2024-09-12T00:01:44.271 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T00:01:44.981 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:01:45.075 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901837 branch: wip-cls-rgw-busy-resharding description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7901837' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 compression type: random ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 main: RGW11111111111111111 s3 tenant: RGW33333333333333333 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-67986 sha1: 6a169fc940965ab446a63954fde870aa497efde7 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2206 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-67986 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 6a169fc940965ab446a63954fde870aa497efde7 targets: smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJBcTOjTxJwH5UTs63hI3jsOX4on18bK8FAszb713csT1fVkTZGwBUvgDygYPssEnHfyf2acUrsO2uDauaIpza8= smithi178.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMqXB/zp75Cp0qIFH/SN8qanvfvWwr7K3bDji1+hWRrTGkH8dxW1MPEodA29vUE0ZJSXZYj4L4QJ73AQsUEDlNo= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: force-branch: wip-67986 rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_23:33:24 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T00:01:45.075 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa; will attempt to use it 2024-09-12T00:01:45.076 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa/tasks 2024-09-12T00:01:45.076 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T00:01:45.077 INFO:teuthology.task.internal:Checking packages... 2024-09-12T00:01:45.099 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-12T00:01:45.099 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T00:01:45.099 INFO:teuthology.packaging:ref: None 2024-09-12T00:01:45.099 INFO:teuthology.packaging:tag: None 2024-09-12T00:01:45.099 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-12T00:01:45.099 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:01:45.099 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-12T00:01:45.249 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:01:45.250 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T00:01:45.258 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T00:01:45.258 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T00:01:45.267 INFO:teuthology.task.internal:Saving configuration 2024-09-12T00:01:45.285 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T00:01:45.294 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T00:01:45.328 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901837', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:55:44.347891', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOrZBmvQfgwlcDXXGP6xNQutIqMr8LkOrPr7TVxuFx4F'} 2024-09-12T00:01:45.361 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi178.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901837', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:55:44.349865', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILx+62npjuddQPw6HrPlcbiBeSKb7upWhBq3XCHkwvmR'} 2024-09-12T00:01:45.361 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T00:01:45.366 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:01:45.366 INFO:teuthology.task.internal:roles: ubuntu@smithi178.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:01:45.366 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T00:01:45.442 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbf3060b490>, signals=[15]) 2024-09-12T00:01:45.442 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T00:01:45.447 INFO:teuthology.task.internal:Opening connections... 2024-09-12T00:01:45.447 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2024-09-12T00:01:45.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:01:45.542 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi178.front.sepia.ceph.com 2024-09-12T00:01:45.543 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:01:45.639 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T00:01:45.644 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-09-12T00:01:45.649 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-09-12T00:01:45.649 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-09-12T00:01:45.693 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T00:01:45.694 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu" 2024-09-12T00:01:45.694 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="22.04" 2024-09-12T00:01:45.694 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T00:01:45.694 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=jammy 2024-09-12T00:01:45.694 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu 2024-09-12T00:01:45.694 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian 2024-09-12T00:01:45.694 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T00:01:45.694 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T00:01:45.694 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T00:01:45.694 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T00:01:45.694 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=jammy 2024-09-12T00:01:45.695 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-09-12T00:01:45.722 DEBUG:teuthology.orchestra.run.smithi178:> uname -m 2024-09-12T00:01:45.727 INFO:teuthology.orchestra.run.smithi178.stdout:x86_64 2024-09-12T00:01:45.728 DEBUG:teuthology.orchestra.run.smithi178:> cat /etc/os-release 2024-09-12T00:01:45.775 INFO:teuthology.orchestra.run.smithi178.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T00:01:45.775 INFO:teuthology.orchestra.run.smithi178.stdout:NAME="Ubuntu" 2024-09-12T00:01:45.775 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_ID="22.04" 2024-09-12T00:01:45.775 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T00:01:45.775 INFO:teuthology.orchestra.run.smithi178.stdout:VERSION_CODENAME=jammy 2024-09-12T00:01:45.775 INFO:teuthology.orchestra.run.smithi178.stdout:ID=ubuntu 2024-09-12T00:01:45.775 INFO:teuthology.orchestra.run.smithi178.stdout:ID_LIKE=debian 2024-09-12T00:01:45.775 INFO:teuthology.orchestra.run.smithi178.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T00:01:45.776 INFO:teuthology.orchestra.run.smithi178.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T00:01:45.776 INFO:teuthology.orchestra.run.smithi178.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T00:01:45.776 INFO:teuthology.orchestra.run.smithi178.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T00:01:45.776 INFO:teuthology.orchestra.run.smithi178.stdout:UBUNTU_CODENAME=jammy 2024-09-12T00:01:45.776 INFO:teuthology.lock.ops:Updating smithi178.front.sepia.ceph.com on lock server 2024-09-12T00:01:45.805 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T00:01:45.818 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T00:01:45.824 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T00:01:45.824 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:01:45.827 DEBUG:teuthology.orchestra.run.smithi178:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:01:45.832 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T00:01:45.837 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T00:01:45.838 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:01:45.876 DEBUG:teuthology.orchestra.run.smithi178:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:01:45.891 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T00:01:45.968 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T00:01:45.981 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T00:01:45.981 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T00:01:45.981 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:01:45.982 DEBUG:teuthology.orchestra.run.smithi178:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:01:45.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:01:45.986 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-09-12T00:01:45.987 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:01:45.987 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2024-09-12T00:01:46.034 INFO:teuthology.orchestra.run.smithi138.stdout:5.15.0-56-generic 2024-09-12T00:01:46.034 INFO:teuthology.task.kernel:Running kernel on smithi138: 5.15.0-56-generic 2024-09-12T00:01:46.035 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean 2024-09-12T00:01:46.036 INFO:teuthology.orchestra.run.smithi178.stdout:5.15.0-56-generic 2024-09-12T00:01:46.036 INFO:teuthology.task.kernel:Running kernel on smithi178: 5.15.0-56-generic 2024-09-12T00:01:46.036 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-get clean 2024-09-12T00:01:46.162 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-get update 2024-09-12T00:01:46.172 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-09-12T00:01:46.298 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:01:46.300 INFO:teuthology.orchestra.run.smithi178.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T00:01:46.303 INFO:teuthology.orchestra.run.smithi178.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T00:01:46.393 INFO:teuthology.orchestra.run.smithi178.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T00:01:46.460 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:01:46.461 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T00:01:46.520 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T00:01:46.540 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T00:01:46.622 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T00:01:46.640 INFO:teuthology.orchestra.run.smithi178.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T00:01:46.646 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T00:01:46.650 INFO:teuthology.orchestra.run.smithi178.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T00:01:46.651 INFO:teuthology.orchestra.run.smithi178.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T00:01:46.673 INFO:teuthology.orchestra.run.smithi178.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T00:01:46.692 INFO:teuthology.orchestra.run.smithi178.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T00:01:46.694 INFO:teuthology.orchestra.run.smithi178.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T00:01:46.697 INFO:teuthology.orchestra.run.smithi178.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T00:01:46.697 INFO:teuthology.orchestra.run.smithi178.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T00:01:46.701 INFO:teuthology.orchestra.run.smithi178.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T00:01:46.707 INFO:teuthology.orchestra.run.smithi178.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T00:01:46.708 INFO:teuthology.orchestra.run.smithi178.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T00:01:46.708 INFO:teuthology.orchestra.run.smithi178.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T00:01:46.709 INFO:teuthology.orchestra.run.smithi178.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T00:01:46.715 INFO:teuthology.orchestra.run.smithi178.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T00:01:46.718 INFO:teuthology.orchestra.run.smithi178.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T00:01:46.728 INFO:teuthology.orchestra.run.smithi178.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T00:01:46.732 INFO:teuthology.orchestra.run.smithi178.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T00:01:46.733 INFO:teuthology.orchestra.run.smithi178.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T00:01:46.753 INFO:teuthology.orchestra.run.smithi178.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T00:01:46.753 INFO:teuthology.orchestra.run.smithi178.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T00:01:46.757 INFO:teuthology.orchestra.run.smithi178.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T00:01:46.757 INFO:teuthology.orchestra.run.smithi178.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T00:01:46.763 INFO:teuthology.orchestra.run.smithi178.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T00:01:46.773 INFO:teuthology.orchestra.run.smithi178.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T00:01:46.775 INFO:teuthology.orchestra.run.smithi178.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T00:01:46.775 INFO:teuthology.orchestra.run.smithi178.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T00:01:46.775 INFO:teuthology.orchestra.run.smithi178.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T00:01:46.784 INFO:teuthology.orchestra.run.smithi178.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T00:01:46.784 INFO:teuthology.orchestra.run.smithi178.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T00:01:46.784 INFO:teuthology.orchestra.run.smithi178.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T00:01:46.784 INFO:teuthology.orchestra.run.smithi178.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T00:01:46.785 INFO:teuthology.orchestra.run.smithi178.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T00:01:46.806 INFO:teuthology.orchestra.run.smithi178.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T00:01:46.806 INFO:teuthology.orchestra.run.smithi178.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T00:01:46.807 INFO:teuthology.orchestra.run.smithi178.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T00:01:46.807 INFO:teuthology.orchestra.run.smithi178.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T00:01:46.807 INFO:teuthology.orchestra.run.smithi178.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T00:01:46.876 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T00:01:46.893 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T00:01:47.015 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T00:01:47.195 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T00:01:47.208 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T00:01:47.367 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T00:01:47.367 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T00:01:47.379 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T00:01:47.380 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T00:01:47.380 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T00:01:47.381 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T00:01:47.448 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T00:01:47.450 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T00:01:47.474 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T00:01:47.474 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T00:01:47.474 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T00:01:47.475 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T00:01:47.482 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T00:01:47.483 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T00:01:47.487 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T00:01:47.494 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T00:01:47.519 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T00:01:47.522 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T00:01:47.524 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T00:01:47.529 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T00:01:47.530 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T00:01:47.530 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T00:01:47.531 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T00:01:47.532 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T00:01:47.533 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T00:01:47.606 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T00:01:47.607 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T00:01:47.608 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T00:01:47.609 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T00:01:47.610 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T00:01:47.611 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T00:01:47.612 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T00:01:47.612 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T00:01:47.613 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T00:01:47.694 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T00:01:47.695 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T00:01:52.983 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 15.8 MB in 2s (7,434 kB/s) 2024-09-12T00:01:53.639 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 15.8 MB in 3s (5,834 kB/s) 2024-09-12T00:01:54.391 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-09-12T00:01:54.408 DEBUG:teuthology.orchestra.run.smithi178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:01:54.469 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-09-12T00:01:54.677 INFO:teuthology.orchestra.run.smithi178.stdout:Building dependency tree... 2024-09-12T00:01:54.677 INFO:teuthology.orchestra.run.smithi178.stdout:Reading state information... 2024-09-12T00:01:54.851 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:01:54.851 INFO:teuthology.orchestra.run.smithi178.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:01:54.851 INFO:teuthology.orchestra.run.smithi178.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:01:54.852 INFO:teuthology.orchestra.run.smithi178.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:01:54.852 INFO:teuthology.orchestra.run.smithi178.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T00:01:54.852 INFO:teuthology.orchestra.run.smithi178.stdout: python2.7-minimal 2024-09-12T00:01:54.852 INFO:teuthology.orchestra.run.smithi178.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:01:54.853 INFO:teuthology.orchestra.run.smithi178.stdout:The following additional packages will be installed: 2024-09-12T00:01:54.853 INFO:teuthology.orchestra.run.smithi178.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:01:54.853 INFO:teuthology.orchestra.run.smithi178.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T00:01:54.853 INFO:teuthology.orchestra.run.smithi178.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T00:01:54.855 INFO:teuthology.orchestra.run.smithi178.stdout:Suggested packages: 2024-09-12T00:01:54.855 INFO:teuthology.orchestra.run.smithi178.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T00:01:54.855 INFO:teuthology.orchestra.run.smithi178.stdout:Recommended packages: 2024-09-12T00:01:54.855 INFO:teuthology.orchestra.run.smithi178.stdout: thermald 2024-09-12T00:01:54.903 INFO:teuthology.orchestra.run.smithi178.stdout:The following NEW packages will be installed: 2024-09-12T00:01:54.903 INFO:teuthology.orchestra.run.smithi178.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:01:54.903 INFO:teuthology.orchestra.run.smithi178.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T00:01:54.903 INFO:teuthology.orchestra.run.smithi178.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T00:01:54.904 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages will be upgraded: 2024-09-12T00:01:54.905 INFO:teuthology.orchestra.run.smithi178.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T00:01:55.083 INFO:teuthology.orchestra.run.smithi178.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:01:55.083 INFO:teuthology.orchestra.run.smithi178.stdout:Need to get 113 MB of archives. 2024-09-12T00:01:55.084 INFO:teuthology.orchestra.run.smithi178.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T00:01:55.084 INFO:teuthology.orchestra.run.smithi178.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T00:01:55.127 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-12T00:01:55.145 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:01:55.208 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-12T00:01:55.418 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-09-12T00:01:55.419 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-09-12T00:01:55.605 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:01:55.605 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:01:55.605 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:01:55.606 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:01:55.606 INFO:teuthology.orchestra.run.smithi138.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T00:01:55.606 INFO:teuthology.orchestra.run.smithi138.stdout: python2.7-minimal 2024-09-12T00:01:55.606 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:01:55.607 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-09-12T00:01:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:01:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T00:01:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T00:01:55.609 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-09-12T00:01:55.609 INFO:teuthology.orchestra.run.smithi138.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T00:01:55.609 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2024-09-12T00:01:55.609 INFO:teuthology.orchestra.run.smithi138.stdout: thermald 2024-09-12T00:01:55.656 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-09-12T00:01:55.656 INFO:teuthology.orchestra.run.smithi138.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:01:55.656 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T00:01:55.657 INFO:teuthology.orchestra.run.smithi138.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T00:01:55.658 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages will be upgraded: 2024-09-12T00:01:55.658 INFO:teuthology.orchestra.run.smithi138.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T00:01:55.709 INFO:teuthology.orchestra.run.smithi138.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:01:55.709 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 113 MB of archives. 2024-09-12T00:01:55.709 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T00:01:55.709 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T00:01:56.128 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T00:01:56.219 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T00:01:56.473 INFO:teuthology.orchestra.run.smithi178.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T00:01:56.877 INFO:teuthology.orchestra.run.smithi178.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T00:01:57.041 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T00:01:57.041 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T00:01:57.041 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T00:01:57.169 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T00:01:57.189 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T00:01:57.583 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 113 MB in 2s (74.4 MB/s) 2024-09-12T00:01:57.769 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T00:01:59.059 INFO:teuthology.orchestra.run.smithi178.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T00:01:59.060 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T00:01:59.060 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T00:01:59.414 INFO:teuthology.orchestra.run.smithi178.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T00:01:59.497 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T00:01:59.847 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T00:01:59.851 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:01:59.887 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 113 MB in 5s (24.7 MB/s) 2024-09-12T00:01:59.941 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:00.072 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T00:02:02.067 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T00:02:02.088 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:02:02.111 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T00:02:02.115 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:02:02.173 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:02.176 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:03.182 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T00:02:03.203 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:02:03.262 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:04.527 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T00:02:04.548 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:02:04.630 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:05.106 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T00:02:05.126 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:02:05.164 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:09.828 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:02:09.980 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:02:10.279 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:02:10.392 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:02:10.703 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T00:02:10.726 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T00:02:10.762 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:02:11.487 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:02:11.614 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:02:11.963 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:02:12.084 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:02:12.379 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T00:02:12.402 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T00:02:12.437 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:02:16.460 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T00:02:16.497 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:02:16.535 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:18.339 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T00:02:18.377 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:02:18.414 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:19.756 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:02:19.882 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:02:20.248 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:02:20.370 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:20.488 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T00:02:20.592 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:21.103 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:02:21.228 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:02:21.561 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:02:21.692 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:21.865 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T00:02:22.053 INFO:teuthology.orchestra.run.smithi138.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:02:22.053 INFO:teuthology.orchestra.run.smithi138.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T00:02:22.053 INFO:teuthology.orchestra.run.smithi138.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:02:22.053 INFO:teuthology.orchestra.run.smithi138.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T00:02:22.798 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:22.803 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:24.123 INFO:teuthology.orchestra.run.smithi178.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:02:24.123 INFO:teuthology.orchestra.run.smithi178.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T00:02:24.123 INFO:teuthology.orchestra.run.smithi178.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:02:24.123 INFO:teuthology.orchestra.run.smithi178.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T00:02:24.263 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:24.300 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:25.639 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T00:02:25.748 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T00:02:25.891 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:25.966 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T00:02:25.966 INFO:teuthology.orchestra.run.smithi138.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:02:26.168 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:27.595 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T00:02:27.721 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T00:02:27.847 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:02:27.904 INFO:teuthology.orchestra.run.smithi178.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T00:02:27.904 INFO:teuthology.orchestra.run.smithi178.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:02:40.074 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T00:02:40.074 INFO:teuthology.orchestra.run.smithi138.stdout:Sourcing file `/etc/default/grub' 2024-09-12T00:02:40.094 INFO:teuthology.orchestra.run.smithi138.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:02:40.113 INFO:teuthology.orchestra.run.smithi138.stdout:Generating grub configuration file ... 2024-09-12T00:02:40.471 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:02:40.499 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:02:40.884 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:02:40.890 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:02:40.957 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:02:40.963 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:02:41.133 INFO:teuthology.orchestra.run.smithi138.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:02:41.134 INFO:teuthology.orchestra.run.smithi138.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:02:41.134 INFO:teuthology.orchestra.run.smithi138.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:02:41.173 INFO:teuthology.orchestra.run.smithi138.stdout:done 2024-09-12T00:02:41.617 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic 2024-09-12T00:02:41.636 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic 2024-09-12T00:02:41.636 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed 2024-09-12T00:02:41.636 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional 2024-09-12T00:02:41.636 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel 2024-09-12T00:02:41.636 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 21 2024-09-12T00:02:41.636 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:02:41.636 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64 2024-09-12T00:02:41.637 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta 2024-09-12T00:02:41.637 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 5.15.0.119.119 2024-09-12T00:02:41.637 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:02:41.637 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:02:41.637 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald 2024-09-12T00:02:41.637 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image 2024-09-12T00:02:41.637 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:02:41.637 INFO:teuthology.orchestra.run.smithi138.stdout: available. 2024-09-12T00:02:41.637 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T00:02:41.638 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:02:41.638 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:02:41.638 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T00:02:41.638 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi138.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:02:41.638 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean 2024-09-12T00:02:41.817 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-09-12T00:02:41.939 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:02:42.059 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:02:42.157 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:02:42.221 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:02:42.589 INFO:teuthology.orchestra.run.smithi178.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T00:02:42.589 INFO:teuthology.orchestra.run.smithi178.stdout:Sourcing file `/etc/default/grub' 2024-09-12T00:02:42.599 INFO:teuthology.orchestra.run.smithi178.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:02:42.628 INFO:teuthology.orchestra.run.smithi178.stdout:Generating grub configuration file ... 2024-09-12T00:02:42.901 INFO:teuthology.orchestra.run.smithi178.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:02:42.920 INFO:teuthology.orchestra.run.smithi178.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:02:43.218 INFO:teuthology.orchestra.run.smithi178.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:02:43.224 INFO:teuthology.orchestra.run.smithi178.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:02:43.299 INFO:teuthology.orchestra.run.smithi178.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:02:43.304 INFO:teuthology.orchestra.run.smithi178.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:02:43.348 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-12T00:02:43.366 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:02:43.430 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-12T00:02:43.463 INFO:teuthology.orchestra.run.smithi178.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:02:43.464 INFO:teuthology.orchestra.run.smithi178.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:02:43.464 INFO:teuthology.orchestra.run.smithi178.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:02:43.500 INFO:teuthology.orchestra.run.smithi178.stdout:done 2024-09-12T00:02:43.638 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-09-12T00:02:43.639 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-09-12T00:02:43.818 INFO:teuthology.orchestra.run.smithi138.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T00:02:43.818 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:02:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:02:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:02:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:02:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:02:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:02:43.819 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:02:43.859 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:02:43.862 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic 2024-09-12T00:02:43.874 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic 2024-09-12T00:02:43.874 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed 2024-09-12T00:02:43.874 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional 2024-09-12T00:02:43.874 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel 2024-09-12T00:02:43.875 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 21 2024-09-12T00:02:43.875 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:02:43.875 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64 2024-09-12T00:02:43.875 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta 2024-09-12T00:02:43.875 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 5.15.0.119.119 2024-09-12T00:02:43.875 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:02:43.875 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:02:43.876 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald 2024-09-12T00:02:43.876 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image 2024-09-12T00:02:43.876 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:02:43.876 INFO:teuthology.orchestra.run.smithi138.stdout: available. 2024-09-12T00:02:43.876 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-09-12T00:02:43.921 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.ecUVqndstk 2024-09-12T00:02:43.922 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ecUVqndstk 2024-09-12T00:02:43.970 DEBUG:teuthology.orchestra.run.smithi178:> dpkg -s linux-image-generic 2024-09-12T00:02:43.978 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.ecUVqndstk 2024-09-12T00:02:43.994 INFO:teuthology.orchestra.run.smithi178.stdout:Package: linux-image-generic 2024-09-12T00:02:43.994 INFO:teuthology.orchestra.run.smithi178.stdout:Status: install ok installed 2024-09-12T00:02:43.994 INFO:teuthology.orchestra.run.smithi178.stdout:Priority: optional 2024-09-12T00:02:43.994 INFO:teuthology.orchestra.run.smithi178.stdout:Section: kernel 2024-09-12T00:02:43.995 INFO:teuthology.orchestra.run.smithi178.stdout:Installed-Size: 21 2024-09-12T00:02:43.995 INFO:teuthology.orchestra.run.smithi178.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:02:43.995 INFO:teuthology.orchestra.run.smithi178.stdout:Architecture: amd64 2024-09-12T00:02:43.995 INFO:teuthology.orchestra.run.smithi178.stdout:Source: linux-meta 2024-09-12T00:02:43.995 INFO:teuthology.orchestra.run.smithi178.stdout:Version: 5.15.0.119.119 2024-09-12T00:02:43.995 INFO:teuthology.orchestra.run.smithi178.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:02:43.995 INFO:teuthology.orchestra.run.smithi178.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:02:43.995 INFO:teuthology.orchestra.run.smithi178.stdout:Recommends: thermald 2024-09-12T00:02:43.995 INFO:teuthology.orchestra.run.smithi178.stdout:Description: Generic Linux kernel image 2024-09-12T00:02:43.995 INFO:teuthology.orchestra.run.smithi178.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:02:43.995 INFO:teuthology.orchestra.run.smithi178.stdout: available. 2024-09-12T00:02:43.995 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T00:02:43.996 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:02:43.996 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:02:43.996 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T00:02:43.996 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi178.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:02:43.996 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-get clean 2024-09-12T00:02:44.090 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.ecUVqndstk is 10KB 2024-09-12T00:02:44.103 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.ecUVqndstk 2024-09-12T00:02:44.109 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T00:02:44.161 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:02:44.161 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T00:02:44.161 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T00:02:44.172 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-get update 2024-09-12T00:02:44.238 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T00:02:44.239 DEBUG:teuthology.orchestra.run.smithi138:> sudo update-grub 2024-09-12T00:02:44.283 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:02:44.406 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:02:44.500 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:02:44.569 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:02:45.619 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub' 2024-09-12T00:02:45.620 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:02:45.622 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2024-09-12T00:02:45.683 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-09-12T00:02:45.701 DEBUG:teuthology.orchestra.run.smithi178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:02:45.762 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-09-12T00:02:45.884 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:02:45.891 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:02:45.968 INFO:teuthology.orchestra.run.smithi178.stdout:Building dependency tree... 2024-09-12T00:02:45.969 INFO:teuthology.orchestra.run.smithi178.stdout:Reading state information... 2024-09-12T00:02:46.150 INFO:teuthology.orchestra.run.smithi178.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T00:02:46.150 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:02:46.150 INFO:teuthology.orchestra.run.smithi178.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:02:46.150 INFO:teuthology.orchestra.run.smithi178.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:02:46.150 INFO:teuthology.orchestra.run.smithi178.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:02:46.150 INFO:teuthology.orchestra.run.smithi178.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:02:46.151 INFO:teuthology.orchestra.run.smithi178.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:02:46.151 INFO:teuthology.orchestra.run.smithi178.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:02:46.189 INFO:teuthology.orchestra.run.smithi178.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:02:46.191 DEBUG:teuthology.orchestra.run.smithi178:> dpkg -s linux-image-generic 2024-09-12T00:02:46.206 INFO:teuthology.orchestra.run.smithi178.stdout:Package: linux-image-generic 2024-09-12T00:02:46.207 INFO:teuthology.orchestra.run.smithi178.stdout:Status: install ok installed 2024-09-12T00:02:46.207 INFO:teuthology.orchestra.run.smithi178.stdout:Priority: optional 2024-09-12T00:02:46.207 INFO:teuthology.orchestra.run.smithi178.stdout:Section: kernel 2024-09-12T00:02:46.207 INFO:teuthology.orchestra.run.smithi178.stdout:Installed-Size: 21 2024-09-12T00:02:46.207 INFO:teuthology.orchestra.run.smithi178.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:02:46.207 INFO:teuthology.orchestra.run.smithi178.stdout:Architecture: amd64 2024-09-12T00:02:46.207 INFO:teuthology.orchestra.run.smithi178.stdout:Source: linux-meta 2024-09-12T00:02:46.207 INFO:teuthology.orchestra.run.smithi178.stdout:Version: 5.15.0.119.119 2024-09-12T00:02:46.207 INFO:teuthology.orchestra.run.smithi178.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:02:46.207 INFO:teuthology.orchestra.run.smithi178.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:02:46.207 INFO:teuthology.orchestra.run.smithi178.stdout:Recommends: thermald 2024-09-12T00:02:46.207 INFO:teuthology.orchestra.run.smithi178.stdout:Description: Generic Linux kernel image 2024-09-12T00:02:46.208 INFO:teuthology.orchestra.run.smithi178.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:02:46.208 INFO:teuthology.orchestra.run.smithi178.stdout: available. 2024-09-12T00:02:46.208 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2024-09-12T00:02:46.249 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:02:46.254 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.kTrfFDJIBi 2024-09-12T00:02:46.254 DEBUG:teuthology.orchestra.run.smithi178:> sudo cp /boot/grub/grub.cfg /tmp/tmp.kTrfFDJIBi 2024-09-12T00:02:46.255 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:02:46.300 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:02:46.306 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:02:46.312 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.kTrfFDJIBi 2024-09-12T00:02:46.428 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.kTrfFDJIBi is 10KB 2024-09-12T00:02:46.440 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.kTrfFDJIBi 2024-09-12T00:02:46.445 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T00:02:46.464 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:02:46.465 INFO:teuthology.orchestra.run.smithi138.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:02:46.465 INFO:teuthology.orchestra.run.smithi138.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:02:46.476 INFO:teuthology.orchestra.run.smithi138.stderr:done 2024-09-12T00:02:46.478 DEBUG:teuthology.orchestra.run.smithi138:> sudo shutdown -r now 2024-09-12T00:02:46.498 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:02:46.498 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T00:02:46.498 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T00:02:46.586 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T00:02:46.586 DEBUG:teuthology.orchestra.run.smithi178:> sudo update-grub 2024-09-12T00:02:47.871 INFO:teuthology.orchestra.run.smithi178.stderr:Sourcing file `/etc/default/grub' 2024-09-12T00:02:47.872 INFO:teuthology.orchestra.run.smithi178.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:02:47.874 INFO:teuthology.orchestra.run.smithi178.stderr:Generating grub configuration file ... 2024-09-12T00:02:48.045 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:02:48.051 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:02:48.282 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:02:48.287 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:02:48.324 INFO:teuthology.orchestra.run.smithi178.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:02:48.329 INFO:teuthology.orchestra.run.smithi178.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:02:48.470 INFO:teuthology.orchestra.run.smithi178.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:02:48.471 INFO:teuthology.orchestra.run.smithi178.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:02:48.471 INFO:teuthology.orchestra.run.smithi178.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:02:48.503 INFO:teuthology.orchestra.run.smithi178.stderr:done 2024-09-12T00:02:48.522 DEBUG:teuthology.orchestra.run.smithi178:> sudo shutdown -r now 2024-09-12T00:03:16.509 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T00:03:16.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-12T00:03:16.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:03:18.527 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T00:03:18.528 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-12T00:03:18.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:03:34.845 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-09-12T00:03:36.893 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-09-12T00:03:43.853 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-12T00:03:43.854 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:03:45.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-12T00:03:45.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:03:46.941 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-09-12T00:03:48.957 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-09-12T00:03:58.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-12T00:03:58.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:04:00.960 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-12T00:04:00.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:04:04.029 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.178 2024-09-12T00:04:19.041 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-12T00:04:19.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:04:30.891 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-09-12T00:04:31.836 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-12T00:04:31.836 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T00:04:31.837 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-09-12T00:04:31.882 INFO:teuthology.orchestra.run.smithi138.stdout:5.15.0-119-generic 2024-09-12T00:04:31.882 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T00:04:31.882 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:04:31.882 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T00:04:32.884 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T00:04:32.884 DEBUG:teuthology.orchestra.run.smithi138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:04:32.953 INFO:teuthology.orchestra.run.smithi138.stdout:ttyS1 2024-09-12T00:04:32.972 DEBUG:teuthology.parallel:result is None 2024-09-12T00:04:50.823 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-09-12T00:04:51.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-12T00:04:51.452 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-12T00:04:51.452 DEBUG:teuthology.orchestra.run.smithi178:> uname -r 2024-09-12T00:04:51.501 INFO:teuthology.orchestra.run.smithi178.stdout:5.15.0-119-generic 2024-09-12T00:04:51.502 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T00:04:51.502 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:04:51.502 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T00:04:52.503 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T00:04:52.503 DEBUG:teuthology.orchestra.run.smithi178:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:04:52.831 INFO:teuthology.orchestra.run.smithi178.stdout:ttyS1 2024-09-12T00:04:52.862 DEBUG:teuthology.parallel:result is None 2024-09-12T00:04:52.863 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T00:04:52.936 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T00:04:52.936 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:04:52.939 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:04:52.944 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T00:04:52.950 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T00:04:52.954 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T00:04:52.954 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:04:52.987 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:04:53.095 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T00:04:53.101 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T00:04:53.101 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:04:53.104 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:04:53.123 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:04:53.124 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:04:53.131 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:04:53.132 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:04:53.134 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T00:04:53.154 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T00:04:53.154 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:04:53.179 DEBUG:teuthology.orchestra.run.smithi178:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:04:53.193 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T00:04:53.260 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T00:04:53.260 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:04:53.263 DEBUG:teuthology.orchestra.run.smithi178:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:04:53.268 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:04:53.315 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:04:53.362 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:04:53.363 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:04:53.429 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:04:53.436 DEBUG:teuthology.orchestra.run.smithi178:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:04:53.483 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:04:53.485 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:04:53.563 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2024-09-12T00:04:53.565 DEBUG:teuthology.orchestra.run.smithi178:> sudo service rsyslog restart 2024-09-12T00:04:53.636 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T00:04:53.657 INFO:teuthology.task.internal:Starting timer... 2024-09-12T00:04:53.657 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T00:04:53.676 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T00:04:53.689 DEBUG:teuthology.task.selinux:Excluding smithi138: OS 'ubuntu' does not support SELinux 2024-09-12T00:04:53.689 DEBUG:teuthology.task.selinux:Excluding smithi178: OS 'ubuntu' does not support SELinux 2024-09-12T00:04:53.690 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T00:04:53.690 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T00:04:53.690 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T00:04:53.690 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T00:04:53.703 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T00:04:53.722 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T00:04:53.724 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi138.front.sepia.ceph.com,smithi178.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T00:12:23.125 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi138.front.sepia.ceph.com'), Remote(name='ubuntu@smithi178.front.sepia.ceph.com')] 2024-09-12T00:12:23.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-12T00:12:23.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:12:23.246 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-09-12T00:12:23.325 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-09-12T00:12:23.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-12T00:12:23.326 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi178.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:12:23.412 DEBUG:teuthology.orchestra.run.smithi178:> true 2024-09-12T00:12:23.492 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi178.front.sepia.ceph.com' 2024-09-12T00:12:23.493 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T00:12:23.504 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T00:12:23.505 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:12:23.505 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:12:23.508 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:12:23.508 DEBUG:teuthology.orchestra.run.smithi178:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:12:23.535 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:12:23.535 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: Command line: ntpd -gq 2024-09-12T00:12:23.535 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: ---------------------------------------------------- 2024-09-12T00:12:23.535 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:12:23.535 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:12:23.535 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: corporation. Support and training for ntp-4 are 2024-09-12T00:12:23.535 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: available at https://www.nwtime.org/support 2024-09-12T00:12:23.536 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: ---------------------------------------------------- 2024-09-12T00:12:23.536 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: proto: precision = 0.044 usec (-24) 2024-09-12T00:12:23.536 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: basedate set to 2022-02-04 2024-09-12T00:12:23.536 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:12:23.537 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:12:23.537 INFO:teuthology.orchestra.run.smithi138.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:12:23.537 INFO:teuthology.orchestra.run.smithi138.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:12:23.538 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:12:23.538 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:12:23.538 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:12:23.538 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:12:23.538 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: Listen normally on 3 enp3s0f1 172.21.15.138:123 2024-09-12T00:12:23.538 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: Listen normally on 4 lo [::1]:123 2024-09-12T00:12:23.538 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f71%5]:123 2024-09-12T00:12:23.538 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:23 ntpd[18503]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:12:23.569 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:12:23.569 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: Command line: ntpd -gq 2024-09-12T00:12:23.569 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: ---------------------------------------------------- 2024-09-12T00:12:23.569 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:12:23.569 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:12:23.570 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: corporation. Support and training for ntp-4 are 2024-09-12T00:12:23.570 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: available at https://www.nwtime.org/support 2024-09-12T00:12:23.570 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: ---------------------------------------------------- 2024-09-12T00:12:23.570 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: proto: precision = 0.062 usec (-24) 2024-09-12T00:12:23.570 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: basedate set to 2022-02-04 2024-09-12T00:12:23.570 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:12:23.571 INFO:teuthology.orchestra.run.smithi178.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:12:23.571 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:12:23.571 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:12:23.571 INFO:teuthology.orchestra.run.smithi178.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:12:23.572 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:12:23.572 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:12:23.573 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:12:23.573 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: Listen normally on 3 enp3s0f1 172.21.15.178:123 2024-09-12T00:12:23.573 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: Listen normally on 4 lo [::1]:123 2024-09-12T00:12:23.573 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7ef9%5]:123 2024-09-12T00:12:23.573 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:23 ntpd[18470]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:12:24.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:24 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:24.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:24 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:24.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:24 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:24.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:24 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:24.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:24 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:24.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:24 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:24.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:24 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:24.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:24 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:25.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:25 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:25.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:25 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:25.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:25 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:25.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:25 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:25.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:25 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:25.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:25 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:25.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:25 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:25.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:25 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:25.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:25 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:25.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:25 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:25.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:25 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:25.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:25 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:25.569 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:25 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:25.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:25 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:25.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:25 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:25.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:25 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:25.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:25 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:25.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:25 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:26.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:26 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:26.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:26 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:26.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:26 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:26.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:26 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:26.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:26 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:26.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:26 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:26.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:26 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:26.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:26 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:26.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:26 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:26.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:26 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:26.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:26 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:26.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:26 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:26.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:26 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:26.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:26 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:26.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:26 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:26.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:26 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:26.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:26 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:26.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:26 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:27.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:27 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:27.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:27 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:27.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:27 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:27.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:27 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:27.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:27 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:27.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:27 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:27.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:27 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:27.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:27 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:27.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:27 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:27.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:27 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:27.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:27 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:27.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:27 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:27.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:27 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:27.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:27 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:27.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:27 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:27.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:27 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:27.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:27 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:27.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:27 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:28.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:28 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:28.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:28 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:28.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:28 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:28.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:28 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:28.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:28 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:28.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:28 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:28.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:28 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:28.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:28 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:28.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:28 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:28.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:28 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:28.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:28 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:28.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:28 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:28.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:28 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:28.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:28 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:28.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:28 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:28.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:28 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:28.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:28 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:28.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:28 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:28.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:28 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:28.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:28 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:29.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:29 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:29.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:29 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:29.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:29 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:29.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:29 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:29.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:29 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:29.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:29 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:29.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:29 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:29.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:29 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:29.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:29 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:29.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:29 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:29.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:29 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:29.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:29 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:29.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:29 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:29.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:29 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:29.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:29 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:29.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:29 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:29.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:29 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:29.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:29 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:30.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:30 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:30.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:30 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:30.536 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:30 ntpd[18503]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:30.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:30 ntpd[18503]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:30.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:30 ntpd[18503]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:30.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:30 ntpd[18503]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:30.537 INFO:teuthology.orchestra.run.smithi138.stdout:12 Sep 00:12:30 ntpd[18503]: ntpd: time slew +0.001283 s 2024-09-12T00:12:30.537 INFO:teuthology.orchestra.run.smithi138.stdout:ntpd: time slew +0.001283s 2024-09-12T00:12:30.537 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:30 ntpd[18503]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:12:30.538 INFO:teuthology.orchestra.run.smithi138.stderr:12 Sep 00:12:30 ntpd[18503]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:12:30.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:30 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:30.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:30 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:30.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:30 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:30.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:30 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:30.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:30 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:30.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:30 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:30.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:30 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:30.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:30 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:30.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:30 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:30.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:30 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:30.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:30 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:30.577 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:30 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:30.608 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:12:30.608 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2024-09-12T00:12:30.608 INFO:teuthology.orchestra.run.smithi138.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:12:30.608 INFO:teuthology.orchestra.run.smithi138.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:12:30.608 INFO:teuthology.orchestra.run.smithi138.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:12:30.608 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:12:31.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:31 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:31.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:31 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:31.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:31 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:31.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:31 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:31.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:31 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:31.570 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:31 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:31.570 INFO:teuthology.orchestra.run.smithi178.stdout:12 Sep 00:12:31 ntpd[18470]: ntpd: time slew -0.001151 s 2024-09-12T00:12:31.570 INFO:teuthology.orchestra.run.smithi178.stdout:ntpd: time slew -0.001151s 2024-09-12T00:12:31.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:31 ntpd[18470]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:12:31.571 INFO:teuthology.orchestra.run.smithi178.stderr:12 Sep 00:12:31 ntpd[18470]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:12:31.617 INFO:teuthology.orchestra.run.smithi178.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:12:31.617 INFO:teuthology.orchestra.run.smithi178.stdout:============================================================================== 2024-09-12T00:12:31.617 INFO:teuthology.orchestra.run.smithi178.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:12:31.617 INFO:teuthology.orchestra.run.smithi178.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:12:31.617 INFO:teuthology.orchestra.run.smithi178.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:12:31.617 INFO:teuthology.orchestra.run.smithi178.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:12:31.618 INFO:teuthology.run_tasks:Running task install... 2024-09-12T00:12:31.682 DEBUG:teuthology.task.install:project ceph 2024-09-12T00:12:31.683 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-12T00:12:31.683 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-12T00:12:31.683 INFO:teuthology.task.install:Using flavor: default 2024-09-12T00:12:31.692 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T00:12:31.692 INFO:teuthology.task.install:extra packages: [] 2024-09-12T00:12:31.693 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-key list | grep Ceph 2024-09-12T00:12:31.693 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-key list | grep Ceph 2024-09-12T00:12:31.754 INFO:teuthology.orchestra.run.smithi178.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:12:31.761 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:12:31.783 INFO:teuthology.orchestra.run.smithi178.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:12:31.783 INFO:teuthology.orchestra.run.smithi178.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:12:31.784 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:12:31.784 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T00:12:31.785 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:12:31.798 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:12:31.799 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:12:31.799 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:12:31.799 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T00:12:31.799 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:12:31.948 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:12:31.948 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:12:31.959 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:12:31.959 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:12:32.064 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:12:32.064 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:12:32.074 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:12:32.074 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:12:32.078 DEBUG:teuthology.orchestra.run.smithi178:> sudo apt-get update 2024-09-12T00:12:32.088 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-09-12T00:12:32.251 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:12:32.257 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:12:32.257 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:12:32.268 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:12:32.285 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:12:32.303 INFO:teuthology.orchestra.run.smithi178.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:12:32.311 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:12:32.323 INFO:teuthology.orchestra.run.smithi178.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:12:32.332 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:12:32.345 INFO:teuthology.orchestra.run.smithi178.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:12:32.354 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:12:32.366 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:12:32.373 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:12:32.374 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:12:32.395 INFO:teuthology.orchestra.run.smithi178.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:12:32.401 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:12:32.455 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:12:32.533 INFO:teuthology.orchestra.run.smithi178.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:12:32.615 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 29.2 kB in 0s (86.0 kB/s) 2024-09-12T00:12:32.669 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 29.2 kB in 0s (71.4 kB/s) 2024-09-12T00:12:33.635 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-12T00:12:33.652 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:12:33.680 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-09-12T00:12:33.698 DEBUG:teuthology.orchestra.run.smithi178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:12:33.705 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-12T00:12:33.763 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-09-12T00:12:33.889 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-09-12T00:12:33.890 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-09-12T00:12:33.970 INFO:teuthology.orchestra.run.smithi178.stdout:Building dependency tree... 2024-09-12T00:12:33.970 INFO:teuthology.orchestra.run.smithi178.stdout:Reading state information... 2024-09-12T00:12:34.072 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:12:34.072 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:12:34.072 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:12:34.072 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:12:34.073 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:12:34.073 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:12:34.073 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:12:34.073 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-09-12T00:12:34.073 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:12:34.074 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:12:34.074 INFO:teuthology.orchestra.run.smithi138.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:12:34.075 INFO:teuthology.orchestra.run.smithi138.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:12:34.075 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:12:34.075 INFO:teuthology.orchestra.run.smithi138.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:12:34.075 INFO:teuthology.orchestra.run.smithi138.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:12:34.075 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:12:34.075 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:12:34.075 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:12:34.075 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:12:34.075 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:12:34.075 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:12:34.075 INFO:teuthology.orchestra.run.smithi138.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:12:34.075 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:12:34.076 INFO:teuthology.orchestra.run.smithi138.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:12:34.076 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:12:34.076 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:12:34.076 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:12:34.076 INFO:teuthology.orchestra.run.smithi138.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:12:34.076 INFO:teuthology.orchestra.run.smithi138.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:12:34.076 INFO:teuthology.orchestra.run.smithi138.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:12:34.076 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:12:34.076 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet zip 2024-09-12T00:12:34.076 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-09-12T00:12:34.077 INFO:teuthology.orchestra.run.smithi138.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:12:34.077 INFO:teuthology.orchestra.run.smithi138.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:12:34.077 INFO:teuthology.orchestra.run.smithi138.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:12:34.077 INFO:teuthology.orchestra.run.smithi138.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:12:34.077 INFO:teuthology.orchestra.run.smithi138.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:12:34.077 INFO:teuthology.orchestra.run.smithi138.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:12:34.077 INFO:teuthology.orchestra.run.smithi138.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:12:34.077 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2024-09-12T00:12:34.078 INFO:teuthology.orchestra.run.smithi138.stdout: btrfs-tools 2024-09-12T00:12:34.176 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:12:34.176 INFO:teuthology.orchestra.run.smithi178.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:12:34.176 INFO:teuthology.orchestra.run.smithi178.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:12:34.176 INFO:teuthology.orchestra.run.smithi178.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:12:34.177 INFO:teuthology.orchestra.run.smithi178.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:12:34.177 INFO:teuthology.orchestra.run.smithi178.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:12:34.177 INFO:teuthology.orchestra.run.smithi178.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:12:34.178 INFO:teuthology.orchestra.run.smithi178.stdout:The following additional packages will be installed: 2024-09-12T00:12:34.178 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:12:34.178 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:12:34.178 INFO:teuthology.orchestra.run.smithi178.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:12:34.178 INFO:teuthology.orchestra.run.smithi178.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:12:34.179 INFO:teuthology.orchestra.run.smithi178.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:12:34.179 INFO:teuthology.orchestra.run.smithi178.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:12:34.179 INFO:teuthology.orchestra.run.smithi178.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:12:34.179 INFO:teuthology.orchestra.run.smithi178.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:12:34.179 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:12:34.179 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:12:34.179 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:12:34.180 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:12:34.180 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:12:34.180 INFO:teuthology.orchestra.run.smithi178.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:12:34.180 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:12:34.180 INFO:teuthology.orchestra.run.smithi178.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:12:34.180 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:12:34.180 INFO:teuthology.orchestra.run.smithi178.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:12:34.180 INFO:teuthology.orchestra.run.smithi178.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:12:34.180 INFO:teuthology.orchestra.run.smithi178.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:12:34.180 INFO:teuthology.orchestra.run.smithi178.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:12:34.180 INFO:teuthology.orchestra.run.smithi178.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:12:34.180 INFO:teuthology.orchestra.run.smithi178.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:12:34.180 INFO:teuthology.orchestra.run.smithi178.stdout: xmlstarlet zip 2024-09-12T00:12:34.181 INFO:teuthology.orchestra.run.smithi178.stdout:Suggested packages: 2024-09-12T00:12:34.181 INFO:teuthology.orchestra.run.smithi178.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:12:34.181 INFO:teuthology.orchestra.run.smithi178.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:12:34.182 INFO:teuthology.orchestra.run.smithi178.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:12:34.182 INFO:teuthology.orchestra.run.smithi178.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:12:34.182 INFO:teuthology.orchestra.run.smithi178.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:12:34.182 INFO:teuthology.orchestra.run.smithi178.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:12:34.182 INFO:teuthology.orchestra.run.smithi178.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:12:34.182 INFO:teuthology.orchestra.run.smithi178.stdout:Recommended packages: 2024-09-12T00:12:34.182 INFO:teuthology.orchestra.run.smithi178.stdout: btrfs-tools 2024-09-12T00:12:34.183 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-09-12T00:12:34.183 INFO:teuthology.orchestra.run.smithi138.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:12:34.183 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:12:34.184 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:12:34.184 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:12:34.184 INFO:teuthology.orchestra.run.smithi138.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:12:34.184 INFO:teuthology.orchestra.run.smithi138.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:12:34.184 INFO:teuthology.orchestra.run.smithi138.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:12:34.184 INFO:teuthology.orchestra.run.smithi138.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:12:34.184 INFO:teuthology.orchestra.run.smithi138.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:12:34.184 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:12:34.184 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:12:34.184 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:12:34.184 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:12:34.184 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:12:34.185 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:12:34.185 INFO:teuthology.orchestra.run.smithi138.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:12:34.185 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:12:34.185 INFO:teuthology.orchestra.run.smithi138.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:12:34.185 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:12:34.185 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:12:34.185 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:12:34.185 INFO:teuthology.orchestra.run.smithi138.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:12:34.185 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:12:34.185 INFO:teuthology.orchestra.run.smithi138.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:12:34.185 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:12:34.186 INFO:teuthology.orchestra.run.smithi138.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:12:34.239 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:12:34.239 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 251 MB of archives. 2024-09-12T00:12:34.239 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:12:34.239 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:12:34.286 INFO:teuthology.orchestra.run.smithi178.stdout:The following NEW packages will be installed: 2024-09-12T00:12:34.287 INFO:teuthology.orchestra.run.smithi178.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:12:34.287 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:12:34.287 INFO:teuthology.orchestra.run.smithi178.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:12:34.287 INFO:teuthology.orchestra.run.smithi178.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:12:34.287 INFO:teuthology.orchestra.run.smithi178.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:12:34.287 INFO:teuthology.orchestra.run.smithi178.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:12:34.287 INFO:teuthology.orchestra.run.smithi178.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:12:34.288 INFO:teuthology.orchestra.run.smithi178.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:12:34.288 INFO:teuthology.orchestra.run.smithi178.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:12:34.288 INFO:teuthology.orchestra.run.smithi178.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:12:34.288 INFO:teuthology.orchestra.run.smithi178.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:12:34.288 INFO:teuthology.orchestra.run.smithi178.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:12:34.288 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:12:34.288 INFO:teuthology.orchestra.run.smithi178.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:12:34.288 INFO:teuthology.orchestra.run.smithi178.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:12:34.288 INFO:teuthology.orchestra.run.smithi178.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:12:34.288 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:12:34.288 INFO:teuthology.orchestra.run.smithi178.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:12:34.289 INFO:teuthology.orchestra.run.smithi178.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:12:34.289 INFO:teuthology.orchestra.run.smithi178.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:12:34.289 INFO:teuthology.orchestra.run.smithi178.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:12:34.289 INFO:teuthology.orchestra.run.smithi178.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:12:34.289 INFO:teuthology.orchestra.run.smithi178.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:12:34.289 INFO:teuthology.orchestra.run.smithi178.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:12:34.289 INFO:teuthology.orchestra.run.smithi178.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:12:34.289 INFO:teuthology.orchestra.run.smithi178.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:12:34.323 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:12:34.330 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:12:34.333 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:12:34.346 INFO:teuthology.orchestra.run.smithi178.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:12:34.346 INFO:teuthology.orchestra.run.smithi178.stdout:Need to get 251 MB of archives. 2024-09-12T00:12:34.346 INFO:teuthology.orchestra.run.smithi178.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:12:34.346 INFO:teuthology.orchestra.run.smithi178.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:12:34.350 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:12:34.414 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:12:34.421 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:12:34.428 INFO:teuthology.orchestra.run.smithi178.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:12:34.432 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:12:34.436 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:12:34.436 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:12:34.437 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:12:34.439 INFO:teuthology.orchestra.run.smithi178.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:12:34.442 INFO:teuthology.orchestra.run.smithi178.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:12:34.445 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:12:34.447 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:12:34.449 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:12:34.450 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:12:34.457 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:12:34.459 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:12:34.460 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:12:34.462 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:12:34.477 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:12:34.478 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:12:34.478 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:12:34.479 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:12:34.479 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:12:34.480 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:12:34.480 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:12:34.498 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:12:34.499 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:12:34.499 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:12:34.508 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:12:34.518 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:12:34.519 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:12:34.519 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:12:34.519 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:12:34.520 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:12:34.521 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:12:34.521 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:12:34.523 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:12:34.528 INFO:teuthology.orchestra.run.smithi178.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:12:34.537 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:12:34.538 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:12:34.539 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:12:34.540 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:12:34.545 INFO:teuthology.orchestra.run.smithi178.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:12:34.545 INFO:teuthology.orchestra.run.smithi178.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:12:34.549 INFO:teuthology.orchestra.run.smithi178.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:12:34.555 INFO:teuthology.orchestra.run.smithi178.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:12:34.557 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:12:34.557 INFO:teuthology.orchestra.run.smithi178.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:12:34.557 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:12:34.558 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:12:34.558 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:12:34.559 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:12:34.559 INFO:teuthology.orchestra.run.smithi178.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:12:34.560 INFO:teuthology.orchestra.run.smithi138.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:12:34.561 INFO:teuthology.orchestra.run.smithi178.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:12:34.562 INFO:teuthology.orchestra.run.smithi138.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:12:34.563 INFO:teuthology.orchestra.run.smithi178.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:12:34.563 INFO:teuthology.orchestra.run.smithi138.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:12:34.565 INFO:teuthology.orchestra.run.smithi178.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:12:34.570 INFO:teuthology.orchestra.run.smithi138.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:12:34.575 INFO:teuthology.orchestra.run.smithi138.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:12:34.576 INFO:teuthology.orchestra.run.smithi138.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:12:34.576 INFO:teuthology.orchestra.run.smithi138.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:12:34.577 INFO:teuthology.orchestra.run.smithi138.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:12:34.579 INFO:teuthology.orchestra.run.smithi178.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:12:34.580 INFO:teuthology.orchestra.run.smithi138.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:12:34.581 INFO:teuthology.orchestra.run.smithi178.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:12:34.581 INFO:teuthology.orchestra.run.smithi138.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:12:34.582 INFO:teuthology.orchestra.run.smithi178.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:12:34.582 INFO:teuthology.orchestra.run.smithi178.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:12:34.582 INFO:teuthology.orchestra.run.smithi138.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:12:34.583 INFO:teuthology.orchestra.run.smithi178.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:12:34.584 INFO:teuthology.orchestra.run.smithi178.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:12:34.584 INFO:teuthology.orchestra.run.smithi178.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:12:34.584 INFO:teuthology.orchestra.run.smithi178.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:12:34.587 INFO:teuthology.orchestra.run.smithi138.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:12:34.595 INFO:teuthology.orchestra.run.smithi138.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:12:34.597 INFO:teuthology.orchestra.run.smithi138.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:12:34.598 INFO:teuthology.orchestra.run.smithi178.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:12:34.599 INFO:teuthology.orchestra.run.smithi178.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:12:34.599 INFO:teuthology.orchestra.run.smithi138.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:12:34.618 INFO:teuthology.orchestra.run.smithi178.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:12:34.621 INFO:teuthology.orchestra.run.smithi178.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:12:34.621 INFO:teuthology.orchestra.run.smithi178.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:12:34.621 INFO:teuthology.orchestra.run.smithi178.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:12:34.622 INFO:teuthology.orchestra.run.smithi178.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:12:34.623 INFO:teuthology.orchestra.run.smithi178.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:12:34.623 INFO:teuthology.orchestra.run.smithi178.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:12:34.623 INFO:teuthology.orchestra.run.smithi178.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:12:34.636 INFO:teuthology.orchestra.run.smithi178.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:12:34.637 INFO:teuthology.orchestra.run.smithi178.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:12:34.655 INFO:teuthology.orchestra.run.smithi178.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:12:34.655 INFO:teuthology.orchestra.run.smithi138.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:12:34.656 INFO:teuthology.orchestra.run.smithi138.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:12:34.658 INFO:teuthology.orchestra.run.smithi138.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:12:34.658 INFO:teuthology.orchestra.run.smithi138.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:12:34.659 INFO:teuthology.orchestra.run.smithi138.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:12:34.660 INFO:teuthology.orchestra.run.smithi178.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:12:34.661 INFO:teuthology.orchestra.run.smithi178.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:12:34.662 INFO:teuthology.orchestra.run.smithi178.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:12:34.662 INFO:teuthology.orchestra.run.smithi178.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:12:34.664 INFO:teuthology.orchestra.run.smithi178.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:12:34.666 INFO:teuthology.orchestra.run.smithi178.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:12:34.667 INFO:teuthology.orchestra.run.smithi178.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:12:34.671 INFO:teuthology.orchestra.run.smithi178.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:12:34.673 INFO:teuthology.orchestra.run.smithi178.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:12:34.677 INFO:teuthology.orchestra.run.smithi138.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:12:34.679 INFO:teuthology.orchestra.run.smithi138.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:12:34.679 INFO:teuthology.orchestra.run.smithi138.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:12:34.690 INFO:teuthology.orchestra.run.smithi178.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:12:34.690 INFO:teuthology.orchestra.run.smithi178.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:12:34.691 INFO:teuthology.orchestra.run.smithi178.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:12:34.694 INFO:teuthology.orchestra.run.smithi138.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:12:34.694 INFO:teuthology.orchestra.run.smithi138.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:12:34.695 INFO:teuthology.orchestra.run.smithi178.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:12:34.701 INFO:teuthology.orchestra.run.smithi138.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:12:34.701 INFO:teuthology.orchestra.run.smithi138.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:12:34.702 INFO:teuthology.orchestra.run.smithi138.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:12:34.702 INFO:teuthology.orchestra.run.smithi138.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:12:34.703 INFO:teuthology.orchestra.run.smithi138.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:12:34.723 INFO:teuthology.orchestra.run.smithi138.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:12:34.727 INFO:teuthology.orchestra.run.smithi138.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:12:34.728 INFO:teuthology.orchestra.run.smithi138.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:12:34.730 INFO:teuthology.orchestra.run.smithi138.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:12:34.730 INFO:teuthology.orchestra.run.smithi138.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:12:34.730 INFO:teuthology.orchestra.run.smithi138.stdout:Get:80 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:12:34.732 INFO:teuthology.orchestra.run.smithi138.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:12:34.738 INFO:teuthology.orchestra.run.smithi138.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:12:34.745 INFO:teuthology.orchestra.run.smithi138.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:12:34.747 INFO:teuthology.orchestra.run.smithi138.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:12:34.748 INFO:teuthology.orchestra.run.smithi138.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:12:34.749 INFO:teuthology.orchestra.run.smithi138.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:12:34.753 INFO:teuthology.orchestra.run.smithi138.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:12:34.757 INFO:teuthology.orchestra.run.smithi178.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:12:34.758 INFO:teuthology.orchestra.run.smithi178.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:12:34.759 INFO:teuthology.orchestra.run.smithi178.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:12:34.759 INFO:teuthology.orchestra.run.smithi178.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:12:34.760 INFO:teuthology.orchestra.run.smithi178.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:12:34.766 INFO:teuthology.orchestra.run.smithi138.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:12:34.769 INFO:teuthology.orchestra.run.smithi138.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:12:34.769 INFO:teuthology.orchestra.run.smithi138.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:12:34.769 INFO:teuthology.orchestra.run.smithi138.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:12:34.770 INFO:teuthology.orchestra.run.smithi138.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:12:34.778 INFO:teuthology.orchestra.run.smithi178.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:12:34.780 INFO:teuthology.orchestra.run.smithi178.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:12:34.780 INFO:teuthology.orchestra.run.smithi178.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:12:34.786 INFO:teuthology.orchestra.run.smithi138.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:12:34.787 INFO:teuthology.orchestra.run.smithi138.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:12:34.794 INFO:teuthology.orchestra.run.smithi138.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:12:34.794 INFO:teuthology.orchestra.run.smithi138.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:12:34.794 INFO:teuthology.orchestra.run.smithi138.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:12:34.795 INFO:teuthology.orchestra.run.smithi178.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:12:34.795 INFO:teuthology.orchestra.run.smithi178.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:12:34.797 INFO:teuthology.orchestra.run.smithi178.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:12:34.798 INFO:teuthology.orchestra.run.smithi178.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:12:34.798 INFO:teuthology.orchestra.run.smithi178.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:12:34.799 INFO:teuthology.orchestra.run.smithi178.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:12:34.804 INFO:teuthology.orchestra.run.smithi138.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:12:34.805 INFO:teuthology.orchestra.run.smithi138.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:12:34.815 INFO:teuthology.orchestra.run.smithi178.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:12:34.816 INFO:teuthology.orchestra.run.smithi178.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:12:34.819 INFO:teuthology.orchestra.run.smithi178.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:12:34.821 INFO:teuthology.orchestra.run.smithi178.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:12:34.822 INFO:teuthology.orchestra.run.smithi178.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:12:34.823 INFO:teuthology.orchestra.run.smithi178.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:12:34.833 INFO:teuthology.orchestra.run.smithi178.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:12:34.835 INFO:teuthology.orchestra.run.smithi178.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:12:34.836 INFO:teuthology.orchestra.run.smithi178.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:12:34.836 INFO:teuthology.orchestra.run.smithi178.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:12:34.850 INFO:teuthology.orchestra.run.smithi178.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:12:34.850 INFO:teuthology.orchestra.run.smithi178.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:12:34.853 INFO:teuthology.orchestra.run.smithi178.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:12:34.854 INFO:teuthology.orchestra.run.smithi178.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:12:34.854 INFO:teuthology.orchestra.run.smithi178.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:12:34.854 INFO:teuthology.orchestra.run.smithi178.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:12:34.867 INFO:teuthology.orchestra.run.smithi178.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:12:34.868 INFO:teuthology.orchestra.run.smithi178.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:12:34.874 INFO:teuthology.orchestra.run.smithi178.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:12:34.874 INFO:teuthology.orchestra.run.smithi178.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:12:34.884 INFO:teuthology.orchestra.run.smithi178.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:12:34.886 INFO:teuthology.orchestra.run.smithi178.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:12:34.887 INFO:teuthology.orchestra.run.smithi178.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:12:35.338 INFO:teuthology.orchestra.run.smithi178.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:12:35.381 INFO:teuthology.orchestra.run.smithi138.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:12:35.449 INFO:teuthology.orchestra.run.smithi138.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:12:35.452 INFO:teuthology.orchestra.run.smithi138.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:12:35.453 INFO:teuthology.orchestra.run.smithi138.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:12:35.466 INFO:teuthology.orchestra.run.smithi138.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:12:35.578 INFO:teuthology.orchestra.run.smithi138.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:12:35.646 INFO:teuthology.orchestra.run.smithi178.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:12:35.757 INFO:teuthology.orchestra.run.smithi178.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:12:35.813 INFO:teuthology.orchestra.run.smithi178.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:12:35.814 INFO:teuthology.orchestra.run.smithi178.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:12:35.818 INFO:teuthology.orchestra.run.smithi178.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:12:35.819 INFO:teuthology.orchestra.run.smithi178.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:12:35.874 INFO:teuthology.orchestra.run.smithi178.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:12:36.124 INFO:teuthology.orchestra.run.smithi138.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:12:36.125 INFO:teuthology.orchestra.run.smithi138.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:12:36.137 INFO:teuthology.orchestra.run.smithi138.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:12:36.172 INFO:teuthology.orchestra.run.smithi138.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:12:36.181 INFO:teuthology.orchestra.run.smithi138.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:12:36.183 INFO:teuthology.orchestra.run.smithi138.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:12:36.387 INFO:teuthology.orchestra.run.smithi178.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:12:36.399 INFO:teuthology.orchestra.run.smithi178.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:12:36.420 INFO:teuthology.orchestra.run.smithi178.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:12:37.810 INFO:teuthology.orchestra.run.smithi178.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:12:37.888 INFO:teuthology.orchestra.run.smithi178.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:12:37.891 INFO:teuthology.orchestra.run.smithi178.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:12:37.892 INFO:teuthology.orchestra.run.smithi178.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:12:37.905 INFO:teuthology.orchestra.run.smithi178.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:12:37.993 INFO:teuthology.orchestra.run.smithi138.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:12:37.995 INFO:teuthology.orchestra.run.smithi178.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:12:38.255 INFO:teuthology.orchestra.run.smithi138.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:12:38.255 INFO:teuthology.orchestra.run.smithi138.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:12:38.626 INFO:teuthology.orchestra.run.smithi178.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:12:38.627 INFO:teuthology.orchestra.run.smithi178.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:12:38.641 INFO:teuthology.orchestra.run.smithi178.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:12:38.677 INFO:teuthology.orchestra.run.smithi178.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:12:38.686 INFO:teuthology.orchestra.run.smithi178.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:12:38.688 INFO:teuthology.orchestra.run.smithi178.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:12:40.434 INFO:teuthology.orchestra.run.smithi178.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:12:40.599 INFO:teuthology.orchestra.run.smithi178.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:12:40.599 INFO:teuthology.orchestra.run.smithi178.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:12:40.816 INFO:teuthology.orchestra.run.smithi138.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:12:40.819 INFO:teuthology.orchestra.run.smithi138.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:12:40.820 INFO:teuthology.orchestra.run.smithi138.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:12:41.579 INFO:teuthology.orchestra.run.smithi138.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:12:42.070 INFO:teuthology.orchestra.run.smithi178.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:12:42.115 INFO:teuthology.orchestra.run.smithi178.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:12:42.118 INFO:teuthology.orchestra.run.smithi178.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:12:42.154 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 251 MB in 7s (33.9 MB/s) 2024-09-12T00:12:42.343 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:12:42.424 INFO:teuthology.orchestra.run.smithi178.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:12:42.444 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:12:42.450 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:12:42.550 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:12:42.879 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:12:42.905 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:12:42.945 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:12:42.989 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 251 MB in 8s (30.9 MB/s) 2024-09-12T00:12:43.161 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:12:43.206 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:12:43.233 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:12:43.260 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:12:43.265 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:12:43.265 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:12:43.351 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:12:43.671 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:12:43.693 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:12:43.698 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:12:43.720 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:12:43.738 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:12:43.768 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:12:44.058 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:12:44.085 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:12:44.124 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:12:44.146 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:12:44.173 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:12:44.213 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:12:44.549 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:12:44.561 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:12:44.576 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:12:44.588 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:12:44.616 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:12:44.636 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:12:45.011 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:12:45.014 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:12:45.037 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:12:45.040 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:12:45.072 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:12:45.077 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:12:45.397 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librados2. 2024-09-12T00:12:45.400 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:12:45.423 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:45.427 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:12:45.463 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:45.467 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:12:45.804 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:12:45.830 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:12:45.870 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:12:45.908 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:12:45.934 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:45.974 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:46.173 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librados2. 2024-09-12T00:12:46.200 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:46.239 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:46.419 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:12:46.446 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:46.485 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:46.709 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:12:46.735 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:46.775 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:46.946 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:12:46.961 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:46.996 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:47.312 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:12:47.338 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:47.341 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:12:47.367 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:12:47.378 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:47.407 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:47.656 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:12:47.660 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:12:47.682 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:47.686 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:47.722 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:47.726 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:48.025 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:12:48.038 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:12:48.052 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:12:48.064 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:12:48.092 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:48.112 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:48.327 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:12:48.354 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:48.394 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:48.441 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:12:48.467 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:12:48.507 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:12:48.697 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:12:48.723 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:12:48.763 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:48.768 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:12:48.783 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:12:48.818 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:12:49.037 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:12:49.052 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:49.075 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:12:49.096 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:49.101 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:12:49.141 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:12:49.449 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:12:49.461 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:12:49.475 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:12:49.487 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:12:49.515 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:12:49.527 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:12:49.746 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:12:49.761 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:49.792 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:12:49.796 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:49.808 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:12:49.851 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:12:50.100 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:12:50.126 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:12:50.145 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:12:50.160 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:12:50.166 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:12:50.220 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:12:50.435 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:12:50.461 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:12:50.502 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:12:50.517 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:12:50.544 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:12:50.584 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:12:50.821 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:12:50.847 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:12:50.888 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:12:50.896 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:12:50.922 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:12:50.962 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:12:51.175 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:12:51.182 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package zip. 2024-09-12T00:12:51.201 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:12:51.209 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:12:51.233 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:12:51.248 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:12:51.578 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package unzip. 2024-09-12T00:12:51.604 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:12:51.644 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:12:51.786 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:12:51.812 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:12:51.852 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:12:52.032 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:12:52.059 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:12:52.099 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:12:52.105 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package zip. 2024-09-12T00:12:52.120 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:12:52.163 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:12:52.450 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package unzip. 2024-09-12T00:12:52.477 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:12:52.483 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:12:52.510 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:52.516 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:12:52.549 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:52.887 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:12:52.913 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:12:52.953 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:12:53.153 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:12:53.168 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:53.211 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:53.328 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:12:53.357 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:53.394 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:53.489 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:12:53.516 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:12:53.547 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:12:53.851 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:12:53.878 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:53.917 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:54.013 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:12:54.040 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:54.079 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:54.346 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:12:54.373 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:54.391 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:12:54.413 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:54.418 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:12:54.458 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:12:54.785 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:12:54.812 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:54.852 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:55.272 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:12:55.299 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:55.338 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:55.936 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:12:55.963 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:56.011 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:56.532 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:12:56.547 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:12:56.582 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:12:56.763 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:12:56.789 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:56.834 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:56.885 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:12:56.912 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:12:56.952 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:12:57.359 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:12:57.385 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:12:57.426 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:12:57.506 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:12:57.532 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:12:57.572 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:12:57.695 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:12:57.720 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:12:57.778 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:12:57.826 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:12:57.852 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:12:57.884 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:12:58.098 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:12:58.125 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:12:58.165 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:12:58.212 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:12:58.239 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:12:58.279 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:12:58.426 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:12:58.453 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:12:58.485 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:12:58.582 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:12:58.609 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:12:58.649 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:12:58.788 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:12:58.814 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:12:58.854 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:12:58.894 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:12:58.920 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:12:58.986 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:12:59.157 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:12:59.184 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:12:59.224 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:12:59.289 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:12:59.315 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:12:59.355 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:12:59.519 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:12:59.534 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:12:59.569 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:12:59.634 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:12:59.660 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:12:59.709 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:12:59.855 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:12:59.882 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:12:59.922 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:13:00.022 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:13:00.039 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:13:00.080 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:13:00.225 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:13:00.252 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:13:00.291 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:13:00.392 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:13:00.418 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:13:00.450 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:13:00.629 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:13:00.649 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:13:00.687 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:13:00.729 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:13:00.755 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:13:00.787 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:13:00.973 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:13:01.000 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:13:01.040 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:13:01.090 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:13:01.117 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:13:01.157 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:13:01.368 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:13:01.395 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:13:01.435 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:13:01.520 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:13:01.546 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:13:01.586 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:13:01.688 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:13:01.714 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:13:01.754 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:13:01.880 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:13:01.907 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:13:01.947 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:13:02.225 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:13:02.252 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:13:02.283 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:13:02.292 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:13:02.309 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:13:02.349 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:13:02.661 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:13:02.662 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:13:02.688 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:13:02.689 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:13:02.728 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:13:02.732 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:13:02.997 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:13:03.023 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:13:03.041 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:13:03.055 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:13:03.067 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:13:03.107 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:13:03.378 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:13:03.383 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:13:03.405 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:13:03.410 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:13:03.444 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:13:03.445 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:13:03.753 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:13:03.764 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:13:03.780 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:13:03.791 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:13:03.820 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:13:03.831 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:13:04.109 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:13:04.123 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:13:04.136 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:13:04.150 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:13:04.176 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:13:04.189 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:13:04.455 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:13:04.482 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:13:04.521 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:13:04.534 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:13:04.561 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:13:04.609 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:13:04.858 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:13:04.885 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:13:04.924 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:13:04.929 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:13:04.956 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:13:04.996 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:13:05.274 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:13:05.288 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:13:05.301 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:13:05.315 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:13:05.340 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:13:05.355 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:13:05.636 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:13:05.652 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:13:05.675 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:13:05.694 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:13:05.702 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:13:05.741 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:13:06.029 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:13:06.032 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:13:06.056 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:13:06.058 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:13:06.095 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:13:06.098 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:13:06.382 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:13:06.409 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:13:06.419 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:13:06.445 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:13:06.448 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:13:06.493 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:13:06.817 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:13:06.838 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:13:06.880 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:13:07.183 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:13:07.209 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:13:07.341 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:13:07.911 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:13:07.938 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:13:07.977 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:13:08.272 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:13:08.288 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:13:08.331 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:08.462 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:13:08.488 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:13:08.536 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:13:08.662 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:13:08.689 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:08.728 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:08.832 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:13:08.858 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:13:08.898 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:09.041 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:13:09.067 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:13:09.106 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:13:09.286 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:13:09.313 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:09.353 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:09.409 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:13:09.436 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:13:09.476 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:13:09.639 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:13:09.655 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:13:09.697 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:13:09.763 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:13:09.789 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:09.829 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:09.959 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:13:09.985 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:13:10.025 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:13:10.225 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:13:10.251 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:10.291 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:10.328 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:13:10.355 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:10.403 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:10.798 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:13:10.825 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:10.854 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:13:10.865 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:10.881 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:10.912 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:11.461 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:13:11.487 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:11.527 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:11.966 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph. 2024-09-12T00:13:11.981 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:12.024 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:12.361 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:13:12.388 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:12.427 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:12.630 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph. 2024-09-12T00:13:12.653 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:12.697 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:12.756 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:13:12.783 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:12.814 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:13.025 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:13:13.051 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:13.091 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:13.201 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:13:13.228 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:13.268 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:13.445 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:13:13.472 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:13.512 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:13.563 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:13:13.590 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:13:13.629 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:13:13.889 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:13:13.916 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:13.932 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:13:13.948 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:13:13.956 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:13.991 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:13:14.267 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:13:14.294 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:13:14.333 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:13:14.645 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:13:14.661 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:13:14.703 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:13:15.030 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:13:15.057 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:13:15.097 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:13:15.400 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:13:15.427 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:13:15.467 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:13:15.717 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:13:15.744 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:13:15.783 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:13:15.804 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:13:15.831 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:13:15.862 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:16.112 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:13:16.139 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:13:16.178 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:13:16.208 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:13:16.235 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:13:16.291 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:13:16.506 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:13:16.534 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:13:16.561 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:13:16.573 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:16.587 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:13:16.627 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:13:16.877 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:13:16.903 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:13:16.932 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:13:16.951 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:13:16.959 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:13:16.989 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:17.205 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:13:17.231 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:13:17.263 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:13:17.558 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:13:17.585 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:13:17.616 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:20.155 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:13:20.185 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:13:20.230 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:13:20.263 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:13:20.294 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:13:20.338 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:13:20.746 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:13:20.778 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:13:20.801 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:13:20.809 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:13:20.828 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:13:20.867 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:13:21.205 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:13:21.229 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:13:21.232 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:13:21.257 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:13:21.271 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:13:21.295 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:13:21.601 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:13:21.602 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:13:21.626 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:13:21.627 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:13:21.664 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:13:21.666 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:13:22.357 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:13:22.373 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:13:22.409 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:13:22.437 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:13:22.501 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:22.562 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:23.566 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:13:23.594 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:13:23.633 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:13:23.672 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:13:23.700 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:13:23.738 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:13:23.936 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:13:23.964 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:13:24.003 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:13:24.041 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:13:24.069 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:13:24.108 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:13:24.332 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:13:24.359 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:13:24.398 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:13:24.420 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:13:24.448 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:13:24.478 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:13:24.752 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:13:24.765 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:13:24.779 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:13:24.792 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:13:24.818 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:13:24.823 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:13:25.131 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:13:25.143 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:13:25.159 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:13:25.171 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:13:25.198 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:13:25.218 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:13:25.485 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:13:25.512 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:13:25.539 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:13:25.543 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:13:25.566 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:13:25.605 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:13:25.863 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:13:25.891 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:13:25.917 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:13:25.930 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:13:25.944 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:13:25.983 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:13:26.242 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:13:26.262 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:13:26.269 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:13:26.278 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:13:26.308 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:13:26.311 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:13:26.968 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:13:26.996 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:13:27.018 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:13:27.034 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:27.045 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:13:27.083 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:27.362 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:13:27.362 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:13:27.389 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:13:27.390 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:13:27.420 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:13:27.428 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:13:27.837 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:13:27.848 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:13:27.865 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:13:27.876 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:13:27.915 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:13:27.940 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:13:28.177 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package jq. 2024-09-12T00:13:28.204 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:13:28.243 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:13:28.435 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package jq. 2024-09-12T00:13:28.463 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:13:28.502 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:13:28.638 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package socat. 2024-09-12T00:13:28.666 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:13:28.704 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:13:28.730 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package socat. 2024-09-12T00:13:28.746 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:13:28.780 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:13:28.982 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:13:28.998 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:13:29.032 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:13:29.067 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:13:29.095 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:13:29.133 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:13:29.380 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:13:29.394 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:29.437 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:29.480 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:13:29.496 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:29.538 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:31.983 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:13:31.999 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:13:32.033 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:32.177 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:13:32.205 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:13:32.243 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:32.321 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:13:32.348 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:32.387 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:32.548 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:13:32.565 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:32.606 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:32.673 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:13:32.701 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:13:32.740 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:13:32.901 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:13:32.929 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:13:32.968 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:13:33.053 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:13:33.081 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:13:33.120 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:13:33.290 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:13:33.318 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:13:33.356 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:13:33.482 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:13:33.510 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:13:33.549 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:13:33.728 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:13:33.756 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:13:33.794 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:13:33.963 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:13:33.991 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:13:34.029 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:13:34.209 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:13:34.237 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:13:34.275 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:13:34.290 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:13:34.306 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:13:34.349 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:13:34.512 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:13:34.528 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:13:34.571 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:13:34.719 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:13:34.747 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:13:34.788 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:13:35.016 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:13:35.044 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:13:35.082 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:13:35.090 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:13:35.118 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:13:35.157 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:13:35.427 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:13:35.455 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:13:35.477 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:13:35.494 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:13:35.504 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:13:35.543 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:13:35.823 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:13:35.829 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:13:35.851 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:13:35.857 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:13:35.889 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:13:35.898 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:13:36.193 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:13:36.207 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:13:36.221 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:13:36.235 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:13:36.259 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:13:36.273 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:13:36.562 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:13:36.579 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:13:36.602 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:13:36.621 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:13:36.629 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:13:36.668 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:13:36.925 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:13:36.953 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:13:36.991 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:13:37.130 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:13:37.159 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:13:37.197 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:13:37.479 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:13:37.499 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:13:37.507 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:13:37.529 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:13:37.546 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:13:37.566 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:13:37.849 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:13:37.877 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:13:37.894 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:13:37.916 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:13:37.922 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:13:37.960 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:13:38.211 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:13:38.258 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:13:38.285 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:13:38.306 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:13:38.334 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:13:38.372 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:13:38.623 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:13:38.641 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:13:38.652 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:13:38.669 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:13:38.681 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:13:38.707 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:13:38.934 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:13:38.950 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:13:38.993 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:13:39.714 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:13:39.742 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:39.753 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:13:39.780 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:39.782 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:39.819 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:40.709 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:13:40.737 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:40.739 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:13:40.768 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:40.775 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:40.805 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:41.056 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:13:41.077 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:13:41.323 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:13:41.327 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:13:41.441 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:13:41.453 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:13:41.669 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:13:41.696 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:13:41.988 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:13:42.007 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:13:42.412 INFO:teuthology.orchestra.run.smithi178.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:13:42.442 INFO:teuthology.orchestra.run.smithi138.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:13:42.480 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:42.510 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:42.921 INFO:teuthology.orchestra.run.smithi178.stdout:Adding system user cephadm....done 2024-09-12T00:13:43.061 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user cephadm....done 2024-09-12T00:13:43.077 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:13:43.217 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:13:43.354 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:13:43.502 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:13:43.605 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:13:43.715 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:13:43.771 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:13:43.897 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:13:43.949 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:13:44.157 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:13:44.208 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:13:44.351 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:13:44.416 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:13:44.518 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:13:44.669 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:13:44.803 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:13:45.046 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:13:45.197 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:13:45.289 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:13:45.456 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:13:45.557 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:13:45.741 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:13:45.841 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:13:45.960 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:13:46.093 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:13:46.186 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:13:46.352 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:13:46.470 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:13:46.611 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:46.722 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:46.854 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:13:47.040 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:13:47.055 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:13:47.164 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:13:47.166 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:13:47.265 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:13:47.276 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:13:47.377 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:13:47.516 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:13:47.620 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:13:47.923 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:13:47.955 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:13:48.007 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:13:48.012 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:13:48.043 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:13:48.107 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:13:48.112 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:13:48.250 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:13:48.472 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:13:48.581 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:13:48.609 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:13:48.731 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:13:48.840 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:13:49.108 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:13:49.345 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:13:49.409 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:13:49.535 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:13:49.613 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:13:49.915 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:13:50.041 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:13:50.187 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:13:50.430 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:13:50.531 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:13:50.649 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:13:50.735 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:13:50.941 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:13:50.969 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:13:51.096 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:13:51.222 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:13:51.309 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:13:51.524 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:13:51.560 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:13:51.920 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:13:51.924 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:13:52.176 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:13:52.230 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:13:52.536 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:13:52.573 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:13:52.832 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:13:52.837 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:13:52.958 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:53.181 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:13:53.260 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:13:53.441 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:13:53.559 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:53.619 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:13:53.843 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:13:54.211 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:13:54.991 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:13:55.234 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:13:55.361 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:13:55.402 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:13:55.628 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:13:55.637 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:13:55.746 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:13:55.763 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:13:55.855 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:13:56.023 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:13:56.140 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:13:56.149 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:13:56.267 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:13:56.399 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:13:56.569 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:13:56.650 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:13:56.776 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:13:56.820 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:13:57.062 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:13:57.086 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:13:57.189 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:13:57.337 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:13:57.499 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:13:57.589 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:13:57.750 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:13:57.839 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:13:57.993 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:13:58.099 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:13:58.244 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:13:58.366 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:13:58.493 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:13:58.495 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:13:58.755 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:13:58.769 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:13:58.878 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:13:58.890 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:13:59.146 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:13:59.175 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:13:59.276 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:13:59.480 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:13:59.552 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:13:59.731 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:13:59.845 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:13:59.857 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:13:59.983 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:14:00.074 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:14:00.096 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:14:00.231 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:14:00.310 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:14:00.357 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:14:00.436 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:14:00.447 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:14:00.685 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:14:00.786 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:14:00.838 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:14:01.080 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:14:01.170 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:14:01.207 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:14:01.430 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:14:01.474 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:14:01.590 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:14:01.592 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:14:01.841 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:14:01.901 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:14:01.951 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:14:02.186 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:14:02.244 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:14:02.470 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:14:02.537 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:14:02.596 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:14:02.813 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:14:02.872 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:14:02.939 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:14:03.157 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:14:03.215 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:14:03.483 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:14:03.493 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:14:03.812 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:14:03.870 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:14:04.146 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:14:04.198 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:14:04.491 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:14:04.498 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:14:04.616 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:04.725 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:04.836 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:14:04.851 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:14:04.979 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:05.106 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:05.196 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:05.232 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:14:05.322 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:05.448 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:14:05.560 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:05.661 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:05.725 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:05.787 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:14:05.850 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:05.960 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:06.065 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:06.157 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:14:06.157 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:14:06.199 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:06.326 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:06.531 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:14:06.531 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:14:06.611 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:06.729 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:06.855 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:06.981 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:14:07.018 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:07.137 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:07.305 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:07.431 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:14:08.193 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:08.319 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:08.445 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:08.571 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:08.593 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:08.697 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:08.762 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:08.888 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:09.014 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:09.140 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:09.248 INFO:teuthology.orchestra.run.smithi178.stdout:Adding group ceph....done 2024-09-12T00:14:09.633 INFO:teuthology.orchestra.run.smithi178.stdout:Adding system user ceph....done 2024-09-12T00:14:09.666 INFO:teuthology.orchestra.run.smithi138.stdout:Adding group ceph....done 2024-09-12T00:14:09.793 INFO:teuthology.orchestra.run.smithi178.stdout:Setting system user ceph properties....done 2024-09-12T00:14:09.812 INFO:teuthology.orchestra.run.smithi178.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:14:09.950 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:14:10.043 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user ceph....done 2024-09-12T00:14:10.211 INFO:teuthology.orchestra.run.smithi138.stdout:Setting system user ceph properties....done 2024-09-12T00:14:10.228 INFO:teuthology.orchestra.run.smithi138.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:14:10.243 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:14:10.363 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:14:10.681 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:14:10.715 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:10.841 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:11.152 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:11.268 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:11.325 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:14:11.325 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:14:11.733 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:14:11.734 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:14:11.835 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:12.146 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:14:12.202 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:12.559 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:14:12.636 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:12.862 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:14:12.862 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:14:13.021 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:13.249 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:14:13.249 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:14:13.304 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:13.520 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:14:13.520 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:14:13.739 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:13.964 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:13.980 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:14:13.980 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:14:14.245 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:14:14.245 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:14:14.499 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:14.699 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:14.798 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:14:14.799 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:14:14.834 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:14.960 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:15.182 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:14:15.182 INFO:teuthology.orchestra.run.smithi178.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:14:15.285 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:15.411 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:15.554 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:15.661 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:15.752 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:14:15.752 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:14:15.824 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:15.947 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:16.098 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:16.254 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:16.408 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:16.450 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:14:16.507 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:16.560 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:14:16.641 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:14:16.787 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:14:16.977 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:14:17.086 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:14:17.330 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:14:17.863 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:14:18.113 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:14:18.546 INFO:teuthology.orchestra.run.smithi178.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:14:18.549 DEBUG:teuthology.orchestra.run.smithi178:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T00:14:18.604 INFO:teuthology.orchestra.run.smithi178.stdout:Reading package lists... 2024-09-12T00:14:18.797 INFO:teuthology.orchestra.run.smithi138.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:14:18.799 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T00:14:18.813 INFO:teuthology.orchestra.run.smithi178.stdout:Building dependency tree... 2024-09-12T00:14:18.814 INFO:teuthology.orchestra.run.smithi178.stdout:Reading state information... 2024-09-12T00:14:18.897 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-12T00:14:18.997 INFO:teuthology.orchestra.run.smithi178.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:14:18.997 INFO:teuthology.orchestra.run.smithi178.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:14:18.997 INFO:teuthology.orchestra.run.smithi178.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:14:18.997 INFO:teuthology.orchestra.run.smithi178.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:14:18.998 INFO:teuthology.orchestra.run.smithi178.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:14:18.998 INFO:teuthology.orchestra.run.smithi178.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:14:18.998 INFO:teuthology.orchestra.run.smithi178.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:14:18.999 INFO:teuthology.orchestra.run.smithi178.stdout:The following additional packages will be installed: 2024-09-12T00:14:18.999 INFO:teuthology.orchestra.run.smithi178.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:14:18.999 INFO:teuthology.orchestra.run.smithi178.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:14:18.999 INFO:teuthology.orchestra.run.smithi178.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:14:18.999 INFO:teuthology.orchestra.run.smithi178.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:14:18.999 INFO:teuthology.orchestra.run.smithi178.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:14:18.999 INFO:teuthology.orchestra.run.smithi178.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:14:19.000 INFO:teuthology.orchestra.run.smithi178.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:14:19.000 INFO:teuthology.orchestra.run.smithi178.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:14:19.000 INFO:teuthology.orchestra.run.smithi178.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:14:19.000 INFO:teuthology.orchestra.run.smithi178.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:14:19.000 INFO:teuthology.orchestra.run.smithi178.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T00:14:19.001 INFO:teuthology.orchestra.run.smithi178.stdout:Suggested packages: 2024-09-12T00:14:19.001 INFO:teuthology.orchestra.run.smithi178.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T00:14:19.001 INFO:teuthology.orchestra.run.smithi178.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T00:14:19.001 INFO:teuthology.orchestra.run.smithi178.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T00:14:19.001 INFO:teuthology.orchestra.run.smithi178.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T00:14:19.001 INFO:teuthology.orchestra.run.smithi178.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T00:14:19.040 INFO:teuthology.orchestra.run.smithi178.stdout:The following NEW packages will be installed: 2024-09-12T00:14:19.040 INFO:teuthology.orchestra.run.smithi178.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:14:19.040 INFO:teuthology.orchestra.run.smithi178.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:14:19.040 INFO:teuthology.orchestra.run.smithi178.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:14:19.040 INFO:teuthology.orchestra.run.smithi178.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:14:19.040 INFO:teuthology.orchestra.run.smithi178.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:14:19.040 INFO:teuthology.orchestra.run.smithi178.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:14:19.040 INFO:teuthology.orchestra.run.smithi178.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:14:19.040 INFO:teuthology.orchestra.run.smithi178.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:14:19.040 INFO:teuthology.orchestra.run.smithi178.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:14:19.041 INFO:teuthology.orchestra.run.smithi178.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:14:19.041 INFO:teuthology.orchestra.run.smithi178.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T00:14:19.041 INFO:teuthology.orchestra.run.smithi178.stdout: s3cmd 2024-09-12T00:14:19.093 INFO:teuthology.orchestra.run.smithi178.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:14:19.093 INFO:teuthology.orchestra.run.smithi178.stdout:Need to get 10.4 MB of archives. 2024-09-12T00:14:19.093 INFO:teuthology.orchestra.run.smithi178.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T00:14:19.093 INFO:teuthology.orchestra.run.smithi178.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T00:14:19.106 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-09-12T00:14:19.107 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-09-12T00:14:19.110 INFO:teuthology.orchestra.run.smithi178.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T00:14:19.111 INFO:teuthology.orchestra.run.smithi178.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T00:14:19.114 INFO:teuthology.orchestra.run.smithi178.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T00:14:19.148 INFO:teuthology.orchestra.run.smithi178.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T00:14:19.164 INFO:teuthology.orchestra.run.smithi178.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T00:14:19.165 INFO:teuthology.orchestra.run.smithi178.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T00:14:19.195 INFO:teuthology.orchestra.run.smithi178.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T00:14:19.215 INFO:teuthology.orchestra.run.smithi178.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T00:14:19.216 INFO:teuthology.orchestra.run.smithi178.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T00:14:19.217 INFO:teuthology.orchestra.run.smithi178.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T00:14:19.265 INFO:teuthology.orchestra.run.smithi178.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T00:14:19.265 INFO:teuthology.orchestra.run.smithi178.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T00:14:19.282 INFO:teuthology.orchestra.run.smithi178.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T00:14:19.282 INFO:teuthology.orchestra.run.smithi178.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T00:14:19.282 INFO:teuthology.orchestra.run.smithi178.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T00:14:19.283 INFO:teuthology.orchestra.run.smithi178.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T00:14:19.284 INFO:teuthology.orchestra.run.smithi178.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T00:14:19.286 INFO:teuthology.orchestra.run.smithi178.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T00:14:19.287 INFO:teuthology.orchestra.run.smithi178.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T00:14:19.288 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:14:19.288 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:14:19.288 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:14:19.288 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:14:19.289 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:14:19.289 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:14:19.289 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:14:19.290 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-09-12T00:14:19.291 INFO:teuthology.orchestra.run.smithi138.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:14:19.291 INFO:teuthology.orchestra.run.smithi138.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:14:19.291 INFO:teuthology.orchestra.run.smithi138.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:14:19.291 INFO:teuthology.orchestra.run.smithi138.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:14:19.291 INFO:teuthology.orchestra.run.smithi138.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:14:19.291 INFO:teuthology.orchestra.run.smithi138.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:14:19.291 INFO:teuthology.orchestra.run.smithi138.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:14:19.291 INFO:teuthology.orchestra.run.smithi138.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:14:19.291 INFO:teuthology.orchestra.run.smithi138.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:14:19.291 INFO:teuthology.orchestra.run.smithi138.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:14:19.291 INFO:teuthology.orchestra.run.smithi138.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T00:14:19.292 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-09-12T00:14:19.292 INFO:teuthology.orchestra.run.smithi138.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T00:14:19.292 INFO:teuthology.orchestra.run.smithi138.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T00:14:19.292 INFO:teuthology.orchestra.run.smithi138.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T00:14:19.292 INFO:teuthology.orchestra.run.smithi138.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T00:14:19.292 INFO:teuthology.orchestra.run.smithi138.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T00:14:19.293 INFO:teuthology.orchestra.run.smithi178.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T00:14:19.300 INFO:teuthology.orchestra.run.smithi178.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T00:14:19.301 INFO:teuthology.orchestra.run.smithi178.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T00:14:19.301 INFO:teuthology.orchestra.run.smithi178.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T00:14:19.318 INFO:teuthology.orchestra.run.smithi178.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T00:14:19.319 INFO:teuthology.orchestra.run.smithi178.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T00:14:19.319 INFO:teuthology.orchestra.run.smithi178.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T00:14:19.320 INFO:teuthology.orchestra.run.smithi178.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T00:14:19.324 INFO:teuthology.orchestra.run.smithi178.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T00:14:19.325 INFO:teuthology.orchestra.run.smithi178.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T00:14:19.329 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-09-12T00:14:19.329 INFO:teuthology.orchestra.run.smithi138.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:14:19.329 INFO:teuthology.orchestra.run.smithi138.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:14:19.330 INFO:teuthology.orchestra.run.smithi138.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:14:19.330 INFO:teuthology.orchestra.run.smithi138.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:14:19.330 INFO:teuthology.orchestra.run.smithi138.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:14:19.330 INFO:teuthology.orchestra.run.smithi138.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:14:19.330 INFO:teuthology.orchestra.run.smithi138.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:14:19.330 INFO:teuthology.orchestra.run.smithi138.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:14:19.330 INFO:teuthology.orchestra.run.smithi138.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:14:19.330 INFO:teuthology.orchestra.run.smithi138.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:14:19.331 INFO:teuthology.orchestra.run.smithi138.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T00:14:19.331 INFO:teuthology.orchestra.run.smithi138.stdout: s3cmd 2024-09-12T00:14:19.340 INFO:teuthology.orchestra.run.smithi178.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T00:14:19.340 INFO:teuthology.orchestra.run.smithi178.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T00:14:19.357 INFO:teuthology.orchestra.run.smithi178.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T00:14:19.357 INFO:teuthology.orchestra.run.smithi178.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T00:14:19.357 INFO:teuthology.orchestra.run.smithi178.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T00:14:19.384 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:14:19.384 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 10.4 MB of archives. 2024-09-12T00:14:19.384 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T00:14:19.384 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T00:14:19.402 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T00:14:19.402 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T00:14:19.405 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T00:14:19.441 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T00:14:19.456 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T00:14:19.457 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T00:14:19.487 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T00:14:19.508 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T00:14:19.508 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T00:14:19.509 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T00:14:19.542 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T00:14:19.543 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T00:14:19.560 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T00:14:19.560 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T00:14:19.560 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T00:14:19.561 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T00:14:19.561 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T00:14:19.565 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T00:14:19.565 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T00:14:19.571 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T00:14:19.573 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T00:14:19.580 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T00:14:19.580 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T00:14:19.580 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T00:14:19.597 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T00:14:19.597 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T00:14:19.599 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T00:14:19.603 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T00:14:19.605 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T00:14:19.620 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T00:14:19.620 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T00:14:19.637 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T00:14:19.638 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T00:14:19.638 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T00:14:19.801 INFO:teuthology.orchestra.run.smithi178.stdout:Fetched 10.4 MB in 0s (33.6 MB/s) 2024-09-12T00:14:19.884 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T00:14:19.968 INFO:teuthology.orchestra.run.smithi178.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T00:14:19.973 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T00:14:20.017 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T00:14:20.081 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 10.4 MB in 0s (34.7 MB/s) 2024-09-12T00:14:20.168 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T00:14:20.228 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T00:14:20.233 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T00:14:20.252 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T00:14:20.269 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T00:14:20.276 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T00:14:20.319 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:14:20.512 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T00:14:20.529 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T00:14:20.571 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:14:20.572 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T00:14:20.589 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T00:14:20.630 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:14:20.823 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T00:14:20.840 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T00:14:20.881 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:14:20.882 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T00:14:20.899 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T00:14:20.932 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T00:14:21.126 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T00:14:21.143 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T00:14:21.168 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T00:14:21.184 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T00:14:21.185 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T00:14:21.227 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T00:14:21.403 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T00:14:21.420 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T00:14:21.462 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T00:14:21.479 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T00:14:21.495 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T00:14:21.537 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T00:14:21.748 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T00:14:21.764 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T00:14:21.790 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T00:14:21.806 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T00:14:21.806 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T00:14:21.864 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T00:14:22.033 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T00:14:22.049 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T00:14:22.083 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T00:14:22.092 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T00:14:22.108 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T00:14:22.142 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T00:14:22.360 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T00:14:22.377 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T00:14:22.419 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T00:14:22.427 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T00:14:22.444 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T00:14:22.494 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:14:22.721 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T00:14:22.737 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T00:14:22.749 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T00:14:22.763 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T00:14:22.780 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:14:22.805 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:14:23.032 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T00:14:23.058 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libguava-java. 2024-09-12T00:14:23.060 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T00:14:23.076 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T00:14:23.099 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:14:23.116 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T00:14:23.335 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libguava-java. 2024-09-12T00:14:23.351 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T00:14:23.393 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T00:14:23.544 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T00:14:23.572 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T00:14:23.611 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T00:14:23.821 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T00:14:23.849 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T00:14:23.887 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T00:14:23.904 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libguice-java. 2024-09-12T00:14:23.928 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T00:14:23.962 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T00:14:24.215 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libguice-java. 2024-09-12T00:14:24.243 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T00:14:24.281 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T00:14:24.349 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T00:14:24.366 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T00:14:24.408 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:14:24.660 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T00:14:24.676 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T00:14:24.677 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T00:14:24.694 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T00:14:24.718 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T00:14:24.735 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:14:24.939 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T00:14:24.956 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T00:14:24.989 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T00:14:25.402 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T00:14:25.430 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T00:14:25.468 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T00:14:25.607 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T00:14:25.636 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T00:14:25.674 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T00:14:25.926 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T00:14:25.943 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T00:14:25.976 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T00:14:26.037 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T00:14:26.065 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T00:14:26.104 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:14:26.220 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T00:14:26.248 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T00:14:26.287 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T00:14:26.331 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T00:14:26.348 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T00:14:26.381 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:14:26.539 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T00:14:26.556 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T00:14:26.598 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:14:26.634 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T00:14:26.650 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T00:14:26.692 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:14:26.875 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T00:14:26.891 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T00:14:26.933 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:14:27.004 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T00:14:27.021 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T00:14:27.062 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:14:27.178 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T00:14:27.206 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T00:14:27.236 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:14:27.324 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T00:14:27.340 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T00:14:27.382 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T00:14:27.523 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T00:14:27.540 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T00:14:27.581 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:14:27.601 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T00:14:27.617 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T00:14:27.659 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:14:27.842 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T00:14:27.859 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T00:14:27.909 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T00:14:27.920 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T00:14:27.948 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T00:14:27.986 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:14:28.179 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T00:14:28.207 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T00:14:28.245 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:14:28.247 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T00:14:28.264 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T00:14:28.306 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:14:28.472 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T00:14:28.489 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T00:14:28.522 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:14:28.550 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T00:14:28.566 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T00:14:28.608 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:14:28.758 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T00:14:28.774 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T00:14:28.816 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:14:28.827 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T00:14:28.843 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T00:14:28.877 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T00:14:29.086 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T00:14:29.114 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T00:14:29.148 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T00:14:29.152 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:14:29.176 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T00:14:29.214 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:14:29.405 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T00:14:29.433 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T00:14:29.471 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T00:14:29.500 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T00:14:29.516 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T00:14:29.558 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:14:29.716 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T00:14:29.733 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T00:14:29.775 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:14:29.828 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T00:14:29.844 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T00:14:29.886 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:14:30.061 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T00:14:30.089 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T00:14:30.128 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:14:30.316 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T00:14:30.344 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T00:14:30.382 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T00:14:30.405 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T00:14:30.421 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T00:14:30.489 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:14:30.634 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T00:14:30.651 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T00:14:30.692 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:14:30.910 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T00:14:30.938 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T00:14:30.977 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T00:14:31.112 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package maven. 2024-09-12T00:14:31.140 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T00:14:31.170 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T00:14:31.204 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T00:14:31.233 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T00:14:31.271 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:14:31.507 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package python3-magic. 2024-09-12T00:14:31.535 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T00:14:31.573 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T00:14:31.757 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package maven. 2024-09-12T00:14:31.785 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T00:14:31.823 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T00:14:31.876 INFO:teuthology.orchestra.run.smithi178.stdout:Selecting previously unselected package s3cmd. 2024-09-12T00:14:31.904 INFO:teuthology.orchestra.run.smithi178.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T00:14:31.942 INFO:teuthology.orchestra.run.smithi178.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T00:14:32.152 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-magic. 2024-09-12T00:14:32.180 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T00:14:32.218 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T00:14:32.306 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T00:14:32.431 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:14:32.488 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package s3cmd. 2024-09-12T00:14:32.504 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T00:14:32.537 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T00:14:32.557 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:14:32.683 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:14:32.809 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T00:14:32.891 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T00:14:32.927 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T00:14:33.017 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:14:33.036 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:14:33.145 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T00:14:33.152 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:14:33.271 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:14:33.278 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:14:33.404 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T00:14:33.405 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:14:33.531 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T00:14:33.546 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T00:14:33.657 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:14:33.672 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:14:33.783 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:14:33.790 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T00:14:33.909 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:14:33.916 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:14:34.027 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:14:34.042 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:14:34.144 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T00:14:34.168 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T00:14:34.294 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:14:34.387 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T00:14:34.420 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:14:34.522 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:14:34.547 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:14:34.648 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:14:34.672 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:14:34.774 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T00:14:34.781 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T00:14:34.900 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T00:14:35.041 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T00:14:35.050 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:14:35.167 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:14:35.177 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T00:14:35.293 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:14:35.427 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T00:14:35.462 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:14:35.553 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T00:14:35.588 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:14:35.679 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:14:35.714 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T00:14:35.805 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T00:14:35.832 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T00:14:35.933 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T00:14:36.034 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T00:14:36.143 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T00:14:36.149 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:14:36.269 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T00:14:36.275 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:14:36.395 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T00:14:36.401 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T00:14:36.521 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:14:36.535 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T00:14:36.636 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T00:14:36.655 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:14:36.762 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T00:14:36.781 INFO:teuthology.orchestra.run.smithi178.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T00:14:36.889 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T00:14:37.014 INFO:teuthology.orchestra.run.smithi178.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T00:14:37.015 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T00:14:37.086 INFO:teuthology.orchestra.run.smithi178.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:14:37.115 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T00:14:37.216 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:14:37.342 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:14:37.477 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T00:14:37.735 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T00:14:37.806 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:14:38.466 INFO:teuthology.orchestra.run.smithi178.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:14:38.473 DEBUG:teuthology.parallel:result is None 2024-09-12T00:14:39.079 INFO:teuthology.orchestra.run.smithi138.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:14:39.083 DEBUG:teuthology.parallel:result is None 2024-09-12T00:14:39.084 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:14:39.250 DEBUG:teuthology.orchestra.run.smithi138:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:14:39.269 INFO:teuthology.orchestra.run.smithi138.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:14:39.270 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:14:39.270 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:14:39.273 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:14:39.420 DEBUG:teuthology.orchestra.run.smithi178:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:14:39.440 INFO:teuthology.orchestra.run.smithi178.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:14:39.440 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:14:39.440 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:14:39.442 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T00:14:39.443 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:14:39.443 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:14:39.457 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:14:39.457 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:14:39.498 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T00:14:39.498 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:14:39.498 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:14:39.511 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:14:39.565 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:14:39.566 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:14:39.579 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:14:39.633 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T00:14:39.633 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:14:39.633 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:14:39.647 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:14:39.701 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:14:39.701 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:14:39.714 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:14:39.768 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T00:14:39.769 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:14:39.769 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:14:39.782 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:14:39.837 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:14:39.837 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:14:39.850 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:14:39.905 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T00:14:40.007 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T00:14:40.008 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /var/log/ceph 2024-09-12T00:14:40.010 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 777 /var/log/ceph 2024-09-12T00:14:40.024 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T00:14:40.025 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:14:40.068 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:14:40.080 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T00:14:40.080 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:14:40.123 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:14:40.170 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T00:14:40.170 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T00:14:40.170 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901837', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7901837', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0'}, 'compression type': 'random', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2206, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-67986', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '6a169fc940965ab446a63954fde870aa497efde7', 'targets': {'smithi138.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJBcTOjTxJwH5UTs63hI3jsOX4on18bK8FAszb713csT1fVkTZGwBUvgDygYPssEnHfyf2acUrsO2uDauaIpza8=', 'smithi178.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMqXB/zp75Cp0qIFH/SN8qanvfvWwr7K3bDji1+hWRrTGkH8dxW1MPEodA29vUE0ZJSXZYj4L4QJ73AQsUEDlNo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_23:33:24', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T00:14:40.171 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:14:40.179 DEBUG:teuthology.orchestra.run.smithi178:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:14:40.185 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:14:40.228 DEBUG:teuthology.orchestra.run.smithi178:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:14:40.242 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:14:40.242 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:14:40.286 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:14:40.287 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2024-09-12T00:14:40.334 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:14:40.335 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:14:40.335 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 872 Links: 1 2024-09-12T00:14:40.335 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:14:40.335 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-12 00:08:53.765140824 +0000 2024-09-12T00:14:40.335 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-12 00:08:53.521143003 +0000 2024-09-12T00:14:40.335 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-12 00:08:53.521143003 +0000 2024-09-12T00:14:40.335 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-09-12T00:14:40.335 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:14:40.388 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-12T00:14:40.389 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-12T00:14:40.389 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000455128 s, 1.1 MB/s 2024-09-12T00:14:40.390 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:14:40.440 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2024-09-12T00:14:40.486 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:14:40.486 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:14:40.486 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-09-12T00:14:40.486 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:14:40.487 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-12 00:08:54.253136465 +0000 2024-09-12T00:14:40.487 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-12 00:08:54.013138609 +0000 2024-09-12T00:14:40.487 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-12 00:08:54.013138609 +0000 2024-09-12T00:14:40.487 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-09-12T00:14:40.487 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:14:40.540 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-12T00:14:40.541 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-12T00:14:40.541 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000339398 s, 1.5 MB/s 2024-09-12T00:14:40.542 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:14:40.593 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2024-09-12T00:14:40.639 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:14:40.639 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:14:40.639 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 907 Links: 1 2024-09-12T00:14:40.639 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:14:40.639 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-12 00:08:54.777131784 +0000 2024-09-12T00:14:40.639 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-12 00:08:54.513134142 +0000 2024-09-12T00:14:40.639 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-12 00:08:54.513134142 +0000 2024-09-12T00:14:40.639 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-09-12T00:14:40.639 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:14:40.693 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-12T00:14:40.693 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-12T00:14:40.694 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000416444 s, 1.2 MB/s 2024-09-12T00:14:40.694 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:14:40.746 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2024-09-12T00:14:40.794 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-09-12 00:08:55.249127567 +0000 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-09-12 00:08:55.013129676 +0000 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-09-12 00:08:55.013129676 +0000 2024-09-12T00:14:40.795 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-09-12T00:14:40.795 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:14:40.849 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-09-12T00:14:40.849 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-09-12T00:14:40.849 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000385857 s, 1.3 MB/s 2024-09-12T00:14:40.850 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:14:40.899 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:14:40.900 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:14:40.900 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:14:40.906 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:14:40.906 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_1 2024-09-12T00:14:40.954 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:14:40.954 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:14:40.954 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-09-12T00:14:40.954 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:14:40.954 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-12 00:08:55.278065079 +0000 2024-09-12T00:14:40.954 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-12 00:08:54.974067795 +0000 2024-09-12T00:14:40.954 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-12 00:08:54.974067795 +0000 2024-09-12T00:14:40.954 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2024-09-12T00:14:40.955 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:14:41.008 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-12T00:14:41.009 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-12T00:14:41.009 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000214546 s, 2.4 MB/s 2024-09-12T00:14:41.010 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:14:41.060 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_2 2024-09-12T00:14:41.105 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:14:41.105 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:14:41.105 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-09-12T00:14:41.105 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:14:41.105 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-12 00:08:55.502063078 +0000 2024-09-12T00:14:41.105 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-12 00:08:55.498063114 +0000 2024-09-12T00:14:41.105 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-12 00:08:55.498063114 +0000 2024-09-12T00:14:41.105 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2024-09-12T00:14:41.106 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:14:41.159 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-12T00:14:41.160 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-12T00:14:41.160 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000303043 s, 1.7 MB/s 2024-09-12T00:14:41.161 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:14:41.210 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_3 2024-09-12T00:14:41.257 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:14:41.257 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:14:41.257 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-09-12T00:14:41.258 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:14:41.258 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-12 00:08:56.018058469 +0000 2024-09-12T00:14:41.258 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-12 00:08:56.014058505 +0000 2024-09-12T00:14:41.258 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-12 00:08:56.014058505 +0000 2024-09-12T00:14:41.258 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2024-09-12T00:14:41.258 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:14:41.311 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-12T00:14:41.312 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-12T00:14:41.312 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000304304 s, 1.7 MB/s 2024-09-12T00:14:41.313 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:14:41.362 DEBUG:teuthology.orchestra.run.smithi178:> stat /dev/vg_nvme/lv_4 2024-09-12T00:14:41.409 INFO:teuthology.orchestra.run.smithi178.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:14:41.409 INFO:teuthology.orchestra.run.smithi178.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:14:41.409 INFO:teuthology.orchestra.run.smithi178.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-12T00:14:41.409 INFO:teuthology.orchestra.run.smithi178.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:14:41.409 INFO:teuthology.orchestra.run.smithi178.stdout:Access: 2024-09-12 00:08:56.750051931 +0000 2024-09-12T00:14:41.409 INFO:teuthology.orchestra.run.smithi178.stdout:Modify: 2024-09-12 00:08:56.518054004 +0000 2024-09-12T00:14:41.409 INFO:teuthology.orchestra.run.smithi178.stdout:Change: 2024-09-12 00:08:56.518054004 +0000 2024-09-12T00:14:41.409 INFO:teuthology.orchestra.run.smithi178.stdout: Birth: - 2024-09-12T00:14:41.409 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:14:41.463 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records in 2024-09-12T00:14:41.463 INFO:teuthology.orchestra.run.smithi178.stderr:1+0 records out 2024-09-12T00:14:41.463 INFO:teuthology.orchestra.run.smithi178.stderr:512 bytes copied, 0.000234037 s, 2.2 MB/s 2024-09-12T00:14:41.464 DEBUG:teuthology.orchestra.run.smithi178:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:14:41.514 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:14:41.514 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:14:41.515 INFO:tasks.ceph:Generating config... 2024-09-12T00:14:41.516 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T00:14:41.516 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T00:14:41.516 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T00:14:41.516 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T00:14:41.516 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T00:14:41.516 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:14:41.517 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-12T00:14:41.517 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-12T00:14:41.517 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T00:14:41.517 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T00:14:41.517 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T00:14:41.517 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T00:14:41.517 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T00:14:41.517 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T00:14:41.517 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T00:14:41.517 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T00:14:41.517 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T00:14:41.518 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T00:14:41.518 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T00:14:41.518 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T00:14:41.518 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T00:14:41.518 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T00:14:41.518 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T00:14:41.518 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T00:14:41.518 INFO:tasks.ceph:[mon] lockdep = True 2024-09-12T00:14:41.518 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T00:14:41.518 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T00:14:41.518 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T00:14:41.518 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T00:14:41.518 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T00:14:41.518 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T00:14:41.519 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T00:14:41.519 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T00:14:41.519 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T00:14:41.519 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T00:14:41.519 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T00:14:41.519 INFO:tasks.ceph:[osd] lockdep = True 2024-09-12T00:14:41.519 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T00:14:41.519 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T00:14:41.519 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T00:14:41.519 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T00:14:41.519 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T00:14:41.519 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T00:14:41.520 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T00:14:41.520 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T00:14:41.554 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T00:14:41.562 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T00:14:41.644 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:14:41.700 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.138'), ('mon.c', '[v2:172.21.15.138:3301,v1:172.21.15.138:6790]'), ('mon.b', '172.21.15.178')] 2024-09-12T00:14:41.701 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.138,[v2:172.21.15.138:3301,v1:172.21.15.138:6790],172.21.15.178', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T00:14:41.702 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:14:41.702 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:14:41.754 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.138 --addv c '[v2:172.21.15.138:3301,v1:172.21.15.138:6790]' --add b 172.21.15.178 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:14:41.845 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:14:41.845 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:14:41.845 INFO:teuthology.orchestra.run.smithi138.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:14:41.845 INFO:teuthology.orchestra.run.smithi138.stdout:monmaptool: generated fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:14:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:setting min_mon_release = quincy 2024-09-12T00:14:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:epoch 0 2024-09-12T00:14:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:14:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:14:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:14:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:min_mon_release 17 (quincy) 2024-09-12T00:14:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:election_strategy: 1 2024-09-12T00:14:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:14:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:14:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:14:41.846 INFO:teuthology.orchestra.run.smithi138.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T00:14:41.847 DEBUG:teuthology.orchestra.run.smithi138:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:14:41.896 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 16f746b5-6307-4fbc-8384-d9f6a260b7cb... 2024-09-12T00:14:41.896 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:14:41.940 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:14:41.967 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2024-09-12T00:14:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2024-09-12T00:14:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:14:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2024-09-12T00:14:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2024-09-12T00:14:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2024-09-12T00:14:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2024-09-12T00:14:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2024-09-12T00:14:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2024-09-12T00:14:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2024-09-12T00:14:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:14:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2024-09-12T00:14:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:14:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:14:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2024-09-12T00:14:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2024-09-12T00:14:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2024-09-12T00:14:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:14:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:14:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2024-09-12T00:14:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:14:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2024-09-12T00:14:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:14:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:14:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: mon_allow_pool_size_one = true 2024-09-12T00:14:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:14:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2024-09-12T00:14:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2024-09-12T00:14:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2024-09-12T00:14:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2024-09-12T00:14:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: mon health detail to clog = false 2024-09-12T00:14:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = "172.21.15.138,[v2:172.21.15.138:3301,v1:172.21.15.138:6790],172.21.15.178" 2024-09-12T00:14:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: mon client directed command retry = 5 2024-09-12T00:14:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: ms inject socket failures = 5000 2024-09-12T00:14:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:14:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:14:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:14:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.971 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2024-09-12T00:14:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2024-09-12T00:14:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2024-09-12T00:14:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 600 2024-09-12T00:14:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:14:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2024-09-12T00:14:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2024-09-12T00:14:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2024-09-12T00:14:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2024-09-12T00:14:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2024-09-12T00:14:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug trim objects = true 2024-09-12T00:14:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2024-09-12T00:14:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2024-09-12T00:14:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:14:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2024-09-12T00:14:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2024-09-12T00:14:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:14:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2024-09-12T00:14:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2024-09-12T00:14:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2024-09-12T00:14:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: bdev async discard = True 2024-09-12T00:14:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: bdev enable discard = True 2024-09-12T00:14:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore allocator = bitmap 2024-09-12T00:14:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2024-09-12T00:14:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2024-09-12T00:14:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 1/20 2024-09-12T00:14:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 1/20 2024-09-12T00:14:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-12T00:14:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: debug objclass = 20 2024-09-12T00:14:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 20 2024-09-12T00:14:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 4/10 2024-09-12T00:14:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: lockdep = True 2024-09-12T00:14:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:14:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2024-09-12T00:14:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:14:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:14:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2024-09-12T00:14:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: osd shutdown pgref assert = True 2024-09-12T00:14:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.975 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2024-09-12T00:14:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-12T00:14:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2024-09-12T00:14:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-09-12T00:14:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-09-12T00:14:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:14:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:14:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2024-09-12T00:14:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.976 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2024-09-12T00:14:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-09-12T00:14:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-09-12T00:14:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2024-09-12T00:14:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-09-12T00:14:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2024-09-12T00:14:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2024-09-12T00:14:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:14:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2024-09-12T00:14:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2024-09-12T00:14:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:14:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:14:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:14:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:14:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:14:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:14:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:14:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: # 1m isn't quite enough 2024-09-12T00:14:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:14:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:14:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: lockdep = True 2024-09-12T00:14:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:14:41.979 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2024-09-12T00:14:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2024-09-12T00:14:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2024-09-12T00:14:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2024-09-12T00:14:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:14:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:14:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: debug rgw = 20 2024-09-12T00:14:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: debug rgw notification = 20 2024-09-12T00:14:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: rgw bucket counters cache = True 2024-09-12T00:14:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: rgw crypt require ssl = False 2024-09-12T00:14:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:14:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:14:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: rgw max chunk size = 4194304 2024-09-12T00:14:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: rgw obj stripe size = 6291456 2024-09-12T00:14:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:14:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: rgw s3 auth use sts = True 2024-09-12T00:14:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:14:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: rgw torrent flag = True 2024-09-12T00:14:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: rgw user counters cache = True 2024-09-12T00:14:41.981 INFO:teuthology.orchestra.run.smithi138.stdout: setgroup = ceph 2024-09-12T00:14:41.981 INFO:teuthology.orchestra.run.smithi138.stdout: setuser = ceph 2024-09-12T00:14:41.981 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2024-09-12T00:14:41.981 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.c] 2024-09-12T00:14:41.981 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.b] 2024-09-12T00:14:41.982 INFO:teuthology.orchestra.run.smithi178.stdout:[global] 2024-09-12T00:14:41.982 INFO:teuthology.orchestra.run.smithi178.stdout: chdir = "" 2024-09-12T00:14:41.983 INFO:teuthology.orchestra.run.smithi178.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:14:41.983 INFO:teuthology.orchestra.run.smithi178.stdout: auth supported = cephx 2024-09-12T00:14:41.983 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.983 INFO:teuthology.orchestra.run.smithi178.stdout: filestore xattr use omap = true 2024-09-12T00:14:41.983 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.983 INFO:teuthology.orchestra.run.smithi178.stdout: mon clock drift allowed = 1.000 2024-09-12T00:14:41.983 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.983 INFO:teuthology.orchestra.run.smithi178.stdout: osd crush chooseleaf type = 0 2024-09-12T00:14:41.983 INFO:teuthology.orchestra.run.smithi178.stdout: auth debug = true 2024-09-12T00:14:41.983 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.983 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on old message = true 2024-09-12T00:14:41.983 INFO:teuthology.orchestra.run.smithi178.stdout: ms die on bug = true 2024-09-12T00:14:41.983 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.984 INFO:teuthology.orchestra.run.smithi178.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:14:41.984 INFO:teuthology.orchestra.run.smithi178.stdout: mon pg warn max object skew = 0 2024-09-12T00:14:41.984 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.984 INFO:teuthology.orchestra.run.smithi178.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:14:41.984 INFO:teuthology.orchestra.run.smithi178.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:14:41.984 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.984 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default size = 2 2024-09-12T00:14:41.984 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.984 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow primary affinity = true 2024-09-12T00:14:41.984 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd allow pg remap = true 2024-09-12T00:14:41.984 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:14:41.984 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:14:41.985 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on no sortbitwise = false 2024-09-12T00:14:41.985 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:14:41.985 INFO:teuthology.orchestra.run.smithi178.stdout: mon warn on too few osds = false 2024-09-12T00:14:41.985 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:14:41.985 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:14:41.985 INFO:teuthology.orchestra.run.smithi178.stdout: mon_allow_pool_size_one = true 2024-09-12T00:14:41.985 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.985 INFO:teuthology.orchestra.run.smithi178.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:14:41.985 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.985 INFO:teuthology.orchestra.run.smithi178.stdout: osd default data pool replay window = 5 2024-09-12T00:14:41.985 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.985 INFO:teuthology.orchestra.run.smithi178.stdout: mon allow pool delete = true 2024-09-12T00:14:41.985 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.986 INFO:teuthology.orchestra.run.smithi178.stdout: mon cluster log file level = debug 2024-09-12T00:14:41.986 INFO:teuthology.orchestra.run.smithi178.stdout: debug asserts on shutdown = true 2024-09-12T00:14:41.986 INFO:teuthology.orchestra.run.smithi178.stdout: mon health detail to clog = false 2024-09-12T00:14:41.986 INFO:teuthology.orchestra.run.smithi178.stdout: mon host = "172.21.15.138,[v2:172.21.15.138:3301,v1:172.21.15.138:6790],172.21.15.178" 2024-09-12T00:14:41.986 INFO:teuthology.orchestra.run.smithi178.stdout: mon client directed command retry = 5 2024-09-12T00:14:41.986 INFO:teuthology.orchestra.run.smithi178.stdout: ms inject socket failures = 5000 2024-09-12T00:14:41.986 INFO:teuthology.orchestra.run.smithi178.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:14:41.986 INFO:teuthology.orchestra.run.smithi178.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:14:41.986 INFO:teuthology.orchestra.run.smithi178.stdout: fsid = 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:14:41.988 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.988 INFO:teuthology.orchestra.run.smithi178.stdout:[osd] 2024-09-12T00:14:41.988 INFO:teuthology.orchestra.run.smithi178.stdout: osd journal size = 100 2024-09-12T00:14:41.988 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.988 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub load threshold = 5.0 2024-09-12T00:14:41.988 INFO:teuthology.orchestra.run.smithi178.stdout: osd scrub max interval = 600 2024-09-12T00:14:41.988 INFO:teuthology.orchestra.run.smithi178.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:14:41.988 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.988 INFO:teuthology.orchestra.run.smithi178.stdout: osd recover clone overlap = true 2024-09-12T00:14:41.988 INFO:teuthology.orchestra.run.smithi178.stdout: osd recovery max chunk = 1048576 2024-09-12T00:14:41.988 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.989 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug shutdown = true 2024-09-12T00:14:41.989 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug op order = true 2024-09-12T00:14:41.989 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug verify stray on activate = true 2024-09-12T00:14:41.989 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug trim objects = true 2024-09-12T00:14:41.989 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.989 INFO:teuthology.orchestra.run.smithi178.stdout: osd open classes on start = true 2024-09-12T00:14:41.989 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug pg log writeout = true 2024-09-12T00:14:41.989 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.989 INFO:teuthology.orchestra.run.smithi178.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:14:41.989 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.989 INFO:teuthology.orchestra.run.smithi178.stdout: osd map max advance = 10 2024-09-12T00:14:41.989 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.989 INFO:teuthology.orchestra.run.smithi178.stdout: journal zero on create = true 2024-09-12T00:14:41.989 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.990 INFO:teuthology.orchestra.run.smithi178.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:14:41.990 INFO:teuthology.orchestra.run.smithi178.stdout: filestore apply finisher threads = 3 2024-09-12T00:14:41.990 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.990 INFO:teuthology.orchestra.run.smithi178.stdout: bdev debug aio = true 2024-09-12T00:14:41.990 INFO:teuthology.orchestra.run.smithi178.stdout: osd debug misdirected ops = true 2024-09-12T00:14:41.990 INFO:teuthology.orchestra.run.smithi178.stdout: bdev async discard = True 2024-09-12T00:14:41.990 INFO:teuthology.orchestra.run.smithi178.stdout: bdev enable discard = True 2024-09-12T00:14:41.990 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore allocator = bitmap 2024-09-12T00:14:41.990 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore block size = 96636764160 2024-09-12T00:14:41.990 INFO:teuthology.orchestra.run.smithi178.stdout: bluestore fsck on mount = True 2024-09-12T00:14:41.990 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluefs = 1/20 2024-09-12T00:14:41.990 INFO:teuthology.orchestra.run.smithi178.stdout: debug bluestore = 1/20 2024-09-12T00:14:41.990 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-09-12T00:14:41.991 INFO:teuthology.orchestra.run.smithi178.stdout: debug objclass = 20 2024-09-12T00:14:41.991 INFO:teuthology.orchestra.run.smithi178.stdout: debug osd = 20 2024-09-12T00:14:41.991 INFO:teuthology.orchestra.run.smithi178.stdout: debug rocksdb = 4/10 2024-09-12T00:14:41.991 INFO:teuthology.orchestra.run.smithi178.stdout: lockdep = True 2024-09-12T00:14:41.991 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:14:41.991 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd full ratio = 0.9 2024-09-12T00:14:41.991 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:14:41.991 INFO:teuthology.orchestra.run.smithi178.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:14:41.991 INFO:teuthology.orchestra.run.smithi178.stdout: osd objectstore = bluestore 2024-09-12T00:14:41.991 INFO:teuthology.orchestra.run.smithi178.stdout: osd shutdown pgref assert = True 2024-09-12T00:14:41.991 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.991 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr] 2024-09-12T00:14:41.991 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-09-12T00:14:41.992 INFO:teuthology.orchestra.run.smithi178.stdout: debug mgr = 20 2024-09-12T00:14:41.992 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-09-12T00:14:41.992 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-09-12T00:14:41.992 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:14:41.992 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:14:41.992 INFO:teuthology.orchestra.run.smithi178.stdout: mgr/telemetry/nag = false 2024-09-12T00:14:41.992 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.992 INFO:teuthology.orchestra.run.smithi178.stdout:[mon] 2024-09-12T00:14:41.992 INFO:teuthology.orchestra.run.smithi178.stdout: debug ms = 1 2024-09-12T00:14:41.992 INFO:teuthology.orchestra.run.smithi178.stdout: debug mon = 20 2024-09-12T00:14:41.992 INFO:teuthology.orchestra.run.smithi178.stdout: debug paxos = 20 2024-09-12T00:14:41.992 INFO:teuthology.orchestra.run.smithi178.stdout: debug auth = 20 2024-09-12T00:14:41.992 INFO:teuthology.orchestra.run.smithi178.stdout: mon data avail warn = 5 2024-09-12T00:14:41.992 INFO:teuthology.orchestra.run.smithi178.stdout: mon mgr mkfs grace = 240 2024-09-12T00:14:41.993 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:14:41.993 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd reporter subtree level = osd 2024-09-12T00:14:41.993 INFO:teuthology.orchestra.run.smithi178.stdout: mon osd prime pg temp = true 2024-09-12T00:14:41.993 INFO:teuthology.orchestra.run.smithi178.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:14:41.993 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.993 INFO:teuthology.orchestra.run.smithi178.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:14:41.993 INFO:teuthology.orchestra.run.smithi178.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:14:41.993 INFO:teuthology.orchestra.run.smithi178.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:14:41.993 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.993 INFO:teuthology.orchestra.run.smithi178.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:14:41.993 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:14:41.993 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:14:41.993 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.994 INFO:teuthology.orchestra.run.smithi178.stdout: # 1m isn't quite enough 2024-09-12T00:14:41.994 INFO:teuthology.orchestra.run.smithi178.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:14:41.994 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.994 INFO:teuthology.orchestra.run.smithi178.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:14:41.994 INFO:teuthology.orchestra.run.smithi178.stdout: lockdep = True 2024-09-12T00:14:41.994 INFO:teuthology.orchestra.run.smithi178.stdout: 2024-09-12T00:14:41.994 INFO:teuthology.orchestra.run.smithi178.stdout:[client] 2024-09-12T00:14:41.994 INFO:teuthology.orchestra.run.smithi178.stdout: rgw cache enabled = true 2024-09-12T00:14:41.994 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable ops log = true 2024-09-12T00:14:41.994 INFO:teuthology.orchestra.run.smithi178.stdout: rgw enable usage log = true 2024-09-12T00:14:41.994 INFO:teuthology.orchestra.run.smithi178.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:14:41.994 INFO:teuthology.orchestra.run.smithi178.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:14:41.994 INFO:teuthology.orchestra.run.smithi178.stdout: debug rgw = 20 2024-09-12T00:14:41.995 INFO:teuthology.orchestra.run.smithi178.stdout: debug rgw notification = 20 2024-09-12T00:14:41.995 INFO:teuthology.orchestra.run.smithi178.stdout: rgw bucket counters cache = True 2024-09-12T00:14:41.995 INFO:teuthology.orchestra.run.smithi178.stdout: rgw crypt require ssl = False 2024-09-12T00:14:41.995 INFO:teuthology.orchestra.run.smithi178.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:14:41.995 INFO:teuthology.orchestra.run.smithi178.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:14:41.995 INFO:teuthology.orchestra.run.smithi178.stdout: rgw max chunk size = 4194304 2024-09-12T00:14:41.995 INFO:teuthology.orchestra.run.smithi178.stdout: rgw obj stripe size = 6291456 2024-09-12T00:14:41.995 INFO:teuthology.orchestra.run.smithi178.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:14:41.995 INFO:teuthology.orchestra.run.smithi178.stdout: rgw s3 auth use sts = True 2024-09-12T00:14:41.995 INFO:teuthology.orchestra.run.smithi178.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:14:41.995 INFO:teuthology.orchestra.run.smithi178.stdout: rgw torrent flag = True 2024-09-12T00:14:41.995 INFO:teuthology.orchestra.run.smithi178.stdout: rgw user counters cache = True 2024-09-12T00:14:41.996 INFO:teuthology.orchestra.run.smithi178.stdout: setgroup = ceph 2024-09-12T00:14:41.996 INFO:teuthology.orchestra.run.smithi178.stdout: setuser = ceph 2024-09-12T00:14:41.996 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.a] 2024-09-12T00:14:41.996 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.c] 2024-09-12T00:14:41.996 INFO:teuthology.orchestra.run.smithi178.stdout:[mon.b] 2024-09-12T00:14:41.996 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T00:14:41.996 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T00:14:42.079 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T00:14:42.080 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:14:42.080 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T00:14:42.085 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:14:42.085 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T00:14:42.131 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi138.front.sepia.ceph.com 2024-09-12T00:14:42.131 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:14:42.131 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:14:42.131 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:14:42.195 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:14:42.195 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:14:42.243 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi178.front.sepia.ceph.com 2024-09-12T00:14:42.243 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:14:42.243 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:14:42.244 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:14:42.268 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:14:42.268 DEBUG:teuthology.orchestra.run.smithi178:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:14:42.318 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T00:14:42.318 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T00:14:42.318 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:14:42.362 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:14:42.365 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:14:42.409 INFO:teuthology.orchestra.run.smithi178.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:14:42.416 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T00:14:42.416 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T00:14:42.416 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T00:14:42.453 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T00:14:42.465 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T00:14:42.500 INFO:teuthology.orchestra.run.smithi178.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T00:14:42.510 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T00:14:42.511 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi178.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:14:42.511 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T00:14:42.525 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:14:42.525 INFO:tasks.ceph:role: osd.0 2024-09-12T00:14:42.525 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-12T00:14:42.525 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:14:42.590 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:14:42.590 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:14:42.590 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:14:42.591 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:14:42.591 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:14:42.591 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:14:42.591 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:14:42.591 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:14:42.591 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:14:42.591 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:14:43.050 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-12T00:14:43.053 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-12T00:14:43.053 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T00:14:43.172 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T00:14:43.184 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:14:43.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:14:43.185 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T00:14:43.237 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:14:43.238 INFO:tasks.ceph:role: osd.1 2024-09-12T00:14:43.238 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-12T00:14:43.238 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:14:43.302 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:14:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:14:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:14:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:14:43.303 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:14:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:14:43.303 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:14:43.303 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:14:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:14:43.303 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:14:43.732 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-12T00:14:43.734 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-12T00:14:43.734 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T00:14:43.798 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T00:14:43.851 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:14:43.851 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:14:43.851 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T00:14:43.903 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:14:43.904 INFO:tasks.ceph:role: osd.2 2024-09-12T00:14:43.904 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-12T00:14:43.904 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:14:43.965 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:14:43.966 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:14:43.966 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:14:43.966 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:14:43.966 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:14:43.966 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:14:43.966 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:14:43.966 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:14:43.966 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:14:43.966 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:14:44.425 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-12T00:14:44.427 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-12T00:14:44.427 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T00:14:44.520 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T00:14:44.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:14:44.530 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:14:44.531 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T00:14:44.585 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:14:44.586 INFO:tasks.ceph:role: osd.3 2024-09-12T00:14:44.586 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-12T00:14:44.586 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:14:44.650 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:14:44.650 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:14:44.650 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:14:44.650 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:14:44.650 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:14:44.650 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:14:44.650 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:14:44.650 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:14:44.651 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:14:44.651 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:14:45.099 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-09-12T00:14:45.101 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-09-12T00:14:45.101 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T00:14:45.224 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T00:14:45.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:14:45.236 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:14:45.237 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:14:45.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:14:45.342+0000 7f8d596497c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T00:14:45.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:14:45.342+0000 7f8d596497c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T00:14:45.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:14:45.342+0000 7f8d596497c0 -1 bdev(0x5647ece81800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T00:14:45.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:14:45.346+0000 7f8d596497c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T00:14:48.471 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T00:14:48.485 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:14:48.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:14:48.566+0000 7fb16907f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T00:14:48.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:14:48.566+0000 7fb16907f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T00:14:48.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:14:48.566+0000 7fb16907f7c0 -1 bdev(0x5610d1235800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T00:14:48.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:14:48.566+0000 7fb16907f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T00:14:51.737 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T00:14:51.791 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:14:51.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:14:51.878+0000 7fb9839907c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T00:14:51.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:14:51.878+0000 7fb9839907c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T00:14:51.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:14:51.878+0000 7fb9839907c0 -1 bdev(0x56419f50f800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T00:14:51.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:14:51.878+0000 7fb9839907c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T00:14:54.998 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T00:14:55.053 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:14:55.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:14:55.142+0000 7fb22ff8b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T00:14:55.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:14:55.146+0000 7fb22ff8b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T00:14:55.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:14:55.146+0000 7fb22ff8b7c0 -1 bdev(0x5555d90c9800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T00:14:55.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:14:55.146+0000 7fb22ff8b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T00:14:58.302 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T00:14:58.363 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T00:14:58.378 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:14:58.378 INFO:tasks.ceph:role: osd.4 2024-09-12T00:14:58.378 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-12T00:14:58.379 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:14:58.435 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:14:58.435 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:14:58.435 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:14:58.436 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:14:58.436 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:14:58.436 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:14:58.436 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:14:58.436 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:14:58.436 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:14:58.436 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:14:58.461 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-09-12T00:14:58.462 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-09-12T00:14:58.462 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T00:14:58.524 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T00:14:58.574 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:14:58.575 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:14:58.575 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T00:14:58.628 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:14:58.628 INFO:tasks.ceph:role: osd.5 2024-09-12T00:14:58.629 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-12T00:14:58.629 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:14:58.685 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:14:58.686 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:14:58.686 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:14:58.686 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:14:58.686 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:14:58.686 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:14:58.686 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:14:58.686 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:14:58.686 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:14:58.686 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:14:58.707 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-09-12T00:14:58.709 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-09-12T00:14:58.709 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T00:14:58.772 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T00:14:58.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:14:58.826 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:14:58.826 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T00:14:58.878 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:14:58.878 INFO:tasks.ceph:role: osd.6 2024-09-12T00:14:58.878 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-12T00:14:58.878 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:14:58.933 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:14:58.933 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:14:58.933 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:14:58.933 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:14:58.933 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:14:58.933 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:14:58.933 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:14:58.933 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:14:58.933 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:14:58.933 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:14:58.956 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-09-12T00:14:58.958 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-09-12T00:14:58.958 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T00:14:59.014 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T00:14:59.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:14:59.065 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:14:59.066 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T00:14:59.121 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:14:59.121 INFO:tasks.ceph:role: osd.7 2024-09-12T00:14:59.121 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-12T00:14:59.121 DEBUG:teuthology.orchestra.run.smithi178:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:14:59.177 INFO:teuthology.orchestra.run.smithi178.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:14:59.181 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:14:59.181 INFO:teuthology.orchestra.run.smithi178.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:14:59.181 INFO:teuthology.orchestra.run.smithi178.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:14:59.181 INFO:teuthology.orchestra.run.smithi178.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:14:59.181 INFO:teuthology.orchestra.run.smithi178.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:14:59.182 INFO:teuthology.orchestra.run.smithi178.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:14:59.182 INFO:teuthology.orchestra.run.smithi178.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:14:59.182 INFO:teuthology.orchestra.run.smithi178.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:14:59.182 INFO:teuthology.orchestra.run.smithi178.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:14:59.201 INFO:teuthology.orchestra.run.smithi178.stdout:Discarding blocks...Done. 2024-09-12T00:14:59.203 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi178.front.sepia.ceph.com -o noatime 2024-09-12T00:14:59.203 DEBUG:teuthology.orchestra.run.smithi178:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T00:14:59.259 DEBUG:teuthology.orchestra.run.smithi178:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T00:14:59.309 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:14:59.309 INFO:teuthology.orchestra.run.smithi178.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:14:59.310 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:14:59.417 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-12T00:14:59.417+0000 7f0aa0bcd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T00:14:59.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-12T00:14:59.417+0000 7f0aa0bcd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T00:14:59.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-12T00:14:59.417+0000 7f0aa0bcd7c0 -1 bdev(0x55f6351b3800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T00:14:59.418 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-12T00:14:59.417+0000 7f0aa0bcd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T00:15:02.594 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T00:15:02.608 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:15:02.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-12T00:15:02.689+0000 7f40f37c57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T00:15:02.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-12T00:15:02.689+0000 7f40f37c57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T00:15:02.691 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-12T00:15:02.689+0000 7f40f37c57c0 -1 bdev(0x55e2cd565800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T00:15:02.692 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-12T00:15:02.689+0000 7f40f37c57c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T00:15:05.837 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T00:15:05.897 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:15:05.980 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-12T00:15:05.981+0000 7f76a207b7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T00:15:05.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-12T00:15:05.981+0000 7f76a207b7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T00:15:05.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-12T00:15:05.981+0000 7f76a207b7c0 -1 bdev(0x563c879fb800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T00:15:05.981 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-12T00:15:05.981+0000 7f76a207b7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T00:15:09.110 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T00:15:09.169 DEBUG:teuthology.orchestra.run.smithi178:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:15:09.251 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-12T00:15:09.249+0000 7f61a988d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T00:15:09.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-12T00:15:09.249+0000 7f61a988d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T00:15:09.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-12T00:15:09.249+0000 7f61a988d7c0 -1 bdev(0x5568f986f800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T00:15:09.252 INFO:teuthology.orchestra.run.smithi178.stderr:2024-09-12T00:15:09.249+0000 7f61a988d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T00:15:12.394 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T00:15:12.449 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T00:15:12.449 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:15:12.450 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T00:15:12.463 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:15:12.464 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T00:15:12.521 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:15:12.521 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T00:15:12.579 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:15:12.579 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T00:15:12.634 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:15:12.634 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T00:15:12.691 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:15:12.691 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T00:15:12.705 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:15:12.705 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T00:15:12.760 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:15:12.761 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T00:15:12.815 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:15:12.815 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T00:15:12.868 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:15:12.868 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T00:15:12.924 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:15:12.924 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T00:15:12.931 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:15:12.931 DEBUG:teuthology.orchestra.run.smithi178:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T00:15:12.973 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T00:15:12.981 DEBUG:teuthology.orchestra.run.smithi138:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:15:12.985 DEBUG:teuthology.orchestra.run.smithi178:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:15:13.028 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.y] 2024-09-12T00:15:13.029 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQByMuJm7+DkFRAAQlRqyZ/A3So4tsOIlBP1nQ== 2024-09-12T00:15:13.029 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.0] 2024-09-12T00:15:13.029 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQB1MuJmSG94FBAAUwOy/QSjcxVCDT+6rIaeDw== 2024-09-12T00:15:13.029 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.1] 2024-09-12T00:15:13.029 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQB4MuJm4LT7IRAAC6pcOpXgThfici7S9QzKgg== 2024-09-12T00:15:13.029 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.2] 2024-09-12T00:15:13.029 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQB7MuJm4wZ7NBAAzg79eT5N6hWLDN6o1vsaZQ== 2024-09-12T00:15:13.029 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.3] 2024-09-12T00:15:13.030 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQB/MuJm2oDECBAAHTPqlTRBTU0nJgboxXk6BQ== 2024-09-12T00:15:13.030 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.x] 2024-09-12T00:15:13.030 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQByMuJm2aiHGBAA57BQQIq1cSbQr53MwrYLcw== 2024-09-12T00:15:13.030 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.4] 2024-09-12T00:15:13.030 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCDMuJmamUAGRAAaKqPLvxqztcPbu8BnFbQIA== 2024-09-12T00:15:13.030 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.5] 2024-09-12T00:15:13.030 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCGMuJmgzROKRAALiaVHEvZrFSZBfWZZ6A9fQ== 2024-09-12T00:15:13.030 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.6] 2024-09-12T00:15:13.031 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCJMuJm7bmSOhAAg8x9a3YjVJC7WI+Q4rm34A== 2024-09-12T00:15:13.031 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.7] 2024-09-12T00:15:13.031 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQCNMuJmlFQdDxAASRS18J8vTocBWF08CmZuyw== 2024-09-12T00:15:13.031 INFO:teuthology.orchestra.run.smithi138.stdout:[client.0] 2024-09-12T00:15:13.031 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQByMuJm1pFQGxAAOuPGaOKc/oe4s9l4t/0Flw== 2024-09-12T00:15:13.031 INFO:teuthology.orchestra.run.smithi138.stdout:[client.1] 2024-09-12T00:15:13.031 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQByMuJmItvwHRAA3SZB2813tpFBYN0idnC7mQ== 2024-09-12T00:15:13.038 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr.y] 2024-09-12T00:15:13.038 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQByMuJm7+DkFRAAQlRqyZ/A3So4tsOIlBP1nQ== 2024-09-12T00:15:13.038 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.0] 2024-09-12T00:15:13.038 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB1MuJmSG94FBAAUwOy/QSjcxVCDT+6rIaeDw== 2024-09-12T00:15:13.038 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.1] 2024-09-12T00:15:13.038 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB4MuJm4LT7IRAAC6pcOpXgThfici7S9QzKgg== 2024-09-12T00:15:13.038 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.2] 2024-09-12T00:15:13.038 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB7MuJm4wZ7NBAAzg79eT5N6hWLDN6o1vsaZQ== 2024-09-12T00:15:13.039 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.3] 2024-09-12T00:15:13.039 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQB/MuJm2oDECBAAHTPqlTRBTU0nJgboxXk6BQ== 2024-09-12T00:15:13.039 INFO:teuthology.orchestra.run.smithi178.stdout:[mgr.x] 2024-09-12T00:15:13.039 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQByMuJm2aiHGBAA57BQQIq1cSbQr53MwrYLcw== 2024-09-12T00:15:13.039 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.4] 2024-09-12T00:15:13.039 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCDMuJmamUAGRAAaKqPLvxqztcPbu8BnFbQIA== 2024-09-12T00:15:13.039 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.5] 2024-09-12T00:15:13.040 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCGMuJmgzROKRAALiaVHEvZrFSZBfWZZ6A9fQ== 2024-09-12T00:15:13.040 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.6] 2024-09-12T00:15:13.040 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCJMuJm7bmSOhAAg8x9a3YjVJC7WI+Q4rm34A== 2024-09-12T00:15:13.040 INFO:teuthology.orchestra.run.smithi178.stdout:[osd.7] 2024-09-12T00:15:13.040 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQCNMuJmlFQdDxAASRS18J8vTocBWF08CmZuyw== 2024-09-12T00:15:13.040 INFO:teuthology.orchestra.run.smithi178.stdout:[client.0] 2024-09-12T00:15:13.040 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQByMuJm1pFQGxAAOuPGaOKc/oe4s9l4t/0Flw== 2024-09-12T00:15:13.040 INFO:teuthology.orchestra.run.smithi178.stdout:[client.1] 2024-09-12T00:15:13.040 INFO:teuthology.orchestra.run.smithi178.stdout: key = AQByMuJmItvwHRAA3SZB2813tpFBYN0idnC7mQ== 2024-09-12T00:15:13.043 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:15:13.098 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:15:13.145 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:15:13.188 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:15:13.234 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:15:13.271 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:15:13.325 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:15:13.359 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:15:13.401 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:15:13.451 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:15:13.495 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:15:13.539 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:15:13.584 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:15:13.623 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:15:13.669 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:15:13.707 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:15:13.755 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:15:13.787 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:15:13.841 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:15:13.867 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:15:13.928 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:15:13.947 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:15:14.016 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:15:14.031 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:15:14.107 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T00:15:14.108 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T00:15:14.124 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:15:14.213 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T00:15:14.225 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T00:15:14.280 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:15:14.366 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T00:15:14.377 DEBUG:teuthology.orchestra.run.smithi178:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T00:15:14.390 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:15:14.484 DEBUG:teuthology.orchestra.run.smithi178:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T00:15:14.497 DEBUG:teuthology.orchestra.run.smithi138:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:15:14.500 DEBUG:teuthology.orchestra.run.smithi178:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:15:14.545 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T00:15:14.545 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T00:15:14.545 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T00:15:14.548 INFO:tasks.ceph.mon.a:Started 2024-09-12T00:15:14.548 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T00:15:14.548 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T00:15:14.550 INFO:tasks.ceph.mon.c:Started 2024-09-12T00:15:14.550 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T00:15:14.550 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T00:15:14.589 INFO:tasks.ceph.mon.b:Started 2024-09-12T00:15:14.590 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T00:15:14.590 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T00:15:14.590 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T00:15:14.592 INFO:tasks.ceph.mgr.y:Started 2024-09-12T00:15:14.593 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T00:15:14.593 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T00:15:14.595 INFO:tasks.ceph.mgr.x:Started 2024-09-12T00:15:14.596 DEBUG:tasks.ceph:set 0 configs 2024-09-12T00:15:14.596 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T00:15:14.596 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T00:15:20.062 INFO:teuthology.orchestra.run.smithi138.stderr:adjusted tunables profile to default 2024-09-12T00:15:20.081 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T00:15:20.081 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T00:15:20.081 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:15:20.082 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T00:15:20.093 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:15:20.093 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T00:15:20.147 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:15:20.147 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T00:15:20.199 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:15:20.200 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T00:15:20.252 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:15:20.252 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T00:15:20.265 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:15:20.265 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T00:15:20.320 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:15:20.320 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T00:15:20.376 DEBUG:teuthology.orchestra.run.smithi178:> set -ex 2024-09-12T00:15:20.376 DEBUG:teuthology.orchestra.run.smithi178:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T00:15:20.432 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new d6c0d880-a1ba-432e-a77c-5808f1c17a87 0 2024-09-12T00:15:20.703 INFO:teuthology.orchestra.run.smithi178.stdout:0 2024-09-12T00:15:20.721 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new aef56edf-4581-434d-960b-e3892e3ca69f 1 2024-09-12T00:15:20.931 INFO:teuthology.orchestra.run.smithi178.stdout:1 2024-09-12T00:15:20.949 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new d6c33e6d-8b8f-4764-88bc-2cc19b88e5a2 2 2024-09-12T00:15:21.150 INFO:teuthology.orchestra.run.smithi178.stdout:2 2024-09-12T00:15:21.166 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 5141ce2d-e459-4787-a2c7-7e1d38f76caf 3 2024-09-12T00:15:21.365 INFO:teuthology.orchestra.run.smithi178.stdout:3 2024-09-12T00:15:21.381 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new 315e9645-3e31-45c9-b23f-febd5f82d1b9 4 2024-09-12T00:15:21.581 INFO:teuthology.orchestra.run.smithi178.stdout:4 2024-09-12T00:15:21.598 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new a2e5129b-d56e-46ef-af21-520fbf6eaf8d 5 2024-09-12T00:15:21.804 INFO:teuthology.orchestra.run.smithi178.stdout:5 2024-09-12T00:15:21.821 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new d6ac10c3-de6a-490a-84ad-a00d16d1def2 6 2024-09-12T00:15:22.021 INFO:teuthology.orchestra.run.smithi178.stdout:6 2024-09-12T00:15:22.038 DEBUG:teuthology.orchestra.run.smithi178:> sudo ceph --cluster ceph osd new e5a9abc6-25d2-4ebb-8970-a40dee5ea841 7 2024-09-12T00:15:22.237 INFO:teuthology.orchestra.run.smithi178.stdout:7 2024-09-12T00:15:22.253 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T00:15:22.253 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T00:15:22.256 INFO:tasks.ceph.osd.0:Started 2024-09-12T00:15:22.256 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T00:15:22.256 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T00:15:22.258 INFO:tasks.ceph.osd.1:Started 2024-09-12T00:15:22.259 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T00:15:22.259 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T00:15:22.261 INFO:tasks.ceph.osd.2:Started 2024-09-12T00:15:22.261 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T00:15:22.261 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T00:15:22.263 INFO:tasks.ceph.osd.3:Started 2024-09-12T00:15:22.263 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T00:15:22.263 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T00:15:22.265 INFO:tasks.ceph.osd.4:Started 2024-09-12T00:15:22.265 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T00:15:22.266 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T00:15:22.267 INFO:tasks.ceph.osd.5:Started 2024-09-12T00:15:22.267 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T00:15:22.268 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T00:15:22.270 INFO:tasks.ceph.osd.6:Started 2024-09-12T00:15:22.270 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T00:15:22.270 DEBUG:teuthology.orchestra.run.smithi178:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T00:15:22.272 INFO:tasks.ceph.osd.7:Started 2024-09-12T00:15:22.273 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:15:22.472 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:15:22.472 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":10,"fsid":"16f746b5-6307-4fbc-8384-d9f6a260b7cb","created":"2024-09-12T00:15:19.923397+0000","modified":"2024-09-12T00:15:22.239170+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:15:22.239170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d6c0d880-a1ba-432e-a77c-5808f1c17a87","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aef56edf-4581-434d-960b-e3892e3ca69f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d6c33e6d-8b8f-4764-88bc-2cc19b88e5a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5141ce2d-e459-4787-a2c7-7e1d38f76caf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"315e9645-3e31-45c9-b23f-febd5f82d1b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a2e5129b-d56e-46ef-af21-520fbf6eaf8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d6ac10c3-de6a-490a-84ad-a00d16d1def2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e5a9abc6-25d2-4ebb-8970-a40dee5ea841","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:15:22.488 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T00:15:22.489 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T00:15:22.924 INFO:tasks.ceph.mgr.x.smithi178.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T00:15:22.925 INFO:tasks.ceph.mgr.x.smithi178.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T00:15:22.925 INFO:tasks.ceph.mgr.x.smithi178.stderr: from numpy import show_config as show_numpy_config 2024-09-12T00:15:23.295 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:15:23.476 INFO:teuthology.misc.health.smithi138.stdout: 2024-09-12T00:15:23.476 INFO:teuthology.misc.health.smithi138.stdout:{"epoch":10,"fsid":"16f746b5-6307-4fbc-8384-d9f6a260b7cb","created":"2024-09-12T00:15:19.923397+0000","modified":"2024-09-12T00:15:22.239170+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:15:22.239170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d6c0d880-a1ba-432e-a77c-5808f1c17a87","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aef56edf-4581-434d-960b-e3892e3ca69f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d6c33e6d-8b8f-4764-88bc-2cc19b88e5a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5141ce2d-e459-4787-a2c7-7e1d38f76caf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"315e9645-3e31-45c9-b23f-febd5f82d1b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a2e5129b-d56e-46ef-af21-520fbf6eaf8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d6ac10c3-de6a-490a-84ad-a00d16d1def2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e5a9abc6-25d2-4ebb-8970-a40dee5ea841","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:15:23.492 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:15:23.551 INFO:tasks.ceph.mgr.y.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T00:15:23.551 INFO:tasks.ceph.mgr.y.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T00:15:23.551 INFO:tasks.ceph.mgr.y.smithi138.stderr: from numpy import show_config as show_numpy_config 2024-09-12T00:15:23.713 INFO:tasks.ceph.osd.5.smithi178.stderr:2024-09-12T00:15:23.713+0000 7fe1230e27c0 -1 Falling back to public interface 2024-09-12T00:15:23.910 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-12T00:15:23.914+0000 7f6d6c14b7c0 -1 Falling back to public interface 2024-09-12T00:15:23.945 INFO:tasks.ceph.osd.4.smithi178.stderr:2024-09-12T00:15:23.945+0000 7f81bdac07c0 -1 Falling back to public interface 2024-09-12T00:15:23.946 INFO:tasks.ceph.osd.6.smithi178.stderr:2024-09-12T00:15:23.945+0000 7f891fa897c0 -1 Falling back to public interface 2024-09-12T00:15:23.946 INFO:tasks.ceph.osd.7.smithi178.stderr:2024-09-12T00:15:23.945+0000 7f7b2b3137c0 -1 Falling back to public interface 2024-09-12T00:15:23.946 INFO:tasks.ceph.osd.6.smithi178.stderr:2024-09-12T00:15:23.945+0000 7f891ea49640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6811/0: (98) Address already in use 2024-09-12T00:15:23.950 INFO:tasks.ceph.osd.0.smithi138.stderr:2024-09-12T00:15:23.954+0000 7f0e47bb67c0 -1 Falling back to public interface 2024-09-12T00:15:24.147 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-09-12T00:15:24.150+0000 7f80f5f897c0 -1 Falling back to public interface 2024-09-12T00:15:24.179 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-09-12T00:15:24.182+0000 7f25659e27c0 -1 Falling back to public interface 2024-09-12T00:15:25.898 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-12T00:15:25.897+0000 7f64154f0640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T00:15:25.898 INFO:tasks.ceph.mgr.x.smithi178.stderr:2024-09-12T00:15:25.897+0000 7f64154f0640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T00:15:27.731 INFO:tasks.ceph.osd.5.smithi178.stderr:2024-09-12T00:15:27.729+0000 7fe1230e27c0 -1 osd.5 0 log_to_monitors true 2024-09-12T00:15:27.946 INFO:tasks.ceph.osd.7.smithi178.stderr:2024-09-12T00:15:27.945+0000 7f7b2b3137c0 -1 osd.7 0 log_to_monitors true 2024-09-12T00:15:27.952 INFO:tasks.ceph.osd.6.smithi178.stderr:2024-09-12T00:15:27.953+0000 7f891fa897c0 -1 osd.6 0 log_to_monitors true 2024-09-12T00:15:28.053 INFO:tasks.ceph.osd.4.smithi178.stderr:2024-09-12T00:15:28.053+0000 7f81bdac07c0 -1 osd.4 0 log_to_monitors true 2024-09-12T00:15:28.086 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-12T00:15:28.090+0000 7f6d6c14b7c0 -1 osd.1 0 log_to_monitors true 2024-09-12T00:15:28.096 INFO:tasks.ceph.osd.0.smithi138.stderr:2024-09-12T00:15:28.098+0000 7f0e47bb67c0 -1 osd.0 0 log_to_monitors true 2024-09-12T00:15:28.569 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-09-12T00:15:28.570+0000 7f80f5f897c0 -1 osd.2 0 log_to_monitors true 2024-09-12T00:15:28.975 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-09-12T00:15:28.978+0000 7f25659e27c0 -1 osd.3 0 log_to_monitors true 2024-09-12T00:15:30.058 INFO:tasks.ceph.osd.7.smithi178.stderr:2024-09-12T00:15:30.057+0000 7f7b272bc640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T00:15:30.062 INFO:tasks.ceph.osd.5.smithi178.stderr:2024-09-12T00:15:30.061+0000 7fe11f89d640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T00:15:30.089 INFO:tasks.ceph.osd.7.smithi178.stderr:2024-09-12T00:15:30.089+0000 7f7b1f0ee640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:15:30.101 INFO:tasks.ceph.osd.5.smithi178.stderr:2024-09-12T00:15:30.101+0000 7fe116ebd640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:15:30.299 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:15:30.638 INFO:teuthology.misc.health.smithi138.stdout: 2024-09-12T00:15:30.638 INFO:teuthology.misc.health.smithi138.stdout:{"epoch":13,"fsid":"16f746b5-6307-4fbc-8384-d9f6a260b7cb","created":"2024-09-12T00:15:19.923397+0000","modified":"2024-09-12T00:15:29.964538+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:15:22.239170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d6c0d880-a1ba-432e-a77c-5808f1c17a87","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aef56edf-4581-434d-960b-e3892e3ca69f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d6c33e6d-8b8f-4764-88bc-2cc19b88e5a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5141ce2d-e459-4787-a2c7-7e1d38f76caf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"315e9645-3e31-45c9-b23f-febd5f82d1b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a2e5129b-d56e-46ef-af21-520fbf6eaf8d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d6ac10c3-de6a-490a-84ad-a00d16d1def2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e5a9abc6-25d2-4ebb-8970-a40dee5ea841","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:15:30.660 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:15:30.968 INFO:tasks.ceph.osd.4.smithi178.stderr:2024-09-12T00:15:30.965+0000 7f81b9a69640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T00:15:30.972 INFO:tasks.ceph.osd.6.smithi178.stderr:2024-09-12T00:15:30.973+0000 7f891ba32640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T00:15:30.992 INFO:tasks.ceph.osd.4.smithi178.stderr:2024-09-12T00:15:30.993+0000 7f81b189b640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:15:31.008 INFO:tasks.ceph.osd.6.smithi178.stderr:2024-09-12T00:15:31.009+0000 7f8913864640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:15:31.721 INFO:tasks.ceph.osd.0.smithi138.stderr:2024-09-12T00:15:31.721+0000 7f0e44371640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:15:31.746 INFO:tasks.ceph.osd.0.smithi138.stderr:2024-09-12T00:15:31.749+0000 7f0e3b991640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:15:31.755 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-12T00:15:31.757+0000 7f6d680f4640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T00:15:31.790 INFO:tasks.ceph.osd.1.smithi138.stderr:2024-09-12T00:15:31.793+0000 7f6d5ff26640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:15:31.798 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-09-12T00:15:31.801+0000 7f80f1f32640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:15:31.823 INFO:tasks.ceph.osd.2.smithi138.stderr:2024-09-12T00:15:31.825+0000 7f80e9d64640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:15:32.179 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-09-12T00:15:32.181+0000 7f256198b640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:15:32.198 INFO:tasks.ceph.osd.3.smithi138.stderr:2024-09-12T00:15:32.201+0000 7f25597bd640 -1 osd.3 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:15:37.468 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:15:37.773 INFO:teuthology.misc.health.smithi138.stdout: 2024-09-12T00:15:37.773 INFO:teuthology.misc.health.smithi138.stdout:{"epoch":18,"fsid":"16f746b5-6307-4fbc-8384-d9f6a260b7cb","created":"2024-09-12T00:15:19.923397+0000","modified":"2024-09-12T00:15:35.038300+0000","last_up_change":"2024-09-12T00:15:33.032265+0000","last_in_change":"2024-09-12T00:15:22.239170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:15:32.937011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6c0d880-a1ba-432e-a77c-5808f1c17a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":276276685},{"type":"v1","addr":"172.21.15.138:6809","nonce":276276685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":276276685},{"type":"v1","addr":"172.21.15.138:6811","nonce":276276685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":276276685},{"type":"v1","addr":"172.21.15.138:6815","nonce":276276685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":276276685},{"type":"v1","addr":"172.21.15.138:6813","nonce":276276685}]},"public_addr":"172.21.15.138:6809/276276685","cluster_addr":"172.21.15.138:6811/276276685","heartbeat_back_addr":"172.21.15.138:6815/276276685","heartbeat_front_addr":"172.21.15.138:6813/276276685","state":["exists","up"]},{"osd":1,"uuid":"aef56edf-4581-434d-960b-e3892e3ca69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1437861584},{"type":"v1","addr":"172.21.15.138:6801","nonce":1437861584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1437861584},{"type":"v1","addr":"172.21.15.138:6803","nonce":1437861584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1437861584},{"type":"v1","addr":"172.21.15.138:6807","nonce":1437861584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1437861584},{"type":"v1","addr":"172.21.15.138:6805","nonce":1437861584}]},"public_addr":"172.21.15.138:6801/1437861584","cluster_addr":"172.21.15.138:6803/1437861584","heartbeat_back_addr":"172.21.15.138:6807/1437861584","heartbeat_front_addr":"172.21.15.138:6805/1437861584","state":["exists","up"]},{"osd":2,"uuid":"d6c33e6d-8b8f-4764-88bc-2cc19b88e5a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3496313381},{"type":"v1","addr":"172.21.15.138:6817","nonce":3496313381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3496313381},{"type":"v1","addr":"172.21.15.138:6819","nonce":3496313381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3496313381},{"type":"v1","addr":"172.21.15.138:6823","nonce":3496313381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3496313381},{"type":"v1","addr":"172.21.15.138:6821","nonce":3496313381}]},"public_addr":"172.21.15.138:6817/3496313381","cluster_addr":"172.21.15.138:6819/3496313381","heartbeat_back_addr":"172.21.15.138:6823/3496313381","heartbeat_front_addr":"172.21.15.138:6821/3496313381","state":["exists","up"]},{"osd":3,"uuid":"5141ce2d-e459-4787-a2c7-7e1d38f76caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":4021037468},{"type":"v1","addr":"172.21.15.138:6825","nonce":4021037468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":4021037468},{"type":"v1","addr":"172.21.15.138:6827","nonce":4021037468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":4021037468},{"type":"v1","addr":"172.21.15.138:6831","nonce":4021037468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4021037468},{"type":"v1","addr":"172.21.15.138:6829","nonce":4021037468}]},"public_addr":"172.21.15.138:6825/4021037468","cluster_addr":"172.21.15.138:6827/4021037468","heartbeat_back_addr":"172.21.15.138:6831/4021037468","heartbeat_front_addr":"172.21.15.138:6829/4021037468","state":["exists","up"]},{"osd":4,"uuid":"315e9645-3e31-45c9-b23f-febd5f82d1b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3653702099},{"type":"v1","addr":"172.21.15.178:6810","nonce":3653702099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":3653702099},{"type":"v1","addr":"172.21.15.178:6818","nonce":3653702099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6827","nonce":3653702099},{"type":"v1","addr":"172.21.15.178:6830","nonce":3653702099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":3653702099},{"type":"v1","addr":"172.21.15.178:6825","nonce":3653702099}]},"public_addr":"172.21.15.178:6810/3653702099","cluster_addr":"172.21.15.178:6818/3653702099","heartbeat_back_addr":"172.21.15.178:6830/3653702099","heartbeat_front_addr":"172.21.15.178:6825/3653702099","state":["exists","up"]},{"osd":5,"uuid":"a2e5129b-d56e-46ef-af21-520fbf6eaf8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":833505061},{"type":"v1","addr":"172.21.15.178:6801","nonce":833505061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":833505061},{"type":"v1","addr":"172.21.15.178:6803","nonce":833505061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":833505061},{"type":"v1","addr":"172.21.15.178:6807","nonce":833505061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":833505061},{"type":"v1","addr":"172.21.15.178:6805","nonce":833505061}]},"public_addr":"172.21.15.178:6801/833505061","cluster_addr":"172.21.15.178:6803/833505061","heartbeat_back_addr":"172.21.15.178:6807/833505061","heartbeat_front_addr":"172.21.15.178:6805/833505061","state":["exists","up"]},{"osd":6,"uuid":"d6ac10c3-de6a-490a-84ad-a00d16d1def2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":1109288734},{"type":"v1","addr":"172.21.15.178:6812","nonce":1109288734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1109288734},{"type":"v1","addr":"172.21.15.178:6817","nonce":1109288734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1109288734},{"type":"v1","addr":"172.21.15.178:6828","nonce":1109288734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":1109288734},{"type":"v1","addr":"172.21.15.178:6822","nonce":1109288734}]},"public_addr":"172.21.15.178:6812/1109288734","cluster_addr":"172.21.15.178:6817/1109288734","heartbeat_back_addr":"172.21.15.178:6828/1109288734","heartbeat_front_addr":"172.21.15.178:6822/1109288734","state":["exists","up"]},{"osd":7,"uuid":"e5a9abc6-25d2-4ebb-8970-a40dee5ea841","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2062234204},{"type":"v1","addr":"172.21.15.178:6813","nonce":2062234204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2062234204},{"type":"v1","addr":"172.21.15.178:6819","nonce":2062234204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":2062234204},{"type":"v1","addr":"172.21.15.178:6831","nonce":2062234204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6823","nonce":2062234204},{"type":"v1","addr":"172.21.15.178:6826","nonce":2062234204}]},"public_addr":"172.21.15.178:6813/2062234204","cluster_addr":"172.21.15.178:6819/2062234204","heartbeat_back_addr":"172.21.15.178:6831/2062234204","heartbeat_front_addr":"172.21.15.178:6826/2062234204","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.146991+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.082686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.550166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.961690+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.098585+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:28.735028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:28.930010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:28.942187+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:15:37.791 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T00:15:37.791 INFO:tasks.ceph:Creating RBD pool 2024-09-12T00:15:37.791 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T00:15:39.078 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'rbd' created 2024-09-12T00:15:39.103 DEBUG:teuthology.orchestra.run.smithi138:> rbd --cluster ceph pool init rbd 2024-09-12T00:15:39.149 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:39.149 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:42.102 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T00:15:42.103 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T00:15:42.103 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T00:15:42.463 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:15:42.481 INFO:teuthology.orchestra.run.smithi138.stdout:[{"version":9,"timestamp":"2024-09-12T00:15:32.185476+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"6237.261628"}]}] 2024-09-12T00:15:42.482 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T00:15:42.482 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T00:15:42.482 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T00:15:42.482 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T00:15:42.820 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:15:42.836 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6832","nonce":7055904},{"type":"v1","addr":"172.21.15.178:6833","nonce":7055904}]},"active_addr":"172.21.15.178:6833/7055904","active_change":"2024-09-12T00:15:24.874835+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":846019145}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":1470798679}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":613163492}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.178:0","nonce":21523685}]}]} 2024-09-12T00:15:42.841 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T00:15:42.841 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:15:42.841 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:15:43.143 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:15:43.143 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":22,"fsid":"16f746b5-6307-4fbc-8384-d9f6a260b7cb","created":"2024-09-12T00:15:19.923397+0000","modified":"2024-09-12T00:15:42.083124+0000","last_up_change":"2024-09-12T00:15:33.032265+0000","last_in_change":"2024-09-12T00:15:22.239170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:15:32.937011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:15:38.096683+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6c0d880-a1ba-432e-a77c-5808f1c17a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":276276685},{"type":"v1","addr":"172.21.15.138:6809","nonce":276276685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":276276685},{"type":"v1","addr":"172.21.15.138:6811","nonce":276276685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":276276685},{"type":"v1","addr":"172.21.15.138:6815","nonce":276276685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":276276685},{"type":"v1","addr":"172.21.15.138:6813","nonce":276276685}]},"public_addr":"172.21.15.138:6809/276276685","cluster_addr":"172.21.15.138:6811/276276685","heartbeat_back_addr":"172.21.15.138:6815/276276685","heartbeat_front_addr":"172.21.15.138:6813/276276685","state":["exists","up"]},{"osd":1,"uuid":"aef56edf-4581-434d-960b-e3892e3ca69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1437861584},{"type":"v1","addr":"172.21.15.138:6801","nonce":1437861584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1437861584},{"type":"v1","addr":"172.21.15.138:6803","nonce":1437861584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1437861584},{"type":"v1","addr":"172.21.15.138:6807","nonce":1437861584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1437861584},{"type":"v1","addr":"172.21.15.138:6805","nonce":1437861584}]},"public_addr":"172.21.15.138:6801/1437861584","cluster_addr":"172.21.15.138:6803/1437861584","heartbeat_back_addr":"172.21.15.138:6807/1437861584","heartbeat_front_addr":"172.21.15.138:6805/1437861584","state":["exists","up"]},{"osd":2,"uuid":"d6c33e6d-8b8f-4764-88bc-2cc19b88e5a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3496313381},{"type":"v1","addr":"172.21.15.138:6817","nonce":3496313381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3496313381},{"type":"v1","addr":"172.21.15.138:6819","nonce":3496313381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3496313381},{"type":"v1","addr":"172.21.15.138:6823","nonce":3496313381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3496313381},{"type":"v1","addr":"172.21.15.138:6821","nonce":3496313381}]},"public_addr":"172.21.15.138:6817/3496313381","cluster_addr":"172.21.15.138:6819/3496313381","heartbeat_back_addr":"172.21.15.138:6823/3496313381","heartbeat_front_addr":"172.21.15.138:6821/3496313381","state":["exists","up"]},{"osd":3,"uuid":"5141ce2d-e459-4787-a2c7-7e1d38f76caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":4021037468},{"type":"v1","addr":"172.21.15.138:6825","nonce":4021037468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":4021037468},{"type":"v1","addr":"172.21.15.138:6827","nonce":4021037468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":4021037468},{"type":"v1","addr":"172.21.15.138:6831","nonce":4021037468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4021037468},{"type":"v1","addr":"172.21.15.138:6829","nonce":4021037468}]},"public_addr":"172.21.15.138:6825/4021037468","cluster_addr":"172.21.15.138:6827/4021037468","heartbeat_back_addr":"172.21.15.138:6831/4021037468","heartbeat_front_addr":"172.21.15.138:6829/4021037468","state":["exists","up"]},{"osd":4,"uuid":"315e9645-3e31-45c9-b23f-febd5f82d1b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3653702099},{"type":"v1","addr":"172.21.15.178:6810","nonce":3653702099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":3653702099},{"type":"v1","addr":"172.21.15.178:6818","nonce":3653702099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6827","nonce":3653702099},{"type":"v1","addr":"172.21.15.178:6830","nonce":3653702099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":3653702099},{"type":"v1","addr":"172.21.15.178:6825","nonce":3653702099}]},"public_addr":"172.21.15.178:6810/3653702099","cluster_addr":"172.21.15.178:6818/3653702099","heartbeat_back_addr":"172.21.15.178:6830/3653702099","heartbeat_front_addr":"172.21.15.178:6825/3653702099","state":["exists","up"]},{"osd":5,"uuid":"a2e5129b-d56e-46ef-af21-520fbf6eaf8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":833505061},{"type":"v1","addr":"172.21.15.178:6801","nonce":833505061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":833505061},{"type":"v1","addr":"172.21.15.178:6803","nonce":833505061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":833505061},{"type":"v1","addr":"172.21.15.178:6807","nonce":833505061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":833505061},{"type":"v1","addr":"172.21.15.178:6805","nonce":833505061}]},"public_addr":"172.21.15.178:6801/833505061","cluster_addr":"172.21.15.178:6803/833505061","heartbeat_back_addr":"172.21.15.178:6807/833505061","heartbeat_front_addr":"172.21.15.178:6805/833505061","state":["exists","up"]},{"osd":6,"uuid":"d6ac10c3-de6a-490a-84ad-a00d16d1def2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":1109288734},{"type":"v1","addr":"172.21.15.178:6812","nonce":1109288734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1109288734},{"type":"v1","addr":"172.21.15.178:6817","nonce":1109288734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1109288734},{"type":"v1","addr":"172.21.15.178:6828","nonce":1109288734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":1109288734},{"type":"v1","addr":"172.21.15.178:6822","nonce":1109288734}]},"public_addr":"172.21.15.178:6812/1109288734","cluster_addr":"172.21.15.178:6817/1109288734","heartbeat_back_addr":"172.21.15.178:6828/1109288734","heartbeat_front_addr":"172.21.15.178:6822/1109288734","state":["exists","up"]},{"osd":7,"uuid":"e5a9abc6-25d2-4ebb-8970-a40dee5ea841","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2062234204},{"type":"v1","addr":"172.21.15.178:6813","nonce":2062234204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2062234204},{"type":"v1","addr":"172.21.15.178:6819","nonce":2062234204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":2062234204},{"type":"v1","addr":"172.21.15.178:6831","nonce":2062234204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6823","nonce":2062234204},{"type":"v1","addr":"172.21.15.178:6826","nonce":2062234204}]},"public_addr":"172.21.15.178:6813/2062234204","cluster_addr":"172.21.15.178:6819/2062234204","heartbeat_back_addr":"172.21.15.178:6831/2062234204","heartbeat_front_addr":"172.21.15.178:6826/2062234204","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.146991+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.082686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.550166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.961690+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.098585+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:28.735028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:28.930010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:28.942187+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:15:43.160 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:15:43.161 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:15:43.459 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:15:43.459 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":22,"fsid":"16f746b5-6307-4fbc-8384-d9f6a260b7cb","created":"2024-09-12T00:15:19.923397+0000","modified":"2024-09-12T00:15:42.083124+0000","last_up_change":"2024-09-12T00:15:33.032265+0000","last_in_change":"2024-09-12T00:15:22.239170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:15:32.937011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:15:38.096683+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6c0d880-a1ba-432e-a77c-5808f1c17a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":276276685},{"type":"v1","addr":"172.21.15.138:6809","nonce":276276685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":276276685},{"type":"v1","addr":"172.21.15.138:6811","nonce":276276685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":276276685},{"type":"v1","addr":"172.21.15.138:6815","nonce":276276685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":276276685},{"type":"v1","addr":"172.21.15.138:6813","nonce":276276685}]},"public_addr":"172.21.15.138:6809/276276685","cluster_addr":"172.21.15.138:6811/276276685","heartbeat_back_addr":"172.21.15.138:6815/276276685","heartbeat_front_addr":"172.21.15.138:6813/276276685","state":["exists","up"]},{"osd":1,"uuid":"aef56edf-4581-434d-960b-e3892e3ca69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1437861584},{"type":"v1","addr":"172.21.15.138:6801","nonce":1437861584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1437861584},{"type":"v1","addr":"172.21.15.138:6803","nonce":1437861584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1437861584},{"type":"v1","addr":"172.21.15.138:6807","nonce":1437861584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1437861584},{"type":"v1","addr":"172.21.15.138:6805","nonce":1437861584}]},"public_addr":"172.21.15.138:6801/1437861584","cluster_addr":"172.21.15.138:6803/1437861584","heartbeat_back_addr":"172.21.15.138:6807/1437861584","heartbeat_front_addr":"172.21.15.138:6805/1437861584","state":["exists","up"]},{"osd":2,"uuid":"d6c33e6d-8b8f-4764-88bc-2cc19b88e5a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3496313381},{"type":"v1","addr":"172.21.15.138:6817","nonce":3496313381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3496313381},{"type":"v1","addr":"172.21.15.138:6819","nonce":3496313381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3496313381},{"type":"v1","addr":"172.21.15.138:6823","nonce":3496313381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3496313381},{"type":"v1","addr":"172.21.15.138:6821","nonce":3496313381}]},"public_addr":"172.21.15.138:6817/3496313381","cluster_addr":"172.21.15.138:6819/3496313381","heartbeat_back_addr":"172.21.15.138:6823/3496313381","heartbeat_front_addr":"172.21.15.138:6821/3496313381","state":["exists","up"]},{"osd":3,"uuid":"5141ce2d-e459-4787-a2c7-7e1d38f76caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":4021037468},{"type":"v1","addr":"172.21.15.138:6825","nonce":4021037468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":4021037468},{"type":"v1","addr":"172.21.15.138:6827","nonce":4021037468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":4021037468},{"type":"v1","addr":"172.21.15.138:6831","nonce":4021037468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4021037468},{"type":"v1","addr":"172.21.15.138:6829","nonce":4021037468}]},"public_addr":"172.21.15.138:6825/4021037468","cluster_addr":"172.21.15.138:6827/4021037468","heartbeat_back_addr":"172.21.15.138:6831/4021037468","heartbeat_front_addr":"172.21.15.138:6829/4021037468","state":["exists","up"]},{"osd":4,"uuid":"315e9645-3e31-45c9-b23f-febd5f82d1b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3653702099},{"type":"v1","addr":"172.21.15.178:6810","nonce":3653702099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":3653702099},{"type":"v1","addr":"172.21.15.178:6818","nonce":3653702099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6827","nonce":3653702099},{"type":"v1","addr":"172.21.15.178:6830","nonce":3653702099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":3653702099},{"type":"v1","addr":"172.21.15.178:6825","nonce":3653702099}]},"public_addr":"172.21.15.178:6810/3653702099","cluster_addr":"172.21.15.178:6818/3653702099","heartbeat_back_addr":"172.21.15.178:6830/3653702099","heartbeat_front_addr":"172.21.15.178:6825/3653702099","state":["exists","up"]},{"osd":5,"uuid":"a2e5129b-d56e-46ef-af21-520fbf6eaf8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":833505061},{"type":"v1","addr":"172.21.15.178:6801","nonce":833505061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":833505061},{"type":"v1","addr":"172.21.15.178:6803","nonce":833505061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":833505061},{"type":"v1","addr":"172.21.15.178:6807","nonce":833505061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":833505061},{"type":"v1","addr":"172.21.15.178:6805","nonce":833505061}]},"public_addr":"172.21.15.178:6801/833505061","cluster_addr":"172.21.15.178:6803/833505061","heartbeat_back_addr":"172.21.15.178:6807/833505061","heartbeat_front_addr":"172.21.15.178:6805/833505061","state":["exists","up"]},{"osd":6,"uuid":"d6ac10c3-de6a-490a-84ad-a00d16d1def2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":1109288734},{"type":"v1","addr":"172.21.15.178:6812","nonce":1109288734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1109288734},{"type":"v1","addr":"172.21.15.178:6817","nonce":1109288734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1109288734},{"type":"v1","addr":"172.21.15.178:6828","nonce":1109288734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":1109288734},{"type":"v1","addr":"172.21.15.178:6822","nonce":1109288734}]},"public_addr":"172.21.15.178:6812/1109288734","cluster_addr":"172.21.15.178:6817/1109288734","heartbeat_back_addr":"172.21.15.178:6828/1109288734","heartbeat_front_addr":"172.21.15.178:6822/1109288734","state":["exists","up"]},{"osd":7,"uuid":"e5a9abc6-25d2-4ebb-8970-a40dee5ea841","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2062234204},{"type":"v1","addr":"172.21.15.178:6813","nonce":2062234204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2062234204},{"type":"v1","addr":"172.21.15.178:6819","nonce":2062234204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":2062234204},{"type":"v1","addr":"172.21.15.178:6831","nonce":2062234204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6823","nonce":2062234204},{"type":"v1","addr":"172.21.15.178:6826","nonce":2062234204}]},"public_addr":"172.21.15.178:6813/2062234204","cluster_addr":"172.21.15.178:6819/2062234204","heartbeat_back_addr":"172.21.15.178:6831/2062234204","heartbeat_front_addr":"172.21.15.178:6826/2062234204","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.146991+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.082686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.550166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.961690+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.098585+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:28.735028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:28.930010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:28.942187+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:15:43.478 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:15:43.478 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:15:43.479 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:15:43.479 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:15:43.479 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T00:15:43.480 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T00:15:43.480 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T00:15:43.481 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T00:15:43.743 INFO:teuthology.orchestra.run.smithi138.stdout:64424509446 2024-09-12T00:15:43.743 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:15:43.744 INFO:teuthology.orchestra.run.smithi138.stdout:68719476740 2024-09-12T00:15:43.745 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:15:43.745 INFO:teuthology.orchestra.run.smithi138.stdout:60129542150 2024-09-12T00:15:43.746 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:15:43.752 INFO:teuthology.orchestra.run.smithi138.stdout:64424509446 2024-09-12T00:15:43.753 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:15:43.755 INFO:teuthology.orchestra.run.smithi138.stdout:64424509447 2024-09-12T00:15:43.755 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:15:43.757 INFO:teuthology.orchestra.run.smithi138.stdout:60129542150 2024-09-12T00:15:43.758 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:15:43.759 INFO:teuthology.orchestra.run.smithi138.stdout:64424509446 2024-09-12T00:15:43.760 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:15:43.761 INFO:teuthology.orchestra.run.smithi138.stdout:64424509447 2024-09-12T00:15:43.762 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:15:44.246 INFO:teuthology.orchestra.run.smithi138.stdout:64424509444 2024-09-12T00:15:44.269 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.0 2024-09-12T00:15:44.280 INFO:teuthology.orchestra.run.smithi138.stdout:68719476739 2024-09-12T00:15:44.302 INFO:teuthology.orchestra.run.smithi138.stdout:64424509444 2024-09-12T00:15:44.305 INFO:teuthology.orchestra.run.smithi138.stdout:64424509445 2024-09-12T00:15:44.306 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476740 got 68719476739 for osd.3 2024-09-12T00:15:44.308 INFO:teuthology.orchestra.run.smithi138.stdout:64424509444 2024-09-12T00:15:44.314 INFO:teuthology.orchestra.run.smithi138.stdout:60129542149 2024-09-12T00:15:44.329 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.4 2024-09-12T00:15:44.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.6 2024-09-12T00:15:44.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.1 2024-09-12T00:15:44.344 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.5 2024-09-12T00:15:44.357 INFO:teuthology.orchestra.run.smithi138.stdout:60129542149 2024-09-12T00:15:44.364 INFO:teuthology.orchestra.run.smithi138.stdout:64424509445 2024-09-12T00:15:44.376 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.7 2024-09-12T00:15:44.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.2 2024-09-12T00:15:45.270 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:15:45.306 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:15:45.330 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:15:45.332 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:15:45.342 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:15:45.345 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:15:45.377 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:15:45.382 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:15:45.745 INFO:teuthology.orchestra.run.smithi138.stdout:64424509446 2024-09-12T00:15:45.774 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2024-09-12T00:15:45.774 DEBUG:teuthology.parallel:result is None 2024-09-12T00:15:45.852 INFO:teuthology.orchestra.run.smithi138.stdout:60129542150 2024-09-12T00:15:45.853 INFO:teuthology.orchestra.run.smithi138.stdout:68719476741 2024-09-12T00:15:45.881 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-09-12T00:15:45.881 DEBUG:teuthology.parallel:result is None 2024-09-12T00:15:45.883 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476740 got 68719476741 for osd.3 2024-09-12T00:15:45.883 INFO:teuthology.orchestra.run.smithi138.stdout:64424509446 2024-09-12T00:15:45.883 DEBUG:teuthology.parallel:result is None 2024-09-12T00:15:45.892 INFO:teuthology.orchestra.run.smithi138.stdout:64424509447 2024-09-12T00:15:45.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-09-12T00:15:45.909 DEBUG:teuthology.parallel:result is None 2024-09-12T00:15:45.919 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-09-12T00:15:45.919 DEBUG:teuthology.parallel:result is None 2024-09-12T00:15:45.920 INFO:teuthology.orchestra.run.smithi138.stdout:64424509446 2024-09-12T00:15:45.924 INFO:teuthology.orchestra.run.smithi138.stdout:60129542150 2024-09-12T00:15:45.940 INFO:teuthology.orchestra.run.smithi138.stdout:64424509447 2024-09-12T00:15:45.941 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-09-12T00:15:45.942 DEBUG:teuthology.parallel:result is None 2024-09-12T00:15:45.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.7 2024-09-12T00:15:45.944 DEBUG:teuthology.parallel:result is None 2024-09-12T00:15:45.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.2 2024-09-12T00:15:45.957 DEBUG:teuthology.parallel:result is None 2024-09-12T00:15:45.957 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:15:45.958 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:15:46.278 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:15:46.278 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-12T00:15:46.295 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-12T00:15:44.883224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252412,"kb_used_data":2872,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722308,"statfs":{"total":773094113280,"available":772835643392,"internally_reserved":0,"allocated":2940928,"data_stored":1770582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.806303"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:42.091675+0000","last_change":"2024-09-12T00:15:42.091675+0000","last_active":"2024-09-12T00:15:42.091675+0000","last_peered":"2024-09-12T00:15:42.091675+0000","last_clean":"2024-09-12T00:15:42.091675+0000","last_became_active":"2024-09-12T00:15:40.663617+0000","last_became_peered":"2024-09-12T00:15:40.663617+0000","last_unstale":"2024-09-12T00:15:42.091675+0000","last_undegraded":"2024-09-12T00:15:42.091675+0000","last_fullsized":"2024-09-12T00:15:42.091675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:31.309528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002428801,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:42.117262+0000","last_change":"2024-09-12T00:15:42.117262+0000","last_active":"2024-09-12T00:15:42.117262+0000","last_peered":"2024-09-12T00:15:42.117262+0000","last_clean":"2024-09-12T00:15:42.117262+0000","last_became_active":"2024-09-12T00:15:40.660718+0000","last_became_peered":"2024-09-12T00:15:40.660718+0000","last_unstale":"2024-09-12T00:15:42.117262+0000","last_undegraded":"2024-09-12T00:15:42.117262+0000","last_fullsized":"2024-09-12T00:15:42.117262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:04.909588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080064100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:42.091937+0000","last_change":"2024-09-12T00:15:42.091937+0000","last_active":"2024-09-12T00:15:42.091937+0000","last_peered":"2024-09-12T00:15:42.091937+0000","last_clean":"2024-09-12T00:15:42.091937+0000","last_became_active":"2024-09-12T00:15:40.093718+0000","last_became_peered":"2024-09-12T00:15:40.093718+0000","last_unstale":"2024-09-12T00:15:42.091937+0000","last_undegraded":"2024-09-12T00:15:42.091937+0000","last_fullsized":"2024-09-12T00:15:42.091937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:26.233329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001992522,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:42.087562+0000","last_change":"2024-09-12T00:15:42.088087+0000","last_active":"2024-09-12T00:15:42.087562+0000","last_peered":"2024-09-12T00:15:42.087562+0000","last_clean":"2024-09-12T00:15:42.087562+0000","last_became_active":"2024-09-12T00:15:40.141037+0000","last_became_peered":"2024-09-12T00:15:40.141037+0000","last_unstale":"2024-09-12T00:15:42.087562+0000","last_undegraded":"2024-09-12T00:15:42.087562+0000","last_fullsized":"2024-09-12T00:15:42.087562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:30.931343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088972300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:42.096162+0000","last_change":"2024-09-12T00:15:42.091191+0000","last_active":"2024-09-12T00:15:42.096162+0000","last_peered":"2024-09-12T00:15:42.096162+0000","last_clean":"2024-09-12T00:15:42.096162+0000","last_became_active":"2024-09-12T00:15:40.144614+0000","last_became_peered":"2024-09-12T00:15:40.144614+0000","last_unstale":"2024-09-12T00:15:42.096162+0000","last_undegraded":"2024-09-12T00:15:42.096162+0000","last_fullsized":"2024-09-12T00:15:42.096162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:01.463335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019634679999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:43.064948+0000","last_change":"2024-09-12T00:15:43.065460+0000","last_active":"2024-09-12T00:15:43.064948+0000","last_peered":"2024-09-12T00:15:43.064948+0000","last_clean":"2024-09-12T00:15:43.064948+0000","last_became_active":"2024-09-12T00:15:40.095888+0000","last_became_peered":"2024-09-12T00:15:40.095888+0000","last_unstale":"2024-09-12T00:15:43.064948+0000","last_undegraded":"2024-09-12T00:15:43.064948+0000","last_fullsized":"2024-09-12T00:15:43.064948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:49.939912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000883303,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:42.090908+0000","last_change":"2024-09-12T00:15:42.090908+0000","last_active":"2024-09-12T00:15:42.090908+0000","last_peered":"2024-09-12T00:15:42.090908+0000","last_clean":"2024-09-12T00:15:42.090908+0000","last_became_active":"2024-09-12T00:15:40.098303+0000","last_became_peered":"2024-09-12T00:15:40.098303+0000","last_unstale":"2024-09-12T00:15:42.090908+0000","last_undegraded":"2024-09-12T00:15:42.090908+0000","last_fullsized":"2024-09-12T00:15:42.090908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:40.232317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017858660000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:42.090501+0000","last_change":"2024-09-12T00:15:42.090501+0000","last_active":"2024-09-12T00:15:42.090501+0000","last_peered":"2024-09-12T00:15:42.090501+0000","last_clean":"2024-09-12T00:15:42.090501+0000","last_became_active":"2024-09-12T00:15:40.490486+0000","last_became_peered":"2024-09-12T00:15:40.490486+0000","last_unstale":"2024-09-12T00:15:42.090501+0000","last_undegraded":"2024-09-12T00:15:42.090501+0000","last_fullsized":"2024-09-12T00:15:42.090501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:41.969157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013201490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:42.090033+0000","last_change":"2024-09-12T00:15:34.148103+0000","last_active":"2024-09-12T00:15:42.090033+0000","last_peered":"2024-09-12T00:15:42.090033+0000","last_clean":"2024-09-12T00:15:42.090033+0000","last_became_active":"2024-09-12T00:15:34.145413+0000","last_became_peered":"2024-09-12T00:15:34.145413+0000","last_unstale":"2024-09-12T00:15:42.090033+0000","last_undegraded":"2024-09-12T00:15:42.090033+0000","last_fullsized":"2024-09-12T00:15:42.090033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.032265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.032265+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.032265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:37.582882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476741,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":75203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336264,"statfs":{"total":96636764160,"available":96600334336,"internally_reserved":0,"allocated":225280,"data_stored":75203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":221184,"data_stored":75184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":665552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":69352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":69352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36144,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335696,"statfs":{"total":96636764160,"available":96599752704,"internally_reserved":0,"allocated":815104,"data_stored":665552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:15:46.296 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:15:46.579 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:15:46.580 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-12T00:15:46.596 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-12T00:15:44.883224+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252412,"kb_used_data":2872,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722308,"statfs":{"total":773094113280,"available":772835643392,"internally_reserved":0,"allocated":2940928,"data_stored":1770582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.806303"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:42.091675+0000","last_change":"2024-09-12T00:15:42.091675+0000","last_active":"2024-09-12T00:15:42.091675+0000","last_peered":"2024-09-12T00:15:42.091675+0000","last_clean":"2024-09-12T00:15:42.091675+0000","last_became_active":"2024-09-12T00:15:40.663617+0000","last_became_peered":"2024-09-12T00:15:40.663617+0000","last_unstale":"2024-09-12T00:15:42.091675+0000","last_undegraded":"2024-09-12T00:15:42.091675+0000","last_fullsized":"2024-09-12T00:15:42.091675+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:31.309528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002428801,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:42.117262+0000","last_change":"2024-09-12T00:15:42.117262+0000","last_active":"2024-09-12T00:15:42.117262+0000","last_peered":"2024-09-12T00:15:42.117262+0000","last_clean":"2024-09-12T00:15:42.117262+0000","last_became_active":"2024-09-12T00:15:40.660718+0000","last_became_peered":"2024-09-12T00:15:40.660718+0000","last_unstale":"2024-09-12T00:15:42.117262+0000","last_undegraded":"2024-09-12T00:15:42.117262+0000","last_fullsized":"2024-09-12T00:15:42.117262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:04.909588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080064100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:42.091937+0000","last_change":"2024-09-12T00:15:42.091937+0000","last_active":"2024-09-12T00:15:42.091937+0000","last_peered":"2024-09-12T00:15:42.091937+0000","last_clean":"2024-09-12T00:15:42.091937+0000","last_became_active":"2024-09-12T00:15:40.093718+0000","last_became_peered":"2024-09-12T00:15:40.093718+0000","last_unstale":"2024-09-12T00:15:42.091937+0000","last_undegraded":"2024-09-12T00:15:42.091937+0000","last_fullsized":"2024-09-12T00:15:42.091937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:26.233329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001992522,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:42.087562+0000","last_change":"2024-09-12T00:15:42.088087+0000","last_active":"2024-09-12T00:15:42.087562+0000","last_peered":"2024-09-12T00:15:42.087562+0000","last_clean":"2024-09-12T00:15:42.087562+0000","last_became_active":"2024-09-12T00:15:40.141037+0000","last_became_peered":"2024-09-12T00:15:40.141037+0000","last_unstale":"2024-09-12T00:15:42.087562+0000","last_undegraded":"2024-09-12T00:15:42.087562+0000","last_fullsized":"2024-09-12T00:15:42.087562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:30.931343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088972300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:42.096162+0000","last_change":"2024-09-12T00:15:42.091191+0000","last_active":"2024-09-12T00:15:42.096162+0000","last_peered":"2024-09-12T00:15:42.096162+0000","last_clean":"2024-09-12T00:15:42.096162+0000","last_became_active":"2024-09-12T00:15:40.144614+0000","last_became_peered":"2024-09-12T00:15:40.144614+0000","last_unstale":"2024-09-12T00:15:42.096162+0000","last_undegraded":"2024-09-12T00:15:42.096162+0000","last_fullsized":"2024-09-12T00:15:42.096162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:01.463335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019634679999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:43.064948+0000","last_change":"2024-09-12T00:15:43.065460+0000","last_active":"2024-09-12T00:15:43.064948+0000","last_peered":"2024-09-12T00:15:43.064948+0000","last_clean":"2024-09-12T00:15:43.064948+0000","last_became_active":"2024-09-12T00:15:40.095888+0000","last_became_peered":"2024-09-12T00:15:40.095888+0000","last_unstale":"2024-09-12T00:15:43.064948+0000","last_undegraded":"2024-09-12T00:15:43.064948+0000","last_fullsized":"2024-09-12T00:15:43.064948+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:49.939912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000883303,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:42.090908+0000","last_change":"2024-09-12T00:15:42.090908+0000","last_active":"2024-09-12T00:15:42.090908+0000","last_peered":"2024-09-12T00:15:42.090908+0000","last_clean":"2024-09-12T00:15:42.090908+0000","last_became_active":"2024-09-12T00:15:40.098303+0000","last_became_peered":"2024-09-12T00:15:40.098303+0000","last_unstale":"2024-09-12T00:15:42.090908+0000","last_undegraded":"2024-09-12T00:15:42.090908+0000","last_fullsized":"2024-09-12T00:15:42.090908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:40.232317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017858660000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:42.090501+0000","last_change":"2024-09-12T00:15:42.090501+0000","last_active":"2024-09-12T00:15:42.090501+0000","last_peered":"2024-09-12T00:15:42.090501+0000","last_clean":"2024-09-12T00:15:42.090501+0000","last_became_active":"2024-09-12T00:15:40.490486+0000","last_became_peered":"2024-09-12T00:15:40.490486+0000","last_unstale":"2024-09-12T00:15:42.090501+0000","last_undegraded":"2024-09-12T00:15:42.090501+0000","last_fullsized":"2024-09-12T00:15:42.090501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:41.969157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013201490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:15:42.090033+0000","last_change":"2024-09-12T00:15:34.148103+0000","last_active":"2024-09-12T00:15:42.090033+0000","last_peered":"2024-09-12T00:15:42.090033+0000","last_clean":"2024-09-12T00:15:42.090033+0000","last_became_active":"2024-09-12T00:15:34.145413+0000","last_became_peered":"2024-09-12T00:15:34.145413+0000","last_unstale":"2024-09-12T00:15:42.090033+0000","last_undegraded":"2024-09-12T00:15:42.090033+0000","last_fullsized":"2024-09-12T00:15:42.090033+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.032265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.032265+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.032265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:37.582882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719476741,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":75203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35576,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336264,"statfs":{"total":96636764160,"available":96600334336,"internally_reserved":0,"allocated":225280,"data_stored":75203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35568,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336272,"statfs":{"total":96636764160,"available":96600342528,"internally_reserved":0,"allocated":221184,"data_stored":75184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":75184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":815104,"data_stored":665552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":69352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35560,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336280,"statfs":{"total":96636764160,"available":96600350720,"internally_reserved":0,"allocated":208896,"data_stored":69352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36144,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335696,"statfs":{"total":96636764160,"available":96599752704,"internally_reserved":0,"allocated":815104,"data_stored":665552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:15:46.597 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:15:46.598 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T00:15:46.598 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T00:15:46.598 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T00:15:46.908 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:15:46.908 INFO:teuthology.orchestra.run.smithi138.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T00:15:46.925 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T00:15:46.926 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T00:15:46.947 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-12T00:15:46.948 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:15:46.953 DEBUG:teuthology.orchestra.run.smithi138:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-12T00:15:47.418 INFO:teuthology.orchestra.run.smithi138.stderr:......+....+...........+...+...+...+.+..............+.........+.+.....+.........+.......+...+...+..+.......+...+..+....+..+...+....+..+.+...+.........+......+.....+....+.....+.+.....+....+...+...+.................+.........+.+.....+.........+.........+....+..+.+.....+....+...+..+.............+...+.........+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...+....+...........+...+.......+...+...+.....+.......+..+......+.........+..........+........+.......+.........+.....+......+.+..+.+..+...+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+......+...............+....+...+.....+......+....+...........+.......+...+......+..............+......+.........+.+.....+....+..+.........+.+.................+.+....................+.+........+.......+.....+...+......+.+......+..+...+...+..........+.....+......+.+...+..........................................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:15:47.902 INFO:teuthology.orchestra.run.smithi138.stderr:.............+.......+..+..........+..+.+..+......+......+....+..+.......+...+...+.............................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.....................+.+..+..........+.....+..........+...........+.+........+.+...........+.........+.+...............+.....+......+.......+...+..................+..+.......+.....+.+......+......+...+......+.....................+..+..........+...............+........+.......+..+...+...+....+.........+.....+.+.....+.+..+..................+.......................................+.+.....+.........................+........+.+..............+...............+.+......+...........................+...+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:15:47.918 INFO:teuthology.orchestra.run.smithi138.stderr:----- 2024-09-12T00:15:47.926 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/local/share/ca-certificates/root.crt 2024-09-12T00:15:47.994 DEBUG:teuthology.orchestra.run.smithi138:> sudo update-ca-certificates 2024-09-12T00:15:48.056 INFO:teuthology.orchestra.run.smithi138.stdout:Updating certificates in /etc/ssl/certs... 2024-09-12T00:15:48.684 INFO:teuthology.orchestra.run.smithi138.stderr:rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2024-09-12T00:15:48.706 INFO:teuthology.orchestra.run.smithi138.stdout:1 added, 0 removed; done. 2024-09-12T00:15:48.711 INFO:teuthology.orchestra.run.smithi138.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-12T00:15:48.715 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:15:50.413 INFO:teuthology.orchestra.run.smithi138.stdout:Adding debian:root.pem 2024-09-12T00:15:50.439 INFO:teuthology.orchestra.run.smithi138.stdout:done. 2024-09-12T00:15:50.439 INFO:teuthology.orchestra.run.smithi138.stdout:done. 2024-09-12T00:15:50.444 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:15:50.490 DEBUG:teuthology.orchestra.run.smithi138:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi138.front.sepia.ceph.com 2024-09-12T00:15:50.599 INFO:teuthology.orchestra.run.smithi138.stderr:.....+...+...+..+....+...+......+.....+.+........+...+....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*..+.....+.+..+.+..+...+......+.+..............+.+...+..+...+..........+......+...+.......................+....+......+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:15:50.637 INFO:teuthology.orchestra.run.smithi138.stderr:...........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+..+.+..............+.+...+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+....+.....+.......+...+........+.........+...+...+....+.........+..............+.+...........+.+..+.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-09-12T00:15:50.640 INFO:teuthology.orchestra.run.smithi138.stderr:----- 2024-09-12T00:15:50.644 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:15:50.644 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:15:50.689 DEBUG:teuthology.orchestra.run.smithi138:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:15:50.741 INFO:teuthology.orchestra.run.smithi138.stderr:Certificate request self-signature ok 2024-09-12T00:15:50.741 INFO:teuthology.orchestra.run.smithi138.stderr:subject=CN = smithi138.front.sepia.ceph.com 2024-09-12T00:15:50.753 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:15:50.802 DEBUG:teuthology.orchestra.run.smithi138:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:15:50.854 INFO:teuthology.orchestra.run.smithi138.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-12T00:15:50.855 DEBUG:teuthology.orchestra.run.smithi138:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:15:50.903 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T00:15:50.927 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0'}} 2024-09-12T00:15:50.927 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T00:15:50.927 INFO:tasks.rgw:Creating data pools 2024-09-12T00:15:50.927 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T00:15:50.927 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-12T00:15:51.980 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T00:15:53.971 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T00:15:54.017 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T00:15:54.981 INFO:teuthology.orchestra.run.smithi138.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T00:15:55.059 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T00:15:55.985 INFO:teuthology.orchestra.run.smithi138.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T00:15:56.016 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T00:15:57.001 INFO:teuthology.orchestra.run.smithi138.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T00:15:57.043 DEBUG:tasks.rgw:Pools created 2024-09-12T00:15:57.044 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T00:15:57.044 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:15:57.044 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:15:57.044 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:15:57.092 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:15:57.092 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:15:59.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.092+0000 7f0b81a3b640 0 -- >> [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] conn(0x560f22450ed0 msgr2=0x560f22451350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2024-09-12T00:15:59.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.096+0000 7f0b83f359c0 20 rados->read ofs=0 len=0 2024-09-12T00:15:59.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.100+0000 7f0b81a3b640 0 -- 172.21.15.138:0/88045437 >> [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] conn(0x7f0a48070ae0 msgr2=0x7f0a48072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:15:59.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.100+0000 7f0b83f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:59.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.100+0000 7f0b83f359c0 20 realm 2024-09-12T00:15:59.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.100+0000 7f0b83f359c0 20 rados->read ofs=0 len=0 2024-09-12T00:15:59.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.100+0000 7f0b83f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:59.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.100+0000 7f0b83f359c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:15:59.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.100+0000 7f0b83f359c0 20 rados->read ofs=0 len=0 2024-09-12T00:15:59.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.100+0000 7f0b83f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:59.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.100+0000 7f0b83f359c0 20 rados->read ofs=0 len=0 2024-09-12T00:15:59.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.100+0000 7f0b83f359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:59.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.100+0000 7f0b83f359c0 20 rados->read ofs=0 len=0 2024-09-12T00:15:59.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.104+0000 7f0b83f359c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:15:59.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.104+0000 7f0b83f359c0 20 searching for the correct realm 2024-09-12T00:15:59.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.120+0000 7f0b83f359c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.120+0000 7f0b83f359c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.120+0000 7f0b83f359c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.120+0000 7f0b83f359c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.120+0000 7f0b83f359c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.120+0000 7f0b83f359c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.120+0000 7f0b83f359c0 20 rados->read ofs=0 len=0 2024-09-12T00:15:59.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.124+0000 7f0b83f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:59.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.124+0000 7f0b83f359c0 20 rados->read ofs=0 len=0 2024-09-12T00:15:59.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.124+0000 7f0b83f359c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:15:59.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.124+0000 7f0b83f359c0 20 rados->read ofs=0 len=0 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.124+0000 7f0b83f359c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.124+0000 7f0b83f359c0 20 zone default found 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.124+0000 7f0b83f359c0 4 Realm: () 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.124+0000 7f0b83f359c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.124+0000 7f0b83f359c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.124+0000 7f0b83f359c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.124+0000 7f0b83f359c0 20 zonegroup default 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.124+0000 7f0b83f359c0 20 rados->read ofs=0 len=0 2024-09-12T00:15:59.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.124+0000 7f0b83f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:15:59.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:15:59.124+0000 7f0b83f359c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:01.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:01.056+0000 7f0b83f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:01.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:01.056+0000 7f0b83f359c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:01.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:01.068+0000 7f0b83f359c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:01.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:01.068+0000 7f0b83f359c0 20 started sync module instance, tier type = 2024-09-12T00:16:01.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:01.068+0000 7f0b83f359c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:16:03.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.120+0000 7f0b83f359c0 20 add_watcher() i=0 2024-09-12T00:16:03.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.120+0000 7f0b83f359c0 20 add_watcher() i=1 2024-09-12T00:16:03.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.120+0000 7f0b83f359c0 20 add_watcher() i=2 2024-09-12T00:16:03.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.120+0000 7f0b83f359c0 20 add_watcher() i=3 2024-09-12T00:16:03.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.120+0000 7f0b83f359c0 20 add_watcher() i=4 2024-09-12T00:16:03.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.120+0000 7f0b83f359c0 20 add_watcher() i=5 2024-09-12T00:16:03.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.120+0000 7f0b83f359c0 20 add_watcher() i=6 2024-09-12T00:16:03.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.120+0000 7f0b83f359c0 20 add_watcher() i=7 2024-09-12T00:16:03.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.120+0000 7f0b83f359c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:16:03.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T00:16:03.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T00:16:03.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T00:16:03.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T00:16:03.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T00:16:03.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T00:16:03.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T00:16:03.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T00:16:03.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T00:16:03.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T00:16:03.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T00:16:03.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T00:16:03.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T00:16:03.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T00:16:03.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.124+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T00:16:03.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T00:16:03.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T00:16:03.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T00:16:03.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T00:16:03.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T00:16:03.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T00:16:03.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T00:16:03.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T00:16:03.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T00:16:03.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T00:16:03.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T00:16:03.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T00:16:03.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T00:16:03.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T00:16:03.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T00:16:03.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T00:16:03.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T00:16:03.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.128+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T00:16:03.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T00:16:03.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T00:16:03.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T00:16:03.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T00:16:03.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T00:16:03.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T00:16:03.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T00:16:03.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T00:16:03.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T00:16:03.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T00:16:03.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T00:16:03.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T00:16:03.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T00:16:03.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T00:16:03.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T00:16:03.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T00:16:03.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T00:16:03.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.132+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T00:16:03.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T00:16:03.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T00:16:03.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T00:16:03.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T00:16:03.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T00:16:03.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T00:16:03.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T00:16:03.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T00:16:03.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T00:16:03.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T00:16:03.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T00:16:03.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T00:16:03.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T00:16:03.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T00:16:03.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T00:16:03.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T00:16:03.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T00:16:03.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.136+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T00:16:03.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T00:16:03.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T00:16:03.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T00:16:03.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T00:16:03.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T00:16:03.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T00:16:03.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T00:16:03.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T00:16:03.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T00:16:03.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T00:16:03.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T00:16:03.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T00:16:03.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T00:16:03.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T00:16:03.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T00:16:03.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T00:16:03.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T00:16:03.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.140+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T00:16:03.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T00:16:03.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T00:16:03.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T00:16:03.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T00:16:03.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T00:16:03.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T00:16:03.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T00:16:03.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T00:16:03.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T00:16:03.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T00:16:03.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T00:16:03.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T00:16:03.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T00:16:03.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T00:16:03.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T00:16:03.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.144+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T00:16:03.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T00:16:03.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T00:16:03.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T00:16:03.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T00:16:03.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T00:16:03.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T00:16:03.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T00:16:03.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T00:16:03.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T00:16:03.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T00:16:03.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T00:16:03.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T00:16:03.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T00:16:03.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.148+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T00:16:03.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T00:16:03.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T00:16:03.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T00:16:03.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T00:16:03.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T00:16:03.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T00:16:03.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T00:16:03.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T00:16:03.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T00:16:03.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T00:16:03.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T00:16:03.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T00:16:03.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T00:16:03.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T00:16:03.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T00:16:03.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.152+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T00:16:03.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T00:16:03.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T00:16:03.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T00:16:03.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T00:16:03.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T00:16:03.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T00:16:03.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T00:16:03.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T00:16:03.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T00:16:03.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T00:16:03.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T00:16:03.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.156+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T00:16:03.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T00:16:03.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T00:16:03.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T00:16:03.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T00:16:03.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T00:16:03.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T00:16:03.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T00:16:03.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T00:16:03.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T00:16:03.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T00:16:03.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T00:16:03.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.160+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T00:16:03.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T00:16:03.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T00:16:03.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T00:16:03.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T00:16:03.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T00:16:03.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T00:16:03.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T00:16:03.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T00:16:03.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T00:16:03.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T00:16:03.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T00:16:03.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T00:16:03.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T00:16:03.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.164+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T00:16:03.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T00:16:03.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T00:16:03.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T00:16:03.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T00:16:03.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T00:16:03.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T00:16:03.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T00:16:03.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T00:16:03.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T00:16:03.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T00:16:03.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T00:16:03.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T00:16:03.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T00:16:03.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.168+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T00:16:03.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T00:16:03.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T00:16:03.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T00:16:03.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T00:16:03.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T00:16:03.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T00:16:03.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T00:16:03.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T00:16:03.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T00:16:03.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T00:16:03.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T00:16:03.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T00:16:03.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T00:16:03.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T00:16:03.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T00:16:03.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.172+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T00:16:03.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T00:16:03.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T00:16:03.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T00:16:03.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T00:16:03.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T00:16:03.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T00:16:03.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T00:16:03.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T00:16:03.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T00:16:03.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T00:16:03.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T00:16:03.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T00:16:03.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T00:16:03.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.176+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.180+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T00:16:03.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.180+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T00:16:03.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.180+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.180+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T00:16:03.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.180+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T00:16:03.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.180+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.180+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T00:16:03.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.180+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T00:16:03.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.180+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.180+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T00:16:03.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.180+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T00:16:03.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.180+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.180+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T00:16:03.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.180+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T00:16:03.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.180+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T00:16:03.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T00:16:03.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T00:16:03.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T00:16:03.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T00:16:03.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T00:16:03.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T00:16:03.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T00:16:03.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T00:16:03.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T00:16:03.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T00:16:03.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T00:16:03.185 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T00:16:03.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T00:16:03.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.184+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.188+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T00:16:03.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.188+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T00:16:03.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.188+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.188+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T00:16:03.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.188+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T00:16:03.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.188+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.188+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T00:16:03.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.188+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T00:16:03.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.188+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.188+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T00:16:03.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.188+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T00:16:03.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.188+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.188+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T00:16:03.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.188+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T00:16:03.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.188+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.192+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T00:16:03.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.192+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T00:16:03.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.192+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.192+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T00:16:03.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.192+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T00:16:03.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.192+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.192+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T00:16:03.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.192+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T00:16:03.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.192+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.192+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T00:16:03.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.192+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T00:16:03.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.192+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.192+0000 7f0b83f359c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T00:16:03.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.192+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T00:16:03.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.196+0000 7f0b83f359c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:16:03.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.200+0000 7f0a33fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:16:03.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.200+0000 7f0b83f359c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:16:03.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:03.200+0000 7f0b83f359c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:16:06.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.076+0000 7f0b83f359c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T00:16:06.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.076+0000 7f0b83f359c0 5 note: GC not initialized 2024-09-12T00:16:06.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.080+0000 7f0a32fe5640 20 reqs_thread_entry: start 2024-09-12T00:16:06.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.080+0000 7f0b83f359c0 20 init_complete bucket index max shards: 11 2024-09-12T00:16:06.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.080+0000 7f0b83f359c0 20 Filter name: none 2024-09-12T00:16:06.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.080+0000 7f0a30fe1640 20 reqs_thread_entry: start 2024-09-12T00:16:06.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.132+0000 7f0a33fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:16:06.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.136+0000 7f0b83f359c0 20 remove_watcher() i=0 2024-09-12T00:16:06.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.136+0000 7f0b83f359c0 2 removed watcher, disabling cache 2024-09-12T00:16:06.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.140+0000 7f0b83f359c0 20 remove_watcher() i=1 2024-09-12T00:16:06.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.144+0000 7f0b83f359c0 20 remove_watcher() i=2 2024-09-12T00:16:06.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.144+0000 7f0b83f359c0 20 remove_watcher() i=3 2024-09-12T00:16:06.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.148+0000 7f0b83f359c0 20 remove_watcher() i=4 2024-09-12T00:16:06.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.152+0000 7f0b83f359c0 20 remove_watcher() i=5 2024-09-12T00:16:06.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.152+0000 7f0b83f359c0 20 remove_watcher() i=6 2024-09-12T00:16:06.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.156+0000 7f0b83f359c0 20 remove_watcher() i=7 2024-09-12T00:16:06.174 INFO:teuthology.orchestra.run.smithi138.stdout:[] 2024-09-12T00:16:06.174 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:16:06.174 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:16:06.175 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:16:06.175 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T00:16:06.262 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:16:06.263 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:16:06.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.292+0000 7fcc7fd009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:16:06.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.292+0000 7fcc7fd009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:16:06.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.296+0000 7fcab3fff640 20 reqs_thread_entry: start 2024-09-12T00:16:06.317 INFO:teuthology.orchestra.run.smithi138.stdout:{"id":"e2043445-c131-4520-984d-b4d52f038a6b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:16:06.317 DEBUG:tasks.util.rgw: json result: {'id': 'e2043445-c131-4520-984d-b4d52f038a6b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:16:06.317 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:16:06.317 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:16:06.317 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:16:06.392 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:16:06.392 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:16:06.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.432+0000 7f9db96129c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.436+0000 7f9db96129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.436+0000 7f9db96129c0 20 realm 2024-09-12T00:16:06.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.436+0000 7f9db96129c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:06.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.436+0000 7f9db96129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:06.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.436+0000 7f9db96129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:16:06.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.436+0000 7f9db96129c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:06.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.436+0000 7f9db96129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:06.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.436+0000 7f9db96129c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:06.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.436+0000 7f9db96129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:16:06.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.436+0000 7f9db96129c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:06.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.436+0000 7f9db96129c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:16:06.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.436+0000 7f9db96129c0 20 searching for the correct realm 2024-09-12T00:16:06.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.444+0000 7f9db7919640 0 -- 172.21.15.138:0/3351736171 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55d4f8df7a70 msgr2=0x55d4f8df9f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:16:06.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.448+0000 7f9db7919640 0 -- 172.21.15.138:0/3351736171 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x55d4f8deb3e0 msgr2=0x55d4f8ded850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:16:06.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.456+0000 7f9db96129c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:16:06.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.456+0000 7f9db96129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:16:06.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.456+0000 7f9db96129c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:16:06.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.456+0000 7f9db96129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:16:06.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.456+0000 7f9db96129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:16:06.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.456+0000 7f9db96129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:16:06.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.456+0000 7f9db96129c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:06.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.456+0000 7f9db96129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:06.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.456+0000 7f9db96129c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:06.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.456+0000 7f9db96129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:16:06.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.456+0000 7f9db96129c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:06.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.460+0000 7f9db96129c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:16:06.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.460+0000 7f9db96129c0 20 zone default found 2024-09-12T00:16:06.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.460+0000 7f9db96129c0 4 Realm: () 2024-09-12T00:16:06.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.460+0000 7f9db96129c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:16:06.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.460+0000 7f9db96129c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:16:06.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.460+0000 7f9db96129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:16:06.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.460+0000 7f9db96129c0 20 zonegroup default 2024-09-12T00:16:06.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.460+0000 7f9db96129c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:06.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.460+0000 7f9db96129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:06.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.460+0000 7f9db96129c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:06.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.460+0000 7f9db96129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:06.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.460+0000 7f9db96129c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:06.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.460+0000 7f9db96129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:06.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.460+0000 7f9db96129c0 20 started sync module instance, tier type = 2024-09-12T00:16:06.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.460+0000 7f9db96129c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:16:06.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.480+0000 7f9db96129c0 20 add_watcher() i=0 2024-09-12T00:16:06.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.480+0000 7f9db96129c0 20 add_watcher() i=1 2024-09-12T00:16:06.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.480+0000 7f9db96129c0 20 add_watcher() i=2 2024-09-12T00:16:06.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.480+0000 7f9db96129c0 20 add_watcher() i=3 2024-09-12T00:16:06.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.480+0000 7f9db96129c0 20 add_watcher() i=4 2024-09-12T00:16:06.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.480+0000 7f9db96129c0 20 add_watcher() i=5 2024-09-12T00:16:06.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.480+0000 7f9db96129c0 20 add_watcher() i=6 2024-09-12T00:16:06.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.480+0000 7f9db96129c0 20 add_watcher() i=7 2024-09-12T00:16:06.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.480+0000 7f9db96129c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:16:06.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.484+0000 7f9c6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:16:06.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.484+0000 7f9db96129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:16:06.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.484+0000 7f9db96129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:16:06.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.484+0000 7f9db96129c0 5 note: GC not initialized 2024-09-12T00:16:06.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.484+0000 7f9c6cfe1640 20 reqs_thread_entry: start 2024-09-12T00:16:06.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.484+0000 7f9db96129c0 20 init_complete bucket index max shards: 11 2024-09-12T00:16:06.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.484+0000 7f9db96129c0 20 Filter name: none 2024-09-12T00:16:06.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.484+0000 7f9be67fc640 20 reqs_thread_entry: start 2024-09-12T00:16:06.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.504+0000 7f9c6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:16:06.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.508+0000 7f9db96129c0 20 remove_watcher() i=0 2024-09-12T00:16:06.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.508+0000 7f9db96129c0 2 removed watcher, disabling cache 2024-09-12T00:16:06.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.508+0000 7f9db96129c0 20 remove_watcher() i=1 2024-09-12T00:16:06.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.512+0000 7f9db96129c0 20 remove_watcher() i=2 2024-09-12T00:16:06.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.512+0000 7f9db96129c0 20 remove_watcher() i=3 2024-09-12T00:16:06.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.516+0000 7f9db96129c0 20 remove_watcher() i=4 2024-09-12T00:16:06.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.520+0000 7f9db96129c0 20 remove_watcher() i=5 2024-09-12T00:16:06.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.520+0000 7f9db96129c0 20 remove_watcher() i=6 2024-09-12T00:16:06.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.524+0000 7f9db96129c0 20 remove_watcher() i=7 2024-09-12T00:16:06.538 INFO:teuthology.orchestra.run.smithi138.stdout:[] 2024-09-12T00:16:06.538 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:16:06.538 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:16:06.538 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:16:06.538 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T00:16:06.626 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:16:06.626 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:16:06.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.656+0000 7ff5f108a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:16:06.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.656+0000 7ff5f108a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:16:06.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.660+0000 7ff4acff9640 20 reqs_thread_entry: start 2024-09-12T00:16:06.680 INFO:teuthology.orchestra.run.smithi138.stdout:{"id":"e2043445-c131-4520-984d-b4d52f038a6b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:16:06.680 DEBUG:tasks.util.rgw: json result: {'id': 'e2043445-c131-4520-984d-b4d52f038a6b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:16:06.680 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:16:06.680 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:16:06.680 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:16:06.756 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:16:06.757 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:16:06.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.796+0000 7fd1479f19c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:06.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.796+0000 7fd1479f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:06.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.796+0000 7fd1479f19c0 20 realm 2024-09-12T00:16:06.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.796+0000 7fd1479f19c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:06.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.796+0000 7fd1479f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:06.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.796+0000 7fd1479f19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:16:06.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.796+0000 7fd1479f19c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:06.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.800+0000 7fd1479f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:06.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.800+0000 7fd1479f19c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:06.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.800+0000 7fd1479f19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:16:06.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.800+0000 7fd1479f19c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:06.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.800+0000 7fd1479f19c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:16:06.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.800+0000 7fd1479f19c0 20 searching for the correct realm 2024-09-12T00:16:06.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:06.804+0000 7fd145cf8640 0 -- 172.21.15.138:0/254257865 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fd140069c40 msgr2=0x7fd1400689a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:16:07.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.020+0000 7fd145cf8640 0 -- 172.21.15.138:0/254257865 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5617d54cf0e0 msgr2=0x5617d54d1580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:16:07.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:16:07.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:16:07.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:16:07.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:16:07.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:16:07.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:16:07.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:07.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:07.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:07.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:16:07.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:07.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:16:07.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 20 zone default found 2024-09-12T00:16:07.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 4 Realm: () 2024-09-12T00:16:07.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:16:07.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:16:07.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:16:07.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 20 zonegroup default 2024-09-12T00:16:07.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.028+0000 7fd1479f19c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:07.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.032+0000 7fd1479f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:07.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.032+0000 7fd1479f19c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:07.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.032+0000 7fd1479f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:07.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.032+0000 7fd1479f19c0 20 rados->read ofs=0 len=0 2024-09-12T00:16:07.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.032+0000 7fd1479f19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:16:07.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.032+0000 7fd1479f19c0 20 started sync module instance, tier type = 2024-09-12T00:16:07.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.032+0000 7fd1479f19c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:16:07.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.056+0000 7fd1479f19c0 20 add_watcher() i=0 2024-09-12T00:16:07.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.056+0000 7fd1479f19c0 20 add_watcher() i=1 2024-09-12T00:16:07.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.056+0000 7fd1479f19c0 20 add_watcher() i=2 2024-09-12T00:16:07.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.056+0000 7fd1479f19c0 20 add_watcher() i=3 2024-09-12T00:16:07.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.056+0000 7fd1479f19c0 20 add_watcher() i=4 2024-09-12T00:16:07.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.056+0000 7fd1479f19c0 20 add_watcher() i=5 2024-09-12T00:16:07.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.056+0000 7fd1479f19c0 20 add_watcher() i=6 2024-09-12T00:16:07.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.056+0000 7fd1479f19c0 20 add_watcher() i=7 2024-09-12T00:16:07.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.056+0000 7fd1479f19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:16:07.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.060+0000 7fcffbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:16:07.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.060+0000 7fd1479f19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:16:07.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.060+0000 7fd1479f19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:16:07.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.060+0000 7fd1479f19c0 5 note: GC not initialized 2024-09-12T00:16:07.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.064+0000 7fcffafe5640 20 reqs_thread_entry: start 2024-09-12T00:16:07.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.064+0000 7fd1479f19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:16:07.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.064+0000 7fd1479f19c0 20 Filter name: none 2024-09-12T00:16:07.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.064+0000 7fcff8fe1640 20 reqs_thread_entry: start 2024-09-12T00:16:07.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.084+0000 7fcffbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:16:07.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.088+0000 7fd1479f19c0 20 remove_watcher() i=0 2024-09-12T00:16:07.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.088+0000 7fd1479f19c0 2 removed watcher, disabling cache 2024-09-12T00:16:07.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.092+0000 7fd1479f19c0 20 remove_watcher() i=1 2024-09-12T00:16:07.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.092+0000 7fd1479f19c0 20 remove_watcher() i=2 2024-09-12T00:16:07.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.096+0000 7fd1479f19c0 20 remove_watcher() i=3 2024-09-12T00:16:07.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.100+0000 7fd1479f19c0 20 remove_watcher() i=4 2024-09-12T00:16:07.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.100+0000 7fd1479f19c0 20 remove_watcher() i=5 2024-09-12T00:16:07.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.104+0000 7fd1479f19c0 20 remove_watcher() i=6 2024-09-12T00:16:07.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.108+0000 7fd1479f19c0 20 remove_watcher() i=7 2024-09-12T00:16:07.124 INFO:teuthology.orchestra.run.smithi138.stdout:[] 2024-09-12T00:16:07.125 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:16:07.125 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T00:16:07.125 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:16:07.125 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:16:07.126 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T00:16:07.210 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:16:07.210 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:16:07.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.240+0000 7f9784ad89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:16:07.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.240+0000 7f9784ad89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:16:07.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.244+0000 7f9644fe1640 20 reqs_thread_entry: start 2024-09-12T00:16:07.265 INFO:teuthology.orchestra.run.smithi138.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T00:16:07.265 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T00:16:07.266 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:16:07.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:16:07.266 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T00:16:07.349 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:16:07.349 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:16:07.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.376+0000 7f2858d5a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:16:07.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.376+0000 7f2858d5a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:16:07.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.380+0000 7f2714ff9640 20 reqs_thread_entry: start 2024-09-12T00:16:07.400 INFO:teuthology.orchestra.run.smithi138.stdout:{"id":"e2043445-c131-4520-984d-b4d52f038a6b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:16:07.400 DEBUG:tasks.util.rgw: json result: {'id': 'e2043445-c131-4520-984d-b4d52f038a6b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:16:07.401 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T00:16:07.401 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:16:07.401 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:16:07.401 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T00:16:07.485 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:16:07.485 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:16:07.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.512+0000 7f3bea4a59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:16:07.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.512+0000 7f3bea4a59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:16:07.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.520+0000 7f3a45ffb640 20 reqs_thread_entry: start 2024-09-12T00:16:07.536 INFO:teuthology.orchestra.run.smithi138.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T00:16:07.536 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T00:16:07.536 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:16:07.536 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:16:07.537 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T00:16:07.616 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:16:07.616 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:16:07.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.644+0000 7fd471c4a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:16:07.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.644+0000 7fd471c4a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:16:07.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:16:07.648+0000 7fd306ffd640 20 reqs_thread_entry: start 2024-09-12T00:16:07.666 INFO:teuthology.orchestra.run.smithi138.stdout:{"id":"e2043445-c131-4520-984d-b4d52f038a6b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:16:07.667 DEBUG:tasks.util.rgw: json result: {'id': 'e2043445-c131-4520-984d-b4d52f038a6b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:16:07.667 INFO:tasks.rgw:Starting rgw... 2024-09-12T00:16:07.667 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0'} 2024-09-12T00:16:07.667 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T00:16:07.667 DEBUG:teuthology.orchestra.run.smithi138:> sudo echo -n https://smithi138.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T00:16:07.724 INFO:teuthology.orchestra.run.smithi138.stdout:https://smithi138.front.sepia.ceph.com:443 2024-09-12T00:16:07.725 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T00:16:07.778 DEBUG:teuthology.orchestra.run.smithi138:> sudo keytool -import -alias smithi138.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-12T00:16:08.137 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-12T00:16:08.540 INFO:teuthology.orchestra.run.smithi138.stderr:Certificate was added to keystore 2024-09-12T00:16:08.566 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T00:16:08.566 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T00:16:08.569 INFO:tasks.rgw.client.0:Started 2024-09-12T00:16:08.569 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi138.front.sepia.ceph.com:443/ 2024-09-12T00:16:08.569 DEBUG:teuthology.orchestra.run.smithi138:> curl https://smithi138.front.sepia.ceph.com:443/ 2024-09-12T00:16:08.600 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:16:08.601 INFO:teuthology.orchestra.run.smithi138.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:16:08.601 INFO:teuthology.orchestra.run.smithi138.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:16:08.601 INFO:teuthology.orchestra.run.smithi138.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:16:08.601 INFO:teuthology.orchestra.run.smithi138.stderr:curl: (7) Failed to connect to smithi138.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-09-12T00:16:09.119 INFO:tasks.rgw.client.0.smithi138.stdout:2024-09-12T00:16:09.119+0000 7f47a4f8ea40 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-12T00:16:09.602 DEBUG:teuthology.orchestra.run.smithi138:> curl https://smithi138.front.sepia.ceph.com:443/ 2024-09-12T00:16:09.614 INFO:teuthology.orchestra.run.smithi138.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:16:09.614 INFO:teuthology.orchestra.run.smithi138.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:16:09.727 INFO:teuthology.orchestra.run.smithi138.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 1656 0 --:--:-- --:--:-- --:--:-- 1654 2024-09-12T00:16:09.729 INFO:teuthology.orchestra.run.smithi138.stdout:anonymous 2024-09-12T00:16:09.729 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T00:16:09.749 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T00:16:09.750 DEBUG:teuthology.orchestra.run.smithi138:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T00:16:12.695 DEBUG:teuthology.orchestra.run.smithi138:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T00:16:13.554 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting tox==3.15.0 2024-09-12T00:16:13.674 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T00:16:13.742 INFO:teuthology.orchestra.run.smithi138.stdout: ---------------------------------------- 82.1/82.1 KB 1.1 MB/s eta 0:00:00 2024-09-12T00:16:13.900 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting packaging>=14 2024-09-12T00:16:13.915 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T00:16:13.960 INFO:teuthology.orchestra.run.smithi138.stdout: ---------------------------------------- 54.0/54.0 KB 1.1 MB/s eta 0:00:00 2024-09-12T00:16:14.045 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting six<2,>=1.14.0 2024-09-12T00:16:14.065 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:16:14.191 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T00:16:14.208 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T00:16:14.496 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T00:16:14.511 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T00:16:15.033 INFO:teuthology.orchestra.run.smithi138.stdout: ---------------------------------------- 6.0/6.0 MB 11.6 MB/s eta 0:00:00 2024-09-12T00:16:15.148 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting toml>=0.9.4 2024-09-12T00:16:15.165 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T00:16:15.320 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T00:16:15.334 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T00:16:15.478 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting py<2,>=1.4.17 2024-09-12T00:16:15.493 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T00:16:15.540 INFO:teuthology.orchestra.run.smithi138.stdout: ---------------------------------------- 98.7/98.7 KB 2.1 MB/s eta 0:00:00 2024-09-12T00:16:15.692 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T00:16:15.707 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T00:16:15.759 INFO:teuthology.orchestra.run.smithi138.stdout: --------------------------------------- 468.9/468.9 KB 9.7 MB/s eta 0:00:00 2024-09-12T00:16:15.911 INFO:teuthology.orchestra.run.smithi138.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T00:16:15.941 INFO:teuthology.orchestra.run.smithi138.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T00:16:16.143 INFO:teuthology.orchestra.run.smithi138.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-12T00:16:17.051 INFO:teuthology.orchestra.run.smithi138.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T00:16:17.140 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:16:17.164 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:16:17.165 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:16:17.165 DEBUG:teuthology.orchestra.run.smithi138:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:16:17.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:16:17.173 INFO:teuthology.orchestra.run.smithi138.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:16:17.173 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:16:17.219 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:16:17.219 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:16:17.272 INFO:tasks.workunit:timeout=3h 2024-09-12T00:16:17.272 INFO:tasks.workunit:cleanup=True 2024-09-12T00:16:17.272 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:16:17.325 INFO:tasks.workunit.client.0.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:17:00.949 INFO:tasks.workunit.client.0.smithi138.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:17:00.949 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:00.949 INFO:tasks.workunit.client.0.smithi138.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:17:00.949 INFO:tasks.workunit.client.0.smithi138.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:17:00.949 INFO:tasks.workunit.client.0.smithi138.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:17:00.950 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:00.950 INFO:tasks.workunit.client.0.smithi138.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:17:00.950 INFO:tasks.workunit.client.0.smithi138.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:17:00.950 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:00.950 INFO:tasks.workunit.client.0.smithi138.stderr: git switch -c 2024-09-12T00:17:00.950 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:00.950 INFO:tasks.workunit.client.0.smithi138.stderr:Or undo this operation with: 2024-09-12T00:17:00.950 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:00.950 INFO:tasks.workunit.client.0.smithi138.stderr: git switch - 2024-09-12T00:17:00.950 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:00.950 INFO:tasks.workunit.client.0.smithi138.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:17:00.950 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:00.951 INFO:tasks.workunit.client.0.smithi138.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:17:00.955 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:17:01.000 INFO:tasks.workunit.client.0.smithi138.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:17:01.004 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:17:01.004 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:17:01.779 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:17:01.894 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:17:01.948 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:17:01.949 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:17:01.949 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:17:01.999 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:17:02.003 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:17:02.003 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:17:02.056 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T00:17:02.057 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T00:17:02.058 DEBUG:teuthology.orchestra.run.smithi138:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:17:02.109 INFO:tasks.workunit.client.0.smithi138.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:17:02.109 INFO:tasks.workunit.client.0.smithi138.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:17:02.109 INFO:tasks.workunit.client.0.smithi138.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:17:05.052 INFO:tasks.workunit.client.0.smithi138.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:17:05.052 INFO:tasks.workunit.client.0.smithi138.stderr:++ deactivate nondestructive 2024-09-12T00:17:05.052 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-12T00:17:05.052 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-12T00:17:05.052 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:17:05.053 INFO:tasks.workunit.client.0.smithi138.stderr:++ hash -r 2024-09-12T00:17:05.053 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-12T00:17:05.053 INFO:tasks.workunit.client.0.smithi138.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:17:05.053 INFO:tasks.workunit.client.0.smithi138.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:17:05.053 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:17:05.053 INFO:tasks.workunit.client.0.smithi138.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:17:05.053 INFO:tasks.workunit.client.0.smithi138.stderr:++ export VIRTUAL_ENV 2024-09-12T00:17:05.053 INFO:tasks.workunit.client.0.smithi138.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:17:05.053 INFO:tasks.workunit.client.0.smithi138.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:17:05.053 INFO:tasks.workunit.client.0.smithi138.stderr:++ export PATH 2024-09-12T00:17:05.053 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-12T00:17:05.053 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -z '' ']' 2024-09-12T00:17:05.054 INFO:tasks.workunit.client.0.smithi138.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:17:05.054 INFO:tasks.workunit.client.0.smithi138.stderr:++ PS1='(rgw) ' 2024-09-12T00:17:05.054 INFO:tasks.workunit.client.0.smithi138.stderr:++ export PS1 2024-09-12T00:17:05.054 INFO:tasks.workunit.client.0.smithi138.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T00:17:05.054 INFO:tasks.workunit.client.0.smithi138.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T00:17:05.054 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:17:05.054 INFO:tasks.workunit.client.0.smithi138.stderr:++ hash -r 2024-09-12T00:17:05.055 INFO:tasks.workunit.client.0.smithi138.stderr:+ pip install pip --upgrade 2024-09-12T00:17:05.442 INFO:tasks.workunit.client.0.smithi138.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:17:05.685 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting pip 2024-09-12T00:17:05.783 INFO:tasks.workunit.client.0.smithi138.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:17:06.073 INFO:tasks.workunit.client.0.smithi138.stdout: ---------------------------------------- 1.8/1.8 MB 6.3 MB/s eta 0:00:00 2024-09-12T00:17:06.148 INFO:tasks.workunit.client.0.smithi138.stdout:Installing collected packages: pip 2024-09-12T00:17:06.148 INFO:tasks.workunit.client.0.smithi138.stdout: Attempting uninstall: pip 2024-09-12T00:17:06.149 INFO:tasks.workunit.client.0.smithi138.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:17:06.436 INFO:tasks.workunit.client.0.smithi138.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:17:06.443 INFO:tasks.workunit.client.0.smithi138.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:17:07.223 INFO:tasks.workunit.client.0.smithi138.stdout:Successfully installed pip-24.2 2024-09-12T00:17:07.286 INFO:tasks.workunit.client.0.smithi138.stderr:+ pip install boto3 2024-09-12T00:17:08.448 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting boto3 2024-09-12T00:17:08.492 INFO:tasks.workunit.client.0.smithi138.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:17:09.234 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:17:09.252 INFO:tasks.workunit.client.0.smithi138.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:17:09.391 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:17:09.407 INFO:tasks.workunit.client.0.smithi138.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:17:09.551 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:17:09.611 INFO:tasks.workunit.client.0.smithi138.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:17:10.063 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:17:10.081 INFO:tasks.workunit.client.0.smithi138.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:17:10.281 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:17:10.296 INFO:tasks.workunit.client.0.smithi138.stdout: Downloading urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:17:10.560 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:17:10.574 INFO:tasks.workunit.client.0.smithi138.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:17:10.649 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:17:10.757 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:17:11.021 INFO:tasks.workunit.client.0.smithi138.stdout: ---------------------------------------- 12.5/12.5 MB 50.0 MB/s eta 0:00:00 2024-09-12T00:17:11.047 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:17:11.117 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:17:11.197 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:17:11.262 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:17:11.331 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:17:11.517 INFO:tasks.workunit.client.0.smithi138.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:17:12.680 INFO:tasks.workunit.client.0.smithi138.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:17:13.129 INFO:tasks.workunit.client.0.smithi138.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T00:17:13.273 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T00:17:13.312 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:13.312 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:13.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.353+0000 7fe7349339c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:13.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.353+0000 7fe7349339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:13.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.353+0000 7fe7349339c0 20 realm 2024-09-12T00:17:13.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.353+0000 7fe7349339c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:13.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.353+0000 7fe7349339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:13.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.353+0000 7fe7349339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:13.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.353+0000 7fe7349339c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:13.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.357+0000 7fe7349339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:13.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.357+0000 7fe7349339c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:13.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.357+0000 7fe7349339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:13.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.357+0000 7fe7349339c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:13.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.357+0000 7fe7349339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:13.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.357+0000 7fe7349339c0 20 searching for the correct realm 2024-09-12T00:17:13.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.361+0000 7fe732c3a640 0 -- 172.21.15.138:0/3782490284 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fe72c0b8950 msgr2=0x7fe72c0aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:17:13.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.577+0000 7fe732c3a640 0 -- 172.21.15.138:0/3782490284 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x56135e0c45f0 msgr2=0x56135e0c6ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:13.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.585+0000 7fe7349339c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:13.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.585+0000 7fe7349339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:13.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.585+0000 7fe7349339c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:13.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.585+0000 7fe7349339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:13.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.585+0000 7fe7349339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:13.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.585+0000 7fe7349339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:13.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.585+0000 7fe7349339c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:13.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.589+0000 7fe7349339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:13.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.589+0000 7fe7349339c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:13.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.589+0000 7fe7349339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:13.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.589+0000 7fe7349339c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:13.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.589+0000 7fe7349339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:13.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.589+0000 7fe7349339c0 20 zone default found 2024-09-12T00:17:13.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.589+0000 7fe7349339c0 4 Realm: () 2024-09-12T00:17:13.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.589+0000 7fe7349339c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:13.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.589+0000 7fe7349339c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:13.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.589+0000 7fe7349339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:13.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.589+0000 7fe7349339c0 20 zonegroup default 2024-09-12T00:17:13.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.589+0000 7fe7349339c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:13.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.589+0000 7fe7349339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:13.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.589+0000 7fe7349339c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:13.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.589+0000 7fe7349339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:13.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.589+0000 7fe7349339c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:13.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.593+0000 7fe7349339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:13.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.593+0000 7fe7349339c0 20 started sync module instance, tier type = 2024-09-12T00:17:13.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.593+0000 7fe7349339c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:13.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.617+0000 7fe7349339c0 20 add_watcher() i=0 2024-09-12T00:17:13.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.617+0000 7fe7349339c0 20 add_watcher() i=1 2024-09-12T00:17:13.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.617+0000 7fe7349339c0 20 add_watcher() i=2 2024-09-12T00:17:13.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.617+0000 7fe7349339c0 20 add_watcher() i=3 2024-09-12T00:17:13.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.617+0000 7fe7349339c0 20 add_watcher() i=4 2024-09-12T00:17:13.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.617+0000 7fe7349339c0 20 add_watcher() i=5 2024-09-12T00:17:13.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.617+0000 7fe7349339c0 20 add_watcher() i=6 2024-09-12T00:17:13.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.621+0000 7fe7349339c0 20 add_watcher() i=7 2024-09-12T00:17:13.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.621+0000 7fe7349339c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:13.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.625+0000 7fe5e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:13.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.625+0000 7fe7349339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:13.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.625+0000 7fe7349339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:13.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.625+0000 7fe7349339c0 5 note: GC not initialized 2024-09-12T00:17:13.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.625+0000 7fe5e37fe640 20 reqs_thread_entry: start 2024-09-12T00:17:13.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.625+0000 7fe7349339c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:13.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.629+0000 7fe7349339c0 20 Filter name: none 2024-09-12T00:17:13.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.629+0000 7fe5e17fa640 20 reqs_thread_entry: start 2024-09-12T00:17:13.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.629+0000 7fe7349339c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T00:17:13.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.629+0000 7fe7349339c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:13.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.629+0000 7fe7349339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:13.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.629+0000 7fe7349339c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T00:17:13.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.629+0000 7fe7349339c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:17:13.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.629+0000 7fe7349339c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T00:17:13.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.629+0000 7fe7349339c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:13.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.629+0000 7fe7349339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:13.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.629+0000 7fe7349339c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T00:17:13.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.629+0000 7fe7349339c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:17:13.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.629+0000 7fe7349339c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:17:13.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.629+0000 7fe7349339c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:17:13.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.633+0000 7fe7349339c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:17:13.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.633+0000 7fe7349339c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:17:13.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.633+0000 7fe7349339c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T00:17:13.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.633+0000 7fe615ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 94641182243088 notifier 4650 bl.length()=593 2024-09-12T00:17:13.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.633+0000 7fe615ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:17:13.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.633+0000 7fe615ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:17:13.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.637+0000 7fe7349339c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:17:13.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.637+0000 7fe7349339c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:17:13.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.637+0000 7fe7349339c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T00:17:13.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.637+0000 7fe6157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 94641182235008 notifier 4650 bl.length()=186 2024-09-12T00:17:13.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.637+0000 7fe6157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:17:13.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.637+0000 7fe6157fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:17:13.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.637+0000 7fe5e97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:13.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.641+0000 7fe7349339c0 20 remove_watcher() i=0 2024-09-12T00:17:13.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.641+0000 7fe7349339c0 2 removed watcher, disabling cache 2024-09-12T00:17:13.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.645+0000 7fe7349339c0 20 remove_watcher() i=1 2024-09-12T00:17:13.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.645+0000 7fe7349339c0 20 remove_watcher() i=2 2024-09-12T00:17:13.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.649+0000 7fe7349339c0 20 remove_watcher() i=3 2024-09-12T00:17:13.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.653+0000 7fe7349339c0 20 remove_watcher() i=4 2024-09-12T00:17:13.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.653+0000 7fe7349339c0 20 remove_watcher() i=5 2024-09-12T00:17:13.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.657+0000 7fe7349339c0 20 remove_watcher() i=6 2024-09-12T00:17:13.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:13.661+0000 7fe7349339c0 20 remove_watcher() i=7 2024-09-12T00:17:13.837 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:13.837 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:13.886 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:13.887 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:13.939 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:13.939 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:13.967 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:13.967 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:13.991 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:13.991 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:13.999 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:13.999 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:14.018 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:14.018 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:14.027 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:14.027 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:14.037 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:14.037 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:14.075 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:14.075 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:14.084 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:14.084 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:14.131 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:14.131 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:14.140 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:14.140 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:14.181 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:14.181 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:14.190 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:14.190 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:14.227 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:14.227 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:14.232 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T00:17:14.233 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:14.233 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:17:14.267 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:14.267 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:14.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.313+0000 7f3d16b109c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.313+0000 7f3d16b109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:14.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.313+0000 7f3d16b109c0 20 realm 2024-09-12T00:17:14.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.313+0000 7f3d16b109c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.313+0000 7f3d16b109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:14.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.313+0000 7f3d16b109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:14.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.313+0000 7f3d16b109c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.313+0000 7f3d16b109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:14.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.313+0000 7f3d16b109c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.313+0000 7f3d16b109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:14.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.313+0000 7f3d16b109c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.317+0000 7f3d16b109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:14.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.317+0000 7f3d16b109c0 20 searching for the correct realm 2024-09-12T00:17:14.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.321+0000 7f3d14e17640 0 -- 172.21.15.138:0/1474016667 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f3d0c029940 msgr2=0x7f3d0c0163e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:14.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.537+0000 7f3d14e17640 0 -- 172.21.15.138:0/1474016667 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55ff62be6e70 msgr2=0x55ff62be9330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:14.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.545+0000 7f3d16b109c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:14.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.545+0000 7f3d16b109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:14.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.545+0000 7f3d16b109c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:14.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.545+0000 7f3d16b109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:14.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.545+0000 7f3d16b109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:14.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.545+0000 7f3d16b109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:14.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.545+0000 7f3d16b109c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.545+0000 7f3d16b109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:14.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.545+0000 7f3d16b109c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.549+0000 7f3d16b109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:14.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.549+0000 7f3d16b109c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.549+0000 7f3d16b109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:14.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.549+0000 7f3d16b109c0 20 zone default found 2024-09-12T00:17:14.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.549+0000 7f3d16b109c0 4 Realm: () 2024-09-12T00:17:14.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.549+0000 7f3d16b109c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:14.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.549+0000 7f3d16b109c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:14.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.549+0000 7f3d16b109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:14.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.549+0000 7f3d16b109c0 20 zonegroup default 2024-09-12T00:17:14.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.549+0000 7f3d16b109c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.549+0000 7f3d16b109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:14.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.549+0000 7f3d16b109c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.549+0000 7f3d16b109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:14.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.549+0000 7f3d16b109c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.553+0000 7f3d16b109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:14.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.553+0000 7f3d16b109c0 20 started sync module instance, tier type = 2024-09-12T00:17:14.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.553+0000 7f3d16b109c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:14.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.573+0000 7f3d16b109c0 20 add_watcher() i=0 2024-09-12T00:17:14.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.573+0000 7f3d16b109c0 20 add_watcher() i=1 2024-09-12T00:17:14.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.573+0000 7f3d16b109c0 20 add_watcher() i=2 2024-09-12T00:17:14.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.573+0000 7f3d16b109c0 20 add_watcher() i=3 2024-09-12T00:17:14.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.573+0000 7f3d16b109c0 20 add_watcher() i=4 2024-09-12T00:17:14.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.573+0000 7f3d16b109c0 20 add_watcher() i=5 2024-09-12T00:17:14.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.573+0000 7f3d16b109c0 20 add_watcher() i=6 2024-09-12T00:17:14.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.577+0000 7f3d16b109c0 20 add_watcher() i=7 2024-09-12T00:17:14.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.577+0000 7f3d16b109c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:14.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3bcafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:14.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:14.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:14.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 5 note: GC not initialized 2024-09-12T00:17:14.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3bc9fdb640 20 reqs_thread_entry: start 2024-09-12T00:17:14.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:14.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 20 Filter name: none 2024-09-12T00:17:14.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3b3b7fe640 20 reqs_thread_entry: start 2024-09-12T00:17:14.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:17:14.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:14.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:17:14.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:17:14.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 : miss 2024-09-12T00:17:14.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:14.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 info.flags=0x17 2024-09-12T00:17:14.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 to cache LRU end 2024-09-12T00:17:14.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:14.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:17:14.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 2024-09-12T00:17:14.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.581+0000 7f3d16b109c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:14.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.585+0000 7f3d16b109c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:14.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.585+0000 7f3d16b109c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:14.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.585+0000 7f3d16b109c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:14.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.585+0000 7f3d16b109c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:14.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.585+0000 7f3d16b109c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:14.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.589+0000 7f3d16b109c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:14.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.589+0000 7f3d16b109c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:14.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.589+0000 7f3d16b109c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:14.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.589+0000 7f3d16b109c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:14.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.593+0000 7f3d16b109c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:14.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.601+0000 7f3bcafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:14.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.605+0000 7f3d16b109c0 20 remove_watcher() i=0 2024-09-12T00:17:14.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.605+0000 7f3d16b109c0 2 removed watcher, disabling cache 2024-09-12T00:17:14.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.609+0000 7f3d16b109c0 20 remove_watcher() i=1 2024-09-12T00:17:14.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.609+0000 7f3d16b109c0 20 remove_watcher() i=2 2024-09-12T00:17:14.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.613+0000 7f3d16b109c0 20 remove_watcher() i=3 2024-09-12T00:17:14.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.613+0000 7f3d16b109c0 20 remove_watcher() i=4 2024-09-12T00:17:14.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.617+0000 7f3d16b109c0 20 remove_watcher() i=5 2024-09-12T00:17:14.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.621+0000 7f3d16b109c0 20 remove_watcher() i=6 2024-09-12T00:17:14.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.621+0000 7f3d16b109c0 20 remove_watcher() i=7 2024-09-12T00:17:14.638 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:17:14.669 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:14.669 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:14.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.709+0000 7fb9785419c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.713+0000 7fb9785419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:14.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.713+0000 7fb9785419c0 20 realm 2024-09-12T00:17:14.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.713+0000 7fb9785419c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.713+0000 7fb9785419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:14.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.713+0000 7fb9785419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:14.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.713+0000 7fb9785419c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.713+0000 7fb9785419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:14.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.713+0000 7fb9785419c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.713+0000 7fb9785419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:14.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.713+0000 7fb9785419c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.717+0000 7fb9785419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:14.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.717+0000 7fb9785419c0 20 searching for the correct realm 2024-09-12T00:17:14.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.721+0000 7fb976848640 0 -- 172.21.15.138:0/3296240638 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55cf858ab650 msgr2=0x55cf858adb10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:14.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.725+0000 7fb975846640 0 -- 172.21.15.138:0/3296240638 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55cf858a68e0 msgr2=0x55cf858a8cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:14.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.733+0000 7fb9785419c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:14.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.733+0000 7fb9785419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:14.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.733+0000 7fb9785419c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:14.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.733+0000 7fb9785419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:14.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.733+0000 7fb9785419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:14.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.733+0000 7fb9785419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:14.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.733+0000 7fb9785419c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.733+0000 7fb9785419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:14.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.733+0000 7fb9785419c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.733+0000 7fb9785419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:14.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.733+0000 7fb9785419c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.737+0000 7fb9785419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:14.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.737+0000 7fb9785419c0 20 zone default found 2024-09-12T00:17:14.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.737+0000 7fb9785419c0 4 Realm: () 2024-09-12T00:17:14.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.737+0000 7fb9785419c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:14.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.737+0000 7fb9785419c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:14.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.737+0000 7fb9785419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:14.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.737+0000 7fb9785419c0 20 zonegroup default 2024-09-12T00:17:14.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.737+0000 7fb9785419c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.737+0000 7fb9785419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:14.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.737+0000 7fb9785419c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.737+0000 7fb9785419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:14.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.737+0000 7fb9785419c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.737+0000 7fb9785419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:14.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.737+0000 7fb9785419c0 20 started sync module instance, tier type = 2024-09-12T00:17:14.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.737+0000 7fb9785419c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:14.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.757+0000 7fb9785419c0 20 add_watcher() i=0 2024-09-12T00:17:14.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.757+0000 7fb9785419c0 20 add_watcher() i=1 2024-09-12T00:17:14.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.757+0000 7fb9785419c0 20 add_watcher() i=2 2024-09-12T00:17:14.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.757+0000 7fb9785419c0 20 add_watcher() i=3 2024-09-12T00:17:14.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.757+0000 7fb9785419c0 20 add_watcher() i=4 2024-09-12T00:17:14.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.757+0000 7fb9785419c0 20 add_watcher() i=5 2024-09-12T00:17:14.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.757+0000 7fb9785419c0 20 add_watcher() i=6 2024-09-12T00:17:14.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.757+0000 7fb9785419c0 20 add_watcher() i=7 2024-09-12T00:17:14.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.757+0000 7fb9785419c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:14.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.761+0000 7fb82cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:14.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.761+0000 7fb9785419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:14.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.761+0000 7fb9785419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:14.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.761+0000 7fb9785419c0 5 note: GC not initialized 2024-09-12T00:17:14.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.765+0000 7fb7a77fe640 20 reqs_thread_entry: start 2024-09-12T00:17:14.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.765+0000 7fb9785419c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:14.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.765+0000 7fb9785419c0 20 Filter name: none 2024-09-12T00:17:14.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.765+0000 7fb7a57fa640 20 reqs_thread_entry: start 2024-09-12T00:17:14.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.765+0000 7fb9785419c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.765+0000 7fb9785419c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:14.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.765+0000 7fb9785419c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.765+0000 7fb9785419c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:14.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.765+0000 7fb9785419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:17:14.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.765+0000 7fb9785419c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.765+0000 7fb9785419c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:14.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.765+0000 7fb9785419c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.765+0000 7fb9785419c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:14.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.765+0000 7fb9785419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:17:14.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.769+0000 7fb82cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:14.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.773+0000 7fb9785419c0 20 remove_watcher() i=0 2024-09-12T00:17:14.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.773+0000 7fb9785419c0 2 removed watcher, disabling cache 2024-09-12T00:17:14.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.773+0000 7fb9785419c0 20 remove_watcher() i=1 2024-09-12T00:17:14.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.777+0000 7fb9785419c0 20 remove_watcher() i=2 2024-09-12T00:17:14.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.777+0000 7fb9785419c0 20 remove_watcher() i=3 2024-09-12T00:17:14.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.781+0000 7fb9785419c0 20 remove_watcher() i=4 2024-09-12T00:17:14.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.781+0000 7fb9785419c0 20 remove_watcher() i=5 2024-09-12T00:17:14.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.785+0000 7fb9785419c0 20 remove_watcher() i=6 2024-09-12T00:17:14.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.789+0000 7fb9785419c0 20 remove_watcher() i=7 2024-09-12T00:17:14.804 INFO:tasks.workunit.client.0.smithi138.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 108, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T00:17:14.804 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T00:17:14.804 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:14.804 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:17:14.835 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:14.835 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:14.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.877+0000 7f91f468d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.881+0000 7f91f468d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:14.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.881+0000 7f91f468d9c0 20 realm 2024-09-12T00:17:14.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.881+0000 7f91f468d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.881+0000 7f91f468d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:14.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.881+0000 7f91f468d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:14.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.881+0000 7f91f468d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.881+0000 7f91f468d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:14.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.881+0000 7f91f468d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.881+0000 7f91f468d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:14.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.881+0000 7f91f468d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:14.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.881+0000 7f91f468d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:14.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.881+0000 7f91f468d9c0 20 searching for the correct realm 2024-09-12T00:17:14.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:14.889+0000 7f91f2994640 0 -- 172.21.15.138:0/793655031 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f91ec030400 msgr2=0x7f91ec030880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:17:15.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.105+0000 7f91f2994640 0 -- 172.21.15.138:0/793655031 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55ac26704a70 msgr2=0x55ac26706f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:15.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:15.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:15.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:15.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:15.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:15.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:15.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:15.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:15.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:15.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:15.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:15.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:15.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 20 zone default found 2024-09-12T00:17:15.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 4 Realm: () 2024-09-12T00:17:15.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:15.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:15.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:15.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 20 zonegroup default 2024-09-12T00:17:15.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.113+0000 7f91f468d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:15.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.117+0000 7f91f468d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:15.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.117+0000 7f91f468d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:15.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.117+0000 7f91f468d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:15.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.117+0000 7f91f468d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:15.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.117+0000 7f91f468d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:15.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.117+0000 7f91f468d9c0 20 started sync module instance, tier type = 2024-09-12T00:17:15.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.117+0000 7f91f468d9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:15.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.141+0000 7f91f468d9c0 20 add_watcher() i=0 2024-09-12T00:17:15.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.141+0000 7f91f468d9c0 20 add_watcher() i=1 2024-09-12T00:17:15.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.141+0000 7f91f468d9c0 20 add_watcher() i=2 2024-09-12T00:17:15.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.141+0000 7f91f468d9c0 20 add_watcher() i=3 2024-09-12T00:17:15.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.141+0000 7f91f468d9c0 20 add_watcher() i=4 2024-09-12T00:17:15.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.141+0000 7f91f468d9c0 20 add_watcher() i=5 2024-09-12T00:17:15.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.141+0000 7f91f468d9c0 20 add_watcher() i=6 2024-09-12T00:17:15.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.141+0000 7f91f468d9c0 20 add_watcher() i=7 2024-09-12T00:17:15.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.141+0000 7f91f468d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:15.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.145+0000 7f90a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:15.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.145+0000 7f91f468d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:15.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.145+0000 7f91f468d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:15.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.145+0000 7f91f468d9c0 5 note: GC not initialized 2024-09-12T00:17:15.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.145+0000 7f90237fe640 20 reqs_thread_entry: start 2024-09-12T00:17:15.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:15.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 20 Filter name: none 2024-09-12T00:17:15.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f90217fa640 20 reqs_thread_entry: start 2024-09-12T00:17:15.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:17:15.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:15.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:15.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:17:15.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:17:15.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 : miss 2024-09-12T00:17:15.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:15.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:15.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 info.flags=0x17 2024-09-12T00:17:15.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 to cache LRU end 2024-09-12T00:17:15.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:15.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:17:15.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 2024-09-12T00:17:15.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:15.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:17:15.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:15.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:17:15.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.149+0000 7f91f468d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:15.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.153+0000 7f91f468d9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:17:15.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.153+0000 7f91f468d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:15.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.153+0000 7f91f468d9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:17:15.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.153+0000 7f91f468d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:15.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.153+0000 7f91f468d9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:17:15.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.153+0000 7f91f468d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:15.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.153+0000 7f91f468d9c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:17:15.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.153+0000 7f91f468d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:15.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.157+0000 7f91f468d9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:17:15.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.157+0000 7f91f468d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:15.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.157+0000 7f91f468d9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:17:15.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.157+0000 7f91f468d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:15.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.157+0000 7f91f468d9c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:17:15.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.157+0000 7f91f468d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:15.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.157+0000 7f91f468d9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:17:15.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.157+0000 7f91f468d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:15.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.161+0000 7f91f468d9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:17:15.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.161+0000 7f91f468d9c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:17:15.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.161+0000 7f90a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:15.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.165+0000 7f91f468d9c0 20 remove_watcher() i=0 2024-09-12T00:17:15.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.165+0000 7f91f468d9c0 2 removed watcher, disabling cache 2024-09-12T00:17:15.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.169+0000 7f91f468d9c0 20 remove_watcher() i=1 2024-09-12T00:17:15.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.169+0000 7f91f468d9c0 20 remove_watcher() i=2 2024-09-12T00:17:15.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.173+0000 7f91f468d9c0 20 remove_watcher() i=3 2024-09-12T00:17:15.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.173+0000 7f91f468d9c0 20 remove_watcher() i=4 2024-09-12T00:17:15.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.177+0000 7f91f468d9c0 20 remove_watcher() i=5 2024-09-12T00:17:15.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.181+0000 7f91f468d9c0 20 remove_watcher() i=6 2024-09-12T00:17:15.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:15.181+0000 7f91f468d9c0 20 remove_watcher() i=7 2024-09-12T00:17:15.199 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:17:15.642 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:17:17.071 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:17.071 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:17.141 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:17:17.142 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:17:17.176 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:17.176 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:17.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.217+0000 7fc5eb9349c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.221+0000 7fc5eb9349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.221+0000 7fc5eb9349c0 20 realm 2024-09-12T00:17:17.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.221+0000 7fc5eb9349c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.221+0000 7fc5eb9349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.221+0000 7fc5eb9349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:17.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.221+0000 7fc5eb9349c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.221+0000 7fc5eb9349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.221+0000 7fc5eb9349c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.221+0000 7fc5eb9349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:17.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.221+0000 7fc5eb9349c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.224+0000 7fc5eb9349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:17.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.224+0000 7fc5eb9349c0 20 searching for the correct realm 2024-09-12T00:17:17.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.228+0000 7fc5e9c3b640 0 -- 172.21.15.138:0/705885 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fc5e4067630 msgr2=0x7fc5e407f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:17.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.444+0000 7fc5e9c3b640 0 -- 172.21.15.138:0/705885 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x564a8cb22090 msgr2=0x564a8cb24550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:17.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.452+0000 7fc5eb9349c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:17.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.452+0000 7fc5eb9349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:17.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.452+0000 7fc5eb9349c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:17.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.452+0000 7fc5eb9349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:17.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.452+0000 7fc5eb9349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:17.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.452+0000 7fc5eb9349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:17.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.452+0000 7fc5eb9349c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.456+0000 7fc5eb9349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.456+0000 7fc5eb9349c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.456+0000 7fc5eb9349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:17.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.456+0000 7fc5eb9349c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.456+0000 7fc5eb9349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:17.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.456+0000 7fc5eb9349c0 20 zone default found 2024-09-12T00:17:17.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.456+0000 7fc5eb9349c0 4 Realm: () 2024-09-12T00:17:17.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.456+0000 7fc5eb9349c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:17.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.456+0000 7fc5eb9349c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:17.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.456+0000 7fc5eb9349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:17.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.456+0000 7fc5eb9349c0 20 zonegroup default 2024-09-12T00:17:17.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.456+0000 7fc5eb9349c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.456+0000 7fc5eb9349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.456+0000 7fc5eb9349c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.456+0000 7fc5eb9349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.456+0000 7fc5eb9349c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.460+0000 7fc5eb9349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.460+0000 7fc5eb9349c0 20 started sync module instance, tier type = 2024-09-12T00:17:17.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.460+0000 7fc5eb9349c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:17.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.484+0000 7fc5eb9349c0 20 add_watcher() i=0 2024-09-12T00:17:17.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.484+0000 7fc5eb9349c0 20 add_watcher() i=1 2024-09-12T00:17:17.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.484+0000 7fc5eb9349c0 20 add_watcher() i=2 2024-09-12T00:17:17.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.484+0000 7fc5eb9349c0 20 add_watcher() i=3 2024-09-12T00:17:17.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.484+0000 7fc5eb9349c0 20 add_watcher() i=4 2024-09-12T00:17:17.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.484+0000 7fc5eb9349c0 20 add_watcher() i=5 2024-09-12T00:17:17.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.484+0000 7fc5eb9349c0 20 add_watcher() i=6 2024-09-12T00:17:17.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.484+0000 7fc5eb9349c0 20 add_watcher() i=7 2024-09-12T00:17:17.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.484+0000 7fc5eb9349c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:17.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.488+0000 7fc49ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:17.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.492+0000 7fc5eb9349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:17.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.492+0000 7fc5eb9349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:17.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.492+0000 7fc5eb9349c0 5 note: GC not initialized 2024-09-12T00:17:17.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.492+0000 7fc49efe5640 20 reqs_thread_entry: start 2024-09-12T00:17:17.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.492+0000 7fc5eb9349c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:17.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.492+0000 7fc5eb9349c0 20 Filter name: none 2024-09-12T00:17:17.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.492+0000 7fc49cfe1640 20 reqs_thread_entry: start 2024-09-12T00:17:17.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.492+0000 7fc5eb9349c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.492+0000 7fc5eb9349c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:17.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.492+0000 7fc5eb9349c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.492+0000 7fc5eb9349c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:17.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.496+0000 7fc5eb9349c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:17:17.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.496+0000 7fc5eb9349c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:17:17.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.496+0000 7fc5eb9349c0 20 INFO: main: starting shard=0 2024-09-12T00:17:17.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.496+0000 7fc5eb9349c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:17.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.496+0000 7fc5eb9349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.496+0000 7fc5eb9349c0 20 INFO: main: starting shard=1 2024-09-12T00:17:17.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.496+0000 7fc5eb9349c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:17.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.496+0000 7fc5eb9349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.496+0000 7fc5eb9349c0 20 INFO: main: starting shard=2 2024-09-12T00:17:17.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.496+0000 7fc5eb9349c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:17.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.496+0000 7fc5eb9349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.496+0000 7fc5eb9349c0 20 INFO: main: starting shard=3 2024-09-12T00:17:17.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.496+0000 7fc5eb9349c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:17.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.496+0000 7fc5eb9349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.496+0000 7fc5eb9349c0 20 INFO: main: starting shard=4 2024-09-12T00:17:17.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.496+0000 7fc5eb9349c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:17.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.496+0000 7fc5eb9349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.500+0000 7fc5eb9349c0 20 INFO: main: starting shard=5 2024-09-12T00:17:17.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.500+0000 7fc5eb9349c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:17.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.500+0000 7fc5eb9349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.500+0000 7fc5eb9349c0 20 INFO: main: starting shard=6 2024-09-12T00:17:17.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.500+0000 7fc5eb9349c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:17.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.500+0000 7fc5eb9349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.500+0000 7fc5eb9349c0 20 INFO: main: starting shard=7 2024-09-12T00:17:17.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.500+0000 7fc5eb9349c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:17.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.500+0000 7fc5eb9349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.500+0000 7fc5eb9349c0 20 INFO: main: starting shard=8 2024-09-12T00:17:17.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.500+0000 7fc5eb9349c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:17.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.504+0000 7fc5eb9349c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:17:17.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.504+0000 7fc5eb9349c0 20 INFO: main: starting shard=9 2024-09-12T00:17:17.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.504+0000 7fc5eb9349c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:17.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.504+0000 7fc5eb9349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.504+0000 7fc5eb9349c0 20 INFO: main: starting shard=10 2024-09-12T00:17:17.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.504+0000 7fc5eb9349c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:17.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.504+0000 7fc5eb9349c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.504+0000 7fc5eb9349c0 20 INFO: main: done 2024-09-12T00:17:17.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.508+0000 7fc49ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:17.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.512+0000 7fc5eb9349c0 20 remove_watcher() i=0 2024-09-12T00:17:17.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.512+0000 7fc5eb9349c0 2 removed watcher, disabling cache 2024-09-12T00:17:17.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.512+0000 7fc5eb9349c0 20 remove_watcher() i=1 2024-09-12T00:17:17.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.516+0000 7fc5eb9349c0 20 remove_watcher() i=2 2024-09-12T00:17:17.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.516+0000 7fc5eb9349c0 20 remove_watcher() i=3 2024-09-12T00:17:17.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.520+0000 7fc5eb9349c0 20 remove_watcher() i=4 2024-09-12T00:17:17.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.524+0000 7fc5eb9349c0 20 remove_watcher() i=5 2024-09-12T00:17:17.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.524+0000 7fc5eb9349c0 20 remove_watcher() i=6 2024-09-12T00:17:17.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.528+0000 7fc5eb9349c0 20 remove_watcher() i=7 2024-09-12T00:17:17.549 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:17.549 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:17.551 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:17.551 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:17.555 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:17.555 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:17.617 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:17:17.617 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:17:17.652 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:17.652 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:17.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.696+0000 7f7cb62fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.696+0000 7f7cb62fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.696+0000 7f7cb62fd9c0 20 realm 2024-09-12T00:17:17.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.696+0000 7f7cb62fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.696+0000 7f7cb62fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.696+0000 7f7cb62fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:17.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.696+0000 7f7cb62fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.696+0000 7f7cb62fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.696+0000 7f7cb62fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.700+0000 7f7cb62fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:17.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.700+0000 7f7cb62fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.700+0000 7f7cb62fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:17.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.700+0000 7f7cb62fd9c0 20 searching for the correct realm 2024-09-12T00:17:17.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.704+0000 7f7cb3602640 0 -- 172.21.15.138:0/3099234213 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f7ca4008040 msgr2=0x7f7ca4063e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:17.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.712+0000 7f7cb3602640 0 -- 172.21.15.138:0/3099234213 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x558e8290af10 msgr2=0x558e8290d300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:17.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:17.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:17.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:17.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:17.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:17.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:17.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:17.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:17.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 zone default found 2024-09-12T00:17:17.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 4 Realm: () 2024-09-12T00:17:17.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:17.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:17.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:17.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 zonegroup default 2024-09-12T00:17:17.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 started sync module instance, tier type = 2024-09-12T00:17:17.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.720+0000 7f7cb62fd9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:17.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.740+0000 7f7cb62fd9c0 20 add_watcher() i=0 2024-09-12T00:17:17.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.740+0000 7f7cb62fd9c0 20 add_watcher() i=1 2024-09-12T00:17:17.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.740+0000 7f7cb62fd9c0 20 add_watcher() i=2 2024-09-12T00:17:17.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.740+0000 7f7cb62fd9c0 20 add_watcher() i=3 2024-09-12T00:17:17.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.740+0000 7f7cb62fd9c0 20 add_watcher() i=4 2024-09-12T00:17:17.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.740+0000 7f7cb62fd9c0 20 add_watcher() i=5 2024-09-12T00:17:17.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.740+0000 7f7cb62fd9c0 20 add_watcher() i=6 2024-09-12T00:17:17.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.744+0000 7f7cb62fd9c0 20 add_watcher() i=7 2024-09-12T00:17:17.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.744+0000 7f7cb62fd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:17.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.748+0000 7f7b69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:17.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.748+0000 7f7cb62fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:17.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.748+0000 7f7cb62fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:17.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.748+0000 7f7cb62fd9c0 5 note: GC not initialized 2024-09-12T00:17:17.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.748+0000 7f7b68fe1640 20 reqs_thread_entry: start 2024-09-12T00:17:17.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.748+0000 7f7cb62fd9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:17.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.748+0000 7f7cb62fd9c0 20 Filter name: none 2024-09-12T00:17:17.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.748+0000 7f7ae27fc640 20 reqs_thread_entry: start 2024-09-12T00:17:17.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.748+0000 7f7cb62fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.748+0000 7f7cb62fd9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:17.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.748+0000 7f7cb62fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.752+0000 7f7cb62fd9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:17.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.752+0000 7f7cb62fd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:17:17.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.752+0000 7f7cb62fd9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:17:17.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.752+0000 7f7cb62fd9c0 20 INFO: main: starting shard=0 2024-09-12T00:17:17.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.752+0000 7f7cb62fd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:17.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.752+0000 7f7cb62fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.752+0000 7f7cb62fd9c0 20 INFO: main: starting shard=1 2024-09-12T00:17:17.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.752+0000 7f7cb62fd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:17.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.752+0000 7f7cb62fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.752+0000 7f7cb62fd9c0 20 INFO: main: starting shard=2 2024-09-12T00:17:17.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.752+0000 7f7cb62fd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:17.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.752+0000 7f7cb62fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.752+0000 7f7cb62fd9c0 20 INFO: main: starting shard=3 2024-09-12T00:17:17.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.752+0000 7f7cb62fd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:17.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.752+0000 7f7cb62fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.752+0000 7f7cb62fd9c0 20 INFO: main: starting shard=4 2024-09-12T00:17:17.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.752+0000 7f7cb62fd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:17.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.756+0000 7f7cb62fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.756+0000 7f7cb62fd9c0 20 INFO: main: starting shard=5 2024-09-12T00:17:17.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.756+0000 7f7cb62fd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:17.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.756+0000 7f7cb62fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:17:17.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.756+0000 7f7cb62fd9c0 20 INFO: main: starting shard=6 2024-09-12T00:17:17.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.756+0000 7f7cb62fd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:17.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.756+0000 7f7cb62fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.756+0000 7f7cb62fd9c0 20 INFO: main: starting shard=7 2024-09-12T00:17:17.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.756+0000 7f7cb62fd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:17.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.756+0000 7f7cb62fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.756+0000 7f7cb62fd9c0 20 INFO: main: starting shard=8 2024-09-12T00:17:17.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.756+0000 7f7cb62fd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:17.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.756+0000 7f7cb62fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.756+0000 7f7cb62fd9c0 20 INFO: main: starting shard=9 2024-09-12T00:17:17.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.756+0000 7f7cb62fd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:17.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.760+0000 7f7cb62fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.760+0000 7f7cb62fd9c0 20 INFO: main: starting shard=10 2024-09-12T00:17:17.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.760+0000 7f7cb62fd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:17.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.760+0000 7f7cb62fd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:17.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.760+0000 7f7cb62fd9c0 20 INFO: main: done 2024-09-12T00:17:17.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.760+0000 7f7b69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:17.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.764+0000 7f7cb62fd9c0 20 remove_watcher() i=0 2024-09-12T00:17:17.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.764+0000 7f7cb62fd9c0 2 removed watcher, disabling cache 2024-09-12T00:17:17.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.768+0000 7f7cb62fd9c0 20 remove_watcher() i=1 2024-09-12T00:17:17.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.768+0000 7f7cb62fd9c0 20 remove_watcher() i=2 2024-09-12T00:17:17.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.772+0000 7f7cb62fd9c0 20 remove_watcher() i=3 2024-09-12T00:17:17.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.772+0000 7f7cb62fd9c0 20 remove_watcher() i=4 2024-09-12T00:17:17.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.776+0000 7f7cb62fd9c0 20 remove_watcher() i=5 2024-09-12T00:17:17.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.776+0000 7f7cb62fd9c0 20 remove_watcher() i=6 2024-09-12T00:17:17.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.780+0000 7f7cb62fd9c0 20 remove_watcher() i=7 2024-09-12T00:17:17.800 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:17.800 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:17.805 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:17.805 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:17.869 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:17:17.870 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:17:17.906 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:17.906 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:17.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.948+0000 7fd0e2b669c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.952+0000 7fd0e2b669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.952+0000 7fd0e2b669c0 20 realm 2024-09-12T00:17:17.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.952+0000 7fd0e2b669c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.952+0000 7fd0e2b669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.952+0000 7fd0e2b669c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:17.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.952+0000 7fd0e2b669c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.952+0000 7fd0e2b669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.952+0000 7fd0e2b669c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.952+0000 7fd0e2b669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:17.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.952+0000 7fd0e2b669c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.952+0000 7fd0e2b669c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:17.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.952+0000 7fd0e2b669c0 20 searching for the correct realm 2024-09-12T00:17:17.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.960+0000 7fd0e0e6d640 0 -- 172.21.15.138:0/3535992641 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x561d7fd5e0b0 msgr2=0x561d7fd60540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:17.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.964+0000 7fd0dfe6b640 0 -- 172.21.15.138:0/3535992641 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x561d7fd518d0 msgr2=0x561d7fd53d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:17:17.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.972+0000 7fd0e2b669c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:17.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.972+0000 7fd0e2b669c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:17.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.972+0000 7fd0e2b669c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:17.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.972+0000 7fd0e2b669c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:17.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.972+0000 7fd0e2b669c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:17.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.972+0000 7fd0e2b669c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:17.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.972+0000 7fd0e2b669c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:17.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:17.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 20 zone default found 2024-09-12T00:17:17.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 4 Realm: () 2024-09-12T00:17:17.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:17.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:17.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:17.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 20 zonegroup default 2024-09-12T00:17:17.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:17.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:17.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 20 started sync module instance, tier type = 2024-09-12T00:17:17.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.976+0000 7fd0e2b669c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:18.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.996+0000 7fd0e2b669c0 20 add_watcher() i=0 2024-09-12T00:17:18.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.996+0000 7fd0e2b669c0 20 add_watcher() i=1 2024-09-12T00:17:18.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.996+0000 7fd0e2b669c0 20 add_watcher() i=2 2024-09-12T00:17:18.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.996+0000 7fd0e2b669c0 20 add_watcher() i=3 2024-09-12T00:17:18.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.996+0000 7fd0e2b669c0 20 add_watcher() i=4 2024-09-12T00:17:18.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:17.996+0000 7fd0e2b669c0 20 add_watcher() i=5 2024-09-12T00:17:18.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.000+0000 7fd0e2b669c0 20 add_watcher() i=6 2024-09-12T00:17:18.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.000+0000 7fd0e2b669c0 20 add_watcher() i=7 2024-09-12T00:17:18.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.000+0000 7fd0e2b669c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:18.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.004+0000 7fcf96fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:18.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.004+0000 7fd0e2b669c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:18.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.004+0000 7fd0e2b669c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:18.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.004+0000 7fd0e2b669c0 5 note: GC not initialized 2024-09-12T00:17:18.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.004+0000 7fcf95fdb640 20 reqs_thread_entry: start 2024-09-12T00:17:18.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.004+0000 7fd0e2b669c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:18.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.004+0000 7fd0e2b669c0 20 Filter name: none 2024-09-12T00:17:18.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.004+0000 7fcf077fe640 20 reqs_thread_entry: start 2024-09-12T00:17:18.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.004+0000 7fd0e2b669c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:18.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.004+0000 7fd0e2b669c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:18.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.004+0000 7fd0e2b669c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:18.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:18.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:17:18.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:17:18.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 INFO: main: starting shard=0 2024-09-12T00:17:18.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:18.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 INFO: main: starting shard=1 2024-09-12T00:17:18.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:18.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:17:18.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 INFO: main: starting shard=2 2024-09-12T00:17:18.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:18.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 INFO: main: starting shard=3 2024-09-12T00:17:18.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:18.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 INFO: main: starting shard=4 2024-09-12T00:17:18.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:18.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 INFO: main: starting shard=5 2024-09-12T00:17:18.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.008+0000 7fd0e2b669c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:18.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.012+0000 7fd0e2b669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.012+0000 7fd0e2b669c0 20 INFO: main: starting shard=6 2024-09-12T00:17:18.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.012+0000 7fd0e2b669c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:18.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.012+0000 7fd0e2b669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.012+0000 7fd0e2b669c0 20 INFO: main: starting shard=7 2024-09-12T00:17:18.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.012+0000 7fd0e2b669c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:18.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.012+0000 7fd0e2b669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.012+0000 7fd0e2b669c0 20 INFO: main: starting shard=8 2024-09-12T00:17:18.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.012+0000 7fd0e2b669c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:18.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.012+0000 7fd0e2b669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.012+0000 7fd0e2b669c0 20 INFO: main: starting shard=9 2024-09-12T00:17:18.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.012+0000 7fd0e2b669c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:18.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.016+0000 7fd0e2b669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.016+0000 7fd0e2b669c0 20 INFO: main: starting shard=10 2024-09-12T00:17:18.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.016+0000 7fd0e2b669c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:18.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.016+0000 7fd0e2b669c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.016+0000 7fd0e2b669c0 20 INFO: main: done 2024-09-12T00:17:18.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.016+0000 7fcf96fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:18.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.020+0000 7fd0e2b669c0 20 remove_watcher() i=0 2024-09-12T00:17:18.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.020+0000 7fd0e2b669c0 2 removed watcher, disabling cache 2024-09-12T00:17:18.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.024+0000 7fd0e2b669c0 20 remove_watcher() i=1 2024-09-12T00:17:18.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.024+0000 7fd0e2b669c0 20 remove_watcher() i=2 2024-09-12T00:17:18.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.028+0000 7fd0e2b669c0 20 remove_watcher() i=3 2024-09-12T00:17:18.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.028+0000 7fd0e2b669c0 20 remove_watcher() i=4 2024-09-12T00:17:18.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.032+0000 7fd0e2b669c0 20 remove_watcher() i=5 2024-09-12T00:17:18.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.036+0000 7fd0e2b669c0 20 remove_watcher() i=6 2024-09-12T00:17:18.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.036+0000 7fd0e2b669c0 20 remove_watcher() i=7 2024-09-12T00:17:18.056 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:18.056 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:18.060 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:18.060 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:18.121 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:17:18.122 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:17:18.158 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:18.158 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:18.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.200+0000 7ff6dd9dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:18.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.204+0000 7ff6dd9dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:18.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.204+0000 7ff6dd9dc9c0 20 realm 2024-09-12T00:17:18.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.204+0000 7ff6dd9dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:18.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.204+0000 7ff6dd9dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:18.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.204+0000 7ff6dd9dc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:18.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.204+0000 7ff6dd9dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:18.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.204+0000 7ff6dd9dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:18.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.204+0000 7ff6dd9dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:18.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.204+0000 7ff6dd9dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:18.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.204+0000 7ff6dd9dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:18.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.204+0000 7ff6dd9dc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:18.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.204+0000 7ff6dd9dc9c0 20 searching for the correct realm 2024-09-12T00:17:18.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.212+0000 7ff6dbce3640 0 -- 172.21.15.138:0/658160307 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7ff6d40c1910 msgr2=0x7ff6d40b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:18.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.428+0000 7ff6dbce3640 0 -- 172.21.15.138:0/658160307 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5582ee468590 msgr2=0x5582ee46aa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:18.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.436+0000 7ff6dd9dc9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:18.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.436+0000 7ff6dd9dc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:18.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.436+0000 7ff6dd9dc9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:18.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.436+0000 7ff6dd9dc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:18.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.436+0000 7ff6dd9dc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:18.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.436+0000 7ff6dd9dc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:18.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.436+0000 7ff6dd9dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:18.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.440+0000 7ff6dd9dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:18.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.440+0000 7ff6dd9dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:18.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.440+0000 7ff6dd9dc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:18.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.440+0000 7ff6dd9dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:18.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.440+0000 7ff6dd9dc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:18.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.440+0000 7ff6dd9dc9c0 20 zone default found 2024-09-12T00:17:18.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.440+0000 7ff6dd9dc9c0 4 Realm: () 2024-09-12T00:17:18.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.440+0000 7ff6dd9dc9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:18.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.440+0000 7ff6dd9dc9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:18.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.440+0000 7ff6dd9dc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:18.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.440+0000 7ff6dd9dc9c0 20 zonegroup default 2024-09-12T00:17:18.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.440+0000 7ff6dd9dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:18.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.440+0000 7ff6dd9dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:18.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.440+0000 7ff6dd9dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:18.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.440+0000 7ff6dd9dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:18.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.440+0000 7ff6dd9dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:18.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.444+0000 7ff6dd9dc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:18.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.444+0000 7ff6dd9dc9c0 20 started sync module instance, tier type = 2024-09-12T00:17:18.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.444+0000 7ff6dd9dc9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:18.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.464+0000 7ff6dd9dc9c0 20 add_watcher() i=0 2024-09-12T00:17:18.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.464+0000 7ff6dd9dc9c0 20 add_watcher() i=1 2024-09-12T00:17:18.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.464+0000 7ff6dd9dc9c0 20 add_watcher() i=2 2024-09-12T00:17:18.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.464+0000 7ff6dd9dc9c0 20 add_watcher() i=3 2024-09-12T00:17:18.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.464+0000 7ff6dd9dc9c0 20 add_watcher() i=4 2024-09-12T00:17:18.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.464+0000 7ff6dd9dc9c0 20 add_watcher() i=5 2024-09-12T00:17:18.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.468+0000 7ff6dd9dc9c0 20 add_watcher() i=6 2024-09-12T00:17:18.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.468+0000 7ff6dd9dc9c0 20 add_watcher() i=7 2024-09-12T00:17:18.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.468+0000 7ff6dd9dc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:18.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.472+0000 7ff591fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:18.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.472+0000 7ff6dd9dc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:18.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.472+0000 7ff6dd9dc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:18.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.472+0000 7ff6dd9dc9c0 5 note: GC not initialized 2024-09-12T00:17:18.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.476+0000 7ff590fe1640 20 reqs_thread_entry: start 2024-09-12T00:17:18.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.476+0000 7ff6dd9dc9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:18.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.476+0000 7ff6dd9dc9c0 20 Filter name: none 2024-09-12T00:17:18.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.476+0000 7ff50a7fc640 20 reqs_thread_entry: start 2024-09-12T00:17:18.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.476+0000 7ff6dd9dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:18.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.476+0000 7ff6dd9dc9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:18.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.476+0000 7ff6dd9dc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:18.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.476+0000 7ff6dd9dc9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:18.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.476+0000 7ff6dd9dc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:17:18.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.476+0000 7ff6dd9dc9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:17:18.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.476+0000 7ff6dd9dc9c0 20 INFO: main: starting shard=0 2024-09-12T00:17:18.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.476+0000 7ff6dd9dc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:18.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.476+0000 7ff6dd9dc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.476+0000 7ff6dd9dc9c0 20 INFO: main: starting shard=1 2024-09-12T00:17:18.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.476+0000 7ff6dd9dc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:18.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.480+0000 7ff6dd9dc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.480+0000 7ff6dd9dc9c0 20 INFO: main: starting shard=2 2024-09-12T00:17:18.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.480+0000 7ff6dd9dc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:18.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.480+0000 7ff6dd9dc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.480+0000 7ff6dd9dc9c0 20 INFO: main: starting shard=3 2024-09-12T00:17:18.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.480+0000 7ff6dd9dc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:18.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.480+0000 7ff6dd9dc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.480+0000 7ff6dd9dc9c0 20 INFO: main: starting shard=4 2024-09-12T00:17:18.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.480+0000 7ff6dd9dc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:18.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.480+0000 7ff6dd9dc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.480+0000 7ff6dd9dc9c0 20 INFO: main: starting shard=5 2024-09-12T00:17:18.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.480+0000 7ff6dd9dc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:18.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.484+0000 7ff6dd9dc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.484+0000 7ff6dd9dc9c0 20 INFO: main: starting shard=6 2024-09-12T00:17:18.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.484+0000 7ff6dd9dc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:18.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.484+0000 7ff6dd9dc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.484+0000 7ff6dd9dc9c0 20 INFO: main: starting shard=7 2024-09-12T00:17:18.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.484+0000 7ff6dd9dc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:18.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.484+0000 7ff6dd9dc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.484+0000 7ff6dd9dc9c0 20 INFO: main: starting shard=8 2024-09-12T00:17:18.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.484+0000 7ff6dd9dc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:18.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.484+0000 7ff6dd9dc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.484+0000 7ff6dd9dc9c0 20 INFO: main: starting shard=9 2024-09-12T00:17:18.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.484+0000 7ff6dd9dc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:18.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.488+0000 7ff6dd9dc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:18.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.488+0000 7ff6dd9dc9c0 20 INFO: main: starting shard=10 2024-09-12T00:17:18.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.488+0000 7ff6dd9dc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:18.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.488+0000 7ff6dd9dc9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:17:18.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.488+0000 7ff6dd9dc9c0 20 INFO: main: done 2024-09-12T00:17:18.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.492+0000 7ff591fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:18.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.496+0000 7ff6dd9dc9c0 20 remove_watcher() i=0 2024-09-12T00:17:18.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.496+0000 7ff6dd9dc9c0 2 removed watcher, disabling cache 2024-09-12T00:17:18.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.496+0000 7ff6dd9dc9c0 20 remove_watcher() i=1 2024-09-12T00:17:18.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.500+0000 7ff6dd9dc9c0 20 remove_watcher() i=2 2024-09-12T00:17:18.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.500+0000 7ff6dd9dc9c0 20 remove_watcher() i=3 2024-09-12T00:17:18.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.504+0000 7ff6dd9dc9c0 20 remove_watcher() i=4 2024-09-12T00:17:18.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.508+0000 7ff6dd9dc9c0 20 remove_watcher() i=5 2024-09-12T00:17:18.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.508+0000 7ff6dd9dc9c0 20 remove_watcher() i=6 2024-09-12T00:17:18.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:18.512+0000 7ff6dd9dc9c0 20 remove_watcher() i=7 2024-09-12T00:17:18.540 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:18.540 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:18.545 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:17:18.982 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:17:19.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.304+0000 7f66ad7d1640 0 --2- 172.21.15.138:0/3967188847 >> [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] conn(0x7f66a80aae10 0x7f66a80ab1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:17:19.626 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T00:17:19.626 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:19.626 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:17:19.661 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:19.661 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:19.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.700+0000 7f7570d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:19.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.704+0000 7f7570d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:19.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.704+0000 7f7570d8a9c0 20 realm 2024-09-12T00:17:19.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.704+0000 7f7570d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:19.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.704+0000 7f7570d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:19.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.704+0000 7f7570d8a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:19.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.704+0000 7f7570d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:19.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.704+0000 7f7570d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:19.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.704+0000 7f7570d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:19.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.704+0000 7f7570d8a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:19.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.704+0000 7f7570d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:19.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.708+0000 7f7570d8a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:19.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.708+0000 7f7570d8a9c0 20 searching for the correct realm 2024-09-12T00:17:19.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.712+0000 7f756f091640 0 -- 172.21.15.138:0/2910516806 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f75600c3c70 msgr2=0x7f75600b8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:19.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.928+0000 7f756f091640 0 -- 172.21.15.138:0/2910516806 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55d31fc4b0c0 msgr2=0x55d31fc4d580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:19.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:19.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:19.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:19.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:19.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:19.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:19.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:19.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:19.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:19.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:19.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:19.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:19.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 20 zone default found 2024-09-12T00:17:19.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 4 Realm: () 2024-09-12T00:17:19.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:19.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:19.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:19.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 20 zonegroup default 2024-09-12T00:17:19.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.936+0000 7f7570d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:19.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.940+0000 7f7570d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:19.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.940+0000 7f7570d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:19.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.940+0000 7f7570d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:19.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.940+0000 7f7570d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:19.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.940+0000 7f7570d8a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:19.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.940+0000 7f7570d8a9c0 20 started sync module instance, tier type = 2024-09-12T00:17:19.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.940+0000 7f7570d8a9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:19.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.968+0000 7f7570d8a9c0 20 add_watcher() i=0 2024-09-12T00:17:19.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.968+0000 7f7570d8a9c0 20 add_watcher() i=1 2024-09-12T00:17:19.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.968+0000 7f7570d8a9c0 20 add_watcher() i=2 2024-09-12T00:17:19.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.968+0000 7f7570d8a9c0 20 add_watcher() i=3 2024-09-12T00:17:19.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.968+0000 7f7570d8a9c0 20 add_watcher() i=4 2024-09-12T00:17:19.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.968+0000 7f7570d8a9c0 20 add_watcher() i=5 2024-09-12T00:17:19.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.968+0000 7f7570d8a9c0 20 add_watcher() i=6 2024-09-12T00:17:19.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.968+0000 7f7570d8a9c0 20 add_watcher() i=7 2024-09-12T00:17:19.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.968+0000 7f7570d8a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:19.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.972+0000 7f74257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:19.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:19.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:19.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 5 note: GC not initialized 2024-09-12T00:17:19.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f739ffff640 20 reqs_thread_entry: start 2024-09-12T00:17:19.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:19.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 20 Filter name: none 2024-09-12T00:17:19.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f739dffb640 20 reqs_thread_entry: start 2024-09-12T00:17:19.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:17:19.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:19.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:19.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:17:19.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:17:19.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 : miss 2024-09-12T00:17:19.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:19.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:19.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 info.flags=0x17 2024-09-12T00:17:19.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 to cache LRU end 2024-09-12T00:17:19.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:19.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:17:19.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 2024-09-12T00:17:19.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.976+0000 7f7570d8a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:19.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.980+0000 7f7570d8a9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:17:19.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.980+0000 7f7570d8a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:19.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.980+0000 7f7570d8a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:19.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.980+0000 7f7570d8a9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:17:19.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.980+0000 7f7570d8a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:19.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.980+0000 7f7570d8a9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:17:19.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.980+0000 7f7570d8a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:19.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.984+0000 7f7570d8a9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:17:19.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.984+0000 7f7570d8a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:19.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.984+0000 7f7570d8a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:19.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.984+0000 7f7570d8a9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:17:19.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.984+0000 7f7570d8a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:19.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.984+0000 7f7570d8a9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:17:19.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.984+0000 7f7570d8a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:19.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.988+0000 7f7570d8a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:19.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.988+0000 7f7570d8a9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:17:19.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.988+0000 7f7570d8a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:19.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.988+0000 7f7570d8a9c0 1 NOTICE: finished shard 1 (1 entries found) 2024-09-12T00:17:19.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.988+0000 7f7570d8a9c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T00:17:19.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.988+0000 7f7570d8a9c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T00:17:19.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.988+0000 7f7570d8a9c0 1 NOTICE: finished shard 10 (1 entries found) 2024-09-12T00:17:19.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.988+0000 7f7570d8a9c0 1 NOTICE: finished all shards (4 entries found) 2024-09-12T00:17:19.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.992+0000 7f74257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:19.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.996+0000 7f7570d8a9c0 20 remove_watcher() i=0 2024-09-12T00:17:19.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:19.996+0000 7f7570d8a9c0 2 removed watcher, disabling cache 2024-09-12T00:17:20.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.000+0000 7f7570d8a9c0 20 remove_watcher() i=1 2024-09-12T00:17:20.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.000+0000 7f7570d8a9c0 20 remove_watcher() i=2 2024-09-12T00:17:20.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.004+0000 7f7570d8a9c0 20 remove_watcher() i=3 2024-09-12T00:17:20.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.004+0000 7f7570d8a9c0 20 remove_watcher() i=4 2024-09-12T00:17:20.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.008+0000 7f7570d8a9c0 20 remove_watcher() i=5 2024-09-12T00:17:20.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.012+0000 7f7570d8a9c0 20 remove_watcher() i=6 2024-09-12T00:17:20.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.012+0000 7f7570d8a9c0 20 remove_watcher() i=7 2024-09-12T00:17:20.032 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: unlinked entries are not listable 2024-09-12T00:17:20.032 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:20.034 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:20.035 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:20.041 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T00:17:20.041 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:20.043 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:20.043 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:20.091 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:20.091 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:20.137 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T00:17:20.137 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:20.137 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:17:20.178 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:20.179 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:20.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.220+0000 7f416eb119c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.220+0000 7f416eb119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:20.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.220+0000 7f416eb119c0 20 realm 2024-09-12T00:17:20.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.220+0000 7f416eb119c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.220+0000 7f416eb119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:20.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.220+0000 7f416eb119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:20.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.220+0000 7f416eb119c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.224+0000 7f416eb119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:20.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.224+0000 7f416eb119c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.224+0000 7f416eb119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:20.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.224+0000 7f416eb119c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.224+0000 7f416eb119c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:20.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.224+0000 7f416eb119c0 20 searching for the correct realm 2024-09-12T00:17:20.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.228+0000 7f416ce18640 0 -- 172.21.15.138:0/2137742751 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f41640b9960 msgr2=0x7f41640aa3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:20.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.236+0000 7f416ce18640 0 -- 172.21.15.138:0/2137742751 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x56228619ac60 msgr2=0x56228619d120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:20.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:20.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:20.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:20.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:20.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:20.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:20.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:20.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:20.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:20.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 zone default found 2024-09-12T00:17:20.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 4 Realm: () 2024-09-12T00:17:20.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:20.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:20.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:20.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 zonegroup default 2024-09-12T00:17:20.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:20.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:20.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.244+0000 7f416eb119c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.248+0000 7f416eb119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:20.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.248+0000 7f416eb119c0 20 started sync module instance, tier type = 2024-09-12T00:17:20.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.248+0000 7f416eb119c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:20.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.268+0000 7f416eb119c0 20 add_watcher() i=0 2024-09-12T00:17:20.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.268+0000 7f416eb119c0 20 add_watcher() i=1 2024-09-12T00:17:20.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.268+0000 7f416eb119c0 20 add_watcher() i=2 2024-09-12T00:17:20.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.268+0000 7f416eb119c0 20 add_watcher() i=3 2024-09-12T00:17:20.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.268+0000 7f416eb119c0 20 add_watcher() i=4 2024-09-12T00:17:20.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.268+0000 7f416eb119c0 20 add_watcher() i=5 2024-09-12T00:17:20.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.268+0000 7f416eb119c0 20 add_watcher() i=6 2024-09-12T00:17:20.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.268+0000 7f416eb119c0 20 add_watcher() i=7 2024-09-12T00:17:20.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.268+0000 7f416eb119c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:20.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.272+0000 7f4022fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:20.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.272+0000 7f416eb119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:20.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.272+0000 7f416eb119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:20.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.272+0000 7f416eb119c0 5 note: GC not initialized 2024-09-12T00:17:20.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f4021fdb640 20 reqs_thread_entry: start 2024-09-12T00:17:20.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:20.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 20 Filter name: none 2024-09-12T00:17:20.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f3f937fe640 20 reqs_thread_entry: start 2024-09-12T00:17:20.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:17:20.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:20.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:17:20.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:17:20.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 : miss 2024-09-12T00:17:20.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:20.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 info.flags=0x17 2024-09-12T00:17:20.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 to cache LRU end 2024-09-12T00:17:20.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:20.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:17:20.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 2024-09-12T00:17:20.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:20.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:17:20.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:20.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:20.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:17:20.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.276+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:20.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.280+0000 7f416eb119c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:17:20.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.280+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:20.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.280+0000 7f416eb119c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:17:20.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.280+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:20.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.280+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:20.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.280+0000 7f416eb119c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:17:20.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.280+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:20.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.280+0000 7f416eb119c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:17:20.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.280+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:20.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.284+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:20.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.284+0000 7f416eb119c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:17:20.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.284+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:20.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.284+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:20.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.284+0000 7f416eb119c0 20 get_obj_state: octx=0x562285e8a3b0 obj=check-bucket:e state=0x5622861cc918 s->prefetch_data=0 2024-09-12T00:17:20.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.284+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:20.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.284+0000 7f416eb119c0 20 get_obj_state: octx=0x562285f2f6d0 obj=check-bucket:d state=0x5622861ce4a8 s->prefetch_data=0 2024-09-12T00:17:20.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.284+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:20.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.284+0000 7f416eb119c0 20 get_obj_state: octx=0x5622861cf5e0 obj=check-bucket:c state=0x5622861c73e8 s->prefetch_data=0 2024-09-12T00:17:20.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.288+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:20.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.288+0000 7f416eb119c0 20 get_obj_state: octx=0x5622861cd450 obj=check-bucket:f state=0x5622861ca0c8 s->prefetch_data=0 2024-09-12T00:17:20.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.288+0000 7f416eb119c0 20 get_obj_state: setting s->obj_tag to f0rtvwrqa5yqvqoy4rji4j56w6onayum 2024-09-12T00:17:20.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.288+0000 7f416eb119c0 20 get_obj_state_impl: setting s->olh_tag to y970m8sj9pzl6pvnpi9y5uxy4yrccraw 2024-09-12T00:17:20.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.288+0000 7f416eb119c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=y970m8sj9pzl6pvnpi9y5uxy4yrccraw 2024-09-12T00:17:20.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.288+0000 7f416eb119c0 20 get_obj_state: setting s->obj_tag to 1rz2igum9zdpsl840d3fm1i6uq27i8yp 2024-09-12T00:17:20.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.288+0000 7f416eb119c0 20 get_obj_state_impl: setting s->olh_tag to clyfve26ylvxtp7ffugxqz5vscy58khf 2024-09-12T00:17:20.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.288+0000 7f416eb119c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=clyfve26ylvxtp7ffugxqz5vscy58khf 2024-09-12T00:17:20.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.288+0000 7f416eb119c0 20 get_obj_state: setting s->obj_tag to l6ytsoi5djuiaeut1s3frpz73castue1 2024-09-12T00:17:20.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.288+0000 7f416eb119c0 20 get_obj_state_impl: setting s->olh_tag to q27t9l4ksuxrdmy23q7pquokvwn4yg9p 2024-09-12T00:17:20.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.288+0000 7f416eb119c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=q27t9l4ksuxrdmy23q7pquokvwn4yg9p 2024-09-12T00:17:20.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.288+0000 7f416eb119c0 20 get_obj_state: setting s->obj_tag to sf5xypyiwera0z07r037tmjzxc6zy4yi 2024-09-12T00:17:20.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.288+0000 7f416eb119c0 20 get_obj_state_impl: setting s->olh_tag to mju7e9bmbrk0r606210kd3gyra2arvt4 2024-09-12T00:17:20.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.288+0000 7f416eb119c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mju7e9bmbrk0r606210kd3gyra2arvt4 2024-09-12T00:17:20.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.292+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:20.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.292+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:20.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.292+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:20.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.292+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:20.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:20.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:17:20.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 olh_log_entry: epoch=2 op=3 key=e[NA7WGpnDsfyWObkMnXLdeFxEsAvjV1r] 2024-09-12T00:17:20.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 get_obj_state: octx=0x562285e8a3b0 obj=check-bucket:_:NA7WGpnDsfyWObkMnXLdeFxEsAvjV1r_e state=0x56228626fcf8 s->prefetch_data=0 2024-09-12T00:17:20.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:20.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 10 manifest: total_size = 11 2024-09-12T00:17:20.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.4524149461074360856 2024-09-12T00:17:20.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 get_obj_state: octx=0x562285e8a3b0 obj=check-bucket:_:NA7WGpnDsfyWObkMnXLdeFxEsAvjV1r_e state=0x56228626fcf8 s->prefetch_data=0 2024-09-12T00:17:20.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 prepare_atomic_modification: state is not atomic. state=0x56228626fcf8 2024-09-12T00:17:20.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:20.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 olh_log_entry: epoch=3 op=3 key=d[4tNj6zPSyd3nV-uNSiYKjnjEEsjfFbl] 2024-09-12T00:17:20.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 get_obj_state: octx=0x562285f2f6d0 obj=check-bucket:_:4tNj6zPSyd3nV-uNSiYKjnjEEsjfFbl_d state=0x56228627c938 s->prefetch_data=0 2024-09-12T00:17:20.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:20.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:20.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:17:20.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 olh_log_entry: epoch=2 op=3 key=f[wCLY2fyL0Tsh34hO2fkaYd7ezmPMjyT] 2024-09-12T00:17:20.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 get_obj_state: octx=0x5622861cd450 obj=check-bucket:_:wCLY2fyL0Tsh34hO2fkaYd7ezmPMjyT_f state=0x56228625b658 s->prefetch_data=0 2024-09-12T00:17:20.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 10 manifest: total_size = 22 2024-09-12T00:17:20.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.4007953570259884184 2024-09-12T00:17:20.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 get_obj_state: octx=0x562285f2f6d0 obj=check-bucket:_:4tNj6zPSyd3nV-uNSiYKjnjEEsjfFbl_d state=0x56228627c938 s->prefetch_data=0 2024-09-12T00:17:20.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 prepare_atomic_modification: state is not atomic. state=0x56228627c938 2024-09-12T00:17:20.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:20.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 olh_log_entry: epoch=3 op=3 key=c[KjWuskjpg8uR80cpO2cXseGJj2m7ioc] 2024-09-12T00:17:20.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 get_obj_state: octx=0x5622861cf5e0 obj=check-bucket:_:KjWuskjpg8uR80cpO2cXseGJj2m7ioc_c state=0x5622862898f8 s->prefetch_data=0 2024-09-12T00:17:20.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 10 manifest: total_size = 12 2024-09-12T00:17:20.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.1996020375408614882 2024-09-12T00:17:20.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 get_obj_state: octx=0x5622861cd450 obj=check-bucket:_:wCLY2fyL0Tsh34hO2fkaYd7ezmPMjyT_f state=0x56228625b658 s->prefetch_data=0 2024-09-12T00:17:20.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 prepare_atomic_modification: state is not atomic. state=0x56228625b658 2024-09-12T00:17:20.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.296+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:20.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.300+0000 7f416eb119c0 10 manifest: total_size = 22 2024-09-12T00:17:20.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.300+0000 7f416eb119c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.16414522709780145286 2024-09-12T00:17:20.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.300+0000 7f416eb119c0 20 get_obj_state: octx=0x5622861cf5e0 obj=check-bucket:_:KjWuskjpg8uR80cpO2cXseGJj2m7ioc_c state=0x5622862898f8 s->prefetch_data=0 2024-09-12T00:17:20.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.300+0000 7f416eb119c0 20 prepare_atomic_modification: state is not atomic. state=0x5622862898f8 2024-09-12T00:17:20.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.300+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:20.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.304+0000 7f416eb119c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:20.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.304+0000 7f416eb119c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T00:17:20.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.304+0000 7f416eb119c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:17:20.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.304+0000 7f416eb119c0 5 delete_objs_inline: removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.1__shadow:NA7WGpnDsfyWObkMnXLdeFxEsAvjV1r_.O-90Rkg60a5yqHSQ_aAPO_Ves01ReLI_0 2024-09-12T00:17:20.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.304+0000 7f416eb119c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:20.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.304+0000 7f416eb119c0 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:17:20.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.304+0000 7f416eb119c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:17:20.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.304+0000 7f416eb119c0 5 delete_objs_inline: removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.1__shadow:wCLY2fyL0Tsh34hO2fkaYd7ezmPMjyT_.UBeD4yBJJgrcsZWEcR1wl0bTuR9CEC1_0 2024-09-12T00:17:20.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.308+0000 7f416eb119c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:20.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.308+0000 7f416eb119c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:17:20.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.308+0000 7f416eb119c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:17:20.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.308+0000 7f416eb119c0 5 delete_objs_inline: removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.1__shadow:4tNj6zPSyd3nV-uNSiYKjnjEEsjfFbl_.Jg9oEse_k3a4btiqqE2PuWVXff2Y3jW_0 2024-09-12T00:17:20.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.308+0000 7f4042ffd640 20 handle_completion(): completion ok for obj=e[NA7WGpnDsfyWObkMnXLdeFxEsAvjV1r] 2024-09-12T00:17:20.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.308+0000 7f416eb119c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:17:20.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.308+0000 7f416eb119c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:20.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.308+0000 7f416eb119c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:17:20.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.308+0000 7f416eb119c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:17:20.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.308+0000 7f416eb119c0 5 delete_objs_inline: removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.1__shadow:KjWuskjpg8uR80cpO2cXseGJj2m7ioc_.dDZ7DvEkPQB9a7_JVFwAWNFzRND3PCa_0 2024-09-12T00:17:20.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.312+0000 7f40437fe640 20 handle_completion(): completion ok for obj=f[wCLY2fyL0Tsh34hO2fkaYd7ezmPMjyT] 2024-09-12T00:17:20.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.312+0000 7f416eb119c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:17:20.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.312+0000 7f416eb119c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:17:20.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.312+0000 7f416eb119c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:17:20.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.312+0000 7f4042ffd640 20 handle_completion(): completion ok for obj=c[KjWuskjpg8uR80cpO2cXseGJj2m7ioc] 2024-09-12T00:17:20.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.316+0000 7f40437fe640 20 handle_completion(): completion ok for obj=d[4tNj6zPSyd3nV-uNSiYKjnjEEsjfFbl] 2024-09-12T00:17:20.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.320+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:20.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.320+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:20.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.320+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:20.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.320+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:20.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.320+0000 7f416eb119c0 20 get_obj_state: octx=0x5622861cd450 obj=check-bucket:f state=0x5622861ca0c8 s->prefetch_data=0 2024-09-12T00:17:20.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.320+0000 7f416eb119c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mju7e9bmbrk0r606210kd3gyra2arvt4 2024-09-12T00:17:20.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.320+0000 7f416eb119c0 20 get_obj_state: octx=0x562285e8a3b0 obj=check-bucket:e state=0x5622861cc918 s->prefetch_data=0 2024-09-12T00:17:20.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.320+0000 7f416eb119c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=y970m8sj9pzl6pvnpi9y5uxy4yrccraw 2024-09-12T00:17:20.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.324+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:20.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.324+0000 7f416eb119c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:17:20.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.328+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:20.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.328+0000 7f416eb119c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:17:20.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.332+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:20.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.336+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:20.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.336+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:20.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.336+0000 7f416eb119c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T00:17:20.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.340+0000 7f416eb119c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:20.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.340+0000 7f416eb119c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T00:17:20.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.340+0000 7f416eb119c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:17:20.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.340+0000 7f4022fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:20.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.344+0000 7f416eb119c0 20 remove_watcher() i=0 2024-09-12T00:17:20.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.344+0000 7f416eb119c0 2 removed watcher, disabling cache 2024-09-12T00:17:20.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.348+0000 7f416eb119c0 20 remove_watcher() i=1 2024-09-12T00:17:20.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.348+0000 7f416eb119c0 20 remove_watcher() i=2 2024-09-12T00:17:20.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.352+0000 7f416eb119c0 20 remove_watcher() i=3 2024-09-12T00:17:20.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.352+0000 7f416eb119c0 20 remove_watcher() i=4 2024-09-12T00:17:20.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.352+0000 7f416eb119c0 20 remove_watcher() i=5 2024-09-12T00:17:20.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.356+0000 7f416eb119c0 20 remove_watcher() i=6 2024-09-12T00:17:20.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.360+0000 7f416eb119c0 20 remove_watcher() i=7 2024-09-12T00:17:20.377 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:20.378 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:20.381 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:20.381 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:20.384 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:20.385 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:20.387 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:20.388 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:20.390 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T00:17:20.390 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:20.390 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:20.391 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:20.440 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:20.440 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:20.443 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:20.443 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:20.447 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:20.447 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:20.451 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:20.451 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:20.453 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T00:17:20.453 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:20.454 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:17:20.489 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:20.489 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:20.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.528+0000 7fe8e8b089c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.532+0000 7fe8e8b089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:20.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.532+0000 7fe8e8b089c0 20 realm 2024-09-12T00:17:20.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.532+0000 7fe8e8b089c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.532+0000 7fe8e8b089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:20.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.532+0000 7fe8e8b089c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:20.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.532+0000 7fe8e8b089c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.532+0000 7fe8e8b089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:20.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.532+0000 7fe8e8b089c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.532+0000 7fe8e8b089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:20.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.532+0000 7fe8e8b089c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.536+0000 7fe8e8b089c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:20.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.536+0000 7fe8e8b089c0 20 searching for the correct realm 2024-09-12T00:17:20.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.540+0000 7fe8e6e0f640 0 -- 172.21.15.138:0/2093447925 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fe8e00f8a30 msgr2=0x7fe8e0119970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:20.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.756+0000 7fe8e6e0f640 0 -- 172.21.15.138:0/2093447925 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55a933a9a2b0 msgr2=0x55a933a9c770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:20.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.764+0000 7fe8e8b089c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:20.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.764+0000 7fe8e8b089c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:20.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.764+0000 7fe8e8b089c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:20.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.764+0000 7fe8e8b089c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:20.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.764+0000 7fe8e8b089c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:20.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.764+0000 7fe8e8b089c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:20.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.764+0000 7fe8e8b089c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.764+0000 7fe8e8b089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:20.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.764+0000 7fe8e8b089c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.768+0000 7fe8e8b089c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:20.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.768+0000 7fe8e8b089c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.768+0000 7fe8e8b089c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:20.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.768+0000 7fe8e8b089c0 20 zone default found 2024-09-12T00:17:20.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.768+0000 7fe8e8b089c0 4 Realm: () 2024-09-12T00:17:20.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.768+0000 7fe8e8b089c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:20.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.768+0000 7fe8e8b089c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:20.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.768+0000 7fe8e8b089c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:20.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.768+0000 7fe8e8b089c0 20 zonegroup default 2024-09-12T00:17:20.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.768+0000 7fe8e8b089c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.768+0000 7fe8e8b089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:20.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.768+0000 7fe8e8b089c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.768+0000 7fe8e8b089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:20.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.768+0000 7fe8e8b089c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.768+0000 7fe8e8b089c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:20.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.768+0000 7fe8e8b089c0 20 started sync module instance, tier type = 2024-09-12T00:17:20.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.768+0000 7fe8e8b089c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:20.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.796+0000 7fe8e8b089c0 20 add_watcher() i=0 2024-09-12T00:17:20.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.796+0000 7fe8e8b089c0 20 add_watcher() i=1 2024-09-12T00:17:20.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.796+0000 7fe8e8b089c0 20 add_watcher() i=2 2024-09-12T00:17:20.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.796+0000 7fe8e8b089c0 20 add_watcher() i=3 2024-09-12T00:17:20.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.796+0000 7fe8e8b089c0 20 add_watcher() i=4 2024-09-12T00:17:20.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.796+0000 7fe8e8b089c0 20 add_watcher() i=5 2024-09-12T00:17:20.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.796+0000 7fe8e8b089c0 20 add_watcher() i=6 2024-09-12T00:17:20.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.800+0000 7fe8e8b089c0 20 add_watcher() i=7 2024-09-12T00:17:20.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.800+0000 7fe8e8b089c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:20.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.804+0000 7fe79cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:20.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.804+0000 7fe8e8b089c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:20.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.804+0000 7fe8e8b089c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:20.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.804+0000 7fe8e8b089c0 5 note: GC not initialized 2024-09-12T00:17:20.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.804+0000 7fe7177fe640 20 reqs_thread_entry: start 2024-09-12T00:17:20.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.804+0000 7fe8e8b089c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:20.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.804+0000 7fe8e8b089c0 20 Filter name: none 2024-09-12T00:17:20.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.804+0000 7fe7157fa640 20 reqs_thread_entry: start 2024-09-12T00:17:20.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.804+0000 7fe8e8b089c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:17:20.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.804+0000 7fe8e8b089c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.808+0000 7fe8e8b089c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:20.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.808+0000 7fe8e8b089c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:17:20.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.808+0000 7fe8e8b089c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:17:20.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.808+0000 7fe8e8b089c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 : miss 2024-09-12T00:17:20.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.808+0000 7fe8e8b089c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:20.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.808+0000 7fe8e8b089c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:20.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.808+0000 7fe8e8b089c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 info.flags=0x17 2024-09-12T00:17:20.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.808+0000 7fe8e8b089c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 to cache LRU end 2024-09-12T00:17:20.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.808+0000 7fe8e8b089c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:20.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.808+0000 7fe8e8b089c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:17:20.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.808+0000 7fe8e8b089c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 2024-09-12T00:17:20.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.808+0000 7fe8e8b089c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:20.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.808+0000 7fe8e8b089c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:17:20.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.808+0000 7fe8e8b089c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:20.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.808+0000 7fe8e8b089c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:17:20.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.808+0000 7fe8e8b089c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:20.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.812+0000 7fe8e8b089c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:17:20.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.812+0000 7fe8e8b089c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:20.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.812+0000 7fe8e8b089c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:17:20.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.812+0000 7fe8e8b089c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:20.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.812+0000 7fe8e8b089c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:17:20.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.812+0000 7fe8e8b089c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:20.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.812+0000 7fe8e8b089c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:17:20.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.812+0000 7fe8e8b089c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:20.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.816+0000 7fe8e8b089c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:17:20.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.816+0000 7fe8e8b089c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:20.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.816+0000 7fe8e8b089c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:17:20.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.816+0000 7fe8e8b089c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:20.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.816+0000 7fe8e8b089c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:17:20.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.816+0000 7fe8e8b089c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:20.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.816+0000 7fe8e8b089c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:17:20.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.816+0000 7fe8e8b089c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:20.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.816+0000 7fe8e8b089c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:17:20.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.816+0000 7fe8e8b089c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:17:20.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.820+0000 7fe79cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:20.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.824+0000 7fe8e8b089c0 20 remove_watcher() i=0 2024-09-12T00:17:20.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.824+0000 7fe8e8b089c0 2 removed watcher, disabling cache 2024-09-12T00:17:20.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.828+0000 7fe8e8b089c0 20 remove_watcher() i=1 2024-09-12T00:17:20.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.828+0000 7fe8e8b089c0 20 remove_watcher() i=2 2024-09-12T00:17:20.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.832+0000 7fe8e8b089c0 20 remove_watcher() i=3 2024-09-12T00:17:20.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.832+0000 7fe8e8b089c0 20 remove_watcher() i=4 2024-09-12T00:17:20.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.836+0000 7fe8e8b089c0 20 remove_watcher() i=5 2024-09-12T00:17:20.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.840+0000 7fe8e8b089c0 20 remove_watcher() i=6 2024-09-12T00:17:20.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:20.840+0000 7fe8e8b089c0 20 remove_watcher() i=7 2024-09-12T00:17:20.866 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:20.866 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:20.896 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:20.896 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:20.925 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:17:20.956 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:20.957 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:21.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.000+0000 7fa0f72bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.000+0000 7fa0f72bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.000+0000 7fa0f72bd9c0 20 realm 2024-09-12T00:17:21.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.000+0000 7fa0f72bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.000+0000 7fa0f72bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.000+0000 7fa0f72bd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:21.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.000+0000 7fa0f72bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.004+0000 7fa0f72bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.004+0000 7fa0f72bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.004+0000 7fa0f72bd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:21.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.004+0000 7fa0f72bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.004+0000 7fa0f72bd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:21.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.004+0000 7fa0f72bd9c0 20 searching for the correct realm 2024-09-12T00:17:21.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.008+0000 7fa0f55c4640 0 -- 172.21.15.138:0/2315216079 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55719b725d30 msgr2=0x55719b7281f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:21.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.016+0000 7fa0f55c4640 0 -- 172.21.15.138:0/2315216079 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x55719b719500 msgr2=0x55719b71b950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:17:21.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:21.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:21.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:21.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:21.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:21.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:21.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:21.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:21.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 zone default found 2024-09-12T00:17:21.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 4 Realm: () 2024-09-12T00:17:21.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:21.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:21.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:21.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 zonegroup default 2024-09-12T00:17:21.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 started sync module instance, tier type = 2024-09-12T00:17:21.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.024+0000 7fa0f72bd9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:21.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.044+0000 7fa0f72bd9c0 20 add_watcher() i=0 2024-09-12T00:17:21.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.044+0000 7fa0f72bd9c0 20 add_watcher() i=1 2024-09-12T00:17:21.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.044+0000 7fa0f72bd9c0 20 add_watcher() i=2 2024-09-12T00:17:21.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.044+0000 7fa0f72bd9c0 20 add_watcher() i=3 2024-09-12T00:17:21.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.044+0000 7fa0f72bd9c0 20 add_watcher() i=4 2024-09-12T00:17:21.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.044+0000 7fa0f72bd9c0 20 add_watcher() i=5 2024-09-12T00:17:21.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.044+0000 7fa0f72bd9c0 20 add_watcher() i=6 2024-09-12T00:17:21.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.048+0000 7fa0f72bd9c0 20 add_watcher() i=7 2024-09-12T00:17:21.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.048+0000 7fa0f72bd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:21.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.052+0000 7f9faafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:21.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.052+0000 7fa0f72bd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:21.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.052+0000 7fa0f72bd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:21.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.052+0000 7fa0f72bd9c0 5 note: GC not initialized 2024-09-12T00:17:21.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.052+0000 7f9fa9fe3640 20 reqs_thread_entry: start 2024-09-12T00:17:21.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.052+0000 7fa0f72bd9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:21.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.052+0000 7fa0f72bd9c0 20 Filter name: none 2024-09-12T00:17:21.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.052+0000 7f9f1b7fe640 20 reqs_thread_entry: start 2024-09-12T00:17:21.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.052+0000 7fa0f72bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.052+0000 7fa0f72bd9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:21.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.052+0000 7fa0f72bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.052+0000 7fa0f72bd9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:21.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.052+0000 7fa0f72bd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:17:21.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.052+0000 7fa0f72bd9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:17:21.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.052+0000 7fa0f72bd9c0 20 INFO: main: starting shard=0 2024-09-12T00:17:21.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.052+0000 7fa0f72bd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:21.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.056+0000 7fa0f72bd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.056+0000 7fa0f72bd9c0 20 INFO: main: starting shard=1 2024-09-12T00:17:21.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.056+0000 7fa0f72bd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:21.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.056+0000 7fa0f72bd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.056+0000 7fa0f72bd9c0 20 INFO: main: starting shard=2 2024-09-12T00:17:21.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.056+0000 7fa0f72bd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:21.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.056+0000 7fa0f72bd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.056+0000 7fa0f72bd9c0 20 INFO: main: starting shard=3 2024-09-12T00:17:21.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.056+0000 7fa0f72bd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:21.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.056+0000 7fa0f72bd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.056+0000 7fa0f72bd9c0 20 INFO: main: starting shard=4 2024-09-12T00:17:21.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.056+0000 7fa0f72bd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:21.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.056+0000 7fa0f72bd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.056+0000 7fa0f72bd9c0 20 INFO: main: starting shard=5 2024-09-12T00:17:21.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.056+0000 7fa0f72bd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:21.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.060+0000 7fa0f72bd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.060+0000 7fa0f72bd9c0 20 INFO: main: starting shard=6 2024-09-12T00:17:21.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.060+0000 7fa0f72bd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:21.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.060+0000 7fa0f72bd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.060+0000 7fa0f72bd9c0 20 INFO: main: starting shard=7 2024-09-12T00:17:21.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.060+0000 7fa0f72bd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:21.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.060+0000 7fa0f72bd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.060+0000 7fa0f72bd9c0 20 INFO: main: starting shard=8 2024-09-12T00:17:21.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.060+0000 7fa0f72bd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:21.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.060+0000 7fa0f72bd9c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:17:21.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.060+0000 7fa0f72bd9c0 20 INFO: main: starting shard=9 2024-09-12T00:17:21.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.060+0000 7fa0f72bd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:21.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.060+0000 7fa0f72bd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.060+0000 7fa0f72bd9c0 20 INFO: main: starting shard=10 2024-09-12T00:17:21.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.060+0000 7fa0f72bd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:21.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.064+0000 7fa0f72bd9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.064+0000 7fa0f72bd9c0 20 INFO: main: done 2024-09-12T00:17:21.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.064+0000 7f9faafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:21.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.068+0000 7fa0f72bd9c0 20 remove_watcher() i=0 2024-09-12T00:17:21.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.068+0000 7fa0f72bd9c0 2 removed watcher, disabling cache 2024-09-12T00:17:21.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.072+0000 7fa0f72bd9c0 20 remove_watcher() i=1 2024-09-12T00:17:21.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.072+0000 7fa0f72bd9c0 20 remove_watcher() i=2 2024-09-12T00:17:21.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.076+0000 7fa0f72bd9c0 20 remove_watcher() i=3 2024-09-12T00:17:21.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.076+0000 7fa0f72bd9c0 20 remove_watcher() i=4 2024-09-12T00:17:21.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.080+0000 7fa0f72bd9c0 20 remove_watcher() i=5 2024-09-12T00:17:21.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.080+0000 7fa0f72bd9c0 20 remove_watcher() i=6 2024-09-12T00:17:21.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.084+0000 7fa0f72bd9c0 20 remove_watcher() i=7 2024-09-12T00:17:21.100 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:17:21.130 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:21.130 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:21.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.172+0000 7f80d32ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.172+0000 7f80d32ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.172+0000 7f80d32ca9c0 20 realm 2024-09-12T00:17:21.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.172+0000 7f80d32ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.176+0000 7f80d32ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.176+0000 7f80d32ca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:21.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.176+0000 7f80d32ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.176+0000 7f80d32ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.176+0000 7f80d32ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.176+0000 7f80d32ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:21.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.176+0000 7f80d32ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.176+0000 7f80d32ca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:21.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.176+0000 7f80d32ca9c0 20 searching for the correct realm 2024-09-12T00:17:21.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.180+0000 7f80d15d1640 0 -- 172.21.15.138:0/3526976989 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f80c8072690 msgr2=0x7f80c8056a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:21.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.396+0000 7f80d15d1640 0 -- 172.21.15.138:0/3526976989 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x556af739a3e0 msgr2=0x556af739c880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:21.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.404+0000 7f80d32ca9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:21.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.404+0000 7f80d32ca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:21.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.404+0000 7f80d32ca9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:21.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.404+0000 7f80d32ca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:21.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.404+0000 7f80d32ca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:21.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.404+0000 7f80d32ca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:21.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.404+0000 7f80d32ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.404+0000 7f80d32ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.404+0000 7f80d32ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.408+0000 7f80d32ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:21.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.408+0000 7f80d32ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.408+0000 7f80d32ca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:21.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.408+0000 7f80d32ca9c0 20 zone default found 2024-09-12T00:17:21.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.408+0000 7f80d32ca9c0 4 Realm: () 2024-09-12T00:17:21.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.408+0000 7f80d32ca9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:21.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.408+0000 7f80d32ca9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:21.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.408+0000 7f80d32ca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:21.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.408+0000 7f80d32ca9c0 20 zonegroup default 2024-09-12T00:17:21.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.408+0000 7f80d32ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.408+0000 7f80d32ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.408+0000 7f80d32ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.408+0000 7f80d32ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.408+0000 7f80d32ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.412+0000 7f80d32ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.412+0000 7f80d32ca9c0 20 started sync module instance, tier type = 2024-09-12T00:17:21.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.412+0000 7f80d32ca9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:21.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.436+0000 7f80d32ca9c0 20 add_watcher() i=0 2024-09-12T00:17:21.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.436+0000 7f80d32ca9c0 20 add_watcher() i=1 2024-09-12T00:17:21.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.436+0000 7f80d32ca9c0 20 add_watcher() i=2 2024-09-12T00:17:21.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.436+0000 7f80d32ca9c0 20 add_watcher() i=3 2024-09-12T00:17:21.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.436+0000 7f80d32ca9c0 20 add_watcher() i=4 2024-09-12T00:17:21.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.436+0000 7f80d32ca9c0 20 add_watcher() i=5 2024-09-12T00:17:21.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.436+0000 7f80d32ca9c0 20 add_watcher() i=6 2024-09-12T00:17:21.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.436+0000 7f80d32ca9c0 20 add_watcher() i=7 2024-09-12T00:17:21.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.436+0000 7f80d32ca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:21.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.440+0000 7f7f86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:21.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.444+0000 7f80d32ca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:21.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.444+0000 7f80d32ca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:21.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.444+0000 7f80d32ca9c0 5 note: GC not initialized 2024-09-12T00:17:21.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.444+0000 7f7f85fe3640 20 reqs_thread_entry: start 2024-09-12T00:17:21.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.444+0000 7f80d32ca9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:21.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.444+0000 7f80d32ca9c0 20 Filter name: none 2024-09-12T00:17:21.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.444+0000 7f7ef77fe640 20 reqs_thread_entry: start 2024-09-12T00:17:21.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.444+0000 7f80d32ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.444+0000 7f80d32ca9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:21.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.444+0000 7f80d32ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.444+0000 7f80d32ca9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:21.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.444+0000 7f80d32ca9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:17:21.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.444+0000 7f80d32ca9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:17:21.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.444+0000 7f80d32ca9c0 20 INFO: main: starting shard=0 2024-09-12T00:17:21.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.444+0000 7f80d32ca9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:21.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.448+0000 7f80d32ca9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.448+0000 7f80d32ca9c0 20 INFO: main: starting shard=1 2024-09-12T00:17:21.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.448+0000 7f80d32ca9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:21.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.448+0000 7f80d32ca9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.448+0000 7f80d32ca9c0 20 INFO: main: starting shard=2 2024-09-12T00:17:21.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.448+0000 7f80d32ca9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:21.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.448+0000 7f80d32ca9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.448+0000 7f80d32ca9c0 20 INFO: main: starting shard=3 2024-09-12T00:17:21.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.448+0000 7f80d32ca9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:21.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.448+0000 7f80d32ca9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.448+0000 7f80d32ca9c0 20 INFO: main: starting shard=4 2024-09-12T00:17:21.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.448+0000 7f80d32ca9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:21.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.448+0000 7f80d32ca9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.448+0000 7f80d32ca9c0 20 INFO: main: starting shard=5 2024-09-12T00:17:21.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.448+0000 7f80d32ca9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:21.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.452+0000 7f80d32ca9c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:17:21.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.452+0000 7f80d32ca9c0 20 INFO: main: starting shard=6 2024-09-12T00:17:21.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.452+0000 7f80d32ca9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:21.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.452+0000 7f80d32ca9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.452+0000 7f80d32ca9c0 20 INFO: main: starting shard=7 2024-09-12T00:17:21.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.452+0000 7f80d32ca9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:21.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.452+0000 7f80d32ca9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.452+0000 7f80d32ca9c0 20 INFO: main: starting shard=8 2024-09-12T00:17:21.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.452+0000 7f80d32ca9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:21.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.452+0000 7f80d32ca9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.452+0000 7f80d32ca9c0 20 INFO: main: starting shard=9 2024-09-12T00:17:21.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.452+0000 7f80d32ca9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:21.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.456+0000 7f80d32ca9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.456+0000 7f80d32ca9c0 20 INFO: main: starting shard=10 2024-09-12T00:17:21.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.456+0000 7f80d32ca9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:21.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.456+0000 7f80d32ca9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:21.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.456+0000 7f80d32ca9c0 20 INFO: main: done 2024-09-12T00:17:21.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.456+0000 7f7f86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:21.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.460+0000 7f80d32ca9c0 20 remove_watcher() i=0 2024-09-12T00:17:21.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.464+0000 7f80d32ca9c0 2 removed watcher, disabling cache 2024-09-12T00:17:21.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.464+0000 7f80d32ca9c0 20 remove_watcher() i=1 2024-09-12T00:17:21.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.468+0000 7f80d32ca9c0 20 remove_watcher() i=2 2024-09-12T00:17:21.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.468+0000 7f80d32ca9c0 20 remove_watcher() i=3 2024-09-12T00:17:21.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.472+0000 7f80d32ca9c0 20 remove_watcher() i=4 2024-09-12T00:17:21.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.472+0000 7f80d32ca9c0 20 remove_watcher() i=5 2024-09-12T00:17:21.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.476+0000 7f80d32ca9c0 20 remove_watcher() i=6 2024-09-12T00:17:21.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.480+0000 7f80d32ca9c0 20 remove_watcher() i=7 2024-09-12T00:17:21.497 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T00:17:21.498 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:21.498 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:17:21.531 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:21.531 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:21.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.572+0000 7f7edaa6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.572+0000 7f7edaa6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.572+0000 7f7edaa6c9c0 20 realm 2024-09-12T00:17:21.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.572+0000 7f7edaa6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.576+0000 7f7edaa6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.576+0000 7f7edaa6c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:21.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.576+0000 7f7edaa6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.576+0000 7f7edaa6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.576+0000 7f7edaa6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.576+0000 7f7edaa6c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:21.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.576+0000 7f7edaa6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.576+0000 7f7edaa6c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:21.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.576+0000 7f7edaa6c9c0 20 searching for the correct realm 2024-09-12T00:17:21.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.580+0000 7f7ed7d71640 0 -- 172.21.15.138:0/2222100078 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f7ed0051040 msgr2=0x7f7ed0042400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:21.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.792+0000 7f7ed7d71640 0 -- 172.21.15.138:0/2222100078 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x559b0f9fb1e0 msgr2=0x559b0f9fd5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:21.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:21.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:21.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:21.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:21.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:21.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:21.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:21.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:21.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 20 zone default found 2024-09-12T00:17:21.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 4 Realm: () 2024-09-12T00:17:21.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:21.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:21.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:21.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 20 zonegroup default 2024-09-12T00:17:21.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.808+0000 7f7edaa6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.812+0000 7f7edaa6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.812+0000 7f7edaa6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.812+0000 7f7edaa6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.812+0000 7f7edaa6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.812+0000 7f7edaa6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.812+0000 7f7edaa6c9c0 20 started sync module instance, tier type = 2024-09-12T00:17:21.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.812+0000 7f7edaa6c9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:21.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.836+0000 7f7edaa6c9c0 20 add_watcher() i=0 2024-09-12T00:17:21.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.836+0000 7f7edaa6c9c0 20 add_watcher() i=1 2024-09-12T00:17:21.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.836+0000 7f7edaa6c9c0 20 add_watcher() i=2 2024-09-12T00:17:21.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.836+0000 7f7edaa6c9c0 20 add_watcher() i=3 2024-09-12T00:17:21.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.836+0000 7f7edaa6c9c0 20 add_watcher() i=4 2024-09-12T00:17:21.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.836+0000 7f7edaa6c9c0 20 add_watcher() i=5 2024-09-12T00:17:21.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.836+0000 7f7edaa6c9c0 20 add_watcher() i=6 2024-09-12T00:17:21.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.840+0000 7f7edaa6c9c0 20 add_watcher() i=7 2024-09-12T00:17:21.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.840+0000 7f7edaa6c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:21.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.844+0000 7f7d8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:21.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.844+0000 7f7edaa6c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:21.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.844+0000 7f7edaa6c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:21.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7edaa6c9c0 5 note: GC not initialized 2024-09-12T00:17:21.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7d8dfdb640 20 reqs_thread_entry: start 2024-09-12T00:17:21.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7edaa6c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:21.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7edaa6c9c0 20 Filter name: none 2024-09-12T00:17:21.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7cff7fe640 20 reqs_thread_entry: start 2024-09-12T00:17:21.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7edaa6c9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:17:21.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7edaa6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7edaa6c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:21.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7edaa6c9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:17:21.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7edaa6c9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:17:21.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7edaa6c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 : miss 2024-09-12T00:17:21.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7edaa6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7edaa6c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:21.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7edaa6c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 info.flags=0x17 2024-09-12T00:17:21.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7edaa6c9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 to cache LRU end 2024-09-12T00:17:21.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7edaa6c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:21.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7edaa6c9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:17:21.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7edaa6c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 2024-09-12T00:17:21.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.848+0000 7f7edaa6c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:21.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.852+0000 7f7edaa6c9c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:17:21.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.852+0000 7f7edaa6c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:21.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.852+0000 7f7edaa6c9c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:17:21.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.852+0000 7f7edaa6c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:21.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.852+0000 7f7edaa6c9c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:17:21.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.852+0000 7f7edaa6c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:21.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.852+0000 7f7edaa6c9c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:17:21.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.852+0000 7f7edaa6c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:21.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.852+0000 7f7edaa6c9c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:17:21.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.852+0000 7f7edaa6c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:21.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.856+0000 7f7edaa6c9c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T00:17:21.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.856+0000 7f7edaa6c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:21.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.856+0000 7f7edaa6c9c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:17:21.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.856+0000 7f7edaa6c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:21.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.856+0000 7f7edaa6c9c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:17:21.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.856+0000 7f7edaa6c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:21.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.856+0000 7f7edaa6c9c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T00:17:21.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.856+0000 7f7edaa6c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:21.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.860+0000 7f7edaa6c9c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:17:21.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.860+0000 7f7edaa6c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:21.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.860+0000 7f7edaa6c9c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:17:21.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.860+0000 7f7edaa6c9c0 1 NOTICE: finished all shards (2 entries found) 2024-09-12T00:17:21.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.860+0000 7f7d8efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:21.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.864+0000 7f7edaa6c9c0 20 remove_watcher() i=0 2024-09-12T00:17:21.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.864+0000 7f7edaa6c9c0 2 removed watcher, disabling cache 2024-09-12T00:17:21.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.868+0000 7f7edaa6c9c0 20 remove_watcher() i=1 2024-09-12T00:17:21.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.872+0000 7f7edaa6c9c0 20 remove_watcher() i=2 2024-09-12T00:17:21.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.872+0000 7f7edaa6c9c0 20 remove_watcher() i=3 2024-09-12T00:17:21.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.876+0000 7f7edaa6c9c0 20 remove_watcher() i=4 2024-09-12T00:17:21.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.876+0000 7f7edaa6c9c0 20 remove_watcher() i=5 2024-09-12T00:17:21.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.880+0000 7f7edaa6c9c0 20 remove_watcher() i=6 2024-09-12T00:17:21.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.884+0000 7f7edaa6c9c0 20 remove_watcher() i=7 2024-09-12T00:17:21.909 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T00:17:21.909 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:21.909 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:17:21.947 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:21.947 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:21.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.992+0000 7f074447c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.992+0000 7f074447c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.992+0000 7f074447c9c0 20 realm 2024-09-12T00:17:21.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.992+0000 7f074447c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.996+0000 7f074447c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.996+0000 7f074447c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:21.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.996+0000 7f074447c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.996+0000 7f074447c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:21.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.996+0000 7f074447c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:21.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.996+0000 7f074447c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:22.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.996+0000 7f074447c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.996+0000 7f074447c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:22.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:21.996+0000 7f074447c9c0 20 searching for the correct realm 2024-09-12T00:17:22.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.000+0000 7f0742783640 0 -- 172.21.15.138:0/3567035175 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f073c07d0b0 msgr2=0x7f073c0109e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:22.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.216+0000 7f0742783640 0 -- 172.21.15.138:0/3567035175 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5620ca9068b0 msgr2=0x5620ca908d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:22.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.224+0000 7f074447c9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:22.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.224+0000 7f074447c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:22.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.224+0000 7f074447c9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:22.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.224+0000 7f074447c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:22.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.224+0000 7f074447c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:22.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.224+0000 7f074447c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:22.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.224+0000 7f074447c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.224+0000 7f074447c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.224+0000 7f074447c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.224+0000 7f074447c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:22.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.224+0000 7f074447c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.228+0000 7f074447c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:22.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.228+0000 7f074447c9c0 20 zone default found 2024-09-12T00:17:22.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.228+0000 7f074447c9c0 4 Realm: () 2024-09-12T00:17:22.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.228+0000 7f074447c9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:22.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.228+0000 7f074447c9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:22.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.228+0000 7f074447c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:22.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.228+0000 7f074447c9c0 20 zonegroup default 2024-09-12T00:17:22.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.228+0000 7f074447c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.228+0000 7f074447c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.228+0000 7f074447c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.228+0000 7f074447c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.228+0000 7f074447c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.228+0000 7f074447c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.228+0000 7f074447c9c0 20 started sync module instance, tier type = 2024-09-12T00:17:22.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.228+0000 7f074447c9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:22.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.252+0000 7f074447c9c0 20 add_watcher() i=0 2024-09-12T00:17:22.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.252+0000 7f074447c9c0 20 add_watcher() i=1 2024-09-12T00:17:22.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.252+0000 7f074447c9c0 20 add_watcher() i=2 2024-09-12T00:17:22.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.252+0000 7f074447c9c0 20 add_watcher() i=3 2024-09-12T00:17:22.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.252+0000 7f074447c9c0 20 add_watcher() i=4 2024-09-12T00:17:22.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.252+0000 7f074447c9c0 20 add_watcher() i=5 2024-09-12T00:17:22.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.252+0000 7f074447c9c0 20 add_watcher() i=6 2024-09-12T00:17:22.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.256+0000 7f074447c9c0 20 add_watcher() i=7 2024-09-12T00:17:22.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.256+0000 7f074447c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:22.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.260+0000 7f05f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:22.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.260+0000 7f074447c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:22.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.260+0000 7f074447c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:22.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.260+0000 7f074447c9c0 5 note: GC not initialized 2024-09-12T00:17:22.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.260+0000 7f05f27fc640 20 reqs_thread_entry: start 2024-09-12T00:17:22.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.260+0000 7f074447c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:22.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.260+0000 7f074447c9c0 20 Filter name: none 2024-09-12T00:17:22.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.260+0000 7f0563fff640 20 reqs_thread_entry: start 2024-09-12T00:17:22.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:17:22.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:22.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:17:22.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:17:22.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 : miss 2024-09-12T00:17:22.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:22.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 info.flags=0x17 2024-09-12T00:17:22.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 to cache LRU end 2024-09-12T00:17:22.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:22.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:17:22.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 2024-09-12T00:17:22.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:22.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:17:22.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:22.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:17:22.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.264+0000 7f074447c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:22.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.268+0000 7f074447c9c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:17:22.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.268+0000 7f074447c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:22.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.268+0000 7f074447c9c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:17:22.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.268+0000 7f074447c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:22.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.268+0000 7f074447c9c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:17:22.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.268+0000 7f074447c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:22.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.268+0000 7f074447c9c0 20 get_obj_state: octx=0x5620ca5f53b0 obj=check-bucket:d state=0x5620ca93cea8 s->prefetch_data=0 2024-09-12T00:17:22.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.268+0000 7f074447c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:22.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.272+0000 7f074447c9c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:17:22.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.272+0000 7f074447c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:22.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.272+0000 7f074447c9c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:17:22.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.272+0000 7f074447c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:22.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.272+0000 7f074447c9c0 20 get_obj_state: octx=0x5620ca69a6c0 obj=check-bucket:c state=0x5620ca938b38 s->prefetch_data=0 2024-09-12T00:17:22.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.272+0000 7f074447c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:22.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.276+0000 7f074447c9c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:17:22.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.276+0000 7f074447c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:22.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.276+0000 7f074447c9c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:17:22.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.276+0000 7f074447c9c0 20 get_obj_state: setting s->obj_tag to 1rz2igum9zdpsl840d3fm1i6uq27i8yp 2024-09-12T00:17:22.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.276+0000 7f074447c9c0 20 get_obj_state_impl: setting s->olh_tag to clyfve26ylvxtp7ffugxqz5vscy58khf 2024-09-12T00:17:22.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.276+0000 7f074447c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:22.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.276+0000 7f074447c9c0 20 get_obj_state: setting s->obj_tag to l6ytsoi5djuiaeut1s3frpz73castue1 2024-09-12T00:17:22.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.276+0000 7f074447c9c0 20 get_obj_state_impl: setting s->olh_tag to q27t9l4ksuxrdmy23q7pquokvwn4yg9p 2024-09-12T00:17:22.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.276+0000 7f074447c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:22.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.276+0000 7f074447c9c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T00:17:22.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.276+0000 7f074447c9c0 20 olh_log_entry: epoch=4 op=3 key=c[1gI.1FDcnPPhYOncSJfJS1oa6XmI8fM] 2024-09-12T00:17:22.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.276+0000 7f074447c9c0 20 get_obj_state: octx=0x5620ca9853a0 obj=check-bucket:_:1gI.1FDcnPPhYOncSJfJS1oa6XmI8fM_c state=0x5620ca988dc8 s->prefetch_data=0 2024-09-12T00:17:22.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.276+0000 7f074447c9c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T00:17:22.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.276+0000 7f074447c9c0 20 olh_log_entry: epoch=4 op=3 key=d[rg66iS-77EAw8Be4043ueAIKSYI-5Kk] 2024-09-12T00:17:22.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.276+0000 7f074447c9c0 20 get_obj_state: octx=0x5620ca9653a0 obj=check-bucket:_:rg66iS-77EAw8Be4043ueAIKSYI-5Kk_d state=0x5620ca98f3c8 s->prefetch_data=0 2024-09-12T00:17:22.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.280+0000 7f074447c9c0 20 get_obj_state: octx=0x5620ca9853a0 obj=check-bucket:c state=0x5620ca98f3c8 s->prefetch_data=0 2024-09-12T00:17:22.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.280+0000 7f074447c9c0 20 get_obj_state: octx=0x5620ca9653a0 obj=check-bucket:d state=0x5620ca98a378 s->prefetch_data=0 2024-09-12T00:17:22.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.280+0000 7f074447c9c0 20 get_obj_state: setting s->obj_tag to l6ytsoi5djuiaeut1s3frpz73castue1 2024-09-12T00:17:22.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.280+0000 7f074447c9c0 20 get_obj_state_impl: setting s->olh_tag to q27t9l4ksuxrdmy23q7pquokvwn4yg9p 2024-09-12T00:17:22.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.280+0000 7f074447c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=q27t9l4ksuxrdmy23q7pquokvwn4yg9p 2024-09-12T00:17:22.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.280+0000 7f074447c9c0 20 get_obj_state: setting s->obj_tag to 1rz2igum9zdpsl840d3fm1i6uq27i8yp 2024-09-12T00:17:22.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.280+0000 7f074447c9c0 20 get_obj_state_impl: setting s->olh_tag to clyfve26ylvxtp7ffugxqz5vscy58khf 2024-09-12T00:17:22.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.280+0000 7f074447c9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=clyfve26ylvxtp7ffugxqz5vscy58khf 2024-09-12T00:17:22.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.296+0000 7f074447c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:22.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.296+0000 7f074447c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:22.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.300+0000 7f074447c9c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:17:22.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.300+0000 7f074447c9c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:17:22.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.300+0000 7f074447c9c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T00:17:22.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.300+0000 7f05f37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:22.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.304+0000 7f074447c9c0 20 remove_watcher() i=0 2024-09-12T00:17:22.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.304+0000 7f074447c9c0 2 removed watcher, disabling cache 2024-09-12T00:17:22.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.308+0000 7f074447c9c0 20 remove_watcher() i=1 2024-09-12T00:17:22.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.312+0000 7f074447c9c0 20 remove_watcher() i=2 2024-09-12T00:17:22.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.312+0000 7f074447c9c0 20 remove_watcher() i=3 2024-09-12T00:17:22.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.316+0000 7f074447c9c0 20 remove_watcher() i=4 2024-09-12T00:17:22.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.320+0000 7f074447c9c0 20 remove_watcher() i=5 2024-09-12T00:17:22.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.320+0000 7f074447c9c0 20 remove_watcher() i=6 2024-09-12T00:17:22.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.324+0000 7f074447c9c0 20 remove_watcher() i=7 2024-09-12T00:17:22.342 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:17:22.375 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:22.375 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:22.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.416+0000 7fc2c87d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.420+0000 7fc2c87d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.420+0000 7fc2c87d89c0 20 realm 2024-09-12T00:17:22.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.420+0000 7fc2c87d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.420+0000 7fc2c87d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.420+0000 7fc2c87d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:22.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.420+0000 7fc2c87d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.420+0000 7fc2c87d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.420+0000 7fc2c87d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.420+0000 7fc2c87d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:22.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.420+0000 7fc2c87d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.420+0000 7fc2c87d89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:22.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.420+0000 7fc2c87d89c0 20 searching for the correct realm 2024-09-12T00:17:22.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.428+0000 7fc2c6adf640 0 -- 172.21.15.138:0/3434951168 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fc2c005fbe0 msgr2=0x7fc2c0067040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:22.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.644+0000 7fc2c6adf640 0 -- 172.21.15.138:0/3434951168 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x564f390a33c0 msgr2=0x564f390a5880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:22.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.652+0000 7fc2c87d89c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:22.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.652+0000 7fc2c87d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:22.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.652+0000 7fc2c87d89c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:22.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.652+0000 7fc2c87d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:22.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.652+0000 7fc2c87d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:22.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.652+0000 7fc2c87d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:22.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.652+0000 7fc2c87d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.652+0000 7fc2c87d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.652+0000 7fc2c87d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.656+0000 7fc2c87d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:22.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.656+0000 7fc2c87d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.656+0000 7fc2c87d89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:22.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.656+0000 7fc2c87d89c0 20 zone default found 2024-09-12T00:17:22.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.656+0000 7fc2c87d89c0 4 Realm: () 2024-09-12T00:17:22.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.656+0000 7fc2c87d89c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:22.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.656+0000 7fc2c87d89c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:22.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.656+0000 7fc2c87d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:22.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.656+0000 7fc2c87d89c0 20 zonegroup default 2024-09-12T00:17:22.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.656+0000 7fc2c87d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.656+0000 7fc2c87d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.656+0000 7fc2c87d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.656+0000 7fc2c87d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.656+0000 7fc2c87d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.656+0000 7fc2c87d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.656+0000 7fc2c87d89c0 20 started sync module instance, tier type = 2024-09-12T00:17:22.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.656+0000 7fc2c87d89c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:22.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.680+0000 7fc2c87d89c0 20 add_watcher() i=0 2024-09-12T00:17:22.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.680+0000 7fc2c87d89c0 20 add_watcher() i=1 2024-09-12T00:17:22.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.680+0000 7fc2c87d89c0 20 add_watcher() i=2 2024-09-12T00:17:22.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.680+0000 7fc2c87d89c0 20 add_watcher() i=3 2024-09-12T00:17:22.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.680+0000 7fc2c87d89c0 20 add_watcher() i=4 2024-09-12T00:17:22.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.680+0000 7fc2c87d89c0 20 add_watcher() i=5 2024-09-12T00:17:22.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.680+0000 7fc2c87d89c0 20 add_watcher() i=6 2024-09-12T00:17:22.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.684+0000 7fc2c87d89c0 20 add_watcher() i=7 2024-09-12T00:17:22.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.684+0000 7fc2c87d89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:22.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.684+0000 7fc17cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:22.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc2c87d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:22.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc2c87d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:22.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc2c87d89c0 5 note: GC not initialized 2024-09-12T00:17:22.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc0f77fe640 20 reqs_thread_entry: start 2024-09-12T00:17:22.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc2c87d89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:22.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc2c87d89c0 20 Filter name: none 2024-09-12T00:17:22.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc0f57fa640 20 reqs_thread_entry: start 2024-09-12T00:17:22.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc2c87d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc2c87d89c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:22.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc2c87d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc2c87d89c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:22.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc2c87d89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:17:22.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc2c87d89c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:17:22.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc2c87d89c0 20 INFO: main: starting shard=0 2024-09-12T00:17:22.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc2c87d89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:22.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc2c87d89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc2c87d89c0 20 INFO: main: starting shard=1 2024-09-12T00:17:22.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.688+0000 7fc2c87d89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:22.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.692+0000 7fc2c87d89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.692+0000 7fc2c87d89c0 20 INFO: main: starting shard=2 2024-09-12T00:17:22.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.692+0000 7fc2c87d89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:22.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.692+0000 7fc2c87d89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.692+0000 7fc2c87d89c0 20 INFO: main: starting shard=3 2024-09-12T00:17:22.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.692+0000 7fc2c87d89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:22.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.692+0000 7fc2c87d89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.692+0000 7fc2c87d89c0 20 INFO: main: starting shard=4 2024-09-12T00:17:22.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.692+0000 7fc2c87d89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:22.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.692+0000 7fc2c87d89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.692+0000 7fc2c87d89c0 20 INFO: main: starting shard=5 2024-09-12T00:17:22.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.692+0000 7fc2c87d89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:22.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.696+0000 7fc2c87d89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.696+0000 7fc2c87d89c0 20 INFO: main: starting shard=6 2024-09-12T00:17:22.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.696+0000 7fc2c87d89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:22.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.696+0000 7fc2c87d89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.696+0000 7fc2c87d89c0 20 INFO: main: starting shard=7 2024-09-12T00:17:22.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.696+0000 7fc2c87d89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:22.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.696+0000 7fc2c87d89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.696+0000 7fc2c87d89c0 20 INFO: main: starting shard=8 2024-09-12T00:17:22.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.696+0000 7fc2c87d89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:22.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.696+0000 7fc2c87d89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.696+0000 7fc2c87d89c0 20 INFO: main: starting shard=9 2024-09-12T00:17:22.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.696+0000 7fc2c87d89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:22.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.700+0000 7fc2c87d89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.700+0000 7fc2c87d89c0 20 INFO: main: starting shard=10 2024-09-12T00:17:22.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.700+0000 7fc2c87d89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:22.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.700+0000 7fc2c87d89c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.700+0000 7fc2c87d89c0 20 INFO: main: done 2024-09-12T00:17:22.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.700+0000 7fc17cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:22.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.704+0000 7fc2c87d89c0 20 remove_watcher() i=0 2024-09-12T00:17:22.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.704+0000 7fc2c87d89c0 2 removed watcher, disabling cache 2024-09-12T00:17:22.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.708+0000 7fc2c87d89c0 20 remove_watcher() i=1 2024-09-12T00:17:22.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.708+0000 7fc2c87d89c0 20 remove_watcher() i=2 2024-09-12T00:17:22.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.712+0000 7fc2c87d89c0 20 remove_watcher() i=3 2024-09-12T00:17:22.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.712+0000 7fc2c87d89c0 20 remove_watcher() i=4 2024-09-12T00:17:22.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.716+0000 7fc2c87d89c0 20 remove_watcher() i=5 2024-09-12T00:17:22.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.716+0000 7fc2c87d89c0 20 remove_watcher() i=6 2024-09-12T00:17:22.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.720+0000 7fc2c87d89c0 20 remove_watcher() i=7 2024-09-12T00:17:22.739 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:17:22.769 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:22.769 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:22.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.808+0000 7f90042ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.812+0000 7f90042ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.812+0000 7f90042ef9c0 20 realm 2024-09-12T00:17:22.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.812+0000 7f90042ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.812+0000 7f90042ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.812+0000 7f90042ef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:22.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.812+0000 7f90042ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.812+0000 7f90042ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.812+0000 7f90042ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.812+0000 7f90042ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:22.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.816+0000 7f90042ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.816+0000 7f90042ef9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:22.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.816+0000 7f90042ef9c0 20 searching for the correct realm 2024-09-12T00:17:22.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.820+0000 7f90025f6640 0 -- 172.21.15.138:0/1975656150 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5638d4b2c280 msgr2=0x5638d4b2e710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:22.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.824+0000 7f90015f4640 0 -- 172.21.15.138:0/1975656150 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x5638d4b27520 msgr2=0x5638d4b29910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:22.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.832+0000 7f90042ef9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:22.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.832+0000 7f90042ef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:22.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.832+0000 7f90042ef9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:22.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.832+0000 7f90042ef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:22.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.832+0000 7f90042ef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:22.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.832+0000 7f90042ef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:22.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.832+0000 7f90042ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.832+0000 7f90042ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.832+0000 7f90042ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.836+0000 7f90042ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:22.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.836+0000 7f90042ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.836+0000 7f90042ef9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:22.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.836+0000 7f90042ef9c0 20 zone default found 2024-09-12T00:17:22.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.836+0000 7f90042ef9c0 4 Realm: () 2024-09-12T00:17:22.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.836+0000 7f90042ef9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:22.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.836+0000 7f90042ef9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:22.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.836+0000 7f90042ef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:22.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.836+0000 7f90042ef9c0 20 zonegroup default 2024-09-12T00:17:22.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.836+0000 7f90042ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.836+0000 7f90042ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.836+0000 7f90042ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.836+0000 7f90042ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.836+0000 7f90042ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.836+0000 7f90042ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.836+0000 7f90042ef9c0 20 started sync module instance, tier type = 2024-09-12T00:17:22.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.836+0000 7f90042ef9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:22.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.856+0000 7f90042ef9c0 20 add_watcher() i=0 2024-09-12T00:17:22.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.856+0000 7f90042ef9c0 20 add_watcher() i=1 2024-09-12T00:17:22.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.856+0000 7f90042ef9c0 20 add_watcher() i=2 2024-09-12T00:17:22.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.856+0000 7f90042ef9c0 20 add_watcher() i=3 2024-09-12T00:17:22.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.856+0000 7f90042ef9c0 20 add_watcher() i=4 2024-09-12T00:17:22.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.856+0000 7f90042ef9c0 20 add_watcher() i=5 2024-09-12T00:17:22.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.856+0000 7f90042ef9c0 20 add_watcher() i=6 2024-09-12T00:17:22.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.860+0000 7f90042ef9c0 20 add_watcher() i=7 2024-09-12T00:17:22.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.860+0000 7f90042ef9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:22.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.860+0000 7f8eb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:22.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:22.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:22.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 5 note: GC not initialized 2024-09-12T00:17:22.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f8eb27fc640 20 reqs_thread_entry: start 2024-09-12T00:17:22.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:22.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 Filter name: none 2024-09-12T00:17:22.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f8e23fff640 20 reqs_thread_entry: start 2024-09-12T00:17:22.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:22.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:22.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:17:22.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:17:22.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 INFO: main: starting shard=0 2024-09-12T00:17:22.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:22.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 INFO: main: starting shard=1 2024-09-12T00:17:22.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:22.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 INFO: main: starting shard=2 2024-09-12T00:17:22.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.864+0000 7f90042ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:22.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.868+0000 7f90042ef9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.868+0000 7f90042ef9c0 20 INFO: main: starting shard=3 2024-09-12T00:17:22.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.868+0000 7f90042ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:22.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.868+0000 7f90042ef9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.868+0000 7f90042ef9c0 20 INFO: main: starting shard=4 2024-09-12T00:17:22.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.868+0000 7f90042ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:22.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.868+0000 7f90042ef9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.868+0000 7f90042ef9c0 20 INFO: main: starting shard=5 2024-09-12T00:17:22.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.868+0000 7f90042ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:22.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.868+0000 7f90042ef9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.868+0000 7f90042ef9c0 20 INFO: main: starting shard=6 2024-09-12T00:17:22.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.868+0000 7f90042ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:22.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.872+0000 7f90042ef9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.872+0000 7f90042ef9c0 20 INFO: main: starting shard=7 2024-09-12T00:17:22.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.872+0000 7f90042ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:22.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.872+0000 7f90042ef9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.872+0000 7f90042ef9c0 20 INFO: main: starting shard=8 2024-09-12T00:17:22.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.872+0000 7f90042ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:22.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.872+0000 7f90042ef9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.872+0000 7f90042ef9c0 20 INFO: main: starting shard=9 2024-09-12T00:17:22.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.872+0000 7f90042ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:22.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.872+0000 7f90042ef9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.872+0000 7f90042ef9c0 20 INFO: main: starting shard=10 2024-09-12T00:17:22.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.872+0000 7f90042ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:22.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.872+0000 7f90042ef9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:22.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.872+0000 7f90042ef9c0 20 INFO: main: done 2024-09-12T00:17:22.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.876+0000 7f8eb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:22.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.880+0000 7f90042ef9c0 20 remove_watcher() i=0 2024-09-12T00:17:22.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.880+0000 7f90042ef9c0 2 removed watcher, disabling cache 2024-09-12T00:17:22.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.880+0000 7f90042ef9c0 20 remove_watcher() i=1 2024-09-12T00:17:22.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.884+0000 7f90042ef9c0 20 remove_watcher() i=2 2024-09-12T00:17:22.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.884+0000 7f90042ef9c0 20 remove_watcher() i=3 2024-09-12T00:17:22.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.888+0000 7f90042ef9c0 20 remove_watcher() i=4 2024-09-12T00:17:22.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.888+0000 7f90042ef9c0 20 remove_watcher() i=5 2024-09-12T00:17:22.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.892+0000 7f90042ef9c0 20 remove_watcher() i=6 2024-09-12T00:17:22.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.896+0000 7f90042ef9c0 20 remove_watcher() i=7 2024-09-12T00:17:22.911 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T00:17:22.911 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:22.912 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:17:22.945 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:22.945 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:22.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.984+0000 7fab40db39c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.988+0000 7fab40db39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.988+0000 7fab40db39c0 20 realm 2024-09-12T00:17:22.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.988+0000 7fab40db39c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.988+0000 7fab40db39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.988+0000 7fab40db39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:22.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.988+0000 7fab40db39c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.988+0000 7fab40db39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:22.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.988+0000 7fab40db39c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.988+0000 7fab40db39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:22.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.988+0000 7fab40db39c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:22.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.992+0000 7fab40db39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:22.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.992+0000 7fab40db39c0 20 searching for the correct realm 2024-09-12T00:17:22.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:22.996+0000 7fab3f0ba640 0 -- 172.21.15.138:0/3963698074 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fab3806a310 msgr2=0x7fab38063850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:17:23.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.212+0000 7fab3f0ba640 0 -- 172.21.15.138:0/3963698074 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x556dcdc0b810 msgr2=0x556dcdc0dcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:23.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.220+0000 7fab40db39c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:23.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.220+0000 7fab40db39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:23.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.220+0000 7fab40db39c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:23.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.220+0000 7fab40db39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:23.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.220+0000 7fab40db39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:23.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.220+0000 7fab40db39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:23.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.220+0000 7fab40db39c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:23.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.224+0000 7fab40db39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:23.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.224+0000 7fab40db39c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:23.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.224+0000 7fab40db39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:23.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.224+0000 7fab40db39c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:23.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.224+0000 7fab40db39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:23.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.224+0000 7fab40db39c0 20 zone default found 2024-09-12T00:17:23.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.224+0000 7fab40db39c0 4 Realm: () 2024-09-12T00:17:23.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.224+0000 7fab40db39c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:23.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.224+0000 7fab40db39c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:23.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.224+0000 7fab40db39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:23.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.224+0000 7fab40db39c0 20 zonegroup default 2024-09-12T00:17:23.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.224+0000 7fab40db39c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:23.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.224+0000 7fab40db39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:23.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.224+0000 7fab40db39c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:23.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.224+0000 7fab40db39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:23.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.224+0000 7fab40db39c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:23.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.228+0000 7fab40db39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:23.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.228+0000 7fab40db39c0 20 started sync module instance, tier type = 2024-09-12T00:17:23.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.228+0000 7fab40db39c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:23.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.252+0000 7fab40db39c0 20 add_watcher() i=0 2024-09-12T00:17:23.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.252+0000 7fab40db39c0 20 add_watcher() i=1 2024-09-12T00:17:23.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.252+0000 7fab40db39c0 20 add_watcher() i=2 2024-09-12T00:17:23.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.252+0000 7fab40db39c0 20 add_watcher() i=3 2024-09-12T00:17:23.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.252+0000 7fab40db39c0 20 add_watcher() i=4 2024-09-12T00:17:23.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.252+0000 7fab40db39c0 20 add_watcher() i=5 2024-09-12T00:17:23.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.252+0000 7fab40db39c0 20 add_watcher() i=6 2024-09-12T00:17:23.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.252+0000 7fab40db39c0 20 add_watcher() i=7 2024-09-12T00:17:23.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.252+0000 7fab40db39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:23.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.256+0000 7fa9f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:23.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:23.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:23.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 5 note: GC not initialized 2024-09-12T00:17:23.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fa96ffff640 20 reqs_thread_entry: start 2024-09-12T00:17:23.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:23.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 20 Filter name: none 2024-09-12T00:17:23.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fa96dffb640 20 reqs_thread_entry: start 2024-09-12T00:17:23.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:17:23.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:23.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:23.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:17:23.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:17:23.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 : miss 2024-09-12T00:17:23.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:23.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:23.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 info.flags=0x17 2024-09-12T00:17:23.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 to cache LRU end 2024-09-12T00:17:23.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:23.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:17:23.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 2024-09-12T00:17:23.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.260+0000 7fab40db39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:23.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.264+0000 7fab40db39c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:17:23.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.264+0000 7fab40db39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:23.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.264+0000 7fab40db39c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:17:23.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.264+0000 7fab40db39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:23.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.264+0000 7fab40db39c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:17:23.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.264+0000 7fab40db39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:23.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.264+0000 7fab40db39c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:17:23.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.264+0000 7fab40db39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:23.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.268+0000 7fab40db39c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:17:23.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.268+0000 7fab40db39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:23.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.268+0000 7fab40db39c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:17:23.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.268+0000 7fab40db39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:23.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.268+0000 7fab40db39c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:17:23.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.268+0000 7fab40db39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:23.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.268+0000 7fab40db39c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:17:23.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.268+0000 7fab40db39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:23.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.268+0000 7fab40db39c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:17:23.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.268+0000 7fab40db39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:23.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.272+0000 7fab40db39c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:17:23.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.272+0000 7fab40db39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:23.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.272+0000 7fab40db39c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:17:23.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.272+0000 7fab40db39c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:17:23.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.272+0000 7fa9f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:23.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.276+0000 7fab40db39c0 20 remove_watcher() i=0 2024-09-12T00:17:23.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.276+0000 7fab40db39c0 2 removed watcher, disabling cache 2024-09-12T00:17:23.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.280+0000 7fab40db39c0 20 remove_watcher() i=1 2024-09-12T00:17:23.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.284+0000 7fab40db39c0 20 remove_watcher() i=2 2024-09-12T00:17:23.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.284+0000 7fab40db39c0 20 remove_watcher() i=3 2024-09-12T00:17:23.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.288+0000 7fab40db39c0 20 remove_watcher() i=4 2024-09-12T00:17:23.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.288+0000 7fab40db39c0 20 remove_watcher() i=5 2024-09-12T00:17:23.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.292+0000 7fab40db39c0 20 remove_watcher() i=6 2024-09-12T00:17:23.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:23.296+0000 7fab40db39c0 20 remove_watcher() i=7 2024-09-12T00:17:23.311 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T00:17:23.312 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:23.313 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:23.313 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:23.317 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:23.317 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:23.320 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:23.320 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:23.366 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T00:17:23.366 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:17:23.367 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:23.367 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:23.420 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:23.420 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:23.494 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:23.494 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:23.529 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:23.530 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:23.536 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:23.536 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:23.575 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:23.575 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:23.582 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:23.582 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:23.620 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:23.620 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:23.627 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:23.627 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:23.665 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:23.665 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:23.673 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:23.673 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:23.710 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:23.711 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:23.718 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:23.718 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:23.755 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:23.755 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:23.761 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:17:24.205 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:17:25.636 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:25.637 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:25.705 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:17:25.706 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:17:25.741 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:25.741 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:25.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:25.784+0000 7f13457bc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:25.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:25.784+0000 7f13457bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:25.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:25.784+0000 7f13457bc9c0 20 realm 2024-09-12T00:17:25.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:25.784+0000 7f13457bc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:25.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:25.784+0000 7f13457bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:25.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:25.784+0000 7f13457bc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:25.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:25.784+0000 7f13457bc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:25.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:25.784+0000 7f13457bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:25.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:25.784+0000 7f13457bc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:25.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:25.788+0000 7f13457bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:25.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:25.788+0000 7f13457bc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:25.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:25.788+0000 7f13457bc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:25.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:25.788+0000 7f13457bc9c0 20 searching for the correct realm 2024-09-12T00:17:25.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:25.792+0000 7f1343ac3640 0 -- 172.21.15.138:0/929052058 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f13340093d0 msgr2=0x7f13341151c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:17:26.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.008+0000 7f1343ac3640 0 -- 172.21.15.138:0/929052058 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55a506b24a80 msgr2=0x55a506b26f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:26.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.016+0000 7f13457bc9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:26.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.016+0000 7f13457bc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:26.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.016+0000 7f13457bc9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:26.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.016+0000 7f13457bc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:26.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.016+0000 7f13457bc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:26.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.016+0000 7f13457bc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:26.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.016+0000 7f13457bc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.016+0000 7f13457bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.016+0000 7f13457bc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.016+0000 7f13457bc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:26.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.016+0000 7f13457bc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.020+0000 7f13457bc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:26.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.020+0000 7f13457bc9c0 20 zone default found 2024-09-12T00:17:26.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.020+0000 7f13457bc9c0 4 Realm: () 2024-09-12T00:17:26.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.020+0000 7f13457bc9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:26.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.020+0000 7f13457bc9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:26.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.020+0000 7f13457bc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:26.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.020+0000 7f13457bc9c0 20 zonegroup default 2024-09-12T00:17:26.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.020+0000 7f13457bc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.020+0000 7f13457bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.020+0000 7f13457bc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.020+0000 7f13457bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.020+0000 7f13457bc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.020+0000 7f13457bc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.020+0000 7f13457bc9c0 20 started sync module instance, tier type = 2024-09-12T00:17:26.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.020+0000 7f13457bc9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:26.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.044+0000 7f13457bc9c0 20 add_watcher() i=0 2024-09-12T00:17:26.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.044+0000 7f13457bc9c0 20 add_watcher() i=1 2024-09-12T00:17:26.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.044+0000 7f13457bc9c0 20 add_watcher() i=2 2024-09-12T00:17:26.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.044+0000 7f13457bc9c0 20 add_watcher() i=3 2024-09-12T00:17:26.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.044+0000 7f13457bc9c0 20 add_watcher() i=4 2024-09-12T00:17:26.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.044+0000 7f13457bc9c0 20 add_watcher() i=5 2024-09-12T00:17:26.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.044+0000 7f13457bc9c0 20 add_watcher() i=6 2024-09-12T00:17:26.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.048+0000 7f13457bc9c0 20 add_watcher() i=7 2024-09-12T00:17:26.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.048+0000 7f13457bc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:26.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.052+0000 7f11f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:26.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.052+0000 7f13457bc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:26.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.052+0000 7f13457bc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:26.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.052+0000 7f13457bc9c0 5 note: GC not initialized 2024-09-12T00:17:26.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.052+0000 7f11f8fe1640 20 reqs_thread_entry: start 2024-09-12T00:17:26.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.052+0000 7f13457bc9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:26.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.052+0000 7f13457bc9c0 20 Filter name: none 2024-09-12T00:17:26.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.052+0000 7f11727fc640 20 reqs_thread_entry: start 2024-09-12T00:17:26.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.052+0000 7f13457bc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.056+0000 7f13457bc9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:26.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.056+0000 7f13457bc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.056+0000 7f13457bc9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:26.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.056+0000 7f13457bc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:17:26.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.056+0000 7f13457bc9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:17:26.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.056+0000 7f13457bc9c0 20 INFO: main: starting shard=0 2024-09-12T00:17:26.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.056+0000 7f13457bc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:26.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.056+0000 7f13457bc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.056+0000 7f13457bc9c0 20 INFO: main: starting shard=1 2024-09-12T00:17:26.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.056+0000 7f13457bc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:26.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.056+0000 7f13457bc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.056+0000 7f13457bc9c0 20 INFO: main: starting shard=2 2024-09-12T00:17:26.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.056+0000 7f13457bc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:26.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.060+0000 7f13457bc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.060+0000 7f13457bc9c0 20 INFO: main: starting shard=3 2024-09-12T00:17:26.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.060+0000 7f13457bc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:26.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.060+0000 7f13457bc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.060+0000 7f13457bc9c0 20 INFO: main: starting shard=4 2024-09-12T00:17:26.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.060+0000 7f13457bc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:26.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.060+0000 7f13457bc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.060+0000 7f13457bc9c0 20 INFO: main: starting shard=5 2024-09-12T00:17:26.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.060+0000 7f13457bc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:26.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.060+0000 7f13457bc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.060+0000 7f13457bc9c0 20 INFO: main: starting shard=6 2024-09-12T00:17:26.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.060+0000 7f13457bc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:26.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.064+0000 7f13457bc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.064+0000 7f13457bc9c0 20 INFO: main: starting shard=7 2024-09-12T00:17:26.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.064+0000 7f13457bc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:26.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.064+0000 7f13457bc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.064+0000 7f13457bc9c0 20 INFO: main: starting shard=8 2024-09-12T00:17:26.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.064+0000 7f13457bc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:26.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.064+0000 7f13457bc9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:17:26.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.064+0000 7f13457bc9c0 20 INFO: main: starting shard=9 2024-09-12T00:17:26.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.064+0000 7f13457bc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:26.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.068+0000 7f13457bc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.068+0000 7f13457bc9c0 20 INFO: main: starting shard=10 2024-09-12T00:17:26.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.068+0000 7f13457bc9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:26.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.068+0000 7f13457bc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.068+0000 7f13457bc9c0 20 INFO: main: done 2024-09-12T00:17:26.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.068+0000 7f11f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:26.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.072+0000 7f13457bc9c0 20 remove_watcher() i=0 2024-09-12T00:17:26.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.072+0000 7f13457bc9c0 2 removed watcher, disabling cache 2024-09-12T00:17:26.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.076+0000 7f13457bc9c0 20 remove_watcher() i=1 2024-09-12T00:17:26.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.076+0000 7f13457bc9c0 20 remove_watcher() i=2 2024-09-12T00:17:26.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.080+0000 7f13457bc9c0 20 remove_watcher() i=3 2024-09-12T00:17:26.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.080+0000 7f13457bc9c0 20 remove_watcher() i=4 2024-09-12T00:17:26.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.084+0000 7f13457bc9c0 20 remove_watcher() i=5 2024-09-12T00:17:26.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.088+0000 7f13457bc9c0 20 remove_watcher() i=6 2024-09-12T00:17:26.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.088+0000 7f13457bc9c0 20 remove_watcher() i=7 2024-09-12T00:17:26.113 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:26.113 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:26.118 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:26.119 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:26.181 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:17:26.182 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:17:26.217 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:26.217 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:26.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.260+0000 7ff009fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.260+0000 7ff009fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.260+0000 7ff009fc59c0 20 realm 2024-09-12T00:17:26.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.260+0000 7ff009fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.264+0000 7ff009fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.264+0000 7ff009fc59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:26.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.264+0000 7ff009fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.264+0000 7ff009fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.264+0000 7ff009fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.264+0000 7ff009fc59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:26.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.264+0000 7ff009fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.264+0000 7ff009fc59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:26.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.264+0000 7ff009fc59c0 20 searching for the correct realm 2024-09-12T00:17:26.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.268+0000 7ff0072ca640 0 -- 172.21.15.138:0/2890917116 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x55ac51601cb0 msgr2=0x7feff811a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:26.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.276+0000 7ff0072ca640 0 -- 172.21.15.138:0/2890917116 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55ac51865ae0 msgr2=0x55ac51867ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:26.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:26.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:26.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:26.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:26.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:26.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:26.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:26.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:26.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 zone default found 2024-09-12T00:17:26.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 4 Realm: () 2024-09-12T00:17:26.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:26.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:26.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:26.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 zonegroup default 2024-09-12T00:17:26.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.284+0000 7ff009fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.288+0000 7ff009fc59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.288+0000 7ff009fc59c0 20 started sync module instance, tier type = 2024-09-12T00:17:26.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.288+0000 7ff009fc59c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:26.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.304+0000 7ff009fc59c0 20 add_watcher() i=0 2024-09-12T00:17:26.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.304+0000 7ff009fc59c0 20 add_watcher() i=1 2024-09-12T00:17:26.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.304+0000 7ff009fc59c0 20 add_watcher() i=2 2024-09-12T00:17:26.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.304+0000 7ff009fc59c0 20 add_watcher() i=3 2024-09-12T00:17:26.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.304+0000 7ff009fc59c0 20 add_watcher() i=4 2024-09-12T00:17:26.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.304+0000 7ff009fc59c0 20 add_watcher() i=5 2024-09-12T00:17:26.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.304+0000 7ff009fc59c0 20 add_watcher() i=6 2024-09-12T00:17:26.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.308+0000 7ff009fc59c0 20 add_watcher() i=7 2024-09-12T00:17:26.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.308+0000 7ff009fc59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:26.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.312+0000 7feebdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:26.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.312+0000 7ff009fc59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:26.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.312+0000 7ff009fc59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:26.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.312+0000 7ff009fc59c0 5 note: GC not initialized 2024-09-12T00:17:26.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.312+0000 7feebcfe1640 20 reqs_thread_entry: start 2024-09-12T00:17:26.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.312+0000 7ff009fc59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:26.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.312+0000 7ff009fc59c0 20 Filter name: none 2024-09-12T00:17:26.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.312+0000 7fee367fc640 20 reqs_thread_entry: start 2024-09-12T00:17:26.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.312+0000 7ff009fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.312+0000 7ff009fc59c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:26.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.312+0000 7ff009fc59c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.312+0000 7ff009fc59c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:26.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.312+0000 7ff009fc59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:17:26.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.312+0000 7ff009fc59c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:17:26.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.312+0000 7ff009fc59c0 20 INFO: main: starting shard=0 2024-09-12T00:17:26.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.312+0000 7ff009fc59c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:26.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.316+0000 7ff009fc59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.316+0000 7ff009fc59c0 20 INFO: main: starting shard=1 2024-09-12T00:17:26.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.316+0000 7ff009fc59c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:26.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.316+0000 7ff009fc59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.316+0000 7ff009fc59c0 20 INFO: main: starting shard=2 2024-09-12T00:17:26.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.316+0000 7ff009fc59c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:26.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.316+0000 7ff009fc59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.316+0000 7ff009fc59c0 20 INFO: main: starting shard=3 2024-09-12T00:17:26.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.316+0000 7ff009fc59c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:26.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.316+0000 7ff009fc59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.316+0000 7ff009fc59c0 20 INFO: main: starting shard=4 2024-09-12T00:17:26.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.316+0000 7ff009fc59c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:26.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.316+0000 7ff009fc59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.316+0000 7ff009fc59c0 20 INFO: main: starting shard=5 2024-09-12T00:17:26.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.316+0000 7ff009fc59c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:26.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.320+0000 7ff009fc59c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:17:26.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.320+0000 7ff009fc59c0 20 INFO: main: starting shard=6 2024-09-12T00:17:26.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.320+0000 7ff009fc59c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:26.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.320+0000 7ff009fc59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.320+0000 7ff009fc59c0 20 INFO: main: starting shard=7 2024-09-12T00:17:26.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.320+0000 7ff009fc59c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:26.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.320+0000 7ff009fc59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.320+0000 7ff009fc59c0 20 INFO: main: starting shard=8 2024-09-12T00:17:26.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.320+0000 7ff009fc59c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:26.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.320+0000 7ff009fc59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.320+0000 7ff009fc59c0 20 INFO: main: starting shard=9 2024-09-12T00:17:26.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.320+0000 7ff009fc59c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:26.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.324+0000 7ff009fc59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.324+0000 7ff009fc59c0 20 INFO: main: starting shard=10 2024-09-12T00:17:26.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.324+0000 7ff009fc59c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:26.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.324+0000 7ff009fc59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.324+0000 7ff009fc59c0 20 INFO: main: done 2024-09-12T00:17:26.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.324+0000 7feebdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:26.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.328+0000 7ff009fc59c0 20 remove_watcher() i=0 2024-09-12T00:17:26.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.328+0000 7ff009fc59c0 2 removed watcher, disabling cache 2024-09-12T00:17:26.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.328+0000 7ff009fc59c0 20 remove_watcher() i=1 2024-09-12T00:17:26.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.332+0000 7ff009fc59c0 20 remove_watcher() i=2 2024-09-12T00:17:26.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.332+0000 7ff009fc59c0 20 remove_watcher() i=3 2024-09-12T00:17:26.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.336+0000 7ff009fc59c0 20 remove_watcher() i=4 2024-09-12T00:17:26.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.336+0000 7ff009fc59c0 20 remove_watcher() i=5 2024-09-12T00:17:26.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.340+0000 7ff009fc59c0 20 remove_watcher() i=6 2024-09-12T00:17:26.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.344+0000 7ff009fc59c0 20 remove_watcher() i=7 2024-09-12T00:17:26.361 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:26.361 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:26.365 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:26.365 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:26.425 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:17:26.425 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:17:26.455 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:26.455 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:26.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.496+0000 7f7896d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.500+0000 7f7896d3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.500+0000 7f7896d3e9c0 20 realm 2024-09-12T00:17:26.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.500+0000 7f7896d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.500+0000 7f7896d3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.500+0000 7f7896d3e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:26.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.500+0000 7f7896d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.500+0000 7f7896d3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.500+0000 7f7896d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.500+0000 7f7896d3e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:26.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.500+0000 7f7896d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.504+0000 7f7896d3e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:26.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.504+0000 7f7896d3e9c0 20 searching for the correct realm 2024-09-12T00:17:26.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.508+0000 7f7895045640 0 -- 172.21.15.138:0/4198595500 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f789001e070 msgr2=0x7f789002a420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:17:26.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.516+0000 7f7895045640 0 -- 172.21.15.138:0/4198595500 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x555d73447840 msgr2=0x555d73449d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:26.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.520+0000 7f7896d3e9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:26.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.520+0000 7f7896d3e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:26.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.520+0000 7f7896d3e9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:26.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.520+0000 7f7896d3e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:26.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.520+0000 7f7896d3e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:26.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.520+0000 7f7896d3e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:26.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.520+0000 7f7896d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:26.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:26.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 20 zone default found 2024-09-12T00:17:26.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 4 Realm: () 2024-09-12T00:17:26.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:26.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:26.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:26.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 20 zonegroup default 2024-09-12T00:17:26.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 20 started sync module instance, tier type = 2024-09-12T00:17:26.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.524+0000 7f7896d3e9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:26.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.544+0000 7f7896d3e9c0 20 add_watcher() i=0 2024-09-12T00:17:26.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.544+0000 7f7896d3e9c0 20 add_watcher() i=1 2024-09-12T00:17:26.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.544+0000 7f7896d3e9c0 20 add_watcher() i=2 2024-09-12T00:17:26.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.544+0000 7f7896d3e9c0 20 add_watcher() i=3 2024-09-12T00:17:26.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.544+0000 7f7896d3e9c0 20 add_watcher() i=4 2024-09-12T00:17:26.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.544+0000 7f7896d3e9c0 20 add_watcher() i=5 2024-09-12T00:17:26.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.544+0000 7f7896d3e9c0 20 add_watcher() i=6 2024-09-12T00:17:26.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.544+0000 7f7896d3e9c0 20 add_watcher() i=7 2024-09-12T00:17:26.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.544+0000 7f7896d3e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:26.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.548+0000 7f774afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:26.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:26.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:26.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 5 note: GC not initialized 2024-09-12T00:17:26.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7749fe3640 20 reqs_thread_entry: start 2024-09-12T00:17:26.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:26.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 Filter name: none 2024-09-12T00:17:26.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f76bb7fe640 20 reqs_thread_entry: start 2024-09-12T00:17:26.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:26.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:26.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:17:26.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:17:26.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 INFO: main: starting shard=0 2024-09-12T00:17:26.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:26.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 INFO: main: starting shard=1 2024-09-12T00:17:26.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:26.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:17:26.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 INFO: main: starting shard=2 2024-09-12T00:17:26.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.552+0000 7f7896d3e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:26.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.556+0000 7f7896d3e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.556+0000 7f7896d3e9c0 20 INFO: main: starting shard=3 2024-09-12T00:17:26.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.556+0000 7f7896d3e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:26.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.556+0000 7f7896d3e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.556+0000 7f7896d3e9c0 20 INFO: main: starting shard=4 2024-09-12T00:17:26.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.556+0000 7f7896d3e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:26.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.556+0000 7f7896d3e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.556+0000 7f7896d3e9c0 20 INFO: main: starting shard=5 2024-09-12T00:17:26.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.556+0000 7f7896d3e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:26.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.556+0000 7f7896d3e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.556+0000 7f7896d3e9c0 20 INFO: main: starting shard=6 2024-09-12T00:17:26.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.556+0000 7f7896d3e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:26.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.556+0000 7f7896d3e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.556+0000 7f7896d3e9c0 20 INFO: main: starting shard=7 2024-09-12T00:17:26.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.556+0000 7f7896d3e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:26.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.560+0000 7f7896d3e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.560+0000 7f7896d3e9c0 20 INFO: main: starting shard=8 2024-09-12T00:17:26.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.560+0000 7f7896d3e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:26.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.560+0000 7f7896d3e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.560+0000 7f7896d3e9c0 20 INFO: main: starting shard=9 2024-09-12T00:17:26.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.560+0000 7f7896d3e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:26.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.560+0000 7f7896d3e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.560+0000 7f7896d3e9c0 20 INFO: main: starting shard=10 2024-09-12T00:17:26.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.560+0000 7f7896d3e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:26.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.560+0000 7f7896d3e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:26.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.560+0000 7f7896d3e9c0 20 INFO: main: done 2024-09-12T00:17:26.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.560+0000 7f774afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:26.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.564+0000 7f7896d3e9c0 20 remove_watcher() i=0 2024-09-12T00:17:26.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.564+0000 7f7896d3e9c0 2 removed watcher, disabling cache 2024-09-12T00:17:26.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.568+0000 7f7896d3e9c0 20 remove_watcher() i=1 2024-09-12T00:17:26.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.572+0000 7f7896d3e9c0 20 remove_watcher() i=2 2024-09-12T00:17:26.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.572+0000 7f7896d3e9c0 20 remove_watcher() i=3 2024-09-12T00:17:26.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.576+0000 7f7896d3e9c0 20 remove_watcher() i=4 2024-09-12T00:17:26.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.576+0000 7f7896d3e9c0 20 remove_watcher() i=5 2024-09-12T00:17:26.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.580+0000 7f7896d3e9c0 20 remove_watcher() i=6 2024-09-12T00:17:26.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.584+0000 7f7896d3e9c0 20 remove_watcher() i=7 2024-09-12T00:17:26.602 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:26.602 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:26.605 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:26.605 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:26.665 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:17:26.665 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:17:26.700 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:26.700 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:26.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.740+0000 7f15a83219c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.744+0000 7f15a83219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.744+0000 7f15a83219c0 20 realm 2024-09-12T00:17:26.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.744+0000 7f15a83219c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.744+0000 7f15a83219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.744+0000 7f15a83219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:26.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.744+0000 7f15a83219c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.744+0000 7f15a83219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.744+0000 7f15a83219c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.748+0000 7f15a83219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:26.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.748+0000 7f15a83219c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.748+0000 7f15a83219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:26.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.748+0000 7f15a83219c0 20 searching for the correct realm 2024-09-12T00:17:26.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.752+0000 7f15a6628640 0 -- 172.21.15.138:0/3457139888 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f15a0030040 msgr2=0x7f15a0030930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:26.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.968+0000 7f15a6628640 0 -- 172.21.15.138:0/3457139888 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x558c2c215980 msgr2=0x558c2c217e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:26.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.976+0000 7f15a83219c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:26.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.976+0000 7f15a83219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:26.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.976+0000 7f15a83219c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:26.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.976+0000 7f15a83219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:26.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.976+0000 7f15a83219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:26.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.976+0000 7f15a83219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:26.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.976+0000 7f15a83219c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.976+0000 7f15a83219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.976+0000 7f15a83219c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.976+0000 7f15a83219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:26.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.976+0000 7f15a83219c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.980+0000 7f15a83219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:26.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.980+0000 7f15a83219c0 20 zone default found 2024-09-12T00:17:26.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.980+0000 7f15a83219c0 4 Realm: () 2024-09-12T00:17:26.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.980+0000 7f15a83219c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:26.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.980+0000 7f15a83219c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:26.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.980+0000 7f15a83219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:26.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.980+0000 7f15a83219c0 20 zonegroup default 2024-09-12T00:17:26.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.980+0000 7f15a83219c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.980+0000 7f15a83219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.980+0000 7f15a83219c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.980+0000 7f15a83219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.980+0000 7f15a83219c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:26.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.984+0000 7f15a83219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:26.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.984+0000 7f15a83219c0 20 started sync module instance, tier type = 2024-09-12T00:17:26.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:26.984+0000 7f15a83219c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:27.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.008+0000 7f15a83219c0 20 add_watcher() i=0 2024-09-12T00:17:27.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.008+0000 7f15a83219c0 20 add_watcher() i=1 2024-09-12T00:17:27.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.008+0000 7f15a83219c0 20 add_watcher() i=2 2024-09-12T00:17:27.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.008+0000 7f15a83219c0 20 add_watcher() i=3 2024-09-12T00:17:27.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.008+0000 7f15a83219c0 20 add_watcher() i=4 2024-09-12T00:17:27.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.008+0000 7f15a83219c0 20 add_watcher() i=5 2024-09-12T00:17:27.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.008+0000 7f15a83219c0 20 add_watcher() i=6 2024-09-12T00:17:27.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.012+0000 7f15a83219c0 20 add_watcher() i=7 2024-09-12T00:17:27.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.012+0000 7f15a83219c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:27.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.016+0000 7f14577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:27.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.016+0000 7f15a83219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:27.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.016+0000 7f15a83219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:27.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.016+0000 7f15a83219c0 5 note: GC not initialized 2024-09-12T00:17:27.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.016+0000 7f14567fc640 20 reqs_thread_entry: start 2024-09-12T00:17:27.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.020+0000 7f15a83219c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:27.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.020+0000 7f15a83219c0 20 Filter name: none 2024-09-12T00:17:27.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.020+0000 7f13c7fff640 20 reqs_thread_entry: start 2024-09-12T00:17:27.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.020+0000 7f15a83219c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:27.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.020+0000 7f15a83219c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:27.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.020+0000 7f15a83219c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:27.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.020+0000 7f15a83219c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:27.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.020+0000 7f15a83219c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:17:27.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.020+0000 7f15a83219c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:17:27.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.020+0000 7f15a83219c0 20 INFO: main: starting shard=0 2024-09-12T00:17:27.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.020+0000 7f15a83219c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:27.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.020+0000 7f15a83219c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:27.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.020+0000 7f15a83219c0 20 INFO: main: starting shard=1 2024-09-12T00:17:27.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.020+0000 7f15a83219c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:27.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.024+0000 7f15a83219c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:27.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.024+0000 7f15a83219c0 20 INFO: main: starting shard=2 2024-09-12T00:17:27.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.024+0000 7f15a83219c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:27.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.024+0000 7f15a83219c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:27.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.024+0000 7f15a83219c0 20 INFO: main: starting shard=3 2024-09-12T00:17:27.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.024+0000 7f15a83219c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:27.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.024+0000 7f15a83219c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:27.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.024+0000 7f15a83219c0 20 INFO: main: starting shard=4 2024-09-12T00:17:27.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.024+0000 7f15a83219c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:27.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.024+0000 7f15a83219c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:27.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.024+0000 7f15a83219c0 20 INFO: main: starting shard=5 2024-09-12T00:17:27.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.024+0000 7f15a83219c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:27.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.024+0000 7f15a83219c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:27.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.024+0000 7f15a83219c0 20 INFO: main: starting shard=6 2024-09-12T00:17:27.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.024+0000 7f15a83219c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:27.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.028+0000 7f15a83219c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:27.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.028+0000 7f15a83219c0 20 INFO: main: starting shard=7 2024-09-12T00:17:27.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.028+0000 7f15a83219c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:27.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.028+0000 7f15a83219c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:27.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.028+0000 7f15a83219c0 20 INFO: main: starting shard=8 2024-09-12T00:17:27.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.028+0000 7f15a83219c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:27.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.028+0000 7f15a83219c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:27.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.028+0000 7f15a83219c0 20 INFO: main: starting shard=9 2024-09-12T00:17:27.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.028+0000 7f15a83219c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:27.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.028+0000 7f15a83219c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:17:27.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.028+0000 7f15a83219c0 20 INFO: main: starting shard=10 2024-09-12T00:17:27.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.028+0000 7f15a83219c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:27.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.032+0000 7f15a83219c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:17:27.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.032+0000 7f15a83219c0 20 INFO: main: done 2024-09-12T00:17:27.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.032+0000 7f14577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:27.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.036+0000 7f15a83219c0 20 remove_watcher() i=0 2024-09-12T00:17:27.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.036+0000 7f15a83219c0 2 removed watcher, disabling cache 2024-09-12T00:17:27.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.040+0000 7f15a83219c0 20 remove_watcher() i=1 2024-09-12T00:17:27.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.040+0000 7f15a83219c0 20 remove_watcher() i=2 2024-09-12T00:17:27.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.044+0000 7f15a83219c0 20 remove_watcher() i=3 2024-09-12T00:17:27.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.048+0000 7f15a83219c0 20 remove_watcher() i=4 2024-09-12T00:17:27.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.048+0000 7f15a83219c0 20 remove_watcher() i=5 2024-09-12T00:17:27.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.052+0000 7f15a83219c0 20 remove_watcher() i=6 2024-09-12T00:17:27.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:27.056+0000 7f15a83219c0 20 remove_watcher() i=7 2024-09-12T00:17:27.075 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:27.075 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:27.078 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:17:27.510 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:17:27.941 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:17:27.973 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:27.973 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:28.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.012+0000 7f2f4385c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.016+0000 7f2f4385c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.016+0000 7f2f4385c9c0 20 realm 2024-09-12T00:17:28.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.016+0000 7f2f4385c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.016+0000 7f2f4385c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.016+0000 7f2f4385c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:28.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.016+0000 7f2f4385c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.016+0000 7f2f4385c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.016+0000 7f2f4385c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.016+0000 7f2f4385c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:28.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.016+0000 7f2f4385c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.016+0000 7f2f4385c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:28.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.016+0000 7f2f4385c9c0 20 searching for the correct realm 2024-09-12T00:17:28.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.024+0000 7f2f41b63640 0 -- 172.21.15.138:0/3224553204 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f2f3c0630b0 msgr2=0x7f2f3c00e860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:17:28.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.240+0000 7f2f41b63640 0 -- 172.21.15.138:0/3224553204 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5610dc7e64c0 msgr2=0x5610dc7e8980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:28.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.248+0000 7f2f4385c9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:28.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.248+0000 7f2f4385c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:28.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.248+0000 7f2f4385c9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:28.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.248+0000 7f2f4385c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:28.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.248+0000 7f2f4385c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:28.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.248+0000 7f2f4385c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:28.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.248+0000 7f2f4385c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.252+0000 7f2f4385c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.252+0000 7f2f4385c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.252+0000 7f2f4385c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:28.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.252+0000 7f2f4385c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.252+0000 7f2f4385c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:28.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.252+0000 7f2f4385c9c0 20 zone default found 2024-09-12T00:17:28.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.252+0000 7f2f4385c9c0 4 Realm: () 2024-09-12T00:17:28.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.252+0000 7f2f4385c9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:28.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.252+0000 7f2f4385c9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:28.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.252+0000 7f2f4385c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:28.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.252+0000 7f2f4385c9c0 20 zonegroup default 2024-09-12T00:17:28.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.252+0000 7f2f4385c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.252+0000 7f2f4385c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.252+0000 7f2f4385c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.252+0000 7f2f4385c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.252+0000 7f2f4385c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.256+0000 7f2f4385c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.256+0000 7f2f4385c9c0 20 started sync module instance, tier type = 2024-09-12T00:17:28.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.256+0000 7f2f4385c9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:28.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.280+0000 7f2f4385c9c0 20 add_watcher() i=0 2024-09-12T00:17:28.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.280+0000 7f2f4385c9c0 20 add_watcher() i=1 2024-09-12T00:17:28.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.280+0000 7f2f4385c9c0 20 add_watcher() i=2 2024-09-12T00:17:28.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.280+0000 7f2f4385c9c0 20 add_watcher() i=3 2024-09-12T00:17:28.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.280+0000 7f2f4385c9c0 20 add_watcher() i=4 2024-09-12T00:17:28.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.280+0000 7f2f4385c9c0 20 add_watcher() i=5 2024-09-12T00:17:28.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.280+0000 7f2f4385c9c0 20 add_watcher() i=6 2024-09-12T00:17:28.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.280+0000 7f2f4385c9c0 20 add_watcher() i=7 2024-09-12T00:17:28.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.280+0000 7f2f4385c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:28.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.284+0000 7f2df7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:28.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:28.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:28.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 5 note: GC not initialized 2024-09-12T00:17:28.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2df6fe5640 20 reqs_thread_entry: start 2024-09-12T00:17:28.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:28.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 20 Filter name: none 2024-09-12T00:17:28.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2df4fe1640 20 reqs_thread_entry: start 2024-09-12T00:17:28.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:17:28.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:28.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:17:28.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:17:28.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 : miss 2024-09-12T00:17:28.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:28.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 info.flags=0x17 2024-09-12T00:17:28.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 to cache LRU end 2024-09-12T00:17:28.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:28.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:17:28.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.288+0000 7f2f4385c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 2024-09-12T00:17:28.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.292+0000 7f2f4385c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:28.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.292+0000 7f2f4385c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:28.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.292+0000 7f2f4385c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:28.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.292+0000 7f2f4385c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:28.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.296+0000 7f2f4385c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:28.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.296+0000 7f2f4385c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:28.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.296+0000 7f2f4385c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:28.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.300+0000 7f2f4385c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:28.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.300+0000 7f2f4385c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:28.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.300+0000 7f2f4385c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:28.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.300+0000 7f2f4385c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:28.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.312+0000 7f2df7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:28.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.316+0000 7f2f4385c9c0 20 remove_watcher() i=0 2024-09-12T00:17:28.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.316+0000 7f2f4385c9c0 2 removed watcher, disabling cache 2024-09-12T00:17:28.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.316+0000 7f2f4385c9c0 20 remove_watcher() i=1 2024-09-12T00:17:28.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.320+0000 7f2f4385c9c0 20 remove_watcher() i=2 2024-09-12T00:17:28.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.324+0000 7f2f4385c9c0 20 remove_watcher() i=3 2024-09-12T00:17:28.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.324+0000 7f2f4385c9c0 20 remove_watcher() i=4 2024-09-12T00:17:28.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.328+0000 7f2f4385c9c0 20 remove_watcher() i=5 2024-09-12T00:17:28.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.332+0000 7f2f4385c9c0 20 remove_watcher() i=6 2024-09-12T00:17:28.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.332+0000 7f2f4385c9c0 20 remove_watcher() i=7 2024-09-12T00:17:28.351 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:17:28.385 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:28.385 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:28.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.428+0000 7fbf1b2199c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.428+0000 7fbf1b2199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.428+0000 7fbf1b2199c0 20 realm 2024-09-12T00:17:28.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.428+0000 7fbf1b2199c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.428+0000 7fbf1b2199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.428+0000 7fbf1b2199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:28.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.428+0000 7fbf1b2199c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.428+0000 7fbf1b2199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.428+0000 7fbf1b2199c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.432+0000 7fbf1b2199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:28.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.432+0000 7fbf1b2199c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.432+0000 7fbf1b2199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:28.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.432+0000 7fbf1b2199c0 20 searching for the correct realm 2024-09-12T00:17:28.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.436+0000 7fbf19520640 0 -- 172.21.15.138:0/167691578 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55b3b47418e0 msgr2=0x55b3b4743da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:28.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.444+0000 7fbf1851e640 0 -- 172.21.15.138:0/167691578 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55b3b473cb60 msgr2=0x55b3b473ef50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:28.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:28.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:28.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:28.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:28.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:28.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:28.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:28.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:28.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 zone default found 2024-09-12T00:17:28.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 4 Realm: () 2024-09-12T00:17:28.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:28.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:28.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:28.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 zonegroup default 2024-09-12T00:17:28.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 started sync module instance, tier type = 2024-09-12T00:17:28.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.452+0000 7fbf1b2199c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:28.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.472+0000 7fbf1b2199c0 20 add_watcher() i=0 2024-09-12T00:17:28.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.472+0000 7fbf1b2199c0 20 add_watcher() i=1 2024-09-12T00:17:28.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.472+0000 7fbf1b2199c0 20 add_watcher() i=2 2024-09-12T00:17:28.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.472+0000 7fbf1b2199c0 20 add_watcher() i=3 2024-09-12T00:17:28.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.472+0000 7fbf1b2199c0 20 add_watcher() i=4 2024-09-12T00:17:28.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.472+0000 7fbf1b2199c0 20 add_watcher() i=5 2024-09-12T00:17:28.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.472+0000 7fbf1b2199c0 20 add_watcher() i=6 2024-09-12T00:17:28.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.476+0000 7fbf1b2199c0 20 add_watcher() i=7 2024-09-12T00:17:28.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.476+0000 7fbf1b2199c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:28.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.480+0000 7fbdcefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:28.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.480+0000 7fbf1b2199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:28.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.480+0000 7fbf1b2199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:28.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.480+0000 7fbf1b2199c0 5 note: GC not initialized 2024-09-12T00:17:28.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.480+0000 7fbdcdfe3640 20 reqs_thread_entry: start 2024-09-12T00:17:28.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.480+0000 7fbf1b2199c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:28.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.480+0000 7fbf1b2199c0 20 Filter name: none 2024-09-12T00:17:28.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.480+0000 7fbd3f7fe640 20 reqs_thread_entry: start 2024-09-12T00:17:28.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.480+0000 7fbf1b2199c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:17:28.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.480+0000 7fbf1b2199c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:28.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:17:28.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:17:28.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 : miss 2024-09-12T00:17:28.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:28.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 info.flags=0x17 2024-09-12T00:17:28.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 to cache LRU end 2024-09-12T00:17:28.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:17:28.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:17:28.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.1 2024-09-12T00:17:28.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.0 2024-09-12T00:17:28.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:17:28.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:28.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.2 2024-09-12T00:17:28.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:17:28.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.3 2024-09-12T00:17:28.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:17:28.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.484+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.4 2024-09-12T00:17:28.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.488+0000 7fbf1b2199c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:17:28.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.488+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:28.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.488+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.6 2024-09-12T00:17:28.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.488+0000 7fbf1b2199c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:17:28.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.488+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.7 2024-09-12T00:17:28.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.488+0000 7fbf1b2199c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:17:28.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.488+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:28.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.492+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.9 2024-09-12T00:17:28.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.492+0000 7fbf1b2199c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:17:28.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.492+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:28.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.492+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:28.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.492+0000 7fbf1b2199c0 20 get_obj_state: octx=0x55b3b44313b0 obj=check-bucket:e state=0x55b3b4775848 s->prefetch_data=0 2024-09-12T00:17:28.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.492+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:28.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.492+0000 7fbf1b2199c0 20 get_obj_state: octx=0x55b3b44d66d0 obj=check-bucket:d state=0x55b3b4770b88 s->prefetch_data=0 2024-09-12T00:17:28.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.492+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:28.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.496+0000 7fbf1b2199c0 20 get_obj_state: octx=0x55b3b4773640 obj=check-bucket:c state=0x55b3b476bc38 s->prefetch_data=0 2024-09-12T00:17:28.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.496+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:28.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.496+0000 7fbf1b2199c0 20 get_obj_state: octx=0x55b3b4773540 obj=check-bucket:f state=0x55b3b476d5c8 s->prefetch_data=0 2024-09-12T00:17:28.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.496+0000 7fbf1b2199c0 20 get_obj_state: setting s->obj_tag to rd1juz11i4hqsgzvq1rl2kqpwsevd5hm 2024-09-12T00:17:28.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.496+0000 7fbf1b2199c0 20 get_obj_state_impl: setting s->olh_tag to y5kpnk30g25cc9kdnecd66u204b2wasc 2024-09-12T00:17:28.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.496+0000 7fbf1b2199c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=y5kpnk30g25cc9kdnecd66u204b2wasc 2024-09-12T00:17:28.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.496+0000 7fbf1b2199c0 20 get_obj_state: setting s->obj_tag to 1niojy1w64m5yxqemrh7zu9i1d6vz9gn 2024-09-12T00:17:28.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.496+0000 7fbf1b2199c0 20 get_obj_state_impl: setting s->olh_tag to o5byja4akushsojb7ct84gd1tq8ciisz 2024-09-12T00:17:28.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.496+0000 7fbf1b2199c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=o5byja4akushsojb7ct84gd1tq8ciisz 2024-09-12T00:17:28.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.496+0000 7fbf1b2199c0 20 get_obj_state: setting s->obj_tag to cf2cn38uvdmqutkuw7dhcw0g2y7vewe9 2024-09-12T00:17:28.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.496+0000 7fbf1b2199c0 20 get_obj_state_impl: setting s->olh_tag to oolu963v8ppvtaskpinln29v0jw6y1p6 2024-09-12T00:17:28.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.496+0000 7fbf1b2199c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=oolu963v8ppvtaskpinln29v0jw6y1p6 2024-09-12T00:17:28.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.496+0000 7fbf1b2199c0 20 get_obj_state: setting s->obj_tag to 6qqblmztd3dq6ofvrxdjvjwvk1r4dcul 2024-09-12T00:17:28.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.496+0000 7fbf1b2199c0 20 get_obj_state_impl: setting s->olh_tag to vw60te1mdd7sdl2punw1ili69lcsr7u3 2024-09-12T00:17:28.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.496+0000 7fbf1b2199c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vw60te1mdd7sdl2punw1ili69lcsr7u3 2024-09-12T00:17:28.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.500+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:28.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.500+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:28.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.500+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:28.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.500+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:28.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:28.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 olh_log_entry: epoch=3 op=3 key=c[lPM6PuEsKQ2p0RFF2Uwh4kXLxR6ttc6] 2024-09-12T00:17:28.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 get_obj_state: octx=0x55b3b4773640 obj=check-bucket:_:lPM6PuEsKQ2p0RFF2Uwh4kXLxR6ttc6_c state=0x55b3b48179f8 s->prefetch_data=0 2024-09-12T00:17:28.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:28.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:17:28.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 olh_log_entry: epoch=2 op=3 key=f[-Dhy29S4HAt-VyXeiiSIkxbPBdjaGqA] 2024-09-12T00:17:28.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 get_obj_state: octx=0x55b3b4773540 obj=check-bucket:_:-Dhy29S4HAt-VyXeiiSIkxbPBdjaGqA_f state=0x55b3b481bf48 s->prefetch_data=0 2024-09-12T00:17:28.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 10 manifest: total_size = 22 2024-09-12T00:17:28.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.4722780039418757898 2024-09-12T00:17:28.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 get_obj_state: octx=0x55b3b4773640 obj=check-bucket:_:lPM6PuEsKQ2p0RFF2Uwh4kXLxR6ttc6_c state=0x55b3b48179f8 s->prefetch_data=0 2024-09-12T00:17:28.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 prepare_atomic_modification: state is not atomic. state=0x55b3b48179f8 2024-09-12T00:17:28.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:28.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 10 manifest: total_size = 11 2024-09-12T00:17:28.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.719855743420065981 2024-09-12T00:17:28.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 get_obj_state: octx=0x55b3b4773540 obj=check-bucket:_:-Dhy29S4HAt-VyXeiiSIkxbPBdjaGqA_f state=0x55b3b481bf48 s->prefetch_data=0 2024-09-12T00:17:28.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 prepare_atomic_modification: state is not atomic. state=0x55b3b481bf48 2024-09-12T00:17:28.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:28.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:28.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 olh_log_entry: epoch=3 op=3 key=d[GN--8owNDn88YX4P1Txtn2OXlvQJPDk] 2024-09-12T00:17:28.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 get_obj_state: octx=0x55b3b44d66d0 obj=check-bucket:_:GN--8owNDn88YX4P1Txtn2OXlvQJPDk_d state=0x55b3b4829668 s->prefetch_data=0 2024-09-12T00:17:28.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.504+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:28.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.508+0000 7fbf1b2199c0 10 manifest: total_size = 22 2024-09-12T00:17:28.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.508+0000 7fbf1b2199c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.12596376615615415853 2024-09-12T00:17:28.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.508+0000 7fbf1b2199c0 20 get_obj_state: octx=0x55b3b44d66d0 obj=check-bucket:_:GN--8owNDn88YX4P1Txtn2OXlvQJPDk_d state=0x55b3b4829668 s->prefetch_data=0 2024-09-12T00:17:28.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.508+0000 7fbf1b2199c0 20 prepare_atomic_modification: state is not atomic. state=0x55b3b4829668 2024-09-12T00:17:28.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.508+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:28.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.508+0000 7fbf1b2199c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:17:28.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.508+0000 7fbf1b2199c0 20 olh_log_entry: epoch=2 op=3 key=e[q1rVsVjz0GJSW0k.LcMVLcv0wQhBj1r] 2024-09-12T00:17:28.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.508+0000 7fbf1b2199c0 20 get_obj_state: octx=0x55b3b44313b0 obj=check-bucket:_:q1rVsVjz0GJSW0k.LcMVLcv0wQhBj1r_e state=0x55b3b4830f78 s->prefetch_data=0 2024-09-12T00:17:28.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.508+0000 7fbf1b2199c0 10 manifest: total_size = 22 2024-09-12T00:17:28.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.508+0000 7fbf1b2199c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.15818376274750777422 2024-09-12T00:17:28.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.508+0000 7fbf1b2199c0 20 get_obj_state: octx=0x55b3b44313b0 obj=check-bucket:_:q1rVsVjz0GJSW0k.LcMVLcv0wQhBj1r_e state=0x55b3b4830f78 s->prefetch_data=0 2024-09-12T00:17:28.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.508+0000 7fbf1b2199c0 20 prepare_atomic_modification: state is not atomic. state=0x55b3b4830f78 2024-09-12T00:17:28.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.508+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:28.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.512+0000 7fbf1b2199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:28.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.512+0000 7fbf1b2199c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:17:28.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.512+0000 7fbf1b2199c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:17:28.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.512+0000 7fbf1b2199c0 5 delete_objs_inline: removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.1__shadow:lPM6PuEsKQ2p0RFF2Uwh4kXLxR6ttc6_.M27efG67v-O9435702-_iag7pWd_QWG_0 2024-09-12T00:17:28.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.512+0000 7fbf1b2199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:28.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.512+0000 7fbf1b2199c0 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-12T00:17:28.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.512+0000 7fbf1b2199c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:17:28.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.512+0000 7fbf1b2199c0 5 delete_objs_inline: removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.1__shadow:-Dhy29S4HAt-VyXeiiSIkxbPBdjaGqA_.UlIHSX4Tfv6I2XWLVbkj4II5ITa7aBm_0 2024-09-12T00:17:28.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.512+0000 7fbdef7fe640 20 handle_completion(): completion ok for obj=c[lPM6PuEsKQ2p0RFF2Uwh4kXLxR6ttc6] 2024-09-12T00:17:28.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.512+0000 7fbf1b2199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:28.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.512+0000 7fbf1b2199c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:17:28.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.512+0000 7fbf1b2199c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:17:28.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.512+0000 7fbf1b2199c0 5 delete_objs_inline: removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.1__shadow:GN--8owNDn88YX4P1Txtn2OXlvQJPDk_.tOrKUmP6hB5DTvmPKWBcTK9f83u-j9t_0 2024-09-12T00:17:28.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.516+0000 7fbdef7fe640 20 handle_completion(): completion ok for obj=f[-Dhy29S4HAt-VyXeiiSIkxbPBdjaGqA] 2024-09-12T00:17:28.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.516+0000 7fbf1b2199c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:17:28.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.516+0000 7fbdef7fe640 20 handle_completion(): completion ok for obj=d[GN--8owNDn88YX4P1Txtn2OXlvQJPDk] 2024-09-12T00:17:28.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.516+0000 7fbf1b2199c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:17:28.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.516+0000 7fbf1b2199c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:17:28.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.516+0000 7fbf1b2199c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:17:28.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.516+0000 7fbf1b2199c0 5 delete_objs_inline: removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.1__shadow:q1rVsVjz0GJSW0k.LcMVLcv0wQhBj1r_.XGt52shbQ77TkL7rLO-87KFAnlsBA70_0 2024-09-12T00:17:28.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.520+0000 7fbf1b2199c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:17:28.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.520+0000 7fbf1b2199c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:17:28.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.520+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:28.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.520+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:28.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.520+0000 7fbdeffff640 20 handle_completion(): completion ok for obj=e[q1rVsVjz0GJSW0k.LcMVLcv0wQhBj1r] 2024-09-12T00:17:28.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.520+0000 7fbf1b2199c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:17:28.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.524+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.8 2024-09-12T00:17:28.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.524+0000 7fbf1b2199c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:17:28.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.524+0000 7fbf1b2199c0 20 get_obj_state: octx=0x55b3b4773540 obj=check-bucket:f state=0x55b3b476d5c8 s->prefetch_data=0 2024-09-12T00:17:28.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.524+0000 7fbf1b2199c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vw60te1mdd7sdl2punw1ili69lcsr7u3 2024-09-12T00:17:28.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.524+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:28.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.524+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:28.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.528+0000 7fbf1b2199c0 20 get_obj_state: octx=0x55b3b44313b0 obj=check-bucket:e state=0x55b3b4775848 s->prefetch_data=0 2024-09-12T00:17:28.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.528+0000 7fbf1b2199c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=y5kpnk30g25cc9kdnecd66u204b2wasc 2024-09-12T00:17:28.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.532+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.5 2024-09-12T00:17:28.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.532+0000 7fbf1b2199c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:17:28.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.532+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:28.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.536+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.10 2024-09-12T00:17:28.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.536+0000 7fbf1b2199c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T00:17:28.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.544+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:28.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.548+0000 7fbf1b2199c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.1.1 2024-09-12T00:17:28.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.548+0000 7fbf1b2199c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T00:17:28.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.548+0000 7fbf1b2199c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:17:28.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.548+0000 7fbdcefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:28.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.552+0000 7fbf1b2199c0 20 remove_watcher() i=0 2024-09-12T00:17:28.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.552+0000 7fbf1b2199c0 2 removed watcher, disabling cache 2024-09-12T00:17:28.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.552+0000 7fbf1b2199c0 20 remove_watcher() i=1 2024-09-12T00:17:28.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.556+0000 7fbf1b2199c0 20 remove_watcher() i=2 2024-09-12T00:17:28.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.556+0000 7fbf1b2199c0 20 remove_watcher() i=3 2024-09-12T00:17:28.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.560+0000 7fbf1b2199c0 20 remove_watcher() i=4 2024-09-12T00:17:28.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.564+0000 7fbf1b2199c0 20 remove_watcher() i=5 2024-09-12T00:17:28.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.564+0000 7fbf1b2199c0 20 remove_watcher() i=6 2024-09-12T00:17:28.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.568+0000 7fbf1b2199c0 20 remove_watcher() i=7 2024-09-12T00:17:28.586 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:28.586 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:28.593 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:28.593 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:28.650 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:17:28.676 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:28.677 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:28.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.716+0000 7f14fb3879c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.716+0000 7f14fb3879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.716+0000 7f14fb3879c0 20 realm 2024-09-12T00:17:28.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.716+0000 7f14fb3879c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.716+0000 7f14fb3879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.716+0000 7f14fb3879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:17:28.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.716+0000 7f14fb3879c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.720+0000 7f14fb3879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.720+0000 7f14fb3879c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.720+0000 7f14fb3879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:28.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.720+0000 7f14fb3879c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.720+0000 7f14fb3879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:17:28.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.720+0000 7f14fb3879c0 20 searching for the correct realm 2024-09-12T00:17:28.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.724+0000 7f14f968e640 0 -- 172.21.15.138:0/2112850190 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f14f00620e0 msgr2=0x7f14f0067880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:17:28.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.940+0000 7f14f968e640 0 -- 172.21.15.138:0/2112850190 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55ff0293e610 msgr2=0x55ff02940ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:17:28.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.948+0000 7f14fb3879c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:17:28.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.948+0000 7f14fb3879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:17:28.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.948+0000 7f14fb3879c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:17:28.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.948+0000 7f14fb3879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:17:28.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.948+0000 7f14fb3879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:17:28.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.948+0000 7f14fb3879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:17:28.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.948+0000 7f14fb3879c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.948+0000 7f14fb3879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.948+0000 7f14fb3879c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.948+0000 7f14fb3879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:17:28.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.948+0000 7f14fb3879c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.952+0000 7f14fb3879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:17:28.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.952+0000 7f14fb3879c0 20 zone default found 2024-09-12T00:17:28.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.952+0000 7f14fb3879c0 4 Realm: () 2024-09-12T00:17:28.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.952+0000 7f14fb3879c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:17:28.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.952+0000 7f14fb3879c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:17:28.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.952+0000 7f14fb3879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:17:28.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.952+0000 7f14fb3879c0 20 zonegroup default 2024-09-12T00:17:28.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.952+0000 7f14fb3879c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.952+0000 7f14fb3879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.952+0000 7f14fb3879c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.952+0000 7f14fb3879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.952+0000 7f14fb3879c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.952+0000 7f14fb3879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:17:28.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.952+0000 7f14fb3879c0 20 started sync module instance, tier type = 2024-09-12T00:17:28.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.952+0000 7f14fb3879c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:17:28.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.976+0000 7f14fb3879c0 20 add_watcher() i=0 2024-09-12T00:17:28.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.976+0000 7f14fb3879c0 20 add_watcher() i=1 2024-09-12T00:17:28.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.976+0000 7f14fb3879c0 20 add_watcher() i=2 2024-09-12T00:17:28.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.976+0000 7f14fb3879c0 20 add_watcher() i=3 2024-09-12T00:17:28.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.976+0000 7f14fb3879c0 20 add_watcher() i=4 2024-09-12T00:17:28.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.976+0000 7f14fb3879c0 20 add_watcher() i=5 2024-09-12T00:17:28.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.976+0000 7f14fb3879c0 20 add_watcher() i=6 2024-09-12T00:17:28.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.980+0000 7f14fb3879c0 20 add_watcher() i=7 2024-09-12T00:17:28.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.980+0000 7f14fb3879c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:17:28.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.984+0000 7f13aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:28.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.984+0000 7f14fb3879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:17:28.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.984+0000 7f14fb3879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:17:28.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.984+0000 7f14fb3879c0 5 note: GC not initialized 2024-09-12T00:17:28.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.984+0000 7f13adfe3640 20 reqs_thread_entry: start 2024-09-12T00:17:28.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.984+0000 7f14fb3879c0 20 init_complete bucket index max shards: 11 2024-09-12T00:17:28.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.984+0000 7f14fb3879c0 20 Filter name: none 2024-09-12T00:17:28.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.984+0000 7f131f7fe640 20 reqs_thread_entry: start 2024-09-12T00:17:28.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.984+0000 7f14fb3879c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.988+0000 7f14fb3879c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:28.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.988+0000 7f14fb3879c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.988+0000 7f14fb3879c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:28.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.988+0000 7f14fb3879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:17:28.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.988+0000 7f14fb3879c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.988+0000 7f14fb3879c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:17:28.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.988+0000 7f14fb3879c0 20 rados->read ofs=0 len=0 2024-09-12T00:17:28.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.988+0000 7f14fb3879c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:17:28.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.988+0000 7f14fb3879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:17:28.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.992+0000 7f13aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:17:29.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.996+0000 7f14fb3879c0 20 remove_watcher() i=0 2024-09-12T00:17:29.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:28.996+0000 7f14fb3879c0 2 removed watcher, disabling cache 2024-09-12T00:17:29.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:29.000+0000 7f14fb3879c0 20 remove_watcher() i=1 2024-09-12T00:17:29.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:29.000+0000 7f14fb3879c0 20 remove_watcher() i=2 2024-09-12T00:17:29.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:29.004+0000 7f14fb3879c0 20 remove_watcher() i=3 2024-09-12T00:17:29.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:29.008+0000 7f14fb3879c0 20 remove_watcher() i=4 2024-09-12T00:17:29.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:29.008+0000 7f14fb3879c0 20 remove_watcher() i=5 2024-09-12T00:17:29.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:29.012+0000 7f14fb3879c0 20 remove_watcher() i=6 2024-09-12T00:17:29.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:17:29.016+0000 7f14fb3879c0 20 remove_watcher() i=7 2024-09-12T00:17:29.031 INFO:tasks.workunit.client.0.smithi138.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:17:29.031 INFO:tasks.workunit.client.0.smithi138.stderr:Deleting bucket check-bucket 2024-09-12T00:17:29.032 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:29.032 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:29.038 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:17:29.038 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:17:29.089 INFO:tasks.workunit.client.0.smithi138.stderr:Completed bucket check tests 2024-09-12T00:17:29.090 INFO:tasks.workunit.client.0.smithi138.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T00:17:29.090 INFO:tasks.workunit.client.0.smithi138.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T00:17:29.090 INFO:tasks.workunit.client.0.smithi138.stdout:connected to https://localhost:443 2024-09-12T00:17:29.175 INFO:tasks.workunit.client.0.smithi138.stderr:+ deactivate 2024-09-12T00:17:29.175 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T00:17:29.175 INFO:tasks.workunit.client.0.smithi138.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:17:29.175 INFO:tasks.workunit.client.0.smithi138.stderr:+ export PATH 2024-09-12T00:17:29.175 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:17:29.175 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n '' ']' 2024-09-12T00:17:29.175 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:17:29.175 INFO:tasks.workunit.client.0.smithi138.stderr:+ hash -r 2024-09-12T00:17:29.176 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n '' ']' 2024-09-12T00:17:29.176 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:17:29.176 INFO:tasks.workunit.client.0.smithi138.stdout:OK. 2024-09-12T00:17:29.177 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:17:29.177 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:17:29.177 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset -f deactivate 2024-09-12T00:17:29.177 INFO:tasks.workunit.client.0.smithi138.stderr:+ echo OK. 2024-09-12T00:17:29.177 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:17:29.178 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:17:29.191 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T00:17:29.191 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:17:29.599 DEBUG:teuthology.parallel:result is None 2024-09-12T00:17:29.599 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:17:29.613 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:17:29.613 DEBUG:teuthology.orchestra.run.smithi138:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:17:29.674 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:17:29.674 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:17:29.685 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:17:29.685 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:17:29.685 DEBUG:teuthology.orchestra.run.smithi138:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:17:29.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:17:29.721 INFO:teuthology.orchestra.run.smithi138.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:17:29.722 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:17:29.769 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:17:29.769 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:17:29.817 INFO:tasks.workunit:timeout=3h 2024-09-12T00:17:29.817 INFO:tasks.workunit:cleanup=True 2024-09-12T00:17:29.818 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:17:29.867 INFO:tasks.workunit.client.0.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:18:13.059 INFO:tasks.workunit.client.0.smithi138.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:18:13.059 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:18:13.059 INFO:tasks.workunit.client.0.smithi138.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:18:13.059 INFO:tasks.workunit.client.0.smithi138.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:18:13.059 INFO:tasks.workunit.client.0.smithi138.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:18:13.060 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:18:13.060 INFO:tasks.workunit.client.0.smithi138.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:18:13.060 INFO:tasks.workunit.client.0.smithi138.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:18:13.060 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:18:13.060 INFO:tasks.workunit.client.0.smithi138.stderr: git switch -c 2024-09-12T00:18:13.060 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:18:13.060 INFO:tasks.workunit.client.0.smithi138.stderr:Or undo this operation with: 2024-09-12T00:18:13.060 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:18:13.060 INFO:tasks.workunit.client.0.smithi138.stderr: git switch - 2024-09-12T00:18:13.060 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:18:13.060 INFO:tasks.workunit.client.0.smithi138.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:18:13.060 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:18:13.060 INFO:tasks.workunit.client.0.smithi138.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:18:13.065 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:18:13.112 INFO:tasks.workunit.client.0.smithi138.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:18:13.114 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:18:13.114 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:18:13.181 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:18:13.236 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:18:13.281 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:18:13.283 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:18:13.283 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:18:13.326 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:18:13.329 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:18:13.330 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:18:13.377 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T00:18:13.379 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T00:18:13.379 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T00:18:13.440 INFO:tasks.workunit.client.0.smithi138.stdout:Running main() from gmock_main.cc 2024-09-12T00:18:13.441 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:18:13.441 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:18:13.441 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 11 tests from ClsLock 2024-09-12T00:18:13.441 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T00:18:15.131 INFO:tasks.workunit.client.0.smithi138.stdout:lock: mylock 2024-09-12T00:18:15.131 INFO:tasks.workunit.client.0.smithi138.stdout: lock_type: exclusive 2024-09-12T00:18:15.131 INFO:tasks.workunit.client.0.smithi138.stdout: tag: 2024-09-12T00:18:15.131 INFO:tasks.workunit.client.0.smithi138.stdout: lockers: 2024-09-12T00:18:15.131 INFO:tasks.workunit.client.0.smithi138.stdout: client.5175 expiration=2024-09-12T00:20:15.128201+0000 addr=v1:172.21.15.138:0/2678531440 cookie= 2024-09-12T00:18:15.136 INFO:tasks.workunit.client.0.smithi138.stdout:lock: mylock 2024-09-12T00:18:15.136 INFO:tasks.workunit.client.0.smithi138.stdout: lock_type: shared 2024-09-12T00:18:15.136 INFO:tasks.workunit.client.0.smithi138.stdout: tag: 2024-09-12T00:18:15.136 INFO:tasks.workunit.client.0.smithi138.stdout: lockers: 2024-09-12T00:18:15.136 INFO:tasks.workunit.client.0.smithi138.stdout: client.5175 expiration=2024-09-12T00:20:15.137457+0000 addr=v1:172.21.15.138:0/2678531440 cookie= 2024-09-12T00:18:15.136 INFO:tasks.workunit.client.0.smithi138.stdout: client.5184 expiration=0.000000 addr=v1:172.21.15.138:0/2413543665 cookie= 2024-09-12T00:18:15.138 INFO:tasks.workunit.client.0.smithi138.stdout:lock: mylock 2024-09-12T00:18:15.138 INFO:tasks.workunit.client.0.smithi138.stdout: lock_type: shared 2024-09-12T00:18:15.138 INFO:tasks.workunit.client.0.smithi138.stdout: tag: 2024-09-12T00:18:15.138 INFO:tasks.workunit.client.0.smithi138.stdout: lockers: 2024-09-12T00:18:15.138 INFO:tasks.workunit.client.0.smithi138.stdout: client.5184 expiration=0.000000 addr=v1:172.21.15.138:0/2413543665 cookie= 2024-09-12T00:18:16.084 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestMultiLocking (2644 ms) 2024-09-12T00:18:16.084 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T00:18:18.375 INFO:tasks.workunit.client.0.smithi138.stdout:lock: mylock 2024-09-12T00:18:18.375 INFO:tasks.workunit.client.0.smithi138.stdout: lock_type: shared 2024-09-12T00:18:18.375 INFO:tasks.workunit.client.0.smithi138.stdout: tag: 2024-09-12T00:18:18.375 INFO:tasks.workunit.client.0.smithi138.stdout: lockers: 2024-09-12T00:18:18.375 INFO:tasks.workunit.client.0.smithi138.stdout: client.5018 expiration=0.000000 addr=v1:172.21.15.138:0/2674729656 cookie= 2024-09-12T00:18:18.380 INFO:tasks.workunit.client.0.smithi138.stdout:lock: mylock 2024-09-12T00:18:18.380 INFO:tasks.workunit.client.0.smithi138.stdout: lock_type: exclusive 2024-09-12T00:18:18.380 INFO:tasks.workunit.client.0.smithi138.stdout: tag: new_tag 2024-09-12T00:18:18.380 INFO:tasks.workunit.client.0.smithi138.stdout: lockers: 2024-09-12T00:18:18.380 INFO:tasks.workunit.client.0.smithi138.stdout: client.5012 expiration=0.000000 addr=v1:172.21.15.138:0/3003984989 cookie= 2024-09-12T00:18:19.131 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestMeta (3047 ms) 2024-09-12T00:18:19.131 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T00:18:21.174 INFO:tasks.workunit.client.0.smithi138.stdout:lock: mylock 2024-09-12T00:18:21.175 INFO:tasks.workunit.client.0.smithi138.stdout: lock_type: exclusive 2024-09-12T00:18:21.175 INFO:tasks.workunit.client.0.smithi138.stdout: tag: 2024-09-12T00:18:21.175 INFO:tasks.workunit.client.0.smithi138.stdout: lockers: 2024-09-12T00:18:21.180 INFO:tasks.workunit.client.0.smithi138.stdout:lock: mylock 2024-09-12T00:18:21.180 INFO:tasks.workunit.client.0.smithi138.stdout: lock_type: shared 2024-09-12T00:18:21.180 INFO:tasks.workunit.client.0.smithi138.stdout: tag: 2024-09-12T00:18:21.180 INFO:tasks.workunit.client.0.smithi138.stdout: lockers: 2024-09-12T00:18:21.181 INFO:tasks.workunit.client.0.smithi138.stdout: client.5202 expiration=0.000000 addr=v1:172.21.15.138:0/1539363424 cookie= 2024-09-12T00:18:21.181 INFO:tasks.workunit.client.0.smithi138.stdout: client.5202 expiration=0.000000 addr=v1:172.21.15.138:0/1539363424 cookie=new cookie 2024-09-12T00:18:22.135 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestCookie (3004 ms) 2024-09-12T00:18:22.135 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T00:18:25.202 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestMultipleLocks (3067 ms) 2024-09-12T00:18:25.202 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T00:18:32.360 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestLockDuration (7153 ms) 2024-09-12T00:18:32.360 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T00:18:35.387 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestAssertLocked (3032 ms) 2024-09-12T00:18:35.387 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T00:18:38.390 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestSetCookie (3002 ms) 2024-09-12T00:18:38.390 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T00:18:58.605 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestRenew (20216 ms) 2024-09-12T00:18:58.606 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T00:19:04.743 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6138 ms) 2024-09-12T00:19:04.743 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T00:19:12.081 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7336 ms) 2024-09-12T00:19:12.081 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T00:19:20.089 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8011 ms) 2024-09-12T00:19:20.090 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 11 tests from ClsLock (66650 ms total) 2024-09-12T00:19:20.090 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:19:20.090 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:19:20.090 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 11 tests from 1 test suite ran. (66650 ms total) 2024-09-12T00:19:20.090 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 11 tests. 2024-09-12T00:19:20.095 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:19:20.096 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:19:20.153 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T00:19:20.154 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T00:19:20.154 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T00:19:20.220 INFO:tasks.workunit.client.0.smithi138.stdout:Running main() from gmock_main.cc 2024-09-12T00:19:20.220 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:19:20.221 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:19:20.221 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 4 tests from cls_log 2024-09-12T00:19:20.221 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T00:19:23.142 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_log.test_log_add_same_time (2923 ms) 2024-09-12T00:19:23.142 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T00:19:26.146 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_log.test_log_add_different_time (3003 ms) 2024-09-12T00:19:26.146 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T00:19:29.218 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_log.trim_by_time (3071 ms) 2024-09-12T00:19:29.219 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T00:19:32.263 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_log.trim_by_marker (3043 ms) 2024-09-12T00:19:32.264 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 4 tests from cls_log (12042 ms total) 2024-09-12T00:19:32.264 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:19:32.264 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:19:32.264 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 4 tests from 1 test suite ran. (12042 ms total) 2024-09-12T00:19:32.264 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 4 tests. 2024-09-12T00:19:32.267 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:19:32.267 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:19:32.324 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T00:19:32.326 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T00:19:32.326 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T00:19:32.390 INFO:tasks.workunit.client.0.smithi138.stdout:Running main() from gmock_main.cc 2024-09-12T00:19:32.390 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:19:32.391 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:19:32.391 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 10 tests from cls_refcount 2024-09-12T00:19:32.391 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T00:19:35.303 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.test_implicit (2912 ms) 2024-09-12T00:19:35.303 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T00:19:38.351 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3046 ms) 2024-09-12T00:19:38.351 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T00:19:47.443 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.test_put_snap (9094 ms) 2024-09-12T00:19:47.443 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T00:19:50.473 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.test_explicit (3030 ms) 2024-09-12T00:19:50.473 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.set 2024-09-12T00:19:53.526 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.set (3053 ms) 2024-09-12T00:19:53.526 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T00:20:00.535 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.test_implicit_ec (7009 ms) 2024-09-12T00:20:00.536 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T00:20:07.635 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7099 ms) 2024-09-12T00:20:07.635 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T00:20:19.815 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.test_put_snap_ec (12182 ms) 2024-09-12T00:20:19.816 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T00:20:26.905 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.test_explicit_ec (7090 ms) 2024-09-12T00:20:26.906 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T00:20:33.933 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_refcount.set_ec (7028 ms) 2024-09-12T00:20:33.933 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 10 tests from cls_refcount (61543 ms total) 2024-09-12T00:20:33.933 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:20:33.933 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:20:33.934 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 10 tests from 1 test suite ran. (61543 ms total) 2024-09-12T00:20:33.934 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 10 tests. 2024-09-12T00:20:33.939 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:20:33.939 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:20:33.995 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T00:20:33.997 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T00:20:33.997 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T00:20:34.063 INFO:tasks.workunit.client.0.smithi138.stdout:Running main() from gmock_main.cc 2024-09-12T00:20:34.063 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:20:34.063 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:20:34.063 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 19 tests from cls_rgw 2024-09-12T00:20:35.966 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T00:20:36.071 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.index_basic (106 ms) 2024-09-12T00:20:36.072 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T00:20:36.144 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (72 ms) 2024-09-12T00:20:36.144 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T00:20:36.247 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.index_remove_object (103 ms) 2024-09-12T00:20:36.247 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T00:20:38.604 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.index_suggest (2357 ms) 2024-09-12T00:20:38.604 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T00:20:38.618 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.index_suggest_complete (15 ms) 2024-09-12T00:20:38.619 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T00:20:38.674 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.index_list (55 ms) 2024-09-12T00:20:38.674 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T00:21:36.462 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.index_list_delimited (57788 ms) 2024-09-12T00:21:36.463 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T00:21:36.685 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.bi_list (224 ms) 2024-09-12T00:21:36.685 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T00:21:36.713 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.gc_set (28 ms) 2024-09-12T00:21:36.713 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T00:21:36.746 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.gc_list (33 ms) 2024-09-12T00:21:36.746 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T00:21:44.271 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.gc_defer (7524 ms) 2024-09-12T00:21:44.271 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T00:21:44.467 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.usage_basic (197 ms) 2024-09-12T00:21:44.467 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T00:21:44.471 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.usage_clear_no_obj (4 ms) 2024-09-12T00:21:44.471 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T00:21:44.691 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.usage_clear (220 ms) 2024-09-12T00:21:44.691 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T00:21:44.826 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.bi_log_trim (135 ms) 2024-09-12T00:21:44.827 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T00:21:44.861 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.index_racing_removes (35 ms) 2024-09-12T00:21:44.861 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T00:21:44.921 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.reshardlog_list (60 ms) 2024-09-12T00:21:44.921 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T00:21:44.950 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.reshardlog_num (29 ms) 2024-09-12T00:21:44.950 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw.bi_put_entries 2024-09-12T00:21:45.025 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw.bi_put_entries (75 ms) 2024-09-12T00:21:45.299 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 19 tests from cls_rgw (69060 ms total) 2024-09-12T00:21:45.300 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:21:45.300 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:21:45.300 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 19 tests from 1 test suite ran. (71237 ms total) 2024-09-12T00:21:45.300 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 19 tests. 2024-09-12T00:21:45.308 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:21:45.308 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:21:45.368 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T00:21:45.369 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T00:21:45.369 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T00:21:45.434 INFO:tasks.workunit.client.0.smithi138.stdout:Running main() from gmock_main.cc 2024-09-12T00:21:45.435 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:21:45.435 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:21:45.435 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T00:21:45.435 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T00:21:47.311 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.init (1876 ms) 2024-09-12T00:21:47.311 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T00:21:47.346 INFO:tasks.workunit.client.0.smithi138.stderr:[ ] list info tag = chain-0 2024-09-12T00:21:47.346 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (35 ms) 2024-09-12T00:21:47.346 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T00:21:47.356 INFO:tasks.workunit.client.0.smithi138.stderr:[ ] next_marker is: = 0/4263 2024-09-12T00:21:47.357 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (12 ms) 2024-09-12T00:21:47.357 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T00:21:47.374 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (17 ms) 2024-09-12T00:21:47.374 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T00:21:47.389 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (15 ms) 2024-09-12T00:21:47.389 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T00:21:47.407 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (18 ms) 2024-09-12T00:21:47.407 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T00:21:47.424 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (18 ms) 2024-09-12T00:21:47.425 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T00:21:47.443 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (18 ms) 2024-09-12T00:21:47.443 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T00:21:48.310 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_gc.finalize (862 ms) 2024-09-12T00:21:48.310 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 9 tests from cls_rgw_gc (2871 ms total) 2024-09-12T00:21:48.310 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:21:48.310 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:21:48.310 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 9 tests from 1 test suite ran. (2871 ms total) 2024-09-12T00:21:48.310 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 9 tests. 2024-09-12T00:21:48.314 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:21:48.314 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:21:48.376 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T00:21:48.378 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T00:21:48.378 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T00:21:48.456 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:48.456 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:48.457 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T00:21:48.457 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:21:50.350 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T00:21:50.350 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T00:21:50.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.389+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=43PLCTDEP491 type=del size=2637641 2024-09-12T00:21:50.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.393+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~VNGJS1SN8OFJ.0 size=1048576 2024-09-12T00:21:50.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.397+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~VNGJS1SN8OFJ.1 size=1048576 2024-09-12T00:21:50.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.397+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~VNGJS1SN8OFJ.2 size=563000 2024-09-12T00:21:50.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.397+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=VNGJS1SN8OFJ tag=DVEVMPO5PNQC type=write size=3708728 2024-09-12T00:21:50.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.401+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=9CORSSLBOTLJ type=del size=2312106 2024-09-12T00:21:50.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.405+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=3S9384XM8SE1 type=del size=3643973 2024-09-12T00:21:50.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.409+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~PLBEKVR8NASD.0 size=1048576 2024-09-12T00:21:50.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.409+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~PLBEKVR8NASD.1 size=1048576 2024-09-12T00:21:50.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.413+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~PLBEKVR8NASD.2 size=884092 2024-09-12T00:21:50.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.413+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=PLBEKVR8NASD tag=1Y3CU8KP2APC type=write size=4029820 2024-09-12T00:21:50.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.417+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=KL0W5RZ1GVZU type=del size=1017299 2024-09-12T00:21:50.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.417+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=KPA3PAS94KBW type=del size=2192533 2024-09-12T00:21:50.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.421+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=L7CALA4SNQJO type=del size=101367 2024-09-12T00:21:50.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.425+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=6CV8YM9QRM43 type=del size=3143958 2024-09-12T00:21:50.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.425+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=TA1RO9R2HIE0 type=del size=1863661 2024-09-12T00:21:50.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.433+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~9ZAXKLAW74ST.0 size=1048576 2024-09-12T00:21:50.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.433+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~9ZAXKLAW74ST.1 size=1048576 2024-09-12T00:21:50.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.437+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~9ZAXKLAW74ST.2 size=366532 2024-09-12T00:21:50.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.437+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=9ZAXKLAW74ST tag=M4X1MWP4DKU7 type=write size=3512260 2024-09-12T00:21:50.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.441+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=H1U2MMU7G9RT type=write size=724353 2024-09-12T00:21:50.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.445+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=OSPUITMHOTZX type=del size=1421268 2024-09-12T00:21:50.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.449+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=87RRZPN2CHDY type=write size=79335 2024-09-12T00:21:50.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.457+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~UI0MC2SRKSST.0 size=1048576 2024-09-12T00:21:50.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.457+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~UI0MC2SRKSST.1 size=190243 2024-09-12T00:21:50.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.457+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=UI0MC2SRKSST tag=VMBLZXRYR1SP type=write size=2287395 2024-09-12T00:21:50.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.461+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=6FKQCA56E4TO type=write size=902967 2024-09-12T00:21:50.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.469+0000 7fd6489978c0 1 < suggested remove operation key=YJJBTNI318EH tag=43PLCTDEP491 type=del 2024-09-12T00:21:50.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.473+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=LH4JDLYKRJJG type=del size=3350522 2024-09-12T00:21:50.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.477+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~VNGJS1SN8OFJ.0 size=1048576 2024-09-12T00:21:50.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.477+0000 7fd6489978c0 1 < canceled part key=_multipart_Y3JFVW74FNT6.2~VNGJS1SN8OFJ.1 size=1048576 2024-09-12T00:21:50.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.477+0000 7fd6489978c0 1 < canceled part key=_multipart_Y3JFVW74FNT6.2~VNGJS1SN8OFJ.2 size=563000 2024-09-12T00:21:50.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.485+0000 7fd6489978c0 1 < canceled multipart upload key=Y3JFVW74FNT6 upload=VNGJS1SN8OFJ tag=DVEVMPO5PNQC type=write size=3708728 2024-09-12T00:21:50.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.489+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=JDM345Q6SQWM type=del size=669569 2024-09-12T00:21:50.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.493+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=9CORSSLBOTLJ type=del 2024-09-12T00:21:50.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.493+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=9J1I40OWRF6E type=del size=2769519 2024-09-12T00:21:50.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.501+0000 7fd6489978c0 1 < canceled operation key=J5IW4G9C72DH tag=3S9384XM8SE1 type=del size=3643973 2024-09-12T00:21:50.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.505+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~A91XH9R0PEDX.0 size=1048576 2024-09-12T00:21:50.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.509+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~A91XH9R0PEDX.1 size=1048576 2024-09-12T00:21:50.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.513+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~A91XH9R0PEDX.2 size=584981 2024-09-12T00:21:50.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.513+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=A91XH9R0PEDX tag=XPFATE82P1PB type=write size=3730709 2024-09-12T00:21:50.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.517+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~PLBEKVR8NASD.0 size=1048576 2024-09-12T00:21:50.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.521+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~PLBEKVR8NASD.1 size=1048576 2024-09-12T00:21:50.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.525+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~PLBEKVR8NASD.2 size=884092 2024-09-12T00:21:50.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.529+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=PLBEKVR8NASD tag=1Y3CU8KP2APC type=write size=4029820 2024-09-12T00:21:50.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.537+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~RC66WZWA59Y8.0 size=262149 2024-09-12T00:21:50.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.537+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=RC66WZWA59Y8 tag=VKES1VM5NCSN type=write size=1310725 2024-09-12T00:21:50.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.541+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=KL0W5RZ1GVZU type=del 2024-09-12T00:21:50.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.545+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~EP1ODDGEGJP0.0 size=1048576 2024-09-12T00:21:50.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.549+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~EP1ODDGEGJP0.1 size=1048576 2024-09-12T00:21:50.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.553+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~EP1ODDGEGJP0.2 size=614837 2024-09-12T00:21:50.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.553+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=EP1ODDGEGJP0 tag=Q5U5WZMWV5OF type=write size=3760565 2024-09-12T00:21:50.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.557+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=KPA3PAS94KBW type=del 2024-09-12T00:21:50.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.561+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=WSFPF904Z49R type=del size=4032171 2024-09-12T00:21:50.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.565+0000 7fd6489978c0 1 < completed delete operation key=JPVKBVRCZTE9 tag=L7CALA4SNQJO type=del 2024-09-12T00:21:50.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.569+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=OE3K90BJP3YG type=del size=3973046 2024-09-12T00:21:50.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.573+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=6CV8YM9QRM43 type=del 2024-09-12T00:21:50.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.577+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=WS7BKO45AH99 type=del size=2521077 2024-09-12T00:21:50.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.577+0000 7fd6489978c0 1 < completed delete operation key=JPVKBVRCZTE9 tag=TA1RO9R2HIE0 type=del 2024-09-12T00:21:50.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.581+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=4OMWSK4L74B4 type=del size=3547672 2024-09-12T00:21:50.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.585+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~9ZAXKLAW74ST.0 size=1048576 2024-09-12T00:21:50.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.589+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~9ZAXKLAW74ST.1 size=1048576 2024-09-12T00:21:50.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.593+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~9ZAXKLAW74ST.2 size=366532 2024-09-12T00:21:50.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.597+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=9ZAXKLAW74ST tag=M4X1MWP4DKU7 type=write size=3512260 2024-09-12T00:21:50.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.605+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~QMT5W7BJT0N2.0 size=1048576 2024-09-12T00:21:50.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.609+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~QMT5W7BJT0N2.1 size=941381 2024-09-12T00:21:50.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.609+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=QMT5W7BJT0N2 tag=GY2VS6Q3RRZL type=write size=3038533 2024-09-12T00:21:50.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.613+0000 7fd6489978c0 1 < completed write operation key=G4EUTQOHAT2E tag=H1U2MMU7G9RT type=write size=724353 2024-09-12T00:21:50.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.617+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=3AY9FZ3PN3MW type=del size=2489528 2024-09-12T00:21:50.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.621+0000 7fd6489978c0 1 < completed delete operation key=3JZP8TZFEIMH tag=OSPUITMHOTZX type=del 2024-09-12T00:21:50.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.625+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~DYZJ9OUT02YG.0 size=1048576 2024-09-12T00:21:50.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.629+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~DYZJ9OUT02YG.1 size=1024653 2024-09-12T00:21:50.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.629+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=DYZJ9OUT02YG tag=F22ZKDZU3VLU type=write size=3121805 2024-09-12T00:21:50.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.633+0000 7fd6489978c0 1 < completed write operation key=N0AAVPQ6MUQ1 tag=87RRZPN2CHDY type=write size=79335 2024-09-12T00:21:50.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.637+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=1WWN1G4G6LIP type=del size=748319 2024-09-12T00:21:50.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.641+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~UI0MC2SRKSST.0 size=1048576 2024-09-12T00:21:50.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.645+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~UI0MC2SRKSST.1 size=190243 2024-09-12T00:21:50.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.649+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=UI0MC2SRKSST tag=VMBLZXRYR1SP type=write size=2287395 2024-09-12T00:21:50.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.657+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~4FQTQ7UH1G44.0 size=1048576 2024-09-12T00:21:50.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.661+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~4FQTQ7UH1G44.1 size=31212 2024-09-12T00:21:50.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.661+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=4FQTQ7UH1G44 tag=YGIG7KODCZ8L type=write size=2128364 2024-09-12T00:21:50.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.665+0000 7fd6489978c0 1 < completed write operation key=IHYHPKVPWTUL tag=6FKQCA56E4TO type=write size=902967 2024-09-12T00:21:50.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.669+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=DYRM7JABRVVG type=del size=3031165 2024-09-12T00:21:50.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.673+0000 7fd6489978c0 1 < completed delete operation key=B2BW7GQ6UN9I tag=LH4JDLYKRJJG type=del 2024-09-12T00:21:50.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.677+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~E7FE2RQ7TCK3.0 size=1048576 2024-09-12T00:21:50.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.681+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~E7FE2RQ7TCK3.1 size=1048576 2024-09-12T00:21:50.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.685+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~E7FE2RQ7TCK3.2 size=1035590 2024-09-12T00:21:50.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.685+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=E7FE2RQ7TCK3 tag=9OC2VLYK1M57 type=write size=4181318 2024-09-12T00:21:50.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.693+0000 7fd6489978c0 1 < suggested remove operation key=Y3JFVW74FNT6 tag=JDM345Q6SQWM type=del 2024-09-12T00:21:50.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.697+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=A3BKAO4R2CHJ type=write size=860899 2024-09-12T00:21:50.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.701+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=9J1I40OWRF6E type=del 2024-09-12T00:21:50.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.709+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~267J3P0UP343.0 size=476190 2024-09-12T00:21:50.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.709+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=267J3P0UP343 tag=U0BSN4Q4QOXV type=write size=1524766 2024-09-12T00:21:50.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.713+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~A91XH9R0PEDX.0 size=1048576 2024-09-12T00:21:50.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.717+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~A91XH9R0PEDX.1 size=1048576 2024-09-12T00:21:50.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.717+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~A91XH9R0PEDX.2 size=584981 2024-09-12T00:21:50.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.725+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=A91XH9R0PEDX tag=XPFATE82P1PB type=write size=3730709 2024-09-12T00:21:50.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.729+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=JOFRY0C9YH0F type=del size=3326307 2024-09-12T00:21:50.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.733+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~RC66WZWA59Y8.0 size=262149 2024-09-12T00:21:50.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.737+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=RC66WZWA59Y8 tag=VKES1VM5NCSN type=write size=1310725 2024-09-12T00:21:50.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.745+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~Q7BKGNTWD6HN.0 size=1048576 2024-09-12T00:21:50.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.749+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~Q7BKGNTWD6HN.1 size=1048576 2024-09-12T00:21:50.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.753+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~Q7BKGNTWD6HN.2 size=224428 2024-09-12T00:21:50.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.753+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=Q7BKGNTWD6HN tag=EDQF5HIRGAAP type=write size=3370156 2024-09-12T00:21:50.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.757+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~EP1ODDGEGJP0.0 size=1048576 2024-09-12T00:21:50.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.761+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~EP1ODDGEGJP0.1 size=1048576 2024-09-12T00:21:50.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.765+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~EP1ODDGEGJP0.2 size=614837 2024-09-12T00:21:50.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.773+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=EP1ODDGEGJP0 tag=Q5U5WZMWV5OF type=write size=3760565 2024-09-12T00:21:50.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.781+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~DJXG12URO6VH.0 size=944621 2024-09-12T00:21:50.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.781+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=DJXG12URO6VH tag=E0IVTMITJGC4 type=write size=1993197 2024-09-12T00:21:50.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.785+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=WSFPF904Z49R type=del 2024-09-12T00:21:50.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.789+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~24GMOE5656XK.0 size=349773 2024-09-12T00:21:50.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.789+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=24GMOE5656XK tag=OSRCL9PIGEXV type=write size=1398349 2024-09-12T00:21:50.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.793+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=OE3K90BJP3YG type=del 2024-09-12T00:21:50.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.801+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~Q5A88J9GSBH4.0 size=1048576 2024-09-12T00:21:50.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.805+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~Q5A88J9GSBH4.1 size=1048576 2024-09-12T00:21:50.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.805+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~Q5A88J9GSBH4.2 size=608732 2024-09-12T00:21:50.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.805+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=Q5A88J9GSBH4 tag=8EV4XGKJR78T type=write size=3754460 2024-09-12T00:21:50.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.813+0000 7fd6489978c0 1 < suggested update operation key=B2BW7GQ6UN9I tag=WS7BKO45AH99 type=del size=2521077 2024-09-12T00:21:50.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.817+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=ETGCE1CY9J1W type=del size=2278319 2024-09-12T00:21:50.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.821+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=4OMWSK4L74B4 type=del 2024-09-12T00:21:50.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.825+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=XKR3UECKJATZ type=del size=3748829 2024-09-12T00:21:50.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.829+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~QMT5W7BJT0N2.0 size=1048576 2024-09-12T00:21:50.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.833+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~QMT5W7BJT0N2.1 size=941381 2024-09-12T00:21:50.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.837+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=QMT5W7BJT0N2 tag=GY2VS6Q3RRZL type=write size=3038533 2024-09-12T00:21:50.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.845+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~YMF6SOOJRRUL.0 size=1048576 2024-09-12T00:21:50.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.849+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~YMF6SOOJRRUL.1 size=960807 2024-09-12T00:21:50.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.849+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=YMF6SOOJRRUL tag=QR02SWUVH42E type=write size=3057959 2024-09-12T00:21:50.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.849+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=3AY9FZ3PN3MW type=del 2024-09-12T00:21:50.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.857+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~D32T81LZNHQO.0 size=1048576 2024-09-12T00:21:50.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.861+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~D32T81LZNHQO.1 size=1048576 2024-09-12T00:21:50.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.861+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~D32T81LZNHQO.2 size=962944 2024-09-12T00:21:50.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.861+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=D32T81LZNHQO tag=J86UQP4BNWMU type=write size=4108672 2024-09-12T00:21:50.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.865+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~DYZJ9OUT02YG.0 size=1048576 2024-09-12T00:21:50.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.865+0000 7fd6489978c0 1 < canceled part key=_multipart_YJJBTNI318EH.2~DYZJ9OUT02YG.1 size=1024653 2024-09-12T00:21:50.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.873+0000 7fd6489978c0 1 < canceled multipart upload key=YJJBTNI318EH upload=DYZJ9OUT02YG tag=F22ZKDZU3VLU type=write size=3121805 2024-09-12T00:21:50.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.881+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~8P31LKKRL8I8.0 size=1048576 2024-09-12T00:21:50.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.881+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~8P31LKKRL8I8.1 size=1016913 2024-09-12T00:21:50.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.881+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=8P31LKKRL8I8 tag=QXM9Y99ULLFR type=write size=3114065 2024-09-12T00:21:50.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.885+0000 7fd6489978c0 1 < canceled operation key=J5IW4G9C72DH tag=1WWN1G4G6LIP type=del size=748319 2024-09-12T00:21:50.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.889+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=UWXEP2601W6H type=del size=2043012 2024-09-12T00:21:50.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.893+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~4FQTQ7UH1G44.0 size=1048576 2024-09-12T00:21:50.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.897+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~4FQTQ7UH1G44.1 size=31212 2024-09-12T00:21:50.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.901+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=4FQTQ7UH1G44 tag=YGIG7KODCZ8L type=write size=2128364 2024-09-12T00:21:50.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.909+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~A8YONYMLBVW9.0 size=649495 2024-09-12T00:21:50.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.909+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=A8YONYMLBVW9 tag=UQ2FAWU0MIAE type=write size=1698071 2024-09-12T00:21:50.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.913+0000 7fd6489978c0 1 < canceled operation key=N4S6I47NSJK6 tag=DYRM7JABRVVG type=del size=3031165 2024-09-12T00:21:50.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.917+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=SXZLM5JVMQ5D type=write size=759256 2024-09-12T00:21:50.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.921+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~E7FE2RQ7TCK3.0 size=1048576 2024-09-12T00:21:50.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.921+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~E7FE2RQ7TCK3.1 size=1048576 2024-09-12T00:21:50.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.925+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~E7FE2RQ7TCK3.2 size=1035590 2024-09-12T00:21:50.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.929+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=E7FE2RQ7TCK3 tag=9OC2VLYK1M57 type=write size=4181318 2024-09-12T00:21:50.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.933+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=14QVPWZKNGCW type=del size=3526167 2024-09-12T00:21:50.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.941+0000 7fd6489978c0 1 < suggested update operation key=B2BW7GQ6UN9I tag=A3BKAO4R2CHJ type=write size=860899 2024-09-12T00:21:50.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.945+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=VK7P8D73TJ54 type=del size=2315787 2024-09-12T00:21:50.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.949+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~267J3P0UP343.0 size=476190 2024-09-12T00:21:50.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.953+0000 7fd6489978c0 1 < completed multipart upload key=9ACGS2FIY7AF upload=267J3P0UP343 tag=U0BSN4Q4QOXV type=write size=1524766 2024-09-12T00:21:50.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.961+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~FR7JHUKS6DSY.0 size=1048576 2024-09-12T00:21:50.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.965+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~FR7JHUKS6DSY.1 size=245379 2024-09-12T00:21:50.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.965+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=FR7JHUKS6DSY tag=OITUU32FURR9 type=write size=2342531 2024-09-12T00:21:50.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.965+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=JOFRY0C9YH0F type=del 2024-09-12T00:21:50.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.969+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=07R9SQZW42TN type=del size=1293396 2024-09-12T00:21:50.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.973+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~Q7BKGNTWD6HN.0 size=1048576 2024-09-12T00:21:50.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.977+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~Q7BKGNTWD6HN.1 size=1048576 2024-09-12T00:21:50.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.977+0000 7fd6489978c0 1 < canceled part key=_multipart_CBXBFK3OXXKG.2~Q7BKGNTWD6HN.2 size=224428 2024-09-12T00:21:50.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.981+0000 7fd6489978c0 1 < canceled multipart upload key=CBXBFK3OXXKG upload=Q7BKGNTWD6HN tag=EDQF5HIRGAAP type=write size=3370156 2024-09-12T00:21:50.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.985+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=9VXXL1SWFEY1 type=del size=430007 2024-09-12T00:21:50.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.989+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~DJXG12URO6VH.0 size=944621 2024-09-12T00:21:50.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.993+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=DJXG12URO6VH tag=E0IVTMITJGC4 type=write size=1993197 2024-09-12T00:21:50.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:50.997+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=HA29790GYPX5 type=del size=3931603 2024-09-12T00:21:50.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.001+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~24GMOE5656XK.0 size=349773 2024-09-12T00:21:51.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.005+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=24GMOE5656XK tag=OSRCL9PIGEXV type=write size=1398349 2024-09-12T00:21:51.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.009+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=QF4M99FX6DZD type=del size=2320929 2024-09-12T00:21:51.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.009+0000 7fd6489978c0 1 < canceled part key=_multipart_8FBXDX6GELE7.2~Q5A88J9GSBH4.0 size=1048576 2024-09-12T00:21:51.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.013+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~Q5A88J9GSBH4.1 size=1048576 2024-09-12T00:21:51.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.017+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~Q5A88J9GSBH4.2 size=608732 2024-09-12T00:21:51.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.021+0000 7fd6489978c0 1 < canceled multipart upload key=8FBXDX6GELE7 upload=Q5A88J9GSBH4 tag=8EV4XGKJR78T type=write size=3754460 2024-09-12T00:21:51.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.025+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=2GO4OU5UL25E type=del size=3958504 2024-09-12T00:21:51.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.033+0000 7fd6489978c0 1 < suggested update operation key=Y3JFVW74FNT6 tag=ETGCE1CY9J1W type=del size=2278319 2024-09-12T00:21:51.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.037+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~5K2BDOIGK4Q0.0 size=1048576 2024-09-12T00:21:51.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.041+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~5K2BDOIGK4Q0.1 size=129895 2024-09-12T00:21:51.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.041+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=5K2BDOIGK4Q0 tag=ENY1ZWKU5F5K type=write size=2227047 2024-09-12T00:21:51.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.045+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=XKR3UECKJATZ type=del 2024-09-12T00:21:51.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.049+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=B7Q67UOE4F0Q type=write size=782292 2024-09-12T00:21:51.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.053+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~YMF6SOOJRRUL.0 size=1048576 2024-09-12T00:21:51.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.053+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~YMF6SOOJRRUL.1 size=960807 2024-09-12T00:21:51.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.061+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=YMF6SOOJRRUL tag=QR02SWUVH42E type=write size=3057959 2024-09-12T00:21:51.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.069+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~C05F211R4KVW.0 size=1048576 2024-09-12T00:21:51.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.069+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~C05F211R4KVW.1 size=1048576 2024-09-12T00:21:51.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.073+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~C05F211R4KVW.2 size=767834 2024-09-12T00:21:51.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.073+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=C05F211R4KVW tag=Z5XPMZR9SGML type=write size=3913562 2024-09-12T00:21:51.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.077+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~D32T81LZNHQO.0 size=1048576 2024-09-12T00:21:51.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.081+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~D32T81LZNHQO.1 size=1048576 2024-09-12T00:21:51.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.085+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~D32T81LZNHQO.2 size=962944 2024-09-12T00:21:51.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.089+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=D32T81LZNHQO tag=J86UQP4BNWMU type=write size=4108672 2024-09-12T00:21:51.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.093+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=OAN13BIRIVF4 type=del size=950263 2024-09-12T00:21:51.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.097+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~8P31LKKRL8I8.0 size=1048576 2024-09-12T00:21:51.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.101+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~8P31LKKRL8I8.1 size=1016913 2024-09-12T00:21:51.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.105+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=8P31LKKRL8I8 tag=QXM9Y99ULLFR type=write size=3114065 2024-09-12T00:21:51.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.109+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=PB9O3LF0ITMY type=write size=169873 2024-09-12T00:21:51.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.113+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=UWXEP2601W6H type=del 2024-09-12T00:21:51.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.117+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~AVMN9MD1SFHE.0 size=160272 2024-09-12T00:21:51.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.117+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=AVMN9MD1SFHE tag=X9FFJDTK8KV8 type=write size=1208848 2024-09-12T00:21:51.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.121+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~A8YONYMLBVW9.0 size=649495 2024-09-12T00:21:51.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.129+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=A8YONYMLBVW9 tag=UQ2FAWU0MIAE type=write size=1698071 2024-09-12T00:21:51.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.133+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=07NXXI5BW7O9 type=write size=1039678 2024-09-12T00:21:51.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.137+0000 7fd6489978c0 1 < completed write operation key=CBXBFK3OXXKG tag=SXZLM5JVMQ5D type=write size=759256 2024-09-12T00:21:51.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.141+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=6IAXFJXIULQC type=del size=1215136 2024-09-12T00:21:51.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.145+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=14QVPWZKNGCW type=del 2024-09-12T00:21:51.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.149+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=A0YF39RRK6TT type=del size=543532 2024-09-12T00:21:51.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.153+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=VK7P8D73TJ54 type=del 2024-09-12T00:21:51.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.153+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=H42SOFQLM5FA type=write size=866573 2024-09-12T00:21:51.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.157+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~FR7JHUKS6DSY.0 size=1048576 2024-09-12T00:21:51.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.161+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~FR7JHUKS6DSY.1 size=245379 2024-09-12T00:21:51.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.169+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=FR7JHUKS6DSY tag=OITUU32FURR9 type=write size=2342531 2024-09-12T00:21:51.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.173+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~L4648TOEFQH6.0 size=1048576 2024-09-12T00:21:51.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.177+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~L4648TOEFQH6.1 size=1048576 2024-09-12T00:21:51.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.181+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~L4648TOEFQH6.2 size=435103 2024-09-12T00:21:51.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.181+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=L4648TOEFQH6 tag=A2L5OKYAXFZD type=write size=3580831 2024-09-12T00:21:51.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.185+0000 7fd6489978c0 1 < completed delete operation key=3JZP8TZFEIMH tag=07R9SQZW42TN type=del 2024-09-12T00:21:51.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.189+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=0JFEX2GNIHFA type=write size=14829 2024-09-12T00:21:51.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.193+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=9VXXL1SWFEY1 type=del 2024-09-12T00:21:51.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.197+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~QBXLCWZJBN15.0 size=1048576 2024-09-12T00:21:51.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.201+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~QBXLCWZJBN15.1 size=1048576 2024-09-12T00:21:51.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.205+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~QBXLCWZJBN15.2 size=356226 2024-09-12T00:21:51.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.205+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=QBXLCWZJBN15 tag=JSC7F8YN1924 type=write size=3501954 2024-09-12T00:21:51.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.209+0000 7fd6489978c0 1 < suggested remove operation key=YSPRZ87DZ2OD tag=HA29790GYPX5 type=del 2024-09-12T00:21:51.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.213+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=ALGIN9RNJGLA type=del size=298103 2024-09-12T00:21:51.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.221+0000 7fd6489978c0 1 < suggested update operation key=Y3JFVW74FNT6 tag=QF4M99FX6DZD type=del size=2320929 2024-09-12T00:21:51.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.225+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=BMNC15GKTJT1 type=write size=330996 2024-09-12T00:21:51.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.229+0000 7fd6489978c0 -1 < failed to complete operation key=YSPRZ87DZ2OD tag=2GO4OU5UL25E type=del size=3958504: (22) Invalid argument 2024-09-12T00:21:51.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.229+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=1A9T5EYRT0IN type=del size=3129600 2024-09-12T00:21:51.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.233+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~5K2BDOIGK4Q0.0 size=1048576 2024-09-12T00:21:51.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.233+0000 7fd6489978c0 1 < canceled part key=_multipart_CBXBFK3OXXKG.2~5K2BDOIGK4Q0.1 size=129895 2024-09-12T00:21:51.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.241+0000 7fd6489978c0 1 < canceled multipart upload key=CBXBFK3OXXKG upload=5K2BDOIGK4Q0 tag=ENY1ZWKU5F5K type=write size=2227047 2024-09-12T00:21:51.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.245+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~TZK7TMTQZHYF.0 size=585950 2024-09-12T00:21:51.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.245+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=TZK7TMTQZHYF tag=MMQSQG7IE72S type=write size=1634526 2024-09-12T00:21:51.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.249+0000 7fd6489978c0 1 < completed write operation key=ZW51KHCLPYN3 tag=B7Q67UOE4F0Q type=write size=782292 2024-09-12T00:21:51.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.257+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~TMQG1D3Y1480.0 size=880359 2024-09-12T00:21:51.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.257+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=TMQG1D3Y1480 tag=A1ER6M2IFMZP type=write size=1928935 2024-09-12T00:21:51.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.261+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~C05F211R4KVW.0 size=1048576 2024-09-12T00:21:51.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.261+0000 7fd6489978c0 1 < canceled part key=_multipart_RGE8T6BTHBWK.2~C05F211R4KVW.1 size=1048576 2024-09-12T00:21:51.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.261+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~C05F211R4KVW.2 size=767834 2024-09-12T00:21:51.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.269+0000 7fd6489978c0 1 < canceled multipart upload key=RGE8T6BTHBWK upload=C05F211R4KVW tag=Z5XPMZR9SGML type=write size=3913562 2024-09-12T00:21:51.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.273+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=CCEW05Z7D1Z6 type=write size=14105 2024-09-12T00:21:51.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.277+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=OAN13BIRIVF4 type=del 2024-09-12T00:21:51.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.281+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=XYFKBC68N6GQ type=write size=909960 2024-09-12T00:21:51.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.289+0000 7fd6489978c0 1 < suggested update operation key=ZW51KHCLPYN3 tag=PB9O3LF0ITMY type=write size=169873 2024-09-12T00:21:51.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.297+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~5B9J5EFXPXGC.0 size=1048576 2024-09-12T00:21:51.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.301+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~5B9J5EFXPXGC.1 size=1048576 2024-09-12T00:21:51.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.301+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~5B9J5EFXPXGC.2 size=131903 2024-09-12T00:21:51.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.301+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=5B9J5EFXPXGC tag=ALUZT7HPOZ3J type=write size=3277631 2024-09-12T00:21:51.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.305+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~AVMN9MD1SFHE.0 size=160272 2024-09-12T00:21:51.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.313+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=AVMN9MD1SFHE tag=X9FFJDTK8KV8 type=write size=1208848 2024-09-12T00:21:51.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.317+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=TUFS1URB9UHB type=del size=3822342 2024-09-12T00:21:51.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.321+0000 7fd6489978c0 -1 < failed to complete operation key=ZW51KHCLPYN3 tag=07NXXI5BW7O9 type=write size=1039678: (22) Invalid argument 2024-09-12T00:21:51.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.329+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~S5KVWNLALOV3.0 size=1048576 2024-09-12T00:21:51.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.333+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~S5KVWNLALOV3.1 size=878426 2024-09-12T00:21:51.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.333+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=S5KVWNLALOV3 tag=P2RY31ZBQ85J type=write size=2975578 2024-09-12T00:21:51.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.341+0000 7fd6489978c0 1 < suggested update operation key=25P4P2I6BE3H tag=6IAXFJXIULQC type=del size=1215136 2024-09-12T00:21:51.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.353+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=ZAFENGR69ARY type=del size=3974953 2024-09-12T00:21:51.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.361+0000 7fd6489978c0 1 < completed delete operation key=LZICTA4BWOW8 tag=A0YF39RRK6TT type=del 2024-09-12T00:21:51.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.365+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=C604P2IFRS5G type=del size=3109684 2024-09-12T00:21:51.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.369+0000 7fd6489978c0 1 < completed write operation key=B2BW7GQ6UN9I tag=H42SOFQLM5FA type=write size=866573 2024-09-12T00:21:51.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.373+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~VLQ3U7RVNB6H.0 size=209716 2024-09-12T00:21:51.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.373+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=VLQ3U7RVNB6H tag=TE4DDNRHH6WE type=write size=1258292 2024-09-12T00:21:51.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.377+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~L4648TOEFQH6.0 size=1048576 2024-09-12T00:21:51.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.381+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~L4648TOEFQH6.1 size=1048576 2024-09-12T00:21:51.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.385+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~L4648TOEFQH6.2 size=435103 2024-09-12T00:21:51.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.389+0000 7fd6489978c0 1 < completed multipart upload key=N0AAVPQ6MUQ1 upload=L4648TOEFQH6 tag=A2L5OKYAXFZD type=write size=3580831 2024-09-12T00:21:51.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.397+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~UKTBHA6V4KWS.0 size=1048576 2024-09-12T00:21:51.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.397+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~UKTBHA6V4KWS.1 size=384255 2024-09-12T00:21:51.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.397+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=UKTBHA6V4KWS tag=YONP991PFP09 type=write size=2481407 2024-09-12T00:21:51.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.401+0000 7fd6489978c0 1 < completed write operation key=F2CTWM0T2698 tag=0JFEX2GNIHFA type=write size=14829 2024-09-12T00:21:51.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.405+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=TKGLOVHI22UM type=del size=2319094 2024-09-12T00:21:51.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.409+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~QBXLCWZJBN15.0 size=1048576 2024-09-12T00:21:51.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.413+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~QBXLCWZJBN15.1 size=1048576 2024-09-12T00:21:51.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.413+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~QBXLCWZJBN15.2 size=356226 2024-09-12T00:21:51.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.421+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=QBXLCWZJBN15 tag=JSC7F8YN1924 type=write size=3501954 2024-09-12T00:21:51.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.425+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=93PRE5CNE0SB type=del size=1703985 2024-09-12T00:21:51.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.425+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=ALGIN9RNJGLA type=del 2024-09-12T00:21:51.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.433+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=KKG88U6TGHJA type=write size=349745 2024-09-12T00:21:51.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.437+0000 7fd6489978c0 1 < completed write operation key=CFID1EVBXOVJ tag=BMNC15GKTJT1 type=write size=330996 2024-09-12T00:21:51.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.441+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~LFTJM4X3DFHT.0 size=1048576 2024-09-12T00:21:51.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.445+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~LFTJM4X3DFHT.1 size=97680 2024-09-12T00:21:51.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.445+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=LFTJM4X3DFHT tag=T53W1ZB21BNE type=write size=2194832 2024-09-12T00:21:51.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.449+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=1A9T5EYRT0IN type=del 2024-09-12T00:21:51.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.453+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=ULAWHB2TERI2 type=del size=4174793 2024-09-12T00:21:51.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.453+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~TZK7TMTQZHYF.0 size=585950 2024-09-12T00:21:51.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.461+0000 7fd6489978c0 1 < completed multipart upload key=G4EUTQOHAT2E upload=TZK7TMTQZHYF tag=MMQSQG7IE72S type=write size=1634526 2024-09-12T00:21:51.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.465+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=UINQM9PHF3FN type=del size=1784069 2024-09-12T00:21:51.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.465+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~TMQG1D3Y1480.0 size=880359 2024-09-12T00:21:51.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.473+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=TMQG1D3Y1480 tag=A1ER6M2IFMZP type=write size=1928935 2024-09-12T00:21:51.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.477+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=WBKGKW3P0LD4 type=del size=3205361 2024-09-12T00:21:51.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.485+0000 7fd6489978c0 1 < suggested update operation key=JPVKBVRCZTE9 tag=CCEW05Z7D1Z6 type=write size=14105 2024-09-12T00:21:51.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.489+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=D2A2B2MTJ1H2 type=del size=3781215 2024-09-12T00:21:51.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.497+0000 7fd6489978c0 1 < suggested update operation key=RGE8T6BTHBWK tag=XYFKBC68N6GQ type=write size=909960 2024-09-12T00:21:51.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.501+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=52D2LM9L19HO type=write size=135364 2024-09-12T00:21:51.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.505+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~5B9J5EFXPXGC.0 size=1048576 2024-09-12T00:21:51.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.509+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~5B9J5EFXPXGC.1 size=1048576 2024-09-12T00:21:51.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.513+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~5B9J5EFXPXGC.2 size=131903 2024-09-12T00:21:51.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.517+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=5B9J5EFXPXGC tag=ALUZT7HPOZ3J type=write size=3277631 2024-09-12T00:21:51.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.521+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=UYOSB6KY6SHW type=del size=864557 2024-09-12T00:21:51.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.525+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=TUFS1URB9UHB type=del 2024-09-12T00:21:51.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.533+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~TF50PJUVVH1N.0 size=1048576 2024-09-12T00:21:51.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.533+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~TF50PJUVVH1N.1 size=696144 2024-09-12T00:21:51.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.533+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=TF50PJUVVH1N tag=P2NDFJJP4O21 type=write size=2793296 2024-09-12T00:21:51.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.537+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~S5KVWNLALOV3.0 size=1048576 2024-09-12T00:21:51.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.541+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~S5KVWNLALOV3.1 size=878426 2024-09-12T00:21:51.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.545+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=S5KVWNLALOV3 tag=P2RY31ZBQ85J type=write size=2975578 2024-09-12T00:21:51.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.549+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=XUSO7PINJBGN type=del size=3431246 2024-09-12T00:21:51.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.553+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=ZAFENGR69ARY type=del 2024-09-12T00:21:51.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.561+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~ZN6JMGLKYBKC.0 size=1048576 2024-09-12T00:21:51.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.569+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~ZN6JMGLKYBKC.1 size=1048576 2024-09-12T00:21:51.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.573+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~ZN6JMGLKYBKC.2 size=906877 2024-09-12T00:21:51.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.573+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=ZN6JMGLKYBKC tag=PWJHVTP96XWQ type=write size=4052605 2024-09-12T00:21:51.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.577+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=C604P2IFRS5G type=del 2024-09-12T00:21:51.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.585+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~FQWQLZIQLHXC.0 size=1048576 2024-09-12T00:21:51.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.585+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~FQWQLZIQLHXC.1 size=738544 2024-09-12T00:21:51.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.585+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=FQWQLZIQLHXC tag=8VJL9ORPJT2P type=write size=2835696 2024-09-12T00:21:51.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.589+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~VLQ3U7RVNB6H.0 size=209716 2024-09-12T00:21:51.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.597+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=VLQ3U7RVNB6H tag=TE4DDNRHH6WE type=write size=1258292 2024-09-12T00:21:51.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.601+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=QUXMEGT9BYM5 type=del size=654276 2024-09-12T00:21:51.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.605+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~UKTBHA6V4KWS.0 size=1048576 2024-09-12T00:21:51.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.605+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~UKTBHA6V4KWS.1 size=384255 2024-09-12T00:21:51.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.613+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=UKTBHA6V4KWS tag=YONP991PFP09 type=write size=2481407 2024-09-12T00:21:51.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.617+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=1FFWA6ZEDAFH type=del size=1274264 2024-09-12T00:21:51.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.621+0000 7fd6489978c0 1 < suggested update operation key=M9YKGQ2GA5CO tag=TKGLOVHI22UM type=del size=2319094 2024-09-12T00:21:51.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.625+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=ZUZOX2I6MXH4 type=write size=942523 2024-09-12T00:21:51.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.629+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=93PRE5CNE0SB type=del 2024-09-12T00:21:51.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.637+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~MDS03O1RDSP6.0 size=1048576 2024-09-12T00:21:51.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.637+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~MDS03O1RDSP6.1 size=1048576 2024-09-12T00:21:51.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.641+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~MDS03O1RDSP6.2 size=726627 2024-09-12T00:21:51.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.641+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=MDS03O1RDSP6 tag=KJDMDL3ANLL3 type=write size=3872355 2024-09-12T00:21:51.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.645+0000 7fd6489978c0 -1 < failed to complete operation key=JPVKBVRCZTE9 tag=KKG88U6TGHJA type=write size=349745: (22) Invalid argument 2024-09-12T00:21:51.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.649+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~ZT58B3SC2L9R.0 size=884354 2024-09-12T00:21:51.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.649+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=ZT58B3SC2L9R tag=2O396OHVPFG6 type=write size=1932930 2024-09-12T00:21:51.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.653+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~LFTJM4X3DFHT.0 size=1048576 2024-09-12T00:21:51.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.653+0000 7fd6489978c0 1 < canceled part key=_multipart_KAT2TB3FGAYG.2~LFTJM4X3DFHT.1 size=97680 2024-09-12T00:21:51.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.661+0000 7fd6489978c0 1 < canceled multipart upload key=KAT2TB3FGAYG upload=LFTJM4X3DFHT tag=T53W1ZB21BNE type=write size=2194832 2024-09-12T00:21:51.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.661+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=J5SQT1BNCFXV type=del size=1639938 2024-09-12T00:21:51.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.665+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=ULAWHB2TERI2 type=del 2024-09-12T00:21:51.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.669+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=I8S5Y3XM4TJ8 type=del size=2782633 2024-09-12T00:21:51.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.673+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=UINQM9PHF3FN type=del 2024-09-12T00:21:51.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.677+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~8RFGS9K2077Y.0 size=755795 2024-09-12T00:21:51.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.677+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=8RFGS9K2077Y tag=7AV5ZAFDHF1D type=write size=1804371 2024-09-12T00:21:51.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.685+0000 7fd6489978c0 1 < suggested update operation key=8JCL0F406L7I tag=WBKGKW3P0LD4 type=del size=3205361 2024-09-12T00:21:51.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.689+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=VSOU7CTTPLMI type=del size=2581960 2024-09-12T00:21:51.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.693+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=D2A2B2MTJ1H2 type=del 2024-09-12T00:21:51.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.697+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=CBGXIUMPP6D4 type=del size=2155397 2024-09-12T00:21:51.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.701+0000 7fd6489978c0 1 < canceled operation key=KAT2TB3FGAYG tag=52D2LM9L19HO type=write size=135364 2024-09-12T00:21:51.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.709+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~K4T890M1QA9C.0 size=707686 2024-09-12T00:21:51.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.709+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=K4T890M1QA9C tag=DXBL1LBPBABN type=write size=1756262 2024-09-12T00:21:51.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.713+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=UYOSB6KY6SHW type=del 2024-09-12T00:21:51.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.721+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~RO6VKT4Q1XFK.0 size=1048576 2024-09-12T00:21:51.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.725+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~RO6VKT4Q1XFK.1 size=1048576 2024-09-12T00:21:51.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.729+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~RO6VKT4Q1XFK.2 size=452531 2024-09-12T00:21:51.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.729+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=RO6VKT4Q1XFK tag=JXDLVFQ1EKHW type=write size=3598259 2024-09-12T00:21:51.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.733+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~TF50PJUVVH1N.0 size=1048576 2024-09-12T00:21:51.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.733+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~TF50PJUVVH1N.1 size=696144 2024-09-12T00:21:51.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.741+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=TF50PJUVVH1N tag=P2NDFJJP4O21 type=write size=2793296 2024-09-12T00:21:51.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.745+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~92NQOWENL16T.0 size=1048576 2024-09-12T00:21:51.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.749+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~92NQOWENL16T.1 size=239768 2024-09-12T00:21:51.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.749+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=92NQOWENL16T tag=LP8QILLCHZYR type=write size=2336920 2024-09-12T00:21:51.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.753+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=XUSO7PINJBGN type=del 2024-09-12T00:21:51.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.757+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=VI66RV5HTX76 type=del size=2665695 2024-09-12T00:21:51.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.761+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~ZN6JMGLKYBKC.0 size=1048576 2024-09-12T00:21:51.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.765+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~ZN6JMGLKYBKC.1 size=1048576 2024-09-12T00:21:51.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.765+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~ZN6JMGLKYBKC.2 size=906877 2024-09-12T00:21:51.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.777+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=ZN6JMGLKYBKC tag=PWJHVTP96XWQ type=write size=4052605 2024-09-12T00:21:51.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.781+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~B9AJO5N5WO7W.0 size=1048576 2024-09-12T00:21:51.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.785+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~B9AJO5N5WO7W.1 size=1048576 2024-09-12T00:21:51.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.789+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~B9AJO5N5WO7W.2 size=72644 2024-09-12T00:21:51.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.789+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=B9AJO5N5WO7W tag=W3XZP5GC6711 type=write size=3218372 2024-09-12T00:21:51.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.793+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~FQWQLZIQLHXC.0 size=1048576 2024-09-12T00:21:51.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.793+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~FQWQLZIQLHXC.1 size=738544 2024-09-12T00:21:51.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.801+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=FQWQLZIQLHXC tag=8VJL9ORPJT2P type=write size=2835696 2024-09-12T00:21:51.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.809+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~10KO48EIVGPF.0 size=1048576 2024-09-12T00:21:51.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.813+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~10KO48EIVGPF.1 size=1048576 2024-09-12T00:21:51.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.813+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~10KO48EIVGPF.2 size=187079 2024-09-12T00:21:51.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.813+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=10KO48EIVGPF tag=RK8GK2KVIPED type=write size=3332807 2024-09-12T00:21:51.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.817+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=QUXMEGT9BYM5 type=del 2024-09-12T00:21:51.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.821+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=SJJXV2RSL1MG type=del size=1149849 2024-09-12T00:21:51.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.825+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=1FFWA6ZEDAFH type=del 2024-09-12T00:21:51.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.833+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~F2QQMLFXPU0P.0 size=1048576 2024-09-12T00:21:51.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.837+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~F2QQMLFXPU0P.1 size=1048576 2024-09-12T00:21:51.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.841+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~F2QQMLFXPU0P.2 size=550884 2024-09-12T00:21:51.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.841+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=F2QQMLFXPU0P tag=LZEK6F6B8E3S type=write size=3696612 2024-09-12T00:21:51.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.845+0000 7fd6489978c0 1 < completed write operation key=9CK160BK5YYY tag=ZUZOX2I6MXH4 type=write size=942523 2024-09-12T00:21:51.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.849+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=6N4SAD3U8PUD type=write size=828574 2024-09-12T00:21:51.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.849+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~MDS03O1RDSP6.0 size=1048576 2024-09-12T00:21:51.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.853+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~MDS03O1RDSP6.1 size=1048576 2024-09-12T00:21:51.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.857+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~MDS03O1RDSP6.2 size=726627 2024-09-12T00:21:51.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.865+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=MDS03O1RDSP6 tag=KJDMDL3ANLL3 type=write size=3872355 2024-09-12T00:21:51.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.869+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~8TN2IMDLEQTQ.0 size=1048576 2024-09-12T00:21:51.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.873+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~8TN2IMDLEQTQ.1 size=1048576 2024-09-12T00:21:51.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.877+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~8TN2IMDLEQTQ.2 size=122326 2024-09-12T00:21:51.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.877+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=8TN2IMDLEQTQ tag=MPHVICNUCPTT type=write size=3268054 2024-09-12T00:21:51.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.881+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~ZT58B3SC2L9R.0 size=884354 2024-09-12T00:21:51.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.885+0000 7fd6489978c0 1 < completed multipart upload key=CFID1EVBXOVJ upload=ZT58B3SC2L9R tag=2O396OHVPFG6 type=write size=1932930 2024-09-12T00:21:51.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.893+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~SA2XMVVFDV1H.0 size=55614 2024-09-12T00:21:51.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.893+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=SA2XMVVFDV1H tag=UCSJ3ZOXNQDJ type=write size=1104190 2024-09-12T00:21:51.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.897+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=J5SQT1BNCFXV type=del 2024-09-12T00:21:51.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.901+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=KZHRAHS7IPDX type=del size=2477320 2024-09-12T00:21:51.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.905+0000 7fd6489978c0 -1 < failed to complete operation key=8JCL0F406L7I tag=I8S5Y3XM4TJ8 type=del size=2782633: (22) Invalid argument 2024-09-12T00:21:51.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.909+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~C8P1TC288S3U.0 size=123333 2024-09-12T00:21:51.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.909+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=C8P1TC288S3U tag=GH6QNP22XOT2 type=write size=1171909 2024-09-12T00:21:51.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.913+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~8RFGS9K2077Y.0 size=755795 2024-09-12T00:21:51.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.921+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=8RFGS9K2077Y tag=7AV5ZAFDHF1D type=write size=1804371 2024-09-12T00:21:51.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.929+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~K6ORUEZTPU7H.0 size=45070 2024-09-12T00:21:51.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.929+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=K6ORUEZTPU7H tag=CEHAM9I83QTP type=write size=1093646 2024-09-12T00:21:51.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.933+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=VSOU7CTTPLMI type=del 2024-09-12T00:21:51.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.933+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=OBZ6FPI5XXXV type=del size=1024474 2024-09-12T00:21:51.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.941+0000 7fd6489978c0 1 < suggested update operation key=RGE8T6BTHBWK tag=CBGXIUMPP6D4 type=del size=2155397 2024-09-12T00:21:51.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.945+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=HRIEWCKD4MZI type=del size=4041902 2024-09-12T00:21:51.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.949+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~K4T890M1QA9C.0 size=707686 2024-09-12T00:21:51.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.957+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=K4T890M1QA9C tag=DXBL1LBPBABN type=write size=1756262 2024-09-12T00:21:51.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.961+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~PVKE1AX5I3HT.0 size=1048576 2024-09-12T00:21:51.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.965+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~PVKE1AX5I3HT.1 size=1048576 2024-09-12T00:21:51.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.969+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~PVKE1AX5I3HT.2 size=598087 2024-09-12T00:21:51.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.969+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=PVKE1AX5I3HT tag=FOXJ98MJ8IB6 type=write size=3743815 2024-09-12T00:21:51.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.973+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~RO6VKT4Q1XFK.0 size=1048576 2024-09-12T00:21:51.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.977+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~RO6VKT4Q1XFK.1 size=1048576 2024-09-12T00:21:51.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.977+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~RO6VKT4Q1XFK.2 size=452531 2024-09-12T00:21:51.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.985+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=RO6VKT4Q1XFK tag=JXDLVFQ1EKHW type=write size=3598259 2024-09-12T00:21:51.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.989+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=C7WIC14N8NOO type=write size=410199 2024-09-12T00:21:51.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.993+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~92NQOWENL16T.0 size=1048576 2024-09-12T00:21:51.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:51.997+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~92NQOWENL16T.1 size=239768 2024-09-12T00:21:52.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.001+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=92NQOWENL16T tag=LP8QILLCHZYR type=write size=2336920 2024-09-12T00:21:52.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.005+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=4WUGPWWZHNGG type=del size=2838919 2024-09-12T00:21:52.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.009+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=VI66RV5HTX76 type=del 2024-09-12T00:21:52.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.013+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=I6037JMNB5S6 type=del size=3057833 2024-09-12T00:21:52.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.017+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~B9AJO5N5WO7W.0 size=1048576 2024-09-12T00:21:52.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.021+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~B9AJO5N5WO7W.1 size=1048576 2024-09-12T00:21:52.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.021+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~B9AJO5N5WO7W.2 size=72644 2024-09-12T00:21:52.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.029+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=B9AJO5N5WO7W tag=W3XZP5GC6711 type=write size=3218372 2024-09-12T00:21:52.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.037+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~IN73JAG5ZMN3.0 size=1048576 2024-09-12T00:21:52.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.037+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~IN73JAG5ZMN3.1 size=642050 2024-09-12T00:21:52.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.037+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=IN73JAG5ZMN3 tag=2AFCR6FACIZ9 type=write size=2739202 2024-09-12T00:21:52.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.041+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~10KO48EIVGPF.0 size=1048576 2024-09-12T00:21:52.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.045+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~10KO48EIVGPF.1 size=1048576 2024-09-12T00:21:52.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.049+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~10KO48EIVGPF.2 size=187079 2024-09-12T00:21:52.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.053+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=10KO48EIVGPF tag=RK8GK2KVIPED type=write size=3332807 2024-09-12T00:21:52.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.061+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~N6WEJS2SL11W.0 size=102752 2024-09-12T00:21:52.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.061+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=N6WEJS2SL11W tag=CQ6JTZ444Y0S type=write size=1151328 2024-09-12T00:21:52.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.065+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=SJJXV2RSL1MG type=del 2024-09-12T00:21:52.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.069+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=CVC5NKOOBRL8 type=del size=3931208 2024-09-12T00:21:52.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.073+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~F2QQMLFXPU0P.0 size=1048576 2024-09-12T00:21:52.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.077+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~F2QQMLFXPU0P.1 size=1048576 2024-09-12T00:21:52.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.077+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~F2QQMLFXPU0P.2 size=550884 2024-09-12T00:21:52.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.085+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=F2QQMLFXPU0P tag=LZEK6F6B8E3S type=write size=3696612 2024-09-12T00:21:52.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.093+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~YK030D4319ES.0 size=1048576 2024-09-12T00:21:52.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.093+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~YK030D4319ES.1 size=806751 2024-09-12T00:21:52.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.093+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=YK030D4319ES tag=3HEHTPQ6O84Y type=write size=2903903 2024-09-12T00:21:52.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.097+0000 7fd6489978c0 -1 < failed to complete operation key=RGE8T6BTHBWK tag=6N4SAD3U8PUD type=write size=828574: (22) Invalid argument 2024-09-12T00:21:52.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.105+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=N77XQJAGZX3K type=del size=1344805 2024-09-12T00:21:52.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.105+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~8TN2IMDLEQTQ.0 size=1048576 2024-09-12T00:21:52.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.109+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~8TN2IMDLEQTQ.1 size=1048576 2024-09-12T00:21:52.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.117+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~8TN2IMDLEQTQ.2 size=122326 2024-09-12T00:21:52.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.121+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=8TN2IMDLEQTQ tag=MPHVICNUCPTT type=write size=3268054 2024-09-12T00:21:52.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.129+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~2JLAWYFEST35.0 size=1048576 2024-09-12T00:21:52.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.129+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~2JLAWYFEST35.1 size=811918 2024-09-12T00:21:52.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.129+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=2JLAWYFEST35 tag=2JT0S53C387W type=write size=2909070 2024-09-12T00:21:52.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.133+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~SA2XMVVFDV1H.0 size=55614 2024-09-12T00:21:52.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.141+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=SA2XMVVFDV1H tag=UCSJ3ZOXNQDJ type=write size=1104190 2024-09-12T00:21:52.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.149+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~50DIOFUD9T5Y.0 size=1048576 2024-09-12T00:21:52.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.149+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~50DIOFUD9T5Y.1 size=465500 2024-09-12T00:21:52.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.149+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=50DIOFUD9T5Y tag=EHL42M164SE7 type=write size=2562652 2024-09-12T00:21:52.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.153+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=KZHRAHS7IPDX type=del 2024-09-12T00:21:52.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.161+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~H0COTJSPHM5B.0 size=569476 2024-09-12T00:21:52.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.161+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=H0COTJSPHM5B tag=VUFZ6956ETIX type=write size=1618052 2024-09-12T00:21:52.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.161+0000 7fd6489978c0 1 < canceled part key=_multipart_Y3JFVW74FNT6.2~C8P1TC288S3U.0 size=123333 2024-09-12T00:21:52.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.169+0000 7fd6489978c0 1 < canceled multipart upload key=Y3JFVW74FNT6 upload=C8P1TC288S3U tag=GH6QNP22XOT2 type=write size=1171909 2024-09-12T00:21:52.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.173+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~2G1Z3HVYW4Q7.0 size=1048576 2024-09-12T00:21:52.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.177+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~2G1Z3HVYW4Q7.1 size=440242 2024-09-12T00:21:52.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.177+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=2G1Z3HVYW4Q7 tag=NP5ZE34Q1KUL type=write size=2537394 2024-09-12T00:21:52.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.181+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~K6ORUEZTPU7H.0 size=45070 2024-09-12T00:21:52.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.189+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=K6ORUEZTPU7H tag=CEHAM9I83QTP type=write size=1093646 2024-09-12T00:21:52.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.193+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=O5I8AXLH3WRV type=del size=745676 2024-09-12T00:21:52.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.197+0000 7fd6489978c0 1 < suggested update operation key=KAT2TB3FGAYG tag=OBZ6FPI5XXXV type=del size=1024474 2024-09-12T00:21:52.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.205+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=2IQN3LVJT2BZ type=del size=717254 2024-09-12T00:21:52.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.205+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=HRIEWCKD4MZI type=del 2024-09-12T00:21:52.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.209+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=QHMBDKBVOSH8 type=del size=3264237 2024-09-12T00:21:52.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.213+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~PVKE1AX5I3HT.0 size=1048576 2024-09-12T00:21:52.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.217+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~PVKE1AX5I3HT.1 size=1048576 2024-09-12T00:21:52.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.221+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~PVKE1AX5I3HT.2 size=598087 2024-09-12T00:21:52.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.229+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=PVKE1AX5I3HT tag=FOXJ98MJ8IB6 type=write size=3743815 2024-09-12T00:21:52.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.229+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=L88E24YQNWK7 type=del size=13270 2024-09-12T00:21:52.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.233+0000 7fd6489978c0 1 < canceled operation key=B2BW7GQ6UN9I tag=C7WIC14N8NOO type=write size=410199 2024-09-12T00:21:52.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.237+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=9FI97MFRWBE8 type=del size=2284645 2024-09-12T00:21:52.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.241+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=4WUGPWWZHNGG type=del 2024-09-12T00:21:52.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.245+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=XUQHZ0WT4W5Q type=write size=281860 2024-09-12T00:21:52.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.253+0000 7fd6489978c0 1 < suggested remove operation key=G4EUTQOHAT2E tag=I6037JMNB5S6 type=del 2024-09-12T00:21:52.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.257+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=JPYPZ2N0V337 type=del size=1068438 2024-09-12T00:21:52.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.261+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~IN73JAG5ZMN3.0 size=1048576 2024-09-12T00:21:52.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.265+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~IN73JAG5ZMN3.1 size=642050 2024-09-12T00:21:52.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.269+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=IN73JAG5ZMN3 tag=2AFCR6FACIZ9 type=write size=2739202 2024-09-12T00:21:52.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.277+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~5CYH3ET07QH1.0 size=832854 2024-09-12T00:21:52.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.277+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=5CYH3ET07QH1 tag=YU7ZSL2A1NTU type=write size=1881430 2024-09-12T00:21:52.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.281+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~N6WEJS2SL11W.0 size=102752 2024-09-12T00:21:52.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.285+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=N6WEJS2SL11W tag=CQ6JTZ444Y0S type=write size=1151328 2024-09-12T00:21:52.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.293+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~1KZM75Y2LGG8.0 size=386705 2024-09-12T00:21:52.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.293+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=1KZM75Y2LGG8 tag=R2M9S15LMCWM type=write size=1435281 2024-09-12T00:21:52.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.297+0000 7fd6489978c0 1 < canceled operation key=RGE8T6BTHBWK tag=CVC5NKOOBRL8 type=del size=3931208 2024-09-12T00:21:52.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.305+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~O7QMKG67SNUY.0 size=1048576 2024-09-12T00:21:52.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.309+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~O7QMKG67SNUY.1 size=441778 2024-09-12T00:21:52.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.309+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=O7QMKG67SNUY tag=NKPRJLJ0S5D0 type=write size=2538930 2024-09-12T00:21:52.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.313+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~YK030D4319ES.0 size=1048576 2024-09-12T00:21:52.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.313+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~YK030D4319ES.1 size=806751 2024-09-12T00:21:52.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.321+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=YK030D4319ES tag=3HEHTPQ6O84Y type=write size=2903903 2024-09-12T00:21:52.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.325+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=477PS2FDAAC1 type=del size=3800041 2024-09-12T00:21:52.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.329+0000 7fd6489978c0 1 < completed delete operation key=J5IW4G9C72DH tag=N77XQJAGZX3K type=del 2024-09-12T00:21:52.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.333+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=ELOX0WWWTH8J type=del size=1016550 2024-09-12T00:21:52.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.337+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~2JLAWYFEST35.0 size=1048576 2024-09-12T00:21:52.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.341+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~2JLAWYFEST35.1 size=811918 2024-09-12T00:21:52.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.345+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=2JLAWYFEST35 tag=2JT0S53C387W type=write size=2909070 2024-09-12T00:21:52.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.353+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~SLR4X03MQ9YX.0 size=1048576 2024-09-12T00:21:52.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.353+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~SLR4X03MQ9YX.1 size=1048576 2024-09-12T00:21:52.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.357+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~SLR4X03MQ9YX.2 size=617041 2024-09-12T00:21:52.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.357+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=SLR4X03MQ9YX tag=J36GJ3G2W920 type=write size=3762769 2024-09-12T00:21:52.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.361+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~50DIOFUD9T5Y.0 size=1048576 2024-09-12T00:21:52.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.361+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~50DIOFUD9T5Y.1 size=465500 2024-09-12T00:21:52.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.369+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=50DIOFUD9T5Y tag=EHL42M164SE7 type=write size=2562652 2024-09-12T00:21:52.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.373+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=TRS1B7VQFLF0 type=del size=2203688 2024-09-12T00:21:52.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.373+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~H0COTJSPHM5B.0 size=569476 2024-09-12T00:21:52.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.381+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=H0COTJSPHM5B tag=VUFZ6956ETIX type=write size=1618052 2024-09-12T00:21:52.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.385+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~4BKVG1QXFX9C.0 size=1048576 2024-09-12T00:21:52.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.389+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~4BKVG1QXFX9C.1 size=873073 2024-09-12T00:21:52.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.389+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=4BKVG1QXFX9C tag=SS3953P2Q623 type=write size=2970225 2024-09-12T00:21:52.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.393+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~2G1Z3HVYW4Q7.0 size=1048576 2024-09-12T00:21:52.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.397+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~2G1Z3HVYW4Q7.1 size=440242 2024-09-12T00:21:52.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.401+0000 7fd6489978c0 1 < completed multipart upload key=N0AAVPQ6MUQ1 upload=2G1Z3HVYW4Q7 tag=NP5ZE34Q1KUL type=write size=2537394 2024-09-12T00:21:52.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.405+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=KCUNCELTK9CA type=write size=784933 2024-09-12T00:21:52.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.413+0000 7fd6489978c0 1 < suggested update operation key=2KP09UFI3N8B tag=O5I8AXLH3WRV type=del size=745676 2024-09-12T00:21:52.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.421+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~XWDW2NS0ALT7.0 size=1048576 2024-09-12T00:21:52.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.421+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~XWDW2NS0ALT7.1 size=1048576 2024-09-12T00:21:52.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.425+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~XWDW2NS0ALT7.2 size=891130 2024-09-12T00:21:52.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.425+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=XWDW2NS0ALT7 tag=NC1DLJUXA1LZ type=write size=4036858 2024-09-12T00:21:52.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.429+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=2IQN3LVJT2BZ type=del 2024-09-12T00:21:52.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.433+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=9WHPJ645BNGJ type=del size=4124385 2024-09-12T00:21:52.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.437+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=QHMBDKBVOSH8 type=del 2024-09-12T00:21:52.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.441+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=R5NQE8JKQHMQ type=del size=3003921 2024-09-12T00:21:52.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.445+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=L88E24YQNWK7 type=del 2024-09-12T00:21:52.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.449+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=UNCSDYD2YEK6 type=del size=1150174 2024-09-12T00:21:52.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.457+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=9FI97MFRWBE8 type=del 2024-09-12T00:21:52.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.461+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=XFM69G29HJ8J type=del size=4135250 2024-09-12T00:21:52.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.465+0000 7fd6489978c0 1 < completed write operation key=DAOTTEMK2P2T tag=XUQHZ0WT4W5Q type=write size=281860 2024-09-12T00:21:52.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.469+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=C21X2U7KRK3L type=del size=3220127 2024-09-12T00:21:52.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.477+0000 7fd6489978c0 1 < suggested update operation key=3JZP8TZFEIMH tag=JPYPZ2N0V337 type=del size=1068438 2024-09-12T00:21:52.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.485+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~K4M9JFB4ELRM.0 size=1048576 2024-09-12T00:21:52.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.489+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~K4M9JFB4ELRM.1 size=1048576 2024-09-12T00:21:52.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.489+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~K4M9JFB4ELRM.2 size=693785 2024-09-12T00:21:52.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.489+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=K4M9JFB4ELRM tag=1A0ALLPER448 type=write size=3839513 2024-09-12T00:21:52.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.493+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~5CYH3ET07QH1.0 size=832854 2024-09-12T00:21:52.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.501+0000 7fd6489978c0 1 < completed multipart upload key=GVPNH3JSO07D upload=5CYH3ET07QH1 tag=YU7ZSL2A1NTU type=write size=1881430 2024-09-12T00:21:52.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.509+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~FLL7UG5M8U62.0 size=1048576 2024-09-12T00:21:52.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.509+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~FLL7UG5M8U62.1 size=1048576 2024-09-12T00:21:52.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.513+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~FLL7UG5M8U62.2 size=412532 2024-09-12T00:21:52.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.513+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=FLL7UG5M8U62 tag=TECZUTGWCB60 type=write size=3558260 2024-09-12T00:21:52.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.517+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~1KZM75Y2LGG8.0 size=386705 2024-09-12T00:21:52.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.521+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=1KZM75Y2LGG8 tag=R2M9S15LMCWM type=write size=1435281 2024-09-12T00:21:52.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.525+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=LFTOX3THCXS2 type=del size=90972 2024-09-12T00:21:52.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.529+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~O7QMKG67SNUY.0 size=1048576 2024-09-12T00:21:52.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.533+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~O7QMKG67SNUY.1 size=441778 2024-09-12T00:21:52.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.541+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=O7QMKG67SNUY tag=NKPRJLJ0S5D0 type=write size=2538930 2024-09-12T00:21:52.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.545+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~ZSH69G69FGKV.0 size=817755 2024-09-12T00:21:52.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.545+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=ZSH69G69FGKV tag=NYDSFOQJJQE8 type=write size=1866331 2024-09-12T00:21:52.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.549+0000 7fd6489978c0 1 < completed delete operation key=JPVKBVRCZTE9 tag=477PS2FDAAC1 type=del 2024-09-12T00:21:52.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.557+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~44GSO7337NBL.0 size=1048576 2024-09-12T00:21:52.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.561+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~44GSO7337NBL.1 size=1048576 2024-09-12T00:21:52.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.561+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~44GSO7337NBL.2 size=234332 2024-09-12T00:21:52.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.561+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=44GSO7337NBL tag=DXB3SQ09UONC type=write size=3380060 2024-09-12T00:21:52.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.565+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=ELOX0WWWTH8J type=del 2024-09-12T00:21:52.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.569+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=1D014TU5P3Y2 type=write size=881584 2024-09-12T00:21:52.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.573+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~SLR4X03MQ9YX.0 size=1048576 2024-09-12T00:21:52.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.577+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~SLR4X03MQ9YX.1 size=1048576 2024-09-12T00:21:52.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.581+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~SLR4X03MQ9YX.2 size=617041 2024-09-12T00:21:52.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.589+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=SLR4X03MQ9YX tag=J36GJ3G2W920 type=write size=3762769 2024-09-12T00:21:52.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.593+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=JIO091JXNEPQ type=del size=3009599 2024-09-12T00:21:52.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.597+0000 7fd6489978c0 1 < suggested remove operation key=GVPNH3JSO07D tag=TRS1B7VQFLF0 type=del 2024-09-12T00:21:52.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.605+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~8ZPYCLHRUT3A.0 size=716383 2024-09-12T00:21:52.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.605+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=8ZPYCLHRUT3A tag=AISTLB3SEL1R type=write size=1764959 2024-09-12T00:21:52.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.609+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~4BKVG1QXFX9C.0 size=1048576 2024-09-12T00:21:52.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.613+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~4BKVG1QXFX9C.1 size=873073 2024-09-12T00:21:52.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.617+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=4BKVG1QXFX9C tag=SS3953P2Q623 type=write size=2970225 2024-09-12T00:21:52.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.621+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=V9W1EWWV5E5B type=del size=303663 2024-09-12T00:21:52.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.625+0000 7fd6489978c0 1 < completed write operation key=ZXEIT45BWHXM tag=KCUNCELTK9CA type=write size=784933 2024-09-12T00:21:52.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.629+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=JI2KRSNJBLXP type=del size=1132253 2024-09-12T00:21:52.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.633+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~XWDW2NS0ALT7.0 size=1048576 2024-09-12T00:21:52.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.637+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~XWDW2NS0ALT7.1 size=1048576 2024-09-12T00:21:52.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.637+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~XWDW2NS0ALT7.2 size=891130 2024-09-12T00:21:52.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.645+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=XWDW2NS0ALT7 tag=NC1DLJUXA1LZ type=write size=4036858 2024-09-12T00:21:52.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.649+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=P59X54HCG80J type=del size=447419 2024-09-12T00:21:52.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.653+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=9WHPJ645BNGJ type=del 2024-09-12T00:21:52.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.661+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~DTNXYULQQ039.0 size=1048576 2024-09-12T00:21:52.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.661+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~DTNXYULQQ039.1 size=1014788 2024-09-12T00:21:52.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.661+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=DTNXYULQQ039 tag=4L6RLB3OKIQV type=write size=3111940 2024-09-12T00:21:52.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.665+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=R5NQE8JKQHMQ type=del 2024-09-12T00:21:52.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.673+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~WWFYZHCRNOIP.0 size=1048576 2024-09-12T00:21:52.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.677+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~WWFYZHCRNOIP.1 size=1048576 2024-09-12T00:21:52.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.677+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~WWFYZHCRNOIP.2 size=549036 2024-09-12T00:21:52.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.677+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=WWFYZHCRNOIP tag=KRJY58LRDKVU type=write size=3694764 2024-09-12T00:21:52.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.681+0000 7fd6489978c0 1 < completed delete operation key=B2BW7GQ6UN9I tag=UNCSDYD2YEK6 type=del 2024-09-12T00:21:52.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.689+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~UEJ9LJHBJ038.0 size=212559 2024-09-12T00:21:52.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.689+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=UEJ9LJHBJ038 tag=D2T7Z8J3HMKN type=write size=1261135 2024-09-12T00:21:52.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.693+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=XFM69G29HJ8J type=del 2024-09-12T00:21:52.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.697+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=TWLHG8YZBSMQ type=write size=130358 2024-09-12T00:21:52.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.701+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=C21X2U7KRK3L type=del 2024-09-12T00:21:52.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.705+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=RPVT60BKYQIH type=write size=614035 2024-09-12T00:21:52.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.709+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~K4M9JFB4ELRM.0 size=1048576 2024-09-12T00:21:52.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.709+0000 7fd6489978c0 1 < canceled part key=_multipart_Y3JFVW74FNT6.2~K4M9JFB4ELRM.1 size=1048576 2024-09-12T00:21:52.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.713+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~K4M9JFB4ELRM.2 size=693785 2024-09-12T00:21:52.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.721+0000 7fd6489978c0 1 < canceled multipart upload key=Y3JFVW74FNT6 upload=K4M9JFB4ELRM tag=1A0ALLPER448 type=write size=3839513 2024-09-12T00:21:52.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.729+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~6A7O2M5N9JU1.0 size=513066 2024-09-12T00:21:52.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.729+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=6A7O2M5N9JU1 tag=YJDUG7KO5UD1 type=write size=1561642 2024-09-12T00:21:52.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.733+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~FLL7UG5M8U62.0 size=1048576 2024-09-12T00:21:52.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.737+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~FLL7UG5M8U62.1 size=1048576 2024-09-12T00:21:52.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.737+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~FLL7UG5M8U62.2 size=412532 2024-09-12T00:21:52.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.749+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=FLL7UG5M8U62 tag=TECZUTGWCB60 type=write size=3558260 2024-09-12T00:21:52.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.753+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~PL6JKF4SR55Z.0 size=1048576 2024-09-12T00:21:52.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.757+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~PL6JKF4SR55Z.1 size=1048576 2024-09-12T00:21:52.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.761+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~PL6JKF4SR55Z.2 size=951107 2024-09-12T00:21:52.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.761+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=PL6JKF4SR55Z tag=WP6I3YGE8T6W type=write size=4096835 2024-09-12T00:21:52.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.765+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=LFTOX3THCXS2 type=del 2024-09-12T00:21:52.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.769+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~9FPRMR81KO0S.0 size=1048576 2024-09-12T00:21:52.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.773+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~9FPRMR81KO0S.1 size=1048576 2024-09-12T00:21:52.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.777+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~9FPRMR81KO0S.2 size=330767 2024-09-12T00:21:52.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.777+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=9FPRMR81KO0S tag=JC1XCJ6CZKUJ type=write size=3476495 2024-09-12T00:21:52.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.781+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~ZSH69G69FGKV.0 size=817755 2024-09-12T00:21:52.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.785+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=ZSH69G69FGKV tag=NYDSFOQJJQE8 type=write size=1866331 2024-09-12T00:21:52.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.793+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~SZLIC6CWPK2V.0 size=1048576 2024-09-12T00:21:52.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.797+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~SZLIC6CWPK2V.1 size=44197 2024-09-12T00:21:52.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.797+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=SZLIC6CWPK2V tag=4KGPILNYQ2AA type=write size=2141349 2024-09-12T00:21:52.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.797+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~44GSO7337NBL.0 size=1048576 2024-09-12T00:21:52.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.805+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~44GSO7337NBL.1 size=1048576 2024-09-12T00:21:52.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.809+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~44GSO7337NBL.2 size=234332 2024-09-12T00:21:52.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.813+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=44GSO7337NBL tag=DXB3SQ09UONC type=write size=3380060 2024-09-12T00:21:52.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.821+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~RFUYNVT6SPU6.0 size=1048576 2024-09-12T00:21:52.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.821+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~RFUYNVT6SPU6.1 size=1048576 2024-09-12T00:21:52.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.825+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~RFUYNVT6SPU6.2 size=495742 2024-09-12T00:21:52.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.825+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=RFUYNVT6SPU6 tag=UQOZZ6H9ZF1D type=write size=3641470 2024-09-12T00:21:52.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.833+0000 7fd6489978c0 1 < suggested remove operation key=8JCL0F406L7I tag=1D014TU5P3Y2 type=write 2024-09-12T00:21:52.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.837+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=9NHOWM5H3UIL type=del size=2811682 2024-09-12T00:21:52.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.841+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=JIO091JXNEPQ type=del 2024-09-12T00:21:52.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.845+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=BNZ4HKFZLFNF type=del size=1058476 2024-09-12T00:21:52.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.849+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~8ZPYCLHRUT3A.0 size=716383 2024-09-12T00:21:52.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.853+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=8ZPYCLHRUT3A tag=AISTLB3SEL1R type=write size=1764959 2024-09-12T00:21:52.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.861+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~6E4L29VU77AR.0 size=1048576 2024-09-12T00:21:52.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.865+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~6E4L29VU77AR.1 size=264286 2024-09-12T00:21:52.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.865+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=6E4L29VU77AR tag=23259P2OI5N4 type=write size=2361438 2024-09-12T00:21:52.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.869+0000 7fd6489978c0 1 < canceled operation key=RGE8T6BTHBWK tag=V9W1EWWV5E5B type=del size=303663 2024-09-12T00:21:52.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.873+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=DYFRI94PXHQV type=del size=504732 2024-09-12T00:21:52.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.877+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=JI2KRSNJBLXP type=del 2024-09-12T00:21:52.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.881+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=NWAAPW7NW56H type=write size=989416 2024-09-12T00:21:52.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.881+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=P59X54HCG80J type=del 2024-09-12T00:21:52.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.889+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~FVJPH4SDGETZ.0 size=1048576 2024-09-12T00:21:52.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.893+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~FVJPH4SDGETZ.1 size=497273 2024-09-12T00:21:52.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.893+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=FVJPH4SDGETZ tag=1D4YJES3IB8A type=write size=2594425 2024-09-12T00:21:52.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.897+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~DTNXYULQQ039.0 size=1048576 2024-09-12T00:21:52.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.897+0000 7fd6489978c0 1 < canceled part key=_multipart_N0AAVPQ6MUQ1.2~DTNXYULQQ039.1 size=1014788 2024-09-12T00:21:52.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.901+0000 7fd6489978c0 1 < canceled multipart upload key=N0AAVPQ6MUQ1 upload=DTNXYULQQ039 tag=4L6RLB3OKIQV type=write size=3111940 2024-09-12T00:21:52.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.909+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~FJHC551QB22N.0 size=1045067 2024-09-12T00:21:52.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.909+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=FJHC551QB22N tag=P8FCJ6ME2GYO type=write size=2093643 2024-09-12T00:21:52.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.909+0000 7fd6489978c0 1 < canceled part key=_multipart_N0AAVPQ6MUQ1.2~WWFYZHCRNOIP.0 size=1048576 2024-09-12T00:21:52.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.913+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~WWFYZHCRNOIP.1 size=1048576 2024-09-12T00:21:52.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.917+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~WWFYZHCRNOIP.2 size=549036 2024-09-12T00:21:52.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.921+0000 7fd6489978c0 1 < canceled multipart upload key=N0AAVPQ6MUQ1 upload=WWFYZHCRNOIP tag=KRJY58LRDKVU type=write size=3694764 2024-09-12T00:21:52.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.925+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=S1PO1D9BQDQN type=del size=2653970 2024-09-12T00:21:52.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.929+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~UEJ9LJHBJ038.0 size=212559 2024-09-12T00:21:52.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.933+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=UEJ9LJHBJ038 tag=D2T7Z8J3HMKN type=write size=1261135 2024-09-12T00:21:52.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.941+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~23W9N711W3MK.0 size=1048576 2024-09-12T00:21:52.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.945+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~23W9N711W3MK.1 size=1048576 2024-09-12T00:21:52.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.945+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~23W9N711W3MK.2 size=946789 2024-09-12T00:21:52.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.945+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=23W9N711W3MK tag=1EQQ85IDIFDS type=write size=4092517 2024-09-12T00:21:52.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.949+0000 7fd6489978c0 1 < canceled operation key=HUKWLE56FRX2 tag=TWLHG8YZBSMQ type=write size=130358 2024-09-12T00:21:52.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.957+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~7KETMC3M4AFF.0 size=259048 2024-09-12T00:21:52.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.957+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=7KETMC3M4AFF tag=6YUL3HXX3V22 type=write size=1307624 2024-09-12T00:21:52.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.961+0000 7fd6489978c0 1 < completed write operation key=QBS4N1KGR1JB tag=RPVT60BKYQIH type=write size=614035 2024-09-12T00:21:52.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.969+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~14F40Z91MW92.0 size=1048576 2024-09-12T00:21:52.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.969+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~14F40Z91MW92.1 size=53569 2024-09-12T00:21:52.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.969+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=14F40Z91MW92 tag=SYGVZM2HFAWF type=write size=2150721 2024-09-12T00:21:52.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.977+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~6A7O2M5N9JU1.0 size=513066 2024-09-12T00:21:52.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.981+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=6A7O2M5N9JU1 tag=YJDUG7KO5UD1 type=write size=1561642 2024-09-12T00:21:52.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.989+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~18TQU79JBFJM.0 size=257408 2024-09-12T00:21:52.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.989+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=18TQU79JBFJM tag=20P8H8RQQ477 type=write size=1305984 2024-09-12T00:21:52.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.993+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~PL6JKF4SR55Z.0 size=1048576 2024-09-12T00:21:52.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.997+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~PL6JKF4SR55Z.1 size=1048576 2024-09-12T00:21:52.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:52.997+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~PL6JKF4SR55Z.2 size=951107 2024-09-12T00:21:53.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.005+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=PL6JKF4SR55Z tag=WP6I3YGE8T6W type=write size=4096835 2024-09-12T00:21:53.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.009+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=5USRFJUBY7C6 type=del size=2610487 2024-09-12T00:21:53.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.009+0000 7fd6489978c0 1 < canceled part key=_multipart_N0AAVPQ6MUQ1.2~9FPRMR81KO0S.0 size=1048576 2024-09-12T00:21:53.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.013+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~9FPRMR81KO0S.1 size=1048576 2024-09-12T00:21:53.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.017+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~9FPRMR81KO0S.2 size=330767 2024-09-12T00:21:53.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.021+0000 7fd6489978c0 1 < canceled multipart upload key=N0AAVPQ6MUQ1 upload=9FPRMR81KO0S tag=JC1XCJ6CZKUJ type=write size=3476495 2024-09-12T00:21:53.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.029+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~P8QRL7MBTA34.0 size=1048576 2024-09-12T00:21:53.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.029+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~P8QRL7MBTA34.1 size=1048576 2024-09-12T00:21:53.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.033+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~P8QRL7MBTA34.2 size=803998 2024-09-12T00:21:53.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.033+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=P8QRL7MBTA34 tag=NCNCR2H8X6HG type=write size=3949726 2024-09-12T00:21:53.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.033+0000 7fd6489978c0 1 < canceled part key=_multipart_JPVKBVRCZTE9.2~SZLIC6CWPK2V.0 size=1048576 2024-09-12T00:21:53.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.037+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~SZLIC6CWPK2V.1 size=44197 2024-09-12T00:21:53.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.041+0000 7fd6489978c0 1 < canceled multipart upload key=JPVKBVRCZTE9 upload=SZLIC6CWPK2V tag=4KGPILNYQ2AA type=write size=2141349 2024-09-12T00:21:53.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.045+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=X2A67ND9JVCY type=del size=3991743 2024-09-12T00:21:53.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.049+0000 7fd6489978c0 1 < canceled part key=_multipart_JPVKBVRCZTE9.2~RFUYNVT6SPU6.0 size=1048576 2024-09-12T00:21:53.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.049+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~RFUYNVT6SPU6.1 size=1048576 2024-09-12T00:21:53.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.053+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~RFUYNVT6SPU6.2 size=495742 2024-09-12T00:21:53.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.061+0000 7fd6489978c0 1 < canceled multipart upload key=JPVKBVRCZTE9 upload=RFUYNVT6SPU6 tag=UQOZZ6H9ZF1D type=write size=3641470 2024-09-12T00:21:53.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.065+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=M59ZIG19Q473 type=del size=1117983 2024-09-12T00:21:53.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.073+0000 7fd6489978c0 1 < suggested update operation key=GVPNH3JSO07D tag=9NHOWM5H3UIL type=del size=2811682 2024-09-12T00:21:53.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.077+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=GY80QOM3LKAZ type=del size=3466195 2024-09-12T00:21:53.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.081+0000 7fd6489978c0 1 < suggested remove operation key=2KP09UFI3N8B tag=BNZ4HKFZLFNF type=del 2024-09-12T00:21:53.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.089+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~DEC2TJLPMXYH.0 size=312522 2024-09-12T00:21:53.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.089+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=DEC2TJLPMXYH tag=5230CTW4CQB0 type=write size=1361098 2024-09-12T00:21:53.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.093+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~6E4L29VU77AR.0 size=1048576 2024-09-12T00:21:53.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.097+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~6E4L29VU77AR.1 size=264286 2024-09-12T00:21:53.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.101+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=6E4L29VU77AR tag=23259P2OI5N4 type=write size=2361438 2024-09-12T00:21:53.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.109+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~CCPDDMXHN5I3.0 size=1048576 2024-09-12T00:21:53.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.109+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~CCPDDMXHN5I3.1 size=918418 2024-09-12T00:21:53.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.109+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=CCPDDMXHN5I3 tag=0EMA239PVHCD type=write size=3015570 2024-09-12T00:21:53.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.113+0000 7fd6489978c0 1 < canceled operation key=YJJBTNI318EH tag=DYFRI94PXHQV type=del size=504732 2024-09-12T00:21:53.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.121+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~0G61OV8IQWBA.0 size=1048576 2024-09-12T00:21:53.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.121+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~0G61OV8IQWBA.1 size=1048576 2024-09-12T00:21:53.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.125+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~0G61OV8IQWBA.2 size=1008947 2024-09-12T00:21:53.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.125+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=0G61OV8IQWBA tag=4VRQNATTZERL type=write size=4154675 2024-09-12T00:21:53.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.129+0000 7fd6489978c0 1 < completed write operation key=G4EUTQOHAT2E tag=NWAAPW7NW56H type=write size=989416 2024-09-12T00:21:53.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.133+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=KLREB9Q0Q65E type=del size=187461 2024-09-12T00:21:53.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.141+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~FVJPH4SDGETZ.0 size=1048576 2024-09-12T00:21:53.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.141+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~FVJPH4SDGETZ.1 size=497273 2024-09-12T00:21:53.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.149+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=FVJPH4SDGETZ tag=1D4YJES3IB8A type=write size=2594425 2024-09-12T00:21:53.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.157+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~LO6YIOVDQGLF.0 size=899416 2024-09-12T00:21:53.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.157+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=LO6YIOVDQGLF tag=MVAOGW61SKWM type=write size=1947992 2024-09-12T00:21:53.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.161+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~FJHC551QB22N.0 size=1045067 2024-09-12T00:21:53.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.165+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=FJHC551QB22N tag=P8FCJ6ME2GYO type=write size=2093643 2024-09-12T00:21:53.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.173+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~6H4ARWLDM823.0 size=1013156 2024-09-12T00:21:53.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.173+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=6H4ARWLDM823 tag=J66F1FFVY8G4 type=write size=2061732 2024-09-12T00:21:53.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.177+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=S1PO1D9BQDQN type=del 2024-09-12T00:21:53.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.185+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~51QE8HTEDCLB.0 size=1048576 2024-09-12T00:21:53.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.185+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~51QE8HTEDCLB.1 size=1048576 2024-09-12T00:21:53.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.189+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~51QE8HTEDCLB.2 size=376242 2024-09-12T00:21:53.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.189+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=51QE8HTEDCLB tag=22FYXOTCMMPE type=write size=3521970 2024-09-12T00:21:53.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.193+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~23W9N711W3MK.0 size=1048576 2024-09-12T00:21:53.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.197+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~23W9N711W3MK.1 size=1048576 2024-09-12T00:21:53.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.201+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~23W9N711W3MK.2 size=946789 2024-09-12T00:21:53.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.205+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=23W9N711W3MK tag=1EQQ85IDIFDS type=write size=4092517 2024-09-12T00:21:53.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.209+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=TOF6NY7FTU3I type=del size=2680602 2024-09-12T00:21:53.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.213+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~7KETMC3M4AFF.0 size=259048 2024-09-12T00:21:53.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.221+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=7KETMC3M4AFF tag=6YUL3HXX3V22 type=write size=1307624 2024-09-12T00:21:53.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.225+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=ZHS9RNRLJUDS type=del size=4180052 2024-09-12T00:21:53.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.229+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~14F40Z91MW92.0 size=1048576 2024-09-12T00:21:53.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.229+0000 7fd6489978c0 1 < canceled part key=_multipart_B2BW7GQ6UN9I.2~14F40Z91MW92.1 size=53569 2024-09-12T00:21:53.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.237+0000 7fd6489978c0 1 < canceled multipart upload key=B2BW7GQ6UN9I upload=14F40Z91MW92 tag=SYGVZM2HFAWF type=write size=2150721 2024-09-12T00:21:53.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.241+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=5MRBNI3WT92S type=del size=101325 2024-09-12T00:21:53.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.245+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~18TQU79JBFJM.0 size=257408 2024-09-12T00:21:53.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.253+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=18TQU79JBFJM tag=20P8H8RQQ477 type=write size=1305984 2024-09-12T00:21:53.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.261+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~PYNX2M1STYOC.0 size=1048576 2024-09-12T00:21:53.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.261+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~PYNX2M1STYOC.1 size=808702 2024-09-12T00:21:53.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.261+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=PYNX2M1STYOC tag=O5KOSXCXXP8W type=write size=2905854 2024-09-12T00:21:53.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.265+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=5USRFJUBY7C6 type=del 2024-09-12T00:21:53.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.273+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~65IOHTZZ0QM1.0 size=1048576 2024-09-12T00:21:53.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.277+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~65IOHTZZ0QM1.1 size=863415 2024-09-12T00:21:53.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.277+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=65IOHTZZ0QM1 tag=C5YWSM2QZA0X type=write size=2960567 2024-09-12T00:21:53.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.281+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~P8QRL7MBTA34.0 size=1048576 2024-09-12T00:21:53.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.281+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~P8QRL7MBTA34.1 size=1048576 2024-09-12T00:21:53.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.285+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~P8QRL7MBTA34.2 size=803998 2024-09-12T00:21:53.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.293+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=P8QRL7MBTA34 tag=NCNCR2H8X6HG type=write size=3949726 2024-09-12T00:21:53.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.297+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~O8UMG4LERM8A.0 size=1048576 2024-09-12T00:21:53.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.301+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~O8UMG4LERM8A.1 size=507126 2024-09-12T00:21:53.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.301+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=O8UMG4LERM8A tag=K129T82YG05H type=write size=2604278 2024-09-12T00:21:53.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.309+0000 7fd6489978c0 1 < suggested remove operation key=HUKWLE56FRX2 tag=X2A67ND9JVCY type=del 2024-09-12T00:21:53.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.317+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~5NWFBDZGEH03.0 size=700764 2024-09-12T00:21:53.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.317+0000 7fd6489978c0 1 > prepared multipart upload key=DAOTTEMK2P2T upload=5NWFBDZGEH03 tag=JHPD8RIXPV3J type=write size=1749340 2024-09-12T00:21:53.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.321+0000 7fd6489978c0 1 < canceled operation key=N4S6I47NSJK6 tag=M59ZIG19Q473 type=del size=1117983 2024-09-12T00:21:53.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.325+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=FF2TPN0CB93V type=del size=1453244 2024-09-12T00:21:53.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.329+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=GY80QOM3LKAZ type=del 2024-09-12T00:21:53.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.337+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~0JHI2AHE9O2Q.0 size=308279 2024-09-12T00:21:53.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.337+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=0JHI2AHE9O2Q tag=W582TELWDD8W type=write size=1356855 2024-09-12T00:21:53.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.341+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~DEC2TJLPMXYH.0 size=312522 2024-09-12T00:21:53.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.345+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=DEC2TJLPMXYH tag=5230CTW4CQB0 type=write size=1361098 2024-09-12T00:21:53.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.349+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=10B21Q32IGFV type=del size=886309 2024-09-12T00:21:53.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.353+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~CCPDDMXHN5I3.0 size=1048576 2024-09-12T00:21:53.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.357+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~CCPDDMXHN5I3.1 size=918418 2024-09-12T00:21:53.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.361+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=CCPDDMXHN5I3 tag=0EMA239PVHCD type=write size=3015570 2024-09-12T00:21:53.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.369+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~OM7EM9M425FM.0 size=1048576 2024-09-12T00:21:53.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.373+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~OM7EM9M425FM.1 size=1048576 2024-09-12T00:21:53.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.373+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~OM7EM9M425FM.2 size=581172 2024-09-12T00:21:53.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.373+0000 7fd6489978c0 1 > prepared multipart upload key=DAOTTEMK2P2T upload=OM7EM9M425FM tag=NHBD0X7ZLM08 type=write size=3726900 2024-09-12T00:21:53.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.377+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~0G61OV8IQWBA.0 size=1048576 2024-09-12T00:21:53.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.381+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~0G61OV8IQWBA.1 size=1048576 2024-09-12T00:21:53.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.381+0000 7fd6489978c0 1 < canceled part key=_multipart_9CK160BK5YYY.2~0G61OV8IQWBA.2 size=1008947 2024-09-12T00:21:53.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.389+0000 7fd6489978c0 1 < canceled multipart upload key=9CK160BK5YYY upload=0G61OV8IQWBA tag=4VRQNATTZERL type=write size=4154675 2024-09-12T00:21:53.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.393+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~RO4BVMJ6FK22.0 size=1048576 2024-09-12T00:21:53.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.397+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~RO4BVMJ6FK22.1 size=1048576 2024-09-12T00:21:53.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.401+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~RO4BVMJ6FK22.2 size=505184 2024-09-12T00:21:53.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.401+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=RO4BVMJ6FK22 tag=RX86TOWGHURT type=write size=3650912 2024-09-12T00:21:53.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.405+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=KLREB9Q0Q65E type=del 2024-09-12T00:21:53.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.409+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~B6B58KGBQR8M.0 size=1048576 2024-09-12T00:21:53.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.413+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~B6B58KGBQR8M.1 size=583256 2024-09-12T00:21:53.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.413+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=B6B58KGBQR8M tag=YH9RI7YNCBVK type=write size=2680408 2024-09-12T00:21:53.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.417+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~LO6YIOVDQGLF.0 size=899416 2024-09-12T00:21:53.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.421+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=LO6YIOVDQGLF tag=MVAOGW61SKWM type=write size=1947992 2024-09-12T00:21:53.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.425+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=UN0ZIO3NK3L6 type=del size=3631056 2024-09-12T00:21:53.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.429+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~6H4ARWLDM823.0 size=1013156 2024-09-12T00:21:53.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.437+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=6H4ARWLDM823 tag=J66F1FFVY8G4 type=write size=2061732 2024-09-12T00:21:53.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.445+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~STGRRESOKGJ9.0 size=783420 2024-09-12T00:21:53.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.445+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=STGRRESOKGJ9 tag=XVBSFF2V72LI type=write size=1831996 2024-09-12T00:21:53.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.445+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~51QE8HTEDCLB.0 size=1048576 2024-09-12T00:21:53.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.449+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~51QE8HTEDCLB.1 size=1048576 2024-09-12T00:21:53.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.453+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~51QE8HTEDCLB.2 size=376242 2024-09-12T00:21:53.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.461+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=51QE8HTEDCLB tag=22FYXOTCMMPE type=write size=3521970 2024-09-12T00:21:53.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.465+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=RDA6G14LLEU2 type=del size=854395 2024-09-12T00:21:53.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.469+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=TOF6NY7FTU3I type=del 2024-09-12T00:21:53.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.477+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~CJ0JPOROEH1F.0 size=1048576 2024-09-12T00:21:53.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.477+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~CJ0JPOROEH1F.1 size=256285 2024-09-12T00:21:53.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.477+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=CJ0JPOROEH1F tag=9LZLOCUFGKGL type=write size=2353437 2024-09-12T00:21:53.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.485+0000 7fd6489978c0 1 < canceled operation key=N4S6I47NSJK6 tag=ZHS9RNRLJUDS type=del size=4180052 2024-09-12T00:21:53.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.489+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=C4K9EUS1WCSD type=del size=1085146 2024-09-12T00:21:53.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.493+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=5MRBNI3WT92S type=del 2024-09-12T00:21:53.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.497+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=C26L0XCX3Q2S type=write size=45432 2024-09-12T00:21:53.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.501+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~PYNX2M1STYOC.0 size=1048576 2024-09-12T00:21:53.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.505+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~PYNX2M1STYOC.1 size=808702 2024-09-12T00:21:53.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.509+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=PYNX2M1STYOC tag=O5KOSXCXXP8W type=write size=2905854 2024-09-12T00:21:53.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.513+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=5299ZYLVLDJQ type=del size=1485965 2024-09-12T00:21:53.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.517+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~65IOHTZZ0QM1.0 size=1048576 2024-09-12T00:21:53.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.521+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~65IOHTZZ0QM1.1 size=863415 2024-09-12T00:21:53.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.529+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=65IOHTZZ0QM1 tag=C5YWSM2QZA0X type=write size=2960567 2024-09-12T00:21:53.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.533+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=R150GMTGPODR type=del size=3632204 2024-09-12T00:21:53.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.537+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~O8UMG4LERM8A.0 size=1048576 2024-09-12T00:21:53.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.537+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~O8UMG4LERM8A.1 size=507126 2024-09-12T00:21:53.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.545+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=O8UMG4LERM8A tag=K129T82YG05H type=write size=2604278 2024-09-12T00:21:53.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.549+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=BPXLG9WK3DIT type=del size=1179659 2024-09-12T00:21:53.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.553+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~5NWFBDZGEH03.0 size=700764 2024-09-12T00:21:53.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.557+0000 7fd6489978c0 1 < completed multipart upload key=DAOTTEMK2P2T upload=5NWFBDZGEH03 tag=JHPD8RIXPV3J type=write size=1749340 2024-09-12T00:21:53.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.561+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=UZB5HH4K4C1Q type=del size=3039385 2024-09-12T00:21:53.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.565+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=FF2TPN0CB93V type=del 2024-09-12T00:21:53.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.569+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=T14QKW2NS651 type=write size=199919 2024-09-12T00:21:53.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.573+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~0JHI2AHE9O2Q.0 size=308279 2024-09-12T00:21:53.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.577+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=0JHI2AHE9O2Q tag=W582TELWDD8W type=write size=1356855 2024-09-12T00:21:53.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.585+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~HDLZYC7FYLUH.0 size=272527 2024-09-12T00:21:53.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.585+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=HDLZYC7FYLUH tag=HLLZ4QE2C8VY type=write size=1321103 2024-09-12T00:21:53.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.589+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=10B21Q32IGFV type=del 2024-09-12T00:21:53.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.597+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~FEJZGWZ8305L.0 size=230664 2024-09-12T00:21:53.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.597+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=FEJZGWZ8305L tag=TT0OAWDW0NF1 type=write size=1279240 2024-09-12T00:21:53.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.597+0000 7fd6489978c0 1 < canceled part key=_multipart_DAOTTEMK2P2T.2~OM7EM9M425FM.0 size=1048576 2024-09-12T00:21:53.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.601+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~OM7EM9M425FM.1 size=1048576 2024-09-12T00:21:53.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.601+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~OM7EM9M425FM.2 size=581172 2024-09-12T00:21:53.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.609+0000 7fd6489978c0 1 < canceled multipart upload key=DAOTTEMK2P2T upload=OM7EM9M425FM tag=NHBD0X7ZLM08 type=write size=3726900 2024-09-12T00:21:53.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.613+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=ORO3OKA0392G type=write size=842633 2024-09-12T00:21:53.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.617+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~RO4BVMJ6FK22.0 size=1048576 2024-09-12T00:21:53.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.617+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~RO4BVMJ6FK22.1 size=1048576 2024-09-12T00:21:53.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.621+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~RO4BVMJ6FK22.2 size=505184 2024-09-12T00:21:53.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.629+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=RO4BVMJ6FK22 tag=RX86TOWGHURT type=write size=3650912 2024-09-12T00:21:53.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.629+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=1ZBSJZTNZ2GL type=del size=278566 2024-09-12T00:21:53.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.633+0000 7fd6489978c0 1 < canceled part key=_multipart_ZXEIT45BWHXM.2~B6B58KGBQR8M.0 size=1048576 2024-09-12T00:21:53.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.633+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~B6B58KGBQR8M.1 size=583256 2024-09-12T00:21:53.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.641+0000 7fd6489978c0 1 < canceled multipart upload key=ZXEIT45BWHXM upload=B6B58KGBQR8M tag=YH9RI7YNCBVK type=write size=2680408 2024-09-12T00:21:53.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.645+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~5HXTM37ZJD2V.0 size=148585 2024-09-12T00:21:53.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.645+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=5HXTM37ZJD2V tag=306TA7UOHDQG type=write size=1197161 2024-09-12T00:21:53.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.649+0000 7fd6489978c0 1 < completed delete operation key=RGE8T6BTHBWK tag=UN0ZIO3NK3L6 type=del 2024-09-12T00:21:53.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.653+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=DEKDW38HMM66 type=del size=1415487 2024-09-12T00:21:53.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.657+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~STGRRESOKGJ9.0 size=783420 2024-09-12T00:21:53.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.665+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=STGRRESOKGJ9 tag=XVBSFF2V72LI type=write size=1831996 2024-09-12T00:21:53.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.669+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=6ERHFKS5TTXD type=del size=893815 2024-09-12T00:21:53.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.673+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=RDA6G14LLEU2 type=del 2024-09-12T00:21:53.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.677+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=PKGOT7NP1607 type=del size=1088647 2024-09-12T00:21:53.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.677+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~CJ0JPOROEH1F.0 size=1048576 2024-09-12T00:21:53.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.681+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~CJ0JPOROEH1F.1 size=256285 2024-09-12T00:21:53.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.689+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=CJ0JPOROEH1F tag=9LZLOCUFGKGL type=write size=2353437 2024-09-12T00:21:53.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.693+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~NDKLMW5G07MJ.0 size=128019 2024-09-12T00:21:53.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.693+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=NDKLMW5G07MJ tag=M61CQ7WR60N6 type=write size=1176595 2024-09-12T00:21:53.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.697+0000 7fd6489978c0 1 < completed delete operation key=B2BW7GQ6UN9I tag=C4K9EUS1WCSD type=del 2024-09-12T00:21:53.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.701+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=5JSVPXLKIDE5 type=del size=2091981 2024-09-12T00:21:53.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.705+0000 7fd6489978c0 1 < completed write operation key=F2CTWM0T2698 tag=C26L0XCX3Q2S type=write size=45432 2024-09-12T00:21:53.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.709+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=YZGEXDVPMP0U type=del size=3996372 2024-09-12T00:21:53.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.713+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=5299ZYLVLDJQ type=del 2024-09-12T00:21:53.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.717+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=14KHR553GWGW type=del size=1319925 2024-09-12T00:21:53.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.721+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=R150GMTGPODR type=del 2024-09-12T00:21:53.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.725+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=YASG2OMM1SV5 type=del size=409812 2024-09-12T00:21:53.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.729+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=BPXLG9WK3DIT type=del 2024-09-12T00:21:53.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.733+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=0D5DR5N2YKE6 type=del size=3936496 2024-09-12T00:21:53.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.741+0000 7fd6489978c0 1 < suggested update operation key=9ACGS2FIY7AF tag=UZB5HH4K4C1Q type=del size=3039385 2024-09-12T00:21:53.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.745+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~LH2BDIW3QHCR.0 size=133624 2024-09-12T00:21:53.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.745+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=LH2BDIW3QHCR tag=IKFLF2WNYS8C type=write size=1182200 2024-09-12T00:21:53.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.749+0000 7fd6489978c0 1 < completed write operation key=GVPNH3JSO07D tag=T14QKW2NS651 type=write size=199919 2024-09-12T00:21:53.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.753+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=WV7VWZ0XU7N4 type=del size=2915601 2024-09-12T00:21:53.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.757+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~HDLZYC7FYLUH.0 size=272527 2024-09-12T00:21:53.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.765+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=HDLZYC7FYLUH tag=HLLZ4QE2C8VY type=write size=1321103 2024-09-12T00:21:53.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.773+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~3UYZJO6E9Q66.0 size=1048576 2024-09-12T00:21:53.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.773+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~3UYZJO6E9Q66.1 size=192652 2024-09-12T00:21:53.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.773+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=3UYZJO6E9Q66 tag=0L9HPLJ7ZKIQ type=write size=2289804 2024-09-12T00:21:53.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.777+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~FEJZGWZ8305L.0 size=230664 2024-09-12T00:21:53.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.785+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=FEJZGWZ8305L tag=TT0OAWDW0NF1 type=write size=1279240 2024-09-12T00:21:53.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.789+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=808UJC611UVM type=del size=3805754 2024-09-12T00:21:53.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.797+0000 7fd6489978c0 1 < suggested remove operation key=ZXEIT45BWHXM tag=ORO3OKA0392G type=write 2024-09-12T00:21:53.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.801+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~DOZWLO4PV65V.0 size=1048576 2024-09-12T00:21:53.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.805+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~DOZWLO4PV65V.1 size=1048576 2024-09-12T00:21:53.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.809+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~DOZWLO4PV65V.2 size=518585 2024-09-12T00:21:53.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.809+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=DOZWLO4PV65V tag=5G113S5K8J7C type=write size=3664313 2024-09-12T00:21:53.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.813+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=1ZBSJZTNZ2GL type=del 2024-09-12T00:21:53.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.813+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=FX05JW11LMP7 type=write size=744110 2024-09-12T00:21:53.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.817+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~5HXTM37ZJD2V.0 size=148585 2024-09-12T00:21:53.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.825+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=5HXTM37ZJD2V tag=306TA7UOHDQG type=write size=1197161 2024-09-12T00:21:53.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.833+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=TWHFRZ40KP7X type=del size=1032724 2024-09-12T00:21:53.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.841+0000 7fd6489978c0 1 < suggested update operation key=M9YKGQ2GA5CO tag=DEKDW38HMM66 type=del size=1415487 2024-09-12T00:21:53.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.845+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~WFSWKGDYMLD3.0 size=1048576 2024-09-12T00:21:53.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.849+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~WFSWKGDYMLD3.1 size=1048576 2024-09-12T00:21:53.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.853+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~WFSWKGDYMLD3.2 size=524274 2024-09-12T00:21:53.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.853+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=WFSWKGDYMLD3 tag=NIKLU8S5A7XX type=write size=3670002 2024-09-12T00:21:53.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.857+0000 7fd6489978c0 1 < completed delete operation key=J5IW4G9C72DH tag=6ERHFKS5TTXD type=del 2024-09-12T00:21:53.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.861+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~JMI09TO0CG23.0 size=458713 2024-09-12T00:21:53.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.861+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=JMI09TO0CG23 tag=PJO53O523KCH type=write size=1507289 2024-09-12T00:21:53.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.865+0000 7fd6489978c0 1 < canceled operation key=N0AAVPQ6MUQ1 tag=PKGOT7NP1607 type=del size=1088647 2024-09-12T00:21:53.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.873+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~0VDZV86VK8RR.0 size=1048576 2024-09-12T00:21:53.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.877+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~0VDZV86VK8RR.1 size=1048576 2024-09-12T00:21:53.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.877+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~0VDZV86VK8RR.2 size=655392 2024-09-12T00:21:53.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.877+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=0VDZV86VK8RR tag=5ARODKY6KP6X type=write size=3801120 2024-09-12T00:21:53.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.881+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~NDKLMW5G07MJ.0 size=128019 2024-09-12T00:21:53.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.889+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=NDKLMW5G07MJ tag=M61CQ7WR60N6 type=write size=1176595 2024-09-12T00:21:53.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.893+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=RKTP5LH89RWZ type=write size=632020 2024-09-12T00:21:53.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.897+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=5JSVPXLKIDE5 type=del 2024-09-12T00:21:53.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.901+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=DKZBHQY2HK2B type=del size=2700064 2024-09-12T00:21:53.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.905+0000 7fd6489978c0 1 < suggested remove operation key=YSPRZ87DZ2OD tag=YZGEXDVPMP0U type=del 2024-09-12T00:21:53.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.913+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~GPR7A12IGVC4.0 size=1048576 2024-09-12T00:21:53.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.917+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~GPR7A12IGVC4.1 size=1048576 2024-09-12T00:21:53.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.917+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~GPR7A12IGVC4.2 size=585685 2024-09-12T00:21:53.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.917+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=GPR7A12IGVC4 tag=GXGT239MN38F type=write size=3731413 2024-09-12T00:21:53.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.921+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=14KHR553GWGW type=del 2024-09-12T00:21:53.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.925+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=3032Y7QTS1AY type=del size=1924523 2024-09-12T00:21:53.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.929+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=YASG2OMM1SV5 type=del 2024-09-12T00:21:53.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.933+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=XXJVBLZVRL08 type=write size=598341 2024-09-12T00:21:53.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.937+0000 7fd6489978c0 1 < completed delete operation key=LZICTA4BWOW8 tag=0D5DR5N2YKE6 type=del 2024-09-12T00:21:53.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.941+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=77G13W59YWK1 type=write size=67568 2024-09-12T00:21:53.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.945+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~LH2BDIW3QHCR.0 size=133624 2024-09-12T00:21:53.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.953+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=LH2BDIW3QHCR tag=IKFLF2WNYS8C type=write size=1182200 2024-09-12T00:21:53.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.957+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~XO9TKJS4NN2Y.0 size=564770 2024-09-12T00:21:53.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.957+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=XO9TKJS4NN2Y tag=KSUYZRF3NNPX type=write size=1613346 2024-09-12T00:21:53.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.965+0000 7fd6489978c0 1 < suggested remove operation key=2KP09UFI3N8B tag=WV7VWZ0XU7N4 type=del 2024-09-12T00:21:53.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.969+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=Z0SZDO58VGZP type=del size=1958978 2024-09-12T00:21:53.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.973+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~3UYZJO6E9Q66.0 size=1048576 2024-09-12T00:21:53.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.973+0000 7fd6489978c0 1 < canceled part key=_multipart_K9FD1L86Q05B.2~3UYZJO6E9Q66.1 size=192652 2024-09-12T00:21:53.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.981+0000 7fd6489978c0 1 < canceled multipart upload key=K9FD1L86Q05B upload=3UYZJO6E9Q66 tag=0L9HPLJ7ZKIQ type=write size=2289804 2024-09-12T00:21:53.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.985+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=5SYF3N2FJMSH type=del size=3406111 2024-09-12T00:21:53.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.989+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=808UJC611UVM type=del 2024-09-12T00:21:53.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.993+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=N6Q1SLFFJ49L type=del size=1892592 2024-09-12T00:21:53.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.997+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~DOZWLO4PV65V.0 size=1048576 2024-09-12T00:21:53.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:53.997+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~DOZWLO4PV65V.1 size=1048576 2024-09-12T00:21:54.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.001+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~DOZWLO4PV65V.2 size=518585 2024-09-12T00:21:54.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.009+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=DOZWLO4PV65V tag=5G113S5K8J7C type=write size=3664313 2024-09-12T00:21:54.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.013+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=1ULTI2JMDTKI type=del size=3739014 2024-09-12T00:21:54.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.017+0000 7fd6489978c0 1 < completed write operation key=Y3JFVW74FNT6 tag=FX05JW11LMP7 type=write size=744110 2024-09-12T00:21:54.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.021+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~A5MRBBD8TO05.0 size=175855 2024-09-12T00:21:54.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.021+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=A5MRBBD8TO05 tag=B5S5IEW96PQM type=write size=1224431 2024-09-12T00:21:54.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.025+0000 7fd6489978c0 1 < completed delete operation key=LZICTA4BWOW8 tag=TWHFRZ40KP7X type=del 2024-09-12T00:21:54.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.033+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~24UBL6TTFCGM.0 size=278837 2024-09-12T00:21:54.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.033+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=24UBL6TTFCGM tag=VIIR1DWK060M type=write size=1327413 2024-09-12T00:21:54.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.037+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~WFSWKGDYMLD3.0 size=1048576 2024-09-12T00:21:54.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.037+0000 7fd6489978c0 1 < canceled part key=_multipart_YSPRZ87DZ2OD.2~WFSWKGDYMLD3.1 size=1048576 2024-09-12T00:21:54.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.041+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~WFSWKGDYMLD3.2 size=524274 2024-09-12T00:21:54.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.045+0000 7fd6489978c0 1 < canceled multipart upload key=YSPRZ87DZ2OD upload=WFSWKGDYMLD3 tag=NIKLU8S5A7XX type=write size=3670002 2024-09-12T00:21:54.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.053+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~8HQMWF3L98XU.0 size=1048576 2024-09-12T00:21:54.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.057+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~8HQMWF3L98XU.1 size=1048576 2024-09-12T00:21:54.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.057+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~8HQMWF3L98XU.2 size=686349 2024-09-12T00:21:54.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.057+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=8HQMWF3L98XU tag=37NIQ3631CSN type=write size=3832077 2024-09-12T00:21:54.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.061+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~JMI09TO0CG23.0 size=458713 2024-09-12T00:21:54.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.069+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=JMI09TO0CG23 tag=PJO53O523KCH type=write size=1507289 2024-09-12T00:21:54.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.073+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=P8FWC4OO7353 type=del size=2911489 2024-09-12T00:21:54.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.077+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~0VDZV86VK8RR.0 size=1048576 2024-09-12T00:21:54.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.077+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~0VDZV86VK8RR.1 size=1048576 2024-09-12T00:21:54.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.081+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~0VDZV86VK8RR.2 size=655392 2024-09-12T00:21:54.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.089+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=0VDZV86VK8RR tag=5ARODKY6KP6X type=write size=3801120 2024-09-12T00:21:54.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.089+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=YTJ6RV6GRNJ2 type=del size=3220914 2024-09-12T00:21:54.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.093+0000 7fd6489978c0 -1 < failed to complete operation key=2KP09UFI3N8B tag=RKTP5LH89RWZ type=write size=632020: (22) Invalid argument 2024-09-12T00:21:54.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.097+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=IS5WPA1ME7OE type=del size=521391 2024-09-12T00:21:54.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.105+0000 7fd6489978c0 1 < suggested update operation key=B2BW7GQ6UN9I tag=DKZBHQY2HK2B type=del size=2700064 2024-09-12T00:21:54.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.109+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=PVMM6XYGX5XT type=del size=237854 2024-09-12T00:21:54.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.113+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~GPR7A12IGVC4.0 size=1048576 2024-09-12T00:21:54.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.113+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~GPR7A12IGVC4.1 size=1048576 2024-09-12T00:21:54.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.117+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~GPR7A12IGVC4.2 size=585685 2024-09-12T00:21:54.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.121+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=GPR7A12IGVC4 tag=GXGT239MN38F type=write size=3731413 2024-09-12T00:21:54.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.125+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=5XJXY8MFIVN5 type=write size=238418 2024-09-12T00:21:54.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.129+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=3032Y7QTS1AY type=del 2024-09-12T00:21:54.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.133+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=ITE7GZYMKHP7 type=del size=936460 2024-09-12T00:21:54.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.141+0000 7fd6489978c0 1 < suggested update operation key=IHYHPKVPWTUL tag=XXJVBLZVRL08 type=write size=598341 2024-09-12T00:21:54.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.145+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=MAW6Q3HASPQG type=del size=2562657 2024-09-12T00:21:54.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.145+0000 7fd6489978c0 1 < completed write operation key=M9YKGQ2GA5CO tag=77G13W59YWK1 type=write size=67568 2024-09-12T00:21:54.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.149+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=9N5CWAB5ELKW type=del size=452983 2024-09-12T00:21:54.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.153+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~XO9TKJS4NN2Y.0 size=564770 2024-09-12T00:21:54.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.161+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=XO9TKJS4NN2Y tag=KSUYZRF3NNPX type=write size=1613346 2024-09-12T00:21:54.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.165+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=JB6IQWA5KQ6B type=del size=2960006 2024-09-12T00:21:54.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.169+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=Z0SZDO58VGZP type=del 2024-09-12T00:21:54.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.177+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~31EDDCN9ASY1.0 size=1048576 2024-09-12T00:21:54.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.177+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~31EDDCN9ASY1.1 size=126572 2024-09-12T00:21:54.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.177+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=31EDDCN9ASY1 tag=CCU5QCAOP9N2 type=write size=2223724 2024-09-12T00:21:54.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.185+0000 7fd6489978c0 1 < suggested remove operation key=9ACGS2FIY7AF tag=5SYF3N2FJMSH type=del 2024-09-12T00:21:54.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.189+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=1HN61LC8XQPZ type=del size=1417252 2024-09-12T00:21:54.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.193+0000 7fd6489978c0 1 < completed delete operation key=LZICTA4BWOW8 tag=N6Q1SLFFJ49L type=del 2024-09-12T00:21:54.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.197+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=NDBHOTNXG80V type=del size=281795 2024-09-12T00:21:54.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.201+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=1ULTI2JMDTKI type=del 2024-09-12T00:21:54.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.205+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~EA28H3RUGXZ2.0 size=1048576 2024-09-12T00:21:54.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.209+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~EA28H3RUGXZ2.1 size=1034811 2024-09-12T00:21:54.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.209+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=EA28H3RUGXZ2 tag=CM22H2SBIMLN type=write size=3131963 2024-09-12T00:21:54.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.213+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~A5MRBBD8TO05.0 size=175855 2024-09-12T00:21:54.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.217+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=A5MRBBD8TO05 tag=B5S5IEW96PQM type=write size=1224431 2024-09-12T00:21:54.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.221+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=9H6M8O7FARWO type=del size=2768629 2024-09-12T00:21:54.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.225+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~24UBL6TTFCGM.0 size=278837 2024-09-12T00:21:54.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.229+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=24UBL6TTFCGM tag=VIIR1DWK060M type=write size=1327413 2024-09-12T00:21:54.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.233+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=4KLSJNU26Q19 type=del size=769972 2024-09-12T00:21:54.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.237+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~8HQMWF3L98XU.0 size=1048576 2024-09-12T00:21:54.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.241+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~8HQMWF3L98XU.1 size=1048576 2024-09-12T00:21:54.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.245+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~8HQMWF3L98XU.2 size=686349 2024-09-12T00:21:54.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.253+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=8HQMWF3L98XU tag=37NIQ3631CSN type=write size=3832077 2024-09-12T00:21:54.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.261+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~YS02O15AQ432.0 size=938122 2024-09-12T00:21:54.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.261+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=YS02O15AQ432 tag=ZCE98SJQL4XT type=write size=1986698 2024-09-12T00:21:54.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.265+0000 7fd6489978c0 1 < completed delete operation key=LZICTA4BWOW8 tag=P8FWC4OO7353 type=del 2024-09-12T00:21:54.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.265+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=452B15QENNIV type=write size=19311 2024-09-12T00:21:54.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.273+0000 7fd6489978c0 1 < suggested remove operation key=B2BW7GQ6UN9I tag=YTJ6RV6GRNJ2 type=del 2024-09-12T00:21:54.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.277+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=AJ6QZVJJO70X type=del size=3461247 2024-09-12T00:21:54.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.281+0000 7fd6489978c0 1 < completed delete operation key=RGE8T6BTHBWK tag=IS5WPA1ME7OE type=del 2024-09-12T00:21:54.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.285+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=X611HOOE9HS3 type=del size=1829621 2024-09-12T00:21:54.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.297+0000 7fd6489978c0 1 < suggested update operation key=3JZP8TZFEIMH tag=PVMM6XYGX5XT type=del size=237854 2024-09-12T00:21:54.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.305+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~UFJKDQYCKRLA.0 size=1048576 2024-09-12T00:21:54.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.305+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~UFJKDQYCKRLA.1 size=1048576 2024-09-12T00:21:54.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.309+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~UFJKDQYCKRLA.2 size=599174 2024-09-12T00:21:54.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.309+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=UFJKDQYCKRLA tag=8PJP500LPA9N type=write size=3744902 2024-09-12T00:21:54.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.313+0000 7fd6489978c0 -1 < failed to complete operation key=3JZP8TZFEIMH tag=5XJXY8MFIVN5 type=write size=238418: (22) Invalid argument 2024-09-12T00:21:54.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.317+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=RLCVPQJXGB72 type=write size=870122 2024-09-12T00:21:54.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.321+0000 7fd6489978c0 -1 < failed to complete operation key=9ACGS2FIY7AF tag=ITE7GZYMKHP7 type=del size=936460: (22) Invalid argument 2024-09-12T00:21:54.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.325+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~2WICHHB249S0.0 size=593887 2024-09-12T00:21:54.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.325+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=2WICHHB249S0 tag=5BYJ6G3H87SE type=write size=1642463 2024-09-12T00:21:54.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.329+0000 7fd6489978c0 -1 < failed to complete operation key=9ACGS2FIY7AF tag=MAW6Q3HASPQG type=del size=2562657: (22) Invalid argument 2024-09-12T00:21:54.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.333+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=RBMN4PRUPSOM type=del size=1310533 2024-09-12T00:21:54.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.341+0000 7fd6489978c0 1 < suggested update operation key=HUKWLE56FRX2 tag=9N5CWAB5ELKW type=del size=452983 2024-09-12T00:21:54.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.345+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=FLJBYK33QLMY type=del size=2020956 2024-09-12T00:21:54.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.349+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=JB6IQWA5KQ6B type=del 2024-09-12T00:21:54.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.353+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=A5DNK6YZJ3DK type=del size=3144577 2024-09-12T00:21:54.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.353+0000 7fd6489978c0 1 < canceled part key=_multipart_J5IW4G9C72DH.2~31EDDCN9ASY1.0 size=1048576 2024-09-12T00:21:54.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.357+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~31EDDCN9ASY1.1 size=126572 2024-09-12T00:21:54.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.361+0000 7fd6489978c0 1 < canceled multipart upload key=J5IW4G9C72DH upload=31EDDCN9ASY1 tag=CCU5QCAOP9N2 type=write size=2223724 2024-09-12T00:21:54.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.365+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=UPPCG5GCQTGL type=del size=3028715 2024-09-12T00:21:54.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.369+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=1HN61LC8XQPZ type=del 2024-09-12T00:21:54.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.373+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=X8XI5N25H195 type=del size=1047877 2024-09-12T00:21:54.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.377+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=NDBHOTNXG80V type=del 2024-09-12T00:21:54.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.381+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=FYZHSJQC4XU2 type=del size=2064116 2024-09-12T00:21:54.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.385+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~EA28H3RUGXZ2.0 size=1048576 2024-09-12T00:21:54.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.389+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~EA28H3RUGXZ2.1 size=1034811 2024-09-12T00:21:54.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.393+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=EA28H3RUGXZ2 tag=CM22H2SBIMLN type=write size=3131963 2024-09-12T00:21:54.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.401+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~35UP7VOG4BMS.0 size=1048576 2024-09-12T00:21:54.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.401+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~35UP7VOG4BMS.1 size=666627 2024-09-12T00:21:54.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.401+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=35UP7VOG4BMS tag=TXMKRFAAP1ND type=write size=2763779 2024-09-12T00:21:54.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.409+0000 7fd6489978c0 1 < suggested update operation key=G4EUTQOHAT2E tag=9H6M8O7FARWO type=del size=2768629 2024-09-12T00:21:54.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.413+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=PIEJUOPALR73 type=del size=904658 2024-09-12T00:21:54.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.417+0000 7fd6489978c0 -1 < failed to complete operation key=HUKWLE56FRX2 tag=4KLSJNU26Q19 type=del size=769972: (22) Invalid argument 2024-09-12T00:21:54.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.421+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=PPUGHLBPWT26 type=del size=1453434 2024-09-12T00:21:54.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.425+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~YS02O15AQ432.0 size=938122 2024-09-12T00:21:54.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.433+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=YS02O15AQ432 tag=ZCE98SJQL4XT type=write size=1986698 2024-09-12T00:21:54.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.437+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=84114OWQNU53 type=del size=2000257 2024-09-12T00:21:54.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.441+0000 7fd6489978c0 1 < completed write operation key=25P4P2I6BE3H tag=452B15QENNIV type=write size=19311 2024-09-12T00:21:54.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.445+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=HEXFT8JCF600 type=write size=98591 2024-09-12T00:21:54.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.453+0000 7fd6489978c0 1 < suggested remove operation key=ZXEIT45BWHXM tag=AJ6QZVJJO70X type=del 2024-09-12T00:21:54.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.457+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=T5J17MO19JPT type=write size=371269 2024-09-12T00:21:54.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.461+0000 7fd6489978c0 -1 < failed to complete operation key=3JZP8TZFEIMH tag=X611HOOE9HS3 type=del size=1829621: (22) Invalid argument 2024-09-12T00:21:54.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.461+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=1XLCSP4AEL72 type=del size=2782745 2024-09-12T00:21:54.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.465+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~UFJKDQYCKRLA.0 size=1048576 2024-09-12T00:21:54.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.469+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~UFJKDQYCKRLA.1 size=1048576 2024-09-12T00:21:54.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.473+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~UFJKDQYCKRLA.2 size=599174 2024-09-12T00:21:54.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.477+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=UFJKDQYCKRLA tag=8PJP500LPA9N type=write size=3744902 2024-09-12T00:21:54.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.481+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=TUI5JCHVUJP1 type=del size=2139971 2024-09-12T00:21:54.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.485+0000 7fd6489978c0 1 < completed write operation key=N4S6I47NSJK6 tag=RLCVPQJXGB72 type=write size=870122 2024-09-12T00:21:54.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.489+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=1UBTLEG0Z92U type=del size=789764 2024-09-12T00:21:54.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.493+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~2WICHHB249S0.0 size=593887 2024-09-12T00:21:54.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.497+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=2WICHHB249S0 tag=5BYJ6G3H87SE type=write size=1642463 2024-09-12T00:21:54.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.505+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~FT3OG7POHAL0.0 size=1048576 2024-09-12T00:21:54.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.509+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~FT3OG7POHAL0.1 size=1048576 2024-09-12T00:21:54.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.509+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~FT3OG7POHAL0.2 size=838641 2024-09-12T00:21:54.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.509+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=FT3OG7POHAL0 tag=3CDYUGPT6K9Q type=write size=3984369 2024-09-12T00:21:54.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.513+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=RBMN4PRUPSOM type=del 2024-09-12T00:21:54.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.517+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=EU3C1ZL95MS4 type=del size=3381159 2024-09-12T00:21:54.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.529+0000 7fd6489978c0 1 < suggested update operation key=YJJBTNI318EH tag=FLJBYK33QLMY type=del size=2020956 2024-09-12T00:21:54.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.537+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~PJMKCHL0Q5PU.0 size=704352 2024-09-12T00:21:54.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.537+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=PJMKCHL0Q5PU tag=OITM2IUZ9AQ8 type=write size=1752928 2024-09-12T00:21:54.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.541+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=A5DNK6YZJ3DK type=del 2024-09-12T00:21:54.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.545+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=VK1NCN55MQMH type=del size=132038 2024-09-12T00:21:54.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.549+0000 7fd6489978c0 1 < canceled operation key=LZICTA4BWOW8 tag=UPPCG5GCQTGL type=del size=3028715 2024-09-12T00:21:54.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.553+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=VX13888AQDW4 type=del size=3879574 2024-09-12T00:21:54.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.557+0000 7fd6489978c0 1 < completed delete operation key=LZICTA4BWOW8 tag=X8XI5N25H195 type=del 2024-09-12T00:21:54.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.565+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=MMWF938YTK9G type=del size=849076 2024-09-12T00:21:54.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.569+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=FYZHSJQC4XU2 type=del 2024-09-12T00:21:54.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.577+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~CT7AU5FVL8QH.0 size=485550 2024-09-12T00:21:54.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.577+0000 7fd6489978c0 1 > prepared multipart upload key=DAOTTEMK2P2T upload=CT7AU5FVL8QH tag=77RX52L3EM3N type=write size=1534126 2024-09-12T00:21:54.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.577+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~35UP7VOG4BMS.0 size=1048576 2024-09-12T00:21:54.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.581+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~35UP7VOG4BMS.1 size=666627 2024-09-12T00:21:54.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.589+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=35UP7VOG4BMS tag=TXMKRFAAP1ND type=write size=2763779 2024-09-12T00:21:54.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.593+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=V2JWYV0HDDLW type=del size=221604 2024-09-12T00:21:54.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.601+0000 7fd6489978c0 1 < suggested remove operation key=GVPNH3JSO07D tag=PIEJUOPALR73 type=del 2024-09-12T00:21:54.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.609+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~8XAQ8IWKI7CB.0 size=738622 2024-09-12T00:21:54.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.609+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=8XAQ8IWKI7CB tag=7K3YWO7YZK6J type=write size=1787198 2024-09-12T00:21:54.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.613+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=PPUGHLBPWT26 type=del 2024-09-12T00:21:54.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.621+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~W3SFM157KCO5.0 size=1048576 2024-09-12T00:21:54.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.621+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~W3SFM157KCO5.1 size=651299 2024-09-12T00:21:54.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.621+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=W3SFM157KCO5 tag=T9TEGAYVH8EF type=write size=2748451 2024-09-12T00:21:54.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.625+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=84114OWQNU53 type=del 2024-09-12T00:21:54.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.633+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~L72ZAHI2M6X0.0 size=1048576 2024-09-12T00:21:54.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.637+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~L72ZAHI2M6X0.1 size=1048576 2024-09-12T00:21:54.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.641+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~L72ZAHI2M6X0.2 size=477251 2024-09-12T00:21:54.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.641+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=L72ZAHI2M6X0 tag=WJUREHYLKIV7 type=write size=3622979 2024-09-12T00:21:54.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.649+0000 7fd6489978c0 1 < suggested remove operation key=JPVKBVRCZTE9 tag=HEXFT8JCF600 type=write 2024-09-12T00:21:54.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.657+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~PTAH18LE2O12.0 size=1048576 2024-09-12T00:21:54.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.661+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~PTAH18LE2O12.1 size=312730 2024-09-12T00:21:54.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.661+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=PTAH18LE2O12 tag=GUY2JQJALHCG type=write size=2409882 2024-09-12T00:21:54.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.665+0000 7fd6489978c0 1 < completed write operation key=B2BW7GQ6UN9I tag=T5J17MO19JPT type=write size=371269 2024-09-12T00:21:54.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.669+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=YAVDTH2AO4SS type=del size=505115 2024-09-12T00:21:54.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.673+0000 7fd6489978c0 -1 < failed to complete operation key=GVPNH3JSO07D tag=1XLCSP4AEL72 type=del size=2782745: (22) Invalid argument 2024-09-12T00:21:54.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.681+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~NBYEQVQMEICL.0 size=745879 2024-09-12T00:21:54.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.681+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=NBYEQVQMEICL tag=9GV3YWH05O1D type=write size=1794455 2024-09-12T00:21:54.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.685+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=TUI5JCHVUJP1 type=del 2024-09-12T00:21:54.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.689+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=T9N4V3JNO8WF type=del size=3755070 2024-09-12T00:21:54.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.693+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=1UBTLEG0Z92U type=del 2024-09-12T00:21:54.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.697+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=9FFNYJCWCJWA type=del size=2997050 2024-09-12T00:21:54.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.697+0000 7fd6489978c0 1 < canceled part key=_multipart_B2BW7GQ6UN9I.2~FT3OG7POHAL0.0 size=1048576 2024-09-12T00:21:54.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.701+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~FT3OG7POHAL0.1 size=1048576 2024-09-12T00:21:54.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.705+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~FT3OG7POHAL0.2 size=838641 2024-09-12T00:21:54.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.709+0000 7fd6489978c0 1 < canceled multipart upload key=B2BW7GQ6UN9I upload=FT3OG7POHAL0 tag=3CDYUGPT6K9Q type=write size=3984369 2024-09-12T00:21:54.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.713+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=JHA9RAD0H4R7 type=del size=779097 2024-09-12T00:21:54.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.717+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=EU3C1ZL95MS4 type=del 2024-09-12T00:21:54.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.725+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~XXCR354C470W.0 size=1048576 2024-09-12T00:21:54.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.729+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~XXCR354C470W.1 size=605638 2024-09-12T00:21:54.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.729+0000 7fd6489978c0 1 > prepared multipart upload key=DAOTTEMK2P2T upload=XXCR354C470W tag=MFN324EP49TL type=write size=2702790 2024-09-12T00:21:54.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.733+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~PJMKCHL0Q5PU.0 size=704352 2024-09-12T00:21:54.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.737+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=PJMKCHL0Q5PU tag=OITM2IUZ9AQ8 type=write size=1752928 2024-09-12T00:21:54.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.741+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=TJHK3D6U1DY4 type=del size=1816755 2024-09-12T00:21:54.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.745+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=VK1NCN55MQMH type=del 2024-09-12T00:21:54.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.753+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~72SUK09UYE6I.0 size=1048576 2024-09-12T00:21:54.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.757+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~72SUK09UYE6I.1 size=640928 2024-09-12T00:21:54.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.757+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=72SUK09UYE6I tag=3JLHGKDTUFWM type=write size=2738080 2024-09-12T00:21:54.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.761+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=VX13888AQDW4 type=del 2024-09-12T00:21:54.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.769+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~LHLLC7KPPFWD.0 size=1048576 2024-09-12T00:21:54.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.769+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~LHLLC7KPPFWD.1 size=1048576 2024-09-12T00:21:54.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.773+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~LHLLC7KPPFWD.2 size=578801 2024-09-12T00:21:54.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.773+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=LHLLC7KPPFWD tag=R41YUQ32SFR6 type=write size=3724529 2024-09-12T00:21:54.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.777+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=MMWF938YTK9G type=del 2024-09-12T00:21:54.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.785+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~RFW6OV42PZEK.0 size=1048576 2024-09-12T00:21:54.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.785+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~RFW6OV42PZEK.1 size=559849 2024-09-12T00:21:54.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.785+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=RFW6OV42PZEK tag=0A0O4XEYDQUW type=write size=2657001 2024-09-12T00:21:54.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.789+0000 7fd6489978c0 1 < canceled part key=_multipart_DAOTTEMK2P2T.2~CT7AU5FVL8QH.0 size=485550 2024-09-12T00:21:54.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.793+0000 7fd6489978c0 1 < canceled multipart upload key=DAOTTEMK2P2T upload=CT7AU5FVL8QH tag=77RX52L3EM3N type=write size=1534126 2024-09-12T00:21:54.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.801+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~P95UI6W7BJZD.0 size=1048576 2024-09-12T00:21:54.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.801+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~P95UI6W7BJZD.1 size=1048576 2024-09-12T00:21:54.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.805+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~P95UI6W7BJZD.2 size=763742 2024-09-12T00:21:54.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.805+0000 7fd6489978c0 1 > prepared multipart upload key=DAOTTEMK2P2T upload=P95UI6W7BJZD tag=ZQM0ZIA1HWGE type=write size=3909470 2024-09-12T00:21:54.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.809+0000 7fd6489978c0 1 < canceled operation key=G4EUTQOHAT2E tag=V2JWYV0HDDLW type=del size=221604 2024-09-12T00:21:54.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.817+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~CTRYXCYHSJJE.0 size=1048576 2024-09-12T00:21:54.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.821+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~CTRYXCYHSJJE.1 size=129360 2024-09-12T00:21:54.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.821+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=CTRYXCYHSJJE tag=WNQGG1AJ8Y47 type=write size=2226512 2024-09-12T00:21:54.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.825+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~8XAQ8IWKI7CB.0 size=738622 2024-09-12T00:21:54.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.829+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=8XAQ8IWKI7CB tag=7K3YWO7YZK6J type=write size=1787198 2024-09-12T00:21:54.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.837+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~VH0OVD2KFRTS.0 size=1048576 2024-09-12T00:21:54.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.837+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~VH0OVD2KFRTS.1 size=335894 2024-09-12T00:21:54.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.837+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=VH0OVD2KFRTS tag=H6TBWBR5F4DB type=write size=2433046 2024-09-12T00:21:54.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.841+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~W3SFM157KCO5.0 size=1048576 2024-09-12T00:21:54.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.845+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~W3SFM157KCO5.1 size=651299 2024-09-12T00:21:54.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.853+0000 7fd6489978c0 1 < completed multipart upload key=9ACGS2FIY7AF upload=W3SFM157KCO5 tag=T9TEGAYVH8EF type=write size=2748451 2024-09-12T00:21:54.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.853+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=DQEL964J3C7T type=del size=2139299 2024-09-12T00:21:54.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.861+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~L72ZAHI2M6X0.0 size=1048576 2024-09-12T00:21:54.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.861+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~L72ZAHI2M6X0.1 size=1048576 2024-09-12T00:21:54.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.865+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~L72ZAHI2M6X0.2 size=477251 2024-09-12T00:21:54.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.873+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=L72ZAHI2M6X0 tag=WJUREHYLKIV7 type=write size=3622979 2024-09-12T00:21:54.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.877+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=FPJBBE8G6OA1 type=del size=3281658 2024-09-12T00:21:54.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.881+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~PTAH18LE2O12.0 size=1048576 2024-09-12T00:21:54.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.881+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~PTAH18LE2O12.1 size=312730 2024-09-12T00:21:54.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.893+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=PTAH18LE2O12 tag=GUY2JQJALHCG type=write size=2409882 2024-09-12T00:21:54.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.897+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=HM1DLYXE14OC type=del size=1395980 2024-09-12T00:21:54.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.901+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=YAVDTH2AO4SS type=del 2024-09-12T00:21:54.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.905+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=WZ4Y1IJYP2Z1 type=del size=2458587 2024-09-12T00:21:54.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.909+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~NBYEQVQMEICL.0 size=745879 2024-09-12T00:21:54.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.917+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=NBYEQVQMEICL tag=9GV3YWH05O1D type=write size=1794455 2024-09-12T00:21:54.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.921+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=HLLM7RAY6AZ1 type=del size=996110 2024-09-12T00:21:54.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.925+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=T9N4V3JNO8WF type=del 2024-09-12T00:21:54.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.929+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=S7AYIKWZ76PL type=del size=3835225 2024-09-12T00:21:54.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.937+0000 7fd6489978c0 1 < suggested update operation key=8JCL0F406L7I tag=9FFNYJCWCJWA type=del size=2997050 2024-09-12T00:21:54.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.941+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=35PPLJ6KPBGA type=del size=3357012 2024-09-12T00:21:54.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.941+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=JHA9RAD0H4R7 type=del 2024-09-12T00:21:54.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.945+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=KSAAJU6BAOJ6 type=write size=206298 2024-09-12T00:21:54.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.949+0000 7fd6489978c0 1 < canceled part key=_multipart_DAOTTEMK2P2T.2~XXCR354C470W.0 size=1048576 2024-09-12T00:21:54.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.949+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~XXCR354C470W.1 size=605638 2024-09-12T00:21:54.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.957+0000 7fd6489978c0 1 < canceled multipart upload key=DAOTTEMK2P2T upload=XXCR354C470W tag=MFN324EP49TL type=write size=2702790 2024-09-12T00:21:54.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.965+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~DQAF8CLOBRXP.0 size=1048576 2024-09-12T00:21:54.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.965+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~DQAF8CLOBRXP.1 size=1048576 2024-09-12T00:21:54.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.969+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~DQAF8CLOBRXP.2 size=6153 2024-09-12T00:21:54.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.969+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=DQAF8CLOBRXP tag=LKZF5ZPU1OG2 type=write size=3151881 2024-09-12T00:21:54.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.977+0000 7fd6489978c0 1 < suggested remove operation key=Y3JFVW74FNT6 tag=TJHK3D6U1DY4 type=del 2024-09-12T00:21:54.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.981+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=CU2R9QB195BH type=del size=3077921 2024-09-12T00:21:54.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.985+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~72SUK09UYE6I.0 size=1048576 2024-09-12T00:21:54.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.985+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~72SUK09UYE6I.1 size=640928 2024-09-12T00:21:54.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.993+0000 7fd6489978c0 1 < completed multipart upload key=N0AAVPQ6MUQ1 upload=72SUK09UYE6I tag=3JLHGKDTUFWM type=write size=2738080 2024-09-12T00:21:54.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:54.997+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=X1MEANV0UD3Z type=del size=2963773 2024-09-12T00:21:54.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.001+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~LHLLC7KPPFWD.0 size=1048576 2024-09-12T00:21:55.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.001+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~LHLLC7KPPFWD.1 size=1048576 2024-09-12T00:21:55.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.005+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~LHLLC7KPPFWD.2 size=578801 2024-09-12T00:21:55.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.013+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=LHLLC7KPPFWD tag=R41YUQ32SFR6 type=write size=3724529 2024-09-12T00:21:55.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.017+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=8O3QLHYK3TJG type=write size=473265 2024-09-12T00:21:55.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.021+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~RFW6OV42PZEK.0 size=1048576 2024-09-12T00:21:55.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.021+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~RFW6OV42PZEK.1 size=559849 2024-09-12T00:21:55.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.029+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=RFW6OV42PZEK tag=0A0O4XEYDQUW type=write size=2657001 2024-09-12T00:21:55.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.033+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=RTL39HIK08VJ type=del size=3365987 2024-09-12T00:21:55.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.037+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~P95UI6W7BJZD.0 size=1048576 2024-09-12T00:21:55.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.041+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~P95UI6W7BJZD.1 size=1048576 2024-09-12T00:21:55.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.045+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~P95UI6W7BJZD.2 size=763742 2024-09-12T00:21:55.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.049+0000 7fd6489978c0 1 < completed multipart upload key=DAOTTEMK2P2T upload=P95UI6W7BJZD tag=ZQM0ZIA1HWGE type=write size=3909470 2024-09-12T00:21:55.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.053+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=VIHZ0720B9I0 type=write size=841872 2024-09-12T00:21:55.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.061+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~CTRYXCYHSJJE.0 size=1048576 2024-09-12T00:21:55.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.061+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~CTRYXCYHSJJE.1 size=129360 2024-09-12T00:21:55.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.069+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=CTRYXCYHSJJE tag=WNQGG1AJ8Y47 type=write size=2226512 2024-09-12T00:21:55.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.077+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~UJ5GAO8SG1UO.0 size=1048576 2024-09-12T00:21:55.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.081+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~UJ5GAO8SG1UO.1 size=1048576 2024-09-12T00:21:55.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.085+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~UJ5GAO8SG1UO.2 size=71575 2024-09-12T00:21:55.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.085+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=UJ5GAO8SG1UO tag=Q2OYXJWTYM5M type=write size=3217303 2024-09-12T00:21:55.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.089+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~VH0OVD2KFRTS.0 size=1048576 2024-09-12T00:21:55.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.089+0000 7fd6489978c0 1 < canceled part key=_multipart_KAT2TB3FGAYG.2~VH0OVD2KFRTS.1 size=335894 2024-09-12T00:21:55.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.093+0000 7fd6489978c0 1 < canceled multipart upload key=KAT2TB3FGAYG upload=VH0OVD2KFRTS tag=H6TBWBR5F4DB type=write size=2433046 2024-09-12T00:21:55.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.097+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=PCB6GN4JAB8F type=del size=2113036 2024-09-12T00:21:55.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.101+0000 7fd6489978c0 1 < completed delete operation key=RGE8T6BTHBWK tag=DQEL964J3C7T type=del 2024-09-12T00:21:55.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.105+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~FNNAJO8MO8AO.0 size=1048576 2024-09-12T00:21:55.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.105+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~FNNAJO8MO8AO.1 size=1048576 2024-09-12T00:21:55.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.109+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~FNNAJO8MO8AO.2 size=131120 2024-09-12T00:21:55.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.109+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=FNNAJO8MO8AO tag=L65VSJI3VCRD type=write size=3276848 2024-09-12T00:21:55.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.113+0000 7fd6489978c0 1 < canceled operation key=ZW51KHCLPYN3 tag=FPJBBE8G6OA1 type=del size=3281658 2024-09-12T00:21:55.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.117+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~RL9NVNRH1HKN.0 size=119175 2024-09-12T00:21:55.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.117+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=RL9NVNRH1HKN tag=0IRTRLKEIAU3 type=write size=1167751 2024-09-12T00:21:55.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.121+0000 7fd6489978c0 1 < suggested update operation key=YSPRZ87DZ2OD tag=HM1DLYXE14OC type=del size=1395980 2024-09-12T00:21:55.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.125+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~B73IQD7MMBCP.0 size=318947 2024-09-12T00:21:55.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.125+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=B73IQD7MMBCP tag=BO6TA0YV4WSJ type=write size=1367523 2024-09-12T00:21:55.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.129+0000 7fd6489978c0 1 < canceled operation key=ZXEIT45BWHXM tag=WZ4Y1IJYP2Z1 type=del size=2458587 2024-09-12T00:21:55.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.133+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~P7L7EP6ST3LH.0 size=1048576 2024-09-12T00:21:55.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.137+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~P7L7EP6ST3LH.1 size=713714 2024-09-12T00:21:55.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.137+0000 7fd6489978c0 1 > prepared multipart upload key=DAOTTEMK2P2T upload=P7L7EP6ST3LH tag=EVCJ15YCCDH8 type=write size=2810866 2024-09-12T00:21:55.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.137+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=HLLM7RAY6AZ1 type=del 2024-09-12T00:21:55.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.141+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=9D3HQSGUWUL9 type=del size=329590 2024-09-12T00:21:55.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.145+0000 7fd6489978c0 1 < suggested update operation key=RGE8T6BTHBWK tag=S7AYIKWZ76PL type=del size=3835225 2024-09-12T00:21:55.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.149+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=796HPSDG9C2I type=del size=1429687 2024-09-12T00:21:55.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.153+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=35PPLJ6KPBGA type=del 2024-09-12T00:21:55.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.157+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~VN0MLK5DXCTL.0 size=208033 2024-09-12T00:21:55.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.157+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=VN0MLK5DXCTL tag=6W96KZVIEMW5 type=write size=1256609 2024-09-12T00:21:55.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.161+0000 7fd6489978c0 1 < completed write operation key=9CK160BK5YYY tag=KSAAJU6BAOJ6 type=write size=206298 2024-09-12T00:21:55.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.165+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~56IXO6FBVSS5.0 size=1048576 2024-09-12T00:21:55.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.165+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~56IXO6FBVSS5.1 size=1048576 2024-09-12T00:21:55.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.169+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~56IXO6FBVSS5.2 size=382583 2024-09-12T00:21:55.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.169+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=56IXO6FBVSS5 tag=IZ7H3IFLHISM type=write size=3528311 2024-09-12T00:21:55.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.173+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~DQAF8CLOBRXP.0 size=1048576 2024-09-12T00:21:55.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.173+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~DQAF8CLOBRXP.1 size=1048576 2024-09-12T00:21:55.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.177+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~DQAF8CLOBRXP.2 size=6153 2024-09-12T00:21:55.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.181+0000 7fd6489978c0 1 < completed multipart upload key=CFID1EVBXOVJ upload=DQAF8CLOBRXP tag=LKZF5ZPU1OG2 type=write size=3151881 2024-09-12T00:21:55.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.185+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=RYMBAB4PU340 type=del size=2007898 2024-09-12T00:21:55.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.189+0000 7fd6489978c0 1 < suggested update operation key=ZXEIT45BWHXM tag=CU2R9QB195BH type=del size=3077921 2024-09-12T00:21:55.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.197+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~DSTO7MIPEGGQ.0 size=1048576 2024-09-12T00:21:55.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.201+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~DSTO7MIPEGGQ.1 size=1048576 2024-09-12T00:21:55.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.205+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~DSTO7MIPEGGQ.2 size=789825 2024-09-12T00:21:55.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.205+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=DSTO7MIPEGGQ tag=H29N444G5R52 type=write size=3935553 2024-09-12T00:21:55.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.209+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=X1MEANV0UD3Z type=del 2024-09-12T00:21:55.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.209+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=EN7IGT8LNBGF type=del size=259352 2024-09-12T00:21:55.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.217+0000 7fd6489978c0 1 < suggested remove operation key=YSPRZ87DZ2OD tag=8O3QLHYK3TJG type=write 2024-09-12T00:21:55.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.221+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=CIOYAQWAT7O2 type=write size=729341 2024-09-12T00:21:55.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.221+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=RTL39HIK08VJ type=del 2024-09-12T00:21:55.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.225+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=4W7LWACZ9D15 type=del size=2626641 2024-09-12T00:21:55.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.229+0000 7fd6489978c0 1 < completed write operation key=CBXBFK3OXXKG tag=VIHZ0720B9I0 type=write size=841872 2024-09-12T00:21:55.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.233+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=VJT4TJNWDCSS type=del size=2124643 2024-09-12T00:21:55.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.233+0000 7fd6489978c0 1 < canceled part key=_multipart_IHYHPKVPWTUL.2~UJ5GAO8SG1UO.0 size=1048576 2024-09-12T00:21:55.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.237+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~UJ5GAO8SG1UO.1 size=1048576 2024-09-12T00:21:55.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.237+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~UJ5GAO8SG1UO.2 size=71575 2024-09-12T00:21:55.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.245+0000 7fd6489978c0 1 < canceled multipart upload key=IHYHPKVPWTUL upload=UJ5GAO8SG1UO tag=Q2OYXJWTYM5M type=write size=3217303 2024-09-12T00:21:55.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.249+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=VYF1R1K5V4MB type=write size=69899 2024-09-12T00:21:55.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.253+0000 7fd6489978c0 1 < completed delete operation key=3JZP8TZFEIMH tag=PCB6GN4JAB8F type=del 2024-09-12T00:21:55.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.253+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=LIDA0VC1KDLT type=del size=1354077 2024-09-12T00:21:55.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.257+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~FNNAJO8MO8AO.0 size=1048576 2024-09-12T00:21:55.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.261+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~FNNAJO8MO8AO.1 size=1048576 2024-09-12T00:21:55.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.265+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~FNNAJO8MO8AO.2 size=131120 2024-09-12T00:21:55.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.269+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=FNNAJO8MO8AO tag=L65VSJI3VCRD type=write size=3276848 2024-09-12T00:21:55.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.273+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~WNM3TP8FVN7H.0 size=1048576 2024-09-12T00:21:55.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.277+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~WNM3TP8FVN7H.1 size=458505 2024-09-12T00:21:55.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.277+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=WNM3TP8FVN7H tag=02GBW668QNZB type=write size=2555657 2024-09-12T00:21:55.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.281+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~RL9NVNRH1HKN.0 size=119175 2024-09-12T00:21:55.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.285+0000 7fd6489978c0 1 < completed multipart upload key=GVPNH3JSO07D upload=RL9NVNRH1HKN tag=0IRTRLKEIAU3 type=write size=1167751 2024-09-12T00:21:55.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.293+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~WFOZU8TAOAKB.0 size=974195 2024-09-12T00:21:55.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.293+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=WFOZU8TAOAKB tag=6KAD8499XAQT type=write size=2022771 2024-09-12T00:21:55.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.297+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~B73IQD7MMBCP.0 size=318947 2024-09-12T00:21:55.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.301+0000 7fd6489978c0 1 < completed multipart upload key=N0AAVPQ6MUQ1 upload=B73IQD7MMBCP tag=BO6TA0YV4WSJ type=write size=1367523 2024-09-12T00:21:55.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.309+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~0UX29OB8XNM0.0 size=1048576 2024-09-12T00:21:55.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.313+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~0UX29OB8XNM0.1 size=716802 2024-09-12T00:21:55.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.313+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=0UX29OB8XNM0 tag=CBHTAMTVNF0Q type=write size=2813954 2024-09-12T00:21:55.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.317+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~P7L7EP6ST3LH.0 size=1048576 2024-09-12T00:21:55.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.321+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~P7L7EP6ST3LH.1 size=713714 2024-09-12T00:21:55.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.325+0000 7fd6489978c0 1 < completed multipart upload key=DAOTTEMK2P2T upload=P7L7EP6ST3LH tag=EVCJ15YCCDH8 type=write size=2810866 2024-09-12T00:21:55.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.329+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=HJWSDCFFM6JA type=del size=445331 2024-09-12T00:21:55.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.333+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=9D3HQSGUWUL9 type=del 2024-09-12T00:21:55.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.337+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=09FRXK1MBT8O type=del size=740405 2024-09-12T00:21:55.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.341+0000 7fd6489978c0 1 < canceled operation key=LZICTA4BWOW8 tag=796HPSDG9C2I type=del size=1429687 2024-09-12T00:21:55.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.349+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~G3L1JC9LTDK3.0 size=922578 2024-09-12T00:21:55.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.349+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=G3L1JC9LTDK3 tag=5I6OZ956UK9C type=write size=1971154 2024-09-12T00:21:55.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.353+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~VN0MLK5DXCTL.0 size=208033 2024-09-12T00:21:55.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.357+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=VN0MLK5DXCTL tag=6W96KZVIEMW5 type=write size=1256609 2024-09-12T00:21:55.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.361+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=62W1UO3ZVCOR type=del size=1927731 2024-09-12T00:21:55.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.365+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~56IXO6FBVSS5.0 size=1048576 2024-09-12T00:21:55.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.369+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~56IXO6FBVSS5.1 size=1048576 2024-09-12T00:21:55.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.373+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~56IXO6FBVSS5.2 size=382583 2024-09-12T00:21:55.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.377+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=56IXO6FBVSS5 tag=IZ7H3IFLHISM type=write size=3528311 2024-09-12T00:21:55.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.385+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~MLTCMA83OREW.0 size=368478 2024-09-12T00:21:55.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.385+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=MLTCMA83OREW tag=QPYT1QOWFY3C type=write size=1417054 2024-09-12T00:21:55.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.393+0000 7fd6489978c0 1 < suggested update operation key=8FBXDX6GELE7 tag=RYMBAB4PU340 type=del size=2007898 2024-09-12T00:21:55.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.397+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~AF2CNDQCNGP8.0 size=1048576 2024-09-12T00:21:55.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.401+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~AF2CNDQCNGP8.1 size=1048576 2024-09-12T00:21:55.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.405+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~AF2CNDQCNGP8.2 size=96969 2024-09-12T00:21:55.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.405+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=AF2CNDQCNGP8 tag=6FPIYBKZXTOU type=write size=3242697 2024-09-12T00:21:55.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.409+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~DSTO7MIPEGGQ.0 size=1048576 2024-09-12T00:21:55.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.409+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~DSTO7MIPEGGQ.1 size=1048576 2024-09-12T00:21:55.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.413+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~DSTO7MIPEGGQ.2 size=789825 2024-09-12T00:21:55.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.421+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=DSTO7MIPEGGQ tag=H29N444G5R52 type=write size=3935553 2024-09-12T00:21:55.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.425+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~RRUJB4XBGGIF.0 size=1048576 2024-09-12T00:21:55.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.429+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~RRUJB4XBGGIF.1 size=244076 2024-09-12T00:21:55.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.429+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=RRUJB4XBGGIF tag=IR4QIIMS9DFR type=write size=2341228 2024-09-12T00:21:55.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.437+0000 7fd6489978c0 1 < suggested remove operation key=J5IW4G9C72DH tag=EN7IGT8LNBGF type=del 2024-09-12T00:21:55.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.445+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~8YO2XYAXXJI2.0 size=671403 2024-09-12T00:21:55.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.445+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=8YO2XYAXXJI2 tag=4TI4MB8UL65X type=write size=1719979 2024-09-12T00:21:55.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.449+0000 7fd6489978c0 -1 < failed to complete operation key=J5IW4G9C72DH tag=CIOYAQWAT7O2 type=write size=729341: (22) Invalid argument 2024-09-12T00:21:55.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.453+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=4Z20I46SXF9B type=del size=3768027 2024-09-12T00:21:55.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.457+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=4W7LWACZ9D15 type=del 2024-09-12T00:21:55.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.461+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=FFDX1E4NG3IR type=del size=2798009 2024-09-12T00:21:55.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.465+0000 7fd6489978c0 1 < canceled operation key=KAT2TB3FGAYG tag=VJT4TJNWDCSS type=del size=2124643 2024-09-12T00:21:55.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.469+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=I8QRWGXG7AYX type=write size=214442 2024-09-12T00:21:55.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.473+0000 7fd6489978c0 1 < completed write operation key=HUKWLE56FRX2 tag=VYF1R1K5V4MB type=write size=69899 2024-09-12T00:21:55.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.477+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=0ZL14E6RJL1Z type=del size=2480421 2024-09-12T00:21:55.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.481+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=LIDA0VC1KDLT type=del 2024-09-12T00:21:55.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.485+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=R7Y4MALBGGSK type=del size=882293 2024-09-12T00:21:55.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.489+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~WNM3TP8FVN7H.0 size=1048576 2024-09-12T00:21:55.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.489+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~WNM3TP8FVN7H.1 size=458505 2024-09-12T00:21:55.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.497+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=WNM3TP8FVN7H tag=02GBW668QNZB type=write size=2555657 2024-09-12T00:21:55.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.501+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=48GX64IORKD5 type=del size=2074681 2024-09-12T00:21:55.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.505+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~WFOZU8TAOAKB.0 size=974195 2024-09-12T00:21:55.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.509+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=WFOZU8TAOAKB tag=6KAD8499XAQT type=write size=2022771 2024-09-12T00:21:55.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.517+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~F23KUQ5CD3PL.0 size=1048576 2024-09-12T00:21:55.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.521+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~F23KUQ5CD3PL.1 size=1048576 2024-09-12T00:21:55.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.525+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~F23KUQ5CD3PL.2 size=495790 2024-09-12T00:21:55.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.525+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=F23KUQ5CD3PL tag=QQ2WT9VI97L9 type=write size=3641518 2024-09-12T00:21:55.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.529+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~0UX29OB8XNM0.0 size=1048576 2024-09-12T00:21:55.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.533+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~0UX29OB8XNM0.1 size=716802 2024-09-12T00:21:55.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.541+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=0UX29OB8XNM0 tag=CBHTAMTVNF0Q type=write size=2813954 2024-09-12T00:21:55.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.545+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~PC4D2B47WVC4.0 size=891516 2024-09-12T00:21:55.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.545+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=PC4D2B47WVC4 tag=TT6GRMZJVH54 type=write size=1940092 2024-09-12T00:21:55.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.549+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=HJWSDCFFM6JA type=del 2024-09-12T00:21:55.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.557+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~JN05UEI2WV1Q.0 size=1048576 2024-09-12T00:21:55.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.561+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~JN05UEI2WV1Q.1 size=390567 2024-09-12T00:21:55.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.561+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=JN05UEI2WV1Q tag=U4ZYIS7RQ67O type=write size=2487719 2024-09-12T00:21:55.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.561+0000 7fd6489978c0 1 < canceled operation key=IHYHPKVPWTUL tag=09FRXK1MBT8O type=del size=740405 2024-09-12T00:21:55.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.569+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~MRGTVN0HR61W.0 size=1048576 2024-09-12T00:21:55.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.573+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~MRGTVN0HR61W.1 size=859241 2024-09-12T00:21:55.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.573+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=MRGTVN0HR61W tag=5TD9B16Y1VL4 type=write size=2956393 2024-09-12T00:21:55.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.577+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~G3L1JC9LTDK3.0 size=922578 2024-09-12T00:21:55.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.581+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=G3L1JC9LTDK3 tag=5I6OZ956UK9C type=write size=1971154 2024-09-12T00:21:55.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.585+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=AGQ8RJKYT70B type=del size=168408 2024-09-12T00:21:55.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.589+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=62W1UO3ZVCOR type=del 2024-09-12T00:21:55.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.593+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=UYQDUEVXEACF type=del size=858653 2024-09-12T00:21:55.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.597+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~MLTCMA83OREW.0 size=368478 2024-09-12T00:21:55.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.605+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=MLTCMA83OREW tag=QPYT1QOWFY3C type=write size=1417054 2024-09-12T00:21:55.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.609+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=UL4GQWNJBN1X type=del size=3151628 2024-09-12T00:21:55.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.613+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~AF2CNDQCNGP8.0 size=1048576 2024-09-12T00:21:55.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.613+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~AF2CNDQCNGP8.1 size=1048576 2024-09-12T00:21:55.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.617+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~AF2CNDQCNGP8.2 size=96969 2024-09-12T00:21:55.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.625+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=AF2CNDQCNGP8 tag=6FPIYBKZXTOU type=write size=3242697 2024-09-12T00:21:55.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.629+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~EZ55TE9OIRAI.0 size=407525 2024-09-12T00:21:55.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.629+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=EZ55TE9OIRAI tag=8U5B21J98SSE type=write size=1456101 2024-09-12T00:21:55.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.633+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~RRUJB4XBGGIF.0 size=1048576 2024-09-12T00:21:55.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.637+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~RRUJB4XBGGIF.1 size=244076 2024-09-12T00:21:55.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.645+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=RRUJB4XBGGIF tag=IR4QIIMS9DFR type=write size=2341228 2024-09-12T00:21:55.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.649+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=CAA35UBTN10M type=del size=1752804 2024-09-12T00:21:55.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.653+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~8YO2XYAXXJI2.0 size=671403 2024-09-12T00:21:55.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.657+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=8YO2XYAXXJI2 tag=4TI4MB8UL65X type=write size=1719979 2024-09-12T00:21:55.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.665+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~ZLVMOGTVXY24.0 size=1048576 2024-09-12T00:21:55.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.665+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~ZLVMOGTVXY24.1 size=1048576 2024-09-12T00:21:55.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.669+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~ZLVMOGTVXY24.2 size=69690 2024-09-12T00:21:55.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.669+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=ZLVMOGTVXY24 tag=WZS0L4YWVIUA type=write size=3215418 2024-09-12T00:21:55.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.673+0000 7fd6489978c0 1 < completed delete operation key=3JZP8TZFEIMH tag=4Z20I46SXF9B type=del 2024-09-12T00:21:55.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.677+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=Y7ZJQ4624CRI type=del size=3173614 2024-09-12T00:21:55.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.685+0000 7fd6489978c0 1 < suggested update operation key=CBXBFK3OXXKG tag=FFDX1E4NG3IR type=del size=2798009 2024-09-12T00:21:55.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.689+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=LHR192S7KVNF type=del size=2201736 2024-09-12T00:21:55.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.693+0000 7fd6489978c0 1 < completed write operation key=G4EUTQOHAT2E tag=I8QRWGXG7AYX type=write size=214442 2024-09-12T00:21:55.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.701+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~MWIM7QA6A6WS.0 size=1048576 2024-09-12T00:21:55.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.705+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~MWIM7QA6A6WS.1 size=545745 2024-09-12T00:21:55.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.705+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=MWIM7QA6A6WS tag=ZUB312DVSJBO type=write size=2642897 2024-09-12T00:21:55.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.709+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=0ZL14E6RJL1Z type=del 2024-09-12T00:21:55.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.713+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=3DJSJ1SLZEEC type=del size=1107910 2024-09-12T00:21:55.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.717+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=R7Y4MALBGGSK type=del 2024-09-12T00:21:55.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.721+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=U5Z84SQERG2J type=del size=3957869 2024-09-12T00:21:55.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.721+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=48GX64IORKD5 type=del 2024-09-12T00:21:55.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.729+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~MRCMEGN7RQAS.0 size=1048576 2024-09-12T00:21:55.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.733+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~MRCMEGN7RQAS.1 size=1048576 2024-09-12T00:21:55.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.733+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~MRCMEGN7RQAS.2 size=135361 2024-09-12T00:21:55.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.733+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=MRCMEGN7RQAS tag=CBFP1WDRZ416 type=write size=3281089 2024-09-12T00:21:55.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.737+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~F23KUQ5CD3PL.0 size=1048576 2024-09-12T00:21:55.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.741+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~F23KUQ5CD3PL.1 size=1048576 2024-09-12T00:21:55.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.745+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~F23KUQ5CD3PL.2 size=495790 2024-09-12T00:21:55.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.749+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=F23KUQ5CD3PL tag=QQ2WT9VI97L9 type=write size=3641518 2024-09-12T00:21:55.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.757+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~C287VDP19HBB.0 size=1048576 2024-09-12T00:21:55.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.761+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~C287VDP19HBB.1 size=1048576 2024-09-12T00:21:55.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.761+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~C287VDP19HBB.2 size=299719 2024-09-12T00:21:55.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.761+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=C287VDP19HBB tag=4PM5NYBPZK3V type=write size=3445447 2024-09-12T00:21:55.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.769+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~PC4D2B47WVC4.0 size=891516 2024-09-12T00:21:55.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.773+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=PC4D2B47WVC4 tag=TT6GRMZJVH54 type=write size=1940092 2024-09-12T00:21:55.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.777+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=S25WPJJVEBRD type=del size=1804612 2024-09-12T00:21:55.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.781+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~JN05UEI2WV1Q.0 size=1048576 2024-09-12T00:21:55.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.785+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~JN05UEI2WV1Q.1 size=390567 2024-09-12T00:21:55.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.789+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=JN05UEI2WV1Q tag=U4ZYIS7RQ67O type=write size=2487719 2024-09-12T00:21:55.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.797+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~VE49X4KTTJ2R.0 size=1048576 2024-09-12T00:21:55.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.797+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~VE49X4KTTJ2R.1 size=960657 2024-09-12T00:21:55.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.797+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=VE49X4KTTJ2R tag=V70L6WVYVAWQ type=write size=3057809 2024-09-12T00:21:55.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.801+0000 7fd6489978c0 1 < canceled part key=_multipart_JPVKBVRCZTE9.2~MRGTVN0HR61W.0 size=1048576 2024-09-12T00:21:55.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.805+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~MRGTVN0HR61W.1 size=859241 2024-09-12T00:21:55.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.809+0000 7fd6489978c0 1 < canceled multipart upload key=JPVKBVRCZTE9 upload=MRGTVN0HR61W tag=5TD9B16Y1VL4 type=write size=2956393 2024-09-12T00:21:55.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.813+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=194ZT1PDIGAD type=del size=4158250 2024-09-12T00:21:55.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.817+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=AGQ8RJKYT70B type=del 2024-09-12T00:21:55.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.821+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=ZZ4SLRJGHG2B type=del size=3475867 2024-09-12T00:21:55.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.825+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=UYQDUEVXEACF type=del 2024-09-12T00:21:55.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.833+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~R12DKV5Z81ZH.0 size=1048576 2024-09-12T00:21:55.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.833+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~R12DKV5Z81ZH.1 size=1048576 2024-09-12T00:21:55.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.837+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~R12DKV5Z81ZH.2 size=989523 2024-09-12T00:21:55.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.837+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=R12DKV5Z81ZH tag=39B82631M798 type=write size=4135251 2024-09-12T00:21:55.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.841+0000 7fd6489978c0 1 < canceled operation key=RGE8T6BTHBWK tag=UL4GQWNJBN1X type=del size=3151628 2024-09-12T00:21:55.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.845+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=ODJ363DPX6E0 type=del size=475636 2024-09-12T00:21:55.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.849+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~EZ55TE9OIRAI.0 size=407525 2024-09-12T00:21:55.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.853+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=EZ55TE9OIRAI tag=8U5B21J98SSE type=write size=1456101 2024-09-12T00:21:55.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.857+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=EG7ONF6XLNEV type=del size=2715775 2024-09-12T00:21:55.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.865+0000 7fd6489978c0 1 < suggested update operation key=ZW51KHCLPYN3 tag=CAA35UBTN10M type=del size=1752804 2024-09-12T00:21:55.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.869+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=5TBYKP0JFEA4 type=del size=3312034 2024-09-12T00:21:55.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.873+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~ZLVMOGTVXY24.0 size=1048576 2024-09-12T00:21:55.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.877+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~ZLVMOGTVXY24.1 size=1048576 2024-09-12T00:21:55.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.885+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~ZLVMOGTVXY24.2 size=69690 2024-09-12T00:21:55.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.889+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=ZLVMOGTVXY24 tag=WZS0L4YWVIUA type=write size=3215418 2024-09-12T00:21:55.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.897+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~QOE8TD9CZ0K2.0 size=1048576 2024-09-12T00:21:55.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.901+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~QOE8TD9CZ0K2.1 size=1048576 2024-09-12T00:21:55.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.901+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~QOE8TD9CZ0K2.2 size=201424 2024-09-12T00:21:55.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.901+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=QOE8TD9CZ0K2 tag=Z1JUOJMNHHN5 type=write size=3347152 2024-09-12T00:21:55.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.909+0000 7fd6489978c0 1 < suggested update operation key=F2CTWM0T2698 tag=Y7ZJQ4624CRI type=del size=3173614 2024-09-12T00:21:55.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.913+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=U2NT0C68JOTG type=write size=501630 2024-09-12T00:21:55.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.921+0000 7fd6489978c0 1 < suggested update operation key=KAT2TB3FGAYG tag=LHR192S7KVNF type=del size=2201736 2024-09-12T00:21:55.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.929+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=KEYYCL4O8B07 type=del size=104653 2024-09-12T00:21:55.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.929+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~MWIM7QA6A6WS.0 size=1048576 2024-09-12T00:21:55.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.933+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~MWIM7QA6A6WS.1 size=545745 2024-09-12T00:21:55.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.941+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=MWIM7QA6A6WS tag=ZUB312DVSJBO type=write size=2642897 2024-09-12T00:21:55.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.945+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~XVI0JV1ERFJQ.0 size=142267 2024-09-12T00:21:55.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.945+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=XVI0JV1ERFJQ tag=DRXG01D9H19V type=write size=1190843 2024-09-12T00:21:55.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.949+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=3DJSJ1SLZEEC type=del 2024-09-12T00:21:55.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.957+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~LB4RTA8K1Y3Z.0 size=1048576 2024-09-12T00:21:55.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.961+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~LB4RTA8K1Y3Z.1 size=1048576 2024-09-12T00:21:55.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.961+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~LB4RTA8K1Y3Z.2 size=876914 2024-09-12T00:21:55.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.961+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=LB4RTA8K1Y3Z tag=DN87NROLBKKX type=write size=4022642 2024-09-12T00:21:55.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.965+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=U5Z84SQERG2J type=del 2024-09-12T00:21:55.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.969+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=AZNNI3XO6MQE type=del size=2846854 2024-09-12T00:21:55.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.973+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~MRCMEGN7RQAS.0 size=1048576 2024-09-12T00:21:55.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.977+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~MRCMEGN7RQAS.1 size=1048576 2024-09-12T00:21:55.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.981+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~MRCMEGN7RQAS.2 size=135361 2024-09-12T00:21:55.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.985+0000 7fd6489978c0 1 < completed multipart upload key=GVPNH3JSO07D upload=MRCMEGN7RQAS tag=CBFP1WDRZ416 type=write size=3281089 2024-09-12T00:21:55.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.989+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=ZIXDI4ID3SFC type=del size=3340711 2024-09-12T00:21:55.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.993+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~C287VDP19HBB.0 size=1048576 2024-09-12T00:21:55.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:55.997+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~C287VDP19HBB.1 size=1048576 2024-09-12T00:21:55.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.001+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~C287VDP19HBB.2 size=299719 2024-09-12T00:21:56.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.005+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=C287VDP19HBB tag=4PM5NYBPZK3V type=write size=3445447 2024-09-12T00:21:56.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.013+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~539X4J3GKXSD.0 size=1048576 2024-09-12T00:21:56.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.017+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~539X4J3GKXSD.1 size=1048576 2024-09-12T00:21:56.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.017+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~539X4J3GKXSD.2 size=904798 2024-09-12T00:21:56.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.017+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=539X4J3GKXSD tag=TEBGGME8A6KQ type=write size=4050526 2024-09-12T00:21:56.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.025+0000 7fd6489978c0 1 < suggested update operation key=CBXBFK3OXXKG tag=S25WPJJVEBRD type=del size=1804612 2024-09-12T00:21:56.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.033+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~IJET0MY7LMFU.0 size=153390 2024-09-12T00:21:56.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.033+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=IJET0MY7LMFU tag=FI19KMUM0X2W type=write size=1201966 2024-09-12T00:21:56.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.037+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~VE49X4KTTJ2R.0 size=1048576 2024-09-12T00:21:56.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.037+0000 7fd6489978c0 1 < canceled part key=_multipart_KAT2TB3FGAYG.2~VE49X4KTTJ2R.1 size=960657 2024-09-12T00:21:56.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.041+0000 7fd6489978c0 1 < canceled multipart upload key=KAT2TB3FGAYG upload=VE49X4KTTJ2R tag=V70L6WVYVAWQ type=write size=3057809 2024-09-12T00:21:56.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.045+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=623EN373XCZT type=del size=2448010 2024-09-12T00:21:56.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.053+0000 7fd6489978c0 1 < suggested remove operation key=B2BW7GQ6UN9I tag=194ZT1PDIGAD type=del 2024-09-12T00:21:56.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.061+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~JQJAQLDZ86QG.0 size=1048576 2024-09-12T00:21:56.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.061+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~JQJAQLDZ86QG.1 size=568323 2024-09-12T00:21:56.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.061+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=JQJAQLDZ86QG tag=OJS3VFTYZF36 type=write size=2665475 2024-09-12T00:21:56.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.065+0000 7fd6489978c0 1 < completed delete operation key=JPVKBVRCZTE9 tag=ZZ4SLRJGHG2B type=del 2024-09-12T00:21:56.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.073+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~KB2OB7QHNNRD.0 size=128170 2024-09-12T00:21:56.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.073+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=KB2OB7QHNNRD tag=SJV7P4RI118U type=write size=1176746 2024-09-12T00:21:56.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.077+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~R12DKV5Z81ZH.0 size=1048576 2024-09-12T00:21:56.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.077+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~R12DKV5Z81ZH.1 size=1048576 2024-09-12T00:21:56.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.081+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~R12DKV5Z81ZH.2 size=989523 2024-09-12T00:21:56.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.089+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=R12DKV5Z81ZH tag=39B82631M798 type=write size=4135251 2024-09-12T00:21:56.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.093+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~FZC0103CIZDX.0 size=1048576 2024-09-12T00:21:56.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.097+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~FZC0103CIZDX.1 size=1048576 2024-09-12T00:21:56.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.101+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~FZC0103CIZDX.2 size=108061 2024-09-12T00:21:56.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.101+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=FZC0103CIZDX tag=UK62N6U89NIT type=write size=3253789 2024-09-12T00:21:56.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.105+0000 7fd6489978c0 -1 < failed to complete operation key=KAT2TB3FGAYG tag=ODJ363DPX6E0 type=del size=475636: (22) Invalid argument 2024-09-12T00:21:56.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.109+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~VPMPQ34AMJ32.0 size=1048576 2024-09-12T00:21:56.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.113+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~VPMPQ34AMJ32.1 size=1048576 2024-09-12T00:21:56.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.117+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~VPMPQ34AMJ32.2 size=671845 2024-09-12T00:21:56.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.117+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=VPMPQ34AMJ32 tag=UCN0C9D42ISB type=write size=3817573 2024-09-12T00:21:56.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.121+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=EG7ONF6XLNEV type=del 2024-09-12T00:21:56.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.125+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=EF3I2BCCM8OF type=del size=2017521 2024-09-12T00:21:56.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.129+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=5TBYKP0JFEA4 type=del 2024-09-12T00:21:56.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.133+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~WDH3DXTL1VQ8.0 size=1048576 2024-09-12T00:21:56.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.137+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~WDH3DXTL1VQ8.1 size=487980 2024-09-12T00:21:56.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.137+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=WDH3DXTL1VQ8 tag=379649S2DXR0 type=write size=2585132 2024-09-12T00:21:56.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.141+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~QOE8TD9CZ0K2.0 size=1048576 2024-09-12T00:21:56.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.141+0000 7fd6489978c0 1 < canceled part key=_multipart_B2BW7GQ6UN9I.2~QOE8TD9CZ0K2.1 size=1048576 2024-09-12T00:21:56.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.145+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~QOE8TD9CZ0K2.2 size=201424 2024-09-12T00:21:56.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.149+0000 7fd6489978c0 1 < canceled multipart upload key=B2BW7GQ6UN9I upload=QOE8TD9CZ0K2 tag=Z1JUOJMNHHN5 type=write size=3347152 2024-09-12T00:21:56.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.153+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=GLS8UU5D7ILO type=del size=1225613 2024-09-12T00:21:56.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.161+0000 7fd6489978c0 1 < completed write operation key=G4EUTQOHAT2E tag=U2NT0C68JOTG type=write size=501630 2024-09-12T00:21:56.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.165+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=U3IWCF5ZE72V type=del size=2919442 2024-09-12T00:21:56.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.169+0000 7fd6489978c0 1 < completed delete operation key=LZICTA4BWOW8 tag=KEYYCL4O8B07 type=del 2024-09-12T00:21:56.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.173+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~797JD2EN7MZE.0 size=1048576 2024-09-12T00:21:56.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.177+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~797JD2EN7MZE.1 size=1048576 2024-09-12T00:21:56.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.181+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~797JD2EN7MZE.2 size=961180 2024-09-12T00:21:56.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.181+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=797JD2EN7MZE tag=UDYEBUO4YLZK type=write size=4106908 2024-09-12T00:21:56.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.185+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~XVI0JV1ERFJQ.0 size=142267 2024-09-12T00:21:56.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.189+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=XVI0JV1ERFJQ tag=DRXG01D9H19V type=write size=1190843 2024-09-12T00:21:56.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.193+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=M02VIG0E0I7Y type=del size=997363 2024-09-12T00:21:56.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.197+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~LB4RTA8K1Y3Z.0 size=1048576 2024-09-12T00:21:56.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.201+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~LB4RTA8K1Y3Z.1 size=1048576 2024-09-12T00:21:56.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.205+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~LB4RTA8K1Y3Z.2 size=876914 2024-09-12T00:21:56.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.209+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=LB4RTA8K1Y3Z tag=DN87NROLBKKX type=write size=4022642 2024-09-12T00:21:56.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.213+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=EH0FBO113M2K type=del size=2523114 2024-09-12T00:21:56.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.217+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=AZNNI3XO6MQE type=del 2024-09-12T00:21:56.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.225+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=L5KDZXSTWH2R type=del size=2683921 2024-09-12T00:21:56.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.229+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=ZIXDI4ID3SFC type=del 2024-09-12T00:21:56.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.233+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~CMLCM3D4H1UP.0 size=1048576 2024-09-12T00:21:56.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.237+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~CMLCM3D4H1UP.1 size=407779 2024-09-12T00:21:56.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.237+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=CMLCM3D4H1UP tag=4BSJGZSJIBI3 type=write size=2504931 2024-09-12T00:21:56.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.241+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~539X4J3GKXSD.0 size=1048576 2024-09-12T00:21:56.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.245+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~539X4J3GKXSD.1 size=1048576 2024-09-12T00:21:56.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.245+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~539X4J3GKXSD.2 size=904798 2024-09-12T00:21:56.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.253+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=539X4J3GKXSD tag=TEBGGME8A6KQ type=write size=4050526 2024-09-12T00:21:56.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.261+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~7IMCOMCRNGQU.0 size=594983 2024-09-12T00:21:56.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.261+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=7IMCOMCRNGQU tag=N3PIQ8NOXX71 type=write size=1643559 2024-09-12T00:21:56.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.261+0000 7fd6489978c0 1 < canceled part key=_multipart_K9FD1L86Q05B.2~IJET0MY7LMFU.0 size=153390 2024-09-12T00:21:56.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.269+0000 7fd6489978c0 1 < canceled multipart upload key=K9FD1L86Q05B upload=IJET0MY7LMFU tag=FI19KMUM0X2W type=write size=1201966 2024-09-12T00:21:56.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.273+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=R00HMM974U3O type=del size=3007259 2024-09-12T00:21:56.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.277+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=623EN373XCZT type=del 2024-09-12T00:21:56.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.281+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=3WMFP1AKLRE4 type=del size=2998099 2024-09-12T00:21:56.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.281+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~JQJAQLDZ86QG.0 size=1048576 2024-09-12T00:21:56.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.285+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~JQJAQLDZ86QG.1 size=568323 2024-09-12T00:21:56.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.293+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=JQJAQLDZ86QG tag=OJS3VFTYZF36 type=write size=2665475 2024-09-12T00:21:56.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.297+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=XJSYCL9JBKSZ type=del size=3923280 2024-09-12T00:21:56.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.301+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~KB2OB7QHNNRD.0 size=128170 2024-09-12T00:21:56.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.305+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=KB2OB7QHNNRD tag=SJV7P4RI118U type=write size=1176746 2024-09-12T00:21:56.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.309+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=IM5COSDB69KS type=del size=2020751 2024-09-12T00:21:56.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.313+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~FZC0103CIZDX.0 size=1048576 2024-09-12T00:21:56.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.317+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~FZC0103CIZDX.1 size=1048576 2024-09-12T00:21:56.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.321+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~FZC0103CIZDX.2 size=108061 2024-09-12T00:21:56.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.325+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=FZC0103CIZDX tag=UK62N6U89NIT type=write size=3253789 2024-09-12T00:21:56.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.333+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~QPS70AUH0DRG.0 size=1048576 2024-09-12T00:21:56.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.337+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~QPS70AUH0DRG.1 size=1048576 2024-09-12T00:21:56.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.341+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~QPS70AUH0DRG.2 size=672760 2024-09-12T00:21:56.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.341+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=QPS70AUH0DRG tag=AXCL5Y0FZG3O type=write size=3818488 2024-09-12T00:21:56.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.345+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~VPMPQ34AMJ32.0 size=1048576 2024-09-12T00:21:56.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.349+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~VPMPQ34AMJ32.1 size=1048576 2024-09-12T00:21:56.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.353+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~VPMPQ34AMJ32.2 size=671845 2024-09-12T00:21:56.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.357+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=VPMPQ34AMJ32 tag=UCN0C9D42ISB type=write size=3817573 2024-09-12T00:21:56.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.361+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=22I6JU9CVGDG type=write size=294370 2024-09-12T00:21:56.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.369+0000 7fd6489978c0 1 < suggested remove operation key=N0AAVPQ6MUQ1 tag=EF3I2BCCM8OF type=del 2024-09-12T00:21:56.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.377+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~3GQ3DLYJ27AG.0 size=611810 2024-09-12T00:21:56.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.377+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=3GQ3DLYJ27AG tag=5EGUZ0O4R6FP type=write size=1660386 2024-09-12T00:21:56.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.381+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~WDH3DXTL1VQ8.0 size=1048576 2024-09-12T00:21:56.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.381+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~WDH3DXTL1VQ8.1 size=487980 2024-09-12T00:21:56.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.389+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=WDH3DXTL1VQ8 tag=379649S2DXR0 type=write size=2585132 2024-09-12T00:21:56.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.397+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~EL3SJ0658WTY.0 size=1048576 2024-09-12T00:21:56.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.397+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~EL3SJ0658WTY.1 size=1048576 2024-09-12T00:21:56.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.401+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~EL3SJ0658WTY.2 size=895023 2024-09-12T00:21:56.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.401+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=EL3SJ0658WTY tag=6GJ5EZ42PLG4 type=write size=4040751 2024-09-12T00:21:56.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.405+0000 7fd6489978c0 1 < canceled operation key=J5IW4G9C72DH tag=GLS8UU5D7ILO type=del size=1225613 2024-09-12T00:21:56.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.409+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=07SDTY8ZOANV type=del size=1754416 2024-09-12T00:21:56.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.413+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=U3IWCF5ZE72V type=del 2024-09-12T00:21:56.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.417+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=F8YUY3KWSXHB type=write size=848820 2024-09-12T00:21:56.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.421+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~797JD2EN7MZE.0 size=1048576 2024-09-12T00:21:56.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.425+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~797JD2EN7MZE.1 size=1048576 2024-09-12T00:21:56.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.425+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~797JD2EN7MZE.2 size=961180 2024-09-12T00:21:56.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.433+0000 7fd6489978c0 1 < completed multipart upload key=N0AAVPQ6MUQ1 upload=797JD2EN7MZE tag=UDYEBUO4YLZK type=write size=4106908 2024-09-12T00:21:56.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.437+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=M6T46K590TOW type=del size=173611 2024-09-12T00:21:56.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.441+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=M02VIG0E0I7Y type=del 2024-09-12T00:21:56.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.445+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=4Z6ZY18V18MB type=del size=2663246 2024-09-12T00:21:56.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.449+0000 7fd6489978c0 1 < canceled operation key=CFID1EVBXOVJ tag=EH0FBO113M2K type=del size=2523114 2024-09-12T00:21:56.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.453+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=W90YRMRMZ27V type=del size=3942012 2024-09-12T00:21:56.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.457+0000 7fd6489978c0 1 < suggested update operation key=JPVKBVRCZTE9 tag=L5KDZXSTWH2R type=del size=2683921 2024-09-12T00:21:56.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.461+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=4I79W1FCPZ1N type=del size=924349 2024-09-12T00:21:56.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.469+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~CMLCM3D4H1UP.0 size=1048576 2024-09-12T00:21:56.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.469+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~CMLCM3D4H1UP.1 size=407779 2024-09-12T00:21:56.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.477+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=CMLCM3D4H1UP tag=4BSJGZSJIBI3 type=write size=2504931 2024-09-12T00:21:56.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.481+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=6FK4JHI93V5H type=del size=3681894 2024-09-12T00:21:56.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.485+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~7IMCOMCRNGQU.0 size=594983 2024-09-12T00:21:56.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.489+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=7IMCOMCRNGQU tag=N3PIQ8NOXX71 type=write size=1643559 2024-09-12T00:21:56.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.493+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=03OJVA28N426 type=write size=284816 2024-09-12T00:21:56.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.497+0000 7fd6489978c0 1 < canceled operation key=ZW51KHCLPYN3 tag=R00HMM974U3O type=del size=3007259 2024-09-12T00:21:56.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.501+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=JHD68E0Y91O1 type=del size=1607944 2024-09-12T00:21:56.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.505+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=3WMFP1AKLRE4 type=del 2024-09-12T00:21:56.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.509+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=HFSFB2HLXIZ9 type=del size=3862496 2024-09-12T00:21:56.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.517+0000 7fd6489978c0 1 < suggested update operation key=YSPRZ87DZ2OD tag=XJSYCL9JBKSZ type=del size=3923280 2024-09-12T00:21:56.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.525+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~M6ECRHW19AMA.0 size=1048576 2024-09-12T00:21:56.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.525+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~M6ECRHW19AMA.1 size=1048576 2024-09-12T00:21:56.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.529+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~M6ECRHW19AMA.2 size=950042 2024-09-12T00:21:56.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.529+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=M6ECRHW19AMA tag=LMFFMBBF43Y9 type=write size=4095770 2024-09-12T00:21:56.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.537+0000 7fd6489978c0 1 < suggested update operation key=Y3JFVW74FNT6 tag=IM5COSDB69KS type=del size=2020751 2024-09-12T00:21:56.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.541+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=T4ERJK09V0RW type=write size=1030923 2024-09-12T00:21:56.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.545+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~QPS70AUH0DRG.0 size=1048576 2024-09-12T00:21:56.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.549+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~QPS70AUH0DRG.1 size=1048576 2024-09-12T00:21:56.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.549+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~QPS70AUH0DRG.2 size=672760 2024-09-12T00:21:56.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.557+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=QPS70AUH0DRG tag=AXCL5Y0FZG3O type=write size=3818488 2024-09-12T00:21:56.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.561+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=SKQG559SLULC type=write size=580069 2024-09-12T00:21:56.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.565+0000 7fd6489978c0 1 < completed write operation key=QBS4N1KGR1JB tag=22I6JU9CVGDG type=write size=294370 2024-09-12T00:21:56.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.569+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=TH9HHH6QTTS3 type=del size=3365654 2024-09-12T00:21:56.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.577+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~3GQ3DLYJ27AG.0 size=611810 2024-09-12T00:21:56.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.581+0000 7fd6489978c0 1 < completed multipart upload key=CFID1EVBXOVJ upload=3GQ3DLYJ27AG tag=5EGUZ0O4R6FP type=write size=1660386 2024-09-12T00:21:56.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.585+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=GA0U3HH0RLYC type=write size=5255 2024-09-12T00:21:56.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.585+0000 7fd6489978c0 1 < canceled part key=_multipart_HUKWLE56FRX2.2~EL3SJ0658WTY.0 size=1048576 2024-09-12T00:21:56.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.589+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~EL3SJ0658WTY.1 size=1048576 2024-09-12T00:21:56.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.593+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~EL3SJ0658WTY.2 size=895023 2024-09-12T00:21:56.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.597+0000 7fd6489978c0 1 < canceled multipart upload key=HUKWLE56FRX2 upload=EL3SJ0658WTY tag=6GJ5EZ42PLG4 type=write size=4040751 2024-09-12T00:21:56.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.605+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~RMTH7VP18TUG.0 size=354571 2024-09-12T00:21:56.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.605+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=RMTH7VP18TUG tag=OE1739BN2S2T type=write size=1403147 2024-09-12T00:21:56.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.609+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=07SDTY8ZOANV type=del 2024-09-12T00:21:56.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.613+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=AY24XHSF2I79 type=del size=2405863 2024-09-12T00:21:56.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.617+0000 7fd6489978c0 1 < completed write operation key=KAT2TB3FGAYG tag=F8YUY3KWSXHB type=write size=848820 2024-09-12T00:21:56.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.621+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=TCGJWNRBI6LF type=del size=657781 2024-09-12T00:21:56.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.625+0000 7fd6489978c0 1 < completed delete operation key=3JZP8TZFEIMH tag=M6T46K590TOW type=del 2024-09-12T00:21:56.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.629+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=CATCJZU036SE type=del size=353726 2024-09-12T00:21:56.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.633+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=4Z6ZY18V18MB type=del 2024-09-12T00:21:56.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.641+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~8X63VU3XZ7QD.0 size=11626 2024-09-12T00:21:56.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.641+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=8X63VU3XZ7QD tag=HY29DY97M9DK type=write size=1060202 2024-09-12T00:21:56.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.645+0000 7fd6489978c0 1 < canceled operation key=J5IW4G9C72DH tag=W90YRMRMZ27V type=del size=3942012 2024-09-12T00:21:56.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.649+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~QIHK911KKJE6.0 size=1048576 2024-09-12T00:21:56.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.653+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~QIHK911KKJE6.1 size=1048576 2024-09-12T00:21:56.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.657+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~QIHK911KKJE6.2 size=454215 2024-09-12T00:21:56.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.657+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=QIHK911KKJE6 tag=VDG4EBXPKZC8 type=write size=3599943 2024-09-12T00:21:56.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.665+0000 7fd6489978c0 1 < suggested update operation key=YJJBTNI318EH tag=4I79W1FCPZ1N type=del size=924349 2024-09-12T00:21:56.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.669+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=0QPSA8L1LM3M type=del size=488874 2024-09-12T00:21:56.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.677+0000 7fd6489978c0 1 < suggested update operation key=ZXEIT45BWHXM tag=6FK4JHI93V5H type=del size=3681894 2024-09-12T00:21:56.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.681+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=TBKN1AW007JW type=del size=82838 2024-09-12T00:21:56.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.689+0000 7fd6489978c0 1 < suggested remove operation key=2KP09UFI3N8B tag=03OJVA28N426 type=write 2024-09-12T00:21:56.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.689+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=2VK1XLSAOL1N type=del size=3290560 2024-09-12T00:21:56.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.693+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=JHD68E0Y91O1 type=del 2024-09-12T00:21:56.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.697+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=7C4FIMTV66A5 type=del size=2054826 2024-09-12T00:21:56.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.701+0000 7fd6489978c0 1 < completed delete operation key=B2BW7GQ6UN9I tag=HFSFB2HLXIZ9 type=del 2024-09-12T00:21:56.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.705+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=GRJRW89FZQB5 type=del size=3715795 2024-09-12T00:21:56.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.709+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~M6ECRHW19AMA.0 size=1048576 2024-09-12T00:21:56.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.713+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~M6ECRHW19AMA.1 size=1048576 2024-09-12T00:21:56.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.717+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~M6ECRHW19AMA.2 size=950042 2024-09-12T00:21:56.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.721+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=M6ECRHW19AMA tag=LMFFMBBF43Y9 type=write size=4095770 2024-09-12T00:21:56.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.725+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=ZKSWYNIVUETF type=del size=4098339 2024-09-12T00:21:56.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.729+0000 7fd6489978c0 1 < completed write operation key=3JZP8TZFEIMH tag=T4ERJK09V0RW type=write size=1030923 2024-09-12T00:21:56.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.733+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=0JC4DA4VHAK7 type=del size=2761221 2024-09-12T00:21:56.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.737+0000 7fd6489978c0 1 < completed write operation key=J5IW4G9C72DH tag=SKQG559SLULC type=write size=580069 2024-09-12T00:21:56.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.745+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~FW9D93EVOXAM.0 size=1048576 2024-09-12T00:21:56.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.749+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~FW9D93EVOXAM.1 size=1048576 2024-09-12T00:21:56.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.753+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~FW9D93EVOXAM.2 size=185858 2024-09-12T00:21:56.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.753+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=FW9D93EVOXAM tag=K7LOQXV5LLVC type=write size=3331586 2024-09-12T00:21:56.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.753+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=TH9HHH6QTTS3 type=del 2024-09-12T00:21:56.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.761+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~LYICD7PYMM7Y.0 size=85951 2024-09-12T00:21:56.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.761+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=LYICD7PYMM7Y tag=F4MFKYT8B3XX type=write size=1134527 2024-09-12T00:21:56.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.769+0000 7fd6489978c0 1 < suggested remove operation key=KAT2TB3FGAYG tag=GA0U3HH0RLYC type=write 2024-09-12T00:21:56.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.773+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=5PS4CZAISL3I type=del size=739617 2024-09-12T00:21:56.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.777+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~RMTH7VP18TUG.0 size=354571 2024-09-12T00:21:56.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.785+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=RMTH7VP18TUG tag=OE1739BN2S2T type=write size=1403147 2024-09-12T00:21:56.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.789+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~S15QM10YM5V6.0 size=345923 2024-09-12T00:21:56.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.789+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=S15QM10YM5V6 tag=B9OK7LEYA4LP type=write size=1394499 2024-09-12T00:21:56.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.793+0000 7fd6489978c0 1 < completed delete operation key=RGE8T6BTHBWK tag=AY24XHSF2I79 type=del 2024-09-12T00:21:56.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.801+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~F076R0W4OSXX.0 size=810185 2024-09-12T00:21:56.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.801+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=F076R0W4OSXX tag=GG5E9W0IG9XQ type=write size=1858761 2024-09-12T00:21:56.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.805+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=TCGJWNRBI6LF type=del 2024-09-12T00:21:56.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.809+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=FSHEX3EBEIF2 type=del size=2732069 2024-09-12T00:21:56.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.817+0000 7fd6489978c0 1 < suggested remove operation key=M9YKGQ2GA5CO tag=CATCJZU036SE type=del 2024-09-12T00:21:56.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.821+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=DMIYPLKIUOVN type=del size=431022 2024-09-12T00:21:56.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.825+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~8X63VU3XZ7QD.0 size=11626 2024-09-12T00:21:56.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.833+0000 7fd6489978c0 1 < completed multipart upload key=CFID1EVBXOVJ upload=8X63VU3XZ7QD tag=HY29DY97M9DK type=write size=1060202 2024-09-12T00:21:56.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.837+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=13MJ9CJB03VO type=write size=63605 2024-09-12T00:21:56.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.841+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~QIHK911KKJE6.0 size=1048576 2024-09-12T00:21:56.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.841+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~QIHK911KKJE6.1 size=1048576 2024-09-12T00:21:56.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.841+0000 7fd6489978c0 1 < canceled part key=_multipart_3JZP8TZFEIMH.2~QIHK911KKJE6.2 size=454215 2024-09-12T00:21:56.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.849+0000 7fd6489978c0 1 < canceled multipart upload key=3JZP8TZFEIMH upload=QIHK911KKJE6 tag=VDG4EBXPKZC8 type=write size=3599943 2024-09-12T00:21:56.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.853+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=YHRMTABR88N3 type=del size=729844 2024-09-12T00:21:56.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.857+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=0QPSA8L1LM3M type=del 2024-09-12T00:21:56.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.865+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~5HKQELC0IGLM.0 size=1048576 2024-09-12T00:21:56.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.865+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~5HKQELC0IGLM.1 size=912086 2024-09-12T00:21:56.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.865+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=5HKQELC0IGLM tag=BFGX8G1V9FGP type=write size=3009238 2024-09-12T00:21:56.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.869+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=TBKN1AW007JW type=del 2024-09-12T00:21:56.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.873+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=SW8ZI4VN0Y9A type=del size=3116356 2024-09-12T00:21:56.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.877+0000 7fd6489978c0 -1 < no bi entry to suggest for operation key=M9YKGQ2GA5CO tag=2VK1XLSAOL1N type=del size=3290560: (2) No such file or directory 2024-09-12T00:21:56.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.881+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~1ZM2473CWQT0.0 size=1048576 2024-09-12T00:21:56.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.885+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~1ZM2473CWQT0.1 size=1048576 2024-09-12T00:21:56.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.889+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~1ZM2473CWQT0.2 size=614384 2024-09-12T00:21:56.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.889+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=1ZM2473CWQT0 tag=4IC7HU90V581 type=write size=3760112 2024-09-12T00:21:56.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.893+0000 7fd6489978c0 1 < completed delete operation key=3JZP8TZFEIMH tag=7C4FIMTV66A5 type=del 2024-09-12T00:21:56.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.901+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~0Z5JIRGJSNZL.0 size=1048576 2024-09-12T00:21:56.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.901+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~0Z5JIRGJSNZL.1 size=130004 2024-09-12T00:21:56.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.901+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=0Z5JIRGJSNZL tag=G4KSK4ZX20N3 type=write size=2227156 2024-09-12T00:21:56.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.905+0000 7fd6489978c0 1 < canceled operation key=25P4P2I6BE3H tag=GRJRW89FZQB5 type=del size=3715795 2024-09-12T00:21:56.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.913+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~V2K2LP9XQUOF.0 size=1048576 2024-09-12T00:21:56.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.917+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~V2K2LP9XQUOF.1 size=806678 2024-09-12T00:21:56.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.917+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=V2K2LP9XQUOF tag=RDUTNS1ZGUN7 type=write size=2903830 2024-09-12T00:21:56.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.925+0000 7fd6489978c0 1 < suggested remove operation key=CFID1EVBXOVJ tag=ZKSWYNIVUETF type=del 2024-09-12T00:21:56.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.929+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~LG3XNT5Y4IDG.0 size=505064 2024-09-12T00:21:56.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.929+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=LG3XNT5Y4IDG tag=BXNSE4F3J0GA type=write size=1553640 2024-09-12T00:21:56.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.937+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=0JC4DA4VHAK7 type=del 2024-09-12T00:21:56.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.945+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~XS8ZDBIWM375.0 size=537739 2024-09-12T00:21:56.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.945+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=XS8ZDBIWM375 tag=IT3ZZWBPWZDC type=write size=1586315 2024-09-12T00:21:56.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.949+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~FW9D93EVOXAM.0 size=1048576 2024-09-12T00:21:56.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.953+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~FW9D93EVOXAM.1 size=1048576 2024-09-12T00:21:56.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.953+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~FW9D93EVOXAM.2 size=185858 2024-09-12T00:21:56.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.961+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=FW9D93EVOXAM tag=K7LOQXV5LLVC type=write size=3331586 2024-09-12T00:21:56.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.965+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=34FNBHAI91RZ type=del size=2797055 2024-09-12T00:21:56.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.969+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~LYICD7PYMM7Y.0 size=85951 2024-09-12T00:21:56.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.973+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=LYICD7PYMM7Y tag=F4MFKYT8B3XX type=write size=1134527 2024-09-12T00:21:56.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.977+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=NHEMD3Q105HY type=write size=181910 2024-09-12T00:21:56.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.981+0000 7fd6489978c0 1 < completed delete operation key=JPVKBVRCZTE9 tag=5PS4CZAISL3I type=del 2024-09-12T00:21:56.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.989+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~ANC79OWS7MLD.0 size=657523 2024-09-12T00:21:56.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.989+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=ANC79OWS7MLD tag=VL31355PCW00 type=write size=1706099 2024-09-12T00:21:56.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.993+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~S15QM10YM5V6.0 size=345923 2024-09-12T00:21:56.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:56.997+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=S15QM10YM5V6 tag=B9OK7LEYA4LP type=write size=1394499 2024-09-12T00:21:57.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.001+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=FFYLUH03OU81 type=del size=2246766 2024-09-12T00:21:57.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.005+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~F076R0W4OSXX.0 size=810185 2024-09-12T00:21:57.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.013+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=F076R0W4OSXX tag=GG5E9W0IG9XQ type=write size=1858761 2024-09-12T00:21:57.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.017+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~R31NAK6MSQ8D.0 size=1048576 2024-09-12T00:21:57.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.021+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~R31NAK6MSQ8D.1 size=782921 2024-09-12T00:21:57.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.021+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=R31NAK6MSQ8D tag=70GUOYA07Q4N type=write size=2880073 2024-09-12T00:21:57.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.029+0000 7fd6489978c0 1 < suggested remove operation key=ES2BLTWZT6PT tag=FSHEX3EBEIF2 type=del 2024-09-12T00:21:57.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.037+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~IVQH6WJV53JY.0 size=156212 2024-09-12T00:21:57.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.037+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=IVQH6WJV53JY tag=1OXPCT27VFQM type=write size=1204788 2024-09-12T00:21:57.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.041+0000 7fd6489978c0 1 < suggested remove operation key=KAT2TB3FGAYG tag=DMIYPLKIUOVN type=del 2024-09-12T00:21:57.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.045+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=LU3857769DGI type=write size=662158 2024-09-12T00:21:57.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.053+0000 7fd6489978c0 1 < suggested update operation key=ZW51KHCLPYN3 tag=13MJ9CJB03VO type=write size=63605 2024-09-12T00:21:57.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.061+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~EOEFW88823T9.0 size=1048576 2024-09-12T00:21:57.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.065+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~EOEFW88823T9.1 size=1048576 2024-09-12T00:21:57.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.065+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~EOEFW88823T9.2 size=266297 2024-09-12T00:21:57.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.065+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=EOEFW88823T9 tag=DZD0DNV1Q0R2 type=write size=3412025 2024-09-12T00:21:57.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.069+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=YHRMTABR88N3 type=del 2024-09-12T00:21:57.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.073+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~Z2L819G1LB6Y.0 size=528396 2024-09-12T00:21:57.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.073+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=Z2L819G1LB6Y tag=MW3GIUSYO93B type=write size=1576972 2024-09-12T00:21:57.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.077+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~5HKQELC0IGLM.0 size=1048576 2024-09-12T00:21:57.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.081+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~5HKQELC0IGLM.1 size=912086 2024-09-12T00:21:57.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.085+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=5HKQELC0IGLM tag=BFGX8G1V9FGP type=write size=3009238 2024-09-12T00:21:57.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.089+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=TOPCQXLUTKMP type=write size=151914 2024-09-12T00:21:57.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.093+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=SW8ZI4VN0Y9A type=del 2024-09-12T00:21:57.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.097+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=OWR78G93Q8SO type=del size=3808618 2024-09-12T00:21:57.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.101+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~1ZM2473CWQT0.0 size=1048576 2024-09-12T00:21:57.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.101+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~1ZM2473CWQT0.1 size=1048576 2024-09-12T00:21:57.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.105+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~1ZM2473CWQT0.2 size=614384 2024-09-12T00:21:57.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.109+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=1ZM2473CWQT0 tag=4IC7HU90V581 type=write size=3760112 2024-09-12T00:21:57.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.113+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=OC59EZ2C88EL type=del size=3635622 2024-09-12T00:21:57.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.117+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~0Z5JIRGJSNZL.0 size=1048576 2024-09-12T00:21:57.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.121+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~0Z5JIRGJSNZL.1 size=130004 2024-09-12T00:21:57.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.125+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=0Z5JIRGJSNZL tag=G4KSK4ZX20N3 type=write size=2227156 2024-09-12T00:21:57.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.129+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~QAFYWBX6GDQK.0 size=1048576 2024-09-12T00:21:57.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.133+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~QAFYWBX6GDQK.1 size=1048576 2024-09-12T00:21:57.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.133+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~QAFYWBX6GDQK.2 size=724712 2024-09-12T00:21:57.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.133+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=QAFYWBX6GDQK tag=735YLQFG8WTA type=write size=3870440 2024-09-12T00:21:57.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.137+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~V2K2LP9XQUOF.0 size=1048576 2024-09-12T00:21:57.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.141+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~V2K2LP9XQUOF.1 size=806678 2024-09-12T00:21:57.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.145+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=V2K2LP9XQUOF tag=RDUTNS1ZGUN7 type=write size=2903830 2024-09-12T00:21:57.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.149+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=AQ3ATY1328GM type=del size=441733 2024-09-12T00:21:57.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.149+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~LG3XNT5Y4IDG.0 size=505064 2024-09-12T00:21:57.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.157+0000 7fd6489978c0 1 < completed multipart upload key=N0AAVPQ6MUQ1 upload=LG3XNT5Y4IDG tag=BXNSE4F3J0GA type=write size=1553640 2024-09-12T00:21:57.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.157+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=WT41HAC6FZQN type=del size=4108108 2024-09-12T00:21:57.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.161+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~XS8ZDBIWM375.0 size=537739 2024-09-12T00:21:57.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.165+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=XS8ZDBIWM375 tag=IT3ZZWBPWZDC type=write size=1586315 2024-09-12T00:21:57.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.173+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~TD669004DXPZ.0 size=1048576 2024-09-12T00:21:57.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.177+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~TD669004DXPZ.1 size=470018 2024-09-12T00:21:57.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.177+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=TD669004DXPZ tag=TCUTM7V5O5HS type=write size=2567170 2024-09-12T00:21:57.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.177+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=34FNBHAI91RZ type=del 2024-09-12T00:21:57.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.185+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~6U4CSB56BW5Q.0 size=1048576 2024-09-12T00:21:57.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.189+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~6U4CSB56BW5Q.1 size=991594 2024-09-12T00:21:57.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.189+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=6U4CSB56BW5Q tag=01MGY3GLUMRJ type=write size=3088746 2024-09-12T00:21:57.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.193+0000 7fd6489978c0 1 < completed write operation key=8JCL0F406L7I tag=NHEMD3Q105HY type=write size=181910 2024-09-12T00:21:57.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.197+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~XVCIZ2VVZ978.0 size=639051 2024-09-12T00:21:57.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.197+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=XVCIZ2VVZ978 tag=C9N9YM4SOSSH type=write size=1687627 2024-09-12T00:21:57.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.201+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~ANC79OWS7MLD.0 size=657523 2024-09-12T00:21:57.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.209+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=ANC79OWS7MLD tag=VL31355PCW00 type=write size=1706099 2024-09-12T00:21:57.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.217+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~LTDFSEFBRJKV.0 size=146910 2024-09-12T00:21:57.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.217+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=LTDFSEFBRJKV tag=FE0Y2N7OJDVM type=write size=1195486 2024-09-12T00:21:57.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.221+0000 7fd6489978c0 1 < canceled operation key=RGE8T6BTHBWK tag=FFYLUH03OU81 type=del size=2246766 2024-09-12T00:21:57.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.225+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=6JWAVR1ZBEND type=write size=837879 2024-09-12T00:21:57.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.229+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~R31NAK6MSQ8D.0 size=1048576 2024-09-12T00:21:57.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.233+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~R31NAK6MSQ8D.1 size=782921 2024-09-12T00:21:57.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.237+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=R31NAK6MSQ8D tag=70GUOYA07Q4N type=write size=2880073 2024-09-12T00:21:57.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.241+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=UCFIAPFK4F6N type=del size=2424296 2024-09-12T00:21:57.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.245+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~IVQH6WJV53JY.0 size=156212 2024-09-12T00:21:57.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.249+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=IVQH6WJV53JY tag=1OXPCT27VFQM type=write size=1204788 2024-09-12T00:21:57.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.261+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~NCQEU14LNPE0.0 size=775242 2024-09-12T00:21:57.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.261+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=NCQEU14LNPE0 tag=Y372X5VBUGG3 type=write size=1823818 2024-09-12T00:21:57.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.265+0000 7fd6489978c0 1 < completed write operation key=8JCL0F406L7I tag=LU3857769DGI type=write size=662158 2024-09-12T00:21:57.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.269+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=FG2KN1J1OSB1 type=del size=663090 2024-09-12T00:21:57.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.273+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~EOEFW88823T9.0 size=1048576 2024-09-12T00:21:57.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.277+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~EOEFW88823T9.1 size=1048576 2024-09-12T00:21:57.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.277+0000 7fd6489978c0 1 < canceled part key=_multipart_25P4P2I6BE3H.2~EOEFW88823T9.2 size=266297 2024-09-12T00:21:57.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.281+0000 7fd6489978c0 1 < canceled multipart upload key=25P4P2I6BE3H upload=EOEFW88823T9 tag=DZD0DNV1Q0R2 type=write size=3412025 2024-09-12T00:21:57.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.285+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=QA3BCGHQY680 type=del size=534915 2024-09-12T00:21:57.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.289+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~Z2L819G1LB6Y.0 size=528396 2024-09-12T00:21:57.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.297+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=Z2L819G1LB6Y tag=MW3GIUSYO93B type=write size=1576972 2024-09-12T00:21:57.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.305+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~J2WP93LG3YJO.0 size=1048576 2024-09-12T00:21:57.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.305+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~J2WP93LG3YJO.1 size=701180 2024-09-12T00:21:57.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.305+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=J2WP93LG3YJO tag=KIBCVE20H7W4 type=write size=2798332 2024-09-12T00:21:57.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.313+0000 7fd6489978c0 1 < suggested remove operation key=HUKWLE56FRX2 tag=TOPCQXLUTKMP type=write 2024-09-12T00:21:57.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.321+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~F0YXA4AUPRTC.0 size=1048576 2024-09-12T00:21:57.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.321+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~F0YXA4AUPRTC.1 size=777392 2024-09-12T00:21:57.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.321+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=F0YXA4AUPRTC tag=WA2EK887RB8C type=write size=2874544 2024-09-12T00:21:57.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.325+0000 7fd6489978c0 1 < canceled operation key=YSPRZ87DZ2OD tag=OWR78G93Q8SO type=del size=3808618 2024-09-12T00:21:57.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.329+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=RTHJA450XEPB type=write size=36149 2024-09-12T00:21:57.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.337+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=OC59EZ2C88EL type=del 2024-09-12T00:21:57.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.341+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~1E8UXUDHWRH2.0 size=1048576 2024-09-12T00:21:57.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.345+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~1E8UXUDHWRH2.1 size=508305 2024-09-12T00:21:57.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.345+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=1E8UXUDHWRH2 tag=QIER5IT4QE7Y type=write size=2605457 2024-09-12T00:21:57.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.349+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~QAFYWBX6GDQK.0 size=1048576 2024-09-12T00:21:57.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.353+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~QAFYWBX6GDQK.1 size=1048576 2024-09-12T00:21:57.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.357+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~QAFYWBX6GDQK.2 size=724712 2024-09-12T00:21:57.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.361+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=QAFYWBX6GDQK tag=735YLQFG8WTA type=write size=3870440 2024-09-12T00:21:57.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.365+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=MIPJJ76MTPQ1 type=write size=405005 2024-09-12T00:21:57.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.369+0000 7fd6489978c0 1 < completed delete operation key=8FBXDX6GELE7 tag=AQ3ATY1328GM type=del 2024-09-12T00:21:57.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.373+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=D866DMCY1R7V type=del size=1517190 2024-09-12T00:21:57.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.377+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=WT41HAC6FZQN type=del 2024-09-12T00:21:57.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.381+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=4I8FRL2RO03C type=write size=334876 2024-09-12T00:21:57.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.385+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~TD669004DXPZ.0 size=1048576 2024-09-12T00:21:57.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.389+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~TD669004DXPZ.1 size=470018 2024-09-12T00:21:57.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.393+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=TD669004DXPZ tag=TCUTM7V5O5HS type=write size=2567170 2024-09-12T00:21:57.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.397+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=XC7RFOE45YNJ type=del size=484664 2024-09-12T00:21:57.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.401+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~6U4CSB56BW5Q.0 size=1048576 2024-09-12T00:21:57.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.405+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~6U4CSB56BW5Q.1 size=991594 2024-09-12T00:21:57.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.413+0000 7fd6489978c0 1 < completed multipart upload key=G4EUTQOHAT2E upload=6U4CSB56BW5Q tag=01MGY3GLUMRJ type=write size=3088746 2024-09-12T00:21:57.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.417+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=106Z4JY9IJRN type=del size=3177833 2024-09-12T00:21:57.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.417+0000 7fd6489978c0 1 < canceled part key=_multipart_RGE8T6BTHBWK.2~XVCIZ2VVZ978.0 size=639051 2024-09-12T00:21:57.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.421+0000 7fd6489978c0 1 < canceled multipart upload key=RGE8T6BTHBWK upload=XVCIZ2VVZ978 tag=C9N9YM4SOSSH type=write size=1687627 2024-09-12T00:21:57.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.425+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=J9LI9W2JNZM3 type=del size=1664522 2024-09-12T00:21:57.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.429+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~LTDFSEFBRJKV.0 size=146910 2024-09-12T00:21:57.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.437+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=LTDFSEFBRJKV tag=FE0Y2N7OJDVM type=write size=1195486 2024-09-12T00:21:57.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.437+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=P8M8UDV8YRSA type=del size=3497526 2024-09-12T00:21:57.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.441+0000 7fd6489978c0 1 < completed write operation key=RGE8T6BTHBWK tag=6JWAVR1ZBEND type=write size=837879 2024-09-12T00:21:57.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.445+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=3LEAJ38AQ12A type=del size=839430 2024-09-12T00:21:57.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.453+0000 7fd6489978c0 1 < suggested update operation key=N4S6I47NSJK6 tag=UCFIAPFK4F6N type=del size=2424296 2024-09-12T00:21:57.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.457+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=9C21HWC7WFAR type=write size=538361 2024-09-12T00:21:57.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.457+0000 7fd6489978c0 1 < canceled part key=_multipart_3JZP8TZFEIMH.2~NCQEU14LNPE0.0 size=775242 2024-09-12T00:21:57.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.465+0000 7fd6489978c0 1 < canceled multipart upload key=3JZP8TZFEIMH upload=NCQEU14LNPE0 tag=Y372X5VBUGG3 type=write size=1823818 2024-09-12T00:21:57.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.469+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=UPGLMK8B5LBZ type=del size=1261129 2024-09-12T00:21:57.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.473+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=FG2KN1J1OSB1 type=del 2024-09-12T00:21:57.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.477+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~7Q3N7BHGRSLZ.0 size=1048576 2024-09-12T00:21:57.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.481+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~7Q3N7BHGRSLZ.1 size=103281 2024-09-12T00:21:57.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.481+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=7Q3N7BHGRSLZ tag=JV99G5YZ59LX type=write size=2200433 2024-09-12T00:21:57.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.489+0000 7fd6489978c0 1 < suggested update operation key=ZW51KHCLPYN3 tag=QA3BCGHQY680 type=del size=534915 2024-09-12T00:21:57.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.493+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=ZXZ7KJ62PJLB type=del size=1497404 2024-09-12T00:21:57.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.497+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~J2WP93LG3YJO.0 size=1048576 2024-09-12T00:21:57.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.497+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~J2WP93LG3YJO.1 size=701180 2024-09-12T00:21:57.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.505+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=J2WP93LG3YJO tag=KIBCVE20H7W4 type=write size=2798332 2024-09-12T00:21:57.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.509+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=ISS1YSMKZTIW type=del size=119380 2024-09-12T00:21:57.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.513+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~F0YXA4AUPRTC.0 size=1048576 2024-09-12T00:21:57.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.513+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~F0YXA4AUPRTC.1 size=777392 2024-09-12T00:21:57.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.521+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=F0YXA4AUPRTC tag=WA2EK887RB8C type=write size=2874544 2024-09-12T00:21:57.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.525+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=6N05405ZCSNT type=del size=4049016 2024-09-12T00:21:57.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.533+0000 7fd6489978c0 1 < suggested update operation key=ZXEIT45BWHXM tag=RTHJA450XEPB type=write size=36149 2024-09-12T00:21:57.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.537+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=99ZXDIIXCS75 type=del size=419922 2024-09-12T00:21:57.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.541+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~1E8UXUDHWRH2.0 size=1048576 2024-09-12T00:21:57.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.541+0000 7fd6489978c0 1 < canceled part key=_multipart_YJJBTNI318EH.2~1E8UXUDHWRH2.1 size=508305 2024-09-12T00:21:57.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.545+0000 7fd6489978c0 1 < canceled multipart upload key=YJJBTNI318EH upload=1E8UXUDHWRH2 tag=QIER5IT4QE7Y type=write size=2605457 2024-09-12T00:21:57.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.549+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=QOX06L1RS7CU type=del size=2954798 2024-09-12T00:21:57.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.553+0000 7fd6489978c0 1 < canceled operation key=YJJBTNI318EH tag=MIPJJ76MTPQ1 type=write size=405005 2024-09-12T00:21:57.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.561+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~7S6KM475XTUP.0 size=1048576 2024-09-12T00:21:57.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.561+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~7S6KM475XTUP.1 size=973092 2024-09-12T00:21:57.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.561+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=7S6KM475XTUP tag=7VS4SC1Z0D20 type=write size=3070244 2024-09-12T00:21:57.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.565+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=D866DMCY1R7V type=del 2024-09-12T00:21:57.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.569+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=SFTQQUTYMWIB type=del size=2084215 2024-09-12T00:21:57.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.573+0000 7fd6489978c0 1 < completed write operation key=RGE8T6BTHBWK tag=4I8FRL2RO03C type=write size=334876 2024-09-12T00:21:57.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.577+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=FEWV4J2K39GP type=write size=792280 2024-09-12T00:21:57.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.581+0000 7fd6489978c0 -1 < failed to complete operation key=N4S6I47NSJK6 tag=XC7RFOE45YNJ type=del size=484664: (22) Invalid argument 2024-09-12T00:21:57.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.585+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=GMAIKLYQY9L3 type=del size=318407 2024-09-12T00:21:57.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.589+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=106Z4JY9IJRN type=del 2024-09-12T00:21:57.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.597+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~DX227W4W2WOZ.0 size=793935 2024-09-12T00:21:57.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.597+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=DX227W4W2WOZ tag=YUUWPO7VA1FR type=write size=1842511 2024-09-12T00:21:57.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.601+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=J9LI9W2JNZM3 type=del 2024-09-12T00:21:57.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.605+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=9YBGDO78OEJX type=write size=442407 2024-09-12T00:21:57.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.613+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=P8M8UDV8YRSA type=del 2024-09-12T00:21:57.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.617+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~18EZ04H6PHGN.0 size=975903 2024-09-12T00:21:57.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.617+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=18EZ04H6PHGN tag=TX10IY2HSOVC type=write size=2024479 2024-09-12T00:21:57.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.621+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=3LEAJ38AQ12A type=del 2024-09-12T00:21:57.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.629+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~W6UGZWIFA56Z.0 size=1048576 2024-09-12T00:21:57.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.633+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~W6UGZWIFA56Z.1 size=147867 2024-09-12T00:21:57.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.633+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=W6UGZWIFA56Z tag=BNVQ5JY0M8YU type=write size=2245019 2024-09-12T00:21:57.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.637+0000 7fd6489978c0 1 < completed write operation key=J5IW4G9C72DH tag=9C21HWC7WFAR type=write size=538361 2024-09-12T00:21:57.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.641+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=D9HOSMDKRZQ1 type=del size=2898658 2024-09-12T00:21:57.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.645+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=UPGLMK8B5LBZ type=del 2024-09-12T00:21:57.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.653+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~SNRHVDZJSOF6.0 size=1048576 2024-09-12T00:21:57.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.653+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~SNRHVDZJSOF6.1 size=1048576 2024-09-12T00:21:57.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.657+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~SNRHVDZJSOF6.2 size=534306 2024-09-12T00:21:57.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.657+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=SNRHVDZJSOF6 tag=JEHCV0GY1UFW type=write size=3680034 2024-09-12T00:21:57.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.661+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~7Q3N7BHGRSLZ.0 size=1048576 2024-09-12T00:21:57.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.665+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~7Q3N7BHGRSLZ.1 size=103281 2024-09-12T00:21:57.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.669+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=7Q3N7BHGRSLZ tag=JV99G5YZ59LX type=write size=2200433 2024-09-12T00:21:57.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.673+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=DD3BKH7TPFTN type=del size=2336888 2024-09-12T00:21:57.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.677+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=ZXZ7KJ62PJLB type=del 2024-09-12T00:21:57.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.681+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=CGAG3UMECVGI type=write size=1027936 2024-09-12T00:21:57.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.685+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=ISS1YSMKZTIW type=del 2024-09-12T00:21:57.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.693+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~LCATHTMSQETW.0 size=1048576 2024-09-12T00:21:57.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.697+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~LCATHTMSQETW.1 size=1048576 2024-09-12T00:21:57.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.697+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~LCATHTMSQETW.2 size=869014 2024-09-12T00:21:57.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.697+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=LCATHTMSQETW tag=YENB70DCHZ84 type=write size=4014742 2024-09-12T00:21:57.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.701+0000 7fd6489978c0 1 < canceled operation key=N4S6I47NSJK6 tag=6N05405ZCSNT type=del size=4049016 2024-09-12T00:21:57.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.709+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~M4T7WEAMO4AP.0 size=1048576 2024-09-12T00:21:57.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.713+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~M4T7WEAMO4AP.1 size=1048576 2024-09-12T00:21:57.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.713+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~M4T7WEAMO4AP.2 size=758302 2024-09-12T00:21:57.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.713+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=M4T7WEAMO4AP tag=ORPYBG1RGZS3 type=write size=3904030 2024-09-12T00:21:57.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.721+0000 7fd6489978c0 1 < suggested remove operation key=KAT2TB3FGAYG tag=99ZXDIIXCS75 type=del 2024-09-12T00:21:57.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.729+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~5NPU9JJ5FGC6.0 size=331770 2024-09-12T00:21:57.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.729+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=5NPU9JJ5FGC6 tag=VLG93UDVNVEY type=write size=1380346 2024-09-12T00:21:57.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.733+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=QOX06L1RS7CU type=del 2024-09-12T00:21:57.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.741+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~04GWU5ZC7WCL.0 size=1048576 2024-09-12T00:21:57.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.741+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~04GWU5ZC7WCL.1 size=1048576 2024-09-12T00:21:57.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.745+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~04GWU5ZC7WCL.2 size=849170 2024-09-12T00:21:57.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.745+0000 7fd6489978c0 1 > prepared multipart upload key=DAOTTEMK2P2T upload=04GWU5ZC7WCL tag=CF3ETS774JUG type=write size=3994898 2024-09-12T00:21:57.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.749+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~7S6KM475XTUP.0 size=1048576 2024-09-12T00:21:57.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.753+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~7S6KM475XTUP.1 size=973092 2024-09-12T00:21:57.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.757+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=7S6KM475XTUP tag=7VS4SC1Z0D20 type=write size=3070244 2024-09-12T00:21:57.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.761+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=PMUM743A1URZ type=del size=2197908 2024-09-12T00:21:57.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.765+0000 7fd6489978c0 -1 < failed to complete operation key=KAT2TB3FGAYG tag=SFTQQUTYMWIB type=del size=2084215: (22) Invalid argument 2024-09-12T00:21:57.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.769+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=768H23YXSM6L type=del size=1075939 2024-09-12T00:21:57.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.773+0000 7fd6489978c0 1 < completed write operation key=DAOTTEMK2P2T tag=FEWV4J2K39GP type=write size=792280 2024-09-12T00:21:57.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.777+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=0KL01ZAD7K0B type=del size=2899729 2024-09-12T00:21:57.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.781+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=GMAIKLYQY9L3 type=del 2024-09-12T00:21:57.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.789+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~PZSJN8I00GO8.0 size=1048576 2024-09-12T00:21:57.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.793+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~PZSJN8I00GO8.1 size=284551 2024-09-12T00:21:57.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.793+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=PZSJN8I00GO8 tag=0GBAFCG9PKZT type=write size=2381703 2024-09-12T00:21:57.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.793+0000 7fd6489978c0 1 < canceled part key=_multipart_ES2BLTWZT6PT.2~DX227W4W2WOZ.0 size=793935 2024-09-12T00:21:57.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.797+0000 7fd6489978c0 1 < canceled multipart upload key=ES2BLTWZT6PT upload=DX227W4W2WOZ tag=YUUWPO7VA1FR type=write size=1842511 2024-09-12T00:21:57.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.805+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~YTDAEAKFVTRH.0 size=1048576 2024-09-12T00:21:57.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.809+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~YTDAEAKFVTRH.1 size=794814 2024-09-12T00:21:57.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.809+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=YTDAEAKFVTRH tag=44ABA7PSIJ3E type=write size=2891966 2024-09-12T00:21:57.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.813+0000 7fd6489978c0 1 < completed write operation key=2KP09UFI3N8B tag=9YBGDO78OEJX type=write size=442407 2024-09-12T00:21:57.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.817+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=0YTS38MD8ZZJ type=del size=1440336 2024-09-12T00:21:57.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.821+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~18EZ04H6PHGN.0 size=975903 2024-09-12T00:21:57.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.829+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=18EZ04H6PHGN tag=TX10IY2HSOVC type=write size=2024479 2024-09-12T00:21:57.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.837+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~KMOBG0LJZV1F.0 size=499180 2024-09-12T00:21:57.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.837+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=KMOBG0LJZV1F tag=FJ31G00VD3NX type=write size=1547756 2024-09-12T00:21:57.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.841+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~W6UGZWIFA56Z.0 size=1048576 2024-09-12T00:21:57.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.845+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~W6UGZWIFA56Z.1 size=147867 2024-09-12T00:21:57.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.849+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=W6UGZWIFA56Z tag=BNVQ5JY0M8YU type=write size=2245019 2024-09-12T00:21:57.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.853+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=ANTE94XMIAPE type=del size=1931511 2024-09-12T00:21:57.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.857+0000 7fd6489978c0 1 < completed delete operation key=RGE8T6BTHBWK tag=D9HOSMDKRZQ1 type=del 2024-09-12T00:21:57.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.861+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=52LYG9ZHYTKM type=del size=3907539 2024-09-12T00:21:57.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.865+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~SNRHVDZJSOF6.0 size=1048576 2024-09-12T00:21:57.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.869+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~SNRHVDZJSOF6.1 size=1048576 2024-09-12T00:21:57.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.873+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~SNRHVDZJSOF6.2 size=534306 2024-09-12T00:21:57.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.877+0000 7fd6489978c0 1 < completed multipart upload key=N0AAVPQ6MUQ1 upload=SNRHVDZJSOF6 tag=JEHCV0GY1UFW type=write size=3680034 2024-09-12T00:21:57.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.881+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=7R2S5MII0M7T type=del size=3215297 2024-09-12T00:21:57.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.885+0000 7fd6489978c0 -1 < failed to complete operation key=KAT2TB3FGAYG tag=DD3BKH7TPFTN type=del size=2336888: (22) Invalid argument 2024-09-12T00:21:57.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.893+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~V4PORHD9OEKW.0 size=1048576 2024-09-12T00:21:57.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.897+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~V4PORHD9OEKW.1 size=923761 2024-09-12T00:21:57.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.897+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=V4PORHD9OEKW tag=ULO5LOYM1FOY type=write size=3020913 2024-09-12T00:21:57.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.901+0000 7fd6489978c0 1 < completed write operation key=9CK160BK5YYY tag=CGAG3UMECVGI type=write size=1027936 2024-09-12T00:21:57.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.905+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=T0BU4BOO27V6 type=del size=1237849 2024-09-12T00:21:57.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.909+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~LCATHTMSQETW.0 size=1048576 2024-09-12T00:21:57.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.909+0000 7fd6489978c0 1 < canceled part key=_multipart_M9YKGQ2GA5CO.2~LCATHTMSQETW.1 size=1048576 2024-09-12T00:21:57.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.913+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~LCATHTMSQETW.2 size=869014 2024-09-12T00:21:57.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.917+0000 7fd6489978c0 1 < canceled multipart upload key=M9YKGQ2GA5CO upload=LCATHTMSQETW tag=YENB70DCHZ84 type=write size=4014742 2024-09-12T00:21:57.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.921+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=V763VVOJD1B6 type=del size=821427 2024-09-12T00:21:57.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.925+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~M4T7WEAMO4AP.0 size=1048576 2024-09-12T00:21:57.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.929+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~M4T7WEAMO4AP.1 size=1048576 2024-09-12T00:21:57.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.929+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~M4T7WEAMO4AP.2 size=758302 2024-09-12T00:21:57.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.937+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=M4T7WEAMO4AP tag=ORPYBG1RGZS3 type=write size=3904030 2024-09-12T00:21:57.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.945+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~YXI0QCDO3YVN.0 size=1048576 2024-09-12T00:21:57.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.945+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~YXI0QCDO3YVN.1 size=1048576 2024-09-12T00:21:57.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.949+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~YXI0QCDO3YVN.2 size=698239 2024-09-12T00:21:57.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.949+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=YXI0QCDO3YVN tag=VFR5HMV8IFN2 type=write size=3843967 2024-09-12T00:21:57.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.949+0000 7fd6489978c0 1 < canceled part key=_multipart_N0AAVPQ6MUQ1.2~5NPU9JJ5FGC6.0 size=331770 2024-09-12T00:21:57.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.957+0000 7fd6489978c0 1 < canceled multipart upload key=N0AAVPQ6MUQ1 upload=5NPU9JJ5FGC6 tag=VLG93UDVNVEY type=write size=1380346 2024-09-12T00:21:57.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.965+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~3DEO29J7PKWL.0 size=1048576 2024-09-12T00:21:57.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.969+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~3DEO29J7PKWL.1 size=520962 2024-09-12T00:21:57.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.969+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=3DEO29J7PKWL tag=DG3U6ULG0Y1I type=write size=2618114 2024-09-12T00:21:57.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.973+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~04GWU5ZC7WCL.0 size=1048576 2024-09-12T00:21:57.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.977+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~04GWU5ZC7WCL.1 size=1048576 2024-09-12T00:21:57.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.981+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~04GWU5ZC7WCL.2 size=849170 2024-09-12T00:21:57.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.985+0000 7fd6489978c0 1 < completed multipart upload key=DAOTTEMK2P2T upload=04GWU5ZC7WCL tag=CF3ETS774JUG type=write size=3994898 2024-09-12T00:21:57.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.993+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~3AX61SBL1B9L.0 size=1048576 2024-09-12T00:21:57.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.993+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~3AX61SBL1B9L.1 size=1048576 2024-09-12T00:21:57.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.997+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~3AX61SBL1B9L.2 size=209037 2024-09-12T00:21:57.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:57.997+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=3AX61SBL1B9L tag=S1HLOJGJ72SF type=write size=3354765 2024-09-12T00:21:57.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.001+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=PMUM743A1URZ type=del 2024-09-12T00:21:58.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.009+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~9SH3JMB5AKRY.0 size=581080 2024-09-12T00:21:58.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.009+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=9SH3JMB5AKRY tag=YWK1NTUJYD55 type=write size=1629656 2024-09-12T00:21:58.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.009+0000 7fd6489978c0 1 < completed delete operation key=LZICTA4BWOW8 tag=768H23YXSM6L type=del 2024-09-12T00:21:58.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.013+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=2WOGM6KCNXNB type=del size=2958896 2024-09-12T00:21:58.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.017+0000 7fd6489978c0 1 < completed delete operation key=J5IW4G9C72DH tag=0KL01ZAD7K0B type=del 2024-09-12T00:21:58.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.021+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=RBWEDIRTHQCA type=write size=888391 2024-09-12T00:21:58.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.025+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~PZSJN8I00GO8.0 size=1048576 2024-09-12T00:21:58.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.025+0000 7fd6489978c0 1 < canceled part key=_multipart_GVPNH3JSO07D.2~PZSJN8I00GO8.1 size=284551 2024-09-12T00:21:58.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.029+0000 7fd6489978c0 1 < canceled multipart upload key=GVPNH3JSO07D upload=PZSJN8I00GO8 tag=0GBAFCG9PKZT type=write size=2381703 2024-09-12T00:21:58.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.037+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~W7UGA39YPTRU.0 size=1048576 2024-09-12T00:21:58.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.041+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~W7UGA39YPTRU.1 size=1048576 2024-09-12T00:21:58.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.041+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~W7UGA39YPTRU.2 size=548619 2024-09-12T00:21:58.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.041+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=W7UGA39YPTRU tag=UHYENZNUTLY3 type=write size=3694347 2024-09-12T00:21:58.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.049+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~YTDAEAKFVTRH.0 size=1048576 2024-09-12T00:21:58.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.049+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~YTDAEAKFVTRH.1 size=794814 2024-09-12T00:21:58.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.057+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=YTDAEAKFVTRH tag=44ABA7PSIJ3E type=write size=2891966 2024-09-12T00:21:58.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.061+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=YXAPE5E4BRD5 type=write size=930901 2024-09-12T00:21:58.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.065+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=0YTS38MD8ZZJ type=del 2024-09-12T00:21:58.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.069+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=5Q9WP8OLP259 type=del size=3980383 2024-09-12T00:21:58.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.073+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~KMOBG0LJZV1F.0 size=499180 2024-09-12T00:21:58.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.077+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=KMOBG0LJZV1F tag=FJ31G00VD3NX type=write size=1547756 2024-09-12T00:21:58.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.081+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=NXVQR010DUWB type=del size=3216079 2024-09-12T00:21:58.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.085+0000 7fd6489978c0 1 < completed delete operation key=RGE8T6BTHBWK tag=ANTE94XMIAPE type=del 2024-09-12T00:21:58.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.089+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=A6C3F8S1M8O3 type=del size=2793379 2024-09-12T00:21:58.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.093+0000 7fd6489978c0 1 < completed delete operation key=RGE8T6BTHBWK tag=52LYG9ZHYTKM type=del 2024-09-12T00:21:58.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.097+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=5LHCL2APXOPT type=del size=3335722 2024-09-12T00:21:58.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.101+0000 7fd6489978c0 1 < completed delete operation key=LZICTA4BWOW8 tag=7R2S5MII0M7T type=del 2024-09-12T00:21:58.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.105+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=4CGVQIDB60KK type=del size=851433 2024-09-12T00:21:58.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.109+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~V4PORHD9OEKW.0 size=1048576 2024-09-12T00:21:58.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.109+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~V4PORHD9OEKW.1 size=923761 2024-09-12T00:21:58.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.117+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=V4PORHD9OEKW tag=ULO5LOYM1FOY type=write size=3020913 2024-09-12T00:21:58.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.125+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~NT27M97OF2VX.0 size=546575 2024-09-12T00:21:58.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.125+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=NT27M97OF2VX tag=PC6FGJI7AKGR type=write size=1595151 2024-09-12T00:21:58.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.129+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=T0BU4BOO27V6 type=del 2024-09-12T00:21:58.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.137+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~S40F8BJOBUIV.0 size=1048576 2024-09-12T00:21:58.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.141+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~S40F8BJOBUIV.1 size=711414 2024-09-12T00:21:58.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.141+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=S40F8BJOBUIV tag=N77JV37OP0AI type=write size=2808566 2024-09-12T00:21:58.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.149+0000 7fd6489978c0 1 < suggested remove operation key=M9YKGQ2GA5CO tag=V763VVOJD1B6 type=del 2024-09-12T00:21:58.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.153+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=SIAHINO7O2RE type=del size=1927259 2024-09-12T00:21:58.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.157+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~YXI0QCDO3YVN.0 size=1048576 2024-09-12T00:21:58.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.161+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~YXI0QCDO3YVN.1 size=1048576 2024-09-12T00:21:58.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.161+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~YXI0QCDO3YVN.2 size=698239 2024-09-12T00:21:58.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.169+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=YXI0QCDO3YVN tag=VFR5HMV8IFN2 type=write size=3843967 2024-09-12T00:21:58.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.173+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=FLQBJ2WP9TJ5 type=write size=65786 2024-09-12T00:21:58.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.173+0000 7fd6489978c0 1 < canceled part key=_multipart_ZW51KHCLPYN3.2~3DEO29J7PKWL.0 size=1048576 2024-09-12T00:21:58.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.177+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~3DEO29J7PKWL.1 size=520962 2024-09-12T00:21:58.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.185+0000 7fd6489978c0 1 < canceled multipart upload key=ZW51KHCLPYN3 upload=3DEO29J7PKWL tag=DG3U6ULG0Y1I type=write size=2618114 2024-09-12T00:21:58.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.189+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=2N8RETS5A685 type=del size=2556364 2024-09-12T00:21:58.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.193+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~3AX61SBL1B9L.0 size=1048576 2024-09-12T00:21:58.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.197+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~3AX61SBL1B9L.1 size=1048576 2024-09-12T00:21:58.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.197+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~3AX61SBL1B9L.2 size=209037 2024-09-12T00:21:58.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.205+0000 7fd6489978c0 1 < completed multipart upload key=N0AAVPQ6MUQ1 upload=3AX61SBL1B9L tag=S1HLOJGJ72SF type=write size=3354765 2024-09-12T00:21:58.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.213+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~9QQH1XDHAUN1.0 size=1048576 2024-09-12T00:21:58.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.217+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~9QQH1XDHAUN1.1 size=45275 2024-09-12T00:21:58.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.217+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=9QQH1XDHAUN1 tag=MZMDNOZN2D1K type=write size=2142427 2024-09-12T00:21:58.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.221+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~9SH3JMB5AKRY.0 size=581080 2024-09-12T00:21:58.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.225+0000 7fd6489978c0 1 < completed multipart upload key=CFID1EVBXOVJ upload=9SH3JMB5AKRY tag=YWK1NTUJYD55 type=write size=1629656 2024-09-12T00:21:58.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.233+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~3PPYCW7JIB3R.0 size=712626 2024-09-12T00:21:58.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.233+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=3PPYCW7JIB3R tag=75UBR58CCREJ type=write size=1761202 2024-09-12T00:21:58.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.237+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=2WOGM6KCNXNB type=del 2024-09-12T00:21:58.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.241+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=QAV4DYQU6CX9 type=del size=635999 2024-09-12T00:21:58.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.241+0000 7fd6489978c0 1 < completed write operation key=QBS4N1KGR1JB tag=RBWEDIRTHQCA type=write size=888391 2024-09-12T00:21:58.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.249+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~KXKQHCIKTVFE.0 size=61665 2024-09-12T00:21:58.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.249+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=KXKQHCIKTVFE tag=FFYLXX2J9Z0Z type=write size=1110241 2024-09-12T00:21:58.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.253+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~W7UGA39YPTRU.0 size=1048576 2024-09-12T00:21:58.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.257+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~W7UGA39YPTRU.1 size=1048576 2024-09-12T00:21:58.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.261+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~W7UGA39YPTRU.2 size=548619 2024-09-12T00:21:58.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.265+0000 7fd6489978c0 1 < completed multipart upload key=GVPNH3JSO07D upload=W7UGA39YPTRU tag=UHYENZNUTLY3 type=write size=3694347 2024-09-12T00:21:58.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.273+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=3C70D94TA31Q type=write size=385055 2024-09-12T00:21:58.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.277+0000 7fd6489978c0 -1 < failed to complete operation key=M9YKGQ2GA5CO tag=YXAPE5E4BRD5 type=write size=930901: (22) Invalid argument 2024-09-12T00:21:58.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.281+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=6CLHM83ELD63 type=del size=902313 2024-09-12T00:21:58.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.285+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=5Q9WP8OLP259 type=del 2024-09-12T00:21:58.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.289+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=C17N2OC56VKP type=del size=1672470 2024-09-12T00:21:58.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.293+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=NXVQR010DUWB type=del 2024-09-12T00:21:58.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.297+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=YXKO7KZJC66Z type=del size=3778656 2024-09-12T00:21:58.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.301+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=A6C3F8S1M8O3 type=del 2024-09-12T00:21:58.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.309+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~4W7JV6EEHSFK.0 size=1048576 2024-09-12T00:21:58.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.313+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~4W7JV6EEHSFK.1 size=1048576 2024-09-12T00:21:58.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.317+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~4W7JV6EEHSFK.2 size=489192 2024-09-12T00:21:58.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.317+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=4W7JV6EEHSFK tag=JRRWYOH5K94O type=write size=3634920 2024-09-12T00:21:58.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.321+0000 7fd6489978c0 1 < canceled operation key=K9FD1L86Q05B tag=5LHCL2APXOPT type=del size=3335722 2024-09-12T00:21:58.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.325+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=BCTX2MNQBO7U type=write size=224627 2024-09-12T00:21:58.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.329+0000 7fd6489978c0 1 < completed delete operation key=RGE8T6BTHBWK tag=4CGVQIDB60KK type=del 2024-09-12T00:21:58.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.333+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=BTQZ8YBC1TKZ type=write size=340838 2024-09-12T00:21:58.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.337+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~NT27M97OF2VX.0 size=546575 2024-09-12T00:21:58.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.341+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=NT27M97OF2VX tag=PC6FGJI7AKGR type=write size=1595151 2024-09-12T00:21:58.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.345+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=K43Y0EJNB139 type=del size=2197278 2024-09-12T00:21:58.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.349+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~S40F8BJOBUIV.0 size=1048576 2024-09-12T00:21:58.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.353+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~S40F8BJOBUIV.1 size=711414 2024-09-12T00:21:58.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.361+0000 7fd6489978c0 1 < completed multipart upload key=G4EUTQOHAT2E upload=S40F8BJOBUIV tag=N77JV37OP0AI type=write size=2808566 2024-09-12T00:21:58.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.369+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~NY2C0MXDU0TR.0 size=1048576 2024-09-12T00:21:58.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.369+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~NY2C0MXDU0TR.1 size=355465 2024-09-12T00:21:58.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.369+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=NY2C0MXDU0TR tag=CAEMI4CRH9FK type=write size=2452617 2024-09-12T00:21:58.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.373+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=SIAHINO7O2RE type=del 2024-09-12T00:21:58.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.381+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~HFXCVSCDOIL6.0 size=1048576 2024-09-12T00:21:58.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.385+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~HFXCVSCDOIL6.1 size=593769 2024-09-12T00:21:58.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.385+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=HFXCVSCDOIL6 tag=BWUM2GS90ALU type=write size=2690921 2024-09-12T00:21:58.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.389+0000 7fd6489978c0 1 < completed write operation key=B2BW7GQ6UN9I tag=FLQBJ2WP9TJ5 type=write size=65786 2024-09-12T00:21:58.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.393+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~V37760Y87K5Q.0 size=1048576 2024-09-12T00:21:58.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.397+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~V37760Y87K5Q.1 size=1048576 2024-09-12T00:21:58.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.401+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~V37760Y87K5Q.2 size=98362 2024-09-12T00:21:58.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.401+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=V37760Y87K5Q tag=ARPBIU8VOG7F type=write size=3244090 2024-09-12T00:21:58.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.405+0000 7fd6489978c0 1 < canceled operation key=IHYHPKVPWTUL tag=2N8RETS5A685 type=del size=2556364 2024-09-12T00:21:58.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.409+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~2CET2Q1IPJ71.0 size=1048576 2024-09-12T00:21:58.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.413+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~2CET2Q1IPJ71.1 size=1048576 2024-09-12T00:21:58.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.417+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~2CET2Q1IPJ71.2 size=631517 2024-09-12T00:21:58.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.417+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=2CET2Q1IPJ71 tag=FL94SJDHQS3P type=write size=3777245 2024-09-12T00:21:58.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.421+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~9QQH1XDHAUN1.0 size=1048576 2024-09-12T00:21:58.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.425+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~9QQH1XDHAUN1.1 size=45275 2024-09-12T00:21:58.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.429+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=9QQH1XDHAUN1 tag=MZMDNOZN2D1K type=write size=2142427 2024-09-12T00:21:58.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.433+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=4KSYRZV9TB10 type=del size=1730507 2024-09-12T00:21:58.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.437+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~3PPYCW7JIB3R.0 size=712626 2024-09-12T00:21:58.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.445+0000 7fd6489978c0 1 < completed multipart upload key=N0AAVPQ6MUQ1 upload=3PPYCW7JIB3R tag=75UBR58CCREJ type=write size=1761202 2024-09-12T00:21:58.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.449+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=75KEIETC5HIY type=del size=2104837 2024-09-12T00:21:58.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.453+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=QAV4DYQU6CX9 type=del 2024-09-12T00:21:58.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.457+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~U6FX6OJTCXGB.0 size=304699 2024-09-12T00:21:58.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.457+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=U6FX6OJTCXGB tag=6KOFFJS23LK0 type=write size=1353275 2024-09-12T00:21:58.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.461+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~KXKQHCIKTVFE.0 size=61665 2024-09-12T00:21:58.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.469+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=KXKQHCIKTVFE tag=FFYLXX2J9Z0Z type=write size=1110241 2024-09-12T00:21:58.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.473+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~6C00GVZ60KW9.0 size=1048576 2024-09-12T00:21:58.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.477+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~6C00GVZ60KW9.1 size=1048576 2024-09-12T00:21:58.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.481+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~6C00GVZ60KW9.2 size=105363 2024-09-12T00:21:58.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.481+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=6C00GVZ60KW9 tag=3XUKCNF0BH32 type=write size=3251091 2024-09-12T00:21:58.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.485+0000 7fd6489978c0 1 < canceled operation key=G4EUTQOHAT2E tag=3C70D94TA31Q type=write size=385055 2024-09-12T00:21:58.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.489+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=6UARUWOXJCHZ type=del size=2317068 2024-09-12T00:21:58.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.493+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=6CLHM83ELD63 type=del 2024-09-12T00:21:58.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.497+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~ONP7H4WABL4I.0 size=1048576 2024-09-12T00:21:58.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.501+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~ONP7H4WABL4I.1 size=1048576 2024-09-12T00:21:58.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.505+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~ONP7H4WABL4I.2 size=85320 2024-09-12T00:21:58.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.505+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=ONP7H4WABL4I tag=9JDJVXKENZY2 type=write size=3231048 2024-09-12T00:21:58.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.509+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=C17N2OC56VKP type=del 2024-09-12T00:21:58.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.513+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=TW979PATP8PY type=write size=655153 2024-09-12T00:21:58.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.521+0000 7fd6489978c0 1 < suggested update operation key=3JZP8TZFEIMH tag=YXKO7KZJC66Z type=del size=3778656 2024-09-12T00:21:58.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.525+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~SD2LZNWM7SW2.0 size=1048576 2024-09-12T00:21:58.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.529+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~SD2LZNWM7SW2.1 size=248845 2024-09-12T00:21:58.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.529+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=SD2LZNWM7SW2 tag=HQC2ZO9AK4GX type=write size=2345997 2024-09-12T00:21:58.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.533+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~4W7JV6EEHSFK.0 size=1048576 2024-09-12T00:21:58.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.537+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~4W7JV6EEHSFK.1 size=1048576 2024-09-12T00:21:58.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.537+0000 7fd6489978c0 1 < canceled part key=_multipart_ZW51KHCLPYN3.2~4W7JV6EEHSFK.2 size=489192 2024-09-12T00:21:58.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.541+0000 7fd6489978c0 1 < canceled multipart upload key=ZW51KHCLPYN3 upload=4W7JV6EEHSFK tag=JRRWYOH5K94O type=write size=3634920 2024-09-12T00:21:58.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.545+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=DJY7PL2GO2GF type=write size=936663 2024-09-12T00:21:58.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.549+0000 7fd6489978c0 1 < completed write operation key=JPVKBVRCZTE9 tag=BCTX2MNQBO7U type=write size=224627 2024-09-12T00:21:58.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.553+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=EUUT27DETP1Q type=write size=242252 2024-09-12T00:21:58.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.557+0000 7fd6489978c0 1 < completed write operation key=CBXBFK3OXXKG tag=BTQZ8YBC1TKZ type=write size=340838 2024-09-12T00:21:58.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.565+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~T0QGIDXTDHVB.0 size=904728 2024-09-12T00:21:58.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.565+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=T0QGIDXTDHVB tag=K51U1KLL17JP type=write size=1953304 2024-09-12T00:21:58.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.569+0000 7fd6489978c0 1 < completed delete operation key=J5IW4G9C72DH tag=K43Y0EJNB139 type=del 2024-09-12T00:21:58.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.573+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=2YR8KEOUDTSQ type=write size=9771 2024-09-12T00:21:58.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.573+0000 7fd6489978c0 1 < canceled part key=_multipart_K9FD1L86Q05B.2~NY2C0MXDU0TR.0 size=1048576 2024-09-12T00:21:58.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.577+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~NY2C0MXDU0TR.1 size=355465 2024-09-12T00:21:58.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.581+0000 7fd6489978c0 1 < canceled multipart upload key=K9FD1L86Q05B upload=NY2C0MXDU0TR tag=CAEMI4CRH9FK type=write size=2452617 2024-09-12T00:21:58.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.585+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=HTB335IB3BB1 type=write size=998001 2024-09-12T00:21:58.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.589+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~HFXCVSCDOIL6.0 size=1048576 2024-09-12T00:21:58.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.593+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~HFXCVSCDOIL6.1 size=593769 2024-09-12T00:21:58.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.597+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=HFXCVSCDOIL6 tag=BWUM2GS90ALU type=write size=2690921 2024-09-12T00:21:58.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.601+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=FILV7MPWWK6Z type=del size=3160431 2024-09-12T00:21:58.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.605+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~V37760Y87K5Q.0 size=1048576 2024-09-12T00:21:58.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.609+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~V37760Y87K5Q.1 size=1048576 2024-09-12T00:21:58.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.613+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~V37760Y87K5Q.2 size=98362 2024-09-12T00:21:58.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.617+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=V37760Y87K5Q tag=ARPBIU8VOG7F type=write size=3244090 2024-09-12T00:21:58.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.621+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=PC8HSE3J9C97 type=del size=4041945 2024-09-12T00:21:58.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.625+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~2CET2Q1IPJ71.0 size=1048576 2024-09-12T00:21:58.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.629+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~2CET2Q1IPJ71.1 size=1048576 2024-09-12T00:21:58.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.629+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~2CET2Q1IPJ71.2 size=631517 2024-09-12T00:21:58.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.637+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=2CET2Q1IPJ71 tag=FL94SJDHQS3P type=write size=3777245 2024-09-12T00:21:58.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.641+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=EC4FSWBE5766 type=del size=2954558 2024-09-12T00:21:58.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.645+0000 7fd6489978c0 1 < canceled operation key=Y3JFVW74FNT6 tag=4KSYRZV9TB10 type=del size=1730507 2024-09-12T00:21:58.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.649+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~8JLA84IXW7ZA.0 size=1048576 2024-09-12T00:21:58.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.653+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~8JLA84IXW7ZA.1 size=897253 2024-09-12T00:21:58.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.653+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=8JLA84IXW7ZA tag=ETFKIFQPTYJU type=write size=2994405 2024-09-12T00:21:58.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.661+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=75KEIETC5HIY type=del 2024-09-12T00:21:58.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.665+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~XI68FJILPHOG.0 size=1048576 2024-09-12T00:21:58.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.669+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~XI68FJILPHOG.1 size=1048576 2024-09-12T00:21:58.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.673+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~XI68FJILPHOG.2 size=861451 2024-09-12T00:21:58.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.673+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=XI68FJILPHOG tag=WUKG1RYOD6Q4 type=write size=4007179 2024-09-12T00:21:58.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.677+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~U6FX6OJTCXGB.0 size=304699 2024-09-12T00:21:58.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.681+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=U6FX6OJTCXGB tag=6KOFFJS23LK0 type=write size=1353275 2024-09-12T00:21:58.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.689+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~7IHJHMM3W68M.0 size=1048576 2024-09-12T00:21:58.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.689+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~7IHJHMM3W68M.1 size=1048576 2024-09-12T00:21:58.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.693+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~7IHJHMM3W68M.2 size=888443 2024-09-12T00:21:58.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.693+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=7IHJHMM3W68M tag=3K4FI5RFX7PC type=write size=4034171 2024-09-12T00:21:58.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.697+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~6C00GVZ60KW9.0 size=1048576 2024-09-12T00:21:58.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.697+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~6C00GVZ60KW9.1 size=1048576 2024-09-12T00:21:58.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.701+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~6C00GVZ60KW9.2 size=105363 2024-09-12T00:21:58.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.709+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=6C00GVZ60KW9 tag=3XUKCNF0BH32 type=write size=3251091 2024-09-12T00:21:58.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.713+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~6BKL474QPGWC.0 size=445162 2024-09-12T00:21:58.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.713+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=6BKL474QPGWC tag=MQF1MH1LJ7U1 type=write size=1493738 2024-09-12T00:21:58.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.717+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=6UARUWOXJCHZ type=del 2024-09-12T00:21:58.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.725+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~U4HT3WT1N3FC.0 size=1048576 2024-09-12T00:21:58.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.729+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~U4HT3WT1N3FC.1 size=1048576 2024-09-12T00:21:58.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.729+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~U4HT3WT1N3FC.2 size=695034 2024-09-12T00:21:58.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.729+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=U4HT3WT1N3FC tag=22NR7X2IFHG9 type=write size=3840762 2024-09-12T00:21:58.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.733+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~ONP7H4WABL4I.0 size=1048576 2024-09-12T00:21:58.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.737+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~ONP7H4WABL4I.1 size=1048576 2024-09-12T00:21:58.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.741+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~ONP7H4WABL4I.2 size=85320 2024-09-12T00:21:58.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.745+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=ONP7H4WABL4I tag=9JDJVXKENZY2 type=write size=3231048 2024-09-12T00:21:58.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.749+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=EG53J0X8EQ9K type=del size=2120790 2024-09-12T00:21:58.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.753+0000 7fd6489978c0 1 < completed write operation key=JPVKBVRCZTE9 tag=TW979PATP8PY type=write size=655153 2024-09-12T00:21:58.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.757+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=7W62DCC2SHCQ type=del size=1021525 2024-09-12T00:21:58.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.761+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~SD2LZNWM7SW2.0 size=1048576 2024-09-12T00:21:58.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.761+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~SD2LZNWM7SW2.1 size=248845 2024-09-12T00:21:58.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.769+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=SD2LZNWM7SW2 tag=HQC2ZO9AK4GX type=write size=2345997 2024-09-12T00:21:58.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.773+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=Z1K3SOJBCEM4 type=del size=522170 2024-09-12T00:21:58.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.781+0000 7fd6489978c0 1 < suggested remove operation key=F2CTWM0T2698 tag=DJY7PL2GO2GF type=write 2024-09-12T00:21:58.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.785+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=X01XYMCN5IF0 type=del size=3148578 2024-09-12T00:21:58.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.785+0000 7fd6489978c0 1 < canceled operation key=YSPRZ87DZ2OD tag=EUUT27DETP1Q type=write size=242252 2024-09-12T00:21:58.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.793+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~NYR68LL4AYRU.0 size=95202 2024-09-12T00:21:58.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.793+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=NYR68LL4AYRU tag=SI89D5J8NCZU type=write size=1143778 2024-09-12T00:21:58.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.797+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~T0QGIDXTDHVB.0 size=904728 2024-09-12T00:21:58.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.801+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=T0QGIDXTDHVB tag=K51U1KLL17JP type=write size=1953304 2024-09-12T00:21:58.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.805+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=XNQ6HENNVSRV type=del size=3843998 2024-09-12T00:21:58.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.813+0000 7fd6489978c0 1 < suggested remove operation key=3JZP8TZFEIMH tag=2YR8KEOUDTSQ type=write 2024-09-12T00:21:58.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.817+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=M54ERGEM4WO3 type=del size=2630231 2024-09-12T00:21:58.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.821+0000 7fd6489978c0 1 < canceled operation key=M9YKGQ2GA5CO tag=HTB335IB3BB1 type=write size=998001 2024-09-12T00:21:58.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.825+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=KGW9VRW66H4V type=del size=2842496 2024-09-12T00:21:58.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.829+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=FILV7MPWWK6Z type=del 2024-09-12T00:21:58.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.833+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=Y9XM95WGZLPW type=del size=4088894 2024-09-12T00:21:58.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.837+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=PC8HSE3J9C97 type=del 2024-09-12T00:21:58.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.841+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=C9QDML9HDMFC type=del size=3719842 2024-09-12T00:21:58.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.845+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=EC4FSWBE5766 type=del 2024-09-12T00:21:58.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.849+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~CSS4STVRTSFR.0 size=1048576 2024-09-12T00:21:58.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.853+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~CSS4STVRTSFR.1 size=1048576 2024-09-12T00:21:58.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.857+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~CSS4STVRTSFR.2 size=564301 2024-09-12T00:21:58.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.857+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=CSS4STVRTSFR tag=GSFNTEVYIPQJ type=write size=3710029 2024-09-12T00:21:58.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.861+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~8JLA84IXW7ZA.0 size=1048576 2024-09-12T00:21:58.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.861+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~8JLA84IXW7ZA.1 size=897253 2024-09-12T00:21:58.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.869+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=8JLA84IXW7ZA tag=ETFKIFQPTYJU type=write size=2994405 2024-09-12T00:21:58.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.877+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~78R9Y3N6I3TD.0 size=1048576 2024-09-12T00:21:58.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.877+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~78R9Y3N6I3TD.1 size=1048576 2024-09-12T00:21:58.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.881+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~78R9Y3N6I3TD.2 size=226738 2024-09-12T00:21:58.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.881+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=78R9Y3N6I3TD tag=VC9Q8UIXS3FJ type=write size=3372466 2024-09-12T00:21:58.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.885+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~XI68FJILPHOG.0 size=1048576 2024-09-12T00:21:58.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.885+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~XI68FJILPHOG.1 size=1048576 2024-09-12T00:21:58.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.889+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~XI68FJILPHOG.2 size=861451 2024-09-12T00:21:58.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.897+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=XI68FJILPHOG tag=WUKG1RYOD6Q4 type=write size=4007179 2024-09-12T00:21:58.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.905+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~TWXFFO6S0AF6.0 size=1048576 2024-09-12T00:21:58.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.905+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~TWXFFO6S0AF6.1 size=1048576 2024-09-12T00:21:58.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.909+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~TWXFFO6S0AF6.2 size=610167 2024-09-12T00:21:58.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.909+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=TWXFFO6S0AF6 tag=9IZPRF76EKWS type=write size=3755895 2024-09-12T00:21:58.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.913+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~7IHJHMM3W68M.0 size=1048576 2024-09-12T00:21:58.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.917+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~7IHJHMM3W68M.1 size=1048576 2024-09-12T00:21:58.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.917+0000 7fd6489978c0 1 < canceled part key=_multipart_N4S6I47NSJK6.2~7IHJHMM3W68M.2 size=888443 2024-09-12T00:21:58.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.921+0000 7fd6489978c0 1 < canceled multipart upload key=N4S6I47NSJK6 upload=7IHJHMM3W68M tag=3K4FI5RFX7PC type=write size=4034171 2024-09-12T00:21:58.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.929+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~EO86UH8MJUU0.0 size=95686 2024-09-12T00:21:58.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.929+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=EO86UH8MJUU0 tag=5XLUG6FW4C4K type=write size=1144262 2024-09-12T00:21:58.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.933+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~6BKL474QPGWC.0 size=445162 2024-09-12T00:21:58.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.937+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=6BKL474QPGWC tag=MQF1MH1LJ7U1 type=write size=1493738 2024-09-12T00:21:58.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.941+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=ZM172KIUI40T type=write size=927217 2024-09-12T00:21:58.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.945+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~U4HT3WT1N3FC.0 size=1048576 2024-09-12T00:21:58.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.949+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~U4HT3WT1N3FC.1 size=1048576 2024-09-12T00:21:58.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.953+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~U4HT3WT1N3FC.2 size=695034 2024-09-12T00:21:58.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.957+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=U4HT3WT1N3FC tag=22NR7X2IFHG9 type=write size=3840762 2024-09-12T00:21:58.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.965+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~KD60IGE6CCUG.0 size=368204 2024-09-12T00:21:58.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.965+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=KD60IGE6CCUG tag=3CM618NUBCXN type=write size=1416780 2024-09-12T00:21:58.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.969+0000 7fd6489978c0 1 < canceled operation key=CBXBFK3OXXKG tag=EG53J0X8EQ9K type=del size=2120790 2024-09-12T00:21:58.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.973+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=L08B3GOY9DAE type=del size=254932 2024-09-12T00:21:58.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.977+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=7W62DCC2SHCQ type=del 2024-09-12T00:21:58.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.981+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=GN3R6Z9E1HDR type=write size=862117 2024-09-12T00:21:58.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.981+0000 7fd6489978c0 -1 < failed to complete operation key=3JZP8TZFEIMH tag=Z1K3SOJBCEM4 type=del size=522170: (22) Invalid argument 2024-09-12T00:21:58.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.993+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~G4P4MJ3W0N87.0 size=1048576 2024-09-12T00:21:58.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.997+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~G4P4MJ3W0N87.1 size=791345 2024-09-12T00:21:58.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:58.997+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=G4P4MJ3W0N87 tag=4652XL4IDHY8 type=write size=2888497 2024-09-12T00:21:58.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.001+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=X01XYMCN5IF0 type=del 2024-09-12T00:21:59.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.005+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=7TV72CPUC7EV type=del size=154032 2024-09-12T00:21:59.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.005+0000 7fd6489978c0 1 < canceled part key=_multipart_GVPNH3JSO07D.2~NYR68LL4AYRU.0 size=95202 2024-09-12T00:21:59.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.009+0000 7fd6489978c0 1 < canceled multipart upload key=GVPNH3JSO07D upload=NYR68LL4AYRU tag=SI89D5J8NCZU type=write size=1143778 2024-09-12T00:21:59.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.013+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=W8X2P8K57H2Y type=del size=1756268 2024-09-12T00:21:59.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.017+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=XNQ6HENNVSRV type=del 2024-09-12T00:21:59.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.021+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=ETOXWM9975SM type=del size=765256 2024-09-12T00:21:59.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.025+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=M54ERGEM4WO3 type=del 2024-09-12T00:21:59.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.029+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=Y2ZRSM2RJB9X type=del size=3120100 2024-09-12T00:21:59.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.037+0000 7fd6489978c0 1 < suggested update operation key=N0AAVPQ6MUQ1 tag=KGW9VRW66H4V type=del size=2842496 2024-09-12T00:21:59.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.045+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~2YQ43J605VOA.0 size=737625 2024-09-12T00:21:59.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.045+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=2YQ43J605VOA tag=MA78IQ02KKXT type=write size=1786201 2024-09-12T00:21:59.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.049+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=Y9XM95WGZLPW type=del 2024-09-12T00:21:59.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.053+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~CK6E3DY96LC1.0 size=1048576 2024-09-12T00:21:59.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.057+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~CK6E3DY96LC1.1 size=987692 2024-09-12T00:21:59.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.057+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=CK6E3DY96LC1 tag=A6W147STRJ32 type=write size=3084844 2024-09-12T00:21:59.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.065+0000 7fd6489978c0 1 < suggested update operation key=CFID1EVBXOVJ tag=C9QDML9HDMFC type=del size=3719842 2024-09-12T00:21:59.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.069+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~U3Y2O15SNA71.0 size=1048576 2024-09-12T00:21:59.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.073+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~U3Y2O15SNA71.1 size=1048576 2024-09-12T00:21:59.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.077+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~U3Y2O15SNA71.2 size=1002859 2024-09-12T00:21:59.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.077+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=U3Y2O15SNA71 tag=9P4WONKSVDP8 type=write size=4148587 2024-09-12T00:21:59.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.077+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~CSS4STVRTSFR.0 size=1048576 2024-09-12T00:21:59.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.081+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~CSS4STVRTSFR.1 size=1048576 2024-09-12T00:21:59.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.085+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~CSS4STVRTSFR.2 size=564301 2024-09-12T00:21:59.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.089+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=CSS4STVRTSFR tag=GSFNTEVYIPQJ type=write size=3710029 2024-09-12T00:21:59.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.093+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~FN6P8BY02RHD.0 size=705213 2024-09-12T00:21:59.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.093+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=FN6P8BY02RHD tag=5E4RDI16NRW0 type=write size=1753789 2024-09-12T00:21:59.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.101+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~78R9Y3N6I3TD.0 size=1048576 2024-09-12T00:21:59.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.101+0000 7fd6489978c0 1 < canceled part key=_multipart_N0AAVPQ6MUQ1.2~78R9Y3N6I3TD.1 size=1048576 2024-09-12T00:21:59.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.101+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~78R9Y3N6I3TD.2 size=226738 2024-09-12T00:21:59.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.109+0000 7fd6489978c0 1 < canceled multipart upload key=N0AAVPQ6MUQ1 upload=78R9Y3N6I3TD tag=VC9Q8UIXS3FJ type=write size=3372466 2024-09-12T00:21:59.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.113+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=HA8VIBQYZDM3 type=del size=1630547 2024-09-12T00:21:59.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.113+0000 7fd6489978c0 1 < canceled part key=_multipart_IHYHPKVPWTUL.2~TWXFFO6S0AF6.0 size=1048576 2024-09-12T00:21:59.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.113+0000 7fd6489978c0 1 < canceled part key=_multipart_IHYHPKVPWTUL.2~TWXFFO6S0AF6.1 size=1048576 2024-09-12T00:21:59.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.117+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~TWXFFO6S0AF6.2 size=610167 2024-09-12T00:21:59.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.121+0000 7fd6489978c0 1 < canceled multipart upload key=IHYHPKVPWTUL upload=TWXFFO6S0AF6 tag=9IZPRF76EKWS type=write size=3755895 2024-09-12T00:21:59.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.125+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=7J850H1CTS1H type=write size=602408 2024-09-12T00:21:59.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.133+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~EO86UH8MJUU0.0 size=95686 2024-09-12T00:21:59.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.137+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=EO86UH8MJUU0 tag=5XLUG6FW4C4K type=write size=1144262 2024-09-12T00:21:59.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.145+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~M48R9GCGQLMQ.0 size=1048576 2024-09-12T00:21:59.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.149+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~M48R9GCGQLMQ.1 size=831849 2024-09-12T00:21:59.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.149+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=M48R9GCGQLMQ tag=XU5ZR9MTF07Q type=write size=2929001 2024-09-12T00:21:59.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.153+0000 7fd6489978c0 1 < completed write operation key=DAOTTEMK2P2T tag=ZM172KIUI40T type=write size=927217 2024-09-12T00:21:59.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.157+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=EAB25Q39IM5S type=del size=3661351 2024-09-12T00:21:59.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.161+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~KD60IGE6CCUG.0 size=368204 2024-09-12T00:21:59.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.169+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=KD60IGE6CCUG tag=3CM618NUBCXN type=write size=1416780 2024-09-12T00:21:59.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.169+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=SQLH8VPW1P67 type=write size=379150 2024-09-12T00:21:59.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.173+0000 7fd6489978c0 1 < completed delete operation key=B2BW7GQ6UN9I tag=L08B3GOY9DAE type=del 2024-09-12T00:21:59.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.177+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=L504UWEISVX5 type=del size=1098918 2024-09-12T00:21:59.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.181+0000 7fd6489978c0 -1 < failed to complete operation key=N0AAVPQ6MUQ1 tag=GN3R6Z9E1HDR type=write size=862117: (22) Invalid argument 2024-09-12T00:21:59.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.185+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=0AKXKY7WL38S type=del size=2243212 2024-09-12T00:21:59.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.189+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~G4P4MJ3W0N87.0 size=1048576 2024-09-12T00:21:59.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.193+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~G4P4MJ3W0N87.1 size=791345 2024-09-12T00:21:59.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.201+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=G4P4MJ3W0N87 tag=4652XL4IDHY8 type=write size=2888497 2024-09-12T00:21:59.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.205+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~3VQ2ARA0XHA0.0 size=1048576 2024-09-12T00:21:59.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.209+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~3VQ2ARA0XHA0.1 size=1048576 2024-09-12T00:21:59.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.213+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~3VQ2ARA0XHA0.2 size=666453 2024-09-12T00:21:59.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.213+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=3VQ2ARA0XHA0 tag=8TJFAI83NAE3 type=write size=3812181 2024-09-12T00:21:59.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.217+0000 7fd6489978c0 1 < completed delete operation key=8FBXDX6GELE7 tag=7TV72CPUC7EV type=del 2024-09-12T00:21:59.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.221+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=VVF7MPSLV8YW type=del size=2132127 2024-09-12T00:21:59.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.225+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=W8X2P8K57H2Y type=del 2024-09-12T00:21:59.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.229+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=L36T2RT6PV9T type=del size=2397196 2024-09-12T00:21:59.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.233+0000 7fd6489978c0 1 < canceled operation key=ZXEIT45BWHXM tag=ETOXWM9975SM type=del size=765256 2024-09-12T00:21:59.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.237+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=P0NT7EZECVAD type=del size=3446640 2024-09-12T00:21:59.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.241+0000 7fd6489978c0 1 < canceled operation key=LZICTA4BWOW8 tag=Y2ZRSM2RJB9X type=del size=3120100 2024-09-12T00:21:59.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.249+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~3J5B1DGKJLQW.0 size=972568 2024-09-12T00:21:59.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.249+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=3J5B1DGKJLQW tag=2X3I3NKFTFHC type=write size=2021144 2024-09-12T00:21:59.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.253+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~2YQ43J605VOA.0 size=737625 2024-09-12T00:21:59.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.257+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=2YQ43J605VOA tag=MA78IQ02KKXT type=write size=1786201 2024-09-12T00:21:59.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.261+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=VIJPM7C5TK3X type=write size=140962 2024-09-12T00:21:59.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.265+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~CK6E3DY96LC1.0 size=1048576 2024-09-12T00:21:59.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.269+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~CK6E3DY96LC1.1 size=987692 2024-09-12T00:21:59.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.277+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=CK6E3DY96LC1 tag=A6W147STRJ32 type=write size=3084844 2024-09-12T00:21:59.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.281+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~AVJE3VNZHRAI.0 size=667756 2024-09-12T00:21:59.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.281+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=AVJE3VNZHRAI tag=B3UBIFTWDAPD type=write size=1716332 2024-09-12T00:21:59.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.285+0000 7fd6489978c0 1 < canceled part key=_multipart_CFID1EVBXOVJ.2~U3Y2O15SNA71.0 size=1048576 2024-09-12T00:21:59.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.285+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~U3Y2O15SNA71.1 size=1048576 2024-09-12T00:21:59.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.289+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~U3Y2O15SNA71.2 size=1002859 2024-09-12T00:21:59.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.297+0000 7fd6489978c0 1 < canceled multipart upload key=CFID1EVBXOVJ upload=U3Y2O15SNA71 tag=9P4WONKSVDP8 type=write size=4148587 2024-09-12T00:21:59.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.301+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=4XNPG2B3HDKZ type=del size=1321386 2024-09-12T00:21:59.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.305+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~FN6P8BY02RHD.0 size=705213 2024-09-12T00:21:59.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.313+0000 7fd6489978c0 1 < completed multipart upload key=GVPNH3JSO07D upload=FN6P8BY02RHD tag=5E4RDI16NRW0 type=write size=1753789 2024-09-12T00:21:59.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.317+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=OOGGO8VNPRAE type=del size=2562160 2024-09-12T00:21:59.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.321+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=HA8VIBQYZDM3 type=del 2024-09-12T00:21:59.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.325+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=80HWGLGQSCP1 type=del size=3780794 2024-09-12T00:21:59.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.329+0000 7fd6489978c0 1 < completed write operation key=ZW51KHCLPYN3 tag=7J850H1CTS1H type=write size=602408 2024-09-12T00:21:59.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.333+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=21Y16XXY6V4W type=del size=24154 2024-09-12T00:21:59.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.337+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~M48R9GCGQLMQ.0 size=1048576 2024-09-12T00:21:59.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.341+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~M48R9GCGQLMQ.1 size=831849 2024-09-12T00:21:59.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.349+0000 7fd6489978c0 1 < completed multipart upload key=GVPNH3JSO07D upload=M48R9GCGQLMQ tag=XU5ZR9MTF07Q type=write size=2929001 2024-09-12T00:21:59.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.353+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=ROZKQU58GRVE type=write size=863117 2024-09-12T00:21:59.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.357+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=EAB25Q39IM5S type=del 2024-09-12T00:21:59.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.361+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=6VE0O0SKW1S9 type=del size=3139037 2024-09-12T00:21:59.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.365+0000 7fd6489978c0 1 < completed write operation key=RGE8T6BTHBWK tag=SQLH8VPW1P67 type=write size=379150 2024-09-12T00:21:59.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.369+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=D102Y4MHXGLL type=del size=3846072 2024-09-12T00:21:59.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.373+0000 7fd6489978c0 1 < completed delete operation key=J5IW4G9C72DH tag=L504UWEISVX5 type=del 2024-09-12T00:21:59.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.377+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=SBBEBKPXMB9G type=del size=3058144 2024-09-12T00:21:59.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.381+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=0AKXKY7WL38S type=del 2024-09-12T00:21:59.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.385+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~VPU9LOPRRS4O.0 size=1048576 2024-09-12T00:21:59.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.389+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~VPU9LOPRRS4O.1 size=1048576 2024-09-12T00:21:59.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.393+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~VPU9LOPRRS4O.2 size=268790 2024-09-12T00:21:59.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.393+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=VPU9LOPRRS4O tag=S4BT091T3YBI type=write size=3414518 2024-09-12T00:21:59.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.397+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~3VQ2ARA0XHA0.0 size=1048576 2024-09-12T00:21:59.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.397+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~3VQ2ARA0XHA0.1 size=1048576 2024-09-12T00:21:59.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.397+0000 7fd6489978c0 1 < canceled part key=_multipart_ZXEIT45BWHXM.2~3VQ2ARA0XHA0.2 size=666453 2024-09-12T00:21:59.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.405+0000 7fd6489978c0 1 < canceled multipart upload key=ZXEIT45BWHXM upload=3VQ2ARA0XHA0 tag=8TJFAI83NAE3 type=write size=3812181 2024-09-12T00:21:59.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.413+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~CRQL4HXFPDBQ.0 size=1048576 2024-09-12T00:21:59.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.413+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~CRQL4HXFPDBQ.1 size=588491 2024-09-12T00:21:59.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.413+0000 7fd6489978c0 1 > prepared multipart upload key=DAOTTEMK2P2T upload=CRQL4HXFPDBQ tag=13EMPCHC89DE type=write size=2685643 2024-09-12T00:21:59.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.417+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=VVF7MPSLV8YW type=del 2024-09-12T00:21:59.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.425+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~G1D3EKB8R245.0 size=747729 2024-09-12T00:21:59.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.425+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=G1D3EKB8R245 tag=4ZMND4512QPE type=write size=1796305 2024-09-12T00:21:59.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.429+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=L36T2RT6PV9T type=del 2024-09-12T00:21:59.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.437+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~54XTOCZUX5ZK.0 size=583871 2024-09-12T00:21:59.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.437+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=54XTOCZUX5ZK tag=MAC7YQ8GRCLK type=write size=1632447 2024-09-12T00:21:59.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.441+0000 7fd6489978c0 1 < completed delete operation key=LZICTA4BWOW8 tag=P0NT7EZECVAD type=del 2024-09-12T00:21:59.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.449+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~1IUMGDWN21P2.0 size=1048576 2024-09-12T00:21:59.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.453+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~1IUMGDWN21P2.1 size=792607 2024-09-12T00:21:59.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.453+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=1IUMGDWN21P2 tag=5T0SOGW8MTMO type=write size=2889759 2024-09-12T00:21:59.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.457+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~3J5B1DGKJLQW.0 size=972568 2024-09-12T00:21:59.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.461+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=3J5B1DGKJLQW tag=2X3I3NKFTFHC type=write size=2021144 2024-09-12T00:21:59.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.469+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~ELCN74E4RFJB.0 size=443879 2024-09-12T00:21:59.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.469+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=ELCN74E4RFJB tag=ACBNGF4FF3CD type=write size=1492455 2024-09-12T00:21:59.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.473+0000 7fd6489978c0 1 < completed write operation key=HUKWLE56FRX2 tag=VIJPM7C5TK3X type=write size=140962 2024-09-12T00:21:59.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.481+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~69DFM95PJDSX.0 size=1048576 2024-09-12T00:21:59.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.485+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~69DFM95PJDSX.1 size=877221 2024-09-12T00:21:59.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.485+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=69DFM95PJDSX tag=MXSUZI0AYQWC type=write size=2974373 2024-09-12T00:21:59.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.489+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~AVJE3VNZHRAI.0 size=667756 2024-09-12T00:21:59.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.493+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=AVJE3VNZHRAI tag=B3UBIFTWDAPD type=write size=1716332 2024-09-12T00:21:59.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.501+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~C12SO4AGI0YE.0 size=1048576 2024-09-12T00:21:59.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.505+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~C12SO4AGI0YE.1 size=268696 2024-09-12T00:21:59.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.505+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=C12SO4AGI0YE tag=D11CQEPXJKXO type=write size=2365848 2024-09-12T00:21:59.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.509+0000 7fd6489978c0 1 < completed delete operation key=8FBXDX6GELE7 tag=4XNPG2B3HDKZ type=del 2024-09-12T00:21:59.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.513+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=NGO604LCFH5B type=del size=2484322 2024-09-12T00:21:59.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.517+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=OOGGO8VNPRAE type=del 2024-09-12T00:21:59.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.521+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=5YFE15Z9LFQS type=del size=3318938 2024-09-12T00:21:59.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.521+0000 7fd6489978c0 1 < completed delete operation key=RGE8T6BTHBWK tag=80HWGLGQSCP1 type=del 2024-09-12T00:21:59.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.525+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=1AJ10FYHGM4O type=del size=1546667 2024-09-12T00:21:59.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.529+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=21Y16XXY6V4W type=del 2024-09-12T00:21:59.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.537+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~9URH57FVXAQK.0 size=699984 2024-09-12T00:21:59.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.537+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=9URH57FVXAQK tag=UP1QZDIEVZ3C type=write size=1748560 2024-09-12T00:21:59.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.541+0000 7fd6489978c0 1 < completed write operation key=CBXBFK3OXXKG tag=ROZKQU58GRVE type=write size=863117 2024-09-12T00:21:59.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.545+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=691MZSGTYIIZ type=del size=751679 2024-09-12T00:21:59.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.553+0000 7fd6489978c0 1 < suggested update operation key=8FBXDX6GELE7 tag=6VE0O0SKW1S9 type=del size=3139037 2024-09-12T00:21:59.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.557+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=RDRNSGZ4R5EC type=del size=1580928 2024-09-12T00:21:59.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.561+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=D102Y4MHXGLL type=del 2024-09-12T00:21:59.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.565+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=QUEQ2B21AUZM type=del size=2203065 2024-09-12T00:21:59.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.569+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=SBBEBKPXMB9G type=del 2024-09-12T00:21:59.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.573+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=6BSWLC3AUTZH type=del size=4172662 2024-09-12T00:21:59.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.577+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~VPU9LOPRRS4O.0 size=1048576 2024-09-12T00:21:59.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.577+0000 7fd6489978c0 1 < canceled part key=_multipart_HUKWLE56FRX2.2~VPU9LOPRRS4O.1 size=1048576 2024-09-12T00:21:59.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.577+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~VPU9LOPRRS4O.2 size=268790 2024-09-12T00:21:59.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.585+0000 7fd6489978c0 1 < canceled multipart upload key=HUKWLE56FRX2 upload=VPU9LOPRRS4O tag=S4BT091T3YBI type=write size=3414518 2024-09-12T00:21:59.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.593+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~V5WJZ6G8O8CA.0 size=1048576 2024-09-12T00:21:59.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.593+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~V5WJZ6G8O8CA.1 size=1048576 2024-09-12T00:21:59.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.597+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~V5WJZ6G8O8CA.2 size=963114 2024-09-12T00:21:59.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.597+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=V5WJZ6G8O8CA tag=Q4Z11U3QAPIP type=write size=4108842 2024-09-12T00:21:59.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.601+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~CRQL4HXFPDBQ.0 size=1048576 2024-09-12T00:21:59.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.601+0000 7fd6489978c0 1 < canceled part key=_multipart_DAOTTEMK2P2T.2~CRQL4HXFPDBQ.1 size=588491 2024-09-12T00:21:59.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.609+0000 7fd6489978c0 1 < canceled multipart upload key=DAOTTEMK2P2T upload=CRQL4HXFPDBQ tag=13EMPCHC89DE type=write size=2685643 2024-09-12T00:21:59.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.613+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=1XBTLYPL76E0 type=del size=286936 2024-09-12T00:21:59.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.617+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~G1D3EKB8R245.0 size=747729 2024-09-12T00:21:59.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.621+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=G1D3EKB8R245 tag=4ZMND4512QPE type=write size=1796305 2024-09-12T00:21:59.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.625+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=RWC7M2ZMYZ9A type=write size=552012 2024-09-12T00:21:59.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.629+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~54XTOCZUX5ZK.0 size=583871 2024-09-12T00:21:59.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.637+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=54XTOCZUX5ZK tag=MAC7YQ8GRCLK type=write size=1632447 2024-09-12T00:21:59.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.641+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~UW3RMCTBHK3X.0 size=669836 2024-09-12T00:21:59.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.641+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=UW3RMCTBHK3X tag=I5ZYFY7A8A9Q type=write size=1718412 2024-09-12T00:21:59.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.645+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~1IUMGDWN21P2.0 size=1048576 2024-09-12T00:21:59.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.649+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~1IUMGDWN21P2.1 size=792607 2024-09-12T00:21:59.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.657+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=1IUMGDWN21P2 tag=5T0SOGW8MTMO type=write size=2889759 2024-09-12T00:21:59.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.661+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~18YGWL0CPB2T.0 size=691361 2024-09-12T00:21:59.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.661+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=18YGWL0CPB2T tag=DGAIGM1LGV2E type=write size=1739937 2024-09-12T00:21:59.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.665+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~ELCN74E4RFJB.0 size=443879 2024-09-12T00:21:59.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.673+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=ELCN74E4RFJB tag=ACBNGF4FF3CD type=write size=1492455 2024-09-12T00:21:59.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.681+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~LNCV1I208ZDL.0 size=1048576 2024-09-12T00:21:59.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.681+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~LNCV1I208ZDL.1 size=1048576 2024-09-12T00:21:59.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.685+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~LNCV1I208ZDL.2 size=758825 2024-09-12T00:21:59.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.685+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=LNCV1I208ZDL tag=9BHGTELAIW05 type=write size=3904553 2024-09-12T00:21:59.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.689+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~69DFM95PJDSX.0 size=1048576 2024-09-12T00:21:59.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.693+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~69DFM95PJDSX.1 size=877221 2024-09-12T00:21:59.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.701+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=69DFM95PJDSX tag=MXSUZI0AYQWC type=write size=2974373 2024-09-12T00:21:59.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.705+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=5J0YTCY55E82 type=del size=3688502 2024-09-12T00:21:59.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.709+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~C12SO4AGI0YE.0 size=1048576 2024-09-12T00:21:59.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.713+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~C12SO4AGI0YE.1 size=268696 2024-09-12T00:21:59.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.717+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=C12SO4AGI0YE tag=D11CQEPXJKXO type=write size=2365848 2024-09-12T00:21:59.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.721+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=37DGF02B99ON type=del size=1664401 2024-09-12T00:21:59.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.725+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=NGO604LCFH5B type=del 2024-09-12T00:21:59.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.729+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~0YVMTHNDQ9S9.0 size=428742 2024-09-12T00:21:59.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.729+0000 7fd6489978c0 1 > prepared multipart upload key=DAOTTEMK2P2T upload=0YVMTHNDQ9S9 tag=8P2R9428G3ET type=write size=1477318 2024-09-12T00:21:59.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.737+0000 7fd6489978c0 1 < suggested remove operation key=ES2BLTWZT6PT tag=5YFE15Z9LFQS type=del 2024-09-12T00:21:59.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.745+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~4C62IMDQA4MM.0 size=208025 2024-09-12T00:21:59.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.745+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=4C62IMDQA4MM tag=KWW26ZV4E4LF type=write size=1256601 2024-09-12T00:21:59.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.749+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=1AJ10FYHGM4O type=del 2024-09-12T00:21:59.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.753+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=CQIOCAAASETF type=del size=29781 2024-09-12T00:21:59.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.753+0000 7fd6489978c0 1 < canceled part key=_multipart_3JZP8TZFEIMH.2~9URH57FVXAQK.0 size=699984 2024-09-12T00:21:59.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.761+0000 7fd6489978c0 1 < canceled multipart upload key=3JZP8TZFEIMH upload=9URH57FVXAQK tag=UP1QZDIEVZ3C type=write size=1748560 2024-09-12T00:21:59.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.765+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=4XYQ1506ESJZ type=del size=3127612 2024-09-12T00:21:59.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.773+0000 7fd6489978c0 1 < suggested update operation key=G4EUTQOHAT2E tag=691MZSGTYIIZ type=del size=751679 2024-09-12T00:21:59.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.777+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=NAUI2XKXRJDR type=del size=3605949 2024-09-12T00:21:59.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.785+0000 7fd6489978c0 1 < suggested update operation key=LZICTA4BWOW8 tag=RDRNSGZ4R5EC type=del size=1580928 2024-09-12T00:21:59.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.789+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=EWPU1TY0O4NW type=del size=1819530 2024-09-12T00:21:59.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.793+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=QUEQ2B21AUZM type=del 2024-09-12T00:21:59.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.797+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~3BV107V9AFMH.0 size=1048576 2024-09-12T00:21:59.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.801+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~3BV107V9AFMH.1 size=1048576 2024-09-12T00:21:59.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.805+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~3BV107V9AFMH.2 size=30618 2024-09-12T00:21:59.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.805+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=3BV107V9AFMH tag=WA6X4I8CI9N4 type=write size=3176346 2024-09-12T00:21:59.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.809+0000 7fd6489978c0 1 < canceled operation key=9ACGS2FIY7AF tag=6BSWLC3AUTZH type=del size=4172662 2024-09-12T00:21:59.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.817+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~G4QQRW1FOEKY.0 size=1048576 2024-09-12T00:21:59.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.821+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~G4QQRW1FOEKY.1 size=94766 2024-09-12T00:21:59.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.821+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=G4QQRW1FOEKY tag=QB86FH3AEGUB type=write size=2191918 2024-09-12T00:21:59.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.821+0000 7fd6489978c0 1 < canceled part key=_multipart_9ACGS2FIY7AF.2~V5WJZ6G8O8CA.0 size=1048576 2024-09-12T00:21:59.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.825+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~V5WJZ6G8O8CA.1 size=1048576 2024-09-12T00:21:59.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.829+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~V5WJZ6G8O8CA.2 size=963114 2024-09-12T00:21:59.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.837+0000 7fd6489978c0 1 < canceled multipart upload key=9ACGS2FIY7AF upload=V5WJZ6G8O8CA tag=Q4Z11U3QAPIP type=write size=4108842 2024-09-12T00:21:59.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.841+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=T1PKXUS66OAL type=del size=521857 2024-09-12T00:21:59.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.845+0000 7fd6489978c0 1 < canceled operation key=9CK160BK5YYY tag=1XBTLYPL76E0 type=del size=286936 2024-09-12T00:21:59.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.853+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~2IT8L98DLC37.0 size=1048576 2024-09-12T00:21:59.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.857+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~2IT8L98DLC37.1 size=1048576 2024-09-12T00:21:59.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.857+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~2IT8L98DLC37.2 size=359513 2024-09-12T00:21:59.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.857+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=2IT8L98DLC37 tag=F5480E0J1C3J type=write size=3505241 2024-09-12T00:21:59.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.861+0000 7fd6489978c0 1 < completed write operation key=CBXBFK3OXXKG tag=RWC7M2ZMYZ9A type=write size=552012 2024-09-12T00:21:59.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.869+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~6XDTEQ5SNCZH.0 size=1048576 2024-09-12T00:21:59.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.873+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~6XDTEQ5SNCZH.1 size=958091 2024-09-12T00:21:59.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.873+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=6XDTEQ5SNCZH tag=6649B6R6G225 type=write size=3055243 2024-09-12T00:21:59.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.877+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~UW3RMCTBHK3X.0 size=669836 2024-09-12T00:21:59.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.885+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=UW3RMCTBHK3X tag=I5ZYFY7A8A9Q type=write size=1718412 2024-09-12T00:21:59.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.893+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~2QO9LL1Y2LBL.0 size=1048576 2024-09-12T00:21:59.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.897+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~2QO9LL1Y2LBL.1 size=998768 2024-09-12T00:21:59.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.897+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=2QO9LL1Y2LBL tag=1JIKU24MZLND type=write size=3095920 2024-09-12T00:21:59.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.901+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~18YGWL0CPB2T.0 size=691361 2024-09-12T00:21:59.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.905+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=18YGWL0CPB2T tag=DGAIGM1LGV2E type=write size=1739937 2024-09-12T00:21:59.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.909+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=T6MXP8Q50KTT type=del size=521434 2024-09-12T00:21:59.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.913+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~LNCV1I208ZDL.0 size=1048576 2024-09-12T00:21:59.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.917+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~LNCV1I208ZDL.1 size=1048576 2024-09-12T00:21:59.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.921+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~LNCV1I208ZDL.2 size=758825 2024-09-12T00:21:59.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.925+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=LNCV1I208ZDL tag=9BHGTELAIW05 type=write size=3904553 2024-09-12T00:21:59.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.929+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=5DFPQNXXY4K9 type=del size=1047988 2024-09-12T00:21:59.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.937+0000 7fd6489978c0 1 < suggested update operation key=9ACGS2FIY7AF tag=5J0YTCY55E82 type=del size=3688502 2024-09-12T00:21:59.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.941+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=GMYB945CFNOU type=del size=2995042 2024-09-12T00:21:59.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.945+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=37DGF02B99ON type=del 2024-09-12T00:21:59.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.949+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=2YPP0ZBQ79KV type=write size=506041 2024-09-12T00:21:59.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.953+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~0YVMTHNDQ9S9.0 size=428742 2024-09-12T00:21:59.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.961+0000 7fd6489978c0 1 < completed multipart upload key=DAOTTEMK2P2T upload=0YVMTHNDQ9S9 tag=8P2R9428G3ET type=write size=1477318 2024-09-12T00:21:59.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.965+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=Q8SR5FURPLW2 type=write size=164621 2024-09-12T00:21:59.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.969+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~4C62IMDQA4MM.0 size=208025 2024-09-12T00:21:59.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.973+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=4C62IMDQA4MM tag=KWW26ZV4E4LF type=write size=1256601 2024-09-12T00:21:59.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.981+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~LDH6P7NWOZ5P.0 size=163491 2024-09-12T00:21:59.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.981+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=LDH6P7NWOZ5P tag=DM4V4GHSD25M type=write size=1212067 2024-09-12T00:21:59.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.985+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=CQIOCAAASETF type=del 2024-09-12T00:21:59.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.989+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=VI4K51PS4S30 type=del size=3697403 2024-09-12T00:21:59.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.993+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=4XYQ1506ESJZ type=del 2024-09-12T00:21:59.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:21:59.997+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=69X18A48ATNV type=del size=138408 2024-09-12T00:21:59.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.001+0000 7fd6489978c0 -1 < failed to complete operation key=LZICTA4BWOW8 tag=NAUI2XKXRJDR type=del size=3605949: (22) Invalid argument 2024-09-12T00:22:00.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.005+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~87URFX3P43B0.0 size=1048576 2024-09-12T00:22:00.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.005+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~87URFX3P43B0.1 size=1048576 2024-09-12T00:22:00.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.009+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~87URFX3P43B0.2 size=988373 2024-09-12T00:22:00.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.009+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=87URFX3P43B0 tag=CD8PAWIK95RF type=write size=4134101 2024-09-12T00:22:00.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.013+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=EWPU1TY0O4NW type=del 2024-09-12T00:22:00.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.017+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=I9WO9MFK6Z03 type=del size=3805119 2024-09-12T00:22:00.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.017+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~3BV107V9AFMH.0 size=1048576 2024-09-12T00:22:00.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.021+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~3BV107V9AFMH.1 size=1048576 2024-09-12T00:22:00.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.025+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~3BV107V9AFMH.2 size=30618 2024-09-12T00:22:00.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.029+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=3BV107V9AFMH tag=WA6X4I8CI9N4 type=write size=3176346 2024-09-12T00:22:00.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.033+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=65OCT2W8OEP0 type=del size=381883 2024-09-12T00:22:00.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.037+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~G4QQRW1FOEKY.0 size=1048576 2024-09-12T00:22:00.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.037+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~G4QQRW1FOEKY.1 size=94766 2024-09-12T00:22:00.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.045+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=G4QQRW1FOEKY tag=QB86FH3AEGUB type=write size=2191918 2024-09-12T00:22:00.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.053+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~0I2RCZLYA2VF.0 size=1048576 2024-09-12T00:22:00.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.053+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~0I2RCZLYA2VF.1 size=418595 2024-09-12T00:22:00.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.053+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=0I2RCZLYA2VF tag=CA3XPEP6EOVQ type=write size=2515747 2024-09-12T00:22:00.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.061+0000 7fd6489978c0 1 < suggested update operation key=DAOTTEMK2P2T tag=T1PKXUS66OAL type=del size=521857 2024-09-12T00:22:00.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.065+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=NGFU4EZFUSK1 type=del size=2430029 2024-09-12T00:22:00.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.069+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~2IT8L98DLC37.0 size=1048576 2024-09-12T00:22:00.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.073+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~2IT8L98DLC37.1 size=1048576 2024-09-12T00:22:00.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.077+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~2IT8L98DLC37.2 size=359513 2024-09-12T00:22:00.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.085+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=2IT8L98DLC37 tag=F5480E0J1C3J type=write size=3505241 2024-09-12T00:22:00.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.093+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~JBVSYI36H6DS.0 size=1048576 2024-09-12T00:22:00.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.097+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~JBVSYI36H6DS.1 size=1048576 2024-09-12T00:22:00.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.101+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~JBVSYI36H6DS.2 size=1024770 2024-09-12T00:22:00.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.101+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=JBVSYI36H6DS tag=WJ2RM5V2J1LH type=write size=4170498 2024-09-12T00:22:00.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.105+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~6XDTEQ5SNCZH.0 size=1048576 2024-09-12T00:22:00.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.105+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~6XDTEQ5SNCZH.1 size=958091 2024-09-12T00:22:00.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.113+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=6XDTEQ5SNCZH tag=6649B6R6G225 type=write size=3055243 2024-09-12T00:22:00.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.117+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=Y2DVL48TRW6Z type=del size=1763441 2024-09-12T00:22:00.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.121+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~2QO9LL1Y2LBL.0 size=1048576 2024-09-12T00:22:00.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.125+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~2QO9LL1Y2LBL.1 size=998768 2024-09-12T00:22:00.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.129+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=2QO9LL1Y2LBL tag=1JIKU24MZLND type=write size=3095920 2024-09-12T00:22:00.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.137+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~PR41LU83YXX9.0 size=1048576 2024-09-12T00:22:00.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.137+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~PR41LU83YXX9.1 size=1676 2024-09-12T00:22:00.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.137+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=PR41LU83YXX9 tag=YH3Y1K0OZVEC type=write size=2098828 2024-09-12T00:22:00.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.141+0000 7fd6489978c0 1 < completed delete operation key=8FBXDX6GELE7 tag=T6MXP8Q50KTT type=del 2024-09-12T00:22:00.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.145+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=DBXBXEB2937Q type=write size=767863 2024-09-12T00:22:00.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.149+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=5DFPQNXXY4K9 type=del 2024-09-12T00:22:00.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.157+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~6P4W65V637PS.0 size=1048576 2024-09-12T00:22:00.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.161+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~6P4W65V637PS.1 size=1048576 2024-09-12T00:22:00.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.165+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~6P4W65V637PS.2 size=571367 2024-09-12T00:22:00.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.165+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=6P4W65V637PS tag=6XZPJVUXRW5B type=write size=3717095 2024-09-12T00:22:00.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.169+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=GMYB945CFNOU type=del 2024-09-12T00:22:00.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.173+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=F02VHKMQEZ8K type=del size=380143 2024-09-12T00:22:00.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.181+0000 7fd6489978c0 1 < suggested remove operation key=K9FD1L86Q05B tag=2YPP0ZBQ79KV type=write 2024-09-12T00:22:00.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.185+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=482KSMDMH6CL type=del size=1801750 2024-09-12T00:22:00.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.193+0000 7fd6489978c0 1 < completed write operation key=IHYHPKVPWTUL tag=Q8SR5FURPLW2 type=write size=164621 2024-09-12T00:22:00.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.201+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~0M0N36DWDX4J.0 size=742289 2024-09-12T00:22:00.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.201+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=0M0N36DWDX4J tag=OXDFKYGG2KKB type=write size=1790865 2024-09-12T00:22:00.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.205+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~LDH6P7NWOZ5P.0 size=163491 2024-09-12T00:22:00.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.209+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=LDH6P7NWOZ5P tag=DM4V4GHSD25M type=write size=1212067 2024-09-12T00:22:00.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.213+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=K4PRI1VYB5CF type=del size=2180397 2024-09-12T00:22:00.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.217+0000 7fd6489978c0 1 < canceled operation key=CFID1EVBXOVJ tag=VI4K51PS4S30 type=del size=3697403 2024-09-12T00:22:00.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.221+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=WTU5I4G6A1EC type=write size=867275 2024-09-12T00:22:00.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.225+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=69X18A48ATNV type=del 2024-09-12T00:22:00.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.229+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=BLVBP3K5XPWX type=del size=3246624 2024-09-12T00:22:00.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.233+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~87URFX3P43B0.0 size=1048576 2024-09-12T00:22:00.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.237+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~87URFX3P43B0.1 size=1048576 2024-09-12T00:22:00.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.237+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~87URFX3P43B0.2 size=988373 2024-09-12T00:22:00.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.245+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=87URFX3P43B0 tag=CD8PAWIK95RF type=write size=4134101 2024-09-12T00:22:00.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.249+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=7WIZVS3JN928 type=del size=1308267 2024-09-12T00:22:00.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.257+0000 7fd6489978c0 1 < suggested update operation key=YJJBTNI318EH tag=I9WO9MFK6Z03 type=del size=3805119 2024-09-12T00:22:00.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.261+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=4BRG3E5N6HPV type=del size=2705573 2024-09-12T00:22:00.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.265+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=65OCT2W8OEP0 type=del 2024-09-12T00:22:00.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.273+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~01NY4QBX462B.0 size=130823 2024-09-12T00:22:00.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.273+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=01NY4QBX462B tag=DB4K1Z5AVJVX type=write size=1179399 2024-09-12T00:22:00.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.277+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~0I2RCZLYA2VF.0 size=1048576 2024-09-12T00:22:00.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.281+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~0I2RCZLYA2VF.1 size=418595 2024-09-12T00:22:00.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.285+0000 7fd6489978c0 1 < completed multipart upload key=GVPNH3JSO07D upload=0I2RCZLYA2VF tag=CA3XPEP6EOVQ type=write size=2515747 2024-09-12T00:22:00.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.289+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=Z89NWW8EYVA7 type=del size=1070049 2024-09-12T00:22:00.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.293+0000 7fd6489978c0 1 < completed delete operation key=B2BW7GQ6UN9I tag=NGFU4EZFUSK1 type=del 2024-09-12T00:22:00.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.297+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=0GU9G3A3735T type=del size=3112475 2024-09-12T00:22:00.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.301+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~JBVSYI36H6DS.0 size=1048576 2024-09-12T00:22:00.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.305+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~JBVSYI36H6DS.1 size=1048576 2024-09-12T00:22:00.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.309+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~JBVSYI36H6DS.2 size=1024770 2024-09-12T00:22:00.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.313+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=JBVSYI36H6DS tag=WJ2RM5V2J1LH type=write size=4170498 2024-09-12T00:22:00.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.321+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~PMUDYO6IWVZC.0 size=1048576 2024-09-12T00:22:00.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.325+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~PMUDYO6IWVZC.1 size=1048576 2024-09-12T00:22:00.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.329+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~PMUDYO6IWVZC.2 size=283540 2024-09-12T00:22:00.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.329+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=PMUDYO6IWVZC tag=57RFAALVSSH0 type=write size=3429268 2024-09-12T00:22:00.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.333+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=Y2DVL48TRW6Z type=del 2024-09-12T00:22:00.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.337+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=YUWRBYUXEU72 type=del size=1727153 2024-09-12T00:22:00.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.341+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~PR41LU83YXX9.0 size=1048576 2024-09-12T00:22:00.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.345+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~PR41LU83YXX9.1 size=1676 2024-09-12T00:22:00.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.349+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=PR41LU83YXX9 tag=YH3Y1K0OZVEC type=write size=2098828 2024-09-12T00:22:00.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.357+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~85BEGYAYK6FT.0 size=1048576 2024-09-12T00:22:00.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.361+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~85BEGYAYK6FT.1 size=1048576 2024-09-12T00:22:00.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.361+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~85BEGYAYK6FT.2 size=707917 2024-09-12T00:22:00.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.361+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=85BEGYAYK6FT tag=L2X2IPNK5ZXN type=write size=3853645 2024-09-12T00:22:00.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.365+0000 7fd6489978c0 1 < completed write operation key=M9YKGQ2GA5CO tag=DBXBXEB2937Q type=write size=767863 2024-09-12T00:22:00.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.373+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~556XJH8YYEME.0 size=1048576 2024-09-12T00:22:00.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.377+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~556XJH8YYEME.1 size=1048576 2024-09-12T00:22:00.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.381+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~556XJH8YYEME.2 size=458140 2024-09-12T00:22:00.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.381+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=556XJH8YYEME tag=0HK90A3VTX7A type=write size=3603868 2024-09-12T00:22:00.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.381+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~6P4W65V637PS.0 size=1048576 2024-09-12T00:22:00.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.381+0000 7fd6489978c0 1 < canceled part key=_multipart_CBXBFK3OXXKG.2~6P4W65V637PS.1 size=1048576 2024-09-12T00:22:00.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.385+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~6P4W65V637PS.2 size=571367 2024-09-12T00:22:00.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.393+0000 7fd6489978c0 1 < canceled multipart upload key=CBXBFK3OXXKG upload=6P4W65V637PS tag=6XZPJVUXRW5B type=write size=3717095 2024-09-12T00:22:00.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.397+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=HEXNW2F2DT5J type=del size=2662820 2024-09-12T00:22:00.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.401+0000 7fd6489978c0 1 < completed delete operation key=JPVKBVRCZTE9 tag=F02VHKMQEZ8K type=del 2024-09-12T00:22:00.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.405+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=F6R8DDZ09DHL type=del size=4169039 2024-09-12T00:22:00.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.413+0000 7fd6489978c0 1 < suggested update operation key=3JZP8TZFEIMH tag=482KSMDMH6CL type=del size=1801750 2024-09-12T00:22:00.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.417+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=88VG2SO57W1X type=write size=1029123 2024-09-12T00:22:00.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.425+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~0M0N36DWDX4J.0 size=742289 2024-09-12T00:22:00.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.429+0000 7fd6489978c0 1 < completed multipart upload key=G4EUTQOHAT2E upload=0M0N36DWDX4J tag=OXDFKYGG2KKB type=write size=1790865 2024-09-12T00:22:00.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.433+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=H7U4J4QFT0CD type=del size=3371039 2024-09-12T00:22:00.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.437+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=K4PRI1VYB5CF type=del 2024-09-12T00:22:00.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.445+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~FSMAWMNMV0MB.0 size=1048576 2024-09-12T00:22:00.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.445+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~FSMAWMNMV0MB.1 size=1048576 2024-09-12T00:22:00.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.449+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~FSMAWMNMV0MB.2 size=1014332 2024-09-12T00:22:00.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.449+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=FSMAWMNMV0MB tag=3BN31F3DZM0F type=write size=4160060 2024-09-12T00:22:00.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.457+0000 7fd6489978c0 1 < suggested remove operation key=K9FD1L86Q05B tag=WTU5I4G6A1EC type=write 2024-09-12T00:22:00.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.461+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=3V8FE3S7E01N type=del size=3870840 2024-09-12T00:22:00.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.465+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=BLVBP3K5XPWX type=del 2024-09-12T00:22:00.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.469+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=VDHXO5K5ZYVV type=del size=160876 2024-09-12T00:22:00.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.473+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=7WIZVS3JN928 type=del 2024-09-12T00:22:00.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.477+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=XSU0WNCQYQ3Y type=del size=2488920 2024-09-12T00:22:00.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.481+0000 7fd6489978c0 1 < completed delete operation key=B2BW7GQ6UN9I tag=4BRG3E5N6HPV type=del 2024-09-12T00:22:00.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.485+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=VAPL3OXFPUK4 type=del size=429371 2024-09-12T00:22:00.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.489+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~01NY4QBX462B.0 size=130823 2024-09-12T00:22:00.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.493+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=01NY4QBX462B tag=DB4K1Z5AVJVX type=write size=1179399 2024-09-12T00:22:00.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.501+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=6GMO0K7RI63I type=del size=3076361 2024-09-12T00:22:00.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.509+0000 7fd6489978c0 1 < suggested remove operation key=LZICTA4BWOW8 tag=Z89NWW8EYVA7 type=del 2024-09-12T00:22:00.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.513+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=O88CZ90DDCAK type=del size=3682656 2024-09-12T00:22:00.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.517+0000 7fd6489978c0 -1 < failed to complete operation key=3JZP8TZFEIMH tag=0GU9G3A3735T type=del size=3112475: (22) Invalid argument 2024-09-12T00:22:00.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.521+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=NMA68AB150X8 type=del size=2686360 2024-09-12T00:22:00.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.525+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~PMUDYO6IWVZC.0 size=1048576 2024-09-12T00:22:00.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.529+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~PMUDYO6IWVZC.1 size=1048576 2024-09-12T00:22:00.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.529+0000 7fd6489978c0 1 < canceled part key=_multipart_QBS4N1KGR1JB.2~PMUDYO6IWVZC.2 size=283540 2024-09-12T00:22:00.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.533+0000 7fd6489978c0 1 < canceled multipart upload key=QBS4N1KGR1JB upload=PMUDYO6IWVZC tag=57RFAALVSSH0 type=write size=3429268 2024-09-12T00:22:00.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.541+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~JLQH1E3LLN0Y.0 size=1048576 2024-09-12T00:22:00.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.541+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~JLQH1E3LLN0Y.1 size=1017146 2024-09-12T00:22:00.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.541+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=JLQH1E3LLN0Y tag=BE4PTNPA9Y86 type=write size=3114298 2024-09-12T00:22:00.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.549+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=YUWRBYUXEU72 type=del 2024-09-12T00:22:00.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.553+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~PRYEU1PWTWHA.0 size=977412 2024-09-12T00:22:00.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.553+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=PRYEU1PWTWHA tag=0OBKEFRHZAJS type=write size=2025988 2024-09-12T00:22:00.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.557+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~85BEGYAYK6FT.0 size=1048576 2024-09-12T00:22:00.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.561+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~85BEGYAYK6FT.1 size=1048576 2024-09-12T00:22:00.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.565+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~85BEGYAYK6FT.2 size=707917 2024-09-12T00:22:00.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.569+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=85BEGYAYK6FT tag=L2X2IPNK5ZXN type=write size=3853645 2024-09-12T00:22:00.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.573+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=CAZ9PCD104DN type=del size=800490 2024-09-12T00:22:00.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.577+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~556XJH8YYEME.0 size=1048576 2024-09-12T00:22:00.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.581+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~556XJH8YYEME.1 size=1048576 2024-09-12T00:22:00.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.585+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~556XJH8YYEME.2 size=458140 2024-09-12T00:22:00.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.589+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=556XJH8YYEME tag=0HK90A3VTX7A type=write size=3603868 2024-09-12T00:22:00.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.593+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=EPJPDKTERBJE type=del size=3408217 2024-09-12T00:22:00.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.597+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=HEXNW2F2DT5J type=del 2024-09-12T00:22:00.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.601+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=7FDJYG88WXLM type=write size=287153 2024-09-12T00:22:00.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.605+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=F6R8DDZ09DHL type=del 2024-09-12T00:22:00.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.613+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~DMN05HCZGAJB.0 size=1048576 2024-09-12T00:22:00.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.617+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~DMN05HCZGAJB.1 size=854522 2024-09-12T00:22:00.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.617+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=DMN05HCZGAJB tag=RLC9R3FCBAM8 type=write size=2951674 2024-09-12T00:22:00.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.621+0000 7fd6489978c0 1 < completed write operation key=KAT2TB3FGAYG tag=88VG2SO57W1X type=write size=1029123 2024-09-12T00:22:00.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.625+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=Q6E3YDL1YR6E type=del size=2521846 2024-09-12T00:22:00.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.629+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=H7U4J4QFT0CD type=del 2024-09-12T00:22:00.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.633+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=TD52LYMLOLL4 type=write size=411533 2024-09-12T00:22:00.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.637+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~FSMAWMNMV0MB.0 size=1048576 2024-09-12T00:22:00.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.641+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~FSMAWMNMV0MB.1 size=1048576 2024-09-12T00:22:00.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.645+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~FSMAWMNMV0MB.2 size=1014332 2024-09-12T00:22:00.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.649+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=FSMAWMNMV0MB tag=3BN31F3DZM0F type=write size=4160060 2024-09-12T00:22:00.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.653+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=90GKS2ROLX4X type=del size=2686624 2024-09-12T00:22:00.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.657+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=3V8FE3S7E01N type=del 2024-09-12T00:22:00.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.665+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~64NXY2TWMAPV.0 size=1048576 2024-09-12T00:22:00.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.669+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~64NXY2TWMAPV.1 size=589348 2024-09-12T00:22:00.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.669+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=64NXY2TWMAPV tag=SNE1REQG3MSC type=write size=2686500 2024-09-12T00:22:00.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.673+0000 7fd6489978c0 1 < canceled operation key=JPVKBVRCZTE9 tag=VDHXO5K5ZYVV type=del size=160876 2024-09-12T00:22:00.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.677+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=9QAA0MMP7KB9 type=del size=740536 2024-09-12T00:22:00.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.681+0000 7fd6489978c0 1 < completed delete operation key=JPVKBVRCZTE9 tag=XSU0WNCQYQ3Y type=del 2024-09-12T00:22:00.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.689+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~UHLOBS1A22AJ.0 size=1048576 2024-09-12T00:22:00.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.689+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~UHLOBS1A22AJ.1 size=1048576 2024-09-12T00:22:00.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.693+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~UHLOBS1A22AJ.2 size=950287 2024-09-12T00:22:00.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.693+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=UHLOBS1A22AJ tag=1JUWY8THQ9CH type=write size=4096015 2024-09-12T00:22:00.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.697+0000 7fd6489978c0 1 < canceled operation key=2KP09UFI3N8B tag=VAPL3OXFPUK4 type=del size=429371 2024-09-12T00:22:00.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.701+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=RZ8FROUPX5T0 type=del size=1451829 2024-09-12T00:22:00.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.709+0000 7fd6489978c0 1 < suggested remove operation key=RGE8T6BTHBWK tag=6GMO0K7RI63I type=del 2024-09-12T00:22:00.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.713+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=DPU5NOOY9N1M type=del size=4104312 2024-09-12T00:22:00.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.721+0000 7fd6489978c0 1 < suggested remove operation key=ES2BLTWZT6PT tag=O88CZ90DDCAK type=del 2024-09-12T00:22:00.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.729+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~97T26MFE7IBZ.0 size=353077 2024-09-12T00:22:00.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.729+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=97T26MFE7IBZ tag=7RZNMM3MJGDE type=write size=1401653 2024-09-12T00:22:00.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.733+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=NMA68AB150X8 type=del 2024-09-12T00:22:00.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.737+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=CHTJGRO7YHLU type=del size=727093 2024-09-12T00:22:00.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.741+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~JLQH1E3LLN0Y.0 size=1048576 2024-09-12T00:22:00.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.741+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~JLQH1E3LLN0Y.1 size=1017146 2024-09-12T00:22:00.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.749+0000 7fd6489978c0 1 < completed multipart upload key=9ACGS2FIY7AF upload=JLQH1E3LLN0Y tag=BE4PTNPA9Y86 type=write size=3114298 2024-09-12T00:22:00.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.753+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=21F2MB7I2AJ1 type=write size=993010 2024-09-12T00:22:00.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.757+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~PRYEU1PWTWHA.0 size=977412 2024-09-12T00:22:00.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.761+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=PRYEU1PWTWHA tag=0OBKEFRHZAJS type=write size=2025988 2024-09-12T00:22:00.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.769+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~I540LFSIYC86.0 size=1048576 2024-09-12T00:22:00.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.777+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~I540LFSIYC86.1 size=994874 2024-09-12T00:22:00.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.777+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=I540LFSIYC86 tag=CEHWG5COGX2M type=write size=3092026 2024-09-12T00:22:00.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.777+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=CAZ9PCD104DN type=del 2024-09-12T00:22:00.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.785+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~PF8GLCR0HJGF.0 size=1048576 2024-09-12T00:22:00.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.789+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~PF8GLCR0HJGF.1 size=560760 2024-09-12T00:22:00.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.789+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=PF8GLCR0HJGF tag=FRUOLYC89EEO type=write size=2657912 2024-09-12T00:22:00.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.793+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=EPJPDKTERBJE type=del 2024-09-12T00:22:00.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.801+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~2KNWS1HWOIXZ.0 size=1048576 2024-09-12T00:22:00.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.801+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~2KNWS1HWOIXZ.1 size=28709 2024-09-12T00:22:00.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.801+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=2KNWS1HWOIXZ tag=OAM4CPKX1BR6 type=write size=2125861 2024-09-12T00:22:00.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.805+0000 7fd6489978c0 1 < completed write operation key=F2CTWM0T2698 tag=7FDJYG88WXLM type=write size=287153 2024-09-12T00:22:00.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.813+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~02YQZ65NEL6V.0 size=1048576 2024-09-12T00:22:00.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.817+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~02YQZ65NEL6V.1 size=901263 2024-09-12T00:22:00.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.817+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=02YQZ65NEL6V tag=8QX24O60OO9Y type=write size=2998415 2024-09-12T00:22:00.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.821+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~DMN05HCZGAJB.0 size=1048576 2024-09-12T00:22:00.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.825+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~DMN05HCZGAJB.1 size=854522 2024-09-12T00:22:00.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.829+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=DMN05HCZGAJB tag=RLC9R3FCBAM8 type=write size=2951674 2024-09-12T00:22:00.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.833+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=5A0SX0DA6LP0 type=write size=1015744 2024-09-12T00:22:00.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.841+0000 7fd6489978c0 1 < suggested remove operation key=9ACGS2FIY7AF tag=Q6E3YDL1YR6E type=del 2024-09-12T00:22:00.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.849+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~07SQZFRIBXU5.0 size=1048576 2024-09-12T00:22:00.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.853+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~07SQZFRIBXU5.1 size=788539 2024-09-12T00:22:00.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.853+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=07SQZFRIBXU5 tag=CJD52I9EFM5L type=write size=2885691 2024-09-12T00:22:00.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.857+0000 7fd6489978c0 1 < completed write operation key=9CK160BK5YYY tag=TD52LYMLOLL4 type=write size=411533 2024-09-12T00:22:00.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.861+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~Y5MYVUB0ZMTG.0 size=1048576 2024-09-12T00:22:00.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.865+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~Y5MYVUB0ZMTG.1 size=1048576 2024-09-12T00:22:00.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.869+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~Y5MYVUB0ZMTG.2 size=183326 2024-09-12T00:22:00.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.869+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=Y5MYVUB0ZMTG tag=Q8JA4CP4G494 type=write size=3329054 2024-09-12T00:22:00.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.873+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=90GKS2ROLX4X type=del 2024-09-12T00:22:00.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.877+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=H2R257FAJHCC type=del size=2489671 2024-09-12T00:22:00.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.881+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~64NXY2TWMAPV.0 size=1048576 2024-09-12T00:22:00.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.885+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~64NXY2TWMAPV.1 size=589348 2024-09-12T00:22:00.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.889+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=64NXY2TWMAPV tag=SNE1REQG3MSC type=write size=2686500 2024-09-12T00:22:00.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.893+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=SPTV8WHL885Z type=del size=3291888 2024-09-12T00:22:00.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.901+0000 7fd6489978c0 1 < suggested update operation key=KAT2TB3FGAYG tag=9QAA0MMP7KB9 type=del size=740536 2024-09-12T00:22:00.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.905+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=530WI14Q1A0A type=write size=167135 2024-09-12T00:22:00.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.909+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~UHLOBS1A22AJ.0 size=1048576 2024-09-12T00:22:00.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.913+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~UHLOBS1A22AJ.1 size=1048576 2024-09-12T00:22:00.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.917+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~UHLOBS1A22AJ.2 size=950287 2024-09-12T00:22:00.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.921+0000 7fd6489978c0 1 < completed multipart upload key=GVPNH3JSO07D upload=UHLOBS1A22AJ tag=1JUWY8THQ9CH type=write size=4096015 2024-09-12T00:22:00.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.929+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~3TZDZNB00LOT.0 size=1048576 2024-09-12T00:22:00.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.933+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~3TZDZNB00LOT.1 size=1048576 2024-09-12T00:22:00.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.937+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~3TZDZNB00LOT.2 size=715544 2024-09-12T00:22:00.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.937+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=3TZDZNB00LOT tag=6RYJ5OP10MQ6 type=write size=3861272 2024-09-12T00:22:00.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.945+0000 7fd6489978c0 1 < suggested remove operation key=Y3JFVW74FNT6 tag=RZ8FROUPX5T0 type=del 2024-09-12T00:22:00.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.949+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~A42ERZDNXRRV.0 size=194004 2024-09-12T00:22:00.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.949+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=A42ERZDNXRRV tag=EFREGR9QOWPK type=write size=1242580 2024-09-12T00:22:00.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.953+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=DPU5NOOY9N1M type=del 2024-09-12T00:22:00.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.961+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~COMWC3ZAU02D.0 size=437736 2024-09-12T00:22:00.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.961+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=COMWC3ZAU02D tag=XYKH2LVQ94LO type=write size=1486312 2024-09-12T00:22:00.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.965+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~97T26MFE7IBZ.0 size=353077 2024-09-12T00:22:00.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.969+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=97T26MFE7IBZ tag=7RZNMM3MJGDE type=write size=1401653 2024-09-12T00:22:00.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.977+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=SHAQN3DJJRFT type=del size=2765276 2024-09-12T00:22:00.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.981+0000 7fd6489978c0 1 < canceled operation key=M9YKGQ2GA5CO tag=CHTJGRO7YHLU type=del size=727093 2024-09-12T00:22:00.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.985+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=44AXZX4LCUQA type=write size=483879 2024-09-12T00:22:00.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.989+0000 7fd6489978c0 1 < suggested update operation key=HUKWLE56FRX2 tag=21F2MB7I2AJ1 type=write size=993010 2024-09-12T00:22:00.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.997+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~6QO0EPUA5U7N.0 size=918794 2024-09-12T00:22:00.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.997+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=6QO0EPUA5U7N tag=203C7JXWU3G3 type=write size=1967370 2024-09-12T00:22:00.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:00.997+0000 7fd6489978c0 1 < canceled part key=_multipart_ZW51KHCLPYN3.2~I540LFSIYC86.0 size=1048576 2024-09-12T00:22:01.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.001+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~I540LFSIYC86.1 size=994874 2024-09-12T00:22:01.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.009+0000 7fd6489978c0 1 < canceled multipart upload key=ZW51KHCLPYN3 upload=I540LFSIYC86 tag=CEHWG5COGX2M type=write size=3092026 2024-09-12T00:22:01.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.013+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=9MQX9ECO5XLD type=del size=745391 2024-09-12T00:22:01.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.013+0000 7fd6489978c0 1 < canceled part key=_multipart_ES2BLTWZT6PT.2~PF8GLCR0HJGF.0 size=1048576 2024-09-12T00:22:01.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.017+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~PF8GLCR0HJGF.1 size=560760 2024-09-12T00:22:01.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.021+0000 7fd6489978c0 1 < canceled multipart upload key=ES2BLTWZT6PT upload=PF8GLCR0HJGF tag=FRUOLYC89EEO type=write size=2657912 2024-09-12T00:22:01.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.029+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~CZUTSSRQ3FT3.0 size=591703 2024-09-12T00:22:01.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.029+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=CZUTSSRQ3FT3 tag=LS0YXYA8PETJ type=write size=1640279 2024-09-12T00:22:01.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.033+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~2KNWS1HWOIXZ.0 size=1048576 2024-09-12T00:22:01.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.033+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~2KNWS1HWOIXZ.1 size=28709 2024-09-12T00:22:01.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.041+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=2KNWS1HWOIXZ tag=OAM4CPKX1BR6 type=write size=2125861 2024-09-12T00:22:01.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.049+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~CE9HA2NSG077.0 size=889771 2024-09-12T00:22:01.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.049+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=CE9HA2NSG077 tag=RBYBZQL45RSW type=write size=1938347 2024-09-12T00:22:01.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.053+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~02YQZ65NEL6V.0 size=1048576 2024-09-12T00:22:01.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.053+0000 7fd6489978c0 1 < canceled part key=_multipart_YJJBTNI318EH.2~02YQZ65NEL6V.1 size=901263 2024-09-12T00:22:01.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.057+0000 7fd6489978c0 1 < canceled multipart upload key=YJJBTNI318EH upload=02YQZ65NEL6V tag=8QX24O60OO9Y type=write size=2998415 2024-09-12T00:22:01.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.061+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=1MZ405O1UH87 type=del size=888312 2024-09-12T00:22:01.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.065+0000 7fd6489978c0 1 < completed write operation key=25P4P2I6BE3H tag=5A0SX0DA6LP0 type=write size=1015744 2024-09-12T00:22:01.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.069+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=I9FB1K880UZV type=del size=2205704 2024-09-12T00:22:01.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.073+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~07SQZFRIBXU5.0 size=1048576 2024-09-12T00:22:01.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.073+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~07SQZFRIBXU5.1 size=788539 2024-09-12T00:22:01.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.077+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=07SQZFRIBXU5 tag=CJD52I9EFM5L type=write size=2885691 2024-09-12T00:22:01.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.081+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=003ZGCMAI18P type=del size=1048782 2024-09-12T00:22:01.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.085+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~Y5MYVUB0ZMTG.0 size=1048576 2024-09-12T00:22:01.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.089+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~Y5MYVUB0ZMTG.1 size=1048576 2024-09-12T00:22:01.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.089+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~Y5MYVUB0ZMTG.2 size=183326 2024-09-12T00:22:01.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.097+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=Y5MYVUB0ZMTG tag=Q8JA4CP4G494 type=write size=3329054 2024-09-12T00:22:01.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.101+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=6EQ2LY08J9F4 type=write size=32810 2024-09-12T00:22:01.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.105+0000 7fd6489978c0 1 < suggested remove operation key=2KP09UFI3N8B tag=H2R257FAJHCC type=del 2024-09-12T00:22:01.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.109+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=JGJKKG7ES276 type=del size=2201800 2024-09-12T00:22:01.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.113+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=SPTV8WHL885Z type=del 2024-09-12T00:22:01.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.121+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=MBT9B4U1O4P9 type=del size=787320 2024-09-12T00:22:01.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.125+0000 7fd6489978c0 1 < completed write operation key=KAT2TB3FGAYG tag=530WI14Q1A0A type=write size=167135 2024-09-12T00:22:01.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.129+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=0LTSXEDPON86 type=del size=1902878 2024-09-12T00:22:01.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.133+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~3TZDZNB00LOT.0 size=1048576 2024-09-12T00:22:01.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.133+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~3TZDZNB00LOT.1 size=1048576 2024-09-12T00:22:01.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.137+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~3TZDZNB00LOT.2 size=715544 2024-09-12T00:22:01.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.141+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=3TZDZNB00LOT tag=6RYJ5OP10MQ6 type=write size=3861272 2024-09-12T00:22:01.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.149+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~7PTGVIOJIX30.0 size=1048576 2024-09-12T00:22:01.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.149+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~7PTGVIOJIX30.1 size=598583 2024-09-12T00:22:01.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.149+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=7PTGVIOJIX30 tag=B0GAA2UZP3KO type=write size=2695735 2024-09-12T00:22:01.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.153+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~A42ERZDNXRRV.0 size=194004 2024-09-12T00:22:01.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.161+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=A42ERZDNXRRV tag=EFREGR9QOWPK type=write size=1242580 2024-09-12T00:22:01.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.165+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~K14GUNKVRUZX.0 size=655109 2024-09-12T00:22:01.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.165+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=K14GUNKVRUZX tag=WC5VUZK7C4PH type=write size=1703685 2024-09-12T00:22:01.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.169+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~COMWC3ZAU02D.0 size=437736 2024-09-12T00:22:01.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.173+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=COMWC3ZAU02D tag=XYKH2LVQ94LO type=write size=1486312 2024-09-12T00:22:01.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.181+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~46YWW7KX1PHY.0 size=511144 2024-09-12T00:22:01.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.181+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=46YWW7KX1PHY tag=G6ZDYBP77VGD type=write size=1559720 2024-09-12T00:22:01.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.185+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=SHAQN3DJJRFT type=del 2024-09-12T00:22:01.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.193+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~3OMKTWI19F3Z.0 size=1048576 2024-09-12T00:22:01.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.197+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~3OMKTWI19F3Z.1 size=926577 2024-09-12T00:22:01.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.197+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=3OMKTWI19F3Z tag=ZK22MPGJSMNT type=write size=3023729 2024-09-12T00:22:01.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.197+0000 7fd6489978c0 1 < completed write operation key=CBXBFK3OXXKG tag=44AXZX4LCUQA type=write size=483879 2024-09-12T00:22:01.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.201+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=9ZP79W2KTPU5 type=del size=2621681 2024-09-12T00:22:01.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.209+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~6QO0EPUA5U7N.0 size=918794 2024-09-12T00:22:01.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.213+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=6QO0EPUA5U7N tag=203C7JXWU3G3 type=write size=1967370 2024-09-12T00:22:01.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.217+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~1TQ541KSYJBY.0 size=1048576 2024-09-12T00:22:01.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.221+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~1TQ541KSYJBY.1 size=1048576 2024-09-12T00:22:01.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.225+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~1TQ541KSYJBY.2 size=365777 2024-09-12T00:22:01.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.225+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=1TQ541KSYJBY tag=HGGOTM1NNTRH type=write size=3511505 2024-09-12T00:22:01.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.229+0000 7fd6489978c0 1 < completed delete operation key=J5IW4G9C72DH tag=9MQX9ECO5XLD type=del 2024-09-12T00:22:01.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.233+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=FUAZ05AFL1UN type=del size=990108 2024-09-12T00:22:01.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.237+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~CZUTSSRQ3FT3.0 size=591703 2024-09-12T00:22:01.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.241+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=CZUTSSRQ3FT3 tag=LS0YXYA8PETJ type=write size=1640279 2024-09-12T00:22:01.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.245+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=OAFOFMY6Y769 type=del size=3298935 2024-09-12T00:22:01.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.249+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~CE9HA2NSG077.0 size=889771 2024-09-12T00:22:01.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.257+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=CE9HA2NSG077 tag=RBYBZQL45RSW type=write size=1938347 2024-09-12T00:22:01.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.257+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=44BSNY3DXZFE type=del size=566841 2024-09-12T00:22:01.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.261+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=1MZ405O1UH87 type=del 2024-09-12T00:22:01.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.265+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=Z9ZQ916I1FA1 type=del size=2721670 2024-09-12T00:22:01.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.269+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=I9FB1K880UZV type=del 2024-09-12T00:22:01.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.273+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=4XW75CMXONJK type=write size=667913 2024-09-12T00:22:01.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.281+0000 7fd6489978c0 1 < suggested update operation key=N0AAVPQ6MUQ1 tag=003ZGCMAI18P type=del size=1048782 2024-09-12T00:22:01.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.285+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=HLI0JBFRDBN4 type=del size=2115609 2024-09-12T00:22:01.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.289+0000 7fd6489978c0 1 < completed write operation key=DAOTTEMK2P2T tag=6EQ2LY08J9F4 type=write size=32810 2024-09-12T00:22:01.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.297+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=OAFO0O8ZGPDE type=write size=268788 2024-09-12T00:22:01.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.301+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=JGJKKG7ES276 type=del 2024-09-12T00:22:01.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.305+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=SWB4XZIHEY7O type=del size=3494975 2024-09-12T00:22:01.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.305+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=MBT9B4U1O4P9 type=del 2024-09-12T00:22:01.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.313+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~NGQ6LI2LMJ1B.0 size=972575 2024-09-12T00:22:01.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.313+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=NGQ6LI2LMJ1B tag=MMPTRAXTLGZ5 type=write size=2021151 2024-09-12T00:22:01.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.321+0000 7fd6489978c0 1 < suggested update operation key=LZICTA4BWOW8 tag=0LTSXEDPON86 type=del size=1902878 2024-09-12T00:22:01.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.325+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~ME8S2TH57IWQ.0 size=1048576 2024-09-12T00:22:01.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.329+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~ME8S2TH57IWQ.1 size=367961 2024-09-12T00:22:01.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.329+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=ME8S2TH57IWQ tag=5XJUGCJC6C5G type=write size=2465113 2024-09-12T00:22:01.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.333+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~7PTGVIOJIX30.0 size=1048576 2024-09-12T00:22:01.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.337+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~7PTGVIOJIX30.1 size=598583 2024-09-12T00:22:01.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.341+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=7PTGVIOJIX30 tag=B0GAA2UZP3KO type=write size=2695735 2024-09-12T00:22:01.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.345+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=A65PV9797EAP type=del size=1637548 2024-09-12T00:22:01.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.345+0000 7fd6489978c0 1 < canceled part key=_multipart_K9FD1L86Q05B.2~K14GUNKVRUZX.0 size=655109 2024-09-12T00:22:01.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.349+0000 7fd6489978c0 1 < canceled multipart upload key=K9FD1L86Q05B upload=K14GUNKVRUZX tag=WC5VUZK7C4PH type=write size=1703685 2024-09-12T00:22:01.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.353+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=H5C3NE28EHC5 type=write size=382788 2024-09-12T00:22:01.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.357+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~46YWW7KX1PHY.0 size=511144 2024-09-12T00:22:01.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.365+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=46YWW7KX1PHY tag=G6ZDYBP77VGD type=write size=1559720 2024-09-12T00:22:01.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.373+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~ECE4W3TID68G.0 size=1048576 2024-09-12T00:22:01.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.373+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~ECE4W3TID68G.1 size=1048576 2024-09-12T00:22:01.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.377+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~ECE4W3TID68G.2 size=868134 2024-09-12T00:22:01.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.377+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=ECE4W3TID68G tag=SFUN082G1C77 type=write size=4013862 2024-09-12T00:22:01.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.381+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~3OMKTWI19F3Z.0 size=1048576 2024-09-12T00:22:01.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.381+0000 7fd6489978c0 1 < canceled part key=_multipart_25P4P2I6BE3H.2~3OMKTWI19F3Z.1 size=926577 2024-09-12T00:22:01.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.385+0000 7fd6489978c0 1 < canceled multipart upload key=25P4P2I6BE3H upload=3OMKTWI19F3Z tag=ZK22MPGJSMNT type=write size=3023729 2024-09-12T00:22:01.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.389+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=8UNS9TUGLPII type=del size=3489548 2024-09-12T00:22:01.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.393+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=9ZP79W2KTPU5 type=del 2024-09-12T00:22:01.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.397+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=GAZUZPEH6PMN type=write size=959599 2024-09-12T00:22:01.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.401+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~1TQ541KSYJBY.0 size=1048576 2024-09-12T00:22:01.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.405+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~1TQ541KSYJBY.1 size=1048576 2024-09-12T00:22:01.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.405+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~1TQ541KSYJBY.2 size=365777 2024-09-12T00:22:01.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.413+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=1TQ541KSYJBY tag=HGGOTM1NNTRH type=write size=3511505 2024-09-12T00:22:01.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.417+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~5F673YMUUVLT.0 size=1048576 2024-09-12T00:22:01.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.421+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~5F673YMUUVLT.1 size=1048576 2024-09-12T00:22:01.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.421+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~5F673YMUUVLT.2 size=13154 2024-09-12T00:22:01.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.421+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=5F673YMUUVLT tag=Z048PL4O8WU6 type=write size=3158882 2024-09-12T00:22:01.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.429+0000 7fd6489978c0 1 < suggested remove operation key=J5IW4G9C72DH tag=FUAZ05AFL1UN type=del 2024-09-12T00:22:01.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.437+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~DL4SIUS8MV6G.0 size=1048576 2024-09-12T00:22:01.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.437+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~DL4SIUS8MV6G.1 size=1048576 2024-09-12T00:22:01.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.441+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~DL4SIUS8MV6G.2 size=205820 2024-09-12T00:22:01.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.441+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=DL4SIUS8MV6G tag=VSHSRQ2T7WD5 type=write size=3351548 2024-09-12T00:22:01.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.445+0000 7fd6489978c0 -1 < failed to complete operation key=LZICTA4BWOW8 tag=OAFOFMY6Y769 type=del size=3298935: (22) Invalid argument 2024-09-12T00:22:01.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.453+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=NL6D42P11FOX type=del size=1264644 2024-09-12T00:22:01.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.457+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=44BSNY3DXZFE type=del 2024-09-12T00:22:01.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.461+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=Z2HRQAMN1SV3 type=del size=3708674 2024-09-12T00:22:01.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.465+0000 7fd6489978c0 1 < canceled operation key=8JCL0F406L7I tag=Z9ZQ916I1FA1 type=del size=2721670 2024-09-12T00:22:01.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.469+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=P28YI7H91WPU type=del size=2433212 2024-09-12T00:22:01.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.473+0000 7fd6489978c0 1 < canceled operation key=K9FD1L86Q05B tag=4XW75CMXONJK type=write size=667913 2024-09-12T00:22:01.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.477+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=5U98MWC20UNX type=del size=4109126 2024-09-12T00:22:01.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.481+0000 7fd6489978c0 -1 < failed to complete operation key=J5IW4G9C72DH tag=HLI0JBFRDBN4 type=del size=2115609: (22) Invalid argument 2024-09-12T00:22:01.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.485+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=TKJ1OPHE27D3 type=del size=4185675 2024-09-12T00:22:01.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.489+0000 7fd6489978c0 -1 < failed to complete operation key=LZICTA4BWOW8 tag=OAFO0O8ZGPDE type=write size=268788: (22) Invalid argument 2024-09-12T00:22:01.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.493+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~E7TEAM1KFUG4.0 size=1048576 2024-09-12T00:22:01.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.497+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~E7TEAM1KFUG4.1 size=1048576 2024-09-12T00:22:01.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.501+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~E7TEAM1KFUG4.2 size=843877 2024-09-12T00:22:01.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.501+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=E7TEAM1KFUG4 tag=YJ0N0824RLEP type=write size=3989605 2024-09-12T00:22:01.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.505+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=SWB4XZIHEY7O type=del 2024-09-12T00:22:01.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.509+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=VJCVCIEH1FLB type=del size=4170948 2024-09-12T00:22:01.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.513+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~NGQ6LI2LMJ1B.0 size=972575 2024-09-12T00:22:01.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.517+0000 7fd6489978c0 1 < completed multipart upload key=GVPNH3JSO07D upload=NGQ6LI2LMJ1B tag=MMPTRAXTLGZ5 type=write size=2021151 2024-09-12T00:22:01.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.521+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=41LOW5GP2A9U type=del size=2614149 2024-09-12T00:22:01.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.525+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~ME8S2TH57IWQ.0 size=1048576 2024-09-12T00:22:01.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.529+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~ME8S2TH57IWQ.1 size=367961 2024-09-12T00:22:01.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.533+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=ME8S2TH57IWQ tag=5XJUGCJC6C5G type=write size=2465113 2024-09-12T00:22:01.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.541+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~BANQJXWJU8Q6.0 size=143950 2024-09-12T00:22:01.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.541+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=BANQJXWJU8Q6 tag=L3G1H7H1QVAB type=write size=1192526 2024-09-12T00:22:01.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.549+0000 7fd6489978c0 1 < suggested remove operation key=M9YKGQ2GA5CO tag=A65PV9797EAP type=del 2024-09-12T00:22:01.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.557+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=ZUK8GT2S9DTM type=write size=231053 2024-09-12T00:22:01.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.557+0000 7fd6489978c0 1 < canceled operation key=QBS4N1KGR1JB tag=H5C3NE28EHC5 type=write size=382788 2024-09-12T00:22:01.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.561+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=8VC4C9LX8W97 type=del size=1930677 2024-09-12T00:22:01.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.565+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~ECE4W3TID68G.0 size=1048576 2024-09-12T00:22:01.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.569+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~ECE4W3TID68G.1 size=1048576 2024-09-12T00:22:01.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.573+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~ECE4W3TID68G.2 size=868134 2024-09-12T00:22:01.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.577+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=ECE4W3TID68G tag=SFUN082G1C77 type=write size=4013862 2024-09-12T00:22:01.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.585+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~LFPZ5JWT5OJV.0 size=1048576 2024-09-12T00:22:01.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.589+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~LFPZ5JWT5OJV.1 size=224457 2024-09-12T00:22:01.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.589+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=LFPZ5JWT5OJV tag=I55B9YXIU2KC type=write size=2321609 2024-09-12T00:22:01.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.589+0000 7fd6489978c0 1 < completed delete operation key=8FBXDX6GELE7 tag=8UNS9TUGLPII type=del 2024-09-12T00:22:01.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.593+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=3KGPT9P255TZ type=del size=2881298 2024-09-12T00:22:01.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.597+0000 7fd6489978c0 1 < canceled operation key=ZXEIT45BWHXM tag=GAZUZPEH6PMN type=write size=959599 2024-09-12T00:22:01.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.601+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=6V0X7GDC0O6H type=del size=3500519 2024-09-12T00:22:01.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.605+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~5F673YMUUVLT.0 size=1048576 2024-09-12T00:22:01.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.609+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~5F673YMUUVLT.1 size=1048576 2024-09-12T00:22:01.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.613+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~5F673YMUUVLT.2 size=13154 2024-09-12T00:22:01.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.617+0000 7fd6489978c0 1 < completed multipart upload key=CFID1EVBXOVJ upload=5F673YMUUVLT tag=Z048PL4O8WU6 type=write size=3158882 2024-09-12T00:22:01.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.621+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=MWAV9R2KMW1O type=del size=2806693 2024-09-12T00:22:01.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.625+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~DL4SIUS8MV6G.0 size=1048576 2024-09-12T00:22:01.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.629+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~DL4SIUS8MV6G.1 size=1048576 2024-09-12T00:22:01.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.633+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~DL4SIUS8MV6G.2 size=205820 2024-09-12T00:22:01.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.641+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=DL4SIUS8MV6G tag=VSHSRQ2T7WD5 type=write size=3351548 2024-09-12T00:22:01.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.645+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=XCB5JM9HF3HV type=del size=3592564 2024-09-12T00:22:01.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.649+0000 7fd6489978c0 1 < completed delete operation key=JPVKBVRCZTE9 tag=NL6D42P11FOX type=del 2024-09-12T00:22:01.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.653+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=6SKG9SAGJ4J7 type=del size=995524 2024-09-12T00:22:01.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.657+0000 7fd6489978c0 1 < completed delete operation key=J5IW4G9C72DH tag=Z2HRQAMN1SV3 type=del 2024-09-12T00:22:01.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.665+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=3FVKPVCHOR7X type=del size=1719292 2024-09-12T00:22:01.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.669+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=P28YI7H91WPU type=del 2024-09-12T00:22:01.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.673+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~C2RU5GZOU31E.0 size=1048576 2024-09-12T00:22:01.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.677+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~C2RU5GZOU31E.1 size=1048576 2024-09-12T00:22:01.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.681+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~C2RU5GZOU31E.2 size=456536 2024-09-12T00:22:01.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.681+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=C2RU5GZOU31E tag=C02D3X09O7BI type=write size=3602264 2024-09-12T00:22:01.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.685+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=5U98MWC20UNX type=del 2024-09-12T00:22:01.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.693+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~DD2OLT1K43B7.0 size=1048576 2024-09-12T00:22:01.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.693+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~DD2OLT1K43B7.1 size=272842 2024-09-12T00:22:01.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.693+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=DD2OLT1K43B7 tag=PKR3E23AAR8M type=write size=2369994 2024-09-12T00:22:01.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.705+0000 7fd6489978c0 1 < suggested remove operation key=KAT2TB3FGAYG tag=TKJ1OPHE27D3 type=del 2024-09-12T00:22:01.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.709+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=WFA0E81D0ALO type=write size=823767 2024-09-12T00:22:01.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.713+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~E7TEAM1KFUG4.0 size=1048576 2024-09-12T00:22:01.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.717+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~E7TEAM1KFUG4.1 size=1048576 2024-09-12T00:22:01.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.717+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~E7TEAM1KFUG4.2 size=843877 2024-09-12T00:22:01.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.725+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=E7TEAM1KFUG4 tag=YJ0N0824RLEP type=write size=3989605 2024-09-12T00:22:01.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.729+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=V4V2M4F8U3K0 type=write size=723434 2024-09-12T00:22:01.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.729+0000 7fd6489978c0 -1 < no bi entry to suggest for operation key=KAT2TB3FGAYG tag=VJCVCIEH1FLB type=del size=4170948: (2) No such file or directory 2024-09-12T00:22:01.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.737+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~0YVCLWZPLQCG.0 size=238990 2024-09-12T00:22:01.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.737+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=0YVCLWZPLQCG tag=OA1IOA7QFN86 type=write size=1287566 2024-09-12T00:22:01.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.741+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=41LOW5GP2A9U type=del 2024-09-12T00:22:01.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.749+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~G1EQ3FEQTXDX.0 size=213075 2024-09-12T00:22:01.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.749+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=G1EQ3FEQTXDX tag=OU0B1IZPW05O type=write size=1261651 2024-09-12T00:22:01.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.753+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~BANQJXWJU8Q6.0 size=143950 2024-09-12T00:22:01.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.757+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=BANQJXWJU8Q6 tag=L3G1H7H1QVAB type=write size=1192526 2024-09-12T00:22:01.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.761+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=9A6LPHMJY4HE type=del size=1591898 2024-09-12T00:22:01.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.765+0000 7fd6489978c0 1 < completed write operation key=ZXEIT45BWHXM tag=ZUK8GT2S9DTM type=write size=231053 2024-09-12T00:22:01.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.773+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~Q3WUXGDMZQ0H.0 size=896229 2024-09-12T00:22:01.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.773+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=Q3WUXGDMZQ0H tag=QZQTZFG3G4VZ type=write size=1944805 2024-09-12T00:22:01.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.777+0000 7fd6489978c0 1 < completed delete operation key=8FBXDX6GELE7 tag=8VC4C9LX8W97 type=del 2024-09-12T00:22:01.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.781+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=X64MYEJA2GBU type=write size=532493 2024-09-12T00:22:01.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.785+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~LFPZ5JWT5OJV.0 size=1048576 2024-09-12T00:22:01.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.785+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~LFPZ5JWT5OJV.1 size=224457 2024-09-12T00:22:01.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.793+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=LFPZ5JWT5OJV tag=I55B9YXIU2KC type=write size=2321609 2024-09-12T00:22:01.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.797+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=YPU6PHR8LSLS type=del size=692586 2024-09-12T00:22:01.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.801+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=3KGPT9P255TZ type=del 2024-09-12T00:22:01.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.805+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=S2NBUF6SG0FD type=del size=85031 2024-09-12T00:22:01.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.809+0000 7fd6489978c0 1 < canceled operation key=ZXEIT45BWHXM tag=6V0X7GDC0O6H type=del size=3500519 2024-09-12T00:22:01.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.821+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~FTD6JHX25LQY.0 size=1048576 2024-09-12T00:22:01.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.821+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~FTD6JHX25LQY.1 size=1048576 2024-09-12T00:22:01.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.825+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~FTD6JHX25LQY.2 size=933393 2024-09-12T00:22:01.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.825+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=FTD6JHX25LQY tag=N1OX5EB3OLOX type=write size=4079121 2024-09-12T00:22:01.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.829+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=MWAV9R2KMW1O type=del 2024-09-12T00:22:01.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.833+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=FDBRRLT34SDW type=del size=2486374 2024-09-12T00:22:01.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.837+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=XCB5JM9HF3HV type=del 2024-09-12T00:22:01.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.845+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~Z91U87USU44A.0 size=1048576 2024-09-12T00:22:01.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.849+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~Z91U87USU44A.1 size=1048576 2024-09-12T00:22:01.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.849+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~Z91U87USU44A.2 size=554059 2024-09-12T00:22:01.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.849+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=Z91U87USU44A tag=C73XU8PHKTZH type=write size=3699787 2024-09-12T00:22:01.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.853+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=6SKG9SAGJ4J7 type=del 2024-09-12T00:22:01.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.861+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~ZLH24NPLIO1I.0 size=1048576 2024-09-12T00:22:01.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.865+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~ZLH24NPLIO1I.1 size=1048576 2024-09-12T00:22:01.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.865+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~ZLH24NPLIO1I.2 size=861399 2024-09-12T00:22:01.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.865+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=ZLH24NPLIO1I tag=ERMZBI5DN8ZG type=write size=4007127 2024-09-12T00:22:01.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.869+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=3FVKPVCHOR7X type=del 2024-09-12T00:22:01.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.873+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=91SQFHJ9J841 type=del size=4088531 2024-09-12T00:22:01.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.877+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~C2RU5GZOU31E.0 size=1048576 2024-09-12T00:22:01.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.881+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~C2RU5GZOU31E.1 size=1048576 2024-09-12T00:22:01.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.885+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~C2RU5GZOU31E.2 size=456536 2024-09-12T00:22:01.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.889+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=C2RU5GZOU31E tag=C02D3X09O7BI type=write size=3602264 2024-09-12T00:22:01.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.897+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~3J18TG7ATSN3.0 size=1048576 2024-09-12T00:22:01.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.901+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~3J18TG7ATSN3.1 size=345433 2024-09-12T00:22:01.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.901+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=3J18TG7ATSN3 tag=M388N1Y2CDB2 type=write size=2442585 2024-09-12T00:22:01.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.905+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~DD2OLT1K43B7.0 size=1048576 2024-09-12T00:22:01.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.909+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~DD2OLT1K43B7.1 size=272842 2024-09-12T00:22:01.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.913+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=DD2OLT1K43B7 tag=PKR3E23AAR8M type=write size=2369994 2024-09-12T00:22:01.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.917+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=EIL9BUY3LGT3 type=del size=596684 2024-09-12T00:22:01.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.921+0000 7fd6489978c0 1 < completed write operation key=ES2BLTWZT6PT tag=WFA0E81D0ALO type=write size=823767 2024-09-12T00:22:01.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.929+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~1Z8DN81I42SK.0 size=1048576 2024-09-12T00:22:01.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.933+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~1Z8DN81I42SK.1 size=278769 2024-09-12T00:22:01.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.933+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=1Z8DN81I42SK tag=PFS12YN9BW9L type=write size=2375921 2024-09-12T00:22:01.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.937+0000 7fd6489978c0 1 < completed write operation key=YJJBTNI318EH tag=V4V2M4F8U3K0 type=write size=723434 2024-09-12T00:22:01.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.941+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=E5150BOWCWPQ type=write size=41073 2024-09-12T00:22:01.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.945+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~0YVCLWZPLQCG.0 size=238990 2024-09-12T00:22:01.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.949+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=0YVCLWZPLQCG tag=OA1IOA7QFN86 type=write size=1287566 2024-09-12T00:22:01.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.957+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~4RT9JNV3K2CU.0 size=1048576 2024-09-12T00:22:01.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.957+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~4RT9JNV3K2CU.1 size=76786 2024-09-12T00:22:01.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.957+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=4RT9JNV3K2CU tag=20YX8YYZEMKP type=write size=2173938 2024-09-12T00:22:01.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.961+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~G1EQ3FEQTXDX.0 size=213075 2024-09-12T00:22:01.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.969+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=G1EQ3FEQTXDX tag=OU0B1IZPW05O type=write size=1261651 2024-09-12T00:22:01.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.973+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=1VJ0L7U0FY6U type=write size=10563 2024-09-12T00:22:01.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.981+0000 7fd6489978c0 1 < suggested remove operation key=HUKWLE56FRX2 tag=9A6LPHMJY4HE type=del 2024-09-12T00:22:01.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.989+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~ENQIRR8HN673.0 size=1048576 2024-09-12T00:22:01.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.989+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~ENQIRR8HN673.1 size=765437 2024-09-12T00:22:01.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.989+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=ENQIRR8HN673 tag=H3S1MUELAG00 type=write size=2862589 2024-09-12T00:22:01.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:01.993+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~Q3WUXGDMZQ0H.0 size=896229 2024-09-12T00:22:01.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.001+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=Q3WUXGDMZQ0H tag=QZQTZFG3G4VZ type=write size=1944805 2024-09-12T00:22:02.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.005+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=LDAQQ2BSBBIU type=del size=1641910 2024-09-12T00:22:02.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.009+0000 7fd6489978c0 1 < completed write operation key=RGE8T6BTHBWK tag=X64MYEJA2GBU type=write size=532493 2024-09-12T00:22:02.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.009+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=B8RQUJYMX7U7 type=del size=2220580 2024-09-12T00:22:02.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.013+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=YPU6PHR8LSLS type=del 2024-09-12T00:22:02.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.017+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=YMH96MQA6WD9 type=del size=3376018 2024-09-12T00:22:02.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.021+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=S2NBUF6SG0FD type=del 2024-09-12T00:22:02.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.029+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~3YRAII8DHIYV.0 size=550 2024-09-12T00:22:02.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.029+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=3YRAII8DHIYV tag=C5M5AKKMF7W1 type=write size=1049126 2024-09-12T00:22:02.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.033+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~FTD6JHX25LQY.0 size=1048576 2024-09-12T00:22:02.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.033+0000 7fd6489978c0 1 < canceled part key=_multipart_CFID1EVBXOVJ.2~FTD6JHX25LQY.1 size=1048576 2024-09-12T00:22:02.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.037+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~FTD6JHX25LQY.2 size=933393 2024-09-12T00:22:02.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.041+0000 7fd6489978c0 1 < canceled multipart upload key=CFID1EVBXOVJ upload=FTD6JHX25LQY tag=N1OX5EB3OLOX type=write size=4079121 2024-09-12T00:22:02.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.049+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=03JWAYQV9GZJ type=del size=4171413 2024-09-12T00:22:02.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.053+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=FDBRRLT34SDW type=del 2024-09-12T00:22:02.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.057+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=ELOHMAY08M1N type=del size=310965 2024-09-12T00:22:02.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.061+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~Z91U87USU44A.0 size=1048576 2024-09-12T00:22:02.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.065+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~Z91U87USU44A.1 size=1048576 2024-09-12T00:22:02.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.065+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~Z91U87USU44A.2 size=554059 2024-09-12T00:22:02.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.073+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=Z91U87USU44A tag=C73XU8PHKTZH type=write size=3699787 2024-09-12T00:22:02.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.077+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=58PA1PUJ1WSE type=del size=1662097 2024-09-12T00:22:02.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.081+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~ZLH24NPLIO1I.0 size=1048576 2024-09-12T00:22:02.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.085+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~ZLH24NPLIO1I.1 size=1048576 2024-09-12T00:22:02.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.085+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~ZLH24NPLIO1I.2 size=861399 2024-09-12T00:22:02.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.093+0000 7fd6489978c0 1 < completed multipart upload key=GVPNH3JSO07D upload=ZLH24NPLIO1I tag=ERMZBI5DN8ZG type=write size=4007127 2024-09-12T00:22:02.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.097+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=4D9GNQDO09VD type=del size=2422961 2024-09-12T00:22:02.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.101+0000 7fd6489978c0 1 < canceled operation key=8FBXDX6GELE7 tag=91SQFHJ9J841 type=del size=4088531 2024-09-12T00:22:02.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.105+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=CB3K7D145O2G type=del size=2204367 2024-09-12T00:22:02.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.109+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~3J18TG7ATSN3.0 size=1048576 2024-09-12T00:22:02.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.109+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~3J18TG7ATSN3.1 size=345433 2024-09-12T00:22:02.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.117+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=3J18TG7ATSN3 tag=M388N1Y2CDB2 type=write size=2442585 2024-09-12T00:22:02.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.125+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~NGJT2PJMY52Q.0 size=1048576 2024-09-12T00:22:02.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.125+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~NGJT2PJMY52Q.1 size=526935 2024-09-12T00:22:02.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.125+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=NGJT2PJMY52Q tag=ERRZBLK5WOUJ type=write size=2624087 2024-09-12T00:22:02.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.129+0000 7fd6489978c0 1 < completed delete operation key=3JZP8TZFEIMH tag=EIL9BUY3LGT3 type=del 2024-09-12T00:22:02.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.137+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~S48JSPQN340I.0 size=1048576 2024-09-12T00:22:02.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.141+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~S48JSPQN340I.1 size=1048576 2024-09-12T00:22:02.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.141+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~S48JSPQN340I.2 size=808058 2024-09-12T00:22:02.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.141+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=S48JSPQN340I tag=5TA0BD4FZHU9 type=write size=3953786 2024-09-12T00:22:02.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.145+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~1Z8DN81I42SK.0 size=1048576 2024-09-12T00:22:02.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.149+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~1Z8DN81I42SK.1 size=278769 2024-09-12T00:22:02.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.153+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=1Z8DN81I42SK tag=PFS12YN9BW9L type=write size=2375921 2024-09-12T00:22:02.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.161+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=P6DR1XWBE05U type=del size=71970 2024-09-12T00:22:02.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.165+0000 7fd6489978c0 1 < completed write operation key=9ACGS2FIY7AF tag=E5150BOWCWPQ type=write size=41073 2024-09-12T00:22:02.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.169+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=X5Q517HNMHOK type=write size=617949 2024-09-12T00:22:02.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.173+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~4RT9JNV3K2CU.0 size=1048576 2024-09-12T00:22:02.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.177+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~4RT9JNV3K2CU.1 size=76786 2024-09-12T00:22:02.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.185+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=4RT9JNV3K2CU tag=20YX8YYZEMKP type=write size=2173938 2024-09-12T00:22:02.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.185+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=F5OENLW05R2P type=del size=3207117 2024-09-12T00:22:02.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.193+0000 7fd6489978c0 1 < suggested update operation key=2KP09UFI3N8B tag=1VJ0L7U0FY6U type=write size=10563 2024-09-12T00:22:02.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.201+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~YMJK840YXHUE.0 size=791436 2024-09-12T00:22:02.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.201+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=YMJK840YXHUE tag=6RCG8QFBRV9K type=write size=1840012 2024-09-12T00:22:02.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.205+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~ENQIRR8HN673.0 size=1048576 2024-09-12T00:22:02.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.209+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~ENQIRR8HN673.1 size=765437 2024-09-12T00:22:02.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.213+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=ENQIRR8HN673 tag=H3S1MUELAG00 type=write size=2862589 2024-09-12T00:22:02.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.217+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=DXRK1UTPG728 type=write size=20785 2024-09-12T00:22:02.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.225+0000 7fd6489978c0 1 < suggested update operation key=Y3JFVW74FNT6 tag=LDAQQ2BSBBIU type=del size=1641910 2024-09-12T00:22:02.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.233+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~WLXBWI2R8S6E.0 size=1048576 2024-09-12T00:22:02.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.237+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~WLXBWI2R8S6E.1 size=1048576 2024-09-12T00:22:02.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.237+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~WLXBWI2R8S6E.2 size=540805 2024-09-12T00:22:02.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.237+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=WLXBWI2R8S6E tag=J0GDDSN7RMYE type=write size=3686533 2024-09-12T00:22:02.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.245+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=B8RQUJYMX7U7 type=del 2024-09-12T00:22:02.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.245+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=FXBJZKFJDTSU type=write size=10714 2024-09-12T00:22:02.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.249+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=YMH96MQA6WD9 type=del 2024-09-12T00:22:02.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.253+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=59TQX0MEYMBD type=del size=3087382 2024-09-12T00:22:02.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.257+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~3YRAII8DHIYV.0 size=550 2024-09-12T00:22:02.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.265+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=3YRAII8DHIYV tag=C5M5AKKMF7W1 type=write size=1049126 2024-09-12T00:22:02.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.269+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=YHKCVV4ZF194 type=del size=1089113 2024-09-12T00:22:02.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.273+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=03JWAYQV9GZJ type=del 2024-09-12T00:22:02.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.277+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=NMDKSX1DLNJ7 type=del size=1209503 2024-09-12T00:22:02.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.285+0000 7fd6489978c0 1 < suggested update operation key=RGE8T6BTHBWK tag=ELOHMAY08M1N type=del size=310965 2024-09-12T00:22:02.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.293+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~UK0RORNZTPZC.0 size=1048576 2024-09-12T00:22:02.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.293+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~UK0RORNZTPZC.1 size=1048576 2024-09-12T00:22:02.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.297+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~UK0RORNZTPZC.2 size=660348 2024-09-12T00:22:02.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.297+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=UK0RORNZTPZC tag=E5WKG4I4JATI type=write size=3806076 2024-09-12T00:22:02.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.301+0000 7fd6489978c0 -1 < failed to complete operation key=2KP09UFI3N8B tag=58PA1PUJ1WSE type=del size=1662097: (22) Invalid argument 2024-09-12T00:22:02.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.305+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=O6IQZDO924JP type=del size=1167260 2024-09-12T00:22:02.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.313+0000 7fd6489978c0 1 < suggested update operation key=3JZP8TZFEIMH tag=4D9GNQDO09VD type=del size=2422961 2024-09-12T00:22:02.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.321+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~GCBCEDJCRQYQ.0 size=594018 2024-09-12T00:22:02.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.321+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=GCBCEDJCRQYQ tag=8MHCSXTLEPMZ type=write size=1642594 2024-09-12T00:22:02.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.329+0000 7fd6489978c0 1 < suggested update operation key=J5IW4G9C72DH tag=CB3K7D145O2G type=del size=2204367 2024-09-12T00:22:02.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.333+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~551ZMYXFZZNN.0 size=1048576 2024-09-12T00:22:02.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.337+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~551ZMYXFZZNN.1 size=1048576 2024-09-12T00:22:02.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.341+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~551ZMYXFZZNN.2 size=387487 2024-09-12T00:22:02.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.341+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=551ZMYXFZZNN tag=DKSC8DYZSQ5O type=write size=3533215 2024-09-12T00:22:02.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.345+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~NGJT2PJMY52Q.0 size=1048576 2024-09-12T00:22:02.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.349+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~NGJT2PJMY52Q.1 size=526935 2024-09-12T00:22:02.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.353+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=NGJT2PJMY52Q tag=ERRZBLK5WOUJ type=write size=2624087 2024-09-12T00:22:02.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.357+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=75OFNLLV2LY2 type=del size=1474413 2024-09-12T00:22:02.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.361+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~S48JSPQN340I.0 size=1048576 2024-09-12T00:22:02.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.365+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~S48JSPQN340I.1 size=1048576 2024-09-12T00:22:02.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.369+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~S48JSPQN340I.2 size=808058 2024-09-12T00:22:02.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.373+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=S48JSPQN340I tag=5TA0BD4FZHU9 type=write size=3953786 2024-09-12T00:22:02.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.377+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=CXI0AUL2U77G type=del size=2914125 2024-09-12T00:22:02.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.381+0000 7fd6489978c0 -1 < failed to complete operation key=2KP09UFI3N8B tag=P6DR1XWBE05U type=del size=71970: (22) Invalid argument 2024-09-12T00:22:02.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.385+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=9Q4HKAKV7ANN type=del size=3438985 2024-09-12T00:22:02.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.389+0000 7fd6489978c0 1 < completed write operation key=G4EUTQOHAT2E tag=X5Q517HNMHOK type=write size=617949 2024-09-12T00:22:02.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.393+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=SBQFNZTIXQ97 type=del size=2502293 2024-09-12T00:22:02.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.397+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=F5OENLW05R2P type=del 2024-09-12T00:22:02.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.401+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=50ANBFYXCYFU type=del size=899514 2024-09-12T00:22:02.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.405+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~YMJK840YXHUE.0 size=791436 2024-09-12T00:22:02.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.413+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=YMJK840YXHUE tag=6RCG8QFBRV9K type=write size=1840012 2024-09-12T00:22:02.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.417+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~WJL65T42AZLQ.0 size=154799 2024-09-12T00:22:02.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.417+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=WJL65T42AZLQ tag=DIANV1YRTX4W type=write size=1203375 2024-09-12T00:22:02.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.421+0000 7fd6489978c0 1 < completed write operation key=GVPNH3JSO07D tag=DXRK1UTPG728 type=write size=20785 2024-09-12T00:22:02.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.429+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~HPHA1XVF71S7.0 size=1048576 2024-09-12T00:22:02.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.433+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~HPHA1XVF71S7.1 size=818909 2024-09-12T00:22:02.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.433+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=HPHA1XVF71S7 tag=67HP2V2482FU type=write size=2916061 2024-09-12T00:22:02.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.433+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~WLXBWI2R8S6E.0 size=1048576 2024-09-12T00:22:02.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.433+0000 7fd6489978c0 1 < canceled part key=_multipart_ZW51KHCLPYN3.2~WLXBWI2R8S6E.1 size=1048576 2024-09-12T00:22:02.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.437+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~WLXBWI2R8S6E.2 size=540805 2024-09-12T00:22:02.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.441+0000 7fd6489978c0 1 < canceled multipart upload key=ZW51KHCLPYN3 upload=WLXBWI2R8S6E tag=J0GDDSN7RMYE type=write size=3686533 2024-09-12T00:22:02.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.445+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=5U4N6Q9U8RPY type=del size=2334349 2024-09-12T00:22:02.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.449+0000 7fd6489978c0 -1 < failed to complete operation key=3JZP8TZFEIMH tag=FXBJZKFJDTSU type=write size=10714: (22) Invalid argument 2024-09-12T00:22:02.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.457+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~DR55YZETP0UQ.0 size=1048576 2024-09-12T00:22:02.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.461+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~DR55YZETP0UQ.1 size=1048576 2024-09-12T00:22:02.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.461+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~DR55YZETP0UQ.2 size=927928 2024-09-12T00:22:02.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.461+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=DR55YZETP0UQ tag=MT8CFOIS891N type=write size=4073656 2024-09-12T00:22:02.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.469+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=59TQX0MEYMBD type=del 2024-09-12T00:22:02.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.473+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~6ETK1OLG9CZP.0 size=1048576 2024-09-12T00:22:02.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.477+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~6ETK1OLG9CZP.1 size=1048576 2024-09-12T00:22:02.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.481+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~6ETK1OLG9CZP.2 size=175325 2024-09-12T00:22:02.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.481+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=6ETK1OLG9CZP tag=PVRG36R4P5LR type=write size=3321053 2024-09-12T00:22:02.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.485+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=YHKCVV4ZF194 type=del 2024-09-12T00:22:02.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.489+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=B7MYGSZLMEOA type=del size=1965505 2024-09-12T00:22:02.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.493+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=NMDKSX1DLNJ7 type=del 2024-09-12T00:22:02.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.497+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~PKJRKJWTOHZP.0 size=160981 2024-09-12T00:22:02.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.497+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=PKJRKJWTOHZP tag=8WU4RKIL35LN type=write size=1209557 2024-09-12T00:22:02.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.501+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~UK0RORNZTPZC.0 size=1048576 2024-09-12T00:22:02.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.505+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~UK0RORNZTPZC.1 size=1048576 2024-09-12T00:22:02.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.509+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~UK0RORNZTPZC.2 size=660348 2024-09-12T00:22:02.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.517+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=UK0RORNZTPZC tag=E5WKG4I4JATI type=write size=3806076 2024-09-12T00:22:02.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.525+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~M9B9J6XOYX5W.0 size=218704 2024-09-12T00:22:02.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.525+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=M9B9J6XOYX5W tag=RX32P2PG3GSZ type=write size=1267280 2024-09-12T00:22:02.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.533+0000 7fd6489978c0 1 < suggested update operation key=25P4P2I6BE3H tag=O6IQZDO924JP type=del size=1167260 2024-09-12T00:22:02.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.537+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=LBRYLWEZ7L60 type=del size=3041654 2024-09-12T00:22:02.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.541+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~GCBCEDJCRQYQ.0 size=594018 2024-09-12T00:22:02.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.545+0000 7fd6489978c0 1 < completed multipart upload key=9ACGS2FIY7AF upload=GCBCEDJCRQYQ tag=8MHCSXTLEPMZ type=write size=1642594 2024-09-12T00:22:02.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.549+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=9DWTS4Q0MLKC type=del size=1911733 2024-09-12T00:22:02.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.553+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~551ZMYXFZZNN.0 size=1048576 2024-09-12T00:22:02.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.557+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~551ZMYXFZZNN.1 size=1048576 2024-09-12T00:22:02.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.557+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~551ZMYXFZZNN.2 size=387487 2024-09-12T00:22:02.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.565+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=551ZMYXFZZNN tag=DKSC8DYZSQ5O type=write size=3533215 2024-09-12T00:22:02.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.573+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~DVSKUIBKC443.0 size=1048576 2024-09-12T00:22:02.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.573+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~DVSKUIBKC443.1 size=1048576 2024-09-12T00:22:02.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.577+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~DVSKUIBKC443.2 size=679161 2024-09-12T00:22:02.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.577+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=DVSKUIBKC443 tag=EIA85D41K7CA type=write size=3824889 2024-09-12T00:22:02.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.581+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=75OFNLLV2LY2 type=del 2024-09-12T00:22:02.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.589+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~J87L80SN8IWA.0 size=805770 2024-09-12T00:22:02.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.589+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=J87L80SN8IWA tag=KKQR6GDBMO7P type=write size=1854346 2024-09-12T00:22:02.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.593+0000 7fd6489978c0 1 < canceled operation key=ES2BLTWZT6PT tag=CXI0AUL2U77G type=del size=2914125 2024-09-12T00:22:02.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.597+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=JZ1F0JVWOXU3 type=del size=687123 2024-09-12T00:22:02.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.601+0000 7fd6489978c0 1 < completed delete operation key=JPVKBVRCZTE9 tag=9Q4HKAKV7ANN type=del 2024-09-12T00:22:02.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.605+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=6Y3LB5KV1G2N type=del size=1438808 2024-09-12T00:22:02.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.613+0000 7fd6489978c0 1 < suggested update operation key=M9YKGQ2GA5CO tag=SBQFNZTIXQ97 type=del size=2502293 2024-09-12T00:22:02.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.621+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~G22ZWGX23UQN.0 size=624200 2024-09-12T00:22:02.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.621+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=G22ZWGX23UQN tag=IXDI6TR2822K type=write size=1672776 2024-09-12T00:22:02.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.621+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=50ANBFYXCYFU type=del 2024-09-12T00:22:02.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.629+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~AEWP2BKB1ULC.0 size=1048576 2024-09-12T00:22:02.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.633+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~AEWP2BKB1ULC.1 size=892291 2024-09-12T00:22:02.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.633+0000 7fd6489978c0 1 > prepared multipart upload key=DAOTTEMK2P2T upload=AEWP2BKB1ULC tag=55LM2TQT0B50 type=write size=2989443 2024-09-12T00:22:02.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.637+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~WJL65T42AZLQ.0 size=154799 2024-09-12T00:22:02.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.641+0000 7fd6489978c0 1 < completed multipart upload key=9ACGS2FIY7AF upload=WJL65T42AZLQ tag=DIANV1YRTX4W type=write size=1203375 2024-09-12T00:22:02.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.645+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=CYLH0PGZLAMX type=del size=2823580 2024-09-12T00:22:02.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.649+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~HPHA1XVF71S7.0 size=1048576 2024-09-12T00:22:02.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.653+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~HPHA1XVF71S7.1 size=818909 2024-09-12T00:22:02.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.661+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=HPHA1XVF71S7 tag=67HP2V2482FU type=write size=2916061 2024-09-12T00:22:02.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.665+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=KX5EQ0JPOVJI type=del size=3503683 2024-09-12T00:22:02.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.669+0000 7fd6489978c0 1 < suggested update operation key=25P4P2I6BE3H tag=5U4N6Q9U8RPY type=del size=2334349 2024-09-12T00:22:02.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.673+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=JX03Z6R9J46O type=del size=3777205 2024-09-12T00:22:02.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.677+0000 7fd6489978c0 1 < canceled part key=_multipart_JPVKBVRCZTE9.2~DR55YZETP0UQ.0 size=1048576 2024-09-12T00:22:02.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.677+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~DR55YZETP0UQ.1 size=1048576 2024-09-12T00:22:02.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.681+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~DR55YZETP0UQ.2 size=927928 2024-09-12T00:22:02.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.689+0000 7fd6489978c0 1 < canceled multipart upload key=JPVKBVRCZTE9 upload=DR55YZETP0UQ tag=MT8CFOIS891N type=write size=4073656 2024-09-12T00:22:02.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.697+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~JEUW0IV0HQX5.0 size=324037 2024-09-12T00:22:02.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.697+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=JEUW0IV0HQX5 tag=1U6U8J6G8MY8 type=write size=1372613 2024-09-12T00:22:02.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.701+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~6ETK1OLG9CZP.0 size=1048576 2024-09-12T00:22:02.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.705+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~6ETK1OLG9CZP.1 size=1048576 2024-09-12T00:22:02.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.709+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~6ETK1OLG9CZP.2 size=175325 2024-09-12T00:22:02.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.713+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=6ETK1OLG9CZP tag=PVRG36R4P5LR type=write size=3321053 2024-09-12T00:22:02.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.717+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=47CKN14227D4 type=write size=352435 2024-09-12T00:22:02.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.721+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=B7MYGSZLMEOA type=del 2024-09-12T00:22:02.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.725+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=QEDDB6BLJDDX type=del size=3069107 2024-09-12T00:22:02.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.729+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~PKJRKJWTOHZP.0 size=160981 2024-09-12T00:22:02.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.733+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=PKJRKJWTOHZP tag=8WU4RKIL35LN type=write size=1209557 2024-09-12T00:22:02.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.741+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~RBUEFXSDSXWN.0 size=1048576 2024-09-12T00:22:02.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.745+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~RBUEFXSDSXWN.1 size=1048576 2024-09-12T00:22:02.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.745+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~RBUEFXSDSXWN.2 size=724337 2024-09-12T00:22:02.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.745+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=RBUEFXSDSXWN tag=CQPV277RHLPY type=write size=3870065 2024-09-12T00:22:02.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.753+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~M9B9J6XOYX5W.0 size=218704 2024-09-12T00:22:02.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.757+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=M9B9J6XOYX5W tag=RX32P2PG3GSZ type=write size=1267280 2024-09-12T00:22:02.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.761+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=MCNVCVP7X99H type=del size=1488032 2024-09-12T00:22:02.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.765+0000 7fd6489978c0 1 < canceled operation key=F2CTWM0T2698 tag=LBRYLWEZ7L60 type=del size=3041654 2024-09-12T00:22:02.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.773+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~BHX439SXJ9GE.0 size=636948 2024-09-12T00:22:02.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.773+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=BHX439SXJ9GE tag=CFKFI6ANMIPZ type=write size=1685524 2024-09-12T00:22:02.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.777+0000 7fd6489978c0 -1 < failed to complete operation key=25P4P2I6BE3H tag=9DWTS4Q0MLKC type=del size=1911733: (22) Invalid argument 2024-09-12T00:22:02.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.781+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=UPEUF8ER14QN type=del size=1815780 2024-09-12T00:22:02.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.785+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~DVSKUIBKC443.0 size=1048576 2024-09-12T00:22:02.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.785+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~DVSKUIBKC443.1 size=1048576 2024-09-12T00:22:02.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.789+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~DVSKUIBKC443.2 size=679161 2024-09-12T00:22:02.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.797+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=DVSKUIBKC443 tag=EIA85D41K7CA type=write size=3824889 2024-09-12T00:22:02.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.801+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=4QMXR771I9YE type=del size=1877335 2024-09-12T00:22:02.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.805+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~J87L80SN8IWA.0 size=805770 2024-09-12T00:22:02.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.809+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=J87L80SN8IWA tag=KKQR6GDBMO7P type=write size=1854346 2024-09-12T00:22:02.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.817+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~6XIEKF4BHVNO.0 size=409034 2024-09-12T00:22:02.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.817+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=6XIEKF4BHVNO tag=5WZ92A9U7QUY type=write size=1457610 2024-09-12T00:22:02.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.821+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=JZ1F0JVWOXU3 type=del 2024-09-12T00:22:02.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.829+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~DY8J7ATLB7WE.0 size=597573 2024-09-12T00:22:02.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.829+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=DY8J7ATLB7WE tag=DIN6TIXDUZG0 type=write size=1646149 2024-09-12T00:22:02.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.833+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=6Y3LB5KV1G2N type=del 2024-09-12T00:22:02.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.837+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~CJML5IUVD0QH.0 size=1048576 2024-09-12T00:22:02.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.841+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~CJML5IUVD0QH.1 size=620387 2024-09-12T00:22:02.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.841+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=CJML5IUVD0QH tag=2IGNE1DHKNLO type=write size=2717539 2024-09-12T00:22:02.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.845+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~G22ZWGX23UQN.0 size=624200 2024-09-12T00:22:02.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.849+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=G22ZWGX23UQN tag=IXDI6TR2822K type=write size=1672776 2024-09-12T00:22:02.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.853+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=NZHORW2SJJD8 type=del size=3039702 2024-09-12T00:22:02.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.857+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~AEWP2BKB1ULC.0 size=1048576 2024-09-12T00:22:02.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.861+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~AEWP2BKB1ULC.1 size=892291 2024-09-12T00:22:02.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.873+0000 7fd6489978c0 1 < completed multipart upload key=DAOTTEMK2P2T upload=AEWP2BKB1ULC tag=55LM2TQT0B50 type=write size=2989443 2024-09-12T00:22:02.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.873+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=ZIURO2SK3DBX type=write size=964922 2024-09-12T00:22:02.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.877+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=CYLH0PGZLAMX type=del 2024-09-12T00:22:02.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.881+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=PSU5ATUI4LZQ type=del size=2876934 2024-09-12T00:22:02.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.885+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=KX5EQ0JPOVJI type=del 2024-09-12T00:22:02.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.889+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=MJ1434REMRBL type=write size=704155 2024-09-12T00:22:02.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.897+0000 7fd6489978c0 1 < suggested update operation key=ZW51KHCLPYN3 tag=JX03Z6R9J46O type=del size=3777205 2024-09-12T00:22:02.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.901+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=TD2EYSLFFHES type=del size=3151423 2024-09-12T00:22:02.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.905+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~JEUW0IV0HQX5.0 size=324037 2024-09-12T00:22:02.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.909+0000 7fd6489978c0 1 < completed multipart upload key=GVPNH3JSO07D upload=JEUW0IV0HQX5 tag=1U6U8J6G8MY8 type=write size=1372613 2024-09-12T00:22:02.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.913+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=WXP90J5L0GPM type=del size=2465998 2024-09-12T00:22:02.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.921+0000 7fd6489978c0 1 < suggested remove operation key=K9FD1L86Q05B tag=47CKN14227D4 type=write 2024-09-12T00:22:02.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.925+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=20QRJ9N2M14B type=del size=383592 2024-09-12T00:22:02.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.929+0000 7fd6489978c0 1 < canceled operation key=J5IW4G9C72DH tag=QEDDB6BLJDDX type=del size=3069107 2024-09-12T00:22:02.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.933+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~747GUFD1NK0L.0 size=753616 2024-09-12T00:22:02.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.933+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=747GUFD1NK0L tag=OVZ09QEET2SX type=write size=1802192 2024-09-12T00:22:02.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.937+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~RBUEFXSDSXWN.0 size=1048576 2024-09-12T00:22:02.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.941+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~RBUEFXSDSXWN.1 size=1048576 2024-09-12T00:22:02.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.945+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~RBUEFXSDSXWN.2 size=724337 2024-09-12T00:22:02.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.949+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=RBUEFXSDSXWN tag=CQPV277RHLPY type=write size=3870065 2024-09-12T00:22:02.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.953+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=HEQFJQ44AO2Q type=write size=779605 2024-09-12T00:22:02.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.957+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=MCNVCVP7X99H type=del 2024-09-12T00:22:02.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.965+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~WXFSSBGM7OT9.0 size=304458 2024-09-12T00:22:02.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.965+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=WXFSSBGM7OT9 tag=HQAT1SQ9OUIO type=write size=1353034 2024-09-12T00:22:02.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.969+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~BHX439SXJ9GE.0 size=636948 2024-09-12T00:22:02.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.973+0000 7fd6489978c0 1 < completed multipart upload key=9ACGS2FIY7AF upload=BHX439SXJ9GE tag=CFKFI6ANMIPZ type=write size=1685524 2024-09-12T00:22:02.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.981+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~IH4ETRD5HGU9.0 size=1048576 2024-09-12T00:22:02.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.981+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~IH4ETRD5HGU9.1 size=656825 2024-09-12T00:22:02.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.981+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=IH4ETRD5HGU9 tag=UWOLQD7QXGPZ type=write size=2753977 2024-09-12T00:22:02.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.985+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=UPEUF8ER14QN type=del 2024-09-12T00:22:02.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.993+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~PKR32XX2O3JM.0 size=363948 2024-09-12T00:22:02.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.993+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=PKR32XX2O3JM tag=76ZT5I8PF5W4 type=write size=1412524 2024-09-12T00:22:02.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:02.997+0000 7fd6489978c0 1 < canceled operation key=8FBXDX6GELE7 tag=4QMXR771I9YE type=del size=1877335 2024-09-12T00:22:02.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.001+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=J7NJ8TCBWZS3 type=write size=988491 2024-09-12T00:22:03.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.005+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~6XIEKF4BHVNO.0 size=409034 2024-09-12T00:22:03.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.009+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=6XIEKF4BHVNO tag=5WZ92A9U7QUY type=write size=1457610 2024-09-12T00:22:03.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.013+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=7NSK41QJJZBH type=del size=3261244 2024-09-12T00:22:03.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.017+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~DY8J7ATLB7WE.0 size=597573 2024-09-12T00:22:03.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.025+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=DY8J7ATLB7WE tag=DIN6TIXDUZG0 type=write size=1646149 2024-09-12T00:22:03.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.029+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=LAEIBEIHZQPH type=del size=3692950 2024-09-12T00:22:03.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.033+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~CJML5IUVD0QH.0 size=1048576 2024-09-12T00:22:03.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.033+0000 7fd6489978c0 1 < canceled part key=_multipart_B2BW7GQ6UN9I.2~CJML5IUVD0QH.1 size=620387 2024-09-12T00:22:03.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.037+0000 7fd6489978c0 1 < canceled multipart upload key=B2BW7GQ6UN9I upload=CJML5IUVD0QH tag=2IGNE1DHKNLO type=write size=2717539 2024-09-12T00:22:03.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.041+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=E8041Y07UCHM type=del size=1377515 2024-09-12T00:22:03.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.045+0000 7fd6489978c0 1 < canceled operation key=YSPRZ87DZ2OD tag=NZHORW2SJJD8 type=del size=3039702 2024-09-12T00:22:03.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.049+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=RSK9XF2AZVIR type=del size=3256102 2024-09-12T00:22:03.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.053+0000 7fd6489978c0 1 < canceled operation key=N4S6I47NSJK6 tag=ZIURO2SK3DBX type=write size=964922 2024-09-12T00:22:03.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.057+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=LVLEAV5BVG71 type=del size=2034506 2024-09-12T00:22:03.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.065+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=PSU5ATUI4LZQ type=del 2024-09-12T00:22:03.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.069+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=9SCJYDOAN8II type=del size=434688 2024-09-12T00:22:03.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.073+0000 7fd6489978c0 1 < completed write operation key=B2BW7GQ6UN9I tag=MJ1434REMRBL type=write size=704155 2024-09-12T00:22:03.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.077+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=XAGESVJDKOOT type=del size=3754108 2024-09-12T00:22:03.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.081+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=TD2EYSLFFHES type=del 2024-09-12T00:22:03.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.085+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=0V2KKFJ74RVZ type=del size=4047998 2024-09-12T00:22:03.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.085+0000 7fd6489978c0 1 < canceled operation key=JPVKBVRCZTE9 tag=WXP90J5L0GPM type=del size=2465998 2024-09-12T00:22:03.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.089+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=PQ08UKWPYRY3 type=write size=854744 2024-09-12T00:22:03.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.093+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=20QRJ9N2M14B type=del 2024-09-12T00:22:03.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.097+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=QVKVMCNNY3AJ type=del size=1135323 2024-09-12T00:22:03.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.101+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~747GUFD1NK0L.0 size=753616 2024-09-12T00:22:03.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.105+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=747GUFD1NK0L tag=OVZ09QEET2SX type=write size=1802192 2024-09-12T00:22:03.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.109+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=Z3RUKWDA50N3 type=del size=3144904 2024-09-12T00:22:03.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.113+0000 7fd6489978c0 1 < completed write operation key=3JZP8TZFEIMH tag=HEQFJQ44AO2Q type=write size=779605 2024-09-12T00:22:03.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.117+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~Y6NQPXYDISA3.0 size=1048576 2024-09-12T00:22:03.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.121+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~Y6NQPXYDISA3.1 size=98925 2024-09-12T00:22:03.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.121+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=Y6NQPXYDISA3 tag=HEF0TRL6OO6H type=write size=2196077 2024-09-12T00:22:03.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.121+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~WXFSSBGM7OT9.0 size=304458 2024-09-12T00:22:03.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.125+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=WXFSSBGM7OT9 tag=HQAT1SQ9OUIO type=write size=1353034 2024-09-12T00:22:03.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.129+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=KMGFW113H0OW type=del size=3685614 2024-09-12T00:22:03.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.133+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~IH4ETRD5HGU9.0 size=1048576 2024-09-12T00:22:03.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.133+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~IH4ETRD5HGU9.1 size=656825 2024-09-12T00:22:03.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.137+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=IH4ETRD5HGU9 tag=UWOLQD7QXGPZ type=write size=2753977 2024-09-12T00:22:03.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.141+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=43KOMR093N9T type=del size=570055 2024-09-12T00:22:03.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.145+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~PKR32XX2O3JM.0 size=363948 2024-09-12T00:22:03.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.149+0000 7fd6489978c0 1 < completed multipart upload key=GVPNH3JSO07D upload=PKR32XX2O3JM tag=76ZT5I8PF5W4 type=write size=1412524 2024-09-12T00:22:03.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.153+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=9T8K46JA93NY type=del size=1836609 2024-09-12T00:22:03.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.157+0000 7fd6489978c0 1 < suggested update operation key=2KP09UFI3N8B tag=J7NJ8TCBWZS3 type=write size=988491 2024-09-12T00:22:03.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.157+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=OTSVPI5KE9C6 type=del size=4140022 2024-09-12T00:22:03.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.161+0000 7fd6489978c0 1 < canceled operation key=K9FD1L86Q05B tag=7NSK41QJJZBH type=del size=3261244 2024-09-12T00:22:03.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.169+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~CW9WB2KR0PPM.0 size=1048576 2024-09-12T00:22:03.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.169+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~CW9WB2KR0PPM.1 size=1048576 2024-09-12T00:22:03.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.173+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~CW9WB2KR0PPM.2 size=205109 2024-09-12T00:22:03.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.173+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=CW9WB2KR0PPM tag=P0GL79QGL6VR type=write size=3350837 2024-09-12T00:22:03.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.173+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=LAEIBEIHZQPH type=del 2024-09-12T00:22:03.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.181+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~6CYNH7XJOJ33.0 size=1048576 2024-09-12T00:22:03.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.185+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~6CYNH7XJOJ33.1 size=181159 2024-09-12T00:22:03.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.185+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=6CYNH7XJOJ33 tag=GU0CPGQJ3YBV type=write size=2278311 2024-09-12T00:22:03.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.189+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=E8041Y07UCHM type=del 2024-09-12T00:22:03.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.197+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=MLP445EGAG9Z type=del size=3182575 2024-09-12T00:22:03.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.197+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=RSK9XF2AZVIR type=del 2024-09-12T00:22:03.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.201+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=AFFVDA58LX4O type=del size=2548007 2024-09-12T00:22:03.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.209+0000 7fd6489978c0 1 < suggested update operation key=KAT2TB3FGAYG tag=LVLEAV5BVG71 type=del size=2034506 2024-09-12T00:22:03.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.213+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~XO9BNHNO7MPM.0 size=1048576 2024-09-12T00:22:03.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.217+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~XO9BNHNO7MPM.1 size=282373 2024-09-12T00:22:03.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.217+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=XO9BNHNO7MPM tag=EA2OCSM4AYZ1 type=write size=2379525 2024-09-12T00:22:03.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.221+0000 7fd6489978c0 -1 < failed to complete operation key=KAT2TB3FGAYG tag=9SCJYDOAN8II type=del size=434688: (22) Invalid argument 2024-09-12T00:22:03.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.229+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~ENCFZOK0GMBK.0 size=1048576 2024-09-12T00:22:03.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.229+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~ENCFZOK0GMBK.1 size=375835 2024-09-12T00:22:03.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.229+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=ENCFZOK0GMBK tag=HXYSRVJX0CC0 type=write size=2472987 2024-09-12T00:22:03.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.237+0000 7fd6489978c0 1 < suggested update operation key=9ACGS2FIY7AF tag=XAGESVJDKOOT type=del size=3754108 2024-09-12T00:22:03.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.241+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=C3KDTE6VL7AL type=del size=1447747 2024-09-12T00:22:03.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.245+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=0V2KKFJ74RVZ type=del 2024-09-12T00:22:03.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.253+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~4R6WMB2OVGZN.0 size=1048576 2024-09-12T00:22:03.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.257+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~4R6WMB2OVGZN.1 size=1048576 2024-09-12T00:22:03.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.261+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~4R6WMB2OVGZN.2 size=543825 2024-09-12T00:22:03.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.261+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=4R6WMB2OVGZN tag=J5AXRLLKQYRF type=write size=3689553 2024-09-12T00:22:03.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.261+0000 7fd6489978c0 -1 < failed to complete operation key=KAT2TB3FGAYG tag=PQ08UKWPYRY3 type=write size=854744: (22) Invalid argument 2024-09-12T00:22:03.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.265+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=Q0GYFOUSHY5C type=del size=3154739 2024-09-12T00:22:03.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.269+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=QVKVMCNNY3AJ type=del 2024-09-12T00:22:03.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.273+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=2BHGTI08ZIYJ type=del size=1526298 2024-09-12T00:22:03.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.277+0000 7fd6489978c0 1 < canceled operation key=LZICTA4BWOW8 tag=Z3RUKWDA50N3 type=del size=3144904 2024-09-12T00:22:03.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.281+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~4ZD2DS0US398.0 size=900518 2024-09-12T00:22:03.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.281+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=4ZD2DS0US398 tag=12IEYWC0B1TW type=write size=1949094 2024-09-12T00:22:03.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.285+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~Y6NQPXYDISA3.0 size=1048576 2024-09-12T00:22:03.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.289+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~Y6NQPXYDISA3.1 size=98925 2024-09-12T00:22:03.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.293+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=Y6NQPXYDISA3 tag=HEF0TRL6OO6H type=write size=2196077 2024-09-12T00:22:03.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.301+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~E0M2YZAJ66PI.0 size=1048576 2024-09-12T00:22:03.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.305+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~E0M2YZAJ66PI.1 size=908931 2024-09-12T00:22:03.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.305+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=E0M2YZAJ66PI tag=V4S2O2Q7RLHW type=write size=3006083 2024-09-12T00:22:03.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.313+0000 7fd6489978c0 1 < suggested update operation key=8JCL0F406L7I tag=KMGFW113H0OW type=del size=3685614 2024-09-12T00:22:03.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.317+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=E2XDTYI6QGSC type=del size=500549 2024-09-12T00:22:03.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.321+0000 7fd6489978c0 1 < completed delete operation key=M9YKGQ2GA5CO tag=43KOMR093N9T type=del 2024-09-12T00:22:03.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.325+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=QHRTXWC3I1ES type=write size=63978 2024-09-12T00:22:03.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.329+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=9T8K46JA93NY type=del 2024-09-12T00:22:03.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.333+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=D3VH6578A6IK type=del size=2789059 2024-09-12T00:22:03.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.341+0000 7fd6489978c0 1 < suggested remove operation key=JPVKBVRCZTE9 tag=OTSVPI5KE9C6 type=del 2024-09-12T00:22:03.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.345+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=5FZGHQF0H25O type=del size=394099 2024-09-12T00:22:03.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.349+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~CW9WB2KR0PPM.0 size=1048576 2024-09-12T00:22:03.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.353+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~CW9WB2KR0PPM.1 size=1048576 2024-09-12T00:22:03.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.353+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~CW9WB2KR0PPM.2 size=205109 2024-09-12T00:22:03.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.361+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=CW9WB2KR0PPM tag=P0GL79QGL6VR type=write size=3350837 2024-09-12T00:22:03.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.369+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~BSZ2P9X8D4UV.0 size=1048576 2024-09-12T00:22:03.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.373+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~BSZ2P9X8D4UV.1 size=528936 2024-09-12T00:22:03.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.373+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=BSZ2P9X8D4UV tag=7OKDTAUY4DFC type=write size=2626088 2024-09-12T00:22:03.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.373+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~6CYNH7XJOJ33.0 size=1048576 2024-09-12T00:22:03.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.377+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~6CYNH7XJOJ33.1 size=181159 2024-09-12T00:22:03.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.385+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=6CYNH7XJOJ33 tag=GU0CPGQJ3YBV type=write size=2278311 2024-09-12T00:22:03.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.389+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~ZB8ML39M7I22.0 size=2747 2024-09-12T00:22:03.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.389+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=ZB8ML39M7I22 tag=912SMMFT5WV3 type=write size=1051323 2024-09-12T00:22:03.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.393+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=MLP445EGAG9Z type=del 2024-09-12T00:22:03.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.397+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=LHCQ0MAIFZRP type=del size=1220041 2024-09-12T00:22:03.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.405+0000 7fd6489978c0 1 < suggested remove operation key=K9FD1L86Q05B tag=AFFVDA58LX4O type=del 2024-09-12T00:22:03.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.409+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=YU98DWYANEZ2 type=write size=1047100 2024-09-12T00:22:03.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.413+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~XO9BNHNO7MPM.0 size=1048576 2024-09-12T00:22:03.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.417+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~XO9BNHNO7MPM.1 size=282373 2024-09-12T00:22:03.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.421+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=XO9BNHNO7MPM tag=EA2OCSM4AYZ1 type=write size=2379525 2024-09-12T00:22:03.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.429+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=DZCKW1MJPDXQ type=del size=1400737 2024-09-12T00:22:03.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.433+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~ENCFZOK0GMBK.0 size=1048576 2024-09-12T00:22:03.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.433+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~ENCFZOK0GMBK.1 size=375835 2024-09-12T00:22:03.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.441+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=ENCFZOK0GMBK tag=HXYSRVJX0CC0 type=write size=2472987 2024-09-12T00:22:03.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.445+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=PST7RD2GW0VG type=write size=738738 2024-09-12T00:22:03.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.449+0000 7fd6489978c0 1 < completed delete operation key=B2BW7GQ6UN9I tag=C3KDTE6VL7AL type=del 2024-09-12T00:22:03.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.453+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=2VJTRLZOH0M4 type=del size=1490339 2024-09-12T00:22:03.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.457+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~4R6WMB2OVGZN.0 size=1048576 2024-09-12T00:22:03.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.457+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~4R6WMB2OVGZN.1 size=1048576 2024-09-12T00:22:03.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.457+0000 7fd6489978c0 1 < canceled part key=_multipart_ZW51KHCLPYN3.2~4R6WMB2OVGZN.2 size=543825 2024-09-12T00:22:03.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.465+0000 7fd6489978c0 1 < canceled multipart upload key=ZW51KHCLPYN3 upload=4R6WMB2OVGZN tag=J5AXRLLKQYRF type=write size=3689553 2024-09-12T00:22:03.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.473+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~XH7NCB8TR1UN.0 size=1048576 2024-09-12T00:22:03.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.477+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~XH7NCB8TR1UN.1 size=1048576 2024-09-12T00:22:03.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.477+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~XH7NCB8TR1UN.2 size=54218 2024-09-12T00:22:03.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.477+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=XH7NCB8TR1UN tag=LKTCDPMHB9ZN type=write size=3199946 2024-09-12T00:22:03.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.481+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=Q0GYFOUSHY5C type=del 2024-09-12T00:22:03.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.485+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=BUA8G2VB070D type=del size=2870022 2024-09-12T00:22:03.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.489+0000 7fd6489978c0 1 < canceled operation key=HUKWLE56FRX2 tag=2BHGTI08ZIYJ type=del size=1526298 2024-09-12T00:22:03.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.493+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=68LKJ5A548VR type=del size=401525 2024-09-12T00:22:03.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.497+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~4ZD2DS0US398.0 size=900518 2024-09-12T00:22:03.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.505+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=4ZD2DS0US398 tag=12IEYWC0B1TW type=write size=1949094 2024-09-12T00:22:03.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.509+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=QBNALI339LDG type=del size=3653815 2024-09-12T00:22:03.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.513+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~E0M2YZAJ66PI.0 size=1048576 2024-09-12T00:22:03.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.513+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~E0M2YZAJ66PI.1 size=908931 2024-09-12T00:22:03.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.521+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=E0M2YZAJ66PI tag=V4S2O2Q7RLHW type=write size=3006083 2024-09-12T00:22:03.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.529+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~08EQ1NJ0I5IZ.0 size=1048576 2024-09-12T00:22:03.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.529+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~08EQ1NJ0I5IZ.1 size=1048576 2024-09-12T00:22:03.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.533+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~08EQ1NJ0I5IZ.2 size=954894 2024-09-12T00:22:03.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.533+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=08EQ1NJ0I5IZ tag=37VPABQIBJUM type=write size=4100622 2024-09-12T00:22:03.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.537+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=E2XDTYI6QGSC type=del 2024-09-12T00:22:03.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.545+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=MDZSW941HJQ4 type=del size=656337 2024-09-12T00:22:03.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.549+0000 7fd6489978c0 1 < completed write operation key=B2BW7GQ6UN9I tag=QHRTXWC3I1ES type=write size=63978 2024-09-12T00:22:03.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.557+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~MFJT2DAFR1KM.0 size=220653 2024-09-12T00:22:03.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.557+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=MFJT2DAFR1KM tag=MWUNPZPM9KIS type=write size=1269229 2024-09-12T00:22:03.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.561+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=D3VH6578A6IK type=del 2024-09-12T00:22:03.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.565+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=9VI0SMTO2681 type=del size=2843990 2024-09-12T00:22:03.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.569+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=5FZGHQF0H25O type=del 2024-09-12T00:22:03.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.573+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=A0WG6MQ9K2CU type=del size=2126541 2024-09-12T00:22:03.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.577+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~BSZ2P9X8D4UV.0 size=1048576 2024-09-12T00:22:03.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.581+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~BSZ2P9X8D4UV.1 size=528936 2024-09-12T00:22:03.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.585+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=BSZ2P9X8D4UV tag=7OKDTAUY4DFC type=write size=2626088 2024-09-12T00:22:03.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.589+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=9BGR67A96G51 type=del size=456037 2024-09-12T00:22:03.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.593+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~ZB8ML39M7I22.0 size=2747 2024-09-12T00:22:03.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.601+0000 7fd6489978c0 1 < completed multipart upload key=GVPNH3JSO07D upload=ZB8ML39M7I22 tag=912SMMFT5WV3 type=write size=1051323 2024-09-12T00:22:03.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.605+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=4BAE74L2IENR type=del size=2854010 2024-09-12T00:22:03.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.609+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=LHCQ0MAIFZRP type=del 2024-09-12T00:22:03.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.613+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~UHVDX6IBR23L.0 size=221340 2024-09-12T00:22:03.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.613+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=UHVDX6IBR23L tag=PHCV0A2BJAW2 type=write size=1269916 2024-09-12T00:22:03.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.617+0000 7fd6489978c0 1 < completed write operation key=K9FD1L86Q05B tag=YU98DWYANEZ2 type=write size=1047100 2024-09-12T00:22:03.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.621+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=VPR4P1G0WJZB type=del size=1074411 2024-09-12T00:22:03.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.625+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=DZCKW1MJPDXQ type=del 2024-09-12T00:22:03.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.633+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~MSJX08W51SP5.0 size=1048576 2024-09-12T00:22:03.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.633+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~MSJX08W51SP5.1 size=1048576 2024-09-12T00:22:03.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.637+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~MSJX08W51SP5.2 size=102688 2024-09-12T00:22:03.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.637+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=MSJX08W51SP5 tag=IUV3WKAH1L4W type=write size=3248416 2024-09-12T00:22:03.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.641+0000 7fd6489978c0 1 < completed write operation key=G4EUTQOHAT2E tag=PST7RD2GW0VG type=write size=738738 2024-09-12T00:22:03.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.649+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~FRDBGS3H7BRH.0 size=1048576 2024-09-12T00:22:03.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.649+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~FRDBGS3H7BRH.1 size=1048576 2024-09-12T00:22:03.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.653+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~FRDBGS3H7BRH.2 size=238722 2024-09-12T00:22:03.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.653+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=FRDBGS3H7BRH tag=ETYUJK14P2MR type=write size=3384450 2024-09-12T00:22:03.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.657+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=2VJTRLZOH0M4 type=del 2024-09-12T00:22:03.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.661+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=M7XB1R5T1ATP type=del size=3472807 2024-09-12T00:22:03.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.665+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~XH7NCB8TR1UN.0 size=1048576 2024-09-12T00:22:03.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.669+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~XH7NCB8TR1UN.1 size=1048576 2024-09-12T00:22:03.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.669+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~XH7NCB8TR1UN.2 size=54218 2024-09-12T00:22:03.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.677+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=XH7NCB8TR1UN tag=LKTCDPMHB9ZN type=write size=3199946 2024-09-12T00:22:03.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.681+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~GLZGUFX00O0B.0 size=1048576 2024-09-12T00:22:03.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.685+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~GLZGUFX00O0B.1 size=1048576 2024-09-12T00:22:03.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.689+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~GLZGUFX00O0B.2 size=316986 2024-09-12T00:22:03.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.689+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=GLZGUFX00O0B tag=XA0SO70929L0 type=write size=3462714 2024-09-12T00:22:03.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.693+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=BUA8G2VB070D type=del 2024-09-12T00:22:03.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.697+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=ZW8FMYJ8MKX0 type=del size=3901316 2024-09-12T00:22:03.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.697+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=68LKJ5A548VR type=del 2024-09-12T00:22:03.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.705+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~4RY3W5Z2NI6B.0 size=1048576 2024-09-12T00:22:03.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.709+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~4RY3W5Z2NI6B.1 size=505145 2024-09-12T00:22:03.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.709+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=4RY3W5Z2NI6B tag=QD8PYQ36P69X type=write size=2602297 2024-09-12T00:22:03.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.713+0000 7fd6489978c0 1 < suggested remove operation key=QBS4N1KGR1JB tag=QBNALI339LDG type=del 2024-09-12T00:22:03.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.717+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=5C0V9VV17GIP type=write size=187330 2024-09-12T00:22:03.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.721+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~08EQ1NJ0I5IZ.0 size=1048576 2024-09-12T00:22:03.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.725+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~08EQ1NJ0I5IZ.1 size=1048576 2024-09-12T00:22:03.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.729+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~08EQ1NJ0I5IZ.2 size=954894 2024-09-12T00:22:03.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.733+0000 7fd6489978c0 1 < completed multipart upload key=G4EUTQOHAT2E upload=08EQ1NJ0I5IZ tag=37VPABQIBJUM type=write size=4100622 2024-09-12T00:22:03.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.737+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=98QDE3QYO8L8 type=write size=855047 2024-09-12T00:22:03.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.741+0000 7fd6489978c0 1 < completed delete operation key=8FBXDX6GELE7 tag=MDZSW941HJQ4 type=del 2024-09-12T00:22:03.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.745+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=3YUY50CRR4S5 type=del size=799852 2024-09-12T00:22:03.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.749+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~MFJT2DAFR1KM.0 size=220653 2024-09-12T00:22:03.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.757+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=MFJT2DAFR1KM tag=MWUNPZPM9KIS type=write size=1269229 2024-09-12T00:22:03.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.761+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=EI1C39NWJZME type=del size=796296 2024-09-12T00:22:03.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.765+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=9VI0SMTO2681 type=del 2024-09-12T00:22:03.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.769+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~WUDG36HG4JSY.0 size=1048576 2024-09-12T00:22:03.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.773+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~WUDG36HG4JSY.1 size=1048576 2024-09-12T00:22:03.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.777+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~WUDG36HG4JSY.2 size=923164 2024-09-12T00:22:03.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.777+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=WUDG36HG4JSY tag=LEAPOS9HDMUD type=write size=4068892 2024-09-12T00:22:03.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.781+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=A0WG6MQ9K2CU type=del 2024-09-12T00:22:03.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.785+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~YHVRRH4AON5M.0 size=684682 2024-09-12T00:22:03.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.785+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=YHVRRH4AON5M tag=8TIFK1JTKRQX type=write size=1733258 2024-09-12T00:22:03.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.789+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=9BGR67A96G51 type=del 2024-09-12T00:22:03.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.793+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=429NZ7265MHH type=del size=245102 2024-09-12T00:22:03.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.801+0000 7fd6489978c0 1 < suggested remove operation key=KAT2TB3FGAYG tag=4BAE74L2IENR type=del 2024-09-12T00:22:03.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.805+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=ODSPILLPHYF5 type=del size=934111 2024-09-12T00:22:03.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.809+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~UHVDX6IBR23L.0 size=221340 2024-09-12T00:22:03.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.817+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=UHVDX6IBR23L tag=PHCV0A2BJAW2 type=write size=1269916 2024-09-12T00:22:03.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.821+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~LD3XAFM8051Z.0 size=273646 2024-09-12T00:22:03.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.821+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=LD3XAFM8051Z tag=696UU1F38STB type=write size=1322222 2024-09-12T00:22:03.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.825+0000 7fd6489978c0 -1 < failed to complete operation key=QBS4N1KGR1JB tag=VPR4P1G0WJZB type=del size=1074411: (22) Invalid argument 2024-09-12T00:22:03.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.829+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=5WS21G4T3WW8 type=del size=748001 2024-09-12T00:22:03.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.833+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~MSJX08W51SP5.0 size=1048576 2024-09-12T00:22:03.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.837+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~MSJX08W51SP5.1 size=1048576 2024-09-12T00:22:03.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.841+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~MSJX08W51SP5.2 size=102688 2024-09-12T00:22:03.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.849+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=MSJX08W51SP5 tag=IUV3WKAH1L4W type=write size=3248416 2024-09-12T00:22:03.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.853+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~G0PE5EVV594R.0 size=129659 2024-09-12T00:22:03.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.853+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=G0PE5EVV594R tag=B2HORCYBAYCF type=write size=1178235 2024-09-12T00:22:03.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.853+0000 7fd6489978c0 1 < canceled part key=_multipart_M9YKGQ2GA5CO.2~FRDBGS3H7BRH.0 size=1048576 2024-09-12T00:22:03.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.857+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~FRDBGS3H7BRH.1 size=1048576 2024-09-12T00:22:03.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.857+0000 7fd6489978c0 1 < canceled part key=_multipart_M9YKGQ2GA5CO.2~FRDBGS3H7BRH.2 size=238722 2024-09-12T00:22:03.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.865+0000 7fd6489978c0 1 < canceled multipart upload key=M9YKGQ2GA5CO upload=FRDBGS3H7BRH tag=ETYUJK14P2MR type=write size=3384450 2024-09-12T00:22:03.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.873+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~S26TQCII4T3O.0 size=1048576 2024-09-12T00:22:03.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.877+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~S26TQCII4T3O.1 size=1048576 2024-09-12T00:22:03.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.877+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~S26TQCII4T3O.2 size=116978 2024-09-12T00:22:03.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.877+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=S26TQCII4T3O tag=BM4YQ9X33AU7 type=write size=3262706 2024-09-12T00:22:03.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.881+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=M7XB1R5T1ATP type=del 2024-09-12T00:22:03.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.893+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~9FDUCH8WF1WP.0 size=316462 2024-09-12T00:22:03.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.893+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=9FDUCH8WF1WP tag=6WCDSYVIFMFK type=write size=1365038 2024-09-12T00:22:03.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.901+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~GLZGUFX00O0B.0 size=1048576 2024-09-12T00:22:03.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.905+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~GLZGUFX00O0B.1 size=1048576 2024-09-12T00:22:03.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.905+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~GLZGUFX00O0B.2 size=316986 2024-09-12T00:22:03.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.913+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=GLZGUFX00O0B tag=XA0SO70929L0 type=write size=3462714 2024-09-12T00:22:03.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.917+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=PCNBPS209AU8 type=del size=3591583 2024-09-12T00:22:03.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.921+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=ZW8FMYJ8MKX0 type=del 2024-09-12T00:22:03.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.925+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=F6UT2R9JN6S5 type=del size=2502273 2024-09-12T00:22:03.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.929+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~4RY3W5Z2NI6B.0 size=1048576 2024-09-12T00:22:03.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.933+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~4RY3W5Z2NI6B.1 size=505145 2024-09-12T00:22:03.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.937+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=4RY3W5Z2NI6B tag=QD8PYQ36P69X type=write size=2602297 2024-09-12T00:22:03.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.945+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~RGYA1U18EAJU.0 size=674161 2024-09-12T00:22:03.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.945+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=RGYA1U18EAJU tag=0PC1J71VC2C9 type=write size=1722737 2024-09-12T00:22:03.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.949+0000 7fd6489978c0 1 < completed write operation key=K9FD1L86Q05B tag=5C0V9VV17GIP type=write size=187330 2024-09-12T00:22:03.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.953+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=TGKSLSLPJGBA type=del size=2850116 2024-09-12T00:22:03.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.957+0000 7fd6489978c0 1 < completed write operation key=F2CTWM0T2698 tag=98QDE3QYO8L8 type=write size=855047 2024-09-12T00:22:03.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.961+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=43SCKA3V6F4R type=del size=2938897 2024-09-12T00:22:03.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.965+0000 7fd6489978c0 -1 < failed to complete operation key=KAT2TB3FGAYG tag=3YUY50CRR4S5 type=del size=799852: (22) Invalid argument 2024-09-12T00:22:03.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.969+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=NXI5VB3X7VEM type=del size=2592566 2024-09-12T00:22:03.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.973+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=EI1C39NWJZME type=del 2024-09-12T00:22:03.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.981+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~JXXKQHS0IOI9.0 size=1048576 2024-09-12T00:22:03.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.981+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~JXXKQHS0IOI9.1 size=1048576 2024-09-12T00:22:03.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.985+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~JXXKQHS0IOI9.2 size=966036 2024-09-12T00:22:03.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.985+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=JXXKQHS0IOI9 tag=0VXBS5CIR5I3 type=write size=4111764 2024-09-12T00:22:03.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.985+0000 7fd6489978c0 1 < canceled part key=_multipart_ZW51KHCLPYN3.2~WUDG36HG4JSY.0 size=1048576 2024-09-12T00:22:03.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.989+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~WUDG36HG4JSY.1 size=1048576 2024-09-12T00:22:03.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.989+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~WUDG36HG4JSY.2 size=923164 2024-09-12T00:22:03.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:03.997+0000 7fd6489978c0 1 < canceled multipart upload key=ZW51KHCLPYN3 upload=WUDG36HG4JSY tag=LEAPOS9HDMUD type=write size=4068892 2024-09-12T00:22:04.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.001+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~HAG5L9M68T4X.0 size=1048576 2024-09-12T00:22:04.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.005+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~HAG5L9M68T4X.1 size=1048576 2024-09-12T00:22:04.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.009+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~HAG5L9M68T4X.2 size=433616 2024-09-12T00:22:04.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.009+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=HAG5L9M68T4X tag=E7NA4C4A1T6G type=write size=3579344 2024-09-12T00:22:04.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.009+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~YHVRRH4AON5M.0 size=684682 2024-09-12T00:22:04.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.017+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=YHVRRH4AON5M tag=8TIFK1JTKRQX type=write size=1733258 2024-09-12T00:22:04.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.025+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~XE466IE87CAJ.0 size=1048576 2024-09-12T00:22:04.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.029+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~XE466IE87CAJ.1 size=532318 2024-09-12T00:22:04.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.029+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=XE466IE87CAJ tag=LWVUVXZJ308N type=write size=2629470 2024-09-12T00:22:04.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.033+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=429NZ7265MHH type=del 2024-09-12T00:22:04.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.037+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=NYBUPKYCVH4H type=write size=540739 2024-09-12T00:22:04.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.041+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=ODSPILLPHYF5 type=del 2024-09-12T00:22:04.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.045+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=2UF4VCATRCA2 type=del size=190980 2024-09-12T00:22:04.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.049+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~LD3XAFM8051Z.0 size=273646 2024-09-12T00:22:04.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.057+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=LD3XAFM8051Z tag=696UU1F38STB type=write size=1322222 2024-09-12T00:22:04.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.061+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=K33FQQTZLM3L type=del size=668455 2024-09-12T00:22:04.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.065+0000 7fd6489978c0 1 < completed delete operation key=3JZP8TZFEIMH tag=5WS21G4T3WW8 type=del 2024-09-12T00:22:04.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.069+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~25D498IXVAB4.0 size=667802 2024-09-12T00:22:04.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.069+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=25D498IXVAB4 tag=GEJK8MTHINY3 type=write size=1716378 2024-09-12T00:22:04.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.073+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~G0PE5EVV594R.0 size=129659 2024-09-12T00:22:04.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.077+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=G0PE5EVV594R tag=B2HORCYBAYCF type=write size=1178235 2024-09-12T00:22:04.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.081+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=MT7QKRK0IETO type=del size=598728 2024-09-12T00:22:04.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.085+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~S26TQCII4T3O.0 size=1048576 2024-09-12T00:22:04.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.089+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~S26TQCII4T3O.1 size=1048576 2024-09-12T00:22:04.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.093+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~S26TQCII4T3O.2 size=116978 2024-09-12T00:22:04.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.097+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=S26TQCII4T3O tag=BM4YQ9X33AU7 type=write size=3262706 2024-09-12T00:22:04.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.105+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~VTNICDC3ALO2.0 size=1048576 2024-09-12T00:22:04.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.109+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~VTNICDC3ALO2.1 size=1048576 2024-09-12T00:22:04.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.109+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~VTNICDC3ALO2.2 size=623315 2024-09-12T00:22:04.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.109+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=VTNICDC3ALO2 tag=GUL4YZUYBSQF type=write size=3769043 2024-09-12T00:22:04.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.113+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~9FDUCH8WF1WP.0 size=316462 2024-09-12T00:22:04.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.117+0000 7fd6489978c0 1 < completed multipart upload key=N0AAVPQ6MUQ1 upload=9FDUCH8WF1WP tag=6WCDSYVIFMFK type=write size=1365038 2024-09-12T00:22:04.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.125+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~1RSLD49EIT5M.0 size=1048576 2024-09-12T00:22:04.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.129+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~1RSLD49EIT5M.1 size=1048576 2024-09-12T00:22:04.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.133+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~1RSLD49EIT5M.2 size=22677 2024-09-12T00:22:04.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.133+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=1RSLD49EIT5M tag=2PHEUOYG59CK type=write size=3168405 2024-09-12T00:22:04.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.137+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=PCNBPS209AU8 type=del 2024-09-12T00:22:04.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.137+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=2AOYRBCBJP88 type=del size=2349233 2024-09-12T00:22:04.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.145+0000 7fd6489978c0 1 < suggested remove operation key=J5IW4G9C72DH tag=F6UT2R9JN6S5 type=del 2024-09-12T00:22:04.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.153+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~CBXK7C2QUFXP.0 size=1048576 2024-09-12T00:22:04.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.157+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~CBXK7C2QUFXP.1 size=1048576 2024-09-12T00:22:04.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.157+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~CBXK7C2QUFXP.2 size=741743 2024-09-12T00:22:04.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.157+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=CBXK7C2QUFXP tag=7YIYEU4F848A type=write size=3887471 2024-09-12T00:22:04.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.161+0000 7fd6489978c0 1 < canceled part key=_multipart_J5IW4G9C72DH.2~RGYA1U18EAJU.0 size=674161 2024-09-12T00:22:04.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.165+0000 7fd6489978c0 1 < canceled multipart upload key=J5IW4G9C72DH upload=RGYA1U18EAJU tag=0PC1J71VC2C9 type=write size=1722737 2024-09-12T00:22:04.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.169+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=IZFKXV2UGG3D type=del size=1252400 2024-09-12T00:22:04.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.173+0000 7fd6489978c0 -1 < failed to complete operation key=J5IW4G9C72DH tag=TGKSLSLPJGBA type=del size=2850116: (22) Invalid argument 2024-09-12T00:22:04.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.177+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~2H06FTXH6ULX.0 size=1014194 2024-09-12T00:22:04.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.177+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=2H06FTXH6ULX tag=4G0ODHLNH9NA type=write size=2062770 2024-09-12T00:22:04.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.185+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=43SCKA3V6F4R type=del 2024-09-12T00:22:04.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.189+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=KF8DGLBQNLAA type=write size=200485 2024-09-12T00:22:04.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.193+0000 7fd6489978c0 1 < completed delete operation key=3JZP8TZFEIMH tag=NXI5VB3X7VEM type=del 2024-09-12T00:22:04.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.193+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=MSCWVTDR3PA2 type=write size=281702 2024-09-12T00:22:04.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.201+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~JXXKQHS0IOI9.0 size=1048576 2024-09-12T00:22:04.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.201+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~JXXKQHS0IOI9.1 size=1048576 2024-09-12T00:22:04.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.205+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~JXXKQHS0IOI9.2 size=966036 2024-09-12T00:22:04.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.209+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=JXXKQHS0IOI9 tag=0VXBS5CIR5I3 type=write size=4111764 2024-09-12T00:22:04.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.217+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~1W0T1JAX0RY1.0 size=494043 2024-09-12T00:22:04.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.217+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=1W0T1JAX0RY1 tag=PBZFOG6UUIYJ type=write size=1542619 2024-09-12T00:22:04.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.221+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~HAG5L9M68T4X.0 size=1048576 2024-09-12T00:22:04.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.225+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~HAG5L9M68T4X.1 size=1048576 2024-09-12T00:22:04.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.225+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~HAG5L9M68T4X.2 size=433616 2024-09-12T00:22:04.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.237+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=HAG5L9M68T4X tag=E7NA4C4A1T6G type=write size=3579344 2024-09-12T00:22:04.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.241+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=HQ000MM1AU95 type=del size=2131137 2024-09-12T00:22:04.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.241+0000 7fd6489978c0 1 < canceled part key=_multipart_ES2BLTWZT6PT.2~XE466IE87CAJ.0 size=1048576 2024-09-12T00:22:04.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.245+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~XE466IE87CAJ.1 size=532318 2024-09-12T00:22:04.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.249+0000 7fd6489978c0 1 < canceled multipart upload key=ES2BLTWZT6PT upload=XE466IE87CAJ tag=LWVUVXZJ308N type=write size=2629470 2024-09-12T00:22:04.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.257+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~7QJWM5EG4L74.0 size=1048576 2024-09-12T00:22:04.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.261+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~7QJWM5EG4L74.1 size=961510 2024-09-12T00:22:04.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.261+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=7QJWM5EG4L74 tag=TSM9BF1IDVYH type=write size=3058662 2024-09-12T00:22:04.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.265+0000 7fd6489978c0 1 < completed write operation key=M9YKGQ2GA5CO tag=NYBUPKYCVH4H type=write size=540739 2024-09-12T00:22:04.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.269+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=1MBOO8A1OSUF type=del size=2490903 2024-09-12T00:22:04.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.273+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=2UF4VCATRCA2 type=del 2024-09-12T00:22:04.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.277+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=6D7N8VM1CE3T type=del size=1777538 2024-09-12T00:22:04.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.277+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=K33FQQTZLM3L type=del 2024-09-12T00:22:04.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.285+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~0Y0DSNZZOPZ6.0 size=913602 2024-09-12T00:22:04.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.285+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=0Y0DSNZZOPZ6 tag=C4SE0XDUX25S type=write size=1962178 2024-09-12T00:22:04.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.289+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~25D498IXVAB4.0 size=667802 2024-09-12T00:22:04.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.293+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=25D498IXVAB4 tag=GEJK8MTHINY3 type=write size=1716378 2024-09-12T00:22:04.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.301+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~TOLQ1Y602PDL.0 size=1048576 2024-09-12T00:22:04.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.305+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~TOLQ1Y602PDL.1 size=1048576 2024-09-12T00:22:04.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.309+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~TOLQ1Y602PDL.2 size=754596 2024-09-12T00:22:04.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.309+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=TOLQ1Y602PDL tag=9ZYPIHAN8YT4 type=write size=3900324 2024-09-12T00:22:04.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.313+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=MT7QKRK0IETO type=del 2024-09-12T00:22:04.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.317+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=DRCYJ69THF6U type=write size=579078 2024-09-12T00:22:04.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.321+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~VTNICDC3ALO2.0 size=1048576 2024-09-12T00:22:04.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.321+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~VTNICDC3ALO2.1 size=1048576 2024-09-12T00:22:04.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.321+0000 7fd6489978c0 1 < canceled part key=_multipart_GVPNH3JSO07D.2~VTNICDC3ALO2.2 size=623315 2024-09-12T00:22:04.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.329+0000 7fd6489978c0 1 < canceled multipart upload key=GVPNH3JSO07D upload=VTNICDC3ALO2 tag=GUL4YZUYBSQF type=write size=3769043 2024-09-12T00:22:04.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.333+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~9FYIACTZ13HD.0 size=1048576 2024-09-12T00:22:04.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.337+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~9FYIACTZ13HD.1 size=1048576 2024-09-12T00:22:04.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.341+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~9FYIACTZ13HD.2 size=1035747 2024-09-12T00:22:04.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.341+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=9FYIACTZ13HD tag=GTVNCE6EP98X type=write size=4181475 2024-09-12T00:22:04.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.345+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~1RSLD49EIT5M.0 size=1048576 2024-09-12T00:22:04.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.345+0000 7fd6489978c0 1 < canceled part key=_multipart_ZW51KHCLPYN3.2~1RSLD49EIT5M.1 size=1048576 2024-09-12T00:22:04.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.345+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~1RSLD49EIT5M.2 size=22677 2024-09-12T00:22:04.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.353+0000 7fd6489978c0 1 < canceled multipart upload key=ZW51KHCLPYN3 upload=1RSLD49EIT5M tag=2PHEUOYG59CK type=write size=3168405 2024-09-12T00:22:04.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.357+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~K29KCN5KHNZT.0 size=1048576 2024-09-12T00:22:04.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.361+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~K29KCN5KHNZT.1 size=1048576 2024-09-12T00:22:04.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.365+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~K29KCN5KHNZT.2 size=649540 2024-09-12T00:22:04.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.365+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=K29KCN5KHNZT tag=9XEW1F493DCK type=write size=3795268 2024-09-12T00:22:04.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.369+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=2AOYRBCBJP88 type=del 2024-09-12T00:22:04.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.369+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=VXZ80AW38U82 type=del size=692161 2024-09-12T00:22:04.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.373+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~CBXK7C2QUFXP.0 size=1048576 2024-09-12T00:22:04.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.373+0000 7fd6489978c0 1 < canceled part key=_multipart_YJJBTNI318EH.2~CBXK7C2QUFXP.1 size=1048576 2024-09-12T00:22:04.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.377+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~CBXK7C2QUFXP.2 size=741743 2024-09-12T00:22:04.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.381+0000 7fd6489978c0 1 < canceled multipart upload key=YJJBTNI318EH upload=CBXK7C2QUFXP tag=7YIYEU4F848A type=write size=3887471 2024-09-12T00:22:04.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.389+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~ZUX8F6I2S3D4.0 size=912392 2024-09-12T00:22:04.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.389+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=ZUX8F6I2S3D4 tag=FNEOSMPR9BO9 type=write size=1960968 2024-09-12T00:22:04.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.389+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=IZFKXV2UGG3D type=del 2024-09-12T00:22:04.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.397+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~T38O2BOB95YF.0 size=1048576 2024-09-12T00:22:04.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.401+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~T38O2BOB95YF.1 size=1048576 2024-09-12T00:22:04.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.401+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~T38O2BOB95YF.2 size=722012 2024-09-12T00:22:04.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.401+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=T38O2BOB95YF tag=3EZVOI2Q5XZN type=write size=3867740 2024-09-12T00:22:04.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.405+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~2H06FTXH6ULX.0 size=1014194 2024-09-12T00:22:04.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.409+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=2H06FTXH6ULX tag=4G0ODHLNH9NA type=write size=2062770 2024-09-12T00:22:04.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.413+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=OMVJ3SICS0G2 type=del size=488340 2024-09-12T00:22:04.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.417+0000 7fd6489978c0 1 < canceled operation key=YJJBTNI318EH tag=KF8DGLBQNLAA type=write size=200485 2024-09-12T00:22:04.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.421+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=4DBNJ3SUSNWR type=del size=283430 2024-09-12T00:22:04.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.421+0000 7fd6489978c0 1 < completed write operation key=9ACGS2FIY7AF tag=MSCWVTDR3PA2 type=write size=281702 2024-09-12T00:22:04.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.429+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=LTYYHYGVFFV7 type=del size=3125305 2024-09-12T00:22:04.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.429+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~1W0T1JAX0RY1.0 size=494043 2024-09-12T00:22:04.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.437+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=1W0T1JAX0RY1 tag=PBZFOG6UUIYJ type=write size=1542619 2024-09-12T00:22:04.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.441+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~K21TJ3Q0RIOK.0 size=1048576 2024-09-12T00:22:04.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.445+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~K21TJ3Q0RIOK.1 size=1048576 2024-09-12T00:22:04.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.449+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~K21TJ3Q0RIOK.2 size=359033 2024-09-12T00:22:04.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.449+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=K21TJ3Q0RIOK tag=760LVTZEWH5H type=write size=3504761 2024-09-12T00:22:04.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.453+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=HQ000MM1AU95 type=del 2024-09-12T00:22:04.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.457+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~T8RB91S4AFIY.0 size=1006028 2024-09-12T00:22:04.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.457+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=T8RB91S4AFIY tag=L1PVVDSVNRF8 type=write size=2054604 2024-09-12T00:22:04.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.461+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~7QJWM5EG4L74.0 size=1048576 2024-09-12T00:22:04.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.461+0000 7fd6489978c0 1 < canceled part key=_multipart_GVPNH3JSO07D.2~7QJWM5EG4L74.1 size=961510 2024-09-12T00:22:04.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.469+0000 7fd6489978c0 1 < canceled multipart upload key=GVPNH3JSO07D upload=7QJWM5EG4L74 tag=TSM9BF1IDVYH type=write size=3058662 2024-09-12T00:22:04.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.473+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=VDD7VNT83DEZ type=del size=2494667 2024-09-12T00:22:04.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.477+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=1MBOO8A1OSUF type=del 2024-09-12T00:22:04.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.477+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=SOH6M1O73JK5 type=del size=3995707 2024-09-12T00:22:04.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.481+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=6D7N8VM1CE3T type=del 2024-09-12T00:22:04.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.485+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=8T2G8PLVQXOA type=del size=721939 2024-09-12T00:22:04.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.489+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~0Y0DSNZZOPZ6.0 size=913602 2024-09-12T00:22:04.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.493+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=0Y0DSNZZOPZ6 tag=C4SE0XDUX25S type=write size=1962178 2024-09-12T00:22:04.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.497+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=T8VQB0KR5ES5 type=del size=651436 2024-09-12T00:22:04.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.501+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~TOLQ1Y602PDL.0 size=1048576 2024-09-12T00:22:04.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.505+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~TOLQ1Y602PDL.1 size=1048576 2024-09-12T00:22:04.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.505+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~TOLQ1Y602PDL.2 size=754596 2024-09-12T00:22:04.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.513+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=TOLQ1Y602PDL tag=9ZYPIHAN8YT4 type=write size=3900324 2024-09-12T00:22:04.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.521+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~WZORVWLILKY0.0 size=1048576 2024-09-12T00:22:04.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.521+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~WZORVWLILKY0.1 size=1048576 2024-09-12T00:22:04.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.525+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~WZORVWLILKY0.2 size=834251 2024-09-12T00:22:04.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.525+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=WZORVWLILKY0 tag=3OWI2TDU9T3D type=write size=3979979 2024-09-12T00:22:04.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.529+0000 7fd6489978c0 1 < canceled operation key=M9YKGQ2GA5CO tag=DRCYJ69THF6U type=write size=579078 2024-09-12T00:22:04.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.533+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=XC9DLXGID3HA type=del size=2629420 2024-09-12T00:22:04.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.537+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~9FYIACTZ13HD.0 size=1048576 2024-09-12T00:22:04.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.541+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~9FYIACTZ13HD.1 size=1048576 2024-09-12T00:22:04.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.541+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~9FYIACTZ13HD.2 size=1035747 2024-09-12T00:22:04.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.549+0000 7fd6489978c0 1 < completed multipart upload key=N0AAVPQ6MUQ1 upload=9FYIACTZ13HD tag=GTVNCE6EP98X type=write size=4181475 2024-09-12T00:22:04.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.553+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=V6Q8S7OLG0YL type=write size=355672 2024-09-12T00:22:04.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.561+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~K29KCN5KHNZT.0 size=1048576 2024-09-12T00:22:04.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.561+0000 7fd6489978c0 1 < canceled part key=_multipart_QBS4N1KGR1JB.2~K29KCN5KHNZT.1 size=1048576 2024-09-12T00:22:04.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.561+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~K29KCN5KHNZT.2 size=649540 2024-09-12T00:22:04.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.569+0000 7fd6489978c0 1 < canceled multipart upload key=QBS4N1KGR1JB upload=K29KCN5KHNZT tag=9XEW1F493DCK type=write size=3795268 2024-09-12T00:22:04.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.573+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=FTQP1VFDVNT4 type=del size=1909495 2024-09-12T00:22:04.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.577+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=VXZ80AW38U82 type=del 2024-09-12T00:22:04.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.581+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~1ZDW5KIV20RY.0 size=1048576 2024-09-12T00:22:04.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.585+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~1ZDW5KIV20RY.1 size=1048576 2024-09-12T00:22:04.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.589+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~1ZDW5KIV20RY.2 size=347217 2024-09-12T00:22:04.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.589+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=1ZDW5KIV20RY tag=7K7RKDHCO564 type=write size=3492945 2024-09-12T00:22:04.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.593+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~ZUX8F6I2S3D4.0 size=912392 2024-09-12T00:22:04.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.597+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=ZUX8F6I2S3D4 tag=FNEOSMPR9BO9 type=write size=1960968 2024-09-12T00:22:04.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.601+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=HSJ3W17A1Z0C type=del size=157580 2024-09-12T00:22:04.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.605+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~T38O2BOB95YF.0 size=1048576 2024-09-12T00:22:04.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.609+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~T38O2BOB95YF.1 size=1048576 2024-09-12T00:22:04.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.609+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~T38O2BOB95YF.2 size=722012 2024-09-12T00:22:04.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.617+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=T38O2BOB95YF tag=3EZVOI2Q5XZN type=write size=3867740 2024-09-12T00:22:04.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.621+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~TM1GOL2QTI95.0 size=764181 2024-09-12T00:22:04.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.621+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=TM1GOL2QTI95 tag=D3YR49LFF2AR type=write size=1812757 2024-09-12T00:22:04.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.625+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=OMVJ3SICS0G2 type=del 2024-09-12T00:22:04.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.633+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~FCD8FESS1GUP.0 size=1048576 2024-09-12T00:22:04.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.633+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~FCD8FESS1GUP.1 size=1048576 2024-09-12T00:22:04.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.637+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~FCD8FESS1GUP.2 size=655312 2024-09-12T00:22:04.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.637+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=FCD8FESS1GUP tag=E2S88YIVOG8W type=write size=3801040 2024-09-12T00:22:04.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.641+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=4DBNJ3SUSNWR type=del 2024-09-12T00:22:04.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.645+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=WML0RY0SC2TU type=del size=2803284 2024-09-12T00:22:04.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.653+0000 7fd6489978c0 1 < suggested update operation key=IHYHPKVPWTUL tag=LTYYHYGVFFV7 type=del size=3125305 2024-09-12T00:22:04.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.657+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=X6DNEXQAN6LQ type=write size=791653 2024-09-12T00:22:04.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.657+0000 7fd6489978c0 1 < canceled part key=_multipart_CFID1EVBXOVJ.2~K21TJ3Q0RIOK.0 size=1048576 2024-09-12T00:22:04.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.657+0000 7fd6489978c0 1 < canceled part key=_multipart_CFID1EVBXOVJ.2~K21TJ3Q0RIOK.1 size=1048576 2024-09-12T00:22:04.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.661+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~K21TJ3Q0RIOK.2 size=359033 2024-09-12T00:22:04.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.665+0000 7fd6489978c0 1 < canceled multipart upload key=CFID1EVBXOVJ upload=K21TJ3Q0RIOK tag=760LVTZEWH5H type=write size=3504761 2024-09-12T00:22:04.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.669+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=ISIGGGY8ZJ1E type=del size=2211841 2024-09-12T00:22:04.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.673+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~T8RB91S4AFIY.0 size=1006028 2024-09-12T00:22:04.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.677+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=T8RB91S4AFIY tag=L1PVVDSVNRF8 type=write size=2054604 2024-09-12T00:22:04.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.685+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~N6KL8Y4MWQHA.0 size=593187 2024-09-12T00:22:04.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.685+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=N6KL8Y4MWQHA tag=KK05ROXZ6PVR type=write size=1641763 2024-09-12T00:22:04.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.689+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=VDD7VNT83DEZ type=del 2024-09-12T00:22:04.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.697+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~DEBGQ2G2THYC.0 size=1048576 2024-09-12T00:22:04.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.701+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~DEBGQ2G2THYC.1 size=595179 2024-09-12T00:22:04.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.701+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=DEBGQ2G2THYC tag=0ME8H45FG2YI type=write size=2692331 2024-09-12T00:22:04.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.705+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=SOH6M1O73JK5 type=del 2024-09-12T00:22:04.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.713+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~O9S7E3FLHHQ2.0 size=1048576 2024-09-12T00:22:04.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.713+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~O9S7E3FLHHQ2.1 size=1048576 2024-09-12T00:22:04.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.717+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~O9S7E3FLHHQ2.2 size=383481 2024-09-12T00:22:04.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.717+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=O9S7E3FLHHQ2 tag=SZGT7MJ5NZ8H type=write size=3529209 2024-09-12T00:22:04.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.725+0000 7fd6489978c0 1 < suggested remove operation key=9CK160BK5YYY tag=8T2G8PLVQXOA type=del 2024-09-12T00:22:04.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.729+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=CYJ0SO0U4SU8 type=del size=1458230 2024-09-12T00:22:04.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.733+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=T8VQB0KR5ES5 type=del 2024-09-12T00:22:04.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.741+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~O7SKQUK16UI0.0 size=352258 2024-09-12T00:22:04.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.741+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=O7SKQUK16UI0 tag=2Z7Y03HYMI3T type=write size=1400834 2024-09-12T00:22:04.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.745+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~WZORVWLILKY0.0 size=1048576 2024-09-12T00:22:04.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.745+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~WZORVWLILKY0.1 size=1048576 2024-09-12T00:22:04.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.745+0000 7fd6489978c0 1 < canceled part key=_multipart_JPVKBVRCZTE9.2~WZORVWLILKY0.2 size=834251 2024-09-12T00:22:04.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.753+0000 7fd6489978c0 1 < canceled multipart upload key=JPVKBVRCZTE9 upload=WZORVWLILKY0 tag=3OWI2TDU9T3D type=write size=3979979 2024-09-12T00:22:04.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.761+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~ZA99E04PQEIT.0 size=1048576 2024-09-12T00:22:04.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.761+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~ZA99E04PQEIT.1 size=1048576 2024-09-12T00:22:04.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.765+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~ZA99E04PQEIT.2 size=803010 2024-09-12T00:22:04.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.765+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=ZA99E04PQEIT tag=XLO8BA4A3UWV type=write size=3948738 2024-09-12T00:22:04.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.769+0000 7fd6489978c0 1 < canceled operation key=QBS4N1KGR1JB tag=XC9DLXGID3HA type=del size=2629420 2024-09-12T00:22:04.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.773+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=RE4ZG377XVLQ type=del size=3890907 2024-09-12T00:22:04.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.777+0000 7fd6489978c0 1 < completed write operation key=K9FD1L86Q05B tag=V6Q8S7OLG0YL type=write size=355672 2024-09-12T00:22:04.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.785+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~MSXFIAVL1DOD.0 size=1048576 2024-09-12T00:22:04.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.785+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~MSXFIAVL1DOD.1 size=889072 2024-09-12T00:22:04.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.785+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=MSXFIAVL1DOD tag=Q142BFPG3S16 type=write size=2986224 2024-09-12T00:22:04.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.789+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=FTQP1VFDVNT4 type=del 2024-09-12T00:22:04.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.797+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~8KMJ2MGOQJG9.0 size=257741 2024-09-12T00:22:04.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.797+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=8KMJ2MGOQJG9 tag=VT0F32FOEDE0 type=write size=1306317 2024-09-12T00:22:04.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.801+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~1ZDW5KIV20RY.0 size=1048576 2024-09-12T00:22:04.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.805+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~1ZDW5KIV20RY.1 size=1048576 2024-09-12T00:22:04.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.805+0000 7fd6489978c0 1 < canceled part key=_multipart_25P4P2I6BE3H.2~1ZDW5KIV20RY.2 size=347217 2024-09-12T00:22:04.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.809+0000 7fd6489978c0 1 < canceled multipart upload key=25P4P2I6BE3H upload=1ZDW5KIV20RY tag=7K7RKDHCO564 type=write size=3492945 2024-09-12T00:22:04.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.813+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=RA2L4PXFLPB7 type=write size=496635 2024-09-12T00:22:04.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.821+0000 7fd6489978c0 1 < suggested update operation key=B2BW7GQ6UN9I tag=HSJ3W17A1Z0C type=del size=157580 2024-09-12T00:22:04.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.825+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=NXP670KO1X0U type=del size=4104453 2024-09-12T00:22:04.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.829+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~TM1GOL2QTI95.0 size=764181 2024-09-12T00:22:04.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.833+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=TM1GOL2QTI95 tag=D3YR49LFF2AR type=write size=1812757 2024-09-12T00:22:04.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.837+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=4L5SULF5T6GU type=del size=1170316 2024-09-12T00:22:04.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.841+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~FCD8FESS1GUP.0 size=1048576 2024-09-12T00:22:04.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.845+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~FCD8FESS1GUP.1 size=1048576 2024-09-12T00:22:04.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.849+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~FCD8FESS1GUP.2 size=655312 2024-09-12T00:22:04.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.853+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=FCD8FESS1GUP tag=E2S88YIVOG8W type=write size=3801040 2024-09-12T00:22:04.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.857+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=JGLM36EFET07 type=del size=4164586 2024-09-12T00:22:04.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.861+0000 7fd6489978c0 -1 < failed to complete operation key=IHYHPKVPWTUL tag=WML0RY0SC2TU type=del size=2803284: (22) Invalid argument 2024-09-12T00:22:04.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.869+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~WU2823JDYGUP.0 size=1048576 2024-09-12T00:22:04.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.873+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~WU2823JDYGUP.1 size=642904 2024-09-12T00:22:04.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.873+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=WU2823JDYGUP tag=HIW3TMEW40AX type=write size=2740056 2024-09-12T00:22:04.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.877+0000 7fd6489978c0 1 < suggested remove operation key=IHYHPKVPWTUL tag=X6DNEXQAN6LQ type=write 2024-09-12T00:22:04.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.881+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=3GY671LH2RJM type=del size=1610049 2024-09-12T00:22:04.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.885+0000 7fd6489978c0 1 < canceled operation key=N0AAVPQ6MUQ1 tag=ISIGGGY8ZJ1E type=del size=2211841 2024-09-12T00:22:04.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.889+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=SEHI3W7W24UW type=write size=66096 2024-09-12T00:22:04.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.893+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~N6KL8Y4MWQHA.0 size=593187 2024-09-12T00:22:04.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.905+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=N6KL8Y4MWQHA tag=KK05ROXZ6PVR type=write size=1641763 2024-09-12T00:22:04.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.909+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=Q62GKNW07R6Q type=write size=674769 2024-09-12T00:22:04.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.913+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~DEBGQ2G2THYC.0 size=1048576 2024-09-12T00:22:04.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.917+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~DEBGQ2G2THYC.1 size=595179 2024-09-12T00:22:04.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.925+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=DEBGQ2G2THYC tag=0ME8H45FG2YI type=write size=2692331 2024-09-12T00:22:04.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.929+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~KU4TFI5NAPIE.0 size=1048576 2024-09-12T00:22:04.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.933+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~KU4TFI5NAPIE.1 size=570902 2024-09-12T00:22:04.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.933+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=KU4TFI5NAPIE tag=ZKDMQ2LS3VLS type=write size=2668054 2024-09-12T00:22:04.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.937+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~O9S7E3FLHHQ2.0 size=1048576 2024-09-12T00:22:04.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.941+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~O9S7E3FLHHQ2.1 size=1048576 2024-09-12T00:22:04.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.945+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~O9S7E3FLHHQ2.2 size=383481 2024-09-12T00:22:04.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.953+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=O9S7E3FLHHQ2 tag=SZGT7MJ5NZ8H type=write size=3529209 2024-09-12T00:22:04.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.957+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=HJSYIK6KKDC1 type=del size=569655 2024-09-12T00:22:04.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.965+0000 7fd6489978c0 1 < suggested remove operation key=RGE8T6BTHBWK tag=CYJ0SO0U4SU8 type=del 2024-09-12T00:22:04.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.973+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~VCM1B31G0UCV.0 size=576428 2024-09-12T00:22:04.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.973+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=VCM1B31G0UCV tag=TQ6QRGCL52MF type=write size=1625004 2024-09-12T00:22:04.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.977+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~O7SKQUK16UI0.0 size=352258 2024-09-12T00:22:04.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.981+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=O7SKQUK16UI0 tag=2Z7Y03HYMI3T type=write size=1400834 2024-09-12T00:22:04.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.985+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=LJ23PDYGG3T1 type=del size=2663327 2024-09-12T00:22:04.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.989+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~ZA99E04PQEIT.0 size=1048576 2024-09-12T00:22:04.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.989+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~ZA99E04PQEIT.1 size=1048576 2024-09-12T00:22:04.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:04.993+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~ZA99E04PQEIT.2 size=803010 2024-09-12T00:22:05.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.041+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=ZA99E04PQEIT tag=XLO8BA4A3UWV type=write size=3948738 2024-09-12T00:22:05.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.045+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=UL1SJZ0TUHSW type=del size=2948689 2024-09-12T00:22:05.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.049+0000 7fd6489978c0 1 < completed delete operation key=J5IW4G9C72DH tag=RE4ZG377XVLQ type=del 2024-09-12T00:22:05.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.057+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~FNE1Z70VA8ZH.0 size=1048576 2024-09-12T00:22:05.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.061+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~FNE1Z70VA8ZH.1 size=1048576 2024-09-12T00:22:05.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.061+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~FNE1Z70VA8ZH.2 size=947622 2024-09-12T00:22:05.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.061+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=FNE1Z70VA8ZH tag=173WWBUSZ3PU type=write size=4093350 2024-09-12T00:22:05.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.065+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~MSXFIAVL1DOD.0 size=1048576 2024-09-12T00:22:05.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.069+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~MSXFIAVL1DOD.1 size=889072 2024-09-12T00:22:05.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.077+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=MSXFIAVL1DOD tag=Q142BFPG3S16 type=write size=2986224 2024-09-12T00:22:05.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.081+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=FNU5M7CB1DJO type=del size=3540591 2024-09-12T00:22:05.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.085+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~8KMJ2MGOQJG9.0 size=257741 2024-09-12T00:22:05.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.089+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=8KMJ2MGOQJG9 tag=VT0F32FOEDE0 type=write size=1306317 2024-09-12T00:22:05.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.093+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=V4LDA3RG680L type=del size=457355 2024-09-12T00:22:05.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.097+0000 7fd6489978c0 -1 < failed to complete operation key=IHYHPKVPWTUL tag=RA2L4PXFLPB7 type=write size=496635: (22) Invalid argument 2024-09-12T00:22:05.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.101+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=NA5MXR9FVTEU type=del size=3769848 2024-09-12T00:22:05.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.105+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=NXP670KO1X0U type=del 2024-09-12T00:22:05.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.109+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~GYFP2W71T4M1.0 size=738921 2024-09-12T00:22:05.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.109+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=GYFP2W71T4M1 tag=HP3YECQQKWMQ type=write size=1787497 2024-09-12T00:22:05.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.113+0000 7fd6489978c0 -1 < failed to complete operation key=IHYHPKVPWTUL tag=4L5SULF5T6GU type=del size=1170316: (22) Invalid argument 2024-09-12T00:22:05.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.117+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=NGJLVM97BPS2 type=del size=2131818 2024-09-12T00:22:05.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.121+0000 7fd6489978c0 -1 < failed to complete operation key=RGE8T6BTHBWK tag=JGLM36EFET07 type=del size=4164586: (22) Invalid argument 2024-09-12T00:22:05.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.125+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=Y7XENVKU5MTU type=write size=857814 2024-09-12T00:22:05.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.129+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~WU2823JDYGUP.0 size=1048576 2024-09-12T00:22:05.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.133+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~WU2823JDYGUP.1 size=642904 2024-09-12T00:22:05.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.137+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=WU2823JDYGUP tag=HIW3TMEW40AX type=write size=2740056 2024-09-12T00:22:05.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.145+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~FVVQMESPPCI6.0 size=602243 2024-09-12T00:22:05.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.145+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=FVVQMESPPCI6 tag=ICT6L8JYZKH2 type=write size=1650819 2024-09-12T00:22:05.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.149+0000 7fd6489978c0 1 < canceled operation key=F2CTWM0T2698 tag=3GY671LH2RJM type=del size=1610049 2024-09-12T00:22:05.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.157+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~72UPUYLEVBOZ.0 size=1048576 2024-09-12T00:22:05.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.157+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~72UPUYLEVBOZ.1 size=1048576 2024-09-12T00:22:05.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.161+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~72UPUYLEVBOZ.2 size=232517 2024-09-12T00:22:05.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.161+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=72UPUYLEVBOZ tag=EWH86ZX31WIQ type=write size=3378245 2024-09-12T00:22:05.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.165+0000 7fd6489978c0 1 < completed write operation key=8FBXDX6GELE7 tag=SEHI3W7W24UW type=write size=66096 2024-09-12T00:22:05.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.173+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~7GGN3YUP8DQP.0 size=1048576 2024-09-12T00:22:05.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.177+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~7GGN3YUP8DQP.1 size=503276 2024-09-12T00:22:05.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.177+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=7GGN3YUP8DQP tag=U5WHL1TE22DU type=write size=2600428 2024-09-12T00:22:05.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.181+0000 7fd6489978c0 1 < completed write operation key=CFID1EVBXOVJ tag=Q62GKNW07R6Q type=write size=674769 2024-09-12T00:22:05.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.189+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~VRV829OKCHU2.0 size=610633 2024-09-12T00:22:05.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.189+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=VRV829OKCHU2 tag=32ST4N9TKXJH type=write size=1659209 2024-09-12T00:22:05.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.193+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~KU4TFI5NAPIE.0 size=1048576 2024-09-12T00:22:05.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.193+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~KU4TFI5NAPIE.1 size=570902 2024-09-12T00:22:05.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.201+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=KU4TFI5NAPIE tag=ZKDMQ2LS3VLS type=write size=2668054 2024-09-12T00:22:05.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.205+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=E4O9MGECCFN1 type=del size=396625 2024-09-12T00:22:05.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.213+0000 7fd6489978c0 1 < suggested remove operation key=KAT2TB3FGAYG tag=HJSYIK6KKDC1 type=del 2024-09-12T00:22:05.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.217+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=TSSEVQ9541RB type=write size=944503 2024-09-12T00:22:05.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.221+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~VCM1B31G0UCV.0 size=576428 2024-09-12T00:22:05.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.225+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=VCM1B31G0UCV tag=TQ6QRGCL52MF type=write size=1625004 2024-09-12T00:22:05.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.229+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=EHLVC7S52CGK type=del size=1126172 2024-09-12T00:22:05.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.233+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=LJ23PDYGG3T1 type=del 2024-09-12T00:22:05.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.241+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~DS85U7IDX05K.0 size=950822 2024-09-12T00:22:05.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.241+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=DS85U7IDX05K tag=47VJ712M1HCY type=write size=1999398 2024-09-12T00:22:05.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.249+0000 7fd6489978c0 1 < suggested update operation key=9CK160BK5YYY tag=UL1SJZ0TUHSW type=del size=2948689 2024-09-12T00:22:05.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.253+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=YL5FQMYF3BXN type=del size=3727299 2024-09-12T00:22:05.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.257+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~FNE1Z70VA8ZH.0 size=1048576 2024-09-12T00:22:05.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.261+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~FNE1Z70VA8ZH.1 size=1048576 2024-09-12T00:22:05.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.265+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~FNE1Z70VA8ZH.2 size=947622 2024-09-12T00:22:05.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.269+0000 7fd6489978c0 1 < completed multipart upload key=N0AAVPQ6MUQ1 upload=FNE1Z70VA8ZH tag=173WWBUSZ3PU type=write size=4093350 2024-09-12T00:22:05.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.273+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=TDR9TUGH8ZTD type=del size=4093165 2024-09-12T00:22:05.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.277+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=FNU5M7CB1DJO type=del 2024-09-12T00:22:05.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.281+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=F7OFVOK548ZP type=del size=3983124 2024-09-12T00:22:05.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.285+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=V4LDA3RG680L type=del 2024-09-12T00:22:05.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.289+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=W8GHPKC2YSDY type=del size=2258450 2024-09-12T00:22:05.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.301+0000 7fd6489978c0 1 < suggested update operation key=N0AAVPQ6MUQ1 tag=NA5MXR9FVTEU type=del size=3769848 2024-09-12T00:22:05.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.309+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~COO2WBOIDS2Y.0 size=1048576 2024-09-12T00:22:05.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.309+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~COO2WBOIDS2Y.1 size=571318 2024-09-12T00:22:05.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.309+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=COO2WBOIDS2Y tag=IHU35UBD3BXI type=write size=2668470 2024-09-12T00:22:05.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.313+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~GYFP2W71T4M1.0 size=738921 2024-09-12T00:22:05.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.321+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=GYFP2W71T4M1 tag=HP3YECQQKWMQ type=write size=1787497 2024-09-12T00:22:05.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.325+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=K5UPG22IG940 type=write size=309131 2024-09-12T00:22:05.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.333+0000 7fd6489978c0 1 < suggested remove operation key=B2BW7GQ6UN9I tag=NGJLVM97BPS2 type=del 2024-09-12T00:22:05.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.337+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=H1XB1AIFAHBL type=del size=2817884 2024-09-12T00:22:05.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.341+0000 7fd6489978c0 1 < completed write operation key=25P4P2I6BE3H tag=Y7XENVKU5MTU type=write size=857814 2024-09-12T00:22:05.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.345+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~RKQ3LJHAZAWN.0 size=1048576 2024-09-12T00:22:05.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.349+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~RKQ3LJHAZAWN.1 size=1048576 2024-09-12T00:22:05.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.353+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~RKQ3LJHAZAWN.2 size=808982 2024-09-12T00:22:05.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.353+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=RKQ3LJHAZAWN tag=NS9R354I1WOT type=write size=3954710 2024-09-12T00:22:05.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.357+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~FVVQMESPPCI6.0 size=602243 2024-09-12T00:22:05.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.361+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=FVVQMESPPCI6 tag=ICT6L8JYZKH2 type=write size=1650819 2024-09-12T00:22:05.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.369+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~9ZO2NDRB4NQY.0 size=438158 2024-09-12T00:22:05.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.369+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=9ZO2NDRB4NQY tag=SE05IT81V2XZ type=write size=1486734 2024-09-12T00:22:05.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.373+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~72UPUYLEVBOZ.0 size=1048576 2024-09-12T00:22:05.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.377+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~72UPUYLEVBOZ.1 size=1048576 2024-09-12T00:22:05.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.381+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~72UPUYLEVBOZ.2 size=232517 2024-09-12T00:22:05.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.389+0000 7fd6489978c0 1 < completed multipart upload key=G4EUTQOHAT2E upload=72UPUYLEVBOZ tag=EWH86ZX31WIQ type=write size=3378245 2024-09-12T00:22:05.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.393+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~GR78QN23DCMI.0 size=1048576 2024-09-12T00:22:05.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.397+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~GR78QN23DCMI.1 size=1048576 2024-09-12T00:22:05.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.401+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~GR78QN23DCMI.2 size=1041501 2024-09-12T00:22:05.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.401+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=GR78QN23DCMI tag=4CN6MAU7P5RG type=write size=4187229 2024-09-12T00:22:05.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.405+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~7GGN3YUP8DQP.0 size=1048576 2024-09-12T00:22:05.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.405+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~7GGN3YUP8DQP.1 size=503276 2024-09-12T00:22:05.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.413+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=7GGN3YUP8DQP tag=U5WHL1TE22DU type=write size=2600428 2024-09-12T00:22:05.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.417+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=UC0XUXHHVWW5 type=del size=3415271 2024-09-12T00:22:05.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.421+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~VRV829OKCHU2.0 size=610633 2024-09-12T00:22:05.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.429+0000 7fd6489978c0 1 < completed multipart upload key=9ACGS2FIY7AF upload=VRV829OKCHU2 tag=32ST4N9TKXJH type=write size=1659209 2024-09-12T00:22:05.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.433+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~0NMITLHTTD3Z.0 size=1048576 2024-09-12T00:22:05.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.437+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~0NMITLHTTD3Z.1 size=1048576 2024-09-12T00:22:05.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.441+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~0NMITLHTTD3Z.2 size=374556 2024-09-12T00:22:05.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.441+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=0NMITLHTTD3Z tag=FSP7CZXWK2M8 type=write size=3520284 2024-09-12T00:22:05.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.441+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=E4O9MGECCFN1 type=del 2024-09-12T00:22:05.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.445+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=G2683D02FIBT type=del size=2551596 2024-09-12T00:22:05.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.449+0000 7fd6489978c0 -1 < failed to complete operation key=9CK160BK5YYY tag=TSSEVQ9541RB type=write size=944503: (22) Invalid argument 2024-09-12T00:22:05.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.453+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=WG2BSRM2YV2W type=del size=369120 2024-09-12T00:22:05.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.461+0000 7fd6489978c0 1 < suggested remove operation key=F2CTWM0T2698 tag=EHLVC7S52CGK type=del 2024-09-12T00:22:05.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.465+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=AB2UU4G82MFQ type=del size=3241077 2024-09-12T00:22:05.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.469+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~DS85U7IDX05K.0 size=950822 2024-09-12T00:22:05.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.477+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=DS85U7IDX05K tag=47VJ712M1HCY type=write size=1999398 2024-09-12T00:22:05.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.481+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=7WURW3MGVYFO type=del size=2775481 2024-09-12T00:22:05.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.485+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=YL5FQMYF3BXN type=del 2024-09-12T00:22:05.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.489+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=81R4CZ6S53S7 type=del size=1845213 2024-09-12T00:22:05.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.493+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=TDR9TUGH8ZTD type=del 2024-09-12T00:22:05.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.497+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=6BMZNI92NQFN type=del size=2417754 2024-09-12T00:22:05.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.505+0000 7fd6489978c0 1 < suggested remove operation key=ZW51KHCLPYN3 tag=F7OFVOK548ZP type=del 2024-09-12T00:22:05.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.509+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=0ET73E79BLVA type=del size=1418835 2024-09-12T00:22:05.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.513+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=W8GHPKC2YSDY type=del 2024-09-12T00:22:05.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.517+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=KOVQIATWVXGC type=del size=2818369 2024-09-12T00:22:05.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.521+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~COO2WBOIDS2Y.0 size=1048576 2024-09-12T00:22:05.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.521+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~COO2WBOIDS2Y.1 size=571318 2024-09-12T00:22:05.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.529+0000 7fd6489978c0 1 < completed multipart upload key=N0AAVPQ6MUQ1 upload=COO2WBOIDS2Y tag=IHU35UBD3BXI type=write size=2668470 2024-09-12T00:22:05.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.533+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=I54HWUABA9NA type=write size=1013316 2024-09-12T00:22:05.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.537+0000 7fd6489978c0 1 < completed write operation key=Y3JFVW74FNT6 tag=K5UPG22IG940 type=write size=309131 2024-09-12T00:22:05.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.545+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~S67SLOGWHKY3.0 size=1048576 2024-09-12T00:22:05.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.545+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~S67SLOGWHKY3.1 size=1048576 2024-09-12T00:22:05.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.549+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~S67SLOGWHKY3.2 size=245072 2024-09-12T00:22:05.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.549+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=S67SLOGWHKY3 tag=T4UE9W9QU6L6 type=write size=3390800 2024-09-12T00:22:05.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.553+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=H1XB1AIFAHBL type=del 2024-09-12T00:22:05.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.561+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~LDVFD2OX33DW.0 size=1005538 2024-09-12T00:22:05.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.561+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=LDVFD2OX33DW tag=H9AC61NF18UO type=write size=2054114 2024-09-12T00:22:05.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.565+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~RKQ3LJHAZAWN.0 size=1048576 2024-09-12T00:22:05.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.569+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~RKQ3LJHAZAWN.1 size=1048576 2024-09-12T00:22:05.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.569+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~RKQ3LJHAZAWN.2 size=808982 2024-09-12T00:22:05.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.577+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=RKQ3LJHAZAWN tag=NS9R354I1WOT type=write size=3954710 2024-09-12T00:22:05.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.581+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=ILSSHIAAZBIR type=del size=386113 2024-09-12T00:22:05.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.585+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~9ZO2NDRB4NQY.0 size=438158 2024-09-12T00:22:05.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.589+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=9ZO2NDRB4NQY tag=SE05IT81V2XZ type=write size=1486734 2024-09-12T00:22:05.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.593+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=5PFF322DPM7E type=del size=712070 2024-09-12T00:22:05.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.597+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~GR78QN23DCMI.0 size=1048576 2024-09-12T00:22:05.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.601+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~GR78QN23DCMI.1 size=1048576 2024-09-12T00:22:05.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.605+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~GR78QN23DCMI.2 size=1041501 2024-09-12T00:22:05.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.609+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=GR78QN23DCMI tag=4CN6MAU7P5RG type=write size=4187229 2024-09-12T00:22:05.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.613+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=2ASV9RJN8NB0 type=del size=2427816 2024-09-12T00:22:05.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.617+0000 7fd6489978c0 1 < completed delete operation key=J5IW4G9C72DH tag=UC0XUXHHVWW5 type=del 2024-09-12T00:22:05.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.621+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=37CN812V9QN5 type=del size=1953146 2024-09-12T00:22:05.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.625+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~0NMITLHTTD3Z.0 size=1048576 2024-09-12T00:22:05.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.629+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~0NMITLHTTD3Z.1 size=1048576 2024-09-12T00:22:05.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.633+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~0NMITLHTTD3Z.2 size=374556 2024-09-12T00:22:05.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.637+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=0NMITLHTTD3Z tag=FSP7CZXWK2M8 type=write size=3520284 2024-09-12T00:22:05.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.645+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~QS2XFXOCVSP7.0 size=1048576 2024-09-12T00:22:05.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.653+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~QS2XFXOCVSP7.1 size=1048576 2024-09-12T00:22:05.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.657+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~QS2XFXOCVSP7.2 size=991582 2024-09-12T00:22:05.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.657+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=QS2XFXOCVSP7 tag=FWQ10RC7M5UV type=write size=4137310 2024-09-12T00:22:05.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.657+0000 7fd6489978c0 -1 < no bi entry to suggest for operation key=ZW51KHCLPYN3 tag=G2683D02FIBT type=del size=2551596: (2) No such file or directory 2024-09-12T00:22:05.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.665+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~SF7L15MD0WW0.0 size=1048576 2024-09-12T00:22:05.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.669+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~SF7L15MD0WW0.1 size=967464 2024-09-12T00:22:05.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.669+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=SF7L15MD0WW0 tag=5EUNIP6H48LQ type=write size=3064616 2024-09-12T00:22:05.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.669+0000 7fd6489978c0 -1 < no bi entry to suggest for operation key=F2CTWM0T2698 tag=WG2BSRM2YV2W type=del size=369120: (2) No such file or directory 2024-09-12T00:22:05.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.677+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~18Q08P96G37C.0 size=384692 2024-09-12T00:22:05.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.677+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=18Q08P96G37C tag=T0IEMC13LNGY type=write size=1433268 2024-09-12T00:22:05.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.681+0000 7fd6489978c0 -1 < failed to complete operation key=ZW51KHCLPYN3 tag=AB2UU4G82MFQ type=del size=3241077: (22) Invalid argument 2024-09-12T00:22:05.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.689+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~HRYL19E2Y8KT.0 size=1048576 2024-09-12T00:22:05.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.689+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~HRYL19E2Y8KT.1 size=68088 2024-09-12T00:22:05.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.689+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=HRYL19E2Y8KT tag=B3HKJ8W7E75L type=write size=2165240 2024-09-12T00:22:05.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.693+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=7WURW3MGVYFO type=del 2024-09-12T00:22:05.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.697+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=O2H75FG3VPB8 type=del size=478358 2024-09-12T00:22:05.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.701+0000 7fd6489978c0 1 < canceled operation key=LZICTA4BWOW8 tag=81R4CZ6S53S7 type=del size=1845213 2024-09-12T00:22:05.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.705+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=PZVSRWK1VIZR type=del size=2283746 2024-09-12T00:22:05.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.709+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=6BMZNI92NQFN type=del 2024-09-12T00:22:05.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.713+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=SZYRAKK7QMV3 type=del size=2183876 2024-09-12T00:22:05.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.717+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=0ET73E79BLVA type=del 2024-09-12T00:22:05.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.721+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=8O1SMLYOXAR3 type=del size=334678 2024-09-12T00:22:05.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.725+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=KOVQIATWVXGC type=del 2024-09-12T00:22:05.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.729+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=5ZXNUG27S9YZ type=del size=2555558 2024-09-12T00:22:05.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.733+0000 7fd6489978c0 1 < completed write operation key=HUKWLE56FRX2 tag=I54HWUABA9NA type=write size=1013316 2024-09-12T00:22:05.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.737+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=9NTG9FEJUK37 type=del size=896623 2024-09-12T00:22:05.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.741+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~S67SLOGWHKY3.0 size=1048576 2024-09-12T00:22:05.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.741+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~S67SLOGWHKY3.1 size=1048576 2024-09-12T00:22:05.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.745+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~S67SLOGWHKY3.2 size=245072 2024-09-12T00:22:05.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.749+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=S67SLOGWHKY3 tag=T4UE9W9QU6L6 type=write size=3390800 2024-09-12T00:22:05.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.757+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~KRHB9X8743GG.0 size=1048576 2024-09-12T00:22:05.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.761+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~KRHB9X8743GG.1 size=75429 2024-09-12T00:22:05.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.761+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=KRHB9X8743GG tag=C79YO0N03GNE type=write size=2172581 2024-09-12T00:22:05.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.765+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~LDVFD2OX33DW.0 size=1005538 2024-09-12T00:22:05.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.769+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=LDVFD2OX33DW tag=H9AC61NF18UO type=write size=2054114 2024-09-12T00:22:05.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.773+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=KO4G6MLWD39S type=del size=4043182 2024-09-12T00:22:05.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.777+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=ILSSHIAAZBIR type=del 2024-09-12T00:22:05.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.781+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=BTN4TLIFWZJ4 type=del size=3549880 2024-09-12T00:22:05.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.785+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=5PFF322DPM7E type=del 2024-09-12T00:22:05.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.789+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=QMTXZGC1NUF6 type=del size=2452526 2024-09-12T00:22:05.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.793+0000 7fd6489978c0 1 < completed delete operation key=RGE8T6BTHBWK tag=2ASV9RJN8NB0 type=del 2024-09-12T00:22:05.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.797+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=DY6RR80ULAFC type=del size=3992640 2024-09-12T00:22:05.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.801+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=37CN812V9QN5 type=del 2024-09-12T00:22:05.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.805+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=YRCLVN3I8UU1 type=del size=2499378 2024-09-12T00:22:05.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.809+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~QS2XFXOCVSP7.0 size=1048576 2024-09-12T00:22:05.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.813+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~QS2XFXOCVSP7.1 size=1048576 2024-09-12T00:22:05.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.817+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~QS2XFXOCVSP7.2 size=991582 2024-09-12T00:22:05.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.821+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=QS2XFXOCVSP7 tag=FWQ10RC7M5UV type=write size=4137310 2024-09-12T00:22:05.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.825+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=FLFE8VKIPJ2D type=del size=1077321 2024-09-12T00:22:05.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.829+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~SF7L15MD0WW0.0 size=1048576 2024-09-12T00:22:05.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.833+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~SF7L15MD0WW0.1 size=967464 2024-09-12T00:22:05.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.837+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=SF7L15MD0WW0 tag=5EUNIP6H48LQ type=write size=3064616 2024-09-12T00:22:05.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.841+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=360VKJ8FIJ15 type=del size=3265218 2024-09-12T00:22:05.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.845+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~18Q08P96G37C.0 size=384692 2024-09-12T00:22:05.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.853+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=18Q08P96G37C tag=T0IEMC13LNGY type=write size=1433268 2024-09-12T00:22:05.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.857+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=NDKBL3BHXEX7 type=del size=1374631 2024-09-12T00:22:05.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.861+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~HRYL19E2Y8KT.0 size=1048576 2024-09-12T00:22:05.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.861+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~HRYL19E2Y8KT.1 size=68088 2024-09-12T00:22:05.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.869+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=HRYL19E2Y8KT tag=B3HKJ8W7E75L type=write size=2165240 2024-09-12T00:22:05.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.877+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~U4PPJIIPMT6Y.0 size=1048576 2024-09-12T00:22:05.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.877+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~U4PPJIIPMT6Y.1 size=174275 2024-09-12T00:22:05.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.877+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=U4PPJIIPMT6Y tag=AI6705YGWL4I type=write size=2271427 2024-09-12T00:22:05.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.881+0000 7fd6489978c0 1 < canceled operation key=J5IW4G9C72DH tag=O2H75FG3VPB8 type=del size=478358 2024-09-12T00:22:05.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.885+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=U5108C24BGN2 type=write size=695206 2024-09-12T00:22:05.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.889+0000 7fd6489978c0 1 < completed delete operation key=JPVKBVRCZTE9 tag=PZVSRWK1VIZR type=del 2024-09-12T00:22:05.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.893+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=GKKME9QSN084 type=del size=1317565 2024-09-12T00:22:05.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.897+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=SZYRAKK7QMV3 type=del 2024-09-12T00:22:05.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.901+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=1USHZKAF31ZN type=del size=824586 2024-09-12T00:22:05.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.905+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=8O1SMLYOXAR3 type=del 2024-09-12T00:22:05.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.909+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=VZIUTY78NYSL type=del size=335972 2024-09-12T00:22:05.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.913+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=5ZXNUG27S9YZ type=del 2024-09-12T00:22:05.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.917+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~2AELYU8YRL7E.0 size=1048576 2024-09-12T00:22:05.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.921+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~2AELYU8YRL7E.1 size=394667 2024-09-12T00:22:05.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.921+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=2AELYU8YRL7E tag=QP5VI2IEWZB9 type=write size=2491819 2024-09-12T00:22:05.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.925+0000 7fd6489978c0 1 < completed delete operation key=RGE8T6BTHBWK tag=9NTG9FEJUK37 type=del 2024-09-12T00:22:05.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.929+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=3LC6AA7H1KDD type=del size=1802912 2024-09-12T00:22:05.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.933+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~KRHB9X8743GG.0 size=1048576 2024-09-12T00:22:05.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.937+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~KRHB9X8743GG.1 size=75429 2024-09-12T00:22:05.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.941+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=KRHB9X8743GG tag=C79YO0N03GNE type=write size=2172581 2024-09-12T00:22:05.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.945+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=XKW40YRCZKF6 type=del size=3267562 2024-09-12T00:22:05.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.949+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=KO4G6MLWD39S type=del 2024-09-12T00:22:05.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.957+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~FF2J7M8PET59.0 size=166993 2024-09-12T00:22:05.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.957+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=FF2J7M8PET59 tag=2E9A3YI2ZR64 type=write size=1215569 2024-09-12T00:22:05.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.961+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=BTN4TLIFWZJ4 type=del 2024-09-12T00:22:05.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.969+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~XH6RSINB79HH.0 size=1048576 2024-09-12T00:22:05.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.973+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~XH6RSINB79HH.1 size=926933 2024-09-12T00:22:05.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.973+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=XH6RSINB79HH tag=1KNFXN5C8GVN type=write size=3024085 2024-09-12T00:22:05.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.981+0000 7fd6489978c0 1 < suggested update operation key=LZICTA4BWOW8 tag=QMTXZGC1NUF6 type=del size=2452526 2024-09-12T00:22:05.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.985+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=CAE041GKTI98 type=del size=1011249 2024-09-12T00:22:05.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.993+0000 7fd6489978c0 1 < suggested remove operation key=N0AAVPQ6MUQ1 tag=DY6RR80ULAFC type=del 2024-09-12T00:22:05.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.997+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=WZ6A6EFD6LPU type=del size=1342111 2024-09-12T00:22:05.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:05.997+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=YRCLVN3I8UU1 type=del 2024-09-12T00:22:06.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.005+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~FE4U1SS9FGQE.0 size=1048576 2024-09-12T00:22:06.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.013+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~FE4U1SS9FGQE.1 size=130263 2024-09-12T00:22:06.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.013+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=FE4U1SS9FGQE tag=X8VFO0LKHWIY type=write size=2227415 2024-09-12T00:22:06.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.013+0000 7fd6489978c0 1 < canceled operation key=KAT2TB3FGAYG tag=FLFE8VKIPJ2D type=del size=1077321 2024-09-12T00:22:06.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.021+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~OZ8NP8YFAD93.0 size=710400 2024-09-12T00:22:06.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.021+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=OZ8NP8YFAD93 tag=V5A3BD21B316 type=write size=1758976 2024-09-12T00:22:06.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.025+0000 7fd6489978c0 -1 < failed to complete operation key=N0AAVPQ6MUQ1 tag=360VKJ8FIJ15 type=del size=3265218: (22) Invalid argument 2024-09-12T00:22:06.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.033+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~J5N9Q9WQWW04.0 size=1048576 2024-09-12T00:22:06.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.033+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~J5N9Q9WQWW04.1 size=1048576 2024-09-12T00:22:06.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.037+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~J5N9Q9WQWW04.2 size=494922 2024-09-12T00:22:06.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.037+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=J5N9Q9WQWW04 tag=VDMBSHGRJAPR type=write size=3640650 2024-09-12T00:22:06.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.041+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=NDKBL3BHXEX7 type=del 2024-09-12T00:22:06.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.049+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~UFZ8SOHJ4LGN.0 size=1048576 2024-09-12T00:22:06.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.049+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~UFZ8SOHJ4LGN.1 size=1048576 2024-09-12T00:22:06.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.053+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~UFZ8SOHJ4LGN.2 size=1030722 2024-09-12T00:22:06.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.053+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=UFZ8SOHJ4LGN tag=8NTJRXVH5JXH type=write size=4176450 2024-09-12T00:22:06.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.057+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~U4PPJIIPMT6Y.0 size=1048576 2024-09-12T00:22:06.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.061+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~U4PPJIIPMT6Y.1 size=174275 2024-09-12T00:22:06.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.065+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=U4PPJIIPMT6Y tag=AI6705YGWL4I type=write size=2271427 2024-09-12T00:22:06.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.069+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=DBK3IMDNIGVB type=del size=3366531 2024-09-12T00:22:06.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.073+0000 7fd6489978c0 1 < completed write operation key=N4S6I47NSJK6 tag=U5108C24BGN2 type=write size=695206 2024-09-12T00:22:06.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.077+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=BYV30YBRFU6S type=del size=3151390 2024-09-12T00:22:06.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.085+0000 7fd6489978c0 1 < suggested remove operation key=GVPNH3JSO07D tag=GKKME9QSN084 type=del 2024-09-12T00:22:06.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.089+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=HXA2OG7C0W9P type=del size=826274 2024-09-12T00:22:06.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.093+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=1USHZKAF31ZN type=del 2024-09-12T00:22:06.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.097+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=06MM9QEY8FAL type=del size=3438755 2024-09-12T00:22:06.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.101+0000 7fd6489978c0 1 < completed delete operation key=3JZP8TZFEIMH tag=VZIUTY78NYSL type=del 2024-09-12T00:22:06.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.105+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=JDPBSIAO09O7 type=del size=513661 2024-09-12T00:22:06.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.109+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~2AELYU8YRL7E.0 size=1048576 2024-09-12T00:22:06.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.113+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~2AELYU8YRL7E.1 size=394667 2024-09-12T00:22:06.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.117+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=2AELYU8YRL7E tag=QP5VI2IEWZB9 type=write size=2491819 2024-09-12T00:22:06.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.121+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=STPOMUD8QH3N type=del size=1817134 2024-09-12T00:22:06.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.129+0000 7fd6489978c0 1 < suggested remove operation key=8JCL0F406L7I tag=3LC6AA7H1KDD type=del 2024-09-12T00:22:06.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.133+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=MWYQ9EW9YK7K type=del size=3607539 2024-09-12T00:22:06.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.137+0000 7fd6489978c0 1 < completed delete operation key=B2BW7GQ6UN9I tag=XKW40YRCZKF6 type=del 2024-09-12T00:22:06.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.137+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=95HKGBRBZTPG type=del size=1750697 2024-09-12T00:22:06.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.141+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~FF2J7M8PET59.0 size=166993 2024-09-12T00:22:06.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.149+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=FF2J7M8PET59 tag=2E9A3YI2ZR64 type=write size=1215569 2024-09-12T00:22:06.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.153+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=ATZ56X0B60WU type=write size=514628 2024-09-12T00:22:06.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.157+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~XH6RSINB79HH.0 size=1048576 2024-09-12T00:22:06.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.157+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~XH6RSINB79HH.1 size=926933 2024-09-12T00:22:06.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.165+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=XH6RSINB79HH tag=1KNFXN5C8GVN type=write size=3024085 2024-09-12T00:22:06.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.173+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~6DA250REW94K.0 size=1048576 2024-09-12T00:22:06.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.177+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~6DA250REW94K.1 size=1048576 2024-09-12T00:22:06.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.177+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~6DA250REW94K.2 size=602196 2024-09-12T00:22:06.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.177+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=6DA250REW94K tag=CA3CBFGOKYH6 type=write size=3747924 2024-09-12T00:22:06.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.181+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=CAE041GKTI98 type=del 2024-09-12T00:22:06.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.189+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~MBAUDV93VLGG.0 size=202882 2024-09-12T00:22:06.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.189+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=MBAUDV93VLGG tag=ZW2SP5FNKTCW type=write size=1251458 2024-09-12T00:22:06.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.193+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=WZ6A6EFD6LPU type=del 2024-09-12T00:22:06.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.201+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~61URC50QB36M.0 size=978153 2024-09-12T00:22:06.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.201+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=61URC50QB36M tag=C9C1V857HBHX type=write size=2026729 2024-09-12T00:22:06.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.205+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~FE4U1SS9FGQE.0 size=1048576 2024-09-12T00:22:06.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.209+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~FE4U1SS9FGQE.1 size=130263 2024-09-12T00:22:06.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.213+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=FE4U1SS9FGQE tag=X8VFO0LKHWIY type=write size=2227415 2024-09-12T00:22:06.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.217+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=L4LSK9ANJ703 type=del size=1844222 2024-09-12T00:22:06.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.221+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~OZ8NP8YFAD93.0 size=710400 2024-09-12T00:22:06.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.225+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=OZ8NP8YFAD93 tag=V5A3BD21B316 type=write size=1758976 2024-09-12T00:22:06.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.229+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=S9UTZ3WHQBHA type=del size=182658 2024-09-12T00:22:06.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.233+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~J5N9Q9WQWW04.0 size=1048576 2024-09-12T00:22:06.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.233+0000 7fd6489978c0 1 < canceled part key=_multipart_8FBXDX6GELE7.2~J5N9Q9WQWW04.1 size=1048576 2024-09-12T00:22:06.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.237+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~J5N9Q9WQWW04.2 size=494922 2024-09-12T00:22:06.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.245+0000 7fd6489978c0 1 < canceled multipart upload key=8FBXDX6GELE7 upload=J5N9Q9WQWW04 tag=VDMBSHGRJAPR type=write size=3640650 2024-09-12T00:22:06.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.249+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~JXXQ62LPGDO5.0 size=1048576 2024-09-12T00:22:06.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.253+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~JXXQ62LPGDO5.1 size=144852 2024-09-12T00:22:06.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.253+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=JXXQ62LPGDO5 tag=6F2QUD6J88MW type=write size=2242004 2024-09-12T00:22:06.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.257+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~UFZ8SOHJ4LGN.0 size=1048576 2024-09-12T00:22:06.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.261+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~UFZ8SOHJ4LGN.1 size=1048576 2024-09-12T00:22:06.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.265+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~UFZ8SOHJ4LGN.2 size=1030722 2024-09-12T00:22:06.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.269+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=UFZ8SOHJ4LGN tag=8NTJRXVH5JXH type=write size=4176450 2024-09-12T00:22:06.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.273+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=FRT321E4DMC4 type=del size=1412375 2024-09-12T00:22:06.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.277+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=DBK3IMDNIGVB type=del 2024-09-12T00:22:06.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.285+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~63CN24SH0NMO.0 size=1048576 2024-09-12T00:22:06.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.285+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~63CN24SH0NMO.1 size=615643 2024-09-12T00:22:06.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.285+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=63CN24SH0NMO tag=N30NUGZYNY63 type=write size=2712795 2024-09-12T00:22:06.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.293+0000 7fd6489978c0 1 < suggested remove operation key=K9FD1L86Q05B tag=BYV30YBRFU6S type=del 2024-09-12T00:22:06.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.301+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~C1TS23SY3NG2.0 size=1048576 2024-09-12T00:22:06.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.305+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~C1TS23SY3NG2.1 size=1048576 2024-09-12T00:22:06.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.305+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~C1TS23SY3NG2.2 size=71327 2024-09-12T00:22:06.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.305+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=C1TS23SY3NG2 tag=AF8DY2C3W11M type=write size=3217055 2024-09-12T00:22:06.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.309+0000 7fd6489978c0 1 < completed delete operation key=LZICTA4BWOW8 tag=HXA2OG7C0W9P type=del 2024-09-12T00:22:06.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.313+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=P3VAH43MMFF9 type=del size=2289972 2024-09-12T00:22:06.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.321+0000 7fd6489978c0 1 < suggested remove operation key=J5IW4G9C72DH tag=06MM9QEY8FAL type=del 2024-09-12T00:22:06.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.325+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=0C89LMVXPYCF type=del size=433071 2024-09-12T00:22:06.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.329+0000 7fd6489978c0 1 < completed delete operation key=RGE8T6BTHBWK tag=JDPBSIAO09O7 type=del 2024-09-12T00:22:06.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.333+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=760XX5D5M5NM type=del size=2639860 2024-09-12T00:22:06.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.337+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=STPOMUD8QH3N type=del 2024-09-12T00:22:06.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.341+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=LCQU0CX3MEA7 type=del size=834314 2024-09-12T00:22:06.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.345+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=MWYQ9EW9YK7K type=del 2024-09-12T00:22:06.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.353+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~OJ2DX54T5M03.0 size=1048576 2024-09-12T00:22:06.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.361+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~OJ2DX54T5M03.1 size=1048576 2024-09-12T00:22:06.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.365+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~OJ2DX54T5M03.2 size=418795 2024-09-12T00:22:06.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.365+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=OJ2DX54T5M03 tag=JKCCBNNGY7KX type=write size=3564523 2024-09-12T00:22:06.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.369+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=95HKGBRBZTPG type=del 2024-09-12T00:22:06.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.377+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~JLC0CX6IL3EI.0 size=1048576 2024-09-12T00:22:06.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.381+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~JLC0CX6IL3EI.1 size=1048576 2024-09-12T00:22:06.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.381+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~JLC0CX6IL3EI.2 size=744661 2024-09-12T00:22:06.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.381+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=JLC0CX6IL3EI tag=HO6DTGHWEECM type=write size=3890389 2024-09-12T00:22:06.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.385+0000 7fd6489978c0 1 < completed write operation key=M9YKGQ2GA5CO tag=ATZ56X0B60WU type=write size=514628 2024-09-12T00:22:06.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.393+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~IIYVLM1SFSII.0 size=1048576 2024-09-12T00:22:06.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.393+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~IIYVLM1SFSII.1 size=1048576 2024-09-12T00:22:06.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.397+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~IIYVLM1SFSII.2 size=917979 2024-09-12T00:22:06.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.397+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=IIYVLM1SFSII tag=AKSZL90822WR type=write size=4063707 2024-09-12T00:22:06.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.401+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~6DA250REW94K.0 size=1048576 2024-09-12T00:22:06.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.405+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~6DA250REW94K.1 size=1048576 2024-09-12T00:22:06.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.405+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~6DA250REW94K.2 size=602196 2024-09-12T00:22:06.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.413+0000 7fd6489978c0 1 < completed multipart upload key=GVPNH3JSO07D upload=6DA250REW94K tag=CA3CBFGOKYH6 type=write size=3747924 2024-09-12T00:22:06.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.417+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~7LCF7UM095ZU.0 size=1048576 2024-09-12T00:22:06.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.421+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~7LCF7UM095ZU.1 size=677511 2024-09-12T00:22:06.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.421+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=7LCF7UM095ZU tag=DFYN5UOPKB1L type=write size=2774663 2024-09-12T00:22:06.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.425+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~MBAUDV93VLGG.0 size=202882 2024-09-12T00:22:06.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.429+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=MBAUDV93VLGG tag=ZW2SP5FNKTCW type=write size=1251458 2024-09-12T00:22:06.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.437+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~PUGW69YT8YY8.0 size=944734 2024-09-12T00:22:06.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.437+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=PUGW69YT8YY8 tag=X58PF6NX7EIO type=write size=1993310 2024-09-12T00:22:06.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.441+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~61URC50QB36M.0 size=978153 2024-09-12T00:22:06.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.449+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=61URC50QB36M tag=C9C1V857HBHX type=write size=2026729 2024-09-12T00:22:06.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.453+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~NVTRQI02HW59.0 size=1048576 2024-09-12T00:22:06.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.457+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~NVTRQI02HW59.1 size=1048576 2024-09-12T00:22:06.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.461+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~NVTRQI02HW59.2 size=845072 2024-09-12T00:22:06.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.461+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=NVTRQI02HW59 tag=YO9A1X7E8G9S type=write size=3990800 2024-09-12T00:22:06.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.465+0000 7fd6489978c0 -1 < failed to complete operation key=K9FD1L86Q05B tag=L4LSK9ANJ703 type=del size=1844222: (22) Invalid argument 2024-09-12T00:22:06.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.469+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~23A13QC4EWXZ.0 size=1048576 2024-09-12T00:22:06.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.473+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~23A13QC4EWXZ.1 size=1048576 2024-09-12T00:22:06.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.477+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~23A13QC4EWXZ.2 size=312653 2024-09-12T00:22:06.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.477+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=23A13QC4EWXZ tag=WG7P004J6ER7 type=write size=3458381 2024-09-12T00:22:06.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.481+0000 7fd6489978c0 1 < canceled operation key=DAOTTEMK2P2T tag=S9UTZ3WHQBHA type=del size=182658 2024-09-12T00:22:06.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.485+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=ZSXZ9LV0TFJI type=del size=765593 2024-09-12T00:22:06.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.489+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~JXXQ62LPGDO5.0 size=1048576 2024-09-12T00:22:06.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.489+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~JXXQ62LPGDO5.1 size=144852 2024-09-12T00:22:06.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.497+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=JXXQ62LPGDO5 tag=6F2QUD6J88MW type=write size=2242004 2024-09-12T00:22:06.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.501+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=EENYP86KW6ID type=write size=977780 2024-09-12T00:22:06.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.505+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=FRT321E4DMC4 type=del 2024-09-12T00:22:06.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.509+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=SSQWF1SV4RU4 type=del size=856652 2024-09-12T00:22:06.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.513+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~63CN24SH0NMO.0 size=1048576 2024-09-12T00:22:06.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.517+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~63CN24SH0NMO.1 size=615643 2024-09-12T00:22:06.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.525+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=63CN24SH0NMO tag=N30NUGZYNY63 type=write size=2712795 2024-09-12T00:22:06.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.529+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=ENQC8SVLTE46 type=del size=3793384 2024-09-12T00:22:06.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.533+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~C1TS23SY3NG2.0 size=1048576 2024-09-12T00:22:06.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.537+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~C1TS23SY3NG2.1 size=1048576 2024-09-12T00:22:06.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.541+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~C1TS23SY3NG2.2 size=71327 2024-09-12T00:22:06.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.545+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=C1TS23SY3NG2 tag=AF8DY2C3W11M type=write size=3217055 2024-09-12T00:22:06.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.549+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=4A8IGAIWLS4C type=del size=1168353 2024-09-12T00:22:06.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.553+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=P3VAH43MMFF9 type=del 2024-09-12T00:22:06.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.561+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~12E05CSMWUNS.0 size=1048576 2024-09-12T00:22:06.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.565+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~12E05CSMWUNS.1 size=1048576 2024-09-12T00:22:06.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.565+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~12E05CSMWUNS.2 size=299789 2024-09-12T00:22:06.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.565+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=12E05CSMWUNS tag=JVXBV6VLF2UC type=write size=3445517 2024-09-12T00:22:06.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.569+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=0C89LMVXPYCF type=del 2024-09-12T00:22:06.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.573+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=ETNO086FEKH0 type=del size=273939 2024-09-12T00:22:06.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.577+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=760XX5D5M5NM type=del 2024-09-12T00:22:06.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.585+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~GY4EXH4PQS9T.0 size=384517 2024-09-12T00:22:06.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.585+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=GY4EXH4PQS9T tag=X8EUO21RNS8U type=write size=1433093 2024-09-12T00:22:06.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.589+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=LCQU0CX3MEA7 type=del 2024-09-12T00:22:06.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.597+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~VEMKYE7I815H.0 size=1048576 2024-09-12T00:22:06.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.601+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~VEMKYE7I815H.1 size=986844 2024-09-12T00:22:06.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.601+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=VEMKYE7I815H tag=94IW32VQ0P6X type=write size=3083996 2024-09-12T00:22:06.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.605+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~OJ2DX54T5M03.0 size=1048576 2024-09-12T00:22:06.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.605+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~OJ2DX54T5M03.1 size=1048576 2024-09-12T00:22:06.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.609+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~OJ2DX54T5M03.2 size=418795 2024-09-12T00:22:06.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.617+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=OJ2DX54T5M03 tag=JKCCBNNGY7KX type=write size=3564523 2024-09-12T00:22:06.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.621+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=GK9JNNASG1B0 type=del size=1893901 2024-09-12T00:22:06.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.625+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~JLC0CX6IL3EI.0 size=1048576 2024-09-12T00:22:06.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.625+0000 7fd6489978c0 1 < canceled part key=_multipart_K9FD1L86Q05B.2~JLC0CX6IL3EI.1 size=1048576 2024-09-12T00:22:06.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.629+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~JLC0CX6IL3EI.2 size=744661 2024-09-12T00:22:06.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.633+0000 7fd6489978c0 1 < canceled multipart upload key=K9FD1L86Q05B upload=JLC0CX6IL3EI tag=HO6DTGHWEECM type=write size=3890389 2024-09-12T00:22:06.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.641+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~3FI7CPP9LIG3.0 size=1048576 2024-09-12T00:22:06.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.645+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~3FI7CPP9LIG3.1 size=1048576 2024-09-12T00:22:06.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.649+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~3FI7CPP9LIG3.2 size=604694 2024-09-12T00:22:06.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.649+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=3FI7CPP9LIG3 tag=1NITSU9Q13PH type=write size=3750422 2024-09-12T00:22:06.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.649+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~IIYVLM1SFSII.0 size=1048576 2024-09-12T00:22:06.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.653+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~IIYVLM1SFSII.1 size=1048576 2024-09-12T00:22:06.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.653+0000 7fd6489978c0 1 < canceled part key=_multipart_8FBXDX6GELE7.2~IIYVLM1SFSII.2 size=917979 2024-09-12T00:22:06.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.661+0000 7fd6489978c0 1 < canceled multipart upload key=8FBXDX6GELE7 upload=IIYVLM1SFSII tag=AKSZL90822WR type=write size=4063707 2024-09-12T00:22:06.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.665+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=MNJF9EQLHNRJ type=del size=2563273 2024-09-12T00:22:06.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.669+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~7LCF7UM095ZU.0 size=1048576 2024-09-12T00:22:06.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.669+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~7LCF7UM095ZU.1 size=677511 2024-09-12T00:22:06.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.677+0000 7fd6489978c0 1 < completed multipart upload key=G4EUTQOHAT2E upload=7LCF7UM095ZU tag=DFYN5UOPKB1L type=write size=2774663 2024-09-12T00:22:06.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.681+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=U3PYICB0AZIJ type=del size=1418073 2024-09-12T00:22:06.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.685+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~PUGW69YT8YY8.0 size=944734 2024-09-12T00:22:06.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.689+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=PUGW69YT8YY8 tag=X58PF6NX7EIO type=write size=1993310 2024-09-12T00:22:06.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.693+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=0CEI42GKFVBG type=del size=3321078 2024-09-12T00:22:06.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.697+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~NVTRQI02HW59.0 size=1048576 2024-09-12T00:22:06.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.705+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~NVTRQI02HW59.1 size=1048576 2024-09-12T00:22:06.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.709+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~NVTRQI02HW59.2 size=845072 2024-09-12T00:22:06.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.713+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=NVTRQI02HW59 tag=YO9A1X7E8G9S type=write size=3990800 2024-09-12T00:22:06.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.717+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=F96OBTXGTKT5 type=write size=141502 2024-09-12T00:22:06.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.721+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~23A13QC4EWXZ.0 size=1048576 2024-09-12T00:22:06.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.725+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~23A13QC4EWXZ.1 size=1048576 2024-09-12T00:22:06.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.725+0000 7fd6489978c0 1 < canceled part key=_multipart_N4S6I47NSJK6.2~23A13QC4EWXZ.2 size=312653 2024-09-12T00:22:06.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.729+0000 7fd6489978c0 1 < canceled multipart upload key=N4S6I47NSJK6 upload=23A13QC4EWXZ tag=WG7P004J6ER7 type=write size=3458381 2024-09-12T00:22:06.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.737+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=58UQDGM566RY type=del size=637278 2024-09-12T00:22:06.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.737+0000 7fd6489978c0 1 < completed delete operation key=8FBXDX6GELE7 tag=ZSXZ9LV0TFJI type=del 2024-09-12T00:22:06.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.745+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~REXV2WRQ7TU2.0 size=1048576 2024-09-12T00:22:06.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.749+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~REXV2WRQ7TU2.1 size=141506 2024-09-12T00:22:06.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.749+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=REXV2WRQ7TU2 tag=U0RHSR4EHE17 type=write size=2238658 2024-09-12T00:22:06.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.753+0000 7fd6489978c0 1 < canceled operation key=YJJBTNI318EH tag=EENYP86KW6ID type=write size=977780 2024-09-12T00:22:06.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.761+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~KIFT6WN45QMB.0 size=525828 2024-09-12T00:22:06.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.761+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=KIFT6WN45QMB tag=X76UMF44VKQ8 type=write size=1574404 2024-09-12T00:22:06.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.765+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=SSQWF1SV4RU4 type=del 2024-09-12T00:22:06.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.769+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=QD693KVF0VNN type=del size=2027550 2024-09-12T00:22:06.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.769+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=ENQC8SVLTE46 type=del 2024-09-12T00:22:06.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.773+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=BOAZ9V96AEDG type=write size=153437 2024-09-12T00:22:06.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.777+0000 7fd6489978c0 1 < completed delete operation key=B2BW7GQ6UN9I tag=4A8IGAIWLS4C type=del 2024-09-12T00:22:06.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.781+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=2TKGJ6M6WG4F type=del size=2857281 2024-09-12T00:22:06.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.781+0000 7fd6489978c0 1 < canceled part key=_multipart_YJJBTNI318EH.2~12E05CSMWUNS.0 size=1048576 2024-09-12T00:22:06.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.785+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~12E05CSMWUNS.1 size=1048576 2024-09-12T00:22:06.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.785+0000 7fd6489978c0 1 < canceled part key=_multipart_YJJBTNI318EH.2~12E05CSMWUNS.2 size=299789 2024-09-12T00:22:06.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.793+0000 7fd6489978c0 1 < canceled multipart upload key=YJJBTNI318EH upload=12E05CSMWUNS tag=JVXBV6VLF2UC type=write size=3445517 2024-09-12T00:22:06.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.797+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=Z0WP03QYEOPE type=write size=630781 2024-09-12T00:22:06.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.801+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=ETNO086FEKH0 type=del 2024-09-12T00:22:06.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.801+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=KY88AAVCKN0E type=write size=174350 2024-09-12T00:22:06.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.809+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~GY4EXH4PQS9T.0 size=384517 2024-09-12T00:22:06.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.813+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=GY4EXH4PQS9T tag=X8EUO21RNS8U type=write size=1433093 2024-09-12T00:22:06.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.821+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~WFXU58LWO9CG.0 size=907100 2024-09-12T00:22:06.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.821+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=WFXU58LWO9CG tag=C2HIY61VM8RD type=write size=1955676 2024-09-12T00:22:06.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.825+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~VEMKYE7I815H.0 size=1048576 2024-09-12T00:22:06.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.829+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~VEMKYE7I815H.1 size=986844 2024-09-12T00:22:06.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.833+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=VEMKYE7I815H tag=94IW32VQ0P6X type=write size=3083996 2024-09-12T00:22:06.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.837+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=XQNV97D12XZK type=del size=741258 2024-09-12T00:22:06.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.841+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=GK9JNNASG1B0 type=del 2024-09-12T00:22:06.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.849+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~GS9WLOKJYNS6.0 size=1048576 2024-09-12T00:22:06.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.853+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~GS9WLOKJYNS6.1 size=1048576 2024-09-12T00:22:06.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.853+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~GS9WLOKJYNS6.2 size=748154 2024-09-12T00:22:06.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.853+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=GS9WLOKJYNS6 tag=0L3II0QF2IMN type=write size=3893882 2024-09-12T00:22:06.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.857+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~3FI7CPP9LIG3.0 size=1048576 2024-09-12T00:22:06.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.861+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~3FI7CPP9LIG3.1 size=1048576 2024-09-12T00:22:06.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.865+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~3FI7CPP9LIG3.2 size=604694 2024-09-12T00:22:06.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.869+0000 7fd6489978c0 1 < completed multipart upload key=CFID1EVBXOVJ upload=3FI7CPP9LIG3 tag=1NITSU9Q13PH type=write size=3750422 2024-09-12T00:22:06.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.873+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=HW741C197K7U type=del size=2913680 2024-09-12T00:22:06.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.877+0000 7fd6489978c0 1 < completed delete operation key=JPVKBVRCZTE9 tag=MNJF9EQLHNRJ type=del 2024-09-12T00:22:06.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.885+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~RNNFAYZI1B0W.0 size=1048576 2024-09-12T00:22:06.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.889+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~RNNFAYZI1B0W.1 size=1048576 2024-09-12T00:22:06.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.889+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~RNNFAYZI1B0W.2 size=121230 2024-09-12T00:22:06.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.889+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=RNNFAYZI1B0W tag=E2SA2B0QW0GO type=write size=3266958 2024-09-12T00:22:06.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.897+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=U3PYICB0AZIJ type=del 2024-09-12T00:22:06.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.901+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=95T3RVO0OID7 type=write size=759803 2024-09-12T00:22:06.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.905+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=0CEI42GKFVBG type=del 2024-09-12T00:22:06.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.913+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~C6DFQMJS1GGJ.0 size=1048576 2024-09-12T00:22:06.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.913+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~C6DFQMJS1GGJ.1 size=1048576 2024-09-12T00:22:06.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.917+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~C6DFQMJS1GGJ.2 size=74568 2024-09-12T00:22:06.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.917+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=C6DFQMJS1GGJ tag=I016VEYU69BU type=write size=3220296 2024-09-12T00:22:06.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.921+0000 7fd6489978c0 1 < completed write operation key=G4EUTQOHAT2E tag=F96OBTXGTKT5 type=write size=141502 2024-09-12T00:22:06.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.925+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=K9MNGLUOREHB type=del size=2362361 2024-09-12T00:22:06.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.929+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=58UQDGM566RY type=del 2024-09-12T00:22:06.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.933+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~D7P7V29SU38O.0 size=1048576 2024-09-12T00:22:06.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.937+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~D7P7V29SU38O.1 size=1048576 2024-09-12T00:22:06.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.941+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~D7P7V29SU38O.2 size=1010717 2024-09-12T00:22:06.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.941+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=D7P7V29SU38O tag=JU90LD6BJCOW type=write size=4156445 2024-09-12T00:22:06.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.945+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~REXV2WRQ7TU2.0 size=1048576 2024-09-12T00:22:06.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.945+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~REXV2WRQ7TU2.1 size=141506 2024-09-12T00:22:06.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.953+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=REXV2WRQ7TU2 tag=U0RHSR4EHE17 type=write size=2238658 2024-09-12T00:22:06.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.961+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~6H0I51OVFWNI.0 size=876971 2024-09-12T00:22:06.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.961+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=6H0I51OVFWNI tag=NVKGH639HJQK type=write size=1925547 2024-09-12T00:22:06.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.965+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~KIFT6WN45QMB.0 size=525828 2024-09-12T00:22:06.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.969+0000 7fd6489978c0 1 < completed multipart upload key=G4EUTQOHAT2E upload=KIFT6WN45QMB tag=X76UMF44VKQ8 type=write size=1574404 2024-09-12T00:22:06.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.977+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~XG4ZOZVTFKPM.0 size=488381 2024-09-12T00:22:06.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.977+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=XG4ZOZVTFKPM tag=ROV4AR6FD9HO type=write size=1536957 2024-09-12T00:22:06.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.981+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=QD693KVF0VNN type=del 2024-09-12T00:22:06.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.985+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=0IMWHWDZULA0 type=del size=2476633 2024-09-12T00:22:06.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.989+0000 7fd6489978c0 1 < completed write operation key=YSPRZ87DZ2OD tag=BOAZ9V96AEDG type=write size=153437 2024-09-12T00:22:06.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.989+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=P8G4G0IN4G2R type=del size=2368309 2024-09-12T00:22:06.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.993+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=2TKGJ6M6WG4F type=del 2024-09-12T00:22:06.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:06.997+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=RAO0NCYKG4DY type=del size=53509 2024-09-12T00:22:07.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.001+0000 7fd6489978c0 1 < completed write operation key=YJJBTNI318EH tag=Z0WP03QYEOPE type=write size=630781 2024-09-12T00:22:07.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.005+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=5FID4ER06ORG type=del size=3917575 2024-09-12T00:22:07.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.009+0000 7fd6489978c0 1 < completed write operation key=M9YKGQ2GA5CO tag=KY88AAVCKN0E type=write size=174350 2024-09-12T00:22:07.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.013+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=Q0ONW9V2B1RP type=del size=1731057 2024-09-12T00:22:07.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.017+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~WFXU58LWO9CG.0 size=907100 2024-09-12T00:22:07.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.025+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=WFXU58LWO9CG tag=C2HIY61VM8RD type=write size=1955676 2024-09-12T00:22:07.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.029+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~OAG63JEYIK09.0 size=22847 2024-09-12T00:22:07.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.029+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=OAG63JEYIK09 tag=NKVFW7DUQ22H type=write size=1071423 2024-09-12T00:22:07.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.033+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=XQNV97D12XZK type=del 2024-09-12T00:22:07.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.037+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=PK6EF8R9RMHW type=write size=316082 2024-09-12T00:22:07.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.041+0000 7fd6489978c0 1 < canceled part key=_multipart_N4S6I47NSJK6.2~GS9WLOKJYNS6.0 size=1048576 2024-09-12T00:22:07.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.041+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~GS9WLOKJYNS6.1 size=1048576 2024-09-12T00:22:07.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.045+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~GS9WLOKJYNS6.2 size=748154 2024-09-12T00:22:07.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.057+0000 7fd6489978c0 1 < canceled multipart upload key=N4S6I47NSJK6 upload=GS9WLOKJYNS6 tag=0L3II0QF2IMN type=write size=3893882 2024-09-12T00:22:07.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.061+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~79N5L985MOF0.0 size=1048576 2024-09-12T00:22:07.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.065+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~79N5L985MOF0.1 size=646457 2024-09-12T00:22:07.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.065+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=79N5L985MOF0 tag=3X562ZV5DROZ type=write size=2743609 2024-09-12T00:22:07.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.069+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=HW741C197K7U type=del 2024-09-12T00:22:07.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.073+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=LFX5JNB7Y634 type=del size=4132205 2024-09-12T00:22:07.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.073+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~RNNFAYZI1B0W.0 size=1048576 2024-09-12T00:22:07.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.077+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~RNNFAYZI1B0W.1 size=1048576 2024-09-12T00:22:07.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.077+0000 7fd6489978c0 1 < canceled part key=_multipart_3JZP8TZFEIMH.2~RNNFAYZI1B0W.2 size=121230 2024-09-12T00:22:07.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.081+0000 7fd6489978c0 1 < canceled multipart upload key=3JZP8TZFEIMH upload=RNNFAYZI1B0W tag=E2SA2B0QW0GO type=write size=3266958 2024-09-12T00:22:07.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.089+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~17PFCRQXNONY.0 size=1048576 2024-09-12T00:22:07.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.089+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~17PFCRQXNONY.1 size=176556 2024-09-12T00:22:07.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.089+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=17PFCRQXNONY tag=TVG1A8WOVBW8 type=write size=2273708 2024-09-12T00:22:07.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.097+0000 7fd6489978c0 1 < suggested update operation key=YSPRZ87DZ2OD tag=95T3RVO0OID7 type=write size=759803 2024-09-12T00:22:07.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.101+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=31L269D3SLBZ type=write size=502086 2024-09-12T00:22:07.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.105+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~C6DFQMJS1GGJ.0 size=1048576 2024-09-12T00:22:07.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.109+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~C6DFQMJS1GGJ.1 size=1048576 2024-09-12T00:22:07.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.113+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~C6DFQMJS1GGJ.2 size=74568 2024-09-12T00:22:07.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.117+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=C6DFQMJS1GGJ tag=I016VEYU69BU type=write size=3220296 2024-09-12T00:22:07.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.121+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=0VQ77YOWTU1P type=write size=274120 2024-09-12T00:22:07.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.129+0000 7fd6489978c0 1 < suggested remove operation key=25P4P2I6BE3H tag=K9MNGLUOREHB type=del 2024-09-12T00:22:07.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.133+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~WLLSTTCLPGHE.0 size=1048576 2024-09-12T00:22:07.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.137+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~WLLSTTCLPGHE.1 size=1048576 2024-09-12T00:22:07.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.141+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~WLLSTTCLPGHE.2 size=977264 2024-09-12T00:22:07.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.141+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=WLLSTTCLPGHE tag=WGL9NQM98EQD type=write size=4122992 2024-09-12T00:22:07.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.145+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~D7P7V29SU38O.0 size=1048576 2024-09-12T00:22:07.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.149+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~D7P7V29SU38O.1 size=1048576 2024-09-12T00:22:07.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.153+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~D7P7V29SU38O.2 size=1010717 2024-09-12T00:22:07.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.157+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=D7P7V29SU38O tag=JU90LD6BJCOW type=write size=4156445 2024-09-12T00:22:07.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.161+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=X9UOVDI24MIX type=write size=29707 2024-09-12T00:22:07.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.165+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~6H0I51OVFWNI.0 size=876971 2024-09-12T00:22:07.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.173+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=6H0I51OVFWNI tag=NVKGH639HJQK type=write size=1925547 2024-09-12T00:22:07.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.177+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=WS93XS3C24RO type=del size=2477662 2024-09-12T00:22:07.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.177+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~XG4ZOZVTFKPM.0 size=488381 2024-09-12T00:22:07.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.185+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=XG4ZOZVTFKPM tag=ROV4AR6FD9HO type=write size=1536957 2024-09-12T00:22:07.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.193+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~TSS8ORE3QIUX.0 size=967435 2024-09-12T00:22:07.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.193+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=TSS8ORE3QIUX tag=3AG9D0VIL8BL type=write size=2016011 2024-09-12T00:22:07.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.193+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=0IMWHWDZULA0 type=del 2024-09-12T00:22:07.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.201+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~YYUBGSA3CHJG.0 size=1048576 2024-09-12T00:22:07.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.205+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~YYUBGSA3CHJG.1 size=1048576 2024-09-12T00:22:07.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.209+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~YYUBGSA3CHJG.2 size=235331 2024-09-12T00:22:07.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.209+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=YYUBGSA3CHJG tag=OCBKGRJDDYW9 type=write size=3381059 2024-09-12T00:22:07.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.213+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=P8G4G0IN4G2R type=del 2024-09-12T00:22:07.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.217+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~XJRC8PVFNEN0.0 size=1048576 2024-09-12T00:22:07.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.221+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~XJRC8PVFNEN0.1 size=768774 2024-09-12T00:22:07.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.221+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=XJRC8PVFNEN0 tag=LRWT7OQ3581Z type=write size=2865926 2024-09-12T00:22:07.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.225+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=RAO0NCYKG4DY type=del 2024-09-12T00:22:07.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.233+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~OYKDAD09MKJW.0 size=1048576 2024-09-12T00:22:07.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.233+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~OYKDAD09MKJW.1 size=945348 2024-09-12T00:22:07.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.233+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=OYKDAD09MKJW tag=9824Q6HR769J type=write size=3042500 2024-09-12T00:22:07.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.241+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=5FID4ER06ORG type=del 2024-09-12T00:22:07.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.245+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=09TKCO27I655 type=del size=178133 2024-09-12T00:22:07.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.249+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=Q0ONW9V2B1RP type=del 2024-09-12T00:22:07.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.257+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~7862WEQ5O0B2.0 size=456379 2024-09-12T00:22:07.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.257+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=7862WEQ5O0B2 tag=13Y3U6RYDD45 type=write size=1504955 2024-09-12T00:22:07.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.261+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~OAG63JEYIK09.0 size=22847 2024-09-12T00:22:07.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.269+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=OAG63JEYIK09 tag=NKVFW7DUQ22H type=write size=1071423 2024-09-12T00:22:07.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.273+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=H19NFTXFR9RQ type=write size=994925 2024-09-12T00:22:07.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.277+0000 7fd6489978c0 1 < completed write operation key=GVPNH3JSO07D tag=PK6EF8R9RMHW type=write size=316082 2024-09-12T00:22:07.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.285+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~X8ERUFHCX1AU.0 size=1011280 2024-09-12T00:22:07.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.285+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=X8ERUFHCX1AU tag=5Q4VKMO5A2ES type=write size=2059856 2024-09-12T00:22:07.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.289+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~79N5L985MOF0.0 size=1048576 2024-09-12T00:22:07.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.289+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~79N5L985MOF0.1 size=646457 2024-09-12T00:22:07.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.297+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=79N5L985MOF0 tag=3X562ZV5DROZ type=write size=2743609 2024-09-12T00:22:07.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.305+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~P8NESX67NROC.0 size=1048576 2024-09-12T00:22:07.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.305+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~P8NESX67NROC.1 size=466276 2024-09-12T00:22:07.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.305+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=P8NESX67NROC tag=TBSXFPCYZSXZ type=write size=2563428 2024-09-12T00:22:07.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.313+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=LFX5JNB7Y634 type=del 2024-09-12T00:22:07.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.317+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=QROGVZ1K3KUB type=write size=554375 2024-09-12T00:22:07.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.317+0000 7fd6489978c0 1 < canceled part key=_multipart_F2CTWM0T2698.2~17PFCRQXNONY.0 size=1048576 2024-09-12T00:22:07.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.321+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~17PFCRQXNONY.1 size=176556 2024-09-12T00:22:07.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.325+0000 7fd6489978c0 1 < canceled multipart upload key=F2CTWM0T2698 upload=17PFCRQXNONY tag=TVG1A8WOVBW8 type=write size=2273708 2024-09-12T00:22:07.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.333+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~DIV9DL1Z2NQ0.0 size=1048576 2024-09-12T00:22:07.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.337+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~DIV9DL1Z2NQ0.1 size=191598 2024-09-12T00:22:07.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.337+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=DIV9DL1Z2NQ0 tag=U00BKFMDHBI6 type=write size=2288750 2024-09-12T00:22:07.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.337+0000 7fd6489978c0 1 < completed write operation key=YSPRZ87DZ2OD tag=31L269D3SLBZ type=write size=502086 2024-09-12T00:22:07.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.341+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=BIE9R58LGEVO type=del size=619803 2024-09-12T00:22:07.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.345+0000 7fd6489978c0 1 < completed write operation key=ZXEIT45BWHXM tag=0VQ77YOWTU1P type=write size=274120 2024-09-12T00:22:07.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.353+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~G8HDIBN6QMI8.0 size=1048576 2024-09-12T00:22:07.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.357+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~G8HDIBN6QMI8.1 size=1048576 2024-09-12T00:22:07.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.357+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~G8HDIBN6QMI8.2 size=194128 2024-09-12T00:22:07.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.357+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=G8HDIBN6QMI8 tag=M280M78MMNC5 type=write size=3339856 2024-09-12T00:22:07.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.361+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~WLLSTTCLPGHE.0 size=1048576 2024-09-12T00:22:07.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.365+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~WLLSTTCLPGHE.1 size=1048576 2024-09-12T00:22:07.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.369+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~WLLSTTCLPGHE.2 size=977264 2024-09-12T00:22:07.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.373+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=WLLSTTCLPGHE tag=WGL9NQM98EQD type=write size=4122992 2024-09-12T00:22:07.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.377+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=ZU0OQDSTGB2Q type=del size=2809598 2024-09-12T00:22:07.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.381+0000 7fd6489978c0 1 < completed write operation key=QBS4N1KGR1JB tag=X9UOVDI24MIX type=write size=29707 2024-09-12T00:22:07.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.385+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=0NFJY6IOU8UB type=del size=1340955 2024-09-12T00:22:07.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.385+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=WS93XS3C24RO type=del 2024-09-12T00:22:07.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.397+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~UHUHTX1M1DAA.0 size=1048576 2024-09-12T00:22:07.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.401+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~UHUHTX1M1DAA.1 size=1009750 2024-09-12T00:22:07.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.401+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=UHUHTX1M1DAA tag=8BL7ZA5RKJTS type=write size=3106902 2024-09-12T00:22:07.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.405+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~TSS8ORE3QIUX.0 size=967435 2024-09-12T00:22:07.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.409+0000 7fd6489978c0 1 < completed multipart upload key=9ACGS2FIY7AF upload=TSS8ORE3QIUX tag=3AG9D0VIL8BL type=write size=2016011 2024-09-12T00:22:07.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.413+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=E6PKW5Y43NFP type=write size=161845 2024-09-12T00:22:07.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.417+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~YYUBGSA3CHJG.0 size=1048576 2024-09-12T00:22:07.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.417+0000 7fd6489978c0 1 < canceled part key=_multipart_RGE8T6BTHBWK.2~YYUBGSA3CHJG.1 size=1048576 2024-09-12T00:22:07.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.421+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~YYUBGSA3CHJG.2 size=235331 2024-09-12T00:22:07.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.425+0000 7fd6489978c0 1 < canceled multipart upload key=RGE8T6BTHBWK upload=YYUBGSA3CHJG tag=OCBKGRJDDYW9 type=write size=3381059 2024-09-12T00:22:07.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.429+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=CHB2U29Q37BS type=del size=1381995 2024-09-12T00:22:07.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.433+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~XJRC8PVFNEN0.0 size=1048576 2024-09-12T00:22:07.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.437+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~XJRC8PVFNEN0.1 size=768774 2024-09-12T00:22:07.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.445+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=XJRC8PVFNEN0 tag=LRWT7OQ3581Z type=write size=2865926 2024-09-12T00:22:07.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.449+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~LUMGOPLHMN55.0 size=663202 2024-09-12T00:22:07.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.449+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=LUMGOPLHMN55 tag=PYI1N12WWTJF type=write size=1711778 2024-09-12T00:22:07.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.453+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~OYKDAD09MKJW.0 size=1048576 2024-09-12T00:22:07.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.457+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~OYKDAD09MKJW.1 size=945348 2024-09-12T00:22:07.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.461+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=OYKDAD09MKJW tag=9824Q6HR769J type=write size=3042500 2024-09-12T00:22:07.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.465+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=C7D7RPIPSUM6 type=del size=840818 2024-09-12T00:22:07.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.469+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=09TKCO27I655 type=del 2024-09-12T00:22:07.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.473+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=803SVIDM26KS type=del size=243051 2024-09-12T00:22:07.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.473+0000 7fd6489978c0 1 < canceled part key=_multipart_ZXEIT45BWHXM.2~7862WEQ5O0B2.0 size=456379 2024-09-12T00:22:07.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.481+0000 7fd6489978c0 1 < canceled multipart upload key=ZXEIT45BWHXM upload=7862WEQ5O0B2 tag=13Y3U6RYDD45 type=write size=1504955 2024-09-12T00:22:07.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.481+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=7FPKP45ZLRG4 type=del size=2798304 2024-09-12T00:22:07.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.489+0000 7fd6489978c0 1 < suggested update operation key=G4EUTQOHAT2E tag=H19NFTXFR9RQ type=write size=994925 2024-09-12T00:22:07.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.493+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=AQZUM92PAO2G type=del size=195594 2024-09-12T00:22:07.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.497+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~X8ERUFHCX1AU.0 size=1011280 2024-09-12T00:22:07.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.501+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=X8ERUFHCX1AU tag=5Q4VKMO5A2ES type=write size=2059856 2024-09-12T00:22:07.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.505+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=YBORBEG4VNDX type=del size=3018051 2024-09-12T00:22:07.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.509+0000 7fd6489978c0 1 < canceled part key=_multipart_ZW51KHCLPYN3.2~P8NESX67NROC.0 size=1048576 2024-09-12T00:22:07.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.509+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~P8NESX67NROC.1 size=466276 2024-09-12T00:22:07.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.517+0000 7fd6489978c0 1 < canceled multipart upload key=ZW51KHCLPYN3 upload=P8NESX67NROC tag=TBSXFPCYZSXZ type=write size=2563428 2024-09-12T00:22:07.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.521+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=03JODK11LAWV type=write size=512179 2024-09-12T00:22:07.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.525+0000 7fd6489978c0 1 < completed write operation key=ZW51KHCLPYN3 tag=QROGVZ1K3KUB type=write size=554375 2024-09-12T00:22:07.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.529+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=LKJNUVDFFEM3 type=del size=3526245 2024-09-12T00:22:07.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.537+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~DIV9DL1Z2NQ0.0 size=1048576 2024-09-12T00:22:07.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.537+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~DIV9DL1Z2NQ0.1 size=191598 2024-09-12T00:22:07.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.541+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=DIV9DL1Z2NQ0 tag=U00BKFMDHBI6 type=write size=2288750 2024-09-12T00:22:07.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.549+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~X492J7NGJNG9.0 size=419284 2024-09-12T00:22:07.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.549+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=X492J7NGJNG9 tag=X0NYTJP9ZJCA type=write size=1467860 2024-09-12T00:22:07.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.553+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=BIE9R58LGEVO type=del 2024-09-12T00:22:07.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.557+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=ZBS3C1TZIF3W type=del size=3882736 2024-09-12T00:22:07.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.561+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~G8HDIBN6QMI8.0 size=1048576 2024-09-12T00:22:07.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.565+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~G8HDIBN6QMI8.1 size=1048576 2024-09-12T00:22:07.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.565+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~G8HDIBN6QMI8.2 size=194128 2024-09-12T00:22:07.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.573+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=G8HDIBN6QMI8 tag=M280M78MMNC5 type=write size=3339856 2024-09-12T00:22:07.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.577+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=84MZU4ZJ7L0K type=write size=409250 2024-09-12T00:22:07.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.581+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=ZU0OQDSTGB2Q type=del 2024-09-12T00:22:07.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.585+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=U8E4BWDM9D60 type=write size=261632 2024-09-12T00:22:07.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.589+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=0NFJY6IOU8UB type=del 2024-09-12T00:22:07.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.593+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=2K9083XTCRLN type=del size=1798598 2024-09-12T00:22:07.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.593+0000 7fd6489978c0 1 < canceled part key=_multipart_HUKWLE56FRX2.2~UHUHTX1M1DAA.0 size=1048576 2024-09-12T00:22:07.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.597+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~UHUHTX1M1DAA.1 size=1009750 2024-09-12T00:22:07.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.601+0000 7fd6489978c0 1 < canceled multipart upload key=HUKWLE56FRX2 upload=UHUHTX1M1DAA tag=8BL7ZA5RKJTS type=write size=3106902 2024-09-12T00:22:07.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.605+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=B45PQ7TP2C9I type=del size=4145218 2024-09-12T00:22:07.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.609+0000 7fd6489978c0 1 < completed write operation key=ES2BLTWZT6PT tag=E6PKW5Y43NFP type=write size=161845 2024-09-12T00:22:07.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.613+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=Z5UXJ5OSX797 type=del size=3804119 2024-09-12T00:22:07.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.617+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=CHB2U29Q37BS type=del 2024-09-12T00:22:07.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.621+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=N4D3ZYQ73378 type=del size=2765965 2024-09-12T00:22:07.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.625+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~LUMGOPLHMN55.0 size=663202 2024-09-12T00:22:07.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.629+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=LUMGOPLHMN55 tag=PYI1N12WWTJF type=write size=1711778 2024-09-12T00:22:07.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.633+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=QKFJNBLDQI97 type=del size=2904509 2024-09-12T00:22:07.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.637+0000 7fd6489978c0 1 < completed delete operation key=M9YKGQ2GA5CO tag=C7D7RPIPSUM6 type=del 2024-09-12T00:22:07.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.641+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=OK3U3UVY1OVL type=del size=1396979 2024-09-12T00:22:07.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.645+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=803SVIDM26KS type=del 2024-09-12T00:22:07.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.653+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~A4DC2D5NRPDC.0 size=258575 2024-09-12T00:22:07.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.653+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=A4DC2D5NRPDC tag=MAMEEVSGHW3J type=write size=1307151 2024-09-12T00:22:07.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.657+0000 7fd6489978c0 1 < completed delete operation key=RGE8T6BTHBWK tag=7FPKP45ZLRG4 type=del 2024-09-12T00:22:07.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.661+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=WEMJW7E6TPY1 type=del size=3414258 2024-09-12T00:22:07.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.665+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=AQZUM92PAO2G type=del 2024-09-12T00:22:07.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.669+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=W32K6GBSDLTT type=del size=3712727 2024-09-12T00:22:07.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.673+0000 7fd6489978c0 1 < suggested remove operation key=9ACGS2FIY7AF tag=YBORBEG4VNDX type=del 2024-09-12T00:22:07.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.677+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=RWPE0XU1A3M3 type=del size=4059870 2024-09-12T00:22:07.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.685+0000 7fd6489978c0 1 < completed write operation key=8FBXDX6GELE7 tag=03JODK11LAWV type=write size=512179 2024-09-12T00:22:07.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.685+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=7YZQR7JKQ3F0 type=del size=2095693 2024-09-12T00:22:07.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.693+0000 7fd6489978c0 1 < suggested remove operation key=K9FD1L86Q05B tag=LKJNUVDFFEM3 type=del 2024-09-12T00:22:07.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.697+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=O4MWH6UCGIWE type=del size=1269544 2024-09-12T00:22:07.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.701+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~X492J7NGJNG9.0 size=419284 2024-09-12T00:22:07.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.709+0000 7fd6489978c0 1 < completed multipart upload key=G4EUTQOHAT2E upload=X492J7NGJNG9 tag=X0NYTJP9ZJCA type=write size=1467860 2024-09-12T00:22:07.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.713+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~BVI9OBTIH3GY.0 size=154246 2024-09-12T00:22:07.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.713+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=BVI9OBTIH3GY tag=LXEZWUQO9GOB type=write size=1202822 2024-09-12T00:22:07.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.717+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=ZBS3C1TZIF3W type=del 2024-09-12T00:22:07.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.721+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=N5C69USQVM2J type=del size=3384670 2024-09-12T00:22:07.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.729+0000 7fd6489978c0 1 < suggested remove operation key=CBXBFK3OXXKG tag=84MZU4ZJ7L0K type=write 2024-09-12T00:22:07.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.733+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=RVZHFP49SHQC type=del size=3960705 2024-09-12T00:22:07.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.741+0000 7fd6489978c0 1 < completed write operation key=8FBXDX6GELE7 tag=U8E4BWDM9D60 type=write size=261632 2024-09-12T00:22:07.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.745+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~XQDJEX18VPO1.0 size=1048576 2024-09-12T00:22:07.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.753+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~XQDJEX18VPO1.1 size=1048576 2024-09-12T00:22:07.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.761+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~XQDJEX18VPO1.2 size=154457 2024-09-12T00:22:07.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.761+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=XQDJEX18VPO1 tag=S8EH520ZQCBQ type=write size=3300185 2024-09-12T00:22:07.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.761+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=2K9083XTCRLN type=del 2024-09-12T00:22:07.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.765+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=Q5PZJJGL5F5T type=del size=1249561 2024-09-12T00:22:07.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.769+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=B45PQ7TP2C9I type=del 2024-09-12T00:22:07.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.773+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=A7J6JPQAY8Y8 type=del size=3440269 2024-09-12T00:22:07.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.777+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=Z5UXJ5OSX797 type=del 2024-09-12T00:22:07.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.781+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=PJK4YPF19BK8 type=del size=3254626 2024-09-12T00:22:07.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.789+0000 7fd6489978c0 1 < suggested update operation key=LZICTA4BWOW8 tag=N4D3ZYQ73378 type=del size=2765965 2024-09-12T00:22:07.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.797+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=OXP5YNVPWVRP type=del size=279435 2024-09-12T00:22:07.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.801+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=QKFJNBLDQI97 type=del 2024-09-12T00:22:07.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.805+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=C6194IMWXCM9 type=write size=261020 2024-09-12T00:22:07.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.809+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=OK3U3UVY1OVL type=del 2024-09-12T00:22:07.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.817+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~WLF6M27ZZBGJ.0 size=1048576 2024-09-12T00:22:07.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.817+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~WLF6M27ZZBGJ.1 size=1048576 2024-09-12T00:22:07.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.821+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~WLF6M27ZZBGJ.2 size=413187 2024-09-12T00:22:07.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.821+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=WLF6M27ZZBGJ tag=QPH2NTPFLWU5 type=write size=3558915 2024-09-12T00:22:07.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.825+0000 7fd6489978c0 1 < canceled part key=_multipart_9ACGS2FIY7AF.2~A4DC2D5NRPDC.0 size=258575 2024-09-12T00:22:07.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.829+0000 7fd6489978c0 1 < canceled multipart upload key=9ACGS2FIY7AF upload=A4DC2D5NRPDC tag=MAMEEVSGHW3J type=write size=1307151 2024-09-12T00:22:07.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.837+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~7E5OXGGX2GU6.0 size=1048576 2024-09-12T00:22:07.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.841+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~7E5OXGGX2GU6.1 size=410707 2024-09-12T00:22:07.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.841+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=7E5OXGGX2GU6 tag=GKE5KPJN16HT type=write size=2507859 2024-09-12T00:22:07.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.845+0000 7fd6489978c0 1 < completed delete operation key=J5IW4G9C72DH tag=WEMJW7E6TPY1 type=del 2024-09-12T00:22:07.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.849+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=BESN038DCSWX type=del size=353812 2024-09-12T00:22:07.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.853+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=W32K6GBSDLTT type=del 2024-09-12T00:22:07.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.861+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~P4ZNHZHM37FA.0 size=252510 2024-09-12T00:22:07.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.861+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=P4ZNHZHM37FA tag=RWWZ7NXSHRWN type=write size=1301086 2024-09-12T00:22:07.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.865+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=RWPE0XU1A3M3 type=del 2024-09-12T00:22:07.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.873+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~5ZRRSIR50HUR.0 size=1048576 2024-09-12T00:22:07.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.873+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~5ZRRSIR50HUR.1 size=337270 2024-09-12T00:22:07.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.873+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=5ZRRSIR50HUR tag=UA7N3FQ6AL1E type=write size=2434422 2024-09-12T00:22:07.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.881+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=7YZQR7JKQ3F0 type=del 2024-09-12T00:22:07.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.885+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~PH6DN4122E2Q.0 size=1048576 2024-09-12T00:22:07.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.889+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~PH6DN4122E2Q.1 size=308790 2024-09-12T00:22:07.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.889+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=PH6DN4122E2Q tag=XHJG1DI4MXPV type=write size=2405942 2024-09-12T00:22:07.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.893+0000 7fd6489978c0 1 < canceled operation key=HUKWLE56FRX2 tag=O4MWH6UCGIWE type=del size=1269544 2024-09-12T00:22:07.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.897+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=OPNQNPAKGJ4U type=del size=400245 2024-09-12T00:22:07.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.901+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~BVI9OBTIH3GY.0 size=154246 2024-09-12T00:22:07.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.905+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=BVI9OBTIH3GY tag=LXEZWUQO9GOB type=write size=1202822 2024-09-12T00:22:07.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.909+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=NIWUYS7LZTTQ type=write size=815688 2024-09-12T00:22:07.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.917+0000 7fd6489978c0 1 < suggested update operation key=JPVKBVRCZTE9 tag=N5C69USQVM2J type=del size=3384670 2024-09-12T00:22:07.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.921+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=8FGOM2ZVEKAK type=del size=179592 2024-09-12T00:22:07.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.929+0000 7fd6489978c0 1 < suggested remove operation key=3JZP8TZFEIMH tag=RVZHFP49SHQC type=del 2024-09-12T00:22:07.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.937+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~8HZ8I11GJFIA.0 size=419 2024-09-12T00:22:07.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.937+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=8HZ8I11GJFIA tag=GZQZ103Q8HJ5 type=write size=1048995 2024-09-12T00:22:07.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.941+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~XQDJEX18VPO1.0 size=1048576 2024-09-12T00:22:07.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.941+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~XQDJEX18VPO1.1 size=1048576 2024-09-12T00:22:07.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.945+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~XQDJEX18VPO1.2 size=154457 2024-09-12T00:22:07.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.953+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=XQDJEX18VPO1 tag=S8EH520ZQCBQ type=write size=3300185 2024-09-12T00:22:07.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.957+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=IV6U8EUA8BB1 type=del size=2668223 2024-09-12T00:22:07.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.957+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=Q5PZJJGL5F5T type=del 2024-09-12T00:22:07.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.965+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~IR8REQE9DYIK.0 size=1048576 2024-09-12T00:22:07.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.969+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~IR8REQE9DYIK.1 size=1048576 2024-09-12T00:22:07.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.973+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~IR8REQE9DYIK.2 size=735611 2024-09-12T00:22:07.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.973+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=IR8REQE9DYIK tag=NWG7GDTDGMEV type=write size=3881339 2024-09-12T00:22:07.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.973+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=A7J6JPQAY8Y8 type=del 2024-09-12T00:22:07.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.977+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=JU9XNSDH2Y9B type=write size=360935 2024-09-12T00:22:07.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.981+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=PJK4YPF19BK8 type=del 2024-09-12T00:22:07.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.985+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=AB1NH62ZBYMY type=del size=1867012 2024-09-12T00:22:07.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.989+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=OXP5YNVPWVRP type=del 2024-09-12T00:22:07.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.993+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=Q0BYBCMFZZUL type=del size=1189720 2024-09-12T00:22:07.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:07.997+0000 7fd6489978c0 1 < canceled operation key=8JCL0F406L7I tag=C6194IMWXCM9 type=write size=261020 2024-09-12T00:22:08.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.005+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~OTMKU0N2D8IY.0 size=937325 2024-09-12T00:22:08.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.005+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=OTMKU0N2D8IY tag=48P0S8229KD8 type=write size=1985901 2024-09-12T00:22:08.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.005+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~WLF6M27ZZBGJ.0 size=1048576 2024-09-12T00:22:08.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.009+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~WLF6M27ZZBGJ.1 size=1048576 2024-09-12T00:22:08.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.013+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~WLF6M27ZZBGJ.2 size=413187 2024-09-12T00:22:08.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.017+0000 7fd6489978c0 1 < completed multipart upload key=CFID1EVBXOVJ upload=WLF6M27ZZBGJ tag=QPH2NTPFLWU5 type=write size=3558915 2024-09-12T00:22:08.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.021+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=Z17V8OTAJE4W type=del size=3965962 2024-09-12T00:22:08.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.025+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~7E5OXGGX2GU6.0 size=1048576 2024-09-12T00:22:08.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.029+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~7E5OXGGX2GU6.1 size=410707 2024-09-12T00:22:08.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.033+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=7E5OXGGX2GU6 tag=GKE5KPJN16HT type=write size=2507859 2024-09-12T00:22:08.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.037+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=C2DISVHHWQYK type=del size=2091483 2024-09-12T00:22:08.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.041+0000 7fd6489978c0 1 < completed delete operation key=J5IW4G9C72DH tag=BESN038DCSWX type=del 2024-09-12T00:22:08.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.045+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=YUCR4XAAMB2N type=write size=585128 2024-09-12T00:22:08.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.049+0000 7fd6489978c0 1 < canceled part key=_multipart_G4EUTQOHAT2E.2~P4ZNHZHM37FA.0 size=252510 2024-09-12T00:22:08.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.053+0000 7fd6489978c0 1 < canceled multipart upload key=G4EUTQOHAT2E upload=P4ZNHZHM37FA tag=RWWZ7NXSHRWN type=write size=1301086 2024-09-12T00:22:08.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.057+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=NONS7QPQR1N6 type=write size=358485 2024-09-12T00:22:08.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.061+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~5ZRRSIR50HUR.0 size=1048576 2024-09-12T00:22:08.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.065+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~5ZRRSIR50HUR.1 size=337270 2024-09-12T00:22:08.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.069+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=5ZRRSIR50HUR tag=UA7N3FQ6AL1E type=write size=2434422 2024-09-12T00:22:08.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.077+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~CL7GZB0WM735.0 size=1048576 2024-09-12T00:22:08.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.081+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~CL7GZB0WM735.1 size=450954 2024-09-12T00:22:08.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.081+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=CL7GZB0WM735 tag=3S898RDBFKAW type=write size=2548106 2024-09-12T00:22:08.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.085+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~PH6DN4122E2Q.0 size=1048576 2024-09-12T00:22:08.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.085+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~PH6DN4122E2Q.1 size=308790 2024-09-12T00:22:08.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.093+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=PH6DN4122E2Q tag=XHJG1DI4MXPV type=write size=2405942 2024-09-12T00:22:08.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.097+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=9H31XGTE2H9T type=del size=3360486 2024-09-12T00:22:08.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.101+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=OPNQNPAKGJ4U type=del 2024-09-12T00:22:08.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.105+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=PG2S2FTASXPW type=del size=299509 2024-09-12T00:22:08.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.109+0000 7fd6489978c0 1 < completed write operation key=RGE8T6BTHBWK tag=NIWUYS7LZTTQ type=write size=815688 2024-09-12T00:22:08.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.117+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~7UJ6FGLALQMS.0 size=1048576 2024-09-12T00:22:08.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.121+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~7UJ6FGLALQMS.1 size=349139 2024-09-12T00:22:08.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.121+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=7UJ6FGLALQMS tag=4RSVNJBRQPBM type=write size=2446291 2024-09-12T00:22:08.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.125+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=8FGOM2ZVEKAK type=del 2024-09-12T00:22:08.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.129+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~4GF3K5WDUCDA.0 size=519443 2024-09-12T00:22:08.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.129+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=4GF3K5WDUCDA tag=HI1C6A20QMFA type=write size=1568019 2024-09-12T00:22:08.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.137+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~8HZ8I11GJFIA.0 size=419 2024-09-12T00:22:08.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.141+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=8HZ8I11GJFIA tag=GZQZ103Q8HJ5 type=write size=1048995 2024-09-12T00:22:08.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.149+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~MPJ2DBIPZCSG.0 size=1048576 2024-09-12T00:22:08.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.153+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~MPJ2DBIPZCSG.1 size=1048576 2024-09-12T00:22:08.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.153+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~MPJ2DBIPZCSG.2 size=254996 2024-09-12T00:22:08.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.153+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=MPJ2DBIPZCSG tag=ISTE9IPC219A type=write size=3400724 2024-09-12T00:22:08.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.157+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=IV6U8EUA8BB1 type=del 2024-09-12T00:22:08.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.161+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=CF23VZQ58GTP type=del size=1513128 2024-09-12T00:22:08.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.165+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~IR8REQE9DYIK.0 size=1048576 2024-09-12T00:22:08.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.169+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~IR8REQE9DYIK.1 size=1048576 2024-09-12T00:22:08.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.173+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~IR8REQE9DYIK.2 size=735611 2024-09-12T00:22:08.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.177+0000 7fd6489978c0 1 < completed multipart upload key=G4EUTQOHAT2E upload=IR8REQE9DYIK tag=NWG7GDTDGMEV type=write size=3881339 2024-09-12T00:22:08.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.181+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=ACT4IBTW3JFZ type=write size=703034 2024-09-12T00:22:08.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.185+0000 7fd6489978c0 1 < completed write operation key=9CK160BK5YYY tag=JU9XNSDH2Y9B type=write size=360935 2024-09-12T00:22:08.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.189+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=IXXGTCDVQQ8L type=del size=4008596 2024-09-12T00:22:08.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.193+0000 7fd6489978c0 1 < completed delete operation key=M9YKGQ2GA5CO tag=AB1NH62ZBYMY type=del 2024-09-12T00:22:08.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.201+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~JSYKMR2N5D1G.0 size=1048576 2024-09-12T00:22:08.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.201+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~JSYKMR2N5D1G.1 size=373765 2024-09-12T00:22:08.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.201+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=JSYKMR2N5D1G tag=EMW5V3JUKDAC type=write size=2470917 2024-09-12T00:22:08.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.205+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=Q0BYBCMFZZUL type=del 2024-09-12T00:22:08.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.209+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=9HU6LXNYN271 type=del size=1306892 2024-09-12T00:22:08.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.213+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~OTMKU0N2D8IY.0 size=937325 2024-09-12T00:22:08.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.221+0000 7fd6489978c0 1 < completed multipart upload key=CFID1EVBXOVJ upload=OTMKU0N2D8IY tag=48P0S8229KD8 type=write size=1985901 2024-09-12T00:22:08.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.221+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=FVSVLK2C4AA6 type=del size=2975247 2024-09-12T00:22:08.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.225+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=Z17V8OTAJE4W type=del 2024-09-12T00:22:08.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.233+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~KES32HKV9B6J.0 size=1048576 2024-09-12T00:22:08.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.237+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~KES32HKV9B6J.1 size=1048576 2024-09-12T00:22:08.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.241+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~KES32HKV9B6J.2 size=99600 2024-09-12T00:22:08.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.241+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=KES32HKV9B6J tag=FWEWRUZLEPRJ type=write size=3245328 2024-09-12T00:22:08.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.245+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=C2DISVHHWQYK type=del 2024-09-12T00:22:08.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.249+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=7DVFTKYV77G4 type=del size=2633813 2024-09-12T00:22:08.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.253+0000 7fd6489978c0 1 < completed write operation key=KAT2TB3FGAYG tag=YUCR4XAAMB2N type=write size=585128 2024-09-12T00:22:08.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.257+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~K7GM21LBK2QN.0 size=1048576 2024-09-12T00:22:08.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.261+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~K7GM21LBK2QN.1 size=1048576 2024-09-12T00:22:08.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.265+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~K7GM21LBK2QN.2 size=161995 2024-09-12T00:22:08.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.265+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=K7GM21LBK2QN tag=N2WNZFVBMAV5 type=write size=3307723 2024-09-12T00:22:08.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.269+0000 7fd6489978c0 1 < completed write operation key=CBXBFK3OXXKG tag=NONS7QPQR1N6 type=write size=358485 2024-09-12T00:22:08.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.277+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~VTJ56BZEQZPL.0 size=1048576 2024-09-12T00:22:08.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.277+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~VTJ56BZEQZPL.1 size=956767 2024-09-12T00:22:08.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.277+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=VTJ56BZEQZPL tag=M47XS4I7OHR0 type=write size=3053919 2024-09-12T00:22:08.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.281+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~CL7GZB0WM735.0 size=1048576 2024-09-12T00:22:08.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.285+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~CL7GZB0WM735.1 size=450954 2024-09-12T00:22:08.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.293+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=CL7GZB0WM735 tag=3S898RDBFKAW type=write size=2548106 2024-09-12T00:22:08.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.297+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~JHHCQ2EUFXY9.0 size=1048576 2024-09-12T00:22:08.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.301+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~JHHCQ2EUFXY9.1 size=1048576 2024-09-12T00:22:08.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.305+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~JHHCQ2EUFXY9.2 size=381339 2024-09-12T00:22:08.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.305+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=JHHCQ2EUFXY9 tag=00P50SU4IKII type=write size=3527067 2024-09-12T00:22:08.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.309+0000 7fd6489978c0 1 < completed delete operation key=LZICTA4BWOW8 tag=9H31XGTE2H9T type=del 2024-09-12T00:22:08.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.313+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=7GI2GRUZXE6G type=write size=954997 2024-09-12T00:22:08.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.321+0000 7fd6489978c0 1 < suggested remove operation key=JPVKBVRCZTE9 tag=PG2S2FTASXPW type=del 2024-09-12T00:22:08.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.329+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~HBGTUZ84403Z.0 size=715679 2024-09-12T00:22:08.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.329+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=HBGTUZ84403Z tag=O6SUNJ62TZGA type=write size=1764255 2024-09-12T00:22:08.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.329+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~7UJ6FGLALQMS.0 size=1048576 2024-09-12T00:22:08.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.333+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~7UJ6FGLALQMS.1 size=349139 2024-09-12T00:22:08.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.341+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=7UJ6FGLALQMS tag=4RSVNJBRQPBM type=write size=2446291 2024-09-12T00:22:08.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.345+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=JJ01CS9CZL5Q type=del size=959968 2024-09-12T00:22:08.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.349+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~4GF3K5WDUCDA.0 size=519443 2024-09-12T00:22:08.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.353+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=4GF3K5WDUCDA tag=HI1C6A20QMFA type=write size=1568019 2024-09-12T00:22:08.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.361+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~AUJ94NAGEQ4N.0 size=1048576 2024-09-12T00:22:08.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.361+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~AUJ94NAGEQ4N.1 size=418058 2024-09-12T00:22:08.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.361+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=AUJ94NAGEQ4N tag=076KLAMNETPI type=write size=2515210 2024-09-12T00:22:08.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.365+0000 7fd6489978c0 1 < canceled part key=_multipart_B2BW7GQ6UN9I.2~MPJ2DBIPZCSG.0 size=1048576 2024-09-12T00:22:08.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.365+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~MPJ2DBIPZCSG.1 size=1048576 2024-09-12T00:22:08.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.369+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~MPJ2DBIPZCSG.2 size=254996 2024-09-12T00:22:08.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.377+0000 7fd6489978c0 1 < canceled multipart upload key=B2BW7GQ6UN9I upload=MPJ2DBIPZCSG tag=ISTE9IPC219A type=write size=3400724 2024-09-12T00:22:08.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.381+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=9SIW8LA8MIY3 type=write size=1028636 2024-09-12T00:22:08.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.381+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=CF23VZQ58GTP type=del 2024-09-12T00:22:08.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.389+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~RZYMZRXXNM6X.0 size=1048576 2024-09-12T00:22:08.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.393+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~RZYMZRXXNM6X.1 size=1048576 2024-09-12T00:22:08.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.397+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~RZYMZRXXNM6X.2 size=785474 2024-09-12T00:22:08.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.397+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=RZYMZRXXNM6X tag=YPL32KU80TZH type=write size=3931202 2024-09-12T00:22:08.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.401+0000 7fd6489978c0 -1 < failed to complete operation key=JPVKBVRCZTE9 tag=ACT4IBTW3JFZ type=write size=703034: (22) Invalid argument 2024-09-12T00:22:08.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.405+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=I0HDCO1OPI1O type=del size=3525569 2024-09-12T00:22:08.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.405+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=IXXGTCDVQQ8L type=del 2024-09-12T00:22:08.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.413+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~9FG6TRTLKB6B.0 size=385210 2024-09-12T00:22:08.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.413+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=9FG6TRTLKB6B tag=XCK9DTQUC1R3 type=write size=1433786 2024-09-12T00:22:08.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.417+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~JSYKMR2N5D1G.0 size=1048576 2024-09-12T00:22:08.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.421+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~JSYKMR2N5D1G.1 size=373765 2024-09-12T00:22:08.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.425+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=JSYKMR2N5D1G tag=EMW5V3JUKDAC type=write size=2470917 2024-09-12T00:22:08.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.433+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~GBYT3ARLZJ5Q.0 size=1048576 2024-09-12T00:22:08.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.437+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~GBYT3ARLZJ5Q.1 size=1048576 2024-09-12T00:22:08.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.437+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~GBYT3ARLZJ5Q.2 size=764507 2024-09-12T00:22:08.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.437+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=GBYT3ARLZJ5Q tag=JSH2XQ805GGH type=write size=3910235 2024-09-12T00:22:08.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.445+0000 7fd6489978c0 1 < suggested update operation key=F2CTWM0T2698 tag=9HU6LXNYN271 type=del size=1306892 2024-09-12T00:22:08.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.449+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=S814CGQ1AL1D type=del size=4024375 2024-09-12T00:22:08.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.457+0000 7fd6489978c0 1 < completed delete operation key=J5IW4G9C72DH tag=FVSVLK2C4AA6 type=del 2024-09-12T00:22:08.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.461+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=DKP22YT27G8I type=del size=1301992 2024-09-12T00:22:08.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.465+0000 7fd6489978c0 1 < canceled part key=_multipart_25P4P2I6BE3H.2~KES32HKV9B6J.0 size=1048576 2024-09-12T00:22:08.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.465+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~KES32HKV9B6J.1 size=1048576 2024-09-12T00:22:08.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.469+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~KES32HKV9B6J.2 size=99600 2024-09-12T00:22:08.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.477+0000 7fd6489978c0 1 < canceled multipart upload key=25P4P2I6BE3H upload=KES32HKV9B6J tag=FWEWRUZLEPRJ type=write size=3245328 2024-09-12T00:22:08.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.481+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~920G9Z0Z3R69.0 size=1048576 2024-09-12T00:22:08.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.485+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~920G9Z0Z3R69.1 size=1048576 2024-09-12T00:22:08.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.489+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~920G9Z0Z3R69.2 size=366383 2024-09-12T00:22:08.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.489+0000 7fd6489978c0 1 > prepared multipart upload key=DAOTTEMK2P2T upload=920G9Z0Z3R69 tag=02T8HX38OS25 type=write size=3512111 2024-09-12T00:22:08.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.493+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=7DVFTKYV77G4 type=del 2024-09-12T00:22:08.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.497+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=623JNJBF3LWE type=del size=1677400 2024-09-12T00:22:08.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.501+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~K7GM21LBK2QN.0 size=1048576 2024-09-12T00:22:08.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.505+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~K7GM21LBK2QN.1 size=1048576 2024-09-12T00:22:08.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.505+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~K7GM21LBK2QN.2 size=161995 2024-09-12T00:22:08.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.513+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=K7GM21LBK2QN tag=N2WNZFVBMAV5 type=write size=3307723 2024-09-12T00:22:08.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.521+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~IMFFAQJ7SQ2I.0 size=1048576 2024-09-12T00:22:08.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.521+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~IMFFAQJ7SQ2I.1 size=1048576 2024-09-12T00:22:08.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.525+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~IMFFAQJ7SQ2I.2 size=736037 2024-09-12T00:22:08.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.525+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=IMFFAQJ7SQ2I tag=FJ2D4YH0QG73 type=write size=3881765 2024-09-12T00:22:08.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.529+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~VTJ56BZEQZPL.0 size=1048576 2024-09-12T00:22:08.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.533+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~VTJ56BZEQZPL.1 size=956767 2024-09-12T00:22:08.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.537+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=VTJ56BZEQZPL tag=M47XS4I7OHR0 type=write size=3053919 2024-09-12T00:22:08.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.541+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=9B7CR705XES8 type=del size=2187839 2024-09-12T00:22:08.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.545+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~JHHCQ2EUFXY9.0 size=1048576 2024-09-12T00:22:08.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.549+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~JHHCQ2EUFXY9.1 size=1048576 2024-09-12T00:22:08.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.553+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~JHHCQ2EUFXY9.2 size=381339 2024-09-12T00:22:08.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.557+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=JHHCQ2EUFXY9 tag=00P50SU4IKII type=write size=3527067 2024-09-12T00:22:08.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.565+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~A1NPGQBR3QJT.0 size=1048576 2024-09-12T00:22:08.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.569+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~A1NPGQBR3QJT.1 size=1048576 2024-09-12T00:22:08.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.573+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~A1NPGQBR3QJT.2 size=1009577 2024-09-12T00:22:08.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.573+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=A1NPGQBR3QJT tag=HZ360LPJX978 type=write size=4155305 2024-09-12T00:22:08.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.577+0000 7fd6489978c0 1 < suggested remove operation key=ZW51KHCLPYN3 tag=7GI2GRUZXE6G type=write 2024-09-12T00:22:08.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.581+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=0HL2LMHB6JKG type=del size=2000339 2024-09-12T00:22:08.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.585+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~HBGTUZ84403Z.0 size=715679 2024-09-12T00:22:08.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.593+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=HBGTUZ84403Z tag=O6SUNJ62TZGA type=write size=1764255 2024-09-12T00:22:08.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.601+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~AVXVZGWXR89S.0 size=1048576 2024-09-12T00:22:08.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.605+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~AVXVZGWXR89S.1 size=104451 2024-09-12T00:22:08.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.605+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=AVXVZGWXR89S tag=QZNLQI7AW00M type=write size=2201603 2024-09-12T00:22:08.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.609+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=JJ01CS9CZL5Q type=del 2024-09-12T00:22:08.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.613+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=D2PNGTFPK5WH type=del size=1193481 2024-09-12T00:22:08.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.613+0000 7fd6489978c0 1 < canceled part key=_multipart_9ACGS2FIY7AF.2~AUJ94NAGEQ4N.0 size=1048576 2024-09-12T00:22:08.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.617+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~AUJ94NAGEQ4N.1 size=418058 2024-09-12T00:22:08.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.625+0000 7fd6489978c0 1 < canceled multipart upload key=9ACGS2FIY7AF upload=AUJ94NAGEQ4N tag=076KLAMNETPI type=write size=2515210 2024-09-12T00:22:08.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.629+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=UXUALEPXH238 type=del size=3851258 2024-09-12T00:22:08.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.637+0000 7fd6489978c0 1 < suggested remove operation key=3JZP8TZFEIMH tag=9SIW8LA8MIY3 type=write 2024-09-12T00:22:08.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.641+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=NEK63UF9SHBD type=write size=87140 2024-09-12T00:22:08.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.645+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~RZYMZRXXNM6X.0 size=1048576 2024-09-12T00:22:08.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.645+0000 7fd6489978c0 1 < canceled part key=_multipart_YSPRZ87DZ2OD.2~RZYMZRXXNM6X.1 size=1048576 2024-09-12T00:22:08.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.645+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~RZYMZRXXNM6X.2 size=785474 2024-09-12T00:22:08.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.653+0000 7fd6489978c0 1 < canceled multipart upload key=YSPRZ87DZ2OD upload=RZYMZRXXNM6X tag=YPL32KU80TZH type=write size=3931202 2024-09-12T00:22:08.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.657+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=8192IKWAI4IH type=write size=78653 2024-09-12T00:22:08.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.661+0000 7fd6489978c0 -1 < failed to complete operation key=ZW51KHCLPYN3 tag=I0HDCO1OPI1O type=del size=3525569: (22) Invalid argument 2024-09-12T00:22:08.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.665+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=8YVHLJKEFD8Y type=write size=449943 2024-09-12T00:22:08.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.669+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~9FG6TRTLKB6B.0 size=385210 2024-09-12T00:22:08.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.673+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=9FG6TRTLKB6B tag=XCK9DTQUC1R3 type=write size=1433786 2024-09-12T00:22:08.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.677+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=77X1Q5ACPCGL type=del size=1088790 2024-09-12T00:22:08.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.681+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~GBYT3ARLZJ5Q.0 size=1048576 2024-09-12T00:22:08.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.685+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~GBYT3ARLZJ5Q.1 size=1048576 2024-09-12T00:22:08.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.689+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~GBYT3ARLZJ5Q.2 size=764507 2024-09-12T00:22:08.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.693+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=GBYT3ARLZJ5Q tag=JSH2XQ805GGH type=write size=3910235 2024-09-12T00:22:08.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.701+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~Y9S0VE3NXE0I.0 size=1048576 2024-09-12T00:22:08.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.705+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~Y9S0VE3NXE0I.1 size=35649 2024-09-12T00:22:08.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.705+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=Y9S0VE3NXE0I tag=H3Z5Y3XJURLH type=write size=2132801 2024-09-12T00:22:08.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.709+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=S814CGQ1AL1D type=del 2024-09-12T00:22:08.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.713+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=FF1ISK6G07JM type=del size=2276931 2024-09-12T00:22:08.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.717+0000 7fd6489978c0 1 < canceled operation key=K9FD1L86Q05B tag=DKP22YT27G8I type=del size=1301992 2024-09-12T00:22:08.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.721+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~G11OFFXEAELY.0 size=183238 2024-09-12T00:22:08.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.721+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=G11OFFXEAELY tag=UE865EAYZ7FM type=write size=1231814 2024-09-12T00:22:08.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.725+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~920G9Z0Z3R69.0 size=1048576 2024-09-12T00:22:08.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.729+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~920G9Z0Z3R69.1 size=1048576 2024-09-12T00:22:08.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.733+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~920G9Z0Z3R69.2 size=366383 2024-09-12T00:22:08.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.737+0000 7fd6489978c0 1 < completed multipart upload key=DAOTTEMK2P2T upload=920G9Z0Z3R69 tag=02T8HX38OS25 type=write size=3512111 2024-09-12T00:22:08.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.741+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=KRJ69UJSVC2A type=del size=3359651 2024-09-12T00:22:08.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.749+0000 7fd6489978c0 1 < suggested update operation key=CBXBFK3OXXKG tag=623JNJBF3LWE type=del size=1677400 2024-09-12T00:22:08.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.757+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~XKJD02TE46PY.0 size=1048576 2024-09-12T00:22:08.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.761+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~XKJD02TE46PY.1 size=717505 2024-09-12T00:22:08.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.761+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=XKJD02TE46PY tag=63YZZXLZD0JC type=write size=2814657 2024-09-12T00:22:08.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.765+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~IMFFAQJ7SQ2I.0 size=1048576 2024-09-12T00:22:08.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.769+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~IMFFAQJ7SQ2I.1 size=1048576 2024-09-12T00:22:08.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.769+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~IMFFAQJ7SQ2I.2 size=736037 2024-09-12T00:22:08.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.777+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=IMFFAQJ7SQ2I tag=FJ2D4YH0QG73 type=write size=3881765 2024-09-12T00:22:08.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.781+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=W54S8WYJ3ELI type=del size=3318486 2024-09-12T00:22:08.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.785+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=9B7CR705XES8 type=del 2024-09-12T00:22:08.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.789+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=0TV4Y2OPDKY6 type=del size=2561837 2024-09-12T00:22:08.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.793+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~A1NPGQBR3QJT.0 size=1048576 2024-09-12T00:22:08.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.797+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~A1NPGQBR3QJT.1 size=1048576 2024-09-12T00:22:08.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.797+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~A1NPGQBR3QJT.2 size=1009577 2024-09-12T00:22:08.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.809+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=A1NPGQBR3QJT tag=HZ360LPJX978 type=write size=4155305 2024-09-12T00:22:08.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.813+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=G1XLW70DGBIL type=del size=623590 2024-09-12T00:22:08.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.817+0000 7fd6489978c0 1 < completed delete operation key=J5IW4G9C72DH tag=0HL2LMHB6JKG type=del 2024-09-12T00:22:08.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.821+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=HJ2O7EY7ZN2Z type=del size=1406506 2024-09-12T00:22:08.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.825+0000 7fd6489978c0 1 < canceled part key=_multipart_M9YKGQ2GA5CO.2~AVXVZGWXR89S.0 size=1048576 2024-09-12T00:22:08.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.825+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~AVXVZGWXR89S.1 size=104451 2024-09-12T00:22:08.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.833+0000 7fd6489978c0 1 < canceled multipart upload key=M9YKGQ2GA5CO upload=AVXVZGWXR89S tag=QZNLQI7AW00M type=write size=2201603 2024-09-12T00:22:08.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.837+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=LZ0P5L4XS3IB type=del size=393243 2024-09-12T00:22:08.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.841+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=D2PNGTFPK5WH type=del 2024-09-12T00:22:08.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.845+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=KWZQDWJ2U5JE type=del size=3722097 2024-09-12T00:22:08.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.849+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=UXUALEPXH238 type=del 2024-09-12T00:22:08.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.853+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=VGVUPNEYZ5CH type=write size=442227 2024-09-12T00:22:08.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.857+0000 7fd6489978c0 1 < completed write operation key=YSPRZ87DZ2OD tag=NEK63UF9SHBD type=write size=87140 2024-09-12T00:22:08.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.861+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=NO23XRAVRZRE type=write size=692813 2024-09-12T00:22:08.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.865+0000 7fd6489978c0 1 < completed write operation key=8JCL0F406L7I tag=8192IKWAI4IH type=write size=78653 2024-09-12T00:22:08.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.869+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=GAONGROZQEE9 type=del size=1075279 2024-09-12T00:22:08.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.873+0000 7fd6489978c0 1 < completed write operation key=DAOTTEMK2P2T tag=8YVHLJKEFD8Y type=write size=449943 2024-09-12T00:22:08.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.881+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~RYH62AZE01O9.0 size=1048576 2024-09-12T00:22:08.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.885+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~RYH62AZE01O9.1 size=1048576 2024-09-12T00:22:08.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.889+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~RYH62AZE01O9.2 size=996951 2024-09-12T00:22:08.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.889+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=RYH62AZE01O9 tag=PEEHCP5AQA45 type=write size=4142679 2024-09-12T00:22:08.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.893+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=77X1Q5ACPCGL type=del 2024-09-12T00:22:08.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.897+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=TCYAXSQWCTPO type=write size=845690 2024-09-12T00:22:08.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.901+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~Y9S0VE3NXE0I.0 size=1048576 2024-09-12T00:22:08.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.905+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~Y9S0VE3NXE0I.1 size=35649 2024-09-12T00:22:08.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.909+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=Y9S0VE3NXE0I tag=H3Z5Y3XJURLH type=write size=2132801 2024-09-12T00:22:08.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.913+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=R83FZW2VK061 type=del size=3300309 2024-09-12T00:22:08.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.917+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=FF1ISK6G07JM type=del 2024-09-12T00:22:08.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.925+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~DK1HSTS831RI.0 size=1048576 2024-09-12T00:22:08.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.929+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~DK1HSTS831RI.1 size=660864 2024-09-12T00:22:08.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.929+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=DK1HSTS831RI tag=WBGH3B5CD47D type=write size=2758016 2024-09-12T00:22:08.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.929+0000 7fd6489978c0 1 < canceled part key=_multipart_G4EUTQOHAT2E.2~G11OFFXEAELY.0 size=183238 2024-09-12T00:22:08.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.933+0000 7fd6489978c0 1 < canceled multipart upload key=G4EUTQOHAT2E upload=G11OFFXEAELY tag=UE865EAYZ7FM type=write size=1231814 2024-09-12T00:22:08.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.941+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~ATN1P1S0N3XE.0 size=492351 2024-09-12T00:22:08.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.941+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=ATN1P1S0N3XE tag=ZTDA3X2Y6N8F type=write size=1540927 2024-09-12T00:22:08.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.945+0000 7fd6489978c0 -1 < failed to complete operation key=CBXBFK3OXXKG tag=KRJ69UJSVC2A type=del size=3359651: (22) Invalid argument 2024-09-12T00:22:08.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.949+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~0B6DGQDN8BUY.0 size=176985 2024-09-12T00:22:08.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.953+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=0B6DGQDN8BUY tag=MA8MS9LOW4BO type=write size=1225561 2024-09-12T00:22:08.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.953+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~XKJD02TE46PY.0 size=1048576 2024-09-12T00:22:08.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.957+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~XKJD02TE46PY.1 size=717505 2024-09-12T00:22:08.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.965+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=XKJD02TE46PY tag=63YZZXLZD0JC type=write size=2814657 2024-09-12T00:22:08.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.969+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=WWUJP09FQ0DZ type=del size=1398267 2024-09-12T00:22:08.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.973+0000 7fd6489978c0 1 < canceled operation key=8FBXDX6GELE7 tag=W54S8WYJ3ELI type=del size=3318486 2024-09-12T00:22:08.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.977+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=RL93YM4DDW2W type=del size=3856678 2024-09-12T00:22:08.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.981+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=0TV4Y2OPDKY6 type=del 2024-09-12T00:22:08.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.985+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=LAMR5WWRDB0M type=write size=903926 2024-09-12T00:22:08.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.989+0000 7fd6489978c0 1 < canceled operation key=J5IW4G9C72DH tag=G1XLW70DGBIL type=del size=623590 2024-09-12T00:22:08.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.993+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=1RIVGTM4FUV2 type=write size=354407 2024-09-12T00:22:08.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:08.997+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=HJ2O7EY7ZN2Z type=del 2024-09-12T00:22:09.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.005+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~ZVX8BVY8P913.0 size=1048576 2024-09-12T00:22:09.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.005+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~ZVX8BVY8P913.1 size=1048576 2024-09-12T00:22:09.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.009+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~ZVX8BVY8P913.2 size=370050 2024-09-12T00:22:09.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.009+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=ZVX8BVY8P913 tag=PA008G0BC4WU type=write size=3515778 2024-09-12T00:22:09.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.013+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=LZ0P5L4XS3IB type=del 2024-09-12T00:22:09.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.021+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~YP8BP84KSA03.0 size=1048576 2024-09-12T00:22:09.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.025+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~YP8BP84KSA03.1 size=592130 2024-09-12T00:22:09.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.025+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=YP8BP84KSA03 tag=KC53ICTOAWZ1 type=write size=2689282 2024-09-12T00:22:09.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.033+0000 7fd6489978c0 1 < suggested update operation key=QBS4N1KGR1JB tag=KWZQDWJ2U5JE type=del size=3722097 2024-09-12T00:22:09.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.037+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=S6KNWUFZJ0O3 type=del size=1363591 2024-09-12T00:22:09.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.041+0000 7fd6489978c0 1 < completed write operation key=DAOTTEMK2P2T tag=VGVUPNEYZ5CH type=write size=442227 2024-09-12T00:22:09.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.045+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=AAHPMUJ09HW2 type=write size=681627 2024-09-12T00:22:09.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.049+0000 7fd6489978c0 1 < canceled operation key=N0AAVPQ6MUQ1 tag=NO23XRAVRZRE type=write size=692813 2024-09-12T00:22:09.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.053+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=EAB31X1YJLZJ type=del size=3997138 2024-09-12T00:22:09.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.057+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=GAONGROZQEE9 type=del 2024-09-12T00:22:09.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.061+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~IRDM5UVBOT5O.0 size=111742 2024-09-12T00:22:09.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.061+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=IRDM5UVBOT5O tag=XELS4ZRXOX0G type=write size=1160318 2024-09-12T00:22:09.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.065+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~RYH62AZE01O9.0 size=1048576 2024-09-12T00:22:09.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.069+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~RYH62AZE01O9.1 size=1048576 2024-09-12T00:22:09.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.069+0000 7fd6489978c0 1 < canceled part key=_multipart_ZW51KHCLPYN3.2~RYH62AZE01O9.2 size=996951 2024-09-12T00:22:09.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.073+0000 7fd6489978c0 1 < canceled multipart upload key=ZW51KHCLPYN3 upload=RYH62AZE01O9 tag=PEEHCP5AQA45 type=write size=4142679 2024-09-12T00:22:09.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.077+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=U19IPAUGP1T3 type=del size=1613184 2024-09-12T00:22:09.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.081+0000 7fd6489978c0 1 < completed write operation key=RGE8T6BTHBWK tag=TCYAXSQWCTPO type=write size=845690 2024-09-12T00:22:09.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.085+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=7Y1F68CWYWKA type=del size=1619708 2024-09-12T00:22:09.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.089+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=R83FZW2VK061 type=del 2024-09-12T00:22:09.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.093+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~NZ4IG36CC7TI.0 size=1048576 2024-09-12T00:22:09.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.097+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~NZ4IG36CC7TI.1 size=460999 2024-09-12T00:22:09.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.097+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=NZ4IG36CC7TI tag=8DYDA14H89D1 type=write size=2558151 2024-09-12T00:22:09.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.101+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~DK1HSTS831RI.0 size=1048576 2024-09-12T00:22:09.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.105+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~DK1HSTS831RI.1 size=660864 2024-09-12T00:22:09.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.109+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=DK1HSTS831RI tag=WBGH3B5CD47D type=write size=2758016 2024-09-12T00:22:09.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.117+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~3PCY7VB7LN6P.0 size=252066 2024-09-12T00:22:09.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.117+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=3PCY7VB7LN6P tag=NN2FI08B1W2Y type=write size=1300642 2024-09-12T00:22:09.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.121+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~ATN1P1S0N3XE.0 size=492351 2024-09-12T00:22:09.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.125+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=ATN1P1S0N3XE tag=ZTDA3X2Y6N8F type=write size=1540927 2024-09-12T00:22:09.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.133+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~3B9349FMYXQG.0 size=89076 2024-09-12T00:22:09.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.133+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=3B9349FMYXQG tag=J02N527T8OKT type=write size=1137652 2024-09-12T00:22:09.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.133+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~0B6DGQDN8BUY.0 size=176985 2024-09-12T00:22:09.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.141+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=0B6DGQDN8BUY tag=MA8MS9LOW4BO type=write size=1225561 2024-09-12T00:22:09.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.145+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~3U7AQVZ4XIO5.0 size=530940 2024-09-12T00:22:09.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.145+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=3U7AQVZ4XIO5 tag=DJKA9H7LQ41Z type=write size=1579516 2024-09-12T00:22:09.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.149+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=WWUJP09FQ0DZ type=del 2024-09-12T00:22:09.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.157+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~P4QUOIE24WK2.0 size=1048576 2024-09-12T00:22:09.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.161+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~P4QUOIE24WK2.1 size=1048576 2024-09-12T00:22:09.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.169+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~P4QUOIE24WK2.2 size=815720 2024-09-12T00:22:09.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.169+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=P4QUOIE24WK2 tag=JSXRKC7D2OP1 type=write size=3961448 2024-09-12T00:22:09.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.169+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=RL93YM4DDW2W type=del 2024-09-12T00:22:09.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.177+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~1SH90REIAPCV.0 size=1048576 2024-09-12T00:22:09.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.181+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~1SH90REIAPCV.1 size=678803 2024-09-12T00:22:09.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.181+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=1SH90REIAPCV tag=CMFO15AH34OE type=write size=2775955 2024-09-12T00:22:09.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.185+0000 7fd6489978c0 1 < completed write operation key=CFID1EVBXOVJ tag=LAMR5WWRDB0M type=write size=903926 2024-09-12T00:22:09.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.185+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=HH0I19EPENX5 type=del size=657369 2024-09-12T00:22:09.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.189+0000 7fd6489978c0 1 < completed write operation key=9ACGS2FIY7AF tag=1RIVGTM4FUV2 type=write size=354407 2024-09-12T00:22:09.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.193+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=4ET89FBYI8AG type=del size=1353926 2024-09-12T00:22:09.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.197+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~ZVX8BVY8P913.0 size=1048576 2024-09-12T00:22:09.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.201+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~ZVX8BVY8P913.1 size=1048576 2024-09-12T00:22:09.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.201+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~ZVX8BVY8P913.2 size=370050 2024-09-12T00:22:09.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.209+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=ZVX8BVY8P913 tag=PA008G0BC4WU type=write size=3515778 2024-09-12T00:22:09.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.213+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~IEDZUMW0JKNZ.0 size=1048576 2024-09-12T00:22:09.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.217+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~IEDZUMW0JKNZ.1 size=1048576 2024-09-12T00:22:09.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.221+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~IEDZUMW0JKNZ.2 size=665534 2024-09-12T00:22:09.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.221+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=IEDZUMW0JKNZ tag=9HDH4V3ESW2U type=write size=3811262 2024-09-12T00:22:09.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.221+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~YP8BP84KSA03.0 size=1048576 2024-09-12T00:22:09.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.225+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~YP8BP84KSA03.1 size=592130 2024-09-12T00:22:09.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.233+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=YP8BP84KSA03 tag=KC53ICTOAWZ1 type=write size=2689282 2024-09-12T00:22:09.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.237+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=FTI15XPOC865 type=del size=1804910 2024-09-12T00:22:09.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.237+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=S6KNWUFZJ0O3 type=del 2024-09-12T00:22:09.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.241+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=T5D89Z6HY6RQ type=write size=872681 2024-09-12T00:22:09.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.245+0000 7fd6489978c0 1 < canceled operation key=CFID1EVBXOVJ tag=AAHPMUJ09HW2 type=write size=681627 2024-09-12T00:22:09.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.253+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~C4JY9P89QK0L.0 size=1048576 2024-09-12T00:22:09.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.253+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~C4JY9P89QK0L.1 size=376077 2024-09-12T00:22:09.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.253+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=C4JY9P89QK0L tag=P68ZLTLWUHFF type=write size=2473229 2024-09-12T00:22:09.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.261+0000 7fd6489978c0 1 < suggested update operation key=CFID1EVBXOVJ tag=EAB31X1YJLZJ type=del size=3997138 2024-09-12T00:22:09.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.269+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~QG2KKS4GNQIE.0 size=1048576 2024-09-12T00:22:09.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.273+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~QG2KKS4GNQIE.1 size=542803 2024-09-12T00:22:09.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.273+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=QG2KKS4GNQIE tag=VX39WK28J6HD type=write size=2639955 2024-09-12T00:22:09.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.277+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~IRDM5UVBOT5O.0 size=111742 2024-09-12T00:22:09.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.281+0000 7fd6489978c0 1 < completed multipart upload key=9ACGS2FIY7AF upload=IRDM5UVBOT5O tag=XELS4ZRXOX0G type=write size=1160318 2024-09-12T00:22:09.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.285+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=HICP8HO7GNGW type=del size=1587373 2024-09-12T00:22:09.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.289+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=U19IPAUGP1T3 type=del 2024-09-12T00:22:09.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.293+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=VHH63EZIND0B type=del size=868394 2024-09-12T00:22:09.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.297+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=7Y1F68CWYWKA type=del 2024-09-12T00:22:09.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.301+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=O250498UK6KY type=del size=2623457 2024-09-12T00:22:09.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.301+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~NZ4IG36CC7TI.0 size=1048576 2024-09-12T00:22:09.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.305+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~NZ4IG36CC7TI.1 size=460999 2024-09-12T00:22:09.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.313+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=NZ4IG36CC7TI tag=8DYDA14H89D1 type=write size=2558151 2024-09-12T00:22:09.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.317+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=RSMSVCYDK281 type=del size=1924780 2024-09-12T00:22:09.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.317+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~3PCY7VB7LN6P.0 size=252066 2024-09-12T00:22:09.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.325+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=3PCY7VB7LN6P tag=NN2FI08B1W2Y type=write size=1300642 2024-09-12T00:22:09.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.329+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=RGBNC31EIYJP type=del size=76816 2024-09-12T00:22:09.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.333+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~3B9349FMYXQG.0 size=89076 2024-09-12T00:22:09.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.337+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=3B9349FMYXQG tag=J02N527T8OKT type=write size=1137652 2024-09-12T00:22:09.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.341+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=7TNV7XBKBEIP type=del size=234053 2024-09-12T00:22:09.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.341+0000 7fd6489978c0 1 < canceled part key=_multipart_GVPNH3JSO07D.2~3U7AQVZ4XIO5.0 size=530940 2024-09-12T00:22:09.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.349+0000 7fd6489978c0 1 < canceled multipart upload key=GVPNH3JSO07D upload=3U7AQVZ4XIO5 tag=DJKA9H7LQ41Z type=write size=1579516 2024-09-12T00:22:09.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.353+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~U5UMB2G4OLWT.0 size=1048576 2024-09-12T00:22:09.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.357+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~U5UMB2G4OLWT.1 size=681000 2024-09-12T00:22:09.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.357+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=U5UMB2G4OLWT tag=EKT9RG4EEE1B type=write size=2778152 2024-09-12T00:22:09.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.361+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~P4QUOIE24WK2.0 size=1048576 2024-09-12T00:22:09.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.365+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~P4QUOIE24WK2.1 size=1048576 2024-09-12T00:22:09.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.369+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~P4QUOIE24WK2.2 size=815720 2024-09-12T00:22:09.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.373+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=P4QUOIE24WK2 tag=JSXRKC7D2OP1 type=write size=3961448 2024-09-12T00:22:09.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.377+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=61SQT0BRGCZX type=del size=2412253 2024-09-12T00:22:09.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.381+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~1SH90REIAPCV.0 size=1048576 2024-09-12T00:22:09.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.385+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~1SH90REIAPCV.1 size=678803 2024-09-12T00:22:09.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.389+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=1SH90REIAPCV tag=CMFO15AH34OE type=write size=2775955 2024-09-12T00:22:09.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.393+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=P70FD0UFNMDF type=write size=529651 2024-09-12T00:22:09.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.401+0000 7fd6489978c0 1 < suggested remove operation key=G4EUTQOHAT2E tag=HH0I19EPENX5 type=del 2024-09-12T00:22:09.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.409+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~AI178SJ2825F.0 size=1048576 2024-09-12T00:22:09.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.413+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~AI178SJ2825F.1 size=178471 2024-09-12T00:22:09.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.413+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=AI178SJ2825F tag=4QEZ3DME14B4 type=write size=2275623 2024-09-12T00:22:09.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.417+0000 7fd6489978c0 1 < completed delete operation key=8FBXDX6GELE7 tag=4ET89FBYI8AG type=del 2024-09-12T00:22:09.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.425+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~J1G8ZKZV0RG3.0 size=1048576 2024-09-12T00:22:09.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.425+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~J1G8ZKZV0RG3.1 size=666340 2024-09-12T00:22:09.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.425+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=J1G8ZKZV0RG3 tag=O9W08ARQZNME type=write size=2763492 2024-09-12T00:22:09.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.429+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~IEDZUMW0JKNZ.0 size=1048576 2024-09-12T00:22:09.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.433+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~IEDZUMW0JKNZ.1 size=1048576 2024-09-12T00:22:09.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.437+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~IEDZUMW0JKNZ.2 size=665534 2024-09-12T00:22:09.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.441+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=IEDZUMW0JKNZ tag=9HDH4V3ESW2U type=write size=3811262 2024-09-12T00:22:09.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.449+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~8OUN0PWQ0RNC.0 size=1048576 2024-09-12T00:22:09.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.453+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~8OUN0PWQ0RNC.1 size=486422 2024-09-12T00:22:09.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.453+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=8OUN0PWQ0RNC tag=XZ9K9QB9LF4T type=write size=2583574 2024-09-12T00:22:09.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.457+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=FTI15XPOC865 type=del 2024-09-12T00:22:09.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.461+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=6VBUW8EQ7LBJ type=del size=1356432 2024-09-12T00:22:09.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.465+0000 7fd6489978c0 1 < completed write operation key=ZW51KHCLPYN3 tag=T5D89Z6HY6RQ type=write size=872681 2024-09-12T00:22:09.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.469+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=3DK7FSS9DDRK type=del size=821320 2024-09-12T00:22:09.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.473+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~C4JY9P89QK0L.0 size=1048576 2024-09-12T00:22:09.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.477+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~C4JY9P89QK0L.1 size=376077 2024-09-12T00:22:09.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.481+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=C4JY9P89QK0L tag=P68ZLTLWUHFF type=write size=2473229 2024-09-12T00:22:09.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.489+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~G0F4HC7WKW82.0 size=1048576 2024-09-12T00:22:09.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.493+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~G0F4HC7WKW82.1 size=944542 2024-09-12T00:22:09.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.493+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=G0F4HC7WKW82 tag=Y98EIBPE0A5I type=write size=3041694 2024-09-12T00:22:09.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.497+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~QG2KKS4GNQIE.0 size=1048576 2024-09-12T00:22:09.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.505+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~QG2KKS4GNQIE.1 size=542803 2024-09-12T00:22:09.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.513+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=QG2KKS4GNQIE tag=VX39WK28J6HD type=write size=2639955 2024-09-12T00:22:09.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.517+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~SPI5N3Y0WA2O.0 size=1048576 2024-09-12T00:22:09.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.521+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~SPI5N3Y0WA2O.1 size=1048576 2024-09-12T00:22:09.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.525+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~SPI5N3Y0WA2O.2 size=264018 2024-09-12T00:22:09.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.525+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=SPI5N3Y0WA2O tag=71FGEWI7VVHJ type=write size=3409746 2024-09-12T00:22:09.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.529+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=HICP8HO7GNGW type=del 2024-09-12T00:22:09.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.533+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=N0RL3S0SW3BJ type=del size=2261168 2024-09-12T00:22:09.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.537+0000 7fd6489978c0 1 < canceled operation key=LZICTA4BWOW8 tag=VHH63EZIND0B type=del size=868394 2024-09-12T00:22:09.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.541+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~3TW8QIA4G3L2.0 size=589143 2024-09-12T00:22:09.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.541+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=3TW8QIA4G3L2 tag=T1F30LSY8NE8 type=write size=1637719 2024-09-12T00:22:09.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.545+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=O250498UK6KY type=del 2024-09-12T00:22:09.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.549+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=1OPWQR6UZH0O type=write size=283519 2024-09-12T00:22:09.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.553+0000 7fd6489978c0 1 < completed delete operation key=B2BW7GQ6UN9I tag=RSMSVCYDK281 type=del 2024-09-12T00:22:09.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.561+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~M88T140IZ32C.0 size=60268 2024-09-12T00:22:09.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.561+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=M88T140IZ32C tag=72KKXTYROSAH type=write size=1108844 2024-09-12T00:22:09.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.565+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=RGBNC31EIYJP type=del 2024-09-12T00:22:09.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.569+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=VCYYFE2FO7K0 type=del size=3515653 2024-09-12T00:22:09.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.573+0000 7fd6489978c0 1 < canceled operation key=2KP09UFI3N8B tag=7TNV7XBKBEIP type=del size=234053 2024-09-12T00:22:09.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.577+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=XX2P856N06GL type=write size=865233 2024-09-12T00:22:09.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.581+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~U5UMB2G4OLWT.0 size=1048576 2024-09-12T00:22:09.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.585+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~U5UMB2G4OLWT.1 size=681000 2024-09-12T00:22:09.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.589+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=U5UMB2G4OLWT tag=EKT9RG4EEE1B type=write size=2778152 2024-09-12T00:22:09.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.593+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=43ISFPZFM26W type=write size=125684 2024-09-12T00:22:09.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.597+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=61SQT0BRGCZX type=del 2024-09-12T00:22:09.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.605+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~VSEHQ1PPZU30.0 size=654790 2024-09-12T00:22:09.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.605+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=VSEHQ1PPZU30 tag=AZ14N9A2DK49 type=write size=1703366 2024-09-12T00:22:09.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.613+0000 7fd6489978c0 1 < suggested remove operation key=G4EUTQOHAT2E tag=P70FD0UFNMDF type=write 2024-09-12T00:22:09.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.621+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~3OXOIAHE0R7B.0 size=217484 2024-09-12T00:22:09.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.621+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=3OXOIAHE0R7B tag=CIO7R6B7AIDZ type=write size=1266060 2024-09-12T00:22:09.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.625+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~AI178SJ2825F.0 size=1048576 2024-09-12T00:22:09.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.625+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~AI178SJ2825F.1 size=178471 2024-09-12T00:22:09.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.633+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=AI178SJ2825F tag=4QEZ3DME14B4 type=write size=2275623 2024-09-12T00:22:09.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.641+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~J205FKOSZOPQ.0 size=1048576 2024-09-12T00:22:09.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.641+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~J205FKOSZOPQ.1 size=1048576 2024-09-12T00:22:09.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.645+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~J205FKOSZOPQ.2 size=277479 2024-09-12T00:22:09.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.645+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=J205FKOSZOPQ tag=S772WA166A8M type=write size=3423207 2024-09-12T00:22:09.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.649+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~J1G8ZKZV0RG3.0 size=1048576 2024-09-12T00:22:09.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.649+0000 7fd6489978c0 1 < canceled part key=_multipart_G4EUTQOHAT2E.2~J1G8ZKZV0RG3.1 size=666340 2024-09-12T00:22:09.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.653+0000 7fd6489978c0 1 < canceled multipart upload key=G4EUTQOHAT2E upload=J1G8ZKZV0RG3 tag=O9W08ARQZNME type=write size=2763492 2024-09-12T00:22:09.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.657+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=XV2EFJFTDKHU type=del size=1450179 2024-09-12T00:22:09.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.661+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~8OUN0PWQ0RNC.0 size=1048576 2024-09-12T00:22:09.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.665+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~8OUN0PWQ0RNC.1 size=486422 2024-09-12T00:22:09.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.673+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=8OUN0PWQ0RNC tag=XZ9K9QB9LF4T type=write size=2583574 2024-09-12T00:22:09.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.673+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=EN2PLWPNJS3Y type=del size=2246654 2024-09-12T00:22:09.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.677+0000 7fd6489978c0 -1 < failed to complete operation key=G4EUTQOHAT2E tag=6VBUW8EQ7LBJ type=del size=1356432: (22) Invalid argument 2024-09-12T00:22:09.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.681+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=NT0QYLI7XGSV type=del size=1402027 2024-09-12T00:22:09.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.685+0000 7fd6489978c0 1 < canceled operation key=J5IW4G9C72DH tag=3DK7FSS9DDRK type=del size=821320 2024-09-12T00:22:09.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.689+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=O78J1CCAJE5V type=write size=107093 2024-09-12T00:22:09.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.693+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~G0F4HC7WKW82.0 size=1048576 2024-09-12T00:22:09.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.697+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~G0F4HC7WKW82.1 size=944542 2024-09-12T00:22:09.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.701+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=G0F4HC7WKW82 tag=Y98EIBPE0A5I type=write size=3041694 2024-09-12T00:22:09.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.709+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=561J4T0LA9KO type=del size=3923934 2024-09-12T00:22:09.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.709+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~SPI5N3Y0WA2O.0 size=1048576 2024-09-12T00:22:09.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.713+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~SPI5N3Y0WA2O.1 size=1048576 2024-09-12T00:22:09.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.717+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~SPI5N3Y0WA2O.2 size=264018 2024-09-12T00:22:09.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.721+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=SPI5N3Y0WA2O tag=71FGEWI7VVHJ type=write size=3409746 2024-09-12T00:22:09.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.725+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=YXVHR29NB09P type=del size=1841398 2024-09-12T00:22:09.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.733+0000 7fd6489978c0 1 < suggested remove operation key=F2CTWM0T2698 tag=N0RL3S0SW3BJ type=del 2024-09-12T00:22:09.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.737+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=6G10WKKIOW5I type=write size=982957 2024-09-12T00:22:09.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.741+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~3TW8QIA4G3L2.0 size=589143 2024-09-12T00:22:09.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.749+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=3TW8QIA4G3L2 tag=T1F30LSY8NE8 type=write size=1637719 2024-09-12T00:22:09.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.749+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=9FKXKCNV3VJ7 type=del size=3345672 2024-09-12T00:22:09.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.757+0000 7fd6489978c0 1 < suggested remove operation key=M9YKGQ2GA5CO tag=1OPWQR6UZH0O type=write 2024-09-12T00:22:09.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.761+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=KOWDZLOKQO4W type=del size=4046306 2024-09-12T00:22:09.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.765+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~M88T140IZ32C.0 size=60268 2024-09-12T00:22:09.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.773+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=M88T140IZ32C tag=72KKXTYROSAH type=write size=1108844 2024-09-12T00:22:09.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.781+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~DLHGKR3KHCSS.0 size=1048576 2024-09-12T00:22:09.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.781+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~DLHGKR3KHCSS.1 size=926533 2024-09-12T00:22:09.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.781+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=DLHGKR3KHCSS tag=L574B0P6PQEO type=write size=3023685 2024-09-12T00:22:09.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.785+0000 7fd6489978c0 1 < completed delete operation key=8FBXDX6GELE7 tag=VCYYFE2FO7K0 type=del 2024-09-12T00:22:09.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.793+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~WLU9QS31REHZ.0 size=1048576 2024-09-12T00:22:09.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.797+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~WLU9QS31REHZ.1 size=1048576 2024-09-12T00:22:09.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.797+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~WLU9QS31REHZ.2 size=56756 2024-09-12T00:22:09.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.797+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=WLU9QS31REHZ tag=RUY8GN51TSPT type=write size=3202484 2024-09-12T00:22:09.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.801+0000 7fd6489978c0 1 < completed write operation key=3JZP8TZFEIMH tag=XX2P856N06GL type=write size=865233 2024-09-12T00:22:09.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.809+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~NU22D8P27TH7.0 size=885098 2024-09-12T00:22:09.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.809+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=NU22D8P27TH7 tag=D2BMZI4FHW5P type=write size=1933674 2024-09-12T00:22:09.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.817+0000 7fd6489978c0 1 < suggested remove operation key=JPVKBVRCZTE9 tag=43ISFPZFM26W type=write 2024-09-12T00:22:09.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.821+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=6OO5VYU2I8EU type=del size=1054648 2024-09-12T00:22:09.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.825+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~VSEHQ1PPZU30.0 size=654790 2024-09-12T00:22:09.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.833+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=VSEHQ1PPZU30 tag=AZ14N9A2DK49 type=write size=1703366 2024-09-12T00:22:09.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.837+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=XVBMP9D12LOB type=del size=984229 2024-09-12T00:22:09.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.841+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~3OXOIAHE0R7B.0 size=217484 2024-09-12T00:22:09.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.845+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=3OXOIAHE0R7B tag=CIO7R6B7AIDZ type=write size=1266060 2024-09-12T00:22:09.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.849+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=6X8EM1OWTULD type=del size=58763 2024-09-12T00:22:09.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.853+0000 7fd6489978c0 1 < canceled part key=_multipart_8JCL0F406L7I.2~J205FKOSZOPQ.0 size=1048576 2024-09-12T00:22:09.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.861+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~J205FKOSZOPQ.1 size=1048576 2024-09-12T00:22:09.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.861+0000 7fd6489978c0 1 < canceled part key=_multipart_8JCL0F406L7I.2~J205FKOSZOPQ.2 size=277479 2024-09-12T00:22:09.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.865+0000 7fd6489978c0 1 < canceled multipart upload key=8JCL0F406L7I upload=J205FKOSZOPQ tag=S772WA166A8M type=write size=3423207 2024-09-12T00:22:09.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.869+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=9G418BP8152F type=del size=60199 2024-09-12T00:22:09.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.873+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=XV2EFJFTDKHU type=del 2024-09-12T00:22:09.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.877+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=8X41V4BZYTN2 type=del size=1277866 2024-09-12T00:22:09.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.881+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=EN2PLWPNJS3Y type=del 2024-09-12T00:22:09.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.889+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~QU9COSYA09XM.0 size=1048576 2024-09-12T00:22:09.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.893+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~QU9COSYA09XM.1 size=1048576 2024-09-12T00:22:09.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.897+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~QU9COSYA09XM.2 size=186932 2024-09-12T00:22:09.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.897+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=QU9COSYA09XM tag=N8XQ9HPMAR6J type=write size=3332660 2024-09-12T00:22:09.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.901+0000 7fd6489978c0 1 < suggested remove operation key=9ACGS2FIY7AF tag=NT0QYLI7XGSV type=del 2024-09-12T00:22:09.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.905+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=3NSBBHSG8ZJP type=write size=45593 2024-09-12T00:22:09.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.909+0000 7fd6489978c0 1 < completed write operation key=N4S6I47NSJK6 tag=O78J1CCAJE5V type=write size=107093 2024-09-12T00:22:09.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.913+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=KRLB2QJ2ETGA type=del size=1922618 2024-09-12T00:22:09.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.921+0000 7fd6489978c0 1 < canceled operation key=LZICTA4BWOW8 tag=561J4T0LA9KO type=del size=3923934 2024-09-12T00:22:09.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.925+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=SHS3R7N09M35 type=del size=3786526 2024-09-12T00:22:09.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.929+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=YXVHR29NB09P type=del 2024-09-12T00:22:09.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.933+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=K6VI3ZS0YPAB type=del size=2695402 2024-09-12T00:22:09.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.937+0000 7fd6489978c0 1 < completed write operation key=3JZP8TZFEIMH tag=6G10WKKIOW5I type=write size=982957 2024-09-12T00:22:09.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.941+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~XXL0BQAHVKV0.0 size=285334 2024-09-12T00:22:09.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.941+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=XXL0BQAHVKV0 tag=XSWR4TWGTRF2 type=write size=1333910 2024-09-12T00:22:09.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.945+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=9FKXKCNV3VJ7 type=del 2024-09-12T00:22:09.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.953+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~VRCE29R4JWQ0.0 size=224177 2024-09-12T00:22:09.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.953+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=VRCE29R4JWQ0 tag=WTVHYXAENNN5 type=write size=1272753 2024-09-12T00:22:09.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.957+0000 7fd6489978c0 1 < canceled operation key=ZXEIT45BWHXM tag=KOWDZLOKQO4W type=del size=4046306 2024-09-12T00:22:09.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.965+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~DU2R452RYHEP.0 size=1048576 2024-09-12T00:22:09.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.965+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~DU2R452RYHEP.1 size=1048576 2024-09-12T00:22:09.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.969+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~DU2R452RYHEP.2 size=260655 2024-09-12T00:22:09.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.969+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=DU2R452RYHEP tag=J7XX89770VTO type=write size=3406383 2024-09-12T00:22:09.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.969+0000 7fd6489978c0 1 < canceled part key=_multipart_YSPRZ87DZ2OD.2~DLHGKR3KHCSS.0 size=1048576 2024-09-12T00:22:09.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.969+0000 7fd6489978c0 1 < canceled part key=_multipart_YSPRZ87DZ2OD.2~DLHGKR3KHCSS.1 size=926533 2024-09-12T00:22:09.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.977+0000 7fd6489978c0 1 < canceled multipart upload key=YSPRZ87DZ2OD upload=DLHGKR3KHCSS tag=L574B0P6PQEO type=write size=3023685 2024-09-12T00:22:09.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.981+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=ELY5RJCTKBT0 type=del size=4135120 2024-09-12T00:22:09.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.985+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~WLU9QS31REHZ.0 size=1048576 2024-09-12T00:22:09.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.985+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~WLU9QS31REHZ.1 size=1048576 2024-09-12T00:22:09.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.989+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~WLU9QS31REHZ.2 size=56756 2024-09-12T00:22:09.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.997+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=WLU9QS31REHZ tag=RUY8GN51TSPT type=write size=3202484 2024-09-12T00:22:09.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:09.997+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=1X83QR0ECSAQ type=del size=288984 2024-09-12T00:22:10.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.001+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~NU22D8P27TH7.0 size=885098 2024-09-12T00:22:10.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.009+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=NU22D8P27TH7 tag=D2BMZI4FHW5P type=write size=1933674 2024-09-12T00:22:10.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.013+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~RUT7BL16UV7H.0 size=1048576 2024-09-12T00:22:10.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.017+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~RUT7BL16UV7H.1 size=837435 2024-09-12T00:22:10.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.017+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=RUT7BL16UV7H tag=FRY7FS1EU5Z0 type=write size=2934587 2024-09-12T00:22:10.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.021+0000 7fd6489978c0 1 < suggested remove operation key=DAOTTEMK2P2T tag=6OO5VYU2I8EU type=del 2024-09-12T00:22:10.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.025+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=WLGV9SS7JK40 type=del size=1565093 2024-09-12T00:22:10.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.033+0000 7fd6489978c0 1 < suggested remove operation key=K9FD1L86Q05B tag=XVBMP9D12LOB type=del 2024-09-12T00:22:10.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.037+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=ISI5XF8E8TPH type=write size=111160 2024-09-12T00:22:10.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.041+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=6X8EM1OWTULD type=del 2024-09-12T00:22:10.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.045+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~A9Y013DMSJNU.0 size=274633 2024-09-12T00:22:10.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.045+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=A9Y013DMSJNU tag=2EGD622KFDUR type=write size=1323209 2024-09-12T00:22:10.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.049+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=9G418BP8152F type=del 2024-09-12T00:22:10.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.057+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~8F1K90SLORQG.0 size=1048576 2024-09-12T00:22:10.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.057+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~8F1K90SLORQG.1 size=1048576 2024-09-12T00:22:10.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.061+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~8F1K90SLORQG.2 size=319134 2024-09-12T00:22:10.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.061+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=8F1K90SLORQG tag=EPMAGE6VKLAO type=write size=3464862 2024-09-12T00:22:10.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.065+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=8X41V4BZYTN2 type=del 2024-09-12T00:22:10.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.073+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~JGJHHRN576UD.0 size=393196 2024-09-12T00:22:10.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.073+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=JGJHHRN576UD tag=T51N5VEAY65P type=write size=1441772 2024-09-12T00:22:10.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.073+0000 7fd6489978c0 1 < canceled part key=_multipart_ES2BLTWZT6PT.2~QU9COSYA09XM.0 size=1048576 2024-09-12T00:22:10.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.073+0000 7fd6489978c0 1 < canceled part key=_multipart_ES2BLTWZT6PT.2~QU9COSYA09XM.1 size=1048576 2024-09-12T00:22:10.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.077+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~QU9COSYA09XM.2 size=186932 2024-09-12T00:22:10.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.081+0000 7fd6489978c0 1 < canceled multipart upload key=ES2BLTWZT6PT upload=QU9COSYA09XM tag=N8XQ9HPMAR6J type=write size=3332660 2024-09-12T00:22:10.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.085+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=96V97QV6BXV8 type=del size=4010670 2024-09-12T00:22:10.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.089+0000 7fd6489978c0 1 < completed write operation key=ZXEIT45BWHXM tag=3NSBBHSG8ZJP type=write size=45593 2024-09-12T00:22:10.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.093+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=UIZ58RNP625C type=del size=2175714 2024-09-12T00:22:10.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.101+0000 7fd6489978c0 1 < suggested remove operation key=M9YKGQ2GA5CO tag=KRLB2QJ2ETGA type=del 2024-09-12T00:22:10.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.109+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~U947G3Q22ZZJ.0 size=833366 2024-09-12T00:22:10.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.109+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=U947G3Q22ZZJ tag=J22PK1POTDOA type=write size=1881942 2024-09-12T00:22:10.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.113+0000 7fd6489978c0 -1 < failed to complete operation key=M9YKGQ2GA5CO tag=SHS3R7N09M35 type=del size=3786526: (22) Invalid argument 2024-09-12T00:22:10.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.121+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~IUZRROUP0BFD.0 size=1048576 2024-09-12T00:22:10.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.121+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~IUZRROUP0BFD.1 size=41185 2024-09-12T00:22:10.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.121+0000 7fd6489978c0 1 > prepared multipart upload key=DAOTTEMK2P2T upload=IUZRROUP0BFD tag=TV9ZEMW45YFF type=write size=2138337 2024-09-12T00:22:10.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.129+0000 7fd6489978c0 1 < completed delete operation key=B2BW7GQ6UN9I tag=K6VI3ZS0YPAB type=del 2024-09-12T00:22:10.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.133+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~UFCUXMUZYIEB.0 size=1048576 2024-09-12T00:22:10.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.137+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~UFCUXMUZYIEB.1 size=926114 2024-09-12T00:22:10.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.137+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=UFCUXMUZYIEB tag=XA8AKOM61CSO type=write size=3023266 2024-09-12T00:22:10.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.141+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~XXL0BQAHVKV0.0 size=285334 2024-09-12T00:22:10.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.149+0000 7fd6489978c0 1 < completed multipart upload key=CFID1EVBXOVJ upload=XXL0BQAHVKV0 tag=XSWR4TWGTRF2 type=write size=1333910 2024-09-12T00:22:10.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.153+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=1M3PFCRKCDYZ type=del size=3448645 2024-09-12T00:22:10.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.153+0000 7fd6489978c0 1 < canceled part key=_multipart_J5IW4G9C72DH.2~VRCE29R4JWQ0.0 size=224177 2024-09-12T00:22:10.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.157+0000 7fd6489978c0 1 < canceled multipart upload key=J5IW4G9C72DH upload=VRCE29R4JWQ0 tag=WTVHYXAENNN5 type=write size=1272753 2024-09-12T00:22:10.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.161+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=K1FP6HS3B78W type=del size=2969042 2024-09-12T00:22:10.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.165+0000 7fd6489978c0 1 < canceled part key=_multipart_9ACGS2FIY7AF.2~DU2R452RYHEP.0 size=1048576 2024-09-12T00:22:10.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.169+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~DU2R452RYHEP.1 size=1048576 2024-09-12T00:22:10.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.169+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~DU2R452RYHEP.2 size=260655 2024-09-12T00:22:10.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.177+0000 7fd6489978c0 1 < canceled multipart upload key=9ACGS2FIY7AF upload=DU2R452RYHEP tag=J7XX89770VTO type=write size=3406383 2024-09-12T00:22:10.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.181+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~RA3ESWC3I401.0 size=1048576 2024-09-12T00:22:10.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.185+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~RA3ESWC3I401.1 size=970717 2024-09-12T00:22:10.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.185+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=RA3ESWC3I401 tag=1Y8M4LUGSNZM type=write size=3067869 2024-09-12T00:22:10.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.193+0000 7fd6489978c0 1 < suggested remove operation key=8FBXDX6GELE7 tag=ELY5RJCTKBT0 type=del 2024-09-12T00:22:10.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.197+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=WG7GBG7ULN69 type=write size=299747 2024-09-12T00:22:10.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.201+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=1X83QR0ECSAQ type=del 2024-09-12T00:22:10.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.205+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=H0P08A6R042X type=del size=3007825 2024-09-12T00:22:10.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.213+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~RUT7BL16UV7H.0 size=1048576 2024-09-12T00:22:10.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.217+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~RUT7BL16UV7H.1 size=837435 2024-09-12T00:22:10.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.225+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=RUT7BL16UV7H tag=FRY7FS1EU5Z0 type=write size=2934587 2024-09-12T00:22:10.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.229+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=9J317O6SK1YC type=del size=3464440 2024-09-12T00:22:10.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.237+0000 7fd6489978c0 1 < suggested remove operation key=IHYHPKVPWTUL tag=WLGV9SS7JK40 type=del 2024-09-12T00:22:10.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.241+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~MRR640AKWGAV.0 size=1048576 2024-09-12T00:22:10.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.245+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~MRR640AKWGAV.1 size=266225 2024-09-12T00:22:10.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.245+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=MRR640AKWGAV tag=HWA8CIQMNDDH type=write size=2363377 2024-09-12T00:22:10.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.249+0000 7fd6489978c0 1 < completed write operation key=CBXBFK3OXXKG tag=ISI5XF8E8TPH type=write size=111160 2024-09-12T00:22:10.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.253+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=4G0CPLJ3CNAZ type=del size=232402 2024-09-12T00:22:10.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.257+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~A9Y013DMSJNU.0 size=274633 2024-09-12T00:22:10.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.265+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=A9Y013DMSJNU tag=2EGD622KFDUR type=write size=1323209 2024-09-12T00:22:10.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.269+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=ZP7Q30J0G56B type=del size=1278697 2024-09-12T00:22:10.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.273+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~8F1K90SLORQG.0 size=1048576 2024-09-12T00:22:10.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.273+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~8F1K90SLORQG.1 size=1048576 2024-09-12T00:22:10.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.277+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~8F1K90SLORQG.2 size=319134 2024-09-12T00:22:10.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.285+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=8F1K90SLORQG tag=EPMAGE6VKLAO type=write size=3464862 2024-09-12T00:22:10.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.289+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=ESEBBQC20MVN type=del size=918183 2024-09-12T00:22:10.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.289+0000 7fd6489978c0 1 < canceled part key=_multipart_HUKWLE56FRX2.2~JGJHHRN576UD.0 size=393196 2024-09-12T00:22:10.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.293+0000 7fd6489978c0 1 < canceled multipart upload key=HUKWLE56FRX2 upload=JGJHHRN576UD tag=T51N5VEAY65P type=write size=1441772 2024-09-12T00:22:10.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.297+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=GWO6U1XK35HC type=del size=2823300 2024-09-12T00:22:10.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.305+0000 7fd6489978c0 1 < suggested update operation key=KAT2TB3FGAYG tag=96V97QV6BXV8 type=del size=4010670 2024-09-12T00:22:10.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.309+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=M3LQ4VH2ZYLQ type=del size=2624791 2024-09-12T00:22:10.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.317+0000 7fd6489978c0 1 < suggested remove operation key=ZW51KHCLPYN3 tag=UIZ58RNP625C type=del 2024-09-12T00:22:10.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.321+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~MSD3STU87Q11.0 size=1048576 2024-09-12T00:22:10.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.325+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~MSD3STU87Q11.1 size=218702 2024-09-12T00:22:10.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.325+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=MSD3STU87Q11 tag=077UW8C44FVM type=write size=2315854 2024-09-12T00:22:10.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.329+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~U947G3Q22ZZJ.0 size=833366 2024-09-12T00:22:10.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.333+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=U947G3Q22ZZJ tag=J22PK1POTDOA type=write size=1881942 2024-09-12T00:22:10.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.337+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=9K29CH85RT41 type=del size=1143686 2024-09-12T00:22:10.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.341+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~IUZRROUP0BFD.0 size=1048576 2024-09-12T00:22:10.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.345+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~IUZRROUP0BFD.1 size=41185 2024-09-12T00:22:10.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.349+0000 7fd6489978c0 1 < completed multipart upload key=DAOTTEMK2P2T upload=IUZRROUP0BFD tag=TV9ZEMW45YFF type=write size=2138337 2024-09-12T00:22:10.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.353+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=J9CNSSCVSUPG type=del size=483330 2024-09-12T00:22:10.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.357+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~UFCUXMUZYIEB.0 size=1048576 2024-09-12T00:22:10.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.361+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~UFCUXMUZYIEB.1 size=926114 2024-09-12T00:22:10.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.365+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=UFCUXMUZYIEB tag=XA8AKOM61CSO type=write size=3023266 2024-09-12T00:22:10.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.369+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=OX9WBOUCAT2I type=del size=2459200 2024-09-12T00:22:10.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.373+0000 7fd6489978c0 1 < canceled operation key=G4EUTQOHAT2E tag=1M3PFCRKCDYZ type=del size=3448645 2024-09-12T00:22:10.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.381+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~V2DUTDJ63TB0.0 size=434223 2024-09-12T00:22:10.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.381+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=V2DUTDJ63TB0 tag=PQIH277EZ07G type=write size=1482799 2024-09-12T00:22:10.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.389+0000 7fd6489978c0 1 < suggested update operation key=N0AAVPQ6MUQ1 tag=K1FP6HS3B78W type=del size=2969042 2024-09-12T00:22:10.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.393+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=UTJGEAQ0X2GJ type=del size=3451927 2024-09-12T00:22:10.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.393+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~RA3ESWC3I401.0 size=1048576 2024-09-12T00:22:10.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.397+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~RA3ESWC3I401.1 size=970717 2024-09-12T00:22:10.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.405+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=RA3ESWC3I401 tag=1Y8M4LUGSNZM type=write size=3067869 2024-09-12T00:22:10.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.409+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=8ZGJ311GAD2K type=del size=3324041 2024-09-12T00:22:10.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.413+0000 7fd6489978c0 -1 < failed to complete operation key=N0AAVPQ6MUQ1 tag=WG7GBG7ULN69 type=write size=299747: (22) Invalid argument 2024-09-12T00:22:10.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.417+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=KZ98Q16CS3ZQ type=write size=193913 2024-09-12T00:22:10.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.421+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=H0P08A6R042X type=del 2024-09-12T00:22:10.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.425+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=IN099T02MZJK type=del size=559696 2024-09-12T00:22:10.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.429+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=9J317O6SK1YC type=del 2024-09-12T00:22:10.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.429+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=GD83RNG3HP31 type=del size=4079905 2024-09-12T00:22:10.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.433+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~MRR640AKWGAV.0 size=1048576 2024-09-12T00:22:10.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.437+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~MRR640AKWGAV.1 size=266225 2024-09-12T00:22:10.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.445+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=MRR640AKWGAV tag=HWA8CIQMNDDH type=write size=2363377 2024-09-12T00:22:10.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.445+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=Q3EUDVRI3MVI type=del size=2168819 2024-09-12T00:22:10.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.449+0000 7fd6489978c0 1 < completed delete operation key=M9YKGQ2GA5CO tag=4G0CPLJ3CNAZ type=del 2024-09-12T00:22:10.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.453+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=GSOB52F0XF5M type=del size=1175626 2024-09-12T00:22:10.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.457+0000 7fd6489978c0 -1 < failed to complete operation key=KAT2TB3FGAYG tag=ZP7Q30J0G56B type=del size=1278697: (22) Invalid argument 2024-09-12T00:22:10.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.461+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=1THUU5FW0JKQ type=del size=718992 2024-09-12T00:22:10.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.465+0000 7fd6489978c0 1 < completed delete operation key=JPVKBVRCZTE9 tag=ESEBBQC20MVN type=del 2024-09-12T00:22:10.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.473+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~N6G7FT9VJ10P.0 size=955891 2024-09-12T00:22:10.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.473+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=N6G7FT9VJ10P tag=QGW49RBF6PNM type=write size=2004467 2024-09-12T00:22:10.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.477+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=GWO6U1XK35HC type=del 2024-09-12T00:22:10.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.481+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=HLR419S53OH3 type=del size=2147135 2024-09-12T00:22:10.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.485+0000 7fd6489978c0 -1 < failed to complete operation key=N0AAVPQ6MUQ1 tag=M3LQ4VH2ZYLQ type=del size=2624791: (22) Invalid argument 2024-09-12T00:22:10.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.489+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~ZHQOE2OV6T8R.0 size=769465 2024-09-12T00:22:10.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.489+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=ZHQOE2OV6T8R tag=VJ8P4ZMG43NW type=write size=1818041 2024-09-12T00:22:10.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.497+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~MSD3STU87Q11.0 size=1048576 2024-09-12T00:22:10.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.497+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~MSD3STU87Q11.1 size=218702 2024-09-12T00:22:10.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.505+0000 7fd6489978c0 1 < completed multipart upload key=N0AAVPQ6MUQ1 upload=MSD3STU87Q11 tag=077UW8C44FVM type=write size=2315854 2024-09-12T00:22:10.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.509+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=E02O8FYV5A6N type=del size=2268972 2024-09-12T00:22:10.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.513+0000 7fd6489978c0 1 < suggested remove operation key=K9FD1L86Q05B tag=9K29CH85RT41 type=del 2024-09-12T00:22:10.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.517+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=Y7N2390I3KL1 type=del size=3646568 2024-09-12T00:22:10.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.521+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=J9CNSSCVSUPG type=del 2024-09-12T00:22:10.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.529+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~9993ONP22HDB.0 size=1048576 2024-09-12T00:22:10.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.533+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~9993ONP22HDB.1 size=556832 2024-09-12T00:22:10.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.533+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=9993ONP22HDB tag=YZ1WSRT190WZ type=write size=2653984 2024-09-12T00:22:10.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.537+0000 7fd6489978c0 1 < canceled operation key=CFID1EVBXOVJ tag=OX9WBOUCAT2I type=del size=2459200 2024-09-12T00:22:10.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.545+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~29LX285471DK.0 size=1048576 2024-09-12T00:22:10.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.545+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~29LX285471DK.1 size=1048576 2024-09-12T00:22:10.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.549+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~29LX285471DK.2 size=519526 2024-09-12T00:22:10.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.549+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=29LX285471DK tag=IEMTCJ4W7Q5E type=write size=3665254 2024-09-12T00:22:10.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.553+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~V2DUTDJ63TB0.0 size=434223 2024-09-12T00:22:10.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.565+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=V2DUTDJ63TB0 tag=PQIH277EZ07G type=write size=1482799 2024-09-12T00:22:10.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.569+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~TCK6AQ8NOQC9.0 size=572676 2024-09-12T00:22:10.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.569+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=TCK6AQ8NOQC9 tag=69YXEUN6TY6H type=write size=1621252 2024-09-12T00:22:10.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.573+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=UTJGEAQ0X2GJ type=del 2024-09-12T00:22:10.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.581+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~FA2YZPI7DQZQ.0 size=843236 2024-09-12T00:22:10.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.581+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=FA2YZPI7DQZQ tag=HFPS3S8BMYZ2 type=write size=1891812 2024-09-12T00:22:10.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.585+0000 7fd6489978c0 1 < completed delete operation key=JPVKBVRCZTE9 tag=8ZGJ311GAD2K type=del 2024-09-12T00:22:10.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.589+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=W88CFX37X1FM type=del size=3153989 2024-09-12T00:22:10.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.593+0000 7fd6489978c0 1 < completed write operation key=3JZP8TZFEIMH tag=KZ98Q16CS3ZQ type=write size=193913 2024-09-12T00:22:10.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.601+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~I3P2TUCTNTKX.0 size=1048576 2024-09-12T00:22:10.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.605+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~I3P2TUCTNTKX.1 size=1048576 2024-09-12T00:22:10.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.605+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~I3P2TUCTNTKX.2 size=615539 2024-09-12T00:22:10.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.605+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=I3P2TUCTNTKX tag=4YX6L1W6XW56 type=write size=3761267 2024-09-12T00:22:10.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.609+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=IN099T02MZJK type=del 2024-09-12T00:22:10.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.617+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~GB0BCFJAD7F3.0 size=794612 2024-09-12T00:22:10.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.617+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=GB0BCFJAD7F3 tag=UQRAACJLBME7 type=write size=1843188 2024-09-12T00:22:10.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.621+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=GD83RNG3HP31 type=del 2024-09-12T00:22:10.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.629+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~U0REDD20TCXV.0 size=813177 2024-09-12T00:22:10.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.629+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=U0REDD20TCXV tag=LRN1E9UTLKTZ type=write size=1861753 2024-09-12T00:22:10.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.633+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=Q3EUDVRI3MVI type=del 2024-09-12T00:22:10.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.641+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~FM3GP2BET0ZR.0 size=1048576 2024-09-12T00:22:10.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.641+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~FM3GP2BET0ZR.1 size=1048576 2024-09-12T00:22:10.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.645+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~FM3GP2BET0ZR.2 size=526773 2024-09-12T00:22:10.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.645+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=FM3GP2BET0ZR tag=21DNJUYX38TG type=write size=3672501 2024-09-12T00:22:10.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.649+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=GSOB52F0XF5M type=del 2024-09-12T00:22:10.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.657+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~1UBL6BTM2OQ8.0 size=18586 2024-09-12T00:22:10.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.657+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=1UBL6BTM2OQ8 tag=OTE7GW6V36X2 type=write size=1067162 2024-09-12T00:22:10.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.661+0000 7fd6489978c0 1 < completed delete operation key=B2BW7GQ6UN9I tag=1THUU5FW0JKQ type=del 2024-09-12T00:22:10.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.665+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=Y5NEHFNVNARW type=del size=3662907 2024-09-12T00:22:10.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.669+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~N6G7FT9VJ10P.0 size=955891 2024-09-12T00:22:10.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.673+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=N6G7FT9VJ10P tag=QGW49RBF6PNM type=write size=2004467 2024-09-12T00:22:10.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.681+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=3486EBZKWESC type=del size=2012354 2024-09-12T00:22:10.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.685+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=HLR419S53OH3 type=del 2024-09-12T00:22:10.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.693+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~L1A8C64XOA8V.0 size=1048576 2024-09-12T00:22:10.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.693+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~L1A8C64XOA8V.1 size=1011796 2024-09-12T00:22:10.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.693+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=L1A8C64XOA8V tag=8IES69NGTO5J type=write size=3108948 2024-09-12T00:22:10.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.697+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~ZHQOE2OV6T8R.0 size=769465 2024-09-12T00:22:10.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.705+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=ZHQOE2OV6T8R tag=VJ8P4ZMG43NW type=write size=1818041 2024-09-12T00:22:10.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.709+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~O33S7V0RHH86.0 size=1048576 2024-09-12T00:22:10.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.713+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~O33S7V0RHH86.1 size=273752 2024-09-12T00:22:10.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.713+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=O33S7V0RHH86 tag=1PKAA40BAK17 type=write size=2370904 2024-09-12T00:22:10.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.717+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=E02O8FYV5A6N type=del 2024-09-12T00:22:10.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.721+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=4DU1RVSB1MKC type=del size=2671457 2024-09-12T00:22:10.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.725+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=Y7N2390I3KL1 type=del 2024-09-12T00:22:10.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.733+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~BSPM6F6948D1.0 size=1048576 2024-09-12T00:22:10.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.733+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~BSPM6F6948D1.1 size=351397 2024-09-12T00:22:10.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.733+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=BSPM6F6948D1 tag=RZA8NCJVOYS7 type=write size=2448549 2024-09-12T00:22:10.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.741+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~9993ONP22HDB.0 size=1048576 2024-09-12T00:22:10.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.741+0000 7fd6489978c0 1 < canceled part key=_multipart_LZICTA4BWOW8.2~9993ONP22HDB.1 size=556832 2024-09-12T00:22:10.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.745+0000 7fd6489978c0 1 < canceled multipart upload key=LZICTA4BWOW8 upload=9993ONP22HDB tag=YZ1WSRT190WZ type=write size=2653984 2024-09-12T00:22:10.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.749+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=BKYGJ19DLXXM type=write size=395884 2024-09-12T00:22:10.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.753+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~29LX285471DK.0 size=1048576 2024-09-12T00:22:10.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.757+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~29LX285471DK.1 size=1048576 2024-09-12T00:22:10.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.761+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~29LX285471DK.2 size=519526 2024-09-12T00:22:10.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.765+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=29LX285471DK tag=IEMTCJ4W7Q5E type=write size=3665254 2024-09-12T00:22:10.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.773+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~ZGLW048F1V18.0 size=672396 2024-09-12T00:22:10.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.773+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=ZGLW048F1V18 tag=84G2AGSWWRT2 type=write size=1720972 2024-09-12T00:22:10.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.777+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~TCK6AQ8NOQC9.0 size=572676 2024-09-12T00:22:10.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.781+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=TCK6AQ8NOQC9 tag=69YXEUN6TY6H type=write size=1621252 2024-09-12T00:22:10.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.785+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=28KW9A2FZF4Y type=write size=871513 2024-09-12T00:22:10.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.789+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~FA2YZPI7DQZQ.0 size=843236 2024-09-12T00:22:10.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.797+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=FA2YZPI7DQZQ tag=HFPS3S8BMYZ2 type=write size=1891812 2024-09-12T00:22:10.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.805+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~GWZV8ZE79UBZ.0 size=1048576 2024-09-12T00:22:10.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.805+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~GWZV8ZE79UBZ.1 size=182515 2024-09-12T00:22:10.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.805+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=GWZV8ZE79UBZ tag=6I4HCLDU06XD type=write size=2279667 2024-09-12T00:22:10.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.809+0000 7fd6489978c0 1 < canceled operation key=GVPNH3JSO07D tag=W88CFX37X1FM type=del size=3153989 2024-09-12T00:22:10.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.813+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=541GXC7POPVB type=write size=144925 2024-09-12T00:22:10.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.817+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~I3P2TUCTNTKX.0 size=1048576 2024-09-12T00:22:10.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.821+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~I3P2TUCTNTKX.1 size=1048576 2024-09-12T00:22:10.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.825+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~I3P2TUCTNTKX.2 size=615539 2024-09-12T00:22:10.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.829+0000 7fd6489978c0 1 < completed multipart upload key=9ACGS2FIY7AF upload=I3P2TUCTNTKX tag=4YX6L1W6XW56 type=write size=3761267 2024-09-12T00:22:10.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.833+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=MBXET4G1CJYL type=write size=800449 2024-09-12T00:22:10.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.837+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~GB0BCFJAD7F3.0 size=794612 2024-09-12T00:22:10.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.845+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=GB0BCFJAD7F3 tag=UQRAACJLBME7 type=write size=1843188 2024-09-12T00:22:10.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.853+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~Y32TDTERVREP.0 size=1048576 2024-09-12T00:22:10.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.853+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~Y32TDTERVREP.1 size=44712 2024-09-12T00:22:10.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.853+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=Y32TDTERVREP tag=O5I3GKZ2PBH0 type=write size=2141864 2024-09-12T00:22:10.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.857+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~U0REDD20TCXV.0 size=813177 2024-09-12T00:22:10.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.865+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=U0REDD20TCXV tag=LRN1E9UTLKTZ type=write size=1861753 2024-09-12T00:22:10.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.869+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=T2T3R1ZDDHR4 type=del size=2474670 2024-09-12T00:22:10.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.873+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~FM3GP2BET0ZR.0 size=1048576 2024-09-12T00:22:10.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.877+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~FM3GP2BET0ZR.1 size=1048576 2024-09-12T00:22:10.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.877+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~FM3GP2BET0ZR.2 size=526773 2024-09-12T00:22:10.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.885+0000 7fd6489978c0 1 < completed multipart upload key=CFID1EVBXOVJ upload=FM3GP2BET0ZR tag=21DNJUYX38TG type=write size=3672501 2024-09-12T00:22:10.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.893+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~O1CDRJSO3G5Y.0 size=1048576 2024-09-12T00:22:10.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.893+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~O1CDRJSO3G5Y.1 size=1048576 2024-09-12T00:22:10.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.897+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~O1CDRJSO3G5Y.2 size=192520 2024-09-12T00:22:10.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.897+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=O1CDRJSO3G5Y tag=FHRPBX8KYYAU type=write size=3338248 2024-09-12T00:22:10.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.905+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~1UBL6BTM2OQ8.0 size=18586 2024-09-12T00:22:10.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.909+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=1UBL6BTM2OQ8 tag=OTE7GW6V36X2 type=write size=1067162 2024-09-12T00:22:10.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.917+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=DXFSBGDQHHIQ type=del size=775414 2024-09-12T00:22:10.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.921+0000 7fd6489978c0 1 < canceled operation key=J5IW4G9C72DH tag=Y5NEHFNVNARW type=del size=3662907 2024-09-12T00:22:10.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.925+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=ZO1LM7OLIT5R type=del size=3562439 2024-09-12T00:22:10.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.933+0000 7fd6489978c0 1 < suggested update operation key=YJJBTNI318EH tag=3486EBZKWESC type=del size=2012354 2024-09-12T00:22:10.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.937+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=ENF6SX4E4O3V type=del size=2884432 2024-09-12T00:22:10.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.941+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~L1A8C64XOA8V.0 size=1048576 2024-09-12T00:22:10.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.945+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~L1A8C64XOA8V.1 size=1011796 2024-09-12T00:22:10.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.949+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=L1A8C64XOA8V tag=8IES69NGTO5J type=write size=3108948 2024-09-12T00:22:10.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.957+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~L07K0EG05OJV.0 size=1048576 2024-09-12T00:22:10.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.961+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~L07K0EG05OJV.1 size=319504 2024-09-12T00:22:10.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.961+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=L07K0EG05OJV tag=NOD4VRBFLZ6S type=write size=2416656 2024-09-12T00:22:10.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.965+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~O33S7V0RHH86.0 size=1048576 2024-09-12T00:22:10.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.969+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~O33S7V0RHH86.1 size=273752 2024-09-12T00:22:10.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.973+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=O33S7V0RHH86 tag=1PKAA40BAK17 type=write size=2370904 2024-09-12T00:22:10.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.977+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=K8I1WRXZRIPS type=del size=3197940 2024-09-12T00:22:10.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.981+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=4DU1RVSB1MKC type=del 2024-09-12T00:22:10.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.989+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~5XRGCI2XMOVQ.0 size=1048576 2024-09-12T00:22:10.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.993+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~5XRGCI2XMOVQ.1 size=228564 2024-09-12T00:22:10.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.993+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=5XRGCI2XMOVQ tag=QRHLFFEZ9GCC type=write size=2325716 2024-09-12T00:22:10.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:10.997+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~BSPM6F6948D1.0 size=1048576 2024-09-12T00:22:10.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.001+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~BSPM6F6948D1.1 size=351397 2024-09-12T00:22:11.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.009+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=BSPM6F6948D1 tag=RZA8NCJVOYS7 type=write size=2448549 2024-09-12T00:22:11.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.013+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=0AFMGUBT3VTR type=del size=919644 2024-09-12T00:22:11.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.017+0000 7fd6489978c0 1 < completed write operation key=GVPNH3JSO07D tag=BKYGJ19DLXXM type=write size=395884 2024-09-12T00:22:11.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.021+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=6I8ULO95L224 type=write size=365613 2024-09-12T00:22:11.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.025+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~ZGLW048F1V18.0 size=672396 2024-09-12T00:22:11.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.029+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=ZGLW048F1V18 tag=84G2AGSWWRT2 type=write size=1720972 2024-09-12T00:22:11.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.037+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~HXTA9GAVALOY.0 size=1048576 2024-09-12T00:22:11.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.041+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~HXTA9GAVALOY.1 size=1048576 2024-09-12T00:22:11.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.045+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~HXTA9GAVALOY.2 size=795240 2024-09-12T00:22:11.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.045+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=HXTA9GAVALOY tag=U6EA3X012M43 type=write size=3940968 2024-09-12T00:22:11.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.045+0000 7fd6489978c0 1 < canceled operation key=N0AAVPQ6MUQ1 tag=28KW9A2FZF4Y type=write size=871513 2024-09-12T00:22:11.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.049+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=OPRDJVPFZWRS type=del size=2299218 2024-09-12T00:22:11.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.053+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~GWZV8ZE79UBZ.0 size=1048576 2024-09-12T00:22:11.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.057+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~GWZV8ZE79UBZ.1 size=182515 2024-09-12T00:22:11.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.065+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=GWZV8ZE79UBZ tag=6I4HCLDU06XD type=write size=2279667 2024-09-12T00:22:11.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.069+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~QBR82RFCXJDU.0 size=981699 2024-09-12T00:22:11.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.069+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=QBR82RFCXJDU tag=IZWWST3B9SVL type=write size=2030275 2024-09-12T00:22:11.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.077+0000 7fd6489978c0 1 < completed write operation key=LZICTA4BWOW8 tag=541GXC7POPVB type=write size=144925 2024-09-12T00:22:11.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.081+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=E06IW3LLS0ZS type=del size=657851 2024-09-12T00:22:11.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.085+0000 7fd6489978c0 1 < completed write operation key=9ACGS2FIY7AF tag=MBXET4G1CJYL type=write size=800449 2024-09-12T00:22:11.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.085+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=VBMDXP6WW0W9 type=del size=1455453 2024-09-12T00:22:11.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.089+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~Y32TDTERVREP.0 size=1048576 2024-09-12T00:22:11.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.093+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~Y32TDTERVREP.1 size=44712 2024-09-12T00:22:11.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.097+0000 7fd6489978c0 1 < completed multipart upload key=GVPNH3JSO07D upload=Y32TDTERVREP tag=O5I3GKZ2PBH0 type=write size=2141864 2024-09-12T00:22:11.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.101+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=VYZPN09AQK7O type=del size=1398720 2024-09-12T00:22:11.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.105+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=T2T3R1ZDDHR4 type=del 2024-09-12T00:22:11.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.105+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=F2LHAKYGSJI2 type=write size=266603 2024-09-12T00:22:11.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.109+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~O1CDRJSO3G5Y.0 size=1048576 2024-09-12T00:22:11.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.109+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~O1CDRJSO3G5Y.1 size=1048576 2024-09-12T00:22:11.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.113+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~O1CDRJSO3G5Y.2 size=192520 2024-09-12T00:22:11.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.117+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=O1CDRJSO3G5Y tag=FHRPBX8KYYAU type=write size=3338248 2024-09-12T00:22:11.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.121+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~Q4N1QT55G6NS.0 size=1048576 2024-09-12T00:22:11.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.125+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~Q4N1QT55G6NS.1 size=1048576 2024-09-12T00:22:11.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.125+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~Q4N1QT55G6NS.2 size=534545 2024-09-12T00:22:11.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.125+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=Q4N1QT55G6NS tag=BXOKTDG7NPWI type=write size=3680273 2024-09-12T00:22:11.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.129+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=DXFSBGDQHHIQ type=del 2024-09-12T00:22:11.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.133+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~IKN6NECL7LHD.0 size=1048576 2024-09-12T00:22:11.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.137+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~IKN6NECL7LHD.1 size=1048576 2024-09-12T00:22:11.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.137+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~IKN6NECL7LHD.2 size=223936 2024-09-12T00:22:11.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.137+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=IKN6NECL7LHD tag=TZEN0Z5OXGRH type=write size=3369664 2024-09-12T00:22:11.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.141+0000 7fd6489978c0 1 < suggested remove operation key=Y3JFVW74FNT6 tag=ZO1LM7OLIT5R type=del 2024-09-12T00:22:11.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.149+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~M3KQQ0R69XC8.0 size=1048576 2024-09-12T00:22:11.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.149+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~M3KQQ0R69XC8.1 size=880456 2024-09-12T00:22:11.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.149+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=M3KQQ0R69XC8 tag=IKJMCUSQONJ0 type=write size=2977608 2024-09-12T00:22:11.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.157+0000 7fd6489978c0 1 < suggested remove operation key=F2CTWM0T2698 tag=ENF6SX4E4O3V type=del 2024-09-12T00:22:11.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.161+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~I7CDXC4XJW17.0 size=1048576 2024-09-12T00:22:11.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.161+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~I7CDXC4XJW17.1 size=202001 2024-09-12T00:22:11.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.161+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=I7CDXC4XJW17 tag=M5SRFWD7TE2F type=write size=2299153 2024-09-12T00:22:11.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.165+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~L07K0EG05OJV.0 size=1048576 2024-09-12T00:22:11.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.169+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~L07K0EG05OJV.1 size=319504 2024-09-12T00:22:11.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.173+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=L07K0EG05OJV tag=NOD4VRBFLZ6S type=write size=2416656 2024-09-12T00:22:11.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.177+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~TDVJWTUL9EL4.0 size=1048576 2024-09-12T00:22:11.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.181+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~TDVJWTUL9EL4.1 size=1048576 2024-09-12T00:22:11.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.181+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~TDVJWTUL9EL4.2 size=7787 2024-09-12T00:22:11.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.181+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=TDVJWTUL9EL4 tag=5LOK6AN73T18 type=write size=3153515 2024-09-12T00:22:11.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.185+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=K8I1WRXZRIPS type=del 2024-09-12T00:22:11.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.189+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=Y0YQHCJM1F99 type=write size=183244 2024-09-12T00:22:11.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.193+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~5XRGCI2XMOVQ.0 size=1048576 2024-09-12T00:22:11.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.193+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~5XRGCI2XMOVQ.1 size=228564 2024-09-12T00:22:11.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.201+0000 7fd6489978c0 1 < completed multipart upload key=J5IW4G9C72DH upload=5XRGCI2XMOVQ tag=QRHLFFEZ9GCC type=write size=2325716 2024-09-12T00:22:11.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.205+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~0Q5CQCJIVS59.0 size=1048576 2024-09-12T00:22:11.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.209+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~0Q5CQCJIVS59.1 size=341543 2024-09-12T00:22:11.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.209+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=0Q5CQCJIVS59 tag=IGRPIRPR5FPD type=write size=2438695 2024-09-12T00:22:11.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.213+0000 7fd6489978c0 1 < canceled operation key=B2BW7GQ6UN9I tag=0AFMGUBT3VTR type=del size=919644 2024-09-12T00:22:11.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.217+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~0QT55J455QDZ.0 size=1048576 2024-09-12T00:22:11.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.221+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~0QT55J455QDZ.1 size=711670 2024-09-12T00:22:11.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.221+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=0QT55J455QDZ tag=OIOY76I4GFEH type=write size=2808822 2024-09-12T00:22:11.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.233+0000 7fd6489978c0 1 < suggested remove operation key=LZICTA4BWOW8 tag=6I8ULO95L224 type=write 2024-09-12T00:22:11.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.237+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~O09EWHQBGAKW.0 size=1048576 2024-09-12T00:22:11.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.241+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~O09EWHQBGAKW.1 size=655026 2024-09-12T00:22:11.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.241+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=O09EWHQBGAKW tag=TT5DAZGZX39H type=write size=2752178 2024-09-12T00:22:11.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.245+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~HXTA9GAVALOY.0 size=1048576 2024-09-12T00:22:11.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.245+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~HXTA9GAVALOY.1 size=1048576 2024-09-12T00:22:11.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.249+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~HXTA9GAVALOY.2 size=795240 2024-09-12T00:22:11.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.257+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=HXTA9GAVALOY tag=U6EA3X012M43 type=write size=3940968 2024-09-12T00:22:11.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.261+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~82QZ2R0RMSGU.0 size=1048576 2024-09-12T00:22:11.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.265+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~82QZ2R0RMSGU.1 size=311202 2024-09-12T00:22:11.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.265+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=82QZ2R0RMSGU tag=1RA8FG4U7SQP type=write size=2408354 2024-09-12T00:22:11.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.269+0000 7fd6489978c0 -1 < failed to complete operation key=LZICTA4BWOW8 tag=OPRDJVPFZWRS type=del size=2299218: (22) Invalid argument 2024-09-12T00:22:11.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.269+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=A7VGVCE1HOG7 type=del size=1860559 2024-09-12T00:22:11.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.273+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~QBR82RFCXJDU.0 size=981699 2024-09-12T00:22:11.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.277+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=QBR82RFCXJDU tag=IZWWST3B9SVL type=write size=2030275 2024-09-12T00:22:11.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.285+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~JFRLUJ4JJBA1.0 size=1048576 2024-09-12T00:22:11.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.285+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~JFRLUJ4JJBA1.1 size=935576 2024-09-12T00:22:11.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.285+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=JFRLUJ4JJBA1 tag=T9QQQOV9WPE5 type=write size=3032728 2024-09-12T00:22:11.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.289+0000 7fd6489978c0 -1 < failed to complete operation key=Y3JFVW74FNT6 tag=E06IW3LLS0ZS type=del size=657851: (22) Invalid argument 2024-09-12T00:22:11.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.293+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=YRA09NMZNAUI type=del size=1195600 2024-09-12T00:22:11.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.293+0000 7fd6489978c0 -1 < failed to complete operation key=Y3JFVW74FNT6 tag=VBMDXP6WW0W9 type=del size=1455453: (22) Invalid argument 2024-09-12T00:22:11.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.297+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=8A42Y2VAWW05 type=del size=2269704 2024-09-12T00:22:11.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.301+0000 7fd6489978c0 -1 < no bi entry to suggest for operation key=Y3JFVW74FNT6 tag=VYZPN09AQK7O type=del size=1398720: (2) No such file or directory 2024-09-12T00:22:11.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.301+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=3Q24VVD3G521 type=write size=165549 2024-09-12T00:22:11.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.305+0000 7fd6489978c0 1 < canceled operation key=ZW51KHCLPYN3 tag=F2LHAKYGSJI2 type=write size=266603 2024-09-12T00:22:11.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.313+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~0VCUOM6EZW05.0 size=1048576 2024-09-12T00:22:11.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.313+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~0VCUOM6EZW05.1 size=528932 2024-09-12T00:22:11.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.313+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=0VCUOM6EZW05 tag=QO18CCIXZ67U type=write size=2626084 2024-09-12T00:22:11.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.317+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~Q4N1QT55G6NS.0 size=1048576 2024-09-12T00:22:11.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.317+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~Q4N1QT55G6NS.1 size=1048576 2024-09-12T00:22:11.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.321+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~Q4N1QT55G6NS.2 size=534545 2024-09-12T00:22:11.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.325+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=Q4N1QT55G6NS tag=BXOKTDG7NPWI type=write size=3680273 2024-09-12T00:22:11.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.329+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=DQ1OE92R9E5R type=del size=2544346 2024-09-12T00:22:11.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.333+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~IKN6NECL7LHD.0 size=1048576 2024-09-12T00:22:11.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.337+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~IKN6NECL7LHD.1 size=1048576 2024-09-12T00:22:11.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.337+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~IKN6NECL7LHD.2 size=223936 2024-09-12T00:22:11.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.345+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=IKN6NECL7LHD tag=TZEN0Z5OXGRH type=write size=3369664 2024-09-12T00:22:11.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.349+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~UGPKL3PHB2DA.0 size=504746 2024-09-12T00:22:11.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.349+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=UGPKL3PHB2DA tag=O87C39W6UVP6 type=write size=1553322 2024-09-12T00:22:11.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.353+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~M3KQQ0R69XC8.0 size=1048576 2024-09-12T00:22:11.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.353+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~M3KQQ0R69XC8.1 size=880456 2024-09-12T00:22:11.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.361+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=M3KQQ0R69XC8 tag=IKJMCUSQONJ0 type=write size=2977608 2024-09-12T00:22:11.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.365+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~GY516AUZ11ER.0 size=914528 2024-09-12T00:22:11.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.365+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=GY516AUZ11ER tag=KILIVRQSWORS type=write size=1963104 2024-09-12T00:22:11.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.369+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~I7CDXC4XJW17.0 size=1048576 2024-09-12T00:22:11.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.373+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~I7CDXC4XJW17.1 size=202001 2024-09-12T00:22:11.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.377+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=I7CDXC4XJW17 tag=M5SRFWD7TE2F type=write size=2299153 2024-09-12T00:22:11.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.381+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=8UI7DBUNWAV7 type=del size=139004 2024-09-12T00:22:11.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.385+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~TDVJWTUL9EL4.0 size=1048576 2024-09-12T00:22:11.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.385+0000 7fd6489978c0 1 < canceled part key=_multipart_9CK160BK5YYY.2~TDVJWTUL9EL4.1 size=1048576 2024-09-12T00:22:11.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.385+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~TDVJWTUL9EL4.2 size=7787 2024-09-12T00:22:11.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.393+0000 7fd6489978c0 1 < canceled multipart upload key=9CK160BK5YYY upload=TDVJWTUL9EL4 tag=5LOK6AN73T18 type=write size=3153515 2024-09-12T00:22:11.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.397+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=BEZ2BI4VSVV1 type=write size=89490 2024-09-12T00:22:11.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.397+0000 7fd6489978c0 1 < completed write operation key=ZW51KHCLPYN3 tag=Y0YQHCJM1F99 type=write size=183244 2024-09-12T00:22:11.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.401+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=ORIT3VUEBFI0 type=del size=1055145 2024-09-12T00:22:11.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.405+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~0Q5CQCJIVS59.0 size=1048576 2024-09-12T00:22:11.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.405+0000 7fd6489978c0 1 < canceled part key=_multipart_CBXBFK3OXXKG.2~0Q5CQCJIVS59.1 size=341543 2024-09-12T00:22:11.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.409+0000 7fd6489978c0 1 < canceled multipart upload key=CBXBFK3OXXKG upload=0Q5CQCJIVS59 tag=IGRPIRPR5FPD type=write size=2438695 2024-09-12T00:22:11.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.413+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=3JFW20V7IT1S type=write size=324762 2024-09-12T00:22:11.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.417+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~0QT55J455QDZ.0 size=1048576 2024-09-12T00:22:11.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.417+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~0QT55J455QDZ.1 size=711670 2024-09-12T00:22:11.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.425+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=0QT55J455QDZ tag=OIOY76I4GFEH type=write size=2808822 2024-09-12T00:22:11.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.425+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=PV14A9E6K313 type=del size=1329238 2024-09-12T00:22:11.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.429+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~O09EWHQBGAKW.0 size=1048576 2024-09-12T00:22:11.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.429+0000 7fd6489978c0 1 < canceled part key=_multipart_CFID1EVBXOVJ.2~O09EWHQBGAKW.1 size=655026 2024-09-12T00:22:11.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.437+0000 7fd6489978c0 1 < canceled multipart upload key=CFID1EVBXOVJ upload=O09EWHQBGAKW tag=TT5DAZGZX39H type=write size=2752178 2024-09-12T00:22:11.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.437+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=9VPRK4PB6ZZB type=write size=1015504 2024-09-12T00:22:11.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.441+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~82QZ2R0RMSGU.0 size=1048576 2024-09-12T00:22:11.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.445+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~82QZ2R0RMSGU.1 size=311202 2024-09-12T00:22:11.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.449+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=82QZ2R0RMSGU tag=1RA8FG4U7SQP type=write size=2408354 2024-09-12T00:22:11.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.453+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=ZMW9FJMSFL8X type=del size=3900949 2024-09-12T00:22:11.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.457+0000 7fd6489978c0 1 < completed delete operation key=M9YKGQ2GA5CO tag=A7VGVCE1HOG7 type=del 2024-09-12T00:22:11.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.461+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=YEZ7RT750KG0 type=del size=2078841 2024-09-12T00:22:11.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.461+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~JFRLUJ4JJBA1.0 size=1048576 2024-09-12T00:22:11.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.465+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~JFRLUJ4JJBA1.1 size=935576 2024-09-12T00:22:11.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.469+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=JFRLUJ4JJBA1 tag=T9QQQOV9WPE5 type=write size=3032728 2024-09-12T00:22:11.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.477+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~WLNFN3L3YU1W.0 size=782694 2024-09-12T00:22:11.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.477+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=WLNFN3L3YU1W tag=ECUBTXZ1YJL7 type=write size=1831270 2024-09-12T00:22:11.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.481+0000 7fd6489978c0 1 < completed delete operation key=M9YKGQ2GA5CO tag=YRA09NMZNAUI type=del 2024-09-12T00:22:11.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.485+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~XHW10D9U6OR8.0 size=1048576 2024-09-12T00:22:11.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.489+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~XHW10D9U6OR8.1 size=1048576 2024-09-12T00:22:11.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.489+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~XHW10D9U6OR8.2 size=155428 2024-09-12T00:22:11.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.489+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=XHW10D9U6OR8 tag=9LQ1JAH4B541 type=write size=3301156 2024-09-12T00:22:11.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.497+0000 7fd6489978c0 1 < suggested remove operation key=M9YKGQ2GA5CO tag=8A42Y2VAWW05 type=del 2024-09-12T00:22:11.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.501+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=ZXFS88A1TDC0 type=write size=49611 2024-09-12T00:22:11.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.505+0000 7fd6489978c0 1 < completed write operation key=LZICTA4BWOW8 tag=3Q24VVD3G521 type=write size=165549 2024-09-12T00:22:11.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.509+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=O6NKWNA0B4K3 type=write size=937224 2024-09-12T00:22:11.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.509+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~0VCUOM6EZW05.0 size=1048576 2024-09-12T00:22:11.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.513+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~0VCUOM6EZW05.1 size=528932 2024-09-12T00:22:11.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.521+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=0VCUOM6EZW05 tag=QO18CCIXZ67U type=write size=2626084 2024-09-12T00:22:11.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.525+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=IH73HJ6RS4N0 type=write size=18404 2024-09-12T00:22:11.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.529+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=DQ1OE92R9E5R type=del 2024-09-12T00:22:11.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.533+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=TM7CRDFC2BQV type=write size=534521 2024-09-12T00:22:11.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.537+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~UGPKL3PHB2DA.0 size=504746 2024-09-12T00:22:11.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.545+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=UGPKL3PHB2DA tag=O87C39W6UVP6 type=write size=1553322 2024-09-12T00:22:11.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.549+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~P4CVI22M24T2.0 size=956085 2024-09-12T00:22:11.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.549+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=P4CVI22M24T2 tag=LQ0VHKA5U9WZ type=write size=2004661 2024-09-12T00:22:11.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.557+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~GY516AUZ11ER.0 size=914528 2024-09-12T00:22:11.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.561+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=GY516AUZ11ER tag=KILIVRQSWORS type=write size=1963104 2024-09-12T00:22:11.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.565+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~UETRD7XJLD2F.0 size=1048576 2024-09-12T00:22:11.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.569+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~UETRD7XJLD2F.1 size=1048576 2024-09-12T00:22:11.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.573+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~UETRD7XJLD2F.2 size=463268 2024-09-12T00:22:11.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.573+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=UETRD7XJLD2F tag=JD5Q8A0X8OVB type=write size=3608996 2024-09-12T00:22:11.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.577+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=8UI7DBUNWAV7 type=del 2024-09-12T00:22:11.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.581+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~45XFTDT45YV1.0 size=859666 2024-09-12T00:22:11.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.581+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=45XFTDT45YV1 tag=AHTP3NEECD9S type=write size=1908242 2024-09-12T00:22:11.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.585+0000 7fd6489978c0 1 < completed write operation key=IHYHPKVPWTUL tag=BEZ2BI4VSVV1 type=write size=89490 2024-09-12T00:22:11.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.593+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~2EWVSPD0KBTQ.0 size=1048576 2024-09-12T00:22:11.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.597+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~2EWVSPD0KBTQ.1 size=1048576 2024-09-12T00:22:11.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.601+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~2EWVSPD0KBTQ.2 size=685523 2024-09-12T00:22:11.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.601+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=2EWVSPD0KBTQ tag=0AZQK77N2H9E type=write size=3831251 2024-09-12T00:22:11.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.609+0000 7fd6489978c0 1 < suggested remove operation key=9ACGS2FIY7AF tag=ORIT3VUEBFI0 type=del 2024-09-12T00:22:11.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.613+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=YU9HME10X85M type=del size=2581329 2024-09-12T00:22:11.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.613+0000 7fd6489978c0 -1 < failed to complete operation key=M9YKGQ2GA5CO tag=3JFW20V7IT1S type=write size=324762: (22) Invalid argument 2024-09-12T00:22:11.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.621+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=CVB82GT6A4MK type=del size=1846761 2024-09-12T00:22:11.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.625+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=PV14A9E6K313 type=del 2024-09-12T00:22:11.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.625+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=QJXSUK2F9A3E type=del size=2639674 2024-09-12T00:22:11.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.629+0000 7fd6489978c0 1 < completed write operation key=YJJBTNI318EH tag=9VPRK4PB6ZZB type=write size=1015504 2024-09-12T00:22:11.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.633+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=5W3ZWZ8Z3SZN type=del size=3094650 2024-09-12T00:22:11.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.637+0000 7fd6489978c0 1 < completed delete operation key=8FBXDX6GELE7 tag=ZMW9FJMSFL8X type=del 2024-09-12T00:22:11.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.641+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=SMRLRG68TN05 type=write size=412500 2024-09-12T00:22:11.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.645+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=YEZ7RT750KG0 type=del 2024-09-12T00:22:11.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.649+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=3SP3CATSQZGG type=del size=1475419 2024-09-12T00:22:11.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.653+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~WLNFN3L3YU1W.0 size=782694 2024-09-12T00:22:11.658 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.661+0000 7fd6489978c0 1 < completed multipart upload key=GVPNH3JSO07D upload=WLNFN3L3YU1W tag=ECUBTXZ1YJL7 type=write size=1831270 2024-09-12T00:22:11.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.665+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=Y5GU20ZRYQIH type=del size=1511996 2024-09-12T00:22:11.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.669+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~XHW10D9U6OR8.0 size=1048576 2024-09-12T00:22:11.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.673+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~XHW10D9U6OR8.1 size=1048576 2024-09-12T00:22:11.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.673+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~XHW10D9U6OR8.2 size=155428 2024-09-12T00:22:11.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.681+0000 7fd6489978c0 1 < completed multipart upload key=N0AAVPQ6MUQ1 upload=XHW10D9U6OR8 tag=9LQ1JAH4B541 type=write size=3301156 2024-09-12T00:22:11.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.685+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=Q0PQSLJ3WZD4 type=del size=3480533 2024-09-12T00:22:11.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.685+0000 7fd6489978c0 1 < completed write operation key=LZICTA4BWOW8 tag=ZXFS88A1TDC0 type=write size=49611 2024-09-12T00:22:11.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.689+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=LE5UQFTFWJFZ type=del size=1848476 2024-09-12T00:22:11.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.693+0000 7fd6489978c0 1 < completed write operation key=QBS4N1KGR1JB tag=O6NKWNA0B4K3 type=write size=937224 2024-09-12T00:22:11.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.701+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~BSYA47R7ETDO.0 size=1048576 2024-09-12T00:22:11.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.701+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~BSYA47R7ETDO.1 size=1048576 2024-09-12T00:22:11.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.705+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~BSYA47R7ETDO.2 size=717761 2024-09-12T00:22:11.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.705+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=BSYA47R7ETDO tag=R0OA2GWRKDMD type=write size=3863489 2024-09-12T00:22:11.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.713+0000 7fd6489978c0 1 < suggested update operation key=YSPRZ87DZ2OD tag=IH73HJ6RS4N0 type=write size=18404 2024-09-12T00:22:11.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.717+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~45TUGIWFNCKL.0 size=1048576 2024-09-12T00:22:11.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.721+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~45TUGIWFNCKL.1 size=1048576 2024-09-12T00:22:11.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.725+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~45TUGIWFNCKL.2 size=39021 2024-09-12T00:22:11.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.725+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=45TUGIWFNCKL tag=UV3T4DS79DAL type=write size=3184749 2024-09-12T00:22:11.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.725+0000 7fd6489978c0 1 < completed write operation key=25P4P2I6BE3H tag=TM7CRDFC2BQV type=write size=534521 2024-09-12T00:22:11.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.733+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~BJ438W4FPNVP.0 size=1048576 2024-09-12T00:22:11.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.737+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~BJ438W4FPNVP.1 size=85293 2024-09-12T00:22:11.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.737+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=BJ438W4FPNVP tag=XRZHOHAJDD8V type=write size=2182445 2024-09-12T00:22:11.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.741+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~P4CVI22M24T2.0 size=956085 2024-09-12T00:22:11.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.745+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=P4CVI22M24T2 tag=LQ0VHKA5U9WZ type=write size=2004661 2024-09-12T00:22:11.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.749+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=TZ8WHAT74OMX type=del size=3939049 2024-09-12T00:22:11.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.753+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~UETRD7XJLD2F.0 size=1048576 2024-09-12T00:22:11.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.757+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~UETRD7XJLD2F.1 size=1048576 2024-09-12T00:22:11.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.761+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~UETRD7XJLD2F.2 size=463268 2024-09-12T00:22:11.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.765+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=UETRD7XJLD2F tag=JD5Q8A0X8OVB type=write size=3608996 2024-09-12T00:22:11.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.773+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~SF1KTTGO4WMA.0 size=1048576 2024-09-12T00:22:11.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.777+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~SF1KTTGO4WMA.1 size=1048576 2024-09-12T00:22:11.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.777+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~SF1KTTGO4WMA.2 size=208721 2024-09-12T00:22:11.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.777+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=SF1KTTGO4WMA tag=FMRC114D7Y8E type=write size=3354449 2024-09-12T00:22:11.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.781+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~45XFTDT45YV1.0 size=859666 2024-09-12T00:22:11.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.789+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=45XFTDT45YV1 tag=AHTP3NEECD9S type=write size=1908242 2024-09-12T00:22:11.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.793+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=G9W0Q7TQ0KFK type=del size=2945406 2024-09-12T00:22:11.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.797+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~2EWVSPD0KBTQ.0 size=1048576 2024-09-12T00:22:11.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.797+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~2EWVSPD0KBTQ.1 size=1048576 2024-09-12T00:22:11.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.801+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~2EWVSPD0KBTQ.2 size=685523 2024-09-12T00:22:11.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.805+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=2EWVSPD0KBTQ tag=0AZQK77N2H9E type=write size=3831251 2024-09-12T00:22:11.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.809+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=HO6YNXL8ECL8 type=del size=2414497 2024-09-12T00:22:11.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.817+0000 7fd6489978c0 1 < suggested remove operation key=ZW51KHCLPYN3 tag=YU9HME10X85M type=del 2024-09-12T00:22:11.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.825+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~832FUGJHEIJI.0 size=1048576 2024-09-12T00:22:11.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.829+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~832FUGJHEIJI.1 size=737396 2024-09-12T00:22:11.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.829+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=832FUGJHEIJI tag=KABLCZYD8EB8 type=write size=2834548 2024-09-12T00:22:11.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.833+0000 7fd6489978c0 1 < suggested update operation key=8JCL0F406L7I tag=CVB82GT6A4MK type=del size=1846761 2024-09-12T00:22:11.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.841+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~QHUSDJEV4P52.0 size=1048576 2024-09-12T00:22:11.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.845+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~QHUSDJEV4P52.1 size=1048576 2024-09-12T00:22:11.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.849+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~QHUSDJEV4P52.2 size=664001 2024-09-12T00:22:11.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.849+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=QHUSDJEV4P52 tag=RLWGRR3V03P5 type=write size=3809729 2024-09-12T00:22:11.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.857+0000 7fd6489978c0 1 < suggested update operation key=JPVKBVRCZTE9 tag=QJXSUK2F9A3E type=del size=2639674 2024-09-12T00:22:11.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.869+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~6S88N4QT0LJP.0 size=1048576 2024-09-12T00:22:11.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.869+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~6S88N4QT0LJP.1 size=41757 2024-09-12T00:22:11.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.869+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=6S88N4QT0LJP tag=SQNRS4OFC7BL type=write size=2138909 2024-09-12T00:22:11.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.873+0000 7fd6489978c0 1 < canceled operation key=F2CTWM0T2698 tag=5W3ZWZ8Z3SZN type=del size=3094650 2024-09-12T00:22:11.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.877+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=382LT6R3E4O3 type=del size=167444 2024-09-12T00:22:11.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.881+0000 7fd6489978c0 1 < completed write operation key=N0AAVPQ6MUQ1 tag=SMRLRG68TN05 type=write size=412500 2024-09-12T00:22:11.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.885+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=ORNFOM2OVB3D type=write size=689516 2024-09-12T00:22:11.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.889+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=3SP3CATSQZGG type=del 2024-09-12T00:22:11.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.897+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~MDWZ14L2XUBI.0 size=157162 2024-09-12T00:22:11.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.897+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=MDWZ14L2XUBI tag=1IC2KLRJTJYE type=write size=1205738 2024-09-12T00:22:11.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.901+0000 7fd6489978c0 1 < canceled operation key=DAOTTEMK2P2T tag=Y5GU20ZRYQIH type=del size=1511996 2024-09-12T00:22:11.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.909+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~8AS39P6QLJC0.0 size=1048576 2024-09-12T00:22:11.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.913+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~8AS39P6QLJC0.1 size=1048576 2024-09-12T00:22:11.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.913+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~8AS39P6QLJC0.2 size=196146 2024-09-12T00:22:11.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.913+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=8AS39P6QLJC0 tag=P5SZHDCS7CSA type=write size=3341874 2024-09-12T00:22:11.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.917+0000 7fd6489978c0 1 < canceled operation key=HUKWLE56FRX2 tag=Q0PQSLJ3WZD4 type=del size=3480533 2024-09-12T00:22:11.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.921+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=BQMT3CUP8J4T type=del size=3214580 2024-09-12T00:22:11.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.925+0000 7fd6489978c0 1 < completed delete operation key=RGE8T6BTHBWK tag=LE5UQFTFWJFZ type=del 2024-09-12T00:22:11.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.933+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~BW9F06U347EK.0 size=1048576 2024-09-12T00:22:11.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.937+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~BW9F06U347EK.1 size=1048576 2024-09-12T00:22:11.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.937+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~BW9F06U347EK.2 size=118580 2024-09-12T00:22:11.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.937+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=BW9F06U347EK tag=5RF857ZBJDMH type=write size=3264308 2024-09-12T00:22:11.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.941+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~BSYA47R7ETDO.0 size=1048576 2024-09-12T00:22:11.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.945+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~BSYA47R7ETDO.1 size=1048576 2024-09-12T00:22:11.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.945+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~BSYA47R7ETDO.2 size=717761 2024-09-12T00:22:11.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.953+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=BSYA47R7ETDO tag=R0OA2GWRKDMD type=write size=3863489 2024-09-12T00:22:11.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.961+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~3PNS3ITWW8G3.0 size=1048576 2024-09-12T00:22:11.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.961+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~3PNS3ITWW8G3.1 size=1048576 2024-09-12T00:22:11.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.965+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~3PNS3ITWW8G3.2 size=810248 2024-09-12T00:22:11.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.965+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=3PNS3ITWW8G3 tag=JQ9959A22HRV type=write size=3955976 2024-09-12T00:22:11.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.965+0000 7fd6489978c0 1 < canceled part key=_multipart_CBXBFK3OXXKG.2~45TUGIWFNCKL.0 size=1048576 2024-09-12T00:22:11.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.965+0000 7fd6489978c0 1 < canceled part key=_multipart_CBXBFK3OXXKG.2~45TUGIWFNCKL.1 size=1048576 2024-09-12T00:22:11.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.969+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~45TUGIWFNCKL.2 size=39021 2024-09-12T00:22:11.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.973+0000 7fd6489978c0 1 < canceled multipart upload key=CBXBFK3OXXKG upload=45TUGIWFNCKL tag=UV3T4DS79DAL type=write size=3184749 2024-09-12T00:22:11.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.981+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~8LCRX45OTFIB.0 size=1048576 2024-09-12T00:22:11.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.985+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~8LCRX45OTFIB.1 size=1048576 2024-09-12T00:22:11.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.985+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~8LCRX45OTFIB.2 size=232145 2024-09-12T00:22:11.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.985+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=8LCRX45OTFIB tag=72DE0NEGND3M type=write size=3377873 2024-09-12T00:22:11.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.989+0000 7fd6489978c0 1 < canceled part key=_multipart_JPVKBVRCZTE9.2~BJ438W4FPNVP.0 size=1048576 2024-09-12T00:22:11.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.989+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~BJ438W4FPNVP.1 size=85293 2024-09-12T00:22:11.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:11.997+0000 7fd6489978c0 1 < canceled multipart upload key=JPVKBVRCZTE9 upload=BJ438W4FPNVP tag=XRZHOHAJDD8V type=write size=2182445 2024-09-12T00:22:11.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.001+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=8ULS8SJAANSA type=del size=2754971 2024-09-12T00:22:12.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.005+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=TZ8WHAT74OMX type=del 2024-09-12T00:22:12.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.009+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=8YCUYP5UNK7I type=del size=673053 2024-09-12T00:22:12.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.009+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~SF1KTTGO4WMA.0 size=1048576 2024-09-12T00:22:12.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.009+0000 7fd6489978c0 1 < canceled part key=_multipart_GVPNH3JSO07D.2~SF1KTTGO4WMA.1 size=1048576 2024-09-12T00:22:12.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.013+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~SF1KTTGO4WMA.2 size=208721 2024-09-12T00:22:12.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.021+0000 7fd6489978c0 1 < canceled multipart upload key=GVPNH3JSO07D upload=SF1KTTGO4WMA tag=FMRC114D7Y8E type=write size=3354449 2024-09-12T00:22:12.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.025+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~T87F93Q1EYCQ.0 size=1048576 2024-09-12T00:22:12.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.029+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~T87F93Q1EYCQ.1 size=1048576 2024-09-12T00:22:12.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.033+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~T87F93Q1EYCQ.2 size=340915 2024-09-12T00:22:12.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.033+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=T87F93Q1EYCQ tag=U0B75J0KH8J7 type=write size=3486643 2024-09-12T00:22:12.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.033+0000 7fd6489978c0 1 < canceled operation key=8FBXDX6GELE7 tag=G9W0Q7TQ0KFK type=del size=2945406 2024-09-12T00:22:12.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.037+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=LZ8U77CKNG4Y type=del size=1847847 2024-09-12T00:22:12.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.041+0000 7fd6489978c0 1 < canceled operation key=K9FD1L86Q05B tag=HO6YNXL8ECL8 type=del size=2414497 2024-09-12T00:22:12.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.045+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=SKNBW87ETXKE type=del size=470675 2024-09-12T00:22:12.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.049+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~832FUGJHEIJI.0 size=1048576 2024-09-12T00:22:12.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.053+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~832FUGJHEIJI.1 size=737396 2024-09-12T00:22:12.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.057+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=832FUGJHEIJI tag=KABLCZYD8EB8 type=write size=2834548 2024-09-12T00:22:12.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.065+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~QBKOOYNIO1QL.0 size=202906 2024-09-12T00:22:12.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.065+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=QBKOOYNIO1QL tag=Z11AES8YELPP type=write size=1251482 2024-09-12T00:22:12.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.065+0000 7fd6489978c0 1 < canceled part key=_multipart_JPVKBVRCZTE9.2~QHUSDJEV4P52.0 size=1048576 2024-09-12T00:22:12.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.069+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~QHUSDJEV4P52.1 size=1048576 2024-09-12T00:22:12.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.073+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~QHUSDJEV4P52.2 size=664001 2024-09-12T00:22:12.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.077+0000 7fd6489978c0 1 < canceled multipart upload key=JPVKBVRCZTE9 upload=QHUSDJEV4P52 tag=RLWGRR3V03P5 type=write size=3809729 2024-09-12T00:22:12.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.081+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=X051WW0Z4XQU type=write size=156675 2024-09-12T00:22:12.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.085+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~6S88N4QT0LJP.0 size=1048576 2024-09-12T00:22:12.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.089+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~6S88N4QT0LJP.1 size=41757 2024-09-12T00:22:12.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.093+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=6S88N4QT0LJP tag=SQNRS4OFC7BL type=write size=2138909 2024-09-12T00:22:12.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.101+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~1Z1IUPGHES31.0 size=1048576 2024-09-12T00:22:12.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.105+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~1Z1IUPGHES31.1 size=1048576 2024-09-12T00:22:12.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.105+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~1Z1IUPGHES31.2 size=855466 2024-09-12T00:22:12.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.105+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=1Z1IUPGHES31 tag=F7SNB7OOS46G type=write size=4001194 2024-09-12T00:22:12.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.109+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=382LT6R3E4O3 type=del 2024-09-12T00:22:12.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.117+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~QXIT65HGVVL1.0 size=587599 2024-09-12T00:22:12.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.117+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=QXIT65HGVVL1 tag=9NCAO3ZN9NFV type=write size=1636175 2024-09-12T00:22:12.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.121+0000 7fd6489978c0 1 < completed write operation key=N4S6I47NSJK6 tag=ORNFOM2OVB3D type=write size=689516 2024-09-12T00:22:12.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.129+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~XAYR26C6XR0W.0 size=880017 2024-09-12T00:22:12.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.129+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=XAYR26C6XR0W tag=EW6ZWPBQUQWQ type=write size=1928593 2024-09-12T00:22:12.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.133+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~MDWZ14L2XUBI.0 size=157162 2024-09-12T00:22:12.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.137+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=MDWZ14L2XUBI tag=1IC2KLRJTJYE type=write size=1205738 2024-09-12T00:22:12.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.141+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=A1BG4HV4X1V0 type=del size=3647044 2024-09-12T00:22:12.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.145+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~8AS39P6QLJC0.0 size=1048576 2024-09-12T00:22:12.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.149+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~8AS39P6QLJC0.1 size=1048576 2024-09-12T00:22:12.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.149+0000 7fd6489978c0 1 < canceled part key=_multipart_G4EUTQOHAT2E.2~8AS39P6QLJC0.2 size=196146 2024-09-12T00:22:12.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.157+0000 7fd6489978c0 1 < canceled multipart upload key=G4EUTQOHAT2E upload=8AS39P6QLJC0 tag=P5SZHDCS7CSA type=write size=3341874 2024-09-12T00:22:12.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.161+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~495N0H8XHT2B.0 size=85120 2024-09-12T00:22:12.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.161+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=495N0H8XHT2B tag=RVQDCWQX6VN9 type=write size=1133696 2024-09-12T00:22:12.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.165+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=BQMT3CUP8J4T type=del 2024-09-12T00:22:12.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.173+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~AV2E6U7PFUH1.0 size=1048576 2024-09-12T00:22:12.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.177+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~AV2E6U7PFUH1.1 size=1048576 2024-09-12T00:22:12.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.177+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~AV2E6U7PFUH1.2 size=422151 2024-09-12T00:22:12.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.177+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=AV2E6U7PFUH1 tag=8FKONRHYB0A0 type=write size=3567879 2024-09-12T00:22:12.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.181+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~BW9F06U347EK.0 size=1048576 2024-09-12T00:22:12.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.185+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~BW9F06U347EK.1 size=1048576 2024-09-12T00:22:12.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.189+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~BW9F06U347EK.2 size=118580 2024-09-12T00:22:12.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.197+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=BW9F06U347EK tag=5RF857ZBJDMH type=write size=3264308 2024-09-12T00:22:12.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.205+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=M6CYAIF7MM2E type=write size=945181 2024-09-12T00:22:12.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.205+0000 7fd6489978c0 1 < canceled part key=_multipart_ZW51KHCLPYN3.2~3PNS3ITWW8G3.0 size=1048576 2024-09-12T00:22:12.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.205+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~3PNS3ITWW8G3.1 size=1048576 2024-09-12T00:22:12.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.209+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~3PNS3ITWW8G3.2 size=810248 2024-09-12T00:22:12.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.217+0000 7fd6489978c0 1 < canceled multipart upload key=ZW51KHCLPYN3 upload=3PNS3ITWW8G3 tag=JQ9959A22HRV type=write size=3955976 2024-09-12T00:22:12.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.225+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~VEMYFC5T5UU6.0 size=1048576 2024-09-12T00:22:12.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.225+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~VEMYFC5T5UU6.1 size=970788 2024-09-12T00:22:12.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.225+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=VEMYFC5T5UU6 tag=ZHSUQ0M4WL2G type=write size=3067940 2024-09-12T00:22:12.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.229+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~8LCRX45OTFIB.0 size=1048576 2024-09-12T00:22:12.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.233+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~8LCRX45OTFIB.1 size=1048576 2024-09-12T00:22:12.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.237+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~8LCRX45OTFIB.2 size=232145 2024-09-12T00:22:12.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.241+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=8LCRX45OTFIB tag=72DE0NEGND3M type=write size=3377873 2024-09-12T00:22:12.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.249+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~AGG4P1TLHFLH.0 size=1048576 2024-09-12T00:22:12.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.249+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~AGG4P1TLHFLH.1 size=982435 2024-09-12T00:22:12.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.249+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=AGG4P1TLHFLH tag=9R80PEK79IJH type=write size=3079587 2024-09-12T00:22:12.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.257+0000 7fd6489978c0 1 < suggested update operation key=GVPNH3JSO07D tag=8ULS8SJAANSA type=del size=2754971 2024-09-12T00:22:12.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.261+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=F8131UO3FI2O type=del size=2001171 2024-09-12T00:22:12.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.269+0000 7fd6489978c0 1 < suggested remove operation key=F2CTWM0T2698 tag=8YCUYP5UNK7I type=del 2024-09-12T00:22:12.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.273+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~IEKJM035ZOHR.0 size=1048576 2024-09-12T00:22:12.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.277+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~IEKJM035ZOHR.1 size=923206 2024-09-12T00:22:12.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.277+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=IEKJM035ZOHR tag=JB2OX183LQPK type=write size=3020358 2024-09-12T00:22:12.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.281+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~T87F93Q1EYCQ.0 size=1048576 2024-09-12T00:22:12.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.285+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~T87F93Q1EYCQ.1 size=1048576 2024-09-12T00:22:12.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.285+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~T87F93Q1EYCQ.2 size=340915 2024-09-12T00:22:12.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.293+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=T87F93Q1EYCQ tag=U0B75J0KH8J7 type=write size=3486643 2024-09-12T00:22:12.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.297+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=MCQI6YSG3LL7 type=del size=2070750 2024-09-12T00:22:12.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.297+0000 7fd6489978c0 1 < completed delete operation key=LZICTA4BWOW8 tag=LZ8U77CKNG4Y type=del 2024-09-12T00:22:12.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.305+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~JH09PZ3OZ557.0 size=1048576 2024-09-12T00:22:12.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.309+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~JH09PZ3OZ557.1 size=118080 2024-09-12T00:22:12.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.309+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=JH09PZ3OZ557 tag=FIHQJB3KS3GX type=write size=2215232 2024-09-12T00:22:12.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.309+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=SKNBW87ETXKE type=del 2024-09-12T00:22:12.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.317+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~DYO4WNBBF945.0 size=1048576 2024-09-12T00:22:12.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.321+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~DYO4WNBBF945.1 size=401217 2024-09-12T00:22:12.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.321+0000 7fd6489978c0 1 > prepared multipart upload key=DAOTTEMK2P2T upload=DYO4WNBBF945 tag=ACLM0GG02Z28 type=write size=2498369 2024-09-12T00:22:12.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.325+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~QBKOOYNIO1QL.0 size=202906 2024-09-12T00:22:12.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.329+0000 7fd6489978c0 1 < completed multipart upload key=CFID1EVBXOVJ upload=QBKOOYNIO1QL tag=Z11AES8YELPP type=write size=1251482 2024-09-12T00:22:12.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.333+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=3E1DERL6FC1H type=del size=1481785 2024-09-12T00:22:12.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.337+0000 7fd6489978c0 -1 < failed to complete operation key=GVPNH3JSO07D tag=X051WW0Z4XQU type=write size=156675: (22) Invalid argument 2024-09-12T00:22:12.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.341+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=IRMWDH0W4GEP type=del size=3346974 2024-09-12T00:22:12.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.341+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~1Z1IUPGHES31.0 size=1048576 2024-09-12T00:22:12.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.345+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~1Z1IUPGHES31.1 size=1048576 2024-09-12T00:22:12.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.345+0000 7fd6489978c0 1 < canceled part key=_multipart_2KP09UFI3N8B.2~1Z1IUPGHES31.2 size=855466 2024-09-12T00:22:12.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.353+0000 7fd6489978c0 1 < canceled multipart upload key=2KP09UFI3N8B upload=1Z1IUPGHES31 tag=F7SNB7OOS46G type=write size=4001194 2024-09-12T00:22:12.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.357+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~5NWLC8O8MP61.0 size=538187 2024-09-12T00:22:12.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.357+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=5NWLC8O8MP61 tag=GNHS4YWFW3OW type=write size=1586763 2024-09-12T00:22:12.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.361+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~QXIT65HGVVL1.0 size=587599 2024-09-12T00:22:12.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.365+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=QXIT65HGVVL1 tag=9NCAO3ZN9NFV type=write size=1636175 2024-09-12T00:22:12.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.373+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~LHOZEVD17V0G.0 size=365430 2024-09-12T00:22:12.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.373+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=LHOZEVD17V0G tag=XEZV2W406C61 type=write size=1414006 2024-09-12T00:22:12.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.377+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~XAYR26C6XR0W.0 size=880017 2024-09-12T00:22:12.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.385+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=XAYR26C6XR0W tag=EW6ZWPBQUQWQ type=write size=1928593 2024-09-12T00:22:12.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.389+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~LU4BMWW6GZAM.0 size=1048576 2024-09-12T00:22:12.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.393+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~LU4BMWW6GZAM.1 size=124319 2024-09-12T00:22:12.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.393+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=LU4BMWW6GZAM tag=9AGL4G7HFK6F type=write size=2221471 2024-09-12T00:22:12.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.401+0000 7fd6489978c0 1 < suggested remove operation key=G4EUTQOHAT2E tag=A1BG4HV4X1V0 type=del 2024-09-12T00:22:12.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.405+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=CVHCET6JJQEE type=del size=1475031 2024-09-12T00:22:12.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.405+0000 7fd6489978c0 1 < canceled part key=_multipart_F2CTWM0T2698.2~495N0H8XHT2B.0 size=85120 2024-09-12T00:22:12.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.413+0000 7fd6489978c0 1 < canceled multipart upload key=F2CTWM0T2698 upload=495N0H8XHT2B tag=RVQDCWQX6VN9 type=write size=1133696 2024-09-12T00:22:12.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.413+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=GZ5S5IJM1H9X type=del size=3200273 2024-09-12T00:22:12.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.417+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~AV2E6U7PFUH1.0 size=1048576 2024-09-12T00:22:12.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.421+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~AV2E6U7PFUH1.1 size=1048576 2024-09-12T00:22:12.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.425+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~AV2E6U7PFUH1.2 size=422151 2024-09-12T00:22:12.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.429+0000 7fd6489978c0 1 < completed multipart upload key=G4EUTQOHAT2E upload=AV2E6U7PFUH1 tag=8FKONRHYB0A0 type=write size=3567879 2024-09-12T00:22:12.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.433+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=N8XDF3EMKJQ1 type=del size=197697 2024-09-12T00:22:12.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.437+0000 7fd6489978c0 1 < completed write operation key=B2BW7GQ6UN9I tag=M6CYAIF7MM2E type=write size=945181 2024-09-12T00:22:12.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.437+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=QTO4I3VVU38X type=del size=1988271 2024-09-12T00:22:12.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.441+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~VEMYFC5T5UU6.0 size=1048576 2024-09-12T00:22:12.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.441+0000 7fd6489978c0 1 < canceled part key=_multipart_ZXEIT45BWHXM.2~VEMYFC5T5UU6.1 size=970788 2024-09-12T00:22:12.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.449+0000 7fd6489978c0 1 < canceled multipart upload key=ZXEIT45BWHXM upload=VEMYFC5T5UU6 tag=ZHSUQ0M4WL2G type=write size=3067940 2024-09-12T00:22:12.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.449+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=NIAFG1Q2XSWU type=del size=1269585 2024-09-12T00:22:12.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.453+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~AGG4P1TLHFLH.0 size=1048576 2024-09-12T00:22:12.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.457+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~AGG4P1TLHFLH.1 size=982435 2024-09-12T00:22:12.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.461+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=AGG4P1TLHFLH tag=9R80PEK79IJH type=write size=3079587 2024-09-12T00:22:12.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.465+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=9WLA9SXTC7JK type=del size=2111552 2024-09-12T00:22:12.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.469+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=F8131UO3FI2O type=del 2024-09-12T00:22:12.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.473+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=L5V4KPI6I8YR type=del size=2411578 2024-09-12T00:22:12.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.477+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~IEKJM035ZOHR.0 size=1048576 2024-09-12T00:22:12.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.481+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~IEKJM035ZOHR.1 size=923206 2024-09-12T00:22:12.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.485+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=IEKJM035ZOHR tag=JB2OX183LQPK type=write size=3020358 2024-09-12T00:22:12.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.489+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=FRSM8TFK01KG type=del size=2425592 2024-09-12T00:22:12.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.493+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=MCQI6YSG3LL7 type=del 2024-09-12T00:22:12.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.501+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~UIZYWO47W1BS.0 size=1048576 2024-09-12T00:22:12.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.505+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~UIZYWO47W1BS.1 size=507443 2024-09-12T00:22:12.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.505+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=UIZYWO47W1BS tag=QUYLNSTV3M37 type=write size=2604595 2024-09-12T00:22:12.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.509+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~JH09PZ3OZ557.0 size=1048576 2024-09-12T00:22:12.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.513+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~JH09PZ3OZ557.1 size=118080 2024-09-12T00:22:12.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.517+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=JH09PZ3OZ557 tag=FIHQJB3KS3GX type=write size=2215232 2024-09-12T00:22:12.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.529+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~4DXYC1ZKT5AG.0 size=1048576 2024-09-12T00:22:12.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.529+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~4DXYC1ZKT5AG.1 size=783102 2024-09-12T00:22:12.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.529+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=4DXYC1ZKT5AG tag=90I2BW6QB6P3 type=write size=2880254 2024-09-12T00:22:12.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.533+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~DYO4WNBBF945.0 size=1048576 2024-09-12T00:22:12.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.537+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~DYO4WNBBF945.1 size=401217 2024-09-12T00:22:12.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.541+0000 7fd6489978c0 1 < completed multipart upload key=DAOTTEMK2P2T upload=DYO4WNBBF945 tag=ACLM0GG02Z28 type=write size=2498369 2024-09-12T00:22:12.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.545+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=K2ZAYY9AYLMV type=write size=1035716 2024-09-12T00:22:12.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.553+0000 7fd6489978c0 1 < suggested update operation key=ES2BLTWZT6PT tag=3E1DERL6FC1H type=del size=1481785 2024-09-12T00:22:12.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.557+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=R65ASJ22GHH8 type=write size=284042 2024-09-12T00:22:12.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.561+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=IRMWDH0W4GEP type=del 2024-09-12T00:22:12.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.565+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=TA88WWWM8I6I type=del size=3853859 2024-09-12T00:22:12.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.569+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~5NWLC8O8MP61.0 size=538187 2024-09-12T00:22:12.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.577+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=5NWLC8O8MP61 tag=GNHS4YWFW3OW type=write size=1586763 2024-09-12T00:22:12.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.581+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=8SWFNQGZ57W1 type=del size=259443 2024-09-12T00:22:12.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.585+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~LHOZEVD17V0G.0 size=365430 2024-09-12T00:22:12.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.589+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=LHOZEVD17V0G tag=XEZV2W406C61 type=write size=1414006 2024-09-12T00:22:12.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.597+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~C7PVJ4CW3AEK.0 size=1005552 2024-09-12T00:22:12.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.597+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=C7PVJ4CW3AEK tag=P7HHD5WCG8TG type=write size=2054128 2024-09-12T00:22:12.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.597+0000 7fd6489978c0 1 < canceled part key=_multipart_KAT2TB3FGAYG.2~LU4BMWW6GZAM.0 size=1048576 2024-09-12T00:22:12.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.597+0000 7fd6489978c0 1 < canceled part key=_multipart_KAT2TB3FGAYG.2~LU4BMWW6GZAM.1 size=124319 2024-09-12T00:22:12.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.605+0000 7fd6489978c0 1 < canceled multipart upload key=KAT2TB3FGAYG upload=LU4BMWW6GZAM tag=9AGL4G7HFK6F type=write size=2221471 2024-09-12T00:22:12.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.613+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~YEWRF7EQKSKF.0 size=1048576 2024-09-12T00:22:12.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.613+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~YEWRF7EQKSKF.1 size=511996 2024-09-12T00:22:12.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.613+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=YEWRF7EQKSKF tag=RQE2YQY123UE type=write size=2609148 2024-09-12T00:22:12.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.617+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=CVHCET6JJQEE type=del 2024-09-12T00:22:12.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.621+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=73X2DNH9RZDV type=del size=3411755 2024-09-12T00:22:12.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.625+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=GZ5S5IJM1H9X type=del 2024-09-12T00:22:12.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.629+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=U0SXYEY5P0IF type=del size=390331 2024-09-12T00:22:12.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.633+0000 7fd6489978c0 1 < canceled operation key=KAT2TB3FGAYG tag=N8XDF3EMKJQ1 type=del size=197697 2024-09-12T00:22:12.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.641+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~A08HZ4P6FYH7.0 size=1048576 2024-09-12T00:22:12.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.645+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~A08HZ4P6FYH7.1 size=466789 2024-09-12T00:22:12.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.645+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=A08HZ4P6FYH7 tag=BV274DVYJ22W type=write size=2563941 2024-09-12T00:22:12.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.649+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=QTO4I3VVU38X type=del 2024-09-12T00:22:12.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.653+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~H4I0WNW3G3N8.0 size=1048576 2024-09-12T00:22:12.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.657+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~H4I0WNW3G3N8.1 size=56912 2024-09-12T00:22:12.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.657+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=H4I0WNW3G3N8 tag=G9TBYCDN8F33 type=write size=2154064 2024-09-12T00:22:12.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.661+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=NIAFG1Q2XSWU type=del 2024-09-12T00:22:12.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.669+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~UUSIC36U6JTO.0 size=1048576 2024-09-12T00:22:12.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.669+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~UUSIC36U6JTO.1 size=1048576 2024-09-12T00:22:12.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.673+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~UUSIC36U6JTO.2 size=612796 2024-09-12T00:22:12.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.673+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=UUSIC36U6JTO tag=JEDZTA2ABUTZ type=write size=3758524 2024-09-12T00:22:12.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.677+0000 7fd6489978c0 1 < completed delete operation key=8FBXDX6GELE7 tag=9WLA9SXTC7JK type=del 2024-09-12T00:22:12.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.685+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~LQ9Q7ONVRKFP.0 size=1048576 2024-09-12T00:22:12.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.689+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~LQ9Q7ONVRKFP.1 size=1048576 2024-09-12T00:22:12.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.689+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~LQ9Q7ONVRKFP.2 size=522249 2024-09-12T00:22:12.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.689+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=LQ9Q7ONVRKFP tag=IPP143KRSFKW type=write size=3667977 2024-09-12T00:22:12.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.697+0000 7fd6489978c0 1 < suggested remove operation key=CFID1EVBXOVJ tag=L5V4KPI6I8YR type=del 2024-09-12T00:22:12.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.701+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=STMYXY3NF38A type=del size=2621186 2024-09-12T00:22:12.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.705+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=FRSM8TFK01KG type=del 2024-09-12T00:22:12.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.713+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~3TQL4UOUG2FI.0 size=1004711 2024-09-12T00:22:12.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.713+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=3TQL4UOUG2FI tag=42VWW143HIVE type=write size=2053287 2024-09-12T00:22:12.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.717+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~UIZYWO47W1BS.0 size=1048576 2024-09-12T00:22:12.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.721+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~UIZYWO47W1BS.1 size=507443 2024-09-12T00:22:12.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.725+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=UIZYWO47W1BS tag=QUYLNSTV3M37 type=write size=2604595 2024-09-12T00:22:12.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.733+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~U094MS3S74T9.0 size=1048576 2024-09-12T00:22:12.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.737+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~U094MS3S74T9.1 size=1048576 2024-09-12T00:22:12.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.741+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~U094MS3S74T9.2 size=343399 2024-09-12T00:22:12.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.741+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=U094MS3S74T9 tag=DE3W6U67PU0D type=write size=3489127 2024-09-12T00:22:12.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.745+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~4DXYC1ZKT5AG.0 size=1048576 2024-09-12T00:22:12.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.745+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~4DXYC1ZKT5AG.1 size=783102 2024-09-12T00:22:12.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.753+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=4DXYC1ZKT5AG tag=90I2BW6QB6P3 type=write size=2880254 2024-09-12T00:22:12.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.757+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=QFQAKW7XNGMZ type=del size=1956594 2024-09-12T00:22:12.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.761+0000 7fd6489978c0 1 < completed write operation key=8FBXDX6GELE7 tag=K2ZAYY9AYLMV type=write size=1035716 2024-09-12T00:22:12.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.765+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=QIU4RM8Z2B8R type=del size=169878 2024-09-12T00:22:12.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.769+0000 7fd6489978c0 1 < completed write operation key=DAOTTEMK2P2T tag=R65ASJ22GHH8 type=write size=284042 2024-09-12T00:22:12.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.773+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=AUHK0YCXFR7N type=del size=1973226 2024-09-12T00:22:12.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.777+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=TA88WWWM8I6I type=del 2024-09-12T00:22:12.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.781+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=NS1989SYE597 type=del size=1327272 2024-09-12T00:22:12.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.789+0000 7fd6489978c0 1 < suggested update operation key=ZW51KHCLPYN3 tag=8SWFNQGZ57W1 type=del size=259443 2024-09-12T00:22:12.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.793+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=19YU59S80CXG type=write size=1019718 2024-09-12T00:22:12.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.797+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~C7PVJ4CW3AEK.0 size=1005552 2024-09-12T00:22:12.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.801+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=C7PVJ4CW3AEK tag=P7HHD5WCG8TG type=write size=2054128 2024-09-12T00:22:12.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.805+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=SY3TNM11JUJU type=del size=1158748 2024-09-12T00:22:12.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.809+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~YEWRF7EQKSKF.0 size=1048576 2024-09-12T00:22:12.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.813+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~YEWRF7EQKSKF.1 size=511996 2024-09-12T00:22:12.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.821+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=YEWRF7EQKSKF tag=RQE2YQY123UE type=write size=2609148 2024-09-12T00:22:12.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.825+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=N8XYUD7AM8T7 type=write size=140817 2024-09-12T00:22:12.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.833+0000 7fd6489978c0 1 < suggested update operation key=Y3JFVW74FNT6 tag=73X2DNH9RZDV type=del size=3411755 2024-09-12T00:22:12.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.841+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~QCFS1ZZJATLU.0 size=1048576 2024-09-12T00:22:12.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.841+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~QCFS1ZZJATLU.1 size=1048576 2024-09-12T00:22:12.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.845+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~QCFS1ZZJATLU.2 size=273959 2024-09-12T00:22:12.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.845+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=QCFS1ZZJATLU tag=WV4BJ2V4X6A8 type=write size=3419687 2024-09-12T00:22:12.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.853+0000 7fd6489978c0 1 < suggested remove operation key=9CK160BK5YYY tag=U0SXYEY5P0IF type=del 2024-09-12T00:22:12.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.857+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=4N39466LNKFG type=del size=995008 2024-09-12T00:22:12.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.861+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~A08HZ4P6FYH7.0 size=1048576 2024-09-12T00:22:12.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.865+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~A08HZ4P6FYH7.1 size=466789 2024-09-12T00:22:12.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.869+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=A08HZ4P6FYH7 tag=BV274DVYJ22W type=write size=2563941 2024-09-12T00:22:12.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.881+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~VWGPHC69FQ20.0 size=18528 2024-09-12T00:22:12.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.881+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=VWGPHC69FQ20 tag=MYWEFAN3JRPB type=write size=1067104 2024-09-12T00:22:12.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.885+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~H4I0WNW3G3N8.0 size=1048576 2024-09-12T00:22:12.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.889+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~H4I0WNW3G3N8.1 size=56912 2024-09-12T00:22:12.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.897+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=H4I0WNW3G3N8 tag=G9TBYCDN8F33 type=write size=2154064 2024-09-12T00:22:12.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.901+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=RU0HML6N2176 type=del size=3754003 2024-09-12T00:22:12.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.905+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~UUSIC36U6JTO.0 size=1048576 2024-09-12T00:22:12.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.909+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~UUSIC36U6JTO.1 size=1048576 2024-09-12T00:22:12.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.909+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~UUSIC36U6JTO.2 size=612796 2024-09-12T00:22:12.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.917+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=UUSIC36U6JTO tag=JEDZTA2ABUTZ type=write size=3758524 2024-09-12T00:22:12.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.925+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~MBSL0UJMKZVY.0 size=43819 2024-09-12T00:22:12.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.925+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=MBSL0UJMKZVY tag=LBL95N0YUY0S type=write size=1092395 2024-09-12T00:22:12.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.929+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~LQ9Q7ONVRKFP.0 size=1048576 2024-09-12T00:22:12.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.933+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~LQ9Q7ONVRKFP.1 size=1048576 2024-09-12T00:22:12.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.937+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~LQ9Q7ONVRKFP.2 size=522249 2024-09-12T00:22:12.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.941+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=LQ9Q7ONVRKFP tag=IPP143KRSFKW type=write size=3667977 2024-09-12T00:22:12.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.949+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~K62C5BAV01VT.0 size=1048576 2024-09-12T00:22:12.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.953+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~K62C5BAV01VT.1 size=1048576 2024-09-12T00:22:12.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.957+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~K62C5BAV01VT.2 size=565216 2024-09-12T00:22:12.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.957+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=K62C5BAV01VT tag=NYHZ2ZORI7P2 type=write size=3710944 2024-09-12T00:22:12.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.961+0000 7fd6489978c0 -1 < failed to complete operation key=ZW51KHCLPYN3 tag=STMYXY3NF38A type=del size=2621186: (22) Invalid argument 2024-09-12T00:22:12.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.965+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=9JQB7GRT1RKB type=write size=611549 2024-09-12T00:22:12.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.969+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~3TQL4UOUG2FI.0 size=1004711 2024-09-12T00:22:12.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.977+0000 7fd6489978c0 1 < completed multipart upload key=N0AAVPQ6MUQ1 upload=3TQL4UOUG2FI tag=42VWW143HIVE type=write size=2053287 2024-09-12T00:22:12.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.985+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~T2XTSAZNK9FE.0 size=47013 2024-09-12T00:22:12.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.985+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=T2XTSAZNK9FE tag=G8UL17XU4Z4G type=write size=1095589 2024-09-12T00:22:12.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.989+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~U094MS3S74T9.0 size=1048576 2024-09-12T00:22:12.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.989+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~U094MS3S74T9.1 size=1048576 2024-09-12T00:22:12.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.993+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~U094MS3S74T9.2 size=343399 2024-09-12T00:22:12.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:12.997+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=U094MS3S74T9 tag=DE3W6U67PU0D type=write size=3489127 2024-09-12T00:22:13.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.005+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~7BS8Z5K7FWZ9.0 size=1048576 2024-09-12T00:22:13.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.009+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~7BS8Z5K7FWZ9.1 size=169780 2024-09-12T00:22:13.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.009+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=7BS8Z5K7FWZ9 tag=SZAKNBKR2F7H type=write size=2266932 2024-09-12T00:22:13.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.013+0000 7fd6489978c0 1 < canceled operation key=J5IW4G9C72DH tag=QFQAKW7XNGMZ type=del size=1956594 2024-09-12T00:22:13.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.013+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=VP31RMM1W96U type=write size=1015204 2024-09-12T00:22:13.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.017+0000 7fd6489978c0 1 < canceled operation key=CFID1EVBXOVJ tag=QIU4RM8Z2B8R type=del size=169878 2024-09-12T00:22:13.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.021+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=5E5IB1MXQ68Z type=write size=608265 2024-09-12T00:22:13.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.025+0000 7fd6489978c0 1 < completed delete operation key=JPVKBVRCZTE9 tag=AUHK0YCXFR7N type=del 2024-09-12T00:22:13.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.029+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=FKG2AB98XP30 type=del size=2562575 2024-09-12T00:22:13.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.033+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=NS1989SYE597 type=del 2024-09-12T00:22:13.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.041+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~EQDS00X7TNTF.0 size=273482 2024-09-12T00:22:13.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.041+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=EQDS00X7TNTF tag=48E0U1GP203K type=write size=1322058 2024-09-12T00:22:13.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.049+0000 7fd6489978c0 1 < suggested remove operation key=HUKWLE56FRX2 tag=19YU59S80CXG type=write 2024-09-12T00:22:13.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.053+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=MGMNCGB0MVOF type=del size=1695201 2024-09-12T00:22:13.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.057+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=SY3TNM11JUJU type=del 2024-09-12T00:22:13.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.061+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=7BQN4PLAI098 type=del size=3804362 2024-09-12T00:22:13.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.065+0000 7fd6489978c0 1 < completed write operation key=8FBXDX6GELE7 tag=N8XYUD7AM8T7 type=write size=140817 2024-09-12T00:22:13.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.069+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~RC3NFR0JR96G.0 size=1048576 2024-09-12T00:22:13.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.073+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~RC3NFR0JR96G.1 size=1048576 2024-09-12T00:22:13.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.077+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~RC3NFR0JR96G.2 size=630555 2024-09-12T00:22:13.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.077+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=RC3NFR0JR96G tag=D5IBTCPEGOS6 type=write size=3776283 2024-09-12T00:22:13.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.081+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~QCFS1ZZJATLU.0 size=1048576 2024-09-12T00:22:13.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.081+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~QCFS1ZZJATLU.1 size=1048576 2024-09-12T00:22:13.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.085+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~QCFS1ZZJATLU.2 size=273959 2024-09-12T00:22:13.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.093+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=QCFS1ZZJATLU tag=WV4BJ2V4X6A8 type=write size=3419687 2024-09-12T00:22:13.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.093+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=ZVPYDAYJ0HUE type=del size=2191904 2024-09-12T00:22:13.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.097+0000 7fd6489978c0 1 < canceled operation key=K9FD1L86Q05B tag=4N39466LNKFG type=del size=995008 2024-09-12T00:22:13.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.105+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~IM08Y1VIVO6T.0 size=1048576 2024-09-12T00:22:13.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.105+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~IM08Y1VIVO6T.1 size=450117 2024-09-12T00:22:13.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.105+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=IM08Y1VIVO6T tag=W4LYQ9HHJZ2L type=write size=2547269 2024-09-12T00:22:13.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.109+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~VWGPHC69FQ20.0 size=18528 2024-09-12T00:22:13.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.117+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=VWGPHC69FQ20 tag=MYWEFAN3JRPB type=write size=1067104 2024-09-12T00:22:13.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.121+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~K6V19E8SL117.0 size=90873 2024-09-12T00:22:13.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.121+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=K6V19E8SL117 tag=S0RFKQPIO0ZH type=write size=1139449 2024-09-12T00:22:13.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.125+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=RU0HML6N2176 type=del 2024-09-12T00:22:13.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.129+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=TNT946ZUIQJO type=del size=1780388 2024-09-12T00:22:13.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.133+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~MBSL0UJMKZVY.0 size=43819 2024-09-12T00:22:13.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.137+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=MBSL0UJMKZVY tag=LBL95N0YUY0S type=write size=1092395 2024-09-12T00:22:13.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.145+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~8KHAGOWHF77U.0 size=1048576 2024-09-12T00:22:13.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.149+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~8KHAGOWHF77U.1 size=711376 2024-09-12T00:22:13.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.149+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=8KHAGOWHF77U tag=KTYDC3ODAPWL type=write size=2808528 2024-09-12T00:22:13.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.149+0000 7fd6489978c0 1 < canceled part key=_multipart_IHYHPKVPWTUL.2~K62C5BAV01VT.0 size=1048576 2024-09-12T00:22:13.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.149+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~K62C5BAV01VT.1 size=1048576 2024-09-12T00:22:13.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.153+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~K62C5BAV01VT.2 size=565216 2024-09-12T00:22:13.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.161+0000 7fd6489978c0 1 < canceled multipart upload key=IHYHPKVPWTUL upload=K62C5BAV01VT tag=NYHZ2ZORI7P2 type=write size=3710944 2024-09-12T00:22:13.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.165+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=5WRFH1NCEE4D type=del size=3231745 2024-09-12T00:22:13.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.169+0000 7fd6489978c0 1 < completed write operation key=Y3JFVW74FNT6 tag=9JQB7GRT1RKB type=write size=611549 2024-09-12T00:22:13.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.169+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=Z9H3CVVU9BP7 type=del size=1518910 2024-09-12T00:22:13.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.173+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~T2XTSAZNK9FE.0 size=47013 2024-09-12T00:22:13.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.181+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=T2XTSAZNK9FE tag=G8UL17XU4Z4G type=write size=1095589 2024-09-12T00:22:13.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.185+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=ZREO2FQKFM5G type=del size=779015 2024-09-12T00:22:13.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.189+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~7BS8Z5K7FWZ9.0 size=1048576 2024-09-12T00:22:13.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.193+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~7BS8Z5K7FWZ9.1 size=169780 2024-09-12T00:22:13.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.197+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=7BS8Z5K7FWZ9 tag=SZAKNBKR2F7H type=write size=2266932 2024-09-12T00:22:13.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.201+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=71S4BL7UJHL0 type=del size=2398869 2024-09-12T00:22:13.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.205+0000 7fd6489978c0 1 < completed write operation key=3JZP8TZFEIMH tag=VP31RMM1W96U type=write size=1015204 2024-09-12T00:22:13.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.209+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=9EJQ5DZESPZ9 type=del size=692825 2024-09-12T00:22:13.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.213+0000 7fd6489978c0 1 < completed write operation key=2KP09UFI3N8B tag=5E5IB1MXQ68Z type=write size=608265 2024-09-12T00:22:13.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.221+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~Z1XANAK7DVT4.0 size=1048576 2024-09-12T00:22:13.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.225+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~Z1XANAK7DVT4.1 size=676469 2024-09-12T00:22:13.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.225+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=Z1XANAK7DVT4 tag=YS7IR4R4Q4CX type=write size=2773621 2024-09-12T00:22:13.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.229+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=FKG2AB98XP30 type=del 2024-09-12T00:22:13.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.233+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=5FECA5R1XX4J type=del size=132097 2024-09-12T00:22:13.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.237+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~EQDS00X7TNTF.0 size=273482 2024-09-12T00:22:13.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.245+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=EQDS00X7TNTF tag=48E0U1GP203K type=write size=1322058 2024-09-12T00:22:13.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.249+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=YEXG6NZG59PP type=del size=3572495 2024-09-12T00:22:13.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.249+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=MGMNCGB0MVOF type=del 2024-09-12T00:22:13.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.253+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=5E8K3BFEU63I type=del size=3377481 2024-09-12T00:22:13.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.257+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=7BQN4PLAI098 type=del 2024-09-12T00:22:13.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.261+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=YD3BH629EKAA type=del size=1922863 2024-09-12T00:22:13.261 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.261+0000 7fd6489978c0 1 < canceled part key=_multipart_YJJBTNI318EH.2~RC3NFR0JR96G.0 size=1048576 2024-09-12T00:22:13.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.265+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~RC3NFR0JR96G.1 size=1048576 2024-09-12T00:22:13.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.269+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~RC3NFR0JR96G.2 size=630555 2024-09-12T00:22:13.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.273+0000 7fd6489978c0 1 < canceled multipart upload key=YJJBTNI318EH upload=RC3NFR0JR96G tag=D5IBTCPEGOS6 type=write size=3776283 2024-09-12T00:22:13.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.277+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=W94P3FBKJGPR type=del size=1686740 2024-09-12T00:22:13.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.281+0000 7fd6489978c0 1 < completed delete operation key=3JZP8TZFEIMH tag=ZVPYDAYJ0HUE type=del 2024-09-12T00:22:13.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.285+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=N3I7TUP0V4IW type=del size=2748411 2024-09-12T00:22:13.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.285+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~IM08Y1VIVO6T.0 size=1048576 2024-09-12T00:22:13.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.289+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~IM08Y1VIVO6T.1 size=450117 2024-09-12T00:22:13.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.297+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=IM08Y1VIVO6T tag=W4LYQ9HHJZ2L type=write size=2547269 2024-09-12T00:22:13.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.301+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~TX55ZKO6T92S.0 size=952545 2024-09-12T00:22:13.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.301+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=TX55ZKO6T92S tag=ILATGYJ7ZSH1 type=write size=2001121 2024-09-12T00:22:13.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.305+0000 7fd6489978c0 1 < canceled part key=_multipart_JPVKBVRCZTE9.2~K6V19E8SL117.0 size=90873 2024-09-12T00:22:13.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.309+0000 7fd6489978c0 1 < canceled multipart upload key=JPVKBVRCZTE9 upload=K6V19E8SL117 tag=S0RFKQPIO0ZH type=write size=1139449 2024-09-12T00:22:13.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.313+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=9KCY1YAQW9U9 type=del size=929463 2024-09-12T00:22:13.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.321+0000 7fd6489978c0 1 < suggested update operation key=N0AAVPQ6MUQ1 tag=TNT946ZUIQJO type=del size=1780388 2024-09-12T00:22:13.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.325+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=JDNJUINTLGBE type=del size=2384373 2024-09-12T00:22:13.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.329+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~8KHAGOWHF77U.0 size=1048576 2024-09-12T00:22:13.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.333+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~8KHAGOWHF77U.1 size=711376 2024-09-12T00:22:13.336 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.337+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=8KHAGOWHF77U tag=KTYDC3ODAPWL type=write size=2808528 2024-09-12T00:22:13.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.341+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=GNI82RXFNBQA type=del size=3359979 2024-09-12T00:22:13.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.345+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=5WRFH1NCEE4D type=del 2024-09-12T00:22:13.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.349+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=N3C4Z463YAJM type=del size=3233132 2024-09-12T00:22:13.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.357+0000 7fd6489978c0 1 < suggested update operation key=8FBXDX6GELE7 tag=Z9H3CVVU9BP7 type=del size=1518910 2024-09-12T00:22:13.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.361+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~5LGRBY67MAAY.0 size=1048576 2024-09-12T00:22:13.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.365+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~5LGRBY67MAAY.1 size=1048576 2024-09-12T00:22:13.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.369+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~5LGRBY67MAAY.2 size=946242 2024-09-12T00:22:13.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.369+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=5LGRBY67MAAY tag=HZ46IORY855L type=write size=4091970 2024-09-12T00:22:13.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.373+0000 7fd6489978c0 -1 < failed to complete operation key=8FBXDX6GELE7 tag=ZREO2FQKFM5G type=del size=779015: (22) Invalid argument 2024-09-12T00:22:13.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.377+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=N2LD13JN205O type=del size=1729497 2024-09-12T00:22:13.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.381+0000 7fd6489978c0 1 < completed delete operation key=M9YKGQ2GA5CO tag=71S4BL7UJHL0 type=del 2024-09-12T00:22:13.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.389+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~DDZ3QOELEV5H.0 size=1048576 2024-09-12T00:22:13.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.393+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~DDZ3QOELEV5H.1 size=1048576 2024-09-12T00:22:13.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.393+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~DDZ3QOELEV5H.2 size=845029 2024-09-12T00:22:13.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.393+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=DDZ3QOELEV5H tag=3GVTM1LJ0HJO type=write size=3990757 2024-09-12T00:22:13.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.401+0000 7fd6489978c0 1 < suggested update operation key=YSPRZ87DZ2OD tag=9EJQ5DZESPZ9 type=del size=692825 2024-09-12T00:22:13.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.405+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=NKJFNCGN82G1 type=write size=827197 2024-09-12T00:22:13.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.409+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~Z1XANAK7DVT4.0 size=1048576 2024-09-12T00:22:13.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.413+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~Z1XANAK7DVT4.1 size=676469 2024-09-12T00:22:13.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.417+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=Z1XANAK7DVT4 tag=YS7IR4R4Q4CX type=write size=2773621 2024-09-12T00:22:13.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.421+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=DDLMEQ37PNBR type=del size=126643 2024-09-12T00:22:13.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.425+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=5FECA5R1XX4J type=del 2024-09-12T00:22:13.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.429+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=QQFL995QHW1Z type=del size=2462429 2024-09-12T00:22:13.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.433+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=YEXG6NZG59PP type=del 2024-09-12T00:22:13.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.441+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~CKG15WSSV73P.0 size=607943 2024-09-12T00:22:13.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.441+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=CKG15WSSV73P tag=97XVX6WZPRMX type=write size=1656519 2024-09-12T00:22:13.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.445+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=5E8K3BFEU63I type=del 2024-09-12T00:22:13.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.449+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=247U4WHS20GI type=write size=712600 2024-09-12T00:22:13.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.449+0000 7fd6489978c0 1 < completed delete operation key=B2BW7GQ6UN9I tag=YD3BH629EKAA type=del 2024-09-12T00:22:13.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.453+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=S60UWNB1MJ9O type=del size=514229 2024-09-12T00:22:13.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.461+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=W94P3FBKJGPR type=del 2024-09-12T00:22:13.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.465+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=J3UMOWOP2W2V type=del size=3737507 2024-09-12T00:22:13.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.469+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=N3I7TUP0V4IW type=del 2024-09-12T00:22:13.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.473+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=FXEGRF1B3OGU type=del size=660299 2024-09-12T00:22:13.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.477+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~TX55ZKO6T92S.0 size=952545 2024-09-12T00:22:13.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.485+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=TX55ZKO6T92S tag=ILATGYJ7ZSH1 type=write size=2001121 2024-09-12T00:22:13.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.489+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=MUDMVUIP9N86 type=del size=3374703 2024-09-12T00:22:13.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.493+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=9KCY1YAQW9U9 type=del 2024-09-12T00:22:13.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.501+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~NT2O6JRWZ6DB.0 size=1048576 2024-09-12T00:22:13.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.501+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~NT2O6JRWZ6DB.1 size=276733 2024-09-12T00:22:13.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.501+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=NT2O6JRWZ6DB tag=0J6DIBJD1545 type=write size=2373885 2024-09-12T00:22:13.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.505+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=JDNJUINTLGBE type=del 2024-09-12T00:22:13.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.513+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~1GSNC62POALQ.0 size=1048576 2024-09-12T00:22:13.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.517+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~1GSNC62POALQ.1 size=267658 2024-09-12T00:22:13.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.517+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=1GSNC62POALQ tag=TOZN97XTSBN1 type=write size=2364810 2024-09-12T00:22:13.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.517+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=GNI82RXFNBQA type=del 2024-09-12T00:22:13.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.521+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=FCPWAOZJW7XF type=del size=1533496 2024-09-12T00:22:13.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.525+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=N3C4Z463YAJM type=del 2024-09-12T00:22:13.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.529+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=V3XN6BWYILFG type=del size=837824 2024-09-12T00:22:13.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.533+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~5LGRBY67MAAY.0 size=1048576 2024-09-12T00:22:13.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.533+0000 7fd6489978c0 1 < canceled part key=_multipart_RGE8T6BTHBWK.2~5LGRBY67MAAY.1 size=1048576 2024-09-12T00:22:13.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.537+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~5LGRBY67MAAY.2 size=946242 2024-09-12T00:22:13.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.545+0000 7fd6489978c0 1 < canceled multipart upload key=RGE8T6BTHBWK upload=5LGRBY67MAAY tag=HZ46IORY855L type=write size=4091970 2024-09-12T00:22:13.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.549+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=VF4BKSN4NDGQ type=del size=250380 2024-09-12T00:22:13.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.549+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=N2LD13JN205O type=del 2024-09-12T00:22:13.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.557+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~7278IRHGJCR3.0 size=1048576 2024-09-12T00:22:13.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.561+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~7278IRHGJCR3.1 size=606233 2024-09-12T00:22:13.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.561+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=7278IRHGJCR3 tag=EFFMODG0PCHU type=write size=2703385 2024-09-12T00:22:13.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.565+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~DDZ3QOELEV5H.0 size=1048576 2024-09-12T00:22:13.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.565+0000 7fd6489978c0 1 < canceled part key=_multipart_M9YKGQ2GA5CO.2~DDZ3QOELEV5H.1 size=1048576 2024-09-12T00:22:13.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.569+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~DDZ3QOELEV5H.2 size=845029 2024-09-12T00:22:13.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.573+0000 7fd6489978c0 1 < canceled multipart upload key=M9YKGQ2GA5CO upload=DDZ3QOELEV5H tag=3GVTM1LJ0HJO type=write size=3990757 2024-09-12T00:22:13.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.581+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=25VWEE0UZR5A type=del size=2148204 2024-09-12T00:22:13.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.589+0000 7fd6489978c0 1 < suggested remove operation key=N0AAVPQ6MUQ1 tag=NKJFNCGN82G1 type=write 2024-09-12T00:22:13.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.593+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=U4OZ345ONUD3 type=del size=3256341 2024-09-12T00:22:13.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.597+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=DDLMEQ37PNBR type=del 2024-09-12T00:22:13.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.601+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=M8BEQQG0804V type=del size=2765626 2024-09-12T00:22:13.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.605+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=QQFL995QHW1Z type=del 2024-09-12T00:22:13.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.609+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=I37JRAY1VD0X type=del size=2024010 2024-09-12T00:22:13.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.613+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~CKG15WSSV73P.0 size=607943 2024-09-12T00:22:13.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.617+0000 7fd6489978c0 1 < completed multipart upload key=G4EUTQOHAT2E upload=CKG15WSSV73P tag=97XVX6WZPRMX type=write size=1656519 2024-09-12T00:22:13.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.621+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=G3Y04UJSD2OE type=write size=1045228 2024-09-12T00:22:13.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.629+0000 7fd6489978c0 1 < suggested update operation key=QBS4N1KGR1JB tag=247U4WHS20GI type=write size=712600 2024-09-12T00:22:13.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.633+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=YDKNJ6KSWR6C type=write size=395710 2024-09-12T00:22:13.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.633+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=S60UWNB1MJ9O type=del 2024-09-12T00:22:13.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.637+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=AI3XCLYCI5QX type=del size=3893181 2024-09-12T00:22:13.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.641+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=J3UMOWOP2W2V type=del 2024-09-12T00:22:13.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.649+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~MH0VW1ZZ57N0.0 size=1048576 2024-09-12T00:22:13.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.653+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~MH0VW1ZZ57N0.1 size=1048576 2024-09-12T00:22:13.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.657+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~MH0VW1ZZ57N0.2 size=988441 2024-09-12T00:22:13.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.657+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=MH0VW1ZZ57N0 tag=5LI69GAMSKAT type=write size=4134169 2024-09-12T00:22:13.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.661+0000 7fd6489978c0 -1 < failed to complete operation key=QBS4N1KGR1JB tag=FXEGRF1B3OGU type=del size=660299: (22) Invalid argument 2024-09-12T00:22:13.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.669+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~LB6OX7N5K1MO.0 size=1048576 2024-09-12T00:22:13.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.673+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~LB6OX7N5K1MO.1 size=133553 2024-09-12T00:22:13.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.673+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=LB6OX7N5K1MO tag=TQAJ00H08VJQ type=write size=2230705 2024-09-12T00:22:13.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.681+0000 7fd6489978c0 1 < suggested update operation key=KAT2TB3FGAYG tag=MUDMVUIP9N86 type=del size=3374703 2024-09-12T00:22:13.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.685+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=OFR46LXAOUC8 type=del size=4130207 2024-09-12T00:22:13.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.689+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~NT2O6JRWZ6DB.0 size=1048576 2024-09-12T00:22:13.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.693+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~NT2O6JRWZ6DB.1 size=276733 2024-09-12T00:22:13.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.697+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=NT2O6JRWZ6DB tag=0J6DIBJD1545 type=write size=2373885 2024-09-12T00:22:13.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.705+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~3ZE7JJSBTRAF.0 size=1048576 2024-09-12T00:22:13.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.709+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~3ZE7JJSBTRAF.1 size=1048576 2024-09-12T00:22:13.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.713+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~3ZE7JJSBTRAF.2 size=665952 2024-09-12T00:22:13.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.713+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=3ZE7JJSBTRAF tag=HB0RJJ3TQM89 type=write size=3811680 2024-09-12T00:22:13.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.717+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~1GSNC62POALQ.0 size=1048576 2024-09-12T00:22:13.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.717+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~1GSNC62POALQ.1 size=267658 2024-09-12T00:22:13.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.725+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=1GSNC62POALQ tag=TOZN97XTSBN1 type=write size=2364810 2024-09-12T00:22:13.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.729+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=HM4X30TTQQ5J type=del size=1231397 2024-09-12T00:22:13.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.733+0000 7fd6489978c0 1 < completed delete operation key=B2BW7GQ6UN9I tag=FCPWAOZJW7XF type=del 2024-09-12T00:22:13.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.737+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=A4225WN0U4B3 type=del size=4082238 2024-09-12T00:22:13.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.741+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=V3XN6BWYILFG type=del 2024-09-12T00:22:13.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.745+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=2UB00S7RM461 type=del size=2038867 2024-09-12T00:22:13.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.749+0000 7fd6489978c0 -1 < failed to complete operation key=N0AAVPQ6MUQ1 tag=VF4BKSN4NDGQ type=del size=250380: (22) Invalid argument 2024-09-12T00:22:13.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.749+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=LNLMLWVGIB9U type=del size=19579 2024-09-12T00:22:13.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.753+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~7278IRHGJCR3.0 size=1048576 2024-09-12T00:22:13.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.757+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~7278IRHGJCR3.1 size=606233 2024-09-12T00:22:13.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.765+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=7278IRHGJCR3 tag=EFFMODG0PCHU type=write size=2703385 2024-09-12T00:22:13.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.769+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=OKQZNQNK8AUD type=write size=184801 2024-09-12T00:22:13.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.773+0000 7fd6489978c0 -1 < failed to complete operation key=N0AAVPQ6MUQ1 tag=25VWEE0UZR5A type=del size=2148204: (22) Invalid argument 2024-09-12T00:22:13.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.773+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=NOSHH9554N5H type=write size=621786 2024-09-12T00:22:13.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.777+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=U4OZ345ONUD3 type=del 2024-09-12T00:22:13.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.781+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=NXPJY0N6I3Q8 type=del size=643309 2024-09-12T00:22:13.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.785+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=M8BEQQG0804V type=del 2024-09-12T00:22:13.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.793+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~JP0MBX34LV0Y.0 size=1048576 2024-09-12T00:22:13.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.797+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~JP0MBX34LV0Y.1 size=418575 2024-09-12T00:22:13.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.797+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=JP0MBX34LV0Y tag=BWUY3TH45VYM type=write size=2515727 2024-09-12T00:22:13.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.801+0000 7fd6489978c0 1 < canceled operation key=ZXEIT45BWHXM tag=I37JRAY1VD0X type=del size=2024010 2024-09-12T00:22:13.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.805+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=23UD34Y1LBN5 type=del size=67610 2024-09-12T00:22:13.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.809+0000 7fd6489978c0 1 < completed write operation key=N4S6I47NSJK6 tag=G3Y04UJSD2OE type=write size=1045228 2024-09-12T00:22:13.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.813+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=0XXOQDOWB1TN type=del size=505586 2024-09-12T00:22:13.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.821+0000 7fd6489978c0 1 < completed write operation key=GVPNH3JSO07D tag=YDKNJ6KSWR6C type=write size=395710 2024-09-12T00:22:13.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.825+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~4EBL3ST478DO.0 size=1048576 2024-09-12T00:22:13.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.829+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~4EBL3ST478DO.1 size=1048576 2024-09-12T00:22:13.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.833+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~4EBL3ST478DO.2 size=407428 2024-09-12T00:22:13.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.833+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=4EBL3ST478DO tag=H56EG3T5QRH1 type=write size=3553156 2024-09-12T00:22:13.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.837+0000 7fd6489978c0 1 < canceled operation key=ZXEIT45BWHXM tag=AI3XCLYCI5QX type=del size=3893181 2024-09-12T00:22:13.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.841+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=ALTZAPE5BXD7 type=del size=3269458 2024-09-12T00:22:13.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.845+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~MH0VW1ZZ57N0.0 size=1048576 2024-09-12T00:22:13.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.845+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~MH0VW1ZZ57N0.1 size=1048576 2024-09-12T00:22:13.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.849+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~MH0VW1ZZ57N0.2 size=988441 2024-09-12T00:22:13.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.857+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=MH0VW1ZZ57N0 tag=5LI69GAMSKAT type=write size=4134169 2024-09-12T00:22:13.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.861+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=HSTHVKD7UBMQ type=del size=2883930 2024-09-12T00:22:13.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.865+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~LB6OX7N5K1MO.0 size=1048576 2024-09-12T00:22:13.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.869+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~LB6OX7N5K1MO.1 size=133553 2024-09-12T00:22:13.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.877+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=LB6OX7N5K1MO tag=TQAJ00H08VJQ type=write size=2230705 2024-09-12T00:22:13.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.881+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~M70F5BWE23HR.0 size=1048576 2024-09-12T00:22:13.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.885+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~M70F5BWE23HR.1 size=1048576 2024-09-12T00:22:13.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.889+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~M70F5BWE23HR.2 size=590486 2024-09-12T00:22:13.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.889+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=M70F5BWE23HR tag=Q5YAOS6C1TTG type=write size=3736214 2024-09-12T00:22:13.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.897+0000 7fd6489978c0 1 < suggested update operation key=JPVKBVRCZTE9 tag=OFR46LXAOUC8 type=del size=4130207 2024-09-12T00:22:13.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.905+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~D3TW0RK7TWJE.0 size=1048576 2024-09-12T00:22:13.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.909+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~D3TW0RK7TWJE.1 size=1048576 2024-09-12T00:22:13.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.909+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~D3TW0RK7TWJE.2 size=354099 2024-09-12T00:22:13.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.909+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=D3TW0RK7TWJE tag=DB5V1B4EAFQ8 type=write size=3499827 2024-09-12T00:22:13.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.913+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~3ZE7JJSBTRAF.0 size=1048576 2024-09-12T00:22:13.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.917+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~3ZE7JJSBTRAF.1 size=1048576 2024-09-12T00:22:13.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.921+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~3ZE7JJSBTRAF.2 size=665952 2024-09-12T00:22:13.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.929+0000 7fd6489978c0 1 < completed multipart upload key=CFID1EVBXOVJ upload=3ZE7JJSBTRAF tag=HB0RJJ3TQM89 type=write size=3811680 2024-09-12T00:22:13.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.933+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~WA8GSEB6TQ7H.0 size=1048576 2024-09-12T00:22:13.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.937+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~WA8GSEB6TQ7H.1 size=1048576 2024-09-12T00:22:13.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.945+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~WA8GSEB6TQ7H.2 size=383196 2024-09-12T00:22:13.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.945+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=WA8GSEB6TQ7H tag=WEZRUWNOJFGB type=write size=3528924 2024-09-12T00:22:13.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.953+0000 7fd6489978c0 1 < suggested update operation key=JPVKBVRCZTE9 tag=HM4X30TTQQ5J type=del size=1231397 2024-09-12T00:22:13.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.953+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=H61SB7X7LRWP type=del size=1421968 2024-09-12T00:22:13.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.957+0000 7fd6489978c0 -1 < failed to complete operation key=JPVKBVRCZTE9 tag=A4225WN0U4B3 type=del size=4082238: (22) Invalid argument 2024-09-12T00:22:13.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.965+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~9UNTX5U4C3YW.0 size=1048576 2024-09-12T00:22:13.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.969+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~9UNTX5U4C3YW.1 size=960851 2024-09-12T00:22:13.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.969+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=9UNTX5U4C3YW tag=6MH703O6MQRT type=write size=3058003 2024-09-12T00:22:13.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.973+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=2UB00S7RM461 type=del 2024-09-12T00:22:13.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.977+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=VSR9QKXVGYY9 type=write size=42579 2024-09-12T00:22:13.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.985+0000 7fd6489978c0 1 < suggested remove operation key=K9FD1L86Q05B tag=LNLMLWVGIB9U type=del 2024-09-12T00:22:13.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.989+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=2O3ZY5HF2IW3 type=del size=3116259 2024-09-12T00:22:13.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.993+0000 7fd6489978c0 1 < completed write operation key=CFID1EVBXOVJ tag=OKQZNQNK8AUD type=write size=184801 2024-09-12T00:22:13.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.997+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=N6ML3EWCDIV3 type=del size=3912059 2024-09-12T00:22:13.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:13.997+0000 7fd6489978c0 1 < completed write operation key=HUKWLE56FRX2 tag=NOSHH9554N5H type=write size=621786 2024-09-12T00:22:14.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.001+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=2P3VYKEC65B7 type=del size=2026755 2024-09-12T00:22:14.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.005+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=NXPJY0N6I3Q8 type=del 2024-09-12T00:22:14.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.009+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=L4ZLOQSTRWUB type=del size=2521875 2024-09-12T00:22:14.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.013+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~JP0MBX34LV0Y.0 size=1048576 2024-09-12T00:22:14.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.017+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~JP0MBX34LV0Y.1 size=418575 2024-09-12T00:22:14.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.025+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=JP0MBX34LV0Y tag=BWUY3TH45VYM type=write size=2515727 2024-09-12T00:22:14.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.025+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=HZE5T6CDTS0W type=write size=333823 2024-09-12T00:22:14.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.029+0000 7fd6489978c0 1 < canceled operation key=G4EUTQOHAT2E tag=23UD34Y1LBN5 type=del size=67610 2024-09-12T00:22:14.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.033+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=L3HJ7CKQK9HV type=del size=4060626 2024-09-12T00:22:14.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.037+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=0XXOQDOWB1TN type=del 2024-09-12T00:22:14.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.041+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=2PJMZVLQJSBT type=del size=61748 2024-09-12T00:22:14.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.045+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~4EBL3ST478DO.0 size=1048576 2024-09-12T00:22:14.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.049+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~4EBL3ST478DO.1 size=1048576 2024-09-12T00:22:14.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.053+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~4EBL3ST478DO.2 size=407428 2024-09-12T00:22:14.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.057+0000 7fd6489978c0 1 < completed multipart upload key=K9FD1L86Q05B upload=4EBL3ST478DO tag=H56EG3T5QRH1 type=write size=3553156 2024-09-12T00:22:14.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.061+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=3Q6PP2SHFJFG type=del size=3239647 2024-09-12T00:22:14.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.069+0000 7fd6489978c0 1 < suggested remove operation key=CFID1EVBXOVJ tag=ALTZAPE5BXD7 type=del 2024-09-12T00:22:14.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.073+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=A9B5R9ENYHGU type=write size=97954 2024-09-12T00:22:14.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.077+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=HSTHVKD7UBMQ type=del 2024-09-12T00:22:14.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.085+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~75K5DRA15BN3.0 size=1048576 2024-09-12T00:22:14.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.085+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~75K5DRA15BN3.1 size=1048576 2024-09-12T00:22:14.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.089+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~75K5DRA15BN3.2 size=1048168 2024-09-12T00:22:14.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.089+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=75K5DRA15BN3 tag=PNH4EQX747AC type=write size=4193896 2024-09-12T00:22:14.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.093+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~M70F5BWE23HR.0 size=1048576 2024-09-12T00:22:14.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.097+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~M70F5BWE23HR.1 size=1048576 2024-09-12T00:22:14.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.101+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~M70F5BWE23HR.2 size=590486 2024-09-12T00:22:14.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.105+0000 7fd6489978c0 1 < completed multipart upload key=9ACGS2FIY7AF upload=M70F5BWE23HR tag=Q5YAOS6C1TTG type=write size=3736214 2024-09-12T00:22:14.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.109+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=Y783OZ51HZ1U type=del size=3485363 2024-09-12T00:22:14.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.113+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~D3TW0RK7TWJE.0 size=1048576 2024-09-12T00:22:14.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.117+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~D3TW0RK7TWJE.1 size=1048576 2024-09-12T00:22:14.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.121+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~D3TW0RK7TWJE.2 size=354099 2024-09-12T00:22:14.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.125+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=D3TW0RK7TWJE tag=DB5V1B4EAFQ8 type=write size=3499827 2024-09-12T00:22:14.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.133+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~N4QCZKPDXHLT.0 size=952141 2024-09-12T00:22:14.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.133+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=N4QCZKPDXHLT tag=HX3QGDNRJVUM type=write size=2000717 2024-09-12T00:22:14.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.137+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~WA8GSEB6TQ7H.0 size=1048576 2024-09-12T00:22:14.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.141+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~WA8GSEB6TQ7H.1 size=1048576 2024-09-12T00:22:14.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.145+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~WA8GSEB6TQ7H.2 size=383196 2024-09-12T00:22:14.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.149+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=WA8GSEB6TQ7H tag=WEZRUWNOJFGB type=write size=3528924 2024-09-12T00:22:14.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.153+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=9RAYF3QLNXSC type=del size=3364818 2024-09-12T00:22:14.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.157+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=H61SB7X7LRWP type=del 2024-09-12T00:22:14.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.165+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~NFCYIT6CVV39.0 size=1048576 2024-09-12T00:22:14.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.169+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~NFCYIT6CVV39.1 size=1048576 2024-09-12T00:22:14.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.169+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~NFCYIT6CVV39.2 size=689167 2024-09-12T00:22:14.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.169+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=NFCYIT6CVV39 tag=9BDUA1UQSOBO type=write size=3834895 2024-09-12T00:22:14.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.173+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~9UNTX5U4C3YW.0 size=1048576 2024-09-12T00:22:14.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.177+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~9UNTX5U4C3YW.1 size=960851 2024-09-12T00:22:14.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.185+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=9UNTX5U4C3YW tag=6MH703O6MQRT type=write size=3058003 2024-09-12T00:22:14.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.189+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~J6AG2QTGVH29.0 size=1048576 2024-09-12T00:22:14.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.193+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~J6AG2QTGVH29.1 size=503972 2024-09-12T00:22:14.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.193+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=J6AG2QTGVH29 tag=LVGT3IGW2J9I type=write size=2601124 2024-09-12T00:22:14.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.197+0000 7fd6489978c0 1 < completed write operation key=ES2BLTWZT6PT tag=VSR9QKXVGYY9 type=write size=42579 2024-09-12T00:22:14.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.201+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=3VPHAYO4SHZG type=del size=118162 2024-09-12T00:22:14.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.205+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=2O3ZY5HF2IW3 type=del 2024-09-12T00:22:14.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.213+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~0BTVQ300JMYN.0 size=1048576 2024-09-12T00:22:14.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.213+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~0BTVQ300JMYN.1 size=737968 2024-09-12T00:22:14.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.213+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=0BTVQ300JMYN tag=XG2F7WNILUBJ type=write size=2835120 2024-09-12T00:22:14.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.217+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=N6ML3EWCDIV3 type=del 2024-09-12T00:22:14.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.221+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=LXMI75B8MN9B type=del size=2753580 2024-09-12T00:22:14.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.225+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=2P3VYKEC65B7 type=del 2024-09-12T00:22:14.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.229+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=MBNZ2QZR3PI8 type=del size=1514034 2024-09-12T00:22:14.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.233+0000 7fd6489978c0 1 < canceled operation key=M9YKGQ2GA5CO tag=L4ZLOQSTRWUB type=del size=2521875 2024-09-12T00:22:14.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.237+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=T3U43J3UMQDZ type=del size=1158653 2024-09-12T00:22:14.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.241+0000 7fd6489978c0 1 < completed write operation key=KAT2TB3FGAYG tag=HZE5T6CDTS0W type=write size=333823 2024-09-12T00:22:14.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.249+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~Y0PLJE0OHQ24.0 size=704912 2024-09-12T00:22:14.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.249+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=Y0PLJE0OHQ24 tag=ZK4BL440AV4R type=write size=1753488 2024-09-12T00:22:14.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.249+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=L3HJ7CKQK9HV type=del 2024-09-12T00:22:14.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.257+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~EKRB42A1ZV13.0 size=1048576 2024-09-12T00:22:14.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.261+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~EKRB42A1ZV13.1 size=591416 2024-09-12T00:22:14.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.261+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=EKRB42A1ZV13 tag=N1C87D4LNSGK type=write size=2688568 2024-09-12T00:22:14.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.265+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=2PJMZVLQJSBT type=del 2024-09-12T00:22:14.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.269+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=U2YFK4PM16BJ type=del size=2227836 2024-09-12T00:22:14.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.273+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=3Q6PP2SHFJFG type=del 2024-09-12T00:22:14.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.277+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=E99HCHTQ7JZ0 type=del size=2886768 2024-09-12T00:22:14.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.281+0000 7fd6489978c0 1 < completed write operation key=N0AAVPQ6MUQ1 tag=A9B5R9ENYHGU type=write size=97954 2024-09-12T00:22:14.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.285+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=WFBPDSZ0TAWV type=write size=875477 2024-09-12T00:22:14.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.289+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~75K5DRA15BN3.0 size=1048576 2024-09-12T00:22:14.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.289+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~75K5DRA15BN3.1 size=1048576 2024-09-12T00:22:14.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.297+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~75K5DRA15BN3.2 size=1048168 2024-09-12T00:22:14.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.301+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=75K5DRA15BN3 tag=PNH4EQX747AC type=write size=4193896 2024-09-12T00:22:14.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.305+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=9DY2DRIYL3A2 type=del size=3214072 2024-09-12T00:22:14.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.309+0000 7fd6489978c0 1 < completed delete operation key=LZICTA4BWOW8 tag=Y783OZ51HZ1U type=del 2024-09-12T00:22:14.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.313+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=9D0OKUR7JYPG type=del size=2458986 2024-09-12T00:22:14.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.317+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~N4QCZKPDXHLT.0 size=952141 2024-09-12T00:22:14.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.321+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=N4QCZKPDXHLT tag=HX3QGDNRJVUM type=write size=2000717 2024-09-12T00:22:14.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.325+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=891L06Z0GV9Y type=del size=2961681 2024-09-12T00:22:14.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.329+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=9RAYF3QLNXSC type=del 2024-09-12T00:22:14.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.337+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~MXF1EVT3HB03.0 size=867913 2024-09-12T00:22:14.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.337+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=MXF1EVT3HB03 tag=19Y0J0JH7PG6 type=write size=1916489 2024-09-12T00:22:14.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.341+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~NFCYIT6CVV39.0 size=1048576 2024-09-12T00:22:14.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.345+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~NFCYIT6CVV39.1 size=1048576 2024-09-12T00:22:14.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.345+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~NFCYIT6CVV39.2 size=689167 2024-09-12T00:22:14.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.353+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=NFCYIT6CVV39 tag=9BDUA1UQSOBO type=write size=3834895 2024-09-12T00:22:14.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.357+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=9VZX1836ENJF type=write size=293250 2024-09-12T00:22:14.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.361+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~J6AG2QTGVH29.0 size=1048576 2024-09-12T00:22:14.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.361+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~J6AG2QTGVH29.1 size=503972 2024-09-12T00:22:14.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.369+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=J6AG2QTGVH29 tag=LVGT3IGW2J9I type=write size=2601124 2024-09-12T00:22:14.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.373+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=RBRR1N98THQQ type=del size=3813508 2024-09-12T00:22:14.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.381+0000 7fd6489978c0 1 < suggested remove operation key=9CK160BK5YYY tag=3VPHAYO4SHZG type=del 2024-09-12T00:22:14.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.389+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~OQO6FVU43GJK.0 size=1048576 2024-09-12T00:22:14.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.389+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~OQO6FVU43GJK.1 size=1048576 2024-09-12T00:22:14.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.393+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~OQO6FVU43GJK.2 size=791945 2024-09-12T00:22:14.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.393+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=OQO6FVU43GJK tag=F6353348DN6P type=write size=3937673 2024-09-12T00:22:14.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.397+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~0BTVQ300JMYN.0 size=1048576 2024-09-12T00:22:14.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.401+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~0BTVQ300JMYN.1 size=737968 2024-09-12T00:22:14.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.405+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=0BTVQ300JMYN tag=XG2F7WNILUBJ type=write size=2835120 2024-09-12T00:22:14.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.409+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=BYB0MUI6ULFV type=del size=1119520 2024-09-12T00:22:14.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.413+0000 7fd6489978c0 -1 < no bi entry to suggest for operation key=9CK160BK5YYY tag=LXMI75B8MN9B type=del size=2753580: (2) No such file or directory 2024-09-12T00:22:14.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.417+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=PL0EO2K49A1M type=del size=4168944 2024-09-12T00:22:14.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.421+0000 7fd6489978c0 1 < completed delete operation key=8FBXDX6GELE7 tag=MBNZ2QZR3PI8 type=del 2024-09-12T00:22:14.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.421+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=IYIN9VQ64VF9 type=del size=503661 2024-09-12T00:22:14.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.429+0000 7fd6489978c0 1 < suggested remove operation key=25P4P2I6BE3H tag=T3U43J3UMQDZ type=del 2024-09-12T00:22:14.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.433+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=9D6CLGZ1LHFZ type=del size=298325 2024-09-12T00:22:14.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.437+0000 7fd6489978c0 1 < canceled part key=_multipart_CBXBFK3OXXKG.2~Y0PLJE0OHQ24.0 size=704912 2024-09-12T00:22:14.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.441+0000 7fd6489978c0 1 < canceled multipart upload key=CBXBFK3OXXKG upload=Y0PLJE0OHQ24 tag=ZK4BL440AV4R type=write size=1753488 2024-09-12T00:22:14.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.449+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~BXKUFOQHQ15X.0 size=1048576 2024-09-12T00:22:14.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.449+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~BXKUFOQHQ15X.1 size=920563 2024-09-12T00:22:14.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.449+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=BXKUFOQHQ15X tag=6RKO4RUR4IL1 type=write size=3017715 2024-09-12T00:22:14.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.453+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~EKRB42A1ZV13.0 size=1048576 2024-09-12T00:22:14.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.457+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~EKRB42A1ZV13.1 size=591416 2024-09-12T00:22:14.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.461+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=EKRB42A1ZV13 tag=N1C87D4LNSGK type=write size=2688568 2024-09-12T00:22:14.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.465+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=PIP35MHRULUO type=del size=1042426 2024-09-12T00:22:14.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.469+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=U2YFK4PM16BJ type=del 2024-09-12T00:22:14.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.473+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=O4QJUAOE03FY type=del size=2721256 2024-09-12T00:22:14.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.477+0000 7fd6489978c0 1 < canceled operation key=3JZP8TZFEIMH tag=E99HCHTQ7JZ0 type=del size=2886768 2024-09-12T00:22:14.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.481+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=GCTUBJSJSVEE type=del size=2315535 2024-09-12T00:22:14.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.485+0000 7fd6489978c0 1 < completed write operation key=N4S6I47NSJK6 tag=WFBPDSZ0TAWV type=write size=875477 2024-09-12T00:22:14.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.489+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=CS9ELUI24BVB type=del size=1614920 2024-09-12T00:22:14.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.493+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=9DY2DRIYL3A2 type=del 2024-09-12T00:22:14.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.497+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=WA78954EMXOI type=del size=943455 2024-09-12T00:22:14.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.505+0000 7fd6489978c0 1 < suggested update operation key=HUKWLE56FRX2 tag=9D0OKUR7JYPG type=del size=2458986 2024-09-12T00:22:14.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.513+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~R5FFS6AMZ0NR.0 size=1048576 2024-09-12T00:22:14.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.513+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~R5FFS6AMZ0NR.1 size=474202 2024-09-12T00:22:14.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.513+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=R5FFS6AMZ0NR tag=FFV51A01NCZA type=write size=2571354 2024-09-12T00:22:14.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.517+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=891L06Z0GV9Y type=del 2024-09-12T00:22:14.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.521+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=QI23B44R6J7D type=del size=2348215 2024-09-12T00:22:14.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.525+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~MXF1EVT3HB03.0 size=867913 2024-09-12T00:22:14.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.533+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=MXF1EVT3HB03 tag=19Y0J0JH7PG6 type=write size=1916489 2024-09-12T00:22:14.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.537+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=HY2YVCTWK07Z type=del size=3721093 2024-09-12T00:22:14.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.541+0000 7fd6489978c0 1 < completed write operation key=N0AAVPQ6MUQ1 tag=9VZX1836ENJF type=write size=293250 2024-09-12T00:22:14.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.549+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~C3W1RNLT5MXD.0 size=1048576 2024-09-12T00:22:14.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.549+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~C3W1RNLT5MXD.1 size=1048576 2024-09-12T00:22:14.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.553+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~C3W1RNLT5MXD.2 size=843429 2024-09-12T00:22:14.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.553+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=C3W1RNLT5MXD tag=019LOSNS6COD type=write size=3989157 2024-09-12T00:22:14.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.557+0000 7fd6489978c0 -1 < failed to complete operation key=HUKWLE56FRX2 tag=RBRR1N98THQQ type=del size=3813508: (22) Invalid argument 2024-09-12T00:22:14.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.561+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=QXK6L2KKTIO7 type=del size=2497158 2024-09-12T00:22:14.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.565+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~OQO6FVU43GJK.0 size=1048576 2024-09-12T00:22:14.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.569+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~OQO6FVU43GJK.1 size=1048576 2024-09-12T00:22:14.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.569+0000 7fd6489978c0 1 < canceled part key=_multipart_F2CTWM0T2698.2~OQO6FVU43GJK.2 size=791945 2024-09-12T00:22:14.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.573+0000 7fd6489978c0 1 < canceled multipart upload key=F2CTWM0T2698 upload=OQO6FVU43GJK tag=F6353348DN6P type=write size=3937673 2024-09-12T00:22:14.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.577+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=ECOIAWQYHRAY type=del size=1557561 2024-09-12T00:22:14.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.585+0000 7fd6489978c0 1 < suggested update operation key=KAT2TB3FGAYG tag=BYB0MUI6ULFV type=del size=1119520 2024-09-12T00:22:14.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.593+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~EXLHYHLVVYFB.0 size=403315 2024-09-12T00:22:14.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.593+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=EXLHYHLVVYFB tag=EPZNWFHWSV8S type=write size=1451891 2024-09-12T00:22:14.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.597+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=PL0EO2K49A1M type=del 2024-09-12T00:22:14.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.601+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~S9XIWDP3N10C.0 size=1048576 2024-09-12T00:22:14.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.605+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~S9XIWDP3N10C.1 size=1026602 2024-09-12T00:22:14.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.605+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=S9XIWDP3N10C tag=YEX4K5CCSGO0 type=write size=3123754 2024-09-12T00:22:14.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.609+0000 7fd6489978c0 -1 < failed to complete operation key=25P4P2I6BE3H tag=IYIN9VQ64VF9 type=del size=503661: (22) Invalid argument 2024-09-12T00:22:14.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.617+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~52OBDBGD23HA.0 size=1048576 2024-09-12T00:22:14.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.617+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~52OBDBGD23HA.1 size=1048576 2024-09-12T00:22:14.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.621+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~52OBDBGD23HA.2 size=341132 2024-09-12T00:22:14.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.621+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=52OBDBGD23HA tag=WCOFSRAHG01H type=write size=3486860 2024-09-12T00:22:14.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.625+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=9D6CLGZ1LHFZ type=del 2024-09-12T00:22:14.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.629+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=5C5L0B5V613W type=del size=1047825 2024-09-12T00:22:14.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.633+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~BXKUFOQHQ15X.0 size=1048576 2024-09-12T00:22:14.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.633+0000 7fd6489978c0 1 < canceled part key=_multipart_ZW51KHCLPYN3.2~BXKUFOQHQ15X.1 size=920563 2024-09-12T00:22:14.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.637+0000 7fd6489978c0 1 < canceled multipart upload key=ZW51KHCLPYN3 upload=BXKUFOQHQ15X tag=6RKO4RUR4IL1 type=write size=3017715 2024-09-12T00:22:14.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.645+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=TI9JYD5PONQK type=del size=3116256 2024-09-12T00:22:14.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.649+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=PIP35MHRULUO type=del 2024-09-12T00:22:14.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.653+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=O58PZ9A8WP6O type=del size=3001673 2024-09-12T00:22:14.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.657+0000 7fd6489978c0 1 < completed delete operation key=3JZP8TZFEIMH tag=O4QJUAOE03FY type=del 2024-09-12T00:22:14.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.665+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~9OVRHDGZCIXS.0 size=1048576 2024-09-12T00:22:14.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.669+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~9OVRHDGZCIXS.1 size=1048576 2024-09-12T00:22:14.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.669+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~9OVRHDGZCIXS.2 size=943836 2024-09-12T00:22:14.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.669+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=9OVRHDGZCIXS tag=8PQ1MLY8O1RH type=write size=4089564 2024-09-12T00:22:14.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.677+0000 7fd6489978c0 1 < suggested remove operation key=N4S6I47NSJK6 tag=GCTUBJSJSVEE type=del 2024-09-12T00:22:14.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.685+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~V4LHSNJSF4Z4.0 size=1048576 2024-09-12T00:22:14.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.689+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~V4LHSNJSF4Z4.1 size=1048576 2024-09-12T00:22:14.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.689+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~V4LHSNJSF4Z4.2 size=608232 2024-09-12T00:22:14.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.689+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=V4LHSNJSF4Z4 tag=GTI472GI0QZD type=write size=3753960 2024-09-12T00:22:14.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.693+0000 7fd6489978c0 -1 < no bi entry to suggest for operation key=N4S6I47NSJK6 tag=CS9ELUI24BVB type=del size=1614920: (2) No such file or directory 2024-09-12T00:22:14.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.697+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=A1Y380FQCVON type=del size=2610465 2024-09-12T00:22:14.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.697+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=WA78954EMXOI type=del 2024-09-12T00:22:14.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.701+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=4TO8NN26GPBQ type=del size=3490936 2024-09-12T00:22:14.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.705+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~R5FFS6AMZ0NR.0 size=1048576 2024-09-12T00:22:14.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.709+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~R5FFS6AMZ0NR.1 size=474202 2024-09-12T00:22:14.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.713+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=R5FFS6AMZ0NR tag=FFV51A01NCZA type=write size=2571354 2024-09-12T00:22:14.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.717+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=1E4VOTH0WQXS type=del size=289852 2024-09-12T00:22:14.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.725+0000 7fd6489978c0 1 < suggested update operation key=ES2BLTWZT6PT tag=QI23B44R6J7D type=del size=2348215 2024-09-12T00:22:14.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.733+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~E4NKWM6XN9PV.0 size=1048576 2024-09-12T00:22:14.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.737+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~E4NKWM6XN9PV.1 size=782951 2024-09-12T00:22:14.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.737+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=E4NKWM6XN9PV tag=MXLL7463LV5P type=write size=2880103 2024-09-12T00:22:14.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.741+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=HY2YVCTWK07Z type=del 2024-09-12T00:22:14.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.749+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~QZ3T2QKHWTX8.0 size=761671 2024-09-12T00:22:14.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.749+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=QZ3T2QKHWTX8 tag=D0OWGGXLI7KK type=write size=1810247 2024-09-12T00:22:14.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.753+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~C3W1RNLT5MXD.0 size=1048576 2024-09-12T00:22:14.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.753+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~C3W1RNLT5MXD.1 size=1048576 2024-09-12T00:22:14.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.757+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~C3W1RNLT5MXD.2 size=843429 2024-09-12T00:22:14.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.765+0000 7fd6489978c0 1 < completed multipart upload key=9CK160BK5YYY upload=C3W1RNLT5MXD tag=019LOSNS6COD type=write size=3989157 2024-09-12T00:22:14.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.769+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=6L8P36W4BMZL type=del size=2341003 2024-09-12T00:22:14.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.769+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=QXK6L2KKTIO7 type=del 2024-09-12T00:22:14.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.773+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=NNDKP1Z5BVQP type=del size=1096926 2024-09-12T00:22:14.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.777+0000 7fd6489978c0 -1 < failed to complete operation key=ES2BLTWZT6PT tag=ECOIAWQYHRAY type=del size=1557561: (22) Invalid argument 2024-09-12T00:22:14.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.781+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=PUMRM8HEH44B type=del size=1739139 2024-09-12T00:22:14.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.785+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~EXLHYHLVVYFB.0 size=403315 2024-09-12T00:22:14.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.793+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=EXLHYHLVVYFB tag=EPZNWFHWSV8S type=write size=1451891 2024-09-12T00:22:14.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.797+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=ECXBTQMQ935A type=del size=3534910 2024-09-12T00:22:14.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.797+0000 7fd6489978c0 1 < canceled part key=_multipart_3JZP8TZFEIMH.2~S9XIWDP3N10C.0 size=1048576 2024-09-12T00:22:14.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.797+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~S9XIWDP3N10C.1 size=1026602 2024-09-12T00:22:14.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.805+0000 7fd6489978c0 1 < canceled multipart upload key=3JZP8TZFEIMH upload=S9XIWDP3N10C tag=YEX4K5CCSGO0 type=write size=3123754 2024-09-12T00:22:14.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.809+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=0YM5H0O0741X type=del size=2409489 2024-09-12T00:22:14.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.813+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~52OBDBGD23HA.0 size=1048576 2024-09-12T00:22:14.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.813+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~52OBDBGD23HA.1 size=1048576 2024-09-12T00:22:14.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.817+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~52OBDBGD23HA.2 size=341132 2024-09-12T00:22:14.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.825+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=52OBDBGD23HA tag=WCOFSRAHG01H type=write size=3486860 2024-09-12T00:22:14.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.829+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~HRS9PY3GQ0Z3.0 size=1048576 2024-09-12T00:22:14.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.833+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~HRS9PY3GQ0Z3.1 size=1048576 2024-09-12T00:22:14.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.837+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~HRS9PY3GQ0Z3.2 size=821652 2024-09-12T00:22:14.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.837+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=HRS9PY3GQ0Z3 tag=W3PFQUF4THLD type=write size=3967380 2024-09-12T00:22:14.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.841+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=5C5L0B5V613W type=del 2024-09-12T00:22:14.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.845+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=CES4PN7J448R type=write size=316953 2024-09-12T00:22:14.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.845+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=TI9JYD5PONQK type=del 2024-09-12T00:22:14.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.849+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=WPD2M3DBKYOG type=del size=1402903 2024-09-12T00:22:14.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.853+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=O58PZ9A8WP6O type=del 2024-09-12T00:22:14.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.861+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~97NGKZ4H04OS.0 size=1048576 2024-09-12T00:22:14.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.865+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~97NGKZ4H04OS.1 size=1048576 2024-09-12T00:22:14.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.865+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~97NGKZ4H04OS.2 size=131593 2024-09-12T00:22:14.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.865+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=97NGKZ4H04OS tag=EXU0E376YEPP type=write size=3277321 2024-09-12T00:22:14.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.869+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~9OVRHDGZCIXS.0 size=1048576 2024-09-12T00:22:14.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.873+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~9OVRHDGZCIXS.1 size=1048576 2024-09-12T00:22:14.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.877+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~9OVRHDGZCIXS.2 size=943836 2024-09-12T00:22:14.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.881+0000 7fd6489978c0 1 < completed multipart upload key=CFID1EVBXOVJ upload=9OVRHDGZCIXS tag=8PQ1MLY8O1RH type=write size=4089564 2024-09-12T00:22:14.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.885+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=WI6VQYAE84G6 type=del size=1930532 2024-09-12T00:22:14.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.889+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~V4LHSNJSF4Z4.0 size=1048576 2024-09-12T00:22:14.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.893+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~V4LHSNJSF4Z4.1 size=1048576 2024-09-12T00:22:14.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.897+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~V4LHSNJSF4Z4.2 size=608232 2024-09-12T00:22:14.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.901+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=V4LHSNJSF4Z4 tag=GTI472GI0QZD type=write size=3753960 2024-09-12T00:22:14.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.909+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~8PF108OQZ1HD.0 size=1048576 2024-09-12T00:22:14.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.913+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~8PF108OQZ1HD.1 size=774932 2024-09-12T00:22:14.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.913+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=8PF108OQZ1HD tag=87SUSQGFWRPD type=write size=2872084 2024-09-12T00:22:14.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.921+0000 7fd6489978c0 1 < suggested remove operation key=9CK160BK5YYY tag=A1Y380FQCVON type=del 2024-09-12T00:22:14.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.925+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=3UHYNPLRUPQX type=del size=3581367 2024-09-12T00:22:14.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.929+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=4TO8NN26GPBQ type=del 2024-09-12T00:22:14.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.933+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=2U1UIZFAFZNN type=del size=613047 2024-09-12T00:22:14.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.937+0000 7fd6489978c0 1 < completed delete operation key=JPVKBVRCZTE9 tag=1E4VOTH0WQXS type=del 2024-09-12T00:22:14.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.941+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=1TIX5X2TSL5Q type=del size=804585 2024-09-12T00:22:14.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.945+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~E4NKWM6XN9PV.0 size=1048576 2024-09-12T00:22:14.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.949+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~E4NKWM6XN9PV.1 size=782951 2024-09-12T00:22:14.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.953+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=E4NKWM6XN9PV tag=MXLL7463LV5P type=write size=2880103 2024-09-12T00:22:14.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.957+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=WFHX7K9O3SVE type=write size=367104 2024-09-12T00:22:14.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.961+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~QZ3T2QKHWTX8.0 size=761671 2024-09-12T00:22:14.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.969+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=QZ3T2QKHWTX8 tag=D0OWGGXLI7KK type=write size=1810247 2024-09-12T00:22:14.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.977+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~YR2AD8JV4C4S.0 size=1048576 2024-09-12T00:22:14.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.977+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~YR2AD8JV4C4S.1 size=1048576 2024-09-12T00:22:14.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.981+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~YR2AD8JV4C4S.2 size=1020433 2024-09-12T00:22:14.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.981+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=YR2AD8JV4C4S tag=YMHZ2JVY7GN3 type=write size=4166161 2024-09-12T00:22:14.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.985+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=6L8P36W4BMZL type=del 2024-09-12T00:22:14.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.997+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~K4H9XSX7SOI6.0 size=1048576 2024-09-12T00:22:14.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.997+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~K4H9XSX7SOI6.1 size=965453 2024-09-12T00:22:14.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:14.997+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=K4H9XSX7SOI6 tag=4GKNO5PQDHII type=write size=3062605 2024-09-12T00:22:15.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.005+0000 7fd6489978c0 1 < suggested update operation key=YSPRZ87DZ2OD tag=NNDKP1Z5BVQP type=del size=1096926 2024-09-12T00:22:15.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.009+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=B30QHFGPYXWB type=del size=3380314 2024-09-12T00:22:15.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.013+0000 7fd6489978c0 1 < completed delete operation key=LZICTA4BWOW8 tag=PUMRM8HEH44B type=del 2024-09-12T00:22:15.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.021+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~G4OB1A211QKO.0 size=140794 2024-09-12T00:22:15.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.021+0000 7fd6489978c0 1 > prepared multipart upload key=DAOTTEMK2P2T upload=G4OB1A211QKO tag=42F2GA3ZGFRE type=write size=1189370 2024-09-12T00:22:15.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.025+0000 7fd6489978c0 1 < completed delete operation key=8FBXDX6GELE7 tag=ECXBTQMQ935A type=del 2024-09-12T00:22:15.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.029+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=3VMPC0VDPLAU type=write size=1020913 2024-09-12T00:22:15.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.033+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=0YM5H0O0741X type=del 2024-09-12T00:22:15.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.037+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~0PUQG78HGROY.0 size=1048576 2024-09-12T00:22:15.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.041+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~0PUQG78HGROY.1 size=214573 2024-09-12T00:22:15.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.041+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=0PUQG78HGROY tag=DKCEQ3B2Z4K3 type=write size=2311725 2024-09-12T00:22:15.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.045+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~HRS9PY3GQ0Z3.0 size=1048576 2024-09-12T00:22:15.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.049+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~HRS9PY3GQ0Z3.1 size=1048576 2024-09-12T00:22:15.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.049+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~HRS9PY3GQ0Z3.2 size=821652 2024-09-12T00:22:15.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.057+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=HRS9PY3GQ0Z3 tag=W3PFQUF4THLD type=write size=3967380 2024-09-12T00:22:15.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.057+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=X088431Z1M9I type=del size=3076592 2024-09-12T00:22:15.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.065+0000 7fd6489978c0 1 < suggested update operation key=F2CTWM0T2698 tag=CES4PN7J448R type=write size=316953 2024-09-12T00:22:15.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.073+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~UP015DEL606R.0 size=1048576 2024-09-12T00:22:15.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.073+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~UP015DEL606R.1 size=1048576 2024-09-12T00:22:15.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.077+0000 7fd6489978c0 1 > prepared part key=_multipart_9CK160BK5YYY.2~UP015DEL606R.2 size=885649 2024-09-12T00:22:15.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.077+0000 7fd6489978c0 1 > prepared multipart upload key=9CK160BK5YYY upload=UP015DEL606R tag=Q0BRJ1QPF3F4 type=write size=4031377 2024-09-12T00:22:15.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.081+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=WPD2M3DBKYOG type=del 2024-09-12T00:22:15.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.089+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~6Q9V36Z42F80.0 size=1048576 2024-09-12T00:22:15.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.089+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~6Q9V36Z42F80.1 size=1048576 2024-09-12T00:22:15.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.093+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~6Q9V36Z42F80.2 size=391290 2024-09-12T00:22:15.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.093+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=6Q9V36Z42F80 tag=Z76CJDOEY2E2 type=write size=3537018 2024-09-12T00:22:15.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.097+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~97NGKZ4H04OS.0 size=1048576 2024-09-12T00:22:15.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.097+0000 7fd6489978c0 1 < canceled part key=_multipart_N0AAVPQ6MUQ1.2~97NGKZ4H04OS.1 size=1048576 2024-09-12T00:22:15.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.097+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~97NGKZ4H04OS.2 size=131593 2024-09-12T00:22:15.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.105+0000 7fd6489978c0 1 < canceled multipart upload key=N0AAVPQ6MUQ1 upload=97NGKZ4H04OS tag=EXU0E376YEPP type=write size=3277321 2024-09-12T00:22:15.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.113+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~GVFJNVADN1NC.0 size=329439 2024-09-12T00:22:15.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.113+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=GVFJNVADN1NC tag=XUUIAXCVVA7F type=write size=1378015 2024-09-12T00:22:15.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.113+0000 7fd6489978c0 1 < canceled operation key=2KP09UFI3N8B tag=WI6VQYAE84G6 type=del size=1930532 2024-09-12T00:22:15.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.121+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~33JT2RXQIPF8.0 size=1048576 2024-09-12T00:22:15.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.125+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~33JT2RXQIPF8.1 size=670972 2024-09-12T00:22:15.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.125+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=33JT2RXQIPF8 tag=II283FGB3Y2W type=write size=2768124 2024-09-12T00:22:15.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.129+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~8PF108OQZ1HD.0 size=1048576 2024-09-12T00:22:15.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.133+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~8PF108OQZ1HD.1 size=774932 2024-09-12T00:22:15.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.137+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=8PF108OQZ1HD tag=87SUSQGFWRPD type=write size=2872084 2024-09-12T00:22:15.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.141+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=H1RP6J9GHAZW type=del size=461750 2024-09-12T00:22:15.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.145+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=3UHYNPLRUPQX type=del 2024-09-12T00:22:15.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.149+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=XMIA90NI71A7 type=del size=1744629 2024-09-12T00:22:15.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.157+0000 7fd6489978c0 1 < suggested remove operation key=N0AAVPQ6MUQ1 tag=2U1UIZFAFZNN type=del 2024-09-12T00:22:15.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.165+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~DG9F6TWA157T.0 size=1048576 2024-09-12T00:22:15.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.165+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~DG9F6TWA157T.1 size=1048576 2024-09-12T00:22:15.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.169+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~DG9F6TWA157T.2 size=1009436 2024-09-12T00:22:15.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.169+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=DG9F6TWA157T tag=417NGG64QSGV type=write size=4155164 2024-09-12T00:22:15.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.173+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=1TIX5X2TSL5Q type=del 2024-09-12T00:22:15.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.181+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~EN71J5BUFS7O.0 size=1048576 2024-09-12T00:22:15.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.181+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~EN71J5BUFS7O.1 size=1048576 2024-09-12T00:22:15.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.185+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~EN71J5BUFS7O.2 size=260326 2024-09-12T00:22:15.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.185+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=EN71J5BUFS7O tag=LW5UJPJ99U1V type=write size=3406054 2024-09-12T00:22:15.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.189+0000 7fd6489978c0 1 < completed write operation key=8JCL0F406L7I tag=WFHX7K9O3SVE type=write size=367104 2024-09-12T00:22:15.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.197+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~MLDAWY0XL4H2.0 size=1048576 2024-09-12T00:22:15.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.197+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~MLDAWY0XL4H2.1 size=161979 2024-09-12T00:22:15.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.197+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=MLDAWY0XL4H2 tag=5PR6WCAR5L8C type=write size=2259131 2024-09-12T00:22:15.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.201+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~YR2AD8JV4C4S.0 size=1048576 2024-09-12T00:22:15.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.205+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~YR2AD8JV4C4S.1 size=1048576 2024-09-12T00:22:15.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.209+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~YR2AD8JV4C4S.2 size=1020433 2024-09-12T00:22:15.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.213+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=YR2AD8JV4C4S tag=YMHZ2JVY7GN3 type=write size=4166161 2024-09-12T00:22:15.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.217+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=YOQRCC1OZVRQ type=del size=2484994 2024-09-12T00:22:15.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.221+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~K4H9XSX7SOI6.0 size=1048576 2024-09-12T00:22:15.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.225+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~K4H9XSX7SOI6.1 size=965453 2024-09-12T00:22:15.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.233+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=K4H9XSX7SOI6 tag=4GKNO5PQDHII type=write size=3062605 2024-09-12T00:22:15.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.237+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~60FJXXOWCZQ9.0 size=1048576 2024-09-12T00:22:15.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.241+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~60FJXXOWCZQ9.1 size=528413 2024-09-12T00:22:15.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.241+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=60FJXXOWCZQ9 tag=6LS5V72VE60P type=write size=2625565 2024-09-12T00:22:15.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.245+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=B30QHFGPYXWB type=del 2024-09-12T00:22:15.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.249+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=FANBMQWSP6JP type=del size=4176593 2024-09-12T00:22:15.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.253+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~G4OB1A211QKO.0 size=140794 2024-09-12T00:22:15.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.257+0000 7fd6489978c0 1 < completed multipart upload key=DAOTTEMK2P2T upload=G4OB1A211QKO tag=42F2GA3ZGFRE type=write size=1189370 2024-09-12T00:22:15.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.265+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~WDVQDQUQX3TI.0 size=7266 2024-09-12T00:22:15.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.265+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=WDVQDQUQX3TI tag=5YG69LM43TTO type=write size=1055842 2024-09-12T00:22:15.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.269+0000 7fd6489978c0 1 < completed write operation key=CBXBFK3OXXKG tag=3VMPC0VDPLAU type=write size=1020913 2024-09-12T00:22:15.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.269+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=TURXKGO8S9FQ type=write size=171875 2024-09-12T00:22:15.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.273+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~0PUQG78HGROY.0 size=1048576 2024-09-12T00:22:15.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.277+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~0PUQG78HGROY.1 size=214573 2024-09-12T00:22:15.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.285+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=0PUQG78HGROY tag=DKCEQ3B2Z4K3 type=write size=2311725 2024-09-12T00:22:15.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.289+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~M2A0HKXOY2NI.0 size=1048576 2024-09-12T00:22:15.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.293+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~M2A0HKXOY2NI.1 size=102194 2024-09-12T00:22:15.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.293+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=M2A0HKXOY2NI tag=SU9KEPSCJAAP type=write size=2199346 2024-09-12T00:22:15.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.297+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=X088431Z1M9I type=del 2024-09-12T00:22:15.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.305+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~GJCIN8Y78GBM.0 size=1048576 2024-09-12T00:22:15.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.305+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~GJCIN8Y78GBM.1 size=608714 2024-09-12T00:22:15.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.305+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=GJCIN8Y78GBM tag=WURCUF9QB5H4 type=write size=2705866 2024-09-12T00:22:15.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.309+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~UP015DEL606R.0 size=1048576 2024-09-12T00:22:15.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.313+0000 7fd6489978c0 1 < completed part key=_multipart_9CK160BK5YYY.2~UP015DEL606R.1 size=1048576 2024-09-12T00:22:15.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.313+0000 7fd6489978c0 1 < canceled part key=_multipart_9CK160BK5YYY.2~UP015DEL606R.2 size=885649 2024-09-12T00:22:15.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.325+0000 7fd6489978c0 1 < canceled multipart upload key=9CK160BK5YYY upload=UP015DEL606R tag=Q0BRJ1QPF3F4 type=write size=4031377 2024-09-12T00:22:15.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.329+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=YZ29GTXDL0B4 type=del size=695075 2024-09-12T00:22:15.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.333+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~6Q9V36Z42F80.0 size=1048576 2024-09-12T00:22:15.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.337+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~6Q9V36Z42F80.1 size=1048576 2024-09-12T00:22:15.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.341+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~6Q9V36Z42F80.2 size=391290 2024-09-12T00:22:15.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.345+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=6Q9V36Z42F80 tag=Z76CJDOEY2E2 type=write size=3537018 2024-09-12T00:22:15.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.353+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~OUJW1EVKPNSG.0 size=424098 2024-09-12T00:22:15.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.353+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=OUJW1EVKPNSG tag=12S1CR5N96ER type=write size=1472674 2024-09-12T00:22:15.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.357+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~GVFJNVADN1NC.0 size=329439 2024-09-12T00:22:15.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.361+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=GVFJNVADN1NC tag=XUUIAXCVVA7F type=write size=1378015 2024-09-12T00:22:15.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.365+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=8HE5P2WTV9VP type=del size=1808964 2024-09-12T00:22:15.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.369+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~33JT2RXQIPF8.0 size=1048576 2024-09-12T00:22:15.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.373+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~33JT2RXQIPF8.1 size=670972 2024-09-12T00:22:15.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.377+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=33JT2RXQIPF8 tag=II283FGB3Y2W type=write size=2768124 2024-09-12T00:22:15.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.381+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=Y9RHDSF5U8N6 type=del size=746809 2024-09-12T00:22:15.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.385+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=H1RP6J9GHAZW type=del 2024-09-12T00:22:15.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.389+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=JU97ZY9XHWMI type=write size=1021128 2024-09-12T00:22:15.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.393+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=XMIA90NI71A7 type=del 2024-09-12T00:22:15.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.401+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~JIGNHZ1PIK9T.0 size=1048576 2024-09-12T00:22:15.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.401+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~JIGNHZ1PIK9T.1 size=892735 2024-09-12T00:22:15.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.401+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=JIGNHZ1PIK9T tag=FQPC2H1M4LI9 type=write size=2989887 2024-09-12T00:22:15.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.405+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~DG9F6TWA157T.0 size=1048576 2024-09-12T00:22:15.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.409+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~DG9F6TWA157T.1 size=1048576 2024-09-12T00:22:15.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.413+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~DG9F6TWA157T.2 size=1009436 2024-09-12T00:22:15.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.417+0000 7fd6489978c0 1 < completed multipart upload key=G4EUTQOHAT2E upload=DG9F6TWA157T tag=417NGG64QSGV type=write size=4155164 2024-09-12T00:22:15.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.425+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~489T06N0X1XO.0 size=819219 2024-09-12T00:22:15.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.425+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=489T06N0X1XO tag=K8JJKC81B3T1 type=write size=1867795 2024-09-12T00:22:15.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.429+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~EN71J5BUFS7O.0 size=1048576 2024-09-12T00:22:15.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.433+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~EN71J5BUFS7O.1 size=1048576 2024-09-12T00:22:15.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.433+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~EN71J5BUFS7O.2 size=260326 2024-09-12T00:22:15.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.441+0000 7fd6489978c0 1 < completed multipart upload key=G4EUTQOHAT2E upload=EN71J5BUFS7O tag=LW5UJPJ99U1V type=write size=3406054 2024-09-12T00:22:15.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.445+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~DO2OEKIWS644.0 size=997836 2024-09-12T00:22:15.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.445+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=DO2OEKIWS644 tag=V7UL6OYEPLSP type=write size=2046412 2024-09-12T00:22:15.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.449+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~MLDAWY0XL4H2.0 size=1048576 2024-09-12T00:22:15.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.453+0000 7fd6489978c0 1 < completed part key=_multipart_IHYHPKVPWTUL.2~MLDAWY0XL4H2.1 size=161979 2024-09-12T00:22:15.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.461+0000 7fd6489978c0 1 < completed multipart upload key=IHYHPKVPWTUL upload=MLDAWY0XL4H2 tag=5PR6WCAR5L8C type=write size=2259131 2024-09-12T00:22:15.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.465+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~ZT7LUP1BCL45.0 size=1048576 2024-09-12T00:22:15.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.469+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~ZT7LUP1BCL45.1 size=48790 2024-09-12T00:22:15.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.469+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=ZT7LUP1BCL45 tag=VK3XAY8KKJHF type=write size=2145942 2024-09-12T00:22:15.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.477+0000 7fd6489978c0 1 < suggested remove operation key=YJJBTNI318EH tag=YOQRCC1OZVRQ type=del 2024-09-12T00:22:15.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.481+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=SLN0VO76F0T7 type=del size=3371194 2024-09-12T00:22:15.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.485+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~60FJXXOWCZQ9.0 size=1048576 2024-09-12T00:22:15.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.489+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~60FJXXOWCZQ9.1 size=528413 2024-09-12T00:22:15.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.493+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=60FJXXOWCZQ9 tag=6LS5V72VE60P type=write size=2625565 2024-09-12T00:22:15.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.497+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=4M10DL35PNKK type=write size=149214 2024-09-12T00:22:15.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.501+0000 7fd6489978c0 1 < completed delete operation key=3JZP8TZFEIMH tag=FANBMQWSP6JP type=del 2024-09-12T00:22:15.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.505+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=TI520XH811AY type=write size=139280 2024-09-12T00:22:15.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.505+0000 7fd6489978c0 1 < canceled part key=_multipart_YSPRZ87DZ2OD.2~WDVQDQUQX3TI.0 size=7266 2024-09-12T00:22:15.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.509+0000 7fd6489978c0 1 < canceled multipart upload key=YSPRZ87DZ2OD upload=WDVQDQUQX3TI tag=5YG69LM43TTO type=write size=1055842 2024-09-12T00:22:15.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.517+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~G54SHR8G11WL.0 size=1048576 2024-09-12T00:22:15.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.521+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~G54SHR8G11WL.1 size=400049 2024-09-12T00:22:15.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.521+0000 7fd6489978c0 1 > prepared multipart upload key=DAOTTEMK2P2T upload=G54SHR8G11WL tag=7DAMGR0K8YJ3 type=write size=2497201 2024-09-12T00:22:15.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.525+0000 7fd6489978c0 1 < completed write operation key=8JCL0F406L7I tag=TURXKGO8S9FQ type=write size=171875 2024-09-12T00:22:15.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.533+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~XBNG6CZKLXWT.0 size=1048576 2024-09-12T00:22:15.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.533+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~XBNG6CZKLXWT.1 size=1048576 2024-09-12T00:22:15.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.537+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~XBNG6CZKLXWT.2 size=928763 2024-09-12T00:22:15.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.537+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=XBNG6CZKLXWT tag=4VJHYGJ7A0M7 type=write size=4074491 2024-09-12T00:22:15.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.537+0000 7fd6489978c0 1 < canceled part key=_multipart_YSPRZ87DZ2OD.2~M2A0HKXOY2NI.0 size=1048576 2024-09-12T00:22:15.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.541+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~M2A0HKXOY2NI.1 size=102194 2024-09-12T00:22:15.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.549+0000 7fd6489978c0 1 < canceled multipart upload key=YSPRZ87DZ2OD upload=M2A0HKXOY2NI tag=SU9KEPSCJAAP type=write size=2199346 2024-09-12T00:22:15.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.553+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~M1L9E95JQ87F.0 size=312641 2024-09-12T00:22:15.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.553+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=M1L9E95JQ87F tag=CW3344YC8DMG type=write size=1361217 2024-09-12T00:22:15.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.557+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~GJCIN8Y78GBM.0 size=1048576 2024-09-12T00:22:15.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.561+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~GJCIN8Y78GBM.1 size=608714 2024-09-12T00:22:15.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.569+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=GJCIN8Y78GBM tag=WURCUF9QB5H4 type=write size=2705866 2024-09-12T00:22:15.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.573+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=91LADVAWJBE2 type=del size=2819181 2024-09-12T00:22:15.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.577+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=YZ29GTXDL0B4 type=del 2024-09-12T00:22:15.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.585+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~2NAIY7UC80S3.0 size=1048576 2024-09-12T00:22:15.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.589+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~2NAIY7UC80S3.1 size=1048576 2024-09-12T00:22:15.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.589+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~2NAIY7UC80S3.2 size=772751 2024-09-12T00:22:15.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.589+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=2NAIY7UC80S3 tag=XM9DA6Y619RC type=write size=3918479 2024-09-12T00:22:15.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.593+0000 7fd6489978c0 1 < canceled part key=_multipart_YSPRZ87DZ2OD.2~OUJW1EVKPNSG.0 size=424098 2024-09-12T00:22:15.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.601+0000 7fd6489978c0 1 < canceled multipart upload key=YSPRZ87DZ2OD upload=OUJW1EVKPNSG tag=12S1CR5N96ER type=write size=1472674 2024-09-12T00:22:15.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.605+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=SIYOHU81FFYT type=del size=2586772 2024-09-12T00:22:15.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.613+0000 7fd6489978c0 1 < suggested remove operation key=ZXEIT45BWHXM tag=8HE5P2WTV9VP type=del 2024-09-12T00:22:15.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.617+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=32I9D8LVFIJL type=del size=215845 2024-09-12T00:22:15.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.625+0000 7fd6489978c0 1 < suggested remove operation key=CFID1EVBXOVJ tag=Y9RHDSF5U8N6 type=del 2024-09-12T00:22:15.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.629+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=VU6BWAUMMKAD type=write size=273768 2024-09-12T00:22:15.629 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.629+0000 7fd6489978c0 1 < completed write operation key=YSPRZ87DZ2OD tag=JU97ZY9XHWMI type=write size=1021128 2024-09-12T00:22:15.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.637+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~ENCDMIJ329SW.0 size=1019117 2024-09-12T00:22:15.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.637+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=ENCDMIJ329SW tag=QA2FIAXHASAY type=write size=2067693 2024-09-12T00:22:15.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.641+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~JIGNHZ1PIK9T.0 size=1048576 2024-09-12T00:22:15.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.645+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~JIGNHZ1PIK9T.1 size=892735 2024-09-12T00:22:15.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.649+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=JIGNHZ1PIK9T tag=FQPC2H1M4LI9 type=write size=2989887 2024-09-12T00:22:15.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.657+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~AIN905FPGXEF.0 size=971678 2024-09-12T00:22:15.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.657+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=AIN905FPGXEF tag=3T8RBHSTG7S0 type=write size=2020254 2024-09-12T00:22:15.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.661+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~489T06N0X1XO.0 size=819219 2024-09-12T00:22:15.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.673+0000 7fd6489978c0 1 < completed multipart upload key=CFID1EVBXOVJ upload=489T06N0X1XO tag=K8JJKC81B3T1 type=write size=1867795 2024-09-12T00:22:15.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.677+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=ZP8RKJAF7RXK type=del size=1440747 2024-09-12T00:22:15.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.681+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~DO2OEKIWS644.0 size=997836 2024-09-12T00:22:15.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.685+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=DO2OEKIWS644 tag=V7UL6OYEPLSP type=write size=2046412 2024-09-12T00:22:15.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.693+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~F32VDZDRP1DM.0 size=1048576 2024-09-12T00:22:15.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.697+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~F32VDZDRP1DM.1 size=1048576 2024-09-12T00:22:15.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.697+0000 7fd6489978c0 1 > prepared part key=_multipart_Y3JFVW74FNT6.2~F32VDZDRP1DM.2 size=465843 2024-09-12T00:22:15.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.697+0000 7fd6489978c0 1 > prepared multipart upload key=Y3JFVW74FNT6 upload=F32VDZDRP1DM tag=1CQPEXJUCF9K type=write size=3611571 2024-09-12T00:22:15.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.701+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~ZT7LUP1BCL45.0 size=1048576 2024-09-12T00:22:15.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.705+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~ZT7LUP1BCL45.1 size=48790 2024-09-12T00:22:15.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.709+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=ZT7LUP1BCL45 tag=VK3XAY8KKJHF type=write size=2145942 2024-09-12T00:22:15.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.713+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=5I529QNZ0GQR type=del size=960407 2024-09-12T00:22:15.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.717+0000 7fd6489978c0 1 < completed delete operation key=HUKWLE56FRX2 tag=SLN0VO76F0T7 type=del 2024-09-12T00:22:15.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.725+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~2IKQ3A3JZ7E5.0 size=1018326 2024-09-12T00:22:15.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.725+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=2IKQ3A3JZ7E5 tag=DL651G55YG64 type=write size=2066902 2024-09-12T00:22:15.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.733+0000 7fd6489978c0 1 < suggested update operation key=25P4P2I6BE3H tag=4M10DL35PNKK type=write size=149214 2024-09-12T00:22:15.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.737+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=ZOS119VC2XUH type=del size=1697416 2024-09-12T00:22:15.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.741+0000 7fd6489978c0 1 < completed write operation key=N0AAVPQ6MUQ1 tag=TI520XH811AY type=write size=139280 2024-09-12T00:22:15.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.749+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~G9ZP3W0LB43P.0 size=1048576 2024-09-12T00:22:15.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.749+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~G9ZP3W0LB43P.1 size=1048576 2024-09-12T00:22:15.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.753+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~G9ZP3W0LB43P.2 size=505699 2024-09-12T00:22:15.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.753+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=G9ZP3W0LB43P tag=9T29PHPBD637 type=write size=3651427 2024-09-12T00:22:15.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.753+0000 7fd6489978c0 1 < canceled part key=_multipart_DAOTTEMK2P2T.2~G54SHR8G11WL.0 size=1048576 2024-09-12T00:22:15.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.757+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~G54SHR8G11WL.1 size=400049 2024-09-12T00:22:15.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.765+0000 7fd6489978c0 1 < canceled multipart upload key=DAOTTEMK2P2T upload=G54SHR8G11WL tag=7DAMGR0K8YJ3 type=write size=2497201 2024-09-12T00:22:15.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.769+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=AE97HFW7SHVO type=del size=3511282 2024-09-12T00:22:15.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.773+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~XBNG6CZKLXWT.0 size=1048576 2024-09-12T00:22:15.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.773+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~XBNG6CZKLXWT.1 size=1048576 2024-09-12T00:22:15.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.777+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~XBNG6CZKLXWT.2 size=928763 2024-09-12T00:22:15.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.785+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=XBNG6CZKLXWT tag=4VJHYGJ7A0M7 type=write size=4074491 2024-09-12T00:22:15.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.789+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=YWEHZZ3HDCRN type=del size=3951354 2024-09-12T00:22:15.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.793+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~M1L9E95JQ87F.0 size=312641 2024-09-12T00:22:15.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.797+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=M1L9E95JQ87F tag=CW3344YC8DMG type=write size=1361217 2024-09-12T00:22:15.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.801+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=8K1A6Q340OPU type=write size=671719 2024-09-12T00:22:15.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.805+0000 7fd6489978c0 1 < completed delete operation key=ZW51KHCLPYN3 tag=91LADVAWJBE2 type=del 2024-09-12T00:22:15.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.809+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=EQ7JP0M7C654 type=write size=545431 2024-09-12T00:22:15.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.813+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~2NAIY7UC80S3.0 size=1048576 2024-09-12T00:22:15.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.813+0000 7fd6489978c0 1 < canceled part key=_multipart_HUKWLE56FRX2.2~2NAIY7UC80S3.1 size=1048576 2024-09-12T00:22:15.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.817+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~2NAIY7UC80S3.2 size=772751 2024-09-12T00:22:15.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.821+0000 7fd6489978c0 1 < canceled multipart upload key=HUKWLE56FRX2 upload=2NAIY7UC80S3 tag=XM9DA6Y619RC type=write size=3918479 2024-09-12T00:22:15.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.825+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=U86EG3XLPY6P type=del size=4008618 2024-09-12T00:22:15.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.829+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=SIYOHU81FFYT type=del 2024-09-12T00:22:15.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.833+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=EJSUZGRO698A type=del size=3269120 2024-09-12T00:22:15.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.841+0000 7fd6489978c0 1 < suggested update operation key=KAT2TB3FGAYG tag=32I9D8LVFIJL type=del size=215845 2024-09-12T00:22:15.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.849+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~99R1HQQTGBQY.0 size=1048576 2024-09-12T00:22:15.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.853+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~99R1HQQTGBQY.1 size=321972 2024-09-12T00:22:15.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.853+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=99R1HQQTGBQY tag=M7D9YUGRTMTE type=write size=2419124 2024-09-12T00:22:15.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.857+0000 7fd6489978c0 1 < completed write operation key=J5IW4G9C72DH tag=VU6BWAUMMKAD type=write size=273768 2024-09-12T00:22:15.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.865+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~XCT5UXGNHPKP.0 size=1048576 2024-09-12T00:22:15.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.869+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~XCT5UXGNHPKP.1 size=846302 2024-09-12T00:22:15.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.869+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=XCT5UXGNHPKP tag=GS9NFNR0F4CS type=write size=2943454 2024-09-12T00:22:15.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.873+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~ENCDMIJ329SW.0 size=1019117 2024-09-12T00:22:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.877+0000 7fd6489978c0 1 < completed multipart upload key=CFID1EVBXOVJ upload=ENCDMIJ329SW tag=QA2FIAXHASAY type=write size=2067693 2024-09-12T00:22:15.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.881+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=QN2SK791QVF5 type=del size=2052973 2024-09-12T00:22:15.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.885+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~AIN905FPGXEF.0 size=971678 2024-09-12T00:22:15.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.893+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=AIN905FPGXEF tag=3T8RBHSTG7S0 type=write size=2020254 2024-09-12T00:22:15.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.897+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~ZMMZJYSDSQUQ.0 size=1048576 2024-09-12T00:22:15.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.901+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~ZMMZJYSDSQUQ.1 size=1048576 2024-09-12T00:22:15.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.905+0000 7fd6489978c0 1 > prepared part key=_multipart_YJJBTNI318EH.2~ZMMZJYSDSQUQ.2 size=226461 2024-09-12T00:22:15.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.905+0000 7fd6489978c0 1 > prepared multipart upload key=YJJBTNI318EH upload=ZMMZJYSDSQUQ tag=CNI6G8UTOL5P type=write size=3372189 2024-09-12T00:22:15.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.909+0000 7fd6489978c0 -1 < failed to complete operation key=25P4P2I6BE3H tag=ZP8RKJAF7RXK type=del size=1440747: (22) Invalid argument 2024-09-12T00:22:15.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.917+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~9CQ4SY9H9HL1.0 size=1048576 2024-09-12T00:22:15.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.917+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~9CQ4SY9H9HL1.1 size=1048576 2024-09-12T00:22:15.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.921+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~9CQ4SY9H9HL1.2 size=1010378 2024-09-12T00:22:15.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.921+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=9CQ4SY9H9HL1 tag=JGY02E52GWBU type=write size=4156106 2024-09-12T00:22:15.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.925+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~F32VDZDRP1DM.0 size=1048576 2024-09-12T00:22:15.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.929+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~F32VDZDRP1DM.1 size=1048576 2024-09-12T00:22:15.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.933+0000 7fd6489978c0 1 < completed part key=_multipart_Y3JFVW74FNT6.2~F32VDZDRP1DM.2 size=465843 2024-09-12T00:22:15.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.937+0000 7fd6489978c0 1 < completed multipart upload key=Y3JFVW74FNT6 upload=F32VDZDRP1DM tag=1CQPEXJUCF9K type=write size=3611571 2024-09-12T00:22:15.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.941+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=ZUQ8T6GLZ300 type=del size=3562223 2024-09-12T00:22:15.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.945+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=5I529QNZ0GQR type=del 2024-09-12T00:22:15.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.953+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~9QETIYTRRDE9.0 size=1048576 2024-09-12T00:22:15.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.953+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~9QETIYTRRDE9.1 size=1048576 2024-09-12T00:22:15.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.957+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~9QETIYTRRDE9.2 size=318989 2024-09-12T00:22:15.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.957+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=9QETIYTRRDE9 tag=EJVXMRPF70QY type=write size=3464717 2024-09-12T00:22:15.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.961+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~2IKQ3A3JZ7E5.0 size=1018326 2024-09-12T00:22:15.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.969+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=2IKQ3A3JZ7E5 tag=DL651G55YG64 type=write size=2066902 2024-09-12T00:22:15.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.973+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=L7ITGCGQ61A7 type=write size=756828 2024-09-12T00:22:15.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.977+0000 7fd6489978c0 1 < completed delete operation key=J5IW4G9C72DH tag=ZOS119VC2XUH type=del 2024-09-12T00:22:15.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.981+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~0Q58V6GLSN6E.0 size=532172 2024-09-12T00:22:15.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.981+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=0Q58V6GLSN6E tag=TAWH56Y77W73 type=write size=1580748 2024-09-12T00:22:15.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.985+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~G9ZP3W0LB43P.0 size=1048576 2024-09-12T00:22:15.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.989+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~G9ZP3W0LB43P.1 size=1048576 2024-09-12T00:22:15.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:15.993+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~G9ZP3W0LB43P.2 size=505699 2024-09-12T00:22:15.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.001+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=G9ZP3W0LB43P tag=9T29PHPBD637 type=write size=3651427 2024-09-12T00:22:16.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.005+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=PN8SMW0806S8 type=del size=1569318 2024-09-12T00:22:16.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.013+0000 7fd6489978c0 1 < suggested update operation key=YSPRZ87DZ2OD tag=AE97HFW7SHVO type=del size=3511282 2024-09-12T00:22:16.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.025+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~7GR0Z8FPZIVP.0 size=1005354 2024-09-12T00:22:16.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.025+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=7GR0Z8FPZIVP tag=6GSHD6YVK267 type=write size=2053930 2024-09-12T00:22:16.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.033+0000 7fd6489978c0 1 < suggested remove operation key=M9YKGQ2GA5CO tag=YWEHZZ3HDCRN type=del 2024-09-12T00:22:16.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.033+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=WUX5FL9JTFVS type=del size=3993619 2024-09-12T00:22:16.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.037+0000 7fd6489978c0 1 < completed write operation key=3JZP8TZFEIMH tag=8K1A6Q340OPU type=write size=671719 2024-09-12T00:22:16.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.041+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=1Q2NWSR4H6GE type=del size=1957609 2024-09-12T00:22:16.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.045+0000 7fd6489978c0 -1 < failed to complete operation key=M9YKGQ2GA5CO tag=EQ7JP0M7C654 type=write size=545431: (22) Invalid argument 2024-09-12T00:22:16.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.049+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=COUV17OPQCLU type=del size=3852049 2024-09-12T00:22:16.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.053+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=U86EG3XLPY6P type=del 2024-09-12T00:22:16.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.061+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~7ERQRX4VC44X.0 size=457771 2024-09-12T00:22:16.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.061+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=7ERQRX4VC44X tag=6II3JKP5RQOQ type=write size=1506347 2024-09-12T00:22:16.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.069+0000 7fd6489978c0 1 < suggested remove operation key=LZICTA4BWOW8 tag=EJSUZGRO698A type=del 2024-09-12T00:22:16.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.073+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=Y2I0HP5RIFVW type=del size=3225818 2024-09-12T00:22:16.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.077+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~99R1HQQTGBQY.0 size=1048576 2024-09-12T00:22:16.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.077+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~99R1HQQTGBQY.1 size=321972 2024-09-12T00:22:16.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.085+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=99R1HQQTGBQY tag=M7D9YUGRTMTE type=write size=2419124 2024-09-12T00:22:16.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.093+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~QLOF4GLTMYN8.0 size=1048576 2024-09-12T00:22:16.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.093+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~QLOF4GLTMYN8.1 size=1048576 2024-09-12T00:22:16.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.097+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~QLOF4GLTMYN8.2 size=237430 2024-09-12T00:22:16.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.097+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=QLOF4GLTMYN8 tag=Z777A488KODE type=write size=3383158 2024-09-12T00:22:16.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.101+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~XCT5UXGNHPKP.0 size=1048576 2024-09-12T00:22:16.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.105+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~XCT5UXGNHPKP.1 size=846302 2024-09-12T00:22:16.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.109+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=XCT5UXGNHPKP tag=GS9NFNR0F4CS type=write size=2943454 2024-09-12T00:22:16.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.113+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=QY57TJG4NFUH type=del size=3183018 2024-09-12T00:22:16.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.117+0000 7fd6489978c0 1 < completed delete operation key=3JZP8TZFEIMH tag=QN2SK791QVF5 type=del 2024-09-12T00:22:16.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.125+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~H40960PPSQ9T.0 size=770897 2024-09-12T00:22:16.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.125+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=H40960PPSQ9T tag=75WH02P3QTKO type=write size=1819473 2024-09-12T00:22:16.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.125+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~ZMMZJYSDSQUQ.0 size=1048576 2024-09-12T00:22:16.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.129+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~ZMMZJYSDSQUQ.1 size=1048576 2024-09-12T00:22:16.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.133+0000 7fd6489978c0 1 < completed part key=_multipart_YJJBTNI318EH.2~ZMMZJYSDSQUQ.2 size=226461 2024-09-12T00:22:16.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.137+0000 7fd6489978c0 1 < completed multipart upload key=YJJBTNI318EH upload=ZMMZJYSDSQUQ tag=CNI6G8UTOL5P type=write size=3372189 2024-09-12T00:22:16.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.141+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=36G3IFNITIII type=del size=1773599 2024-09-12T00:22:16.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.145+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~9CQ4SY9H9HL1.0 size=1048576 2024-09-12T00:22:16.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.149+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~9CQ4SY9H9HL1.1 size=1048576 2024-09-12T00:22:16.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.153+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~9CQ4SY9H9HL1.2 size=1010378 2024-09-12T00:22:16.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.161+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=9CQ4SY9H9HL1 tag=JGY02E52GWBU type=write size=4156106 2024-09-12T00:22:16.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.169+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~UPJEDVJJ2ZQB.0 size=1048576 2024-09-12T00:22:16.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.173+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~UPJEDVJJ2ZQB.1 size=1048576 2024-09-12T00:22:16.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.173+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~UPJEDVJJ2ZQB.2 size=47360 2024-09-12T00:22:16.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.173+0000 7fd6489978c0 1 > prepared multipart upload key=DAOTTEMK2P2T upload=UPJEDVJJ2ZQB tag=B40AYY81F0HD type=write size=3193088 2024-09-12T00:22:16.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.177+0000 7fd6489978c0 -1 < failed to complete operation key=M9YKGQ2GA5CO tag=ZUQ8T6GLZ300 type=del size=3562223: (22) Invalid argument 2024-09-12T00:22:16.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.185+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~0F7XXX8FENMS.0 size=1048576 2024-09-12T00:22:16.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.189+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~0F7XXX8FENMS.1 size=1048576 2024-09-12T00:22:16.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.193+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~0F7XXX8FENMS.2 size=1034723 2024-09-12T00:22:16.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.193+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=0F7XXX8FENMS tag=FAOW3ABD4OSW type=write size=4180451 2024-09-12T00:22:16.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.193+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~9QETIYTRRDE9.0 size=1048576 2024-09-12T00:22:16.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.197+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~9QETIYTRRDE9.1 size=1048576 2024-09-12T00:22:16.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.201+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~9QETIYTRRDE9.2 size=318989 2024-09-12T00:22:16.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.205+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=9QETIYTRRDE9 tag=EJVXMRPF70QY type=write size=3464717 2024-09-12T00:22:16.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.209+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=Z7WGMVP3XLG2 type=del size=3961561 2024-09-12T00:22:16.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.213+0000 7fd6489978c0 1 < completed write operation key=Y3JFVW74FNT6 tag=L7ITGCGQ61A7 type=write size=756828 2024-09-12T00:22:16.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.217+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=D328CYSZ8B9G type=write size=55419 2024-09-12T00:22:16.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.221+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~0Q58V6GLSN6E.0 size=532172 2024-09-12T00:22:16.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.229+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=0Q58V6GLSN6E tag=TAWH56Y77W73 type=write size=1580748 2024-09-12T00:22:16.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.233+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~VKDOV22I70FX.0 size=1048576 2024-09-12T00:22:16.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.237+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~VKDOV22I70FX.1 size=1048576 2024-09-12T00:22:16.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.241+0000 7fd6489978c0 1 > prepared part key=_multipart_J5IW4G9C72DH.2~VKDOV22I70FX.2 size=1038450 2024-09-12T00:22:16.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.241+0000 7fd6489978c0 1 > prepared multipart upload key=J5IW4G9C72DH upload=VKDOV22I70FX tag=JFMOC3A7F27L type=write size=4184178 2024-09-12T00:22:16.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.245+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=PN8SMW0806S8 type=del 2024-09-12T00:22:16.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.249+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~E3MTIJGU1BPZ.0 size=1048576 2024-09-12T00:22:16.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.253+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~E3MTIJGU1BPZ.1 size=1048576 2024-09-12T00:22:16.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.257+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~E3MTIJGU1BPZ.2 size=981014 2024-09-12T00:22:16.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.257+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=E3MTIJGU1BPZ tag=9KNC2U5RALDX type=write size=4126742 2024-09-12T00:22:16.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.261+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~7GR0Z8FPZIVP.0 size=1005354 2024-09-12T00:22:16.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.265+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=7GR0Z8FPZIVP tag=6GSHD6YVK267 type=write size=2053930 2024-09-12T00:22:16.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.269+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=M97FG6KLQ3W9 type=del size=3418459 2024-09-12T00:22:16.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.273+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=WUX5FL9JTFVS type=del 2024-09-12T00:22:16.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.277+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=V7L1IZ92J05X type=del size=511254 2024-09-12T00:22:16.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.281+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=1Q2NWSR4H6GE type=del 2024-09-12T00:22:16.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.289+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~5EOIVEZSQ5BK.0 size=1048576 2024-09-12T00:22:16.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.289+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~5EOIVEZSQ5BK.1 size=1048576 2024-09-12T00:22:16.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.293+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~5EOIVEZSQ5BK.2 size=442205 2024-09-12T00:22:16.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.293+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=5EOIVEZSQ5BK tag=CZTY1PW303GP type=write size=3587933 2024-09-12T00:22:16.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.301+0000 7fd6489978c0 1 < suggested update operation key=K9FD1L86Q05B tag=COUV17OPQCLU type=del size=3852049 2024-09-12T00:22:16.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.305+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=EVIWWILEL3W2 type=del size=2624866 2024-09-12T00:22:16.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.309+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~7ERQRX4VC44X.0 size=457771 2024-09-12T00:22:16.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.313+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=7ERQRX4VC44X tag=6II3JKP5RQOQ type=write size=1506347 2024-09-12T00:22:16.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.317+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=XVV1EVG8J76S type=del size=2971698 2024-09-12T00:22:16.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.321+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=Y2I0HP5RIFVW type=del 2024-09-12T00:22:16.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.325+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=8WTCLOGA6OMG type=del size=2174783 2024-09-12T00:22:16.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.329+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~QLOF4GLTMYN8.0 size=1048576 2024-09-12T00:22:16.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.333+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~QLOF4GLTMYN8.1 size=1048576 2024-09-12T00:22:16.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.333+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~QLOF4GLTMYN8.2 size=237430 2024-09-12T00:22:16.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.341+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=QLOF4GLTMYN8 tag=Z777A488KODE type=write size=3383158 2024-09-12T00:22:16.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.345+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=HPSWJPZZE1GD type=del size=3826924 2024-09-12T00:22:16.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.349+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=QY57TJG4NFUH type=del 2024-09-12T00:22:16.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.353+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=UG83K4412Y2U type=del size=3946964 2024-09-12T00:22:16.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.357+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~H40960PPSQ9T.0 size=770897 2024-09-12T00:22:16.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.369+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=H40960PPSQ9T tag=75WH02P3QTKO type=write size=1819473 2024-09-12T00:22:16.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.373+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~7UCFHYK2WB2M.0 size=1048576 2024-09-12T00:22:16.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.377+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~7UCFHYK2WB2M.1 size=1048576 2024-09-12T00:22:16.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.381+0000 7fd6489978c0 1 > prepared part key=_multipart_2KP09UFI3N8B.2~7UCFHYK2WB2M.2 size=721145 2024-09-12T00:22:16.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.381+0000 7fd6489978c0 1 > prepared multipart upload key=2KP09UFI3N8B upload=7UCFHYK2WB2M tag=CDDJ1KY07TWN type=write size=3866873 2024-09-12T00:22:16.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.385+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=36G3IFNITIII type=del 2024-09-12T00:22:16.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.389+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=4A6XP2POMXIE type=del size=4183947 2024-09-12T00:22:16.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.393+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~UPJEDVJJ2ZQB.0 size=1048576 2024-09-12T00:22:16.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.393+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~UPJEDVJJ2ZQB.1 size=1048576 2024-09-12T00:22:16.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.397+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~UPJEDVJJ2ZQB.2 size=47360 2024-09-12T00:22:16.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.405+0000 7fd6489978c0 1 < completed multipart upload key=DAOTTEMK2P2T upload=UPJEDVJJ2ZQB tag=B40AYY81F0HD type=write size=3193088 2024-09-12T00:22:16.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.409+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~5C69K5U241ND.0 size=1048576 2024-09-12T00:22:16.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.413+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~5C69K5U241ND.1 size=1035433 2024-09-12T00:22:16.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.413+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=5C69K5U241ND tag=DCKM16YDRSN6 type=write size=3132585 2024-09-12T00:22:16.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.413+0000 7fd6489978c0 1 < canceled part key=_multipart_K9FD1L86Q05B.2~0F7XXX8FENMS.0 size=1048576 2024-09-12T00:22:16.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.417+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~0F7XXX8FENMS.1 size=1048576 2024-09-12T00:22:16.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.421+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~0F7XXX8FENMS.2 size=1034723 2024-09-12T00:22:16.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.425+0000 7fd6489978c0 1 < canceled multipart upload key=K9FD1L86Q05B upload=0F7XXX8FENMS tag=FAOW3ABD4OSW type=write size=4180451 2024-09-12T00:22:16.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.433+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~6OYZDN19K35L.0 size=1048576 2024-09-12T00:22:16.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.437+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~6OYZDN19K35L.1 size=1048576 2024-09-12T00:22:16.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.437+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~6OYZDN19K35L.2 size=34539 2024-09-12T00:22:16.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.437+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=6OYZDN19K35L tag=0OJRYF9WWIKF type=write size=3180267 2024-09-12T00:22:16.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.441+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=Z7WGMVP3XLG2 type=del 2024-09-12T00:22:16.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.449+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~CBI6FB6QOBA2.0 size=1048576 2024-09-12T00:22:16.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.453+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~CBI6FB6QOBA2.1 size=1048576 2024-09-12T00:22:16.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.453+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~CBI6FB6QOBA2.2 size=529550 2024-09-12T00:22:16.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.453+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=CBI6FB6QOBA2 tag=WHX9QF9CBNZR type=write size=3675278 2024-09-12T00:22:16.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.457+0000 7fd6489978c0 1 < completed write operation key=GVPNH3JSO07D tag=D328CYSZ8B9G type=write size=55419 2024-09-12T00:22:16.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.461+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=O94I2AKDUXM2 type=del size=1842635 2024-09-12T00:22:16.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.465+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~VKDOV22I70FX.0 size=1048576 2024-09-12T00:22:16.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.465+0000 7fd6489978c0 1 < canceled part key=_multipart_J5IW4G9C72DH.2~VKDOV22I70FX.1 size=1048576 2024-09-12T00:22:16.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.469+0000 7fd6489978c0 1 < completed part key=_multipart_J5IW4G9C72DH.2~VKDOV22I70FX.2 size=1038450 2024-09-12T00:22:16.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.473+0000 7fd6489978c0 1 < canceled multipart upload key=J5IW4G9C72DH upload=VKDOV22I70FX tag=JFMOC3A7F27L type=write size=4184178 2024-09-12T00:22:16.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.477+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=CATRMS4309RX type=del size=415979 2024-09-12T00:22:16.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.481+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~E3MTIJGU1BPZ.0 size=1048576 2024-09-12T00:22:16.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.485+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~E3MTIJGU1BPZ.1 size=1048576 2024-09-12T00:22:16.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.489+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~E3MTIJGU1BPZ.2 size=981014 2024-09-12T00:22:16.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.493+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=E3MTIJGU1BPZ tag=9KNC2U5RALDX type=write size=4126742 2024-09-12T00:22:16.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.497+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=8TIDSPAC09TZ type=del size=1317760 2024-09-12T00:22:16.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.501+0000 7fd6489978c0 1 < canceled operation key=JPVKBVRCZTE9 tag=M97FG6KLQ3W9 type=del size=3418459 2024-09-12T00:22:16.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.505+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=X52JTUOIA4I4 type=write size=846110 2024-09-12T00:22:16.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.509+0000 7fd6489978c0 1 < completed delete operation key=RGE8T6BTHBWK tag=V7L1IZ92J05X type=del 2024-09-12T00:22:16.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.513+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=CK0ZVGZJABZ6 type=del size=4075898 2024-09-12T00:22:16.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.517+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~5EOIVEZSQ5BK.0 size=1048576 2024-09-12T00:22:16.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.521+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~5EOIVEZSQ5BK.1 size=1048576 2024-09-12T00:22:16.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.521+0000 7fd6489978c0 1 < canceled part key=_multipart_9ACGS2FIY7AF.2~5EOIVEZSQ5BK.2 size=442205 2024-09-12T00:22:16.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.525+0000 7fd6489978c0 1 < canceled multipart upload key=9ACGS2FIY7AF upload=5EOIVEZSQ5BK tag=CZTY1PW303GP type=write size=3587933 2024-09-12T00:22:16.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.529+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=YJ1N318R7JG7 type=del size=794964 2024-09-12T00:22:16.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.537+0000 7fd6489978c0 1 < suggested remove operation key=2KP09UFI3N8B tag=EVIWWILEL3W2 type=del 2024-09-12T00:22:16.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.541+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=DTJ1CAYKVF4S type=del size=4117613 2024-09-12T00:22:16.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.545+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=XVV1EVG8J76S type=del 2024-09-12T00:22:16.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.549+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=H2T1WW0HHASR type=del size=1363410 2024-09-12T00:22:16.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.553+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=8WTCLOGA6OMG type=del 2024-09-12T00:22:16.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.561+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~5Q7M09Y0N6L7.0 size=1048576 2024-09-12T00:22:16.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.565+0000 7fd6489978c0 1 > prepared part key=_multipart_F2CTWM0T2698.2~5Q7M09Y0N6L7.1 size=185086 2024-09-12T00:22:16.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.565+0000 7fd6489978c0 1 > prepared multipart upload key=F2CTWM0T2698 upload=5Q7M09Y0N6L7 tag=ZERCWAJBWU6S type=write size=2282238 2024-09-12T00:22:16.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.573+0000 7fd6489978c0 1 < suggested remove operation key=RGE8T6BTHBWK tag=HPSWJPZZE1GD type=del 2024-09-12T00:22:16.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.577+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=XFOBIFG320CW type=write size=498790 2024-09-12T00:22:16.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.581+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=UG83K4412Y2U type=del 2024-09-12T00:22:16.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.589+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~FU2405SC391H.0 size=52113 2024-09-12T00:22:16.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.589+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=FU2405SC391H tag=VNKGD28NHB55 type=write size=1100689 2024-09-12T00:22:16.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.593+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~7UCFHYK2WB2M.0 size=1048576 2024-09-12T00:22:16.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.597+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~7UCFHYK2WB2M.1 size=1048576 2024-09-12T00:22:16.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.601+0000 7fd6489978c0 1 < completed part key=_multipart_2KP09UFI3N8B.2~7UCFHYK2WB2M.2 size=721145 2024-09-12T00:22:16.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.609+0000 7fd6489978c0 1 < completed multipart upload key=2KP09UFI3N8B upload=7UCFHYK2WB2M tag=CDDJ1KY07TWN type=write size=3866873 2024-09-12T00:22:16.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.613+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~0C8J3LKLFPCX.0 size=1048576 2024-09-12T00:22:16.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.617+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~0C8J3LKLFPCX.1 size=911052 2024-09-12T00:22:16.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.617+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=0C8J3LKLFPCX tag=VKAWYRSOYYIR type=write size=3008204 2024-09-12T00:22:16.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.621+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=4A6XP2POMXIE type=del 2024-09-12T00:22:16.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.629+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~GPDM00Y9C72M.0 size=776752 2024-09-12T00:22:16.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.629+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=GPDM00Y9C72M tag=AKA9R57IX0DM type=write size=1825328 2024-09-12T00:22:16.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.633+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~5C69K5U241ND.0 size=1048576 2024-09-12T00:22:16.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.637+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~5C69K5U241ND.1 size=1035433 2024-09-12T00:22:16.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.641+0000 7fd6489978c0 1 < completed multipart upload key=9ACGS2FIY7AF upload=5C69K5U241ND tag=DCKM16YDRSN6 type=write size=3132585 2024-09-12T00:22:16.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.645+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=OVNLU53J21I3 type=write size=199682 2024-09-12T00:22:16.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.649+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~6OYZDN19K35L.0 size=1048576 2024-09-12T00:22:16.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.653+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~6OYZDN19K35L.1 size=1048576 2024-09-12T00:22:16.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.657+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~6OYZDN19K35L.2 size=34539 2024-09-12T00:22:16.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.665+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=6OYZDN19K35L tag=0OJRYF9WWIKF type=write size=3180267 2024-09-12T00:22:16.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.669+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~SBRXI93H38RP.0 size=231875 2024-09-12T00:22:16.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.669+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=SBRXI93H38RP tag=OT83TEYTTKAJ type=write size=1280451 2024-09-12T00:22:16.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.673+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~CBI6FB6QOBA2.0 size=1048576 2024-09-12T00:22:16.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.673+0000 7fd6489978c0 1 < canceled part key=_multipart_RGE8T6BTHBWK.2~CBI6FB6QOBA2.1 size=1048576 2024-09-12T00:22:16.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.677+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~CBI6FB6QOBA2.2 size=529550 2024-09-12T00:22:16.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.685+0000 7fd6489978c0 1 < canceled multipart upload key=RGE8T6BTHBWK upload=CBI6FB6QOBA2 tag=WHX9QF9CBNZR type=write size=3675278 2024-09-12T00:22:16.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.689+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=SNZMLY6KF41W type=del size=1109409 2024-09-12T00:22:16.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.693+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=O94I2AKDUXM2 type=del 2024-09-12T00:22:16.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.697+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~ZMQL62WYS4XH.0 size=1048576 2024-09-12T00:22:16.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.701+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~ZMQL62WYS4XH.1 size=1048576 2024-09-12T00:22:16.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.705+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~ZMQL62WYS4XH.2 size=1004353 2024-09-12T00:22:16.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.705+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=ZMQL62WYS4XH tag=467VOTTEF6GC type=write size=4150081 2024-09-12T00:22:16.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.709+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=CATRMS4309RX type=del 2024-09-12T00:22:16.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.713+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=F4RAWZ8HLWN3 type=del size=1396791 2024-09-12T00:22:16.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.725+0000 7fd6489978c0 1 < suggested update operation key=K9FD1L86Q05B tag=8TIDSPAC09TZ type=del size=1317760 2024-09-12T00:22:16.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.725+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=3VXS2R0DZ0SR type=del size=2065724 2024-09-12T00:22:16.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.729+0000 7fd6489978c0 1 < completed write operation key=HUKWLE56FRX2 tag=X52JTUOIA4I4 type=write size=846110 2024-09-12T00:22:16.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.737+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~AC655TYBK27X.0 size=224781 2024-09-12T00:22:16.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.737+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=AC655TYBK27X tag=W7XMSDEW0VFV type=write size=1273357 2024-09-12T00:22:16.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.741+0000 7fd6489978c0 1 < completed delete operation key=KAT2TB3FGAYG tag=CK0ZVGZJABZ6 type=del 2024-09-12T00:22:16.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.745+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=NQC3FQC7PGY9 type=del size=1711000 2024-09-12T00:22:16.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.749+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=YJ1N318R7JG7 type=del 2024-09-12T00:22:16.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.753+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=96F7KQOSB9NP type=del size=3601775 2024-09-12T00:22:16.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.757+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=DTJ1CAYKVF4S type=del 2024-09-12T00:22:16.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.761+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=OUQTIN79IWKL type=del size=573539 2024-09-12T00:22:16.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.765+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=H2T1WW0HHASR type=del 2024-09-12T00:22:16.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.773+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~T2YJFKQS36IX.0 size=1048576 2024-09-12T00:22:16.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.773+0000 7fd6489978c0 1 > prepared part key=_multipart_DAOTTEMK2P2T.2~T2YJFKQS36IX.1 size=160988 2024-09-12T00:22:16.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.773+0000 7fd6489978c0 1 > prepared multipart upload key=DAOTTEMK2P2T upload=T2YJFKQS36IX tag=2NJ2E4HGJEXU type=write size=2258140 2024-09-12T00:22:16.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.777+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~5Q7M09Y0N6L7.0 size=1048576 2024-09-12T00:22:16.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.781+0000 7fd6489978c0 1 < completed part key=_multipart_F2CTWM0T2698.2~5Q7M09Y0N6L7.1 size=185086 2024-09-12T00:22:16.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.789+0000 7fd6489978c0 1 < completed multipart upload key=F2CTWM0T2698 upload=5Q7M09Y0N6L7 tag=ZERCWAJBWU6S type=write size=2282238 2024-09-12T00:22:16.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.793+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~QRFX0F1W0PGO.0 size=1048576 2024-09-12T00:22:16.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.797+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~QRFX0F1W0PGO.1 size=1048576 2024-09-12T00:22:16.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.801+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~QRFX0F1W0PGO.2 size=897647 2024-09-12T00:22:16.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.801+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=QRFX0F1W0PGO tag=XK6F0AFBY9TN type=write size=4043375 2024-09-12T00:22:16.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.805+0000 7fd6489978c0 1 < completed write operation key=HUKWLE56FRX2 tag=XFOBIFG320CW type=write size=498790 2024-09-12T00:22:16.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.809+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=KIYARTK06NYL type=del size=3553720 2024-09-12T00:22:16.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.813+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~FU2405SC391H.0 size=52113 2024-09-12T00:22:16.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.817+0000 7fd6489978c0 1 < completed multipart upload key=GVPNH3JSO07D upload=FU2405SC391H tag=VNKGD28NHB55 type=write size=1100689 2024-09-12T00:22:16.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.825+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~64CCIDO35ZFW.0 size=1048576 2024-09-12T00:22:16.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.829+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~64CCIDO35ZFW.1 size=1048576 2024-09-12T00:22:16.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.829+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~64CCIDO35ZFW.2 size=520736 2024-09-12T00:22:16.829 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.829+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=64CCIDO35ZFW tag=6LOA523GH7WB type=write size=3666464 2024-09-12T00:22:16.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.837+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~0C8J3LKLFPCX.0 size=1048576 2024-09-12T00:22:16.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.837+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~0C8J3LKLFPCX.1 size=911052 2024-09-12T00:22:16.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.845+0000 7fd6489978c0 1 < completed multipart upload key=9ACGS2FIY7AF upload=0C8J3LKLFPCX tag=VKAWYRSOYYIR type=write size=3008204 2024-09-12T00:22:16.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.849+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=YRYI34PJEV6P type=write size=291716 2024-09-12T00:22:16.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.853+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~GPDM00Y9C72M.0 size=776752 2024-09-12T00:22:16.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.857+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=GPDM00Y9C72M tag=AKA9R57IX0DM type=write size=1825328 2024-09-12T00:22:16.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.865+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~ME80XEPAV3E8.0 size=1048576 2024-09-12T00:22:16.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.865+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~ME80XEPAV3E8.1 size=1048576 2024-09-12T00:22:16.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.869+0000 7fd6489978c0 1 > prepared part key=_multipart_CFID1EVBXOVJ.2~ME80XEPAV3E8.2 size=626037 2024-09-12T00:22:16.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.869+0000 7fd6489978c0 1 > prepared multipart upload key=CFID1EVBXOVJ upload=ME80XEPAV3E8 tag=TZEIVFICC6Y5 type=write size=3771765 2024-09-12T00:22:16.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.873+0000 7fd6489978c0 1 < completed write operation key=M9YKGQ2GA5CO tag=OVNLU53J21I3 type=write size=199682 2024-09-12T00:22:16.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.881+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~PJGUGWTU5VE4.0 size=299578 2024-09-12T00:22:16.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.881+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=PJGUGWTU5VE4 tag=Y3KKLBVMWYW5 type=write size=1348154 2024-09-12T00:22:16.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.885+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~SBRXI93H38RP.0 size=231875 2024-09-12T00:22:16.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.889+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=SBRXI93H38RP tag=OT83TEYTTKAJ type=write size=1280451 2024-09-12T00:22:16.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.893+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=L8IK6MN8HIAZ type=del size=44056 2024-09-12T00:22:16.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.901+0000 7fd6489978c0 1 < suggested update operation key=J5IW4G9C72DH tag=SNZMLY6KF41W type=del size=1109409 2024-09-12T00:22:16.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.905+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=JNSK8OVDYRHC type=del size=556728 2024-09-12T00:22:16.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.909+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~ZMQL62WYS4XH.0 size=1048576 2024-09-12T00:22:16.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.913+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~ZMQL62WYS4XH.1 size=1048576 2024-09-12T00:22:16.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.917+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~ZMQL62WYS4XH.2 size=1004353 2024-09-12T00:22:16.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.921+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=ZMQL62WYS4XH tag=467VOTTEF6GC type=write size=4150081 2024-09-12T00:22:16.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.925+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=F98JW8E0HJ3W type=del size=2810894 2024-09-12T00:22:16.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.929+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=F4RAWZ8HLWN3 type=del 2024-09-12T00:22:16.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.933+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=KMILDWCJ3N8K type=del size=793485 2024-09-12T00:22:16.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.937+0000 7fd6489978c0 1 < completed delete operation key=K9FD1L86Q05B tag=3VXS2R0DZ0SR type=del 2024-09-12T00:22:16.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.941+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=ZLQN74BSXTS3 type=del size=1332205 2024-09-12T00:22:16.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.945+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~AC655TYBK27X.0 size=224781 2024-09-12T00:22:16.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.953+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=AC655TYBK27X tag=W7XMSDEW0VFV type=write size=1273357 2024-09-12T00:22:16.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.957+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=VX4WICWVPMST type=del size=3189583 2024-09-12T00:22:16.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.961+0000 7fd6489978c0 1 < canceled operation key=QBS4N1KGR1JB tag=NQC3FQC7PGY9 type=del size=1711000 2024-09-12T00:22:16.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.969+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~NY3WQMMK6FMN.0 size=24471 2024-09-12T00:22:16.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.969+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=NY3WQMMK6FMN tag=QC1CKT1D4KJ2 type=write size=1073047 2024-09-12T00:22:16.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.969+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=96F7KQOSB9NP type=del 2024-09-12T00:22:16.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.973+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=CD3S7ZI29OXU type=write size=596574 2024-09-12T00:22:16.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.977+0000 7fd6489978c0 1 < completed delete operation key=M9YKGQ2GA5CO tag=OUQTIN79IWKL type=del 2024-09-12T00:22:16.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.981+0000 7fd6489978c0 1 > prepared operation key=ES2BLTWZT6PT tag=P54KKHPS26FW type=del size=1041404 2024-09-12T00:22:16.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.985+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~T2YJFKQS36IX.0 size=1048576 2024-09-12T00:22:16.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.989+0000 7fd6489978c0 1 < completed part key=_multipart_DAOTTEMK2P2T.2~T2YJFKQS36IX.1 size=160988 2024-09-12T00:22:16.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:16.993+0000 7fd6489978c0 1 < completed multipart upload key=DAOTTEMK2P2T upload=T2YJFKQS36IX tag=2NJ2E4HGJEXU type=write size=2258140 2024-09-12T00:22:16.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.001+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~70TKUOFZZXW6.0 size=37140 2024-09-12T00:22:16.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.001+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=70TKUOFZZXW6 tag=OR7UGBFXY22Z type=write size=1085716 2024-09-12T00:22:17.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.001+0000 7fd6489978c0 1 < canceled part key=_multipart_ZW51KHCLPYN3.2~QRFX0F1W0PGO.0 size=1048576 2024-09-12T00:22:17.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.005+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~QRFX0F1W0PGO.1 size=1048576 2024-09-12T00:22:17.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.009+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~QRFX0F1W0PGO.2 size=897647 2024-09-12T00:22:17.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.013+0000 7fd6489978c0 1 < canceled multipart upload key=ZW51KHCLPYN3 upload=QRFX0F1W0PGO tag=XK6F0AFBY9TN type=write size=4043375 2024-09-12T00:22:17.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.021+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~53D5B65JBJ50.0 size=819012 2024-09-12T00:22:17.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.021+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=53D5B65JBJ50 tag=XZ2EKCM5OFK6 type=write size=1867588 2024-09-12T00:22:17.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.025+0000 7fd6489978c0 1 < completed delete operation key=JPVKBVRCZTE9 tag=KIYARTK06NYL type=del 2024-09-12T00:22:17.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.029+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=FMLKHX9ZWMQM type=del size=2443968 2024-09-12T00:22:17.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.029+0000 7fd6489978c0 1 < canceled part key=_multipart_M9YKGQ2GA5CO.2~64CCIDO35ZFW.0 size=1048576 2024-09-12T00:22:17.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.033+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~64CCIDO35ZFW.1 size=1048576 2024-09-12T00:22:17.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.033+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~64CCIDO35ZFW.2 size=520736 2024-09-12T00:22:17.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.041+0000 7fd6489978c0 1 < canceled multipart upload key=M9YKGQ2GA5CO upload=64CCIDO35ZFW tag=6LOA523GH7WB type=write size=3666464 2024-09-12T00:22:17.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.045+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=LW3UNP3XOP28 type=del size=740431 2024-09-12T00:22:17.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.053+0000 7fd6489978c0 1 < suggested update operation key=HUKWLE56FRX2 tag=YRYI34PJEV6P type=write size=291716 2024-09-12T00:22:17.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.061+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~ZMNQ4FEMYYDG.0 size=1048576 2024-09-12T00:22:17.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.065+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~ZMNQ4FEMYYDG.1 size=292191 2024-09-12T00:22:17.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.065+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=ZMNQ4FEMYYDG tag=SWKW5BFVWEKY type=write size=2389343 2024-09-12T00:22:17.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.073+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~ME80XEPAV3E8.0 size=1048576 2024-09-12T00:22:17.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.077+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~ME80XEPAV3E8.1 size=1048576 2024-09-12T00:22:17.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.077+0000 7fd6489978c0 1 < completed part key=_multipart_CFID1EVBXOVJ.2~ME80XEPAV3E8.2 size=626037 2024-09-12T00:22:17.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.085+0000 7fd6489978c0 1 < completed multipart upload key=CFID1EVBXOVJ upload=ME80XEPAV3E8 tag=TZEIVFICC6Y5 type=write size=3771765 2024-09-12T00:22:17.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.089+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=1Z67XQH3RI1E type=del size=3027724 2024-09-12T00:22:17.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.093+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~PJGUGWTU5VE4.0 size=299578 2024-09-12T00:22:17.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.097+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=PJGUGWTU5VE4 tag=Y3KKLBVMWYW5 type=write size=1348154 2024-09-12T00:22:17.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.105+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~XW9HF9IATDY2.0 size=448720 2024-09-12T00:22:17.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.105+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=XW9HF9IATDY2 tag=SJPQGXD5J226 type=write size=1497296 2024-09-12T00:22:17.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.105+0000 7fd6489978c0 1 < canceled operation key=YSPRZ87DZ2OD tag=L8IK6MN8HIAZ type=del size=44056 2024-09-12T00:22:17.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.113+0000 7fd6489978c0 1 > prepared part key=_multipart_8FBXDX6GELE7.2~BH1UAOD4J7UM.0 size=745571 2024-09-12T00:22:17.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.113+0000 7fd6489978c0 1 > prepared multipart upload key=8FBXDX6GELE7 upload=BH1UAOD4J7UM tag=6TS8HYO03VU1 type=write size=1794147 2024-09-12T00:22:17.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.121+0000 7fd6489978c0 1 < suggested remove operation key=J5IW4G9C72DH tag=JNSK8OVDYRHC type=del 2024-09-12T00:22:17.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.125+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=CDEBVXFA06UZ type=del size=4109254 2024-09-12T00:22:17.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.129+0000 7fd6489978c0 1 < canceled operation key=B2BW7GQ6UN9I tag=F98JW8E0HJ3W type=del size=2810894 2024-09-12T00:22:17.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.129+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=FVB12B4W63IO type=del size=884008 2024-09-12T00:22:17.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.133+0000 7fd6489978c0 1 < completed delete operation key=2KP09UFI3N8B tag=KMILDWCJ3N8K type=del 2024-09-12T00:22:17.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.141+0000 7fd6489978c0 1 > prepared part key=_multipart_KAT2TB3FGAYG.2~7E4ASLAG9KCH.0 size=71130 2024-09-12T00:22:17.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.141+0000 7fd6489978c0 1 > prepared multipart upload key=KAT2TB3FGAYG upload=7E4ASLAG9KCH tag=4YD31LPMBKMM type=write size=1119706 2024-09-12T00:22:17.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.145+0000 7fd6489978c0 1 < canceled operation key=YSPRZ87DZ2OD tag=ZLQN74BSXTS3 type=del size=1332205 2024-09-12T00:22:17.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.153+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~HB3ZEQRZTR9P.0 size=1048576 2024-09-12T00:22:17.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.153+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~HB3ZEQRZTR9P.1 size=37088 2024-09-12T00:22:17.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.153+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=HB3ZEQRZTR9P tag=PN6RKRGW0ERX type=write size=2134240 2024-09-12T00:22:17.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.157+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=VX4WICWVPMST type=del 2024-09-12T00:22:17.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.161+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=86X1F6M183NW type=write size=874796 2024-09-12T00:22:17.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.165+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~NY3WQMMK6FMN.0 size=24471 2024-09-12T00:22:17.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.173+0000 7fd6489978c0 1 < completed multipart upload key=G4EUTQOHAT2E upload=NY3WQMMK6FMN tag=QC1CKT1D4KJ2 type=write size=1073047 2024-09-12T00:22:17.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.177+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=12ZOVMOSAVM1 type=del size=4160338 2024-09-12T00:22:17.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.181+0000 7fd6489978c0 1 < completed write operation key=GVPNH3JSO07D tag=CD3S7ZI29OXU type=write size=596574 2024-09-12T00:22:17.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.185+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=M2O79ALQKXDL type=del size=3215002 2024-09-12T00:22:17.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.189+0000 7fd6489978c0 1 < completed delete operation key=ES2BLTWZT6PT tag=P54KKHPS26FW type=del 2024-09-12T00:22:17.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.197+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~Y10Q0WDDXTL4.0 size=1048576 2024-09-12T00:22:17.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.201+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~Y10Q0WDDXTL4.1 size=1048576 2024-09-12T00:22:17.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.201+0000 7fd6489978c0 1 > prepared part key=_multipart_9ACGS2FIY7AF.2~Y10Q0WDDXTL4.2 size=996648 2024-09-12T00:22:17.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.201+0000 7fd6489978c0 1 > prepared multipart upload key=9ACGS2FIY7AF upload=Y10Q0WDDXTL4 tag=PW6QHVWUDQC0 type=write size=4142376 2024-09-12T00:22:17.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.205+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~70TKUOFZZXW6.0 size=37140 2024-09-12T00:22:17.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.213+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=70TKUOFZZXW6 tag=OR7UGBFXY22Z type=write size=1085716 2024-09-12T00:22:17.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.217+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=XDXBRH30NQA7 type=write size=424127 2024-09-12T00:22:17.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.221+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~53D5B65JBJ50.0 size=819012 2024-09-12T00:22:17.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.225+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=53D5B65JBJ50 tag=XZ2EKCM5OFK6 type=write size=1867588 2024-09-12T00:22:17.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.229+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=PKMC69S2B0S0 type=del size=2832757 2024-09-12T00:22:17.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.233+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=FMLKHX9ZWMQM type=del 2024-09-12T00:22:17.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.237+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=T8EH0WMENW3C type=del size=1153388 2024-09-12T00:22:17.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.241+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=LW3UNP3XOP28 type=del 2024-09-12T00:22:17.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.249+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~ES7OXVWPBVJD.0 size=1048576 2024-09-12T00:22:17.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.249+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~ES7OXVWPBVJD.1 size=1048576 2024-09-12T00:22:17.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.253+0000 7fd6489978c0 1 > prepared part key=_multipart_25P4P2I6BE3H.2~ES7OXVWPBVJD.2 size=94637 2024-09-12T00:22:17.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.253+0000 7fd6489978c0 1 > prepared multipart upload key=25P4P2I6BE3H upload=ES7OXVWPBVJD tag=K1M4XGHHWBOM type=write size=3240365 2024-09-12T00:22:17.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.257+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~ZMNQ4FEMYYDG.0 size=1048576 2024-09-12T00:22:17.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.261+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~ZMNQ4FEMYYDG.1 size=292191 2024-09-12T00:22:17.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.265+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=ZMNQ4FEMYYDG tag=SWKW5BFVWEKY type=write size=2389343 2024-09-12T00:22:17.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.273+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~FDJOE0NZ0EKX.0 size=450636 2024-09-12T00:22:17.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.273+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=FDJOE0NZ0EKX tag=HIDN80R325CS type=write size=1499212 2024-09-12T00:22:17.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.277+0000 7fd6489978c0 1 < completed delete operation key=B2BW7GQ6UN9I tag=1Z67XQH3RI1E type=del 2024-09-12T00:22:17.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.281+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=GP7MO16RF4OU type=del size=2892963 2024-09-12T00:22:17.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.285+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~XW9HF9IATDY2.0 size=448720 2024-09-12T00:22:17.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.289+0000 7fd6489978c0 1 < completed multipart upload key=9ACGS2FIY7AF upload=XW9HF9IATDY2 tag=SJPQGXD5J226 type=write size=1497296 2024-09-12T00:22:17.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.297+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~J6NNTINR75GJ.0 size=1048576 2024-09-12T00:22:17.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.297+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~J6NNTINR75GJ.1 size=1048576 2024-09-12T00:22:17.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.301+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~J6NNTINR75GJ.2 size=131492 2024-09-12T00:22:17.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.301+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=J6NNTINR75GJ tag=7A2OREBXHSR2 type=write size=3277220 2024-09-12T00:22:17.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.305+0000 7fd6489978c0 1 < completed part key=_multipart_8FBXDX6GELE7.2~BH1UAOD4J7UM.0 size=745571 2024-09-12T00:22:17.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.309+0000 7fd6489978c0 1 < completed multipart upload key=8FBXDX6GELE7 upload=BH1UAOD4J7UM tag=6TS8HYO03VU1 type=write size=1794147 2024-09-12T00:22:17.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.317+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~JF3B8T5AYU13.0 size=1048576 2024-09-12T00:22:17.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.321+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~JF3B8T5AYU13.1 size=1048576 2024-09-12T00:22:17.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.325+0000 7fd6489978c0 1 > prepared part key=_multipart_K9FD1L86Q05B.2~JF3B8T5AYU13.2 size=296452 2024-09-12T00:22:17.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.325+0000 7fd6489978c0 1 > prepared multipart upload key=K9FD1L86Q05B upload=JF3B8T5AYU13 tag=194THPHC8BWL type=write size=3442180 2024-09-12T00:22:17.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.329+0000 7fd6489978c0 1 < suggested remove operation key=2KP09UFI3N8B tag=CDEBVXFA06UZ type=del 2024-09-12T00:22:17.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.337+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~6VIFEPE26GOU.0 size=1048576 2024-09-12T00:22:17.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.341+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~6VIFEPE26GOU.1 size=1048576 2024-09-12T00:22:17.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.341+0000 7fd6489978c0 1 > prepared part key=_multipart_N0AAVPQ6MUQ1.2~6VIFEPE26GOU.2 size=153800 2024-09-12T00:22:17.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.341+0000 7fd6489978c0 1 > prepared multipart upload key=N0AAVPQ6MUQ1 upload=6VIFEPE26GOU tag=ZZDIORR51EGP type=write size=3299528 2024-09-12T00:22:17.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.345+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=FVB12B4W63IO type=del 2024-09-12T00:22:17.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.353+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~0OQ3X3Q9FHAA.0 size=1048576 2024-09-12T00:22:17.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.357+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~0OQ3X3Q9FHAA.1 size=1048576 2024-09-12T00:22:17.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.361+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~0OQ3X3Q9FHAA.2 size=536881 2024-09-12T00:22:17.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.361+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=0OQ3X3Q9FHAA tag=6A65FCLA12IP type=write size=3682609 2024-09-12T00:22:17.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.365+0000 7fd6489978c0 1 < completed part key=_multipart_KAT2TB3FGAYG.2~7E4ASLAG9KCH.0 size=71130 2024-09-12T00:22:17.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.369+0000 7fd6489978c0 1 < completed multipart upload key=KAT2TB3FGAYG upload=7E4ASLAG9KCH tag=4YD31LPMBKMM type=write size=1119706 2024-09-12T00:22:17.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.377+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~8S6OWIRDX80Z.0 size=804822 2024-09-12T00:22:17.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.377+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=8S6OWIRDX80Z tag=4YWIHVP1M5UR type=write size=1853398 2024-09-12T00:22:17.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.381+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~HB3ZEQRZTR9P.0 size=1048576 2024-09-12T00:22:17.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.381+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~HB3ZEQRZTR9P.1 size=37088 2024-09-12T00:22:17.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.389+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=HB3ZEQRZTR9P tag=PN6RKRGW0ERX type=write size=2134240 2024-09-12T00:22:17.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.393+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=4MUII73NB0HN type=write size=560278 2024-09-12T00:22:17.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.397+0000 7fd6489978c0 1 < completed write operation key=N4S6I47NSJK6 tag=86X1F6M183NW type=write size=874796 2024-09-12T00:22:17.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.405+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~4W375CJEOJHH.0 size=1048576 2024-09-12T00:22:17.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.413+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~4W375CJEOJHH.1 size=1048576 2024-09-12T00:22:17.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.417+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~4W375CJEOJHH.2 size=747573 2024-09-12T00:22:17.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.417+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=4W375CJEOJHH tag=J0XQ46N9TG6L type=write size=3893301 2024-09-12T00:22:17.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.421+0000 7fd6489978c0 1 < completed delete operation key=RGE8T6BTHBWK tag=12ZOVMOSAVM1 type=del 2024-09-12T00:22:17.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.425+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=A54Y5A2QCNIW type=del size=775521 2024-09-12T00:22:17.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.429+0000 7fd6489978c0 1 < completed delete operation key=CBXBFK3OXXKG tag=M2O79ALQKXDL type=del 2024-09-12T00:22:17.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.433+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=QU92OFAA2KOC type=del size=1961266 2024-09-12T00:22:17.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.437+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~Y10Q0WDDXTL4.0 size=1048576 2024-09-12T00:22:17.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.441+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~Y10Q0WDDXTL4.1 size=1048576 2024-09-12T00:22:17.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.445+0000 7fd6489978c0 1 < completed part key=_multipart_9ACGS2FIY7AF.2~Y10Q0WDDXTL4.2 size=996648 2024-09-12T00:22:17.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.453+0000 7fd6489978c0 1 < completed multipart upload key=9ACGS2FIY7AF upload=Y10Q0WDDXTL4 tag=PW6QHVWUDQC0 type=write size=4142376 2024-09-12T00:22:17.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.461+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~EOZ2Q6AVCGK5.0 size=1048576 2024-09-12T00:22:17.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.461+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~EOZ2Q6AVCGK5.1 size=617539 2024-09-12T00:22:17.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.461+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=EOZ2Q6AVCGK5 tag=MI10R4G2EC42 type=write size=2714691 2024-09-12T00:22:17.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.465+0000 7fd6489978c0 1 < completed write operation key=G4EUTQOHAT2E tag=XDXBRH30NQA7 type=write size=424127 2024-09-12T00:22:17.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.473+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~ZJLQJ3EGDV3E.0 size=1048576 2024-09-12T00:22:17.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.477+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~ZJLQJ3EGDV3E.1 size=455536 2024-09-12T00:22:17.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.477+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=ZJLQJ3EGDV3E tag=LD2IPTMOY3AR type=write size=2552688 2024-09-12T00:22:17.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.481+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=PKMC69S2B0S0 type=del 2024-09-12T00:22:17.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.489+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~R26O4JF9K74K.0 size=1048576 2024-09-12T00:22:17.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.493+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~R26O4JF9K74K.1 size=1048576 2024-09-12T00:22:17.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.493+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~R26O4JF9K74K.2 size=65025 2024-09-12T00:22:17.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.493+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=R26O4JF9K74K tag=A96AXSTCYD8I type=write size=3210753 2024-09-12T00:22:17.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.497+0000 7fd6489978c0 1 < completed delete operation key=JPVKBVRCZTE9 tag=T8EH0WMENW3C type=del 2024-09-12T00:22:17.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.501+0000 7fd6489978c0 1 > prepared operation key=G4EUTQOHAT2E tag=2W2VOX4L69PH type=del size=1447625 2024-09-12T00:22:17.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.505+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~ES7OXVWPBVJD.0 size=1048576 2024-09-12T00:22:17.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.509+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~ES7OXVWPBVJD.1 size=1048576 2024-09-12T00:22:17.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.513+0000 7fd6489978c0 1 < completed part key=_multipart_25P4P2I6BE3H.2~ES7OXVWPBVJD.2 size=94637 2024-09-12T00:22:17.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.517+0000 7fd6489978c0 1 < completed multipart upload key=25P4P2I6BE3H upload=ES7OXVWPBVJD tag=K1M4XGHHWBOM type=write size=3240365 2024-09-12T00:22:17.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.521+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=B4KIPN6X12JL type=del size=189050 2024-09-12T00:22:17.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.525+0000 7fd6489978c0 1 < canceled part key=_multipart_YSPRZ87DZ2OD.2~FDJOE0NZ0EKX.0 size=450636 2024-09-12T00:22:17.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.529+0000 7fd6489978c0 1 < canceled multipart upload key=YSPRZ87DZ2OD upload=FDJOE0NZ0EKX tag=HIDN80R325CS type=write size=1499212 2024-09-12T00:22:17.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.537+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~S12P7GYQ9CQO.0 size=1048576 2024-09-12T00:22:17.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.541+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~S12P7GYQ9CQO.1 size=809898 2024-09-12T00:22:17.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.541+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=S12P7GYQ9CQO tag=OJ4O16031VI3 type=write size=2907050 2024-09-12T00:22:17.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.545+0000 7fd6489978c0 1 < canceled operation key=25P4P2I6BE3H tag=GP7MO16RF4OU type=del size=2892963 2024-09-12T00:22:17.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.549+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=IVXV7PS1R9PU type=del size=546150 2024-09-12T00:22:17.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.553+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~J6NNTINR75GJ.0 size=1048576 2024-09-12T00:22:17.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.557+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~J6NNTINR75GJ.1 size=1048576 2024-09-12T00:22:17.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.557+0000 7fd6489978c0 1 < canceled part key=_multipart_YSPRZ87DZ2OD.2~J6NNTINR75GJ.2 size=131492 2024-09-12T00:22:17.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.565+0000 7fd6489978c0 1 < canceled multipart upload key=YSPRZ87DZ2OD upload=J6NNTINR75GJ tag=7A2OREBXHSR2 type=write size=3277220 2024-09-12T00:22:17.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.573+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~JJLF04X55A52.0 size=391001 2024-09-12T00:22:17.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.573+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=JJLF04X55A52 tag=NPVRJCEUG9G8 type=write size=1439577 2024-09-12T00:22:17.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.577+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~JF3B8T5AYU13.0 size=1048576 2024-09-12T00:22:17.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.577+0000 7fd6489978c0 1 < canceled part key=_multipart_K9FD1L86Q05B.2~JF3B8T5AYU13.1 size=1048576 2024-09-12T00:22:17.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.577+0000 7fd6489978c0 1 < completed part key=_multipart_K9FD1L86Q05B.2~JF3B8T5AYU13.2 size=296452 2024-09-12T00:22:17.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.585+0000 7fd6489978c0 1 < canceled multipart upload key=K9FD1L86Q05B upload=JF3B8T5AYU13 tag=194THPHC8BWL type=write size=3442180 2024-09-12T00:22:17.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.589+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=JW7JR2DXMV7K type=del size=3601492 2024-09-12T00:22:17.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.593+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~6VIFEPE26GOU.0 size=1048576 2024-09-12T00:22:17.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.593+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~6VIFEPE26GOU.1 size=1048576 2024-09-12T00:22:17.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.597+0000 7fd6489978c0 1 < completed part key=_multipart_N0AAVPQ6MUQ1.2~6VIFEPE26GOU.2 size=153800 2024-09-12T00:22:17.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.605+0000 7fd6489978c0 1 < completed multipart upload key=N0AAVPQ6MUQ1 upload=6VIFEPE26GOU tag=ZZDIORR51EGP type=write size=3299528 2024-09-12T00:22:17.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.609+0000 7fd6489978c0 1 > prepared operation key=K9FD1L86Q05B tag=84Q0LT8CO6CJ type=del size=3999396 2024-09-12T00:22:17.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.613+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~0OQ3X3Q9FHAA.0 size=1048576 2024-09-12T00:22:17.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.613+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~0OQ3X3Q9FHAA.1 size=1048576 2024-09-12T00:22:17.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.617+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~0OQ3X3Q9FHAA.2 size=536881 2024-09-12T00:22:17.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.625+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=0OQ3X3Q9FHAA tag=6A65FCLA12IP type=write size=3682609 2024-09-12T00:22:17.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.629+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=I1FH6LERHK4Y type=write size=129078 2024-09-12T00:22:17.632 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.633+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~8S6OWIRDX80Z.0 size=804822 2024-09-12T00:22:17.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.641+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=8S6OWIRDX80Z tag=4YWIHVP1M5UR type=write size=1853398 2024-09-12T00:22:17.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.645+0000 7fd6489978c0 1 > prepared operation key=J5IW4G9C72DH tag=S6H2DCUWBVWT type=del size=1159446 2024-09-12T00:22:17.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.645+0000 7fd6489978c0 1 < completed write operation key=3JZP8TZFEIMH tag=4MUII73NB0HN type=write size=560278 2024-09-12T00:22:17.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.649+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=LN9E21EO98N9 type=del size=1388741 2024-09-12T00:22:17.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.653+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~4W375CJEOJHH.0 size=1048576 2024-09-12T00:22:17.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.657+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~4W375CJEOJHH.1 size=1048576 2024-09-12T00:22:17.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.661+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~4W375CJEOJHH.2 size=747573 2024-09-12T00:22:17.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.665+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=4W375CJEOJHH tag=J0XQ46N9TG6L type=write size=3893301 2024-09-12T00:22:17.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.673+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~AOVZN37T3NUM.0 size=1048576 2024-09-12T00:22:17.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.677+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~AOVZN37T3NUM.1 size=1048576 2024-09-12T00:22:17.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.681+0000 7fd6489978c0 1 > prepared part key=_multipart_LZICTA4BWOW8.2~AOVZN37T3NUM.2 size=827642 2024-09-12T00:22:17.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.681+0000 7fd6489978c0 1 > prepared multipart upload key=LZICTA4BWOW8 upload=AOVZN37T3NUM tag=8OMSGZIFABW1 type=write size=3973370 2024-09-12T00:22:17.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.685+0000 7fd6489978c0 1 < completed delete operation key=CFID1EVBXOVJ tag=A54Y5A2QCNIW type=del 2024-09-12T00:22:17.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.689+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=YX11BVLZFV8X type=write size=67766 2024-09-12T00:22:17.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.693+0000 7fd6489978c0 1 < canceled operation key=3JZP8TZFEIMH tag=QU92OFAA2KOC type=del size=1961266 2024-09-12T00:22:17.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.697+0000 7fd6489978c0 1 > prepared operation key=GVPNH3JSO07D tag=CA1F4KA75ZSQ type=del size=356260 2024-09-12T00:22:17.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.701+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~EOZ2Q6AVCGK5.0 size=1048576 2024-09-12T00:22:17.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.705+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~EOZ2Q6AVCGK5.1 size=617539 2024-09-12T00:22:17.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.709+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=EOZ2Q6AVCGK5 tag=MI10R4G2EC42 type=write size=2714691 2024-09-12T00:22:17.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.713+0000 7fd6489978c0 1 > prepared operation key=25P4P2I6BE3H tag=WMK0XKHTKX02 type=del size=2494424 2024-09-12T00:22:17.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.717+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~ZJLQJ3EGDV3E.0 size=1048576 2024-09-12T00:22:17.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.721+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~ZJLQJ3EGDV3E.1 size=455536 2024-09-12T00:22:17.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.725+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=ZJLQJ3EGDV3E tag=LD2IPTMOY3AR type=write size=2552688 2024-09-12T00:22:17.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.729+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=TVS8BAXLET6U type=del size=1275413 2024-09-12T00:22:17.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.733+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~R26O4JF9K74K.0 size=1048576 2024-09-12T00:22:17.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.737+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~R26O4JF9K74K.1 size=1048576 2024-09-12T00:22:17.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.741+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~R26O4JF9K74K.2 size=65025 2024-09-12T00:22:17.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.745+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=R26O4JF9K74K tag=A96AXSTCYD8I type=write size=3210753 2024-09-12T00:22:17.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.749+0000 7fd6489978c0 1 > prepared operation key=KAT2TB3FGAYG tag=74LPM623LHRL type=del size=158278 2024-09-12T00:22:17.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.753+0000 7fd6489978c0 1 < completed delete operation key=G4EUTQOHAT2E tag=2W2VOX4L69PH type=del 2024-09-12T00:22:17.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.757+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=QF93VMDZL2IH type=del size=1391448 2024-09-12T00:22:17.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.761+0000 7fd6489978c0 1 < completed delete operation key=9CK160BK5YYY tag=B4KIPN6X12JL type=del 2024-09-12T00:22:17.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.765+0000 7fd6489978c0 1 > prepared operation key=CFID1EVBXOVJ tag=AIYKWV5X82FY type=del size=628137 2024-09-12T00:22:17.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.765+0000 7fd6489978c0 1 < canceled part key=_multipart_ZW51KHCLPYN3.2~S12P7GYQ9CQO.0 size=1048576 2024-09-12T00:22:17.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.773+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~S12P7GYQ9CQO.1 size=809898 2024-09-12T00:22:17.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.781+0000 7fd6489978c0 1 < canceled multipart upload key=ZW51KHCLPYN3 upload=S12P7GYQ9CQO tag=OJ4O16031VI3 type=write size=2907050 2024-09-12T00:22:17.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.785+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=X6FES1JQ2YZH type=del size=1595827 2024-09-12T00:22:17.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.789+0000 7fd6489978c0 1 < suggested update operation key=CFID1EVBXOVJ tag=IVXV7PS1R9PU type=del size=546150 2024-09-12T00:22:17.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.793+0000 7fd6489978c0 1 > prepared operation key=YJJBTNI318EH tag=2GNZV5J2K0JL type=del size=768678 2024-09-12T00:22:17.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.797+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~JJLF04X55A52.0 size=391001 2024-09-12T00:22:17.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.805+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=JJLF04X55A52 tag=NPVRJCEUG9G8 type=write size=1439577 2024-09-12T00:22:17.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.813+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~RHAARDZYDFVC.0 size=669148 2024-09-12T00:22:17.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.813+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=RHAARDZYDFVC tag=7FBOBZPRJD4C type=write size=1717724 2024-09-12T00:22:17.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.817+0000 7fd6489978c0 1 < completed delete operation key=8FBXDX6GELE7 tag=JW7JR2DXMV7K type=del 2024-09-12T00:22:17.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.821+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=CDVFV343QNDK type=write size=107025 2024-09-12T00:22:17.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.821+0000 7fd6489978c0 1 < canceled operation key=K9FD1L86Q05B tag=84Q0LT8CO6CJ type=del size=3999396 2024-09-12T00:22:17.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.829+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~6VGHYBLM207N.0 size=1048576 2024-09-12T00:22:17.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.833+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~6VGHYBLM207N.1 size=1048576 2024-09-12T00:22:17.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.833+0000 7fd6489978c0 1 > prepared part key=_multipart_N4S6I47NSJK6.2~6VGHYBLM207N.2 size=221666 2024-09-12T00:22:17.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.833+0000 7fd6489978c0 1 > prepared multipart upload key=N4S6I47NSJK6 upload=6VGHYBLM207N tag=0C15WEBOKS2R type=write size=3367394 2024-09-12T00:22:17.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.841+0000 7fd6489978c0 1 < suggested update operation key=F2CTWM0T2698 tag=I1FH6LERHK4Y type=write size=129078 2024-09-12T00:22:17.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.849+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~DQP2X17N0XNU.0 size=1048576 2024-09-12T00:22:17.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.849+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~DQP2X17N0XNU.1 size=1048576 2024-09-12T00:22:17.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.853+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~DQP2X17N0XNU.2 size=201417 2024-09-12T00:22:17.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.853+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=DQP2X17N0XNU tag=GPOVKU08NPN7 type=write size=3347145 2024-09-12T00:22:17.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.861+0000 7fd6489978c0 1 < suggested update operation key=J5IW4G9C72DH tag=S6H2DCUWBVWT type=del size=1159446 2024-09-12T00:22:17.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.865+0000 7fd6489978c0 1 > prepared part key=_multipart_QBS4N1KGR1JB.2~6X05D1T53PCA.0 size=626498 2024-09-12T00:22:17.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.865+0000 7fd6489978c0 1 > prepared multipart upload key=QBS4N1KGR1JB upload=6X05D1T53PCA tag=OOLF5HS2ZV1L type=write size=1675074 2024-09-12T00:22:17.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.869+0000 7fd6489978c0 1 < canceled operation key=Y3JFVW74FNT6 tag=LN9E21EO98N9 type=del size=1388741 2024-09-12T00:22:17.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.877+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~WQK75NPNHLXB.0 size=1048576 2024-09-12T00:22:17.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.881+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~WQK75NPNHLXB.1 size=1048576 2024-09-12T00:22:17.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.881+0000 7fd6489978c0 1 > prepared part key=_multipart_M9YKGQ2GA5CO.2~WQK75NPNHLXB.2 size=1978 2024-09-12T00:22:17.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.881+0000 7fd6489978c0 1 > prepared multipart upload key=M9YKGQ2GA5CO upload=WQK75NPNHLXB tag=XR0JGARIB1CT type=write size=3147706 2024-09-12T00:22:17.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.885+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~AOVZN37T3NUM.0 size=1048576 2024-09-12T00:22:17.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.889+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~AOVZN37T3NUM.1 size=1048576 2024-09-12T00:22:17.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.893+0000 7fd6489978c0 1 < completed part key=_multipart_LZICTA4BWOW8.2~AOVZN37T3NUM.2 size=827642 2024-09-12T00:22:17.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.897+0000 7fd6489978c0 1 < completed multipart upload key=LZICTA4BWOW8 upload=AOVZN37T3NUM tag=8OMSGZIFABW1 type=write size=3973370 2024-09-12T00:22:17.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.901+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=OM6NUKNAUUHG type=del size=3100682 2024-09-12T00:22:17.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.905+0000 7fd6489978c0 1 < completed write operation key=RGE8T6BTHBWK tag=YX11BVLZFV8X type=write size=67766 2024-09-12T00:22:17.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.913+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~JSXAHRRV90YB.0 size=1048576 2024-09-12T00:22:17.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.913+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~JSXAHRRV90YB.1 size=1048576 2024-09-12T00:22:17.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.917+0000 7fd6489978c0 1 > prepared part key=_multipart_ES2BLTWZT6PT.2~JSXAHRRV90YB.2 size=937205 2024-09-12T00:22:17.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.917+0000 7fd6489978c0 1 > prepared multipart upload key=ES2BLTWZT6PT upload=JSXAHRRV90YB tag=7F1VWHUB6T88 type=write size=4082933 2024-09-12T00:22:17.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.921+0000 7fd6489978c0 1 < completed delete operation key=GVPNH3JSO07D tag=CA1F4KA75ZSQ type=del 2024-09-12T00:22:17.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.925+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=1ZTMXEPYQG9U type=del size=2353539 2024-09-12T00:22:17.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.929+0000 7fd6489978c0 1 < completed delete operation key=25P4P2I6BE3H tag=WMK0XKHTKX02 type=del 2024-09-12T00:22:17.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.933+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=6SVKBLBYXKL7 type=del size=3311430 2024-09-12T00:22:17.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.937+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=TVS8BAXLET6U type=del 2024-09-12T00:22:17.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.945+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~G1VDHI4QW186.0 size=1048576 2024-09-12T00:22:17.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.945+0000 7fd6489978c0 1 > prepared part key=_multipart_JPVKBVRCZTE9.2~G1VDHI4QW186.1 size=1034919 2024-09-12T00:22:17.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.945+0000 7fd6489978c0 1 > prepared multipart upload key=JPVKBVRCZTE9 upload=G1VDHI4QW186 tag=WJE53M3U03UP type=write size=3132071 2024-09-12T00:22:17.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.953+0000 7fd6489978c0 1 < canceled operation key=KAT2TB3FGAYG tag=74LPM623LHRL type=del size=158278 2024-09-12T00:22:17.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.953+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=J058JXROATUZ type=write size=78595 2024-09-12T00:22:17.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.957+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=QF93VMDZL2IH type=del 2024-09-12T00:22:17.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.965+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~EZHSJE2M8325.0 size=1048576 2024-09-12T00:22:17.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.969+0000 7fd6489978c0 1 > prepared part key=_multipart_ZXEIT45BWHXM.2~EZHSJE2M8325.1 size=822808 2024-09-12T00:22:17.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.969+0000 7fd6489978c0 1 > prepared multipart upload key=ZXEIT45BWHXM upload=EZHSJE2M8325 tag=LZ4RAZRHJQ6Z type=write size=2919960 2024-09-12T00:22:17.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.973+0000 7fd6489978c0 -1 < failed to complete operation key=CFID1EVBXOVJ tag=AIYKWV5X82FY type=del size=628137: (22) Invalid argument 2024-09-12T00:22:17.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.977+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=RXM66J8JNWIQ type=write size=502707 2024-09-12T00:22:17.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.981+0000 7fd6489978c0 1 < completed delete operation key=3JZP8TZFEIMH tag=X6FES1JQ2YZH type=del 2024-09-12T00:22:17.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.989+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~7FC8LY8V1PFE.0 size=1048576 2024-09-12T00:22:17.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.993+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~7FC8LY8V1PFE.1 size=1048576 2024-09-12T00:22:17.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.993+0000 7fd6489978c0 1 > prepared part key=_multipart_GVPNH3JSO07D.2~7FC8LY8V1PFE.2 size=976995 2024-09-12T00:22:17.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.993+0000 7fd6489978c0 1 > prepared multipart upload key=GVPNH3JSO07D upload=7FC8LY8V1PFE tag=DLLO65CG0ZC9 type=write size=4122723 2024-09-12T00:22:17.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:17.997+0000 7fd6489978c0 1 < completed delete operation key=YJJBTNI318EH tag=2GNZV5J2K0JL type=del 2024-09-12T00:22:17.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.001+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=XNJKQYSA2MUB type=write size=758800 2024-09-12T00:22:18.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.005+0000 7fd6489978c0 1 < completed part key=_multipart_YSPRZ87DZ2OD.2~RHAARDZYDFVC.0 size=669148 2024-09-12T00:22:18.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.009+0000 7fd6489978c0 1 < completed multipart upload key=YSPRZ87DZ2OD upload=RHAARDZYDFVC tag=7FBOBZPRJD4C type=write size=1717724 2024-09-12T00:22:18.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.017+0000 7fd6489978c0 1 > prepared part key=_multipart_RGE8T6BTHBWK.2~BMZNJORDPG6U.0 size=413523 2024-09-12T00:22:18.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.017+0000 7fd6489978c0 1 > prepared multipart upload key=RGE8T6BTHBWK upload=BMZNJORDPG6U tag=MKE7AN894TZO type=write size=1462099 2024-09-12T00:22:18.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.021+0000 7fd6489978c0 1 < completed write operation key=B2BW7GQ6UN9I tag=CDVFV343QNDK type=write size=107025 2024-09-12T00:22:18.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.025+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=VZZN4HP9THXE type=write size=240284 2024-09-12T00:22:18.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.025+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~6VGHYBLM207N.0 size=1048576 2024-09-12T00:22:18.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.029+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~6VGHYBLM207N.1 size=1048576 2024-09-12T00:22:18.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.033+0000 7fd6489978c0 1 < completed part key=_multipart_N4S6I47NSJK6.2~6VGHYBLM207N.2 size=221666 2024-09-12T00:22:18.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.037+0000 7fd6489978c0 1 < completed multipart upload key=N4S6I47NSJK6 upload=6VGHYBLM207N tag=0C15WEBOKS2R type=write size=3367394 2024-09-12T00:22:18.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.045+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=S4MP922EIRGN type=write size=562315 2024-09-12T00:22:18.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.049+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~DQP2X17N0XNU.0 size=1048576 2024-09-12T00:22:18.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.049+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~DQP2X17N0XNU.1 size=1048576 2024-09-12T00:22:18.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.053+0000 7fd6489978c0 1 < completed part key=_multipart_3JZP8TZFEIMH.2~DQP2X17N0XNU.2 size=201417 2024-09-12T00:22:18.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.061+0000 7fd6489978c0 1 < completed multipart upload key=3JZP8TZFEIMH upload=DQP2X17N0XNU tag=GPOVKU08NPN7 type=write size=3347145 2024-09-12T00:22:18.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.061+0000 7fd6489978c0 1 > prepared operation key=N0AAVPQ6MUQ1 tag=OQT1WQSY5ILU type=del size=517555 2024-09-12T00:22:18.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.065+0000 7fd6489978c0 1 < completed part key=_multipart_QBS4N1KGR1JB.2~6X05D1T53PCA.0 size=626498 2024-09-12T00:22:18.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.073+0000 7fd6489978c0 1 < completed multipart upload key=QBS4N1KGR1JB upload=6X05D1T53PCA tag=OOLF5HS2ZV1L type=write size=1675074 2024-09-12T00:22:18.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.077+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=W6EKZ4WUDH7I type=del size=3064186 2024-09-12T00:22:18.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.081+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~WQK75NPNHLXB.0 size=1048576 2024-09-12T00:22:18.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.081+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~WQK75NPNHLXB.1 size=1048576 2024-09-12T00:22:18.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.085+0000 7fd6489978c0 1 < completed part key=_multipart_M9YKGQ2GA5CO.2~WQK75NPNHLXB.2 size=1978 2024-09-12T00:22:18.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.089+0000 7fd6489978c0 1 < completed multipart upload key=M9YKGQ2GA5CO upload=WQK75NPNHLXB tag=XR0JGARIB1CT type=write size=3147706 2024-09-12T00:22:18.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.097+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~QU4NS2Y1IG9H.0 size=1048576 2024-09-12T00:22:18.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.101+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~QU4NS2Y1IG9H.1 size=1048576 2024-09-12T00:22:18.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.101+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~QU4NS2Y1IG9H.2 size=102257 2024-09-12T00:22:18.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.101+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=QU4NS2Y1IG9H tag=IJ0DAQOXCH9B type=write size=3247985 2024-09-12T00:22:18.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.109+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=OM6NUKNAUUHG type=del 2024-09-12T00:22:18.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.117+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~Z73DTCY14ILW.0 size=1048576 2024-09-12T00:22:18.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.117+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~Z73DTCY14ILW.1 size=1048576 2024-09-12T00:22:18.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.121+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~Z73DTCY14ILW.2 size=302572 2024-09-12T00:22:18.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.121+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=Z73DTCY14ILW tag=Y78QDXA7BVVD type=write size=3448300 2024-09-12T00:22:18.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.125+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~JSXAHRRV90YB.0 size=1048576 2024-09-12T00:22:18.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.125+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~JSXAHRRV90YB.1 size=1048576 2024-09-12T00:22:18.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.129+0000 7fd6489978c0 1 < completed part key=_multipart_ES2BLTWZT6PT.2~JSXAHRRV90YB.2 size=937205 2024-09-12T00:22:18.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.133+0000 7fd6489978c0 1 < completed multipart upload key=ES2BLTWZT6PT upload=JSXAHRRV90YB tag=7F1VWHUB6T88 type=write size=4082933 2024-09-12T00:22:18.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.141+0000 7fd6489978c0 1 > prepared part key=_multipart_G4EUTQOHAT2E.2~XU28T662R3Y2.0 size=657833 2024-09-12T00:22:18.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.141+0000 7fd6489978c0 1 > prepared multipart upload key=G4EUTQOHAT2E upload=XU28T662R3Y2 tag=EAZWTBBP562E type=write size=1706409 2024-09-12T00:22:18.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.145+0000 7fd6489978c0 1 < completed delete operation key=QBS4N1KGR1JB tag=1ZTMXEPYQG9U type=del 2024-09-12T00:22:18.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.149+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=I3SP2O28O4RQ type=del size=604148 2024-09-12T00:22:18.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.157+0000 7fd6489978c0 1 < suggested update operation key=YSPRZ87DZ2OD tag=6SVKBLBYXKL7 type=del size=3311430 2024-09-12T00:22:18.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.161+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=DGH8PSW9V2XL type=del size=1531083 2024-09-12T00:22:18.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.165+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~G1VDHI4QW186.0 size=1048576 2024-09-12T00:22:18.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.165+0000 7fd6489978c0 1 < completed part key=_multipart_JPVKBVRCZTE9.2~G1VDHI4QW186.1 size=1034919 2024-09-12T00:22:18.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.173+0000 7fd6489978c0 1 < completed multipart upload key=JPVKBVRCZTE9 upload=G1VDHI4QW186 tag=WJE53M3U03UP type=write size=3132071 2024-09-12T00:22:18.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.177+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=RAOGEJZARCAV type=write size=1034269 2024-09-12T00:22:18.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.181+0000 7fd6489978c0 1 < completed write operation key=N4S6I47NSJK6 tag=J058JXROATUZ type=write size=78595 2024-09-12T00:22:18.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.189+0000 7fd6489978c0 1 > prepared part key=_multipart_CBXBFK3OXXKG.2~D6KJDLYOSBNB.0 size=856402 2024-09-12T00:22:18.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.189+0000 7fd6489978c0 1 > prepared multipart upload key=CBXBFK3OXXKG upload=D6KJDLYOSBNB tag=MC2EYMIP4L3A type=write size=1904978 2024-09-12T00:22:18.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.193+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~EZHSJE2M8325.0 size=1048576 2024-09-12T00:22:18.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.193+0000 7fd6489978c0 1 < completed part key=_multipart_ZXEIT45BWHXM.2~EZHSJE2M8325.1 size=822808 2024-09-12T00:22:18.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.201+0000 7fd6489978c0 1 < completed multipart upload key=ZXEIT45BWHXM upload=EZHSJE2M8325 tag=LZ4RAZRHJQ6Z type=write size=2919960 2024-09-12T00:22:18.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.205+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=1JWAZY5V8KHB type=del size=1152455 2024-09-12T00:22:18.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.209+0000 7fd6489978c0 1 < completed write operation key=JPVKBVRCZTE9 tag=RXM66J8JNWIQ type=write size=502707 2024-09-12T00:22:18.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.213+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~I1GTR4EZWHIM.0 size=1048576 2024-09-12T00:22:18.215 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.217+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~I1GTR4EZWHIM.1 size=1048576 2024-09-12T00:22:18.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.221+0000 7fd6489978c0 1 > prepared part key=_multipart_B2BW7GQ6UN9I.2~I1GTR4EZWHIM.2 size=892259 2024-09-12T00:22:18.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.221+0000 7fd6489978c0 1 > prepared multipart upload key=B2BW7GQ6UN9I upload=I1GTR4EZWHIM tag=3B8RYH18E3CN type=write size=4037987 2024-09-12T00:22:18.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.221+0000 7fd6489978c0 1 < canceled part key=_multipart_GVPNH3JSO07D.2~7FC8LY8V1PFE.0 size=1048576 2024-09-12T00:22:18.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.225+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~7FC8LY8V1PFE.1 size=1048576 2024-09-12T00:22:18.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.225+0000 7fd6489978c0 1 < completed part key=_multipart_GVPNH3JSO07D.2~7FC8LY8V1PFE.2 size=976995 2024-09-12T00:22:18.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.233+0000 7fd6489978c0 1 < canceled multipart upload key=GVPNH3JSO07D upload=7FC8LY8V1PFE tag=DLLO65CG0ZC9 type=write size=4122723 2024-09-12T00:22:18.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.237+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~R20T6MQ23SIU.0 size=1048576 2024-09-12T00:22:18.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.241+0000 7fd6489978c0 1 > prepared part key=_multipart_HUKWLE56FRX2.2~R20T6MQ23SIU.1 size=471196 2024-09-12T00:22:18.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.241+0000 7fd6489978c0 1 > prepared multipart upload key=HUKWLE56FRX2 upload=R20T6MQ23SIU tag=1G02RDS02UGN type=write size=2568348 2024-09-12T00:22:18.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.245+0000 7fd6489978c0 1 < completed write operation key=3JZP8TZFEIMH tag=XNJKQYSA2MUB type=write size=758800 2024-09-12T00:22:18.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.249+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=TSAA69IQDK3A type=write size=1046061 2024-09-12T00:22:18.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.253+0000 7fd6489978c0 1 < completed part key=_multipart_RGE8T6BTHBWK.2~BMZNJORDPG6U.0 size=413523 2024-09-12T00:22:18.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.261+0000 7fd6489978c0 1 < completed multipart upload key=RGE8T6BTHBWK upload=BMZNJORDPG6U tag=MKE7AN894TZO type=write size=1462099 2024-09-12T00:22:18.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.269+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~746Q469AN27I.0 size=1048576 2024-09-12T00:22:18.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.269+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~746Q469AN27I.1 size=1048576 2024-09-12T00:22:18.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.273+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~746Q469AN27I.2 size=155982 2024-09-12T00:22:18.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.273+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=746Q469AN27I tag=U088MZ0UJMEE type=write size=3301710 2024-09-12T00:22:18.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.277+0000 7fd6489978c0 1 < completed write operation key=ZW51KHCLPYN3 tag=VZZN4HP9THXE type=write size=240284 2024-09-12T00:22:18.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.281+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~TTSM0SKC803U.0 size=1048576 2024-09-12T00:22:18.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.285+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~TTSM0SKC803U.1 size=1048576 2024-09-12T00:22:18.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.289+0000 7fd6489978c0 1 > prepared part key=_multipart_ZW51KHCLPYN3.2~TTSM0SKC803U.2 size=705620 2024-09-12T00:22:18.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.289+0000 7fd6489978c0 1 > prepared multipart upload key=ZW51KHCLPYN3 upload=TTSM0SKC803U tag=OWP124M0ZP60 type=write size=3851348 2024-09-12T00:22:18.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.293+0000 7fd6489978c0 1 < completed write operation key=HUKWLE56FRX2 tag=S4MP922EIRGN type=write size=562315 2024-09-12T00:22:18.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.297+0000 7fd6489978c0 1 > prepared operation key=9CK160BK5YYY tag=F24IXTKPZPA5 type=del size=1242340 2024-09-12T00:22:18.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.301+0000 7fd6489978c0 1 < completed delete operation key=N0AAVPQ6MUQ1 tag=OQT1WQSY5ILU type=del 2024-09-12T00:22:18.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.305+0000 7fd6489978c0 1 > prepared operation key=YSPRZ87DZ2OD tag=4XZTF6VIDSFE type=del size=905129 2024-09-12T00:22:18.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.309+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=W6EKZ4WUDH7I type=del 2024-09-12T00:22:18.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.313+0000 7fd6489978c0 1 > prepared operation key=CBXBFK3OXXKG tag=DX7NV90KK15J type=del size=1254664 2024-09-12T00:22:18.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.317+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~QU4NS2Y1IG9H.0 size=1048576 2024-09-12T00:22:18.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.317+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~QU4NS2Y1IG9H.1 size=1048576 2024-09-12T00:22:18.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.321+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~QU4NS2Y1IG9H.2 size=102257 2024-09-12T00:22:18.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.329+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=QU4NS2Y1IG9H tag=IJ0DAQOXCH9B type=write size=3247985 2024-09-12T00:22:18.329 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.333+0000 7fd6489978c0 1 > prepared operation key=N4S6I47NSJK6 tag=GB30YQUUSB8Q type=del size=999539 2024-09-12T00:22:18.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.337+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~Z73DTCY14ILW.0 size=1048576 2024-09-12T00:22:18.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.337+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~Z73DTCY14ILW.1 size=1048576 2024-09-12T00:22:18.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.341+0000 7fd6489978c0 1 < completed part key=_multipart_8JCL0F406L7I.2~Z73DTCY14ILW.2 size=302572 2024-09-12T00:22:18.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.345+0000 7fd6489978c0 1 < completed multipart upload key=8JCL0F406L7I upload=Z73DTCY14ILW tag=Y78QDXA7BVVD type=write size=3448300 2024-09-12T00:22:18.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.349+0000 7fd6489978c0 1 > prepared operation key=M9YKGQ2GA5CO tag=VHXJCSLB4UJK type=del size=3341632 2024-09-12T00:22:18.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.357+0000 7fd6489978c0 1 < completed part key=_multipart_G4EUTQOHAT2E.2~XU28T662R3Y2.0 size=657833 2024-09-12T00:22:18.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.361+0000 7fd6489978c0 1 < completed multipart upload key=G4EUTQOHAT2E upload=XU28T662R3Y2 tag=EAZWTBBP562E type=write size=1706409 2024-09-12T00:22:18.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.365+0000 7fd6489978c0 1 > prepared operation key=IHYHPKVPWTUL tag=L9T7X3818UGY type=write size=222699 2024-09-12T00:22:18.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.369+0000 7fd6489978c0 1 < completed delete operation key=IHYHPKVPWTUL tag=I3SP2O28O4RQ type=del 2024-09-12T00:22:18.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.373+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=QW0QP7R1163Y type=del size=3232235 2024-09-12T00:22:18.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.377+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=DGH8PSW9V2XL type=del 2024-09-12T00:22:18.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.381+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=3GULWP90WYCA type=del size=514828 2024-09-12T00:22:18.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.385+0000 7fd6489978c0 1 < completed write operation key=9ACGS2FIY7AF tag=RAOGEJZARCAV type=write size=1034269 2024-09-12T00:22:18.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.389+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=YEHSRB6RN1U6 type=del size=618535 2024-09-12T00:22:18.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.393+0000 7fd6489978c0 1 < completed part key=_multipart_CBXBFK3OXXKG.2~D6KJDLYOSBNB.0 size=856402 2024-09-12T00:22:18.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.397+0000 7fd6489978c0 1 < completed multipart upload key=CBXBFK3OXXKG upload=D6KJDLYOSBNB tag=MC2EYMIP4L3A type=write size=1904978 2024-09-12T00:22:18.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.401+0000 7fd6489978c0 1 > prepared operation key=F2CTWM0T2698 tag=TQ1FVPF8CPB8 type=del size=3116866 2024-09-12T00:22:18.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.409+0000 7fd6489978c0 1 < suggested remove operation key=M9YKGQ2GA5CO tag=1JWAZY5V8KHB type=del 2024-09-12T00:22:18.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.413+0000 7fd6489978c0 1 > prepared operation key=Y3JFVW74FNT6 tag=BWZGXCGSB6JX type=del size=1700994 2024-09-12T00:22:18.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.417+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~I1GTR4EZWHIM.0 size=1048576 2024-09-12T00:22:18.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.421+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~I1GTR4EZWHIM.1 size=1048576 2024-09-12T00:22:18.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.425+0000 7fd6489978c0 1 < completed part key=_multipart_B2BW7GQ6UN9I.2~I1GTR4EZWHIM.2 size=892259 2024-09-12T00:22:18.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.429+0000 7fd6489978c0 1 < completed multipart upload key=B2BW7GQ6UN9I upload=I1GTR4EZWHIM tag=3B8RYH18E3CN type=write size=4037987 2024-09-12T00:22:18.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.433+0000 7fd6489978c0 1 > prepared operation key=9ACGS2FIY7AF tag=11GHWSL8LFCD type=del size=531524 2024-09-12T00:22:18.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.437+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~R20T6MQ23SIU.0 size=1048576 2024-09-12T00:22:18.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.441+0000 7fd6489978c0 1 < completed part key=_multipart_HUKWLE56FRX2.2~R20T6MQ23SIU.1 size=471196 2024-09-12T00:22:18.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.449+0000 7fd6489978c0 1 < completed multipart upload key=HUKWLE56FRX2 upload=R20T6MQ23SIU tag=1G02RDS02UGN type=write size=2568348 2024-09-12T00:22:18.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.453+0000 7fd6489978c0 1 > prepared operation key=DAOTTEMK2P2T tag=T639LVZ8Q9H4 type=del size=1305531 2024-09-12T00:22:18.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.461+0000 7fd6489978c0 1 < suggested update operation key=CBXBFK3OXXKG tag=TSAA69IQDK3A type=write size=1046061 2024-09-12T00:22:18.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.465+0000 7fd6489978c0 1 > prepared operation key=ZXEIT45BWHXM tag=4OBJJ8EG8ZA1 type=del size=1075994 2024-09-12T00:22:18.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.473+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~746Q469AN27I.0 size=1048576 2024-09-12T00:22:18.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.473+0000 7fd6489978c0 1 < canceled part key=_multipart_ZW51KHCLPYN3.2~746Q469AN27I.1 size=1048576 2024-09-12T00:22:18.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.473+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~746Q469AN27I.2 size=155982 2024-09-12T00:22:18.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.481+0000 7fd6489978c0 1 < canceled multipart upload key=ZW51KHCLPYN3 upload=746Q469AN27I tag=U088MZ0UJMEE type=write size=3301710 2024-09-12T00:22:18.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.485+0000 7fd6489978c0 1 > prepared operation key=JPVKBVRCZTE9 tag=IJFCL6HVW5MV type=del size=2518531 2024-09-12T00:22:18.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.485+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~TTSM0SKC803U.0 size=1048576 2024-09-12T00:22:18.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.489+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~TTSM0SKC803U.1 size=1048576 2024-09-12T00:22:18.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.493+0000 7fd6489978c0 1 < completed part key=_multipart_ZW51KHCLPYN3.2~TTSM0SKC803U.2 size=705620 2024-09-12T00:22:18.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.497+0000 7fd6489978c0 1 < completed multipart upload key=ZW51KHCLPYN3 upload=TTSM0SKC803U tag=OWP124M0ZP60 type=write size=3851348 2024-09-12T00:22:18.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.501+0000 7fd6489978c0 1 > prepared operation key=LZICTA4BWOW8 tag=5QHWJ23KJ0XN type=del size=3433651 2024-09-12T00:22:18.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.509+0000 7fd6489978c0 1 < suggested update operation key=9CK160BK5YYY tag=F24IXTKPZPA5 type=del size=1242340 2024-09-12T00:22:18.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.513+0000 7fd6489978c0 1 > prepared operation key=HUKWLE56FRX2 tag=WYQCIIMR8TWJ type=del size=464440 2024-09-12T00:22:18.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.517+0000 7fd6489978c0 1 < completed delete operation key=YSPRZ87DZ2OD tag=4XZTF6VIDSFE type=del 2024-09-12T00:22:18.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.521+0000 7fd6489978c0 1 > prepared operation key=2KP09UFI3N8B tag=QHUWQDGTI9H3 type=del size=3981068 2024-09-12T00:22:18.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.525+0000 7fd6489978c0 -1 < failed to complete operation key=CBXBFK3OXXKG tag=DX7NV90KK15J type=del size=1254664: (22) Invalid argument 2024-09-12T00:22:18.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.529+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=4KQD3DK2NSDV type=del size=3238314 2024-09-12T00:22:18.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.533+0000 7fd6489978c0 1 < completed delete operation key=N4S6I47NSJK6 tag=GB30YQUUSB8Q type=del 2024-09-12T00:22:18.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.537+0000 7fd6489978c0 1 > prepared operation key=RGE8T6BTHBWK tag=RNIO9ME0YV4G type=del size=1191280 2024-09-12T00:22:18.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.537+0000 7fd6489978c0 -1 < no bi entry to suggest for operation key=M9YKGQ2GA5CO tag=VHXJCSLB4UJK type=del size=3341632: (2) No such file or directory 2024-09-12T00:22:18.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.541+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=E13F4517XMAI type=del size=528518 2024-09-12T00:22:18.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.545+0000 7fd6489978c0 1 < completed write operation key=IHYHPKVPWTUL tag=L9T7X3818UGY type=write size=222699 2024-09-12T00:22:18.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.553+0000 7fd6489978c0 1 > prepared part key=_multipart_YSPRZ87DZ2OD.2~I5499PX03NI7.0 size=2448 2024-09-12T00:22:18.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.553+0000 7fd6489978c0 1 > prepared multipart upload key=YSPRZ87DZ2OD upload=I5499PX03NI7 tag=7W4FBRGKLDQQ type=write size=1051024 2024-09-12T00:22:18.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.557+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=QW0QP7R1163Y type=del 2024-09-12T00:22:18.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.561+0000 7fd6489978c0 1 > prepared operation key=ZW51KHCLPYN3 tag=P3WIXKZMP66S type=del size=420430 2024-09-12T00:22:18.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.565+0000 7fd6489978c0 1 < completed delete operation key=B2BW7GQ6UN9I tag=3GULWP90WYCA type=del 2024-09-12T00:22:18.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.573+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~NB7M2SCC8Q83.0 size=1048576 2024-09-12T00:22:18.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.577+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~NB7M2SCC8Q83.1 size=1048576 2024-09-12T00:22:18.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.577+0000 7fd6489978c0 1 > prepared part key=_multipart_IHYHPKVPWTUL.2~NB7M2SCC8Q83.2 size=688334 2024-09-12T00:22:18.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.577+0000 7fd6489978c0 1 > prepared multipart upload key=IHYHPKVPWTUL upload=NB7M2SCC8Q83 tag=GR4VWXMFLOKP type=write size=3834062 2024-09-12T00:22:18.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.581+0000 7fd6489978c0 1 < completed delete operation key=8JCL0F406L7I tag=YEHSRB6RN1U6 type=del 2024-09-12T00:22:18.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.585+0000 7fd6489978c0 1 > prepared operation key=3JZP8TZFEIMH tag=S3O6Z9MJBKRG type=del size=454327 2024-09-12T00:22:18.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.589+0000 7fd6489978c0 1 < completed delete operation key=F2CTWM0T2698 tag=TQ1FVPF8CPB8 type=del 2024-09-12T00:22:18.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.593+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=WS473Y9W1ZQ8 type=del size=1639505 2024-09-12T00:22:18.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.597+0000 7fd6489978c0 1 < completed delete operation key=Y3JFVW74FNT6 tag=BWZGXCGSB6JX type=del 2024-09-12T00:22:18.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.605+0000 7fd6489978c0 1 > prepared operation key=B2BW7GQ6UN9I tag=C8QVX9PL9HRU type=write size=240140 2024-09-12T00:22:18.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.609+0000 7fd6489978c0 1 < completed delete operation key=9ACGS2FIY7AF tag=11GHWSL8LFCD type=del 2024-09-12T00:22:18.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.613+0000 7fd6489978c0 1 > prepared operation key=8FBXDX6GELE7 tag=3AEFMC7I5RFC type=del size=413653 2024-09-12T00:22:18.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.617+0000 7fd6489978c0 1 < completed delete operation key=DAOTTEMK2P2T tag=T639LVZ8Q9H4 type=del 2024-09-12T00:22:18.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.621+0000 7fd6489978c0 1 > prepared operation key=8JCL0F406L7I tag=9LWA6A3LE8TD type=del size=3893952 2024-09-12T00:22:18.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.625+0000 7fd6489978c0 1 < completed delete operation key=ZXEIT45BWHXM tag=4OBJJ8EG8ZA1 type=del 2024-09-12T00:22:18.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.629+0000 7fd6489978c0 1 > prepared operation key=QBS4N1KGR1JB tag=AFPTY9FF46A8 type=del size=410583 2024-09-12T00:22:18.630 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.633+0000 7fd6489978c0 1 < canceled operation key=JPVKBVRCZTE9 tag=IJFCL6HVW5MV type=del size=2518531 2024-09-12T00:22:18.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.641+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~XBJ10H3WZWUH.0 size=1048576 2024-09-12T00:22:18.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.641+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~XBJ10H3WZWUH.1 size=1048576 2024-09-12T00:22:18.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.645+0000 7fd6489978c0 1 > prepared part key=_multipart_3JZP8TZFEIMH.2~XBJ10H3WZWUH.2 size=71223 2024-09-12T00:22:18.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.645+0000 7fd6489978c0 1 > prepared multipart upload key=3JZP8TZFEIMH upload=XBJ10H3WZWUH tag=EMNF3VWVI11U type=write size=3216951 2024-09-12T00:22:18.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.649+0000 7fd6489978c0 1 < completed delete operation key=LZICTA4BWOW8 tag=5QHWJ23KJ0XN type=del 2024-09-12T00:22:18.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.657+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~3YT4F14ZKRJM.0 size=1048576 2024-09-12T00:22:18.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.657+0000 7fd6489978c0 1 > prepared part key=_multipart_8JCL0F406L7I.2~3YT4F14ZKRJM.1 size=859000 2024-09-12T00:22:18.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:22:18.657+0000 7fd6489978c0 1 > prepared multipart upload key=8JCL0F406L7I upload=3YT4F14ZKRJM tag=AODQM20GA6RO type=write size=2956152 2024-09-12T00:22:18.657 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] cls_rgw_stats.simulate (28308 ms) 2024-09-12T00:22:18.657 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 1 test from cls_rgw_stats (28308 ms total) 2024-09-12T00:22:18.657 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:22:18.657 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:22:19.436 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 1 test from 1 test suite ran. (30981 ms total) 2024-09-12T00:22:19.437 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 1 test. 2024-09-12T00:22:19.444 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:22:19.444 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:22:19.498 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T00:22:19.499 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T00:22:19.499 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T00:22:19.564 INFO:tasks.workunit.client.0.smithi138.stdout:Running main() from gmock_main.cc 2024-09-12T00:22:19.565 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T00:22:19.565 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:22:21.429 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 31 tests from CmpOmap 2024-09-12T00:22:21.430 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T00:22:21.470 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (40 ms) 2024-09-12T00:22:21.470 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T00:22:21.476 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (6 ms) 2024-09-12T00:22:21.476 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T00:22:21.481 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (6 ms) 2024-09-12T00:22:21.481 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T00:22:21.490 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (8 ms) 2024-09-12T00:22:21.490 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T00:22:21.501 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_str (12 ms) 2024-09-12T00:22:21.502 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T00:22:21.516 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_u64 (15 ms) 2024-09-12T00:22:21.516 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T00:22:21.523 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (7 ms) 2024-09-12T00:22:21.524 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T00:22:21.529 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (5 ms) 2024-09-12T00:22:21.529 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T00:22:21.537 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (8 ms) 2024-09-12T00:22:21.537 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T00:22:21.545 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (9 ms) 2024-09-12T00:22:21.545 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T00:22:21.546 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T00:22:21.546 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T00:22:21.547 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-12T00:22:21.547 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T00:22:21.558 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (11 ms) 2024-09-12T00:22:21.558 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T00:22:21.577 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (19 ms) 2024-09-12T00:22:21.577 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T00:22:21.590 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (13 ms) 2024-09-12T00:22:21.590 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T00:22:21.608 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (18 ms) 2024-09-12T00:22:21.609 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T00:22:21.629 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_str (21 ms) 2024-09-12T00:22:21.629 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T00:22:21.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (16 ms) 2024-09-12T00:22:21.646 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T00:22:21.651 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (6 ms) 2024-09-12T00:22:21.651 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T00:22:21.658 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (7 ms) 2024-09-12T00:22:21.658 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T00:22:21.660 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (2 ms) 2024-09-12T00:22:21.660 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T00:22:21.661 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (1 ms) 2024-09-12T00:22:21.661 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T00:22:21.678 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (17 ms) 2024-09-12T00:22:21.679 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T00:22:21.697 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (18 ms) 2024-09-12T00:22:21.697 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T00:22:21.718 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (21 ms) 2024-09-12T00:22:21.718 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T00:22:21.737 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (20 ms) 2024-09-12T00:22:21.737 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T00:22:21.743 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (6 ms) 2024-09-12T00:22:21.743 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T00:22:21.750 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (7 ms) 2024-09-12T00:22:21.750 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T00:22:21.753 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-09-12T00:22:21.753 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T00:22:21.755 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-12T00:22:21.755 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (21 ms) 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 31 tests from CmpOmap (347 ms total) 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:22:21.777 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:22:22.436 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 31 tests from 1 test suite ran. (2871 ms total) 2024-09-12T00:22:22.436 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 31 tests. 2024-09-12T00:22:22.443 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:22:22.443 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:22:22.498 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T00:22:22.499 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T00:22:22.500 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T00:22:22.564 INFO:tasks.workunit.client.0.smithi138.stdout:Running main() from gmock_main.cc 2024-09-12T00:22:22.565 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:22:22.565 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:22:22.565 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T00:22:22.565 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T00:22:25.474 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2909 ms) 2024-09-12T00:22:25.474 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T00:22:28.484 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3010 ms) 2024-09-12T00:22:28.484 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T00:22:31.549 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.Reserve (3065 ms) 2024-09-12T00:22:31.549 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T00:22:34.616 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3068 ms) 2024-09-12T00:22:34.617 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T00:22:38.659 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.Commit (4042 ms) 2024-09-12T00:22:38.659 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T00:22:42.756 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.Stats (4094 ms) 2024-09-12T00:22:42.756 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T00:22:47.834 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (5081 ms) 2024-09-12T00:22:47.834 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T00:22:50.867 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.Abort (3033 ms) 2024-09-12T00:22:50.868 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T00:22:54.927 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.ReserveError (4060 ms) 2024-09-12T00:22:54.927 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T00:22:57.985 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.CommitError (3053 ms) 2024-09-12T00:22:57.985 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T00:23:00.986 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.AbortError (3006 ms) 2024-09-12T00:23:00.986 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T00:23:04.055 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3069 ms) 2024-09-12T00:23:04.055 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T00:23:07.080 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3024 ms) 2024-09-12T00:23:07.080 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T00:23:10.107 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3028 ms) 2024-09-12T00:23:10.107 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T00:23:13.179 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3072 ms) 2024-09-12T00:23:13.180 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T00:23:16.197 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3018 ms) 2024-09-12T00:23:16.198 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T00:23:19.256 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3059 ms) 2024-09-12T00:23:19.256 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T00:23:22.320 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.Cleanup (3064 ms) 2024-09-12T00:23:22.320 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T00:23:36.380 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.MultiProducer (14059 ms) 2024-09-12T00:23:36.381 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T00:23:41.445 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5065 ms) 2024-09-12T00:23:41.445 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T00:23:54.576 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13130 ms) 2024-09-12T00:23:54.576 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T00:24:00.773 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6198 ms) 2024-09-12T00:24:00.773 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T00:24:08.836 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (8063 ms) 2024-09-12T00:24:08.836 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T00:24:16.921 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (8080 ms) 2024-09-12T00:24:16.922 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 24 tests from TestCls2PCQueue (114352 ms total) 2024-09-12T00:24:16.922 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:24:16.922 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:24:16.922 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 24 tests from 1 test suite ran. (114352 ms total) 2024-09-12T00:24:16.922 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 24 tests. 2024-09-12T00:24:16.924 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:24:16.928 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:24:16.981 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T00:24:16.983 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T00:24:16.983 DEBUG:teuthology.orchestra.run.smithi138:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T00:24:17.058 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:17.058 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:17.059 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:24:17.059 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:24:18.942 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 4 tests from ClsAccount 2024-09-12T00:24:18.943 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsAccount.add 2024-09-12T00:24:18.982 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsAccount.add (40 ms) 2024-09-12T00:24:18.982 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsAccount.get 2024-09-12T00:24:18.992 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsAccount.get (10 ms) 2024-09-12T00:24:18.992 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsAccount.rm 2024-09-12T00:24:19.007 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsAccount.rm (15 ms) 2024-09-12T00:24:19.007 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] ClsAccount.list 2024-09-12T00:24:19.038 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] ClsAccount.list (31 ms) 2024-09-12T00:24:19.038 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 4 tests from ClsAccount (96 ms total) 2024-09-12T00:24:19.038 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:24:19.038 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:24:19.942 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 4 tests from 1 test suite ran. (2883 ms total) 2024-09-12T00:24:19.942 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 4 tests. 2024-09-12T00:24:19.949 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:24:19.950 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:24:20.005 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T00:24:20.007 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T00:24:20.007 DEBUG:teuthology.orchestra.run.smithi138:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T00:24:20.081 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:20.081 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:20.082 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T00:24:20.082 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:24:21.978 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T00:24:21.978 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T00:24:22.025 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] rgw_gc_log.init_existing_queue (48 ms) 2024-09-12T00:24:22.025 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T00:24:22.032 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] rgw_gc_log.init_existing_omap (6 ms) 2024-09-12T00:24:22.033 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T00:24:22.038 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (6 ms) 2024-09-12T00:24:22.038 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T00:24:22.040 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (3 ms) 2024-09-12T00:24:22.041 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T00:24:22.046 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] rgw_gc_log.defer1_after_init (6 ms) 2024-09-12T00:24:22.046 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T00:24:22.052 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] rgw_gc_log.defer2_before_init (3 ms) 2024-09-12T00:24:22.052 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 6 tests from rgw_gc_log (72 ms total) 2024-09-12T00:24:22.052 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:24:22.052 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:24:22.989 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 6 tests from 1 test suite ran. (2907 ms total) 2024-09-12T00:24:22.989 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 6 tests. 2024-09-12T00:24:22.995 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:24:22.995 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:24:23.053 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T00:24:23.055 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T00:24:23.055 DEBUG:teuthology.orchestra.run.smithi138:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T00:24:23.126 INFO:tasks.workunit.client.0.smithi138.stdout:Running main() from gmock_main.cc 2024-09-12T00:24:23.126 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:24:23.126 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:24:23.126 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T00:24:23.127 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T00:24:23.127 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-12T00:24:23.127 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-12T00:24:23.127 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns= i= 2024-09-12T00:24:23.127 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-12T00:24:23.127 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-12T00:24:23.127 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns= i= 2024-09-12T00:24:23.127 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-12T00:24:23.127 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-12T00:24:23.127 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns= i= 2024-09-12T00:24:23.127 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.127 INFO:tasks.workunit.client.0.smithi138.stdout: "obj1": { 2024-09-12T00:24:23.127 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.128 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.128 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.128 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.128 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.128 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.128 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.128 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.128 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.128 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.128 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.128 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.128 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-12T00:24:23.128 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.129 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.129 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.129 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.129 INFO:tasks.workunit.client.0.smithi138.stdout: "obj2": { 2024-09-12T00:24:23.129 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.129 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.129 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.129 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.129 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.129 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.129 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.129 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.129 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.129 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.130 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.130 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.130 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-12T00:24:23.130 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.130 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.130 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.130 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.130 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3": { 2024-09-12T00:24:23.130 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.130 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.130 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.130 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.130 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.130 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.131 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.131 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.131 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.131 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.131 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.131 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.131 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-12T00:24:23.131 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.131 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.131 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.131 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.131 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3-2": { 2024-09-12T00:24:23.131 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.131 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.132 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.132 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.132 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.132 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.132 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.132 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.132 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.132 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.132 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.132 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.132 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-12T00:24:23.132 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.132 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.133 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.133 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.133 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.133 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-12T00:24:23.133 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-12T00:24:23.133 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns=ns i= 2024-09-12T00:24:23.133 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-12T00:24:23.133 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-12T00:24:23.133 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns=ns i= 2024-09-12T00:24:23.133 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-12T00:24:23.133 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj 2024-09-12T00:24:23.133 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns=ns i= 2024-09-12T00:24:23.133 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.133 INFO:tasks.workunit.client.0.smithi138.stdout: "obj1": { 2024-09-12T00:24:23.134 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.134 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.134 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.134 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.134 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.134 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.134 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.134 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.134 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.134 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.134 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.134 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.134 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-12T00:24:23.135 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.135 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.135 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.135 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.135 INFO:tasks.workunit.client.0.smithi138.stdout: "obj2": { 2024-09-12T00:24:23.135 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.135 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.135 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.135 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.135 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.135 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.135 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.135 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.135 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.136 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.136 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.136 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.136 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-12T00:24:23.136 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.136 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.136 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.136 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.136 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3": { 2024-09-12T00:24:23.136 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.136 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.136 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.137 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.137 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.137 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.137 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.137 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.137 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.137 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.137 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.137 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.137 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-12T00:24:23.137 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.137 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.138 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.138 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.138 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3-2": { 2024-09-12T00:24:23.138 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.138 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.138 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.138 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.138 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.138 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.138 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.138 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.138 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.138 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.138 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.139 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.139 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-12T00:24:23.139 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.139 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.139 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.139 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.139 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.139 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-12T00:24:23.139 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-12T00:24:23.139 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns= i=v1 2024-09-12T00:24:23.139 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-12T00:24:23.139 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-12T00:24:23.139 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns= i=v1 2024-09-12T00:24:23.139 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-12T00:24:23.140 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-12T00:24:23.140 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns= i=v1 2024-09-12T00:24:23.140 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.140 INFO:tasks.workunit.client.0.smithi138.stdout: "obj1": { 2024-09-12T00:24:23.140 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.140 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.140 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.140 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.140 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.140 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.140 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.140 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.140 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.141 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.141 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.141 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.141 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-12T00:24:23.141 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-12T00:24:23.141 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.141 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.141 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.141 INFO:tasks.workunit.client.0.smithi138.stdout: "obj2": { 2024-09-12T00:24:23.141 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.141 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.141 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.141 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.142 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.142 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.142 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.142 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.142 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.142 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.142 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.142 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.142 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-12T00:24:23.142 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-12T00:24:23.142 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.142 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.142 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.143 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3": { 2024-09-12T00:24:23.143 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.143 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.143 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.143 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.143 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.143 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.143 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.143 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.143 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.143 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.143 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.143 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.143 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-12T00:24:23.144 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.144 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.144 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.144 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.144 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3-2": { 2024-09-12T00:24:23.144 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.144 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.144 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.144 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.144 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.144 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.144 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.144 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.145 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.145 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.145 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.145 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.145 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-12T00:24:23.145 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-12T00:24:23.145 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.145 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.145 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.145 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.145 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-12T00:24:23.145 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-12T00:24:23.145 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:24:23.146 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-12T00:24:23.146 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-12T00:24:23.146 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:24:23.146 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-12T00:24:23.146 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: _obj[v1] 2024-09-12T00:24:23.146 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:24:23.146 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.146 INFO:tasks.workunit.client.0.smithi138.stdout: "obj1": { 2024-09-12T00:24:23.146 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.146 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.146 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.146 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.146 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.147 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.147 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.147 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.147 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.147 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.147 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.147 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.147 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-12T00:24:23.147 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-12T00:24:23.147 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.147 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.147 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.147 INFO:tasks.workunit.client.0.smithi138.stdout: "obj2": { 2024-09-12T00:24:23.148 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.148 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.148 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.148 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.148 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.148 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.148 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.148 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.148 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.148 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.148 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.148 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.148 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-12T00:24:23.149 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-12T00:24:23.149 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.149 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.149 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.149 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3": { 2024-09-12T00:24:23.149 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.149 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.149 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.149 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.149 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.149 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.149 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.149 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.149 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.150 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.150 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.150 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.150 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-12T00:24:23.150 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.150 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.150 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.150 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.150 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3-2": { 2024-09-12T00:24:23.150 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.150 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.150 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.150 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.151 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.151 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.151 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.151 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.151 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.151 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.151 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.151 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.151 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_obj", 2024-09-12T00:24:23.151 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-12T00:24:23.151 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.151 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.151 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.152 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.152 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T00:24:23.152 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T00:24:23.152 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-12T00:24:23.152 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-12T00:24:23.152 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns= i= 2024-09-12T00:24:23.152 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-12T00:24:23.152 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-12T00:24:23.152 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns= i= 2024-09-12T00:24:23.152 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-12T00:24:23.152 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-12T00:24:23.152 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns= i= 2024-09-12T00:24:23.152 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.153 INFO:tasks.workunit.client.0.smithi138.stdout: "obj1": { 2024-09-12T00:24:23.153 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.153 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.153 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.153 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.153 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.153 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.153 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.153 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.153 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.153 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.153 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.153 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.153 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-12T00:24:23.154 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.154 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.154 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.154 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.154 INFO:tasks.workunit.client.0.smithi138.stdout: "obj2": { 2024-09-12T00:24:23.154 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.154 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.154 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.154 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.154 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.154 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.154 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.154 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.155 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.155 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.155 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.155 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.155 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-12T00:24:23.155 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.155 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.155 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.155 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.155 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3": { 2024-09-12T00:24:23.155 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.155 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.155 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.156 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.156 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.156 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.156 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.156 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.156 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.156 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.156 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.156 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.156 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-12T00:24:23.156 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.156 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.157 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.157 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.157 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3-2": { 2024-09-12T00:24:23.157 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.157 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.157 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.157 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.157 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.157 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.157 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.157 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.157 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.157 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.157 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.158 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.158 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-12T00:24:23.158 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.158 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.158 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.158 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.158 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.158 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-12T00:24:23.158 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-12T00:24:23.158 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns=ns i= 2024-09-12T00:24:23.158 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-12T00:24:23.158 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-12T00:24:23.158 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns=ns i= 2024-09-12T00:24:23.159 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-12T00:24:23.159 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj 2024-09-12T00:24:23.159 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns=ns i= 2024-09-12T00:24:23.159 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.159 INFO:tasks.workunit.client.0.smithi138.stdout: "obj1": { 2024-09-12T00:24:23.159 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.159 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.159 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.159 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.159 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.159 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.159 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.159 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.159 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.160 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.160 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.160 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.160 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-12T00:24:23.160 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.160 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.160 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.160 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.160 INFO:tasks.workunit.client.0.smithi138.stdout: "obj2": { 2024-09-12T00:24:23.160 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.160 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.160 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.161 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.161 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.161 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.161 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.161 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.161 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.161 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.161 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.161 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.161 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-12T00:24:23.161 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.161 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.161 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.161 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.162 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3": { 2024-09-12T00:24:23.162 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.162 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.162 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.162 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.162 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.162 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.162 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.162 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.162 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.162 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.162 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.162 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.163 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-12T00:24:23.163 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.163 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.163 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.163 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.163 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3-2": { 2024-09-12T00:24:23.163 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.163 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.163 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.163 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.163 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.163 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.163 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.164 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.164 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.164 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.164 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.164 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.164 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-12T00:24:23.164 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.164 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.164 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.164 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.164 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.164 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-12T00:24:23.164 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-12T00:24:23.164 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns= i=v1 2024-09-12T00:24:23.165 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-12T00:24:23.165 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-12T00:24:23.165 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns= i=v1 2024-09-12T00:24:23.165 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-12T00:24:23.165 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-12T00:24:23.165 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns= i=v1 2024-09-12T00:24:23.165 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.165 INFO:tasks.workunit.client.0.smithi138.stdout: "obj1": { 2024-09-12T00:24:23.165 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.165 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.165 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.165 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.165 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.166 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.166 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.166 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.166 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.166 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.166 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.166 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.166 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-12T00:24:23.166 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-12T00:24:23.166 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.166 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.166 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.166 INFO:tasks.workunit.client.0.smithi138.stdout: "obj2": { 2024-09-12T00:24:23.166 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.167 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.167 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.167 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.167 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.167 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.167 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.167 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.167 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.167 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.167 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.167 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.167 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-12T00:24:23.167 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-12T00:24:23.168 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.168 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.168 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.168 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3": { 2024-09-12T00:24:23.168 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.168 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.168 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.168 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.168 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.168 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.168 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.168 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.168 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.169 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.169 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.169 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.169 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-12T00:24:23.169 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.169 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.169 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.169 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.169 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3-2": { 2024-09-12T00:24:23.169 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.169 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.169 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.169 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.169 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.170 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.170 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.170 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.170 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.170 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.170 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.170 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.170 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-12T00:24:23.170 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-12T00:24:23.170 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.170 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.170 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.170 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.171 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-12T00:24:23.171 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-12T00:24:23.171 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:24:23.171 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-12T00:24:23.171 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-12T00:24:23.171 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:24:23.171 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-12T00:24:23.171 INFO:tasks.workunit.client.0.smithi138.stdout:parsed: obj[v1] 2024-09-12T00:24:23.171 INFO:tasks.workunit.client.0.smithi138.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:24:23.171 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.171 INFO:tasks.workunit.client.0.smithi138.stdout: "obj1": { 2024-09-12T00:24:23.171 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.171 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.171 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.172 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.172 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.172 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.172 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.172 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.172 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.172 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.172 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.172 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.172 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-12T00:24:23.172 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-12T00:24:23.172 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.172 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.173 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.173 INFO:tasks.workunit.client.0.smithi138.stdout: "obj2": { 2024-09-12T00:24:23.173 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.173 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.173 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.173 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.173 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.173 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.173 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.173 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.173 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.173 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.173 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.174 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.174 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-12T00:24:23.174 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-12T00:24:23.174 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.174 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.174 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.174 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3": { 2024-09-12T00:24:23.174 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.174 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.174 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.174 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.174 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.174 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.175 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.175 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.175 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.175 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.175 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.175 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.175 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-12T00:24:23.175 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.175 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.175 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.175 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.175 INFO:tasks.workunit.client.0.smithi138.stdout: "obj3-2": { 2024-09-12T00:24:23.175 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.175 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.175 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.176 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.176 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.176 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.176 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.176 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.176 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.176 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.176 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.176 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.176 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "obj", 2024-09-12T00:24:23.176 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "v1", 2024-09-12T00:24:23.176 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.176 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.177 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.177 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.177 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T00:24:23.177 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T00:24:23.177 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.177 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.177 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.177 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.177 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.177 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.177 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.177 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.177 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.178 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.178 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.178 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.178 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.178 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.178 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.178 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.178 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.178 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.178 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.178 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.178 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.178 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.178 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.179 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.179 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.179 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.179 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.179 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.179 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.179 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.179 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.179 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.179 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.179 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.179 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.179 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-12T00:24:23.180 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker_myobj", 2024-09-12T00:24:23.180 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.180 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.180 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.180 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.180 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.180 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.180 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.180 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.180 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.180 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.180 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.180 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.181 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.181 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.181 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.181 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.181 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.181 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.181 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.181 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.181 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.181 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.181 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.181 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.181 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.181 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.182 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.182 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.182 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.182 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.182 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.182 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.182 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.182 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.182 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.182 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.182 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.182 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.182 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.183 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.183 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.183 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.183 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.183 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.183 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.183 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.183 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.183 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.183 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.183 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.183 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.183 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.184 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.184 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.184 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.184 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.184 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.184 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.184 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.184 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker_myobj", 2024-09-12T00:24:23.184 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.184 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.184 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.184 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.184 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.185 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.185 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.185 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.185 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.185 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.185 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.185 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.185 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.185 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.185 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.185 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.185 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.185 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.186 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.186 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.186 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.186 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.186 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.186 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.186 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.186 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.186 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.186 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.186 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.186 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.186 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.187 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.187 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.187 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.187 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.187 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.187 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.187 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.187 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.187 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.187 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.187 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.187 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.187 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.188 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.188 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.188 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.188 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.188 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.188 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.188 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.188 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.188 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.188 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.188 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.188 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.188 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.189 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.189 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-12T00:24:23.189 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:24:23.189 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.189 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.189 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.189 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.189 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.189 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.189 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.189 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.189 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.189 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.190 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.190 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.190 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.190 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.190 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.190 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.190 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.190 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.190 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.190 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.190 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.190 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.191 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.191 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.191 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.191 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.191 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.191 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.191 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.191 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.191 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.191 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.191 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.191 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.191 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.192 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.192 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.192 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.192 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.192 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.192 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.192 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.192 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.192 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.192 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.192 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.192 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.192 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.192 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.193 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.193 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.193 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.193 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.193 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.193 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.193 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.193 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.193 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.193 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.193 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:24:23.193 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.193 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.193 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.194 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.194 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.194 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.194 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.194 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.194 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.194 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.194 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.194 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.194 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.194 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.194 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.194 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.194 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.195 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.195 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.195 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.195 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.195 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.195 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.195 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.195 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.195 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.195 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.195 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.195 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.195 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.195 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.196 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.196 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.196 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.196 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.196 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.196 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.196 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.196 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.196 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.196 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.196 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.196 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.197 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.197 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.197 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.197 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.197 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.197 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.197 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.197 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.197 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.197 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.197 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.197 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.197 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.198 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.198 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.198 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-12T00:24:23.198 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:24:23.198 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.198 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.198 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.198 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.198 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.198 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.198 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.198 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.198 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.198 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.199 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.199 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.199 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.199 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.199 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.199 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.199 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.199 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.199 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.199 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.199 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.199 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.199 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.200 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.200 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.200 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.200 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.200 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.200 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.200 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.200 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.200 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.200 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.200 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.200 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.200 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.201 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.201 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.201 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.201 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.201 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.201 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.201 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.201 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.201 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.201 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.201 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.201 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.201 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.201 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.202 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.202 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.202 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.202 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.202 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.202 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.202 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.202 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.202 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.202 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:24:23.202 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.202 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.202 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.202 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.203 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.203 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.203 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.203 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.203 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.203 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.203 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.203 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.203 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.203 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.203 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.203 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.204 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.204 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.204 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.204 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.204 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.204 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.204 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.204 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.204 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.204 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.204 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.204 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.204 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.204 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.205 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.205 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.205 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.205 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.205 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.205 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.205 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.205 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.205 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.205 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.205 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.205 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.205 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.206 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.206 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.206 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.206 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.206 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.206 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.206 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.206 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.206 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.206 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.206 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.206 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.206 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.207 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.207 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.207 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-12T00:24:23.207 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:24:23.207 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.207 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.207 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.207 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.207 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.207 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.207 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.207 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.207 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.207 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.208 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.208 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.208 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.208 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.208 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.208 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.208 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.208 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.208 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.208 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.208 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.208 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.209 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.209 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.209 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.209 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.209 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.209 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.209 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.209 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.209 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.209 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.209 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.209 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.209 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.209 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.210 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.210 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.210 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.210 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.210 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.210 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.210 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.210 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.210 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.210 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.210 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.210 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.210 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.211 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.211 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.211 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.211 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.211 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.211 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.211 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.211 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.211 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.211 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.211 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:24:23.211 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.211 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.212 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.212 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.212 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.212 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.212 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.212 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.212 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.212 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.212 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.212 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.212 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.212 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.212 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.212 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.213 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.213 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.213 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.213 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.213 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.213 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.213 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.213 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.213 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.213 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.213 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.213 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.213 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.214 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.214 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.214 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.214 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.214 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.214 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.214 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.214 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.214 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.214 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.214 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.214 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.214 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.214 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.215 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.215 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.215 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.215 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.215 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.215 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.215 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.215 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.215 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.215 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.215 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.215 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.215 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.215 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.216 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.216 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-12T00:24:23.216 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker___myobj", 2024-09-12T00:24:23.216 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj" 2024-09-12T00:24:23.216 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.216 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.216 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.216 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.216 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.216 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.216 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.216 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.216 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.216 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.217 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.217 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.217 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.217 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.217 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.217 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.217 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.217 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.217 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.217 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.217 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.217 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.217 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.217 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.218 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.218 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.218 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.218 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.218 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.218 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.218 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.218 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.218 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.218 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.218 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.218 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.218 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.219 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.219 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.219 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.219 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.219 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.219 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.219 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.219 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.219 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.219 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.219 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.219 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.219 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.219 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.219 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.220 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.220 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.220 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.220 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.220 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.220 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.220 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker___myobj", 2024-09-12T00:24:23.220 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj" 2024-09-12T00:24:23.220 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.220 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.220 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.220 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.221 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.221 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.221 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.221 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.221 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.221 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.221 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.221 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.221 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.221 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.221 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.221 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.221 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.221 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.222 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.222 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.222 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.222 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.222 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.222 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.222 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.222 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.222 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.222 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.222 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.222 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.222 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.222 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.223 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.223 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.223 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.223 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.223 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.223 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.223 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.223 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.223 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.223 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.223 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.223 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.223 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.223 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.224 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.224 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.224 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.224 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.224 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.224 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.224 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.224 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.224 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.224 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.224 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.224 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-12T00:24:23.224 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:24:23.225 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.225 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.225 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.225 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.225 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.225 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.225 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.225 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.225 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.225 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.225 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.225 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.225 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.225 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.226 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.226 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.226 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.226 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.226 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.226 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.226 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.226 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.226 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.226 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.226 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.226 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.226 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.226 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.227 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.227 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.227 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.227 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.227 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.227 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.227 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.227 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.227 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.227 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.227 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.227 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.227 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.227 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.228 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.228 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.228 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.228 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.228 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.228 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.228 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.228 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.228 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.228 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.228 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.228 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.228 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.228 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.229 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.229 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.229 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.229 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:24:23.229 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.229 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.229 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.229 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.229 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.229 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.229 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.229 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.229 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.229 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.230 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.230 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.230 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.230 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.230 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.230 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.230 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.230 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.230 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.230 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.230 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.230 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.230 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.230 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.231 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.231 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.231 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.231 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.231 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.231 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.231 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.231 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.231 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.231 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.231 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.231 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.231 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.231 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.232 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.232 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.232 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.232 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.232 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.232 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.232 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.232 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.232 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.232 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.232 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.232 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.232 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.233 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.233 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.233 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.233 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.233 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.233 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.233 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.233 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-12T00:24:23.233 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:24:23.233 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj" 2024-09-12T00:24:23.233 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.233 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.233 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.233 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.234 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.234 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.234 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.234 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.234 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.234 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.234 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.234 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.234 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.234 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.234 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.234 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.234 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.234 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.235 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.235 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.235 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.235 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.235 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.235 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.235 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.235 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.235 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.235 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.235 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.235 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.235 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.235 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.236 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.236 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.236 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.236 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.236 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.236 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.236 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.236 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.236 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.236 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.236 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.236 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.236 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.237 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.237 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.237 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.237 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.237 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.237 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.237 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.237 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.237 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.237 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.237 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.237 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.237 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.237 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:24:23.238 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj" 2024-09-12T00:24:23.238 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.238 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.238 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.238 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.238 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.238 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.238 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.238 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.238 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.238 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.238 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.238 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.238 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.239 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.239 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.239 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.239 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.239 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.239 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.239 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.239 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.239 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.239 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.239 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.239 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.239 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.239 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.240 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.240 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.240 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.240 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.240 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.240 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.240 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.240 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.240 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.240 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.240 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.240 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.240 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.240 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.241 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.241 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.241 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.241 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.241 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.241 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.241 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.241 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.241 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.241 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.241 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.241 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.241 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.242 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.242 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.242 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.242 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-12T00:24:23.242 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:24:23.242 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.242 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.242 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.242 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.242 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.242 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.242 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.242 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.242 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.243 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.243 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.243 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.243 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.243 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.243 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.243 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.243 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.243 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.243 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.243 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.243 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.243 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.243 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.243 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.244 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.244 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.244 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.244 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.244 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.244 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.244 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.244 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.244 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.244 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.244 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.244 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.244 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.245 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.245 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.245 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.245 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.245 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.245 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.245 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.245 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.245 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.245 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.245 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.245 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.245 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.245 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.246 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.247 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.247 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.247 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.247 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.247 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.247 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.247 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.247 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.247 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.247 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.247 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.247 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.247 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.247 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.248 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.248 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.248 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.248 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.248 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.248 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.248 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.248 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.248 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.248 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.248 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.248 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.248 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.248 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.249 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.249 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.249 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.249 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.249 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.249 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.249 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.249 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.249 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.249 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.249 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.249 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.249 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.249 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.250 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.250 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.250 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.250 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.250 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.250 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.250 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.250 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.250 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.250 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.250 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.250 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-12T00:24:23.250 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker___myobj_", 2024-09-12T00:24:23.250 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj_" 2024-09-12T00:24:23.251 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.251 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.251 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.251 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.251 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.251 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.251 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.251 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.251 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.251 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.251 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.251 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.251 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.251 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.252 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.252 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.252 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.252 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.252 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.252 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.252 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.252 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.252 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.252 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.252 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.252 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.252 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.253 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.253 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.253 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.253 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.253 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.253 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.253 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.253 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.253 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.253 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.253 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.253 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.253 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.253 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.254 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.254 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.254 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.254 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.254 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.254 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.254 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.254 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.254 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.254 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.254 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.254 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.255 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.255 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.255 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.255 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.255 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.255 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker___myobj_", 2024-09-12T00:24:23.255 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj_" 2024-09-12T00:24:23.255 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.255 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.255 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.255 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.255 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.255 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.255 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.256 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.256 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.256 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.256 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.256 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.256 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.256 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.256 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.256 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.256 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.256 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.256 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.256 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.257 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.257 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.257 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.257 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.257 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.257 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.257 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.257 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.257 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.257 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.257 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.257 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.257 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.257 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.258 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.258 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.258 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.258 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.258 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.258 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.258 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.258 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.258 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.258 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.258 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.258 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.258 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.258 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.259 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.259 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.259 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.259 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.259 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.259 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.259 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.259 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.259 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.259 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-12T00:24:23.259 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:24:23.259 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.259 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.260 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.260 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.260 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.260 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.260 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.260 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.260 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.260 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.260 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.260 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.260 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.260 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.260 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.260 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.261 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.262 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.262 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.262 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.262 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.262 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.262 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.262 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.262 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.262 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.262 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.262 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.262 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.262 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.263 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.263 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.263 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.263 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.263 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.263 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.263 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.263 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.263 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.263 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.263 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.263 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.263 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.264 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.264 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.264 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:24:23.264 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.264 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.264 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.264 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.264 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.264 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.264 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.264 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.264 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.264 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.265 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.265 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.265 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.265 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.265 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.265 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.265 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.265 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.265 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.265 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.265 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.265 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.265 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.266 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.266 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.266 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.266 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.266 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.266 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.266 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.266 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.266 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.266 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.266 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.266 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.266 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.267 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.267 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.267 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.267 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.267 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.267 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.267 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.267 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.267 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.267 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.267 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.267 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.267 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.268 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.268 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.268 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.268 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.268 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.268 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.268 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.268 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.268 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.268 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-12T00:24:23.268 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:24:23.268 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj_" 2024-09-12T00:24:23.268 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.269 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.269 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.269 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.269 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.269 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.269 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.269 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.269 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.269 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.269 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.269 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.269 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.269 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.270 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.270 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.270 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.270 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.270 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.270 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.270 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.270 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.270 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.270 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.270 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.270 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.270 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.270 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.271 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.271 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.271 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.271 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.271 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.271 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.271 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.271 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.271 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.271 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.271 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.271 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.271 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.271 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.272 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.272 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.272 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.272 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.272 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.272 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.272 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.272 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.272 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.272 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.272 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.272 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.272 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.272 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.273 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.273 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.273 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:24:23.273 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj_" 2024-09-12T00:24:23.273 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.273 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.273 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.273 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.273 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.273 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.273 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.273 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.273 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.274 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.274 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.274 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.274 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.274 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.274 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.274 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.274 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.274 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.274 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.274 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.274 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.274 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.274 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.275 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.275 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.275 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.275 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.275 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.275 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.275 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.275 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.275 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.275 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.275 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.275 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.275 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.275 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.276 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.276 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.276 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.276 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.276 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.276 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.276 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.276 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.276 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.276 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.276 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.276 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.276 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.277 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.277 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.277 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.280 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.280 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.280 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.280 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.280 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": "default-placement.data", 2024-09-12T00:24:23.280 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:24:23.281 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.281 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.281 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.281 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.281 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.281 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.281 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "test", 2024-09-12T00:24:23.281 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.281 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.281 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.281 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.281 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": "", 2024-09-12T00:24:23.281 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.281 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": "" 2024-09-12T00:24:23.282 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.282 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.282 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.282 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.282 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.282 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.282 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.282 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.282 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.282 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.282 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.282 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.282 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.282 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.283 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.283 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.283 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.283 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.283 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.283 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.283 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.283 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.283 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.283 INFO:tasks.workunit.client.0.smithi138.stdout: "obj": { 2024-09-12T00:24:23.283 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.283 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.283 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.283 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.284 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.284 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.284 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.284 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.284 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.284 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.284 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.284 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.284 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.284 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.284 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.284 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.284 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.284 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.285 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.285 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.285 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.285 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:24:23.285 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.285 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.285 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.285 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.285 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.285 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.285 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.285 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.285 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.285 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.286 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.286 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.286 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.286 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.286 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.286 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.286 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.286 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.286 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.286 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.286 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.286 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.286 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.286 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-12T00:24:23.287 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T00:24:23.287 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.287 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.287 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.287 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker_myobj", 2024-09-12T00:24:23.287 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.287 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.287 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.287 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.287 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.287 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.287 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.287 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.287 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.288 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.288 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.288 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.288 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.288 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.288 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.288 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.288 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.288 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.288 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.288 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.288 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.288 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.289 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.289 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker_myobj 2024-09-12T00:24:23.289 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.289 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-12T00:24:23.289 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.289 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker_myobj", 2024-09-12T00:24:23.289 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.289 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.289 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.289 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.289 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-12T00:24:23.289 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.289 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.289 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.289 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.290 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.290 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.290 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.290 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.290 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.290 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.290 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.290 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.290 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.290 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.290 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.290 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.290 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.291 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.291 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker_myobj 2024-09-12T00:24:23.291 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.291 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.291 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.291 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:24:23.291 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.291 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.291 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.291 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.291 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.291 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.291 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.291 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.291 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.292 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.292 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.292 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.292 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.292 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.292 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.292 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.292 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.293 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.293 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.293 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.293 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.293 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.293 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.293 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T00:24:23.293 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.294 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-12T00:24:23.294 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.294 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:24:23.294 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.294 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.294 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.294 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.295 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-12T00:24:23.295 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.295 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.295 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.295 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.295 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.295 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.296 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.296 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.296 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.296 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.296 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.296 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.296 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.297 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.297 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.297 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.297 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.297 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.297 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T00:24:23.298 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.298 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.298 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.298 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:24:23.298 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.298 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.298 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.298 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.299 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.299 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.299 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.299 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.299 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.299 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.299 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.300 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.300 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.300 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.300 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.300 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.300 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.300 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.301 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.301 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.301 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.301 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.301 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.302 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T00:24:23.302 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.302 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-12T00:24:23.302 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.302 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:24:23.302 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.303 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.303 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.303 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.303 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-12T00:24:23.303 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.303 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.303 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.304 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.304 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.304 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.304 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.304 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.304 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.305 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.305 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.305 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.305 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.305 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.305 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.305 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.305 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.306 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.306 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T00:24:23.306 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.306 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.306 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.306 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:24:23.307 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.307 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.307 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.307 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.307 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.307 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.307 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.308 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.308 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.308 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.308 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.308 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.308 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.308 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.309 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.309 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.309 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.309 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.309 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.309 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.309 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.309 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.309 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.310 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T00:24:23.310 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.310 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-12T00:24:23.310 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.310 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:24:23.310 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.310 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.311 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.311 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.311 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-12T00:24:23.311 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.311 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.311 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.311 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.311 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.311 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.312 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.312 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.312 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.312 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.312 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.312 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.313 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "myobj", 2024-09-12T00:24:23.313 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.313 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.313 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.313 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.313 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.314 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T00:24:23.314 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.314 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.314 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.314 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker___myobj", 2024-09-12T00:24:23.314 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj" 2024-09-12T00:24:23.315 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.315 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.315 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.315 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.315 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.315 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.315 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.316 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.316 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.316 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.316 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.316 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.316 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.316 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.317 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.317 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.317 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.317 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.317 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.317 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.317 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.318 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.318 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker___myobj 2024-09-12T00:24:23.318 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.318 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-12T00:24:23.318 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.319 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker___myobj", 2024-09-12T00:24:23.319 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj" 2024-09-12T00:24:23.319 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.319 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.319 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.319 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-12T00:24:23.319 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.320 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.320 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.320 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.320 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.320 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.320 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.320 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.321 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.321 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.321 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.321 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.321 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.321 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.321 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.322 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.322 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.322 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.322 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker___myobj 2024-09-12T00:24:23.322 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.323 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.323 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.323 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:24:23.323 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.323 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.323 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.323 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.323 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.324 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.324 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.324 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.324 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.324 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.324 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.324 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.325 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.325 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.325 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.325 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.325 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.325 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.325 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.326 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.326 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.326 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.326 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.326 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T00:24:23.326 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.326 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-12T00:24:23.326 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.327 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:24:23.327 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.327 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.327 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.327 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.327 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-12T00:24:23.327 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.327 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.328 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.328 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.328 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.328 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.328 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.328 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.328 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.328 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.329 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.329 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.329 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.329 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.329 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.329 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.329 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.330 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.330 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T00:24:23.330 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.330 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.330 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.330 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:24:23.330 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj" 2024-09-12T00:24:23.330 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.331 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.331 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.331 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.331 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.331 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.331 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.331 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.332 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.332 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.332 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.332 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.332 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.333 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.333 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.333 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.333 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.333 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.333 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.333 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.333 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.334 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.334 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T00:24:23.334 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.334 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-12T00:24:23.334 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.334 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:24:23.334 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj" 2024-09-12T00:24:23.335 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.335 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.335 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.335 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-12T00:24:23.335 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.335 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.336 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.337 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.337 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.337 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.337 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.337 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.337 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.338 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.338 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.338 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.338 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.338 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.338 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.338 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.338 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.338 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.338 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T00:24:23.338 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.339 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.339 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.339 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:24:23.339 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.339 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.339 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.339 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.339 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.339 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.339 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.339 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.339 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.339 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.339 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.340 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.340 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.340 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.340 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.340 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.340 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.340 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.340 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.340 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.340 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.340 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.340 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.340 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T00:24:23.341 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.341 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-12T00:24:23.341 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.341 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:24:23.341 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.341 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.341 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.341 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.341 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-12T00:24:23.341 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.341 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.341 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.341 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.341 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.342 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.342 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.342 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.342 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.342 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.342 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.342 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.342 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj", 2024-09-12T00:24:23.342 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.342 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.342 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.342 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.342 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.343 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T00:24:23.343 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.343 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.343 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.343 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker___myobj_", 2024-09-12T00:24:23.343 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj_" 2024-09-12T00:24:23.343 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.343 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.343 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.343 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.343 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.343 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.343 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.343 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.344 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.344 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.344 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.344 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.344 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.344 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.344 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.344 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.344 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.344 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.344 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.344 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.345 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.345 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.345 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T00:24:23.345 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.345 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-12T00:24:23.345 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.345 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker___myobj_", 2024-09-12T00:24:23.345 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj_" 2024-09-12T00:24:23.345 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.345 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.345 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.345 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-12T00:24:23.345 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.346 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.346 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.346 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.346 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.346 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.346 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.346 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.346 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.346 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.346 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.346 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.346 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.347 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.347 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.347 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.347 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.347 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.347 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T00:24:23.347 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.347 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.348 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.348 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:24:23.348 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.348 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.348 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.348 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.348 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.348 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.348 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.348 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.348 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.348 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.348 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.349 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.349 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.349 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.349 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.349 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.349 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.349 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.349 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.349 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.349 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.349 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.349 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.350 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T00:24:23.350 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.350 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-12T00:24:23.350 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.350 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:24:23.350 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.350 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.350 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.350 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.350 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-12T00:24:23.350 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.350 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.351 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.351 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.351 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.351 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.351 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.351 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.351 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.351 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.351 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.351 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.351 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.352 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "", 2024-09-12T00:24:23.352 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.352 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.352 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.352 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.352 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T00:24:23.352 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.352 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.352 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.352 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:24:23.352 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj_" 2024-09-12T00:24:23.353 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.353 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.353 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.353 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.353 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.353 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.353 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.353 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.353 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.353 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.353 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.353 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.353 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.353 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.354 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.354 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.354 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.354 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.354 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.354 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.354 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.354 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.354 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T00:24:23.354 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.354 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-12T00:24:23.354 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.354 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:24:23.354 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "marker__myobj_" 2024-09-12T00:24:23.355 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.355 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.355 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.355 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-12T00:24:23.355 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.355 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.355 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.355 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.355 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.355 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.355 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.355 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.355 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.356 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.356 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.356 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.356 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.356 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.356 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "" 2024-09-12T00:24:23.356 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.356 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.356 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.356 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T00:24:23.356 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.356 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj": { 2024-09-12T00:24:23.356 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.356 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:24:23.357 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.357 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.357 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.357 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.357 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj": { 2024-09-12T00:24:23.357 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.357 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.357 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.357 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.358 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.358 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.358 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.358 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.358 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.358 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.358 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.358 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.358 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.358 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.358 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.358 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.358 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.359 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.359 INFO:tasks.workunit.client.0.smithi138.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:24:23.359 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.359 INFO:tasks.workunit.client.0.smithi138.stdout: "raw_obj2": { 2024-09-12T00:24:23.359 INFO:tasks.workunit.client.0.smithi138.stdout: "pool": ".data-pool", 2024-09-12T00:24:23.359 INFO:tasks.workunit.client.0.smithi138.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:24:23.359 INFO:tasks.workunit.client.0.smithi138.stdout: "loc": "" 2024-09-12T00:24:23.359 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.359 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.359 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.359 INFO:tasks.workunit.client.0.smithi138.stdout: "new_obj2": { 2024-09-12T00:24:23.359 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket": { 2024-09-12T00:24:23.359 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "ebtest", 2024-09-12T00:24:23.359 INFO:tasks.workunit.client.0.smithi138.stdout: "marker": "marker", 2024-09-12T00:24:23.360 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_id": "bucket-id", 2024-09-12T00:24:23.360 INFO:tasks.workunit.client.0.smithi138.stdout: "tenant": "", 2024-09-12T00:24:23.360 INFO:tasks.workunit.client.0.smithi138.stdout: "explicit_placement": { 2024-09-12T00:24:23.360 INFO:tasks.workunit.client.0.smithi138.stdout: "data_pool": ".data-pool", 2024-09-12T00:24:23.360 INFO:tasks.workunit.client.0.smithi138.stdout: "data_extra_pool": "", 2024-09-12T00:24:23.360 INFO:tasks.workunit.client.0.smithi138.stdout: "index_pool": ".index-pool" 2024-09-12T00:24:23.360 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.360 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.360 INFO:tasks.workunit.client.0.smithi138.stdout: "key": { 2024-09-12T00:24:23.360 INFO:tasks.workunit.client.0.smithi138.stdout: "name": "_myobj_", 2024-09-12T00:24:23.360 INFO:tasks.workunit.client.0.smithi138.stdout: "instance": "inst", 2024-09-12T00:24:23.360 INFO:tasks.workunit.client.0.smithi138.stdout: "ns": "ns" 2024-09-12T00:24:23.360 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.360 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.361 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.361 INFO:tasks.workunit.client.0.smithi138.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:24:23.361 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T00:24:23.361 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-12T00:24:23.361 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:24:23.361 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:24:23.361 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T00:24:23.361 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 4 tests. 2024-09-12T00:24:23.361 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:24:23.361 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:24:23.376 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T00:24:23.377 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T00:24:23.377 DEBUG:teuthology.orchestra.run.smithi138:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T00:24:23.477 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:23.478 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:23.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.523+0000 7ff8fd6d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:24:23.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.523+0000 7ff8fd6d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:23.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.523+0000 7ff8fd6d89c0 20 realm 2024-09-12T00:24:23.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.523+0000 7ff8fd6d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:24:23.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.523+0000 7ff8fd6d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:23.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.523+0000 7ff8fd6d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:24:23.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.523+0000 7ff8fd6d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:24:23.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.523+0000 7ff8fd6d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:23.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.523+0000 7ff8fd6d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:24:23.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.523+0000 7ff8fd6d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:23.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.523+0000 7ff8fd6d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:24:23.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.527+0000 7ff8fd6d89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:24:23.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.527+0000 7ff8fd6d89c0 20 searching for the correct realm 2024-09-12T00:24:23.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.539+0000 7ff8fb9df640 0 -- 172.21.15.138:0/1018132670 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7ff8f40cf400 msgr2=0x7ff8f40cf840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:23.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.555+0000 7ff8fb9df640 0 -- 172.21.15.138:0/1018132670 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55d648cb8fe0 msgr2=0x55d648cbb4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:24:23.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:24:23.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:24:23.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:24:23.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:24:23.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:24:23.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:24:23.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:24:23.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:24:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:24:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:24:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:24:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 zone default found 2024-09-12T00:24:23.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 4 Realm: () 2024-09-12T00:24:23.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:24:23.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:24:23.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:24:23.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 zonegroup default 2024-09-12T00:24:23.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:24:23.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:23.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:24:23.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:23.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:24:23.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:23.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 started sync module instance, tier type = 2024-09-12T00:24:23.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.567+0000 7ff8fd6d89c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:24:23.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.587+0000 7ff8fd6d89c0 20 add_watcher() i=0 2024-09-12T00:24:23.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.587+0000 7ff8fd6d89c0 20 add_watcher() i=1 2024-09-12T00:24:23.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.587+0000 7ff8fd6d89c0 20 add_watcher() i=2 2024-09-12T00:24:23.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.587+0000 7ff8fd6d89c0 20 add_watcher() i=3 2024-09-12T00:24:23.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.587+0000 7ff8fd6d89c0 20 add_watcher() i=4 2024-09-12T00:24:23.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.587+0000 7ff8fd6d89c0 20 add_watcher() i=5 2024-09-12T00:24:23.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.587+0000 7ff8fd6d89c0 20 add_watcher() i=6 2024-09-12T00:24:23.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.591+0000 7ff8fd6d89c0 20 add_watcher() i=7 2024-09-12T00:24:23.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.591+0000 7ff8fd6d89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:24:23.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff7b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:23.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff8fd6d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:24:23.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff8fd6d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:24:23.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff8fd6d89c0 5 note: GC not initialized 2024-09-12T00:24:23.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff7b0fe1640 20 reqs_thread_entry: start 2024-09-12T00:24:23.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff8fd6d89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:24:23.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff8fd6d89c0 20 Filter name: none 2024-09-12T00:24:23.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff72a7fc640 20 reqs_thread_entry: start 2024-09-12T00:24:23.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff8fd6d89c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T00:24:23.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff8fd6d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:24:23.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff8fd6d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:23.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff8fd6d89c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T00:24:23.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff8fd6d89c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:24:23.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff8fd6d89c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T00:24:23.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff8fd6d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:24:23.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff8fd6d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:23.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff8fd6d89c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T00:24:23.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff8fd6d89c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:24:23.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff8fd6d89c0 10 cache get: name=default.rgw.meta+users.keys+QQNjzPFHEnI88WMF1pSMv+yWVuQ= : miss 2024-09-12T00:24:23.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.595+0000 7ff8fd6d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:24:23.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.599+0000 7ff8fd6d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:24:23.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.599+0000 7ff8fd6d89c0 10 cache put: name=default.rgw.meta+users.keys+QQNjzPFHEnI88WMF1pSMv+yWVuQ= info.flags=0x0 2024-09-12T00:24:23.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.599+0000 7ff8fd6d89c0 10 adding default.rgw.meta+users.keys+QQNjzPFHEnI88WMF1pSMv+yWVuQ= to cache LRU end 2024-09-12T00:24:23.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.599+0000 7ff8fd6d89c0 10 cache get: name=default.rgw.meta+users.keys+QQNjzPFHEnI88WMF1pSMv+yWVuQ= : hit (negative entry) 2024-09-12T00:24:23.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.599+0000 7ff8fd6d89c0 10 cache get: name=default.rgw.meta+users.keys+QQNjzPFHEnI88WMF1pSMv+yWVuQ= : hit (negative entry) 2024-09-12T00:24:23.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.599+0000 7ff8fd6d89c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:24:23.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.599+0000 7ff8fd6d89c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:24:23.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.599+0000 7ff8fd6d89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T00:24:23.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.599+0000 7ff7deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627777 cookie 94378832680080 notifier 5574 bl.length()=697 2024-09-12T00:24:23.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.599+0000 7ff7deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:24:23.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.599+0000 7ff7deffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:24:23.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.603+0000 7ff8fd6d89c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:24:23.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.603+0000 7ff8fd6d89c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:24:23.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.603+0000 7ff8fd6d89c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T00:24:23.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.603+0000 7ff7de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627776 cookie 94378832676512 notifier 5574 bl.length()=194 2024-09-12T00:24:23.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.603+0000 7ff7de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:24:23.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.603+0000 7ff7de7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:24:23.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.607+0000 7ff8fd6d89c0 10 cache put: name=default.rgw.meta+users.keys+QQNjzPFHEnI88WMF1pSMv+yWVuQ= info.flags=0x7 2024-09-12T00:24:23.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.607+0000 7ff8fd6d89c0 10 moving default.rgw.meta+users.keys+QQNjzPFHEnI88WMF1pSMv+yWVuQ= to cache LRU end 2024-09-12T00:24:23.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.607+0000 7ff8fd6d89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:QQNjzPFHEnI88WMF1pSMv+yWVuQ=, ofs0, ns] 2024-09-12T00:24:23.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.607+0000 7ff7deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627776 cookie 94378832689184 notifier 5574 bl.length()=203 2024-09-12T00:24:23.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.607+0000 7ff7deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QQNjzPFHEnI88WMF1pSMv+yWVuQ= info.flags=0x7 2024-09-12T00:24:23.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.607+0000 7ff7deffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QQNjzPFHEnI88WMF1pSMv+yWVuQ= to cache LRU end 2024-09-12T00:24:23.606 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:24:23.606 INFO:tasks.workunit.client.0.smithi138.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T00:24:23.606 INFO:tasks.workunit.client.0.smithi138.stdout: "display_name": "librgw test user", 2024-09-12T00:24:23.606 INFO:tasks.workunit.client.0.smithi138.stdout: "email": "librgw@example.com", 2024-09-12T00:24:23.606 INFO:tasks.workunit.client.0.smithi138.stdout: "suspended": 0, 2024-09-12T00:24:23.606 INFO:tasks.workunit.client.0.smithi138.stdout: "max_buckets": 1000, 2024-09-12T00:24:23.607 INFO:tasks.workunit.client.0.smithi138.stdout: "subusers": [], 2024-09-12T00:24:23.607 INFO:tasks.workunit.client.0.smithi138.stdout: "keys": [ 2024-09-12T00:24:23.607 INFO:tasks.workunit.client.0.smithi138.stdout: { 2024-09-12T00:24:23.607 INFO:tasks.workunit.client.0.smithi138.stdout: "user": "ceph-test-librgw-file", 2024-09-12T00:24:23.607 INFO:tasks.workunit.client.0.smithi138.stdout: "access_key": "QQNjzPFHEnI88WMF1pSMv+yWVuQ=", 2024-09-12T00:24:23.607 INFO:tasks.workunit.client.0.smithi138.stdout: "secret_key": "aOsAzrAZoITR3hyDcLDtuJHSa8LqJAfSprDFYC1IF+ESUv9E9aI58Q==", 2024-09-12T00:24:23.607 INFO:tasks.workunit.client.0.smithi138.stdout: "active": true, 2024-09-12T00:24:23.607 INFO:tasks.workunit.client.0.smithi138.stdout: "create_date": "2024-09-12T00:24:23.603303Z" 2024-09-12T00:24:23.607 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:24:23.607 INFO:tasks.workunit.client.0.smithi138.stdout: ], 2024-09-12T00:24:23.607 INFO:tasks.workunit.client.0.smithi138.stdout: "swift_keys": [], 2024-09-12T00:24:23.608 INFO:tasks.workunit.client.0.smithi138.stdout: "caps": [], 2024-09-12T00:24:23.608 INFO:tasks.workunit.client.0.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-12T00:24:23.608 INFO:tasks.workunit.client.0.smithi138.stdout: "default_placement": "", 2024-09-12T00:24:23.608 INFO:tasks.workunit.client.0.smithi138.stdout: "default_storage_class": "", 2024-09-12T00:24:23.608 INFO:tasks.workunit.client.0.smithi138.stdout: "placement_tags": [], 2024-09-12T00:24:23.608 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_quota": { 2024-09-12T00:24:23.608 INFO:tasks.workunit.client.0.smithi138.stdout: "enabled": false, 2024-09-12T00:24:23.608 INFO:tasks.workunit.client.0.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:24:23.608 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size": -1, 2024-09-12T00:24:23.608 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:24:23.608 INFO:tasks.workunit.client.0.smithi138.stdout: "max_objects": -1 2024-09-12T00:24:23.608 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.608 INFO:tasks.workunit.client.0.smithi138.stdout: "user_quota": { 2024-09-12T00:24:23.609 INFO:tasks.workunit.client.0.smithi138.stdout: "enabled": false, 2024-09-12T00:24:23.609 INFO:tasks.workunit.client.0.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:24:23.609 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size": -1, 2024-09-12T00:24:23.609 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:24:23.609 INFO:tasks.workunit.client.0.smithi138.stdout: "max_objects": -1 2024-09-12T00:24:23.609 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:24:23.609 INFO:tasks.workunit.client.0.smithi138.stdout: "temp_url_keys": [], 2024-09-12T00:24:23.609 INFO:tasks.workunit.client.0.smithi138.stdout: "type": "rgw", 2024-09-12T00:24:23.609 INFO:tasks.workunit.client.0.smithi138.stdout: "mfa_ids": [], 2024-09-12T00:24:23.609 INFO:tasks.workunit.client.0.smithi138.stdout: "account_id": "", 2024-09-12T00:24:23.609 INFO:tasks.workunit.client.0.smithi138.stdout: "path": "/", 2024-09-12T00:24:23.609 INFO:tasks.workunit.client.0.smithi138.stdout: "create_date": "2024-09-12T00:24:23.603277Z", 2024-09-12T00:24:23.609 INFO:tasks.workunit.client.0.smithi138.stdout: "tags": [], 2024-09-12T00:24:23.610 INFO:tasks.workunit.client.0.smithi138.stdout: "group_ids": [] 2024-09-12T00:24:23.610 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:24:23.610 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:24:23.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.607+0000 7ff7b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:24:23.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.611+0000 7ff8fd6d89c0 20 remove_watcher() i=0 2024-09-12T00:24:23.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.611+0000 7ff8fd6d89c0 2 removed watcher, disabling cache 2024-09-12T00:24:23.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.615+0000 7ff8fd6d89c0 20 remove_watcher() i=1 2024-09-12T00:24:23.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.615+0000 7ff8fd6d89c0 20 remove_watcher() i=2 2024-09-12T00:24:23.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.619+0000 7ff8fd6d89c0 20 remove_watcher() i=3 2024-09-12T00:24:23.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.619+0000 7ff8fd6d89c0 20 remove_watcher() i=4 2024-09-12T00:24:23.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.623+0000 7ff8fd6d89c0 20 remove_watcher() i=5 2024-09-12T00:24:23.623 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.623+0000 7ff8fd6d89c0 20 remove_watcher() i=6 2024-09-12T00:24:23.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:23.627+0000 7ff8fd6d89c0 20 remove_watcher() i=7 2024-09-12T00:24:23.640 INFO:tasks.workunit.client.0.smithi138.stdout:phase 1.1 2024-09-12T00:24:23.658 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:24:23.659 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:24:23.659 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:24:23.659 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:24:23.672 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:23.672 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:24.309 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (648 ms) 2024-09-12T00:24:24.309 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:24:24.309 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T00:24:24.310 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:24:24.310 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:24:24.310 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:24:24.328 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T00:24:24.337 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/f1 2024-09-12T00:24:24.343 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/f2 2024-09-12T00:24:24.347 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T00:24:24.354 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T00:24:24.361 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T00:24:24.367 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T00:24:24.374 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T00:24:24.381 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T00:24:24.387 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T00:24:24.393 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T00:24:24.399 INFO:tasks.workunit.client.0.smithi138.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T00:24:24.405 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETUP_HIER1 (97 ms) 2024-09-12T00:24:24.406 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:24:24.649 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETUP_DIRS1 (244 ms) 2024-09-12T00:24:24.650 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:24:24.650 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:24:24.650 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:24:24.689 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (39 ms) 2024-09-12T00:24:24.689 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:24:24.785 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (95 ms) 2024-09-12T00:24:24.785 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:24:24.785 INFO:tasks.workunit.client.0.smithi138.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T00:24:24.800 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (15 ms) 2024-09-12T00:24:24.800 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:24:24.800 INFO:tasks.workunit.client.0.smithi138.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T00:24:24.816 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (16 ms) 2024-09-12T00:24:24.816 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:24:24.817 INFO:tasks.workunit.client.0.smithi138.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:24:24.817 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:24:24.817 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:24:24.817 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:24:24.817 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:24:24.817 INFO:tasks.workunit.client.0.smithi138.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:24:24.817 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:24:24.817 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:24:24.817 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:24:24.817 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:24:24.817 INFO:tasks.workunit.client.0.smithi138.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:24:24.817 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:24:24.817 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:24:24.818 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:24:24.818 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:24:24.818 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (1 ms) 2024-09-12T00:24:24.818 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:24:24.818 INFO:tasks.workunit.client.0.smithi138.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:24:24.818 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:24:24.822 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:24:24.822 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:24:24.826 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:24:24.826 INFO:tasks.workunit.client.0.smithi138.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:24:24.826 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:24:24.830 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:24:24.830 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:24:24.834 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:24:24.834 INFO:tasks.workunit.client.0.smithi138.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:24:24.834 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:24:24.837 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:24:24.837 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:24:24.842 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:24:24.843 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READ_DIRS1 (26 ms) 2024-09-12T00:24:24.843 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:24:25.068 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READF_SETUP1 (225 ms) 2024-09-12T00:24:25.068 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:24:25.068 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:24:25.068 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:24:25.068 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:24:25.069 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:24:25.069 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:24:25.069 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:24:25.069 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:24:25.069 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:24:25.069 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:24:25.069 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:24:25.069 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:24:25.069 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:24:25.069 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:24:25.069 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:24:25.069 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:24:25.069 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:24:25.069 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:24:25.070 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:24:25.086 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:24:25.086 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:24:25.094 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:24:25.098 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:24:25.104 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:24:25.105 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:24:25.106 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:24:25.107 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:24:25.108 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:24:25.109 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:24:25.110 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:24:25.115 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:24:25.115 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:24:25.115 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:24:25.115 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:24:25.115 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:24:25.116 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.HIER1 (47 ms) 2024-09-12T00:24:25.116 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:24:25.116 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:24:25.116 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:24:25.116 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:24:25.116 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:24:25.116 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:24:25.116 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:24:25.116 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:24:25.116 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:24:25.116 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:24:25.116 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:24:25.116 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (1 ms) 2024-09-12T00:24:25.117 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:24:25.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:25.115+0000 7f745d49ba80 -1 shutting down 2024-09-12T00:24:25.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:25.119+0000 7f73371ed640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56967, si_uid : 1000, si_addr0x3e80000de87, si_status0 2024-09-12T00:24:54.273 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (29157 ms) 2024-09-12T00:24:54.274 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 24 tests from LibRGW (30614 ms total) 2024-09-12T00:24:54.274 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:24:54.274 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:24:54.274 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 24 tests from 1 test suite ran. (30614 ms total) 2024-09-12T00:24:54.274 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 24 tests. 2024-09-12T00:24:54.288 INFO:tasks.workunit.client.0.smithi138.stdout:phase 1.2 2024-09-12T00:24:54.310 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:24:54.310 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:24:54.310 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:24:54.310 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:24:54.320 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:54.320 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:54.634 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (323 ms) 2024-09-12T00:24:54.634 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:24:54.636 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T00:24:54.636 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:24:54.636 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:24:54.636 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:24:54.636 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T00:24:54.636 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:24:54.636 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T00:24:54.636 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:24:54.636 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:24:54.637 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:24:54.637 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:24:54.637 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:24:54.637 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:24:54.637 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:24:54.637 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:24:54.637 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:24:54.637 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:24:54.637 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:24:54.637 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:24:54.637 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:24:54.637 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T00:24:54.638 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:24:54.638 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:24:54.638 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:24:54.638 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:24:54.638 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:24:54.638 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:24:54.638 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:24:54.638 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:24:54.638 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:24:54.638 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T00:24:54.638 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:24:54.638 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:24:54.639 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:24:54.639 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:24:54.639 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:24:54.639 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:24:54.639 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:24:54.639 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:24:54.639 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:24:54.639 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:24:54.639 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:24:54.639 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:24:54.639 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:24:54.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:54.639+0000 7f577bf45a80 -1 shutting down 2024-09-12T00:24:54.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:24:54.643+0000 7f5655c97640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57612, si_uid : 1000, si_addr0x3e80000e10c, si_status0 2024-09-12T00:25:24.969 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (30333 ms) 2024-09-12T00:25:24.970 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 24 tests from LibRGW (30658 ms total) 2024-09-12T00:25:24.970 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:25:24.970 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:25:24.970 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 24 tests from 1 test suite ran. (30658 ms total) 2024-09-12T00:25:24.970 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 24 tests. 2024-09-12T00:25:24.982 INFO:tasks.workunit.client.0.smithi138.stdout:phase 1.3 2024-09-12T00:25:25.005 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:25:25.005 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:25:25.005 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:25:25.006 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:25:25.017 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:25.018 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:25.563 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (557 ms) 2024-09-12T00:25:25.563 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:25:25.564 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T00:25:25.565 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:25:25.565 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:25:25.565 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:25:25.575 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETUP_HIER1 (11 ms) 2024-09-12T00:25:25.575 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:25:25.686 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETUP_DIRS1 (111 ms) 2024-09-12T00:25:25.686 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:25:25.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:25:25.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:25:25.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:25:25.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:25:25.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:25:25.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:25:25.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:25:25.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:25:25.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:25:25.687 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:25:25.687 INFO:tasks.workunit.client.0.smithi138.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:25:25.687 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:25:25.688 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:25:25.688 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:25:25.688 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:25:25.688 INFO:tasks.workunit.client.0.smithi138.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:25:25.688 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:25:25.688 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:25:25.688 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:25:25.688 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:25:25.688 INFO:tasks.workunit.client.0.smithi138.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:25:25.688 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:25:25.688 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:25:25.688 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:25:25.689 INFO:tasks.workunit.client.0.smithi138.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:25:25.689 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:25:25.689 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:25:25.689 INFO:tasks.workunit.client.0.smithi138.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:25:25.689 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:25:25.689 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:25:25.689 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:25:25.693 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:25:25.693 INFO:tasks.workunit.client.0.smithi138.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:25:25.693 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:25:25.695 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:25:25.696 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:25:25.699 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:25:25.699 INFO:tasks.workunit.client.0.smithi138.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:25:25.699 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:25:25.701 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:25:25.701 INFO:tasks.workunit.client.0.smithi138.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:25:25.704 INFO:tasks.workunit.client.0.smithi138.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:25:25.704 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READ_DIRS1 (18 ms) 2024-09-12T00:25:25.704 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:25:25.704 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:25:25.704 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:25:25.705 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:25:25.705 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:25:25.705 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:25:25.705 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:25:25.705 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:25:25.705 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:25:25.705 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:25:25.705 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:25:25.705 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:25:25.705 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:25:25.705 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:25:25.705 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:25:25.706 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:25:25.706 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:25:25.706 INFO:tasks.workunit.client.0.smithi138.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:25:25.706 INFO:tasks.workunit.client.0.smithi138.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:25:25.706 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:25:25.706 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:25:25.721 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:25:25.722 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:25:25.728 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:25:25.732 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:25:25.740 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:25:25.741 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:25:25.742 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:25:25.743 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:25:25.744 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:25:25.749 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:25:25.749 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:25:25.751 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:25:25.751 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:25:25.751 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:25:25.752 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:25:25.752 INFO:tasks.workunit.client.0.smithi138.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:25:25.752 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.HIER1 (47 ms) 2024-09-12T00:25:25.752 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:25:25.752 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:25:25.752 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:25:25.752 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:25:25.752 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:25:25.752 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:25:25.752 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:25:25.752 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:25:25.752 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:25:25.753 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:25:25.753 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:25:25.753 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:25:25.753 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:25:25.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:25:25.754+0000 7f6c7c6bea80 -1 shutting down 2024-09-12T00:25:25.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:25:25.758+0000 7f6b56410640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58260, si_uid : 1000, si_addr0x3e80000e394, si_status0 2024-09-12T00:25:55.787 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (30035 ms) 2024-09-12T00:25:55.788 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 24 tests from LibRGW (30781 ms total) 2024-09-12T00:25:55.788 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:25:55.788 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:25:55.788 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 24 tests from 1 test suite ran. (30781 ms total) 2024-09-12T00:25:55.788 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 24 tests. 2024-09-12T00:25:55.800 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2.1 2024-09-12T00:25:55.824 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:25:55.824 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:25:55.825 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:25:55.825 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:25:55.835 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:55.835 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:56.126 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (303 ms) 2024-09-12T00:25:56.127 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:25:56.128 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:25:56.128 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:25:56.144 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKET (17 ms) 2024-09-12T00:25:56.144 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:25:56.144 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:25:56.145 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:25:56.162 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave0 2024-09-12T00:25:56.178 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave1 2024-09-12T00:25:56.195 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave2 2024-09-12T00:25:56.213 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave3 2024-09-12T00:25:56.230 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave4 2024-09-12T00:25:56.249 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave5 2024-09-12T00:25:56.267 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave6 2024-09-12T00:25:56.283 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave7 2024-09-12T00:25:56.302 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave8 2024-09-12T00:25:56.321 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave9 2024-09-12T00:25:56.321 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (176 ms) 2024-09-12T00:25:56.321 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:25:56.967 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (647 ms) 2024-09-12T00:25:56.968 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:25:56.968 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:25:56.968 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:25:56.968 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:25:56.968 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:25:56.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:25:56.970+0000 7f706bc16a80 -1 shutting down 2024-09-12T00:25:56.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:25:56.974+0000 7f6f45968640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58907, si_uid : 1000, si_addr0x3e80000e61b, si_status0 2024-09-12T00:26:26.520 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (29552 ms) 2024-09-12T00:26:26.521 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 9 tests from LibRGW (30696 ms total) 2024-09-12T00:26:26.521 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:26:26.521 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:26:26.521 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 9 tests from 1 test suite ran. (30696 ms total) 2024-09-12T00:26:26.521 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 9 tests. 2024-09-12T00:26:26.529 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2.2 2024-09-12T00:26:26.553 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:26:26.553 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:26:26.553 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:26:26.553 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:26:26.564 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:26.564 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:27.095 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (543 ms) 2024-09-12T00:26:27.096 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:26:27.096 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:26:27.097 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:26:27.097 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:26:27.097 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:26:27.160 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_BUCKET (64 ms) 2024-09-12T00:26:27.160 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:26:27.181 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave0 2024-09-12T00:26:27.198 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave1 2024-09-12T00:26:27.216 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave2 2024-09-12T00:26:27.232 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave3 2024-09-12T00:26:27.248 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave4 2024-09-12T00:26:27.267 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave5 2024-09-12T00:26:27.284 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave6 2024-09-12T00:26:27.301 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave7 2024-09-12T00:26:27.321 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave8 2024-09-12T00:26:27.341 INFO:tasks.workunit.client.0.smithi138.stdout:created: sorrydave9 2024-09-12T00:26:27.341 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (181 ms) 2024-09-12T00:26:27.341 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:26:28.071 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (729 ms) 2024-09-12T00:26:28.071 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:26:28.071 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:26:28.071 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:26:28.071 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:26:28.072 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:26:28.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:26:28.073+0000 7f2cf97f9a80 -1 shutting down 2024-09-12T00:26:28.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:26:28.077+0000 7f2bd354b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59553, si_uid : 1000, si_addr0x3e80000e8a1, si_status0 2024-09-12T00:26:57.317 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (29246 ms) 2024-09-12T00:26:57.317 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 9 tests from LibRGW (30764 ms total) 2024-09-12T00:26:57.317 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:26:57.317 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:26:57.317 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 9 tests from 1 test suite ran. (30764 ms total) 2024-09-12T00:26:57.317 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 9 tests. 2024-09-12T00:26:57.330 INFO:tasks.workunit.client.0.smithi138.stdout:phase 3.1 2024-09-12T00:26:57.673 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:26:57.673 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:26:57.673 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:26:57.673 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:26:57.683 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:57.683 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:57.985 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (312 ms) 2024-09-12T00:26:57.985 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:26:57.986 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:26:57.986 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:26:58.003 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKET (17 ms) 2024-09-12T00:26:58.003 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:26:58.009 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T00:26:58.009 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:26:58.012 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T00:26:58.012 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:26:58.068 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LARGE1 (56 ms) 2024-09-12T00:26:58.068 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:26:58.133 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LARGE2 (65 ms) 2024-09-12T00:26:58.133 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:26:58.133 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:26:58.133 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:26:58.133 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:26:58.134 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:26:58.134 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:26:58.134 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:26:58.134 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:26:58.134 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:26:58.134 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:26:58.134 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:26:58.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:26:58.137+0000 7fc26298ba80 -1 shutting down 2024-09-12T00:26:58.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:26:58.141+0000 7fc13c6dd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60198, si_uid : 1000, si_addr0x3e80000eb26, si_status0 2024-09-12T00:27:28.349 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (30215 ms) 2024-09-12T00:27:28.350 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 13 tests from LibRGW (30676 ms total) 2024-09-12T00:27:28.350 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:27:28.350 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:27:28.350 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 13 tests from 1 test suite ran. (30676 ms total) 2024-09-12T00:27:28.350 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 13 tests. 2024-09-12T00:27:28.367 INFO:tasks.workunit.client.0.smithi138.stdout:phase 3.2 2024-09-12T00:27:28.710 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:27:28.710 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:27:28.710 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:27:28.710 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:27:28.719 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:28.719 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:29.225 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (515 ms) 2024-09-12T00:27:29.225 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:27:29.226 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:27:29.226 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:27:29.227 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:27:29.227 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:27:29.235 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (8 ms) 2024-09-12T00:27:29.235 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:27:29.242 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-12T00:27:29.242 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:27:29.303 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LARGE1 (63 ms) 2024-09-12T00:27:29.303 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:27:29.303 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T00:27:29.303 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:27:29.303 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:27:29.303 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:27:29.309 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_OBJECT (6 ms) 2024-09-12T00:27:29.309 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:27:29.356 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_BUCKET (47 ms) 2024-09-12T00:27:29.356 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:27:29.356 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:27:29.356 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:27:29.356 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:27:29.356 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:27:29.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:27:29.361+0000 7fef970a2a80 -1 shutting down 2024-09-12T00:27:29.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:27:29.361+0000 7fee70df4640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60843, si_uid : 1000, si_addr0x3e80000edab, si_status0 2024-09-12T00:27:59.478 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (30122 ms) 2024-09-12T00:27:59.479 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 13 tests from LibRGW (30768 ms total) 2024-09-12T00:27:59.479 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:27:59.479 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:27:59.479 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 13 tests from 1 test suite ran. (30768 ms total) 2024-09-12T00:27:59.479 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 13 tests. 2024-09-12T00:27:59.496 INFO:tasks.workunit.client.0.smithi138.stdout:phase 4.1 2024-09-12T00:27:59.520 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:27:59.520 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:27:59.520 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:27:59.520 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:27:59.520 INFO:tasks.workunit.client.0.smithi138.stdout:read i1: 64001 2024-09-12T00:27:59.521 INFO:tasks.workunit.client.0.smithi138.stdout:read s1: blunderbuss 2024-09-12T00:27:59.521 INFO:tasks.workunit.client.0.smithi138.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:27:59.521 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:27:59.533 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:59.533 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:59.853 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (334 ms) 2024-09-12T00:27:59.854 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:27:59.855 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:27:59.855 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:27:59.887 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (32 ms) 2024-09-12T00:27:59.887 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:28:01.030 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_0 2024-09-12T00:28:01.030 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_1 2024-09-12T00:28:01.030 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_2 2024-09-12T00:28:01.030 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_3 2024-09-12T00:28:01.031 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_4 2024-09-12T00:28:01.031 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_5 2024-09-12T00:28:01.031 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_6 2024-09-12T00:28:01.031 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_7 2024-09-12T00:28:01.031 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_8 2024-09-12T00:28:01.031 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_9 2024-09-12T00:28:01.031 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_10 2024-09-12T00:28:01.031 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_11 2024-09-12T00:28:01.031 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_12 2024-09-12T00:28:01.031 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_13 2024-09-12T00:28:01.031 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_14 2024-09-12T00:28:01.031 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_15 2024-09-12T00:28:01.031 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_16 2024-09-12T00:28:01.031 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_17 2024-09-12T00:28:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_18 2024-09-12T00:28:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_19 2024-09-12T00:28:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_20 2024-09-12T00:28:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_21 2024-09-12T00:28:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_22 2024-09-12T00:28:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_23 2024-09-12T00:28:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_24 2024-09-12T00:28:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_25 2024-09-12T00:28:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_26 2024-09-12T00:28:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_27 2024-09-12T00:28:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_28 2024-09-12T00:28:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_29 2024-09-12T00:28:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_30 2024-09-12T00:28:01.032 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_31 2024-09-12T00:28:01.033 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_32 2024-09-12T00:28:01.033 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_33 2024-09-12T00:28:01.033 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_34 2024-09-12T00:28:01.033 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_35 2024-09-12T00:28:01.033 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_36 2024-09-12T00:28:01.033 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_37 2024-09-12T00:28:01.033 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_38 2024-09-12T00:28:01.033 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_39 2024-09-12T00:28:01.033 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_40 2024-09-12T00:28:01.033 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_41 2024-09-12T00:28:01.033 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_42 2024-09-12T00:28:01.033 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_43 2024-09-12T00:28:01.033 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_44 2024-09-12T00:28:01.034 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_45 2024-09-12T00:28:01.034 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_46 2024-09-12T00:28:01.034 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_47 2024-09-12T00:28:01.034 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_48 2024-09-12T00:28:01.034 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_49 2024-09-12T00:28:01.034 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_50 2024-09-12T00:28:01.034 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_51 2024-09-12T00:28:01.034 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_52 2024-09-12T00:28:01.034 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_53 2024-09-12T00:28:01.034 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_54 2024-09-12T00:28:01.034 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_55 2024-09-12T00:28:01.034 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_56 2024-09-12T00:28:01.034 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_57 2024-09-12T00:28:01.034 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_58 2024-09-12T00:28:01.034 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_59 2024-09-12T00:28:01.035 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_60 2024-09-12T00:28:01.035 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_61 2024-09-12T00:28:01.035 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_62 2024-09-12T00:28:01.035 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_63 2024-09-12T00:28:01.035 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_64 2024-09-12T00:28:01.035 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_65 2024-09-12T00:28:01.035 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_66 2024-09-12T00:28:01.035 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_67 2024-09-12T00:28:01.035 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_68 2024-09-12T00:28:01.035 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_69 2024-09-12T00:28:01.035 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_70 2024-09-12T00:28:01.035 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_71 2024-09-12T00:28:01.036 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_72 2024-09-12T00:28:01.036 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_73 2024-09-12T00:28:01.036 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_74 2024-09-12T00:28:01.036 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_75 2024-09-12T00:28:01.036 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_76 2024-09-12T00:28:01.036 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_77 2024-09-12T00:28:01.036 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_78 2024-09-12T00:28:01.036 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_79 2024-09-12T00:28:01.036 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_80 2024-09-12T00:28:01.036 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_81 2024-09-12T00:28:01.036 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_82 2024-09-12T00:28:01.036 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_83 2024-09-12T00:28:01.037 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_84 2024-09-12T00:28:01.037 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_85 2024-09-12T00:28:01.037 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_86 2024-09-12T00:28:01.037 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_87 2024-09-12T00:28:01.037 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_88 2024-09-12T00:28:01.037 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_89 2024-09-12T00:28:01.037 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_90 2024-09-12T00:28:01.037 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_91 2024-09-12T00:28:01.037 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_92 2024-09-12T00:28:01.037 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_93 2024-09-12T00:28:01.037 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_94 2024-09-12T00:28:01.037 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_95 2024-09-12T00:28:01.038 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_96 2024-09-12T00:28:01.038 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_97 2024-09-12T00:28:01.038 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_98 2024-09-12T00:28:01.038 INFO:tasks.workunit.client.0.smithi138.stdout:created: dmarker:f_99 2024-09-12T00:28:01.038 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1143 ms) 2024-09-12T00:28:01.038 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:28:01.039 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T00:28:01.039 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T00:28:01.039 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:28:01.039 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:28:01.039 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:28:01.039 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:28:01.039 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:28:01.039 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:28:01.040 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:28:01.040 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:28:01.040 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:28:01.040 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:28:01.040 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:28:01.040 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:28:01.040 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:28:01.040 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:28:01.040 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:28:01.040 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:28:01.040 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:28:01.040 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:28:01.040 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:28:01.041 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:28:01.041 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:28:01.041 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:28:01.041 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:28:01.041 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:28:01.041 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:28:01.041 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:28:01.041 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:28:01.041 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:28:01.041 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:28:01.041 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:28:01.041 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:28:01.042 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:28:01.042 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:28:01.042 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:28:01.042 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:28:01.042 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:28:01.042 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:28:01.042 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:28:01.042 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:28:01.042 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:28:01.042 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:28:01.042 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:28:01.042 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:28:01.042 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:28:01.043 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:28:01.043 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:28:01.043 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:28:01.043 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:28:01.043 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:28:01.043 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:28:01.043 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:28:01.043 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:28:01.043 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:28:01.043 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:28:01.043 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:28:01.043 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:28:01.044 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:28:01.044 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:28:01.044 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:28:01.044 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:28:01.044 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:28:01.044 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:28:01.044 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:28:01.044 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:28:01.044 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:28:01.044 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:28:01.044 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:28:01.044 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:28:01.044 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:28:01.045 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:28:01.045 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:28:01.045 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:28:01.045 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:28:01.045 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:28:01.045 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:28:01.045 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:28:01.045 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:28:01.045 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:28:01.045 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:28:01.045 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:28:01.045 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:28:01.046 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:28:01.046 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:28:01.046 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:28:01.046 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:28:01.046 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:28:01.046 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:28:01.046 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:28:01.046 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:28:01.046 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:28:01.046 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:28:01.046 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:28:01.046 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:28:01.046 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:28:01.047 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:28:01.047 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:28:01.047 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:28:01.047 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:28:01.047 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:28:01.047 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:28:01.047 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_READDIR (7 ms) 2024-09-12T00:28:01.047 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:28:01.048 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:28:01.048 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:28:01.048 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:28:01.048 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:28:01.048 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:28:01.048 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:28:01.048 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:28:01.049 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:28:01.049 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:28:01.049 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:28:01.049 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:28:01.049 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:28:01.049 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:28:01.049 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:28:01.049 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:28:01.049 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:28:01.049 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:28:01.049 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:28:01.049 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:28:01.049 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:28:01.050 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:28:01.050 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:28:01.050 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:28:01.050 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:28:01.050 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:28:01.050 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:28:01.050 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:28:01.050 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:28:01.050 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:28:01.050 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:28:01.050 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:28:01.050 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:28:01.050 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:28:01.051 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:28:01.051 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:28:01.051 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:28:01.051 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:28:01.051 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:28:01.051 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:28:01.051 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:28:01.051 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:28:01.051 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:28:01.051 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:28:01.051 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:28:01.051 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:28:01.051 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:28:01.052 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:28:01.052 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:28:01.052 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:28:01.052 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:28:01.052 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:28:01.052 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:28:01.052 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:28:01.052 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:28:01.052 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:28:01.052 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:28:01.052 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:28:01.052 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:28:01.052 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:28:01.052 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:28:01.053 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:28:01.053 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:28:01.053 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:28:01.053 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:28:01.053 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:28:01.053 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:28:01.053 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:28:01.053 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:28:01.053 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:28:01.053 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:28:01.053 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:28:01.053 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:28:01.053 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:28:01.054 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:28:01.054 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:28:01.054 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:28:01.054 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:28:01.054 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:28:01.054 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:28:01.054 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:28:01.054 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:28:01.054 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:28:01.054 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:28:01.054 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:28:01.054 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:28:01.054 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:28:01.055 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:28:01.055 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:28:01.055 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:28:01.055 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:28:01.055 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:28:01.055 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:28:01.055 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:28:01.055 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:28:01.056 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:28:01.056 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:28:01.056 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:28:01.056 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:28:01.056 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:28:01.056 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:28:01.056 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER2_READDIR (5 ms) 2024-09-12T00:28:01.056 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:28:01.056 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (1 ms) 2024-09-12T00:28:01.056 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:28:01.056 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:28:01.056 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:28:01.056 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:28:01.057 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:28:01.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:28:01.048+0000 7f4749df3a80 -1 shutting down 2024-09-12T00:28:01.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:28:01.048+0000 7f4623b45640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61488, si_uid : 1000, si_addr0x3e80000f030, si_status0 2024-09-12T00:28:30.040 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (28997 ms) 2024-09-12T00:28:30.041 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 11 tests from LibRGW (30520 ms total) 2024-09-12T00:28:30.041 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:28:30.041 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:28:30.041 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 11 tests from 1 test suite ran. (30520 ms total) 2024-09-12T00:28:30.041 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 11 tests. 2024-09-12T00:28:30.053 INFO:tasks.workunit.client.0.smithi138.stdout:phase 4.2 2024-09-12T00:28:30.076 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:28:30.076 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:28:30.076 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:28:30.077 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:28:30.077 INFO:tasks.workunit.client.0.smithi138.stdout:read i1: 64001 2024-09-12T00:28:30.077 INFO:tasks.workunit.client.0.smithi138.stdout:read s1: blunderbuss 2024-09-12T00:28:30.077 INFO:tasks.workunit.client.0.smithi138.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:28:30.077 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:28:30.086 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:30.087 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:30.376 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (300 ms) 2024-09-12T00:28:30.376 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:28:30.377 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:28:30.377 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:28:30.395 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (17 ms) 2024-09-12T00:28:30.395 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:28:30.395 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1 ms) 2024-09-12T00:28:30.396 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:28:30.396 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:28:30.396 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:28:30.402 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:28:30.402 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:28:30.402 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:28:30.402 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:28:30.402 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:28:30.402 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:28:30.402 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:28:30.403 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:28:30.403 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:28:30.403 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:28:30.403 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:28:30.403 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:28:30.403 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:28:30.403 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:28:30.403 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:28:30.403 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:28:30.403 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:28:30.403 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:28:30.403 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:28:30.403 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:28:30.404 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:28:30.404 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:28:30.404 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:28:30.404 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:28:30.404 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:28:30.404 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:28:30.404 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:28:30.404 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:28:30.404 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:28:30.404 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:28:30.404 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:28:30.404 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:28:30.405 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:28:30.405 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:28:30.405 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:28:30.405 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:28:30.405 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:28:30.405 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:28:30.405 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:28:30.405 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:28:30.405 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:28:30.405 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:28:30.405 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:28:30.405 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:28:30.406 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:28:30.406 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:28:30.406 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:28:30.406 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:28:30.406 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:28:30.406 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:28:30.406 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:28:30.406 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:28:30.406 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:28:30.406 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:28:30.406 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:28:30.406 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:28:30.406 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:28:30.406 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:28:30.407 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:28:30.407 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:28:30.407 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:28:30.407 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:28:30.407 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:28:30.407 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:28:30.407 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:28:30.407 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:28:30.407 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:28:30.407 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:28:30.407 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:28:30.407 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:28:30.408 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:28:30.408 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:28:30.408 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:28:30.408 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:28:30.408 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:28:30.408 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:28:30.408 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:28:30.408 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:28:30.408 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:28:30.408 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:28:30.408 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:28:30.408 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:28:30.408 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:28:30.408 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:28:30.409 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:28:30.409 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:28:30.409 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:28:30.409 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:28:30.409 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:28:30.409 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:28:30.409 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:28:30.409 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:28:30.409 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:28:30.409 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:28:30.409 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:28:30.409 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:28:30.410 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:28:30.410 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:28:30.410 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:28:30.410 INFO:tasks.workunit.client.0.smithi138.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:28:30.410 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER2_READDIR (6 ms) 2024-09-12T00:28:30.410 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:28:30.410 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:28:30.410 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:28:30.410 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:28:30.410 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:28:30.410 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:28:30.410 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:28:30.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:28:30.404+0000 7f5a35936a80 -1 shutting down 2024-09-12T00:28:30.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:28:30.408+0000 7f590f688640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62133, si_uid : 1000, si_addr0x3e80000f2b5, si_status0 2024-09-12T00:29:00.678 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (30275 ms) 2024-09-12T00:29:00.678 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 11 tests from LibRGW (30601 ms total) 2024-09-12T00:29:00.678 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:29:00.678 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:29:00.678 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 11 tests from 1 test suite ran. (30601 ms total) 2024-09-12T00:29:00.678 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 11 tests. 2024-09-12T00:29:00.691 INFO:tasks.workunit.client.0.smithi138.stdout:phase 5.1 2024-09-12T00:29:00.726 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:29:00.726 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:29:00.726 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:29:00.726 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:29:00.738 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:00.738 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:01.063 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (337 ms) 2024-09-12T00:29:01.063 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:29:01.064 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:29:01.064 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:29:01.081 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKET (17 ms) 2024-09-12T00:29:01.081 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:29:01.087 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T00:29:01.087 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:29:01.087 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:29:01.087 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:29:01.090 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T00:29:01.090 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:29:01.090 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:29:01.090 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:29:01.099 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.PUT_OBJECT (9 ms) 2024-09-12T00:29:01.099 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:29:01.102 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-09-12T00:29:01.102 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:29:01.102 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:29:01.102 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:29:01.102 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:29:01.102 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:29:01.102 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:29:01.102 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:29:01.102 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:29:01.103 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:29:01.103 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:29:01.103 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:29:01.103 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:29:01.103 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:29:01.103 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:29:01.103 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:29:01.103 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:29:01.103 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:29:01.103 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:29:01.104 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:29:01.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:29:01.103+0000 7ff94478ba80 -1 shutting down 2024-09-12T00:29:01.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:29:01.107+0000 7ff81e4dd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62778, si_uid : 1000, si_addr0x3e80000f53a, si_status0 2024-09-12T00:29:31.282 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (30180 ms) 2024-09-12T00:29:31.283 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 19 tests from LibRGW (30555 ms total) 2024-09-12T00:29:31.283 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:29:31.283 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:29:31.283 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 19 tests from 1 test suite ran. (30555 ms total) 2024-09-12T00:29:31.283 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 19 tests. 2024-09-12T00:29:31.296 INFO:tasks.workunit.client.0.smithi138.stdout:phase 5.2 2024-09-12T00:29:31.330 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:29:31.330 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:29:31.330 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:29:31.330 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:29:31.339 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:31.339 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:31.893 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (563 ms) 2024-09-12T00:29:31.894 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:29:31.895 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:29:31.895 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:29:31.895 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:29:31.895 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:29:31.903 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (8 ms) 2024-09-12T00:29:31.903 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:29:31.903 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:29:31.903 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:29:31.903 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T00:29:31.903 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:29:31.903 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:29:31.903 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:29:31.903 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T00:29:31.904 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:29:31.904 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T00:29:31.904 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:29:31.904 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:29:31.904 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:29:31.904 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:29:31.904 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:29:31.904 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:29:31.904 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:29:31.904 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:29:31.904 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:29:31.904 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:29:31.904 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:29:31.912 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_OBJECT (9 ms) 2024-09-12T00:29:31.912 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:29:31.962 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.DELETE_BUCKET (50 ms) 2024-09-12T00:29:31.962 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:29:31.962 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:29:31.962 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:29:31.963 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:29:31.963 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:29:31.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:29:31.966+0000 7f03bb226a80 -1 shutting down 2024-09-12T00:29:31.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:29:31.970+0000 7f0294f78640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63423, si_uid : 1000, si_addr0x3e80000f7bf, si_status0 2024-09-12T00:30:02.041 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (30078 ms) 2024-09-12T00:30:02.042 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 19 tests from LibRGW (30710 ms total) 2024-09-12T00:30:02.042 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:30:02.042 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:30:02.042 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 19 tests from 1 test suite ran. (30710 ms total) 2024-09-12T00:30:02.042 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 19 tests. 2024-09-12T00:30:02.049 INFO:tasks.workunit.client.0.smithi138.stdout:phase 6.1 2024-09-12T00:30:02.073 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:30:02.073 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment set-up. 2024-09-12T00:30:02.073 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 10 tests from LibRGW 2024-09-12T00:30:02.074 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:30:02.082 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:02.082 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:02.620 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.INIT (547 ms) 2024-09-12T00:30:02.620 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:30:02.621 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:30:02.621 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T00:30:02.649 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CREATE_BUCKETS (28 ms) 2024-09-12T00:30:02.649 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T00:30:02.657 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (8 ms) 2024-09-12T00:30:02.657 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T00:30:02.689 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.TOPDIR_RENAME (32 ms) 2024-09-12T00:30:02.689 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T00:30:02.730 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SUBDIR_RENAME (41 ms) 2024-09-12T00:30:02.730 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T00:30:02.772 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (42 ms) 2024-09-12T00:30:02.773 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:30:02.773 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:30:02.773 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:30:02.773 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:30:02.773 INFO:tasks.workunit.client.0.smithi138.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:30:02.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:02.777+0000 7fefc39d1a80 -1 shutting down 2024-09-12T00:30:02.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:02.777+0000 7fee9d723640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64068, si_uid : 1000, si_addr0x3e80000fa44, si_status0 2024-09-12T00:30:32.801 INFO:tasks.workunit.client.0.smithi138.stdout:[ OK ] LibRGW.SHUTDOWN (30028 ms) 2024-09-12T00:30:32.801 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] 10 tests from LibRGW (30727 ms total) 2024-09-12T00:30:32.801 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:30:32.801 INFO:tasks.workunit.client.0.smithi138.stdout:[----------] Global test environment tear-down 2024-09-12T00:30:32.801 INFO:tasks.workunit.client.0.smithi138.stdout:[==========] 10 tests from 1 test suite ran. (30727 ms total) 2024-09-12T00:30:32.801 INFO:tasks.workunit.client.0.smithi138.stdout:[ PASSED ] 10 tests. 2024-09-12T00:30:32.818 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:30:32.819 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:30:32.834 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T00:30:32.835 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T00:30:32.835 DEBUG:teuthology.orchestra.run.smithi138:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T00:30:32.884 INFO:tasks.workunit.client.0.smithi138.stderr:+ [ -z ] 2024-09-12T00:30:32.884 INFO:tasks.workunit.client.0.smithi138.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:30:32.884 INFO:tasks.workunit.client.0.smithi138.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:30:32.884 INFO:tasks.workunit.client.0.smithi138.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-12T00:30:32.924 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:32.925 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:32.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.972+0000 7f08585b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.976+0000 7f08585b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.976+0000 7f08585b59c0 20 realm 2024-09-12T00:30:32.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.976+0000 7f08585b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.976+0000 7f08585b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.976+0000 7f08585b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:32.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.976+0000 7f08585b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.976+0000 7f08585b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.976+0000 7f08585b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.976+0000 7f08585b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:32.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.976+0000 7f08585b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.976+0000 7f08585b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:32.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.976+0000 7f08585b59c0 20 searching for the correct realm 2024-09-12T00:30:32.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.984+0000 7f08568bc640 0 -- 172.21.15.138:0/1009916368 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55ac6c6fee20 msgr2=0x55ac6c7012e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:32.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.988+0000 7f08558ba640 0 -- 172.21.15.138:0/1009916368 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55ac6c6fa0e0 msgr2=0x55ac6c6fc4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:32.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:30:32.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:32.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:30:32.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:32.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:32.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:32.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:32.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:32.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 20 zone default found 2024-09-12T00:30:32.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 4 Realm: () 2024-09-12T00:30:32.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:30:32.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:30:32.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:32.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 20 zonegroup default 2024-09-12T00:30:32.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:32.996+0000 7f08585b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.000+0000 7f08585b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.000+0000 7f08585b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:32.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.000+0000 7f08585b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:32.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.000+0000 7f08585b59c0 20 started sync module instance, tier type = 2024-09-12T00:30:32.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.000+0000 7f08585b59c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:30:33.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.016+0000 7f08585b59c0 20 add_watcher() i=0 2024-09-12T00:30:33.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.016+0000 7f08585b59c0 20 add_watcher() i=1 2024-09-12T00:30:33.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.016+0000 7f08585b59c0 20 add_watcher() i=2 2024-09-12T00:30:33.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.016+0000 7f08585b59c0 20 add_watcher() i=3 2024-09-12T00:30:33.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.016+0000 7f08585b59c0 20 add_watcher() i=4 2024-09-12T00:30:33.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.016+0000 7f08585b59c0 20 add_watcher() i=5 2024-09-12T00:30:33.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.016+0000 7f08585b59c0 20 add_watcher() i=6 2024-09-12T00:30:33.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.020+0000 7f08585b59c0 20 add_watcher() i=7 2024-09-12T00:30:33.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.020+0000 7f08585b59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:33.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f070cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:33.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f08585b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:33.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f08585b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:33.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f08585b59c0 5 note: GC not initialized 2024-09-12T00:30:33.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f06877fe640 20 reqs_thread_entry: start 2024-09-12T00:30:33.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f08585b59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:33.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f08585b59c0 20 Filter name: none 2024-09-12T00:30:33.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f06857fa640 20 reqs_thread_entry: start 2024-09-12T00:30:33.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f08585b59c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T00:30:33.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f08585b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f08585b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f08585b59c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T00:30:33.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f08585b59c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:30:33.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f08585b59c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T00:30:33.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f08585b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f08585b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f08585b59c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T00:30:33.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f08585b59c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:30:33.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f08585b59c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T00:30:33.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.024+0000 7f08585b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:33.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.028+0000 7f08585b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:33.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.028+0000 7f08585b59c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T00:30:33.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.028+0000 7f08585b59c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:30:33.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.028+0000 7f08585b59c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:30:33.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.028+0000 7f08585b59c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:30:33.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.028+0000 7f08585b59c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:30:33.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.028+0000 7f08585b59c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:30:33.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.028+0000 7f08585b59c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T00:30:33.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.032+0000 7f0739ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627839 cookie 94199042032384 notifier 5823 bl.length()=677 2024-09-12T00:30:33.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.032+0000 7f0739ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:30:33.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.032+0000 7f0739ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:30:33.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.032+0000 7f08585b59c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:30:33.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.032+0000 7f08585b59c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:30:33.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.032+0000 7f08585b59c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T00:30:33.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.036+0000 7f0739ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627784 cookie 94199041996368 notifier 5823 bl.length()=187 2024-09-12T00:30:33.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.036+0000 7f0739ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:30:33.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.036+0000 7f0739ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:30:33.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.036+0000 7f08585b59c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:30:33.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.036+0000 7f08585b59c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:30:33.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.036+0000 7f08585b59c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T00:30:33.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.036+0000 7f07397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627785 cookie 94199041996368 notifier 5823 bl.length()=197 2024-09-12T00:30:33.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.036+0000 7f07397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:30:33.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.036+0000 7f07397fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:30:33.036 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:30:33.036 INFO:tasks.workunit.client.0.smithi138.stdout: "user_id": "ceph-test-maven", 2024-09-12T00:30:33.036 INFO:tasks.workunit.client.0.smithi138.stdout: "display_name": "maven test user", 2024-09-12T00:30:33.036 INFO:tasks.workunit.client.0.smithi138.stdout: "email": "sigv4@example.com", 2024-09-12T00:30:33.036 INFO:tasks.workunit.client.0.smithi138.stdout: "suspended": 0, 2024-09-12T00:30:33.036 INFO:tasks.workunit.client.0.smithi138.stdout: "max_buckets": 1000, 2024-09-12T00:30:33.036 INFO:tasks.workunit.client.0.smithi138.stdout: "subusers": [], 2024-09-12T00:30:33.036 INFO:tasks.workunit.client.0.smithi138.stdout: "keys": [ 2024-09-12T00:30:33.036 INFO:tasks.workunit.client.0.smithi138.stdout: { 2024-09-12T00:30:33.036 INFO:tasks.workunit.client.0.smithi138.stdout: "user": "ceph-test-maven", 2024-09-12T00:30:33.036 INFO:tasks.workunit.client.0.smithi138.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T00:30:33.037 INFO:tasks.workunit.client.0.smithi138.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T00:30:33.037 INFO:tasks.workunit.client.0.smithi138.stdout: "active": true, 2024-09-12T00:30:33.037 INFO:tasks.workunit.client.0.smithi138.stdout: "create_date": "2024-09-12T00:30:33.031386Z" 2024-09-12T00:30:33.037 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:30:33.037 INFO:tasks.workunit.client.0.smithi138.stdout: ], 2024-09-12T00:30:33.037 INFO:tasks.workunit.client.0.smithi138.stdout: "swift_keys": [], 2024-09-12T00:30:33.037 INFO:tasks.workunit.client.0.smithi138.stdout: "caps": [], 2024-09-12T00:30:33.037 INFO:tasks.workunit.client.0.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-12T00:30:33.037 INFO:tasks.workunit.client.0.smithi138.stdout: "default_placement": "", 2024-09-12T00:30:33.037 INFO:tasks.workunit.client.0.smithi138.stdout: "default_storage_class": "", 2024-09-12T00:30:33.037 INFO:tasks.workunit.client.0.smithi138.stdout: "placement_tags": [], 2024-09-12T00:30:33.038 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_quota": { 2024-09-12T00:30:33.038 INFO:tasks.workunit.client.0.smithi138.stdout: "enabled": false, 2024-09-12T00:30:33.038 INFO:tasks.workunit.client.0.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:30:33.038 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size": -1, 2024-09-12T00:30:33.038 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:30:33.038 INFO:tasks.workunit.client.0.smithi138.stdout: "max_objects": -1 2024-09-12T00:30:33.038 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:30:33.038 INFO:tasks.workunit.client.0.smithi138.stdout: "user_quota": { 2024-09-12T00:30:33.038 INFO:tasks.workunit.client.0.smithi138.stdout: "enabled": false, 2024-09-12T00:30:33.038 INFO:tasks.workunit.client.0.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:30:33.038 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size": -1, 2024-09-12T00:30:33.038 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:30:33.038 INFO:tasks.workunit.client.0.smithi138.stdout: "max_objects": -1 2024-09-12T00:30:33.038 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:30:33.039 INFO:tasks.workunit.client.0.smithi138.stdout: "temp_url_keys": [], 2024-09-12T00:30:33.039 INFO:tasks.workunit.client.0.smithi138.stdout: "type": "rgw", 2024-09-12T00:30:33.039 INFO:tasks.workunit.client.0.smithi138.stdout: "mfa_ids": [], 2024-09-12T00:30:33.039 INFO:tasks.workunit.client.0.smithi138.stdout: "account_id": "", 2024-09-12T00:30:33.039 INFO:tasks.workunit.client.0.smithi138.stdout: "path": "/", 2024-09-12T00:30:33.039 INFO:tasks.workunit.client.0.smithi138.stdout: "create_date": "2024-09-12T00:30:33.031343Z", 2024-09-12T00:30:33.039 INFO:tasks.workunit.client.0.smithi138.stdout: "tags": [], 2024-09-12T00:30:33.039 INFO:tasks.workunit.client.0.smithi138.stdout: "group_ids": [] 2024-09-12T00:30:33.039 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:30:33.039 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:30:33.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.040+0000 7f070cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:33.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.044+0000 7f08585b59c0 20 remove_watcher() i=0 2024-09-12T00:30:33.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.044+0000 7f08585b59c0 2 removed watcher, disabling cache 2024-09-12T00:30:33.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.044+0000 7f08585b59c0 20 remove_watcher() i=1 2024-09-12T00:30:33.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.048+0000 7f08585b59c0 20 remove_watcher() i=2 2024-09-12T00:30:33.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.048+0000 7f08585b59c0 20 remove_watcher() i=3 2024-09-12T00:30:33.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.052+0000 7f08585b59c0 20 remove_watcher() i=4 2024-09-12T00:30:33.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.052+0000 7f08585b59c0 20 remove_watcher() i=5 2024-09-12T00:30:33.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.056+0000 7f08585b59c0 20 remove_watcher() i=6 2024-09-12T00:30:33.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:30:33.060+0000 7f08585b59c0 20 remove_watcher() i=7 2024-09-12T00:30:33.074 INFO:tasks.workunit.client.0.smithi138.stderr:+ [ -z ] 2024-09-12T00:30:33.074 INFO:tasks.workunit.client.0.smithi138.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-12T00:30:33.075 INFO:tasks.workunit.client.0.smithi138.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-12T00:30:33.096 INFO:tasks.workunit.client.0.smithi138.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi138.front.sepia.ceph.com:443 2024-09-12T00:30:33.096 INFO:tasks.workunit.client.0.smithi138.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-12T00:30:33.096 INFO:tasks.workunit.client.0.smithi138.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T00:30:33.096 INFO:tasks.workunit.client.0.smithi138.stderr:+ ./mvnw clean package 2024-09-12T00:30:33.103 INFO:tasks.workunit.client.0.smithi138.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:30:35.765 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Scanning for projects... 2024-09-12T00:30:35.901 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T00:30:36.005 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 52 kB/s) 2024-09-12T00:30:36.046 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T00:30:36.081 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 32/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.4 MB/s) 2024-09-12T00:30:36.091 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T00:30:36.111 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 64/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.8 MB/s) 2024-09-12T00:30:36.144 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:30:36.144 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:30:36.144 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:30:36.144 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] from pom.xml 2024-09-12T00:30:36.144 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:30:36.148 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T00:30:36.165 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 312 kB/s) 2024-09-12T00:30:36.172 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T00:30:36.187 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-09-12T00:30:36.191 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T00:30:36.208 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.7 MB/s) 2024-09-12T00:30:36.214 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T00:30:36.231 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.1 MB/s) 2024-09-12T00:30:36.245 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T00:30:36.263 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.0 MB/s) 2024-09-12T00:30:36.272 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T00:30:36.290 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 429 kB/s) 2024-09-12T00:30:36.293 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T00:30:36.311 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 450 kB/s) 2024-09-12T00:30:36.314 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T00:30:36.331 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.0 MB/s) 2024-09-12T00:30:36.336 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T00:30:36.352 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.3 MB/s) 2024-09-12T00:30:36.363 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T00:30:36.376 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.9 MB/s) 2024-09-12T00:30:36.382 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T00:30:36.412 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 338 kB/s) 2024-09-12T00:30:36.420 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T00:30:36.438 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.6 MB/s) 2024-09-12T00:30:36.446 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T00:30:36.462 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 313 kB/s) 2024-09-12T00:30:36.466 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T00:30:36.484 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.2 MB/s) 2024-09-12T00:30:36.488 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T00:30:36.505 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.9 MB/s) 2024-09-12T00:30:36.511 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T00:30:36.527 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.4 MB/s) 2024-09-12T00:30:36.536 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T00:30:36.554 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 296 kB/s) 2024-09-12T00:30:36.561 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T00:30:36.580 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.2 MB/s) 2024-09-12T00:30:36.590 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T00:30:36.608 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 376 kB/s) 2024-09-12T00:30:36.613 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T00:30:36.633 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 495 kB/s) 2024-09-12T00:30:36.637 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T00:30:36.654 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/46 kB Progress (1): 32/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.5 MB/s) 2024-09-12T00:30:36.660 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T00:30:36.678 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.1 MB/s) 2024-09-12T00:30:36.687 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T00:30:36.706 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.5 MB/s) 2024-09-12T00:30:36.734 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T00:30:36.751 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 338 kB/s) 2024-09-12T00:30:36.756 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T00:30:36.776 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.0 MB/s) 2024-09-12T00:30:36.786 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T00:30:36.803 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-09-12T00:30:36.817 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T00:30:36.837 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 200 kB/s) 2024-09-12T00:30:36.841 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T00:30:36.858 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 91 kB/s) 2024-09-12T00:30:36.861 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T00:30:36.878 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 131 kB/s) 2024-09-12T00:30:36.886 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T00:30:36.904 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 202 kB/s) 2024-09-12T00:30:36.912 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T00:30:36.930 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 179 kB/s) 2024-09-12T00:30:36.938 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T00:30:36.955 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 609 kB/s) 2024-09-12T00:30:36.963 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T00:30:36.981 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 94 kB/s) 2024-09-12T00:30:36.987 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T00:30:37.007 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 191 kB/s) 2024-09-12T00:30:37.013 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T00:30:37.029 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 307 kB/s) 2024-09-12T00:30:37.036 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T00:30:37.053 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 68 kB/s) 2024-09-12T00:30:37.058 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T00:30:37.075 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 240 kB/s) 2024-09-12T00:30:37.078 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T00:30:37.094 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 863 kB/s) 2024-09-12T00:30:37.099 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T00:30:37.116 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 216 kB/s) 2024-09-12T00:30:37.123 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T00:30:37.140 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 144 kB/s) 2024-09-12T00:30:37.147 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T00:30:37.163 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 171 kB/s) 2024-09-12T00:30:37.171 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T00:30:37.189 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 412 kB/s) 2024-09-12T00:30:37.202 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T00:30:37.223 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 273 kB/s) 2024-09-12T00:30:37.233 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T00:30:37.251 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 194 kB/s) 2024-09-12T00:30:37.263 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T00:30:37.285 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 200 kB/s) 2024-09-12T00:30:37.292 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T00:30:37.313 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 115 kB/s) 2024-09-12T00:30:37.325 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T00:30:37.339 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 358 kB/s) 2024-09-12T00:30:37.344 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T00:30:37.360 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 379 kB/s) 2024-09-12T00:30:37.366 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T00:30:37.383 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 175 kB/s) 2024-09-12T00:30:37.388 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T00:30:37.408 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 174 kB/s) 2024-09-12T00:30:37.413 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T00:30:37.430 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 240 kB/s) 2024-09-12T00:30:37.432 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T00:30:37.452 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 89 kB/s) 2024-09-12T00:30:37.457 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T00:30:37.475 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 389 kB/s) 2024-09-12T00:30:37.481 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T00:30:37.498 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 910 kB/s) 2024-09-12T00:30:37.506 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T00:30:37.527 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.7 MB/s) 2024-09-12T00:30:37.538 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T00:30:37.556 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 950 kB/s) 2024-09-12T00:30:37.565 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T00:30:37.582 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 292 kB/s) 2024-09-12T00:30:37.586 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T00:30:37.602 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 823 kB/s) 2024-09-12T00:30:37.609 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T00:30:37.626 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 822 kB/s) 2024-09-12T00:30:37.630 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T00:30:37.648 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/68 kB Progress (1): 32/68 kB Progress (1): 49/68 kB Progress (1): 65/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.8 MB/s) 2024-09-12T00:30:37.735 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T00:30:37.751 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 922 kB/s) 2024-09-12T00:30:37.758 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T00:30:37.776 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 858 kB/s) 2024-09-12T00:30:37.781 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T00:30:37.801 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.0 MB/s) 2024-09-12T00:30:37.812 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T00:30:37.831 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.0 MB/s) 2024-09-12T00:30:37.845 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T00:30:37.866 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 951 kB/s) 2024-09-12T00:30:37.874 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T00:30:37.897 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15/78 kB Progress (1): 31/78 kB Progress (1): 48/78 kB Progress (1): 64/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.4 MB/s) 2024-09-12T00:30:37.917 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T00:30:37.937 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 213 kB/s) 2024-09-12T00:30:37.940 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T00:30:37.957 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 812 kB/s) 2024-09-12T00:30:37.964 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T00:30:37.981 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 189 kB/s) 2024-09-12T00:30:37.987 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T00:30:38.006 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 168 kB/s) 2024-09-12T00:30:38.012 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T00:30:38.033 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 92 kB/s) 2024-09-12T00:30:38.038 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T00:30:38.057 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 149 kB/s) 2024-09-12T00:30:38.062 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T00:30:38.079 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 90 kB/s) 2024-09-12T00:30:38.084 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T00:30:38.103 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 158 kB/s) 2024-09-12T00:30:38.109 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T00:30:38.126 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 188 kB/s) 2024-09-12T00:30:38.132 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T00:30:38.149 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 189 kB/s) 2024-09-12T00:30:38.159 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T00:30:38.176 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 60 kB/s) 2024-09-12T00:30:38.185 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T00:30:38.207 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 42 kB/s) 2024-09-12T00:30:38.214 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T00:30:38.231 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 180 kB/s) 2024-09-12T00:30:38.237 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T00:30:38.256 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 152 kB/s) 2024-09-12T00:30:38.261 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T00:30:38.280 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 191 kB/s) 2024-09-12T00:30:38.285 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T00:30:38.304 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 181 kB/s) 2024-09-12T00:30:38.309 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T00:30:38.328 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 159 kB/s) 2024-09-12T00:30:38.383 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T00:30:38.502 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 27 MB/s) 2024-09-12T00:30:38.505 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T00:30:38.505 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T00:30:38.505 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T00:30:38.505 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T00:30:38.506 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T00:30:38.530 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 1.4 MB/s) 2024-09-12T00:30:38.530 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T00:30:38.545 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 401 kB/s) 2024-09-12T00:30:38.545 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T00:30:38.562 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/16 kB Progress (1): 2.8/16 kB Progress (1): 4.1/16 kB Progress (1): 5.5/16 kB Progress (1): 6.9/16 kB Progress (1): 8.3/16 kB Progress (1): 9.7/16 kB Progress (1): 11/16 kB Progress (2): 11/16 kB | 1.4/49 kB Progress (2): 12/16 kB | 1.4/49 kB Progress (2): 12/16 kB | 2.8/49 kB Progress (2): 14/16 kB | 2.8/49 kB Progress (3): 14/16 kB | 2.8/49 kB | 16/782 kB Progress (3): 15/16 kB | 2.8/49 kB | 16/782 kB Progress (3): 15/16 kB | 4.1/49 kB | 16/782 kB Progress (3): 15/16 kB | 4.1/49 kB | 33/782 kB Progress (3): 16 kB | 4.1/49 kB | 33/782 kB Progress (3): 16 kB | 5.5/49 kB | 33/782 kB Progress (3): 16 kB | 5.5/49 kB | 49/782 kB Progress (3): 16 kB | 6.9/49 kB | 49/782 kB Progress (3): 16 kB | 6.9/49 kB | 65/782 kB Progress (3): 16 kB | 8.3/49 kB | 65/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 277 kB/s) 2024-09-12T00:30:38.562 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 8.3/49 kB | 82/782 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T00:30:38.575 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 9.7/49 kB | 82/782 kB Progress (2): 9.7/49 kB | 98/782 kB Progress (2): 11/49 kB | 98/782 kB Progress (2): 11/49 kB | 115/782 kB Progress (2): 12/49 kB | 115/782 kB Progress (2): 12/49 kB | 131/782 kB Progress (2): 14/49 kB | 131/782 kB Progress (2): 14/49 kB | 147/782 kB Progress (2): 15/49 kB | 147/782 kB Progress (2): 15/49 kB | 164/782 kB Progress (2): 16/49 kB | 164/782 kB Progress (2): 16/49 kB | 180/782 kB Progress (2): 18/49 kB | 180/782 kB Progress (2): 18/49 kB | 197/782 kB Progress (2): 19/49 kB | 197/782 kB Progress (2): 19/49 kB | 213/782 kB Progress (2): 21/49 kB | 213/782 kB Progress (2): 21/49 kB | 229/782 kB Progress (2): 22/49 kB | 229/782 kB Progress (2): 22/49 kB | 246/782 kB Progress (2): 23/49 kB | 246/782 kB Progress (2): 23/49 kB | 262/782 kB Progress (2): 25/49 kB | 262/782 kB Progress (2): 25/49 kB | 278/782 kB Progress (2): 26/49 kB | 278/782 kB Progress (2): 26/49 kB | 295/782 kB Progress (2): 27/49 kB | 295/782 kB Progress (2): 27/49 kB | 311/782 kB Progress (2): 29/49 kB | 311/782 kB Progress (2): 29/49 kB | 328/782 kB Progress (2): 30/49 kB | 328/782 kB Progress (2): 30/49 kB | 344/782 kB Progress (2): 32/49 kB | 344/782 kB Progress (2): 32/49 kB | 360/782 kB Progress (2): 33/49 kB | 360/782 kB Progress (2): 34/49 kB | 360/782 kB Progress (2): 34/49 kB | 377/782 kB Progress (2): 36/49 kB | 377/782 kB Progress (3): 36/49 kB | 377/782 kB | 1.4/71 kB Progress (3): 36/49 kB | 393/782 kB | 1.4/71 kB Progress (3): 37/49 kB | 393/782 kB | 1.4/71 kB Progress (3): 37/49 kB | 393/782 kB | 2.8/71 kB Progress (3): 37/49 kB | 410/782 kB | 2.8/71 kB Progress (3): 38/49 kB | 410/782 kB | 2.8/71 kB Progress (3): 38/49 kB | 410/782 kB | 4.1/71 kB Progress (3): 38/49 kB | 426/782 kB | 4.1/71 kB Progress (3): 38/49 kB | 426/782 kB | 5.5/71 kB Progress (3): 38/49 kB | 426/782 kB | 6.9/71 kB Progress (3): 38/49 kB | 442/782 kB | 6.9/71 kB Progress (3): 38/49 kB | 442/782 kB | 8.3/71 kB Progress (3): 38/49 kB | 442/782 kB | 9.7/71 kB Progress (3): 38/49 kB | 459/782 kB | 9.7/71 kB Progress (3): 38/49 kB | 459/782 kB | 11/71 kB Progress (3): 38/49 kB | 459/782 kB | 12/71 kB Progress (3): 38/49 kB | 475/782 kB | 12/71 kB Progress (3): 38/49 kB | 475/782 kB | 14/71 kB Progress (3): 38/49 kB | 475/782 kB | 15/71 kB Progress (3): 38/49 kB | 491/782 kB | 15/71 kB Progress (3): 38/49 kB | 491/782 kB | 17/71 kB Progress (3): 38/49 kB | 491/782 kB | 18/71 kB Progress (3): 38/49 kB | 491/782 kB | 19/71 kB Progress (3): 38/49 kB | 491/782 kB | 21/71 kB Progress (3): 38/49 kB | 508/782 kB | 21/71 kB Progress (3): 38/49 kB | 508/782 kB | 22/71 kB Progress (3): 38/49 kB | 508/782 kB | 23/71 kB Progress (3): 38/49 kB | 508/782 kB | 25/71 kB Progress (3): 38/49 kB | 508/782 kB | 26/71 kB Progress (3): 38/49 kB | 524/782 kB | 26/71 kB Progress (3): 40/49 kB | 524/782 kB | 26/71 kB Progress (3): 41/49 kB | 524/782 kB | 26/71 kB Progress (3): 42/49 kB | 524/782 kB | 26/71 kB Progress (3): 42/49 kB | 541/782 kB | 26/71 kB Progress (3): 44/49 kB | 541/782 kB | 26/71 kB Progress (3): 44/49 kB | 541/782 kB | 28/71 kB Progress (3): 45/49 kB | 541/782 kB | 28/71 kB Progress (4): 45/49 kB | 541/782 kB | 28/71 kB | 1.4/98 kB Progress (4): 47/49 kB | 541/782 kB | 28/71 kB | 1.4/98 kB Progress (4): 47/49 kB | 541/782 kB | 29/71 kB | 1.4/98 kB Progress (4): 47/49 kB | 541/782 kB | 29/71 kB | 2.8/98 kB Progress (4): 47/49 kB | 557/782 kB | 29/71 kB | 2.8/98 kB Progress (4): 47/49 kB | 557/782 kB | 30/71 kB | 2.8/98 kB Progress (4): 47/49 kB | 557/782 kB | 30/71 kB | 4.1/98 kB Progress (4): 48/49 kB | 557/782 kB | 30/71 kB | 4.1/98 kB Progress (4): 48/49 kB | 557/782 kB | 32/71 kB | 4.1/98 kB Progress (4): 48/49 kB | 557/782 kB | 32/71 kB | 5.5/98 kB Progress (4): 49 kB | 557/782 kB | 32/71 kB | 5.5/98 kB Progress (4): 49 kB | 573/782 kB | 32/71 kB | 5.5/98 kB Progress (4): 49 kB | 573/782 kB | 33/71 kB | 5.5/98 kB Progress (4): 49 kB | 573/782 kB | 33/71 kB | 6.9/98 kB Progress (4): 49 kB | 573/782 kB | 34/71 kB | 6.9/98 kB Progress (4): 49 kB | 573/782 kB | 34/71 kB | 8.3/98 kB Progress (4): 49 kB | 573/782 kB | 36/71 kB | 8.3/98 kB Progress (4): 49 kB | 590/782 kB | 36/71 kB | 8.3/98 kB Progress (4): 49 kB | 590/782 kB | 37/71 kB | 8.3/98 kB Progress (4): 49 kB | 590/782 kB | 37/71 kB | 9.7/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 714 kB/s) 2024-09-12T00:30:38.575 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (3): 590/782 kB | 39/71 kB | 9.7/98 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T00:30:38.582 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (3): 590/782 kB | 39/71 kB | 11/98 kB Progress (3): 606/782 kB | 39/71 kB | 11/98 kB Progress (3): 606/782 kB | 39/71 kB | 12/98 kB Progress (3): 606/782 kB | 39/71 kB | 14/98 kB Progress (3): 606/782 kB | 39/71 kB | 15/98 kB Progress (3): 623/782 kB | 39/71 kB | 15/98 kB Progress (3): 623/782 kB | 39/71 kB | 16/98 kB Progress (3): 639/782 kB | 39/71 kB | 16/98 kB Progress (3): 639/782 kB | 39/71 kB | 32/98 kB Progress (3): 655/782 kB | 39/71 kB | 32/98 kB Progress (3): 672/782 kB | 39/71 kB | 32/98 kB Progress (3): 688/782 kB | 39/71 kB | 32/98 kB Progress (3): 704/782 kB | 39/71 kB | 32/98 kB Progress (3): 721/782 kB | 39/71 kB | 32/98 kB Progress (3): 737/782 kB | 39/71 kB | 32/98 kB Progress (4): 737/782 kB | 39/71 kB | 32/98 kB | 1.4/11 kB Progress (4): 754/782 kB | 39/71 kB | 32/98 kB | 1.4/11 kB Progress (4): 754/782 kB | 39/71 kB | 32/98 kB | 2.8/11 kB Progress (4): 770/782 kB | 39/71 kB | 32/98 kB | 2.8/11 kB Progress (4): 770/782 kB | 39/71 kB | 32/98 kB | 4.1/11 kB Progress (4): 770/782 kB | 39/71 kB | 32/98 kB | 5.5/11 kB Progress (4): 770/782 kB | 39/71 kB | 32/98 kB | 6.9/11 kB Progress (4): 782 kB | 39/71 kB | 32/98 kB | 6.9/11 kB Progress (4): 782 kB | 40/71 kB | 32/98 kB | 6.9/11 kB Progress (4): 782 kB | 41/71 kB | 32/98 kB | 6.9/11 kB Progress (4): 782 kB | 43/71 kB | 32/98 kB | 6.9/11 kB Progress (4): 782 kB | 43/71 kB | 32/98 kB | 8.3/11 kB Progress (4): 782 kB | 44/71 kB | 32/98 kB | 8.3/11 kB Progress (4): 782 kB | 44/71 kB | 32/98 kB | 9.7/11 kB Progress (4): 782 kB | 46/71 kB | 32/98 kB | 9.7/11 kB Progress (4): 782 kB | 46/71 kB | 32/98 kB | 11/11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 11 MB/s) 2024-09-12T00:30:38.582 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (3): 46/71 kB | 32/98 kB | 11 kB Progress (3): 47/71 kB | 32/98 kB | 11 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T00:30:38.582 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (3): 48/71 kB | 32/98 kB | 11 kB Progress (3): 50/71 kB | 32/98 kB | 11 kB Progress (3): 51/71 kB | 32/98 kB | 11 kB Progress (3): 52/71 kB | 32/98 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 154 kB/s) 2024-09-12T00:30:38.582 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 54/71 kB | 32/98 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T00:30:38.583 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 55/71 kB | 32/98 kB Progress (2): 57/71 kB | 32/98 kB Progress (2): 58/71 kB | 32/98 kB Progress (2): 59/71 kB | 32/98 kB Progress (2): 61/71 kB | 32/98 kB Progress (2): 62/71 kB | 32/98 kB Progress (2): 63/71 kB | 32/98 kB Progress (2): 63/71 kB | 32/98 kB Progress (2): 71 kB | 32/98 kB Progress (2): 71 kB | 49/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 893 kB/s) 2024-09-12T00:30:38.583 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T00:30:38.596 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 65/98 kB Progress (1): 81/98 kB Progress (2): 81/98 kB | 16/205 kB Progress (2): 81/98 kB | 33/205 kB Progress (2): 81/98 kB | 49/205 kB Progress (2): 98/98 kB | 49/205 kB Progress (2): 98 kB | 49/205 kB Progress (2): 98 kB | 64/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.0 MB/s) 2024-09-12T00:30:38.596 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T00:30:38.601 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 64/205 kB | 1.4/30 kB Progress (2): 64/205 kB | 2.8/30 kB Progress (2): 64/205 kB | 4.1/30 kB Progress (2): 64/205 kB | 5.5/30 kB Progress (2): 64/205 kB | 6.9/30 kB Progress (3): 64/205 kB | 6.9/30 kB | 16/81 kB Progress (3): 64/205 kB | 8.3/30 kB | 16/81 kB Progress (3): 64/205 kB | 9.7/30 kB | 16/81 kB Progress (3): 64/205 kB | 11/30 kB | 16/81 kB Progress (3): 64/205 kB | 11/30 kB | 33/81 kB Progress (3): 64/205 kB | 12/30 kB | 33/81 kB Progress (3): 64/205 kB | 12/30 kB | 49/81 kB Progress (3): 64/205 kB | 14/30 kB | 49/81 kB Progress (3): 64/205 kB | 15/30 kB | 49/81 kB Progress (3): 64/205 kB | 16/30 kB | 49/81 kB Progress (3): 64/205 kB | 16/30 kB | 64/81 kB Progress (3): 64/205 kB | 18/30 kB | 64/81 kB Progress (3): 64/205 kB | 18/30 kB | 80/81 kB Progress (3): 64/205 kB | 19/30 kB | 80/81 kB Progress (3): 64/205 kB | 19/30 kB | 81 kB Progress (3): 64/205 kB | 21/30 kB | 81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 874 kB/s) 2024-09-12T00:30:38.601 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 64/205 kB | 22/30 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T00:30:38.603 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 64/205 kB | 23/30 kB Progress (3): 64/205 kB | 23/30 kB | 16/798 kB Progress (3): 64/205 kB | 25/30 kB | 16/798 kB Progress (3): 64/205 kB | 25/30 kB | 33/798 kB Progress (3): 64/205 kB | 26/30 kB | 33/798 kB Progress (3): 64/205 kB | 27/30 kB | 33/798 kB Progress (3): 64/205 kB | 29/30 kB | 33/798 kB Progress (3): 64/205 kB | 29/30 kB | 49/798 kB Progress (3): 64/205 kB | 30/30 kB | 49/798 kB Progress (3): 64/205 kB | 30 kB | 49/798 kB Progress (3): 64/205 kB | 30 kB | 66/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 318 kB/s) 2024-09-12T00:30:38.603 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T00:30:38.609 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 80/205 kB | 66/798 kB Progress (2): 80/205 kB | 78/798 kB Progress (2): 97/205 kB | 78/798 kB Progress (2): 113/205 kB | 78/798 kB Progress (2): 113/205 kB | 95/798 kB Progress (2): 113/205 kB | 111/798 kB Progress (2): 129/205 kB | 111/798 kB Progress (2): 146/205 kB | 111/798 kB Progress (2): 162/205 kB | 111/798 kB Progress (2): 179/205 kB | 111/798 kB Progress (2): 195/205 kB | 111/798 kB Progress (2): 205 kB | 111/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.0 MB/s) 2024-09-12T00:30:38.610 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T00:30:38.614 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 128/798 kB Progress (1): 144/798 kB Progress (2): 144/798 kB | 13 kB Progress (2): 160/798 kB | 13 kB Progress (2): 177/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 125 kB/s) 2024-09-12T00:30:38.614 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 193/798 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T00:30:38.623 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 209/798 kB Progress (1): 226/798 kB Progress (1): 242/798 kB Progress (1): 259/798 kB Progress (1): 275/798 kB Progress (1): 291/798 kB Progress (2): 291/798 kB | 16/151 kB Progress (3): 291/798 kB | 16/151 kB | 16/182 kB Progress (3): 308/798 kB | 16/151 kB | 16/182 kB Progress (3): 308/798 kB | 16/151 kB | 33/182 kB Progress (3): 324/798 kB | 16/151 kB | 33/182 kB Progress (3): 324/798 kB | 16/151 kB | 49/182 kB Progress (3): 341/798 kB | 16/151 kB | 49/182 kB Progress (3): 341/798 kB | 16/151 kB | 62/182 kB Progress (3): 341/798 kB | 33/151 kB | 62/182 kB Progress (3): 341/798 kB | 33/151 kB | 78/182 kB Progress (3): 341/798 kB | 33/151 kB | 94/182 kB Progress (3): 341/798 kB | 33/151 kB | 111/182 kB Progress (3): 341/798 kB | 33/151 kB | 127/182 kB Progress (3): 341/798 kB | 33/151 kB | 143/182 kB Progress (3): 341/798 kB | 49/151 kB | 143/182 kB Progress (3): 341/798 kB | 49/151 kB | 160/182 kB Progress (3): 341/798 kB | 49/151 kB | 176/182 kB Progress (3): 341/798 kB | 49/151 kB | 182 kB Progress (3): 341/798 kB | 62/151 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.6 MB/s) 2024-09-12T00:30:38.623 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T00:30:38.627 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 357/798 kB | 62/151 kB Progress (2): 373/798 kB | 62/151 kB Progress (2): 390/798 kB | 62/151 kB Progress (2): 406/798 kB | 62/151 kB Progress (2): 422/798 kB | 62/151 kB Progress (2): 439/798 kB | 62/151 kB Progress (2): 455/798 kB | 62/151 kB Progress (2): 472/798 kB | 62/151 kB Progress (2): 488/798 kB | 62/151 kB Progress (3): 488/798 kB | 62/151 kB | 16/27 kB Progress (3): 504/798 kB | 62/151 kB | 16/27 kB Progress (3): 504/798 kB | 62/151 kB | 27 kB Progress (3): 521/798 kB | 62/151 kB | 27 kB Progress (3): 537/798 kB | 62/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 229 kB/s) 2024-09-12T00:30:38.627 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T00:30:38.631 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 554/798 kB | 62/151 kB Progress (2): 570/798 kB | 62/151 kB Progress (2): 586/798 kB | 62/151 kB Progress (2): 603/798 kB | 62/151 kB Progress (2): 619/798 kB | 62/151 kB Progress (2): 635/798 kB | 62/151 kB Progress (3): 635/798 kB | 62/151 kB | 16/30 kB Progress (3): 652/798 kB | 62/151 kB | 16/30 kB Progress (3): 652/798 kB | 79/151 kB | 16/30 kB Progress (3): 652/798 kB | 79/151 kB | 30 kB Progress (3): 668/798 kB | 79/151 kB | 30 kB Progress (3): 685/798 kB | 79/151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 246 kB/s) 2024-09-12T00:30:38.631 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T00:30:38.635 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 701/798 kB | 79/151 kB Progress (2): 701/798 kB | 95/151 kB Progress (2): 717/798 kB | 95/151 kB Progress (2): 734/798 kB | 95/151 kB Progress (2): 750/798 kB | 95/151 kB Progress (2): 766/798 kB | 95/151 kB Progress (2): 766/798 kB | 111/151 kB Progress (2): 783/798 kB | 111/151 kB Progress (2): 783/798 kB | 128/151 kB Progress (2): 783/798 kB | 144/151 kB Progress (2): 783/798 kB | 151 kB Progress (2): 798 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.2 MB/s) 2024-09-12T00:30:38.635 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T00:30:38.635 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-09-12T00:30:38.635 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T00:30:38.642 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/385 kB Progress (1): 33/385 kB Progress (1): 49/385 kB Progress (1): 66/385 kB Progress (1): 82/385 kB Progress (1): 98/385 kB Progress (1): 115/385 kB Progress (1): 131/385 kB Progress (1): 147/385 kB Progress (1): 164/385 kB Progress (2): 164/385 kB | 13 kB Progress (2): 180/385 kB | 13 kB Progress (2): 196/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 98 kB/s) 2024-09-12T00:30:38.643 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T00:30:38.663 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 213/385 kB Progress (1): 229/385 kB Progress (1): 245/385 kB Progress (1): 262/385 kB Progress (1): 278/385 kB Progress (1): 295/385 kB Progress (1): 311/385 kB Progress (1): 327/385 kB Progress (1): 344/385 kB Progress (1): 360/385 kB Progress (1): 376/385 kB Progress (2): 376/385 kB | 16/780 kB Progress (2): 385 kB | 16/780 kB Progress (2): 385 kB | 33/780 kB Progress (2): 385 kB | 49/780 kB Progress (2): 385 kB | 65/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.5 MB/s) 2024-09-12T00:30:38.664 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T00:30:38.670 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 65/780 kB | 16/75 kB Progress (3): 65/780 kB | 16/75 kB | 16/501 kB Progress (3): 81/780 kB | 16/75 kB | 16/501 kB Progress (4): 81/780 kB | 16/75 kB | 16/501 kB | 16/329 kB Progress (4): 81/780 kB | 16/75 kB | 32/501 kB | 16/329 kB Progress (4): 81/780 kB | 33/75 kB | 32/501 kB | 16/329 kB Progress (4): 97/780 kB | 33/75 kB | 32/501 kB | 16/329 kB Progress (4): 97/780 kB | 33/75 kB | 32/501 kB | 33/329 kB Progress (4): 97/780 kB | 33/75 kB | 49/501 kB | 33/329 kB Progress (4): 97/780 kB | 49/75 kB | 49/501 kB | 33/329 kB Progress (4): 114/780 kB | 49/75 kB | 49/501 kB | 33/329 kB Progress (4): 114/780 kB | 49/75 kB | 49/501 kB | 49/329 kB Progress (4): 114/780 kB | 49/75 kB | 65/501 kB | 49/329 kB Progress (4): 114/780 kB | 61/75 kB | 65/501 kB | 49/329 kB Progress (4): 130/780 kB | 61/75 kB | 65/501 kB | 49/329 kB Progress (4): 130/780 kB | 61/75 kB | 65/501 kB | 66/329 kB Progress (4): 130/780 kB | 61/75 kB | 81/501 kB | 66/329 kB Progress (4): 130/780 kB | 75 kB | 81/501 kB | 66/329 kB Progress (4): 147/780 kB | 75 kB | 81/501 kB | 66/329 kB Progress (4): 147/780 kB | 75 kB | 81/501 kB | 82/329 kB Progress (4): 147/780 kB | 75 kB | 98/501 kB | 82/329 kB Progress (4): 163/780 kB | 75 kB | 98/501 kB | 82/329 kB Progress (4): 163/780 kB | 75 kB | 98/501 kB | 98/329 kB Progress (4): 163/780 kB | 75 kB | 114/501 kB | 98/329 kB Progress (4): 179/780 kB | 75 kB | 114/501 kB | 98/329 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 472 kB/s) 2024-09-12T00:30:38.670 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T00:30:38.674 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (3): 179/780 kB | 114/501 kB | 115/329 kB Progress (3): 179/780 kB | 130/501 kB | 115/329 kB Progress (3): 196/780 kB | 130/501 kB | 115/329 kB Progress (3): 196/780 kB | 130/501 kB | 131/329 kB Progress (3): 196/780 kB | 147/501 kB | 131/329 kB Progress (3): 212/780 kB | 147/501 kB | 131/329 kB Progress (3): 212/780 kB | 163/501 kB | 131/329 kB Progress (3): 212/780 kB | 163/501 kB | 147/329 kB Progress (3): 229/780 kB | 163/501 kB | 147/329 kB Progress (3): 229/780 kB | 180/501 kB | 147/329 kB Progress (3): 229/780 kB | 180/501 kB | 164/329 kB Progress (3): 229/780 kB | 196/501 kB | 164/329 kB Progress (3): 245/780 kB | 196/501 kB | 164/329 kB Progress (3): 245/780 kB | 212/501 kB | 164/329 kB Progress (3): 245/780 kB | 212/501 kB | 180/329 kB Progress (3): 261/780 kB | 212/501 kB | 180/329 kB Progress (3): 261/780 kB | 229/501 kB | 180/329 kB Progress (3): 261/780 kB | 229/501 kB | 191/329 kB Progress (3): 278/780 kB | 229/501 kB | 191/329 kB Progress (3): 278/780 kB | 245/501 kB | 191/329 kB Progress (3): 294/780 kB | 245/501 kB | 191/329 kB Progress (3): 294/780 kB | 262/501 kB | 191/329 kB Progress (3): 294/780 kB | 262/501 kB | 208/329 kB Progress (3): 310/780 kB | 262/501 kB | 208/329 kB Progress (3): 310/780 kB | 278/501 kB | 208/329 kB Progress (3): 327/780 kB | 278/501 kB | 208/329 kB Progress (3): 327/780 kB | 278/501 kB | 224/329 kB Progress (3): 327/780 kB | 294/501 kB | 224/329 kB Progress (3): 343/780 kB | 294/501 kB | 224/329 kB Progress (3): 343/780 kB | 311/501 kB | 224/329 kB Progress (3): 360/780 kB | 311/501 kB | 224/329 kB Progress (3): 360/780 kB | 311/501 kB | 240/329 kB Progress (3): 376/780 kB | 311/501 kB | 240/329 kB Progress (3): 376/780 kB | 311/501 kB | 257/329 kB Progress (3): 392/780 kB | 311/501 kB | 257/329 kB Progress (3): 409/780 kB | 311/501 kB | 257/329 kB Progress (3): 409/780 kB | 311/501 kB | 273/329 kB Progress (3): 425/780 kB | 311/501 kB | 273/329 kB Progress (3): 442/780 kB | 311/501 kB | 273/329 kB Progress (3): 442/780 kB | 311/501 kB | 290/329 kB Progress (3): 458/780 kB | 311/501 kB | 290/329 kB Progress (3): 474/780 kB | 311/501 kB | 290/329 kB Progress (3): 474/780 kB | 311/501 kB | 306/329 kB Progress (3): 474/780 kB | 311/501 kB | 310/329 kB Progress (3): 474/780 kB | 327/501 kB | 310/329 kB Progress (3): 491/780 kB | 327/501 kB | 310/329 kB Progress (3): 491/780 kB | 343/501 kB | 310/329 kB Progress (3): 507/780 kB | 343/501 kB | 310/329 kB Progress (3): 507/780 kB | 343/501 kB | 326/329 kB Progress (3): 507/780 kB | 343/501 kB | 329 kB Progress (3): 523/780 kB | 343/501 kB | 329 kB Progress (3): 523/780 kB | 360/501 kB | 329 kB Progress (3): 540/780 kB | 360/501 kB | 329 kB Progress (3): 540/780 kB | 376/501 kB | 329 kB Progress (3): 556/780 kB | 376/501 kB | 329 kB Progress (3): 556/780 kB | 393/501 kB | 329 kB Progress (3): 573/780 kB | 393/501 kB | 329 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.0 MB/s) 2024-09-12T00:30:38.675 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 573/780 kB | 409/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T00:30:38.676 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 589/780 kB | 409/501 kB Progress (2): 589/780 kB | 425/501 kB Progress (2): 605/780 kB | 425/501 kB Progress (2): 605/780 kB | 442/501 kB Progress (2): 622/780 kB | 442/501 kB Progress (2): 622/780 kB | 458/501 kB Progress (2): 638/780 kB | 458/501 kB Progress (2): 638/780 kB | 475/501 kB Progress (2): 655/780 kB | 475/501 kB Progress (2): 655/780 kB | 491/501 kB Progress (2): 655/780 kB | 501 kB Progress (2): 671/780 kB | 501 kB Progress (2): 687/780 kB | 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.0 MB/s) 2024-09-12T00:30:38.676 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T00:30:38.679 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 704/780 kB Progress (1): 720/780 kB Progress (1): 736/780 kB Progress (1): 753/780 kB Progress (1): 769/780 kB Progress (2): 769/780 kB | 16/354 kB Progress (2): 780 kB | 16/354 kB Progress (2): 780 kB | 33/354 kB Progress (2): 780 kB | 49/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.6 MB/s) 2024-09-12T00:30:38.679 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T00:30:38.684 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 66/354 kB Progress (1): 78/354 kB Progress (1): 94/354 kB Progress (1): 111/354 kB Progress (1): 127/354 kB Progress (1): 143/354 kB Progress (1): 160/354 kB Progress (1): 176/354 kB Progress (1): 193/354 kB Progress (1): 209/354 kB Progress (1): 225/354 kB Progress (1): 242/354 kB Progress (1): 258/354 kB Progress (2): 258/354 kB | 16/41 kB Progress (2): 274/354 kB | 16/41 kB Progress (2): 274/354 kB | 33/41 kB Progress (2): 291/354 kB | 33/41 kB Progress (2): 291/354 kB | 41 kB Progress (2): 307/354 kB | 41 kB Progress (2): 324/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 235 kB/s) 2024-09-12T00:30:38.684 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T00:30:38.685 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 340/354 kB Progress (1): 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.0 MB/s) 2024-09-12T00:30:38.685 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T00:30:38.695 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 34 kB/s) 2024-09-12T00:30:38.695 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T00:30:38.702 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/586 kB Progress (1): 32/586 kB Progress (1): 49/586 kB Progress (1): 62/586 kB Progress (1): 78/586 kB Progress (1): 95/586 kB Progress (1): 111/586 kB Progress (1): 127/586 kB Progress (1): 144/586 kB Progress (1): 160/586 kB Progress (1): 176/586 kB Progress (2): 176/586 kB | 15/211 kB Progress (2): 193/586 kB | 15/211 kB Progress (2): 193/586 kB | 31/211 kB Progress (2): 209/586 kB | 31/211 kB Progress (2): 209/586 kB | 48/211 kB Progress (2): 226/586 kB | 48/211 kB Progress (2): 226/586 kB | 64/211 kB Progress (2): 242/586 kB | 64/211 kB Progress (2): 242/586 kB | 81/211 kB Progress (2): 258/586 kB | 81/211 kB Progress (2): 258/586 kB | 94/211 kB Progress (2): 275/586 kB | 94/211 kB Progress (2): 275/586 kB | 110/211 kB Progress (2): 291/586 kB | 110/211 kB Progress (2): 291/586 kB | 127/211 kB Progress (2): 308/586 kB | 127/211 kB Progress (2): 308/586 kB | 143/211 kB Progress (2): 324/586 kB | 143/211 kB Progress (2): 324/586 kB | 159/211 kB Progress (2): 340/586 kB | 159/211 kB Progress (2): 340/586 kB | 176/211 kB Progress (2): 357/586 kB | 176/211 kB Progress (2): 357/586 kB | 192/211 kB Progress (2): 373/586 kB | 192/211 kB Progress (2): 373/586 kB | 208/211 kB Progress (2): 373/586 kB | 211 kB Progress (2): 389/586 kB | 211 kB Progress (2): 406/586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.1 MB/s) 2024-09-12T00:30:38.702 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T00:30:38.705 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 422/586 kB Progress (2): 422/586 kB | 15/106 kB Progress (2): 439/586 kB | 15/106 kB Progress (3): 439/586 kB | 15/106 kB | 14 kB Progress (3): 439/586 kB | 31/106 kB | 14 kB Progress (3): 455/586 kB | 31/106 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 74 kB/s) 2024-09-12T00:30:38.705 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 471/586 kB | 31/106 kB Progress (2): 471/586 kB | 48/106 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T00:30:38.706 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 488/586 kB | 48/106 kB Progress (2): 488/586 kB | 64/106 kB Progress (2): 504/586 kB | 64/106 kB Progress (2): 504/586 kB | 81/106 kB Progress (2): 521/586 kB | 81/106 kB Progress (2): 521/586 kB | 97/106 kB Progress (2): 537/586 kB | 97/106 kB Progress (2): 537/586 kB | 106 kB Progress (2): 553/586 kB | 106 kB Progress (2): 570/586 kB | 106 kB Progress (2): 586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 542 kB/s) 2024-09-12T00:30:38.706 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T00:30:38.706 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.0 MB/s) 2024-09-12T00:30:38.706 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:30:38.712 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 34 kB/s) 2024-09-12T00:30:38.712 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T00:30:38.726 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (1): 82/245 kB Progress (2): 82/245 kB | 15/205 kB Progress (2): 98/245 kB | 15/205 kB Progress (2): 98/245 kB | 31/205 kB Progress (2): 115/245 kB | 31/205 kB Progress (2): 115/245 kB | 48/205 kB Progress (2): 131/245 kB | 48/205 kB Progress (2): 131/245 kB | 64/205 kB Progress (2): 147/245 kB | 64/205 kB Progress (3): 147/245 kB | 64/205 kB | 15 kB Progress (3): 147/245 kB | 77/205 kB | 15 kB Progress (3): 164/245 kB | 77/205 kB | 15 kB Progress (3): 164/245 kB | 94/205 kB | 15 kB Progress (3): 180/245 kB | 94/205 kB | 15 kB Progress (3): 180/245 kB | 110/205 kB | 15 kB Progress (3): 197/245 kB | 110/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 72 kB/s) 2024-09-12T00:30:38.726 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T00:30:38.726 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 197/245 kB | 126/205 kB Progress (2): 213/245 kB | 126/205 kB Progress (2): 213/245 kB | 143/205 kB Progress (2): 229/245 kB | 143/205 kB Progress (2): 229/245 kB | 159/205 kB Progress (3): 229/245 kB | 159/205 kB | 16/16 kB Progress (3): 245 kB | 159/205 kB | 16/16 kB Progress (3): 245 kB | 159/205 kB | 16 kB Progress (3): 245 kB | 175/205 kB | 16 kB Progress (3): 245 kB | 192/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.1 MB/s) 2024-09-12T00:30:38.726 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 77 kB/s) 2024-09-12T00:30:38.726 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T00:30:38.727 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T00:30:38.727 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 957 kB/s) 2024-09-12T00:30:38.727 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T00:30:38.728 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 29 kB/s) 2024-09-12T00:30:38.740 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Progress (2): 23 kB | 16/184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 98 kB/s) 2024-09-12T00:30:38.742 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (2): 147/184 kB | 16/24 kB Progress (2): 163/184 kB | 16/24 kB Progress (2): 163/184 kB | 24 kB Progress (2): 180/184 kB | 24 kB Progress (2): 184 kB | 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 104 kB/s) 2024-09-12T00:30:38.743 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 785 kB/s) 2024-09-12T00:30:38.748 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 73 kB/s) 2024-09-12T00:30:38.770 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:30:38.770 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T00:30:38.777 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T00:30:38.792 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 364 kB/s) 2024-09-12T00:30:38.794 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T00:30:38.810 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 318 kB/s) 2024-09-12T00:30:38.813 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T00:30:38.828 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.7 MB/s) 2024-09-12T00:30:38.833 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T00:30:38.851 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 792 kB/s) 2024-09-12T00:30:38.857 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T00:30:38.879 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/153 kB Progress (1): 32/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 81/153 kB Progress (1): 98/153 kB Progress (1): 114/153 kB Progress (1): 130/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 7.0 MB/s) 2024-09-12T00:30:38.880 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T00:30:38.902 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 96/215 kB Progress (1): 112/215 kB Progress (1): 129/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 211/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 9.3 MB/s) 2024-09-12T00:30:38.998 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:30:38.998 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:30:39.003 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T00:30:39.019 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 166 kB/s) 2024-09-12T00:30:39.022 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T00:30:39.038 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.3 MB/s) 2024-09-12T00:30:39.042 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T00:30:39.061 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 487 kB/s) 2024-09-12T00:30:39.064 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T00:30:39.081 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.5 MB/s) 2024-09-12T00:30:39.086 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T00:30:39.104 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 318 kB/s) 2024-09-12T00:30:39.107 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T00:30:39.123 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 201 kB/s) 2024-09-12T00:30:39.128 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T00:30:39.144 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 38 kB/s) 2024-09-12T00:30:39.147 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T00:30:39.163 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 183 kB/s) 2024-09-12T00:30:39.165 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T00:30:39.181 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 881 kB/s) 2024-09-12T00:30:39.185 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T00:30:39.203 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 178 kB/s) 2024-09-12T00:30:39.206 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T00:30:39.222 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 557 kB/s) 2024-09-12T00:30:39.224 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T00:30:39.241 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 523 kB/s) 2024-09-12T00:30:39.244 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T00:30:39.259 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 534 kB/s) 2024-09-12T00:30:39.263 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T00:30:39.279 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.2 MB/s) 2024-09-12T00:30:39.290 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T00:30:39.307 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 283 kB/s) 2024-09-12T00:30:39.312 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T00:30:39.329 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.7 MB/s) 2024-09-12T00:30:39.339 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T00:30:39.357 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 283 kB/s) 2024-09-12T00:30:39.366 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T00:30:39.389 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 3.9 MB/s) 2024-09-12T00:30:39.389 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T00:30:39.390 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T00:30:39.390 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T00:30:39.391 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T00:30:39.391 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T00:30:39.405 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/41 kB Progress (2): 16/41 kB | 2.5 kB Progress (2): 33/41 kB | 2.5 kB Progress (2): 41 kB | 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 156 kB/s) 2024-09-12T00:30:39.406 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T00:30:39.406 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.7 MB/s) 2024-09-12T00:30:39.406 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T00:30:39.406 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 530 kB/s) 2024-09-12T00:30:39.411 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/269 kB Progress (1): 32/269 kB Progress (1): 49/269 kB Progress (1): 65/269 kB Progress (1): 81/269 kB Progress (1): 98/269 kB Progress (1): 114/269 kB Progress (1): 130/269 kB Progress (1): 147/269 kB Progress (1): 163/269 kB Progress (1): 180/269 kB Progress (2): 180/269 kB | 16/55 kB Progress (2): 196/269 kB | 16/55 kB Progress (2): 196/269 kB | 32/55 kB Progress (2): 212/269 kB | 32/55 kB Progress (2): 212/269 kB | 49/55 kB Progress (2): 229/269 kB | 49/55 kB Progress (2): 229/269 kB | 55 kB Progress (2): 245/269 kB | 55 kB Progress (2): 262/269 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.5 MB/s) 2024-09-12T00:30:39.412 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 11 MB/s) 2024-09-12T00:30:39.427 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/327 kB Progress (2): 16/327 kB | 16/587 kB Progress (2): 33/327 kB | 16/587 kB Progress (2): 33/327 kB | 31/587 kB Progress (2): 49/327 kB | 31/587 kB Progress (2): 49/327 kB | 48/587 kB Progress (2): 65/327 kB | 48/587 kB Progress (2): 65/327 kB | 64/587 kB Progress (2): 82/327 kB | 64/587 kB Progress (2): 82/327 kB | 77/587 kB Progress (2): 98/327 kB | 77/587 kB Progress (2): 98/327 kB | 93/587 kB Progress (2): 114/327 kB | 93/587 kB Progress (2): 114/327 kB | 109/587 kB Progress (2): 131/327 kB | 109/587 kB Progress (2): 131/327 kB | 126/587 kB Progress (2): 147/327 kB | 126/587 kB Progress (2): 147/327 kB | 142/587 kB Progress (2): 147/327 kB | 158/587 kB Progress (2): 163/327 kB | 158/587 kB Progress (2): 163/327 kB | 175/587 kB Progress (2): 180/327 kB | 175/587 kB Progress (2): 180/327 kB | 191/587 kB Progress (2): 196/327 kB | 191/587 kB Progress (2): 196/327 kB | 208/587 kB Progress (2): 213/327 kB | 208/587 kB Progress (2): 213/327 kB | 224/587 kB Progress (2): 229/327 kB | 224/587 kB Progress (2): 229/327 kB | 240/587 kB Progress (2): 229/327 kB | 257/587 kB Progress (2): 245/327 kB | 257/587 kB Progress (2): 245/327 kB | 273/587 kB Progress (2): 262/327 kB | 273/587 kB Progress (2): 262/327 kB | 289/587 kB Progress (2): 278/327 kB | 289/587 kB Progress (2): 278/327 kB | 306/587 kB Progress (2): 295/327 kB | 306/587 kB Progress (2): 295/327 kB | 322/587 kB Progress (2): 295/327 kB | 339/587 kB Progress (2): 311/327 kB | 339/587 kB Progress (2): 311/327 kB | 355/587 kB Progress (2): 323/327 kB | 355/587 kB Progress (2): 327 kB | 355/587 kB Progress (2): 327 kB | 371/587 kB Progress (2): 327 kB | 388/587 kB Progress (2): 327 kB | 404/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.1 MB/s) 2024-09-12T00:30:39.429 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 421/587 kB Progress (1): 437/587 kB Progress (1): 453/587 kB Progress (1): 470/587 kB Progress (1): 486/587 kB Progress (1): 502/587 kB Progress (1): 519/587 kB Progress (1): 535/587 kB Progress (1): 552/587 kB Progress (1): 568/587 kB Progress (1): 584/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 15 MB/s) 2024-09-12T00:30:39.466 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:30:39.466 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:30:39.466 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:30:39.471 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T00:30:39.486 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 296 kB/s) 2024-09-12T00:30:39.488 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T00:30:39.503 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 424 kB/s) 2024-09-12T00:30:39.505 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T00:30:39.519 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-12T00:30:39.522 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T00:30:39.556 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 399 kB/s) 2024-09-12T00:30:39.559 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T00:30:39.574 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-12T00:30:39.576 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T00:30:39.594 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 236 kB/s) 2024-09-12T00:30:39.597 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T00:30:39.631 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 494 kB/s) 2024-09-12T00:30:39.636 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T00:30:39.652 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 311 kB/s) 2024-09-12T00:30:39.655 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T00:30:39.673 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 230 kB/s) 2024-09-12T00:30:39.678 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T00:30:39.695 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 139 kB/s) 2024-09-12T00:30:39.698 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T00:30:39.717 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 594 kB/s) 2024-09-12T00:30:39.722 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T00:30:39.739 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 958 kB/s) 2024-09-12T00:30:39.743 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T00:30:39.760 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 411 kB/s) 2024-09-12T00:30:39.764 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T00:30:39.780 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 62 kB/s) 2024-09-12T00:30:39.783 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T00:30:39.804 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 399 kB/s) 2024-09-12T00:30:39.807 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T00:30:39.825 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 158 kB/s) 2024-09-12T00:30:39.829 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T00:30:39.846 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 352 kB/s) 2024-09-12T00:30:39.850 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T00:30:39.868 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 67 kB/s) 2024-09-12T00:30:39.873 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T00:30:39.889 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 48 kB/s) 2024-09-12T00:30:39.892 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T00:30:39.912 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 318 kB/s) 2024-09-12T00:30:39.915 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T00:30:39.934 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.4 MB/s) 2024-09-12T00:30:39.940 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T00:30:39.963 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 52 kB/s) 2024-09-12T00:30:39.966 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T00:30:39.997 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 43 kB/s) 2024-09-12T00:30:40.013 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T00:30:40.029 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 846 kB/s) 2024-09-12T00:30:40.030 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T00:30:40.030 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T00:30:40.031 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T00:30:40.031 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T00:30:40.031 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T00:30:40.048 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/55 kB Progress (3): 4.2 kB | 16/55 kB | 16/27 kB Progress (3): 4.2 kB | 33/55 kB | 16/27 kB Progress (3): 4.2 kB | 33/55 kB | 27 kB Progress (3): 4.2 kB | 49/55 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 234 kB/s) 2024-09-12T00:30:40.048 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T00:30:40.049 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 55 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.6 MB/s) 2024-09-12T00:30:40.050 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.0 MB/s) 2024-09-12T00:30:40.050 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T00:30:40.050 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T00:30:40.063 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 32/334 kB Progress (1): 49/334 kB Progress (1): 65/334 kB Progress (1): 81/334 kB Progress (1): 98/334 kB Progress (1): 114/334 kB Progress (1): 130/334 kB Progress (1): 147/334 kB Progress (1): 163/334 kB Progress (1): 180/334 kB Progress (1): 196/334 kB Progress (1): 212/334 kB Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 262/334 kB Progress (1): 278/334 kB Progress (1): 294/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 10 MB/s) 2024-09-12T00:30:40.064 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 146 kB/s) 2024-09-12T00:30:40.065 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 670 kB/s) 2024-09-12T00:30:40.069 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15/122 kB Progress (1): 31/122 kB Progress (1): 48/122 kB Progress (1): 64/122 kB Progress (1): 81/122 kB Progress (1): 97/122 kB Progress (1): 113/122 kB Progress (1): 122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 3.2 MB/s) 2024-09-12T00:30:40.085 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/267 kB Progress (1): 32/267 kB Progress (1): 49/267 kB Progress (1): 65/267 kB Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (1): 114/267 kB Progress (1): 130/267 kB Progress (1): 147/267 kB Progress (1): 163/267 kB Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 211/267 kB Progress (1): 227/267 kB Progress (1): 244/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 5.0 MB/s) 2024-09-12T00:30:40.407 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T00:30:40.410 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T00:30:41.611 INFO:tasks.workunit.client.0.smithi138.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:30:41.611 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:30:41.612 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:30:41.616 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:30:41.616 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:30:41.616 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:30:41.624 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T00:30:41.624 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T00:30:41.862 INFO:tasks.workunit.client.0.smithi138.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:30:41.862 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:30:41.862 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:30:41.868 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T00:30:41.887 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 329 kB/s) 2024-09-12T00:30:41.892 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T00:30:41.909 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 208 kB/s) 2024-09-12T00:30:41.913 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T00:30:41.931 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 192 kB/s) 2024-09-12T00:30:41.936 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T00:30:41.952 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 239 kB/s) 2024-09-12T00:30:41.957 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T00:30:41.972 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 207 kB/s) 2024-09-12T00:30:41.977 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T00:30:41.992 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 278 kB/s) 2024-09-12T00:30:41.995 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T00:30:42.013 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 98 kB/s) 2024-09-12T00:30:42.016 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T00:30:42.030 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 157 kB/s) 2024-09-12T00:30:42.032 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T00:30:42.045 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.2 MB/s) 2024-09-12T00:30:42.048 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T00:30:42.063 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-12T00:30:42.067 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T00:30:42.084 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 322 kB/s) 2024-09-12T00:30:42.087 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T00:30:42.104 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 138 kB/s) 2024-09-12T00:30:42.107 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T00:30:42.125 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.2 MB/s) 2024-09-12T00:30:42.129 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T00:30:42.145 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15/37 kB Progress (1): 31/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.2 MB/s) 2024-09-12T00:30:42.149 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T00:30:42.164 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.0 MB/s) 2024-09-12T00:30:42.170 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T00:30:42.186 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 577 kB/s) 2024-09-12T00:30:42.189 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T00:30:42.205 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.6 MB/s) 2024-09-12T00:30:42.212 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T00:30:42.228 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 474 kB/s) 2024-09-12T00:30:42.236 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T00:30:42.253 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 121 kB/s) 2024-09-12T00:30:42.260 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T00:30:42.282 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 113 kB/s) 2024-09-12T00:30:42.288 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T00:30:42.307 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 77 kB/s) 2024-09-12T00:30:42.309 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T00:30:42.322 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-12T00:30:42.324 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T00:30:42.338 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-12T00:30:42.341 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T00:30:42.355 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 451 kB/s) 2024-09-12T00:30:42.358 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T00:30:42.373 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 848 kB/s) 2024-09-12T00:30:42.379 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T00:30:42.395 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 174 kB/s) 2024-09-12T00:30:42.399 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T00:30:42.415 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 425 kB/s) 2024-09-12T00:30:42.419 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T00:30:42.437 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 560 kB/s) 2024-09-12T00:30:42.439 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T00:30:42.455 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 129 kB/s) 2024-09-12T00:30:42.459 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T00:30:42.475 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 139 kB/s) 2024-09-12T00:30:42.484 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T00:30:42.501 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 178 kB/s) 2024-09-12T00:30:42.507 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T00:30:42.536 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 534 kB/s) 2024-09-12T00:30:42.539 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T00:30:42.558 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 806 kB/s) 2024-09-12T00:30:42.564 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T00:30:42.581 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 790 kB/s) 2024-09-12T00:30:42.584 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T00:30:42.600 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 319 kB/s) 2024-09-12T00:30:42.604 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T00:30:42.621 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 392 kB/s) 2024-09-12T00:30:42.625 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T00:30:42.643 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.9 MB/s) 2024-09-12T00:30:42.650 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T00:30:42.668 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 913 kB/s) 2024-09-12T00:30:42.672 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T00:30:42.690 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 822 kB/s) 2024-09-12T00:30:42.699 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T00:30:42.716 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 44 kB/s) 2024-09-12T00:30:42.720 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T00:30:42.736 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 283 kB/s) 2024-09-12T00:30:42.742 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T00:30:42.759 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 465 kB/s) 2024-09-12T00:30:42.765 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T00:30:42.782 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 176 kB/s) 2024-09-12T00:30:42.790 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T00:30:42.806 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 250 kB/s) 2024-09-12T00:30:42.812 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T00:30:42.832 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 114 kB/s) 2024-09-12T00:30:42.837 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T00:30:42.854 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 204 kB/s) 2024-09-12T00:30:42.860 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T00:30:42.877 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 643 kB/s) 2024-09-12T00:30:42.881 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T00:30:42.897 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 842 kB/s) 2024-09-12T00:30:42.902 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T00:30:42.918 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-12T00:30:42.924 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T00:30:42.940 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 23 kB/s) 2024-09-12T00:30:42.944 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T00:30:42.960 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 407 kB/s) 2024-09-12T00:30:42.963 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T00:30:42.980 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 458 kB/s) 2024-09-12T00:30:42.984 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T00:30:43.000 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 302 kB/s) 2024-09-12T00:30:43.007 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T00:30:43.024 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 430 kB/s) 2024-09-12T00:30:43.030 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T00:30:43.056 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 902 kB/s) 2024-09-12T00:30:43.059 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T00:30:43.081 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 37/78 kB Progress (1): 53/78 kB Progress (1): 69/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 3.5 MB/s) 2024-09-12T00:30:43.095 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T00:30:43.110 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.4 MB/s) 2024-09-12T00:30:43.118 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T00:30:43.134 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 332 kB/s) 2024-09-12T00:30:43.139 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T00:30:43.161 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 186 kB/s) 2024-09-12T00:30:43.165 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T00:30:43.183 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 188 kB/s) 2024-09-12T00:30:43.186 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T00:30:43.204 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.5 MB/s) 2024-09-12T00:30:43.209 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T00:30:43.228 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 125 kB/s) 2024-09-12T00:30:43.240 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T00:30:43.272 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 9.6 MB/s) 2024-09-12T00:30:43.273 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T00:30:43.273 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T00:30:43.274 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T00:30:43.274 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T00:30:43.275 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T00:30:43.294 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/171 kB Progress (2): 16/171 kB | 8.2 kB Progress (2): 33/171 kB | 8.2 kB Progress (2): 49/171 kB | 8.2 kB Progress (2): 64/171 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 430 kB/s) 2024-09-12T00:30:43.294 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 81/171 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T00:30:43.294 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 81/171 kB | 14 kB Progress (2): 97/171 kB | 14 kB Progress (2): 113/171 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 647 kB/s) 2024-09-12T00:30:43.294 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T00:30:43.297 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 113/171 kB | 16/118 kB Progress (2): 130/171 kB | 16/118 kB Progress (3): 130/171 kB | 16/118 kB | 15/26 kB Progress (3): 130/171 kB | 32/118 kB | 15/26 kB Progress (3): 146/171 kB | 32/118 kB | 15/26 kB Progress (3): 146/171 kB | 49/118 kB | 15/26 kB Progress (3): 163/171 kB | 49/118 kB | 15/26 kB Progress (3): 163/171 kB | 49/118 kB | 26 kB Progress (3): 171 kB | 49/118 kB | 26 kB Progress (3): 171 kB | 65/118 kB | 26 kB Progress (3): 171 kB | 81/118 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.1 MB/s) 2024-09-12T00:30:43.297 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T00:30:43.297 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 6.8 MB/s) 2024-09-12T00:30:43.297 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 98/118 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T00:30:43.298 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 114/118 kB Progress (1): 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 4.7 MB/s) 2024-09-12T00:30:43.298 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T00:30:43.315 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/136 kB Progress (2): 16/136 kB | 16/146 kB Progress (2): 32/136 kB | 16/146 kB Progress (2): 32/136 kB | 32/146 kB Progress (2): 49/136 kB | 32/146 kB Progress (2): 49/136 kB | 49/146 kB Progress (2): 65/136 kB | 49/146 kB Progress (2): 65/136 kB | 65/146 kB Progress (2): 65/136 kB | 79/146 kB Progress (2): 81/136 kB | 79/146 kB Progress (3): 81/136 kB | 79/146 kB | 16/61 kB Progress (3): 98/136 kB | 79/146 kB | 16/61 kB Progress (3): 98/136 kB | 95/146 kB | 16/61 kB Progress (4): 98/136 kB | 95/146 kB | 16/61 kB | 15/501 kB Progress (4): 98/136 kB | 95/146 kB | 33/61 kB | 15/501 kB Progress (4): 98/136 kB | 112/146 kB | 33/61 kB | 15/501 kB Progress (4): 114/136 kB | 112/146 kB | 33/61 kB | 15/501 kB Progress (4): 114/136 kB | 112/146 kB | 33/61 kB | 31/501 kB Progress (4): 114/136 kB | 112/146 kB | 49/61 kB | 31/501 kB Progress (4): 114/136 kB | 128/146 kB | 49/61 kB | 31/501 kB Progress (4): 130/136 kB | 128/146 kB | 49/61 kB | 31/501 kB Progress (4): 130/136 kB | 128/146 kB | 49/61 kB | 48/501 kB Progress (4): 136 kB | 128/146 kB | 49/61 kB | 48/501 kB Progress (4): 136 kB | 128/146 kB | 61 kB | 48/501 kB Progress (4): 136 kB | 144/146 kB | 61 kB | 48/501 kB Progress (4): 136 kB | 144/146 kB | 61 kB | 64/501 kB Progress (4): 136 kB | 146 kB | 61 kB | 64/501 kB Progress (4): 136 kB | 146 kB | 61 kB | 77/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.5 MB/s) 2024-09-12T00:30:43.315 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.6 MB/s) 2024-09-12T00:30:43.315 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.4 MB/s) 2024-09-12T00:30:43.315 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 93/501 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T00:30:43.315 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T00:30:43.319 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 110/501 kB Progress (1): 126/501 kB Progress (1): 143/501 kB Progress (1): 159/501 kB Progress (2): 159/501 kB | 16/58 kB Progress (2): 175/501 kB | 16/58 kB Progress (2): 175/501 kB | 32/58 kB Progress (2): 192/501 kB | 32/58 kB Progress (2): 192/501 kB | 49/58 kB Progress (2): 192/501 kB | 58 kB Progress (2): 208/501 kB | 58 kB Progress (2): 224/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.3 MB/s) 2024-09-12T00:30:43.324 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 241/501 kB Progress (1): 257/501 kB Progress (1): 274/501 kB Progress (1): 290/501 kB Progress (1): 294/501 kB Progress (1): 310/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 392/501 kB Progress (1): 409/501 kB Progress (1): 425/501 kB Progress (1): 442/501 kB Progress (1): 458/501 kB Progress (1): 474/501 kB Progress (1): 491/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 10 MB/s) 2024-09-12T00:30:43.334 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15/124 kB Progress (1): 31/124 kB Progress (1): 48/124 kB Progress (1): 64/124 kB Progress (1): 81/124 kB Progress (1): 97/124 kB Progress (2): 97/124 kB | 0/2.4 MB Progress (2): 113/124 kB | 0/2.4 MB Progress (2): 113/124 kB | 0/2.4 MB Progress (2): 124 kB | 0/2.4 MB Progress (2): 124 kB | 0/2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.1 MB/s) 2024-09-12T00:30:43.385 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 22 MB/s) 2024-09-12T00:30:43.509 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:30:43.509 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T00:30:43.515 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T00:30:43.532 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 249 kB/s) 2024-09-12T00:30:43.535 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T00:30:43.551 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 306 kB/s) 2024-09-12T00:30:43.554 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T00:30:43.570 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.7 MB/s) 2024-09-12T00:30:43.574 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T00:30:43.594 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 978 kB/s) 2024-09-12T00:30:43.598 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T00:30:43.613 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-12T00:30:43.616 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T00:30:43.635 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 206 kB/s) 2024-09-12T00:30:43.638 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T00:30:43.659 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 286 kB/s) 2024-09-12T00:30:43.664 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T00:30:43.684 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 272 kB/s) 2024-09-12T00:30:43.687 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T00:30:43.701 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.3 MB/s) 2024-09-12T00:30:43.706 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T00:30:43.721 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 909 kB/s) 2024-09-12T00:30:43.724 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T00:30:43.741 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 120 kB/s) 2024-09-12T00:30:43.746 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T00:30:43.762 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 514 kB/s) 2024-09-12T00:30:43.766 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T00:30:43.785 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.3 MB/s) 2024-09-12T00:30:43.799 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T00:30:43.819 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 1.9 MB/s) 2024-09-12T00:30:43.819 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T00:30:43.820 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T00:30:43.820 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T00:30:43.820 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T00:30:43.821 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T00:30:43.838 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/211 kB Progress (2): 16/211 kB | 16/58 kB Progress (2): 33/211 kB | 16/58 kB Progress (2): 33/211 kB | 32/58 kB Progress (3): 33/211 kB | 32/58 kB | 16/79 kB Progress (3): 49/211 kB | 32/58 kB | 16/79 kB Progress (3): 49/211 kB | 49/58 kB | 16/79 kB Progress (3): 63/211 kB | 49/58 kB | 16/79 kB Progress (3): 63/211 kB | 49/58 kB | 32/79 kB Progress (3): 63/211 kB | 58 kB | 32/79 kB Progress (3): 79/211 kB | 58 kB | 32/79 kB Progress (3): 79/211 kB | 58 kB | 49/79 kB Progress (4): 79/211 kB | 58 kB | 49/79 kB | 16/26 kB Progress (4): 95/211 kB | 58 kB | 49/79 kB | 16/26 kB Progress (4): 95/211 kB | 58 kB | 49/79 kB | 26 kB Progress (4): 95/211 kB | 58 kB | 65/79 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.4 MB/s) 2024-09-12T00:30:43.838 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T00:30:43.838 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (3): 112/211 kB | 65/79 kB | 26 kB Progress (3): 112/211 kB | 79 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.5 MB/s) 2024-09-12T00:30:43.838 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 128/211 kB | 79 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T00:30:43.838 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.4 MB/s) 2024-09-12T00:30:43.840 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 145/211 kB Progress (1): 161/211 kB Progress (1): 177/211 kB Progress (2): 177/211 kB | 0/1.0 MB Progress (2): 194/211 kB | 0/1.0 MB Progress (2): 194/211 kB | 0/1.0 MB Progress (2): 210/211 kB | 0/1.0 MB Progress (2): 211 kB | 0/1.0 MB Progress (2): 211 kB | 0/1.0 MB Progress (2): 211 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 10 MB/s) 2024-09-12T00:30:43.855 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (2): 0.9/1.0 MB | 16/116 kB Progress (2): 0.9/1.0 MB | 16/116 kB Progress (2): 0.9/1.0 MB | 32/116 kB Progress (2): 0.9/1.0 MB | 32/116 kB Progress (2): 1.0/1.0 MB | 32/116 kB Progress (2): 1.0/1.0 MB | 49/116 kB Progress (2): 1.0/1.0 MB | 49/116 kB Progress (2): 1.0/1.0 MB | 65/116 kB Progress (2): 1.0/1.0 MB | 65/116 kB Progress (2): 1.0/1.0 MB | 65/116 kB Progress (2): 1.0 MB | 65/116 kB Progress (2): 1.0 MB | 81/116 kB Progress (2): 1.0 MB | 98/116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 30 MB/s) 2024-09-12T00:30:43.856 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 98/116 kB | 16/267 kB Progress (2): 114/116 kB | 16/267 kB Progress (2): 116 kB | 16/267 kB Progress (2): 116 kB | 32/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.3 MB/s) 2024-09-12T00:30:43.860 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 49/267 kB Progress (1): 49/267 kB Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 96/267 kB Progress (1): 112/267 kB Progress (1): 128/267 kB Progress (1): 145/267 kB Progress (1): 161/267 kB Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 210/267 kB Progress (1): 227/267 kB Progress (1): 243/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 6.7 MB/s) 2024-09-12T00:30:44.035 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T00:30:44.065 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:30:44.065 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:30:44.065 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:30:44.066 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Total time: 8.349 s 2024-09-12T00:30:44.066 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Finished at: 2024-09-12T00:30:44Z 2024-09-12T00:30:44.066 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:30:44.096 INFO:tasks.workunit.client.0.smithi138.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T00:30:44.102 INFO:tasks.workunit.client.0.smithi138.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:30:45.305 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Scanning for projects... 2024-09-12T00:30:45.422 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:30:45.422 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:30:45.422 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:30:45.422 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] from pom.xml 2024-09-12T00:30:45.423 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:30:45.795 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:30:45.796 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:30:45.942 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:30:45.943 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:30:45.943 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:30:46.036 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:30:46.036 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:30:46.037 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:30:46.039 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:30:46.039 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:30:46.039 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:30:46.047 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:30:46.047 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:30:46.047 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:30:46.294 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T00:30:46.520 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T00:30:46.716 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-09-12T00:30:46.725 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T00:30:46.750 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 100 kB/s) 2024-09-12T00:30:46.758 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T00:30:46.783 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 117 kB/s) 2024-09-12T00:30:46.789 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T00:30:46.817 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 108 kB/s) 2024-09-12T00:30:46.821 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T00:30:46.839 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 169 kB/s) 2024-09-12T00:30:46.843 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T00:30:46.862 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 84 kB/s) 2024-09-12T00:30:46.866 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T00:30:46.885 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 149 kB/s) 2024-09-12T00:30:46.893 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T00:30:46.920 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 970 kB/s) 2024-09-12T00:30:46.923 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T00:30:46.923 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T00:30:46.924 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T00:30:46.924 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T00:30:46.925 INFO:tasks.workunit.client.0.smithi138.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T00:30:46.964 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 16/169 kB Progress (1): 33/169 kB Progress (1): 49/169 kB Progress (1): 66/169 kB Progress (1): 82/169 kB Progress (1): 98/169 kB Progress (1): 115/169 kB Progress (1): 131/169 kB Progress (1): 147/169 kB Progress (1): 164/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 3.9 MB/s) 2024-09-12T00:30:46.978 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (1): 4.1/7.7 kB Progress (1): 5.5/7.7 kB Progress (1): 6.9/7.7 kB Progress (1): 7.7 kB Progress (2): 7.7 kB | 1.4/189 kB Progress (3): 7.7 kB | 1.4/189 kB | 1.4/103 kB Progress (3): 7.7 kB | 2.8/189 kB | 1.4/103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 139 kB/s) 2024-09-12T00:30:46.996 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 4.1/189 kB | 1.4/103 kB Progress (2): 4.1/189 kB | 2.8/103 kB Progress (2): 5.5/189 kB | 2.8/103 kB Progress (2): 6.9/189 kB | 2.8/103 kB Progress (2): 6.9/189 kB | 4.1/103 kB Progress (2): 8.3/189 kB | 4.1/103 kB Progress (2): 9.7/189 kB | 4.1/103 kB Progress (2): 9.7/189 kB | 5.5/103 kB Progress (2): 11/189 kB | 5.5/103 kB Progress (2): 12/189 kB | 5.5/103 kB Progress (2): 12/189 kB | 6.9/103 kB Progress (2): 14/189 kB | 6.9/103 kB Progress (2): 15/189 kB | 6.9/103 kB Progress (2): 15/189 kB | 8.3/103 kB Progress (2): 16/189 kB | 8.3/103 kB Progress (2): 16/189 kB | 9.7/103 kB Progress (3): 16/189 kB | 9.7/103 kB | 1.4/18 kB Progress (3): 32/189 kB | 9.7/103 kB | 1.4/18 kB Progress (3): 32/189 kB | 11/103 kB | 1.4/18 kB Progress (3): 32/189 kB | 11/103 kB | 2.8/18 kB Progress (3): 32/189 kB | 12/103 kB | 2.8/18 kB Progress (3): 32/189 kB | 12/103 kB | 4.1/18 kB Progress (3): 32/189 kB | 14/103 kB | 4.1/18 kB Progress (3): 32/189 kB | 14/103 kB | 5.5/18 kB Progress (3): 32/189 kB | 15/103 kB | 5.5/18 kB Progress (3): 32/189 kB | 15/103 kB | 6.9/18 kB Progress (3): 32/189 kB | 16/103 kB | 6.9/18 kB Progress (3): 32/189 kB | 16/103 kB | 8.3/18 kB Progress (3): 32/189 kB | 16/103 kB | 9.7/18 kB Progress (3): 32/189 kB | 16/103 kB | 11/18 kB Progress (3): 32/189 kB | 16/103 kB | 12/18 kB Progress (3): 32/189 kB | 16/103 kB | 14/18 kB Progress (3): 32/189 kB | 16/103 kB | 15/18 kB Progress (3): 32/189 kB | 16/103 kB | 16/18 kB Progress (3): 49/189 kB | 16/103 kB | 16/18 kB Progress (3): 49/189 kB | 16/103 kB | 17/18 kB Progress (3): 49/189 kB | 32/103 kB | 17/18 kB Progress (3): 65/189 kB | 32/103 kB | 17/18 kB Progress (3): 65/189 kB | 32/103 kB | 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 231 kB/s) 2024-09-12T00:30:47.009 INFO:tasks.workunit.client.0.smithi138.stdout:Progress (2): 65/189 kB | 49/103 kB Progress (2): 65/189 kB | 65/103 kB Progress (2): 81/189 kB | 65/103 kB Progress (2): 98/189 kB | 65/103 kB Progress (2): 98/189 kB | 81/103 kB Progress (2): 114/189 kB | 81/103 kB Progress (2): 130/189 kB | 81/103 kB Progress (2): 130/189 kB | 98/103 kB Progress (2): 147/189 kB | 98/103 kB Progress (2): 147/189 kB | 103 kB Progress (2): 163/189 kB | 103 kB Progress (2): 180/189 kB | 103 kB Progress (2): 189 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-12T00:30:47.009 INFO:tasks.workunit.client.0.smithi138.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.2 MB/s) 2024-09-12T00:30:47.026 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:30:47.026 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:30:47.026 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] T E S T S 2024-09-12T00:30:47.026 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:30:47.600 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T00:30:47.678 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjects.java: starting test run: 2024-09-12T00:30:47.678 INFO:tasks.workunit.client.0.smithi138.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:30:47.678 INFO:tasks.workunit.client.0.smithi138.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:30:47.678 INFO:tasks.workunit.client.0.smithi138.stdout: EndpointUrl=https://smithi138.front.sepia.ceph.com:443 2024-09-12T00:30:47.678 INFO:tasks.workunit.client.0.smithi138.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T00:30:47.874 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Environment Variables Read 2024-09-12T00:30:48.175 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: S3 Client Initialized 2024-09-12T00:30:48.175 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Generating File 2024-09-12T00:30:48.175 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: File Generated 2024-09-12T00:30:48.175 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Generating File 2024-09-12T00:30:48.175 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: File Generated 2024-09-12T00:30:48.176 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Generating File 2024-09-12T00:30:48.276 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: File Generated 2024-09-12T00:30:48.276 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Generating File 2024-09-12T00:30:48.276 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: File Generated 2024-09-12T00:30:48.276 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Generating File 2024-09-12T00:30:48.276 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: File Generated 2024-09-12T00:30:48.276 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Generating File 2024-09-12T00:30:48.276 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: File Generated 2024-09-12T00:30:48.276 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Generated Big Files 2024-09-12T00:30:48.548 INFO:tasks.workunit.client.0.smithi138.stdout:HeadBucketResponse() 2024-09-12T00:30:48.548 INFO:tasks.workunit.client.0.smithi138.stdout:sheik is ready 2024-09-12T00:30:48.548 INFO:tasks.workunit.client.0.smithi138.stdout:DEBUG: Test Bucket Created 2024-09-12T00:30:48.578 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T00:30:48.769 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T00:30:48.778 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T00:30:48.879 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T00:30:48.979 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T00:30:49.080 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T00:30:49.280 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T00:30:49.380 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T00:30:49.480 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T00:30:49.581 INFO:tasks.workunit.client.0.smithi138.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T00:30:52.186 INFO:tasks.workunit.client.0.smithi138.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T00:30:52.788 INFO:tasks.workunit.client.0.smithi138.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T00:30:56.213 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-0b 2024-09-12T00:30:56.214 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-8b 2024-09-12T00:30:56.215 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-200b 2024-09-12T00:30:56.217 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-21983b 2024-09-12T00:30:56.218 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-5519b 2024-09-12T00:30:56.219 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-204329b 2024-09-12T00:30:56.220 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-256k 2024-09-12T00:30:56.221 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-1m 2024-09-12T00:30:56.222 INFO:tasks.workunit.client.0.smithi138.stdout:arg: file-1038757b 2024-09-12T00:30:56.272 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T00:30:56.272 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-12T00:30:56.295 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T00:30:56.295 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-12T00:30:56.396 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T00:30:56.396 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-12T00:30:56.496 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T00:30:56.496 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-12T00:30:56.594 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T00:30:56.594 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-12T00:30:56.663 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T00:30:56.663 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-12T00:30:56.696 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T00:30:56.734 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-12T00:30:56.797 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T00:30:56.848 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-12T00:30:56.897 INFO:tasks.workunit.client.0.smithi138.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T00:30:56.990 INFO:tasks.workunit.client.0.smithi138.stdout:PutObjectResponse 2024-09-12T00:30:56.997 INFO:tasks.workunit.client.0.smithi138.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T00:30:57.502 INFO:tasks.workunit.client.0.smithi138.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T00:30:58.103 INFO:tasks.workunit.client.0.smithi138.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T00:31:02.550 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.90 s -- in io.ceph.jcksum.PutObjects 2024-09-12T00:31:02.587 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:31:02.587 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Results: 2024-09-12T00:31:02.587 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:31:02.587 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T00:31:02.587 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] 2024-09-12T00:31:02.589 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:31:02.589 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:31:02.589 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:31:02.590 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Total time: 17.310 s 2024-09-12T00:31:02.590 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] Finished at: 2024-09-12T00:31:02Z 2024-09-12T00:31:02.590 INFO:tasks.workunit.client.0.smithi138.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:31:02.623 INFO:tasks.workunit.client.0.smithi138.stderr:+ exit 2024-09-12T00:31:02.623 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:31:02.623 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:31:02.680 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T00:31:02.680 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:31:03.092 DEBUG:teuthology.parallel:result is None 2024-09-12T00:31:03.093 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:31:03.105 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:31:03.105 DEBUG:teuthology.orchestra.run.smithi138:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:31:03.151 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:31:03.152 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:31:03.162 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:31:03.162 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:31:03.163 DEBUG:teuthology.orchestra.run.smithi138:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:31:03.199 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:31:03.200 INFO:teuthology.orchestra.run.smithi138.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:31:03.200 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:31:03.248 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:31:03.248 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:31:03.300 INFO:tasks.workunit:timeout=3h 2024-09-12T00:31:03.300 INFO:tasks.workunit:cleanup=True 2024-09-12T00:31:03.301 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:31:03.351 INFO:tasks.workunit.client.0.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:31:46.249 INFO:tasks.workunit.client.0.smithi138.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:31:46.250 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:31:46.250 INFO:tasks.workunit.client.0.smithi138.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:31:46.250 INFO:tasks.workunit.client.0.smithi138.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:31:46.250 INFO:tasks.workunit.client.0.smithi138.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:31:46.250 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:31:46.250 INFO:tasks.workunit.client.0.smithi138.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:31:46.250 INFO:tasks.workunit.client.0.smithi138.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:31:46.250 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:31:46.250 INFO:tasks.workunit.client.0.smithi138.stderr: git switch -c 2024-09-12T00:31:46.251 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:31:46.251 INFO:tasks.workunit.client.0.smithi138.stderr:Or undo this operation with: 2024-09-12T00:31:46.251 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:31:46.251 INFO:tasks.workunit.client.0.smithi138.stderr: git switch - 2024-09-12T00:31:46.251 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:31:46.251 INFO:tasks.workunit.client.0.smithi138.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:31:46.251 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:31:46.251 INFO:tasks.workunit.client.0.smithi138.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:31:46.256 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:31:46.306 INFO:tasks.workunit.client.0.smithi138.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:31:46.308 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:31:46.308 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:31:46.363 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:31:46.419 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:31:46.462 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:31:46.463 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:31:46.463 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:31:46.513 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:31:46.516 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:31:46.516 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:31:46.564 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T00:31:46.565 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T00:31:46.566 DEBUG:teuthology.orchestra.run.smithi138:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T00:31:46.619 INFO:tasks.workunit.client.0.smithi138.stdout:INFO: fully qualified domain name: smithi138.front.sepia.ceph.com 2024-09-12T00:31:46.619 INFO:tasks.workunit.client.0.smithi138.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T00:31:46.619 INFO:tasks.workunit.client.0.smithi138.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-12T00:31:49.865 INFO:tasks.workunit.client.0.smithi138.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:31:50.073 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting pip 2024-09-12T00:31:50.079 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:31:50.116 INFO:tasks.workunit.client.0.smithi138.stdout:Installing collected packages: pip 2024-09-12T00:31:50.116 INFO:tasks.workunit.client.0.smithi138.stdout: Attempting uninstall: pip 2024-09-12T00:31:50.116 INFO:tasks.workunit.client.0.smithi138.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:31:50.415 INFO:tasks.workunit.client.0.smithi138.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:31:50.421 INFO:tasks.workunit.client.0.smithi138.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:31:51.441 INFO:tasks.workunit.client.0.smithi138.stdout:Successfully installed pip-24.2 2024-09-12T00:31:52.494 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting boto3 2024-09-12T00:31:52.495 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:31:53.057 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:31:53.058 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:31:53.111 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:31:53.113 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:31:53.168 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:31:53.170 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:31:53.229 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:31:53.230 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:31:53.343 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:31:53.345 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:31:53.598 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:31:53.599 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:31:53.602 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:31:53.604 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:31:53.613 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:31:53.614 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:31:53.615 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:31:53.617 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:31:53.618 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:31:53.686 INFO:tasks.workunit.client.0.smithi138.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:31:54.806 INFO:tasks.workunit.client.0.smithi138.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:31:55.175 INFO:tasks.workunit.client.0.smithi138.stdout:INFO: creating user 2024-09-12T00:31:55.313 INFO:tasks.workunit.client.0.smithi138.stdout:{ 2024-09-12T00:31:55.314 INFO:tasks.workunit.client.0.smithi138.stdout: "user_id": "testid", 2024-09-12T00:31:55.314 INFO:tasks.workunit.client.0.smithi138.stdout: "display_name": "M. Tester", 2024-09-12T00:31:55.314 INFO:tasks.workunit.client.0.smithi138.stdout: "email": "tester@ceph.com", 2024-09-12T00:31:55.314 INFO:tasks.workunit.client.0.smithi138.stdout: "suspended": 0, 2024-09-12T00:31:55.314 INFO:tasks.workunit.client.0.smithi138.stdout: "max_buckets": 1000, 2024-09-12T00:31:55.314 INFO:tasks.workunit.client.0.smithi138.stdout: "subusers": [], 2024-09-12T00:31:55.314 INFO:tasks.workunit.client.0.smithi138.stdout: "keys": [ 2024-09-12T00:31:55.315 INFO:tasks.workunit.client.0.smithi138.stdout: { 2024-09-12T00:31:55.315 INFO:tasks.workunit.client.0.smithi138.stdout: "user": "testid", 2024-09-12T00:31:55.315 INFO:tasks.workunit.client.0.smithi138.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T00:31:55.315 INFO:tasks.workunit.client.0.smithi138.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T00:31:55.315 INFO:tasks.workunit.client.0.smithi138.stdout: "active": true, 2024-09-12T00:31:55.315 INFO:tasks.workunit.client.0.smithi138.stdout: "create_date": "2024-09-12T00:31:55.311407Z" 2024-09-12T00:31:55.315 INFO:tasks.workunit.client.0.smithi138.stdout: } 2024-09-12T00:31:55.315 INFO:tasks.workunit.client.0.smithi138.stdout: ], 2024-09-12T00:31:55.315 INFO:tasks.workunit.client.0.smithi138.stdout: "swift_keys": [], 2024-09-12T00:31:55.315 INFO:tasks.workunit.client.0.smithi138.stdout: "caps": [], 2024-09-12T00:31:55.315 INFO:tasks.workunit.client.0.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-12T00:31:55.315 INFO:tasks.workunit.client.0.smithi138.stdout: "default_placement": "", 2024-09-12T00:31:55.315 INFO:tasks.workunit.client.0.smithi138.stdout: "default_storage_class": "", 2024-09-12T00:31:55.316 INFO:tasks.workunit.client.0.smithi138.stdout: "placement_tags": [], 2024-09-12T00:31:55.316 INFO:tasks.workunit.client.0.smithi138.stdout: "bucket_quota": { 2024-09-12T00:31:55.316 INFO:tasks.workunit.client.0.smithi138.stdout: "enabled": false, 2024-09-12T00:31:55.316 INFO:tasks.workunit.client.0.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:31:55.316 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size": -1, 2024-09-12T00:31:55.316 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:31:55.316 INFO:tasks.workunit.client.0.smithi138.stdout: "max_objects": -1 2024-09-12T00:31:55.316 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:31:55.316 INFO:tasks.workunit.client.0.smithi138.stdout: "user_quota": { 2024-09-12T00:31:55.316 INFO:tasks.workunit.client.0.smithi138.stdout: "enabled": false, 2024-09-12T00:31:55.316 INFO:tasks.workunit.client.0.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:31:55.316 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size": -1, 2024-09-12T00:31:55.317 INFO:tasks.workunit.client.0.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:31:55.317 INFO:tasks.workunit.client.0.smithi138.stdout: "max_objects": -1 2024-09-12T00:31:55.317 INFO:tasks.workunit.client.0.smithi138.stdout: }, 2024-09-12T00:31:55.317 INFO:tasks.workunit.client.0.smithi138.stdout: "temp_url_keys": [], 2024-09-12T00:31:55.317 INFO:tasks.workunit.client.0.smithi138.stdout: "type": "rgw", 2024-09-12T00:31:55.317 INFO:tasks.workunit.client.0.smithi138.stdout: "mfa_ids": [], 2024-09-12T00:31:55.317 INFO:tasks.workunit.client.0.smithi138.stdout: "account_id": "", 2024-09-12T00:31:55.317 INFO:tasks.workunit.client.0.smithi138.stdout: "path": "/", 2024-09-12T00:31:55.317 INFO:tasks.workunit.client.0.smithi138.stdout: "create_date": "2024-09-12T00:31:55.311389Z", 2024-09-12T00:31:55.317 INFO:tasks.workunit.client.0.smithi138.stdout: "tags": [], 2024-09-12T00:31:55.317 INFO:tasks.workunit.client.0.smithi138.stdout: "group_ids": [] 2024-09-12T00:31:55.317 INFO:tasks.workunit.client.0.smithi138.stdout:} 2024-09-12T00:31:55.317 INFO:tasks.workunit.client.0.smithi138.stdout: 2024-09-12T00:32:03.268 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:32:03.268 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:32:03.316 INFO:tasks.workunit.client.0.smithi138.stderr:5+0 records in 2024-09-12T00:32:03.316 INFO:tasks.workunit.client.0.smithi138.stderr:5+0 records out 2024-09-12T00:32:03.316 INFO:tasks.workunit.client.0.smithi138.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0223595 s, 234 MB/s 2024-09-12T00:32:03.322 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:32:03.322 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:32:03.402 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:32:03.402 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:32:03.531 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:32:03.531 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:32:03.655 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:32:03.655 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:32:03.783 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:32:03.783 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:32:03.904 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:32:03.904 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:32:04.033 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:32:04.034 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:32:04.164 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:32:04.164 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:32:04.296 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:32:04.297 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:32:04.424 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:32:04.424 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:32:04.551 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:32:04.551 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:32:04.679 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:32:04.679 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:32:04.816 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:32:04.816 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:32:04.943 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:32:04.943 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:32:05.053 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:32:05.053 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:32:05.131 INFO:tasks.workunit.client.0.smithi138.stdout:bucket nams is reupload-bkt-104469 2024-09-12T00:32:05.131 INFO:tasks.workunit.client.0.smithi138.stdout:endpoint is https://smithi138.front.sepia.ceph.com:443 2024-09-12T00:32:05.131 INFO:tasks.workunit.client.0.smithi138.stdout:start UploadId=2~Je7_4G4DGF0JNchvvp6KK4q0nRO5xkb 2024-09-12T00:32:05.131 INFO:tasks.workunit.client.0.smithi138.stdout:phase 1 uploaded part {'ETag': '"7a4a97d4e6db898b02479b761fc16b08"', 'PartNumber': 1} 2024-09-12T00:32:05.132 INFO:tasks.workunit.client.0.smithi138.stdout:phase 1 uploaded part {'ETag': '"7a4a97d4e6db898b02479b761fc16b08"', 'PartNumber': 2} 2024-09-12T00:32:05.132 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"7a4a97d4e6db898b02479b761fc16b08"', 'PartNumber': 1} 2024-09-12T00:32:05.132 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"7a4a97d4e6db898b02479b761fc16b08"', 'PartNumber': 1} 2024-09-12T00:32:05.132 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"7a4a97d4e6db898b02479b761fc16b08"', 'PartNumber': 1} 2024-09-12T00:32:05.132 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"7a4a97d4e6db898b02479b761fc16b08"', 'PartNumber': 1} 2024-09-12T00:32:05.132 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"7a4a97d4e6db898b02479b761fc16b08"', 'PartNumber': 1} 2024-09-12T00:32:05.132 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"7a4a97d4e6db898b02479b761fc16b08"', 'PartNumber': 1} 2024-09-12T00:32:05.132 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"7a4a97d4e6db898b02479b761fc16b08"', 'PartNumber': 1} 2024-09-12T00:32:05.132 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"7a4a97d4e6db898b02479b761fc16b08"', 'PartNumber': 1} 2024-09-12T00:32:05.133 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"7a4a97d4e6db898b02479b761fc16b08"', 'PartNumber': 1} 2024-09-12T00:32:05.133 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"7a4a97d4e6db898b02479b761fc16b08"', 'PartNumber': 1} 2024-09-12T00:32:05.133 INFO:tasks.workunit.client.0.smithi138.stdout:phase 2 uploaded part {'ETag': '"7a4a97d4e6db898b02479b761fc16b08"', 'PartNumber': 1} 2024-09-12T00:32:05.133 INFO:tasks.workunit.client.0.smithi138.stdout:completing multipart upload, parts=[{'ETag': '"7a4a97d4e6db898b02479b761fc16b08"', 'PartNumber': 1}, {'ETag': '"7a4a97d4e6db898b02479b761fc16b08"', 'PartNumber': 2}] 2024-09-12T00:32:06.710 INFO:tasks.workunit.client.0.smithi138.stdout:radosgw-admin bucket radoslist: 2024-09-12T00:32:06.711 INFO:tasks.workunit.client.0.smithi138.stdout:e2043445-c131-4520-984d-b4d52f038a6b.4538.3_mpu_test4 2024-09-12T00:32:06.711 INFO:tasks.workunit.client.0.smithi138.stdout:e2043445-c131-4520-984d-b4d52f038a6b.4538.3__multipart_mpu_test4.2~Je7_4G4DGF0JNchvvp6KK4q0nRO5xkb.2 2024-09-12T00:32:06.711 INFO:tasks.workunit.client.0.smithi138.stdout:e2043445-c131-4520-984d-b4d52f038a6b.4538.3__multipart_mpu_test4.H4EtIKOI_1id_CaetHOd2ghiHtGWCfde.1 2024-09-12T00:32:06.797 INFO:tasks.workunit.client.0.smithi138.stdout:rados ls: 2024-09-12T00:32:06.797 INFO:tasks.workunit.client.0.smithi138.stdout:e2043445-c131-4520-984d-b4d52f038a6b.4538.3_mpu_test4 2024-09-12T00:32:06.798 INFO:tasks.workunit.client.0.smithi138.stdout:e2043445-c131-4520-984d-b4d52f038a6b.4538.3__multipart_mpu_test4.2~Je7_4G4DGF0JNchvvp6KK4q0nRO5xkb.2 2024-09-12T00:32:06.798 INFO:tasks.workunit.client.0.smithi138.stdout:e2043445-c131-4520-984d-b4d52f038a6b.4538.3__multipart_mpu_test4.H4EtIKOI_1id_CaetHOd2ghiHtGWCfde.1 2024-09-12T00:32:06.811 INFO:tasks.workunit.client.0.smithi138.stdout:== PASSED == 2024-09-12T00:32:06.811 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:32:06.812 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:32:06.867 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T00:32:06.867 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:32:07.284 DEBUG:teuthology.parallel:result is None 2024-09-12T00:32:07.285 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:32:07.297 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:32:07.297 DEBUG:teuthology.orchestra.run.smithi138:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:32:07.343 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:32:07.343 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T00:32:07.366 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T00:32:07.367 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T00:32:07.367 INFO:tasks.ragweed:Using branch 'wip-67986' for ragweed 2024-09-12T00:32:07.367 DEBUG:teuthology.orchestra.run.smithi138:> git clone -b wip-67986 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:32:07.392 INFO:teuthology.orchestra.run.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T00:32:07.568 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T00:32:07.569 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T00:32:07.569 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key BJOKEJQSJXRFOVAAWYZB --secret 2vCX0fsvoCVede3d+fimMvK41MpZSqzWJRkhYRcaQpGeLdkb/U2Siw== --email ragweed.client.0+test@test.test --system false 2024-09-12T00:32:07.658 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:07.658 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:07.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.702+0000 7f6b1375b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:07.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.706+0000 7f6b1375b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:07.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.706+0000 7f6b1375b9c0 20 realm 2024-09-12T00:32:07.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.706+0000 7f6b1375b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:07.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.706+0000 7f6b1375b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:07.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.706+0000 7f6b1375b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:07.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.706+0000 7f6b1375b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:07.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.706+0000 7f6b1375b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:07.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.706+0000 7f6b1375b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:07.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.706+0000 7f6b1375b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:07.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.706+0000 7f6b1375b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:07.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.706+0000 7f6b1375b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:07.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.706+0000 7f6b1375b9c0 20 searching for the correct realm 2024-09-12T00:32:07.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.714+0000 7f6b11a62640 0 -- 172.21.15.138:0/693094956 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f6b0c025920 msgr2=0x7f6b0c017410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:07.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.930+0000 7f6b11a62640 0 -- 172.21.15.138:0/693094956 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x56077cfac380 msgr2=0x56077cfae840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.938+0000 7f6b1375b9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:32:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.938+0000 7f6b1375b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.938+0000 7f6b1375b9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:32:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.938+0000 7f6b1375b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.938+0000 7f6b1375b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.938+0000 7f6b1375b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.938+0000 7f6b1375b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:07.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:07.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:07.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:07.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:07.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:07.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 20 zone default found 2024-09-12T00:32:07.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 4 Realm: () 2024-09-12T00:32:07.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:32:07.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:32:07.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:07.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 20 zonegroup default 2024-09-12T00:32:07.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:07.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:07.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:07.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:07.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:07.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:07.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 20 started sync module instance, tier type = 2024-09-12T00:32:07.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.942+0000 7f6b1375b9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:32:07.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.966+0000 7f6b1375b9c0 20 add_watcher() i=0 2024-09-12T00:32:07.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.966+0000 7f6b1375b9c0 20 add_watcher() i=1 2024-09-12T00:32:07.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.966+0000 7f6b1375b9c0 20 add_watcher() i=2 2024-09-12T00:32:07.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.966+0000 7f6b1375b9c0 20 add_watcher() i=3 2024-09-12T00:32:07.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.966+0000 7f6b1375b9c0 20 add_watcher() i=4 2024-09-12T00:32:07.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.966+0000 7f6b1375b9c0 20 add_watcher() i=5 2024-09-12T00:32:07.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.966+0000 7f6b1375b9c0 20 add_watcher() i=6 2024-09-12T00:32:07.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.970+0000 7f6b1375b9c0 20 add_watcher() i=7 2024-09-12T00:32:07.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.970+0000 7f6b1375b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:07.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.974+0000 7f69c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:07.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.974+0000 7f6b1375b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:07.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.974+0000 7f6b1375b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:07.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.974+0000 7f6b1375b9c0 5 note: GC not initialized 2024-09-12T00:32:07.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.974+0000 7f69c67e4640 20 reqs_thread_entry: start 2024-09-12T00:32:07.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.974+0000 7f6b1375b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:07.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.974+0000 7f6b1375b9c0 20 Filter name: none 2024-09-12T00:32:07.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.974+0000 7f6937fff640 20 reqs_thread_entry: start 2024-09-12T00:32:07.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.974+0000 7f6b1375b9c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:32:07.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.974+0000 7f6b1375b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:07.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:07.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T00:32:07.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:32:07.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T00:32:07.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:07.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:07.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T00:32:07.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:32:07.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 10 cache get: name=default.rgw.meta+users.keys+BJOKEJQSJXRFOVAAWYZB : miss 2024-09-12T00:32:07.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:07.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:07.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 10 cache put: name=default.rgw.meta+users.keys+BJOKEJQSJXRFOVAAWYZB info.flags=0x0 2024-09-12T00:32:07.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 10 adding default.rgw.meta+users.keys+BJOKEJQSJXRFOVAAWYZB to cache LRU end 2024-09-12T00:32:07.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 10 cache get: name=default.rgw.meta+users.keys+BJOKEJQSJXRFOVAAWYZB : hit (negative entry) 2024-09-12T00:32:07.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 10 cache get: name=default.rgw.meta+users.keys+BJOKEJQSJXRFOVAAWYZB : hit (negative entry) 2024-09-12T00:32:07.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:32:07.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:32:07.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f6b1375b9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:32:07.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f69f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529715 cookie 94590161594384 notifier 5609 bl.length()=675 2024-09-12T00:32:07.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f69f4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:32:07.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.978+0000 7f69f4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:32:07.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.982+0000 7f6b1375b9c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:32:07.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.982+0000 7f6b1375b9c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:32:07.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.982+0000 7f6b1375b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:32:07.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.982+0000 7f69f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529674 cookie 94590161576816 notifier 5609 bl.length()=202 2024-09-12T00:32:07.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.982+0000 7f69f4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:32:07.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.982+0000 7f69f4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:32:07.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.986+0000 7f6b1375b9c0 10 cache put: name=default.rgw.meta+users.keys+BJOKEJQSJXRFOVAAWYZB info.flags=0x7 2024-09-12T00:32:07.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.986+0000 7f6b1375b9c0 10 moving default.rgw.meta+users.keys+BJOKEJQSJXRFOVAAWYZB to cache LRU end 2024-09-12T00:32:07.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.986+0000 7f6b1375b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:BJOKEJQSJXRFOVAAWYZB, ofs0, ns] 2024-09-12T00:32:07.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.986+0000 7f69e3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529730 cookie 94590161591408 notifier 5609 bl.length()=190 2024-09-12T00:32:07.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.986+0000 7f69e3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BJOKEJQSJXRFOVAAWYZB info.flags=0x7 2024-09-12T00:32:07.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.986+0000 7f69e3fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BJOKEJQSJXRFOVAAWYZB to cache LRU end 2024-09-12T00:32:07.984 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T00:32:07.984 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "ragweed.client.0", 2024-09-12T00:32:07.984 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T00:32:07.984 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T00:32:07.985 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-12T00:32:07.985 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-12T00:32:07.985 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-12T00:32:07.985 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-12T00:32:07.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-12T00:32:07.985 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "ragweed.client.0", 2024-09-12T00:32:07.985 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "BJOKEJQSJXRFOVAAWYZB", 2024-09-12T00:32:07.985 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "2vCX0fsvoCVede3d+fimMvK41MpZSqzWJRkhYRcaQpGeLdkb/U2Siw==", 2024-09-12T00:32:07.985 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-12T00:32:07.985 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:32:07.980829Z" 2024-09-12T00:32:07.985 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-12T00:32:07.985 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-12T00:32:07.986 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-12T00:32:07.986 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-12T00:32:07.986 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-12T00:32:07.986 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-12T00:32:07.986 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-12T00:32:07.986 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-12T00:32:07.986 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-12T00:32:07.986 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:32:07.986 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:32:07.986 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:32:07.986 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:32:07.986 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:32:07.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:32:07.987 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-12T00:32:07.987 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:32:07.987 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:32:07.987 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:32:07.987 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:32:07.987 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:32:07.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:32:07.987 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-12T00:32:07.987 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "rgw", 2024-09-12T00:32:07.987 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-12T00:32:07.987 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "", 2024-09-12T00:32:07.987 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-12T00:32:07.987 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:32:07.980794Z", 2024-09-12T00:32:07.987 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-12T00:32:07.988 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-12T00:32:07.988 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T00:32:07.988 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:32:07.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.990+0000 7f69c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:07.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.994+0000 7f6b1375b9c0 20 remove_watcher() i=0 2024-09-12T00:32:07.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.994+0000 7f6b1375b9c0 2 removed watcher, disabling cache 2024-09-12T00:32:07.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.998+0000 7f6b1375b9c0 20 remove_watcher() i=1 2024-09-12T00:32:07.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:07.998+0000 7f6b1375b9c0 20 remove_watcher() i=2 2024-09-12T00:32:07.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.002+0000 7f6b1375b9c0 20 remove_watcher() i=3 2024-09-12T00:32:07.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.002+0000 7f6b1375b9c0 20 remove_watcher() i=4 2024-09-12T00:32:08.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.006+0000 7f6b1375b9c0 20 remove_watcher() i=5 2024-09-12T00:32:08.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.006+0000 7f6b1375b9c0 20 remove_watcher() i=6 2024-09-12T00:32:08.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.010+0000 7f6b1375b9c0 20 remove_watcher() i=7 2024-09-12T00:32:08.020 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T00:32:08.020 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key HBEMHDTVFGZEUUMEPMBZ --secret Z6PQjdSewjpWKVVNQyiP/M+YrztLvLWv37J+wOEBCoAREHOSFpPPrA== --email sysuser.client.0+test@test.test --system true 2024-09-12T00:32:08.066 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:08.066 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:08.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.110+0000 7f2ee4eca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:08.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.110+0000 7f2ee4eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:08.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.110+0000 7f2ee4eca9c0 20 realm 2024-09-12T00:32:08.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.110+0000 7f2ee4eca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:08.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.110+0000 7f2ee4eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:08.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.110+0000 7f2ee4eca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:08.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.110+0000 7f2ee4eca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:08.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.110+0000 7f2ee4eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:08.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.110+0000 7f2ee4eca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:08.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.110+0000 7f2ee4eca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:08.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.110+0000 7f2ee4eca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:08.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.114+0000 7f2ee4eca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:08.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.114+0000 7f2ee4eca9c0 20 searching for the correct realm 2024-09-12T00:32:08.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.118+0000 7f2ee31d1640 0 -- 172.21.15.138:0/2287764955 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f2ecc07d230 msgr2=0x7f2ecc078640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:08.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.126+0000 7f2ee31d1640 0 -- 172.21.15.138:0/2287764955 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x557677292e00 msgr2=0x5576772952c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:08.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.130+0000 7f2ee4eca9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:32:08.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.130+0000 7f2ee4eca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:08.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.130+0000 7f2ee4eca9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:32:08.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.130+0000 7f2ee4eca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:08.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.130+0000 7f2ee4eca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:08.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.130+0000 7f2ee4eca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:08.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.130+0000 7f2ee4eca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:08.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.130+0000 7f2ee4eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:08.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.130+0000 7f2ee4eca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:08.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.130+0000 7f2ee4eca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:08.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.130+0000 7f2ee4eca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:08.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.134+0000 7f2ee4eca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:08.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.134+0000 7f2ee4eca9c0 20 zone default found 2024-09-12T00:32:08.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.134+0000 7f2ee4eca9c0 4 Realm: () 2024-09-12T00:32:08.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.134+0000 7f2ee4eca9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:32:08.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.134+0000 7f2ee4eca9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:32:08.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.134+0000 7f2ee4eca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:08.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.134+0000 7f2ee4eca9c0 20 zonegroup default 2024-09-12T00:32:08.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.134+0000 7f2ee4eca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:08.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.134+0000 7f2ee4eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:08.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.134+0000 7f2ee4eca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:08.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.134+0000 7f2ee4eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:08.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.134+0000 7f2ee4eca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:08.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.134+0000 7f2ee4eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:08.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.134+0000 7f2ee4eca9c0 20 started sync module instance, tier type = 2024-09-12T00:32:08.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.134+0000 7f2ee4eca9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:32:08.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.150+0000 7f2ee4eca9c0 20 add_watcher() i=0 2024-09-12T00:32:08.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.150+0000 7f2ee4eca9c0 20 add_watcher() i=1 2024-09-12T00:32:08.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.150+0000 7f2ee4eca9c0 20 add_watcher() i=2 2024-09-12T00:32:08.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.150+0000 7f2ee4eca9c0 20 add_watcher() i=3 2024-09-12T00:32:08.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.150+0000 7f2ee4eca9c0 20 add_watcher() i=4 2024-09-12T00:32:08.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.150+0000 7f2ee4eca9c0 20 add_watcher() i=5 2024-09-12T00:32:08.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.150+0000 7f2ee4eca9c0 20 add_watcher() i=6 2024-09-12T00:32:08.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.154+0000 7f2ee4eca9c0 20 add_watcher() i=7 2024-09-12T00:32:08.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.154+0000 7f2ee4eca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:08.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2d937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:08.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:08.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:08.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 5 note: GC not initialized 2024-09-12T00:32:08.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2d927fc640 20 reqs_thread_entry: start 2024-09-12T00:32:08.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:08.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 20 Filter name: none 2024-09-12T00:32:08.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2d03fff640 20 reqs_thread_entry: start 2024-09-12T00:32:08.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:32:08.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:08.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:08.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T00:32:08.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:32:08.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T00:32:08.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:08.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:08.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T00:32:08.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:32:08.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 10 cache get: name=default.rgw.meta+users.keys+HBEMHDTVFGZEUUMEPMBZ : miss 2024-09-12T00:32:08.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:08.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:08.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 10 cache put: name=default.rgw.meta+users.keys+HBEMHDTVFGZEUUMEPMBZ info.flags=0x0 2024-09-12T00:32:08.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 10 adding default.rgw.meta+users.keys+HBEMHDTVFGZEUUMEPMBZ to cache LRU end 2024-09-12T00:32:08.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 10 cache get: name=default.rgw.meta+users.keys+HBEMHDTVFGZEUUMEPMBZ : hit (negative entry) 2024-09-12T00:32:08.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.158+0000 7f2ee4eca9c0 10 cache get: name=default.rgw.meta+users.keys+HBEMHDTVFGZEUUMEPMBZ : hit (negative entry) 2024-09-12T00:32:08.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.162+0000 7f2ee4eca9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:32:08.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.162+0000 7f2ee4eca9c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:32:08.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.162+0000 7f2ee4eca9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:32:08.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.162+0000 7f2dc57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529675 cookie 93967293706816 notifier 5964 bl.length()=675 2024-09-12T00:32:08.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.162+0000 7f2dc57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:32:08.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.162+0000 7f2dc57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:32:08.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.166+0000 7f2ee4eca9c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:32:08.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.166+0000 7f2ee4eca9c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:32:08.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.166+0000 7f2ee4eca9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:32:08.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.166+0000 7f2dc4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529716 cookie 93967293714800 notifier 5964 bl.length()=202 2024-09-12T00:32:08.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.166+0000 7f2dc4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:32:08.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.166+0000 7f2dc4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:32:08.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.170+0000 7f2ee4eca9c0 10 cache put: name=default.rgw.meta+users.keys+HBEMHDTVFGZEUUMEPMBZ info.flags=0x7 2024-09-12T00:32:08.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.170+0000 7f2ee4eca9c0 10 moving default.rgw.meta+users.keys+HBEMHDTVFGZEUUMEPMBZ to cache LRU end 2024-09-12T00:32:08.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.170+0000 7f2ee4eca9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:HBEMHDTVFGZEUUMEPMBZ, ofs0, ns] 2024-09-12T00:32:08.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.170+0000 7f2dc57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529676 cookie 93967293706816 notifier 5964 bl.length()=190 2024-09-12T00:32:08.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.170+0000 7f2dc57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+HBEMHDTVFGZEUUMEPMBZ info.flags=0x7 2024-09-12T00:32:08.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.170+0000 7f2dc57fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+HBEMHDTVFGZEUUMEPMBZ to cache LRU end 2024-09-12T00:32:08.166 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T00:32:08.166 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "sysuser.client.0", 2024-09-12T00:32:08.166 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T00:32:08.167 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T00:32:08.167 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-12T00:32:08.167 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-12T00:32:08.167 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-12T00:32:08.167 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-12T00:32:08.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-12T00:32:08.168 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "sysuser.client.0", 2024-09-12T00:32:08.168 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "HBEMHDTVFGZEUUMEPMBZ", 2024-09-12T00:32:08.168 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "Z6PQjdSewjpWKVVNQyiP/M+YrztLvLWv37J+wOEBCoAREHOSFpPPrA==", 2024-09-12T00:32:08.168 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-12T00:32:08.168 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:32:08.162462Z" 2024-09-12T00:32:08.168 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-12T00:32:08.168 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-12T00:32:08.168 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-12T00:32:08.168 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-12T00:32:08.168 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-12T00:32:08.168 INFO:teuthology.orchestra.run.smithi138.stdout: "system": true, 2024-09-12T00:32:08.168 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-12T00:32:08.169 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-12T00:32:08.169 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-12T00:32:08.169 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-12T00:32:08.169 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:32:08.169 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:32:08.169 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:32:08.169 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:32:08.169 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:32:08.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:32:08.169 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-12T00:32:08.169 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:32:08.169 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:32:08.169 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:32:08.170 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:32:08.170 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:32:08.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:32:08.170 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-12T00:32:08.170 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "rgw", 2024-09-12T00:32:08.170 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-12T00:32:08.170 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "", 2024-09-12T00:32:08.170 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-12T00:32:08.170 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:32:08.162451Z", 2024-09-12T00:32:08.170 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-12T00:32:08.170 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-12T00:32:08.171 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T00:32:08.171 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:32:08.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.170+0000 7f2d937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:08.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.174+0000 7f2ee4eca9c0 20 remove_watcher() i=0 2024-09-12T00:32:08.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.174+0000 7f2ee4eca9c0 2 removed watcher, disabling cache 2024-09-12T00:32:08.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.174+0000 7f2ee4eca9c0 20 remove_watcher() i=1 2024-09-12T00:32:08.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.178+0000 7f2ee4eca9c0 20 remove_watcher() i=2 2024-09-12T00:32:08.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.178+0000 7f2ee4eca9c0 20 remove_watcher() i=3 2024-09-12T00:32:08.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.182+0000 7f2ee4eca9c0 20 remove_watcher() i=4 2024-09-12T00:32:08.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.182+0000 7f2ee4eca9c0 20 remove_watcher() i=5 2024-09-12T00:32:08.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.186+0000 7f2ee4eca9c0 20 remove_watcher() i=6 2024-09-12T00:32:08.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:08.190+0000 7f2ee4eca9c0 20 remove_watcher() i=7 2024-09-12T00:32:08.195 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T00:32:08.195 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:32:08.195 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T00:32:08.200 INFO:tasks.ragweed:Configuring boto... 2024-09-12T00:32:08.201 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:32:08.201 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T00:32:08.247 DEBUG:teuthology.orchestra.run.smithi138:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T00:32:08.421 INFO:teuthology.orchestra.run.smithi138.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T00:32:08.605 INFO:teuthology.orchestra.run.smithi138.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T00:32:09.198 INFO:teuthology.orchestra.run.smithi138.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:32:11.846 INFO:teuthology.orchestra.run.smithi138.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T00:32:16.041 INFO:teuthology.orchestra.run.smithi138.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=c1162184df5c8de87366e06942b76acd651bc3896fb4dcd5af21ae0d9b531a17,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-12T00:32:16.041 INFO:teuthology.orchestra.run.smithi138.stdout:py run-test-pre: PYTHONHASHSEED='1278606960' 2024-09-12T00:32:16.041 INFO:teuthology.orchestra.run.smithi138.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T00:32:16.214 INFO:teuthology.orchestra.run.smithi138.stdout:============================= test session starts ============================== 2024-09-12T00:32:16.214 INFO:teuthology.orchestra.run.smithi138.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T00:32:16.214 INFO:teuthology.orchestra.run.smithi138.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:32:16.215 INFO:teuthology.orchestra.run.smithi138.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-12T00:32:16.370 INFO:teuthology.orchestra.run.smithi138.stdout:collecting ... collected 9 items 2024-09-12T00:32:16.370 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:32:18.594 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T00:32:19.937 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T00:32:21.131 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T00:32:22.323 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T00:32:23.430 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T00:32:30.393 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T00:32:32.748 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T00:32:35.774 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T00:32:40.448 INFO:teuthology.orchestra.run.smithi138.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T00:32:40.448 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:32:40.448 INFO:teuthology.orchestra.run.smithi138.stdout:=============================== warnings summary =============================== 2024-09-12T00:32:40.448 INFO:teuthology.orchestra.run.smithi138.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T00:32:40.449 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T00:32:40.449 INFO:teuthology.orchestra.run.smithi138.stdout: import imp 2024-09-12T00:32:40.449 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:32:40.449 INFO:teuthology.orchestra.run.smithi138.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-12T00:32:40.449 INFO:teuthology.orchestra.run.smithi138.stdout:======================== 9 passed, 1 warning in 24.23s ========================= 2024-09-12T00:32:40.495 INFO:teuthology.orchestra.run.smithi138.stdout:___________________________________ summary ____________________________________ 2024-09-12T00:32:40.495 INFO:teuthology.orchestra.run.smithi138.stdout: py: commands succeeded 2024-09-12T00:32:40.495 INFO:teuthology.orchestra.run.smithi138.stdout: congratulations :) 2024-09-12T00:32:40.526 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T00:32:40.527 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T00:32:40.533 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T00:32:40.611 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:40.611 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:40.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.653+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.657+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.657+0000 7f996682d9c0 20 realm 2024-09-12T00:32:40.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.657+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.657+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.657+0000 7f996682d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:40.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.657+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.657+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.657+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.657+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:40.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.657+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.661+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:40.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.661+0000 7f996682d9c0 20 searching for the correct realm 2024-09-12T00:32:40.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.665+0000 7f9964b34640 0 -- 172.21.15.138:0/3552798222 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x558f68e8bcc0 msgr2=0x558f68e8e180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:40.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.669+0000 7f9963b32640 0 -- 172.21.15.138:0/3552798222 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x558f68e86fb0 msgr2=0x558f68e893a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:40.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:32:40.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:40.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:32:40.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:40.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:40.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:40.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:40.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:40.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 20 zone default found 2024-09-12T00:32:40.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 4 Realm: () 2024-09-12T00:32:40.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:32:40.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:32:40.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:40.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 20 zonegroup default 2024-09-12T00:32:40.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.677+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.681+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.681+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.681+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.681+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.681+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.681+0000 7f996682d9c0 20 started sync module instance, tier type = 2024-09-12T00:32:40.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.681+0000 7f996682d9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:32:40.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.697+0000 7f996682d9c0 20 add_watcher() i=0 2024-09-12T00:32:40.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.697+0000 7f996682d9c0 20 add_watcher() i=1 2024-09-12T00:32:40.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.697+0000 7f996682d9c0 20 add_watcher() i=2 2024-09-12T00:32:40.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.697+0000 7f996682d9c0 20 add_watcher() i=3 2024-09-12T00:32:40.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.697+0000 7f996682d9c0 20 add_watcher() i=4 2024-09-12T00:32:40.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.697+0000 7f996682d9c0 20 add_watcher() i=5 2024-09-12T00:32:40.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.697+0000 7f996682d9c0 20 add_watcher() i=6 2024-09-12T00:32:40.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.701+0000 7f996682d9c0 20 add_watcher() i=7 2024-09-12T00:32:40.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.701+0000 7f996682d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:40.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.705+0000 7f981afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:40.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.705+0000 7f996682d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:40.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.705+0000 7f996682d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:40.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.781+0000 7f9819fdb640 20 reqs_thread_entry: start 2024-09-12T00:32:40.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.781+0000 7f996682d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:40.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.781+0000 7f996682d9c0 20 Filter name: none 2024-09-12T00:32:40.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.781+0000 7f978b7fe640 20 reqs_thread_entry: start 2024-09-12T00:32:40.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.781+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:32:40.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.781+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.785+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:32:40.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.785+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T00:32:40.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.785+0000 7f996682d9c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:32:40.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.785+0000 7f996682d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:40.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.785+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:e2043445-c131-4520-984d-b4d52f038a6b.4538.4 : miss 2024-09-12T00:32:40.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.785+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.785+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T00:32:40.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.785+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:e2043445-c131-4520-984d-b4d52f038a6b.4538.4 info.flags=0x17 2024-09-12T00:32:40.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.785+0000 7f996682d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:e2043445-c131-4520-984d-b4d52f038a6b.4538.4 to cache LRU end 2024-09-12T00:32:40.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.785+0000 7f996682d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:40.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.785+0000 7f996682d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:32:40.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.785+0000 7f996682d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:e2043445-c131-4520-984d-b4d52f038a6b.4538.4 2024-09-12T00:32:40.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.789+0000 7f996682d9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:32:40.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.789+0000 7f996682d9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T00:32:40.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.789+0000 7f996682d9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T00:32:40.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.789+0000 7f996682d9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T00:32:40.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.789+0000 7f996682d9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T00:32:40.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.789+0000 7f996682d9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T00:32:40.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.789+0000 7f996682d9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T00:32:40.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.793+0000 7f996682d9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T00:32:40.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.793+0000 7f996682d9c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T00:32:40.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.793+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995405cdb0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.793+0000 7f996682d9c0 10 manifest: total_size = 5091 2024-09-12T00:32:40.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.793+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.13600555981558945854 2024-09-12T00:32:40.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.793+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995405cdb0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.793+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68f3aa28 2024-09-12T00:32:40.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.793+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.4.1 2024-09-12T00:32:40.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.801+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:40.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.801+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5091 stripe_ofs=5091 part_ofs=0 rule->part_size=0 2024-09-12T00:32:40.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.801+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.13600555981558945854 2024-09-12T00:32:40.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.801+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:40.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.801+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.V3knmeUrwBVxzXN8vDUDubjxwNlas-p_0 2024-09-12T00:32:40.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.801+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:32:40.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.801+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:40.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.801+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.13600555981558945854 2024-09-12T00:32:40.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.805+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:32:40.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.805+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995405cdb0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.805+0000 7f996682d9c0 10 manifest: total_size = 5089 2024-09-12T00:32:40.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.805+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.3733127249162896797 2024-09-12T00:32:40.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.805+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995405cdb0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.805+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68f3aa28 2024-09-12T00:32:40.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.805+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.4.2 2024-09-12T00:32:40.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.809+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:40.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.809+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5089 stripe_ofs=5089 part_ofs=0 rule->part_size=0 2024-09-12T00:32:40.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.809+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.3733127249162896797 2024-09-12T00:32:40.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.809+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:40.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.809+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.O3H0DPqSQCI_fR8UVBjHv4HZcN9ciP4_0 2024-09-12T00:32:40.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.809+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:32:40.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.809+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:40.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.809+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.3733127249162896797 2024-09-12T00:32:40.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.813+0000 7f983affd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T00:32:40.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.813+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68f3c140 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.813+0000 7f996682d9c0 10 manifest: total_size = 5251 2024-09-12T00:32:40.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.813+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.5646217842240486457 2024-09-12T00:32:40.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.813+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68f3c140 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.813+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68f3aa28 2024-09-12T00:32:40.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.813+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.4.2 2024-09-12T00:32:40.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.817+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:40.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.817+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5251 stripe_ofs=5251 part_ofs=0 rule->part_size=0 2024-09-12T00:32:40.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.817+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.5646217842240486457 2024-09-12T00:32:40.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.817+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:40.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.817+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.drgdmevXATq9FQwMt-i3-9G8fAUHW_b_0 2024-09-12T00:32:40.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.817+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:32:40.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.817+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:40.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.817+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.5646217842240486457 2024-09-12T00:32:40.816 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.821+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68f3bb50 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.821+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T00:32:40.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.821+0000 7f996682d9c0 10 manifest: total_size = 5218 2024-09-12T00:32:40.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.821+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.8483166802481019742 2024-09-12T00:32:40.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.821+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68f3bb50 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.821+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68f3aa28 2024-09-12T00:32:40.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.821+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.4.3 2024-09-12T00:32:40.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.825+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:40.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.825+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5218 stripe_ofs=5218 part_ofs=0 rule->part_size=0 2024-09-12T00:32:40.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.825+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.8483166802481019742 2024-09-12T00:32:40.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.825+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:40.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.825+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.xSkpAdpSRGCPchNhieV-_LpG0YObQ6d_0 2024-09-12T00:32:40.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.825+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:32:40.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.825+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:40.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.825+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.8483166802481019742 2024-09-12T00:32:40.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.829+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68f3c140 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.829+0000 7f996682d9c0 10 manifest: total_size = 7548 2024-09-12T00:32:40.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.829+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.12838419454642460139 2024-09-12T00:32:40.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.829+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68f3c140 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.829+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68f3aa28 2024-09-12T00:32:40.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.829+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.4.4 2024-09-12T00:32:40.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.829+0000 7f983affd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T00:32:40.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.833+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:40.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.833+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=7548 stripe_ofs=7548 part_ofs=0 rule->part_size=0 2024-09-12T00:32:40.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.833+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.12838419454642460139 2024-09-12T00:32:40.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.833+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:40.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.833+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.smYEdzrKQw_sPiDZSGlIu9iY1QKrTQ7_0 2024-09-12T00:32:40.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.833+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:32:40.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.833+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:40.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.833+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.12838419454642460139 2024-09-12T00:32:40.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.833+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T00:32:40.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.837+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0b8d70 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.837+0000 7f996682d9c0 10 manifest: total_size = 13593 2024-09-12T00:32:40.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.837+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.17586532457386590059 2024-09-12T00:32:40.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.837+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0b8d70 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.837+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68f3aa28 2024-09-12T00:32:40.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.837+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.4.4 2024-09-12T00:32:40.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.841+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:40.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.841+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=13593 stripe_ofs=13593 part_ofs=0 rule->part_size=0 2024-09-12T00:32:40.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.841+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.17586532457386590059 2024-09-12T00:32:40.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.841+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:40.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.841+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.hO0c6PAwCtjp3wG-taqv6YrctbmzeV8_0 2024-09-12T00:32:40.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.841+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:32:40.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.841+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:40.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.841+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.17586532457386590059 2024-09-12T00:32:40.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.841+0000 7f983affd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T00:32:40.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.841+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68ec4230 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.841+0000 7f996682d9c0 10 manifest: total_size = 4909 2024-09-12T00:32:40.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.841+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.13532773913651647958 2024-09-12T00:32:40.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.841+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68ec4230 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.841+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68f3aa28 2024-09-12T00:32:40.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.841+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.4.5 2024-09-12T00:32:40.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.849+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:40.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.849+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=4909 stripe_ofs=4909 part_ofs=0 rule->part_size=0 2024-09-12T00:32:40.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.849+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.13532773913651647958 2024-09-12T00:32:40.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.849+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:40.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.849+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.cmVeQo4vVY6HX5GLa1x8cMsz6oqa_oy_0 2024-09-12T00:32:40.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.849+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:32:40.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.849+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:40.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.849+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.13532773913651647958 2024-09-12T00:32:40.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.849+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T00:32:40.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.849+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0b8d70 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.849+0000 7f996682d9c0 10 manifest: total_size = 5391 2024-09-12T00:32:40.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.849+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.2901422447214724617 2024-09-12T00:32:40.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.849+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0b8d70 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.849+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68f3aa28 2024-09-12T00:32:40.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.849+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.4.7 2024-09-12T00:32:40.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.857+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:40.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.857+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5391 stripe_ofs=5391 part_ofs=0 rule->part_size=0 2024-09-12T00:32:40.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.857+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.2901422447214724617 2024-09-12T00:32:40.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.857+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:40.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.857+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.DGp0Cwqlu4h-ZRI0vGD8IPUKT_nbNTY_0 2024-09-12T00:32:40.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.857+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:32:40.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.857+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:40.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.857+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.2901422447214724617 2024-09-12T00:32:40.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.861+0000 7f983affd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T00:32:40.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.861+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0e6f80 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.861+0000 7f996682d9c0 10 manifest: total_size = 7766 2024-09-12T00:32:40.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.861+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.17925227288810102824 2024-09-12T00:32:40.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.861+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0e6f80 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x558f68f3aa28 s->prefetch_data=0 2024-09-12T00:32:40.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.861+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68f3aa28 2024-09-12T00:32:40.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.861+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.4.8 2024-09-12T00:32:40.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.865+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:40.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.865+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=7766 stripe_ofs=7766 part_ofs=0 rule->part_size=0 2024-09-12T00:32:40.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.865+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.17925227288810102824 2024-09-12T00:32:40.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.865+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:40.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.865+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.S5YSG15_AKqu1-vYbfcD5Z2U-HXa816_0 2024-09-12T00:32:40.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.865+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:32:40.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.865+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:40.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.865+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.17925227288810102824 2024-09-12T00:32:40.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.869+0000 7f996682d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:32:40.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.869+0000 7f996682d9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:32:40.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.869+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T00:32:40.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.869+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:32:40.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.869+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:32:40.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.869+0000 7f996682d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:32:40.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.869+0000 7f996682d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:32:40.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.869+0000 7f996682d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[e2043445-c131-4520-984d-b4d52f038a6b.4538.4])"; uploads.size()=0; is_truncated=0 2024-09-12T00:32:40.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.873+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T00:32:40.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.873+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.877+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T00:32:40.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.877+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T00:32:40.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.877+0000 7f996682d9c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T00:32:40.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.877+0000 7f996682d9c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T00:32:40.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.877+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T00:32:40.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.877+0000 7f983b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333459 cookie 94074428753312 notifier 6000 bl.length()=162 2024-09-12T00:32:40.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.881+0000 7f996682d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:e2043445-c131-4520-984d-b4d52f038a6b.4538.4 from cache 2024-09-12T00:32:40.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.881+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:e2043445-c131-4520-984d-b4d52f038a6b.4538.4, ofs0, ns] 2024-09-12T00:32:40.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.881+0000 7f983affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333515 cookie 94074428782464 notifier 6000 bl.length()=219 2024-09-12T00:32:40.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.889+0000 7f996682d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/e2043445-c131-4520-984d-b4d52f038a6b.4538.4 : miss 2024-09-12T00:32:40.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.889+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.889+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.889+0000 7f996682d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/e2043445-c131-4520-984d-b4d52f038a6b.4538.4 info.flags=0x0 2024-09-12T00:32:40.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.889+0000 7f996682d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/e2043445-c131-4520-984d-b4d52f038a6b.4538.4 to cache LRU end 2024-09-12T00:32:40.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.893+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.11 : miss 2024-09-12T00:32:40.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.893+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.897+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T00:32:40.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.897+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.11 info.flags=0x17 2024-09-12T00:32:40.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.897+0000 7f996682d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.11 to cache LRU end 2024-09-12T00:32:40.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.897+0000 7f996682d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:40.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.897+0000 7f996682d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:32:40.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.897+0000 7f996682d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.11 2024-09-12T00:32:40.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.905+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:32:40.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.905+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0b8d70 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x558f68ec8368 s->prefetch_data=0 2024-09-12T00:32:40.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.905+0000 7f996682d9c0 10 manifest: total_size = 18874368 2024-09-12T00:32:40.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.905+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.17149201718960481642 2024-09-12T00:32:40.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.905+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0b8d70 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x558f68ec8368 s->prefetch_data=0 2024-09-12T00:32:40.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.905+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ec8368 2024-09-12T00:32:40.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.905+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.11.10 2024-09-12T00:32:40.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:32:40.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:32:40.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:32:40.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:32:40.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:32:40.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:32:40.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:32:40.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:32:40.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T00:32:40.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T00:32:40.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-12T00:32:40.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T00:32:40.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.17149201718960481642 2024-09-12T00:32:40.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:40.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.11__multipart_foo.2~yFIawm4Cml9QlqvSLxUhOYK--iD7TE8.1 2024-09-12T00:32:40.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T00:32:40.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.11__multipart_foo.2~yFIawm4Cml9QlqvSLxUhOYK--iD7TE8.2 2024-09-12T00:32:40.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T00:32:40.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.11__multipart_foo.2~yFIawm4Cml9QlqvSLxUhOYK--iD7TE8.3 2024-09-12T00:32:40.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T00:32:40.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.11__multipart_foo.2~yFIawm4Cml9QlqvSLxUhOYK--iD7TE8.4 2024-09-12T00:32:40.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T00:32:40.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:40.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.913+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.17149201718960481642 2024-09-12T00:32:40.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.917+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:32:40.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.917+0000 7f996682d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:32:40.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.917+0000 7f996682d9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:32:40.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.917+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:32:40.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.917+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:32:40.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.917+0000 7f996682d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:32:40.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.917+0000 7f996682d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:32:40.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.917+0000 7f996682d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[e2043445-c131-4520-984d-b4d52f038a6b.4538.11])"; uploads.size()=0; is_truncated=0 2024-09-12T00:32:40.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.921+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T00:32:40.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.921+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.921+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T00:32:40.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.921+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T00:32:40.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.921+0000 7f996682d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T00:32:40.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.925+0000 7f996682d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T00:32:40.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.925+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T00:32:40.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.925+0000 7f983affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333502 cookie 94074428770912 notifier 6000 bl.length()=191 2024-09-12T00:32:40.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.925+0000 7f996682d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.11 from cache 2024-09-12T00:32:40.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.925+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.11, ofs0, ns] 2024-09-12T00:32:40.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.925+0000 7f983b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333503 cookie 94074428770912 notifier 6000 bl.length()=249 2024-09-12T00:32:40.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.933+0000 7f996682d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.11 : miss 2024-09-12T00:32:40.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.933+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.933+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.933+0000 7f996682d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.11 info.flags=0x0 2024-09-12T00:32:40.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.933+0000 7f996682d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.11 to cache LRU end 2024-09-12T00:32:40.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.937+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.12 : miss 2024-09-12T00:32:40.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.937+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.941+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T00:32:40.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.941+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.12 info.flags=0x17 2024-09-12T00:32:40.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.941+0000 7f996682d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.12 to cache LRU end 2024-09-12T00:32:40.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.941+0000 7f996682d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:40.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.941+0000 7f996682d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:32:40.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.941+0000 7f996682d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.12 2024-09-12T00:32:40.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.949+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:32:40.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.949+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68e93840 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:40.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.949+0000 7f996682d9c0 10 manifest: total_size = 74198 2024-09-12T00:32:40.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.949+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.7564356551748226200 2024-09-12T00:32:40.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.949+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68e93840 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:40.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.949+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ebda98 2024-09-12T00:32:40.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.949+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.12.10 2024-09-12T00:32:40.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:32:40.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-12T00:32:40.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:32:40.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:32:40.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-12T00:32:40.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T00:32:40.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:32:40.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=20613 2024-09-12T00:32:40.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T00:32:40.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T00:32:40.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6353295 part_ofs=61839 rule->part_size=12359 2024-09-12T00:32:40.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T00:32:40.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.7564356551748226200 2024-09-12T00:32:40.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:40.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.12__multipart_foo.2~JCUEe7dAbd0crx3qhgtQDmXcAmc0eTr.1 2024-09-12T00:32:40.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:32:40.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.12__multipart_foo.2~JCUEe7dAbd0crx3qhgtQDmXcAmc0eTr.2 2024-09-12T00:32:40.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:32:40.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.12__multipart_foo.2~JCUEe7dAbd0crx3qhgtQDmXcAmc0eTr.3 2024-09-12T00:32:40.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:32:40.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.12__multipart_foo.2~JCUEe7dAbd0crx3qhgtQDmXcAmc0eTr.4 2024-09-12T00:32:40.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:32:40.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:40.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.957+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.7564356551748226200 2024-09-12T00:32:40.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.961+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:32:40.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.961+0000 7f996682d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:32:40.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.961+0000 7f996682d9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:32:40.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.961+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:32:40.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.961+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:32:40.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.961+0000 7f996682d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:32:40.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.961+0000 7f996682d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:32:40.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.961+0000 7f996682d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[e2043445-c131-4520-984d-b4d52f038a6b.4538.12])"; uploads.size()=0; is_truncated=0 2024-09-12T00:32:40.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.965+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T00:32:40.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.965+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.969+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T00:32:40.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.969+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T00:32:40.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.969+0000 7f996682d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T00:32:40.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.969+0000 7f996682d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T00:32:40.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.969+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T00:32:40.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.969+0000 7f983b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333457 cookie 94074428773120 notifier 6000 bl.length()=198 2024-09-12T00:32:40.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.973+0000 7f996682d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.12 from cache 2024-09-12T00:32:40.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.973+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.12, ofs0, ns] 2024-09-12T00:32:40.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.973+0000 7f983b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333516 cookie 94074428784800 notifier 6000 bl.length()=256 2024-09-12T00:32:40.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.981+0000 7f996682d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.12 : miss 2024-09-12T00:32:40.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.981+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.981+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.981+0000 7f996682d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.12 info.flags=0x0 2024-09-12T00:32:40.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.981+0000 7f996682d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.12 to cache LRU end 2024-09-12T00:32:40.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.989+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.10 : miss 2024-09-12T00:32:40.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.989+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.989+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T00:32:40.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.989+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.10 info.flags=0x17 2024-09-12T00:32:40.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.989+0000 7f996682d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.10 to cache LRU end 2024-09-12T00:32:40.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.989+0000 7f996682d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:40.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.989+0000 7f996682d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:32:40.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:40.989+0000 7f996682d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.10 2024-09-12T00:32:40.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.001+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo[HK1RVWakFZTLtSK8lVrXoCqOyhY4AaI] 2024-09-12T00:32:40.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.001+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.10.10 2024-09-12T00:32:40.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.001+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c061cf0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x558f68ee76b8 s->prefetch_data=0 2024-09-12T00:32:40.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.001+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to itjlg9u75jzrog4v3af1g5ps9ulrbfni 2024-09-12T00:32:40.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.001+0000 7f996682d9c0 20 get_obj_state_impl: setting s->olh_tag to edtlm5j62h5p61e321m631lh4fawyfuo 2024-09-12T00:32:40.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.001+0000 7f996682d9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=edtlm5j62h5p61e321m631lh4fawyfuo 2024-09-12T00:32:41.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.005+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.10.10 2024-09-12T00:32:41.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.009+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.10.10 2024-09-12T00:32:41.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.009+0000 7f996682d9c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T00:32:41.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.009+0000 7f996682d9c0 20 olh_log_entry: epoch=3 op=3 key=foo[HK1RVWakFZTLtSK8lVrXoCqOyhY4AaI] 2024-09-12T00:32:41.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.009+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c061cf0 obj=test-client.0-r-test-multipart-index-versioning.1:_:HK1RVWakFZTLtSK8lVrXoCqOyhY4AaI_foo state=0x558f68edd2e8 s->prefetch_data=0 2024-09-12T00:32:41.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.009+0000 7f996682d9c0 10 manifest: total_size = 26077 2024-09-12T00:32:41.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.009+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.3154619321990305929 2024-09-12T00:32:41.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.009+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c061cf0 obj=test-client.0-r-test-multipart-index-versioning.1:_:HK1RVWakFZTLtSK8lVrXoCqOyhY4AaI_foo state=0x558f68edd2e8 s->prefetch_data=0 2024-09-12T00:32:41.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.009+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edd2e8 2024-09-12T00:32:41.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.009+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.10.10 2024-09-12T00:32:41.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=2 2024-09-12T00:32:41.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7670 2024-09-12T00:32:41.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=7670 stripe_ofs=7670 part_ofs=7670 rule->part_size=7670 2024-09-12T00:32:41.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=2 2024-09-12T00:32:41.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6299126 part_ofs=7670 rule->part_size=7670 2024-09-12T00:32:41.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=15340 stripe_ofs=15340 part_ofs=15340 rule->part_size=7670 2024-09-12T00:32:41.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=2 2024-09-12T00:32:41.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6306796 part_ofs=15340 rule->part_size=7670 2024-09-12T00:32:41.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=23010 stripe_ofs=23010 part_ofs=23010 rule->part_size=3067 2024-09-12T00:32:41.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=2 2024-09-12T00:32:41.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6314466 part_ofs=23010 rule->part_size=3067 2024-09-12T00:32:41.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=26077 stripe_ofs=26077 part_ofs=26077 rule->part_size=3067 2024-09-12T00:32:41.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.3154619321990305929 2024-09-12T00:32:41.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.10__multipart_foo.2~DP7wHxdWehZxYn5FlhD_5VWRl7LChVj.1 2024-09-12T00:32:41.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:32:41.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.10__multipart_foo.2~DP7wHxdWehZxYn5FlhD_5VWRl7LChVj.2 2024-09-12T00:32:41.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:32:41.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.10__multipart_foo.2~DP7wHxdWehZxYn5FlhD_5VWRl7LChVj.3 2024-09-12T00:32:41.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:32:41.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.10__multipart_foo.2~DP7wHxdWehZxYn5FlhD_5VWRl7LChVj.4 2024-09-12T00:32:41.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:32:41.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.017+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.3154619321990305929 2024-09-12T00:32:41.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.021+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo[HK1RVWakFZTLtSK8lVrXoCqOyhY4AaI] 2024-09-12T00:32:41.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.025+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c061cf0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x558f68ee76b8 s->prefetch_data=0 2024-09-12T00:32:41.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.029+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.10.10 2024-09-12T00:32:41.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.033+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.10.10 2024-09-12T00:32:41.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.033+0000 7f996682d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:32:41.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.033+0000 7f996682d9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:32:41.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.037+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:32:41.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.037+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:32:41.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.037+0000 7f996682d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:32:41.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.037+0000 7f996682d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:32:41.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.037+0000 7f996682d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[e2043445-c131-4520-984d-b4d52f038a6b.4538.10])"; uploads.size()=0; is_truncated=0 2024-09-12T00:32:41.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.041+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T00:32:41.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.041+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.041+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T00:32:41.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.041+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T00:32:41.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.041+0000 7f996682d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T00:32:41.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.045+0000 7f996682d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T00:32:41.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.045+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T00:32:41.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.045+0000 7f983affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333458 cookie 94074428773120 notifier 6000 bl.length()=193 2024-09-12T00:32:41.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.049+0000 7f996682d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.10 from cache 2024-09-12T00:32:41.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.049+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.10, ofs0, ns] 2024-09-12T00:32:41.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.049+0000 7f983b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333504 cookie 94074428755888 notifier 6000 bl.length()=251 2024-09-12T00:32:41.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.057+0000 7f996682d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.10 : miss 2024-09-12T00:32:41.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.057+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.057+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.057+0000 7f996682d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.10 info.flags=0x0 2024-09-12T00:32:41.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.057+0000 7f996682d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.10 to cache LRU end 2024-09-12T00:32:41.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.065+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.9 : miss 2024-09-12T00:32:41.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.065+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.065+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:32:41.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.065+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.9 info.flags=0x17 2024-09-12T00:32:41.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.065+0000 7f996682d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.9 to cache LRU end 2024-09-12T00:32:41.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.065+0000 7f996682d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:41.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.065+0000 7f996682d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:32:41.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.065+0000 7f996682d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.9 2024-09-12T00:32:41.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.077+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:32:41.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.077+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68e9da10 obj=test-client.0-r-test-multipart-simple.1:foo state=0x558f68ec8cf8 s->prefetch_data=0 2024-09-12T00:32:41.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.077+0000 7f996682d9c0 10 manifest: total_size = 26083 2024-09-12T00:32:41.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.077+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.6778104730770828000 2024-09-12T00:32:41.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.077+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68e9da10 obj=test-client.0-r-test-multipart-simple.1:foo state=0x558f68ec8cf8 s->prefetch_data=0 2024-09-12T00:32:41.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.077+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ec8cf8 2024-09-12T00:32:41.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.077+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.9.10 2024-09-12T00:32:41.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=2 2024-09-12T00:32:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7672 2024-09-12T00:32:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=7672 stripe_ofs=7672 part_ofs=7672 rule->part_size=7672 2024-09-12T00:32:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=2 2024-09-12T00:32:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6299128 part_ofs=7672 rule->part_size=7672 2024-09-12T00:32:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=15344 stripe_ofs=15344 part_ofs=15344 rule->part_size=7672 2024-09-12T00:32:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=2 2024-09-12T00:32:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6306800 part_ofs=15344 rule->part_size=7672 2024-09-12T00:32:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=23016 stripe_ofs=23016 part_ofs=23016 rule->part_size=3067 2024-09-12T00:32:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=2 2024-09-12T00:32:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6314472 part_ofs=23016 rule->part_size=3067 2024-09-12T00:32:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=26083 stripe_ofs=26083 part_ofs=26083 rule->part_size=3067 2024-09-12T00:32:41.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.6778104730770828000 2024-09-12T00:32:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.9__multipart_foo.2~ZQqvXKRGG2dbphRp-UPAHwpkHuK3IyX.1 2024-09-12T00:32:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 344 2024-09-12T00:32:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.9__multipart_foo.2~ZQqvXKRGG2dbphRp-UPAHwpkHuK3IyX.2 2024-09-12T00:32:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 588 2024-09-12T00:32:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.9__multipart_foo.2~ZQqvXKRGG2dbphRp-UPAHwpkHuK3IyX.3 2024-09-12T00:32:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 832 2024-09-12T00:32:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.9__multipart_foo.2~ZQqvXKRGG2dbphRp-UPAHwpkHuK3IyX.4 2024-09-12T00:32:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1076 2024-09-12T00:32:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.081+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.6778104730770828000 2024-09-12T00:32:41.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.089+0000 7f996682d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:32:41.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.089+0000 7f996682d9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:32:41.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.089+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:32:41.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.089+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:32:41.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.089+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:32:41.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.089+0000 7f996682d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:32:41.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.089+0000 7f996682d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:32:41.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.089+0000 7f996682d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[e2043445-c131-4520-984d-b4d52f038a6b.4538.9])"; uploads.size()=0; is_truncated=0 2024-09-12T00:32:41.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.097+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T00:32:41.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.097+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.097+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:32:41.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.097+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T00:32:41.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.097+0000 7f996682d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T00:32:41.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.101+0000 7f996682d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T00:32:41.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.101+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T00:32:41.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.101+0000 7f983b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333505 cookie 94074428755888 notifier 6000 bl.length()=183 2024-09-12T00:32:41.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.105+0000 7f996682d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.9 from cache 2024-09-12T00:32:41.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.105+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.9, ofs0, ns] 2024-09-12T00:32:41.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.105+0000 7f983affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333460 cookie 94074428774912 notifier 6000 bl.length()=240 2024-09-12T00:32:41.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.113+0000 7f996682d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.9 : miss 2024-09-12T00:32:41.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.113+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.113+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.113+0000 7f996682d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.9 info.flags=0x0 2024-09-12T00:32:41.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.113+0000 7f996682d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.9 to cache LRU end 2024-09-12T00:32:41.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.117+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.15 : miss 2024-09-12T00:32:41.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.117+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.117+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:32:41.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.117+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.15 info.flags=0x17 2024-09-12T00:32:41.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.117+0000 7f996682d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.15 to cache LRU end 2024-09-12T00:32:41.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.117+0000 7f996682d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:41.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.117+0000 7f996682d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:32:41.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.117+0000 7f996682d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.15 2024-09-12T00:32:41.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.121+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:32:41.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.121+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:32:41.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.121+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:32:41.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.125+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:32:41.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.125+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:32:41.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.125+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:32:41.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.125+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:32:41.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.125+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:32:41.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.125+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:32:41.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.129+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:32:41.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.129+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:32:41.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.129+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:32:41.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.129+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68eddbe0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.129+0000 7f996682d9c0 10 manifest: total_size = 324647 2024-09-12T00:32:41.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.129+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to _VFal-R_a25MO2z2Wg2JoaTKr_a-qd1k 2024-09-12T00:32:41.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.129+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68eddbe0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.129+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.127 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.129+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.15.0 2024-09-12T00:32:41.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.137+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.137+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.137+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _VFal-R_a25MO2z2Wg2JoaTKr_a-qd1k 2024-09-12T00:32:41.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.137+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.137+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.lAgEwnqy6Mu8-sAcT0XZAmeS3sBCsQN_0 2024-09-12T00:32:41.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.137+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:32:41.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.137+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.137+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _VFal-R_a25MO2z2Wg2JoaTKr_a-qd1k 2024-09-12T00:32:41.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.137+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:32:41.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.137+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995406a230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.141+0000 7f996682d9c0 10 manifest: total_size = 5242880 2024-09-12T00:32:41.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.141+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to _xeXAa97skI_H1JWkxSdlo-QZ0-nN6Co 2024-09-12T00:32:41.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.141+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995406a230 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.141+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.141+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.15.2 2024-09-12T00:32:41.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.145+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.145+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.145+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _xeXAa97skI_H1JWkxSdlo-QZ0-nN6Co 2024-09-12T00:32:41.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.145+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.145+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.ET0K8HLEHTplKnc6cjd8wmxhUkxJt9l_0 2024-09-12T00:32:41.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.145+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:32:41.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.145+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.145+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _xeXAa97skI_H1JWkxSdlo-QZ0-nN6Co 2024-09-12T00:32:41.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.149+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:32:41.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.149+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995405cdb0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.149+0000 7f996682d9c0 10 manifest: total_size = 5242880 2024-09-12T00:32:41.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.149+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.16353324678544606605 2024-09-12T00:32:41.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.149+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995405cdb0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.149+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.149+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.15.3 2024-09-12T00:32:41.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.157+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.157+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.157+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.16353324678544606605 2024-09-12T00:32:41.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.157+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.157+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.b5LaxNOZE5VW8zuIdU0s0JqxCyNtiAL_0 2024-09-12T00:32:41.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.157+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T00:32:41.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.157+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.157+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.16353324678544606605 2024-09-12T00:32:41.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.161+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:32:41.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.161+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0e6650 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.161+0000 7f996682d9c0 10 manifest: total_size = 5242880 2024-09-12T00:32:41.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.161+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to _CzQ04H9_f6niPO6X3H_C32RpOrJAWFp 2024-09-12T00:32:41.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.161+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0e6650 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.161+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.161+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.15.5 2024-09-12T00:32:41.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.165+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.165+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.165+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _CzQ04H9_f6niPO6X3H_C32RpOrJAWFp 2024-09-12T00:32:41.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.165+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.165+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.6TJtgI9R_Q5-QRDvIcUrrXF9I0WxUJP_0 2024-09-12T00:32:41.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.165+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:32:41.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.165+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.165+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _CzQ04H9_f6niPO6X3H_C32RpOrJAWFp 2024-09-12T00:32:41.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.169+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:32:41.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.169+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0abe70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.169+0000 7f996682d9c0 10 manifest: total_size = 5242880 2024-09-12T00:32:41.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.169+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to _4K9WJMLCDvk8izrQN0TMbf3w-iLmsud 2024-09-12T00:32:41.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.169+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0abe70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.169+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.169+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.15.5 2024-09-12T00:32:41.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.177+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.177+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.177+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _4K9WJMLCDvk8izrQN0TMbf3w-iLmsud 2024-09-12T00:32:41.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.177+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.177+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.kWTyJg1I8yjrk3yJ66Q5u2qQ4H8iJLV_0 2024-09-12T00:32:41.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.177+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:32:41.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.177+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.177+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _4K9WJMLCDvk8izrQN0TMbf3w-iLmsud 2024-09-12T00:32:41.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.177+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:32:41.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.177+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c083460 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.181+0000 7f996682d9c0 10 manifest: total_size = 324647 2024-09-12T00:32:41.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.181+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.12031010731933369408 2024-09-12T00:32:41.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.181+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c083460 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.181+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.181+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.15.5 2024-09-12T00:32:41.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.185+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.185+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.185+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.12031010731933369408 2024-09-12T00:32:41.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.185+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.185+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.SNS6g_WYMoNKmqZnx_HExn_xLNeV6gg_0 2024-09-12T00:32:41.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.185+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:32:41.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.185+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.185+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.12031010731933369408 2024-09-12T00:32:41.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.189+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0abe70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.189+0000 7f996682d9c0 10 manifest: total_size = 5242880 2024-09-12T00:32:41.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.189+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to _q54lexO-AZwGVeNSfwLBHH8XMQ0jExo 2024-09-12T00:32:41.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.189+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0abe70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.189+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.189+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.15.7 2024-09-12T00:32:41.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.189+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:32:41.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.197+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.197+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.197+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _q54lexO-AZwGVeNSfwLBHH8XMQ0jExo 2024-09-12T00:32:41.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.197+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.197+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.f8k-Iqvl21J17MPZqy4uIjveTj0B7HE_0 2024-09-12T00:32:41.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.197+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:32:41.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.197+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.197+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _q54lexO-AZwGVeNSfwLBHH8XMQ0jExo 2024-09-12T00:32:41.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.197+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0e6650 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.201+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:32:41.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.201+0000 7f996682d9c0 10 manifest: total_size = 5242880 2024-09-12T00:32:41.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.201+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.6955837973615786167 2024-09-12T00:32:41.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.201+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0e6650 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.201+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.201+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.15.7 2024-09-12T00:32:41.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.205+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.205+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.205+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.6955837973615786167 2024-09-12T00:32:41.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.205+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.205+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.sdXlQdmJ6nd-geqI4iqus6ByaUH1SLr_0 2024-09-12T00:32:41.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.205+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:32:41.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.205+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.205+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.6955837973615786167 2024-09-12T00:32:41.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.209+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0abe70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.209+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:32:41.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.209+0000 7f996682d9c0 10 manifest: total_size = 324647 2024-09-12T00:32:41.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.209+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.3059281410891117616 2024-09-12T00:32:41.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.209+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0abe70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.209+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.209+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.15.7 2024-09-12T00:32:41.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.213+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.213+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.213+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.3059281410891117616 2024-09-12T00:32:41.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.213+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.213+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.SNS6g_WYMoNKmqZnx_HExn_xLNeV6gg_0 2024-09-12T00:32:41.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.213+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T00:32:41.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.213+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.213+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.3059281410891117616 2024-09-12T00:32:41.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.217+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0e6650 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.217+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:32:41.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.217+0000 7f996682d9c0 10 manifest: total_size = 5242880 2024-09-12T00:32:41.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.217+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.14117658751077289386 2024-09-12T00:32:41.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.217+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0e6650 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.217+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.217+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.15.8 2024-09-12T00:32:41.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.225+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.225+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.225+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.14117658751077289386 2024-09-12T00:32:41.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.225+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.225+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.sdXlQdmJ6nd-geqI4iqus6ByaUH1SLr_0 2024-09-12T00:32:41.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.225+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T00:32:41.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.225+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.225+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.14117658751077289386 2024-09-12T00:32:41.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.229+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:32:41.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.229+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0abe70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.229+0000 7f996682d9c0 10 manifest: total_size = 324647 2024-09-12T00:32:41.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.229+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to _V6bXtOoL2-_lUtdwjJgazuBudTWahv4 2024-09-12T00:32:41.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.229+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0abe70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.229+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.229+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.15.8 2024-09-12T00:32:41.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.237+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.237+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.237+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _V6bXtOoL2-_lUtdwjJgazuBudTWahv4 2024-09-12T00:32:41.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.237+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.237+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.M_Z-JknBCiXZj_8Eyq7XCy3KzdcAhJf_0 2024-09-12T00:32:41.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.237+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:32:41.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.237+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.237+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _V6bXtOoL2-_lUtdwjJgazuBudTWahv4 2024-09-12T00:32:41.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.237+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:32:41.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.237+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0e6650 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.241+0000 7f996682d9c0 10 manifest: total_size = 5242880 2024-09-12T00:32:41.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.241+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.4732516424218184280 2024-09-12T00:32:41.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.241+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0e6650 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.241+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.241+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.15.9 2024-09-12T00:32:41.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.245+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.245+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.245+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.4732516424218184280 2024-09-12T00:32:41.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.245+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.245+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.b5LaxNOZE5VW8zuIdU0s0JqxCyNtiAL_0 2024-09-12T00:32:41.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.245+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:32:41.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.245+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.245+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.4732516424218184280 2024-09-12T00:32:41.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.249+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:32:41.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.249+0000 7f996682d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:32:41.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.249+0000 7f996682d9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:32:41.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.253+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:32:41.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.253+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:32:41.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.253+0000 7f996682d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:32:41.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.253+0000 7f996682d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:32:41.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.253+0000 7f996682d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[e2043445-c131-4520-984d-b4d52f038a6b.4538.15])"; uploads.size()=0; is_truncated=0 2024-09-12T00:32:41.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.257+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T00:32:41.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.257+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.257+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T00:32:41.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.257+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T00:32:41.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.257+0000 7f996682d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T00:32:41.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.257+0000 7f996682d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T00:32:41.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.257+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T00:32:41.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.261+0000 7f983b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333459 cookie 94074428773120 notifier 6000 bl.length()=189 2024-09-12T00:32:41.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.261+0000 7f996682d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.15 from cache 2024-09-12T00:32:41.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.261+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.15, ofs0, ns] 2024-09-12T00:32:41.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.265+0000 7f983affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333506 cookie 94074428755888 notifier 6000 bl.length()=247 2024-09-12T00:32:41.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.269+0000 7f996682d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.15 : miss 2024-09-12T00:32:41.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.269+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.269+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.269+0000 7f996682d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.15 info.flags=0x0 2024-09-12T00:32:41.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.269+0000 7f996682d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.15 to cache LRU end 2024-09-12T00:32:41.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.277+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.16 : miss 2024-09-12T00:32:41.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.277+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.277+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:32:41.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.277+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.16 info.flags=0x17 2024-09-12T00:32:41.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.277+0000 7f996682d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.16 to cache LRU end 2024-09-12T00:32:41.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.277+0000 7f996682d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:41.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.277+0000 7f996682d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:32:41.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.277+0000 7f996682d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.16 2024-09-12T00:32:41.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.277+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:32:41.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.277+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:32:41.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.281+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:32:41.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.281+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:32:41.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.281+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:32:41.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.281+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:32:41.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.285+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:32:41.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.285+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:32:41.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.285+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:32:41.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.285+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:32:41.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.285+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:32:41.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.285+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:32:41.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.285+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995406a230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.289+0000 7f996682d9c0 10 manifest: total_size = 16380 2024-09-12T00:32:41.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.289+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to _zYK2a5BsKIbFhiiNGI1J2Zwxku8ltaE 2024-09-12T00:32:41.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.289+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995406a230 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.289+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.289+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.16.0 2024-09-12T00:32:41.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.293+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.293+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=16380 stripe_ofs=16380 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.293+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _zYK2a5BsKIbFhiiNGI1J2Zwxku8ltaE 2024-09-12T00:32:41.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.293+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.293+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.W25CuMnbK_25MEa76LGyraJ0WI5LHwh_0 2024-09-12T00:32:41.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.293+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:32:41.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.293+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.293+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _zYK2a5BsKIbFhiiNGI1J2Zwxku8ltaE 2024-09-12T00:32:41.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.297+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:32:41.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.297+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68ede5e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.297+0000 7f996682d9c0 10 manifest: total_size = 11534336 2024-09-12T00:32:41.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.297+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to _aaDFG4IxUv_59ReHUiw4iXA-7mlGtCj 2024-09-12T00:32:41.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.297+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68ede5e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.297+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.297+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.16.2 2024-09-12T00:32:41.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.305+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.305+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.305+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.305+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.305+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _aaDFG4IxUv_59ReHUiw4iXA-7mlGtCj 2024-09-12T00:32:41.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.305+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.305+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.Q2qO5BvG8SCMMbsZm7WnSzG0OcMF5k1_0 2024-09-12T00:32:41.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.305+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:32:41.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.305+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.Q2qO5BvG8SCMMbsZm7WnSzG0OcMF5k1_1 2024-09-12T00:32:41.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.305+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:32:41.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.305+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.305+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _aaDFG4IxUv_59ReHUiw4iXA-7mlGtCj 2024-09-12T00:32:41.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.309+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68ede5e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.309+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:32:41.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.309+0000 7f996682d9c0 10 manifest: total_size = 11534336 2024-09-12T00:32:41.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.309+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.1392201350760281244 2024-09-12T00:32:41.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.309+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68ede5e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.309+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.309+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.16.3 2024-09-12T00:32:41.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:32:41.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:32:41.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:32:41.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:32:41.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:32:41.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:32:41.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:32:41.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:32:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:32:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.1392201350760281244 2024-09-12T00:32:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-FROZEN.2~s95WScGF9RVMJsX2bESYT3P5Lp48vCx.1 2024-09-12T00:32:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:32:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-FROZEN.2~s95WScGF9RVMJsX2bESYT3P5Lp48vCx.2 2024-09-12T00:32:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-12T00:32:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-FROZEN.2~s95WScGF9RVMJsX2bESYT3P5Lp48vCx.3 2024-09-12T00:32:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-12T00:32:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.313+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.1392201350760281244 2024-09-12T00:32:41.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.317+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:32:41.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.317+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0abe70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.317+0000 7f996682d9c0 10 manifest: total_size = 11534336 2024-09-12T00:32:41.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.317+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to _QoPw2wiT9PXG55UeqbmwOfZVClFeK45 2024-09-12T00:32:41.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.317+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0abe70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.317+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.317+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.16.5 2024-09-12T00:32:41.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.325+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.325+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.325+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.325+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.325+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _QoPw2wiT9PXG55UeqbmwOfZVClFeK45 2024-09-12T00:32:41.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.325+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.325+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.v7P0CO71zBfeh2Cr6KjWAVr58W8bo7q_0 2024-09-12T00:32:41.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.325+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:32:41.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.325+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.v7P0CO71zBfeh2Cr6KjWAVr58W8bo7q_1 2024-09-12T00:32:41.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.325+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:32:41.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.325+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.325+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _QoPw2wiT9PXG55UeqbmwOfZVClFeK45 2024-09-12T00:32:41.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.325+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0abe70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.329+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:32:41.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.329+0000 7f996682d9c0 10 manifest: total_size = 11534336 2024-09-12T00:32:41.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.329+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to _Q2AzhjWyRNThhLx540lV7GMqfWkuR8a 2024-09-12T00:32:41.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.329+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0abe70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.329+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.329+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.16.5 2024-09-12T00:32:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.333+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.333+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.333+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.333+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.333+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _Q2AzhjWyRNThhLx540lV7GMqfWkuR8a 2024-09-12T00:32:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.333+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.333+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.ooyVsjR6SK5e434lfX5NZCQGdTOUy_v_0 2024-09-12T00:32:41.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.333+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:32:41.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.333+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.ooyVsjR6SK5e434lfX5NZCQGdTOUy_v_1 2024-09-12T00:32:41.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.333+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:32:41.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.333+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.333+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _Q2AzhjWyRNThhLx540lV7GMqfWkuR8a 2024-09-12T00:32:41.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.337+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:32:41.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.337+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c00a7b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.341+0000 7f996682d9c0 10 manifest: total_size = 16380 2024-09-12T00:32:41.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.341+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.6583575158879278100 2024-09-12T00:32:41.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.341+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c00a7b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.341+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.341+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.16.5 2024-09-12T00:32:41.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-12T00:32:41.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7671 2024-09-12T00:32:41.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7674 2024-09-12T00:32:41.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=3 2024-09-12T00:32:41.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6299127 part_ofs=7671 rule->part_size=7674 2024-09-12T00:32:41.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=15345 stripe_ofs=15345 part_ofs=15345 rule->part_size=1035 2024-09-12T00:32:41.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-12T00:32:41.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6306801 part_ofs=15345 rule->part_size=1035 2024-09-12T00:32:41.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=16380 stripe_ofs=16380 part_ofs=16380 rule->part_size=1035 2024-09-12T00:32:41.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.6583575158879278100 2024-09-12T00:32:41.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-STANDARD.2~MKryYOMaRoz-AMDa2zkBMNRN7R5s3NY.1 2024-09-12T00:32:41.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T00:32:41.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-STANDARD.2~MKryYOMaRoz-AMDa2zkBMNRN7R5s3NY.2 2024-09-12T00:32:41.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T00:32:41.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-STANDARD.2~MKryYOMaRoz-AMDa2zkBMNRN7R5s3NY.3 2024-09-12T00:32:41.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T00:32:41.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.345+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.6583575158879278100 2024-09-12T00:32:41.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.349+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:32:41.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.349+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0e6650 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.349+0000 7f996682d9c0 10 manifest: total_size = 11534336 2024-09-12T00:32:41.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.349+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to _mCWUOIBGVAZUdelX1Tlu4a9LDc9z9f2 2024-09-12T00:32:41.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.349+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0e6650 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.349+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.349+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.16.7 2024-09-12T00:32:41.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _mCWUOIBGVAZUdelX1Tlu4a9LDc9z9f2 2024-09-12T00:32:41.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.bbXKoND8zH8DdLCPzbiYsw8VveFP7LQ_0 2024-09-12T00:32:41.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:32:41.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.bbXKoND8zH8DdLCPzbiYsw8VveFP7LQ_1 2024-09-12T00:32:41.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:32:41.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _mCWUOIBGVAZUdelX1Tlu4a9LDc9z9f2 2024-09-12T00:32:41.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:32:41.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c00a7b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 10 manifest: total_size = 11534336 2024-09-12T00:32:41.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.12241926498939962583 2024-09-12T00:32:41.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c00a7b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.357+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.16.7 2024-09-12T00:32:41.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:32:41.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:32:41.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:32:41.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:32:41.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:32:41.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:32:41.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:32:41.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:32:41.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:32:41.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.12241926498939962583 2024-09-12T00:32:41.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-LUKEWARM.2~Ig4ng87RG8L0NSDx3lH7mxAfoUO2r8C.1 2024-09-12T00:32:41.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:32:41.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-LUKEWARM.2~Ig4ng87RG8L0NSDx3lH7mxAfoUO2r8C.2 2024-09-12T00:32:41.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-12T00:32:41.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-LUKEWARM.2~Ig4ng87RG8L0NSDx3lH7mxAfoUO2r8C.3 2024-09-12T00:32:41.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-12T00:32:41.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.365+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.12241926498939962583 2024-09-12T00:32:41.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.369+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:32:41.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.369+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0e6650 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.369+0000 7f996682d9c0 10 manifest: total_size = 16380 2024-09-12T00:32:41.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.369+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.14043497490123959392 2024-09-12T00:32:41.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.369+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0e6650 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.369+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.369+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.16.7 2024-09-12T00:32:41.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-12T00:32:41.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7671 2024-09-12T00:32:41.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7674 2024-09-12T00:32:41.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=3 2024-09-12T00:32:41.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6299127 part_ofs=7671 rule->part_size=7674 2024-09-12T00:32:41.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=15345 stripe_ofs=15345 part_ofs=15345 rule->part_size=1035 2024-09-12T00:32:41.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-12T00:32:41.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6306801 part_ofs=15345 rule->part_size=1035 2024-09-12T00:32:41.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=16380 stripe_ofs=16380 part_ofs=16380 rule->part_size=1035 2024-09-12T00:32:41.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.14043497490123959392 2024-09-12T00:32:41.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-STANDARD.2~MKryYOMaRoz-AMDa2zkBMNRN7R5s3NY.1 2024-09-12T00:32:41.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:32:41.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-STANDARD.2~MKryYOMaRoz-AMDa2zkBMNRN7R5s3NY.2 2024-09-12T00:32:41.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T00:32:41.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-STANDARD.2~MKryYOMaRoz-AMDa2zkBMNRN7R5s3NY.3 2024-09-12T00:32:41.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T00:32:41.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.14043497490123959392 2024-09-12T00:32:41.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:32:41.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c00a7b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 10 manifest: total_size = 11534336 2024-09-12T00:32:41.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.3194749336537918555 2024-09-12T00:32:41.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c00a7b0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.377+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.16.8 2024-09-12T00:32:41.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:32:41.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:32:41.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:32:41.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:32:41.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:32:41.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:32:41.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:32:41.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:32:41.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:32:41.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.3194749336537918555 2024-09-12T00:32:41.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-LUKEWARM.2~Ig4ng87RG8L0NSDx3lH7mxAfoUO2r8C.1 2024-09-12T00:32:41.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T00:32:41.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-LUKEWARM.2~Ig4ng87RG8L0NSDx3lH7mxAfoUO2r8C.2 2024-09-12T00:32:41.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-12T00:32:41.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-LUKEWARM.2~Ig4ng87RG8L0NSDx3lH7mxAfoUO2r8C.3 2024-09-12T00:32:41.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-12T00:32:41.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.385+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.3194749336537918555 2024-09-12T00:32:41.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.389+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0abe70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.389+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:32:41.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.389+0000 7f996682d9c0 10 manifest: total_size = 16380 2024-09-12T00:32:41.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.389+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to _5PF4kfC0mTkThDf_GQHScQN2llaE6bm 2024-09-12T00:32:41.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.389+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c0abe70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.389+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.389+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.16.8 2024-09-12T00:32:41.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.393+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.393+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=16380 stripe_ofs=16380 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.393+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _5PF4kfC0mTkThDf_GQHScQN2llaE6bm 2024-09-12T00:32:41.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.393+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.393+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.542c5jMYltjz17DB1KBAUoaEDL5z4dk_0 2024-09-12T00:32:41.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.393+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:32:41.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.393+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.393+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _5PF4kfC0mTkThDf_GQHScQN2llaE6bm 2024-09-12T00:32:41.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.397+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:32:41.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.397+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c1294f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.397+0000 7f996682d9c0 10 manifest: total_size = 11534336 2024-09-12T00:32:41.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.397+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.12217671696807105053 2024-09-12T00:32:41.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.397+0000 7f996682d9c0 20 get_obj_state: octx=0x7f994c1294f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x558f68edc298 s->prefetch_data=0 2024-09-12T00:32:41.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.397+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68edc298 2024-09-12T00:32:41.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.401+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.16.9 2024-09-12T00:32:41.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:32:41.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:32:41.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:32:41.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:32:41.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:32:41.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:32:41.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:32:41.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:32:41.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:32:41.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.12217671696807105053 2024-09-12T00:32:41.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-FROZEN.2~s95WScGF9RVMJsX2bESYT3P5Lp48vCx.1 2024-09-12T00:32:41.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T00:32:41.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-FROZEN.2~s95WScGF9RVMJsX2bESYT3P5Lp48vCx.2 2024-09-12T00:32:41.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-12T00:32:41.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-FROZEN.2~s95WScGF9RVMJsX2bESYT3P5Lp48vCx.3 2024-09-12T00:32:41.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-12T00:32:41.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.405+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.12217671696807105053 2024-09-12T00:32:41.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.409+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:32:41.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.409+0000 7f996682d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:32:41.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.409+0000 7f996682d9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:32:41.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.409+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:32:41.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.409+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:32:41.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.409+0000 7f996682d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:32:41.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.409+0000 7f996682d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:32:41.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.409+0000 7f996682d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[e2043445-c131-4520-984d-b4d52f038a6b.4538.16])"; uploads.size()=0; is_truncated=0 2024-09-12T00:32:41.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.417+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T00:32:41.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.417+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.417+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T00:32:41.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.417+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T00:32:41.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.417+0000 7f996682d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T00:32:41.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.417+0000 7f996682d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T00:32:41.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.417+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T00:32:41.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.421+0000 7f983b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333461 cookie 94074428774912 notifier 6000 bl.length()=199 2024-09-12T00:32:41.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.425+0000 7f996682d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.16 from cache 2024-09-12T00:32:41.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.425+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.16, ofs0, ns] 2024-09-12T00:32:41.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.425+0000 7f983affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333517 cookie 94074428788224 notifier 6000 bl.length()=257 2024-09-12T00:32:41.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.429+0000 7f996682d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.16 : miss 2024-09-12T00:32:41.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.429+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.433+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.433+0000 7f996682d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.16 info.flags=0x0 2024-09-12T00:32:41.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.433+0000 7f996682d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.16 to cache LRU end 2024-09-12T00:32:41.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.437+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.14 : miss 2024-09-12T00:32:41.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.437+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.437+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:32:41.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.437+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.14 info.flags=0x17 2024-09-12T00:32:41.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.437+0000 7f996682d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.14 to cache LRU end 2024-09-12T00:32:41.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.437+0000 7f996682d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:41.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.437+0000 7f996682d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:32:41.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.437+0000 7f996682d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.14 2024-09-12T00:32:41.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.441+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:32:41.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.441+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:32:41.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.445+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:32:41.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.449+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68f3af00 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.449+0000 7f996682d9c0 10 manifest: total_size = 11534336 2024-09-12T00:32:41.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.449+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.4059405578713980225 2024-09-12T00:32:41.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.449+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68f3af00 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.449+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ebda98 2024-09-12T00:32:41.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.449+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.14.3 2024-09-12T00:32:41.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:32:41.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:32:41.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:32:41.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:32:41.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:32:41.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:32:41.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:32:41.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:32:41.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:32:41.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.4059405578713980225 2024-09-12T00:32:41.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-FROZEN.2~cI7O_oAoqVL3kGmKWzTvMdFZt7nhQEr.1 2024-09-12T00:32:41.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:32:41.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-FROZEN.2~cI7O_oAoqVL3kGmKWzTvMdFZt7nhQEr.2 2024-09-12T00:32:41.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-12T00:32:41.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-FROZEN.2~cI7O_oAoqVL3kGmKWzTvMdFZt7nhQEr.3 2024-09-12T00:32:41.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-12T00:32:41.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.4059405578713980225 2024-09-12T00:32:41.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.457+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:32:41.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.461+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68ed56b0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.461+0000 7f996682d9c0 10 manifest: total_size = 1087 2024-09-12T00:32:41.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.461+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.8643553911065858245 2024-09-12T00:32:41.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.461+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68ed56b0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.461+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ebda98 2024-09-12T00:32:41.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.461+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.14.5 2024-09-12T00:32:41.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:32:41.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-12T00:32:41.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:32:41.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:32:41.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-12T00:32:41.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T00:32:41.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T00:32:41.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=55 2024-09-12T00:32:41.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T00:32:41.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.8643553911065858245 2024-09-12T00:32:41.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-STANDARD.2~W4ExblD_SyqQ0ZCGNNWLsaqXTJMYRE1.1 2024-09-12T00:32:41.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T00:32:41.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-STANDARD.2~W4ExblD_SyqQ0ZCGNNWLsaqXTJMYRE1.2 2024-09-12T00:32:41.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T00:32:41.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-STANDARD.2~W4ExblD_SyqQ0ZCGNNWLsaqXTJMYRE1.3 2024-09-12T00:32:41.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T00:32:41.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.465+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.8643553911065858245 2024-09-12T00:32:41.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.469+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68ed4d90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.469+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:32:41.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.469+0000 7f996682d9c0 10 manifest: total_size = 11534336 2024-09-12T00:32:41.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.469+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.881200093889395099 2024-09-12T00:32:41.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.469+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68ed4d90 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.469+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ebda98 2024-09-12T00:32:41.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.469+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.14.7 2024-09-12T00:32:41.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:32:41.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:32:41.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:32:41.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:32:41.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:32:41.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:32:41.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:32:41.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:32:41.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:32:41.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.881200093889395099 2024-09-12T00:32:41.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-LUKEWARM.2~KhrfDCMUS2zNsIcxDTxHzN7B5I9UL8U.1 2024-09-12T00:32:41.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 372 2024-09-12T00:32:41.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-LUKEWARM.2~KhrfDCMUS2zNsIcxDTxHzN7B5I9UL8U.2 2024-09-12T00:32:41.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T00:32:41.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-LUKEWARM.2~KhrfDCMUS2zNsIcxDTxHzN7B5I9UL8U.3 2024-09-12T00:32:41.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T00:32:41.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.477+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.881200093889395099 2024-09-12T00:32:41.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.481+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:32:41.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.481+0000 7f996682d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:32:41.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.481+0000 7f996682d9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:32:41.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.485+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:32:41.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.485+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:32:41.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.485+0000 7f996682d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:32:41.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.485+0000 7f996682d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:32:41.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.485+0000 7f996682d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[e2043445-c131-4520-984d-b4d52f038a6b.4538.14])"; uploads.size()=0; is_truncated=0 2024-09-12T00:32:41.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.489+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T00:32:41.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.489+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.489+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T00:32:41.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.489+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T00:32:41.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.489+0000 7f996682d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T00:32:41.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.489+0000 7f996682d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T00:32:41.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.489+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T00:32:41.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.493+0000 7f983affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333518 cookie 94074428782464 notifier 6000 bl.length()=194 2024-09-12T00:32:41.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.497+0000 7f996682d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.14 from cache 2024-09-12T00:32:41.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.497+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.14, ofs0, ns] 2024-09-12T00:32:41.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.497+0000 7f983b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333519 cookie 94074428788224 notifier 6000 bl.length()=252 2024-09-12T00:32:41.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.505+0000 7f996682d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.14 : miss 2024-09-12T00:32:41.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.505+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.505+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.505+0000 7f996682d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.14 info.flags=0x0 2024-09-12T00:32:41.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.505+0000 7f996682d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.14 to cache LRU end 2024-09-12T00:32:41.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.509+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.13 : miss 2024-09-12T00:32:41.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.509+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.509+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T00:32:41.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.509+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.13 info.flags=0x17 2024-09-12T00:32:41.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.509+0000 7f996682d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.13 to cache LRU end 2024-09-12T00:32:41.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.509+0000 7f996682d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:41.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.509+0000 7f996682d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:32:41.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.509+0000 7f996682d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.13 2024-09-12T00:32:41.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.513+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:32:41.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.513+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:32:41.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.517+0000 7f996682d9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:32:41.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.517+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68ec7a70 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.521+0000 7f996682d9c0 10 manifest: total_size = 10485760 2024-09-12T00:32:41.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.521+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.5825443069615252216 2024-09-12T00:32:41.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.521+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68ec7a70 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.521+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ebda98 2024-09-12T00:32:41.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.521+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.13.3 2024-09-12T00:32:41.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.525+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.525+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.525+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.525+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.525+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.5825443069615252216 2024-09-12T00:32:41.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.525+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.525+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.13__shadow_.qYfFtfFttpTmcG5utQyqwPbrYM5XwQe_0 2024-09-12T00:32:41.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.525+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:32:41.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.525+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.13__shadow_.qYfFtfFttpTmcG5utQyqwPbrYM5XwQe_1 2024-09-12T00:32:41.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.525+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T00:32:41.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.525+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.525+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.5825443069615252216 2024-09-12T00:32:41.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.529+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:32:41.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.529+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68ecaf50 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.529+0000 7f996682d9c0 10 manifest: total_size = 10485760 2024-09-12T00:32:41.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.529+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.6820297438831168845 2024-09-12T00:32:41.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.529+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68ecaf50 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.529+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ebda98 2024-09-12T00:32:41.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.529+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.13.5 2024-09-12T00:32:41.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.537+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.537+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.537+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.537+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.537+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.6820297438831168845 2024-09-12T00:32:41.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.537+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.537+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.13__shadow_.ODf01ypyHwh9vZzUF7yGHwhLWZPNQgZ_0 2024-09-12T00:32:41.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.537+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T00:32:41.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.537+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.13__shadow_.ODf01ypyHwh9vZzUF7yGHwhLWZPNQgZ_1 2024-09-12T00:32:41.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.537+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 560 2024-09-12T00:32:41.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.537+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.537+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.6820297438831168845 2024-09-12T00:32:41.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.541+0000 7f983affd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:32:41.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.541+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68eca9b0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.541+0000 7f996682d9c0 10 manifest: total_size = 10485760 2024-09-12T00:32:41.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.541+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.1281051011569598549 2024-09-12T00:32:41.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.541+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68eca9b0 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.541+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ebda98 2024-09-12T00:32:41.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.541+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.13.7 2024-09-12T00:32:41.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.549+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.549+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.549+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.549+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.549+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.1281051011569598549 2024-09-12T00:32:41.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.549+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.549+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.13__shadow_.J3UEipnnch0EZvB6LKuRptCylFBVX-w_0 2024-09-12T00:32:41.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.549+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:32:41.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.549+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.13__shadow_.J3UEipnnch0EZvB6LKuRptCylFBVX-w_1 2024-09-12T00:32:41.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.549+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T00:32:41.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.549+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.549+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.1281051011569598549 2024-09-12T00:32:41.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.549+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:32:41.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.553+0000 7f996682d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:32:41.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.553+0000 7f996682d9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:32:41.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.553+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:32:41.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.553+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:32:41.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.553+0000 7f996682d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:32:41.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.553+0000 7f996682d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:32:41.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.553+0000 7f996682d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[e2043445-c131-4520-984d-b4d52f038a6b.4538.13])"; uploads.size()=0; is_truncated=0 2024-09-12T00:32:41.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.557+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T00:32:41.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.557+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.561+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T00:32:41.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.561+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T00:32:41.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.561+0000 7f996682d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T00:32:41.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.565+0000 7f996682d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T00:32:41.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.565+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T00:32:41.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.565+0000 7f983affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333460 cookie 94074428773120 notifier 6000 bl.length()=184 2024-09-12T00:32:41.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.569+0000 7f996682d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.13 from cache 2024-09-12T00:32:41.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.569+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.13, ofs0, ns] 2024-09-12T00:32:41.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.569+0000 7f983b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333520 cookie 94074428784800 notifier 6000 bl.length()=242 2024-09-12T00:32:41.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.577+0000 7f996682d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.13 : miss 2024-09-12T00:32:41.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.577+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.577+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.577+0000 7f996682d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.13 info.flags=0x0 2024-09-12T00:32:41.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.577+0000 7f996682d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.13 to cache LRU end 2024-09-12T00:32:41.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.581+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.6 : miss 2024-09-12T00:32:41.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.581+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.585+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:32:41.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.585+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.6 info.flags=0x17 2024-09-12T00:32:41.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.585+0000 7f996682d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.6 to cache LRU end 2024-09-12T00:32:41.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.585+0000 7f996682d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:41.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.585+0000 7f996682d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:32:41.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.585+0000 7f996682d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.6 2024-09-12T00:32:41.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.585+0000 7f996682d9c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:32:41.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.589+0000 7f996682d9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:32:41.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.589+0000 7f996682d9c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:32:41.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.593+0000 7f996682d9c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:32:41.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.593+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68eddbe0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x558f68d3ddb8 s->prefetch_data=0 2024-09-12T00:32:41.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.593+0000 7f996682d9c0 10 manifest: total_size = 0 2024-09-12T00:32:41.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.593+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.235287762534205433 2024-09-12T00:32:41.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.593+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68eddbe0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x558f68d3ddb8 s->prefetch_data=0 2024-09-12T00:32:41.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.593+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68d3ddb8 2024-09-12T00:32:41.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.597+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.6.2 2024-09-12T00:32:41.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.601+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c061cf0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x558f68d3ddb8 s->prefetch_data=0 2024-09-12T00:32:41.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.601+0000 7f996682d9c0 10 manifest: total_size = 0 2024-09-12T00:32:41.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.601+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.12743921383725480578 2024-09-12T00:32:41.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.601+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c061cf0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x558f68d3ddb8 s->prefetch_data=0 2024-09-12T00:32:41.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.601+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68d3ddb8 2024-09-12T00:32:41.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.601+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.6.3 2024-09-12T00:32:41.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.605+0000 7f983affd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:32:41.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.609+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c061cf0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.609+0000 7f996682d9c0 10 manifest: total_size = 0 2024-09-12T00:32:41.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.609+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.2276019587007106171 2024-09-12T00:32:41.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.609+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c061cf0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.609+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ebda98 2024-09-12T00:32:41.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.609+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.6.6 2024-09-12T00:32:41.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.613+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:32:41.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.617+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c00a7b0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.617+0000 7f996682d9c0 10 manifest: total_size = 0 2024-09-12T00:32:41.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.617+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.6196879223379831592 2024-09-12T00:32:41.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.617+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995c00a7b0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.617+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ebda98 2024-09-12T00:32:41.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.617+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.6.8 2024-09-12T00:32:41.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.621+0000 7f983affd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:32:41.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.625+0000 7f996682d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:32:41.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.625+0000 7f996682d9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:32:41.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.629+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:32:41.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.629+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:32:41.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.629+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:32:41.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.629+0000 7f996682d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:32:41.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.629+0000 7f996682d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:32:41.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.629+0000 7f996682d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[e2043445-c131-4520-984d-b4d52f038a6b.4538.6])"; uploads.size()=0; is_truncated=0 2024-09-12T00:32:41.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.633+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T00:32:41.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.633+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.633+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:32:41.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.633+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T00:32:41.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.633+0000 7f996682d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T00:32:41.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.637+0000 7f996682d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T00:32:41.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.637+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T00:32:41.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.637+0000 7f983b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333507 cookie 94074428770912 notifier 6000 bl.length()=181 2024-09-12T00:32:41.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.641+0000 7f996682d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.6 from cache 2024-09-12T00:32:41.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.641+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:e2043445-c131-4520-984d-b4d52f038a6b.4538.6, ofs0, ns] 2024-09-12T00:32:41.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.645+0000 7f983affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333460 cookie 94074428753312 notifier 6000 bl.length()=238 2024-09-12T00:32:41.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.653+0000 7f996682d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.6 : miss 2024-09-12T00:32:41.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.653+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.653+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.653+0000 7f996682d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.6 info.flags=0x0 2024-09-12T00:32:41.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.653+0000 7f996682d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/e2043445-c131-4520-984d-b4d52f038a6b.4538.6 to cache LRU end 2024-09-12T00:32:41.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.657+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e2043445-c131-4520-984d-b4d52f038a6b.4538.7 : miss 2024-09-12T00:32:41.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.657+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.661+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:32:41.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.661+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e2043445-c131-4520-984d-b4d52f038a6b.4538.7 info.flags=0x17 2024-09-12T00:32:41.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.661+0000 7f996682d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e2043445-c131-4520-984d-b4d52f038a6b.4538.7 to cache LRU end 2024-09-12T00:32:41.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.661+0000 7f996682d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:41.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.661+0000 7f996682d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:32:41.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.661+0000 7f996682d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e2043445-c131-4520-984d-b4d52f038a6b.4538.7 2024-09-12T00:32:41.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.665+0000 7f996682d9c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:32:41.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.665+0000 7f996682d9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:32:41.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.669+0000 7f996682d9c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:32:41.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.669+0000 7f996682d9c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:32:41.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.669+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995407d2b0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x558f68ef0e58 s->prefetch_data=0 2024-09-12T00:32:41.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.673+0000 7f996682d9c0 10 manifest: total_size = 2078 2024-09-12T00:32:41.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.673+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.6188920870170586014 2024-09-12T00:32:41.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.673+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995407d2b0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x558f68ef0e58 s->prefetch_data=0 2024-09-12T00:32:41.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.673+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ef0e58 2024-09-12T00:32:41.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.673+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.7.2 2024-09-12T00:32:41.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.681+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.681+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.681+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.6188920870170586014 2024-09-12T00:32:41.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.681+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.681+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.7__shadow_.ek7FdOdF-5b2klEnCX9x0JGeh6Cdffz_0 2024-09-12T00:32:41.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.681+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:32:41.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.681+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.681+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.6188920870170586014 2024-09-12T00:32:41.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.685+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:32:41.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.685+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68f3c140 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x558f68ef0e58 s->prefetch_data=0 2024-09-12T00:32:41.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.685+0000 7f996682d9c0 10 manifest: total_size = 24595 2024-09-12T00:32:41.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.685+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.11450409698346634935 2024-09-12T00:32:41.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.685+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68f3c140 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x558f68ef0e58 s->prefetch_data=0 2024-09-12T00:32:41.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.685+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ef0e58 2024-09-12T00:32:41.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.685+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.7.3 2024-09-12T00:32:41.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.689+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.689+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.689+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.11450409698346634935 2024-09-12T00:32:41.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.689+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.689+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.7__shadow_.4PnT9sqHONWktmgGIQVCSi3Fdazy_4c_0 2024-09-12T00:32:41.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.689+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:32:41.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.689+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.689+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.11450409698346634935 2024-09-12T00:32:41.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.693+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995405c640 obj=test-client.0-r-test-small-obj-data.2:__ state=0x558f68ef0e58 s->prefetch_data=0 2024-09-12T00:32:41.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.693+0000 7f983affd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:32:41.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.693+0000 7f996682d9c0 10 manifest: total_size = 524288 2024-09-12T00:32:41.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.693+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.17439981507388714639 2024-09-12T00:32:41.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.693+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995405c640 obj=test-client.0-r-test-small-obj-data.2:__ state=0x558f68ef0e58 s->prefetch_data=0 2024-09-12T00:32:41.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.693+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ef0e58 2024-09-12T00:32:41.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.693+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.7.6 2024-09-12T00:32:41.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.701+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.701+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.701+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.17439981507388714639 2024-09-12T00:32:41.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.701+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.701+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.7__shadow_.RAIvjX3-wXg0EqhW2LTlBC2Y6zoLcNY_0 2024-09-12T00:32:41.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.701+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:32:41.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.701+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.701+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.17439981507388714639 2024-09-12T00:32:41.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.705+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995405c640 obj=test-client.0-r-test-small-obj-data.2:obj state=0x558f68ef0e58 s->prefetch_data=0 2024-09-12T00:32:41.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.705+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:32:41.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.705+0000 7f996682d9c0 10 manifest: total_size = 2078 2024-09-12T00:32:41.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.705+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.3320846641809965331 2024-09-12T00:32:41.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.705+0000 7f996682d9c0 20 get_obj_state: octx=0x7f995405c640 obj=test-client.0-r-test-small-obj-data.2:obj state=0x558f68ef0e58 s->prefetch_data=0 2024-09-12T00:32:41.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.705+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ef0e58 2024-09-12T00:32:41.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.705+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.7.8 2024-09-12T00:32:41.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.713+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.713+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.713+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.3320846641809965331 2024-09-12T00:32:41.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.713+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.713+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.7__shadow_.Q90C93uXvrPKrjpC492tpVYUQ9s4hpa_0 2024-09-12T00:32:41.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.713+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:32:41.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.713+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.713+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.3320846641809965331 2024-09-12T00:32:41.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.717+0000 7f983affd640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:32:41.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.717+0000 7f996682d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:32:41.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.717+0000 7f996682d9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:32:41.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.717+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:32:41.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.717+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:32:41.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.717+0000 7f996682d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:32:41.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.717+0000 7f996682d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:32:41.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.717+0000 7f996682d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[e2043445-c131-4520-984d-b4d52f038a6b.4538.7])"; uploads.size()=0; is_truncated=0 2024-09-12T00:32:41.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.725+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T00:32:41.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.725+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.725+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:32:41.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.725+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T00:32:41.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.725+0000 7f996682d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T00:32:41.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.729+0000 7f996682d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T00:32:41.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.729+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T00:32:41.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.729+0000 7f983b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333508 cookie 94074428770912 notifier 6000 bl.length()=181 2024-09-12T00:32:41.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.733+0000 7f996682d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:e2043445-c131-4520-984d-b4d52f038a6b.4538.7 from cache 2024-09-12T00:32:41.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.733+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:e2043445-c131-4520-984d-b4d52f038a6b.4538.7, ofs0, ns] 2024-09-12T00:32:41.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.733+0000 7f983affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333461 cookie 94074428753312 notifier 6000 bl.length()=238 2024-09-12T00:32:41.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.741+0000 7f996682d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/e2043445-c131-4520-984d-b4d52f038a6b.4538.7 : miss 2024-09-12T00:32:41.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.741+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.741+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.741+0000 7f996682d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/e2043445-c131-4520-984d-b4d52f038a6b.4538.7 info.flags=0x0 2024-09-12T00:32:41.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.741+0000 7f996682d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/e2043445-c131-4520-984d-b4d52f038a6b.4538.7 to cache LRU end 2024-09-12T00:32:41.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.745+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e2043445-c131-4520-984d-b4d52f038a6b.4538.8 : miss 2024-09-12T00:32:41.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.745+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.749+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:32:41.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.749+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e2043445-c131-4520-984d-b4d52f038a6b.4538.8 info.flags=0x17 2024-09-12T00:32:41.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.749+0000 7f996682d9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e2043445-c131-4520-984d-b4d52f038a6b.4538.8 to cache LRU end 2024-09-12T00:32:41.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.749+0000 7f996682d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:41.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.749+0000 7f996682d9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:32:41.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.749+0000 7f996682d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e2043445-c131-4520-984d-b4d52f038a6b.4538.8 2024-09-12T00:32:41.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.749+0000 7f996682d9c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:32:41.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.753+0000 7f996682d9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:32:41.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.753+0000 7f996682d9c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:32:41.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.757+0000 7f996682d9c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:32:41.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.757+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68eddbe0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.761+0000 7f996682d9c0 10 manifest: total_size = 1048576 2024-09-12T00:32:41.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.761+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.11083655623854992699 2024-09-12T00:32:41.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.761+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68eddbe0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.761+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ebda98 2024-09-12T00:32:41.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.761+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.8.2 2024-09-12T00:32:41.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.765+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.765+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.765+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.11083655623854992699 2024-09-12T00:32:41.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.765+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.765+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.8__shadow_.N0cxNrp5vTChb9EpN7q6Mx4ag7NhoCm_0 2024-09-12T00:32:41.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.765+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:32:41.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.765+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.765+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.11083655623854992699 2024-09-12T00:32:41.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.769+0000 7f983affd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:32:41.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.769+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68eddbe0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.773+0000 7f996682d9c0 10 manifest: total_size = 49187 2024-09-12T00:32:41.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.773+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.3726023757901528706 2024-09-12T00:32:41.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.773+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68eddbe0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.773+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ebda98 2024-09-12T00:32:41.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.773+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.8.3 2024-09-12T00:32:41.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.777+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.777+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.777+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.3726023757901528706 2024-09-12T00:32:41.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.777+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.777+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.8__shadow_.PQEsvf1gFDOzTkV7csQXDK6W4FpohX1_0 2024-09-12T00:32:41.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.777+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:32:41.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.777+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.777+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.3726023757901528706 2024-09-12T00:32:41.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.781+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:32:41.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.785+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68f3c140 obj=test-client.0-r-test-small-obj-data.3:__ state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.785+0000 7f996682d9c0 10 manifest: total_size = 4134 2024-09-12T00:32:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.785+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.13766511971138853259 2024-09-12T00:32:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.785+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68f3c140 obj=test-client.0-r-test-small-obj-data.3:__ state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.785+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ebda98 2024-09-12T00:32:41.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.785+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.8.6 2024-09-12T00:32:41.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.789+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.789+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.789+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.13766511971138853259 2024-09-12T00:32:41.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.789+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.789+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.8__shadow_.IPdJgDre9SGSog7U4Ta0NAO5aIaBX9G_0 2024-09-12T00:32:41.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.789+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:32:41.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.789+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.789+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.13766511971138853259 2024-09-12T00:32:41.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.793+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68eddbe0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.793+0000 7f983affd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:32:41.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.793+0000 7f996682d9c0 10 manifest: total_size = 1048576 2024-09-12T00:32:41.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.793+0000 7f996682d9c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.13902784687612969538 2024-09-12T00:32:41.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.793+0000 7f996682d9c0 20 get_obj_state: octx=0x558f68eddbe0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x558f68ebda98 s->prefetch_data=0 2024-09-12T00:32:41.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.793+0000 7f996682d9c0 20 prepare_atomic_modification: state is not atomic. state=0x558f68ebda98 2024-09-12T00:32:41.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.793+0000 7f996682d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.8.8 2024-09-12T00:32:41.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.801+0000 7f996682d9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:32:41.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.801+0000 7f996682d9c0 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T00:32:41.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.801+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.13902784687612969538 2024-09-12T00:32:41.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.801+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:32:41.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.801+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: e2043445-c131-4520-984d-b4d52f038a6b.4538.8__shadow_.RsfktUS5Wm8jzYoCh8NO2D_P3Wez469_0 2024-09-12T00:32:41.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.801+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:32:41.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.801+0000 7f996682d9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:32:41.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.801+0000 7f996682d9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: e2043445-c131-4520-984d-b4d52f038a6b.4538.13902784687612969538 2024-09-12T00:32:41.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.805+0000 7f983b7fe640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:32:41.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.805+0000 7f996682d9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:32:41.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.805+0000 7f996682d9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:32:41.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.805+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:32:41.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.805+0000 7f996682d9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:32:41.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.805+0000 7f996682d9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:32:41.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.805+0000 7f996682d9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:32:41.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.805+0000 7f996682d9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[e2043445-c131-4520-984d-b4d52f038a6b.4538.8])"; uploads.size()=0; is_truncated=0 2024-09-12T00:32:41.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.809+0000 7f996682d9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T00:32:41.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.809+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.813+0000 7f996682d9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:32:41.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.813+0000 7f996682d9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T00:32:41.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.813+0000 7f996682d9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T00:32:41.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.813+0000 7f996682d9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T00:32:41.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.813+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T00:32:41.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.813+0000 7f983affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333509 cookie 94074428770912 notifier 6000 bl.length()=181 2024-09-12T00:32:41.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.817+0000 7f996682d9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:e2043445-c131-4520-984d-b4d52f038a6b.4538.8 from cache 2024-09-12T00:32:41.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.817+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:e2043445-c131-4520-984d-b4d52f038a6b.4538.8, ofs0, ns] 2024-09-12T00:32:41.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.817+0000 7f983affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333462 cookie 94074428753312 notifier 6000 bl.length()=238 2024-09-12T00:32:41.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.825+0000 7f996682d9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/e2043445-c131-4520-984d-b4d52f038a6b.4538.8 : miss 2024-09-12T00:32:41.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.825+0000 7f996682d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.825+0000 7f996682d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.825+0000 7f996682d9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/e2043445-c131-4520-984d-b4d52f038a6b.4538.8 info.flags=0x0 2024-09-12T00:32:41.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.825+0000 7f996682d9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/e2043445-c131-4520-984d-b4d52f038a6b.4538.8 to cache LRU end 2024-09-12T00:32:41.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.833+0000 7f996682d9c0 10 removing key index: BJOKEJQSJXRFOVAAWYZB 2024-09-12T00:32:41.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.833+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:BJOKEJQSJXRFOVAAWYZB, ofs0, ns] 2024-09-12T00:32:41.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.837+0000 7f983b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333521 cookie 94074428782464 notifier 6000 bl.length()=170 2024-09-12T00:32:41.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.837+0000 7f996682d9c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T00:32:41.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.837+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:32:41.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.837+0000 7f983affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333461 cookie 94074428773120 notifier 6000 bl.length()=182 2024-09-12T00:32:41.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.841+0000 7f996682d9c0 10 removing user buckets index 2024-09-12T00:32:41.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.841+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T00:32:41.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.845+0000 7f983b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333522 cookie 94074428782464 notifier 6000 bl.length()=173 2024-09-12T00:32:41.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.845+0000 7f996682d9c0 10 removing user index: ragweed.client.0 2024-09-12T00:32:41.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.849+0000 7f996682d9c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T00:32:41.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.849+0000 7f996682d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:32:41.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.849+0000 7f983b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333510 cookie 94074428755888 notifier 6000 bl.length()=165 2024-09-12T00:32:41.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.853+0000 7f981afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:41.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.857+0000 7f996682d9c0 20 remove_watcher() i=0 2024-09-12T00:32:41.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.857+0000 7f996682d9c0 2 removed watcher, disabling cache 2024-09-12T00:32:41.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.861+0000 7f996682d9c0 20 remove_watcher() i=1 2024-09-12T00:32:41.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.861+0000 7f996682d9c0 20 remove_watcher() i=2 2024-09-12T00:32:41.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.865+0000 7f996682d9c0 20 remove_watcher() i=3 2024-09-12T00:32:41.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.865+0000 7f996682d9c0 20 remove_watcher() i=4 2024-09-12T00:32:41.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.869+0000 7f996682d9c0 20 remove_watcher() i=5 2024-09-12T00:32:41.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.873+0000 7f996682d9c0 20 remove_watcher() i=6 2024-09-12T00:32:41.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:41.877+0000 7f996682d9c0 20 remove_watcher() i=7 2024-09-12T00:32:41.894 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T00:32:41.973 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:41.973 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:42.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.017+0000 7fdbe9bcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:42.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.021+0000 7fdbe9bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:42.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.021+0000 7fdbe9bcb9c0 20 realm 2024-09-12T00:32:42.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.021+0000 7fdbe9bcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:42.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.021+0000 7fdbe9bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:42.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.021+0000 7fdbe9bcb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:42.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.021+0000 7fdbe9bcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:42.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.021+0000 7fdbe9bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:42.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.021+0000 7fdbe9bcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:42.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.021+0000 7fdbe9bcb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:42.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.021+0000 7fdbe9bcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:42.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.021+0000 7fdbe9bcb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:42.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.021+0000 7fdbe9bcb9c0 20 searching for the correct realm 2024-09-12T00:32:42.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.229+0000 7fdbe7ed2640 0 -- 172.21.15.138:0/2294812039 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fdbe0033400 msgr2=0x7fdbe0033860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:42.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.445+0000 7fdbe7ed2640 0 -- 172.21.15.138:0/2294812039 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55d92052ffd0 msgr2=0x55d920532490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:42.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.453+0000 7fdbe9bcb9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:32:42.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.453+0000 7fdbe9bcb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:42.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.453+0000 7fdbe9bcb9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:32:42.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.453+0000 7fdbe9bcb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:42.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.453+0000 7fdbe9bcb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:42.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.453+0000 7fdbe9bcb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:42.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.453+0000 7fdbe9bcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:42.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.457+0000 7fdbe9bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:42.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.457+0000 7fdbe9bcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:42.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.457+0000 7fdbe9bcb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:42.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.457+0000 7fdbe9bcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:42.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.457+0000 7fdbe9bcb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:42.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.457+0000 7fdbe9bcb9c0 20 zone default found 2024-09-12T00:32:42.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.457+0000 7fdbe9bcb9c0 4 Realm: () 2024-09-12T00:32:42.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.457+0000 7fdbe9bcb9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:32:42.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.457+0000 7fdbe9bcb9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:32:42.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.457+0000 7fdbe9bcb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:42.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.457+0000 7fdbe9bcb9c0 20 zonegroup default 2024-09-12T00:32:42.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.457+0000 7fdbe9bcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:42.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.457+0000 7fdbe9bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:42.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.457+0000 7fdbe9bcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:42.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.457+0000 7fdbe9bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:42.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.457+0000 7fdbe9bcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:42.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.461+0000 7fdbe9bcb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:42.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.461+0000 7fdbe9bcb9c0 20 started sync module instance, tier type = 2024-09-12T00:32:42.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.461+0000 7fdbe9bcb9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:32:42.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.485+0000 7fdbe9bcb9c0 20 add_watcher() i=0 2024-09-12T00:32:42.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.485+0000 7fdbe9bcb9c0 20 add_watcher() i=1 2024-09-12T00:32:42.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.485+0000 7fdbe9bcb9c0 20 add_watcher() i=2 2024-09-12T00:32:42.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.485+0000 7fdbe9bcb9c0 20 add_watcher() i=3 2024-09-12T00:32:42.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.485+0000 7fdbe9bcb9c0 20 add_watcher() i=4 2024-09-12T00:32:42.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.485+0000 7fdbe9bcb9c0 20 add_watcher() i=5 2024-09-12T00:32:42.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.485+0000 7fdbe9bcb9c0 20 add_watcher() i=6 2024-09-12T00:32:42.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.485+0000 7fdbe9bcb9c0 20 add_watcher() i=7 2024-09-12T00:32:42.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.485+0000 7fdbe9bcb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:42.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.489+0000 7fda9e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:42.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.489+0000 7fdbe9bcb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:42.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.489+0000 7fdbe9bcb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:42.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.581+0000 7fda9d7e2640 20 reqs_thread_entry: start 2024-09-12T00:32:42.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.581+0000 7fdbe9bcb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:42.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.581+0000 7fdbe9bcb9c0 20 Filter name: none 2024-09-12T00:32:42.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.581+0000 7fda967fc640 20 reqs_thread_entry: start 2024-09-12T00:32:42.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.581+0000 7fdbe9bcb9c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:32:42.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.581+0000 7fdbe9bcb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:42.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.585+0000 7fdbe9bcb9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:32:42.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.585+0000 7fdbe9bcb9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T00:32:42.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.585+0000 7fdbe9bcb9c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:32:42.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.585+0000 7fdbe9bcb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:42.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.585+0000 7fdbe9bcb9c0 10 removing key index: HBEMHDTVFGZEUUMEPMBZ 2024-09-12T00:32:42.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.589+0000 7fdbe9bcb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:HBEMHDTVFGZEUUMEPMBZ, ofs0, ns] 2024-09-12T00:32:42.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.589+0000 7fdacaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333462 cookie 94391038592464 notifier 6018 bl.length()=170 2024-09-12T00:32:42.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.589+0000 7fdbe9bcb9c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T00:32:42.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.589+0000 7fdbe9bcb9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:32:42.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.593+0000 7fdacaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333511 cookie 94391038590960 notifier 6018 bl.length()=182 2024-09-12T00:32:42.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.593+0000 7fdbe9bcb9c0 10 removing user buckets index 2024-09-12T00:32:42.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.593+0000 7fdbe9bcb9c0 10 removing user index: sysuser.client.0 2024-09-12T00:32:42.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.597+0000 7fdbe9bcb9c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T00:32:42.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.597+0000 7fdbe9bcb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:32:42.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.597+0000 7fdacaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333463 cookie 94391038592464 notifier 6018 bl.length()=165 2024-09-12T00:32:42.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.597+0000 7fda9e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:42.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.601+0000 7fdbe9bcb9c0 20 remove_watcher() i=0 2024-09-12T00:32:42.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.601+0000 7fdbe9bcb9c0 2 removed watcher, disabling cache 2024-09-12T00:32:42.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.605+0000 7fdbe9bcb9c0 20 remove_watcher() i=1 2024-09-12T00:32:42.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.605+0000 7fdbe9bcb9c0 20 remove_watcher() i=2 2024-09-12T00:32:42.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.609+0000 7fdbe9bcb9c0 20 remove_watcher() i=3 2024-09-12T00:32:42.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.613+0000 7fdbe9bcb9c0 20 remove_watcher() i=4 2024-09-12T00:32:42.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.613+0000 7fdbe9bcb9c0 20 remove_watcher() i=5 2024-09-12T00:32:42.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.617+0000 7fdbe9bcb9c0 20 remove_watcher() i=6 2024-09-12T00:32:42.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:32:42.621+0000 7fdbe9bcb9c0 20 remove_watcher() i=7 2024-09-12T00:32:42.631 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T00:32:42.632 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:32:42.722 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:32:42.732 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:32:42.732 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:32:42.732 DEBUG:teuthology.orchestra.run.smithi138:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:32:42.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:32:42.739 INFO:teuthology.orchestra.run.smithi138.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:32:42.739 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:32:42.788 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:32:42.788 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:32:42.836 INFO:tasks.workunit:timeout=3h 2024-09-12T00:32:42.836 INFO:tasks.workunit:cleanup=True 2024-09-12T00:32:42.837 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:32:42.886 INFO:tasks.workunit.client.0.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:33:25.791 INFO:tasks.workunit.client.0.smithi138.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:33:25.791 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:25.791 INFO:tasks.workunit.client.0.smithi138.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:33:25.792 INFO:tasks.workunit.client.0.smithi138.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:33:25.792 INFO:tasks.workunit.client.0.smithi138.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:33:25.792 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:25.792 INFO:tasks.workunit.client.0.smithi138.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:33:25.792 INFO:tasks.workunit.client.0.smithi138.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:33:25.792 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:25.792 INFO:tasks.workunit.client.0.smithi138.stderr: git switch -c 2024-09-12T00:33:25.792 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:25.792 INFO:tasks.workunit.client.0.smithi138.stderr:Or undo this operation with: 2024-09-12T00:33:25.792 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:25.792 INFO:tasks.workunit.client.0.smithi138.stderr: git switch - 2024-09-12T00:33:25.792 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:25.793 INFO:tasks.workunit.client.0.smithi138.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:33:25.793 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:25.793 INFO:tasks.workunit.client.0.smithi138.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:33:25.798 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:33:25.844 INFO:tasks.workunit.client.0.smithi138.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:33:25.848 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:33:25.848 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:33:25.908 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:33:25.967 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:33:26.013 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:33:26.015 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:33:26.015 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:33:26.057 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:33:26.061 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:33:26.061 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:33:26.108 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T00:33:26.110 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T00:33:26.110 DEBUG:teuthology.orchestra.run.smithi138:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:33:26.161 INFO:tasks.workunit.client.0.smithi138.stderr:+ ulimit -c 0 2024-09-12T00:33:26.161 INFO:tasks.workunit.client.0.smithi138.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:33:26.162 INFO:tasks.workunit.client.0.smithi138.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:33:26.162 INFO:tasks.workunit.client.0.smithi138.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:33:29.081 INFO:tasks.workunit.client.0.smithi138.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:33:29.082 INFO:tasks.workunit.client.0.smithi138.stderr:++ deactivate nondestructive 2024-09-12T00:33:29.082 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-12T00:33:29.082 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-12T00:33:29.082 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:33:29.082 INFO:tasks.workunit.client.0.smithi138.stderr:++ hash -r 2024-09-12T00:33:29.082 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-12T00:33:29.082 INFO:tasks.workunit.client.0.smithi138.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:33:29.082 INFO:tasks.workunit.client.0.smithi138.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:33:29.082 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:33:29.082 INFO:tasks.workunit.client.0.smithi138.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:33:29.082 INFO:tasks.workunit.client.0.smithi138.stderr:++ export VIRTUAL_ENV 2024-09-12T00:33:29.082 INFO:tasks.workunit.client.0.smithi138.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:33:29.082 INFO:tasks.workunit.client.0.smithi138.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:33:29.083 INFO:tasks.workunit.client.0.smithi138.stderr:++ export PATH 2024-09-12T00:33:29.083 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-12T00:33:29.083 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -z '' ']' 2024-09-12T00:33:29.083 INFO:tasks.workunit.client.0.smithi138.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:33:29.083 INFO:tasks.workunit.client.0.smithi138.stderr:++ PS1='(rgw) ' 2024-09-12T00:33:29.083 INFO:tasks.workunit.client.0.smithi138.stderr:++ export PS1 2024-09-12T00:33:29.083 INFO:tasks.workunit.client.0.smithi138.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T00:33:29.083 INFO:tasks.workunit.client.0.smithi138.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T00:33:29.083 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:33:29.083 INFO:tasks.workunit.client.0.smithi138.stderr:++ hash -r 2024-09-12T00:33:29.083 INFO:tasks.workunit.client.0.smithi138.stderr:+ pip install pip --upgrade 2024-09-12T00:33:29.441 INFO:tasks.workunit.client.0.smithi138.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:33:29.648 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting pip 2024-09-12T00:33:29.653 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:33:29.688 INFO:tasks.workunit.client.0.smithi138.stdout:Installing collected packages: pip 2024-09-12T00:33:29.688 INFO:tasks.workunit.client.0.smithi138.stdout: Attempting uninstall: pip 2024-09-12T00:33:29.688 INFO:tasks.workunit.client.0.smithi138.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:33:29.953 INFO:tasks.workunit.client.0.smithi138.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:33:29.959 INFO:tasks.workunit.client.0.smithi138.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:33:30.970 INFO:tasks.workunit.client.0.smithi138.stdout:Successfully installed pip-24.2 2024-09-12T00:33:31.041 INFO:tasks.workunit.client.0.smithi138.stderr:+ pip install boto3 2024-09-12T00:33:32.049 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting boto3 2024-09-12T00:33:32.050 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:33:32.643 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:33:32.644 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:33:32.702 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:33:32.703 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:33:32.758 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:33:32.758 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:33:32.808 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:33:32.809 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:33:32.877 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:33:32.878 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:33:33.105 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:33:33.106 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:33:33.110 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:33:33.111 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:33:33.121 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:33:33.122 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:33:33.123 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:33:33.125 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:33:33.126 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:33:33.198 INFO:tasks.workunit.client.0.smithi138.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:33:34.403 INFO:tasks.workunit.client.0.smithi138.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:33:34.619 INFO:tasks.workunit.client.0.smithi138.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T00:33:34.758 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T00:33:34.800 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:34.800 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:34.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:34.844+0000 7f65eaffe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:34.844+0000 7f65eaffe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:34.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:34.844+0000 7f65eaffe9c0 20 realm 2024-09-12T00:33:34.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:34.844+0000 7f65eaffe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:34.844+0000 7f65eaffe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:34.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:34.844+0000 7f65eaffe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:34.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:34.844+0000 7f65eaffe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:34.844+0000 7f65eaffe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:34.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:34.844+0000 7f65eaffe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:34.844+0000 7f65eaffe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:34.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:34.844+0000 7f65eaffe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:34.848+0000 7f65eaffe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:34.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:34.848+0000 7f65eaffe9c0 20 searching for the correct realm 2024-09-12T00:33:34.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:34.852+0000 7f65e8b04640 0 -- 172.21.15.138:0/3907317339 >> [v2:172.21.15.138:6816/3496313381,v1:172.21.15.138:6817/3496313381] conn(0x7f65e0017020 msgr2=0x7f65e0033440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:34.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:34.860+0000 7f65e8b04640 0 -- 172.21.15.138:0/3907317339 >> [v2:172.21.15.178:6811/2062234204,v1:172.21.15.178:6813/2062234204] conn(0x7f65d8099050 msgr2=0x7f65d8088330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:35.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.072+0000 7f65eaffe9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:33:35.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.072+0000 7f65eaffe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:35.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.072+0000 7f65eaffe9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:33:35.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.072+0000 7f65eaffe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:35.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.072+0000 7f65eaffe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:35.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.072+0000 7f65eaffe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:35.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.072+0000 7f65eaffe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:35.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.072+0000 7f65eaffe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:35.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.072+0000 7f65eaffe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:35.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.076+0000 7f65eaffe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:35.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.076+0000 7f65eaffe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:35.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.076+0000 7f65eaffe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:35.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.076+0000 7f65eaffe9c0 20 zone default found 2024-09-12T00:33:35.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.076+0000 7f65eaffe9c0 4 Realm: () 2024-09-12T00:33:35.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.076+0000 7f65eaffe9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:33:35.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.076+0000 7f65eaffe9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:33:35.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.076+0000 7f65eaffe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:35.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.076+0000 7f65eaffe9c0 20 zonegroup default 2024-09-12T00:33:35.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.076+0000 7f65eaffe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:35.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.076+0000 7f65eaffe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:35.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.076+0000 7f65eaffe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:35.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.076+0000 7f65eaffe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:35.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.076+0000 7f65eaffe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:35.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.076+0000 7f65eaffe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:35.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.076+0000 7f65eaffe9c0 20 started sync module instance, tier type = 2024-09-12T00:33:35.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.076+0000 7f65eaffe9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:33:35.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.100+0000 7f65eaffe9c0 20 add_watcher() i=0 2024-09-12T00:33:35.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.100+0000 7f65eaffe9c0 20 add_watcher() i=1 2024-09-12T00:33:35.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.100+0000 7f65eaffe9c0 20 add_watcher() i=2 2024-09-12T00:33:35.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.100+0000 7f65eaffe9c0 20 add_watcher() i=3 2024-09-12T00:33:35.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.100+0000 7f65eaffe9c0 20 add_watcher() i=4 2024-09-12T00:33:35.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.100+0000 7f65eaffe9c0 20 add_watcher() i=5 2024-09-12T00:33:35.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.100+0000 7f65eaffe9c0 20 add_watcher() i=6 2024-09-12T00:33:35.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.104+0000 7f65eaffe9c0 20 add_watcher() i=7 2024-09-12T00:33:35.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.104+0000 7f65eaffe9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:35.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.108+0000 7f649f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:35.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.108+0000 7f65eaffe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:35.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.108+0000 7f65eaffe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:35.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.108+0000 7f65eaffe9c0 5 note: GC not initialized 2024-09-12T00:33:35.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.108+0000 7f649e7e4640 20 reqs_thread_entry: start 2024-09-12T00:33:35.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.108+0000 7f65eaffe9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:35.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.108+0000 7f65eaffe9c0 20 Filter name: none 2024-09-12T00:33:35.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.108+0000 7f64977fe640 20 reqs_thread_entry: start 2024-09-12T00:33:35.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.108+0000 7f65eaffe9c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T00:33:35.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.108+0000 7f65eaffe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:35.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.108+0000 7f65eaffe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:35.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.108+0000 7f65eaffe9c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T00:33:35.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.108+0000 7f65eaffe9c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:33:35.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.108+0000 7f65eaffe9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T00:33:35.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.108+0000 7f65eaffe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:35.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.112+0000 7f65eaffe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:35.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.112+0000 7f65eaffe9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T00:33:35.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.112+0000 7f65eaffe9c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:33:35.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.112+0000 7f65eaffe9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:33:35.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.112+0000 7f65eaffe9c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:33:35.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.112+0000 7f65eaffe9c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T00:33:35.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.112+0000 7f65eaffe9c0 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:33:35.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.112+0000 7f65eaffe9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-12T00:33:35.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.116+0000 7f64bffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333523 cookie 94026097569280 notifier 5690 bl.length()=569 2024-09-12T00:33:35.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.116+0000 7f64bffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T00:33:35.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.116+0000 7f64bffff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:33:35.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.120+0000 7f65eaffe9c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:33:35.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.120+0000 7f65eaffe9c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:33:35.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.120+0000 7f65eaffe9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T00:33:35.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.120+0000 7f64bf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333524 cookie 94026097588464 notifier 5690 bl.length()=180 2024-09-12T00:33:35.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.120+0000 7f64bf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:33:35.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.120+0000 7f64bf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:33:35.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.120+0000 7f649f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:35.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.128+0000 7f65eaffe9c0 20 remove_watcher() i=0 2024-09-12T00:33:35.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.128+0000 7f65eaffe9c0 2 removed watcher, disabling cache 2024-09-12T00:33:35.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.132+0000 7f65eaffe9c0 20 remove_watcher() i=1 2024-09-12T00:33:35.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.132+0000 7f65eaffe9c0 20 remove_watcher() i=2 2024-09-12T00:33:35.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.136+0000 7f65eaffe9c0 20 remove_watcher() i=3 2024-09-12T00:33:35.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.136+0000 7f65eaffe9c0 20 remove_watcher() i=4 2024-09-12T00:33:35.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.140+0000 7f65eaffe9c0 20 remove_watcher() i=5 2024-09-12T00:33:35.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.144+0000 7f65eaffe9c0 20 remove_watcher() i=6 2024-09-12T00:33:35.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:35.148+0000 7f65eaffe9c0 20 remove_watcher() i=7 2024-09-12T00:33:48.515 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:48.516 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:48.570 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:48.571 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:48.599 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:48.600 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:48.631 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:48.631 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:48.645 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:48.645 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:48.692 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:48.692 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:48.737 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard add 2024-09-12T00:33:48.737 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:48.737 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:33:48.771 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:48.771 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:48.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.815+0000 7fe5f92629c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.819+0000 7fe5f92629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.819+0000 7fe5f92629c0 20 realm 2024-09-12T00:33:48.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.819+0000 7fe5f92629c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.819+0000 7fe5f92629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.819+0000 7fe5f92629c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:48.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.819+0000 7fe5f92629c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.819+0000 7fe5f92629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.819+0000 7fe5f92629c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.819+0000 7fe5f92629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:48.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.819+0000 7fe5f92629c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.823+0000 7fe5f92629c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:48.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.823+0000 7fe5f92629c0 20 searching for the correct realm 2024-09-12T00:33:48.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.827+0000 7fe5f6567640 0 -- 172.21.15.138:0/2018504321 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7fe5e8008040 msgr2=0x7fe5e8067c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:48.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.831+0000 7fe5f6567640 0 -- 172.21.15.138:0/2018504321 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x5619ccb24b50 msgr2=0x5619ccb26f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:48.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:33:48.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:48.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:33:48.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:48.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:48.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:48.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:48.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:48.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 zone default found 2024-09-12T00:33:48.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 4 Realm: () 2024-09-12T00:33:48.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:33:48.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:33:48.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:48.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 zonegroup default 2024-09-12T00:33:48.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 started sync module instance, tier type = 2024-09-12T00:33:48.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.843+0000 7fe5f92629c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:33:48.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.863+0000 7fe5f92629c0 20 add_watcher() i=0 2024-09-12T00:33:48.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.863+0000 7fe5f92629c0 20 add_watcher() i=1 2024-09-12T00:33:48.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.863+0000 7fe5f92629c0 20 add_watcher() i=2 2024-09-12T00:33:48.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.863+0000 7fe5f92629c0 20 add_watcher() i=3 2024-09-12T00:33:48.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.863+0000 7fe5f92629c0 20 add_watcher() i=4 2024-09-12T00:33:48.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.863+0000 7fe5f92629c0 20 add_watcher() i=5 2024-09-12T00:33:48.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.863+0000 7fe5f92629c0 20 add_watcher() i=6 2024-09-12T00:33:48.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.863+0000 7fe5f92629c0 20 add_watcher() i=7 2024-09-12T00:33:48.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.863+0000 7fe5f92629c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:48.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.867+0000 7fe4ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:48.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.867+0000 7fe5f92629c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:48.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.867+0000 7fe5f92629c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:48.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.867+0000 7fe5f92629c0 5 note: GC not initialized 2024-09-12T00:33:48.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.867+0000 7fe427fff640 20 reqs_thread_entry: start 2024-09-12T00:33:48.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.867+0000 7fe5f92629c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:48.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.867+0000 7fe5f92629c0 20 Filter name: none 2024-09-12T00:33:48.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.867+0000 7fe425ffb640 20 reqs_thread_entry: start 2024-09-12T00:33:48.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.871+0000 7fe5f92629c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.871+0000 7fe5f92629c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:33:48.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.871+0000 7fe5f92629c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.871+0000 7fe5f92629c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:33:48.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.871+0000 7fe5f92629c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:48.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.871+0000 7fe5f92629c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.871+0000 7fe5f92629c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:33:48.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.871+0000 7fe5f92629c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.871+0000 7fe5f92629c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:33:48.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.871+0000 7fe5f92629c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:48.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.875+0000 7fe4ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:48.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.879+0000 7fe5f92629c0 20 remove_watcher() i=0 2024-09-12T00:33:48.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.879+0000 7fe5f92629c0 2 removed watcher, disabling cache 2024-09-12T00:33:48.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.879+0000 7fe5f92629c0 20 remove_watcher() i=1 2024-09-12T00:33:48.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.883+0000 7fe5f92629c0 20 remove_watcher() i=2 2024-09-12T00:33:48.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.883+0000 7fe5f92629c0 20 remove_watcher() i=3 2024-09-12T00:33:48.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.887+0000 7fe5f92629c0 20 remove_watcher() i=4 2024-09-12T00:33:48.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.887+0000 7fe5f92629c0 20 remove_watcher() i=5 2024-09-12T00:33:48.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.891+0000 7fe5f92629c0 20 remove_watcher() i=6 2024-09-12T00:33:48.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.895+0000 7fe5f92629c0 20 remove_watcher() i=7 2024-09-12T00:33:48.907 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:48.907 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:33:48.907 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: a-bucket id: e2043445-c131-4520-984d-b4d52f038a6b.4538.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T00:33:48.907 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:48.907 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-12T00:33:48.937 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:48.937 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:48.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.983+0000 7f64c0e429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.983+0000 7f64c0e429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.983+0000 7f64c0e429c0 20 realm 2024-09-12T00:33:48.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.983+0000 7f64c0e429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.983+0000 7f64c0e429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.983+0000 7f64c0e429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:48.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.983+0000 7f64c0e429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.987+0000 7f64c0e429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.987+0000 7f64c0e429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.987+0000 7f64c0e429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:48.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.987+0000 7f64c0e429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.987+0000 7f64c0e429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:48.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.987+0000 7f64c0e429c0 20 searching for the correct realm 2024-09-12T00:33:48.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.991+0000 7f64be948640 0 -- 172.21.15.138:0/1435932448 >> [v2:172.21.15.138:6816/3496313381,v1:172.21.15.138:6817/3496313381] conn(0x556278722650 msgr2=0x7f64b80a8980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:48.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:48.995+0000 7f64bf149640 0 -- 172.21.15.138:0/1435932448 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x556278951330 msgr2=0x5562789537a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:49.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:33:49.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:49.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:33:49.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:49.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:49.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:49.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:49.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:49.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 zone default found 2024-09-12T00:33:49.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 4 Realm: () 2024-09-12T00:33:49.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:33:49.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:33:49.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:49.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 zonegroup default 2024-09-12T00:33:49.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 started sync module instance, tier type = 2024-09-12T00:33:49.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.007+0000 7f64c0e429c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:33:49.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.027+0000 7f64c0e429c0 20 add_watcher() i=0 2024-09-12T00:33:49.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.027+0000 7f64c0e429c0 20 add_watcher() i=1 2024-09-12T00:33:49.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.027+0000 7f64c0e429c0 20 add_watcher() i=2 2024-09-12T00:33:49.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.027+0000 7f64c0e429c0 20 add_watcher() i=3 2024-09-12T00:33:49.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.027+0000 7f64c0e429c0 20 add_watcher() i=4 2024-09-12T00:33:49.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.027+0000 7f64c0e429c0 20 add_watcher() i=5 2024-09-12T00:33:49.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.027+0000 7f64c0e429c0 20 add_watcher() i=6 2024-09-12T00:33:49.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.031+0000 7f64c0e429c0 20 add_watcher() i=7 2024-09-12T00:33:49.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.031+0000 7f64c0e429c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:49.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.031+0000 7f63757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:49.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.031+0000 7f64c0e429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:49.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.031+0000 7f64c0e429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:49.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.031+0000 7f64c0e429c0 5 note: GC not initialized 2024-09-12T00:33:49.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.031+0000 7f62effff640 20 reqs_thread_entry: start 2024-09-12T00:33:49.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.035+0000 7f64c0e429c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:49.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.035+0000 7f64c0e429c0 20 Filter name: none 2024-09-12T00:33:49.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.035+0000 7f62edffb640 20 reqs_thread_entry: start 2024-09-12T00:33:49.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.035+0000 7f64c0e429c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:33:49.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.035+0000 7f64c0e429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.035+0000 7f64c0e429c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:33:49.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.035+0000 7f64c0e429c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:33:49.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.035+0000 7f64c0e429c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:33:49.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.035+0000 7f64c0e429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:33:49.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.035+0000 7f64c0e429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.035+0000 7f64c0e429c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:33:49.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.035+0000 7f64c0e429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:33:49.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.035+0000 7f64c0e429c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:33:49.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.035+0000 7f64c0e429c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:49.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.035+0000 7f64c0e429c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:33:49.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.035+0000 7f64c0e429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:33:49.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.039+0000 7f63757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:49.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.043+0000 7f64c0e429c0 20 remove_watcher() i=0 2024-09-12T00:33:49.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.043+0000 7f64c0e429c0 2 removed watcher, disabling cache 2024-09-12T00:33:49.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.043+0000 7f64c0e429c0 20 remove_watcher() i=1 2024-09-12T00:33:49.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.047+0000 7f64c0e429c0 20 remove_watcher() i=2 2024-09-12T00:33:49.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.047+0000 7f64c0e429c0 20 remove_watcher() i=3 2024-09-12T00:33:49.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.051+0000 7f64c0e429c0 20 remove_watcher() i=4 2024-09-12T00:33:49.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.051+0000 7f64c0e429c0 20 remove_watcher() i=5 2024-09-12T00:33:49.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.055+0000 7f64c0e429c0 20 remove_watcher() i=6 2024-09-12T00:33:49.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.059+0000 7f64c0e429c0 20 remove_watcher() i=7 2024-09-12T00:33:49.072 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshard list 2024-09-12T00:33:49.097 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:49.097 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:49.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.143+0000 7f67a28569c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.143+0000 7f67a28569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.143+0000 7f67a28569c0 20 realm 2024-09-12T00:33:49.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.143+0000 7f67a28569c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.143+0000 7f67a28569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.143+0000 7f67a28569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:49.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.143+0000 7f67a28569c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.143+0000 7f67a28569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.147+0000 7f67a28569c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.147+0000 7f67a28569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:49.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.147+0000 7f67a28569c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.147+0000 7f67a28569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:49.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.147+0000 7f67a28569c0 20 searching for the correct realm 2024-09-12T00:33:49.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.151+0000 7f67a0b5d640 0 -- 172.21.15.138:0/1410227632 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55843e7c4de0 msgr2=0x55843e7c72a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:49.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.159+0000 7f679fb5b640 0 -- 172.21.15.138:0/1410227632 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55843e7c0080 msgr2=0x55843e7c2470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:49.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.163+0000 7f67a28569c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:33:49.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.163+0000 7f67a28569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:49.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.163+0000 7f67a28569c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:33:49.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.163+0000 7f67a28569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:49.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.163+0000 7f67a28569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:49.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.163+0000 7f67a28569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:49.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.163+0000 7f67a28569c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:49.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:49.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 20 zone default found 2024-09-12T00:33:49.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 4 Realm: () 2024-09-12T00:33:49.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:33:49.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:33:49.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:49.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 20 zonegroup default 2024-09-12T00:33:49.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 20 started sync module instance, tier type = 2024-09-12T00:33:49.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.167+0000 7f67a28569c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:33:49.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.187+0000 7f67a28569c0 20 add_watcher() i=0 2024-09-12T00:33:49.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.187+0000 7f67a28569c0 20 add_watcher() i=1 2024-09-12T00:33:49.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.187+0000 7f67a28569c0 20 add_watcher() i=2 2024-09-12T00:33:49.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.187+0000 7f67a28569c0 20 add_watcher() i=3 2024-09-12T00:33:49.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.187+0000 7f67a28569c0 20 add_watcher() i=4 2024-09-12T00:33:49.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.187+0000 7f67a28569c0 20 add_watcher() i=5 2024-09-12T00:33:49.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.187+0000 7f67a28569c0 20 add_watcher() i=6 2024-09-12T00:33:49.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.191+0000 7f67a28569c0 20 add_watcher() i=7 2024-09-12T00:33:49.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.191+0000 7f67a28569c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:49.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.191+0000 7f6656fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:49.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.195+0000 7f67a28569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:49.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.195+0000 7f67a28569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:49.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.195+0000 7f67a28569c0 5 note: GC not initialized 2024-09-12T00:33:49.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.195+0000 7f6655fdb640 20 reqs_thread_entry: start 2024-09-12T00:33:49.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.195+0000 7f67a28569c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:49.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.195+0000 7f67a28569c0 20 Filter name: none 2024-09-12T00:33:49.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.195+0000 7f65c77fe640 20 reqs_thread_entry: start 2024-09-12T00:33:49.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.203+0000 7f6656fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:49.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.207+0000 7f67a28569c0 20 remove_watcher() i=0 2024-09-12T00:33:49.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.207+0000 7f67a28569c0 2 removed watcher, disabling cache 2024-09-12T00:33:49.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.211+0000 7f67a28569c0 20 remove_watcher() i=1 2024-09-12T00:33:49.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.211+0000 7f67a28569c0 20 remove_watcher() i=2 2024-09-12T00:33:49.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.215+0000 7f67a28569c0 20 remove_watcher() i=3 2024-09-12T00:33:49.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.215+0000 7f67a28569c0 20 remove_watcher() i=4 2024-09-12T00:33:49.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.219+0000 7f67a28569c0 20 remove_watcher() i=5 2024-09-12T00:33:49.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.219+0000 7f67a28569c0 20 remove_watcher() i=6 2024-09-12T00:33:49.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.223+0000 7f67a28569c0 20 remove_watcher() i=7 2024-09-12T00:33:49.236 INFO:tasks.workunit.client.0.smithi138.stderr:bucket name a-bucket 2024-09-12T00:33:49.236 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard process 2024-09-12T00:33:49.236 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:49.236 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshard process 2024-09-12T00:33:49.261 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:49.261 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:49.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.307+0000 7fc4f3e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.311+0000 7fc4f3e1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.311+0000 7fc4f3e1d9c0 20 realm 2024-09-12T00:33:49.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.311+0000 7fc4f3e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.311+0000 7fc4f3e1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.311+0000 7fc4f3e1d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:49.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.311+0000 7fc4f3e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.311+0000 7fc4f3e1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.311+0000 7fc4f3e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.311+0000 7fc4f3e1d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:49.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.311+0000 7fc4f3e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.311+0000 7fc4f3e1d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:49.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.311+0000 7fc4f3e1d9c0 20 searching for the correct realm 2024-09-12T00:33:49.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.319+0000 7fc4f2124640 0 -- 172.21.15.138:0/4062106624 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fc4ec06bb10 msgr2=0x7fc4ec06a870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:49.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.535+0000 7fc4f2124640 0 -- 172.21.15.138:0/4062106624 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x56231e619b50 msgr2=0x56231e61bf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:49.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.543+0000 7fc4f3e1d9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:33:49.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.543+0000 7fc4f3e1d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:49.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.543+0000 7fc4f3e1d9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:33:49.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.543+0000 7fc4f3e1d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:49.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.543+0000 7fc4f3e1d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:49.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.543+0000 7fc4f3e1d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:49.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.543+0000 7fc4f3e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.543+0000 7fc4f3e1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.543+0000 7fc4f3e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.543+0000 7fc4f3e1d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:49.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.543+0000 7fc4f3e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.547+0000 7fc4f3e1d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:49.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.547+0000 7fc4f3e1d9c0 20 zone default found 2024-09-12T00:33:49.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.547+0000 7fc4f3e1d9c0 4 Realm: () 2024-09-12T00:33:49.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.547+0000 7fc4f3e1d9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:33:49.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.547+0000 7fc4f3e1d9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:33:49.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.547+0000 7fc4f3e1d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:49.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.547+0000 7fc4f3e1d9c0 20 zonegroup default 2024-09-12T00:33:49.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.547+0000 7fc4f3e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.547+0000 7fc4f3e1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.547+0000 7fc4f3e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.547+0000 7fc4f3e1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.547+0000 7fc4f3e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.547+0000 7fc4f3e1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.547+0000 7fc4f3e1d9c0 20 started sync module instance, tier type = 2024-09-12T00:33:49.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.547+0000 7fc4f3e1d9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:33:49.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.571+0000 7fc4f3e1d9c0 20 add_watcher() i=0 2024-09-12T00:33:49.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.571+0000 7fc4f3e1d9c0 20 add_watcher() i=1 2024-09-12T00:33:49.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.571+0000 7fc4f3e1d9c0 20 add_watcher() i=2 2024-09-12T00:33:49.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.571+0000 7fc4f3e1d9c0 20 add_watcher() i=3 2024-09-12T00:33:49.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.571+0000 7fc4f3e1d9c0 20 add_watcher() i=4 2024-09-12T00:33:49.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.571+0000 7fc4f3e1d9c0 20 add_watcher() i=5 2024-09-12T00:33:49.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.571+0000 7fc4f3e1d9c0 20 add_watcher() i=6 2024-09-12T00:33:49.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.575+0000 7fc4f3e1d9c0 20 add_watcher() i=7 2024-09-12T00:33:49.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.575+0000 7fc4f3e1d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:49.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.579+0000 7fc3a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:49.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.579+0000 7fc4f3e1d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:49.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.579+0000 7fc4f3e1d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:49.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.579+0000 7fc4f3e1d9c0 5 note: GC not initialized 2024-09-12T00:33:49.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.583+0000 7fc3a27fc640 20 reqs_thread_entry: start 2024-09-12T00:33:49.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.583+0000 7fc4f3e1d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:49.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.583+0000 7fc4f3e1d9c0 20 Filter name: none 2024-09-12T00:33:49.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.583+0000 7fc313fff640 20 reqs_thread_entry: start 2024-09-12T00:33:49.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.583+0000 7fc4f3e1d9c0 20 processing logshard = reshard.0000000000 2024-09-12T00:33:49.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.587+0000 7fc4f3e1d9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:33:49.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.587+0000 7fc4f3e1d9c0 20 processing logshard = reshard.0000000001 2024-09-12T00:33:49.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.591+0000 7fc4f3e1d9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:33:49.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.591+0000 7fc4f3e1d9c0 20 processing logshard = reshard.0000000002 2024-09-12T00:33:49.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.599+0000 7fc4f3e1d9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:33:49.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.599+0000 7fc4f3e1d9c0 20 processing logshard = reshard.0000000003 2024-09-12T00:33:49.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.603+0000 7fc4f3e1d9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:33:49.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.603+0000 7fc4f3e1d9c0 20 processing logshard = reshard.0000000004 2024-09-12T00:33:49.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.611+0000 7fc4f3e1d9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:33:49.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.611+0000 7fc4f3e1d9c0 20 processing logshard = reshard.0000000005 2024-09-12T00:33:49.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.615+0000 7fc4f3e1d9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:33:49.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.615+0000 7fc4f3e1d9c0 20 processing logshard = reshard.0000000006 2024-09-12T00:33:49.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.619+0000 7fc4f3e1d9c0 20 process_entry resharding a-bucket 2024-09-12T00:33:49.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.619+0000 7fc4f3e1d9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:33:49.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.619+0000 7fc4f3e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.619+0000 7fc4f3e1d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:33:49.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.619+0000 7fc4f3e1d9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:33:49.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.619+0000 7fc4f3e1d9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:33:49.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.619+0000 7fc4f3e1d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:33:49.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.619+0000 7fc4f3e1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.619+0000 7fc4f3e1d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:33:49.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.619+0000 7fc4f3e1d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:33:49.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.619+0000 7fc4f3e1d9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:33:49.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.619+0000 7fc4f3e1d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:49.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.619+0000 7fc4f3e1d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:33:49.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.619+0000 7fc4f3e1d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:33:49.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.635+0000 7fc4f3e1d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:33:49.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.635+0000 7fc4f3e1d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:33:49.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.635+0000 7fc4f3e1d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:33:49.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.635+0000 7fc4f3e1d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:33:49.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.635+0000 7fc3d4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333514 cookie 94708833569168 notifier 5759 bl.length()=827 2024-09-12T00:33:49.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.635+0000 7fc3d4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:33:49.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.635+0000 7fc3d4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:33:49.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.635+0000 7fc3d4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:33:49.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.635+0000 7fc4f3e1d9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:33:49.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.635+0000 7fc4f3e1d9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:33:49.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.635+0000 7fc4f3e1d9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:33:49.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.635+0000 7fc4f3e1d9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:33:49.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.0 2024-09-12T00:33:49.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.0 2024-09-12T00:33:49.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.1 2024-09-12T00:33:49.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.1 2024-09-12T00:33:49.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.2 2024-09-12T00:33:49.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.2 2024-09-12T00:33:49.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.3 2024-09-12T00:33:49.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.3 2024-09-12T00:33:49.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.4 2024-09-12T00:33:49.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.4 2024-09-12T00:33:49.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.5 2024-09-12T00:33:49.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.5 2024-09-12T00:33:49.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.6 2024-09-12T00:33:49.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.6 2024-09-12T00:33:49.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.7 2024-09-12T00:33:49.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.7 2024-09-12T00:33:49.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.8 2024-09-12T00:33:49.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.8 2024-09-12T00:33:49.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.9 2024-09-12T00:33:49.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.9 2024-09-12T00:33:49.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.10 2024-09-12T00:33:49.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.10 2024-09-12T00:33:49.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.11 2024-09-12T00:33:49.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.11 2024-09-12T00:33:49.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.0 2024-09-12T00:33:49.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1 2024-09-12T00:33:49.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.647+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2 2024-09-12T00:33:49.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.651+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3 2024-09-12T00:33:49.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.651+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.4 2024-09-12T00:33:49.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.651+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.5 2024-09-12T00:33:49.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.651+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.6 2024-09-12T00:33:49.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.655+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.7 2024-09-12T00:33:49.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.655+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.8 2024-09-12T00:33:49.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.655+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.9 2024-09-12T00:33:49.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.655+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.10 2024-09-12T00:33:49.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.659+0000 7fc4f3e1d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:49.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.659+0000 7fc4f3e1d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:33:49.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.659+0000 7fc4f3e1d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:33:49.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.659+0000 7fc4f3e1d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:33:49.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.659+0000 7fc4f3e1d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:33:49.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.659+0000 7fc4f3e1d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:33:49.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.663+0000 7fc3d4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333515 cookie 94708833569168 notifier 5759 bl.length()=827 2024-09-12T00:33:49.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.663+0000 7fc3d4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:33:49.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.663+0000 7fc3d4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:33:49.660 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.663+0000 7fc3d4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:33:49.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.663+0000 7fc4f3e1d9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:33:49.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.663+0000 7fc4f3e1d9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:33:49.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.663+0000 7fc4f3e1d9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:33:49.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.663+0000 7fc4f3e1d9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:33:49.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.667+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.0 2024-09-12T00:33:49.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.667+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1 2024-09-12T00:33:49.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.671+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2 2024-09-12T00:33:49.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.671+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3 2024-09-12T00:33:49.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.671+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.4 2024-09-12T00:33:49.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.671+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.5 2024-09-12T00:33:49.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.671+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.6 2024-09-12T00:33:49.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.675+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.7 2024-09-12T00:33:49.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.675+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.8 2024-09-12T00:33:49.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.675+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.9 2024-09-12T00:33:49.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.675+0000 7fc4f3e1d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.10 2024-09-12T00:33:49.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.675+0000 7fc4f3e1d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:49.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.675+0000 7fc4f3e1d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:33:49.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.679+0000 7fc4f3e1d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:33:49.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.679+0000 7fc4f3e1d9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:33:49.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.679+0000 7fc4f3e1d9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:33:49.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.679+0000 7fc4f3e1d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:33:49.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.679+0000 7fc3d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333516 cookie 94708833569168 notifier 5759 bl.length()=795 2024-09-12T00:33:49.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.679+0000 7fc3d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:33:49.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.679+0000 7fc3d57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:33:49.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.679+0000 7fc3d57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:33:49.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.679+0000 7fc4f3e1d9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:33:49.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.679+0000 7fc4f3e1d9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:33:49.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.679+0000 7fc4f3e1d9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:33:49.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.679+0000 7fc4f3e1d9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:33:49.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.687+0000 7fc4f3e1d9c0 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-12T00:33:49.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.687+0000 7fc4f3e1d9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:33:49.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.695+0000 7fc4f3e1d9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:33:49.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.695+0000 7fc4f3e1d9c0 20 processing logshard = reshard.0000000007 2024-09-12T00:33:49.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.699+0000 7fc4f3e1d9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:33:49.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.699+0000 7fc4f3e1d9c0 20 processing logshard = reshard.0000000008 2024-09-12T00:33:49.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.707+0000 7fc4f3e1d9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:33:49.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.707+0000 7fc4f3e1d9c0 20 processing logshard = reshard.0000000009 2024-09-12T00:33:49.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.711+0000 7fc4f3e1d9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:33:49.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.711+0000 7fc4f3e1d9c0 20 processing logshard = reshard.0000000010 2024-09-12T00:33:49.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.723+0000 7fc4f3e1d9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:33:49.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.723+0000 7fc4f3e1d9c0 20 processing logshard = reshard.0000000011 2024-09-12T00:33:49.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.727+0000 7fc4f3e1d9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:33:49.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.727+0000 7fc4f3e1d9c0 20 processing logshard = reshard.0000000012 2024-09-12T00:33:49.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.731+0000 7fc4f3e1d9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:33:49.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.731+0000 7fc4f3e1d9c0 20 processing logshard = reshard.0000000013 2024-09-12T00:33:49.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.739+0000 7fc4f3e1d9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:33:49.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.739+0000 7fc4f3e1d9c0 20 processing logshard = reshard.0000000014 2024-09-12T00:33:49.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.743+0000 7fc4f3e1d9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:33:49.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.743+0000 7fc4f3e1d9c0 20 processing logshard = reshard.0000000015 2024-09-12T00:33:49.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.751+0000 7fc4f3e1d9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:33:49.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.751+0000 7fc3a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:49.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.755+0000 7fc4f3e1d9c0 20 remove_watcher() i=0 2024-09-12T00:33:49.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.755+0000 7fc4f3e1d9c0 2 removed watcher, disabling cache 2024-09-12T00:33:49.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.759+0000 7fc4f3e1d9c0 20 remove_watcher() i=1 2024-09-12T00:33:49.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.759+0000 7fc4f3e1d9c0 20 remove_watcher() i=2 2024-09-12T00:33:49.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.763+0000 7fc4f3e1d9c0 20 remove_watcher() i=3 2024-09-12T00:33:49.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.767+0000 7fc4f3e1d9c0 20 remove_watcher() i=4 2024-09-12T00:33:49.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.767+0000 7fc4f3e1d9c0 20 remove_watcher() i=5 2024-09-12T00:33:49.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.771+0000 7fc4f3e1d9c0 20 remove_watcher() i=6 2024-09-12T00:33:49.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:49.775+0000 7fc4f3e1d9c0 20 remove_watcher() i=7 2024-09-12T00:33:54.796 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:33:54.829 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:54.829 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:54.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:54.875+0000 7f04c56419c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:54.879+0000 7f04c56419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:54.879+0000 7f04c56419c0 20 realm 2024-09-12T00:33:54.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:54.879+0000 7f04c56419c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:54.879+0000 7f04c56419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:54.879+0000 7f04c56419c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:54.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:54.879+0000 7f04c56419c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:54.879+0000 7f04c56419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:54.879+0000 7f04c56419c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:54.883+0000 7f04c56419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:54.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:54.883+0000 7f04c56419c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:54.883+0000 7f04c56419c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:54.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:54.883+0000 7f04c56419c0 20 searching for the correct realm 2024-09-12T00:33:54.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:54.887+0000 7f04c3948640 0 -- 172.21.15.138:0/3359890423 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f04bc0c1040 msgr2=0x7f04bc0ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:55.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.107+0000 7f04c3948640 0 -- 172.21.15.138:0/3359890423 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x563c7ec4f200 msgr2=0x563c7ec516a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:55.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.115+0000 7f04c56419c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:33:55.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.115+0000 7f04c56419c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:55.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.115+0000 7f04c56419c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:33:55.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.115+0000 7f04c56419c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:55.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.115+0000 7f04c56419c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:55.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.115+0000 7f04c56419c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:55.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.115+0000 7f04c56419c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.115+0000 7f04c56419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.115+0000 7f04c56419c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.115+0000 7f04c56419c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:55.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.119+0000 7f04c56419c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.119+0000 7f04c56419c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:55.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.119+0000 7f04c56419c0 20 zone default found 2024-09-12T00:33:55.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.119+0000 7f04c56419c0 4 Realm: () 2024-09-12T00:33:55.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.119+0000 7f04c56419c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:33:55.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.119+0000 7f04c56419c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:33:55.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.119+0000 7f04c56419c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:55.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.119+0000 7f04c56419c0 20 zonegroup default 2024-09-12T00:33:55.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.119+0000 7f04c56419c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.119+0000 7f04c56419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.119+0000 7f04c56419c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.119+0000 7f04c56419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.119+0000 7f04c56419c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.119+0000 7f04c56419c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.119+0000 7f04c56419c0 20 started sync module instance, tier type = 2024-09-12T00:33:55.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.119+0000 7f04c56419c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:33:55.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.143+0000 7f04c56419c0 20 add_watcher() i=0 2024-09-12T00:33:55.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.143+0000 7f04c56419c0 20 add_watcher() i=1 2024-09-12T00:33:55.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.143+0000 7f04c56419c0 20 add_watcher() i=2 2024-09-12T00:33:55.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.143+0000 7f04c56419c0 20 add_watcher() i=3 2024-09-12T00:33:55.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.143+0000 7f04c56419c0 20 add_watcher() i=4 2024-09-12T00:33:55.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.143+0000 7f04c56419c0 20 add_watcher() i=5 2024-09-12T00:33:55.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.143+0000 7f04c56419c0 20 add_watcher() i=6 2024-09-12T00:33:55.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.143+0000 7f04c56419c0 20 add_watcher() i=7 2024-09-12T00:33:55.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.143+0000 7f04c56419c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:55.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.147+0000 7f0379fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:55.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.151+0000 7f04c56419c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:55.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.151+0000 7f04c56419c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:55.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.151+0000 7f04c56419c0 5 note: GC not initialized 2024-09-12T00:33:55.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.151+0000 7f0378fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:55.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.151+0000 7f04c56419c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:55.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.151+0000 7f04c56419c0 20 Filter name: none 2024-09-12T00:33:55.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.151+0000 7f02f27fc640 20 reqs_thread_entry: start 2024-09-12T00:33:55.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.151+0000 7f04c56419c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.151+0000 7f04c56419c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:33:55.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.151+0000 7f04c56419c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.151+0000 7f04c56419c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:33:55.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.151+0000 7f04c56419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:55.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.151+0000 7f04c56419c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.151+0000 7f04c56419c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:33:55.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.151+0000 7f04c56419c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.155+0000 7f04c56419c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:33:55.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.155+0000 7f04c56419c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:55.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.159+0000 7f0379fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:55.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.163+0000 7f04c56419c0 20 remove_watcher() i=0 2024-09-12T00:33:55.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.163+0000 7f04c56419c0 2 removed watcher, disabling cache 2024-09-12T00:33:55.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.163+0000 7f04c56419c0 20 remove_watcher() i=1 2024-09-12T00:33:55.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.167+0000 7f04c56419c0 20 remove_watcher() i=2 2024-09-12T00:33:55.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.167+0000 7f04c56419c0 20 remove_watcher() i=3 2024-09-12T00:33:55.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.171+0000 7f04c56419c0 20 remove_watcher() i=4 2024-09-12T00:33:55.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.171+0000 7f04c56419c0 20 remove_watcher() i=5 2024-09-12T00:33:55.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.175+0000 7f04c56419c0 20 remove_watcher() i=6 2024-09-12T00:33:55.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.175+0000 7f04c56419c0 20 remove_watcher() i=7 2024-09-12T00:33:55.190 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:55.190 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:33:55.190 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: a-bucket id: e2043445-c131-4520-984d-b4d52f038a6b.4538.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:33:55.191 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:55.191 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard add non empty bucket 2024-09-12T00:33:55.191 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:55.194 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:55.194 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:55.210 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:55.210 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:55.223 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:55.223 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:55.241 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:55.241 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:55.255 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:55.255 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:55.273 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:55.273 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:55.289 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:55.290 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:55.309 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:55.309 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:55.323 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:33:55.354 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:55.354 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:55.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.399+0000 7fcdfa3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.403+0000 7fcdfa3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.403+0000 7fcdfa3ff9c0 20 realm 2024-09-12T00:33:55.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.403+0000 7fcdfa3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.403+0000 7fcdfa3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.403+0000 7fcdfa3ff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:55.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.403+0000 7fcdfa3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.403+0000 7fcdfa3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.403+0000 7fcdfa3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.403+0000 7fcdfa3ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:55.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.403+0000 7fcdfa3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.403+0000 7fcdfa3ff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:55.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.403+0000 7fcdfa3ff9c0 20 searching for the correct realm 2024-09-12T00:33:55.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.411+0000 7fcdf8706640 0 -- 172.21.15.138:0/1669798232 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fcdf00608d0 msgr2=0x7fcdf00818c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:55.626 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.627+0000 7fcdf8706640 0 -- 172.21.15.138:0/1669798232 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x556a5a92d5c0 msgr2=0x556a5a92fa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:55.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.635+0000 7fcdfa3ff9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:33:55.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.635+0000 7fcdfa3ff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:55.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.635+0000 7fcdfa3ff9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:33:55.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.635+0000 7fcdfa3ff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:55.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.635+0000 7fcdfa3ff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:55.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.635+0000 7fcdfa3ff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:55.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.635+0000 7fcdfa3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.635+0000 7fcdfa3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.635+0000 7fcdfa3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.639+0000 7fcdfa3ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:55.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.639+0000 7fcdfa3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.639+0000 7fcdfa3ff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:55.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.639+0000 7fcdfa3ff9c0 20 zone default found 2024-09-12T00:33:55.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.639+0000 7fcdfa3ff9c0 4 Realm: () 2024-09-12T00:33:55.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.639+0000 7fcdfa3ff9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:33:55.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.639+0000 7fcdfa3ff9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:33:55.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.639+0000 7fcdfa3ff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:55.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.639+0000 7fcdfa3ff9c0 20 zonegroup default 2024-09-12T00:33:55.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.639+0000 7fcdfa3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.639+0000 7fcdfa3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.639+0000 7fcdfa3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.639+0000 7fcdfa3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.639+0000 7fcdfa3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.639+0000 7fcdfa3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.639+0000 7fcdfa3ff9c0 20 started sync module instance, tier type = 2024-09-12T00:33:55.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.639+0000 7fcdfa3ff9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:33:55.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.663+0000 7fcdfa3ff9c0 20 add_watcher() i=0 2024-09-12T00:33:55.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.663+0000 7fcdfa3ff9c0 20 add_watcher() i=1 2024-09-12T00:33:55.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.663+0000 7fcdfa3ff9c0 20 add_watcher() i=2 2024-09-12T00:33:55.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.663+0000 7fcdfa3ff9c0 20 add_watcher() i=3 2024-09-12T00:33:55.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.663+0000 7fcdfa3ff9c0 20 add_watcher() i=4 2024-09-12T00:33:55.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.663+0000 7fcdfa3ff9c0 20 add_watcher() i=5 2024-09-12T00:33:55.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.663+0000 7fcdfa3ff9c0 20 add_watcher() i=6 2024-09-12T00:33:55.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.667+0000 7fcdfa3ff9c0 20 add_watcher() i=7 2024-09-12T00:33:55.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.667+0000 7fcdfa3ff9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:55.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.671+0000 7fccadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:55.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.671+0000 7fcdfa3ff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:55.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.671+0000 7fcdfa3ff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:55.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.671+0000 7fcdfa3ff9c0 5 note: GC not initialized 2024-09-12T00:33:55.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.675+0000 7fccacfe1640 20 reqs_thread_entry: start 2024-09-12T00:33:55.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.675+0000 7fcdfa3ff9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:55.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.675+0000 7fcdfa3ff9c0 20 Filter name: none 2024-09-12T00:33:55.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.675+0000 7fcc267fc640 20 reqs_thread_entry: start 2024-09-12T00:33:55.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.675+0000 7fcdfa3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.675+0000 7fcdfa3ff9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:33:55.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.675+0000 7fcdfa3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.675+0000 7fcdfa3ff9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:33:55.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.675+0000 7fcdfa3ff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:55.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.675+0000 7fcdfa3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.675+0000 7fcdfa3ff9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:33:55.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.675+0000 7fcdfa3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.675+0000 7fcdfa3ff9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:33:55.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.675+0000 7fcdfa3ff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:55.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.679+0000 7fccadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:55.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.683+0000 7fcdfa3ff9c0 20 remove_watcher() i=0 2024-09-12T00:33:55.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.683+0000 7fcdfa3ff9c0 2 removed watcher, disabling cache 2024-09-12T00:33:55.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.687+0000 7fcdfa3ff9c0 20 remove_watcher() i=1 2024-09-12T00:33:55.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.687+0000 7fcdfa3ff9c0 20 remove_watcher() i=2 2024-09-12T00:33:55.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.691+0000 7fcdfa3ff9c0 20 remove_watcher() i=3 2024-09-12T00:33:55.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.691+0000 7fcdfa3ff9c0 20 remove_watcher() i=4 2024-09-12T00:33:55.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.695+0000 7fcdfa3ff9c0 20 remove_watcher() i=5 2024-09-12T00:33:55.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.699+0000 7fcdfa3ff9c0 20 remove_watcher() i=6 2024-09-12T00:33:55.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.703+0000 7fcdfa3ff9c0 20 remove_watcher() i=7 2024-09-12T00:33:55.716 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:55.716 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:33:55.716 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: a-bucket id: e2043445-c131-4520-984d-b4d52f038a6b.4538.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-12T00:33:55.716 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:55.716 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-12T00:33:55.750 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:55.751 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:55.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.795+0000 7f30fedeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.799+0000 7f30fedeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.799+0000 7f30fedeb9c0 20 realm 2024-09-12T00:33:55.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.799+0000 7f30fedeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.799+0000 7f30fedeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.799+0000 7f30fedeb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:55.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.799+0000 7f30fedeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.799+0000 7f30fedeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.799+0000 7f30fedeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.799+0000 7f30fedeb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:55.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.799+0000 7f30fedeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.799+0000 7f30fedeb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:55.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.799+0000 7f30fedeb9c0 20 searching for the correct realm 2024-09-12T00:33:55.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:55.803+0000 7f30fd0f2640 0 -- 172.21.15.138:0/3710440455 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f30f40628b0 msgr2=0x7f30f40838a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:56.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.019+0000 7f30fd0f2640 0 -- 172.21.15.138:0/3710440455 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x564226c659c0 msgr2=0x564226c67e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:56.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.027+0000 7f30fedeb9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:33:56.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.027+0000 7f30fedeb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:56.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.027+0000 7f30fedeb9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:33:56.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.027+0000 7f30fedeb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:56.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.027+0000 7f30fedeb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:56.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.027+0000 7f30fedeb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:56.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.027+0000 7f30fedeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.031+0000 7f30fedeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.031+0000 7f30fedeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.031+0000 7f30fedeb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:56.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.031+0000 7f30fedeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.031+0000 7f30fedeb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:56.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.031+0000 7f30fedeb9c0 20 zone default found 2024-09-12T00:33:56.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.031+0000 7f30fedeb9c0 4 Realm: () 2024-09-12T00:33:56.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.031+0000 7f30fedeb9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:33:56.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.031+0000 7f30fedeb9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:33:56.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.031+0000 7f30fedeb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:56.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.031+0000 7f30fedeb9c0 20 zonegroup default 2024-09-12T00:33:56.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.031+0000 7f30fedeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.031+0000 7f30fedeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.031+0000 7f30fedeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.031+0000 7f30fedeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.031+0000 7f30fedeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.035+0000 7f30fedeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.035+0000 7f30fedeb9c0 20 started sync module instance, tier type = 2024-09-12T00:33:56.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.035+0000 7f30fedeb9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:33:56.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.055+0000 7f30fedeb9c0 20 add_watcher() i=0 2024-09-12T00:33:56.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.055+0000 7f30fedeb9c0 20 add_watcher() i=1 2024-09-12T00:33:56.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.055+0000 7f30fedeb9c0 20 add_watcher() i=2 2024-09-12T00:33:56.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.055+0000 7f30fedeb9c0 20 add_watcher() i=3 2024-09-12T00:33:56.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.055+0000 7f30fedeb9c0 20 add_watcher() i=4 2024-09-12T00:33:56.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.055+0000 7f30fedeb9c0 20 add_watcher() i=5 2024-09-12T00:33:56.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.055+0000 7f30fedeb9c0 20 add_watcher() i=6 2024-09-12T00:33:56.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.059+0000 7f30fedeb9c0 20 add_watcher() i=7 2024-09-12T00:33:56.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.059+0000 7f30fedeb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:56.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.063+0000 7f2fb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:56.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.063+0000 7f30fedeb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:56.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.063+0000 7f30fedeb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:56.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.063+0000 7f30fedeb9c0 5 note: GC not initialized 2024-09-12T00:33:56.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.063+0000 7f2fb27e4640 20 reqs_thread_entry: start 2024-09-12T00:33:56.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.063+0000 7f30fedeb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:56.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.063+0000 7f30fedeb9c0 20 Filter name: none 2024-09-12T00:33:56.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.063+0000 7f2fab7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:56.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.063+0000 7f30fedeb9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:33:56.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.063+0000 7f30fedeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.067+0000 7f30fedeb9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:33:56.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.067+0000 7f30fedeb9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:33:56.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.067+0000 7f30fedeb9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:33:56.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.067+0000 7f30fedeb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:33:56.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.067+0000 7f30fedeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.067+0000 7f30fedeb9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:33:56.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.067+0000 7f30fedeb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:33:56.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.067+0000 7f30fedeb9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:33:56.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.067+0000 7f30fedeb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:56.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.067+0000 7f30fedeb9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:33:56.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.067+0000 7f30fedeb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:33:56.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.071+0000 7f2fb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:56.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.075+0000 7f30fedeb9c0 20 remove_watcher() i=0 2024-09-12T00:33:56.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.075+0000 7f30fedeb9c0 2 removed watcher, disabling cache 2024-09-12T00:33:56.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.075+0000 7f30fedeb9c0 20 remove_watcher() i=1 2024-09-12T00:33:56.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.079+0000 7f30fedeb9c0 20 remove_watcher() i=2 2024-09-12T00:33:56.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.079+0000 7f30fedeb9c0 20 remove_watcher() i=3 2024-09-12T00:33:56.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.083+0000 7f30fedeb9c0 20 remove_watcher() i=4 2024-09-12T00:33:56.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.083+0000 7f30fedeb9c0 20 remove_watcher() i=5 2024-09-12T00:33:56.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.087+0000 7f30fedeb9c0 20 remove_watcher() i=6 2024-09-12T00:33:56.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.091+0000 7f30fedeb9c0 20 remove_watcher() i=7 2024-09-12T00:33:56.104 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshard list 2024-09-12T00:33:56.129 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:56.129 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:56.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.175+0000 7f43967af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.175+0000 7f43967af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.175+0000 7f43967af9c0 20 realm 2024-09-12T00:33:56.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.175+0000 7f43967af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.175+0000 7f43967af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.175+0000 7f43967af9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:56.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.175+0000 7f43967af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.175+0000 7f43967af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.175+0000 7f43967af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.179+0000 7f43967af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:56.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.179+0000 7f43967af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.179+0000 7f43967af9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:56.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.179+0000 7f43967af9c0 20 searching for the correct realm 2024-09-12T00:33:56.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.183+0000 7f4394ab6640 0 -- 172.21.15.138:0/1943388381 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f438c0fc860 msgr2=0x7f438c0fcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:56.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.399+0000 7f4394ab6640 0 -- 172.21.15.138:0/1943388381 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55e4cf3ae9d0 msgr2=0x55e4cf3b0e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:56.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.407+0000 7f43967af9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:33:56.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.407+0000 7f43967af9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:56.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.407+0000 7f43967af9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:33:56.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.407+0000 7f43967af9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:56.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.407+0000 7f43967af9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:56.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.407+0000 7f43967af9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:56.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.407+0000 7f43967af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.407+0000 7f43967af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.407+0000 7f43967af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.407+0000 7f43967af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:56.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.407+0000 7f43967af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.411+0000 7f43967af9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:56.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.411+0000 7f43967af9c0 20 zone default found 2024-09-12T00:33:56.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.411+0000 7f43967af9c0 4 Realm: () 2024-09-12T00:33:56.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.411+0000 7f43967af9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:33:56.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.411+0000 7f43967af9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:33:56.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.411+0000 7f43967af9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:56.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.411+0000 7f43967af9c0 20 zonegroup default 2024-09-12T00:33:56.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.411+0000 7f43967af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.411+0000 7f43967af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.411+0000 7f43967af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.411+0000 7f43967af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.411+0000 7f43967af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.411+0000 7f43967af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.411+0000 7f43967af9c0 20 started sync module instance, tier type = 2024-09-12T00:33:56.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.411+0000 7f43967af9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:33:56.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.435+0000 7f43967af9c0 20 add_watcher() i=0 2024-09-12T00:33:56.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.435+0000 7f43967af9c0 20 add_watcher() i=1 2024-09-12T00:33:56.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.435+0000 7f43967af9c0 20 add_watcher() i=2 2024-09-12T00:33:56.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.435+0000 7f43967af9c0 20 add_watcher() i=3 2024-09-12T00:33:56.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.435+0000 7f43967af9c0 20 add_watcher() i=4 2024-09-12T00:33:56.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.435+0000 7f43967af9c0 20 add_watcher() i=5 2024-09-12T00:33:56.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.435+0000 7f43967af9c0 20 add_watcher() i=6 2024-09-12T00:33:56.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.439+0000 7f43967af9c0 20 add_watcher() i=7 2024-09-12T00:33:56.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.439+0000 7f43967af9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:56.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.443+0000 7f424afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:56.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.443+0000 7f43967af9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:56.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.443+0000 7f43967af9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:56.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.443+0000 7f43967af9c0 5 note: GC not initialized 2024-09-12T00:33:56.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.443+0000 7f4249fdb640 20 reqs_thread_entry: start 2024-09-12T00:33:56.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.443+0000 7f43967af9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:56.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.443+0000 7f43967af9c0 20 Filter name: none 2024-09-12T00:33:56.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.443+0000 7f41bb7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:56.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.455+0000 7f424afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:56.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.459+0000 7f43967af9c0 20 remove_watcher() i=0 2024-09-12T00:33:56.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.459+0000 7f43967af9c0 2 removed watcher, disabling cache 2024-09-12T00:33:56.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.463+0000 7f43967af9c0 20 remove_watcher() i=1 2024-09-12T00:33:56.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.463+0000 7f43967af9c0 20 remove_watcher() i=2 2024-09-12T00:33:56.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.467+0000 7f43967af9c0 20 remove_watcher() i=3 2024-09-12T00:33:56.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.467+0000 7f43967af9c0 20 remove_watcher() i=4 2024-09-12T00:33:56.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.471+0000 7f43967af9c0 20 remove_watcher() i=5 2024-09-12T00:33:56.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.475+0000 7f43967af9c0 20 remove_watcher() i=6 2024-09-12T00:33:56.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.479+0000 7f43967af9c0 20 remove_watcher() i=7 2024-09-12T00:33:56.500 INFO:tasks.workunit.client.0.smithi138.stderr:bucket name a-bucket 2024-09-12T00:33:56.500 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard process non empty bucket 2024-09-12T00:33:56.500 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:56.500 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshard process 2024-09-12T00:33:56.526 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:56.527 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:56.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.571+0000 7feeeae6e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.575+0000 7feeeae6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.575+0000 7feeeae6e9c0 20 realm 2024-09-12T00:33:56.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.575+0000 7feeeae6e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.575+0000 7feeeae6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.575+0000 7feeeae6e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:56.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.575+0000 7feeeae6e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.575+0000 7feeeae6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.575+0000 7feeeae6e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.575+0000 7feeeae6e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:56.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.575+0000 7feeeae6e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.579+0000 7feeeae6e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:56.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.579+0000 7feeeae6e9c0 20 searching for the correct realm 2024-09-12T00:33:56.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.579+0000 7feee9175640 0 -- 172.21.15.138:0/3429691263 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x557e8ae74850 msgr2=0x557e8ae76ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:56.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.587+0000 7feee8974640 0 -- 172.21.15.138:0/3429691263 >> [v2:172.21.15.178:6811/2062234204,v1:172.21.15.178:6813/2062234204] conn(0x7feedc0e2940 msgr2=0x7feedc0f13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:56.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:33:56.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:56.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:33:56.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:56.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:56.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:56.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:56.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:56.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 20 zone default found 2024-09-12T00:33:56.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 4 Realm: () 2024-09-12T00:33:56.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:33:56.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:33:56.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:56.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 20 zonegroup default 2024-09-12T00:33:56.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.807+0000 7feeeae6e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.811+0000 7feeeae6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.811+0000 7feeeae6e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.811+0000 7feeeae6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.811+0000 7feeeae6e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.811+0000 7feeeae6e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:56.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.811+0000 7feeeae6e9c0 20 started sync module instance, tier type = 2024-09-12T00:33:56.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.811+0000 7feeeae6e9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:33:56.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.835+0000 7feeeae6e9c0 20 add_watcher() i=0 2024-09-12T00:33:56.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.835+0000 7feeeae6e9c0 20 add_watcher() i=1 2024-09-12T00:33:56.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.835+0000 7feeeae6e9c0 20 add_watcher() i=2 2024-09-12T00:33:56.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.835+0000 7feeeae6e9c0 20 add_watcher() i=3 2024-09-12T00:33:56.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.835+0000 7feeeae6e9c0 20 add_watcher() i=4 2024-09-12T00:33:56.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.835+0000 7feeeae6e9c0 20 add_watcher() i=5 2024-09-12T00:33:56.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.835+0000 7feeeae6e9c0 20 add_watcher() i=6 2024-09-12T00:33:56.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.839+0000 7feeeae6e9c0 20 add_watcher() i=7 2024-09-12T00:33:56.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.839+0000 7feeeae6e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:56.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.843+0000 7fed9efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:56.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.843+0000 7feeeae6e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:56.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.843+0000 7feeeae6e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:56.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.843+0000 7feeeae6e9c0 5 note: GC not initialized 2024-09-12T00:33:56.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.843+0000 7fed9dfe3640 20 reqs_thread_entry: start 2024-09-12T00:33:56.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.843+0000 7feeeae6e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:56.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.843+0000 7feeeae6e9c0 20 Filter name: none 2024-09-12T00:33:56.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.843+0000 7fed0f7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:56.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.843+0000 7feeeae6e9c0 20 processing logshard = reshard.0000000000 2024-09-12T00:33:56.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.851+0000 7feeeae6e9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:33:56.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.851+0000 7feeeae6e9c0 20 processing logshard = reshard.0000000001 2024-09-12T00:33:56.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.855+0000 7feeeae6e9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:33:56.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.855+0000 7feeeae6e9c0 20 processing logshard = reshard.0000000002 2024-09-12T00:33:56.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.859+0000 7feeeae6e9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:33:56.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.859+0000 7feeeae6e9c0 20 processing logshard = reshard.0000000003 2024-09-12T00:33:56.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.863+0000 7feeeae6e9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:33:56.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.863+0000 7feeeae6e9c0 20 processing logshard = reshard.0000000004 2024-09-12T00:33:56.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.871+0000 7feeeae6e9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:33:56.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.871+0000 7feeeae6e9c0 20 processing logshard = reshard.0000000005 2024-09-12T00:33:56.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.875+0000 7feeeae6e9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:33:56.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.875+0000 7feeeae6e9c0 20 processing logshard = reshard.0000000006 2024-09-12T00:33:56.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.879+0000 7feeeae6e9c0 20 process_entry resharding a-bucket 2024-09-12T00:33:56.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.879+0000 7feeeae6e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:33:56.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.879+0000 7feeeae6e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.879+0000 7feeeae6e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:33:56.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.879+0000 7feeeae6e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:33:56.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.879+0000 7feeeae6e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:33:56.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.879+0000 7feeeae6e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:33:56.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.879+0000 7feeeae6e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:56.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.879+0000 7feeeae6e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:33:56.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.879+0000 7feeeae6e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:33:56.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.879+0000 7feeeae6e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:33:56.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.879+0000 7feeeae6e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:56.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.879+0000 7feeeae6e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:33:56.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.879+0000 7feeeae6e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:33:56.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.891+0000 7feeeae6e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:33:56.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.891+0000 7feeeae6e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:33:56.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.891+0000 7feeeae6e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:33:56.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.891+0000 7feeeae6e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:33:56.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.895+0000 7fedbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333517 cookie 94001984659216 notifier 5846 bl.length()=827 2024-09-12T00:33:56.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.895+0000 7fedbf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:33:56.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.895+0000 7fedbf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:33:56.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.895+0000 7fedbf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:33:56.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.895+0000 7feeeae6e9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:33:56.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.895+0000 7feeeae6e9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:33:56.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.895+0000 7feeeae6e9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:33:56.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.895+0000 7feeeae6e9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:33:56.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:33:56.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:33:56.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:33:56.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:33:56.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:33:56.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:33:56.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:33:56.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:33:56.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:33:56.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:33:56.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:33:56.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:33:56.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:33:56.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:33:56.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:33:56.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:33:56.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:33:56.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:33:56.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:33:56.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:33:56.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:33:56.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:33:56.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:33:56.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:33:56.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:33:56.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:33:56.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.0 2024-09-12T00:33:56.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.907+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.0 2024-09-12T00:33:56.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.911+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.1 2024-09-12T00:33:56.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.911+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.1 2024-09-12T00:33:56.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.911+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.2 2024-09-12T00:33:56.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.911+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.2 2024-09-12T00:33:56.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.911+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.3 2024-09-12T00:33:56.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.911+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.3 2024-09-12T00:33:56.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.911+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.4 2024-09-12T00:33:56.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.911+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.4 2024-09-12T00:33:56.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.915+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.5 2024-09-12T00:33:56.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.915+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.5 2024-09-12T00:33:56.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.915+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.6 2024-09-12T00:33:56.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.915+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.6 2024-09-12T00:33:56.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.915+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.7 2024-09-12T00:33:56.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.915+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.7 2024-09-12T00:33:56.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.915+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.8 2024-09-12T00:33:56.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.915+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.8 2024-09-12T00:33:56.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.919+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.9 2024-09-12T00:33:56.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.919+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.9 2024-09-12T00:33:56.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.919+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.10 2024-09-12T00:33:56.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.919+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.10 2024-09-12T00:33:56.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.919+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.11 2024-09-12T00:33:56.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.919+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.11 2024-09-12T00:33:56.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.927+0000 7feeeae6e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:56.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.927+0000 7feeeae6e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:33:56.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.927+0000 7feeeae6e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:33:56.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.927+0000 7feeeae6e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:33:56.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.927+0000 7feeeae6e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:33:56.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.927+0000 7feeeae6e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:33:56.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.931+0000 7fedbffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333518 cookie 94001984659216 notifier 5846 bl.length()=827 2024-09-12T00:33:56.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.931+0000 7fedbffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:33:56.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.931+0000 7fedbffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:33:56.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.931+0000 7fedbffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:33:56.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.931+0000 7feeeae6e9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:33:56.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.931+0000 7feeeae6e9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:33:56.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.931+0000 7feeeae6e9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:33:56.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.931+0000 7feeeae6e9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:33:56.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.939+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.0 2024-09-12T00:33:56.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.939+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.0 2024-09-12T00:33:56.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.939+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.1 2024-09-12T00:33:56.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.939+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.1 2024-09-12T00:33:56.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.939+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.2 2024-09-12T00:33:56.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.939+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.2 2024-09-12T00:33:56.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.939+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.3 2024-09-12T00:33:56.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.939+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.3 2024-09-12T00:33:56.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.939+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.4 2024-09-12T00:33:56.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.939+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.4 2024-09-12T00:33:56.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.943+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.5 2024-09-12T00:33:56.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.943+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.5 2024-09-12T00:33:56.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.943+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.6 2024-09-12T00:33:56.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.943+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.6 2024-09-12T00:33:56.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.943+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.7 2024-09-12T00:33:56.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.943+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.7 2024-09-12T00:33:56.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.943+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.8 2024-09-12T00:33:56.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.943+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.8 2024-09-12T00:33:56.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.947+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.9 2024-09-12T00:33:56.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.947+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.9 2024-09-12T00:33:56.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.947+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.10 2024-09-12T00:33:56.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.947+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.10 2024-09-12T00:33:56.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.947+0000 7feeeae6e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.11 2024-09-12T00:33:56.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.947+0000 7feeeae6e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.1.11 2024-09-12T00:33:56.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.947+0000 7feeeae6e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:56.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.947+0000 7feeeae6e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:33:56.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.951+0000 7feeeae6e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:33:56.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.951+0000 7feeeae6e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:33:56.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.951+0000 7feeeae6e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:33:56.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.951+0000 7feeeae6e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:33:56.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.951+0000 7fedbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333519 cookie 94001984659216 notifier 5846 bl.length()=795 2024-09-12T00:33:56.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.951+0000 7fedbf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:33:56.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.951+0000 7fedbf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:33:56.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.951+0000 7fedbf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:33:56.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.951+0000 7feeeae6e9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:33:56.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.951+0000 7feeeae6e9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:33:56.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.951+0000 7feeeae6e9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:33:56.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.951+0000 7feeeae6e9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:33:56.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.959+0000 7feeeae6e9c0 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-12T00:33:56.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.963+0000 7feeeae6e9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:33:56.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.967+0000 7feeeae6e9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:33:56.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.967+0000 7feeeae6e9c0 20 processing logshard = reshard.0000000007 2024-09-12T00:33:56.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.971+0000 7feeeae6e9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:33:56.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.971+0000 7feeeae6e9c0 20 processing logshard = reshard.0000000008 2024-09-12T00:33:56.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.979+0000 7feeeae6e9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:33:56.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.979+0000 7feeeae6e9c0 20 processing logshard = reshard.0000000009 2024-09-12T00:33:56.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.983+0000 7feeeae6e9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:33:56.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.983+0000 7feeeae6e9c0 20 processing logshard = reshard.0000000010 2024-09-12T00:33:56.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.991+0000 7feeeae6e9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:33:56.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.991+0000 7feeeae6e9c0 20 processing logshard = reshard.0000000011 2024-09-12T00:33:56.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.999+0000 7feeeae6e9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:33:56.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:56.999+0000 7feeeae6e9c0 20 processing logshard = reshard.0000000012 2024-09-12T00:33:57.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.003+0000 7feeeae6e9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:33:57.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.003+0000 7feeeae6e9c0 20 processing logshard = reshard.0000000013 2024-09-12T00:33:57.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.007+0000 7feeeae6e9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:33:57.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.007+0000 7feeeae6e9c0 20 processing logshard = reshard.0000000014 2024-09-12T00:33:57.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.015+0000 7feeeae6e9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:33:57.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.015+0000 7feeeae6e9c0 20 processing logshard = reshard.0000000015 2024-09-12T00:33:57.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.019+0000 7feeeae6e9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:33:57.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.023+0000 7fed9efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:57.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.027+0000 7feeeae6e9c0 20 remove_watcher() i=0 2024-09-12T00:33:57.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.027+0000 7feeeae6e9c0 2 removed watcher, disabling cache 2024-09-12T00:33:57.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.027+0000 7feeeae6e9c0 20 remove_watcher() i=1 2024-09-12T00:33:57.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.031+0000 7feeeae6e9c0 20 remove_watcher() i=2 2024-09-12T00:33:57.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.035+0000 7feeeae6e9c0 20 remove_watcher() i=3 2024-09-12T00:33:57.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.035+0000 7feeeae6e9c0 20 remove_watcher() i=4 2024-09-12T00:33:57.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.039+0000 7feeeae6e9c0 20 remove_watcher() i=5 2024-09-12T00:33:57.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.039+0000 7feeeae6e9c0 20 remove_watcher() i=6 2024-09-12T00:33:57.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.043+0000 7feeeae6e9c0 20 remove_watcher() i=7 2024-09-12T00:33:57.070 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:33:57.103 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:57.103 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:57.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.151+0000 7f82f6c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:57.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.151+0000 7f82f6c3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:57.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.151+0000 7f82f6c3d9c0 20 realm 2024-09-12T00:33:57.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.151+0000 7f82f6c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:57.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.155+0000 7f82f6c3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:57.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.155+0000 7f82f6c3d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:57.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.155+0000 7f82f6c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:57.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.155+0000 7f82f6c3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:57.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.155+0000 7f82f6c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:57.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.155+0000 7f82f6c3d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:57.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.155+0000 7f82f6c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:57.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.155+0000 7f82f6c3d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:57.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.155+0000 7f82f6c3d9c0 20 searching for the correct realm 2024-09-12T00:33:57.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.159+0000 7f82f4f44640 0 -- 172.21.15.138:0/3676133520 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f82ec017020 msgr2=0x7f82ec06a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:57.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.375+0000 7f82f4f44640 0 -- 172.21.15.138:0/3676133520 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55f1048926a0 msgr2=0x55f104894b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:57.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.383+0000 7f82f6c3d9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:33:57.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.383+0000 7f82f6c3d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:57.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.383+0000 7f82f6c3d9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:33:57.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.383+0000 7f82f6c3d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:57.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.383+0000 7f82f6c3d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:57.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.383+0000 7f82f6c3d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:57.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.383+0000 7f82f6c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:57.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.387+0000 7f82f6c3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:57.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.387+0000 7f82f6c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:57.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.387+0000 7f82f6c3d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:57.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.387+0000 7f82f6c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:57.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.387+0000 7f82f6c3d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:57.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.387+0000 7f82f6c3d9c0 20 zone default found 2024-09-12T00:33:57.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.387+0000 7f82f6c3d9c0 4 Realm: () 2024-09-12T00:33:57.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.387+0000 7f82f6c3d9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:33:57.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.387+0000 7f82f6c3d9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:33:57.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.387+0000 7f82f6c3d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:57.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.387+0000 7f82f6c3d9c0 20 zonegroup default 2024-09-12T00:33:57.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.387+0000 7f82f6c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:57.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.387+0000 7f82f6c3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:57.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.387+0000 7f82f6c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:57.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.387+0000 7f82f6c3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:57.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.387+0000 7f82f6c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:57.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.391+0000 7f82f6c3d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:57.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.391+0000 7f82f6c3d9c0 20 started sync module instance, tier type = 2024-09-12T00:33:57.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.391+0000 7f82f6c3d9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:33:57.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.411+0000 7f82f6c3d9c0 20 add_watcher() i=0 2024-09-12T00:33:57.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.411+0000 7f82f6c3d9c0 20 add_watcher() i=1 2024-09-12T00:33:57.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.411+0000 7f82f6c3d9c0 20 add_watcher() i=2 2024-09-12T00:33:57.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.411+0000 7f82f6c3d9c0 20 add_watcher() i=3 2024-09-12T00:33:57.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.411+0000 7f82f6c3d9c0 20 add_watcher() i=4 2024-09-12T00:33:57.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.411+0000 7f82f6c3d9c0 20 add_watcher() i=5 2024-09-12T00:33:57.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.411+0000 7f82f6c3d9c0 20 add_watcher() i=6 2024-09-12T00:33:57.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.415+0000 7f82f6c3d9c0 20 add_watcher() i=7 2024-09-12T00:33:57.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.415+0000 7f82f6c3d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:57.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.419+0000 7f81aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:57.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.419+0000 7f82f6c3d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:57.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.419+0000 7f82f6c3d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:57.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.419+0000 7f82f6c3d9c0 5 note: GC not initialized 2024-09-12T00:33:57.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.419+0000 7f81a9fdb640 20 reqs_thread_entry: start 2024-09-12T00:33:57.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.423+0000 7f82f6c3d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:57.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.423+0000 7f82f6c3d9c0 20 Filter name: none 2024-09-12T00:33:57.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.423+0000 7f811b7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:57.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.423+0000 7f82f6c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:57.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.423+0000 7f82f6c3d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:33:57.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.423+0000 7f82f6c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:57.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.423+0000 7f82f6c3d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:33:57.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.423+0000 7f82f6c3d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:57.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.423+0000 7f82f6c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:57.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.423+0000 7f82f6c3d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:33:57.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.423+0000 7f82f6c3d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:57.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.423+0000 7f82f6c3d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:33:57.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.423+0000 7f82f6c3d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:57.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.427+0000 7f81aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:57.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.431+0000 7f82f6c3d9c0 20 remove_watcher() i=0 2024-09-12T00:33:57.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.431+0000 7f82f6c3d9c0 2 removed watcher, disabling cache 2024-09-12T00:33:57.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.435+0000 7f82f6c3d9c0 20 remove_watcher() i=1 2024-09-12T00:33:57.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.435+0000 7f82f6c3d9c0 20 remove_watcher() i=2 2024-09-12T00:33:57.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.439+0000 7f82f6c3d9c0 20 remove_watcher() i=3 2024-09-12T00:33:57.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.439+0000 7f82f6c3d9c0 20 remove_watcher() i=4 2024-09-12T00:33:57.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.443+0000 7f82f6c3d9c0 20 remove_watcher() i=5 2024-09-12T00:33:57.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.447+0000 7f82f6c3d9c0 20 remove_watcher() i=6 2024-09-12T00:33:57.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:57.451+0000 7f82f6c3d9c0 20 remove_watcher() i=7 2024-09-12T00:33:57.472 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:57.472 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:33:57.472 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: a-bucket id: e2043445-c131-4520-984d-b4d52f038a6b.4538.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T00:33:57.472 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:57.472 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T00:33:57.472 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:57.474 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.474 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.498 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.498 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.544 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.544 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.565 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.565 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.586 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.586 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.609 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.609 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.629 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.629 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.650 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.650 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.671 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.671 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.691 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.691 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.713 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.713 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.734 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.734 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.756 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.756 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.778 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.778 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.799 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.799 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.819 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.820 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.842 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.842 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.863 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.863 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.883 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.883 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.903 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.903 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.923 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.923 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.943 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:57.944 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:57.961 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:33:57.993 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:57.993 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:58.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.039+0000 7f92719289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.039+0000 7f92719289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.039+0000 7f92719289c0 20 realm 2024-09-12T00:33:58.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.039+0000 7f92719289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.043+0000 7f92719289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.043+0000 7f92719289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:58.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.043+0000 7f92719289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.043+0000 7f92719289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.043+0000 7f92719289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.043+0000 7f92719289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:58.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.043+0000 7f92719289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.043+0000 7f92719289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:58.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.043+0000 7f92719289c0 20 searching for the correct realm 2024-09-12T00:33:58.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.047+0000 7f9267fff640 0 -- 172.21.15.138:0/2810703558 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f92600dc060 msgr2=0x7f9260131a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:58.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.055+0000 7f9267fff640 0 -- 172.21.15.138:0/2810703558 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55a0939878c0 msgr2=0x55a093989cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:58.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:33:58.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:58.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:33:58.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:58.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:58.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:58.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:58.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:58.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 20 zone default found 2024-09-12T00:33:58.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 4 Realm: () 2024-09-12T00:33:58.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:33:58.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:33:58.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:58.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 20 zonegroup default 2024-09-12T00:33:58.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.063+0000 7f92719289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.067+0000 7f92719289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.067+0000 7f92719289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.067+0000 7f92719289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.067+0000 7f92719289c0 20 started sync module instance, tier type = 2024-09-12T00:33:58.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.067+0000 7f92719289c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:33:58.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.083+0000 7f92719289c0 20 add_watcher() i=0 2024-09-12T00:33:58.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.083+0000 7f92719289c0 20 add_watcher() i=1 2024-09-12T00:33:58.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.083+0000 7f92719289c0 20 add_watcher() i=2 2024-09-12T00:33:58.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.083+0000 7f92719289c0 20 add_watcher() i=3 2024-09-12T00:33:58.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.083+0000 7f92719289c0 20 add_watcher() i=4 2024-09-12T00:33:58.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.083+0000 7f92719289c0 20 add_watcher() i=5 2024-09-12T00:33:58.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.083+0000 7f92719289c0 20 add_watcher() i=6 2024-09-12T00:33:58.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.087+0000 7f92719289c0 20 add_watcher() i=7 2024-09-12T00:33:58.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.087+0000 7f92719289c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:58.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.091+0000 7f9125fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:58.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.091+0000 7f92719289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:58.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.091+0000 7f92719289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:58.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.091+0000 7f92719289c0 5 note: GC not initialized 2024-09-12T00:33:58.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.091+0000 7f9124fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:58.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.091+0000 7f92719289c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:58.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.091+0000 7f92719289c0 20 Filter name: none 2024-09-12T00:33:58.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.091+0000 7f909e7fc640 20 reqs_thread_entry: start 2024-09-12T00:33:58.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.091+0000 7f92719289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.091+0000 7f92719289c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:33:58.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.091+0000 7f92719289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.091+0000 7f92719289c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:33:58.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.091+0000 7f92719289c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:58.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.091+0000 7f92719289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.095+0000 7f92719289c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:33:58.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.095+0000 7f92719289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.095+0000 7f92719289c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:33:58.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.095+0000 7f92719289c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:58.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.095+0000 7f9125fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:58.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.099+0000 7f92719289c0 20 remove_watcher() i=0 2024-09-12T00:33:58.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.099+0000 7f92719289c0 2 removed watcher, disabling cache 2024-09-12T00:33:58.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.103+0000 7f92719289c0 20 remove_watcher() i=1 2024-09-12T00:33:58.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.103+0000 7f92719289c0 20 remove_watcher() i=2 2024-09-12T00:33:58.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.107+0000 7f92719289c0 20 remove_watcher() i=3 2024-09-12T00:33:58.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.107+0000 7f92719289c0 20 remove_watcher() i=4 2024-09-12T00:33:58.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.111+0000 7f92719289c0 20 remove_watcher() i=5 2024-09-12T00:33:58.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.115+0000 7f92719289c0 20 remove_watcher() i=6 2024-09-12T00:33:58.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.115+0000 7f92719289c0 20 remove_watcher() i=7 2024-09-12T00:33:58.128 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:58.128 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:33:58.129 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-init-index id: e2043445-c131-4520-984d-b4d52f038a6b.4538.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:33:58.129 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:58.129 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T00:33:58.161 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:58.161 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:58.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.203+0000 7fd8817fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.207+0000 7fd8817fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.207+0000 7fd8817fd9c0 20 realm 2024-09-12T00:33:58.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.207+0000 7fd8817fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.207+0000 7fd8817fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.207+0000 7fd8817fd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:58.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.207+0000 7fd8817fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.207+0000 7fd8817fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.207+0000 7fd8817fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.207+0000 7fd8817fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:58.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.207+0000 7fd8817fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.207+0000 7fd8817fd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:58.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.207+0000 7fd8817fd9c0 20 searching for the correct realm 2024-09-12T00:33:58.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.215+0000 7fd87fb04640 0 -- 172.21.15.138:0/217719794 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fd878061590 msgr2=0x7fd878090950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:58.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.431+0000 7fd87fb04640 0 -- 172.21.15.138:0/217719794 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55e6c0873990 msgr2=0x55e6c0875e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:58.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.439+0000 7fd8817fd9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:33:58.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.439+0000 7fd8817fd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:58.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.439+0000 7fd8817fd9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:33:58.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.439+0000 7fd8817fd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:58.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.439+0000 7fd8817fd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:58.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.439+0000 7fd8817fd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:58.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.439+0000 7fd8817fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.443+0000 7fd8817fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.443+0000 7fd8817fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.443+0000 7fd8817fd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:58.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.443+0000 7fd8817fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.443+0000 7fd8817fd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:58.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.443+0000 7fd8817fd9c0 20 zone default found 2024-09-12T00:33:58.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.443+0000 7fd8817fd9c0 4 Realm: () 2024-09-12T00:33:58.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.443+0000 7fd8817fd9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:33:58.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.443+0000 7fd8817fd9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:33:58.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.443+0000 7fd8817fd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:58.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.443+0000 7fd8817fd9c0 20 zonegroup default 2024-09-12T00:33:58.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.443+0000 7fd8817fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.443+0000 7fd8817fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.443+0000 7fd8817fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.447+0000 7fd8817fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.447+0000 7fd8817fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.447+0000 7fd8817fd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.447+0000 7fd8817fd9c0 20 started sync module instance, tier type = 2024-09-12T00:33:58.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.447+0000 7fd8817fd9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:33:58.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.467+0000 7fd8817fd9c0 20 add_watcher() i=0 2024-09-12T00:33:58.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.467+0000 7fd8817fd9c0 20 add_watcher() i=1 2024-09-12T00:33:58.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.467+0000 7fd8817fd9c0 20 add_watcher() i=2 2024-09-12T00:33:58.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.467+0000 7fd8817fd9c0 20 add_watcher() i=3 2024-09-12T00:33:58.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.467+0000 7fd8817fd9c0 20 add_watcher() i=4 2024-09-12T00:33:58.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.467+0000 7fd8817fd9c0 20 add_watcher() i=5 2024-09-12T00:33:58.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.467+0000 7fd8817fd9c0 20 add_watcher() i=6 2024-09-12T00:33:58.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.471+0000 7fd8817fd9c0 20 add_watcher() i=7 2024-09-12T00:33:58.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.471+0000 7fd8817fd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:58.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.475+0000 7fd735fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:58.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.475+0000 7fd8817fd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:58.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.475+0000 7fd8817fd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:58.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.475+0000 7fd8817fd9c0 5 note: GC not initialized 2024-09-12T00:33:58.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.475+0000 7fd734fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:58.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.475+0000 7fd8817fd9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:58.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.475+0000 7fd8817fd9c0 20 Filter name: none 2024-09-12T00:33:58.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.475+0000 7fd6ae7fc640 20 reqs_thread_entry: start 2024-09-12T00:33:58.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.475+0000 7fd8817fd9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:33:58.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.479+0000 7fd8817fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.479+0000 7fd8817fd9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:33:58.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.479+0000 7fd8817fd9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:33:58.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.479+0000 7fd8817fd9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:33:58.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.479+0000 7fd8817fd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 : miss 2024-09-12T00:33:58.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.479+0000 7fd8817fd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.479+0000 7fd8817fd9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:33:58.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.479+0000 7fd8817fd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 info.flags=0x17 2024-09-12T00:33:58.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.479+0000 7fd8817fd9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 to cache LRU end 2024-09-12T00:33:58.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.479+0000 7fd8817fd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:58.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.479+0000 7fd8817fd9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:58.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.479+0000 7fd8817fd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 2024-09-12T00:33:58.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.483+0000 7fd8817fd9c0 -1 Injecting error=-5 at location=init_index 2024-09-12T00:33:58.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.483+0000 7fd8817fd9c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T00:33:58.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.483+0000 7fd735fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:58.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.491+0000 7fd8817fd9c0 20 remove_watcher() i=0 2024-09-12T00:33:58.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.491+0000 7fd8817fd9c0 2 removed watcher, disabling cache 2024-09-12T00:33:58.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.491+0000 7fd8817fd9c0 20 remove_watcher() i=1 2024-09-12T00:33:58.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.495+0000 7fd8817fd9c0 20 remove_watcher() i=2 2024-09-12T00:33:58.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.495+0000 7fd8817fd9c0 20 remove_watcher() i=3 2024-09-12T00:33:58.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.499+0000 7fd8817fd9c0 20 remove_watcher() i=4 2024-09-12T00:33:58.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.499+0000 7fd8817fd9c0 20 remove_watcher() i=5 2024-09-12T00:33:58.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.503+0000 7fd8817fd9c0 20 remove_watcher() i=6 2024-09-12T00:33:58.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.507+0000 7fd8817fd9c0 20 remove_watcher() i=7 2024-09-12T00:33:58.524 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:33:58.555 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:58.555 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:58.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.599+0000 7fdad2e9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.603+0000 7fdad2e9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.603+0000 7fdad2e9e9c0 20 realm 2024-09-12T00:33:58.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.603+0000 7fdad2e9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.603+0000 7fdad2e9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.603+0000 7fdad2e9e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:58.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.603+0000 7fdad2e9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.603+0000 7fdad2e9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.603+0000 7fdad2e9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.603+0000 7fdad2e9e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:58.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.603+0000 7fdad2e9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.607+0000 7fdad2e9e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:58.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.607+0000 7fdad2e9e9c0 20 searching for the correct realm 2024-09-12T00:33:58.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.611+0000 7fdad11a5640 0 -- 172.21.15.138:0/2920749787 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fdacc05ffc0 msgr2=0x7fdacc0790c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:58.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.827+0000 7fdad11a5640 0 -- 172.21.15.138:0/2920749787 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x562128b838e0 msgr2=0x562128b85da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:58.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.835+0000 7fdad2e9e9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:33:58.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.835+0000 7fdad2e9e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:58.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.835+0000 7fdad2e9e9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:33:58.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.835+0000 7fdad2e9e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:58.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.835+0000 7fdad2e9e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:58.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.835+0000 7fdad2e9e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:58.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.835+0000 7fdad2e9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.839+0000 7fdad2e9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.839+0000 7fdad2e9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.839+0000 7fdad2e9e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:58.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.839+0000 7fdad2e9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.839+0000 7fdad2e9e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:58.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.839+0000 7fdad2e9e9c0 20 zone default found 2024-09-12T00:33:58.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.839+0000 7fdad2e9e9c0 4 Realm: () 2024-09-12T00:33:58.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.839+0000 7fdad2e9e9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:33:58.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.839+0000 7fdad2e9e9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:33:58.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.839+0000 7fdad2e9e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:58.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.839+0000 7fdad2e9e9c0 20 zonegroup default 2024-09-12T00:33:58.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.839+0000 7fdad2e9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.839+0000 7fdad2e9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.839+0000 7fdad2e9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.839+0000 7fdad2e9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.839+0000 7fdad2e9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.843+0000 7fdad2e9e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:58.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.843+0000 7fdad2e9e9c0 20 started sync module instance, tier type = 2024-09-12T00:33:58.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.843+0000 7fdad2e9e9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:33:58.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.867+0000 7fdad2e9e9c0 20 add_watcher() i=0 2024-09-12T00:33:58.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.867+0000 7fdad2e9e9c0 20 add_watcher() i=1 2024-09-12T00:33:58.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.867+0000 7fdad2e9e9c0 20 add_watcher() i=2 2024-09-12T00:33:58.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.867+0000 7fdad2e9e9c0 20 add_watcher() i=3 2024-09-12T00:33:58.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.867+0000 7fdad2e9e9c0 20 add_watcher() i=4 2024-09-12T00:33:58.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.867+0000 7fdad2e9e9c0 20 add_watcher() i=5 2024-09-12T00:33:58.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.867+0000 7fdad2e9e9c0 20 add_watcher() i=6 2024-09-12T00:33:58.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.867+0000 7fdad2e9e9c0 20 add_watcher() i=7 2024-09-12T00:33:58.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.867+0000 7fdad2e9e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:58.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.871+0000 7fd986fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:58.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.875+0000 7fdad2e9e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:58.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.875+0000 7fdad2e9e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:58.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.875+0000 7fdad2e9e9c0 5 note: GC not initialized 2024-09-12T00:33:58.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.875+0000 7fd985fe3640 20 reqs_thread_entry: start 2024-09-12T00:33:58.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.875+0000 7fdad2e9e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:58.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.875+0000 7fdad2e9e9c0 20 Filter name: none 2024-09-12T00:33:58.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.875+0000 7fd8f77fe640 20 reqs_thread_entry: start 2024-09-12T00:33:58.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.875+0000 7fdad2e9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.875+0000 7fdad2e9e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:33:58.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.875+0000 7fdad2e9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.875+0000 7fdad2e9e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:33:58.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.875+0000 7fdad2e9e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:58.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.875+0000 7fdad2e9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.875+0000 7fdad2e9e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:33:58.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.875+0000 7fdad2e9e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:58.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.879+0000 7fdad2e9e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:33:58.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.879+0000 7fdad2e9e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:58.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.879+0000 7fd986fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:58.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.883+0000 7fdad2e9e9c0 20 remove_watcher() i=0 2024-09-12T00:33:58.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.883+0000 7fdad2e9e9c0 2 removed watcher, disabling cache 2024-09-12T00:33:58.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.887+0000 7fdad2e9e9c0 20 remove_watcher() i=1 2024-09-12T00:33:58.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.891+0000 7fdad2e9e9c0 20 remove_watcher() i=2 2024-09-12T00:33:58.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.891+0000 7fdad2e9e9c0 20 remove_watcher() i=3 2024-09-12T00:33:58.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.895+0000 7fdad2e9e9c0 20 remove_watcher() i=4 2024-09-12T00:33:58.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.895+0000 7fdad2e9e9c0 20 remove_watcher() i=5 2024-09-12T00:33:58.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.899+0000 7fdad2e9e9c0 20 remove_watcher() i=6 2024-09-12T00:33:58.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:58.903+0000 7fdad2e9e9c0 20 remove_watcher() i=7 2024-09-12T00:33:58.920 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:58.920 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:33:58.920 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-init-index id: e2043445-c131-4520-984d-b4d52f038a6b.4538.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:33:58.920 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:58.923 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:58.923 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:58.936 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:58.936 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:58.981 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:33:59.017 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:59.017 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:59.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.063+0000 7f1a7ed2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.063+0000 7f1a7ed2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:59.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.063+0000 7f1a7ed2d9c0 20 realm 2024-09-12T00:33:59.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.063+0000 7f1a7ed2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.063+0000 7f1a7ed2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:59.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.063+0000 7f1a7ed2d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:59.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.063+0000 7f1a7ed2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.063+0000 7f1a7ed2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:59.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.063+0000 7f1a7ed2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.067+0000 7f1a7ed2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:59.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.067+0000 7f1a7ed2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.067+0000 7f1a7ed2d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:59.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.067+0000 7f1a7ed2d9c0 20 searching for the correct realm 2024-09-12T00:33:59.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.071+0000 7f1a7d034640 0 -- 172.21.15.138:0/146019336 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f1a7406db50 msgr2=0x7f1a74089990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:59.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.287+0000 7f1a7d034640 0 -- 172.21.15.138:0/146019336 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55c1531a00e0 msgr2=0x55c1531a25a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:59.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.295+0000 7f1a7ed2d9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:33:59.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.295+0000 7f1a7ed2d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:59.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.295+0000 7f1a7ed2d9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:33:59.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.295+0000 7f1a7ed2d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:59.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.295+0000 7f1a7ed2d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:59.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.295+0000 7f1a7ed2d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:59.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.295+0000 7f1a7ed2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.295+0000 7f1a7ed2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:59.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.295+0000 7f1a7ed2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.299+0000 7f1a7ed2d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:59.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.299+0000 7f1a7ed2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.299+0000 7f1a7ed2d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:59.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.299+0000 7f1a7ed2d9c0 20 zone default found 2024-09-12T00:33:59.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.299+0000 7f1a7ed2d9c0 4 Realm: () 2024-09-12T00:33:59.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.299+0000 7f1a7ed2d9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:33:59.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.299+0000 7f1a7ed2d9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:33:59.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.299+0000 7f1a7ed2d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:59.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.299+0000 7f1a7ed2d9c0 20 zonegroup default 2024-09-12T00:33:59.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.299+0000 7f1a7ed2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.299+0000 7f1a7ed2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:59.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.299+0000 7f1a7ed2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.299+0000 7f1a7ed2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:59.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.299+0000 7f1a7ed2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.303+0000 7f1a7ed2d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:59.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.303+0000 7f1a7ed2d9c0 20 started sync module instance, tier type = 2024-09-12T00:33:59.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.303+0000 7f1a7ed2d9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:33:59.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.323+0000 7f1a7ed2d9c0 20 add_watcher() i=0 2024-09-12T00:33:59.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.323+0000 7f1a7ed2d9c0 20 add_watcher() i=1 2024-09-12T00:33:59.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.323+0000 7f1a7ed2d9c0 20 add_watcher() i=2 2024-09-12T00:33:59.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.323+0000 7f1a7ed2d9c0 20 add_watcher() i=3 2024-09-12T00:33:59.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.323+0000 7f1a7ed2d9c0 20 add_watcher() i=4 2024-09-12T00:33:59.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.323+0000 7f1a7ed2d9c0 20 add_watcher() i=5 2024-09-12T00:33:59.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.323+0000 7f1a7ed2d9c0 20 add_watcher() i=6 2024-09-12T00:33:59.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.327+0000 7f1a7ed2d9c0 20 add_watcher() i=7 2024-09-12T00:33:59.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.327+0000 7f1a7ed2d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:59.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.331+0000 7f19337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:59.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.331+0000 7f1a7ed2d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:59.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.331+0000 7f1a7ed2d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:59.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f1a7ed2d9c0 5 note: GC not initialized 2024-09-12T00:33:59.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f19327e4640 20 reqs_thread_entry: start 2024-09-12T00:33:59.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f1a7ed2d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:59.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f1a7ed2d9c0 20 Filter name: none 2024-09-12T00:33:59.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f192b7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:59.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f1a7ed2d9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:33:59.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f1a7ed2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f1a7ed2d9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:33:59.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f1a7ed2d9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:33:59.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f1a7ed2d9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:33:59.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f1a7ed2d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 : miss 2024-09-12T00:33:59.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f1a7ed2d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f1a7ed2d9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:33:59.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f1a7ed2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 info.flags=0x17 2024-09-12T00:33:59.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f1a7ed2d9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 to cache LRU end 2024-09-12T00:33:59.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f1a7ed2d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:59.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f1a7ed2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:59.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.335+0000 7f1a7ed2d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 2024-09-12T00:33:59.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.347+0000 7f1a7ed2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 info.flags=0x17 2024-09-12T00:33:59.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.347+0000 7f1a7ed2d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 to cache LRU end 2024-09-12T00:33:59.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.347+0000 7f1a7ed2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:59.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.347+0000 7f1a7ed2d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19, ofs0, ns] 2024-09-12T00:33:59.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.347+0000 7f1953fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333464 cookie 94288811270144 notifier 6285 bl.length()=911 2024-09-12T00:33:59.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.347+0000 7f1953fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 info.flags=0x17 2024-09-12T00:33:59.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.347+0000 7f1953fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 to cache LRU end 2024-09-12T00:33:59.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.347+0000 7f1953fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:59.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.347+0000 7f1a7ed2d9c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.19]): orig_sources= new_sources= 2024-09-12T00:33:59.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.347+0000 7f1a7ed2d9c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.19]): potential sources added=[] removed=[] 2024-09-12T00:33:59.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.347+0000 7f1a7ed2d9c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.19]): orig_dests= new_dests= 2024-09-12T00:33:59.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.347+0000 7f1a7ed2d9c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.19]): potential dests added=[] removed=[] 2024-09-12T00:33:59.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.0 2024-09-12T00:33:59.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.0 2024-09-12T00:33:59.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.1 2024-09-12T00:33:59.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.1 2024-09-12T00:33:59.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.2 2024-09-12T00:33:59.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.2 2024-09-12T00:33:59.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.3 2024-09-12T00:33:59.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.3 2024-09-12T00:33:59.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.4 2024-09-12T00:33:59.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.4 2024-09-12T00:33:59.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.5 2024-09-12T00:33:59.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.5 2024-09-12T00:33:59.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.6 2024-09-12T00:33:59.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.6 2024-09-12T00:33:59.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.7 2024-09-12T00:33:59.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.7 2024-09-12T00:33:59.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.8 2024-09-12T00:33:59.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.8 2024-09-12T00:33:59.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.9 2024-09-12T00:33:59.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.9 2024-09-12T00:33:59.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.10 2024-09-12T00:33:59.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.10 2024-09-12T00:33:59.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.11 2024-09-12T00:33:59.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1.11 2024-09-12T00:33:59.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.0 2024-09-12T00:33:59.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.359+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1 2024-09-12T00:33:59.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.363+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.2 2024-09-12T00:33:59.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.363+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.3 2024-09-12T00:33:59.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.363+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.4 2024-09-12T00:33:59.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.363+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.5 2024-09-12T00:33:59.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.367+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.6 2024-09-12T00:33:59.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.367+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.7 2024-09-12T00:33:59.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.367+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.8 2024-09-12T00:33:59.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.371+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.9 2024-09-12T00:33:59.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.371+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.10 2024-09-12T00:33:59.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.379+0000 7f1a7ed2d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:59.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.379+0000 7f1a7ed2d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 2024-09-12T00:33:59.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.379+0000 7f1a7ed2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 info.flags=0x17 2024-09-12T00:33:59.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.379+0000 7f1a7ed2d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 to cache LRU end 2024-09-12T00:33:59.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.379+0000 7f1a7ed2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:59.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.379+0000 7f1a7ed2d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19, ofs0, ns] 2024-09-12T00:33:59.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.379+0000 7f1953fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333465 cookie 94288811270144 notifier 6285 bl.length()=911 2024-09-12T00:33:59.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.379+0000 7f1953fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 info.flags=0x17 2024-09-12T00:33:59.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.379+0000 7f1953fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 to cache LRU end 2024-09-12T00:33:59.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.379+0000 7f1953fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:59.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.383+0000 7f1a7ed2d9c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.19]): orig_sources= new_sources= 2024-09-12T00:33:59.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.383+0000 7f1a7ed2d9c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.19]): potential sources added=[] removed=[] 2024-09-12T00:33:59.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.383+0000 7f1a7ed2d9c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.19]): orig_dests= new_dests= 2024-09-12T00:33:59.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.383+0000 7f1a7ed2d9c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.19]): potential dests added=[] removed=[] 2024-09-12T00:33:59.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.387+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.0 2024-09-12T00:33:59.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.387+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.1 2024-09-12T00:33:59.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.391+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.2 2024-09-12T00:33:59.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.391+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.3 2024-09-12T00:33:59.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.391+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.4 2024-09-12T00:33:59.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.391+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.5 2024-09-12T00:33:59.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.391+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.6 2024-09-12T00:33:59.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.391+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.7 2024-09-12T00:33:59.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.391+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.8 2024-09-12T00:33:59.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.395+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.9 2024-09-12T00:33:59.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.395+0000 7f1a7ed2d9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.19.10 2024-09-12T00:33:59.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.395+0000 7f1a7ed2d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:59.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.395+0000 7f1a7ed2d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 2024-09-12T00:33:59.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.399+0000 7f1a7ed2d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 info.flags=0x17 2024-09-12T00:33:59.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.399+0000 7f1a7ed2d9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 to cache LRU end 2024-09-12T00:33:59.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.399+0000 7f1a7ed2d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:59.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.399+0000 7f1a7ed2d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19, ofs0, ns] 2024-09-12T00:33:59.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.399+0000 7f1953fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333466 cookie 94288811270144 notifier 6285 bl.length()=879 2024-09-12T00:33:59.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.399+0000 7f1953fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 info.flags=0x17 2024-09-12T00:33:59.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.399+0000 7f1953fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.19 to cache LRU end 2024-09-12T00:33:59.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.399+0000 7f1953fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:59.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.399+0000 7f1a7ed2d9c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.19]): orig_sources= new_sources= 2024-09-12T00:33:59.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.399+0000 7f1a7ed2d9c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.19]): potential sources added=[] removed=[] 2024-09-12T00:33:59.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.399+0000 7f1a7ed2d9c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.19]): orig_dests= new_dests= 2024-09-12T00:33:59.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.399+0000 7f1a7ed2d9c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.19]): potential dests added=[] removed=[] 2024-09-12T00:33:59.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.407+0000 7f1a7ed2d9c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T00:33:59.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.411+0000 7f19337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:59.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.415+0000 7f1a7ed2d9c0 20 remove_watcher() i=0 2024-09-12T00:33:59.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.415+0000 7f1a7ed2d9c0 2 removed watcher, disabling cache 2024-09-12T00:33:59.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.415+0000 7f1a7ed2d9c0 20 remove_watcher() i=1 2024-09-12T00:33:59.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.419+0000 7f1a7ed2d9c0 20 remove_watcher() i=2 2024-09-12T00:33:59.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.419+0000 7f1a7ed2d9c0 20 remove_watcher() i=3 2024-09-12T00:33:59.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.423+0000 7f1a7ed2d9c0 20 remove_watcher() i=4 2024-09-12T00:33:59.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.423+0000 7f1a7ed2d9c0 20 remove_watcher() i=5 2024-09-12T00:33:59.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.427+0000 7f1a7ed2d9c0 20 remove_watcher() i=6 2024-09-12T00:33:59.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.431+0000 7f1a7ed2d9c0 20 remove_watcher() i=7 2024-09-12T00:33:59.445 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:33:59.471 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:59.471 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:59.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.515+0000 7f0b8aef09c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.515+0000 7f0b8aef09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:59.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.515+0000 7f0b8aef09c0 20 realm 2024-09-12T00:33:59.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.515+0000 7f0b8aef09c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.519+0000 7f0b8aef09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:59.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.519+0000 7f0b8aef09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:59.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.519+0000 7f0b8aef09c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.519+0000 7f0b8aef09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:59.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.519+0000 7f0b8aef09c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.519+0000 7f0b8aef09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:59.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.519+0000 7f0b8aef09c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.519+0000 7f0b8aef09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:59.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.519+0000 7f0b8aef09c0 20 searching for the correct realm 2024-09-12T00:33:59.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.523+0000 7f0b891f7640 0 -- 172.21.15.138:0/881171934 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f0b800ce910 msgr2=0x7f0b800b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:59.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.739+0000 7f0b891f7640 0 -- 172.21.15.138:0/881171934 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5592901ac270 msgr2=0x5592901ae730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:59.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.747+0000 7f0b8aef09c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:33:59.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.747+0000 7f0b8aef09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:59.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.747+0000 7f0b8aef09c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:33:59.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.747+0000 7f0b8aef09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:59.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.747+0000 7f0b8aef09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:59.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.747+0000 7f0b8aef09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:59.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.747+0000 7f0b8aef09c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:59.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:59.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:59.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 20 zone default found 2024-09-12T00:33:59.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 4 Realm: () 2024-09-12T00:33:59.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:33:59.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:33:59.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:59.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 20 zonegroup default 2024-09-12T00:33:59.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:59.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:59.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:59.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 20 started sync module instance, tier type = 2024-09-12T00:33:59.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.751+0000 7f0b8aef09c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:33:59.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.775+0000 7f0b8aef09c0 20 add_watcher() i=0 2024-09-12T00:33:59.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.775+0000 7f0b8aef09c0 20 add_watcher() i=1 2024-09-12T00:33:59.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.775+0000 7f0b8aef09c0 20 add_watcher() i=2 2024-09-12T00:33:59.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.775+0000 7f0b8aef09c0 20 add_watcher() i=3 2024-09-12T00:33:59.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.775+0000 7f0b8aef09c0 20 add_watcher() i=4 2024-09-12T00:33:59.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.775+0000 7f0b8aef09c0 20 add_watcher() i=5 2024-09-12T00:33:59.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.775+0000 7f0b8aef09c0 20 add_watcher() i=6 2024-09-12T00:33:59.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.779+0000 7f0b8aef09c0 20 add_watcher() i=7 2024-09-12T00:33:59.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.779+0000 7f0b8aef09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:59.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.783+0000 7f0a3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:59.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.783+0000 7f0b8aef09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:59.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.783+0000 7f0b8aef09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:59.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.783+0000 7f0b8aef09c0 5 note: GC not initialized 2024-09-12T00:33:59.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.783+0000 7f0a3dfe3640 20 reqs_thread_entry: start 2024-09-12T00:33:59.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.783+0000 7f0b8aef09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:59.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.783+0000 7f0b8aef09c0 20 Filter name: none 2024-09-12T00:33:59.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.783+0000 7f09af7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:59.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.783+0000 7f0b8aef09c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.783+0000 7f0b8aef09c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:33:59.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.783+0000 7f0b8aef09c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.787+0000 7f0b8aef09c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:33:59.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.787+0000 7f0b8aef09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:59.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.787+0000 7f0b8aef09c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.787+0000 7f0b8aef09c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:33:59.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.787+0000 7f0b8aef09c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:59.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.787+0000 7f0b8aef09c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:33:59.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.787+0000 7f0b8aef09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:59.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.791+0000 7f0a3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:59.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.795+0000 7f0b8aef09c0 20 remove_watcher() i=0 2024-09-12T00:33:59.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.795+0000 7f0b8aef09c0 2 removed watcher, disabling cache 2024-09-12T00:33:59.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.795+0000 7f0b8aef09c0 20 remove_watcher() i=1 2024-09-12T00:33:59.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.799+0000 7f0b8aef09c0 20 remove_watcher() i=2 2024-09-12T00:33:59.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.799+0000 7f0b8aef09c0 20 remove_watcher() i=3 2024-09-12T00:33:59.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.803+0000 7f0b8aef09c0 20 remove_watcher() i=4 2024-09-12T00:33:59.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.803+0000 7f0b8aef09c0 20 remove_watcher() i=5 2024-09-12T00:33:59.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.807+0000 7f0b8aef09c0 20 remove_watcher() i=6 2024-09-12T00:33:59.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:33:59.811+0000 7f0b8aef09c0 20 remove_watcher() i=7 2024-09-12T00:33:59.824 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:59.824 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:33:59.824 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-init-index id: e2043445-c131-4520-984d-b4d52f038a6b.4538.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:33:59.824 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:59.825 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:59.825 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:59.829 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:59.830 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:59.878 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:59.879 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:59.930 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T00:33:59.930 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:33:59.931 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:59.931 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:59.951 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:59.951 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:33:59.999 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:33:59.999 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.021 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.021 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.043 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.043 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.066 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.066 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.086 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.086 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.107 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.107 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.126 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.126 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.145 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.146 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.163 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.164 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.180 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.180 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.199 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.199 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.218 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.218 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.237 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.238 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.255 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.255 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.274 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.275 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.295 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.295 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.315 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.315 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.335 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.335 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.357 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.357 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.377 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:00.378 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:00.396 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:34:00.430 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:00.430 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:00.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.475+0000 7fdfcdeeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.479+0000 7fdfcdeeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:00.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.479+0000 7fdfcdeeb9c0 20 realm 2024-09-12T00:34:00.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.479+0000 7fdfcdeeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.479+0000 7fdfcdeeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:00.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.479+0000 7fdfcdeeb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:00.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.479+0000 7fdfcdeeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.479+0000 7fdfcdeeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:00.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.479+0000 7fdfcdeeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.483+0000 7fdfcdeeb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:00.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.483+0000 7fdfcdeeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.483+0000 7fdfcdeeb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:00.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.483+0000 7fdfcdeeb9c0 20 searching for the correct realm 2024-09-12T00:34:00.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.487+0000 7fdfcc1f2640 0 -- 172.21.15.138:0/604422332 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fdfc4101700 msgr2=0x7fdfc412b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:00.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.703+0000 7fdfcc1f2640 0 -- 172.21.15.138:0/604422332 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x559d949804c0 msgr2=0x559d94982980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:00.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.711+0000 7fdfcdeeb9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:00.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.711+0000 7fdfcdeeb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:00.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.711+0000 7fdfcdeeb9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:00.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.711+0000 7fdfcdeeb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:00.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.711+0000 7fdfcdeeb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:00.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.711+0000 7fdfcdeeb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:00.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.711+0000 7fdfcdeeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.711+0000 7fdfcdeeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:00.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.711+0000 7fdfcdeeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.715+0000 7fdfcdeeb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:00.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.715+0000 7fdfcdeeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.715+0000 7fdfcdeeb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:00.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.715+0000 7fdfcdeeb9c0 20 zone default found 2024-09-12T00:34:00.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.715+0000 7fdfcdeeb9c0 4 Realm: () 2024-09-12T00:34:00.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.715+0000 7fdfcdeeb9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:00.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.715+0000 7fdfcdeeb9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:00.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.715+0000 7fdfcdeeb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:00.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.715+0000 7fdfcdeeb9c0 20 zonegroup default 2024-09-12T00:34:00.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.715+0000 7fdfcdeeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.715+0000 7fdfcdeeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:00.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.715+0000 7fdfcdeeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.715+0000 7fdfcdeeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:00.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.715+0000 7fdfcdeeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.719+0000 7fdfcdeeb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:00.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.719+0000 7fdfcdeeb9c0 20 started sync module instance, tier type = 2024-09-12T00:34:00.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.719+0000 7fdfcdeeb9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:00.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.739+0000 7fdfcdeeb9c0 20 add_watcher() i=0 2024-09-12T00:34:00.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.739+0000 7fdfcdeeb9c0 20 add_watcher() i=1 2024-09-12T00:34:00.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.739+0000 7fdfcdeeb9c0 20 add_watcher() i=2 2024-09-12T00:34:00.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.739+0000 7fdfcdeeb9c0 20 add_watcher() i=3 2024-09-12T00:34:00.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.739+0000 7fdfcdeeb9c0 20 add_watcher() i=4 2024-09-12T00:34:00.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.739+0000 7fdfcdeeb9c0 20 add_watcher() i=5 2024-09-12T00:34:00.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.739+0000 7fdfcdeeb9c0 20 add_watcher() i=6 2024-09-12T00:34:00.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.743+0000 7fdfcdeeb9c0 20 add_watcher() i=7 2024-09-12T00:34:00.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.743+0000 7fdfcdeeb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:00.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.747+0000 7fde81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:00.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.747+0000 7fdfcdeeb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:00.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.747+0000 7fdfcdeeb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:00.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.747+0000 7fdfcdeeb9c0 5 note: GC not initialized 2024-09-12T00:34:00.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.747+0000 7fde80fe1640 20 reqs_thread_entry: start 2024-09-12T00:34:00.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.747+0000 7fdfcdeeb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:00.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.747+0000 7fdfcdeeb9c0 20 Filter name: none 2024-09-12T00:34:00.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.747+0000 7fddfa7fc640 20 reqs_thread_entry: start 2024-09-12T00:34:00.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.747+0000 7fdfcdeeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.747+0000 7fdfcdeeb9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:34:00.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.747+0000 7fdfcdeeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.751+0000 7fdfcdeeb9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:34:00.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.751+0000 7fdfcdeeb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:00.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.751+0000 7fdfcdeeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.751+0000 7fdfcdeeb9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:34:00.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.751+0000 7fdfcdeeb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.751+0000 7fdfcdeeb9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:34:00.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.751+0000 7fdfcdeeb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:00.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.755+0000 7fde81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:00.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.759+0000 7fdfcdeeb9c0 20 remove_watcher() i=0 2024-09-12T00:34:00.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.759+0000 7fdfcdeeb9c0 2 removed watcher, disabling cache 2024-09-12T00:34:00.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.759+0000 7fdfcdeeb9c0 20 remove_watcher() i=1 2024-09-12T00:34:00.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.763+0000 7fdfcdeeb9c0 20 remove_watcher() i=2 2024-09-12T00:34:00.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.767+0000 7fdfcdeeb9c0 20 remove_watcher() i=3 2024-09-12T00:34:00.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.767+0000 7fdfcdeeb9c0 20 remove_watcher() i=4 2024-09-12T00:34:00.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.771+0000 7fdfcdeeb9c0 20 remove_watcher() i=5 2024-09-12T00:34:00.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.775+0000 7fdfcdeeb9c0 20 remove_watcher() i=6 2024-09-12T00:34:00.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.775+0000 7fdfcdeeb9c0 20 remove_watcher() i=7 2024-09-12T00:34:00.791 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:00.791 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:34:00.791 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-init-index id: e2043445-c131-4520-984d-b4d52f038a6b.4538.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:34:00.791 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:00.791 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T00:34:00.826 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:00.826 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:00.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.871+0000 7f9fa50529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.871+0000 7f9fa50529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:00.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.871+0000 7f9fa50529c0 20 realm 2024-09-12T00:34:00.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.871+0000 7f9fa50529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.871+0000 7f9fa50529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:00.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.871+0000 7f9fa50529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:00.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.871+0000 7f9fa50529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.875+0000 7f9fa50529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:00.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.875+0000 7f9fa50529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.875+0000 7f9fa50529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:00.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.875+0000 7f9fa50529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.875+0000 7f9fa50529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:00.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.875+0000 7f9fa50529c0 20 searching for the correct realm 2024-09-12T00:34:00.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.879+0000 7f9fa3359640 0 -- 172.21.15.138:0/2504161648 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x556f916e9fc0 msgr2=0x556f916ec480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:00.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.887+0000 7f9fa2357640 0 -- 172.21.15.138:0/2504161648 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x556f916e5200 msgr2=0x556f916e7610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:00.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.891+0000 7f9fa50529c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:00.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.891+0000 7f9fa50529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:00.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.891+0000 7f9fa50529c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:00.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.891+0000 7f9fa50529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:00.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.891+0000 7f9fa50529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:00.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.891+0000 7f9fa50529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:00.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.891+0000 7f9fa50529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:00.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:00.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:00.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 20 zone default found 2024-09-12T00:34:00.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 4 Realm: () 2024-09-12T00:34:00.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:00.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:00.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:00.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 20 zonegroup default 2024-09-12T00:34:00.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:00.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:00.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:00.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 20 started sync module instance, tier type = 2024-09-12T00:34:00.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.895+0000 7f9fa50529c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:00.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.919+0000 7f9fa50529c0 20 add_watcher() i=0 2024-09-12T00:34:00.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.919+0000 7f9fa50529c0 20 add_watcher() i=1 2024-09-12T00:34:00.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.919+0000 7f9fa50529c0 20 add_watcher() i=2 2024-09-12T00:34:00.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.919+0000 7f9fa50529c0 20 add_watcher() i=3 2024-09-12T00:34:00.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.919+0000 7f9fa50529c0 20 add_watcher() i=4 2024-09-12T00:34:00.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.919+0000 7f9fa50529c0 20 add_watcher() i=5 2024-09-12T00:34:00.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.919+0000 7f9fa50529c0 20 add_watcher() i=6 2024-09-12T00:34:00.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.923+0000 7f9fa50529c0 20 add_watcher() i=7 2024-09-12T00:34:00.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.923+0000 7f9fa50529c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:00.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9e597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:00.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:00.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:00.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 5 note: GC not initialized 2024-09-12T00:34:00.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9dd3fff640 20 reqs_thread_entry: start 2024-09-12T00:34:00.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:00.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 20 Filter name: none 2024-09-12T00:34:00.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9dd1ffb640 20 reqs_thread_entry: start 2024-09-12T00:34:00.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:34:00.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:34:00.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:34:00.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:34:00.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.20 : miss 2024-09-12T00:34:00.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:00.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:34:00.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.20 info.flags=0x17 2024-09-12T00:34:00.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.20 to cache LRU end 2024-09-12T00:34:00.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:00.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:00.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.927+0000 7f9fa50529c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.20 2024-09-12T00:34:00.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.931+0000 7f9fa50529c0 -1 Injecting error=-95 at location=init_index 2024-09-12T00:34:00.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.931+0000 7f9fa50529c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:34:00.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.935+0000 7f9fa50529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.20 info.flags=0x17 2024-09-12T00:34:00.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.935+0000 7f9fa50529c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.20 to cache LRU end 2024-09-12T00:34:00.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.935+0000 7f9fa50529c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:00.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.935+0000 7f9fa50529c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.20, ofs0, ns] 2024-09-12T00:34:00.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.939+0000 7f9e85ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333469 cookie 93937669689152 notifier 6345 bl.length()=911 2024-09-12T00:34:00.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.939+0000 7f9e85ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.20 info.flags=0x17 2024-09-12T00:34:00.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.939+0000 7f9e85ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.20 to cache LRU end 2024-09-12T00:34:00.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.939+0000 7f9e85ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:00.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.939+0000 7f9fa50529c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.20]): orig_sources= new_sources= 2024-09-12T00:34:00.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.939+0000 7f9fa50529c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.20]): potential sources added=[] removed=[] 2024-09-12T00:34:00.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.939+0000 7f9fa50529c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.20]): orig_dests= new_dests= 2024-09-12T00:34:00.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.939+0000 7f9fa50529c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.20]): potential dests added=[] removed=[] 2024-09-12T00:34:00.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.0 2024-09-12T00:34:00.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.0 2024-09-12T00:34:00.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.1 2024-09-12T00:34:00.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.1 2024-09-12T00:34:00.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.2 2024-09-12T00:34:00.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.2 2024-09-12T00:34:00.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.3 2024-09-12T00:34:00.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.3 2024-09-12T00:34:00.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.4 2024-09-12T00:34:00.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.4 2024-09-12T00:34:00.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.5 2024-09-12T00:34:00.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.5 2024-09-12T00:34:00.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.6 2024-09-12T00:34:00.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.6 2024-09-12T00:34:00.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.7 2024-09-12T00:34:00.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.7 2024-09-12T00:34:00.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.8 2024-09-12T00:34:00.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.8 2024-09-12T00:34:00.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.9 2024-09-12T00:34:00.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.9 2024-09-12T00:34:00.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.10 2024-09-12T00:34:00.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.10 2024-09-12T00:34:00.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.11 2024-09-12T00:34:00.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1.11 2024-09-12T00:34:00.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.0 2024-09-12T00:34:00.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.1 2024-09-12T00:34:00.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.943+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.2 2024-09-12T00:34:00.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.947+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.3 2024-09-12T00:34:00.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.947+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.4 2024-09-12T00:34:00.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.947+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.5 2024-09-12T00:34:00.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.947+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.6 2024-09-12T00:34:00.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.947+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.7 2024-09-12T00:34:00.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.951+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.8 2024-09-12T00:34:00.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.951+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.9 2024-09-12T00:34:00.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.951+0000 7f9fa50529c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.20.10 2024-09-12T00:34:00.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.955+0000 7f9fa50529c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:00.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.955+0000 7f9fa50529c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.20 2024-09-12T00:34:00.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.959+0000 7f9fa50529c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.20 info.flags=0x17 2024-09-12T00:34:00.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.959+0000 7f9fa50529c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.20 to cache LRU end 2024-09-12T00:34:00.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.959+0000 7f9fa50529c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:00.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.959+0000 7f9fa50529c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.20, ofs0, ns] 2024-09-12T00:34:00.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.959+0000 7f9e867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333470 cookie 93937669689152 notifier 6345 bl.length()=879 2024-09-12T00:34:00.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.959+0000 7f9e867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.20 info.flags=0x17 2024-09-12T00:34:00.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.959+0000 7f9e867fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:e2043445-c131-4520-984d-b4d52f038a6b.4538.20 to cache LRU end 2024-09-12T00:34:00.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.959+0000 7f9e867fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:00.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.959+0000 7f9fa50529c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.20]): orig_sources= new_sources= 2024-09-12T00:34:00.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.959+0000 7f9fa50529c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.20]): potential sources added=[] removed=[] 2024-09-12T00:34:00.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.959+0000 7f9fa50529c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.20]): orig_dests= new_dests= 2024-09-12T00:34:00.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.959+0000 7f9fa50529c0 20 handle_bi_update(): bucket=:error-at-init-index[e2043445-c131-4520-984d-b4d52f038a6b.4538.20]): potential dests added=[] removed=[] 2024-09-12T00:34:00.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.963+0000 7f9fa50529c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T00:34:00.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.967+0000 7f9e597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:00.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.971+0000 7f9fa50529c0 20 remove_watcher() i=0 2024-09-12T00:34:00.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.971+0000 7f9fa50529c0 2 removed watcher, disabling cache 2024-09-12T00:34:00.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.975+0000 7f9fa50529c0 20 remove_watcher() i=1 2024-09-12T00:34:00.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.975+0000 7f9fa50529c0 20 remove_watcher() i=2 2024-09-12T00:34:00.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.979+0000 7f9fa50529c0 20 remove_watcher() i=3 2024-09-12T00:34:00.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.983+0000 7f9fa50529c0 20 remove_watcher() i=4 2024-09-12T00:34:00.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.983+0000 7f9fa50529c0 20 remove_watcher() i=5 2024-09-12T00:34:00.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.987+0000 7f9fa50529c0 20 remove_watcher() i=6 2024-09-12T00:34:00.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:00.987+0000 7f9fa50529c0 20 remove_watcher() i=7 2024-09-12T00:34:01.002 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:34:01.032 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:01.032 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:01.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.075+0000 7fc254f8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:01.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.079+0000 7fc254f8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:01.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.079+0000 7fc254f8f9c0 20 realm 2024-09-12T00:34:01.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.079+0000 7fc254f8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:01.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.079+0000 7fc254f8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:01.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.079+0000 7fc254f8f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:01.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.079+0000 7fc254f8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:01.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.079+0000 7fc254f8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:01.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.079+0000 7fc254f8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:01.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.083+0000 7fc254f8f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:01.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.083+0000 7fc254f8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:01.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.083+0000 7fc254f8f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:01.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.083+0000 7fc254f8f9c0 20 searching for the correct realm 2024-09-12T00:34:01.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.087+0000 7fc252294640 0 -- 172.21.15.138:0/3369403472 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7fc244034040 msgr2=0x7fc244072040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:01.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.299+0000 7fc252294640 0 -- 172.21.15.138:0/3369403472 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x555c91a19d90 msgr2=0x555c91a1c180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:01.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.315+0000 7fc254f8f9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:01.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.315+0000 7fc254f8f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:01.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.315+0000 7fc254f8f9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:01.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.315+0000 7fc254f8f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:01.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.315+0000 7fc254f8f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:01.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.315+0000 7fc254f8f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:01.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.315+0000 7fc254f8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:01.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.315+0000 7fc254f8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:01.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.315+0000 7fc254f8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:01.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.319+0000 7fc254f8f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:01.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.319+0000 7fc254f8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:01.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.319+0000 7fc254f8f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:01.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.319+0000 7fc254f8f9c0 20 zone default found 2024-09-12T00:34:01.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.319+0000 7fc254f8f9c0 4 Realm: () 2024-09-12T00:34:01.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.319+0000 7fc254f8f9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:01.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.319+0000 7fc254f8f9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:01.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.319+0000 7fc254f8f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:01.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.319+0000 7fc254f8f9c0 20 zonegroup default 2024-09-12T00:34:01.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.319+0000 7fc254f8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:01.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.319+0000 7fc254f8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:01.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.319+0000 7fc254f8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:01.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.319+0000 7fc254f8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:01.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.319+0000 7fc254f8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:01.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.323+0000 7fc254f8f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:01.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.323+0000 7fc254f8f9c0 20 started sync module instance, tier type = 2024-09-12T00:34:01.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.323+0000 7fc254f8f9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:01.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.355+0000 7fc254f8f9c0 20 add_watcher() i=0 2024-09-12T00:34:01.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.355+0000 7fc254f8f9c0 20 add_watcher() i=1 2024-09-12T00:34:01.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.355+0000 7fc254f8f9c0 20 add_watcher() i=2 2024-09-12T00:34:01.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.355+0000 7fc254f8f9c0 20 add_watcher() i=3 2024-09-12T00:34:01.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.355+0000 7fc254f8f9c0 20 add_watcher() i=4 2024-09-12T00:34:01.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.355+0000 7fc254f8f9c0 20 add_watcher() i=5 2024-09-12T00:34:01.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.355+0000 7fc254f8f9c0 20 add_watcher() i=6 2024-09-12T00:34:01.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.355+0000 7fc254f8f9c0 20 add_watcher() i=7 2024-09-12T00:34:01.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.355+0000 7fc254f8f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:01.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.363+0000 7fc1097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:01.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.363+0000 7fc254f8f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:01.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.363+0000 7fc254f8f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:01.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.363+0000 7fc254f8f9c0 5 note: GC not initialized 2024-09-12T00:34:01.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.363+0000 7fc083fff640 20 reqs_thread_entry: start 2024-09-12T00:34:01.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.363+0000 7fc254f8f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:01.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.363+0000 7fc254f8f9c0 20 Filter name: none 2024-09-12T00:34:01.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.363+0000 7fc081ffb640 20 reqs_thread_entry: start 2024-09-12T00:34:01.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.363+0000 7fc254f8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:01.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.363+0000 7fc254f8f9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:34:01.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.363+0000 7fc254f8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:01.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.363+0000 7fc254f8f9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:34:01.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.363+0000 7fc254f8f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:01.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.363+0000 7fc254f8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:01.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.367+0000 7fc254f8f9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:34:01.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.367+0000 7fc254f8f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:01.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.367+0000 7fc254f8f9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:34:01.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.367+0000 7fc254f8f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:01.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.367+0000 7fc1097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:01.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.371+0000 7fc254f8f9c0 20 remove_watcher() i=0 2024-09-12T00:34:01.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.371+0000 7fc254f8f9c0 2 removed watcher, disabling cache 2024-09-12T00:34:01.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.375+0000 7fc254f8f9c0 20 remove_watcher() i=1 2024-09-12T00:34:01.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.375+0000 7fc254f8f9c0 20 remove_watcher() i=2 2024-09-12T00:34:01.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.379+0000 7fc254f8f9c0 20 remove_watcher() i=3 2024-09-12T00:34:01.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.379+0000 7fc254f8f9c0 20 remove_watcher() i=4 2024-09-12T00:34:01.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.383+0000 7fc254f8f9c0 20 remove_watcher() i=5 2024-09-12T00:34:01.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.387+0000 7fc254f8f9c0 20 remove_watcher() i=6 2024-09-12T00:34:01.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:01.387+0000 7fc254f8f9c0 20 remove_watcher() i=7 2024-09-12T00:34:01.402 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:01.402 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:34:01.403 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-init-index id: e2043445-c131-4520-984d-b4d52f038a6b.4538.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:34:01.403 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:01.404 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.404 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.407 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.407 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.451 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.451 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.489 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T00:34:01.489 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:01.490 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.490 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.506 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.507 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.552 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.552 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.574 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.574 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.596 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.596 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.620 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.621 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.639 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.639 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.660 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.660 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.681 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.681 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.702 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.703 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.723 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.723 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.744 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.745 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.765 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.765 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.789 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.789 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.811 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.811 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.832 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.832 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.853 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.853 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.874 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.874 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.895 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.895 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.916 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.916 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.938 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.938 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.958 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:01.959 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:01.977 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:34:02.008 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:02.008 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:02.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.055+0000 7f230efa19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.055+0000 7f230efa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.055+0000 7f230efa19c0 20 realm 2024-09-12T00:34:02.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.055+0000 7f230efa19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.059+0000 7f230efa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.059+0000 7f230efa19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:02.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.059+0000 7f230efa19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.059+0000 7f230efa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.059+0000 7f230efa19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.059+0000 7f230efa19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:02.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.059+0000 7f230efa19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.059+0000 7f230efa19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:02.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.059+0000 7f230efa19c0 20 searching for the correct realm 2024-09-12T00:34:02.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.063+0000 7f230d2a8640 0 -- 172.21.15.138:0/4058388406 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f2304008210 msgr2=0x7f2304028400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:02.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.479+0000 7f230c2a6640 0 -- 172.21.15.138:0/4058388406 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x561a6926fc10 msgr2=0x561a69272000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:02.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.491+0000 7f230efa19c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:02.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.491+0000 7f230efa19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:02.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.491+0000 7f230efa19c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:02.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.491+0000 7f230efa19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:02.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.491+0000 7f230efa19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:02.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.491+0000 7f230efa19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:02.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.491+0000 7f230efa19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.491+0000 7f230efa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.491+0000 7f230efa19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.491+0000 7f230efa19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:02.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.491+0000 7f230efa19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.495+0000 7f230efa19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:02.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.495+0000 7f230efa19c0 20 zone default found 2024-09-12T00:34:02.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.495+0000 7f230efa19c0 4 Realm: () 2024-09-12T00:34:02.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.495+0000 7f230efa19c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:02.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.495+0000 7f230efa19c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:02.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.495+0000 7f230efa19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:02.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.495+0000 7f230efa19c0 20 zonegroup default 2024-09-12T00:34:02.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.495+0000 7f230efa19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.495+0000 7f230efa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.495+0000 7f230efa19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.495+0000 7f230efa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.495+0000 7f230efa19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.495+0000 7f230efa19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.495+0000 7f230efa19c0 20 started sync module instance, tier type = 2024-09-12T00:34:02.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.495+0000 7f230efa19c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:02.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.519+0000 7f230efa19c0 20 add_watcher() i=0 2024-09-12T00:34:02.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.519+0000 7f230efa19c0 20 add_watcher() i=1 2024-09-12T00:34:02.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.519+0000 7f230efa19c0 20 add_watcher() i=2 2024-09-12T00:34:02.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.519+0000 7f230efa19c0 20 add_watcher() i=3 2024-09-12T00:34:02.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.519+0000 7f230efa19c0 20 add_watcher() i=4 2024-09-12T00:34:02.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.519+0000 7f230efa19c0 20 add_watcher() i=5 2024-09-12T00:34:02.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.519+0000 7f230efa19c0 20 add_watcher() i=6 2024-09-12T00:34:02.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.523+0000 7f230efa19c0 20 add_watcher() i=7 2024-09-12T00:34:02.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.523+0000 7f230efa19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:02.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.527+0000 7f21c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:02.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.527+0000 7f230efa19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:02.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.527+0000 7f230efa19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:02.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.527+0000 7f230efa19c0 5 note: GC not initialized 2024-09-12T00:34:02.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.531+0000 7f21c1fe3640 20 reqs_thread_entry: start 2024-09-12T00:34:02.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.531+0000 7f230efa19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:02.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.531+0000 7f230efa19c0 20 Filter name: none 2024-09-12T00:34:02.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.531+0000 7f21337fe640 20 reqs_thread_entry: start 2024-09-12T00:34:02.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.531+0000 7f230efa19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.531+0000 7f230efa19c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:34:02.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.531+0000 7f230efa19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.531+0000 7f230efa19c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:34:02.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.531+0000 7f230efa19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:02.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.531+0000 7f230efa19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.531+0000 7f230efa19c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:34:02.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.531+0000 7f230efa19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.535+0000 7f230efa19c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:34:02.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.535+0000 7f230efa19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:02.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.535+0000 7f21c2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:02.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.539+0000 7f230efa19c0 20 remove_watcher() i=0 2024-09-12T00:34:02.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.539+0000 7f230efa19c0 2 removed watcher, disabling cache 2024-09-12T00:34:02.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.543+0000 7f230efa19c0 20 remove_watcher() i=1 2024-09-12T00:34:02.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.543+0000 7f230efa19c0 20 remove_watcher() i=2 2024-09-12T00:34:02.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.547+0000 7f230efa19c0 20 remove_watcher() i=3 2024-09-12T00:34:02.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.547+0000 7f230efa19c0 20 remove_watcher() i=4 2024-09-12T00:34:02.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.551+0000 7f230efa19c0 20 remove_watcher() i=5 2024-09-12T00:34:02.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.555+0000 7f230efa19c0 20 remove_watcher() i=6 2024-09-12T00:34:02.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.555+0000 7f230efa19c0 20 remove_watcher() i=7 2024-09-12T00:34:02.570 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.570 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:34:02.570 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-init-indext id: e2043445-c131-4520-984d-b4d52f038a6b.4538.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:34:02.570 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.570 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T00:34:02.603 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:02.604 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:02.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.647+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.651+0000 7f120037d9c0 20 realm 2024-09-12T00:34:02.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.651+0000 7f120037d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:02.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:02.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:02.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.651+0000 7f120037d9c0 20 searching for the correct realm 2024-09-12T00:34:02.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.659+0000 7f11fe684640 0 -- 172.21.15.138:0/3730954905 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f11f8069840 msgr2=0x7f11f8024800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:02.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.875+0000 7f11fe684640 0 -- 172.21.15.138:0/3730954905 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x562c41da7af0 msgr2=0x562c41da9fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:02.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:02.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:02.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:02.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:02.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:02.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:02.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.883+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.883+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.883+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:02.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:02.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.887+0000 7f120037d9c0 20 zone default found 2024-09-12T00:34:02.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.887+0000 7f120037d9c0 4 Realm: () 2024-09-12T00:34:02.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.887+0000 7f120037d9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:02.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.887+0000 7f120037d9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:02.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.887+0000 7f120037d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:02.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.887+0000 7f120037d9c0 20 zonegroup default 2024-09-12T00:34:02.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.887+0000 7f120037d9c0 20 started sync module instance, tier type = 2024-09-12T00:34:02.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.887+0000 7f120037d9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:02.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=0 2024-09-12T00:34:02.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=1 2024-09-12T00:34:02.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=2 2024-09-12T00:34:02.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=3 2024-09-12T00:34:02.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=4 2024-09-12T00:34:02.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=5 2024-09-12T00:34:02.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=6 2024-09-12T00:34:02.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.915+0000 7f120037d9c0 20 add_watcher() i=7 2024-09-12T00:34:02.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.915+0000 7f120037d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:02.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.919+0000 7f10af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:02.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.919+0000 7f120037d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:02.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.919+0000 7f120037d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:02.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.919+0000 7f120037d9c0 5 note: GC not initialized 2024-09-12T00:34:02.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.919+0000 7f10ae7fc640 20 reqs_thread_entry: start 2024-09-12T00:34:02.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.919+0000 7f120037d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:02.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.919+0000 7f120037d9c0 20 Filter name: none 2024-09-12T00:34:02.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.919+0000 7f101ffff640 20 reqs_thread_entry: start 2024-09-12T00:34:02.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.919+0000 7f120037d9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:34:02.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.919+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.919+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:34:02.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.919+0000 7f120037d9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:34:02.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.919+0000 7f120037d9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:34:02.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.919+0000 7f120037d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 : miss 2024-09-12T00:34:02.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.919+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.923+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:34:02.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.923+0000 7f120037d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 info.flags=0x17 2024-09-12T00:34:02.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.923+0000 7f120037d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 to cache LRU end 2024-09-12T00:34:02.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.923+0000 7f120037d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:02.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.923+0000 7f120037d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:02.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.923+0000 7f120037d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 2024-09-12T00:34:02.923 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f120037d9c0 time 2024-09-12T00:34:02.930195+0000 2024-09-12T00:34:02.923 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:34:02.924 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:02.924 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1203c572eb] 2024-09-12T00:34:02.924 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1203c5749f] 2024-09-12T00:34:02.924 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c3fb68cc1] 2024-09-12T00:34:02.925 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1421f32) [0x562c405c5f32] 2024-09-12T00:34:02.925 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562c3fb7dced] 2024-09-12T00:34:02.925 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:34:02.925 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1202abdd90] 2024-09-12T00:34:02.925 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:34:02.925 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:34:02.925 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:34:02.925 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f120037d9c0 thread_name:radosgw-admin 2024-09-12T00:34:02.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.927+0000 7f120037d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f120037d9c0 time 2024-09-12T00:34:02.930195+0000 2024-09-12T00:34:02.925 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:34:02.925 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.926 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:02.926 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1203c572eb] 2024-09-12T00:34:02.926 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1203c5749f] 2024-09-12T00:34:02.926 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c3fb68cc1] 2024-09-12T00:34:02.926 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1421f32) [0x562c405c5f32] 2024-09-12T00:34:02.926 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562c3fb7dced] 2024-09-12T00:34:02.926 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:34:02.926 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1202abdd90] 2024-09-12T00:34:02.926 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:34:02.926 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:34:02.926 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1202ad6520] 2024-09-12T00:34:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:34:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:34:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:34:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1203c57345] 2024-09-12T00:34:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1203c5749f] 2024-09-12T00:34:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c3fb68cc1] 2024-09-12T00:34:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1421f32) [0x562c405c5f32] 2024-09-12T00:34:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562c3fb7dced] 2024-09-12T00:34:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:34:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1202abdd90] 2024-09-12T00:34:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:34:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:34:02.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:02.927+0000 7f120037d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:34:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f120037d9c0 thread_name:radosgw-admin 2024-09-12T00:34:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1202ad6520] 2024-09-12T00:34:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:34:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:34:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:34:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1203c57345] 2024-09-12T00:34:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1203c5749f] 2024-09-12T00:34:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c3fb68cc1] 2024-09-12T00:34:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1421f32) [0x562c405c5f32] 2024-09-12T00:34:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562c3fb7dced] 2024-09-12T00:34:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:34:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1202abdd90] 2024-09-12T00:34:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:34:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:34:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:34:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.942 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:34:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:34:02.627+0000 7f11fe684640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:34:02.627+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:34:02.627+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:34:02.627+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:34:02.627+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:34:02.627+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:34:02.627+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:34:02.627+0000 7f11fde83640 10 monclient(hunting): get_auth_request con 0x562c41b61440 auth_method 0 2024-09-12T00:34:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:34:02.627+0000 7f11fde83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:34:02.627+0000 7f11fde83640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:34:02.627+0000 7f11fde83640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:02.944 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:34:02.627+0000 7f11fd682640 10 monclient(hunting): handle_auth_done global_id 6020 payload 274 2024-09-12T00:34:02.944 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:34:02.627+0000 7f11fd682640 10 monclient: _finish_hunting 0 2024-09-12T00:34:02.944 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:34:02.627+0000 7f11fd682640 1 monclient: found mon.noname-c 2024-09-12T00:34:02.944 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:34:02.627+0000 7f11fd682640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:34:02.944 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:02.944 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:02.944 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: dump: 2024-09-12T00:34:02.944 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:02.944 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:02.944 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.944 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.944 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:02.944 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:02.944 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:02.945 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:02.945 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:02.945 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.945 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: _finish_auth 0 2024-09-12T00:34:02.945 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: _check_auth_tickets 2024-09-12T00:34:02.945 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:02.945 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 monclient: authenticate success, global_id 6020 2024-09-12T00:34:02.945 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:34:02.627+0000 7f120037d9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:34:02.945 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:34:02.627+0000 7f120037d9c0 4 set_mon_vals no callback set 2024-09-12T00:34:02.945 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:02.945 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:02.945 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: dump: 2024-09-12T00:34:02.945 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:02.945 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:02.946 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.946 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.946 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:02.946 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:02.946 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:02.946 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:02.946 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:02.946 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.946 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:34:02.627+0000 7f120037d9c0 10 monclient: shutdown 2024-09-12T00:34:02.946 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 asok(0x562c41aa62b0) unregister_commands rotate-key 2024-09-12T00:34:02.946 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:34:02.627+0000 7f120037d9c0 10 monclient: build_initial_monmap 2024-09-12T00:34:02.946 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:34:02.627+0000 7f120037d9c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:02.946 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:34:02.627+0000 7f120037d9c0 10 monclient: monmap: 2024-09-12T00:34:02.946 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:34:02.946 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:02.947 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:34:02.947 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:34:02.947 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:02.947 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:02.947 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:34:02.947 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:34:02.947 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:34:02.947 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.947 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding auth protocol: cephx 2024-09-12T00:34:02.947 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding auth protocol: cephx 2024-09-12T00:34:02.947 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding auth protocol: cephx 2024-09-12T00:34:02.947 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: secure 2024-09-12T00:34:02.947 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: crc 2024-09-12T00:34:02.948 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: secure 2024-09-12T00:34:02.948 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: crc 2024-09-12T00:34:02.948 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: secure 2024-09-12T00:34:02.948 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: crc 2024-09-12T00:34:02.948 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: crc 2024-09-12T00:34:02.948 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: secure 2024-09-12T00:34:02.948 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: crc 2024-09-12T00:34:02.948 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: secure 2024-09-12T00:34:02.948 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: crc 2024-09-12T00:34:02.948 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: secure 2024-09-12T00:34:02.948 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:34:02.627+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:02.948 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:34:02.627+0000 7f120037d9c0 1 librados: starting msgr at 2024-09-12T00:34:02.948 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:34:02.627+0000 7f120037d9c0 1 librados: starting objecter 2024-09-12T00:34:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command objecter_requests hook 0x562c41ce2500 2024-09-12T00:34:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:34:02.627+0000 7f120037d9c0 1 librados: setting wanted keys 2024-09-12T00:34:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:34:02.627+0000 7f120037d9c0 1 librados: calling monclient init 2024-09-12T00:34:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:34:02.627+0000 7f120037d9c0 10 monclient: init 2024-09-12T00:34:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding auth protocol: cephx 2024-09-12T00:34:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding auth protocol: cephx 2024-09-12T00:34:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding auth protocol: cephx 2024-09-12T00:34:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: secure 2024-09-12T00:34:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: crc 2024-09-12T00:34:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: secure 2024-09-12T00:34:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: crc 2024-09-12T00:34:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: secure 2024-09-12T00:34:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: crc 2024-09-12T00:34:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: crc 2024-09-12T00:34:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: secure 2024-09-12T00:34:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: crc 2024-09-12T00:34:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: secure 2024-09-12T00:34:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:34:02.631+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: crc 2024-09-12T00:34:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:34:02.631+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: secure 2024-09-12T00:34:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:34:02.631+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:34:02.631+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:34:02.631+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command rotate-key hook 0x562c41cb13e8 2024-09-12T00:34:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:34:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-b con 0x562c41b61440 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:34:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-c con 0x562c41b6cbd0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:34:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-a con 0x562c41cb7f20 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:34:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient(hunting): authenticate will time out at 2095.976558s 2024-09-12T00:34:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient(hunting): get_auth_request con 0x562c41b6cbd0 auth_method 0 2024-09-12T00:34:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:34:02.631+0000 7f11fe684640 10 monclient(hunting): get_auth_request con 0x562c41cb7f20 auth_method 0 2024-09-12T00:34:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:34:02.631+0000 7f11fe684640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:34:02.631+0000 7f11fe684640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:34:02.631+0000 7f11fe684640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:34:02.631+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:34:02.631+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:34:02.631+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient(hunting): handle_auth_done global_id 6023 payload 824 2024-09-12T00:34:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient: _finish_hunting 0 2024-09-12T00:34:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:34:02.631+0000 7f11fd682640 1 monclient: found mon.noname-c 2024-09-12T00:34:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:34:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:02.953 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: dump: 2024-09-12T00:34:02.953 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:02.953 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:02.953 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.953 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.953 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:02.953 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:02.953 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:02.953 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:02.953 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:02.953 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.953 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: _finish_auth 0 2024-09-12T00:34:02.953 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: _check_auth_tickets 2024-09-12T00:34:02.954 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:02.954 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:02.954 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:02.954 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: dump: 2024-09-12T00:34:02.954 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:02.954 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:02.954 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.954 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.954 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:02.955 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:02.955 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:02.955 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:02.955 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:02.955 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.955 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:34:02.631+0000 7f10ebe07640 4 set_mon_vals no callback set 2024-09-12T00:34:02.955 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:34:02.631+0000 7f120037d9c0 5 monclient: authenticate success, global_id 6023 2024-09-12T00:34:02.955 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient: _renew_subs 2024-09-12T00:34:02.955 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:34:02.955 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient: _renew_subs 2024-09-12T00:34:02.955 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:34:02.955 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:34:02.631+0000 7f120037d9c0 1 librados: init done 2024-09-12T00:34:02.955 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:34:02.631+0000 7f10ea604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:34:02.631+0000 7f10ea604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:34:02.631+0000 7f10ea604640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:34:02.635+0000 7f11fde83640 10 monclient: get_auth_request con 0x7f10e4070ae0 auth_method 0 2024-09-12T00:34:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:34:02.635+0000 7f11fe684640 10 monclient: get_auth_request con 0x562c41cf98b0 auth_method 0 2024-09-12T00:34:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:34:02.635+0000 7f11fde83640 10 monclient: get_auth_request con 0x562c41cfca90 auth_method 0 2024-09-12T00:34:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:34:02.635+0000 7f11fd682640 10 monclient: get_auth_request con 0x562c41d00c80 auth_method 0 2024-09-12T00:34:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: build_initial_monmap 2024-09-12T00:34:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:34:02.639+0000 7f120037d9c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: monmap: 2024-09-12T00:34:02.956 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:34:02.956 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:02.957 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:34:02.957 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:34:02.957 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:02.957 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:02.957 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:34:02.957 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:34:02.957 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:34:02.957 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.957 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding auth protocol: cephx 2024-09-12T00:34:02.957 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding auth protocol: cephx 2024-09-12T00:34:02.957 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding auth protocol: cephx 2024-09-12T00:34:02.957 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: secure 2024-09-12T00:34:02.957 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: crc 2024-09-12T00:34:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: secure 2024-09-12T00:34:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: crc 2024-09-12T00:34:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: secure 2024-09-12T00:34:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: crc 2024-09-12T00:34:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: crc 2024-09-12T00:34:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: secure 2024-09-12T00:34:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: crc 2024-09-12T00:34:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: secure 2024-09-12T00:34:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: crc 2024-09-12T00:34:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: secure 2024-09-12T00:34:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:34:02.639+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command objecter_requests cmddesc objecter_requests hook 0x562c41d091c0 EEXIST 2024-09-12T00:34:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: init 2024-09-12T00:34:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding auth protocol: cephx 2024-09-12T00:34:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding auth protocol: cephx 2024-09-12T00:34:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding auth protocol: cephx 2024-09-12T00:34:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: secure 2024-09-12T00:34:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: crc 2024-09-12T00:34:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: secure 2024-09-12T00:34:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: crc 2024-09-12T00:34:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: secure 2024-09-12T00:34:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: crc 2024-09-12T00:34:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: crc 2024-09-12T00:34:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: secure 2024-09-12T00:34:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: crc 2024-09-12T00:34:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: secure 2024-09-12T00:34:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: crc 2024-09-12T00:34:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: secure 2024-09-12T00:34:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:34:02.639+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:34:02.639+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command rotate-key cmddesc rotate-key hook 0x562c41d04050 EEXIST 2024-09-12T00:34:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:34:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-b con 0x562c41d2d370 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:34:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-a con 0x562c41d2cca0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:34:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-c con 0x562c41d2b680 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:34:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient(hunting): authenticate will time out at 2095.985825s 2024-09-12T00:34:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient(hunting): get_auth_request con 0x562c41d2b680 auth_method 0 2024-09-12T00:34:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:34:02.639+0000 7f11fd682640 10 monclient(hunting): get_auth_request con 0x562c41d2cca0 auth_method 0 2024-09-12T00:34:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:34:02.639+0000 7f11fd682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:34:02.639+0000 7f11fd682640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:34:02.639+0000 7f11fd682640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:34:02.639+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:34:02.639+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:34:02.639+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:34:02.639+0000 7f11fde83640 10 monclient(hunting): get_auth_request con 0x562c41d2d370 auth_method 0 2024-09-12T00:34:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:34:02.639+0000 7f11fde83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:34:02.639+0000 7f11fde83640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:34:02.639+0000 7f11fde83640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient(hunting): handle_auth_done global_id 6026 payload 824 2024-09-12T00:34:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient: _finish_hunting 0 2024-09-12T00:34:02.963 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:34:02.639+0000 7f11fe684640 1 monclient: found mon.noname-c 2024-09-12T00:34:02.963 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:34:02.963 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:02.963 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:02.963 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: dump: 2024-09-12T00:34:02.963 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:02.963 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:02.963 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.963 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.963 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:02.963 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:02.963 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:02.963 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:02.964 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:02.964 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.964 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: _finish_auth 0 2024-09-12T00:34:02.964 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: _check_auth_tickets 2024-09-12T00:34:02.964 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:02.964 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:02.964 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:02.964 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: dump: 2024-09-12T00:34:02.964 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:02.964 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:02.964 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.964 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.965 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:02.965 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:02.965 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:02.965 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:02.965 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:02.965 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.965 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 monclient: authenticate success, global_id 6026 2024-09-12T00:34:02.965 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:34:02.639+0000 7f11fee85640 4 set_mon_vals no callback set 2024-09-12T00:34:02.965 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: _renew_subs 2024-09-12T00:34:02.965 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:34:02.965 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: _renew_subs 2024-09-12T00:34:02.965 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:34:02.965 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:34:02.643+0000 7f10e37fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:02.966 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:34:02.643+0000 7f10e37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:02.966 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:34:02.643+0000 7f10e37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:02.966 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: get_monmap_and_config 2024-09-12T00:34:02.966 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: build_initial_monmap 2024-09-12T00:34:02.966 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:34:02.643+0000 7f120037d9c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:02.966 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: monmap: 2024-09-12T00:34:02.966 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:34:02.966 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:02.966 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:34:02.966 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:34:02.966 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:02.966 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:02.966 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:34:02.967 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:34:02.967 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:34:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding auth protocol: cephx 2024-09-12T00:34:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding auth protocol: cephx 2024-09-12T00:34:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding auth protocol: cephx 2024-09-12T00:34:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: secure 2024-09-12T00:34:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: crc 2024-09-12T00:34:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: secure 2024-09-12T00:34:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: crc 2024-09-12T00:34:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: secure 2024-09-12T00:34:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: crc 2024-09-12T00:34:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: crc 2024-09-12T00:34:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: secure 2024-09-12T00:34:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: crc 2024-09-12T00:34:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: secure 2024-09-12T00:34:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: crc 2024-09-12T00:34:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: secure 2024-09-12T00:34:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:34:02.643+0000 7f11fde83640 10 monclient: get_auth_request con 0x7f10d8070a20 auth_method 0 2024-09-12T00:34:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:34:02.643+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: init 2024-09-12T00:34:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding auth protocol: cephx 2024-09-12T00:34:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding auth protocol: cephx 2024-09-12T00:34:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding auth protocol: cephx 2024-09-12T00:34:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: secure 2024-09-12T00:34:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: crc 2024-09-12T00:34:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: secure 2024-09-12T00:34:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: crc 2024-09-12T00:34:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: secure 2024-09-12T00:34:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: crc 2024-09-12T00:34:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: crc 2024-09-12T00:34:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: secure 2024-09-12T00:34:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: crc 2024-09-12T00:34:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: secure 2024-09-12T00:34:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: crc 2024-09-12T00:34:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: secure 2024-09-12T00:34:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:34:02.643+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:34:02.643+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command rotate-key cmddesc rotate-key hook 0x7ffddf4a9288 EEXIST 2024-09-12T00:34:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:34:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-c con 0x562c41d7b200 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:34:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-b con 0x562c41d7b5e0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:34:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-a con 0x562c41d7caa0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:34:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient(hunting): authenticate will time out at 2095.990116s 2024-09-12T00:34:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:34:02.643+0000 7f11fde83640 10 monclient(hunting): get_auth_request con 0x562c41d7b200 auth_method 0 2024-09-12T00:34:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:34:02.643+0000 7f11fde83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:34:02.643+0000 7f11fde83640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:34:02.643+0000 7f11fde83640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient(hunting): get_auth_request con 0x562c41d7caa0 auth_method 0 2024-09-12T00:34:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:34:02.643+0000 7f11fde83640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:34:02.643+0000 7f11fde83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:34:02.643+0000 7f11fde83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:34:02.643+0000 7f11fd682640 10 monclient(hunting): get_auth_request con 0x562c41d7b5e0 auth_method 0 2024-09-12T00:34:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:34:02.643+0000 7f11fd682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:34:02.643+0000 7f11fd682640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:02.972 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:34:02.643+0000 7f11fd682640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:02.972 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient(hunting): handle_auth_done global_id 6402 payload 274 2024-09-12T00:34:02.972 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient: _finish_hunting 0 2024-09-12T00:34:02.972 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:34:02.643+0000 7f11fe684640 1 monclient: found mon.noname-a 2024-09-12T00:34:02.972 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:34:02.972 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:02.972 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:02.972 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: dump: 2024-09-12T00:34:02.972 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:02.972 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:02.972 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.972 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.972 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:02.973 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:02.973 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:02.973 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:02.973 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:02.973 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.973 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: _finish_auth 0 2024-09-12T00:34:02.973 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: _check_auth_tickets 2024-09-12T00:34:02.973 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:02.973 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:02.973 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:02.973 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: dump: 2024-09-12T00:34:02.973 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:02.973 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:02.974 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.974 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.974 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:02.974 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:02.974 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:02.974 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:02.974 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 monclient: authenticate success, global_id 6402 2024-09-12T00:34:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:34:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:34:02.643+0000 7f120037d9c0 4 set_mon_vals no callback set 2024-09-12T00:34:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: shutdown 2024-09-12T00:34:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: build_initial_monmap 2024-09-12T00:34:02.975 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:34:02.643+0000 7f120037d9c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:02.975 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: monmap: 2024-09-12T00:34:02.975 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:34:02.975 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:02.975 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:34:02.975 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:34:02.975 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:02.975 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:02.976 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:34:02.976 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:34:02.976 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:34:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding auth protocol: cephx 2024-09-12T00:34:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding auth protocol: cephx 2024-09-12T00:34:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding auth protocol: cephx 2024-09-12T00:34:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: secure 2024-09-12T00:34:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: crc 2024-09-12T00:34:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: secure 2024-09-12T00:34:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: crc 2024-09-12T00:34:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: secure 2024-09-12T00:34:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: crc 2024-09-12T00:34:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: crc 2024-09-12T00:34:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: secure 2024-09-12T00:34:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: crc 2024-09-12T00:34:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: secure 2024-09-12T00:34:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: crc 2024-09-12T00:34:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: secure 2024-09-12T00:34:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:34:02.643+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:34:02.643+0000 7f120037d9c0 1 librados: starting msgr at 2024-09-12T00:34:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:34:02.643+0000 7f120037d9c0 1 librados: starting objecter 2024-09-12T00:34:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command objecter_requests cmddesc objecter_requests hook 0x562c41d2b2f0 EEXIST 2024-09-12T00:34:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:34:02.647+0000 7f120037d9c0 1 librados: setting wanted keys 2024-09-12T00:34:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:34:02.647+0000 7f120037d9c0 1 librados: calling monclient init 2024-09-12T00:34:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient: init 2024-09-12T00:34:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding auth protocol: cephx 2024-09-12T00:34:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding auth protocol: cephx 2024-09-12T00:34:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding auth protocol: cephx 2024-09-12T00:34:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: secure 2024-09-12T00:34:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: crc 2024-09-12T00:34:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: secure 2024-09-12T00:34:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: crc 2024-09-12T00:34:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: secure 2024-09-12T00:34:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: crc 2024-09-12T00:34:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: crc 2024-09-12T00:34:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: secure 2024-09-12T00:34:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: crc 2024-09-12T00:34:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: secure 2024-09-12T00:34:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: crc 2024-09-12T00:34:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: secure 2024-09-12T00:34:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:34:02.647+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:34:02.647+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command rotate-key cmddesc rotate-key hook 0x562c41d2f2d8 EEXIST 2024-09-12T00:34:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:34:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-a con 0x562c41d7b200 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:34:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-b con 0x562c41d7caa0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:34:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-c con 0x562c41d74d20 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:34:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient(hunting): authenticate will time out at 2095.992723s 2024-09-12T00:34:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient(hunting): get_auth_request con 0x562c41d7b200 auth_method 0 2024-09-12T00:34:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:34:02.647+0000 7f11fe684640 10 monclient(hunting): get_auth_request con 0x562c41d74d20 auth_method 0 2024-09-12T00:34:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:34:02.647+0000 7f11fe684640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:34:02.647+0000 7f11fe684640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:34:02.647+0000 7f11fe684640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:34:02.647+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:34:02.647+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:34:02.647+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient(hunting): handle_auth_done global_id 6405 payload 824 2024-09-12T00:34:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient: _finish_hunting 0 2024-09-12T00:34:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:34:02.647+0000 7f11fde83640 1 monclient: found mon.noname-a 2024-09-12T00:34:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:34:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:34:02.647+0000 7f11fd682640 10 monclient: get_auth_request con 0x562c41d7caa0 auth_method 0 2024-09-12T00:34:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: dump: 2024-09-12T00:34:02.982 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:02.982 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:02.982 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.982 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.982 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:02.982 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:02.982 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:02.982 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:02.982 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: _finish_auth 0 2024-09-12T00:34:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:34:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:02.983 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:02.983 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:02.983 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: dump: 2024-09-12T00:34:02.983 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:02.983 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:02.983 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.983 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:02.983 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:02.983 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:02.983 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:02.983 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:02.983 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:02.983 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 monclient: authenticate success, global_id 6405 2024-09-12T00:34:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient: _renew_subs 2024-09-12T00:34:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:34:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:34:02.647+0000 7f10e17fa640 4 set_mon_vals no callback set 2024-09-12T00:34:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient: _renew_subs 2024-09-12T00:34:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:34:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:34:02.647+0000 7f120037d9c0 1 librados: init done 2024-09-12T00:34:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command cr dump hook 0x562c41d753d8 2024-09-12T00:34:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:34:02.647+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:34:02.651+0000 7f11fd682640 10 monclient: get_auth_request con 0x7f10c8070b10 auth_method 0 2024-09-12T00:34:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:34:02.651+0000 7f11fe684640 10 monclient: get_auth_request con 0x562c41d9b250 auth_method 0 2024-09-12T00:34:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 realm 2024-09-12T00:34:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:34:02.651+0000 7f120037d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:34:02.651+0000 7f11fde83640 10 monclient: get_auth_request con 0x562c41d9f4b0 auth_method 0 2024-09-12T00:34:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:34:02.651+0000 7f11fd682640 10 monclient: get_auth_request con 0x562c41da2d30 auth_method 0 2024-09-12T00:34:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 searching for the correct realm 2024-09-12T00:34:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:34:02.655+0000 7f11fe684640 10 monclient: get_auth_request con 0x562c41da7af0 auth_method 0 2024-09-12T00:34:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:34:02.655+0000 7f11fde83640 10 monclient: get_auth_request con 0x7f11f8079070 auth_method 0 2024-09-12T00:34:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:34:02.655+0000 7f11fd682640 10 monclient: get_auth_request con 0x7f11f0040020 auth_method 0 2024-09-12T00:34:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:34:02.659+0000 7f11fe684640 0 -- 172.21.15.138:0/3730954905 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f11f8069840 msgr2=0x7f11f8024800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:34:02.659+0000 7f11fe684640 10 monclient: get_auth_request con 0x7f11f8069840 auth_method 0 2024-09-12T00:34:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:34:02.863+0000 7f11fe684640 10 monclient: get_auth_request con 0x7f11f8069840 auth_method 0 2024-09-12T00:34:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:34:02.867+0000 7f11fde83640 10 monclient: get_auth_request con 0x7f11f002a070 auth_method 0 2024-09-12T00:34:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:34:02.875+0000 7f11fe684640 0 -- 172.21.15.138:0/3730954905 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x562c41da7af0 msgr2=0x562c41da9fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:34:02.875+0000 7f10cf7fe640 1 client.6405.objecter ms_handle_reset 0x562c41da7af0 session 0x562c41da7470 osd.4 2024-09-12T00:34:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:34:02.875+0000 7f10cf7fe640 10 monclient: _renew_subs 2024-09-12T00:34:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:34:02.875+0000 7f10cf7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:34:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:34:02.875+0000 7f11fe684640 10 monclient: get_auth_request con 0x7f10c8080e30 auth_method 0 2024-09-12T00:34:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 zone default found 2024-09-12T00:34:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:34:02.887+0000 7f120037d9c0 4 Realm: () 2024-09-12T00:34:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:34:02.887+0000 7f120037d9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:34:02.887+0000 7f120037d9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:34:02.887+0000 7f120037d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 zonegroup default 2024-09-12T00:34:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 started sync module instance, tier type = 2024-09-12T00:34:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=0 2024-09-12T00:34:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=1 2024-09-12T00:34:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=2 2024-09-12T00:34:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=3 2024-09-12T00:34:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=4 2024-09-12T00:34:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=5 2024-09-12T00:34:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=6 2024-09-12T00:34:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:34:02.915+0000 7f120037d9c0 20 add_watcher() i=7 2024-09-12T00:34:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:34:02.915+0000 7f120037d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding auth protocol: cephx 2024-09-12T00:34:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding auth protocol: cephx 2024-09-12T00:34:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding auth protocol: cephx 2024-09-12T00:34:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: secure 2024-09-12T00:34:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: crc 2024-09-12T00:34:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: secure 2024-09-12T00:34:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: crc 2024-09-12T00:34:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: secure 2024-09-12T00:34:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: crc 2024-09-12T00:34:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:34:02.919+0000 7f10af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: crc 2024-09-12T00:34:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: secure 2024-09-12T00:34:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: crc 2024-09-12T00:34:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: secure 2024-09-12T00:34:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: crc 2024-09-12T00:34:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: secure 2024-09-12T00:34:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:34:02.919+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:34:02.919+0000 7f120037d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:34:02.919+0000 7f120037d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command cache list hook 0x562c41d75140 2024-09-12T00:34:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command cache inspect hook 0x562c41d75140 2024-09-12T00:34:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command cache erase hook 0x562c41d75140 2024-09-12T00:34:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command cache zap hook 0x562c41d75140 2024-09-12T00:34:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 note: GC not initialized 2024-09-12T00:34:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:34:02.919+0000 7f10ae7fc640 20 reqs_thread_entry: start 2024-09-12T00:34:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command sync trace show hook 0x7f11f4100f20 2024-09-12T00:34:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command sync trace history hook 0x7f11f4100f20 2024-09-12T00:34:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command sync trace active hook 0x7f11f4100f20 2024-09-12T00:34:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command sync trace active_short hook 0x7f11f4100f20 2024-09-12T00:34:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:34:02.919+0000 7f120037d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:34:02.919+0000 7f120037d9c0 20 Filter name: none 2024-09-12T00:34:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:34:02.919+0000 7f101ffff640 20 reqs_thread_entry: start 2024-09-12T00:34:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:34:02.919+0000 7f120037d9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:34:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:34:02.919+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:34:02.919+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:34:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:34:02.919+0000 7f120037d9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:34:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:34:02.919+0000 7f120037d9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:34:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:34:02.919+0000 7f120037d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 : miss 2024-09-12T00:34:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:34:02.919+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:34:02.923+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:34:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:34:02.923+0000 7f120037d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 info.flags=0x17 2024-09-12T00:34:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:34:02.923+0000 7f120037d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 to cache LRU end 2024-09-12T00:34:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:34:02.923+0000 7f120037d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:34:02.923+0000 7f120037d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:34:02.923+0000 7f120037d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 2024-09-12T00:34:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:34:02.927+0000 7f120037d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f120037d9c0 time 2024-09-12T00:34:02.930195+0000 2024-09-12T00:34:02.993 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:34:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1203c572eb] 2024-09-12T00:34:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1203c5749f] 2024-09-12T00:34:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c3fb68cc1] 2024-09-12T00:34:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1421f32) [0x562c405c5f32] 2024-09-12T00:34:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562c3fb7dced] 2024-09-12T00:34:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:34:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1202abdd90] 2024-09-12T00:34:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:34:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:34:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:34:02.927+0000 7f120037d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:34:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f120037d9c0 thread_name:radosgw-admin 2024-09-12T00:34:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1202ad6520] 2024-09-12T00:34:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:34:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:34:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:34:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1203c57345] 2024-09-12T00:34:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1203c5749f] 2024-09-12T00:34:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c3fb68cc1] 2024-09-12T00:34:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1421f32) [0x562c405c5f32] 2024-09-12T00:34:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562c3fb7dced] 2024-09-12T00:34:02.996 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:34:02.996 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1202abdd90] 2024-09-12T00:34:02.996 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:34:02.996 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:34:02.996 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:34:02.996 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:02.996 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:34:02.996 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:34:02.996 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:34:02.996 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:34:02.997 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:34:02.997 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:34:02.997 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:34:02.997 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:34:02.997 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:34:02.997 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:34:02.997 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:34:02.997 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:34:02.997 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:34:02.997 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:34:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:34:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:34:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:34:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:34:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:34:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:34:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:34:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:34:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:34:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:34:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:34:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:34:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:34:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:34:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:34:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:34:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:34:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:34:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:34:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:34:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:34:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:34:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:34:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:34:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:34:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:34:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:34:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:34:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:34:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:34:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:34:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:34:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:34:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:34:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:34:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:34:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:34:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:34:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:34:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:34:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:34:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:34:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:34:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:34:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:34:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:34:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:34:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:34:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:34:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:34:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:34:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:34:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:34:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:34:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:34:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:34:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:34:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:34:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:34:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:34:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:34:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:34:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:34:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:34:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:34:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:34:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:34:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:34:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:34:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:34:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:34:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:34:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:34:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:34:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:34:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:34:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:34:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:34:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:34:03.004 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:34:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: 7f101ffff640 / http_manager 2024-09-12T00:34:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: 7f10ae7fc640 / http_manager 2024-09-12T00:34:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: 7f10af7fe640 / rgw_dt_lg_renew 2024-09-12T00:34:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: 7f10cf7fe640 / ms_dispatch 2024-09-12T00:34:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: 7f10e17fa640 / io_context_pool 2024-09-12T00:34:03.005 INFO:tasks.workunit.client.0.smithi138.stderr: 7f10e37fe640 / ms_dispatch 2024-09-12T00:34:03.005 INFO:tasks.workunit.client.0.smithi138.stderr: 7f10ea604640 / ms_dispatch 2024-09-12T00:34:03.005 INFO:tasks.workunit.client.0.smithi138.stderr: 7f10ebe07640 / io_context_pool 2024-09-12T00:34:03.005 INFO:tasks.workunit.client.0.smithi138.stderr: 7f11fd682640 / msgr-worker-2 2024-09-12T00:34:03.005 INFO:tasks.workunit.client.0.smithi138.stderr: 7f11fde83640 / msgr-worker-1 2024-09-12T00:34:03.005 INFO:tasks.workunit.client.0.smithi138.stderr: 7f11fe684640 / msgr-worker-0 2024-09-12T00:34:03.005 INFO:tasks.workunit.client.0.smithi138.stderr: 7f11fee85640 / io_context_pool 2024-09-12T00:34:03.005 INFO:tasks.workunit.client.0.smithi138.stderr: 7f120037d9c0 / radosgw-admin 2024-09-12T00:34:03.005 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:34:03.005 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:34:03.005 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.82889.log 2024-09-12T00:34:03.005 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:34:03.006 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:34:03.006 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:34:02.627+0000 7f11fe684640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:03.006 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:34:02.627+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:03.006 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:34:02.627+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:03.006 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:34:02.627+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:03.006 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:34:02.627+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:03.006 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:34:02.627+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:03.006 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:34:02.627+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:03.006 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:34:02.627+0000 7f11fde83640 10 monclient(hunting): get_auth_request con 0x562c41b61440 auth_method 0 2024-09-12T00:34:03.006 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:34:02.627+0000 7f11fde83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:03.006 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:34:02.627+0000 7f11fde83640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:03.006 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:34:02.627+0000 7f11fde83640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:34:02.627+0000 7f11fd682640 10 monclient(hunting): handle_auth_done global_id 6020 payload 274 2024-09-12T00:34:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:34:02.627+0000 7f11fd682640 10 monclient: _finish_hunting 0 2024-09-12T00:34:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:34:02.627+0000 7f11fd682640 1 monclient: found mon.noname-c 2024-09-12T00:34:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:34:02.627+0000 7f11fd682640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:34:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: dump: 2024-09-12T00:34:03.007 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:03.007 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:03.007 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.007 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.007 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:03.008 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:03.008 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:03.008 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:03.008 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:03.008 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.008 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: _finish_auth 0 2024-09-12T00:34:03.008 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: _check_auth_tickets 2024-09-12T00:34:03.008 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:03.008 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 monclient: authenticate success, global_id 6020 2024-09-12T00:34:03.008 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:34:02.627+0000 7f120037d9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:34:03.008 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:34:02.627+0000 7f120037d9c0 4 set_mon_vals no callback set 2024-09-12T00:34:03.008 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:03.009 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:03.009 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:34:02.627+0000 7f10ebe07640 10 monclient: dump: 2024-09-12T00:34:03.009 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:03.009 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:03.009 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.009 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.009 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:03.009 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:03.009 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:03.009 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:03.009 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:34:02.627+0000 7f120037d9c0 10 monclient: shutdown 2024-09-12T00:34:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 asok(0x562c41aa62b0) unregister_commands rotate-key 2024-09-12T00:34:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:34:02.627+0000 7f120037d9c0 10 monclient: build_initial_monmap 2024-09-12T00:34:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:34:02.627+0000 7f120037d9c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:34:02.627+0000 7f120037d9c0 10 monclient: monmap: 2024-09-12T00:34:03.010 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:34:03.010 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:03.010 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:34:03.011 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:34:03.011 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:03.011 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:03.011 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:34:03.011 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:34:03.011 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:34:03.011 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.011 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding auth protocol: cephx 2024-09-12T00:34:03.011 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding auth protocol: cephx 2024-09-12T00:34:03.011 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding auth protocol: cephx 2024-09-12T00:34:03.011 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: secure 2024-09-12T00:34:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: crc 2024-09-12T00:34:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: secure 2024-09-12T00:34:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: crc 2024-09-12T00:34:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: secure 2024-09-12T00:34:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: crc 2024-09-12T00:34:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: crc 2024-09-12T00:34:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: secure 2024-09-12T00:34:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: crc 2024-09-12T00:34:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: secure 2024-09-12T00:34:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: crc 2024-09-12T00:34:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb67f0) adding con mode: secure 2024-09-12T00:34:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:34:02.627+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:34:02.627+0000 7f120037d9c0 1 librados: starting msgr at 2024-09-12T00:34:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:34:02.627+0000 7f120037d9c0 1 librados: starting objecter 2024-09-12T00:34:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command objecter_requests hook 0x562c41ce2500 2024-09-12T00:34:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:34:02.627+0000 7f120037d9c0 1 librados: setting wanted keys 2024-09-12T00:34:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:34:02.627+0000 7f120037d9c0 1 librados: calling monclient init 2024-09-12T00:34:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:34:02.627+0000 7f120037d9c0 10 monclient: init 2024-09-12T00:34:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding auth protocol: cephx 2024-09-12T00:34:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding auth protocol: cephx 2024-09-12T00:34:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding auth protocol: cephx 2024-09-12T00:34:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: secure 2024-09-12T00:34:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: crc 2024-09-12T00:34:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: secure 2024-09-12T00:34:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: crc 2024-09-12T00:34:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: secure 2024-09-12T00:34:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: crc 2024-09-12T00:34:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: crc 2024-09-12T00:34:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: secure 2024-09-12T00:34:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: crc 2024-09-12T00:34:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:34:02.627+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: secure 2024-09-12T00:34:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:34:02.631+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: crc 2024-09-12T00:34:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:34:02.631+0000 7f120037d9c0 5 AuthRegistry(0x562c41cb12a0) adding con mode: secure 2024-09-12T00:34:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:34:02.631+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:34:02.631+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:34:02.631+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command rotate-key hook 0x562c41cb13e8 2024-09-12T00:34:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:34:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-b con 0x562c41b61440 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:34:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-c con 0x562c41b6cbd0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:34:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-a con 0x562c41cb7f20 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:34:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient(hunting): authenticate will time out at 2095.976558s 2024-09-12T00:34:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient(hunting): get_auth_request con 0x562c41b6cbd0 auth_method 0 2024-09-12T00:34:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:34:02.631+0000 7f11fe684640 10 monclient(hunting): get_auth_request con 0x562c41cb7f20 auth_method 0 2024-09-12T00:34:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:34:02.631+0000 7f11fe684640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:34:02.631+0000 7f11fe684640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:34:02.631+0000 7f11fe684640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:34:02.631+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:34:02.631+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:34:02.631+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient(hunting): handle_auth_done global_id 6023 payload 824 2024-09-12T00:34:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient: _finish_hunting 0 2024-09-12T00:34:03.017 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:34:02.631+0000 7f11fd682640 1 monclient: found mon.noname-c 2024-09-12T00:34:03.017 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:34:02.631+0000 7f11fd682640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:34:03.017 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:03.017 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:03.017 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: dump: 2024-09-12T00:34:03.017 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:03.017 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:03.017 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.017 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.017 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:03.017 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:03.017 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:03.018 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:03.018 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: _finish_auth 0 2024-09-12T00:34:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: _check_auth_tickets 2024-09-12T00:34:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:34:02.631+0000 7f10ea604640 10 monclient: dump: 2024-09-12T00:34:03.018 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:03.018 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:03.018 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.019 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.019 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:03.019 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:03.019 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:03.019 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:03.019 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:03.019 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.019 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:34:02.631+0000 7f10ebe07640 4 set_mon_vals no callback set 2024-09-12T00:34:03.019 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:34:02.631+0000 7f120037d9c0 5 monclient: authenticate success, global_id 6023 2024-09-12T00:34:03.019 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient: _renew_subs 2024-09-12T00:34:03.019 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:34:03.019 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient: _renew_subs 2024-09-12T00:34:03.019 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:34:02.631+0000 7f120037d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:34:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:34:02.631+0000 7f120037d9c0 1 librados: init done 2024-09-12T00:34:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:34:02.631+0000 7f10ea604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:34:02.631+0000 7f10ea604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:34:02.631+0000 7f10ea604640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:34:02.635+0000 7f11fde83640 10 monclient: get_auth_request con 0x7f10e4070ae0 auth_method 0 2024-09-12T00:34:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:34:02.635+0000 7f11fe684640 10 monclient: get_auth_request con 0x562c41cf98b0 auth_method 0 2024-09-12T00:34:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:34:02.635+0000 7f11fde83640 10 monclient: get_auth_request con 0x562c41cfca90 auth_method 0 2024-09-12T00:34:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:34:02.635+0000 7f11fd682640 10 monclient: get_auth_request con 0x562c41d00c80 auth_method 0 2024-09-12T00:34:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: build_initial_monmap 2024-09-12T00:34:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:34:02.639+0000 7f120037d9c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: monmap: 2024-09-12T00:34:03.020 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:34:03.021 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:03.021 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:34:03.021 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:34:03.021 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:03.021 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:03.021 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:34:03.021 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:34:03.021 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:34:03.021 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.021 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding auth protocol: cephx 2024-09-12T00:34:03.021 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding auth protocol: cephx 2024-09-12T00:34:03.021 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding auth protocol: cephx 2024-09-12T00:34:03.021 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: secure 2024-09-12T00:34:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: crc 2024-09-12T00:34:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: secure 2024-09-12T00:34:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: crc 2024-09-12T00:34:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: secure 2024-09-12T00:34:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: crc 2024-09-12T00:34:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: crc 2024-09-12T00:34:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: secure 2024-09-12T00:34:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: crc 2024-09-12T00:34:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: secure 2024-09-12T00:34:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: crc 2024-09-12T00:34:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d05880) adding con mode: secure 2024-09-12T00:34:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:34:02.639+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command objecter_requests cmddesc objecter_requests hook 0x562c41d091c0 EEXIST 2024-09-12T00:34:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: init 2024-09-12T00:34:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding auth protocol: cephx 2024-09-12T00:34:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding auth protocol: cephx 2024-09-12T00:34:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding auth protocol: cephx 2024-09-12T00:34:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: secure 2024-09-12T00:34:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: crc 2024-09-12T00:34:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: secure 2024-09-12T00:34:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: crc 2024-09-12T00:34:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: secure 2024-09-12T00:34:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: crc 2024-09-12T00:34:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: crc 2024-09-12T00:34:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: secure 2024-09-12T00:34:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: crc 2024-09-12T00:34:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: secure 2024-09-12T00:34:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: crc 2024-09-12T00:34:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 AuthRegistry(0x562c41d03f08) adding con mode: secure 2024-09-12T00:34:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:34:02.639+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:34:02.639+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command rotate-key cmddesc rotate-key hook 0x562c41d04050 EEXIST 2024-09-12T00:34:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:34:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-b con 0x562c41d2d370 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:34:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-a con 0x562c41d2cca0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:34:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-c con 0x562c41d2b680 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:34:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient(hunting): authenticate will time out at 2095.985825s 2024-09-12T00:34:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient(hunting): get_auth_request con 0x562c41d2b680 auth_method 0 2024-09-12T00:34:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:34:02.639+0000 7f11fd682640 10 monclient(hunting): get_auth_request con 0x562c41d2cca0 auth_method 0 2024-09-12T00:34:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:34:02.639+0000 7f11fd682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:34:02.639+0000 7f11fd682640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:34:02.639+0000 7f11fd682640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:34:02.639+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:34:02.639+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:34:02.639+0000 7f11fd682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:34:02.639+0000 7f11fde83640 10 monclient(hunting): get_auth_request con 0x562c41d2d370 auth_method 0 2024-09-12T00:34:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:34:02.639+0000 7f11fde83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:34:02.639+0000 7f11fde83640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:34:02.639+0000 7f11fde83640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient(hunting): handle_auth_done global_id 6026 payload 824 2024-09-12T00:34:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient: _finish_hunting 0 2024-09-12T00:34:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:34:02.639+0000 7f11fe684640 1 monclient: found mon.noname-c 2024-09-12T00:34:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:34:02.639+0000 7f11fe684640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:34:03.027 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:03.027 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:03.027 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: dump: 2024-09-12T00:34:03.027 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:03.027 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:03.027 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.027 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.027 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:03.027 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:03.027 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:03.027 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:03.027 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:03.027 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: _finish_auth 0 2024-09-12T00:34:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: _check_auth_tickets 2024-09-12T00:34:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:34:02.639+0000 7f10e37fe640 10 monclient: dump: 2024-09-12T00:34:03.028 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:03.028 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:03.028 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.028 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.028 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:03.028 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:03.029 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:03.029 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:03.029 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:34:02.639+0000 7f120037d9c0 5 monclient: authenticate success, global_id 6026 2024-09-12T00:34:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:34:02.639+0000 7f11fee85640 4 set_mon_vals no callback set 2024-09-12T00:34:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: _renew_subs 2024-09-12T00:34:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:34:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: _renew_subs 2024-09-12T00:34:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:34:02.639+0000 7f120037d9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:34:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:34:02.643+0000 7f10e37fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:34:02.643+0000 7f10e37fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:34:02.643+0000 7f10e37fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:03.030 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: get_monmap_and_config 2024-09-12T00:34:03.030 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: build_initial_monmap 2024-09-12T00:34:03.030 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:34:02.643+0000 7f120037d9c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:03.030 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: monmap: 2024-09-12T00:34:03.030 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:34:03.030 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:03.030 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:34:03.030 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:34:03.030 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:03.030 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:03.030 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:34:03.030 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:34:03.030 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:34:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding auth protocol: cephx 2024-09-12T00:34:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding auth protocol: cephx 2024-09-12T00:34:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding auth protocol: cephx 2024-09-12T00:34:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: secure 2024-09-12T00:34:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: crc 2024-09-12T00:34:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: secure 2024-09-12T00:34:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: crc 2024-09-12T00:34:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: secure 2024-09-12T00:34:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: crc 2024-09-12T00:34:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: crc 2024-09-12T00:34:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: secure 2024-09-12T00:34:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: crc 2024-09-12T00:34:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: secure 2024-09-12T00:34:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: crc 2024-09-12T00:34:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d4ccc0) adding con mode: secure 2024-09-12T00:34:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:34:02.643+0000 7f11fde83640 10 monclient: get_auth_request con 0x7f10d8070a20 auth_method 0 2024-09-12T00:34:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:34:02.643+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: init 2024-09-12T00:34:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding auth protocol: cephx 2024-09-12T00:34:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding auth protocol: cephx 2024-09-12T00:34:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding auth protocol: cephx 2024-09-12T00:34:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: secure 2024-09-12T00:34:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: crc 2024-09-12T00:34:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: secure 2024-09-12T00:34:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: crc 2024-09-12T00:34:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: secure 2024-09-12T00:34:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: crc 2024-09-12T00:34:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: crc 2024-09-12T00:34:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: secure 2024-09-12T00:34:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: crc 2024-09-12T00:34:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: secure 2024-09-12T00:34:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: crc 2024-09-12T00:34:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9140) adding con mode: secure 2024-09-12T00:34:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:34:02.643+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:34:02.643+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command rotate-key cmddesc rotate-key hook 0x7ffddf4a9288 EEXIST 2024-09-12T00:34:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:34:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-c con 0x562c41d7b200 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:34:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-b con 0x562c41d7b5e0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:34:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-a con 0x562c41d7caa0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:34:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient(hunting): authenticate will time out at 2095.990116s 2024-09-12T00:34:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:34:02.643+0000 7f11fde83640 10 monclient(hunting): get_auth_request con 0x562c41d7b200 auth_method 0 2024-09-12T00:34:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:34:02.643+0000 7f11fde83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:34:02.643+0000 7f11fde83640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:34:02.643+0000 7f11fde83640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient(hunting): get_auth_request con 0x562c41d7caa0 auth_method 0 2024-09-12T00:34:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:34:02.643+0000 7f11fde83640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:34:02.643+0000 7f11fde83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:34:02.643+0000 7f11fde83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:03.036 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:34:02.643+0000 7f11fd682640 10 monclient(hunting): get_auth_request con 0x562c41d7b5e0 auth_method 0 2024-09-12T00:34:03.036 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:34:02.643+0000 7f11fd682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:03.036 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:34:02.643+0000 7f11fd682640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:03.036 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:34:02.643+0000 7f11fd682640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:03.036 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient(hunting): handle_auth_done global_id 6402 payload 274 2024-09-12T00:34:03.036 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient: _finish_hunting 0 2024-09-12T00:34:03.036 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:34:02.643+0000 7f11fe684640 1 monclient: found mon.noname-a 2024-09-12T00:34:03.036 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:34:02.643+0000 7f11fe684640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:34:03.036 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:03.036 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:03.036 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: dump: 2024-09-12T00:34:03.036 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:03.037 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:03.037 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.037 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.037 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:03.037 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:03.037 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:03.037 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:03.037 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: _finish_auth 0 2024-09-12T00:34:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: _check_auth_tickets 2024-09-12T00:34:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:03.038 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:03.038 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:03.038 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:34:02.643+0000 7f10e17fa640 10 monclient: dump: 2024-09-12T00:34:03.038 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:03.038 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:03.038 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.038 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.038 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:03.038 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:03.038 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:03.038 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:03.038 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 monclient: authenticate success, global_id 6402 2024-09-12T00:34:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:34:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:34:02.643+0000 7f120037d9c0 4 set_mon_vals no callback set 2024-09-12T00:34:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: shutdown 2024-09-12T00:34:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: build_initial_monmap 2024-09-12T00:34:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:34:02.643+0000 7f120037d9c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:34:02.643+0000 7f120037d9c0 10 monclient: monmap: 2024-09-12T00:34:03.039 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:34:03.039 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:03.039 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:34:03.040 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:34:03.040 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:03.040 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:03.040 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:34:03.040 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:34:03.040 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:34:03.040 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.040 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding auth protocol: cephx 2024-09-12T00:34:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding auth protocol: cephx 2024-09-12T00:34:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding auth protocol: cephx 2024-09-12T00:34:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: secure 2024-09-12T00:34:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: crc 2024-09-12T00:34:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: secure 2024-09-12T00:34:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: crc 2024-09-12T00:34:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: secure 2024-09-12T00:34:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: crc 2024-09-12T00:34:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: crc 2024-09-12T00:34:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: secure 2024-09-12T00:34:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: crc 2024-09-12T00:34:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: secure 2024-09-12T00:34:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: crc 2024-09-12T00:34:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:34:02.643+0000 7f120037d9c0 5 AuthRegistry(0x562c41d73780) adding con mode: secure 2024-09-12T00:34:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:34:02.643+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:34:02.643+0000 7f120037d9c0 1 librados: starting msgr at 2024-09-12T00:34:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:34:02.643+0000 7f120037d9c0 1 librados: starting objecter 2024-09-12T00:34:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command objecter_requests cmddesc objecter_requests hook 0x562c41d2b2f0 EEXIST 2024-09-12T00:34:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:34:02.647+0000 7f120037d9c0 1 librados: setting wanted keys 2024-09-12T00:34:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:34:02.647+0000 7f120037d9c0 1 librados: calling monclient init 2024-09-12T00:34:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient: init 2024-09-12T00:34:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding auth protocol: cephx 2024-09-12T00:34:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding auth protocol: cephx 2024-09-12T00:34:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding auth protocol: cephx 2024-09-12T00:34:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: secure 2024-09-12T00:34:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: crc 2024-09-12T00:34:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: secure 2024-09-12T00:34:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: crc 2024-09-12T00:34:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: secure 2024-09-12T00:34:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: crc 2024-09-12T00:34:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: crc 2024-09-12T00:34:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: secure 2024-09-12T00:34:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: crc 2024-09-12T00:34:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: secure 2024-09-12T00:34:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: crc 2024-09-12T00:34:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 AuthRegistry(0x562c41d2f190) adding con mode: secure 2024-09-12T00:34:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:34:02.647+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:34:02.647+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command rotate-key cmddesc rotate-key hook 0x562c41d2f2d8 EEXIST 2024-09-12T00:34:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:34:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-a con 0x562c41d7b200 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:34:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-b con 0x562c41d7caa0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:34:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient(hunting): picked mon.noname-c con 0x562c41d74d20 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:34:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient(hunting): authenticate will time out at 2095.992723s 2024-09-12T00:34:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient(hunting): get_auth_request con 0x562c41d7b200 auth_method 0 2024-09-12T00:34:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:34:02.647+0000 7f11fe684640 10 monclient(hunting): get_auth_request con 0x562c41d74d20 auth_method 0 2024-09-12T00:34:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:34:02.647+0000 7f11fe684640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:34:02.647+0000 7f11fe684640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:34:02.647+0000 7f11fe684640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:34:02.647+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:34:02.647+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:34:02.647+0000 7f11fe684640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient(hunting): handle_auth_done global_id 6405 payload 824 2024-09-12T00:34:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient: _finish_hunting 0 2024-09-12T00:34:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:34:02.647+0000 7f11fde83640 1 monclient: found mon.noname-a 2024-09-12T00:34:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:34:02.647+0000 7f11fde83640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:34:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:34:02.647+0000 7f11fd682640 10 monclient: get_auth_request con 0x562c41d7caa0 auth_method 0 2024-09-12T00:34:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: dump: 2024-09-12T00:34:03.046 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:03.046 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:03.046 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.046 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.047 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:03.047 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:03.047 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:03.047 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:03.047 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: _finish_auth 0 2024-09-12T00:34:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:34:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 10 monclient: dump: 2024-09-12T00:34:03.047 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:03.048 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:03.048 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.048 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:03.048 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:03.048 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:03.048 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:03.048 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:03.048 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:03.048 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.048 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 monclient: authenticate success, global_id 6405 2024-09-12T00:34:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient: _renew_subs 2024-09-12T00:34:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:34:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:34:02.647+0000 7f10e17fa640 4 set_mon_vals no callback set 2024-09-12T00:34:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient: _renew_subs 2024-09-12T00:34:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:34:02.647+0000 7f120037d9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:34:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:34:02.647+0000 7f120037d9c0 1 librados: init done 2024-09-12T00:34:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:34:02.647+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command cr dump hook 0x562c41d753d8 2024-09-12T00:34:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:34:02.647+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:34:02.647+0000 7f10cf7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:34:02.651+0000 7f11fd682640 10 monclient: get_auth_request con 0x7f10c8070b10 auth_method 0 2024-09-12T00:34:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:34:02.651+0000 7f11fe684640 10 monclient: get_auth_request con 0x562c41d9b250 auth_method 0 2024-09-12T00:34:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 realm 2024-09-12T00:34:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:34:02.651+0000 7f120037d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:34:02.651+0000 7f11fde83640 10 monclient: get_auth_request con 0x562c41d9f4b0 auth_method 0 2024-09-12T00:34:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:34:02.651+0000 7f11fd682640 10 monclient: get_auth_request con 0x562c41da2d30 auth_method 0 2024-09-12T00:34:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:34:02.651+0000 7f120037d9c0 20 searching for the correct realm 2024-09-12T00:34:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:34:02.655+0000 7f11fe684640 10 monclient: get_auth_request con 0x562c41da7af0 auth_method 0 2024-09-12T00:34:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:34:02.655+0000 7f11fde83640 10 monclient: get_auth_request con 0x7f11f8079070 auth_method 0 2024-09-12T00:34:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:34:02.655+0000 7f11fd682640 10 monclient: get_auth_request con 0x7f11f0040020 auth_method 0 2024-09-12T00:34:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:34:02.659+0000 7f11fe684640 0 -- 172.21.15.138:0/3730954905 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f11f8069840 msgr2=0x7f11f8024800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:34:02.659+0000 7f11fe684640 10 monclient: get_auth_request con 0x7f11f8069840 auth_method 0 2024-09-12T00:34:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:34:02.863+0000 7f11fe684640 10 monclient: get_auth_request con 0x7f11f8069840 auth_method 0 2024-09-12T00:34:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:34:02.867+0000 7f11fde83640 10 monclient: get_auth_request con 0x7f11f002a070 auth_method 0 2024-09-12T00:34:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:34:02.875+0000 7f11fe684640 0 -- 172.21.15.138:0/3730954905 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x562c41da7af0 msgr2=0x562c41da9fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:34:02.875+0000 7f10cf7fe640 1 client.6405.objecter ms_handle_reset 0x562c41da7af0 session 0x562c41da7470 osd.4 2024-09-12T00:34:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:34:02.875+0000 7f10cf7fe640 10 monclient: _renew_subs 2024-09-12T00:34:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:34:02.875+0000 7f10cf7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:34:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:34:02.875+0000 7f11fe684640 10 monclient: get_auth_request con 0x7f10c8080e30 auth_method 0 2024-09-12T00:34:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:34:02.883+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 zone default found 2024-09-12T00:34:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:34:02.887+0000 7f120037d9c0 4 Realm: () 2024-09-12T00:34:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:34:02.887+0000 7f120037d9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:34:02.887+0000 7f120037d9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:34:02.887+0000 7f120037d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 zonegroup default 2024-09-12T00:34:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 started sync module instance, tier type = 2024-09-12T00:34:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:34:02.887+0000 7f120037d9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=0 2024-09-12T00:34:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=1 2024-09-12T00:34:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=2 2024-09-12T00:34:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=3 2024-09-12T00:34:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=4 2024-09-12T00:34:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=5 2024-09-12T00:34:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:34:02.911+0000 7f120037d9c0 20 add_watcher() i=6 2024-09-12T00:34:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:34:02.915+0000 7f120037d9c0 20 add_watcher() i=7 2024-09-12T00:34:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:34:02.915+0000 7f120037d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding auth protocol: cephx 2024-09-12T00:34:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding auth protocol: cephx 2024-09-12T00:34:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding auth protocol: cephx 2024-09-12T00:34:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: secure 2024-09-12T00:34:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: crc 2024-09-12T00:34:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: secure 2024-09-12T00:34:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: crc 2024-09-12T00:34:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: secure 2024-09-12T00:34:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: crc 2024-09-12T00:34:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:34:02.919+0000 7f10af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: crc 2024-09-12T00:34:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: secure 2024-09-12T00:34:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: crc 2024-09-12T00:34:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: secure 2024-09-12T00:34:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: crc 2024-09-12T00:34:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 AuthRegistry(0x7ffddf4a9620) adding con mode: secure 2024-09-12T00:34:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:34:02.919+0000 7f120037d9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:34:02.919+0000 7f120037d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:34:02.919+0000 7f120037d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command cache list hook 0x562c41d75140 2024-09-12T00:34:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command cache inspect hook 0x562c41d75140 2024-09-12T00:34:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command cache erase hook 0x562c41d75140 2024-09-12T00:34:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command cache zap hook 0x562c41d75140 2024-09-12T00:34:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 note: GC not initialized 2024-09-12T00:34:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:34:02.919+0000 7f10ae7fc640 20 reqs_thread_entry: start 2024-09-12T00:34:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command sync trace show hook 0x7f11f4100f20 2024-09-12T00:34:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command sync trace history hook 0x7f11f4100f20 2024-09-12T00:34:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command sync trace active hook 0x7f11f4100f20 2024-09-12T00:34:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:34:02.919+0000 7f120037d9c0 5 asok(0x562c41aa62b0) register_command sync trace active_short hook 0x7f11f4100f20 2024-09-12T00:34:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:34:02.919+0000 7f120037d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:34:02.919+0000 7f120037d9c0 20 Filter name: none 2024-09-12T00:34:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:34:02.919+0000 7f101ffff640 20 reqs_thread_entry: start 2024-09-12T00:34:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:34:02.919+0000 7f120037d9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:34:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:34:02.919+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.058 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:34:02.919+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:34:03.058 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:34:02.919+0000 7f120037d9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:34:03.058 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:34:02.919+0000 7f120037d9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:34:03.058 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:34:02.919+0000 7f120037d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 : miss 2024-09-12T00:34:03.058 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:34:02.919+0000 7f120037d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.058 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:34:02.923+0000 7f120037d9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:34:03.058 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:34:02.923+0000 7f120037d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 info.flags=0x17 2024-09-12T00:34:03.058 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:34:02.923+0000 7f120037d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 to cache LRU end 2024-09-12T00:34:03.058 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:34:02.923+0000 7f120037d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:03.058 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:34:02.923+0000 7f120037d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:03.058 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:34:02.923+0000 7f120037d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 2024-09-12T00:34:03.058 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:34:02.927+0000 7f120037d9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f120037d9c0 time 2024-09-12T00:34:02.930195+0000 2024-09-12T00:34:03.058 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:34:03.059 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.059 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:03.059 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1203c572eb] 2024-09-12T00:34:03.059 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1203c5749f] 2024-09-12T00:34:03.059 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c3fb68cc1] 2024-09-12T00:34:03.059 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1421f32) [0x562c405c5f32] 2024-09-12T00:34:03.059 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562c3fb7dced] 2024-09-12T00:34:03.059 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:34:03.059 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1202abdd90] 2024-09-12T00:34:03.059 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:34:03.059 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:34:03.059 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.059 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:34:02.927+0000 7f120037d9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:34:03.059 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f120037d9c0 thread_name:radosgw-admin 2024-09-12T00:34:03.060 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.060 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:03.060 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1202ad6520] 2024-09-12T00:34:03.060 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:34:03.060 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:34:03.060 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:34:03.060 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1203c57345] 2024-09-12T00:34:03.060 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1203c5749f] 2024-09-12T00:34:03.060 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562c3fb68cc1] 2024-09-12T00:34:03.060 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1421f32) [0x562c405c5f32] 2024-09-12T00:34:03.060 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x562c3fb7dced] 2024-09-12T00:34:03.061 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:34:03.061 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1202abdd90] 2024-09-12T00:34:03.061 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:34:03.061 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:34:03.061 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:34:03.061 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.061 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:34:03.061 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:34:03.061 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:34:03.061 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:34:03.061 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:34:03.061 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:34:03.061 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:34:03.062 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:34:03.062 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:34:03.062 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:34:03.062 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:34:03.062 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:34:03.062 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:34:03.062 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:34:03.062 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:34:03.062 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:34:03.062 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:34:03.062 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:34:03.062 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:34:03.062 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:34:03.062 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:34:03.062 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:34:03.063 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:34:03.063 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:34:03.063 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:34:03.063 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:34:03.063 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:34:03.063 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:34:03.063 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:34:03.063 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:34:03.063 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:34:03.063 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:34:03.063 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:34:03.063 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:34:03.063 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:34:03.064 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:34:03.064 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:34:03.064 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:34:03.064 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:34:03.064 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:34:03.064 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:34:03.064 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:34:03.064 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:34:03.064 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:34:03.065 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:34:03.065 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:34:03.065 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:34:03.065 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:34:03.065 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:34:03.065 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:34:03.065 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:34:03.065 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:34:03.065 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:34:03.065 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:34:03.065 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:34:03.065 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:34:03.066 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:34:03.066 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:34:03.066 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:34:03.066 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:34:03.066 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:34:03.066 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:34:03.066 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:34:03.066 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:34:03.066 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:34:03.066 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:34:03.066 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:34:03.066 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:34:03.067 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:34:03.067 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:34:03.067 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:34:03.067 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:34:03.067 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:34:03.067 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:34:03.067 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:34:03.067 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:34:03.067 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:34:03.067 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:34:03.067 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:34:03.067 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:34:03.067 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:34:03.067 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:34:03.068 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:34:03.068 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:34:03.068 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:34:03.068 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:34:03.068 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:34:03.068 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:34:03.068 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:34:03.068 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:34:03.068 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:34:03.068 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:34:03.068 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:34:03.068 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:34:03.068 INFO:tasks.workunit.client.0.smithi138.stderr: 7f101ffff640 / http_manager 2024-09-12T00:34:03.069 INFO:tasks.workunit.client.0.smithi138.stderr: 7f10ae7fc640 / http_manager 2024-09-12T00:34:03.069 INFO:tasks.workunit.client.0.smithi138.stderr: 7f10af7fe640 / rgw_dt_lg_renew 2024-09-12T00:34:03.069 INFO:tasks.workunit.client.0.smithi138.stderr: 7f10cf7fe640 / ms_dispatch 2024-09-12T00:34:03.069 INFO:tasks.workunit.client.0.smithi138.stderr: 7f10e17fa640 / io_context_pool 2024-09-12T00:34:03.072 INFO:tasks.workunit.client.0.smithi138.stderr: 7f10e37fe640 / ms_dispatch 2024-09-12T00:34:03.072 INFO:tasks.workunit.client.0.smithi138.stderr: 7f10ea604640 / ms_dispatch 2024-09-12T00:34:03.072 INFO:tasks.workunit.client.0.smithi138.stderr: 7f10ebe07640 / io_context_pool 2024-09-12T00:34:03.072 INFO:tasks.workunit.client.0.smithi138.stderr: 7f11fd682640 / msgr-worker-2 2024-09-12T00:34:03.072 INFO:tasks.workunit.client.0.smithi138.stderr: 7f11fde83640 / msgr-worker-1 2024-09-12T00:34:03.072 INFO:tasks.workunit.client.0.smithi138.stderr: 7f11fe684640 / msgr-worker-0 2024-09-12T00:34:03.072 INFO:tasks.workunit.client.0.smithi138.stderr: 7f11fee85640 / io_context_pool 2024-09-12T00:34:03.073 INFO:tasks.workunit.client.0.smithi138.stderr: 7f120037d9c0 / radosgw-admin 2024-09-12T00:34:03.073 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:34:03.073 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:34:03.073 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:34:02.932733Z_89e6c254-7b98-43c4-80a2-f3559fc7f6f9/log 2024-09-12T00:34:03.073 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:34:03.073 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-12T00:34:03.073 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:34:03.077 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:03.078 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:03.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.015+0000 7f0ecb7ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.015+0000 7f0ecb7ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.015+0000 7f0ecb7ec9c0 20 realm 2024-09-12T00:34:03.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.015+0000 7f0ecb7ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.015+0000 7f0ecb7ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.015+0000 7f0ecb7ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:03.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.019+0000 7f0ecb7ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.019+0000 7f0ecb7ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.019+0000 7f0ecb7ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.019+0000 7f0ecb7ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:03.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.019+0000 7f0ecb7ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.019+0000 7f0ecb7ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:03.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.019+0000 7f0ecb7ec9c0 20 searching for the correct realm 2024-09-12T00:34:03.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.023+0000 7f0ec92f2640 0 -- 172.21.15.138:0/2020084765 >> [v2:172.21.15.138:6816/3496313381,v1:172.21.15.138:6817/3496313381] conn(0x7f0ec40c0070 msgr2=0x7f0ec411fbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:03.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.027+0000 7f0ec8af1640 0 -- 172.21.15.138:0/2020084765 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x55fd242f7f10 msgr2=0x55fd242fa3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:03.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:03.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:03.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:03.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:03.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:03.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:03.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:03.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:03.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 zone default found 2024-09-12T00:34:03.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 4 Realm: () 2024-09-12T00:34:03.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:03.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:03.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:03.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 zonegroup default 2024-09-12T00:34:03.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.039+0000 7f0ecb7ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.043+0000 7f0ecb7ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.043+0000 7f0ecb7ec9c0 20 started sync module instance, tier type = 2024-09-12T00:34:03.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.043+0000 7f0ecb7ec9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:03.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.059+0000 7f0ecb7ec9c0 20 add_watcher() i=0 2024-09-12T00:34:03.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.059+0000 7f0ecb7ec9c0 20 add_watcher() i=1 2024-09-12T00:34:03.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.059+0000 7f0ecb7ec9c0 20 add_watcher() i=2 2024-09-12T00:34:03.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.059+0000 7f0ecb7ec9c0 20 add_watcher() i=3 2024-09-12T00:34:03.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.059+0000 7f0ecb7ec9c0 20 add_watcher() i=4 2024-09-12T00:34:03.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.059+0000 7f0ecb7ec9c0 20 add_watcher() i=5 2024-09-12T00:34:03.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.059+0000 7f0ecb7ec9c0 20 add_watcher() i=6 2024-09-12T00:34:03.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.063+0000 7f0ecb7ec9c0 20 add_watcher() i=7 2024-09-12T00:34:03.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.063+0000 7f0ecb7ec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:03.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.063+0000 7f0d7f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:03.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.067+0000 7f0ecb7ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:03.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.067+0000 7f0ecb7ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:03.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.067+0000 7f0ecb7ec9c0 5 note: GC not initialized 2024-09-12T00:34:03.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.067+0000 7f0d7e7e4640 20 reqs_thread_entry: start 2024-09-12T00:34:03.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.067+0000 7f0ecb7ec9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:03.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.067+0000 7f0ecb7ec9c0 20 Filter name: none 2024-09-12T00:34:03.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.067+0000 7f0ceffff640 20 reqs_thread_entry: start 2024-09-12T00:34:03.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.067+0000 7f0ecb7ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.067+0000 7f0ecb7ec9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:34:03.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.067+0000 7f0ecb7ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.067+0000 7f0ecb7ec9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:34:03.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.067+0000 7f0ecb7ec9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:03.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.067+0000 7f0ecb7ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.067+0000 7f0ecb7ec9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:34:03.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.067+0000 7f0ecb7ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.067+0000 7f0ecb7ec9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:34:03.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.067+0000 7f0ecb7ec9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:03.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.071+0000 7f0d7f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:03.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.075+0000 7f0ecb7ec9c0 20 remove_watcher() i=0 2024-09-12T00:34:03.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.075+0000 7f0ecb7ec9c0 2 removed watcher, disabling cache 2024-09-12T00:34:03.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.075+0000 7f0ecb7ec9c0 20 remove_watcher() i=1 2024-09-12T00:34:03.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.079+0000 7f0ecb7ec9c0 20 remove_watcher() i=2 2024-09-12T00:34:03.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.079+0000 7f0ecb7ec9c0 20 remove_watcher() i=3 2024-09-12T00:34:03.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.083+0000 7f0ecb7ec9c0 20 remove_watcher() i=4 2024-09-12T00:34:03.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.087+0000 7f0ecb7ec9c0 20 remove_watcher() i=5 2024-09-12T00:34:03.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.091+0000 7f0ecb7ec9c0 20 remove_watcher() i=6 2024-09-12T00:34:03.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.091+0000 7f0ecb7ec9c0 20 remove_watcher() i=7 2024-09-12T00:34:03.108 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.109 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:34:03.109 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-init-indext id: e2043445-c131-4520-984d-b4d52f038a6b.4538.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:34:03.109 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:03.110 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:03.110 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:03.123 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:03.123 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:03.169 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:34:03.203 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:03.203 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:03.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.247+0000 7f9161dd19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.251+0000 7f9161dd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.251+0000 7f9161dd19c0 20 realm 2024-09-12T00:34:03.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.251+0000 7f9161dd19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.251+0000 7f9161dd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.251+0000 7f9161dd19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:03.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.251+0000 7f9161dd19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.251+0000 7f9161dd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.251+0000 7f9161dd19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.251+0000 7f9161dd19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:03.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.251+0000 7f9161dd19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.255+0000 7f9161dd19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:03.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.255+0000 7f9161dd19c0 20 searching for the correct realm 2024-09-12T00:34:03.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.259+0000 7f91600d8640 0 -- 172.21.15.138:0/3007942669 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f9158001c40 msgr2=0x7f9158017410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:03.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.475+0000 7f91600d8640 0 -- 172.21.15.138:0/3007942669 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x56094b4a7d00 msgr2=0x56094b4aa1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:03.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.483+0000 7f9161dd19c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:03.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.483+0000 7f9161dd19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:03.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.483+0000 7f9161dd19c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:03.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.483+0000 7f9161dd19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:03.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.483+0000 7f9161dd19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:03.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.483+0000 7f9161dd19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:03.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.483+0000 7f9161dd19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.483+0000 7f9161dd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.483+0000 7f9161dd19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.483+0000 7f9161dd19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:03.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.483+0000 7f9161dd19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.487+0000 7f9161dd19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:03.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.487+0000 7f9161dd19c0 20 zone default found 2024-09-12T00:34:03.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.487+0000 7f9161dd19c0 4 Realm: () 2024-09-12T00:34:03.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.487+0000 7f9161dd19c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:03.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.487+0000 7f9161dd19c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:03.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.487+0000 7f9161dd19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:03.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.487+0000 7f9161dd19c0 20 zonegroup default 2024-09-12T00:34:03.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.487+0000 7f9161dd19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.487+0000 7f9161dd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.487+0000 7f9161dd19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.487+0000 7f9161dd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.487+0000 7f9161dd19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.487+0000 7f9161dd19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:03.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.487+0000 7f9161dd19c0 20 started sync module instance, tier type = 2024-09-12T00:34:03.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.487+0000 7f9161dd19c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:03.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.511+0000 7f9161dd19c0 20 add_watcher() i=0 2024-09-12T00:34:03.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.511+0000 7f9161dd19c0 20 add_watcher() i=1 2024-09-12T00:34:03.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.511+0000 7f9161dd19c0 20 add_watcher() i=2 2024-09-12T00:34:03.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.511+0000 7f9161dd19c0 20 add_watcher() i=3 2024-09-12T00:34:03.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.511+0000 7f9161dd19c0 20 add_watcher() i=4 2024-09-12T00:34:03.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.511+0000 7f9161dd19c0 20 add_watcher() i=5 2024-09-12T00:34:03.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.511+0000 7f9161dd19c0 20 add_watcher() i=6 2024-09-12T00:34:03.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.515+0000 7f9161dd19c0 20 add_watcher() i=7 2024-09-12T00:34:03.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.515+0000 7f9161dd19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:03.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.519+0000 7f9015fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:03.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.519+0000 7f9161dd19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:03.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.519+0000 7f9161dd19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:03.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.519+0000 7f9161dd19c0 5 note: GC not initialized 2024-09-12T00:34:03.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.519+0000 7f9014fe1640 20 reqs_thread_entry: start 2024-09-12T00:34:03.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.519+0000 7f9161dd19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:03.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.523+0000 7f9161dd19c0 20 Filter name: none 2024-09-12T00:34:03.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.523+0000 7f8f8e7fc640 20 reqs_thread_entry: start 2024-09-12T00:34:03.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.523+0000 7f9161dd19c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:34:03.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.523+0000 7f9161dd19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.523+0000 7f9161dd19c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:34:03.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.523+0000 7f9161dd19c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:34:03.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.523+0000 7f9161dd19c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:34:03.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.523+0000 7f9161dd19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 : miss 2024-09-12T00:34:03.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.523+0000 7f9161dd19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:03.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.523+0000 7f9161dd19c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:34:03.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.523+0000 7f9161dd19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 info.flags=0x17 2024-09-12T00:34:03.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.523+0000 7f9161dd19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 to cache LRU end 2024-09-12T00:34:03.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.523+0000 7f9161dd19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:03.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.523+0000 7f9161dd19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:03.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.523+0000 7f9161dd19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 2024-09-12T00:34:03.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.527+0000 7f9161dd19c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 to be held by another RGW process; skipping for now 2024-09-12T00:34:03.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.527+0000 7f9015fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:03.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.531+0000 7f9161dd19c0 20 remove_watcher() i=0 2024-09-12T00:34:03.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.531+0000 7f9161dd19c0 2 removed watcher, disabling cache 2024-09-12T00:34:03.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.535+0000 7f9161dd19c0 20 remove_watcher() i=1 2024-09-12T00:34:03.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.535+0000 7f9161dd19c0 20 remove_watcher() i=2 2024-09-12T00:34:03.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.539+0000 7f9161dd19c0 20 remove_watcher() i=3 2024-09-12T00:34:03.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.539+0000 7f9161dd19c0 20 remove_watcher() i=4 2024-09-12T00:34:03.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.543+0000 7f9161dd19c0 20 remove_watcher() i=5 2024-09-12T00:34:03.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.543+0000 7f9161dd19c0 20 remove_watcher() i=6 2024-09-12T00:34:03.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:03.547+0000 7f9161dd19c0 20 remove_watcher() i=7 2024-09-12T00:34:03.563 INFO:tasks.workunit.client.0.smithi138.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:34:33.597 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:34:33.631 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:33.631 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:33.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.678+0000 7fe66372e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.682+0000 7fe66372e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:33.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.682+0000 7fe66372e9c0 20 realm 2024-09-12T00:34:33.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.682+0000 7fe66372e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.682+0000 7fe66372e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:33.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.682+0000 7fe66372e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:33.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.682+0000 7fe66372e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.682+0000 7fe66372e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:33.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.682+0000 7fe66372e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.682+0000 7fe66372e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:33.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.686+0000 7fe66372e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.686+0000 7fe66372e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:33.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.686+0000 7fe66372e9c0 20 searching for the correct realm 2024-09-12T00:34:33.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.690+0000 7fe661a35640 0 -- 172.21.15.138:0/649785970 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fe65c117680 msgr2=0x7fe65c0b9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:33.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.906+0000 7fe661a35640 0 -- 172.21.15.138:0/649785970 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x564ce3cce890 msgr2=0x564ce3cd0d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:33.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.914+0000 7fe66372e9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:33.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.914+0000 7fe66372e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:33.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.914+0000 7fe66372e9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:33.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.914+0000 7fe66372e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:33.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.914+0000 7fe66372e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:33.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.914+0000 7fe66372e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:33.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.914+0000 7fe66372e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.914+0000 7fe66372e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:33.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.914+0000 7fe66372e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.918+0000 7fe66372e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:33.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.918+0000 7fe66372e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.918+0000 7fe66372e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:33.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.918+0000 7fe66372e9c0 20 zone default found 2024-09-12T00:34:33.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.918+0000 7fe66372e9c0 4 Realm: () 2024-09-12T00:34:33.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.918+0000 7fe66372e9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:33.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.918+0000 7fe66372e9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:33.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.918+0000 7fe66372e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:33.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.918+0000 7fe66372e9c0 20 zonegroup default 2024-09-12T00:34:33.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.918+0000 7fe66372e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.918+0000 7fe66372e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:33.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.918+0000 7fe66372e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.918+0000 7fe66372e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:33.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.918+0000 7fe66372e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.918+0000 7fe66372e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:33.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.918+0000 7fe66372e9c0 20 started sync module instance, tier type = 2024-09-12T00:34:33.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.918+0000 7fe66372e9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:33.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.942+0000 7fe66372e9c0 20 add_watcher() i=0 2024-09-12T00:34:33.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.942+0000 7fe66372e9c0 20 add_watcher() i=1 2024-09-12T00:34:33.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.942+0000 7fe66372e9c0 20 add_watcher() i=2 2024-09-12T00:34:33.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.942+0000 7fe66372e9c0 20 add_watcher() i=3 2024-09-12T00:34:33.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.942+0000 7fe66372e9c0 20 add_watcher() i=4 2024-09-12T00:34:33.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.942+0000 7fe66372e9c0 20 add_watcher() i=5 2024-09-12T00:34:33.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.942+0000 7fe66372e9c0 20 add_watcher() i=6 2024-09-12T00:34:33.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.946+0000 7fe66372e9c0 20 add_watcher() i=7 2024-09-12T00:34:33.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.946+0000 7fe66372e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:33.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.950+0000 7fe517fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:33.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.950+0000 7fe66372e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:33.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.950+0000 7fe66372e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:33.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.950+0000 7fe66372e9c0 5 note: GC not initialized 2024-09-12T00:34:33.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.950+0000 7fe516fe5640 20 reqs_thread_entry: start 2024-09-12T00:34:33.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.950+0000 7fe66372e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:33.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.950+0000 7fe66372e9c0 20 Filter name: none 2024-09-12T00:34:33.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.950+0000 7fe514fe1640 20 reqs_thread_entry: start 2024-09-12T00:34:33.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.950+0000 7fe66372e9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:34:33.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.950+0000 7fe66372e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.954+0000 7fe66372e9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:34:33.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.954+0000 7fe66372e9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:34:33.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.954+0000 7fe66372e9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:34:33.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.954+0000 7fe66372e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 : miss 2024-09-12T00:34:33.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.954+0000 7fe66372e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:33.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.954+0000 7fe66372e9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:34:33.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.954+0000 7fe66372e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 info.flags=0x17 2024-09-12T00:34:33.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.954+0000 7fe66372e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 to cache LRU end 2024-09-12T00:34:33.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.954+0000 7fe66372e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:33.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.954+0000 7fe66372e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:33.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.954+0000 7fe66372e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 2024-09-12T00:34:33.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.966+0000 7fe66372e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 info.flags=0x17 2024-09-12T00:34:33.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.966+0000 7fe66372e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 to cache LRU end 2024-09-12T00:34:33.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.966+0000 7fe66372e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:33.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.966+0000 7fe66372e9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21, ofs0, ns] 2024-09-12T00:34:33.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.966+0000 7fe544ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333473 cookie 94888239378208 notifier 6456 bl.length()=913 2024-09-12T00:34:33.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.966+0000 7fe544ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 info.flags=0x17 2024-09-12T00:34:33.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.966+0000 7fe544ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 to cache LRU end 2024-09-12T00:34:33.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.966+0000 7fe544ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:33.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.966+0000 7fe66372e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e2043445-c131-4520-984d-b4d52f038a6b.4538.21]): orig_sources= new_sources= 2024-09-12T00:34:33.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.966+0000 7fe66372e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e2043445-c131-4520-984d-b4d52f038a6b.4538.21]): potential sources added=[] removed=[] 2024-09-12T00:34:33.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.966+0000 7fe66372e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e2043445-c131-4520-984d-b4d52f038a6b.4538.21]): orig_dests= new_dests= 2024-09-12T00:34:33.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.966+0000 7fe66372e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e2043445-c131-4520-984d-b4d52f038a6b.4538.21]): potential dests added=[] removed=[] 2024-09-12T00:34:33.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.0 2024-09-12T00:34:33.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.0 2024-09-12T00:34:33.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.1 2024-09-12T00:34:33.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.1 2024-09-12T00:34:33.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.2 2024-09-12T00:34:33.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.2 2024-09-12T00:34:33.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.3 2024-09-12T00:34:33.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.3 2024-09-12T00:34:33.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.4 2024-09-12T00:34:33.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.4 2024-09-12T00:34:33.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.5 2024-09-12T00:34:33.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.5 2024-09-12T00:34:33.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.6 2024-09-12T00:34:33.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.6 2024-09-12T00:34:33.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.7 2024-09-12T00:34:33.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.7 2024-09-12T00:34:33.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.8 2024-09-12T00:34:33.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.8 2024-09-12T00:34:33.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.9 2024-09-12T00:34:33.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.9 2024-09-12T00:34:33.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.10 2024-09-12T00:34:33.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.10 2024-09-12T00:34:33.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.11 2024-09-12T00:34:33.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1.11 2024-09-12T00:34:33.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.974+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.0 2024-09-12T00:34:33.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.978+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1 2024-09-12T00:34:33.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.978+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.2 2024-09-12T00:34:33.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.978+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.3 2024-09-12T00:34:33.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.978+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.4 2024-09-12T00:34:33.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.982+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.5 2024-09-12T00:34:33.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.982+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.6 2024-09-12T00:34:33.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.982+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.7 2024-09-12T00:34:33.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.982+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.8 2024-09-12T00:34:33.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.982+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.9 2024-09-12T00:34:33.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.986+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.10 2024-09-12T00:34:33.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.994+0000 7fe66372e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:33.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.994+0000 7fe66372e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 2024-09-12T00:34:33.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.994+0000 7fe66372e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 info.flags=0x17 2024-09-12T00:34:33.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.994+0000 7fe66372e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 to cache LRU end 2024-09-12T00:34:33.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.994+0000 7fe66372e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:33.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.994+0000 7fe66372e9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21, ofs0, ns] 2024-09-12T00:34:33.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.994+0000 7fe544ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333474 cookie 94888239378208 notifier 6456 bl.length()=913 2024-09-12T00:34:33.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.994+0000 7fe544ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 info.flags=0x17 2024-09-12T00:34:33.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.994+0000 7fe544ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 to cache LRU end 2024-09-12T00:34:33.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.994+0000 7fe544ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:33.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.998+0000 7fe66372e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e2043445-c131-4520-984d-b4d52f038a6b.4538.21]): orig_sources= new_sources= 2024-09-12T00:34:33.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.998+0000 7fe66372e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e2043445-c131-4520-984d-b4d52f038a6b.4538.21]): potential sources added=[] removed=[] 2024-09-12T00:34:33.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.998+0000 7fe66372e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e2043445-c131-4520-984d-b4d52f038a6b.4538.21]): orig_dests= new_dests= 2024-09-12T00:34:33.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:33.998+0000 7fe66372e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e2043445-c131-4520-984d-b4d52f038a6b.4538.21]): potential dests added=[] removed=[] 2024-09-12T00:34:33.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.002+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.0 2024-09-12T00:34:33.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.002+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.1 2024-09-12T00:34:33.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.002+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.2 2024-09-12T00:34:33.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.002+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.3 2024-09-12T00:34:33.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.002+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.4 2024-09-12T00:34:33.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.002+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.5 2024-09-12T00:34:34.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.002+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.6 2024-09-12T00:34:34.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.006+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.7 2024-09-12T00:34:34.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.006+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.8 2024-09-12T00:34:34.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.006+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.9 2024-09-12T00:34:34.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.006+0000 7fe66372e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.21.10 2024-09-12T00:34:34.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.006+0000 7fe66372e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:34.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.006+0000 7fe66372e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 2024-09-12T00:34:34.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.010+0000 7fe66372e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 info.flags=0x17 2024-09-12T00:34:34.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.010+0000 7fe66372e9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 to cache LRU end 2024-09-12T00:34:34.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.010+0000 7fe66372e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:34.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.010+0000 7fe66372e9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21, ofs0, ns] 2024-09-12T00:34:34.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.010+0000 7fe544ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333475 cookie 94888239378208 notifier 6456 bl.length()=881 2024-09-12T00:34:34.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.010+0000 7fe544ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 info.flags=0x17 2024-09-12T00:34:34.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.010+0000 7fe544ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:e2043445-c131-4520-984d-b4d52f038a6b.4538.21 to cache LRU end 2024-09-12T00:34:34.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.010+0000 7fe544ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:34.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.010+0000 7fe66372e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e2043445-c131-4520-984d-b4d52f038a6b.4538.21]): orig_sources= new_sources= 2024-09-12T00:34:34.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.010+0000 7fe66372e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e2043445-c131-4520-984d-b4d52f038a6b.4538.21]): potential sources added=[] removed=[] 2024-09-12T00:34:34.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.010+0000 7fe66372e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e2043445-c131-4520-984d-b4d52f038a6b.4538.21]): orig_dests= new_dests= 2024-09-12T00:34:34.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.010+0000 7fe66372e9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[e2043445-c131-4520-984d-b4d52f038a6b.4538.21]): potential dests added=[] removed=[] 2024-09-12T00:34:34.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.018+0000 7fe66372e9c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-12T00:34:34.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.022+0000 7fe517fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:34.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.026+0000 7fe66372e9c0 20 remove_watcher() i=0 2024-09-12T00:34:34.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.026+0000 7fe66372e9c0 2 removed watcher, disabling cache 2024-09-12T00:34:34.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.026+0000 7fe66372e9c0 20 remove_watcher() i=1 2024-09-12T00:34:34.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.030+0000 7fe66372e9c0 20 remove_watcher() i=2 2024-09-12T00:34:34.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.030+0000 7fe66372e9c0 20 remove_watcher() i=3 2024-09-12T00:34:34.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.034+0000 7fe66372e9c0 20 remove_watcher() i=4 2024-09-12T00:34:34.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.034+0000 7fe66372e9c0 20 remove_watcher() i=5 2024-09-12T00:34:34.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.038+0000 7fe66372e9c0 20 remove_watcher() i=6 2024-09-12T00:34:34.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.038+0000 7fe66372e9c0 20 remove_watcher() i=7 2024-09-12T00:34:34.052 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:34:34.082 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:34.082 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:34.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.130+0000 7f5f9947a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.130+0000 7f5f9947a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.130+0000 7f5f9947a9c0 20 realm 2024-09-12T00:34:34.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.130+0000 7f5f9947a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.130+0000 7f5f9947a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.130+0000 7f5f9947a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:34.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.130+0000 7f5f9947a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.130+0000 7f5f9947a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.130+0000 7f5f9947a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.134+0000 7f5f9947a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:34.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.134+0000 7f5f9947a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.134+0000 7f5f9947a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:34.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.134+0000 7f5f9947a9c0 20 searching for the correct realm 2024-09-12T00:34:34.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.138+0000 7f5f97781640 0 -- 172.21.15.138:0/933206425 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f5f90034400 msgr2=0x7f5f90034880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:34.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.354+0000 7f5f97781640 0 -- 172.21.15.138:0/933206425 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55a532004260 msgr2=0x55a532006720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:34.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.362+0000 7f5f9947a9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:34.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.362+0000 7f5f9947a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:34.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.362+0000 7f5f9947a9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:34.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.362+0000 7f5f9947a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:34.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.362+0000 7f5f9947a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:34.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.362+0000 7f5f9947a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:34.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.362+0000 7f5f9947a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.362+0000 7f5f9947a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.362+0000 7f5f9947a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.366+0000 7f5f9947a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:34.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.366+0000 7f5f9947a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.366+0000 7f5f9947a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:34.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.366+0000 7f5f9947a9c0 20 zone default found 2024-09-12T00:34:34.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.366+0000 7f5f9947a9c0 4 Realm: () 2024-09-12T00:34:34.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.366+0000 7f5f9947a9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:34.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.366+0000 7f5f9947a9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:34.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.366+0000 7f5f9947a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:34.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.366+0000 7f5f9947a9c0 20 zonegroup default 2024-09-12T00:34:34.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.366+0000 7f5f9947a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.366+0000 7f5f9947a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.366+0000 7f5f9947a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.366+0000 7f5f9947a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.366+0000 7f5f9947a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.366+0000 7f5f9947a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:34.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.366+0000 7f5f9947a9c0 20 started sync module instance, tier type = 2024-09-12T00:34:34.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.366+0000 7f5f9947a9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:34.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.390+0000 7f5f9947a9c0 20 add_watcher() i=0 2024-09-12T00:34:34.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.390+0000 7f5f9947a9c0 20 add_watcher() i=1 2024-09-12T00:34:34.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.390+0000 7f5f9947a9c0 20 add_watcher() i=2 2024-09-12T00:34:34.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.390+0000 7f5f9947a9c0 20 add_watcher() i=3 2024-09-12T00:34:34.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.390+0000 7f5f9947a9c0 20 add_watcher() i=4 2024-09-12T00:34:34.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.390+0000 7f5f9947a9c0 20 add_watcher() i=5 2024-09-12T00:34:34.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.390+0000 7f5f9947a9c0 20 add_watcher() i=6 2024-09-12T00:34:34.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.394+0000 7f5f9947a9c0 20 add_watcher() i=7 2024-09-12T00:34:34.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.394+0000 7f5f9947a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:34.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.398+0000 7f5e4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:34.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.398+0000 7f5f9947a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:34.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.398+0000 7f5f9947a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:34.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.398+0000 7f5f9947a9c0 5 note: GC not initialized 2024-09-12T00:34:34.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.398+0000 7f5dc7fff640 20 reqs_thread_entry: start 2024-09-12T00:34:34.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.398+0000 7f5f9947a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:34.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.398+0000 7f5f9947a9c0 20 Filter name: none 2024-09-12T00:34:34.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.398+0000 7f5dc5ffb640 20 reqs_thread_entry: start 2024-09-12T00:34:34.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.398+0000 7f5f9947a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.402+0000 7f5f9947a9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:34:34.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.402+0000 7f5f9947a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.402+0000 7f5f9947a9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:34:34.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.402+0000 7f5f9947a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:34.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.402+0000 7f5f9947a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.402+0000 7f5f9947a9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:34:34.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.402+0000 7f5f9947a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:34.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.402+0000 7f5f9947a9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:34:34.400 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.402+0000 7f5f9947a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:34.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.406+0000 7f5e4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:34.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.410+0000 7f5f9947a9c0 20 remove_watcher() i=0 2024-09-12T00:34:34.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.410+0000 7f5f9947a9c0 2 removed watcher, disabling cache 2024-09-12T00:34:34.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.414+0000 7f5f9947a9c0 20 remove_watcher() i=1 2024-09-12T00:34:34.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.414+0000 7f5f9947a9c0 20 remove_watcher() i=2 2024-09-12T00:34:34.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.418+0000 7f5f9947a9c0 20 remove_watcher() i=3 2024-09-12T00:34:34.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.418+0000 7f5f9947a9c0 20 remove_watcher() i=4 2024-09-12T00:34:34.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.422+0000 7f5f9947a9c0 20 remove_watcher() i=5 2024-09-12T00:34:34.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.422+0000 7f5f9947a9c0 20 remove_watcher() i=6 2024-09-12T00:34:34.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:34.426+0000 7f5f9947a9c0 20 remove_watcher() i=7 2024-09-12T00:34:34.437 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:34.437 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:34:34.437 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-init-indext id: e2043445-c131-4520-984d-b4d52f038a6b.4538.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:34:34.437 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:34.440 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.440 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.443 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.443 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.494 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.495 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.545 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T00:34:34.545 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:34.547 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.547 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.569 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.569 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.616 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.616 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.638 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.638 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.659 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.659 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.682 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.682 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.705 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.705 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.725 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.725 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.746 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.746 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.768 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.768 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.789 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.789 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.811 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.811 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.831 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.831 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.853 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.853 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.874 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.875 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.897 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.897 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.918 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.918 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.939 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.939 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.961 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.961 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:34.982 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:34.983 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:35.003 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:35.003 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:35.025 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:35.028 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:35.044 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:34:35.077 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:35.077 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:35.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.134+0000 7f717e4809c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.138+0000 7f717e4809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.138+0000 7f717e4809c0 20 realm 2024-09-12T00:34:35.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.138+0000 7f717e4809c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.138+0000 7f717e4809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.138+0000 7f717e4809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:35.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.138+0000 7f717e4809c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.138+0000 7f717e4809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.138+0000 7f717e4809c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.142+0000 7f717e4809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:35.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.142+0000 7f717e4809c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.142+0000 7f717e4809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:35.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.142+0000 7f717e4809c0 20 searching for the correct realm 2024-09-12T00:34:35.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.146+0000 7f717b785640 0 -- 172.21.15.138:0/1856053922 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f716c06ce20 msgr2=0x7f716c062cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:35.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.150+0000 7f717b785640 0 -- 172.21.15.138:0/1856053922 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x5626ed7e9fe0 msgr2=0x5626ed7ec3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:35.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:35.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:35.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:35.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:35.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:35.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:35.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:35.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:35.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 zone default found 2024-09-12T00:34:35.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 4 Realm: () 2024-09-12T00:34:35.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:35.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:35.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:35.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 zonegroup default 2024-09-12T00:34:35.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 started sync module instance, tier type = 2024-09-12T00:34:35.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.162+0000 7f717e4809c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:35.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.182+0000 7f717e4809c0 20 add_watcher() i=0 2024-09-12T00:34:35.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.182+0000 7f717e4809c0 20 add_watcher() i=1 2024-09-12T00:34:35.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.182+0000 7f717e4809c0 20 add_watcher() i=2 2024-09-12T00:34:35.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.182+0000 7f717e4809c0 20 add_watcher() i=3 2024-09-12T00:34:35.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.182+0000 7f717e4809c0 20 add_watcher() i=4 2024-09-12T00:34:35.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.182+0000 7f717e4809c0 20 add_watcher() i=5 2024-09-12T00:34:35.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.182+0000 7f717e4809c0 20 add_watcher() i=6 2024-09-12T00:34:35.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.182+0000 7f717e4809c0 20 add_watcher() i=7 2024-09-12T00:34:35.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.182+0000 7f717e4809c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:35.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.186+0000 7f7031fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:35.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.186+0000 7f717e4809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:35.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.186+0000 7f717e4809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:35.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.186+0000 7f717e4809c0 5 note: GC not initialized 2024-09-12T00:34:35.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.186+0000 7f7030fe1640 20 reqs_thread_entry: start 2024-09-12T00:34:35.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.186+0000 7f717e4809c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:35.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.186+0000 7f717e4809c0 20 Filter name: none 2024-09-12T00:34:35.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.186+0000 7f6faa7fc640 20 reqs_thread_entry: start 2024-09-12T00:34:35.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.186+0000 7f717e4809c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.190+0000 7f717e4809c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:35.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.190+0000 7f717e4809c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.190+0000 7f717e4809c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:35.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.190+0000 7f717e4809c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:35.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.190+0000 7f717e4809c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.190+0000 7f717e4809c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:35.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.190+0000 7f717e4809c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.190+0000 7f717e4809c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:35.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.190+0000 7f717e4809c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:35.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.194+0000 7f7031fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:35.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.198+0000 7f717e4809c0 20 remove_watcher() i=0 2024-09-12T00:34:35.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.198+0000 7f717e4809c0 2 removed watcher, disabling cache 2024-09-12T00:34:35.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.198+0000 7f717e4809c0 20 remove_watcher() i=1 2024-09-12T00:34:35.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.202+0000 7f717e4809c0 20 remove_watcher() i=2 2024-09-12T00:34:35.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.202+0000 7f717e4809c0 20 remove_watcher() i=3 2024-09-12T00:34:35.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.206+0000 7f717e4809c0 20 remove_watcher() i=4 2024-09-12T00:34:35.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.206+0000 7f717e4809c0 20 remove_watcher() i=5 2024-09-12T00:34:35.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.210+0000 7f717e4809c0 20 remove_watcher() i=6 2024-09-12T00:34:35.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.214+0000 7f717e4809c0 20 remove_watcher() i=7 2024-09-12T00:34:35.223 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:35.223 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:34:35.223 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-set-target-layout id: e2043445-c131-4520-984d-b4d52f038a6b.4538.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:34:35.223 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:35.223 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T00:34:35.256 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:35.256 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:35.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.302+0000 7fd56a0119c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.302+0000 7fd56a0119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.302+0000 7fd56a0119c0 20 realm 2024-09-12T00:34:35.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.302+0000 7fd56a0119c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.302+0000 7fd56a0119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.302+0000 7fd56a0119c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:35.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.302+0000 7fd56a0119c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.306+0000 7fd56a0119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.306+0000 7fd56a0119c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.306+0000 7fd56a0119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:35.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.306+0000 7fd56a0119c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.306+0000 7fd56a0119c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:35.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.306+0000 7fd56a0119c0 20 searching for the correct realm 2024-09-12T00:34:35.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.310+0000 7fd568318640 0 -- 172.21.15.138:0/87691627 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fd5600c1400 msgr2=0x7fd5600c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:34:35.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.526+0000 7fd568318640 0 -- 172.21.15.138:0/87691627 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5565fe249150 msgr2=0x5565fe24b610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:35.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.534+0000 7fd56a0119c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:35.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.534+0000 7fd56a0119c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:35.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.534+0000 7fd56a0119c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:35.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.534+0000 7fd56a0119c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:35.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.534+0000 7fd56a0119c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:35.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.534+0000 7fd56a0119c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:35.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.534+0000 7fd56a0119c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.534+0000 7fd56a0119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.534+0000 7fd56a0119c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.534+0000 7fd56a0119c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:35.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.534+0000 7fd56a0119c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.538+0000 7fd56a0119c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:35.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.538+0000 7fd56a0119c0 20 zone default found 2024-09-12T00:34:35.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.538+0000 7fd56a0119c0 4 Realm: () 2024-09-12T00:34:35.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.538+0000 7fd56a0119c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:35.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.538+0000 7fd56a0119c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:35.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.538+0000 7fd56a0119c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:35.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.538+0000 7fd56a0119c0 20 zonegroup default 2024-09-12T00:34:35.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.538+0000 7fd56a0119c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.538+0000 7fd56a0119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.538+0000 7fd56a0119c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.538+0000 7fd56a0119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.538+0000 7fd56a0119c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.538+0000 7fd56a0119c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.538+0000 7fd56a0119c0 20 started sync module instance, tier type = 2024-09-12T00:34:35.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.538+0000 7fd56a0119c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:35.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.562+0000 7fd56a0119c0 20 add_watcher() i=0 2024-09-12T00:34:35.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.562+0000 7fd56a0119c0 20 add_watcher() i=1 2024-09-12T00:34:35.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.562+0000 7fd56a0119c0 20 add_watcher() i=2 2024-09-12T00:34:35.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.562+0000 7fd56a0119c0 20 add_watcher() i=3 2024-09-12T00:34:35.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.562+0000 7fd56a0119c0 20 add_watcher() i=4 2024-09-12T00:34:35.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.562+0000 7fd56a0119c0 20 add_watcher() i=5 2024-09-12T00:34:35.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.562+0000 7fd56a0119c0 20 add_watcher() i=6 2024-09-12T00:34:35.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.566+0000 7fd56a0119c0 20 add_watcher() i=7 2024-09-12T00:34:35.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.566+0000 7fd56a0119c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:35.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.570+0000 7fd41dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:35.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.570+0000 7fd56a0119c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:35.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.570+0000 7fd56a0119c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:35.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.570+0000 7fd56a0119c0 5 note: GC not initialized 2024-09-12T00:34:35.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.574+0000 7fd41cfe1640 20 reqs_thread_entry: start 2024-09-12T00:34:35.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.574+0000 7fd56a0119c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:35.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.574+0000 7fd56a0119c0 20 Filter name: none 2024-09-12T00:34:35.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.574+0000 7fd3967fc640 20 reqs_thread_entry: start 2024-09-12T00:34:35.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.574+0000 7fd56a0119c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:34:35.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.574+0000 7fd56a0119c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.574+0000 7fd56a0119c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:35.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.574+0000 7fd56a0119c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:34:35.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.574+0000 7fd56a0119c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:34:35.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.574+0000 7fd56a0119c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 : miss 2024-09-12T00:34:35.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.574+0000 7fd56a0119c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.574+0000 7fd56a0119c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:35.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.574+0000 7fd56a0119c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 info.flags=0x17 2024-09-12T00:34:35.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.574+0000 7fd56a0119c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 to cache LRU end 2024-09-12T00:34:35.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.574+0000 7fd56a0119c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:35.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.574+0000 7fd56a0119c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:35.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.574+0000 7fd56a0119c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 2024-09-12T00:34:35.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.582+0000 7fd56a0119c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T00:34:35.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.582+0000 7fd56a0119c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T00:34:35.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.594+0000 7fd41dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:35.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.598+0000 7fd56a0119c0 20 remove_watcher() i=0 2024-09-12T00:34:35.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.598+0000 7fd56a0119c0 2 removed watcher, disabling cache 2024-09-12T00:34:35.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.598+0000 7fd56a0119c0 20 remove_watcher() i=1 2024-09-12T00:34:35.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.602+0000 7fd56a0119c0 20 remove_watcher() i=2 2024-09-12T00:34:35.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.602+0000 7fd56a0119c0 20 remove_watcher() i=3 2024-09-12T00:34:35.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.606+0000 7fd56a0119c0 20 remove_watcher() i=4 2024-09-12T00:34:35.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.606+0000 7fd56a0119c0 20 remove_watcher() i=5 2024-09-12T00:34:35.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.610+0000 7fd56a0119c0 20 remove_watcher() i=6 2024-09-12T00:34:35.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.614+0000 7fd56a0119c0 20 remove_watcher() i=7 2024-09-12T00:34:35.626 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:34:35.655 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:35.656 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:35.701 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.706+0000 7f28875389c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.706+0000 7f28875389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.706+0000 7f28875389c0 20 realm 2024-09-12T00:34:35.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.706+0000 7f28875389c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.710+0000 7f28875389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.710+0000 7f28875389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:35.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.710+0000 7f28875389c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.710+0000 7f28875389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.710+0000 7f28875389c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.710+0000 7f28875389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:35.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.710+0000 7f28875389c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.710+0000 7f28875389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:35.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.710+0000 7f28875389c0 20 searching for the correct realm 2024-09-12T00:34:35.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.714+0000 7f288583f640 0 -- 172.21.15.138:0/2311706962 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55b238d88990 msgr2=0x55b238d8ae50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:35.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.722+0000 7f288583f640 0 -- 172.21.15.138:0/2311706962 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x55b238d7c160 msgr2=0x55b238d7e5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:35.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:35.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:35.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:35.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:35.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:35.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:35.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:35.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:35.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 zone default found 2024-09-12T00:34:35.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 4 Realm: () 2024-09-12T00:34:35.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:35.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:35.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:35.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 zonegroup default 2024-09-12T00:34:35.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.730+0000 7f28875389c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.734+0000 7f28875389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.734+0000 7f28875389c0 20 started sync module instance, tier type = 2024-09-12T00:34:35.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.734+0000 7f28875389c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:35.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.750+0000 7f28875389c0 20 add_watcher() i=0 2024-09-12T00:34:35.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.750+0000 7f28875389c0 20 add_watcher() i=1 2024-09-12T00:34:35.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.750+0000 7f28875389c0 20 add_watcher() i=2 2024-09-12T00:34:35.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.750+0000 7f28875389c0 20 add_watcher() i=3 2024-09-12T00:34:35.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.750+0000 7f28875389c0 20 add_watcher() i=4 2024-09-12T00:34:35.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.750+0000 7f28875389c0 20 add_watcher() i=5 2024-09-12T00:34:35.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.750+0000 7f28875389c0 20 add_watcher() i=6 2024-09-12T00:34:35.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.754+0000 7f28875389c0 20 add_watcher() i=7 2024-09-12T00:34:35.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.754+0000 7f28875389c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:35.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.758+0000 7f273b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:35.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.758+0000 7f28875389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:35.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.758+0000 7f28875389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:35.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.758+0000 7f28875389c0 5 note: GC not initialized 2024-09-12T00:34:35.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.758+0000 7f273a7e4640 20 reqs_thread_entry: start 2024-09-12T00:34:35.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.758+0000 7f28875389c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:35.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.758+0000 7f28875389c0 20 Filter name: none 2024-09-12T00:34:35.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.758+0000 7f26abfff640 20 reqs_thread_entry: start 2024-09-12T00:34:35.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.758+0000 7f28875389c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.758+0000 7f28875389c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:35.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.758+0000 7f28875389c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.758+0000 7f28875389c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:35.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.758+0000 7f28875389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:35.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.758+0000 7f28875389c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.762+0000 7f28875389c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:35.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.762+0000 7f28875389c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.762+0000 7f28875389c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:35.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.762+0000 7f28875389c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:35.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.762+0000 7f273b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:35.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.766+0000 7f28875389c0 20 remove_watcher() i=0 2024-09-12T00:34:35.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.766+0000 7f28875389c0 2 removed watcher, disabling cache 2024-09-12T00:34:35.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.770+0000 7f28875389c0 20 remove_watcher() i=1 2024-09-12T00:34:35.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.770+0000 7f28875389c0 20 remove_watcher() i=2 2024-09-12T00:34:35.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.774+0000 7f28875389c0 20 remove_watcher() i=3 2024-09-12T00:34:35.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.774+0000 7f28875389c0 20 remove_watcher() i=4 2024-09-12T00:34:35.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.778+0000 7f28875389c0 20 remove_watcher() i=5 2024-09-12T00:34:35.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.782+0000 7f28875389c0 20 remove_watcher() i=6 2024-09-12T00:34:35.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.782+0000 7f28875389c0 20 remove_watcher() i=7 2024-09-12T00:34:35.794 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:35.794 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:34:35.795 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-set-target-layout id: e2043445-c131-4520-984d-b4d52f038a6b.4538.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:34:35.795 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:35.795 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:35.796 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:35.811 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:35.811 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:35.857 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:34:35.889 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:35.889 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:35.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.938+0000 7f930694e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.938+0000 7f930694e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.938+0000 7f930694e9c0 20 realm 2024-09-12T00:34:35.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.938+0000 7f930694e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.938+0000 7f930694e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.938+0000 7f930694e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:35.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.938+0000 7f930694e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.938+0000 7f930694e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.938+0000 7f930694e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.942+0000 7f930694e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:35.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.942+0000 7f930694e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.942+0000 7f930694e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:35.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.942+0000 7f930694e9c0 20 searching for the correct realm 2024-09-12T00:34:35.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.946+0000 7f9304c55640 0 -- 172.21.15.138:0/1007248364 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55d14bb89d10 msgr2=0x55d14bb8c1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:35.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.954+0000 7f9303c53640 0 -- 172.21.15.138:0/1007248364 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55d14bb84f70 msgr2=0x55d14bb87360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:35.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.958+0000 7f930694e9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:35.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.958+0000 7f930694e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:35.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.958+0000 7f930694e9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:35.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.958+0000 7f930694e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:35.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.958+0000 7f930694e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:35.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.958+0000 7f930694e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:35.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.958+0000 7f930694e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:35.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:35.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 20 zone default found 2024-09-12T00:34:35.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 4 Realm: () 2024-09-12T00:34:35.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:35.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:35.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:35.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 20 zonegroup default 2024-09-12T00:34:35.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:35.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 20 started sync module instance, tier type = 2024-09-12T00:34:35.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.962+0000 7f930694e9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:35.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.982+0000 7f930694e9c0 20 add_watcher() i=0 2024-09-12T00:34:35.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.982+0000 7f930694e9c0 20 add_watcher() i=1 2024-09-12T00:34:35.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.982+0000 7f930694e9c0 20 add_watcher() i=2 2024-09-12T00:34:35.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.982+0000 7f930694e9c0 20 add_watcher() i=3 2024-09-12T00:34:35.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.982+0000 7f930694e9c0 20 add_watcher() i=4 2024-09-12T00:34:35.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.982+0000 7f930694e9c0 20 add_watcher() i=5 2024-09-12T00:34:35.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.982+0000 7f930694e9c0 20 add_watcher() i=6 2024-09-12T00:34:35.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.982+0000 7f930694e9c0 20 add_watcher() i=7 2024-09-12T00:34:35.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.982+0000 7f930694e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:35.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.986+0000 7f91bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:35.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.986+0000 7f930694e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:35.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.986+0000 7f930694e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:35.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.986+0000 7f930694e9c0 5 note: GC not initialized 2024-09-12T00:34:35.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.986+0000 7f91b9fdb640 20 reqs_thread_entry: start 2024-09-12T00:34:35.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.986+0000 7f930694e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:35.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.986+0000 7f930694e9c0 20 Filter name: none 2024-09-12T00:34:35.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.986+0000 7f912b7fe640 20 reqs_thread_entry: start 2024-09-12T00:34:35.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.990+0000 7f930694e9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:34:35.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.990+0000 7f930694e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.990+0000 7f930694e9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:35.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.990+0000 7f930694e9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:34:35.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.990+0000 7f930694e9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:34:35.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.990+0000 7f930694e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 : miss 2024-09-12T00:34:35.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.990+0000 7f930694e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:35.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.990+0000 7f930694e9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:35.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.990+0000 7f930694e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 info.flags=0x17 2024-09-12T00:34:35.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.990+0000 7f930694e9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 to cache LRU end 2024-09-12T00:34:35.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.990+0000 7f930694e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:35.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.990+0000 7f930694e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:35.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.990+0000 7f930694e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 2024-09-12T00:34:35.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.998+0000 7f930694e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 info.flags=0x17 2024-09-12T00:34:35.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.998+0000 7f930694e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 to cache LRU end 2024-09-12T00:34:35.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.998+0000 7f930694e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:35.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.998+0000 7f930694e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22, ofs0, ns] 2024-09-12T00:34:35.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.998+0000 7f91db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333523 cookie 94357406919200 notifier 6170 bl.length()=925 2024-09-12T00:34:35.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.998+0000 7f91db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 info.flags=0x17 2024-09-12T00:34:35.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.998+0000 7f91db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 to cache LRU end 2024-09-12T00:34:35.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:35.998+0000 7f91db7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:35.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.002+0000 7f930694e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.22]): orig_sources= new_sources= 2024-09-12T00:34:35.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.002+0000 7f930694e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.22]): potential sources added=[] removed=[] 2024-09-12T00:34:35.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.002+0000 7f930694e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.22]): orig_dests= new_dests= 2024-09-12T00:34:35.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.002+0000 7f930694e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.22]): potential dests added=[] removed=[] 2024-09-12T00:34:36.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.0 2024-09-12T00:34:36.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.0 2024-09-12T00:34:36.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.1 2024-09-12T00:34:36.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.1 2024-09-12T00:34:36.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.2 2024-09-12T00:34:36.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.2 2024-09-12T00:34:36.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.3 2024-09-12T00:34:36.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.3 2024-09-12T00:34:36.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.4 2024-09-12T00:34:36.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.4 2024-09-12T00:34:36.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.5 2024-09-12T00:34:36.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.5 2024-09-12T00:34:36.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.6 2024-09-12T00:34:36.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.6 2024-09-12T00:34:36.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.7 2024-09-12T00:34:36.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.7 2024-09-12T00:34:36.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.8 2024-09-12T00:34:36.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.8 2024-09-12T00:34:36.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.9 2024-09-12T00:34:36.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.9 2024-09-12T00:34:36.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.10 2024-09-12T00:34:36.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.10 2024-09-12T00:34:36.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.11 2024-09-12T00:34:36.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1.11 2024-09-12T00:34:36.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.010+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.0 2024-09-12T00:34:36.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.014+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1 2024-09-12T00:34:36.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.014+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.2 2024-09-12T00:34:36.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.014+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.3 2024-09-12T00:34:36.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.014+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.4 2024-09-12T00:34:36.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.018+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.5 2024-09-12T00:34:36.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.018+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.6 2024-09-12T00:34:36.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.018+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.7 2024-09-12T00:34:36.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.018+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.8 2024-09-12T00:34:36.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.018+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.9 2024-09-12T00:34:36.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.018+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.10 2024-09-12T00:34:36.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.026+0000 7f930694e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:36.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.026+0000 7f930694e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 2024-09-12T00:34:36.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.030+0000 7f930694e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 info.flags=0x17 2024-09-12T00:34:36.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.030+0000 7f930694e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 to cache LRU end 2024-09-12T00:34:36.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.030+0000 7f930694e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:36.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.030+0000 7f930694e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22, ofs0, ns] 2024-09-12T00:34:36.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.030+0000 7f91db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333524 cookie 94357406919200 notifier 6170 bl.length()=925 2024-09-12T00:34:36.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.030+0000 7f91db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 info.flags=0x17 2024-09-12T00:34:36.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.030+0000 7f91db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 to cache LRU end 2024-09-12T00:34:36.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.030+0000 7f91db7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:36.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.030+0000 7f930694e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.22]): orig_sources= new_sources= 2024-09-12T00:34:36.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.030+0000 7f930694e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.22]): potential sources added=[] removed=[] 2024-09-12T00:34:36.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.030+0000 7f930694e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.22]): orig_dests= new_dests= 2024-09-12T00:34:36.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.030+0000 7f930694e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.22]): potential dests added=[] removed=[] 2024-09-12T00:34:36.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.034+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.0 2024-09-12T00:34:36.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.034+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.1 2024-09-12T00:34:36.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.034+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.2 2024-09-12T00:34:36.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.038+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.3 2024-09-12T00:34:36.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.038+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.4 2024-09-12T00:34:36.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.038+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.5 2024-09-12T00:34:36.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.038+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.6 2024-09-12T00:34:36.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.038+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.7 2024-09-12T00:34:36.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.038+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.8 2024-09-12T00:34:36.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.038+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.9 2024-09-12T00:34:36.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.042+0000 7f930694e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.22.10 2024-09-12T00:34:36.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.042+0000 7f930694e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:36.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.042+0000 7f930694e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 2024-09-12T00:34:36.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.042+0000 7f930694e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 info.flags=0x17 2024-09-12T00:34:36.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.042+0000 7f930694e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 to cache LRU end 2024-09-12T00:34:36.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.042+0000 7f930694e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:36.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.042+0000 7f930694e9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22, ofs0, ns] 2024-09-12T00:34:36.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.042+0000 7f91db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333525 cookie 94357406919200 notifier 6170 bl.length()=893 2024-09-12T00:34:36.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.042+0000 7f91db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 info.flags=0x17 2024-09-12T00:34:36.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.042+0000 7f91db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.22 to cache LRU end 2024-09-12T00:34:36.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.042+0000 7f91db7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:36.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.042+0000 7f930694e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.22]): orig_sources= new_sources= 2024-09-12T00:34:36.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.046+0000 7f930694e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.22]): potential sources added=[] removed=[] 2024-09-12T00:34:36.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.046+0000 7f930694e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.22]): orig_dests= new_dests= 2024-09-12T00:34:36.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.046+0000 7f930694e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.22]): potential dests added=[] removed=[] 2024-09-12T00:34:36.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.050+0000 7f930694e9c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:34:36.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.054+0000 7f91bafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:36.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.058+0000 7f930694e9c0 20 remove_watcher() i=0 2024-09-12T00:34:36.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.058+0000 7f930694e9c0 2 removed watcher, disabling cache 2024-09-12T00:34:36.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.058+0000 7f930694e9c0 20 remove_watcher() i=1 2024-09-12T00:34:36.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.062+0000 7f930694e9c0 20 remove_watcher() i=2 2024-09-12T00:34:36.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.062+0000 7f930694e9c0 20 remove_watcher() i=3 2024-09-12T00:34:36.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.066+0000 7f930694e9c0 20 remove_watcher() i=4 2024-09-12T00:34:36.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.066+0000 7f930694e9c0 20 remove_watcher() i=5 2024-09-12T00:34:36.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.070+0000 7f930694e9c0 20 remove_watcher() i=6 2024-09-12T00:34:36.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.070+0000 7f930694e9c0 20 remove_watcher() i=7 2024-09-12T00:34:36.082 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:34:36.110 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:36.110 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:36.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.158+0000 7fa74c4d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:36.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.158+0000 7fa74c4d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:36.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.158+0000 7fa74c4d89c0 20 realm 2024-09-12T00:34:36.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.158+0000 7fa74c4d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:36.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.162+0000 7fa74c4d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:36.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.162+0000 7fa74c4d89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:36.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.162+0000 7fa74c4d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:36.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.162+0000 7fa74c4d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:36.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.162+0000 7fa74c4d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:36.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.162+0000 7fa74c4d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:36.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.162+0000 7fa74c4d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:36.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.162+0000 7fa74c4d89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:36.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.162+0000 7fa74c4d89c0 20 searching for the correct realm 2024-09-12T00:34:36.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.166+0000 7fa74a7df640 0 -- 172.21.15.138:0/235525328 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fa74400f940 msgr2=0x7fa74402e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:36.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.382+0000 7fa74a7df640 0 -- 172.21.15.138:0/235525328 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5571a3ff34f0 msgr2=0x5571a3ff59b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:36.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.390+0000 7fa74c4d89c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:36.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.390+0000 7fa74c4d89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:36.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.390+0000 7fa74c4d89c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:36.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.390+0000 7fa74c4d89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:36.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.390+0000 7fa74c4d89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:36.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.390+0000 7fa74c4d89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:36.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.390+0000 7fa74c4d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:36.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.394+0000 7fa74c4d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:36.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.394+0000 7fa74c4d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:36.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.394+0000 7fa74c4d89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:36.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.394+0000 7fa74c4d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:36.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.394+0000 7fa74c4d89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:36.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.394+0000 7fa74c4d89c0 20 zone default found 2024-09-12T00:34:36.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.394+0000 7fa74c4d89c0 4 Realm: () 2024-09-12T00:34:36.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.394+0000 7fa74c4d89c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:36.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.394+0000 7fa74c4d89c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:36.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.394+0000 7fa74c4d89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:36.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.394+0000 7fa74c4d89c0 20 zonegroup default 2024-09-12T00:34:36.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.394+0000 7fa74c4d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:36.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.394+0000 7fa74c4d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:36.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.394+0000 7fa74c4d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:36.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.394+0000 7fa74c4d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:36.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.394+0000 7fa74c4d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:36.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.394+0000 7fa74c4d89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:36.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.398+0000 7fa74c4d89c0 20 started sync module instance, tier type = 2024-09-12T00:34:36.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.398+0000 7fa74c4d89c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:36.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.418+0000 7fa74c4d89c0 20 add_watcher() i=0 2024-09-12T00:34:36.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.418+0000 7fa74c4d89c0 20 add_watcher() i=1 2024-09-12T00:34:36.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.418+0000 7fa74c4d89c0 20 add_watcher() i=2 2024-09-12T00:34:36.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.418+0000 7fa74c4d89c0 20 add_watcher() i=3 2024-09-12T00:34:36.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.418+0000 7fa74c4d89c0 20 add_watcher() i=4 2024-09-12T00:34:36.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.418+0000 7fa74c4d89c0 20 add_watcher() i=5 2024-09-12T00:34:36.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.418+0000 7fa74c4d89c0 20 add_watcher() i=6 2024-09-12T00:34:36.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.422+0000 7fa74c4d89c0 20 add_watcher() i=7 2024-09-12T00:34:36.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.422+0000 7fa74c4d89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:36.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.426+0000 7fa5fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:36.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.426+0000 7fa74c4d89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:36.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.426+0000 7fa74c4d89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:36.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.426+0000 7fa74c4d89c0 5 note: GC not initialized 2024-09-12T00:34:36.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.426+0000 7fa5fa7fc640 20 reqs_thread_entry: start 2024-09-12T00:34:36.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.426+0000 7fa74c4d89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:36.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.426+0000 7fa74c4d89c0 20 Filter name: none 2024-09-12T00:34:36.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.426+0000 7fa56bfff640 20 reqs_thread_entry: start 2024-09-12T00:34:36.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.426+0000 7fa74c4d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:36.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.430+0000 7fa74c4d89c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:36.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.430+0000 7fa74c4d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:36.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.430+0000 7fa74c4d89c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:36.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.430+0000 7fa74c4d89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:36.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.430+0000 7fa74c4d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:36.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.430+0000 7fa74c4d89c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:36.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.430+0000 7fa74c4d89c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:36.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.430+0000 7fa74c4d89c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:36.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.430+0000 7fa74c4d89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:36.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.434+0000 7fa5fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:36.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.438+0000 7fa74c4d89c0 20 remove_watcher() i=0 2024-09-12T00:34:36.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.438+0000 7fa74c4d89c0 2 removed watcher, disabling cache 2024-09-12T00:34:36.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.442+0000 7fa74c4d89c0 20 remove_watcher() i=1 2024-09-12T00:34:36.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.442+0000 7fa74c4d89c0 20 remove_watcher() i=2 2024-09-12T00:34:36.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.446+0000 7fa74c4d89c0 20 remove_watcher() i=3 2024-09-12T00:34:36.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.446+0000 7fa74c4d89c0 20 remove_watcher() i=4 2024-09-12T00:34:36.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.446+0000 7fa74c4d89c0 20 remove_watcher() i=5 2024-09-12T00:34:36.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.450+0000 7fa74c4d89c0 20 remove_watcher() i=6 2024-09-12T00:34:36.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:36.454+0000 7fa74c4d89c0 20 remove_watcher() i=7 2024-09-12T00:34:36.465 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:36.465 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:34:36.465 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-set-target-layout id: e2043445-c131-4520-984d-b4d52f038a6b.4538.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:34:36.465 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:36.467 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.467 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.473 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.473 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.523 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.523 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.566 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T00:34:36.566 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:36.568 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.568 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.590 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.590 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.635 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.636 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.657 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.657 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.677 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.677 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.698 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.698 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.718 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.719 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.741 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.741 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.762 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.762 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.781 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.782 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.802 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.802 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.822 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.822 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.842 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.842 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.863 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.863 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.886 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.886 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.906 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.907 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.930 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.930 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.951 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.952 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.972 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.972 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:36.991 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:36.992 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:37.012 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:37.012 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:37.072 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:37.072 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:37.089 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:34:37.121 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:37.122 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:37.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.170+0000 7fd551d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.174+0000 7fd551d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:37.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.174+0000 7fd551d269c0 20 realm 2024-09-12T00:34:37.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.174+0000 7fd551d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.174+0000 7fd551d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:37.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.174+0000 7fd551d269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:37.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.174+0000 7fd551d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.174+0000 7fd551d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:37.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.174+0000 7fd551d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.174+0000 7fd551d269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:37.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.174+0000 7fd551d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.174+0000 7fd551d269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:37.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.174+0000 7fd551d269c0 20 searching for the correct realm 2024-09-12T00:34:37.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.182+0000 7fd55002d640 0 -- 172.21.15.138:0/1138025237 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fd548023410 msgr2=0x7fd548023890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:34:37.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.398+0000 7fd55002d640 0 -- 172.21.15.138:0/1138025237 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x559e1f173110 msgr2=0x559e1f1755d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:37.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.406+0000 7fd551d269c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:37.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.406+0000 7fd551d269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:37.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.406+0000 7fd551d269c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:37.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.406+0000 7fd551d269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:37.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.406+0000 7fd551d269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:37.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.406+0000 7fd551d269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:37.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.406+0000 7fd551d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.410+0000 7fd551d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:37.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.410+0000 7fd551d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.410+0000 7fd551d269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:37.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.410+0000 7fd551d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.410+0000 7fd551d269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:37.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.410+0000 7fd551d269c0 20 zone default found 2024-09-12T00:34:37.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.410+0000 7fd551d269c0 4 Realm: () 2024-09-12T00:34:37.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.410+0000 7fd551d269c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:37.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.410+0000 7fd551d269c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:37.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.410+0000 7fd551d269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:37.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.410+0000 7fd551d269c0 20 zonegroup default 2024-09-12T00:34:37.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.410+0000 7fd551d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.410+0000 7fd551d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:37.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.410+0000 7fd551d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.410+0000 7fd551d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:37.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.410+0000 7fd551d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.414+0000 7fd551d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:37.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.414+0000 7fd551d269c0 20 started sync module instance, tier type = 2024-09-12T00:34:37.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.414+0000 7fd551d269c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:37.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.434+0000 7fd551d269c0 20 add_watcher() i=0 2024-09-12T00:34:37.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.434+0000 7fd551d269c0 20 add_watcher() i=1 2024-09-12T00:34:37.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.434+0000 7fd551d269c0 20 add_watcher() i=2 2024-09-12T00:34:37.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.434+0000 7fd551d269c0 20 add_watcher() i=3 2024-09-12T00:34:37.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.434+0000 7fd551d269c0 20 add_watcher() i=4 2024-09-12T00:34:37.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.434+0000 7fd551d269c0 20 add_watcher() i=5 2024-09-12T00:34:37.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.434+0000 7fd551d269c0 20 add_watcher() i=6 2024-09-12T00:34:37.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.438+0000 7fd551d269c0 20 add_watcher() i=7 2024-09-12T00:34:37.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.438+0000 7fd551d269c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:37.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.442+0000 7fd405fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:37.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.442+0000 7fd551d269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:37.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.442+0000 7fd551d269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:37.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.442+0000 7fd551d269c0 5 note: GC not initialized 2024-09-12T00:34:37.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.442+0000 7fd404fe1640 20 reqs_thread_entry: start 2024-09-12T00:34:37.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.442+0000 7fd551d269c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:37.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.442+0000 7fd551d269c0 20 Filter name: none 2024-09-12T00:34:37.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.442+0000 7fd37e7fc640 20 reqs_thread_entry: start 2024-09-12T00:34:37.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.442+0000 7fd551d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.446+0000 7fd551d269c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:37.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.446+0000 7fd551d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.446+0000 7fd551d269c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:37.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.446+0000 7fd551d269c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:37.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.446+0000 7fd551d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.446+0000 7fd551d269c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:37.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.446+0000 7fd551d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.446+0000 7fd551d269c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:37.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.446+0000 7fd551d269c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:37.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.450+0000 7fd405fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:37.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.454+0000 7fd551d269c0 20 remove_watcher() i=0 2024-09-12T00:34:37.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.454+0000 7fd551d269c0 2 removed watcher, disabling cache 2024-09-12T00:34:37.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.458+0000 7fd551d269c0 20 remove_watcher() i=1 2024-09-12T00:34:37.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.458+0000 7fd551d269c0 20 remove_watcher() i=2 2024-09-12T00:34:37.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.462+0000 7fd551d269c0 20 remove_watcher() i=3 2024-09-12T00:34:37.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.462+0000 7fd551d269c0 20 remove_watcher() i=4 2024-09-12T00:34:37.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.466+0000 7fd551d269c0 20 remove_watcher() i=5 2024-09-12T00:34:37.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.470+0000 7fd551d269c0 20 remove_watcher() i=6 2024-09-12T00:34:37.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.470+0000 7fd551d269c0 20 remove_watcher() i=7 2024-09-12T00:34:37.483 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:37.483 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:34:37.483 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-set-target-layout id: e2043445-c131-4520-984d-b4d52f038a6b.4538.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:34:37.484 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:37.484 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T00:34:37.519 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:37.519 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:37.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.566+0000 7f4ebf21a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.570+0000 7f4ebf21a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:37.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.570+0000 7f4ebf21a9c0 20 realm 2024-09-12T00:34:37.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.570+0000 7f4ebf21a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.570+0000 7f4ebf21a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:37.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.570+0000 7f4ebf21a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:37.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.570+0000 7f4ebf21a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.570+0000 7f4ebf21a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:37.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.570+0000 7f4ebf21a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.570+0000 7f4ebf21a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:37.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.570+0000 7f4ebf21a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.570+0000 7f4ebf21a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:37.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.570+0000 7f4ebf21a9c0 20 searching for the correct realm 2024-09-12T00:34:37.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.574+0000 7f4ebd521640 0 -- 172.21.15.138:0/760491523 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x55bb3315ff60 msgr2=0x55bb33162420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:37.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.582+0000 7f4ebcd20640 0 -- 172.21.15.138:0/760491523 >> [v2:172.21.15.178:6811/2062234204,v1:172.21.15.178:6813/2062234204] conn(0x7f4eb4075ba0 msgr2=0x7f4eb4085b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:37.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.802+0000 7f4ebf21a9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:37.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.802+0000 7f4ebf21a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:37.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.802+0000 7f4ebf21a9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:37.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.802+0000 7f4ebf21a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:37.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.802+0000 7f4ebf21a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:37.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.802+0000 7f4ebf21a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:37.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.802+0000 7f4ebf21a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.802+0000 7f4ebf21a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:37.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.802+0000 7f4ebf21a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.806+0000 7f4ebf21a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:37.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.806+0000 7f4ebf21a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.806+0000 7f4ebf21a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:37.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.806+0000 7f4ebf21a9c0 20 zone default found 2024-09-12T00:34:37.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.806+0000 7f4ebf21a9c0 4 Realm: () 2024-09-12T00:34:37.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.806+0000 7f4ebf21a9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:37.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.806+0000 7f4ebf21a9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:37.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.806+0000 7f4ebf21a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:37.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.806+0000 7f4ebf21a9c0 20 zonegroup default 2024-09-12T00:34:37.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.806+0000 7f4ebf21a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.806+0000 7f4ebf21a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:37.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.806+0000 7f4ebf21a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.806+0000 7f4ebf21a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:37.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.806+0000 7f4ebf21a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.810+0000 7f4ebf21a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:37.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.810+0000 7f4ebf21a9c0 20 started sync module instance, tier type = 2024-09-12T00:34:37.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.810+0000 7f4ebf21a9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:37.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.830+0000 7f4ebf21a9c0 20 add_watcher() i=0 2024-09-12T00:34:37.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.830+0000 7f4ebf21a9c0 20 add_watcher() i=1 2024-09-12T00:34:37.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.830+0000 7f4ebf21a9c0 20 add_watcher() i=2 2024-09-12T00:34:37.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.830+0000 7f4ebf21a9c0 20 add_watcher() i=3 2024-09-12T00:34:37.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.830+0000 7f4ebf21a9c0 20 add_watcher() i=4 2024-09-12T00:34:37.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.830+0000 7f4ebf21a9c0 20 add_watcher() i=5 2024-09-12T00:34:37.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.830+0000 7f4ebf21a9c0 20 add_watcher() i=6 2024-09-12T00:34:37.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.834+0000 7f4ebf21a9c0 20 add_watcher() i=7 2024-09-12T00:34:37.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.834+0000 7f4ebf21a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:37.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.838+0000 7f4d737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:37.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.838+0000 7f4ebf21a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:37.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.838+0000 7f4ebf21a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:37.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.838+0000 7f4ebf21a9c0 5 note: GC not initialized 2024-09-12T00:34:37.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.838+0000 7f4d727e4640 20 reqs_thread_entry: start 2024-09-12T00:34:37.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.842+0000 7f4ebf21a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:37.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.842+0000 7f4ebf21a9c0 20 Filter name: none 2024-09-12T00:34:37.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.842+0000 7f4d6b7fe640 20 reqs_thread_entry: start 2024-09-12T00:34:37.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.842+0000 7f4ebf21a9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:34:37.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.842+0000 7f4ebf21a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.842+0000 7f4ebf21a9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:37.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.842+0000 7f4ebf21a9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:34:37.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.842+0000 7f4ebf21a9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:34:37.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.842+0000 7f4ebf21a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 : miss 2024-09-12T00:34:37.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.842+0000 7f4ebf21a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:37.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.842+0000 7f4ebf21a9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:37.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.842+0000 7f4ebf21a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 info.flags=0x17 2024-09-12T00:34:37.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.842+0000 7f4ebf21a9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 to cache LRU end 2024-09-12T00:34:37.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.842+0000 7f4ebf21a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:37.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.842+0000 7f4ebf21a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:37.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.842+0000 7f4ebf21a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 2024-09-12T00:34:37.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.850+0000 7f4ebf21a9c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T00:34:37.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.854+0000 7f4ebf21a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 info.flags=0x17 2024-09-12T00:34:37.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.854+0000 7f4ebf21a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 to cache LRU end 2024-09-12T00:34:37.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.854+0000 7f4ebf21a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:37.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.854+0000 7f4ebf21a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23, ofs0, ns] 2024-09-12T00:34:37.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.854+0000 7f4d937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333528 cookie 94262504390448 notifier 6597 bl.length()=925 2024-09-12T00:34:37.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.854+0000 7f4d937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 info.flags=0x17 2024-09-12T00:34:37.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.854+0000 7f4d937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 to cache LRU end 2024-09-12T00:34:37.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.854+0000 7f4d937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:37.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.854+0000 7f4ebf21a9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.23]): orig_sources= new_sources= 2024-09-12T00:34:37.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.854+0000 7f4ebf21a9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.23]): potential sources added=[] removed=[] 2024-09-12T00:34:37.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.854+0000 7f4ebf21a9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.23]): orig_dests= new_dests= 2024-09-12T00:34:37.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.854+0000 7f4ebf21a9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.23]): potential dests added=[] removed=[] 2024-09-12T00:34:37.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.0 2024-09-12T00:34:37.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.0 2024-09-12T00:34:37.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.1 2024-09-12T00:34:37.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.1 2024-09-12T00:34:37.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.2 2024-09-12T00:34:37.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.2 2024-09-12T00:34:37.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.3 2024-09-12T00:34:37.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.3 2024-09-12T00:34:37.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.4 2024-09-12T00:34:37.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.4 2024-09-12T00:34:37.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.5 2024-09-12T00:34:37.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.5 2024-09-12T00:34:37.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.6 2024-09-12T00:34:37.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.6 2024-09-12T00:34:37.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.7 2024-09-12T00:34:37.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.7 2024-09-12T00:34:37.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.8 2024-09-12T00:34:37.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.8 2024-09-12T00:34:37.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.9 2024-09-12T00:34:37.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.9 2024-09-12T00:34:37.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.10 2024-09-12T00:34:37.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.10 2024-09-12T00:34:37.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.11 2024-09-12T00:34:37.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1.11 2024-09-12T00:34:37.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.0 2024-09-12T00:34:37.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1 2024-09-12T00:34:37.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.866+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.2 2024-09-12T00:34:37.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.870+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.3 2024-09-12T00:34:37.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.870+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.4 2024-09-12T00:34:37.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.870+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.5 2024-09-12T00:34:37.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.870+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.6 2024-09-12T00:34:37.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.874+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.7 2024-09-12T00:34:37.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.874+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.8 2024-09-12T00:34:37.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.874+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.9 2024-09-12T00:34:37.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.874+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.10 2024-09-12T00:34:37.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.882+0000 7f4ebf21a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:37.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.882+0000 7f4ebf21a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 2024-09-12T00:34:37.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.882+0000 7f4ebf21a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 info.flags=0x17 2024-09-12T00:34:37.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.882+0000 7f4ebf21a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 to cache LRU end 2024-09-12T00:34:37.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.882+0000 7f4ebf21a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:37.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.882+0000 7f4ebf21a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23, ofs0, ns] 2024-09-12T00:34:37.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.886+0000 7f4d937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333529 cookie 94262504390448 notifier 6597 bl.length()=925 2024-09-12T00:34:37.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.886+0000 7f4d937fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 info.flags=0x17 2024-09-12T00:34:37.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.886+0000 7f4d937fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 to cache LRU end 2024-09-12T00:34:37.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.886+0000 7f4d937fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:37.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.886+0000 7f4ebf21a9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.23]): orig_sources= new_sources= 2024-09-12T00:34:37.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.886+0000 7f4ebf21a9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.23]): potential sources added=[] removed=[] 2024-09-12T00:34:37.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.886+0000 7f4ebf21a9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.23]): orig_dests= new_dests= 2024-09-12T00:34:37.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.886+0000 7f4ebf21a9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.23]): potential dests added=[] removed=[] 2024-09-12T00:34:37.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.890+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.0 2024-09-12T00:34:37.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.890+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.1 2024-09-12T00:34:37.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.894+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.2 2024-09-12T00:34:37.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.894+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.3 2024-09-12T00:34:37.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.894+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.4 2024-09-12T00:34:37.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.894+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.5 2024-09-12T00:34:37.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.894+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.6 2024-09-12T00:34:37.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.898+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.7 2024-09-12T00:34:37.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.898+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.8 2024-09-12T00:34:37.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.898+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.9 2024-09-12T00:34:37.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.898+0000 7f4ebf21a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.23.10 2024-09-12T00:34:37.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.898+0000 7f4ebf21a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:37.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.898+0000 7f4ebf21a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 2024-09-12T00:34:37.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.902+0000 7f4ebf21a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 info.flags=0x17 2024-09-12T00:34:37.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.902+0000 7f4ebf21a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 to cache LRU end 2024-09-12T00:34:37.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.902+0000 7f4ebf21a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:37.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.902+0000 7f4ebf21a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23, ofs0, ns] 2024-09-12T00:34:37.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.902+0000 7f4d93fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333530 cookie 94262504390448 notifier 6597 bl.length()=893 2024-09-12T00:34:37.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.902+0000 7f4d93fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 info.flags=0x17 2024-09-12T00:34:37.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.902+0000 7f4d93fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.23 to cache LRU end 2024-09-12T00:34:37.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.902+0000 7f4d93fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:37.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.902+0000 7f4ebf21a9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.23]): orig_sources= new_sources= 2024-09-12T00:34:37.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.902+0000 7f4ebf21a9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.23]): potential sources added=[] removed=[] 2024-09-12T00:34:37.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.902+0000 7f4ebf21a9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.23]): orig_dests= new_dests= 2024-09-12T00:34:37.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.902+0000 7f4ebf21a9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.23]): potential dests added=[] removed=[] 2024-09-12T00:34:37.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.910+0000 7f4ebf21a9c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:34:37.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.910+0000 7f4d737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:37.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.918+0000 7f4ebf21a9c0 20 remove_watcher() i=0 2024-09-12T00:34:37.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.918+0000 7f4ebf21a9c0 2 removed watcher, disabling cache 2024-09-12T00:34:37.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.918+0000 7f4ebf21a9c0 20 remove_watcher() i=1 2024-09-12T00:34:37.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.922+0000 7f4ebf21a9c0 20 remove_watcher() i=2 2024-09-12T00:34:37.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.922+0000 7f4ebf21a9c0 20 remove_watcher() i=3 2024-09-12T00:34:37.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.926+0000 7f4ebf21a9c0 20 remove_watcher() i=4 2024-09-12T00:34:37.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.926+0000 7f4ebf21a9c0 20 remove_watcher() i=5 2024-09-12T00:34:37.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.930+0000 7f4ebf21a9c0 20 remove_watcher() i=6 2024-09-12T00:34:37.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:37.930+0000 7f4ebf21a9c0 20 remove_watcher() i=7 2024-09-12T00:34:37.943 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:34:37.973 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:37.973 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:38.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.018+0000 7fd6f73a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:38.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.022+0000 7fd6f73a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:38.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.022+0000 7fd6f73a19c0 20 realm 2024-09-12T00:34:38.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.022+0000 7fd6f73a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:38.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.022+0000 7fd6f73a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:38.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.022+0000 7fd6f73a19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:38.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.022+0000 7fd6f73a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:38.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.022+0000 7fd6f73a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:38.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.022+0000 7fd6f73a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:38.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.022+0000 7fd6f73a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:38.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.022+0000 7fd6f73a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:38.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.022+0000 7fd6f73a19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:38.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.022+0000 7fd6f73a19c0 20 searching for the correct realm 2024-09-12T00:34:38.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.030+0000 7fd6f56a8640 0 -- 172.21.15.138:0/3408438477 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fd6ec1138b0 msgr2=0x7fd6ec0c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:34:38.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.246+0000 7fd6f56a8640 0 -- 172.21.15.138:0/3408438477 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5608b4617170 msgr2=0x5608b4619610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:38.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.254+0000 7fd6f73a19c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:38.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.254+0000 7fd6f73a19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:38.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.254+0000 7fd6f73a19c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:38.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.254+0000 7fd6f73a19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:38.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.254+0000 7fd6f73a19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:38.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.254+0000 7fd6f73a19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:38.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.254+0000 7fd6f73a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:38.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.254+0000 7fd6f73a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:38.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.254+0000 7fd6f73a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:38.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.258+0000 7fd6f73a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:38.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.258+0000 7fd6f73a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:38.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.258+0000 7fd6f73a19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:38.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.258+0000 7fd6f73a19c0 20 zone default found 2024-09-12T00:34:38.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.258+0000 7fd6f73a19c0 4 Realm: () 2024-09-12T00:34:38.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.258+0000 7fd6f73a19c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:38.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.258+0000 7fd6f73a19c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:38.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.258+0000 7fd6f73a19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:38.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.258+0000 7fd6f73a19c0 20 zonegroup default 2024-09-12T00:34:38.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.258+0000 7fd6f73a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:38.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.258+0000 7fd6f73a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:38.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.258+0000 7fd6f73a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:38.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.258+0000 7fd6f73a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:38.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.258+0000 7fd6f73a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:38.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.258+0000 7fd6f73a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:38.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.262+0000 7fd6f73a19c0 20 started sync module instance, tier type = 2024-09-12T00:34:38.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.262+0000 7fd6f73a19c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:38.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.282+0000 7fd6f73a19c0 20 add_watcher() i=0 2024-09-12T00:34:38.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.282+0000 7fd6f73a19c0 20 add_watcher() i=1 2024-09-12T00:34:38.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.282+0000 7fd6f73a19c0 20 add_watcher() i=2 2024-09-12T00:34:38.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.282+0000 7fd6f73a19c0 20 add_watcher() i=3 2024-09-12T00:34:38.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.282+0000 7fd6f73a19c0 20 add_watcher() i=4 2024-09-12T00:34:38.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.282+0000 7fd6f73a19c0 20 add_watcher() i=5 2024-09-12T00:34:38.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.282+0000 7fd6f73a19c0 20 add_watcher() i=6 2024-09-12T00:34:38.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.282+0000 7fd6f73a19c0 20 add_watcher() i=7 2024-09-12T00:34:38.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.282+0000 7fd6f73a19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:38.284 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.286+0000 7fd5aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:38.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.290+0000 7fd6f73a19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:38.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.290+0000 7fd6f73a19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:38.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.290+0000 7fd6f73a19c0 5 note: GC not initialized 2024-09-12T00:34:38.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.290+0000 7fd5a9fe3640 20 reqs_thread_entry: start 2024-09-12T00:34:38.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.290+0000 7fd6f73a19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:38.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.290+0000 7fd6f73a19c0 20 Filter name: none 2024-09-12T00:34:38.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.290+0000 7fd51b7fe640 20 reqs_thread_entry: start 2024-09-12T00:34:38.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.290+0000 7fd6f73a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:38.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.290+0000 7fd6f73a19c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:38.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.290+0000 7fd6f73a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:38.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.290+0000 7fd6f73a19c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:38.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.290+0000 7fd6f73a19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:38.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.290+0000 7fd6f73a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:38.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.294+0000 7fd6f73a19c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:38.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.294+0000 7fd6f73a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:38.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.294+0000 7fd6f73a19c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:38.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.294+0000 7fd6f73a19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:38.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.298+0000 7fd5aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:38.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.302+0000 7fd6f73a19c0 20 remove_watcher() i=0 2024-09-12T00:34:38.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.302+0000 7fd6f73a19c0 2 removed watcher, disabling cache 2024-09-12T00:34:38.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.302+0000 7fd6f73a19c0 20 remove_watcher() i=1 2024-09-12T00:34:38.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.306+0000 7fd6f73a19c0 20 remove_watcher() i=2 2024-09-12T00:34:38.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.306+0000 7fd6f73a19c0 20 remove_watcher() i=3 2024-09-12T00:34:38.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.310+0000 7fd6f73a19c0 20 remove_watcher() i=4 2024-09-12T00:34:38.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.310+0000 7fd6f73a19c0 20 remove_watcher() i=5 2024-09-12T00:34:38.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.314+0000 7fd6f73a19c0 20 remove_watcher() i=6 2024-09-12T00:34:38.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:38.318+0000 7fd6f73a19c0 20 remove_watcher() i=7 2024-09-12T00:34:38.330 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:38.330 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:34:38.330 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-set-target-layout id: e2043445-c131-4520-984d-b4d52f038a6b.4538.23 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:34:38.330 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:38.332 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.332 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.335 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.336 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.390 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.391 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.438 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T00:34:38.438 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:38.440 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.440 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.460 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.460 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.508 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.508 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.529 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.529 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.550 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.550 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.571 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.571 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.592 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.592 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.613 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.613 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.637 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.638 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.659 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.659 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.680 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.681 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.706 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.706 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.729 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.729 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.750 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.750 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.772 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.772 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.792 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.793 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.813 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.814 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.834 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.835 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.856 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.856 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.877 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.877 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.899 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.899 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.920 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:38.920 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:38.938 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:34:38.972 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:38.972 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:39.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.022+0000 7f667c5699c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.026+0000 7f667c5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.026+0000 7f667c5699c0 20 realm 2024-09-12T00:34:39.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.026+0000 7f667c5699c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.026+0000 7f667c5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.026+0000 7f667c5699c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:39.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.026+0000 7f667c5699c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.026+0000 7f667c5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.026+0000 7f667c5699c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.026+0000 7f667c5699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:39.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.026+0000 7f667c5699c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.026+0000 7f667c5699c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:39.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.026+0000 7f667c5699c0 20 searching for the correct realm 2024-09-12T00:34:39.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.030+0000 7f667a870640 0 -- 172.21.15.138:0/188936981 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5606f8086b60 msgr2=0x5606f8089020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:39.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.038+0000 7f667986e640 0 -- 172.21.15.138:0/188936981 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x5606f8081df0 msgr2=0x5606f80841e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:39.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:39.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:39.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 zone default found 2024-09-12T00:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 4 Realm: () 2024-09-12T00:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 zonegroup default 2024-09-12T00:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.046+0000 7f667c5699c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.050+0000 7f667c5699c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.050+0000 7f667c5699c0 20 started sync module instance, tier type = 2024-09-12T00:34:39.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.050+0000 7f667c5699c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:39.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.066+0000 7f667c5699c0 20 add_watcher() i=0 2024-09-12T00:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.066+0000 7f667c5699c0 20 add_watcher() i=1 2024-09-12T00:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.066+0000 7f667c5699c0 20 add_watcher() i=2 2024-09-12T00:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.066+0000 7f667c5699c0 20 add_watcher() i=3 2024-09-12T00:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.066+0000 7f667c5699c0 20 add_watcher() i=4 2024-09-12T00:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.066+0000 7f667c5699c0 20 add_watcher() i=5 2024-09-12T00:34:39.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.066+0000 7f667c5699c0 20 add_watcher() i=6 2024-09-12T00:34:39.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.070+0000 7f667c5699c0 20 add_watcher() i=7 2024-09-12T00:34:39.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.070+0000 7f667c5699c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:39.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.074+0000 7f6530fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:39.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.074+0000 7f667c5699c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.074+0000 7f667c5699c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.074+0000 7f667c5699c0 5 note: GC not initialized 2024-09-12T00:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.074+0000 7f64ab7fe640 20 reqs_thread_entry: start 2024-09-12T00:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.074+0000 7f667c5699c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.074+0000 7f667c5699c0 20 Filter name: none 2024-09-12T00:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.074+0000 7f64a97fa640 20 reqs_thread_entry: start 2024-09-12T00:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.074+0000 7f667c5699c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.074+0000 7f667c5699c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:39.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.074+0000 7f667c5699c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.074+0000 7f667c5699c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:39.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.074+0000 7f667c5699c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:39.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.074+0000 7f667c5699c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.074+0000 7f667c5699c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.074+0000 7f667c5699c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.078+0000 7f667c5699c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:39.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.078+0000 7f667c5699c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:39.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.078+0000 7f6530fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:39.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.082+0000 7f667c5699c0 20 remove_watcher() i=0 2024-09-12T00:34:39.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.082+0000 7f667c5699c0 2 removed watcher, disabling cache 2024-09-12T00:34:39.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.086+0000 7f667c5699c0 20 remove_watcher() i=1 2024-09-12T00:34:39.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.086+0000 7f667c5699c0 20 remove_watcher() i=2 2024-09-12T00:34:39.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.090+0000 7f667c5699c0 20 remove_watcher() i=3 2024-09-12T00:34:39.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.090+0000 7f667c5699c0 20 remove_watcher() i=4 2024-09-12T00:34:39.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.094+0000 7f667c5699c0 20 remove_watcher() i=5 2024-09-12T00:34:39.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.094+0000 7f667c5699c0 20 remove_watcher() i=6 2024-09-12T00:34:39.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.098+0000 7f667c5699c0 20 remove_watcher() i=7 2024-09-12T00:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-set-target-layout id: e2043445-c131-4520-984d-b4d52f038a6b.4538.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.108 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T00:34:39.141 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:39.141 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:39.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.186+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 realm 2024-09-12T00:34:39.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.190+0000 7f7974fa39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:39.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.194+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:39.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.194+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.194+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:39.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.194+0000 7f7974fa39c0 20 searching for the correct realm 2024-09-12T00:34:39.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.198+0000 7f79732aa640 0 -- 172.21.15.138:0/2099929600 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f796c0e5b60 msgr2=0x7f796c11f050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:39.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.414+0000 7f79732aa640 0 -- 172.21.15.138:0/2099929600 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x561f26e699f0 msgr2=0x561f26e6beb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:39.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:39.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:39.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:39.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:39.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:39.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:39.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:39.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:39.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 zone default found 2024-09-12T00:34:39.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.426+0000 7f7974fa39c0 4 Realm: () 2024-09-12T00:34:39.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.426+0000 7f7974fa39c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:39.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.426+0000 7f7974fa39c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:39.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.426+0000 7f7974fa39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:39.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 zonegroup default 2024-09-12T00:34:39.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.430+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.430+0000 7f7974fa39c0 20 started sync module instance, tier type = 2024-09-12T00:34:39.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.430+0000 7f7974fa39c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:39.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=0 2024-09-12T00:34:39.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=1 2024-09-12T00:34:39.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=2 2024-09-12T00:34:39.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=3 2024-09-12T00:34:39.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=4 2024-09-12T00:34:39.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=5 2024-09-12T00:34:39.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=6 2024-09-12T00:34:39.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.454+0000 7f7974fa39c0 20 add_watcher() i=7 2024-09-12T00:34:39.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.454+0000 7f7974fa39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:39.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.458+0000 7f78297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:39.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.458+0000 7f7974fa39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:39.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.458+0000 7f7974fa39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:39.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 note: GC not initialized 2024-09-12T00:34:39.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.458+0000 7f77a3fff640 20 reqs_thread_entry: start 2024-09-12T00:34:39.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:39.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 Filter name: none 2024-09-12T00:34:39.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.462+0000 7f77a1ffb640 20 reqs_thread_entry: start 2024-09-12T00:34:39.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:34:39.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:39.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:34:39.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:34:39.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 : miss 2024-09-12T00:34:39.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:39.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 info.flags=0x17 2024-09-12T00:34:39.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 to cache LRU end 2024-09-12T00:34:39.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:39.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:39.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 2024-09-12T00:34:39.467 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7974fa39c0 time 2024-09-12T00:34:39.474146+0000 2024-09-12T00:34:39.467 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:34:39.468 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:39.468 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f797887d2eb] 2024-09-12T00:34:39.469 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f797887d49f] 2024-09-12T00:34:39.469 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f25524cc1] 2024-09-12T00:34:39.469 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422078) [0x561f25f82078] 2024-09-12T00:34:39.469 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561f25539ced] 2024-09-12T00:34:39.469 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:34:39.469 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f79776e3d90] 2024-09-12T00:34:39.469 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:34:39.469 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:34:39.469 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:34:39.469 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f7974fa39c0 thread_name:radosgw-admin 2024-09-12T00:34:39.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.474+0000 7f7974fa39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7974fa39c0 time 2024-09-12T00:34:39.474146+0000 2024-09-12T00:34:39.469 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:34:39.470 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.470 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:39.470 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f797887d2eb] 2024-09-12T00:34:39.470 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f797887d49f] 2024-09-12T00:34:39.470 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f25524cc1] 2024-09-12T00:34:39.470 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422078) [0x561f25f82078] 2024-09-12T00:34:39.470 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561f25539ced] 2024-09-12T00:34:39.470 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:34:39.470 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f79776e3d90] 2024-09-12T00:34:39.470 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:34:39.470 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:34:39.471 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.493 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:39.493 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f79776fc520] 2024-09-12T00:34:39.493 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:34:39.493 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:34:39.493 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:34:39.493 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f797887d345] 2024-09-12T00:34:39.493 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f797887d49f] 2024-09-12T00:34:39.494 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f25524cc1] 2024-09-12T00:34:39.494 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422078) [0x561f25f82078] 2024-09-12T00:34:39.494 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561f25539ced] 2024-09-12T00:34:39.494 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:34:39.494 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f79776e3d90] 2024-09-12T00:34:39.494 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:34:39.494 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:34:39.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.474+0000 7f7974fa39c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:34:39.494 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f7974fa39c0 thread_name:radosgw-admin 2024-09-12T00:34:39.494 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.495 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:39.495 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f79776fc520] 2024-09-12T00:34:39.495 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:34:39.495 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:34:39.495 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:34:39.495 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f797887d345] 2024-09-12T00:34:39.495 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f797887d49f] 2024-09-12T00:34:39.496 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f25524cc1] 2024-09-12T00:34:39.496 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422078) [0x561f25f82078] 2024-09-12T00:34:39.496 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561f25539ced] 2024-09-12T00:34:39.496 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:34:39.496 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f79776e3d90] 2024-09-12T00:34:39.496 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:34:39.497 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:34:39.497 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:34:39.497 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.497 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:34:39.497 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:34:39.166+0000 7f7972aa9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.497 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:34:39.166+0000 7f7972aa9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.498 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:34:39.166+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.498 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:34:39.166+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.498 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:34:39.166+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.498 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:34:39.166+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.498 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:34:39.166+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.498 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:34:39.166+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.499 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:34:39.166+0000 7f79722a8640 10 monclient(hunting): get_auth_request con 0x561f26cb8b00 auth_method 0 2024-09-12T00:34:39.499 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:34:39.166+0000 7f79722a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.499 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:34:39.166+0000 7f79722a8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.499 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:34:39.166+0000 7f79722a8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.499 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:34:39.166+0000 7f7972aa9640 10 monclient(hunting): handle_auth_done global_id 6639 payload 274 2024-09-12T00:34:39.499 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:34:39.166+0000 7f7972aa9640 10 monclient: _finish_hunting 0 2024-09-12T00:34:39.500 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:34:39.166+0000 7f7972aa9640 1 monclient: found mon.noname-a 2024-09-12T00:34:39.500 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:34:39.166+0000 7f7972aa9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:34:39.500 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.500 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:39.500 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: dump: 2024-09-12T00:34:39.500 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.501 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.501 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.501 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.501 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.501 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.501 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.502 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.502 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.502 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.502 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: _finish_auth 0 2024-09-12T00:34:39.502 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: _check_auth_tickets 2024-09-12T00:34:39.502 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:39.503 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.503 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:39.503 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: dump: 2024-09-12T00:34:39.504 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.504 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.504 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.504 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.504 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.504 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.504 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.504 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.505 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.505 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.505 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 monclient: authenticate success, global_id 6639 2024-09-12T00:34:39.505 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 10 monclient: get_monmap_and_config success 2024-09-12T00:34:39.505 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 4 set_mon_vals no callback set 2024-09-12T00:34:39.505 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 10 monclient: shutdown 2024-09-12T00:34:39.505 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 asok(0x561f26b692b0) unregister_commands rotate-key 2024-09-12T00:34:39.505 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 10 monclient: build_initial_monmap 2024-09-12T00:34:39.505 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:39.505 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 10 monclient: monmap: 2024-09-12T00:34:39.505 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:34:39.505 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:39.505 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:34:39.506 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:34:39.506 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:39.506 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.506 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:34:39.506 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:34:39.506 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:34:39.506 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.506 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding auth protocol: cephx 2024-09-12T00:34:39.506 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding auth protocol: cephx 2024-09-12T00:34:39.506 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding auth protocol: cephx 2024-09-12T00:34:39.506 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: secure 2024-09-12T00:34:39.506 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: crc 2024-09-12T00:34:39.507 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: secure 2024-09-12T00:34:39.507 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: crc 2024-09-12T00:34:39.507 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: secure 2024-09-12T00:34:39.507 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: crc 2024-09-12T00:34:39.507 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: crc 2024-09-12T00:34:39.507 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: secure 2024-09-12T00:34:39.507 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: crc 2024-09-12T00:34:39.507 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: secure 2024-09-12T00:34:39.507 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: crc 2024-09-12T00:34:39.507 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: secure 2024-09-12T00:34:39.507 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.507 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 1 librados: starting msgr at 2024-09-12T00:34:39.508 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 1 librados: starting objecter 2024-09-12T00:34:39.508 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command objecter_requests hook 0x561f26b44430 2024-09-12T00:34:39.508 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 1 librados: setting wanted keys 2024-09-12T00:34:39.508 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 1 librados: calling monclient init 2024-09-12T00:34:39.508 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient: init 2024-09-12T00:34:39.508 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding auth protocol: cephx 2024-09-12T00:34:39.508 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding auth protocol: cephx 2024-09-12T00:34:39.508 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding auth protocol: cephx 2024-09-12T00:34:39.508 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: secure 2024-09-12T00:34:39.508 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: crc 2024-09-12T00:34:39.508 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: secure 2024-09-12T00:34:39.508 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: crc 2024-09-12T00:34:39.509 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: secure 2024-09-12T00:34:39.509 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: crc 2024-09-12T00:34:39.509 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: crc 2024-09-12T00:34:39.509 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: secure 2024-09-12T00:34:39.509 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: crc 2024-09-12T00:34:39.509 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: secure 2024-09-12T00:34:39.509 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: crc 2024-09-12T00:34:39.509 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: secure 2024-09-12T00:34:39.509 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.509 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.509 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command rotate-key hook 0x561f26d74758 2024-09-12T00:34:39.509 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:39.509 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:34:39.510 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-b con 0x561f26c235b0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:34:39.510 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-c con 0x561f26cb8b00 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:34:39.510 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-a con 0x561f26cbbd10 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:34:39.510 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.510 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.510 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.510 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:39.510 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient(hunting): authenticate will time out at 2132.512933s 2024-09-12T00:34:39.510 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient(hunting): get_auth_request con 0x561f26cbbd10 auth_method 0 2024-09-12T00:34:39.510 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.510 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.510 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.510 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:34:39.170+0000 7f79722a8640 10 monclient(hunting): get_auth_request con 0x561f26cb8b00 auth_method 0 2024-09-12T00:34:39.511 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:34:39.170+0000 7f79722a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.511 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:34:39.170+0000 7f79722a8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.511 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:34:39.170+0000 7f79722a8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.511 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.511 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.511 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.511 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:34:39.170+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.511 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:34:39.170+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.511 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:34:39.170+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.511 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:34:39.170+0000 7f7972aa9640 10 monclient(hunting): get_auth_request con 0x561f26c235b0 auth_method 0 2024-09-12T00:34:39.511 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:34:39.170+0000 7f7972aa9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.511 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:34:39.170+0000 7f7972aa9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.511 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:34:39.170+0000 7f7972aa9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.512 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient(hunting): handle_auth_done global_id 6642 payload 824 2024-09-12T00:34:39.512 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient: _finish_hunting 0 2024-09-12T00:34:39.512 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:34:39.170+0000 7f79732aa640 1 monclient: found mon.noname-a 2024-09-12T00:34:39.512 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:34:39.512 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.512 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:39.512 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: dump: 2024-09-12T00:34:39.512 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.512 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.512 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.512 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.513 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.513 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.513 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.513 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.513 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.513 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.513 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: _finish_auth 0 2024-09-12T00:34:39.513 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: _check_auth_tickets 2024-09-12T00:34:39.513 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:39.513 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.513 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:39.513 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: dump: 2024-09-12T00:34:39.513 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.514 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.514 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.514 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.514 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.514 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.514 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.514 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.514 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.514 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.514 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 monclient: authenticate success, global_id 6642 2024-09-12T00:34:39.514 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient: _renew_subs 2024-09-12T00:34:39.514 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:34:39.170+0000 7f7860e09640 4 set_mon_vals no callback set 2024-09-12T00:34:39.514 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:34:39.515 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient: _renew_subs 2024-09-12T00:34:39.515 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:34:39.515 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 1 librados: init done 2024-09-12T00:34:39.515 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:34:39.170+0000 7f785f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:39.515 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:34:39.170+0000 7f785f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:39.515 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:34:39.170+0000 7f785f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:39.515 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:34:39.174+0000 7f7972aa9640 10 monclient: get_auth_request con 0x7f7858070b10 auth_method 0 2024-09-12T00:34:39.515 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:34:39.174+0000 7f79722a8640 10 monclient: get_auth_request con 0x561f26dbc410 auth_method 0 2024-09-12T00:34:39.515 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:34:39.174+0000 7f7972aa9640 10 monclient: get_auth_request con 0x561f26dbf250 auth_method 0 2024-09-12T00:34:39.515 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:34:39.174+0000 7f79722a8640 10 monclient: get_auth_request con 0x561f26dc3440 auth_method 0 2024-09-12T00:34:39.515 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: build_initial_monmap 2024-09-12T00:34:39.515 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:39.515 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: monmap: 2024-09-12T00:34:39.515 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:34:39.516 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:39.516 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:34:39.516 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:34:39.516 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:39.516 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.516 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:34:39.516 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:34:39.516 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:34:39.516 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.516 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding auth protocol: cephx 2024-09-12T00:34:39.516 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding auth protocol: cephx 2024-09-12T00:34:39.516 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding auth protocol: cephx 2024-09-12T00:34:39.517 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: secure 2024-09-12T00:34:39.517 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: crc 2024-09-12T00:34:39.517 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: secure 2024-09-12T00:34:39.517 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: crc 2024-09-12T00:34:39.517 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: secure 2024-09-12T00:34:39.517 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: crc 2024-09-12T00:34:39.517 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: crc 2024-09-12T00:34:39.517 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: secure 2024-09-12T00:34:39.517 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: crc 2024-09-12T00:34:39.517 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: secure 2024-09-12T00:34:39.517 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: crc 2024-09-12T00:34:39.517 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: secure 2024-09-12T00:34:39.517 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.518 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command objecter_requests cmddesc objecter_requests hook 0x561f26dcbc00 EEXIST 2024-09-12T00:34:39.518 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: init 2024-09-12T00:34:39.518 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding auth protocol: cephx 2024-09-12T00:34:39.518 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding auth protocol: cephx 2024-09-12T00:34:39.518 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding auth protocol: cephx 2024-09-12T00:34:39.518 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: secure 2024-09-12T00:34:39.518 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: crc 2024-09-12T00:34:39.518 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: secure 2024-09-12T00:34:39.518 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: crc 2024-09-12T00:34:39.518 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: secure 2024-09-12T00:34:39.518 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: crc 2024-09-12T00:34:39.518 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: crc 2024-09-12T00:34:39.518 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: secure 2024-09-12T00:34:39.519 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: crc 2024-09-12T00:34:39.519 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: secure 2024-09-12T00:34:39.519 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: crc 2024-09-12T00:34:39.519 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: secure 2024-09-12T00:34:39.519 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.519 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.519 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command rotate-key cmddesc rotate-key hook 0x561f26dc6a00 EEXIST 2024-09-12T00:34:39.519 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:39.519 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:34:39.519 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-b con 0x561f26defdb0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:34:39.519 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-c con 0x561f26def6e0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:34:39.519 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-a con 0x561f26dee0c0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:34:39.519 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.520 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.520 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.520 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:39.520 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient(hunting): authenticate will time out at 2132.521784s 2024-09-12T00:34:39.520 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient(hunting): get_auth_request con 0x561f26dee0c0 auth_method 0 2024-09-12T00:34:39.520 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.520 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.520 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.520 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:34:39.178+0000 7f79722a8640 10 monclient(hunting): get_auth_request con 0x561f26def6e0 auth_method 0 2024-09-12T00:34:39.520 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:34:39.178+0000 7f79722a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.520 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:34:39.178+0000 7f79722a8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.520 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:34:39.178+0000 7f79722a8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.520 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.521 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.521 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.521 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:34:39.178+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.521 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:34:39.178+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.521 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:34:39.178+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.521 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient(hunting): handle_auth_done global_id 6645 payload 824 2024-09-12T00:34:39.521 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient: _finish_hunting 0 2024-09-12T00:34:39.521 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:34:39.178+0000 7f79732aa640 1 monclient: found mon.noname-a 2024-09-12T00:34:39.521 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:34:39.521 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.521 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:39.521 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: dump: 2024-09-12T00:34:39.521 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.522 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.522 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.522 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.522 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.522 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.522 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.522 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.522 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.522 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.522 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: _finish_auth 0 2024-09-12T00:34:39.522 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: _check_auth_tickets 2024-09-12T00:34:39.522 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:39.522 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.522 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:39.523 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: dump: 2024-09-12T00:34:39.523 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.523 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.523 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.523 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.523 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.523 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.523 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.523 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.523 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.523 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.523 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:34:39.178+0000 7f7973aab640 4 set_mon_vals no callback set 2024-09-12T00:34:39.523 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 monclient: authenticate success, global_id 6645 2024-09-12T00:34:39.524 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: _renew_subs 2024-09-12T00:34:39.524 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:34:39.524 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: _renew_subs 2024-09-12T00:34:39.524 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:34:39.524 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:34:39.182+0000 7f785ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:39.524 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:34:39.182+0000 7f785ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:39.524 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:34:39.182+0000 7f785ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:39.524 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient: get_monmap_and_config 2024-09-12T00:34:39.524 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient: build_initial_monmap 2024-09-12T00:34:39.524 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:39.524 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient: monmap: 2024-09-12T00:34:39.524 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:34:39.525 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:39.525 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:34:39.525 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:34:39.525 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:39.525 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.525 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:34:39.525 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:34:39.525 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:34:39.525 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.525 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding auth protocol: cephx 2024-09-12T00:34:39.525 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding auth protocol: cephx 2024-09-12T00:34:39.525 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding auth protocol: cephx 2024-09-12T00:34:39.525 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: secure 2024-09-12T00:34:39.526 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: crc 2024-09-12T00:34:39.526 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: secure 2024-09-12T00:34:39.526 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: crc 2024-09-12T00:34:39.526 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: secure 2024-09-12T00:34:39.526 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: crc 2024-09-12T00:34:39.526 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: crc 2024-09-12T00:34:39.526 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: secure 2024-09-12T00:34:39.526 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: crc 2024-09-12T00:34:39.526 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: secure 2024-09-12T00:34:39.526 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: crc 2024-09-12T00:34:39.526 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: secure 2024-09-12T00:34:39.526 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:34:39.182+0000 7f7972aa9640 10 monclient: get_auth_request con 0x7f784c070a20 auth_method 0 2024-09-12T00:34:39.527 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.528 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient: init 2024-09-12T00:34:39.528 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding auth protocol: cephx 2024-09-12T00:34:39.528 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding auth protocol: cephx 2024-09-12T00:34:39.528 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding auth protocol: cephx 2024-09-12T00:34:39.528 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: secure 2024-09-12T00:34:39.528 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: crc 2024-09-12T00:34:39.528 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: secure 2024-09-12T00:34:39.528 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: crc 2024-09-12T00:34:39.528 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: secure 2024-09-12T00:34:39.528 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: crc 2024-09-12T00:34:39.528 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: crc 2024-09-12T00:34:39.528 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: secure 2024-09-12T00:34:39.529 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: crc 2024-09-12T00:34:39.529 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: secure 2024-09-12T00:34:39.529 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: crc 2024-09-12T00:34:39.529 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: secure 2024-09-12T00:34:39.529 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.529 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.529 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command rotate-key cmddesc rotate-key hook 0x7fff35c5f328 EEXIST 2024-09-12T00:34:39.529 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:39.529 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:34:39.529 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-a con 0x561f26e13380 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:34:39.529 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-b con 0x561f26e3daf0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:34:39.530 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-c con 0x561f26e3eb70 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:34:39.530 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.530 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.530 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.530 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:39.530 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient(hunting): authenticate will time out at 2132.526518s 2024-09-12T00:34:39.530 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:34:39.182+0000 7f7972aa9640 10 monclient(hunting): get_auth_request con 0x561f26e13380 auth_method 0 2024-09-12T00:34:39.530 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:34:39.182+0000 7f7972aa9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.530 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:34:39.182+0000 7f7972aa9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.530 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:34:39.182+0000 7f7972aa9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.530 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient(hunting): get_auth_request con 0x561f26e3eb70 auth_method 0 2024-09-12T00:34:39.530 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.530 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.531 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.531 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.531 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.531 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.531 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:34:39.182+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.531 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:34:39.182+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.531 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:34:39.182+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.531 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:34:39.182+0000 7f79722a8640 10 monclient(hunting): get_auth_request con 0x561f26e3daf0 auth_method 0 2024-09-12T00:34:39.531 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:34:39.182+0000 7f79722a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.531 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:34:39.182+0000 7f79722a8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.531 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:34:39.182+0000 7f79722a8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.531 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient(hunting): handle_auth_done global_id 6269 payload 274 2024-09-12T00:34:39.532 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient: _finish_hunting 0 2024-09-12T00:34:39.532 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:34:39.182+0000 7f79732aa640 1 monclient: found mon.noname-c 2024-09-12T00:34:39.532 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:34:39.532 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.532 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:39.532 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: dump: 2024-09-12T00:34:39.532 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.532 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.532 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.532 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.532 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.533 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.533 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.533 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.533 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.533 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.533 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: _finish_auth 0 2024-09-12T00:34:39.533 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: _check_auth_tickets 2024-09-12T00:34:39.533 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:39.533 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 monclient: authenticate success, global_id 6269 2024-09-12T00:34:39.533 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient: get_monmap_and_config success 2024-09-12T00:34:39.533 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 4 set_mon_vals no callback set 2024-09-12T00:34:39.533 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.534 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:39.534 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: dump: 2024-09-12T00:34:39.534 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.534 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.534 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.534 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.534 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.534 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.534 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.534 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.534 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.534 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.534 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient: shutdown 2024-09-12T00:34:39.535 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: build_initial_monmap 2024-09-12T00:34:39.535 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:39.535 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: monmap: 2024-09-12T00:34:39.535 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:34:39.535 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:39.535 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:34:39.535 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:34:39.535 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:39.535 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.535 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:34:39.535 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:34:39.535 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:34:39.535 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.535 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding auth protocol: cephx 2024-09-12T00:34:39.536 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding auth protocol: cephx 2024-09-12T00:34:39.536 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding auth protocol: cephx 2024-09-12T00:34:39.536 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: secure 2024-09-12T00:34:39.536 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: crc 2024-09-12T00:34:39.536 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: secure 2024-09-12T00:34:39.536 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: crc 2024-09-12T00:34:39.536 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: secure 2024-09-12T00:34:39.536 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: crc 2024-09-12T00:34:39.536 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: crc 2024-09-12T00:34:39.536 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: secure 2024-09-12T00:34:39.536 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: crc 2024-09-12T00:34:39.536 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: secure 2024-09-12T00:34:39.536 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: crc 2024-09-12T00:34:39.537 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: secure 2024-09-12T00:34:39.537 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.537 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 1 librados: starting msgr at 2024-09-12T00:34:39.537 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 1 librados: starting objecter 2024-09-12T00:34:39.537 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command objecter_requests cmddesc objecter_requests hook 0x561f26e39e90 EEXIST 2024-09-12T00:34:39.537 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 1 librados: setting wanted keys 2024-09-12T00:34:39.537 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 1 librados: calling monclient init 2024-09-12T00:34:39.537 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: init 2024-09-12T00:34:39.537 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding auth protocol: cephx 2024-09-12T00:34:39.537 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding auth protocol: cephx 2024-09-12T00:34:39.537 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding auth protocol: cephx 2024-09-12T00:34:39.537 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: secure 2024-09-12T00:34:39.538 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: crc 2024-09-12T00:34:39.538 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: secure 2024-09-12T00:34:39.538 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: crc 2024-09-12T00:34:39.538 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: secure 2024-09-12T00:34:39.538 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: crc 2024-09-12T00:34:39.538 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: crc 2024-09-12T00:34:39.538 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: secure 2024-09-12T00:34:39.538 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: crc 2024-09-12T00:34:39.538 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: secure 2024-09-12T00:34:39.538 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: crc 2024-09-12T00:34:39.538 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: secure 2024-09-12T00:34:39.538 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.538 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.539 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command rotate-key cmddesc rotate-key hook 0x561f26df1d18 EEXIST 2024-09-12T00:34:39.539 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:39.539 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:34:39.539 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-c con 0x561f26e13380 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:34:39.539 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-a con 0x561f26e3daf0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:34:39.539 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-b con 0x561f26e3eb70 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:34:39.539 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.539 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.539 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.539 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:39.539 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient(hunting): authenticate will time out at 2132.529104s 2024-09-12T00:34:39.539 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient(hunting): get_auth_request con 0x561f26e13380 auth_method 0 2024-09-12T00:34:39.540 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.540 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.540 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.540 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:34:39.186+0000 7f79722a8640 10 monclient(hunting): get_auth_request con 0x561f26e3daf0 auth_method 0 2024-09-12T00:34:39.540 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:34:39.186+0000 7f79722a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.540 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:34:39.186+0000 7f79722a8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.540 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:34:39.186+0000 7f79722a8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.540 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.540 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.540 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.540 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:34:39.186+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.540 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:34:39.186+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.540 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:34:39.186+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.541 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient(hunting): handle_auth_done global_id 6272 payload 824 2024-09-12T00:34:39.541 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient: _finish_hunting 0 2024-09-12T00:34:39.541 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:34:39.186+0000 7f7972aa9640 1 monclient: found mon.noname-c 2024-09-12T00:34:39.541 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:34:39.541 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.541 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:39.541 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: dump: 2024-09-12T00:34:39.541 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.541 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.541 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.541 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.541 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.542 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.542 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.542 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.542 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.542 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.542 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: _finish_auth 0 2024-09-12T00:34:39.542 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:34:39.542 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:39.542 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.542 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:39.542 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: dump: 2024-09-12T00:34:39.542 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.542 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.542 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.543 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.543 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.543 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.543 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.543 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.543 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.543 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.543 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:34:39.186+0000 7f78567fc640 4 set_mon_vals no callback set 2024-09-12T00:34:39.543 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 monclient: authenticate success, global_id 6272 2024-09-12T00:34:39.543 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: _renew_subs 2024-09-12T00:34:39.543 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:34:39.543 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: _renew_subs 2024-09-12T00:34:39.543 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:34:39.543 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 1 librados: init done 2024-09-12T00:34:39.543 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command cr dump hook 0x561f26e3c608 2024-09-12T00:34:39.544 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.544 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:34:39.190+0000 7f7854ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:39.544 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:34:39.190+0000 7f7854ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:39.544 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:34:39.190+0000 7f7854ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:39.544 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:34:39.190+0000 7f79722a8640 10 monclient: get_auth_request con 0x7f783c070b10 auth_method 0 2024-09-12T00:34:39.544 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:34:39.190+0000 7f79732aa640 10 monclient: get_auth_request con 0x561f26e5d2a0 auth_method 0 2024-09-12T00:34:39.544 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.544 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 realm 2024-09-12T00:34:39.544 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.544 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.544 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:34:39.190+0000 7f7974fa39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:39.544 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.545 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.545 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.545 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:34:39.190+0000 7f7972aa9640 10 monclient: get_auth_request con 0x561f26e61340 auth_method 0 2024-09-12T00:34:39.545 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:34:39.194+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:39.545 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:34:39.194+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.545 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:34:39.194+0000 7f79722a8640 10 monclient: get_auth_request con 0x561f26e64c30 auth_method 0 2024-09-12T00:34:39.545 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:34:39.194+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:39.545 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:34:39.194+0000 7f7974fa39c0 20 searching for the correct realm 2024-09-12T00:34:39.545 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:34:39.194+0000 7f79732aa640 10 monclient: get_auth_request con 0x561f26e699f0 auth_method 0 2024-09-12T00:34:39.545 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:34:39.194+0000 7f7972aa9640 10 monclient: get_auth_request con 0x7f796c11f7b0 auth_method 0 2024-09-12T00:34:39.545 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:34:39.198+0000 7f79722a8640 10 monclient: get_auth_request con 0x7f79640733a0 auth_method 0 2024-09-12T00:34:39.545 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:34:39.198+0000 7f79732aa640 10 monclient: get_auth_request con 0x7f796c0e5b60 auth_method 0 2024-09-12T00:34:39.546 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:34:39.198+0000 7f79732aa640 0 -- 172.21.15.138:0/2099929600 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f796c0e5b60 msgr2=0x7f796c11f050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:39.546 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:34:39.402+0000 7f79732aa640 10 monclient: get_auth_request con 0x7f796c0e5b60 auth_method 0 2024-09-12T00:34:39.546 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:34:39.406+0000 7f7972aa9640 10 monclient: get_auth_request con 0x7f796409dba0 auth_method 0 2024-09-12T00:34:39.546 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:34:39.414+0000 7f79732aa640 0 -- 172.21.15.138:0/2099929600 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x561f26e699f0 msgr2=0x561f26e6beb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:39.546 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:34:39.414+0000 7f7854ff9640 1 client.6272.objecter ms_handle_reset 0x561f26e699f0 session 0x561f26e69370 osd.4 2024-09-12T00:34:39.546 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:34:39.414+0000 7f7854ff9640 10 monclient: _renew_subs 2024-09-12T00:34:39.546 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:34:39.414+0000 7f7854ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:34:39.546 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:34:39.414+0000 7f79732aa640 10 monclient: get_auth_request con 0x7f783c080e30 auth_method 0 2024-09-12T00:34:39.546 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:39.546 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:39.546 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:39.546 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:39.547 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:39.547 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:39.547 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.547 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.547 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.547 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:39.547 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.547 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:39.547 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 zone default found 2024-09-12T00:34:39.547 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 4 Realm: () 2024-09-12T00:34:39.547 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:39.547 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:39.547 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:39.548 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 zonegroup default 2024-09-12T00:34:39.548 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.548 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.548 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.548 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.548 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.548 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:34:39.430+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.548 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:34:39.430+0000 7f7974fa39c0 20 started sync module instance, tier type = 2024-09-12T00:34:39.548 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:34:39.430+0000 7f7974fa39c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:39.548 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=0 2024-09-12T00:34:39.548 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=1 2024-09-12T00:34:39.548 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=2 2024-09-12T00:34:39.549 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=3 2024-09-12T00:34:39.549 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=4 2024-09-12T00:34:39.549 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=5 2024-09-12T00:34:39.549 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=6 2024-09-12T00:34:39.549 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:34:39.454+0000 7f7974fa39c0 20 add_watcher() i=7 2024-09-12T00:34:39.549 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:34:39.454+0000 7f7974fa39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:39.549 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding auth protocol: cephx 2024-09-12T00:34:39.549 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding auth protocol: cephx 2024-09-12T00:34:39.549 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding auth protocol: cephx 2024-09-12T00:34:39.549 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: secure 2024-09-12T00:34:39.549 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: crc 2024-09-12T00:34:39.549 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: secure 2024-09-12T00:34:39.549 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: crc 2024-09-12T00:34:39.549 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: secure 2024-09-12T00:34:39.550 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: crc 2024-09-12T00:34:39.550 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:34:39.458+0000 7f78297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:39.550 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: crc 2024-09-12T00:34:39.550 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: secure 2024-09-12T00:34:39.550 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: crc 2024-09-12T00:34:39.550 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: secure 2024-09-12T00:34:39.550 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: crc 2024-09-12T00:34:39.550 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: secure 2024-09-12T00:34:39.550 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.550 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:39.550 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:39.550 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command cache list hook 0x561f26e3ef70 2024-09-12T00:34:39.550 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command cache inspect hook 0x561f26e3ef70 2024-09-12T00:34:39.551 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command cache erase hook 0x561f26e3ef70 2024-09-12T00:34:39.551 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command cache zap hook 0x561f26e3ef70 2024-09-12T00:34:39.551 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 note: GC not initialized 2024-09-12T00:34:39.551 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:34:39.458+0000 7f77a3fff640 20 reqs_thread_entry: start 2024-09-12T00:34:39.551 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command sync trace show hook 0x7f795c004d30 2024-09-12T00:34:39.551 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command sync trace history hook 0x7f795c004d30 2024-09-12T00:34:39.551 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command sync trace active hook 0x7f795c004d30 2024-09-12T00:34:39.551 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command sync trace active_short hook 0x7f795c004d30 2024-09-12T00:34:39.551 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:39.551 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 Filter name: none 2024-09-12T00:34:39.551 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:34:39.462+0000 7f77a1ffb640 20 reqs_thread_entry: start 2024-09-12T00:34:39.551 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:34:39.551 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.552 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:39.552 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:34:39.552 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:34:39.552 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 : miss 2024-09-12T00:34:39.552 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.552 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:39.552 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 info.flags=0x17 2024-09-12T00:34:39.552 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 to cache LRU end 2024-09-12T00:34:39.552 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:39.552 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:39.552 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 2024-09-12T00:34:39.552 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:34:39.474+0000 7f7974fa39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7974fa39c0 time 2024-09-12T00:34:39.474146+0000 2024-09-12T00:34:39.552 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:34:39.553 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.553 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:39.553 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f797887d2eb] 2024-09-12T00:34:39.553 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f797887d49f] 2024-09-12T00:34:39.553 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f25524cc1] 2024-09-12T00:34:39.553 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422078) [0x561f25f82078] 2024-09-12T00:34:39.553 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561f25539ced] 2024-09-12T00:34:39.553 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:34:39.553 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f79776e3d90] 2024-09-12T00:34:39.553 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:34:39.553 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:34:39.553 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.554 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:34:39.474+0000 7f7974fa39c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:34:39.554 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f7974fa39c0 thread_name:radosgw-admin 2024-09-12T00:34:39.554 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.554 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:39.554 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f79776fc520] 2024-09-12T00:34:39.554 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:34:39.554 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:34:39.554 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:34:39.554 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f797887d345] 2024-09-12T00:34:39.554 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f797887d49f] 2024-09-12T00:34:39.554 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f25524cc1] 2024-09-12T00:34:39.554 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422078) [0x561f25f82078] 2024-09-12T00:34:39.554 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561f25539ced] 2024-09-12T00:34:39.555 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:34:39.555 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f79776e3d90] 2024-09-12T00:34:39.555 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:34:39.555 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:34:39.555 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:34:39.555 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.555 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:34:39.555 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:34:39.555 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:34:39.555 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:34:39.555 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:34:39.556 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:34:39.556 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:34:39.556 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:34:39.556 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:34:39.556 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:34:39.556 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:34:39.556 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:34:39.556 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:34:39.556 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:34:39.556 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:34:39.556 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:34:39.557 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:34:39.557 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:34:39.557 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:34:39.557 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:34:39.557 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:34:39.557 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:34:39.557 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:34:39.557 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:34:39.557 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:34:39.557 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:34:39.557 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:34:39.557 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:34:39.558 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:34:39.558 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:34:39.558 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:34:39.558 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:34:39.558 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:34:39.558 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:34:39.558 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:34:39.558 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:34:39.558 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:34:39.558 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:34:39.558 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:34:39.558 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:34:39.559 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:34:39.559 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:34:39.559 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:34:39.559 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:34:39.559 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:34:39.559 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:34:39.559 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:34:39.559 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:34:39.559 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:34:39.559 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:34:39.559 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:34:39.559 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:34:39.559 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:34:39.559 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:34:39.560 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:34:39.560 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:34:39.560 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:34:39.560 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:34:39.560 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:34:39.560 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:34:39.560 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:34:39.560 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:34:39.560 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:34:39.560 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:34:39.560 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:34:39.560 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:34:39.560 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:34:39.561 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:34:39.561 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:34:39.561 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:34:39.561 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:34:39.561 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:34:39.561 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:34:39.561 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:34:39.561 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:34:39.561 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:34:39.561 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:34:39.561 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:34:39.561 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:34:39.561 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:34:39.562 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:34:39.562 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:34:39.562 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:34:39.562 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:34:39.562 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:34:39.562 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:34:39.562 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:34:39.562 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:34:39.562 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:34:39.562 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:34:39.562 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:34:39.562 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:34:39.563 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:34:39.563 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:34:39.563 INFO:tasks.workunit.client.0.smithi138.stderr: 7f77a1ffb640 / http_manager 2024-09-12T00:34:39.563 INFO:tasks.workunit.client.0.smithi138.stderr: 7f77a3fff640 / http_manager 2024-09-12T00:34:39.563 INFO:tasks.workunit.client.0.smithi138.stderr: 7f78297e2640 / rgw_dt_lg_renew 2024-09-12T00:34:39.563 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7854ff9640 / ms_dispatch 2024-09-12T00:34:39.563 INFO:tasks.workunit.client.0.smithi138.stderr: 7f78567fc640 / io_context_pool 2024-09-12T00:34:39.563 INFO:tasks.workunit.client.0.smithi138.stderr: 7f785ce01640 / ms_dispatch 2024-09-12T00:34:39.563 INFO:tasks.workunit.client.0.smithi138.stderr: 7f785f606640 / ms_dispatch 2024-09-12T00:34:39.563 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7860e09640 / io_context_pool 2024-09-12T00:34:39.563 INFO:tasks.workunit.client.0.smithi138.stderr: 7f79722a8640 / msgr-worker-2 2024-09-12T00:34:39.563 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7972aa9640 / msgr-worker-1 2024-09-12T00:34:39.563 INFO:tasks.workunit.client.0.smithi138.stderr: 7f79732aa640 / msgr-worker-0 2024-09-12T00:34:39.564 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7973aab640 / io_context_pool 2024-09-12T00:34:39.564 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7974fa39c0 / radosgw-admin 2024-09-12T00:34:39.564 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:34:39.564 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:34:39.564 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.91149.log 2024-09-12T00:34:39.564 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:34:39.564 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:34:39.564 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:34:39.166+0000 7f7972aa9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.564 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:34:39.166+0000 7f7972aa9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.564 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:34:39.166+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.564 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:34:39.166+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.564 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:34:39.166+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.565 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:34:39.166+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.565 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:34:39.166+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.565 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:34:39.166+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.565 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:34:39.166+0000 7f79722a8640 10 monclient(hunting): get_auth_request con 0x561f26cb8b00 auth_method 0 2024-09-12T00:34:39.565 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:34:39.166+0000 7f79722a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.565 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:34:39.166+0000 7f79722a8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.565 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:34:39.166+0000 7f79722a8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.565 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:34:39.166+0000 7f7972aa9640 10 monclient(hunting): handle_auth_done global_id 6639 payload 274 2024-09-12T00:34:39.565 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:34:39.166+0000 7f7972aa9640 10 monclient: _finish_hunting 0 2024-09-12T00:34:39.565 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:34:39.166+0000 7f7972aa9640 1 monclient: found mon.noname-a 2024-09-12T00:34:39.565 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:34:39.166+0000 7f7972aa9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:34:39.565 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.565 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:39.566 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: dump: 2024-09-12T00:34:39.566 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.566 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.566 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.566 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.566 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.566 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.566 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.566 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.566 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.566 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.566 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: _finish_auth 0 2024-09-12T00:34:39.566 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: _check_auth_tickets 2024-09-12T00:34:39.566 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:39.567 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.567 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:39.567 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:34:39.166+0000 7f7860e09640 10 monclient: dump: 2024-09-12T00:34:39.567 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.567 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.567 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.567 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.567 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.567 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.567 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.567 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.567 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.567 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.568 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 monclient: authenticate success, global_id 6639 2024-09-12T00:34:39.568 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 10 monclient: get_monmap_and_config success 2024-09-12T00:34:39.568 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 4 set_mon_vals no callback set 2024-09-12T00:34:39.568 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 10 monclient: shutdown 2024-09-12T00:34:39.568 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 asok(0x561f26b692b0) unregister_commands rotate-key 2024-09-12T00:34:39.568 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 10 monclient: build_initial_monmap 2024-09-12T00:34:39.568 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:39.568 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 10 monclient: monmap: 2024-09-12T00:34:39.568 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:34:39.569 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:39.569 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:34:39.569 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:34:39.569 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:39.569 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.569 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:34:39.569 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:34:39.569 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:34:39.569 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.569 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding auth protocol: cephx 2024-09-12T00:34:39.569 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding auth protocol: cephx 2024-09-12T00:34:39.569 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding auth protocol: cephx 2024-09-12T00:34:39.569 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: secure 2024-09-12T00:34:39.570 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: crc 2024-09-12T00:34:39.570 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: secure 2024-09-12T00:34:39.570 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: crc 2024-09-12T00:34:39.570 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: secure 2024-09-12T00:34:39.570 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: crc 2024-09-12T00:34:39.570 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: crc 2024-09-12T00:34:39.570 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: secure 2024-09-12T00:34:39.570 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: crc 2024-09-12T00:34:39.570 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: secure 2024-09-12T00:34:39.570 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: crc 2024-09-12T00:34:39.570 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:34:39.166+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d776f0) adding con mode: secure 2024-09-12T00:34:39.570 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.570 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 1 librados: starting msgr at 2024-09-12T00:34:39.571 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 1 librados: starting objecter 2024-09-12T00:34:39.571 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command objecter_requests hook 0x561f26b44430 2024-09-12T00:34:39.571 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 1 librados: setting wanted keys 2024-09-12T00:34:39.571 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 1 librados: calling monclient init 2024-09-12T00:34:39.571 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient: init 2024-09-12T00:34:39.571 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding auth protocol: cephx 2024-09-12T00:34:39.571 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding auth protocol: cephx 2024-09-12T00:34:39.571 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding auth protocol: cephx 2024-09-12T00:34:39.571 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: secure 2024-09-12T00:34:39.571 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: crc 2024-09-12T00:34:39.571 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: secure 2024-09-12T00:34:39.571 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: crc 2024-09-12T00:34:39.571 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: secure 2024-09-12T00:34:39.572 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: crc 2024-09-12T00:34:39.572 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: crc 2024-09-12T00:34:39.572 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: secure 2024-09-12T00:34:39.572 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: crc 2024-09-12T00:34:39.572 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: secure 2024-09-12T00:34:39.572 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: crc 2024-09-12T00:34:39.572 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 AuthRegistry(0x561f26d74610) adding con mode: secure 2024-09-12T00:34:39.572 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.572 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.572 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command rotate-key hook 0x561f26d74758 2024-09-12T00:34:39.572 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:39.572 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:34:39.572 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-b con 0x561f26c235b0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:34:39.573 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-c con 0x561f26cb8b00 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:34:39.573 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-a con 0x561f26cbbd10 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:34:39.573 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.573 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.573 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.573 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:39.573 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient(hunting): authenticate will time out at 2132.512933s 2024-09-12T00:34:39.573 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient(hunting): get_auth_request con 0x561f26cbbd10 auth_method 0 2024-09-12T00:34:39.573 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.573 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.573 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.573 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:34:39.170+0000 7f79722a8640 10 monclient(hunting): get_auth_request con 0x561f26cb8b00 auth_method 0 2024-09-12T00:34:39.573 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:34:39.170+0000 7f79722a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.574 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:34:39.170+0000 7f79722a8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.574 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:34:39.170+0000 7f79722a8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.574 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.574 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.574 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.574 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:34:39.170+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.574 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:34:39.170+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.574 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:34:39.170+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.574 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:34:39.170+0000 7f7972aa9640 10 monclient(hunting): get_auth_request con 0x561f26c235b0 auth_method 0 2024-09-12T00:34:39.574 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:34:39.170+0000 7f7972aa9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.574 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:34:39.170+0000 7f7972aa9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.574 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:34:39.170+0000 7f7972aa9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.574 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient(hunting): handle_auth_done global_id 6642 payload 824 2024-09-12T00:34:39.574 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient: _finish_hunting 0 2024-09-12T00:34:39.575 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:34:39.170+0000 7f79732aa640 1 monclient: found mon.noname-a 2024-09-12T00:34:39.575 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:34:39.170+0000 7f79732aa640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:34:39.575 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.575 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:39.575 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: dump: 2024-09-12T00:34:39.575 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.575 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.575 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.575 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.575 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.575 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.575 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.575 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.576 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.576 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.576 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: _finish_auth 0 2024-09-12T00:34:39.576 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: _check_auth_tickets 2024-09-12T00:34:39.576 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:39.576 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.576 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:39.576 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:34:39.170+0000 7f785f606640 10 monclient: dump: 2024-09-12T00:34:39.576 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.576 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.576 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.576 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.577 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.577 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.577 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.577 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.577 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.577 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.577 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 5 monclient: authenticate success, global_id 6642 2024-09-12T00:34:39.577 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient: _renew_subs 2024-09-12T00:34:39.577 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:34:39.170+0000 7f7860e09640 4 set_mon_vals no callback set 2024-09-12T00:34:39.577 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:34:39.577 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient: _renew_subs 2024-09-12T00:34:39.577 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:34:39.577 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:34:39.170+0000 7f7974fa39c0 1 librados: init done 2024-09-12T00:34:39.578 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:34:39.170+0000 7f785f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:39.578 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:34:39.170+0000 7f785f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:39.578 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:34:39.170+0000 7f785f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:39.578 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:34:39.174+0000 7f7972aa9640 10 monclient: get_auth_request con 0x7f7858070b10 auth_method 0 2024-09-12T00:34:39.578 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:34:39.174+0000 7f79722a8640 10 monclient: get_auth_request con 0x561f26dbc410 auth_method 0 2024-09-12T00:34:39.578 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:34:39.174+0000 7f7972aa9640 10 monclient: get_auth_request con 0x561f26dbf250 auth_method 0 2024-09-12T00:34:39.578 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:34:39.174+0000 7f79722a8640 10 monclient: get_auth_request con 0x561f26dc3440 auth_method 0 2024-09-12T00:34:39.578 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: build_initial_monmap 2024-09-12T00:34:39.578 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:39.578 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: monmap: 2024-09-12T00:34:39.578 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:34:39.578 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:39.579 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:34:39.579 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:34:39.579 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:39.579 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.579 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:34:39.579 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:34:39.579 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:34:39.579 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.579 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding auth protocol: cephx 2024-09-12T00:34:39.579 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding auth protocol: cephx 2024-09-12T00:34:39.580 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding auth protocol: cephx 2024-09-12T00:34:39.580 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: secure 2024-09-12T00:34:39.580 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: crc 2024-09-12T00:34:39.580 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: secure 2024-09-12T00:34:39.580 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: crc 2024-09-12T00:34:39.580 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: secure 2024-09-12T00:34:39.580 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: crc 2024-09-12T00:34:39.580 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: crc 2024-09-12T00:34:39.580 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: secure 2024-09-12T00:34:39.580 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: crc 2024-09-12T00:34:39.580 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: secure 2024-09-12T00:34:39.580 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: crc 2024-09-12T00:34:39.580 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc82a0) adding con mode: secure 2024-09-12T00:34:39.581 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.581 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command objecter_requests cmddesc objecter_requests hook 0x561f26dcbc00 EEXIST 2024-09-12T00:34:39.581 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: init 2024-09-12T00:34:39.581 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding auth protocol: cephx 2024-09-12T00:34:39.581 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding auth protocol: cephx 2024-09-12T00:34:39.581 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding auth protocol: cephx 2024-09-12T00:34:39.581 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: secure 2024-09-12T00:34:39.581 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: crc 2024-09-12T00:34:39.581 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: secure 2024-09-12T00:34:39.581 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: crc 2024-09-12T00:34:39.581 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: secure 2024-09-12T00:34:39.581 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: crc 2024-09-12T00:34:39.581 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: crc 2024-09-12T00:34:39.582 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: secure 2024-09-12T00:34:39.582 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: crc 2024-09-12T00:34:39.582 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: secure 2024-09-12T00:34:39.582 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: crc 2024-09-12T00:34:39.582 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 AuthRegistry(0x561f26dc68b8) adding con mode: secure 2024-09-12T00:34:39.582 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.582 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.582 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command rotate-key cmddesc rotate-key hook 0x561f26dc6a00 EEXIST 2024-09-12T00:34:39.582 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:39.582 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:34:39.582 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-b con 0x561f26defdb0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:34:39.582 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-c con 0x561f26def6e0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:34:39.582 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-a con 0x561f26dee0c0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:34:39.583 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.583 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.583 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.583 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:39.583 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient(hunting): authenticate will time out at 2132.521784s 2024-09-12T00:34:39.583 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient(hunting): get_auth_request con 0x561f26dee0c0 auth_method 0 2024-09-12T00:34:39.583 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.583 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.583 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.583 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:34:39.178+0000 7f79722a8640 10 monclient(hunting): get_auth_request con 0x561f26def6e0 auth_method 0 2024-09-12T00:34:39.583 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:34:39.178+0000 7f79722a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.583 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:34:39.178+0000 7f79722a8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.583 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:34:39.178+0000 7f79722a8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.584 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.584 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.584 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.584 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:34:39.178+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.584 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:34:39.178+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.584 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:34:39.178+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.584 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient(hunting): handle_auth_done global_id 6645 payload 824 2024-09-12T00:34:39.584 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient: _finish_hunting 0 2024-09-12T00:34:39.584 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:34:39.178+0000 7f79732aa640 1 monclient: found mon.noname-a 2024-09-12T00:34:39.584 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:34:39.178+0000 7f79732aa640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:34:39.584 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.584 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:39.585 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: dump: 2024-09-12T00:34:39.585 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.585 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.585 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.585 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.585 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.585 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.585 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.585 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.585 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.585 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.586 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: _finish_auth 0 2024-09-12T00:34:39.586 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: _check_auth_tickets 2024-09-12T00:34:39.586 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:39.586 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.586 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:39.586 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:34:39.178+0000 7f785ce01640 10 monclient: dump: 2024-09-12T00:34:39.586 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.586 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.586 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.586 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.586 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.586 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.586 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.587 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.587 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.587 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.587 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:34:39.178+0000 7f7973aab640 4 set_mon_vals no callback set 2024-09-12T00:34:39.587 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 5 monclient: authenticate success, global_id 6645 2024-09-12T00:34:39.587 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: _renew_subs 2024-09-12T00:34:39.587 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:34:39.587 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: _renew_subs 2024-09-12T00:34:39.587 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:34:39.178+0000 7f7974fa39c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:34:39.587 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:34:39.182+0000 7f785ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:39.587 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:34:39.182+0000 7f785ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:39.587 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:34:39.182+0000 7f785ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:39.588 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient: get_monmap_and_config 2024-09-12T00:34:39.588 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient: build_initial_monmap 2024-09-12T00:34:39.588 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:39.588 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient: monmap: 2024-09-12T00:34:39.588 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:34:39.588 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:39.588 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:34:39.588 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:34:39.588 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:39.588 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.589 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:34:39.589 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:34:39.589 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:34:39.589 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.589 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding auth protocol: cephx 2024-09-12T00:34:39.589 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding auth protocol: cephx 2024-09-12T00:34:39.589 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding auth protocol: cephx 2024-09-12T00:34:39.589 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: secure 2024-09-12T00:34:39.589 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: crc 2024-09-12T00:34:39.589 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: secure 2024-09-12T00:34:39.589 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: crc 2024-09-12T00:34:39.589 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: secure 2024-09-12T00:34:39.589 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: crc 2024-09-12T00:34:39.590 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: crc 2024-09-12T00:34:39.590 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: secure 2024-09-12T00:34:39.590 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: crc 2024-09-12T00:34:39.590 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: secure 2024-09-12T00:34:39.590 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: crc 2024-09-12T00:34:39.590 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e0f2c0) adding con mode: secure 2024-09-12T00:34:39.590 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:34:39.182+0000 7f7972aa9640 10 monclient: get_auth_request con 0x7f784c070a20 auth_method 0 2024-09-12T00:34:39.590 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.590 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient: init 2024-09-12T00:34:39.590 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding auth protocol: cephx 2024-09-12T00:34:39.590 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding auth protocol: cephx 2024-09-12T00:34:39.590 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding auth protocol: cephx 2024-09-12T00:34:39.591 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: secure 2024-09-12T00:34:39.591 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: crc 2024-09-12T00:34:39.591 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: secure 2024-09-12T00:34:39.591 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: crc 2024-09-12T00:34:39.591 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: secure 2024-09-12T00:34:39.591 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: crc 2024-09-12T00:34:39.591 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: crc 2024-09-12T00:34:39.591 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: secure 2024-09-12T00:34:39.591 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: crc 2024-09-12T00:34:39.591 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: secure 2024-09-12T00:34:39.591 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: crc 2024-09-12T00:34:39.591 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f1e0) adding con mode: secure 2024-09-12T00:34:39.591 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.592 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.592 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command rotate-key cmddesc rotate-key hook 0x7fff35c5f328 EEXIST 2024-09-12T00:34:39.592 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:39.592 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:34:39.592 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-a con 0x561f26e13380 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:34:39.592 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-b con 0x561f26e3daf0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:34:39.592 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-c con 0x561f26e3eb70 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:34:39.592 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.592 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.592 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.592 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:39.592 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient(hunting): authenticate will time out at 2132.526518s 2024-09-12T00:34:39.593 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:34:39.182+0000 7f7972aa9640 10 monclient(hunting): get_auth_request con 0x561f26e13380 auth_method 0 2024-09-12T00:34:39.593 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:34:39.182+0000 7f7972aa9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.593 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:34:39.182+0000 7f7972aa9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.593 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:34:39.182+0000 7f7972aa9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.593 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient(hunting): get_auth_request con 0x561f26e3eb70 auth_method 0 2024-09-12T00:34:39.593 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.593 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.593 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.593 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.593 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.593 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.593 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:34:39.182+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.593 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:34:39.182+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.594 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:34:39.182+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.594 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:34:39.182+0000 7f79722a8640 10 monclient(hunting): get_auth_request con 0x561f26e3daf0 auth_method 0 2024-09-12T00:34:39.594 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:34:39.182+0000 7f79722a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.594 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:34:39.182+0000 7f79722a8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.594 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:34:39.182+0000 7f79722a8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.594 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient(hunting): handle_auth_done global_id 6269 payload 274 2024-09-12T00:34:39.594 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient: _finish_hunting 0 2024-09-12T00:34:39.594 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:34:39.182+0000 7f79732aa640 1 monclient: found mon.noname-c 2024-09-12T00:34:39.594 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:34:39.182+0000 7f79732aa640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:34:39.594 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.594 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:39.594 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: dump: 2024-09-12T00:34:39.594 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.595 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.595 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.595 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.595 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.595 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.595 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.595 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.595 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.595 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.595 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: _finish_auth 0 2024-09-12T00:34:39.595 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: _check_auth_tickets 2024-09-12T00:34:39.595 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:39.596 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 5 monclient: authenticate success, global_id 6269 2024-09-12T00:34:39.596 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient: get_monmap_and_config success 2024-09-12T00:34:39.596 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 4 set_mon_vals no callback set 2024-09-12T00:34:39.596 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.596 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:39.596 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:34:39.182+0000 7f78567fc640 10 monclient: dump: 2024-09-12T00:34:39.596 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.596 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.596 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.596 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.596 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.596 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.596 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.597 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.597 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.597 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.597 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:34:39.182+0000 7f7974fa39c0 10 monclient: shutdown 2024-09-12T00:34:39.597 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: build_initial_monmap 2024-09-12T00:34:39.597 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:39.597 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: monmap: 2024-09-12T00:34:39.597 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:34:39.597 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:39.597 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:34:39.597 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:34:39.597 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:39.598 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.598 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:34:39.598 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:34:39.598 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:34:39.598 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.598 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding auth protocol: cephx 2024-09-12T00:34:39.598 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding auth protocol: cephx 2024-09-12T00:34:39.598 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding auth protocol: cephx 2024-09-12T00:34:39.598 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: secure 2024-09-12T00:34:39.598 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: crc 2024-09-12T00:34:39.598 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: secure 2024-09-12T00:34:39.598 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: crc 2024-09-12T00:34:39.599 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: secure 2024-09-12T00:34:39.599 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: crc 2024-09-12T00:34:39.599 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: crc 2024-09-12T00:34:39.599 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: secure 2024-09-12T00:34:39.599 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: crc 2024-09-12T00:34:39.599 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: secure 2024-09-12T00:34:39.599 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: crc 2024-09-12T00:34:39.599 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26e42f60) adding con mode: secure 2024-09-12T00:34:39.599 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.599 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 1 librados: starting msgr at 2024-09-12T00:34:39.599 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 1 librados: starting objecter 2024-09-12T00:34:39.599 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command objecter_requests cmddesc objecter_requests hook 0x561f26e39e90 EEXIST 2024-09-12T00:34:39.600 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 1 librados: setting wanted keys 2024-09-12T00:34:39.600 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 1 librados: calling monclient init 2024-09-12T00:34:39.600 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: init 2024-09-12T00:34:39.600 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding auth protocol: cephx 2024-09-12T00:34:39.600 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding auth protocol: cephx 2024-09-12T00:34:39.600 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding auth protocol: cephx 2024-09-12T00:34:39.600 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: secure 2024-09-12T00:34:39.600 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: crc 2024-09-12T00:34:39.600 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: secure 2024-09-12T00:34:39.601 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: crc 2024-09-12T00:34:39.601 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: secure 2024-09-12T00:34:39.601 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: crc 2024-09-12T00:34:39.601 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: crc 2024-09-12T00:34:39.601 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: secure 2024-09-12T00:34:39.601 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: crc 2024-09-12T00:34:39.601 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: secure 2024-09-12T00:34:39.601 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: crc 2024-09-12T00:34:39.601 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 AuthRegistry(0x561f26df1bd0) adding con mode: secure 2024-09-12T00:34:39.601 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.601 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.601 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command rotate-key cmddesc rotate-key hook 0x561f26df1d18 EEXIST 2024-09-12T00:34:39.602 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:39.602 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:34:39.602 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-c con 0x561f26e13380 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:34:39.602 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-a con 0x561f26e3daf0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:34:39.602 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient(hunting): picked mon.noname-b con 0x561f26e3eb70 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:34:39.602 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.602 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.602 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:39.602 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:39.602 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient(hunting): authenticate will time out at 2132.529104s 2024-09-12T00:34:39.602 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient(hunting): get_auth_request con 0x561f26e13380 auth_method 0 2024-09-12T00:34:39.602 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.602 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.603 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.603 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:34:39.186+0000 7f79722a8640 10 monclient(hunting): get_auth_request con 0x561f26e3daf0 auth_method 0 2024-09-12T00:34:39.603 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:34:39.186+0000 7f79722a8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:39.603 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:34:39.186+0000 7f79722a8640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:39.603 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:34:39.186+0000 7f79722a8640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:39.603 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.603 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.603 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.603 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:34:39.186+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:39.603 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:34:39.186+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:39.603 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:34:39.186+0000 7f79722a8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:39.603 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient(hunting): handle_auth_done global_id 6272 payload 824 2024-09-12T00:34:39.603 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient: _finish_hunting 0 2024-09-12T00:34:39.604 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:34:39.186+0000 7f7972aa9640 1 monclient: found mon.noname-c 2024-09-12T00:34:39.604 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:34:39.186+0000 7f7972aa9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:34:39.604 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.604 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:39.604 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: dump: 2024-09-12T00:34:39.604 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.604 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.604 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.604 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.604 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.605 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.605 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.605 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.605 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.605 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.605 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: _finish_auth 0 2024-09-12T00:34:39.605 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:34:39.605 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:39.605 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:39.605 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:39.605 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:34:39.186+0000 7f7854ff9640 10 monclient: dump: 2024-09-12T00:34:39.605 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:34:39.606 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:34:39.606 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.606 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:34:39.606 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:39.606 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:34:39.606 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:34:39.606 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:34:39.606 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:34:39.606 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.606 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:34:39.186+0000 7f78567fc640 4 set_mon_vals no callback set 2024-09-12T00:34:39.606 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 monclient: authenticate success, global_id 6272 2024-09-12T00:34:39.606 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: _renew_subs 2024-09-12T00:34:39.607 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:34:39.607 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: _renew_subs 2024-09-12T00:34:39.607 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:34:39.607 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 1 librados: init done 2024-09-12T00:34:39.607 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command cr dump hook 0x561f26e3c608 2024-09-12T00:34:39.607 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:34:39.186+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.607 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:34:39.190+0000 7f7854ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:39.607 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:34:39.190+0000 7f7854ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:39.607 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:34:39.190+0000 7f7854ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:34:39.607 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:34:39.190+0000 7f79722a8640 10 monclient: get_auth_request con 0x7f783c070b10 auth_method 0 2024-09-12T00:34:39.607 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:34:39.190+0000 7f79732aa640 10 monclient: get_auth_request con 0x561f26e5d2a0 auth_method 0 2024-09-12T00:34:39.607 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.607 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 realm 2024-09-12T00:34:39.608 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.608 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.608 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:34:39.190+0000 7f7974fa39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:39.608 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.608 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.608 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:34:39.190+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.608 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:34:39.190+0000 7f7972aa9640 10 monclient: get_auth_request con 0x561f26e61340 auth_method 0 2024-09-12T00:34:39.608 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:34:39.194+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:39.608 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:34:39.194+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.608 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:34:39.194+0000 7f79722a8640 10 monclient: get_auth_request con 0x561f26e64c30 auth_method 0 2024-09-12T00:34:39.608 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:34:39.194+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:39.608 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:34:39.194+0000 7f7974fa39c0 20 searching for the correct realm 2024-09-12T00:34:39.609 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:34:39.194+0000 7f79732aa640 10 monclient: get_auth_request con 0x561f26e699f0 auth_method 0 2024-09-12T00:34:39.609 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:34:39.194+0000 7f7972aa9640 10 monclient: get_auth_request con 0x7f796c11f7b0 auth_method 0 2024-09-12T00:34:39.609 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:34:39.198+0000 7f79722a8640 10 monclient: get_auth_request con 0x7f79640733a0 auth_method 0 2024-09-12T00:34:39.609 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:34:39.198+0000 7f79732aa640 10 monclient: get_auth_request con 0x7f796c0e5b60 auth_method 0 2024-09-12T00:34:39.609 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:34:39.198+0000 7f79732aa640 0 -- 172.21.15.138:0/2099929600 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f796c0e5b60 msgr2=0x7f796c11f050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:39.609 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:34:39.402+0000 7f79732aa640 10 monclient: get_auth_request con 0x7f796c0e5b60 auth_method 0 2024-09-12T00:34:39.609 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:34:39.406+0000 7f7972aa9640 10 monclient: get_auth_request con 0x7f796409dba0 auth_method 0 2024-09-12T00:34:39.609 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:34:39.414+0000 7f79732aa640 0 -- 172.21.15.138:0/2099929600 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x561f26e699f0 msgr2=0x561f26e6beb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:39.609 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:34:39.414+0000 7f7854ff9640 1 client.6272.objecter ms_handle_reset 0x561f26e699f0 session 0x561f26e69370 osd.4 2024-09-12T00:34:39.609 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:34:39.414+0000 7f7854ff9640 10 monclient: _renew_subs 2024-09-12T00:34:39.609 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:34:39.414+0000 7f7854ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:34:39.609 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:34:39.414+0000 7f79732aa640 10 monclient: get_auth_request con 0x7f783c080e30 auth_method 0 2024-09-12T00:34:39.610 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:39.610 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:39.610 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:39.610 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:39.610 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:39.610 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:39.610 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:34:39.422+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.610 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.610 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.610 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:39.610 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.610 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:39.610 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 zone default found 2024-09-12T00:34:39.611 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 4 Realm: () 2024-09-12T00:34:39.611 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:39.611 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:39.611 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:39.611 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 zonegroup default 2024-09-12T00:34:39.611 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.611 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.611 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.611 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.611 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:34:39.426+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.611 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:34:39.430+0000 7f7974fa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.611 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:34:39.430+0000 7f7974fa39c0 20 started sync module instance, tier type = 2024-09-12T00:34:39.611 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:34:39.430+0000 7f7974fa39c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:39.612 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=0 2024-09-12T00:34:39.612 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=1 2024-09-12T00:34:39.612 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=2 2024-09-12T00:34:39.612 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=3 2024-09-12T00:34:39.612 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=4 2024-09-12T00:34:39.612 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=5 2024-09-12T00:34:39.612 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:34:39.450+0000 7f7974fa39c0 20 add_watcher() i=6 2024-09-12T00:34:39.612 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:34:39.454+0000 7f7974fa39c0 20 add_watcher() i=7 2024-09-12T00:34:39.612 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:34:39.454+0000 7f7974fa39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:39.612 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding auth protocol: cephx 2024-09-12T00:34:39.612 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding auth protocol: cephx 2024-09-12T00:34:39.612 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding auth protocol: cephx 2024-09-12T00:34:39.613 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: secure 2024-09-12T00:34:39.613 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: crc 2024-09-12T00:34:39.613 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: secure 2024-09-12T00:34:39.613 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: crc 2024-09-12T00:34:39.613 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: secure 2024-09-12T00:34:39.613 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: crc 2024-09-12T00:34:39.613 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:34:39.458+0000 7f78297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:39.613 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: crc 2024-09-12T00:34:39.613 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: secure 2024-09-12T00:34:39.613 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: crc 2024-09-12T00:34:39.613 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: secure 2024-09-12T00:34:39.613 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: crc 2024-09-12T00:34:39.614 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 AuthRegistry(0x7fff35c5f6c0) adding con mode: secure 2024-09-12T00:34:39.614 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:39.614 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:39.614 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:39.614 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command cache list hook 0x561f26e3ef70 2024-09-12T00:34:39.614 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command cache inspect hook 0x561f26e3ef70 2024-09-12T00:34:39.614 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command cache erase hook 0x561f26e3ef70 2024-09-12T00:34:39.614 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command cache zap hook 0x561f26e3ef70 2024-09-12T00:34:39.614 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 note: GC not initialized 2024-09-12T00:34:39.614 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:34:39.458+0000 7f77a3fff640 20 reqs_thread_entry: start 2024-09-12T00:34:39.614 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:34:39.458+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command sync trace show hook 0x7f795c004d30 2024-09-12T00:34:39.614 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command sync trace history hook 0x7f795c004d30 2024-09-12T00:34:39.614 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command sync trace active hook 0x7f795c004d30 2024-09-12T00:34:39.615 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 5 asok(0x561f26b692b0) register_command sync trace active_short hook 0x7f795c004d30 2024-09-12T00:34:39.615 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:39.615 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 Filter name: none 2024-09-12T00:34:39.615 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:34:39.462+0000 7f77a1ffb640 20 reqs_thread_entry: start 2024-09-12T00:34:39.615 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:34:39.615 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.615 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:39.615 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:34:39.615 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:34:39.615 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 : miss 2024-09-12T00:34:39.615 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.615 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:39.616 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 info.flags=0x17 2024-09-12T00:34:39.616 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 to cache LRU end 2024-09-12T00:34:39.616 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:39.616 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:39.616 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:34:39.462+0000 7f7974fa39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 2024-09-12T00:34:39.616 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:34:39.474+0000 7f7974fa39c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7974fa39c0 time 2024-09-12T00:34:39.474146+0000 2024-09-12T00:34:39.616 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:34:39.616 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.616 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:39.616 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f797887d2eb] 2024-09-12T00:34:39.616 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f797887d49f] 2024-09-12T00:34:39.617 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f25524cc1] 2024-09-12T00:34:39.617 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422078) [0x561f25f82078] 2024-09-12T00:34:39.617 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561f25539ced] 2024-09-12T00:34:39.617 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:34:39.617 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f79776e3d90] 2024-09-12T00:34:39.617 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:34:39.617 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:34:39.617 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.617 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:34:39.474+0000 7f7974fa39c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:34:39.617 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f7974fa39c0 thread_name:radosgw-admin 2024-09-12T00:34:39.617 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.617 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:39.618 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f79776fc520] 2024-09-12T00:34:39.618 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:34:39.618 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:34:39.618 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:34:39.618 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f797887d345] 2024-09-12T00:34:39.618 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f797887d49f] 2024-09-12T00:34:39.618 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x561f25524cc1] 2024-09-12T00:34:39.618 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422078) [0x561f25f82078] 2024-09-12T00:34:39.618 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x561f25539ced] 2024-09-12T00:34:39.618 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:34:39.618 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f79776e3d90] 2024-09-12T00:34:39.618 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:34:39.619 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:34:39.619 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:34:39.619 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.619 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:34:39.619 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:34:39.619 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:34:39.619 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:34:39.619 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:34:39.619 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:34:39.619 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:34:39.619 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:34:39.619 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:34:39.619 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:34:39.620 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:34:39.620 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:34:39.620 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:34:39.620 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:34:39.620 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:34:39.620 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:34:39.620 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:34:39.620 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:34:39.620 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:34:39.620 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:34:39.620 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:34:39.620 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:34:39.620 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:34:39.621 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:34:39.621 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:34:39.621 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:34:39.621 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:34:39.621 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:34:39.621 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:34:39.621 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:34:39.621 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:34:39.621 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:34:39.621 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:34:39.621 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:34:39.621 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:34:39.621 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:34:39.622 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:34:39.622 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:34:39.622 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:34:39.622 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:34:39.622 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:34:39.622 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:34:39.622 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:34:39.622 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:34:39.622 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:34:39.622 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:34:39.622 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:34:39.622 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:34:39.622 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:34:39.623 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:34:39.623 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:34:39.623 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:34:39.623 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:34:39.623 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:34:39.623 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:34:39.623 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:34:39.623 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:34:39.623 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:34:39.623 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:34:39.623 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:34:39.623 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:34:39.623 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:34:39.624 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:34:39.624 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:34:39.624 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:34:39.624 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:34:39.624 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:34:39.624 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:34:39.624 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:34:39.624 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:34:39.624 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:34:39.624 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:34:39.624 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:34:39.624 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:34:39.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:34:39.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:34:39.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:34:39.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:34:39.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:34:39.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:34:39.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:34:39.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:34:39.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:34:39.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:34:39.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:34:39.625 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:34:39.625 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:34:39.626 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:34:39.626 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:34:39.626 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:34:39.626 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:34:39.626 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:34:39.626 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:34:39.626 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:34:39.626 INFO:tasks.workunit.client.0.smithi138.stderr: 7f77a1ffb640 / http_manager 2024-09-12T00:34:39.626 INFO:tasks.workunit.client.0.smithi138.stderr: 7f77a3fff640 / http_manager 2024-09-12T00:34:39.626 INFO:tasks.workunit.client.0.smithi138.stderr: 7f78297e2640 / rgw_dt_lg_renew 2024-09-12T00:34:39.626 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7854ff9640 / ms_dispatch 2024-09-12T00:34:39.626 INFO:tasks.workunit.client.0.smithi138.stderr: 7f78567fc640 / io_context_pool 2024-09-12T00:34:39.627 INFO:tasks.workunit.client.0.smithi138.stderr: 7f785ce01640 / ms_dispatch 2024-09-12T00:34:39.627 INFO:tasks.workunit.client.0.smithi138.stderr: 7f785f606640 / ms_dispatch 2024-09-12T00:34:39.627 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7860e09640 / io_context_pool 2024-09-12T00:34:39.627 INFO:tasks.workunit.client.0.smithi138.stderr: 7f79722a8640 / msgr-worker-2 2024-09-12T00:34:39.627 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7972aa9640 / msgr-worker-1 2024-09-12T00:34:39.627 INFO:tasks.workunit.client.0.smithi138.stderr: 7f79732aa640 / msgr-worker-0 2024-09-12T00:34:39.627 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7973aab640 / io_context_pool 2024-09-12T00:34:39.627 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7974fa39c0 / radosgw-admin 2024-09-12T00:34:39.627 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:34:39.627 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:34:39.627 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:34:39.476680Z_52301445-c23c-480e-9c33-0d3958cc392a/log 2024-09-12T00:34:39.627 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:34:39.627 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-12T00:34:39.628 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:34:39.632 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:39.633 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:39.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.558+0000 7f1b451b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.558+0000 7f1b451b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.558+0000 7f1b451b19c0 20 realm 2024-09-12T00:34:39.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.558+0000 7f1b451b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.562+0000 7f1b451b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.562+0000 7f1b451b19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:39.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.562+0000 7f1b451b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.562+0000 7f1b451b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.562+0000 7f1b451b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.562+0000 7f1b451b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:39.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.562+0000 7f1b451b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.562+0000 7f1b451b19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:39.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.562+0000 7f1b451b19c0 20 searching for the correct realm 2024-09-12T00:34:39.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.566+0000 7f1b434b8640 0 -- 172.21.15.138:0/3491538936 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5613ea94e680 msgr2=0x5613ea950b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:39.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.574+0000 7f1b424b6640 0 -- 172.21.15.138:0/3491538936 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x5613ea949950 msgr2=0x5613ea94bd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:39.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.578+0000 7f1b451b19c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:39.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.578+0000 7f1b451b19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:39.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.578+0000 7f1b451b19c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:39.634 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.578+0000 7f1b451b19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:39.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.578+0000 7f1b451b19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:39.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.578+0000 7f1b451b19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:39.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.578+0000 7f1b451b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:39.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:39.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 20 zone default found 2024-09-12T00:34:39.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 4 Realm: () 2024-09-12T00:34:39.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:39.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:39.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:39.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 20 zonegroup default 2024-09-12T00:34:39.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 20 started sync module instance, tier type = 2024-09-12T00:34:39.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.582+0000 7f1b451b19c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:39.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.602+0000 7f1b451b19c0 20 add_watcher() i=0 2024-09-12T00:34:39.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.602+0000 7f1b451b19c0 20 add_watcher() i=1 2024-09-12T00:34:39.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.602+0000 7f1b451b19c0 20 add_watcher() i=2 2024-09-12T00:34:39.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.602+0000 7f1b451b19c0 20 add_watcher() i=3 2024-09-12T00:34:39.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.602+0000 7f1b451b19c0 20 add_watcher() i=4 2024-09-12T00:34:39.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.602+0000 7f1b451b19c0 20 add_watcher() i=5 2024-09-12T00:34:39.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.602+0000 7f1b451b19c0 20 add_watcher() i=6 2024-09-12T00:34:39.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.606+0000 7f1b451b19c0 20 add_watcher() i=7 2024-09-12T00:34:39.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.606+0000 7f1b451b19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:39.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.606+0000 7f19f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:39.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.606+0000 7f1b451b19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:39.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.606+0000 7f1b451b19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:39.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.610+0000 7f1b451b19c0 5 note: GC not initialized 2024-09-12T00:34:39.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.610+0000 7f1973fff640 20 reqs_thread_entry: start 2024-09-12T00:34:39.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.610+0000 7f1b451b19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:39.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.610+0000 7f1b451b19c0 20 Filter name: none 2024-09-12T00:34:39.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.610+0000 7f1971ffb640 20 reqs_thread_entry: start 2024-09-12T00:34:39.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.610+0000 7f1b451b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.610+0000 7f1b451b19c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:39.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.610+0000 7f1b451b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.610+0000 7f1b451b19c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:39.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.610+0000 7f1b451b19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:39.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.610+0000 7f1b451b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.610+0000 7f1b451b19c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:39.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.610+0000 7f1b451b19c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.610+0000 7f1b451b19c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:39.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.610+0000 7f1b451b19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:39.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.614+0000 7f19f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:39.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.618+0000 7f1b451b19c0 20 remove_watcher() i=0 2024-09-12T00:34:39.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.618+0000 7f1b451b19c0 2 removed watcher, disabling cache 2024-09-12T00:34:39.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.618+0000 7f1b451b19c0 20 remove_watcher() i=1 2024-09-12T00:34:39.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.622+0000 7f1b451b19c0 20 remove_watcher() i=2 2024-09-12T00:34:39.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.622+0000 7f1b451b19c0 20 remove_watcher() i=3 2024-09-12T00:34:39.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.626+0000 7f1b451b19c0 20 remove_watcher() i=4 2024-09-12T00:34:39.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.626+0000 7f1b451b19c0 20 remove_watcher() i=5 2024-09-12T00:34:39.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.630+0000 7f1b451b19c0 20 remove_watcher() i=6 2024-09-12T00:34:39.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.634+0000 7f1b451b19c0 20 remove_watcher() i=7 2024-09-12T00:34:39.643 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.643 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:34:39.643 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-set-target-layout id: e2043445-c131-4520-984d-b4d52f038a6b.4538.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:34:39.643 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:34:39.644 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:39.644 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:39.658 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:34:39.658 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:34:39.701 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:34:39.737 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:39.737 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:39.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.782+0000 7f1c56a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.786+0000 7f1c56a9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.786+0000 7f1c56a9b9c0 20 realm 2024-09-12T00:34:39.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.786+0000 7f1c56a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.786+0000 7f1c56a9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.786+0000 7f1c56a9b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:39.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.786+0000 7f1c56a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.786+0000 7f1c56a9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:39.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.786+0000 7f1c56a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.786+0000 7f1c56a9b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:39.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.786+0000 7f1c56a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:39.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.786+0000 7f1c56a9b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:39.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.786+0000 7f1c56a9b9c0 20 searching for the correct realm 2024-09-12T00:34:39.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:39.794+0000 7f1c54da2640 0 -- 172.21.15.138:0/4186100945 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f1c4c0b6210 msgr2=0x7f1c4c0d5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:40.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.010+0000 7f1c54da2640 0 -- 172.21.15.138:0/4186100945 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x557527d2e830 msgr2=0x557527d30cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:40.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.018+0000 7f1c56a9b9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:34:40.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.018+0000 7f1c56a9b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:40.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.018+0000 7f1c56a9b9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:34:40.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.018+0000 7f1c56a9b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:40.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.018+0000 7f1c56a9b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:40.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.018+0000 7f1c56a9b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:40.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.018+0000 7f1c56a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:40.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.018+0000 7f1c56a9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:40.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.018+0000 7f1c56a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:40.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.022+0000 7f1c56a9b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:40.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.022+0000 7f1c56a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:40.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.022+0000 7f1c56a9b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:40.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.022+0000 7f1c56a9b9c0 20 zone default found 2024-09-12T00:34:40.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.022+0000 7f1c56a9b9c0 4 Realm: () 2024-09-12T00:34:40.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.022+0000 7f1c56a9b9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:34:40.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.022+0000 7f1c56a9b9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:34:40.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.022+0000 7f1c56a9b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:40.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.022+0000 7f1c56a9b9c0 20 zonegroup default 2024-09-12T00:34:40.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.022+0000 7f1c56a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:40.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.022+0000 7f1c56a9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:40.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.022+0000 7f1c56a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:40.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.022+0000 7f1c56a9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:40.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.022+0000 7f1c56a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:40.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.022+0000 7f1c56a9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:40.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.022+0000 7f1c56a9b9c0 20 started sync module instance, tier type = 2024-09-12T00:34:40.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.022+0000 7f1c56a9b9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:34:40.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.046+0000 7f1c56a9b9c0 20 add_watcher() i=0 2024-09-12T00:34:40.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.050+0000 7f1c56a9b9c0 20 add_watcher() i=1 2024-09-12T00:34:40.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.050+0000 7f1c56a9b9c0 20 add_watcher() i=2 2024-09-12T00:34:40.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.050+0000 7f1c56a9b9c0 20 add_watcher() i=3 2024-09-12T00:34:40.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.050+0000 7f1c56a9b9c0 20 add_watcher() i=4 2024-09-12T00:34:40.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.050+0000 7f1c56a9b9c0 20 add_watcher() i=5 2024-09-12T00:34:40.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.050+0000 7f1c56a9b9c0 20 add_watcher() i=6 2024-09-12T00:34:40.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.050+0000 7f1c56a9b9c0 20 add_watcher() i=7 2024-09-12T00:34:40.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.050+0000 7f1c56a9b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:40.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.054+0000 7f1b0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:40.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.054+0000 7f1c56a9b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:40.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.054+0000 7f1c56a9b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:40.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1c56a9b9c0 5 note: GC not initialized 2024-09-12T00:34:40.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1b09fdb640 20 reqs_thread_entry: start 2024-09-12T00:34:40.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1c56a9b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:40.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1c56a9b9c0 20 Filter name: none 2024-09-12T00:34:40.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1a7b7fe640 20 reqs_thread_entry: start 2024-09-12T00:34:40.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1c56a9b9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:34:40.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1c56a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:40.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1c56a9b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:34:40.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1c56a9b9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:34:40.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1c56a9b9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:34:40.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1c56a9b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 : miss 2024-09-12T00:34:40.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1c56a9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:40.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1c56a9b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:34:40.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1c56a9b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 info.flags=0x17 2024-09-12T00:34:40.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1c56a9b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 to cache LRU end 2024-09-12T00:34:40.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1c56a9b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:40.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1c56a9b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:40.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.058+0000 7f1c56a9b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 2024-09-12T00:34:40.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.062+0000 7f1c56a9b9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 to be held by another RGW process; skipping for now 2024-09-12T00:34:40.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.062+0000 7f1b0afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:40.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.066+0000 7f1c56a9b9c0 20 remove_watcher() i=0 2024-09-12T00:34:40.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.066+0000 7f1c56a9b9c0 2 removed watcher, disabling cache 2024-09-12T00:34:40.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.070+0000 7f1c56a9b9c0 20 remove_watcher() i=1 2024-09-12T00:34:40.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.070+0000 7f1c56a9b9c0 20 remove_watcher() i=2 2024-09-12T00:34:40.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.074+0000 7f1c56a9b9c0 20 remove_watcher() i=3 2024-09-12T00:34:40.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.074+0000 7f1c56a9b9c0 20 remove_watcher() i=4 2024-09-12T00:34:40.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.078+0000 7f1c56a9b9c0 20 remove_watcher() i=5 2024-09-12T00:34:40.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.082+0000 7f1c56a9b9c0 20 remove_watcher() i=6 2024-09-12T00:34:40.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:34:40.082+0000 7f1c56a9b9c0 20 remove_watcher() i=7 2024-09-12T00:34:40.095 INFO:tasks.workunit.client.0.smithi138.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:35:10.127 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:35:10.162 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:10.163 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:10.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.209+0000 7fa462c5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.213+0000 7fa462c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:10.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.213+0000 7fa462c5f9c0 20 realm 2024-09-12T00:35:10.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.213+0000 7fa462c5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.213+0000 7fa462c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:10.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.213+0000 7fa462c5f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:10.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.213+0000 7fa462c5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.213+0000 7fa462c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:10.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.213+0000 7fa462c5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.213+0000 7fa462c5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:10.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.213+0000 7fa462c5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.217+0000 7fa462c5f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:10.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.217+0000 7fa462c5f9c0 20 searching for the correct realm 2024-09-12T00:35:10.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.221+0000 7fa460f66640 0 -- 172.21.15.138:0/1005376436 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fa45802f410 msgr2=0x7fa45802f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:10.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.437+0000 7fa460f66640 0 -- 172.21.15.138:0/1005376436 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55dca0d7fae0 msgr2=0x55dca0d81fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:10.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.445+0000 7fa462c5f9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:10.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.445+0000 7fa462c5f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:10.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.445+0000 7fa462c5f9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:10.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.445+0000 7fa462c5f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:10.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.445+0000 7fa462c5f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:10.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.445+0000 7fa462c5f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:10.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.445+0000 7fa462c5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.445+0000 7fa462c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:10.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.445+0000 7fa462c5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.449+0000 7fa462c5f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:10.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.449+0000 7fa462c5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.449+0000 7fa462c5f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:10.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.449+0000 7fa462c5f9c0 20 zone default found 2024-09-12T00:35:10.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.449+0000 7fa462c5f9c0 4 Realm: () 2024-09-12T00:35:10.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.449+0000 7fa462c5f9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:10.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.449+0000 7fa462c5f9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:10.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.449+0000 7fa462c5f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:10.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.449+0000 7fa462c5f9c0 20 zonegroup default 2024-09-12T00:35:10.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.449+0000 7fa462c5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.449+0000 7fa462c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:10.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.449+0000 7fa462c5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.449+0000 7fa462c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:10.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.449+0000 7fa462c5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.449+0000 7fa462c5f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:10.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.449+0000 7fa462c5f9c0 20 started sync module instance, tier type = 2024-09-12T00:35:10.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.449+0000 7fa462c5f9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:10.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.473+0000 7fa462c5f9c0 20 add_watcher() i=0 2024-09-12T00:35:10.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.473+0000 7fa462c5f9c0 20 add_watcher() i=1 2024-09-12T00:35:10.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.473+0000 7fa462c5f9c0 20 add_watcher() i=2 2024-09-12T00:35:10.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.473+0000 7fa462c5f9c0 20 add_watcher() i=3 2024-09-12T00:35:10.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.473+0000 7fa462c5f9c0 20 add_watcher() i=4 2024-09-12T00:35:10.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.473+0000 7fa462c5f9c0 20 add_watcher() i=5 2024-09-12T00:35:10.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.473+0000 7fa462c5f9c0 20 add_watcher() i=6 2024-09-12T00:35:10.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.477+0000 7fa462c5f9c0 20 add_watcher() i=7 2024-09-12T00:35:10.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.477+0000 7fa462c5f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:10.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.481+0000 7fa316fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:10.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.481+0000 7fa462c5f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:10.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.481+0000 7fa462c5f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:10.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.481+0000 7fa462c5f9c0 5 note: GC not initialized 2024-09-12T00:35:10.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.485+0000 7fa315fdb640 20 reqs_thread_entry: start 2024-09-12T00:35:10.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.485+0000 7fa462c5f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:10.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.485+0000 7fa462c5f9c0 20 Filter name: none 2024-09-12T00:35:10.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.485+0000 7fa2877fe640 20 reqs_thread_entry: start 2024-09-12T00:35:10.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.485+0000 7fa462c5f9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:35:10.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.485+0000 7fa462c5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.485+0000 7fa462c5f9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:35:10.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.485+0000 7fa462c5f9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:35:10.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.485+0000 7fa462c5f9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:35:10.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.485+0000 7fa462c5f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 : miss 2024-09-12T00:35:10.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.485+0000 7fa462c5f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.485+0000 7fa462c5f9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:35:10.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.485+0000 7fa462c5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 info.flags=0x17 2024-09-12T00:35:10.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.485+0000 7fa462c5f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 to cache LRU end 2024-09-12T00:35:10.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.485+0000 7fa462c5f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:10.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.485+0000 7fa462c5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:10.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.485+0000 7fa462c5f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 2024-09-12T00:35:10.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.497+0000 7fa462c5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 info.flags=0x17 2024-09-12T00:35:10.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.497+0000 7fa462c5f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 to cache LRU end 2024-09-12T00:35:10.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.497+0000 7fa462c5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:10.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.497+0000 7fa462c5f9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24, ofs0, ns] 2024-09-12T00:35:10.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.497+0000 7fa3377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333530 cookie 94406079703136 notifier 6708 bl.length()=925 2024-09-12T00:35:10.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.497+0000 7fa3377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 info.flags=0x17 2024-09-12T00:35:10.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.497+0000 7fa3377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 to cache LRU end 2024-09-12T00:35:10.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.497+0000 7fa3377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:10.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.501+0000 7fa462c5f9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.24]): orig_sources= new_sources= 2024-09-12T00:35:10.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.501+0000 7fa462c5f9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.24]): potential sources added=[] removed=[] 2024-09-12T00:35:10.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.501+0000 7fa462c5f9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.24]): orig_dests= new_dests= 2024-09-12T00:35:10.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.501+0000 7fa462c5f9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.24]): potential dests added=[] removed=[] 2024-09-12T00:35:10.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.0 2024-09-12T00:35:10.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.0 2024-09-12T00:35:10.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.1 2024-09-12T00:35:10.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.1 2024-09-12T00:35:10.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.2 2024-09-12T00:35:10.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.2 2024-09-12T00:35:10.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.3 2024-09-12T00:35:10.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.3 2024-09-12T00:35:10.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.4 2024-09-12T00:35:10.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.4 2024-09-12T00:35:10.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.5 2024-09-12T00:35:10.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.5 2024-09-12T00:35:10.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.6 2024-09-12T00:35:10.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.6 2024-09-12T00:35:10.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.7 2024-09-12T00:35:10.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.7 2024-09-12T00:35:10.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.8 2024-09-12T00:35:10.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.8 2024-09-12T00:35:10.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.9 2024-09-12T00:35:10.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.9 2024-09-12T00:35:10.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.10 2024-09-12T00:35:10.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.10 2024-09-12T00:35:10.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.11 2024-09-12T00:35:10.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1.11 2024-09-12T00:35:10.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.0 2024-09-12T00:35:10.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1 2024-09-12T00:35:10.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.2 2024-09-12T00:35:10.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.509+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.3 2024-09-12T00:35:10.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.513+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.4 2024-09-12T00:35:10.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.513+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.5 2024-09-12T00:35:10.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.513+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.6 2024-09-12T00:35:10.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.513+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.7 2024-09-12T00:35:10.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.517+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.8 2024-09-12T00:35:10.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.517+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.9 2024-09-12T00:35:10.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.517+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.10 2024-09-12T00:35:10.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.521+0000 7fa462c5f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:10.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.521+0000 7fa462c5f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 2024-09-12T00:35:10.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.525+0000 7fa462c5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 info.flags=0x17 2024-09-12T00:35:10.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.525+0000 7fa462c5f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 to cache LRU end 2024-09-12T00:35:10.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.525+0000 7fa462c5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:10.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.525+0000 7fa462c5f9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24, ofs0, ns] 2024-09-12T00:35:10.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.529+0000 7fa3377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333531 cookie 94406079703136 notifier 6708 bl.length()=925 2024-09-12T00:35:10.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.529+0000 7fa3377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 info.flags=0x17 2024-09-12T00:35:10.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.529+0000 7fa3377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 to cache LRU end 2024-09-12T00:35:10.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.529+0000 7fa3377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:10.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.529+0000 7fa462c5f9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.24]): orig_sources= new_sources= 2024-09-12T00:35:10.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.529+0000 7fa462c5f9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.24]): potential sources added=[] removed=[] 2024-09-12T00:35:10.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.529+0000 7fa462c5f9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.24]): orig_dests= new_dests= 2024-09-12T00:35:10.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.529+0000 7fa462c5f9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.24]): potential dests added=[] removed=[] 2024-09-12T00:35:10.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.533+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.0 2024-09-12T00:35:10.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.533+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.1 2024-09-12T00:35:10.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.533+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.2 2024-09-12T00:35:10.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.533+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.3 2024-09-12T00:35:10.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.533+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.4 2024-09-12T00:35:10.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.533+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.5 2024-09-12T00:35:10.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.537+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.6 2024-09-12T00:35:10.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.537+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.7 2024-09-12T00:35:10.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.537+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.8 2024-09-12T00:35:10.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.537+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.9 2024-09-12T00:35:10.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.537+0000 7fa462c5f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.24.10 2024-09-12T00:35:10.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.537+0000 7fa462c5f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:10.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.537+0000 7fa462c5f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 2024-09-12T00:35:10.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.541+0000 7fa462c5f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 info.flags=0x17 2024-09-12T00:35:10.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.541+0000 7fa462c5f9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 to cache LRU end 2024-09-12T00:35:10.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.541+0000 7fa462c5f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:10.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.541+0000 7fa462c5f9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24, ofs0, ns] 2024-09-12T00:35:10.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.541+0000 7fa336ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333532 cookie 94406079703136 notifier 6708 bl.length()=893 2024-09-12T00:35:10.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.541+0000 7fa336ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 info.flags=0x17 2024-09-12T00:35:10.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.541+0000 7fa336ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.24 to cache LRU end 2024-09-12T00:35:10.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.541+0000 7fa336ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:10.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.541+0000 7fa462c5f9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.24]): orig_sources= new_sources= 2024-09-12T00:35:10.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.541+0000 7fa462c5f9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.24]): potential sources added=[] removed=[] 2024-09-12T00:35:10.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.541+0000 7fa462c5f9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.24]): orig_dests= new_dests= 2024-09-12T00:35:10.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.541+0000 7fa462c5f9c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.24]): potential dests added=[] removed=[] 2024-09-12T00:35:10.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.545+0000 7fa462c5f9c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:35:10.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.549+0000 7fa316fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:10.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.553+0000 7fa462c5f9c0 20 remove_watcher() i=0 2024-09-12T00:35:10.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.553+0000 7fa462c5f9c0 2 removed watcher, disabling cache 2024-09-12T00:35:10.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.553+0000 7fa462c5f9c0 20 remove_watcher() i=1 2024-09-12T00:35:10.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.557+0000 7fa462c5f9c0 20 remove_watcher() i=2 2024-09-12T00:35:10.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.557+0000 7fa462c5f9c0 20 remove_watcher() i=3 2024-09-12T00:35:10.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.561+0000 7fa462c5f9c0 20 remove_watcher() i=4 2024-09-12T00:35:10.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.561+0000 7fa462c5f9c0 20 remove_watcher() i=5 2024-09-12T00:35:10.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.565+0000 7fa462c5f9c0 20 remove_watcher() i=6 2024-09-12T00:35:10.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.565+0000 7fa462c5f9c0 20 remove_watcher() i=7 2024-09-12T00:35:10.579 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:35:10.606 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:10.606 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:10.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.653+0000 7f4d828d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.657+0000 7f4d828d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:10.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.657+0000 7f4d828d99c0 20 realm 2024-09-12T00:35:10.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.657+0000 7f4d828d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.657+0000 7f4d828d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:10.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.657+0000 7f4d828d99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:10.654 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.657+0000 7f4d828d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.657+0000 7f4d828d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:10.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.657+0000 7f4d828d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.657+0000 7f4d828d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:10.656 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.657+0000 7f4d828d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.661+0000 7f4d828d99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:10.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.661+0000 7f4d828d99c0 20 searching for the correct realm 2024-09-12T00:35:10.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.665+0000 7f4d80be0640 0 -- 172.21.15.138:0/1428378322 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x559d405b5c50 msgr2=0x559d405b8110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:10.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.669+0000 7f4d7fbde640 0 -- 172.21.15.138:0/1428378322 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x559d405b0ef0 msgr2=0x559d405b32e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:10.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.677+0000 7f4d828d99c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:10.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.677+0000 7f4d828d99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:10.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.677+0000 7f4d828d99c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:10.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.677+0000 7f4d828d99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:10.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.677+0000 7f4d828d99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:10.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.677+0000 7f4d828d99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:10.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.677+0000 7f4d828d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.677+0000 7f4d828d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:10.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.677+0000 7f4d828d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.681+0000 7f4d828d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:10.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.681+0000 7f4d828d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.681+0000 7f4d828d99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:10.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.681+0000 7f4d828d99c0 20 zone default found 2024-09-12T00:35:10.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.681+0000 7f4d828d99c0 4 Realm: () 2024-09-12T00:35:10.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.681+0000 7f4d828d99c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:10.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.681+0000 7f4d828d99c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:10.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.681+0000 7f4d828d99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:10.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.681+0000 7f4d828d99c0 20 zonegroup default 2024-09-12T00:35:10.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.681+0000 7f4d828d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.681+0000 7f4d828d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:10.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.681+0000 7f4d828d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.681+0000 7f4d828d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:10.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.681+0000 7f4d828d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.681+0000 7f4d828d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:10.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.681+0000 7f4d828d99c0 20 started sync module instance, tier type = 2024-09-12T00:35:10.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.681+0000 7f4d828d99c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:10.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.701+0000 7f4d828d99c0 20 add_watcher() i=0 2024-09-12T00:35:10.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.701+0000 7f4d828d99c0 20 add_watcher() i=1 2024-09-12T00:35:10.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.701+0000 7f4d828d99c0 20 add_watcher() i=2 2024-09-12T00:35:10.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.701+0000 7f4d828d99c0 20 add_watcher() i=3 2024-09-12T00:35:10.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.701+0000 7f4d828d99c0 20 add_watcher() i=4 2024-09-12T00:35:10.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.701+0000 7f4d828d99c0 20 add_watcher() i=5 2024-09-12T00:35:10.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.701+0000 7f4d828d99c0 20 add_watcher() i=6 2024-09-12T00:35:10.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.701+0000 7f4d828d99c0 20 add_watcher() i=7 2024-09-12T00:35:10.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.701+0000 7f4d828d99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:10.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.705+0000 7f4c36fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:10.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.705+0000 7f4d828d99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:10.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.705+0000 7f4d828d99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:10.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.705+0000 7f4d828d99c0 5 note: GC not initialized 2024-09-12T00:35:10.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.705+0000 7f4c35fdb640 20 reqs_thread_entry: start 2024-09-12T00:35:10.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.705+0000 7f4d828d99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:10.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.705+0000 7f4d828d99c0 20 Filter name: none 2024-09-12T00:35:10.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.705+0000 7f4ba77fe640 20 reqs_thread_entry: start 2024-09-12T00:35:10.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.705+0000 7f4d828d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.709+0000 7f4d828d99c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:35:10.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.709+0000 7f4d828d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.709+0000 7f4d828d99c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:35:10.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.709+0000 7f4d828d99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:10.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.709+0000 7f4d828d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.709+0000 7f4d828d99c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:35:10.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.709+0000 7f4d828d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:10.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.709+0000 7f4d828d99c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:35:10.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.709+0000 7f4d828d99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:10.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.713+0000 7f4c36fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:10.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.717+0000 7f4d828d99c0 20 remove_watcher() i=0 2024-09-12T00:35:10.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.717+0000 7f4d828d99c0 2 removed watcher, disabling cache 2024-09-12T00:35:10.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.717+0000 7f4d828d99c0 20 remove_watcher() i=1 2024-09-12T00:35:10.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.721+0000 7f4d828d99c0 20 remove_watcher() i=2 2024-09-12T00:35:10.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.721+0000 7f4d828d99c0 20 remove_watcher() i=3 2024-09-12T00:35:10.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.725+0000 7f4d828d99c0 20 remove_watcher() i=4 2024-09-12T00:35:10.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.725+0000 7f4d828d99c0 20 remove_watcher() i=5 2024-09-12T00:35:10.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.729+0000 7f4d828d99c0 20 remove_watcher() i=6 2024-09-12T00:35:10.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:10.733+0000 7f4d828d99c0 20 remove_watcher() i=7 2024-09-12T00:35:10.744 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:10.744 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:35:10.744 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-set-target-layout id: e2043445-c131-4520-984d-b4d52f038a6b.4538.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:35:10.744 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:10.745 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:10.745 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:10.749 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:10.749 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:10.795 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:10.795 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:10.841 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T00:35:10.841 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:10.843 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:10.843 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:10.865 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:10.865 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:10.911 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:10.912 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:10.933 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:10.933 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:10.953 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:10.953 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:10.974 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:10.974 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:10.996 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:10.996 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:11.017 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:11.018 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:11.039 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:11.039 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:11.060 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:11.060 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:11.083 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:11.083 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:11.104 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:11.104 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:11.124 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:11.125 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:11.145 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:11.146 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:11.166 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:11.166 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:11.187 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:11.187 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:11.210 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:11.210 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:11.282 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:11.282 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:11.298 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:11.298 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:11.315 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:11.316 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:11.333 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:11.333 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:11.352 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:11.352 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:11.369 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:35:11.402 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:11.402 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:11.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.449+0000 7f34bc5e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.453+0000 7f34bc5e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:11.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.453+0000 7f34bc5e49c0 20 realm 2024-09-12T00:35:11.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.453+0000 7f34bc5e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.453+0000 7f34bc5e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:11.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.453+0000 7f34bc5e49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:11.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.453+0000 7f34bc5e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.453+0000 7f34bc5e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:11.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.453+0000 7f34bc5e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.453+0000 7f34bc5e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:11.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.453+0000 7f34bc5e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.457+0000 7f34bc5e49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:11.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.457+0000 7f34bc5e49c0 20 searching for the correct realm 2024-09-12T00:35:11.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.457+0000 7f34ba8eb640 0 -- 172.21.15.138:0/414676586 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x55c09f555bb0 msgr2=0x55c09f558020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:11.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.465+0000 7f34ba0ea640 0 -- 172.21.15.138:0/414676586 >> [v2:172.21.15.138:6800/1437861584,v1:172.21.15.138:6801/1437861584] conn(0x55c09f559d40 msgr2=0x55c09f55c200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:11.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.473+0000 7f34bc5e49c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:11.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.473+0000 7f34bc5e49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:11.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.473+0000 7f34bc5e49c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:11.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.473+0000 7f34bc5e49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:11.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.473+0000 7f34bc5e49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:11.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.473+0000 7f34bc5e49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:11.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.473+0000 7f34bc5e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:11.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:11.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:11.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 20 zone default found 2024-09-12T00:35:11.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 4 Realm: () 2024-09-12T00:35:11.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:11.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:11.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:11.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 20 zonegroup default 2024-09-12T00:35:11.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:11.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:11.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:11.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 20 started sync module instance, tier type = 2024-09-12T00:35:11.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.477+0000 7f34bc5e49c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.497+0000 7f34bc5e49c0 20 add_watcher() i=0 2024-09-12T00:35:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.497+0000 7f34bc5e49c0 20 add_watcher() i=1 2024-09-12T00:35:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.497+0000 7f34bc5e49c0 20 add_watcher() i=2 2024-09-12T00:35:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.497+0000 7f34bc5e49c0 20 add_watcher() i=3 2024-09-12T00:35:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.497+0000 7f34bc5e49c0 20 add_watcher() i=4 2024-09-12T00:35:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.497+0000 7f34bc5e49c0 20 add_watcher() i=5 2024-09-12T00:35:11.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.497+0000 7f34bc5e49c0 20 add_watcher() i=6 2024-09-12T00:35:11.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.497+0000 7f34bc5e49c0 20 add_watcher() i=7 2024-09-12T00:35:11.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.501+0000 7f34bc5e49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:11.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.501+0000 7f3370fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:11.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.501+0000 7f34bc5e49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:11.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.501+0000 7f34bc5e49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:11.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.501+0000 7f34bc5e49c0 5 note: GC not initialized 2024-09-12T00:35:11.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.505+0000 7f32eb7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:11.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.505+0000 7f34bc5e49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:11.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.505+0000 7f34bc5e49c0 20 Filter name: none 2024-09-12T00:35:11.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.505+0000 7f32e97fa640 20 reqs_thread_entry: start 2024-09-12T00:35:11.501 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.505+0000 7f34bc5e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.505+0000 7f34bc5e49c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:11.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.505+0000 7f34bc5e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.505+0000 7f34bc5e49c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:35:11.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.505+0000 7f34bc5e49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:11.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.505+0000 7f34bc5e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.505+0000 7f34bc5e49c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:11.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.505+0000 7f34bc5e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.505+0000 7f34bc5e49c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:35:11.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.505+0000 7f34bc5e49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:11.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.509+0000 7f3370fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:11.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.513+0000 7f34bc5e49c0 20 remove_watcher() i=0 2024-09-12T00:35:11.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.513+0000 7f34bc5e49c0 2 removed watcher, disabling cache 2024-09-12T00:35:11.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.517+0000 7f34bc5e49c0 20 remove_watcher() i=1 2024-09-12T00:35:11.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.517+0000 7f34bc5e49c0 20 remove_watcher() i=2 2024-09-12T00:35:11.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.521+0000 7f34bc5e49c0 20 remove_watcher() i=3 2024-09-12T00:35:11.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.521+0000 7f34bc5e49c0 20 remove_watcher() i=4 2024-09-12T00:35:11.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.525+0000 7f34bc5e49c0 20 remove_watcher() i=5 2024-09-12T00:35:11.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.525+0000 7f34bc5e49c0 20 remove_watcher() i=6 2024-09-12T00:35:11.526 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.529+0000 7f34bc5e49c0 20 remove_watcher() i=7 2024-09-12T00:35:11.541 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:11.542 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:35:11.542 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-trim-reshard-log-entries id: e2043445-c131-4520-984d-b4d52f038a6b.4538.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:35:11.542 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:11.542 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T00:35:11.575 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:11.575 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:11.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.621+0000 7fbd3048e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.621+0000 7fbd3048e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:11.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.621+0000 7fbd3048e9c0 20 realm 2024-09-12T00:35:11.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.621+0000 7fbd3048e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.625+0000 7fbd3048e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:11.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.625+0000 7fbd3048e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:11.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.625+0000 7fbd3048e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.625+0000 7fbd3048e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:11.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.625+0000 7fbd3048e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.625+0000 7fbd3048e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:11.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.625+0000 7fbd3048e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.625+0000 7fbd3048e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:11.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.625+0000 7fbd3048e9c0 20 searching for the correct realm 2024-09-12T00:35:11.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.629+0000 7fbd2e795640 0 -- 172.21.15.138:0/2625994354 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55a5c843fd30 msgr2=0x55a5c84421f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:11.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.637+0000 7fbd2d793640 0 -- 172.21.15.138:0/2625994354 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55a5c843b030 msgr2=0x55a5c843d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:11.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:11.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:11.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:11.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:11.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:11.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:11.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:11.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:11.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:11.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 zone default found 2024-09-12T00:35:11.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 4 Realm: () 2024-09-12T00:35:11.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:11.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:11.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:11.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 zonegroup default 2024-09-12T00:35:11.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:11.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:11.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:11.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 started sync module instance, tier type = 2024-09-12T00:35:11.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.645+0000 7fbd3048e9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:11.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.665+0000 7fbd3048e9c0 20 add_watcher() i=0 2024-09-12T00:35:11.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.665+0000 7fbd3048e9c0 20 add_watcher() i=1 2024-09-12T00:35:11.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.665+0000 7fbd3048e9c0 20 add_watcher() i=2 2024-09-12T00:35:11.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.665+0000 7fbd3048e9c0 20 add_watcher() i=3 2024-09-12T00:35:11.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.665+0000 7fbd3048e9c0 20 add_watcher() i=4 2024-09-12T00:35:11.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.665+0000 7fbd3048e9c0 20 add_watcher() i=5 2024-09-12T00:35:11.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.665+0000 7fbd3048e9c0 20 add_watcher() i=6 2024-09-12T00:35:11.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.669+0000 7fbd3048e9c0 20 add_watcher() i=7 2024-09-12T00:35:11.664 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.669+0000 7fbd3048e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:11.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.669+0000 7fbbdffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:11.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.669+0000 7fbd3048e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:11.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.669+0000 7fbd3048e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:11.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.669+0000 7fbd3048e9c0 5 note: GC not initialized 2024-09-12T00:35:11.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.669+0000 7fbbdeffd640 20 reqs_thread_entry: start 2024-09-12T00:35:11.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.673+0000 7fbd3048e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:11.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.673+0000 7fbd3048e9c0 20 Filter name: none 2024-09-12T00:35:11.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.673+0000 7fbbdcff9640 20 reqs_thread_entry: start 2024-09-12T00:35:11.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.673+0000 7fbd3048e9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:35:11.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.673+0000 7fbd3048e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.673+0000 7fbd3048e9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:11.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.673+0000 7fbd3048e9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:35:11.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.673+0000 7fbd3048e9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:35:11.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.673+0000 7fbd3048e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 : miss 2024-09-12T00:35:11.670 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.673+0000 7fbd3048e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.673+0000 7fbd3048e9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:35:11.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.673+0000 7fbd3048e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 info.flags=0x17 2024-09-12T00:35:11.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.673+0000 7fbd3048e9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 to cache LRU end 2024-09-12T00:35:11.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.673+0000 7fbd3048e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:11.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.673+0000 7fbd3048e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:11.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.673+0000 7fbd3048e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 2024-09-12T00:35:11.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.685+0000 7fbd3048e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 info.flags=0x17 2024-09-12T00:35:11.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.685+0000 7fbd3048e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 to cache LRU end 2024-09-12T00:35:11.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.685+0000 7fbd3048e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:11.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.685+0000 7fbd3048e9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25, ofs0, ns] 2024-09-12T00:35:11.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.685+0000 7fbc117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333535 cookie 94170517883840 notifier 6377 bl.length()=939 2024-09-12T00:35:11.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.685+0000 7fbc117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 info.flags=0x17 2024-09-12T00:35:11.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.685+0000 7fbc117fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 to cache LRU end 2024-09-12T00:35:11.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.685+0000 7fbc117fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:11.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.685+0000 7fbd3048e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.25]): orig_sources= new_sources= 2024-09-12T00:35:11.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.685+0000 7fbd3048e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.25]): potential sources added=[] removed=[] 2024-09-12T00:35:11.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.685+0000 7fbd3048e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.25]): orig_dests= new_dests= 2024-09-12T00:35:11.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.685+0000 7fbd3048e9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.25]): potential dests added=[] removed=[] 2024-09-12T00:35:11.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.685+0000 7fbd3048e9c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T00:35:11.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.685+0000 7fbd3048e9c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T00:35:11.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.689+0000 7fbbdffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:11.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.693+0000 7fbd3048e9c0 20 remove_watcher() i=0 2024-09-12T00:35:11.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.693+0000 7fbd3048e9c0 2 removed watcher, disabling cache 2024-09-12T00:35:11.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.697+0000 7fbd3048e9c0 20 remove_watcher() i=1 2024-09-12T00:35:11.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.697+0000 7fbd3048e9c0 20 remove_watcher() i=2 2024-09-12T00:35:11.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.701+0000 7fbd3048e9c0 20 remove_watcher() i=3 2024-09-12T00:35:11.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.701+0000 7fbd3048e9c0 20 remove_watcher() i=4 2024-09-12T00:35:11.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.705+0000 7fbd3048e9c0 20 remove_watcher() i=5 2024-09-12T00:35:11.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.705+0000 7fbd3048e9c0 20 remove_watcher() i=6 2024-09-12T00:35:11.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.709+0000 7fbd3048e9c0 20 remove_watcher() i=7 2024-09-12T00:35:11.720 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:35:11.747 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:11.747 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:11.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.793+0000 7fb84aca79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.797+0000 7fb84aca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:11.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.797+0000 7fb84aca79c0 20 realm 2024-09-12T00:35:11.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.797+0000 7fb84aca79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.797+0000 7fb84aca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:11.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.797+0000 7fb84aca79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:11.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.797+0000 7fb84aca79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.797+0000 7fb84aca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:11.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.797+0000 7fb84aca79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.797+0000 7fb84aca79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:11.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.797+0000 7fb84aca79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:11.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.797+0000 7fb84aca79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:11.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.797+0000 7fb84aca79c0 20 searching for the correct realm 2024-09-12T00:35:11.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:11.805+0000 7fb848fae640 0 -- 172.21.15.138:0/423749022 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fb84000e070 msgr2=0x7fb84005d990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:12.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.021+0000 7fb848fae640 0 -- 172.21.15.138:0/423749022 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x559949b343c0 msgr2=0x559949b36880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:12.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.029+0000 7fb84aca79c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:12.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.029+0000 7fb84aca79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:12.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.029+0000 7fb84aca79c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:12.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.029+0000 7fb84aca79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:12.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.029+0000 7fb84aca79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:12.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.029+0000 7fb84aca79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:12.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.029+0000 7fb84aca79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.033+0000 7fb84aca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.033+0000 7fb84aca79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.033+0000 7fb84aca79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:12.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.033+0000 7fb84aca79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.033+0000 7fb84aca79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:12.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.033+0000 7fb84aca79c0 20 zone default found 2024-09-12T00:35:12.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.033+0000 7fb84aca79c0 4 Realm: () 2024-09-12T00:35:12.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.033+0000 7fb84aca79c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:12.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.033+0000 7fb84aca79c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:12.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.033+0000 7fb84aca79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:12.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.033+0000 7fb84aca79c0 20 zonegroup default 2024-09-12T00:35:12.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.033+0000 7fb84aca79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.033+0000 7fb84aca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.033+0000 7fb84aca79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.033+0000 7fb84aca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.033+0000 7fb84aca79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.037+0000 7fb84aca79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.037+0000 7fb84aca79c0 20 started sync module instance, tier type = 2024-09-12T00:35:12.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.037+0000 7fb84aca79c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:12.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.061+0000 7fb84aca79c0 20 add_watcher() i=0 2024-09-12T00:35:12.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.061+0000 7fb84aca79c0 20 add_watcher() i=1 2024-09-12T00:35:12.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.061+0000 7fb84aca79c0 20 add_watcher() i=2 2024-09-12T00:35:12.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.061+0000 7fb84aca79c0 20 add_watcher() i=3 2024-09-12T00:35:12.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.061+0000 7fb84aca79c0 20 add_watcher() i=4 2024-09-12T00:35:12.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.061+0000 7fb84aca79c0 20 add_watcher() i=5 2024-09-12T00:35:12.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.061+0000 7fb84aca79c0 20 add_watcher() i=6 2024-09-12T00:35:12.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.061+0000 7fb84aca79c0 20 add_watcher() i=7 2024-09-12T00:35:12.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.061+0000 7fb84aca79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:12.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.065+0000 7fb6fefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:12.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.069+0000 7fb84aca79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:12.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.069+0000 7fb84aca79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:12.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.069+0000 7fb84aca79c0 5 note: GC not initialized 2024-09-12T00:35:12.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.069+0000 7fb6fdfdb640 20 reqs_thread_entry: start 2024-09-12T00:35:12.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.069+0000 7fb84aca79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:12.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.069+0000 7fb84aca79c0 20 Filter name: none 2024-09-12T00:35:12.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.069+0000 7fb66f7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:12.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.069+0000 7fb84aca79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.069+0000 7fb84aca79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:12.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.069+0000 7fb84aca79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.069+0000 7fb84aca79c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:35:12.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.069+0000 7fb84aca79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:12.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.069+0000 7fb84aca79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.069+0000 7fb84aca79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:12.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.069+0000 7fb84aca79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.073+0000 7fb84aca79c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:35:12.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.073+0000 7fb84aca79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:12.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.077+0000 7fb6fefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:12.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.081+0000 7fb84aca79c0 20 remove_watcher() i=0 2024-09-12T00:35:12.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.081+0000 7fb84aca79c0 2 removed watcher, disabling cache 2024-09-12T00:35:12.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.081+0000 7fb84aca79c0 20 remove_watcher() i=1 2024-09-12T00:35:12.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.085+0000 7fb84aca79c0 20 remove_watcher() i=2 2024-09-12T00:35:12.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.085+0000 7fb84aca79c0 20 remove_watcher() i=3 2024-09-12T00:35:12.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.089+0000 7fb84aca79c0 20 remove_watcher() i=4 2024-09-12T00:35:12.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.093+0000 7fb84aca79c0 20 remove_watcher() i=5 2024-09-12T00:35:12.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.093+0000 7fb84aca79c0 20 remove_watcher() i=6 2024-09-12T00:35:12.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.097+0000 7fb84aca79c0 20 remove_watcher() i=7 2024-09-12T00:35:12.112 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:12.112 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:35:12.112 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-trim-reshard-log-entries id: e2043445-c131-4520-984d-b4d52f038a6b.4538.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:35:12.112 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:12.113 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:12.113 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:12.126 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:12.126 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:12.170 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:35:12.207 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:12.207 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:12.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.253+0000 7fc00838a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.257+0000 7fc00838a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.257+0000 7fc00838a9c0 20 realm 2024-09-12T00:35:12.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.257+0000 7fc00838a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.257+0000 7fc00838a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.257+0000 7fc00838a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:12.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.257+0000 7fc00838a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.257+0000 7fc00838a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.257+0000 7fc00838a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.257+0000 7fc00838a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:12.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.257+0000 7fc00838a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.257+0000 7fc00838a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:12.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.257+0000 7fc00838a9c0 20 searching for the correct realm 2024-09-12T00:35:12.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.261+0000 7fc00568f640 0 -- 172.21.15.138:0/2081505598 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7fbff8020060 msgr2=0x7fbff80019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:12.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.473+0000 7fc00568f640 0 -- 172.21.15.138:0/2081505598 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55e9a0819840 msgr2=0x55e9a081bc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:12.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.489+0000 7fc00838a9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:12.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.489+0000 7fc00838a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:12.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.489+0000 7fc00838a9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:12.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.489+0000 7fc00838a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:12.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.489+0000 7fc00838a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:12.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.489+0000 7fc00838a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:12.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.489+0000 7fc00838a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.489+0000 7fc00838a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.489+0000 7fc00838a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.489+0000 7fc00838a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:12.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.489+0000 7fc00838a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.493+0000 7fc00838a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:12.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.493+0000 7fc00838a9c0 20 zone default found 2024-09-12T00:35:12.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.493+0000 7fc00838a9c0 4 Realm: () 2024-09-12T00:35:12.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.493+0000 7fc00838a9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:12.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.493+0000 7fc00838a9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:12.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.493+0000 7fc00838a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:12.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.493+0000 7fc00838a9c0 20 zonegroup default 2024-09-12T00:35:12.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.493+0000 7fc00838a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.493+0000 7fc00838a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.493+0000 7fc00838a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.493+0000 7fc00838a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.493+0000 7fc00838a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.493+0000 7fc00838a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.493+0000 7fc00838a9c0 20 started sync module instance, tier type = 2024-09-12T00:35:12.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.493+0000 7fc00838a9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:12.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.517+0000 7fc00838a9c0 20 add_watcher() i=0 2024-09-12T00:35:12.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.517+0000 7fc00838a9c0 20 add_watcher() i=1 2024-09-12T00:35:12.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.517+0000 7fc00838a9c0 20 add_watcher() i=2 2024-09-12T00:35:12.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.517+0000 7fc00838a9c0 20 add_watcher() i=3 2024-09-12T00:35:12.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.517+0000 7fc00838a9c0 20 add_watcher() i=4 2024-09-12T00:35:12.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.517+0000 7fc00838a9c0 20 add_watcher() i=5 2024-09-12T00:35:12.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.517+0000 7fc00838a9c0 20 add_watcher() i=6 2024-09-12T00:35:12.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.521+0000 7fc00838a9c0 20 add_watcher() i=7 2024-09-12T00:35:12.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.521+0000 7fc00838a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:12.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.525+0000 7fbeb77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:12.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.525+0000 7fc00838a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:12.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.525+0000 7fc00838a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:12.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.525+0000 7fc00838a9c0 5 note: GC not initialized 2024-09-12T00:35:12.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.525+0000 7fbeb67fc640 20 reqs_thread_entry: start 2024-09-12T00:35:12.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.525+0000 7fc00838a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:12.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.525+0000 7fc00838a9c0 20 Filter name: none 2024-09-12T00:35:12.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.525+0000 7fbe27fff640 20 reqs_thread_entry: start 2024-09-12T00:35:12.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.525+0000 7fc00838a9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:35:12.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.525+0000 7fc00838a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.525+0000 7fc00838a9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:12.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.525+0000 7fc00838a9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:35:12.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.525+0000 7fc00838a9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:35:12.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.525+0000 7fc00838a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 : miss 2024-09-12T00:35:12.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.525+0000 7fc00838a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.529+0000 7fc00838a9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:35:12.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.529+0000 7fc00838a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 info.flags=0x17 2024-09-12T00:35:12.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.529+0000 7fc00838a9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 to cache LRU end 2024-09-12T00:35:12.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.529+0000 7fc00838a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:12.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.529+0000 7fc00838a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:12.525 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.529+0000 7fc00838a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 2024-09-12T00:35:12.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.529+0000 7fc00838a9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:35:12.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.545+0000 7fc00838a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 info.flags=0x17 2024-09-12T00:35:12.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.545+0000 7fc00838a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 to cache LRU end 2024-09-12T00:35:12.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.545+0000 7fc00838a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:12.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.545+0000 7fc00838a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25, ofs0, ns] 2024-09-12T00:35:12.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.545+0000 7fbee97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333536 cookie 94461908640672 notifier 6410 bl.length()=939 2024-09-12T00:35:12.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.545+0000 7fbee97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 info.flags=0x17 2024-09-12T00:35:12.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.545+0000 7fbee97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 to cache LRU end 2024-09-12T00:35:12.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.545+0000 7fbee97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:12.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.545+0000 7fc00838a9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.25]): orig_sources= new_sources= 2024-09-12T00:35:12.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.545+0000 7fc00838a9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.25]): potential sources added=[] removed=[] 2024-09-12T00:35:12.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.545+0000 7fc00838a9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.25]): orig_dests= new_dests= 2024-09-12T00:35:12.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.545+0000 7fc00838a9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.25]): potential dests added=[] removed=[] 2024-09-12T00:35:12.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.0 2024-09-12T00:35:12.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.0 2024-09-12T00:35:12.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.1 2024-09-12T00:35:12.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.1 2024-09-12T00:35:12.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.2 2024-09-12T00:35:12.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.2 2024-09-12T00:35:12.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.3 2024-09-12T00:35:12.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.3 2024-09-12T00:35:12.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.4 2024-09-12T00:35:12.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.4 2024-09-12T00:35:12.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.5 2024-09-12T00:35:12.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.5 2024-09-12T00:35:12.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.6 2024-09-12T00:35:12.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.6 2024-09-12T00:35:12.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.7 2024-09-12T00:35:12.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.7 2024-09-12T00:35:12.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.8 2024-09-12T00:35:12.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.8 2024-09-12T00:35:12.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.9 2024-09-12T00:35:12.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.9 2024-09-12T00:35:12.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.10 2024-09-12T00:35:12.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.10 2024-09-12T00:35:12.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.11 2024-09-12T00:35:12.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2.11 2024-09-12T00:35:12.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.557+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.0 2024-09-12T00:35:12.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.561+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.1 2024-09-12T00:35:12.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.561+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2 2024-09-12T00:35:12.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.561+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.3 2024-09-12T00:35:12.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.561+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.4 2024-09-12T00:35:12.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.565+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.5 2024-09-12T00:35:12.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.565+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.6 2024-09-12T00:35:12.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.565+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.7 2024-09-12T00:35:12.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.565+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.8 2024-09-12T00:35:12.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.569+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.9 2024-09-12T00:35:12.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.569+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.10 2024-09-12T00:35:12.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.577+0000 7fc00838a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:12.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.577+0000 7fc00838a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 2024-09-12T00:35:12.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.581+0000 7fc00838a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 info.flags=0x17 2024-09-12T00:35:12.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.581+0000 7fc00838a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 to cache LRU end 2024-09-12T00:35:12.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.581+0000 7fc00838a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:12.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.581+0000 7fc00838a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25, ofs0, ns] 2024-09-12T00:35:12.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.581+0000 7fbee97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333537 cookie 94461908640672 notifier 6410 bl.length()=939 2024-09-12T00:35:12.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.581+0000 7fbee97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 info.flags=0x17 2024-09-12T00:35:12.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.581+0000 7fbee97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 to cache LRU end 2024-09-12T00:35:12.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.581+0000 7fbee97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:12.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.581+0000 7fc00838a9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.25]): orig_sources= new_sources= 2024-09-12T00:35:12.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.581+0000 7fc00838a9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.25]): potential sources added=[] removed=[] 2024-09-12T00:35:12.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.581+0000 7fc00838a9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.25]): orig_dests= new_dests= 2024-09-12T00:35:12.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.581+0000 7fc00838a9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.25]): potential dests added=[] removed=[] 2024-09-12T00:35:12.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.589+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.0 2024-09-12T00:35:12.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.589+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.1 2024-09-12T00:35:12.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.589+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.2 2024-09-12T00:35:12.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.589+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.3 2024-09-12T00:35:12.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.589+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.4 2024-09-12T00:35:12.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.593+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.5 2024-09-12T00:35:12.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.593+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.6 2024-09-12T00:35:12.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.593+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.7 2024-09-12T00:35:12.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.593+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.8 2024-09-12T00:35:12.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.593+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.9 2024-09-12T00:35:12.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.597+0000 7fc00838a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.25.10 2024-09-12T00:35:12.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.597+0000 7fc00838a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:12.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.597+0000 7fc00838a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 2024-09-12T00:35:12.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.601+0000 7fc00838a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 info.flags=0x17 2024-09-12T00:35:12.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.601+0000 7fc00838a9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 to cache LRU end 2024-09-12T00:35:12.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.601+0000 7fc00838a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:12.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.601+0000 7fc00838a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25, ofs0, ns] 2024-09-12T00:35:12.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.601+0000 7fbee8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333538 cookie 94461908640672 notifier 6410 bl.length()=907 2024-09-12T00:35:12.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.601+0000 7fbee8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 info.flags=0x17 2024-09-12T00:35:12.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.601+0000 7fbee8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.25 to cache LRU end 2024-09-12T00:35:12.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.601+0000 7fbee8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:12.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.601+0000 7fc00838a9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.25]): orig_sources= new_sources= 2024-09-12T00:35:12.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.601+0000 7fc00838a9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.25]): potential sources added=[] removed=[] 2024-09-12T00:35:12.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.601+0000 7fc00838a9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.25]): orig_dests= new_dests= 2024-09-12T00:35:12.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.601+0000 7fc00838a9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.25]): potential dests added=[] removed=[] 2024-09-12T00:35:12.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.609+0000 7fc00838a9c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:35:12.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.609+0000 7fbeb77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:12.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.613+0000 7fc00838a9c0 20 remove_watcher() i=0 2024-09-12T00:35:12.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.613+0000 7fc00838a9c0 2 removed watcher, disabling cache 2024-09-12T00:35:12.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.617+0000 7fc00838a9c0 20 remove_watcher() i=1 2024-09-12T00:35:12.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.617+0000 7fc00838a9c0 20 remove_watcher() i=2 2024-09-12T00:35:12.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.621+0000 7fc00838a9c0 20 remove_watcher() i=3 2024-09-12T00:35:12.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.621+0000 7fc00838a9c0 20 remove_watcher() i=4 2024-09-12T00:35:12.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.625+0000 7fc00838a9c0 20 remove_watcher() i=5 2024-09-12T00:35:12.625 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.629+0000 7fc00838a9c0 20 remove_watcher() i=6 2024-09-12T00:35:12.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.629+0000 7fc00838a9c0 20 remove_watcher() i=7 2024-09-12T00:35:12.648 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:35:12.675 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:12.676 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:12.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.721+0000 7f559fd9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.725+0000 7f559fd9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.725+0000 7f559fd9d9c0 20 realm 2024-09-12T00:35:12.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.725+0000 7f559fd9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.725+0000 7f559fd9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.725+0000 7f559fd9d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:12.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.725+0000 7f559fd9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.725+0000 7f559fd9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.725+0000 7f559fd9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.729+0000 7f559fd9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:12.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.729+0000 7f559fd9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.729+0000 7f559fd9d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:12.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.729+0000 7f559fd9d9c0 20 searching for the correct realm 2024-09-12T00:35:12.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.733+0000 7f559d0a2640 0 -- 172.21.15.138:0/1937977657 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f5590124030 msgr2=0x7f5590102920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:12.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.737+0000 7f559d0a2640 0 -- 172.21.15.138:0/1937977657 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x5601ada34830 msgr2=0x5601ada36c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:12.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.745+0000 7f559fd9d9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:12.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.745+0000 7f559fd9d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:12.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.745+0000 7f559fd9d9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:12.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.745+0000 7f559fd9d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:12.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.745+0000 7f559fd9d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:12.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.745+0000 7f559fd9d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:12.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.745+0000 7f559fd9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:12.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:12.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 20 zone default found 2024-09-12T00:35:12.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 4 Realm: () 2024-09-12T00:35:12.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:12.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:12.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:12.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 20 zonegroup default 2024-09-12T00:35:12.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:12.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 20 started sync module instance, tier type = 2024-09-12T00:35:12.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.749+0000 7f559fd9d9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:12.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.769+0000 7f559fd9d9c0 20 add_watcher() i=0 2024-09-12T00:35:12.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.769+0000 7f559fd9d9c0 20 add_watcher() i=1 2024-09-12T00:35:12.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.769+0000 7f559fd9d9c0 20 add_watcher() i=2 2024-09-12T00:35:12.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.769+0000 7f559fd9d9c0 20 add_watcher() i=3 2024-09-12T00:35:12.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.769+0000 7f559fd9d9c0 20 add_watcher() i=4 2024-09-12T00:35:12.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.769+0000 7f559fd9d9c0 20 add_watcher() i=5 2024-09-12T00:35:12.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.769+0000 7f559fd9d9c0 20 add_watcher() i=6 2024-09-12T00:35:12.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.769+0000 7f559fd9d9c0 20 add_watcher() i=7 2024-09-12T00:35:12.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.769+0000 7f559fd9d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:12.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.773+0000 7f544f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:12.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.773+0000 7f559fd9d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:12.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.773+0000 7f559fd9d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:12.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.773+0000 7f559fd9d9c0 5 note: GC not initialized 2024-09-12T00:35:12.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.773+0000 7f544e7fc640 20 reqs_thread_entry: start 2024-09-12T00:35:12.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.777+0000 7f559fd9d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:12.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.777+0000 7f559fd9d9c0 20 Filter name: none 2024-09-12T00:35:12.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.777+0000 7f53bffff640 20 reqs_thread_entry: start 2024-09-12T00:35:12.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.777+0000 7f559fd9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.777+0000 7f559fd9d9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:12.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.777+0000 7f559fd9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.777+0000 7f559fd9d9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:35:12.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.777+0000 7f559fd9d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:12.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.777+0000 7f559fd9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.777+0000 7f559fd9d9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:12.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.777+0000 7f559fd9d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:12.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.777+0000 7f559fd9d9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:35:12.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.777+0000 7f559fd9d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:12.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.781+0000 7f544f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:12.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.785+0000 7f559fd9d9c0 20 remove_watcher() i=0 2024-09-12T00:35:12.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.785+0000 7f559fd9d9c0 2 removed watcher, disabling cache 2024-09-12T00:35:12.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.789+0000 7f559fd9d9c0 20 remove_watcher() i=1 2024-09-12T00:35:12.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.789+0000 7f559fd9d9c0 20 remove_watcher() i=2 2024-09-12T00:35:12.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.793+0000 7f559fd9d9c0 20 remove_watcher() i=3 2024-09-12T00:35:12.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.793+0000 7f559fd9d9c0 20 remove_watcher() i=4 2024-09-12T00:35:12.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.797+0000 7f559fd9d9c0 20 remove_watcher() i=5 2024-09-12T00:35:12.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.797+0000 7f559fd9d9c0 20 remove_watcher() i=6 2024-09-12T00:35:12.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:12.801+0000 7f559fd9d9c0 20 remove_watcher() i=7 2024-09-12T00:35:12.812 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:12.813 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:35:12.813 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-trim-reshard-log-entries id: e2043445-c131-4520-984d-b4d52f038a6b.4538.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:35:12.813 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:12.814 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:12.814 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:12.817 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:12.817 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:12.866 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:12.866 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:12.915 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T00:35:12.915 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:12.916 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:12.916 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:12.938 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:12.938 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:12.983 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:12.983 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.005 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.005 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.025 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.025 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.046 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.046 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.066 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.066 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.085 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.086 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.109 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.109 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.129 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.129 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.151 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.151 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.171 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.171 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.193 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.193 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.214 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.214 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.235 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.235 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.254 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.255 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.276 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.276 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.294 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.294 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.315 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.315 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.335 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.335 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.355 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.355 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.376 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:13.376 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:13.394 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:35:13.426 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:13.427 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:13.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.473+0000 7fbfd0f7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.477+0000 7fbfd0f7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:13.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.477+0000 7fbfd0f7b9c0 20 realm 2024-09-12T00:35:13.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.477+0000 7fbfd0f7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.477+0000 7fbfd0f7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:13.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.477+0000 7fbfd0f7b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:13.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.477+0000 7fbfd0f7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.477+0000 7fbfd0f7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:13.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.477+0000 7fbfd0f7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.477+0000 7fbfd0f7b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:13.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.477+0000 7fbfd0f7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.477+0000 7fbfd0f7b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:13.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.477+0000 7fbfd0f7b9c0 20 searching for the correct realm 2024-09-12T00:35:13.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.485+0000 7fbfcf282640 0 -- 172.21.15.138:0/3168006334 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fbfc0031040 msgr2=0x7fbfc0031930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:13.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.701+0000 7fbfcf282640 0 -- 172.21.15.138:0/3168006334 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55d773c6e1c0 msgr2=0x55d773c70680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:13.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.709+0000 7fbfd0f7b9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:13.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.709+0000 7fbfd0f7b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:13.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.709+0000 7fbfd0f7b9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:13.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.709+0000 7fbfd0f7b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:13.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.709+0000 7fbfd0f7b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:13.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.709+0000 7fbfd0f7b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:13.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.709+0000 7fbfd0f7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.709+0000 7fbfd0f7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:13.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.709+0000 7fbfd0f7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.713+0000 7fbfd0f7b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:13.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.713+0000 7fbfd0f7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.713+0000 7fbfd0f7b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:13.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.713+0000 7fbfd0f7b9c0 20 zone default found 2024-09-12T00:35:13.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.713+0000 7fbfd0f7b9c0 4 Realm: () 2024-09-12T00:35:13.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.713+0000 7fbfd0f7b9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:13.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.713+0000 7fbfd0f7b9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:13.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.713+0000 7fbfd0f7b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:13.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.713+0000 7fbfd0f7b9c0 20 zonegroup default 2024-09-12T00:35:13.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.713+0000 7fbfd0f7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.713+0000 7fbfd0f7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:13.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.713+0000 7fbfd0f7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.713+0000 7fbfd0f7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:13.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.713+0000 7fbfd0f7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.713+0000 7fbfd0f7b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:13.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.713+0000 7fbfd0f7b9c0 20 started sync module instance, tier type = 2024-09-12T00:35:13.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.713+0000 7fbfd0f7b9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:13.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.737+0000 7fbfd0f7b9c0 20 add_watcher() i=0 2024-09-12T00:35:13.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.737+0000 7fbfd0f7b9c0 20 add_watcher() i=1 2024-09-12T00:35:13.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.737+0000 7fbfd0f7b9c0 20 add_watcher() i=2 2024-09-12T00:35:13.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.737+0000 7fbfd0f7b9c0 20 add_watcher() i=3 2024-09-12T00:35:13.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.737+0000 7fbfd0f7b9c0 20 add_watcher() i=4 2024-09-12T00:35:13.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.737+0000 7fbfd0f7b9c0 20 add_watcher() i=5 2024-09-12T00:35:13.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.737+0000 7fbfd0f7b9c0 20 add_watcher() i=6 2024-09-12T00:35:13.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.741+0000 7fbfd0f7b9c0 20 add_watcher() i=7 2024-09-12T00:35:13.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.741+0000 7fbfd0f7b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:13.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.745+0000 7fbe857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:13.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.745+0000 7fbfd0f7b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:13.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.745+0000 7fbfd0f7b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:13.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.745+0000 7fbfd0f7b9c0 5 note: GC not initialized 2024-09-12T00:35:13.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.745+0000 7fbdfffff640 20 reqs_thread_entry: start 2024-09-12T00:35:13.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.745+0000 7fbfd0f7b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:13.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.745+0000 7fbfd0f7b9c0 20 Filter name: none 2024-09-12T00:35:13.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.749+0000 7fbdfdffb640 20 reqs_thread_entry: start 2024-09-12T00:35:13.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.749+0000 7fbfd0f7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.749+0000 7fbfd0f7b9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:13.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.749+0000 7fbfd0f7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.749+0000 7fbfd0f7b9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:35:13.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.749+0000 7fbfd0f7b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:13.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.749+0000 7fbfd0f7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.749+0000 7fbfd0f7b9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:13.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.749+0000 7fbfd0f7b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.749+0000 7fbfd0f7b9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:35:13.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.749+0000 7fbfd0f7b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:13.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.753+0000 7fbe857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:13.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.757+0000 7fbfd0f7b9c0 20 remove_watcher() i=0 2024-09-12T00:35:13.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.757+0000 7fbfd0f7b9c0 2 removed watcher, disabling cache 2024-09-12T00:35:13.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.761+0000 7fbfd0f7b9c0 20 remove_watcher() i=1 2024-09-12T00:35:13.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.761+0000 7fbfd0f7b9c0 20 remove_watcher() i=2 2024-09-12T00:35:13.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.765+0000 7fbfd0f7b9c0 20 remove_watcher() i=3 2024-09-12T00:35:13.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.765+0000 7fbfd0f7b9c0 20 remove_watcher() i=4 2024-09-12T00:35:13.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.769+0000 7fbfd0f7b9c0 20 remove_watcher() i=5 2024-09-12T00:35:13.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.769+0000 7fbfd0f7b9c0 20 remove_watcher() i=6 2024-09-12T00:35:13.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.773+0000 7fbfd0f7b9c0 20 remove_watcher() i=7 2024-09-12T00:35:13.788 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:13.788 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:35:13.788 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-trim-reshard-log-entries id: e2043445-c131-4520-984d-b4d52f038a6b.4538.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:35:13.788 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:13.789 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T00:35:13.827 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:13.827 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:13.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.873+0000 7ff9540049c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.873+0000 7ff9540049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:13.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.873+0000 7ff9540049c0 20 realm 2024-09-12T00:35:13.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.873+0000 7ff9540049c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.877+0000 7ff9540049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:13.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.877+0000 7ff9540049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:13.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.877+0000 7ff9540049c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.877+0000 7ff9540049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:13.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.877+0000 7ff9540049c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.877+0000 7ff9540049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:13.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.877+0000 7ff9540049c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:13.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.877+0000 7ff9540049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:13.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.877+0000 7ff9540049c0 20 searching for the correct realm 2024-09-12T00:35:13.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:13.881+0000 7ff95230b640 0 -- 172.21.15.138:0/1939275141 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7ff9440c9410 msgr2=0x7ff9440c9870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:14.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.097+0000 7ff95230b640 0 -- 172.21.15.138:0/1939275141 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x556ea00655e0 msgr2=0x556ea0067aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:14.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.105+0000 7ff9540049c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:14.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.105+0000 7ff9540049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:14.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.105+0000 7ff9540049c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:14.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.105+0000 7ff9540049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:14.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.105+0000 7ff9540049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:14.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.105+0000 7ff9540049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:14.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.105+0000 7ff9540049c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.105+0000 7ff9540049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:14.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.105+0000 7ff9540049c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.109+0000 7ff9540049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:14.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.109+0000 7ff9540049c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.109+0000 7ff9540049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:14.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.109+0000 7ff9540049c0 20 zone default found 2024-09-12T00:35:14.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.109+0000 7ff9540049c0 4 Realm: () 2024-09-12T00:35:14.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.109+0000 7ff9540049c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:14.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.109+0000 7ff9540049c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:14.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.109+0000 7ff9540049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:14.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.109+0000 7ff9540049c0 20 zonegroup default 2024-09-12T00:35:14.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.109+0000 7ff9540049c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.109+0000 7ff9540049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:14.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.109+0000 7ff9540049c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.109+0000 7ff9540049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:14.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.109+0000 7ff9540049c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.109+0000 7ff9540049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:14.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.109+0000 7ff9540049c0 20 started sync module instance, tier type = 2024-09-12T00:35:14.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.109+0000 7ff9540049c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:14.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.133+0000 7ff9540049c0 20 add_watcher() i=0 2024-09-12T00:35:14.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.133+0000 7ff9540049c0 20 add_watcher() i=1 2024-09-12T00:35:14.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.133+0000 7ff9540049c0 20 add_watcher() i=2 2024-09-12T00:35:14.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.133+0000 7ff9540049c0 20 add_watcher() i=3 2024-09-12T00:35:14.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.133+0000 7ff9540049c0 20 add_watcher() i=4 2024-09-12T00:35:14.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.133+0000 7ff9540049c0 20 add_watcher() i=5 2024-09-12T00:35:14.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.133+0000 7ff9540049c0 20 add_watcher() i=6 2024-09-12T00:35:14.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.137+0000 7ff9540049c0 20 add_watcher() i=7 2024-09-12T00:35:14.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.137+0000 7ff9540049c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:14.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.141+0000 7ff8037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:14.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.141+0000 7ff9540049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:14.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.141+0000 7ff9540049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:14.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.141+0000 7ff9540049c0 5 note: GC not initialized 2024-09-12T00:35:14.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.141+0000 7ff8027fc640 20 reqs_thread_entry: start 2024-09-12T00:35:14.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.141+0000 7ff9540049c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:14.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.141+0000 7ff9540049c0 20 Filter name: none 2024-09-12T00:35:14.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.141+0000 7ff773fff640 20 reqs_thread_entry: start 2024-09-12T00:35:14.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.141+0000 7ff9540049c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:35:14.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.141+0000 7ff9540049c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.141+0000 7ff9540049c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:14.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.141+0000 7ff9540049c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:35:14.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.141+0000 7ff9540049c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:35:14.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.141+0000 7ff9540049c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.26 : miss 2024-09-12T00:35:14.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.141+0000 7ff9540049c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.145+0000 7ff9540049c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:35:14.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.145+0000 7ff9540049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.26 info.flags=0x17 2024-09-12T00:35:14.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.145+0000 7ff9540049c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.26 to cache LRU end 2024-09-12T00:35:14.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.145+0000 7ff9540049c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:14.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.145+0000 7ff9540049c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:14.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.145+0000 7ff9540049c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.26 2024-09-12T00:35:14.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.153+0000 7ff9540049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.26 info.flags=0x17 2024-09-12T00:35:14.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.153+0000 7ff9540049c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.26 to cache LRU end 2024-09-12T00:35:14.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.153+0000 7ff9540049c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:14.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.153+0000 7ff9540049c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.26, ofs0, ns] 2024-09-12T00:35:14.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.153+0000 7ff8357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333541 cookie 93933619565248 notifier 6849 bl.length()=939 2024-09-12T00:35:14.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.153+0000 7ff8357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.26 info.flags=0x17 2024-09-12T00:35:14.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.153+0000 7ff8357fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.26 to cache LRU end 2024-09-12T00:35:14.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.153+0000 7ff8357fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:14.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.157+0000 7ff9540049c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.26]): orig_sources= new_sources= 2024-09-12T00:35:14.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.157+0000 7ff9540049c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.26]): potential sources added=[] removed=[] 2024-09-12T00:35:14.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.157+0000 7ff9540049c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.26]): orig_dests= new_dests= 2024-09-12T00:35:14.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.157+0000 7ff9540049c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.26]): potential dests added=[] removed=[] 2024-09-12T00:35:14.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.157+0000 7ff9540049c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T00:35:14.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.157+0000 7ff9540049c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:35:14.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.0 2024-09-12T00:35:14.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.0 2024-09-12T00:35:14.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.1 2024-09-12T00:35:14.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.1 2024-09-12T00:35:14.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.2 2024-09-12T00:35:14.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.2 2024-09-12T00:35:14.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.3 2024-09-12T00:35:14.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.3 2024-09-12T00:35:14.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.4 2024-09-12T00:35:14.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.4 2024-09-12T00:35:14.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.5 2024-09-12T00:35:14.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.5 2024-09-12T00:35:14.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.6 2024-09-12T00:35:14.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.6 2024-09-12T00:35:14.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.7 2024-09-12T00:35:14.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.7 2024-09-12T00:35:14.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.8 2024-09-12T00:35:14.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.8 2024-09-12T00:35:14.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.9 2024-09-12T00:35:14.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.9 2024-09-12T00:35:14.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.10 2024-09-12T00:35:14.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.10 2024-09-12T00:35:14.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.11 2024-09-12T00:35:14.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1.11 2024-09-12T00:35:14.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.0 2024-09-12T00:35:14.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.1 2024-09-12T00:35:14.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.2 2024-09-12T00:35:14.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.161+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.3 2024-09-12T00:35:14.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.165+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.4 2024-09-12T00:35:14.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.165+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.5 2024-09-12T00:35:14.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.165+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.6 2024-09-12T00:35:14.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.165+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.7 2024-09-12T00:35:14.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.169+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.8 2024-09-12T00:35:14.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.169+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.9 2024-09-12T00:35:14.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.169+0000 7ff9540049c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.26.10 2024-09-12T00:35:14.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.177+0000 7ff9540049c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:14.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.177+0000 7ff9540049c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.26 2024-09-12T00:35:14.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.177+0000 7ff9540049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.26 info.flags=0x17 2024-09-12T00:35:14.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.177+0000 7ff9540049c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.26 to cache LRU end 2024-09-12T00:35:14.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.177+0000 7ff9540049c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:14.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.177+0000 7ff9540049c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.26, ofs0, ns] 2024-09-12T00:35:14.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.181+0000 7ff834ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333542 cookie 93933619565248 notifier 6849 bl.length()=907 2024-09-12T00:35:14.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.181+0000 7ff834ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.26 info.flags=0x17 2024-09-12T00:35:14.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.181+0000 7ff834ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.26 to cache LRU end 2024-09-12T00:35:14.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.181+0000 7ff834ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:14.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.181+0000 7ff9540049c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.26]): orig_sources= new_sources= 2024-09-12T00:35:14.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.181+0000 7ff9540049c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.26]): potential sources added=[] removed=[] 2024-09-12T00:35:14.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.181+0000 7ff9540049c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.26]): orig_dests= new_dests= 2024-09-12T00:35:14.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.181+0000 7ff9540049c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.26]): potential dests added=[] removed=[] 2024-09-12T00:35:14.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.185+0000 7ff9540049c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:35:14.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.189+0000 7ff8037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:14.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.193+0000 7ff9540049c0 20 remove_watcher() i=0 2024-09-12T00:35:14.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.193+0000 7ff9540049c0 2 removed watcher, disabling cache 2024-09-12T00:35:14.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.197+0000 7ff9540049c0 20 remove_watcher() i=1 2024-09-12T00:35:14.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.197+0000 7ff9540049c0 20 remove_watcher() i=2 2024-09-12T00:35:14.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.201+0000 7ff9540049c0 20 remove_watcher() i=3 2024-09-12T00:35:14.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.201+0000 7ff9540049c0 20 remove_watcher() i=4 2024-09-12T00:35:14.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.205+0000 7ff9540049c0 20 remove_watcher() i=5 2024-09-12T00:35:14.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.209+0000 7ff9540049c0 20 remove_watcher() i=6 2024-09-12T00:35:14.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.209+0000 7ff9540049c0 20 remove_watcher() i=7 2024-09-12T00:35:14.225 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:35:14.255 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:14.256 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:14.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.301+0000 7f11dfc079c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.305+0000 7f11dfc079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:14.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.305+0000 7f11dfc079c0 20 realm 2024-09-12T00:35:14.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.305+0000 7f11dfc079c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.305+0000 7f11dfc079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:14.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.305+0000 7f11dfc079c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:14.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.305+0000 7f11dfc079c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.305+0000 7f11dfc079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:14.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.305+0000 7f11dfc079c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.305+0000 7f11dfc079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:14.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.305+0000 7f11dfc079c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.305+0000 7f11dfc079c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:14.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.305+0000 7f11dfc079c0 20 searching for the correct realm 2024-09-12T00:35:14.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.313+0000 7f11dcf0c640 0 -- 172.21.15.138:0/2355515461 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f11d004c070 msgr2=0x7f11d009c280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:14.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.317+0000 7f11dcf0c640 0 -- 172.21.15.138:0/2355515461 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55ac255cb620 msgr2=0x55ac255cda10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:14.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.325+0000 7f11dfc079c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:14.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.325+0000 7f11dfc079c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:14.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.325+0000 7f11dfc079c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:14.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.325+0000 7f11dfc079c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:14.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.325+0000 7f11dfc079c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:14.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.325+0000 7f11dfc079c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:14.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.325+0000 7f11dfc079c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.325+0000 7f11dfc079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:14.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.325+0000 7f11dfc079c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.329+0000 7f11dfc079c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:14.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.329+0000 7f11dfc079c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.329+0000 7f11dfc079c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:14.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.329+0000 7f11dfc079c0 20 zone default found 2024-09-12T00:35:14.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.329+0000 7f11dfc079c0 4 Realm: () 2024-09-12T00:35:14.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.329+0000 7f11dfc079c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:14.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.329+0000 7f11dfc079c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:14.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.329+0000 7f11dfc079c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:14.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.329+0000 7f11dfc079c0 20 zonegroup default 2024-09-12T00:35:14.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.329+0000 7f11dfc079c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.329+0000 7f11dfc079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:14.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.329+0000 7f11dfc079c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.329+0000 7f11dfc079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:14.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.329+0000 7f11dfc079c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.329+0000 7f11dfc079c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:14.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.329+0000 7f11dfc079c0 20 started sync module instance, tier type = 2024-09-12T00:35:14.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.329+0000 7f11dfc079c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:14.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.349+0000 7f11dfc079c0 20 add_watcher() i=0 2024-09-12T00:35:14.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.349+0000 7f11dfc079c0 20 add_watcher() i=1 2024-09-12T00:35:14.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.349+0000 7f11dfc079c0 20 add_watcher() i=2 2024-09-12T00:35:14.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.349+0000 7f11dfc079c0 20 add_watcher() i=3 2024-09-12T00:35:14.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.349+0000 7f11dfc079c0 20 add_watcher() i=4 2024-09-12T00:35:14.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.349+0000 7f11dfc079c0 20 add_watcher() i=5 2024-09-12T00:35:14.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.349+0000 7f11dfc079c0 20 add_watcher() i=6 2024-09-12T00:35:14.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.349+0000 7f11dfc079c0 20 add_watcher() i=7 2024-09-12T00:35:14.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.349+0000 7f11dfc079c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:14.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.353+0000 7f1093fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:14.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.357+0000 7f11dfc079c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:14.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.357+0000 7f11dfc079c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:14.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.357+0000 7f11dfc079c0 5 note: GC not initialized 2024-09-12T00:35:14.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.357+0000 7f1092fe5640 20 reqs_thread_entry: start 2024-09-12T00:35:14.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.357+0000 7f11dfc079c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:14.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.357+0000 7f11dfc079c0 20 Filter name: none 2024-09-12T00:35:14.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.357+0000 7f1090fe1640 20 reqs_thread_entry: start 2024-09-12T00:35:14.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.357+0000 7f11dfc079c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.357+0000 7f11dfc079c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:14.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.357+0000 7f11dfc079c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.357+0000 7f11dfc079c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:35:14.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.357+0000 7f11dfc079c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:14.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.357+0000 7f11dfc079c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.357+0000 7f11dfc079c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:14.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.357+0000 7f11dfc079c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:14.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.357+0000 7f11dfc079c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:35:14.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.357+0000 7f11dfc079c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:14.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.361+0000 7f1093fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:14.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.365+0000 7f11dfc079c0 20 remove_watcher() i=0 2024-09-12T00:35:14.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.365+0000 7f11dfc079c0 2 removed watcher, disabling cache 2024-09-12T00:35:14.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.365+0000 7f11dfc079c0 20 remove_watcher() i=1 2024-09-12T00:35:14.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.369+0000 7f11dfc079c0 20 remove_watcher() i=2 2024-09-12T00:35:14.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.369+0000 7f11dfc079c0 20 remove_watcher() i=3 2024-09-12T00:35:14.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.373+0000 7f11dfc079c0 20 remove_watcher() i=4 2024-09-12T00:35:14.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.373+0000 7f11dfc079c0 20 remove_watcher() i=5 2024-09-12T00:35:14.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.377+0000 7f11dfc079c0 20 remove_watcher() i=6 2024-09-12T00:35:14.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:14.377+0000 7f11dfc079c0 20 remove_watcher() i=7 2024-09-12T00:35:14.390 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:14.390 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:35:14.390 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-trim-reshard-log-entries id: e2043445-c131-4520-984d-b4d52f038a6b.4538.26 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:35:14.390 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:14.391 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.391 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.394 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.394 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.442 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.442 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.484 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T00:35:14.484 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:14.485 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.486 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.507 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.507 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.552 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.552 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.577 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.577 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.599 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.599 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.619 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.619 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.640 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.640 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.660 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.660 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.681 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.681 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.702 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.702 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.723 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.724 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.745 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.745 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.765 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.765 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.787 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.788 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.810 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.810 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.833 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.833 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.854 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.854 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.875 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.875 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.897 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.897 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.920 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.920 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.942 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.942 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.963 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:14.963 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:14.981 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:35:15.013 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:15.013 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:15.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.061+0000 7f25715e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.065+0000 7f25715e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.065+0000 7f25715e69c0 20 realm 2024-09-12T00:35:15.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.065+0000 7f25715e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.065+0000 7f25715e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.065+0000 7f25715e69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:15.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.065+0000 7f25715e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.065+0000 7f25715e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.065+0000 7f25715e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.065+0000 7f25715e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:15.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.065+0000 7f25715e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.065+0000 7f25715e69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:15.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.065+0000 7f25715e69c0 20 searching for the correct realm 2024-09-12T00:35:15.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.073+0000 7f256f8ed640 0 -- 172.21.15.138:0/2107219088 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f256806aea0 msgr2=0x7f25680967c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:15.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.289+0000 7f256f8ed640 0 -- 172.21.15.138:0/2107219088 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x565373b13550 msgr2=0x565373b159f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:15.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.297+0000 7f25715e69c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:15.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.297+0000 7f25715e69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:15.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.297+0000 7f25715e69c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:15.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.297+0000 7f25715e69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:15.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.297+0000 7f25715e69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:15.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.297+0000 7f25715e69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:15.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.297+0000 7f25715e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.301+0000 7f25715e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.301+0000 7f25715e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.301+0000 7f25715e69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:15.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.301+0000 7f25715e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.301+0000 7f25715e69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:15.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.301+0000 7f25715e69c0 20 zone default found 2024-09-12T00:35:15.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.301+0000 7f25715e69c0 4 Realm: () 2024-09-12T00:35:15.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.301+0000 7f25715e69c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:15.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.301+0000 7f25715e69c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:15.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.301+0000 7f25715e69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:15.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.301+0000 7f25715e69c0 20 zonegroup default 2024-09-12T00:35:15.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.301+0000 7f25715e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.301+0000 7f25715e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.301+0000 7f25715e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.301+0000 7f25715e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.301+0000 7f25715e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.305+0000 7f25715e69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.305+0000 7f25715e69c0 20 started sync module instance, tier type = 2024-09-12T00:35:15.301 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.305+0000 7f25715e69c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:15.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.329+0000 7f25715e69c0 20 add_watcher() i=0 2024-09-12T00:35:15.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.329+0000 7f25715e69c0 20 add_watcher() i=1 2024-09-12T00:35:15.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.329+0000 7f25715e69c0 20 add_watcher() i=2 2024-09-12T00:35:15.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.329+0000 7f25715e69c0 20 add_watcher() i=3 2024-09-12T00:35:15.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.329+0000 7f25715e69c0 20 add_watcher() i=4 2024-09-12T00:35:15.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.329+0000 7f25715e69c0 20 add_watcher() i=5 2024-09-12T00:35:15.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.329+0000 7f25715e69c0 20 add_watcher() i=6 2024-09-12T00:35:15.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.329+0000 7f25715e69c0 20 add_watcher() i=7 2024-09-12T00:35:15.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.329+0000 7f25715e69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:15.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.333+0000 7f2425fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:15.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.337+0000 7f25715e69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:15.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.337+0000 7f25715e69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:15.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.337+0000 7f25715e69c0 5 note: GC not initialized 2024-09-12T00:35:15.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.337+0000 7f2424fe1640 20 reqs_thread_entry: start 2024-09-12T00:35:15.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.337+0000 7f25715e69c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:15.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.337+0000 7f25715e69c0 20 Filter name: none 2024-09-12T00:35:15.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.337+0000 7f239e7fc640 20 reqs_thread_entry: start 2024-09-12T00:35:15.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.337+0000 7f25715e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.337+0000 7f25715e69c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:15.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.337+0000 7f25715e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.341+0000 7f25715e69c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:35:15.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.341+0000 7f25715e69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:15.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.341+0000 7f25715e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.341+0000 7f25715e69c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:15.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.341+0000 7f25715e69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.341+0000 7f25715e69c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:35:15.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.341+0000 7f25715e69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:15.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.345+0000 7f2425fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:15.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.349+0000 7f25715e69c0 20 remove_watcher() i=0 2024-09-12T00:35:15.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.349+0000 7f25715e69c0 2 removed watcher, disabling cache 2024-09-12T00:35:15.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.353+0000 7f25715e69c0 20 remove_watcher() i=1 2024-09-12T00:35:15.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.353+0000 7f25715e69c0 20 remove_watcher() i=2 2024-09-12T00:35:15.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.357+0000 7f25715e69c0 20 remove_watcher() i=3 2024-09-12T00:35:15.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.357+0000 7f25715e69c0 20 remove_watcher() i=4 2024-09-12T00:35:15.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.361+0000 7f25715e69c0 20 remove_watcher() i=5 2024-09-12T00:35:15.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.365+0000 7f25715e69c0 20 remove_watcher() i=6 2024-09-12T00:35:15.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.365+0000 7f25715e69c0 20 remove_watcher() i=7 2024-09-12T00:35:15.379 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.379 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:35:15.379 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-trim-reshard-log-entries id: e2043445-c131-4520-984d-b4d52f038a6b.4538.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:35:15.379 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.380 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T00:35:15.416 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:15.416 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:15.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.461+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.461+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.461+0000 7f61aa1df9c0 20 realm 2024-09-12T00:35:15.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.461+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.465+0000 7f61aa1df9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:15.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:15.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:15.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 searching for the correct realm 2024-09-12T00:35:15.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.469+0000 7f61a84e6640 0 -- 172.21.15.138:0/438939887 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f61a0104f10 msgr2=0x7f61a012f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:15.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.685+0000 7f61a84e6640 0 -- 172.21.15.138:0/438939887 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55e3de7756c0 msgr2=0x55e3de777b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:15.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:15.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:15.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:15.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:15.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:15.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:15.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:15.693 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:15.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 zone default found 2024-09-12T00:35:15.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.697+0000 7f61aa1df9c0 4 Realm: () 2024-09-12T00:35:15.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.697+0000 7f61aa1df9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:15.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.697+0000 7f61aa1df9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:15.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.697+0000 7f61aa1df9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:15.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 zonegroup default 2024-09-12T00:35:15.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.701+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.701+0000 7f61aa1df9c0 20 started sync module instance, tier type = 2024-09-12T00:35:15.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.701+0000 7f61aa1df9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:15.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=0 2024-09-12T00:35:15.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=1 2024-09-12T00:35:15.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=2 2024-09-12T00:35:15.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=3 2024-09-12T00:35:15.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=4 2024-09-12T00:35:15.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=5 2024-09-12T00:35:15.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=6 2024-09-12T00:35:15.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.725+0000 7f61aa1df9c0 20 add_watcher() i=7 2024-09-12T00:35:15.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.725+0000 7f61aa1df9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:15.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.729+0000 7f605dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:15.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.729+0000 7f61aa1df9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:15.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.729+0000 7f61aa1df9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:15.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 note: GC not initialized 2024-09-12T00:35:15.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.729+0000 7f605cfe1640 20 reqs_thread_entry: start 2024-09-12T00:35:15.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.729+0000 7f61aa1df9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:15.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.729+0000 7f61aa1df9c0 20 Filter name: none 2024-09-12T00:35:15.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.733+0000 7f5fd67fc640 20 reqs_thread_entry: start 2024-09-12T00:35:15.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:35:15.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.733+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.733+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:15.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:35:15.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:35:15.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 : miss 2024-09-12T00:35:15.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.733+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.733+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:35:15.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 info.flags=0x17 2024-09-12T00:35:15.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to cache LRU end 2024-09-12T00:35:15.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:15.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:15.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 2024-09-12T00:35:15.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.745+0000 7f61aa1df9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 info.flags=0x17 2024-09-12T00:35:15.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.745+0000 7f61aa1df9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to cache LRU end 2024-09-12T00:35:15.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.745+0000 7f61aa1df9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:15.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.745+0000 7f61aa1df9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27, ofs0, ns] 2024-09-12T00:35:15.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.745+0000 7f6086ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333545 cookie 94437178320160 notifier 6515 bl.length()=939 2024-09-12T00:35:15.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.745+0000 7f6086ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 info.flags=0x17 2024-09-12T00:35:15.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.745+0000 7f6086ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to cache LRU end 2024-09-12T00:35:15.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.745+0000 7f6086ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:15.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.749+0000 7f61aa1df9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): orig_sources= new_sources= 2024-09-12T00:35:15.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.749+0000 7f61aa1df9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): potential sources added=[] removed=[] 2024-09-12T00:35:15.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.749+0000 7f61aa1df9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): orig_dests= new_dests= 2024-09-12T00:35:15.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.749+0000 7f61aa1df9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): potential dests added=[] removed=[] 2024-09-12T00:35:15.745 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f61aa1df9c0 time 2024-09-12T00:35:15.751360+0000 2024-09-12T00:35:15.745 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:15.748 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:15.748 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f61adab92eb] 2024-09-12T00:35:15.748 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f61adab949f] 2024-09-12T00:35:15.748 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e3dbf4ecc1] 2024-09-12T00:35:15.749 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422a3e) [0x55e3dc9aca3e] 2024-09-12T00:35:15.749 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e3dbf63ced] 2024-09-12T00:35:15.749 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:35:15.749 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f61ac91fd90] 2024-09-12T00:35:15.749 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:35:15.749 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:35:15.749 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:35:15.749 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f61aa1df9c0 thread_name:radosgw-admin 2024-09-12T00:35:15.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.749+0000 7f61aa1df9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f61aa1df9c0 time 2024-09-12T00:35:15.751360+0000 2024-09-12T00:35:15.749 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:15.749 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.749 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:15.749 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f61adab92eb] 2024-09-12T00:35:15.750 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f61adab949f] 2024-09-12T00:35:15.750 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e3dbf4ecc1] 2024-09-12T00:35:15.750 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422a3e) [0x55e3dc9aca3e] 2024-09-12T00:35:15.750 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e3dbf63ced] 2024-09-12T00:35:15.750 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:35:15.750 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f61ac91fd90] 2024-09-12T00:35:15.750 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:35:15.750 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:35:15.750 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.752 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:15.752 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f61ac938520] 2024-09-12T00:35:15.752 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:35:15.752 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:35:15.752 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:35:15.752 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f61adab9345] 2024-09-12T00:35:15.752 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f61adab949f] 2024-09-12T00:35:15.752 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e3dbf4ecc1] 2024-09-12T00:35:15.752 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422a3e) [0x55e3dc9aca3e] 2024-09-12T00:35:15.752 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e3dbf63ced] 2024-09-12T00:35:15.752 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:35:15.752 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f61ac91fd90] 2024-09-12T00:35:15.753 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:35:15.753 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:35:15.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.753+0000 7f61aa1df9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:15.753 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f61aa1df9c0 thread_name:radosgw-admin 2024-09-12T00:35:15.753 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.753 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:15.753 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f61ac938520] 2024-09-12T00:35:15.753 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:35:15.753 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:35:15.753 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:35:15.753 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f61adab9345] 2024-09-12T00:35:15.753 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f61adab949f] 2024-09-12T00:35:15.753 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e3dbf4ecc1] 2024-09-12T00:35:15.754 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422a3e) [0x55e3dc9aca3e] 2024-09-12T00:35:15.754 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e3dbf63ced] 2024-09-12T00:35:15.754 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:35:15.754 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f61ac91fd90] 2024-09-12T00:35:15.754 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:35:15.754 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:35:15.754 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:15.754 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.754 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:35:15.786 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.786 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.786 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.786 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:35:15.441+0000 7f61a7ce5640 10 monclient(hunting): handle_auth_done global_id 6503 payload 274 2024-09-12T00:35:15.786 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:35:15.441+0000 7f61a7ce5640 10 monclient: _finish_hunting 0 2024-09-12T00:35:15.786 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:35:15.441+0000 7f61a7ce5640 1 monclient: found mon.noname-c 2024-09-12T00:35:15.786 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:35:15.441+0000 7f61a7ce5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.786 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.786 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:15.787 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: dump: 2024-09-12T00:35:15.787 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.787 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.787 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.787 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.787 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.787 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.787 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.787 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.787 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.787 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.787 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: _finish_auth 0 2024-09-12T00:35:15.787 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: _check_auth_tickets 2024-09-12T00:35:15.788 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:15.788 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.788 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:15.788 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: dump: 2024-09-12T00:35:15.788 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.788 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.788 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.788 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.788 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.788 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.788 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.788 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.788 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.789 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.789 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 monclient: authenticate success, global_id 6503 2024-09-12T00:35:15.789 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:15.789 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 4 set_mon_vals no callback set 2024-09-12T00:35:15.789 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient: shutdown 2024-09-12T00:35:15.789 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) unregister_commands rotate-key 2024-09-12T00:35:15.789 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient: build_initial_monmap 2024-09-12T00:35:15.789 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:15.789 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient: monmap: 2024-09-12T00:35:15.789 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:35:15.789 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:15.789 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:35:15.790 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:35:15.790 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:15.790 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.790 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:35:15.790 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:35:15.790 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:35:15.790 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.790 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding auth protocol: cephx 2024-09-12T00:35:15.790 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding auth protocol: cephx 2024-09-12T00:35:15.790 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding auth protocol: cephx 2024-09-12T00:35:15.790 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: secure 2024-09-12T00:35:15.790 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: crc 2024-09-12T00:35:15.790 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: secure 2024-09-12T00:35:15.791 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: crc 2024-09-12T00:35:15.791 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: secure 2024-09-12T00:35:15.791 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: crc 2024-09-12T00:35:15.791 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: crc 2024-09-12T00:35:15.791 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: secure 2024-09-12T00:35:15.791 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: crc 2024-09-12T00:35:15.791 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: secure 2024-09-12T00:35:15.791 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: crc 2024-09-12T00:35:15.791 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: secure 2024-09-12T00:35:15.791 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.791 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 1 librados: starting msgr at 2024-09-12T00:35:15.791 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 1 librados: starting objecter 2024-09-12T00:35:15.791 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command objecter_requests hook 0x55e3de682df0 2024-09-12T00:35:15.792 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 1 librados: setting wanted keys 2024-09-12T00:35:15.792 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 1 librados: calling monclient init 2024-09-12T00:35:15.792 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient: init 2024-09-12T00:35:15.792 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding auth protocol: cephx 2024-09-12T00:35:15.792 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding auth protocol: cephx 2024-09-12T00:35:15.792 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding auth protocol: cephx 2024-09-12T00:35:15.792 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: secure 2024-09-12T00:35:15.792 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: crc 2024-09-12T00:35:15.792 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: secure 2024-09-12T00:35:15.792 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: crc 2024-09-12T00:35:15.792 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: secure 2024-09-12T00:35:15.792 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: crc 2024-09-12T00:35:15.792 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: crc 2024-09-12T00:35:15.793 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: secure 2024-09-12T00:35:15.793 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: crc 2024-09-12T00:35:15.793 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: secure 2024-09-12T00:35:15.793 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: crc 2024-09-12T00:35:15.793 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: secure 2024-09-12T00:35:15.793 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.793 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.793 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command rotate-key hook 0x55e3de67e678 2024-09-12T00:35:15.793 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:15.793 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:35:15.793 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-b con 0x55e3de52e5b0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:35:15.793 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-c con 0x55e3de5c3b00 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:35:15.793 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-a con 0x55e3de5c6d10 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:35:15.794 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.794 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.794 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.794 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:15.794 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient(hunting): authenticate will time out at 2168.787367s 2024-09-12T00:35:15.794 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): get_auth_request con 0x55e3de5c3b00 auth_method 0 2024-09-12T00:35:15.794 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.794 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.794 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.794 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:35:15.441+0000 7f61a84e6640 10 monclient(hunting): get_auth_request con 0x55e3de5c6d10 auth_method 0 2024-09-12T00:35:15.794 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:35:15.441+0000 7f61a84e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.794 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:35:15.441+0000 7f61a84e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.794 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:35:15.441+0000 7f61a84e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.795 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.795 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.795 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.795 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:35:15.441+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.795 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:35:15.441+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.795 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:35:15.441+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.795 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:35:15.441+0000 7f61a7ce5640 10 monclient(hunting): get_auth_request con 0x55e3de52e5b0 auth_method 0 2024-09-12T00:35:15.795 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:35:15.441+0000 7f61a7ce5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.795 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:35:15.441+0000 7f61a7ce5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.795 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:35:15.441+0000 7f61a7ce5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.795 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): handle_auth_done global_id 6506 payload 824 2024-09-12T00:35:15.795 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient: _finish_hunting 0 2024-09-12T00:35:15.795 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:35:15.441+0000 7f61a74e4640 1 monclient: found mon.noname-c 2024-09-12T00:35:15.795 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.796 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.796 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:15.796 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: dump: 2024-09-12T00:35:15.796 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.796 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.796 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.796 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.796 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.796 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.796 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.796 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.796 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.797 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.797 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: _finish_auth 0 2024-09-12T00:35:15.797 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:35:15.797 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:15.797 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.797 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:15.797 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: dump: 2024-09-12T00:35:15.797 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.797 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.797 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.797 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.797 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.797 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.797 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.798 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.798 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.798 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.798 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:35:15.445+0000 7f61aa1df9c0 5 monclient: authenticate success, global_id 6506 2024-09-12T00:35:15.798 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:35:15.445+0000 7f61aa1df9c0 10 monclient: _renew_subs 2024-09-12T00:35:15.798 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:35:15.445+0000 7f6095e0b640 4 set_mon_vals no callback set 2024-09-12T00:35:15.798 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:35:15.445+0000 7f61aa1df9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.798 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:35:15.445+0000 7f61aa1df9c0 10 monclient: _renew_subs 2024-09-12T00:35:15.798 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:35:15.445+0000 7f61aa1df9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.798 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:35:15.445+0000 7f61aa1df9c0 1 librados: init done 2024-09-12T00:35:15.798 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:35:15.445+0000 7f608ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:15.798 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:35:15.445+0000 7f608ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:15.799 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:35:15.445+0000 7f608ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:15.799 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:35:15.445+0000 7f61a7ce5640 10 monclient: get_auth_request con 0x7f6090070b10 auth_method 0 2024-09-12T00:35:15.799 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:35:15.445+0000 7f61a84e6640 10 monclient: get_auth_request con 0x55e3de6c7560 auth_method 0 2024-09-12T00:35:15.799 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:35:15.449+0000 7f61a7ce5640 10 monclient: get_auth_request con 0x55e3de6ca740 auth_method 0 2024-09-12T00:35:15.799 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:35:15.449+0000 7f61a74e4640 10 monclient: get_auth_request con 0x55e3de6ce930 auth_method 0 2024-09-12T00:35:15.799 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 10 monclient: build_initial_monmap 2024-09-12T00:35:15.799 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:15.799 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 10 monclient: monmap: 2024-09-12T00:35:15.799 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:35:15.799 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:15.799 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:35:15.799 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:35:15.799 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:15.799 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.800 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:35:15.800 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:35:15.800 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:35:15.800 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.800 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding auth protocol: cephx 2024-09-12T00:35:15.800 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding auth protocol: cephx 2024-09-12T00:35:15.800 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding auth protocol: cephx 2024-09-12T00:35:15.800 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: secure 2024-09-12T00:35:15.800 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: crc 2024-09-12T00:35:15.800 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: secure 2024-09-12T00:35:15.800 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: crc 2024-09-12T00:35:15.800 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: secure 2024-09-12T00:35:15.800 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: crc 2024-09-12T00:35:15.801 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: crc 2024-09-12T00:35:15.801 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: secure 2024-09-12T00:35:15.801 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: crc 2024-09-12T00:35:15.801 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: secure 2024-09-12T00:35:15.801 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: crc 2024-09-12T00:35:15.801 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: secure 2024-09-12T00:35:15.801 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.801 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command objecter_requests cmddesc objecter_requests hook 0x55e3de6d6dc0 EEXIST 2024-09-12T00:35:15.801 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 10 monclient: init 2024-09-12T00:35:15.801 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding auth protocol: cephx 2024-09-12T00:35:15.801 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding auth protocol: cephx 2024-09-12T00:35:15.801 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding auth protocol: cephx 2024-09-12T00:35:15.802 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: secure 2024-09-12T00:35:15.802 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: crc 2024-09-12T00:35:15.802 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: secure 2024-09-12T00:35:15.802 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: crc 2024-09-12T00:35:15.802 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: secure 2024-09-12T00:35:15.802 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: crc 2024-09-12T00:35:15.802 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: crc 2024-09-12T00:35:15.802 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: secure 2024-09-12T00:35:15.802 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: crc 2024-09-12T00:35:15.802 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: secure 2024-09-12T00:35:15.802 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: crc 2024-09-12T00:35:15.802 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: secure 2024-09-12T00:35:15.802 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.803 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.803 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command rotate-key cmddesc rotate-key hook 0x55e3de6d1d00 EEXIST 2024-09-12T00:35:15.803 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:15.803 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:35:15.803 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-a con 0x55e3de6faf70 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:35:15.803 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-b con 0x55e3de6fa8a0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:35:15.803 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-c con 0x55e3de6f9280 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:35:15.803 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.803 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.803 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.803 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:15.803 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient(hunting): authenticate will time out at 2168.796043s 2024-09-12T00:35:15.803 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient(hunting): get_auth_request con 0x55e3de6faf70 auth_method 0 2024-09-12T00:35:15.803 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.804 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.804 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.804 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:35:15.453+0000 7f61a84e6640 10 monclient(hunting): get_auth_request con 0x55e3de6f9280 auth_method 0 2024-09-12T00:35:15.804 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:35:15.453+0000 7f61a84e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.804 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:35:15.453+0000 7f61a84e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.804 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:35:15.453+0000 7f61a84e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.804 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.804 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.804 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.804 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:35:15.453+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.804 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:35:15.453+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.804 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:35:15.453+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.805 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient(hunting): handle_auth_done global_id 6897 payload 824 2024-09-12T00:35:15.805 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient: _finish_hunting 0 2024-09-12T00:35:15.805 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 1 monclient: found mon.noname-a 2024-09-12T00:35:15.805 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:35:15.805 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:35:15.453+0000 7f61a74e4640 10 monclient: get_auth_request con 0x55e3de6fa8a0 auth_method 0 2024-09-12T00:35:15.805 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.805 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:15.805 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: dump: 2024-09-12T00:35:15.805 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.805 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.805 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.805 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.805 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.805 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.806 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.806 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.806 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.806 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.806 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:35:15.806 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:35:15.806 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:15.806 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.806 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:15.806 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: dump: 2024-09-12T00:35:15.806 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.806 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.806 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.807 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.807 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.807 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.807 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.807 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.807 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.807 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.807 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 monclient: authenticate success, global_id 6897 2024-09-12T00:35:15.807 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient: _renew_subs 2024-09-12T00:35:15.807 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:35:15.807 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:35:15.453+0000 7f61a8ce7640 4 set_mon_vals no callback set 2024-09-12T00:35:15.807 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient: _renew_subs 2024-09-12T00:35:15.807 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:35:15.808 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:35:15.453+0000 7f608d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:15.808 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:35:15.453+0000 7f608d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:15.808 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:35:15.453+0000 7f608d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:15.808 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient: get_monmap_and_config 2024-09-12T00:35:15.808 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient: build_initial_monmap 2024-09-12T00:35:15.808 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:15.808 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient: monmap: 2024-09-12T00:35:15.808 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:35:15.808 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:15.808 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:35:15.808 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:35:15.808 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:15.808 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.809 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:35:15.809 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:35:15.809 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:35:15.809 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.809 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding auth protocol: cephx 2024-09-12T00:35:15.809 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding auth protocol: cephx 2024-09-12T00:35:15.809 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding auth protocol: cephx 2024-09-12T00:35:15.809 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: secure 2024-09-12T00:35:15.809 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: crc 2024-09-12T00:35:15.809 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: secure 2024-09-12T00:35:15.809 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: crc 2024-09-12T00:35:15.809 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: secure 2024-09-12T00:35:15.809 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: crc 2024-09-12T00:35:15.810 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: crc 2024-09-12T00:35:15.810 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: secure 2024-09-12T00:35:15.810 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: crc 2024-09-12T00:35:15.810 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: secure 2024-09-12T00:35:15.810 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: crc 2024-09-12T00:35:15.810 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: secure 2024-09-12T00:35:15.810 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:35:15.453+0000 7f61a74e4640 10 monclient: get_auth_request con 0x7f6080070bc0 auth_method 0 2024-09-12T00:35:15.810 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.810 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient: init 2024-09-12T00:35:15.810 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding auth protocol: cephx 2024-09-12T00:35:15.810 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding auth protocol: cephx 2024-09-12T00:35:15.810 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding auth protocol: cephx 2024-09-12T00:35:15.810 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: secure 2024-09-12T00:35:15.811 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: crc 2024-09-12T00:35:15.811 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: secure 2024-09-12T00:35:15.811 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: crc 2024-09-12T00:35:15.811 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: secure 2024-09-12T00:35:15.811 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: crc 2024-09-12T00:35:15.811 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: crc 2024-09-12T00:35:15.811 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: secure 2024-09-12T00:35:15.811 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: crc 2024-09-12T00:35:15.811 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: secure 2024-09-12T00:35:15.811 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: crc 2024-09-12T00:35:15.811 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: secure 2024-09-12T00:35:15.811 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.811 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.812 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command rotate-key cmddesc rotate-key hook 0x7ffee032f808 EEXIST 2024-09-12T00:35:15.812 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:15.812 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:35:15.812 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-a con 0x55e3de74ed20 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:35:15.812 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-c con 0x55e3de71fdc0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:35:15.812 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-b con 0x55e3de74a6c0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:35:15.812 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.812 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.812 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.812 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:15.812 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): authenticate will time out at 2168.800081s 2024-09-12T00:35:15.812 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): get_auth_request con 0x55e3de71fdc0 auth_method 0 2024-09-12T00:35:15.812 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.813 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.813 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.813 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:35:15.457+0000 7f61a7ce5640 10 monclient(hunting): get_auth_request con 0x55e3de74ed20 auth_method 0 2024-09-12T00:35:15.813 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:35:15.457+0000 7f61a7ce5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.813 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:35:15.457+0000 7f61a7ce5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.813 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:35:15.457+0000 7f61a7ce5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.813 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.813 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.813 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.813 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:35:15.457+0000 7f61a7ce5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.813 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:35:15.457+0000 7f61a7ce5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.813 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:35:15.457+0000 7f61a7ce5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.813 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): handle_auth_done global_id 6512 payload 274 2024-09-12T00:35:15.814 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient: _finish_hunting 0 2024-09-12T00:35:15.814 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:35:15.457+0000 7f61a74e4640 1 monclient: found mon.noname-c 2024-09-12T00:35:15.814 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.814 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.814 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:15.814 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: dump: 2024-09-12T00:35:15.814 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.814 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.814 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.814 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.814 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.814 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.814 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.814 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.815 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.815 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.815 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: _finish_auth 0 2024-09-12T00:35:15.815 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:35:15.815 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:15.815 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.815 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:15.815 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: dump: 2024-09-12T00:35:15.815 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.815 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.815 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.815 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.815 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.816 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.816 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.816 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.816 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.816 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.816 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 monclient: authenticate success, global_id 6512 2024-09-12T00:35:15.816 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:15.816 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 4 set_mon_vals no callback set 2024-09-12T00:35:15.816 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: shutdown 2024-09-12T00:35:15.816 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: build_initial_monmap 2024-09-12T00:35:15.816 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:15.816 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: monmap: 2024-09-12T00:35:15.816 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:35:15.817 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:15.817 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:35:15.817 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:35:15.817 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:15.817 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.817 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:35:15.817 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:35:15.817 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:35:15.817 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.817 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding auth protocol: cephx 2024-09-12T00:35:15.817 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding auth protocol: cephx 2024-09-12T00:35:15.817 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding auth protocol: cephx 2024-09-12T00:35:15.817 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: secure 2024-09-12T00:35:15.818 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: crc 2024-09-12T00:35:15.818 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: secure 2024-09-12T00:35:15.818 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: crc 2024-09-12T00:35:15.818 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: secure 2024-09-12T00:35:15.818 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: crc 2024-09-12T00:35:15.818 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: crc 2024-09-12T00:35:15.818 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: secure 2024-09-12T00:35:15.818 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: crc 2024-09-12T00:35:15.818 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: secure 2024-09-12T00:35:15.818 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: crc 2024-09-12T00:35:15.818 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: secure 2024-09-12T00:35:15.818 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.818 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 1 librados: starting msgr at 2024-09-12T00:35:15.819 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 1 librados: starting objecter 2024-09-12T00:35:15.819 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command objecter_requests cmddesc objecter_requests hook 0x55e3de71d3c0 EEXIST 2024-09-12T00:35:15.819 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 1 librados: setting wanted keys 2024-09-12T00:35:15.819 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 1 librados: calling monclient init 2024-09-12T00:35:15.819 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: init 2024-09-12T00:35:15.819 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding auth protocol: cephx 2024-09-12T00:35:15.819 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding auth protocol: cephx 2024-09-12T00:35:15.819 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding auth protocol: cephx 2024-09-12T00:35:15.819 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: secure 2024-09-12T00:35:15.819 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: crc 2024-09-12T00:35:15.819 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: secure 2024-09-12T00:35:15.819 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: crc 2024-09-12T00:35:15.819 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: secure 2024-09-12T00:35:15.819 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: crc 2024-09-12T00:35:15.820 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: crc 2024-09-12T00:35:15.820 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: secure 2024-09-12T00:35:15.820 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: crc 2024-09-12T00:35:15.820 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: secure 2024-09-12T00:35:15.820 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: crc 2024-09-12T00:35:15.820 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: secure 2024-09-12T00:35:15.820 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.820 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.820 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command rotate-key cmddesc rotate-key hook 0x55e3de6fced8 EEXIST 2024-09-12T00:35:15.820 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:15.820 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:35:15.820 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-b con 0x55e3de74a6c0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:35:15.820 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-a con 0x55e3de74ed20 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:35:15.821 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-c con 0x55e3de752980 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:35:15.821 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.821 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.821 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.821 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:15.821 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): authenticate will time out at 2168.802677s 2024-09-12T00:35:15.821 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient(hunting): get_auth_request con 0x55e3de752980 auth_method 0 2024-09-12T00:35:15.821 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.821 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.821 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.821 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): get_auth_request con 0x55e3de74ed20 auth_method 0 2024-09-12T00:35:15.821 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.821 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.822 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.822 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.822 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.822 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.822 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.822 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.822 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.822 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient(hunting): handle_auth_done global_id 6515 payload 824 2024-09-12T00:35:15.822 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient: _finish_hunting 0 2024-09-12T00:35:15.822 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:35:15.457+0000 7f61a84e6640 1 monclient: found mon.noname-c 2024-09-12T00:35:15.822 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.822 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:35:15.457+0000 7f61a7ce5640 10 monclient: get_auth_request con 0x55e3de74a6c0 auth_method 0 2024-09-12T00:35:15.822 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.823 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:15.823 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: dump: 2024-09-12T00:35:15.823 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.823 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.823 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.823 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.823 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.823 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.823 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.823 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.823 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.823 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.823 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: _finish_auth 0 2024-09-12T00:35:15.824 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: _check_auth_tickets 2024-09-12T00:35:15.824 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:15.824 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.824 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:15.824 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: dump: 2024-09-12T00:35:15.824 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.824 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.824 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.824 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.824 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.824 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.824 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.824 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:35:15.457+0000 7f6086ffd640 4 set_mon_vals no callback set 2024-09-12T00:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 monclient: authenticate success, global_id 6515 2024-09-12T00:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: _renew_subs 2024-09-12T00:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: _renew_subs 2024-09-12T00:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 1 librados: init done 2024-09-12T00:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command cr dump hook 0x55e3de754288 2024-09-12T00:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:35:15.461+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:35:15.461+0000 7f60857fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:15.825 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:35:15.461+0000 7f60857fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:15.826 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:35:15.461+0000 7f60857fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:15.826 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:35:15.461+0000 7f61a7ce5640 10 monclient: get_auth_request con 0x7f6070070ae0 auth_method 0 2024-09-12T00:35:15.826 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:35:15.461+0000 7f61a74e4640 10 monclient: get_auth_request con 0x55e3de768e80 auth_method 0 2024-09-12T00:35:15.826 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:35:15.461+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.826 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:35:15.461+0000 7f61aa1df9c0 20 realm 2024-09-12T00:35:15.826 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:35:15.461+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.826 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.826 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:15.826 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.826 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.826 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.826 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:35:15.465+0000 7f61a7ce5640 10 monclient: get_auth_request con 0x55e3de76d130 auth_method 0 2024-09-12T00:35:15.826 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:15.827 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.827 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:35:15.465+0000 7f61a74e4640 10 monclient: get_auth_request con 0x55e3de770990 auth_method 0 2024-09-12T00:35:15.827 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:15.827 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 searching for the correct realm 2024-09-12T00:35:15.827 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:35:15.465+0000 7f61a84e6640 10 monclient: get_auth_request con 0x55e3de7756c0 auth_method 0 2024-09-12T00:35:15.827 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:35:15.469+0000 7f61a7ce5640 10 monclient: get_auth_request con 0x7f61a00fc370 auth_method 0 2024-09-12T00:35:15.827 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:35:15.469+0000 7f61a74e4640 10 monclient: get_auth_request con 0x7f619808a040 auth_method 0 2024-09-12T00:35:15.827 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:35:15.469+0000 7f61a84e6640 0 -- 172.21.15.138:0/438939887 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f61a0104f10 msgr2=0x7f61a012f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:15.827 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:35:15.673+0000 7f61a84e6640 10 monclient: get_auth_request con 0x7f61a0104f10 auth_method 0 2024-09-12T00:35:15.827 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:35:15.677+0000 7f61a7ce5640 10 monclient: get_auth_request con 0x7f61980653a0 auth_method 0 2024-09-12T00:35:15.827 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:35:15.685+0000 7f61a84e6640 0 -- 172.21.15.138:0/438939887 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55e3de7756c0 msgr2=0x55e3de777b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:15.827 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:35:15.685+0000 7f60857fa640 1 client.6515.objecter ms_handle_reset 0x55e3de7756c0 session 0x55e3de775040 osd.4 2024-09-12T00:35:15.827 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:35:15.685+0000 7f60857fa640 10 monclient: _renew_subs 2024-09-12T00:35:15.827 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:35:15.685+0000 7f60857fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.828 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:35:15.685+0000 7f61a84e6640 10 monclient: get_auth_request con 0x7f6070080e00 auth_method 0 2024-09-12T00:35:15.828 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:15.828 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:15.828 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:15.828 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:15.828 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:15.828 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:15.828 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.828 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.828 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.828 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:15.828 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.828 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:15.829 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 zone default found 2024-09-12T00:35:15.829 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 4 Realm: () 2024-09-12T00:35:15.829 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:15.829 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:15.829 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:15.829 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 zonegroup default 2024-09-12T00:35:15.829 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.829 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.829 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.829 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.829 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.829 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:35:15.701+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.830 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:35:15.701+0000 7f61aa1df9c0 20 started sync module instance, tier type = 2024-09-12T00:35:15.830 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:35:15.701+0000 7f61aa1df9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:15.830 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=0 2024-09-12T00:35:15.830 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=1 2024-09-12T00:35:15.830 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=2 2024-09-12T00:35:15.830 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=3 2024-09-12T00:35:15.830 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=4 2024-09-12T00:35:15.830 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=5 2024-09-12T00:35:15.830 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=6 2024-09-12T00:35:15.830 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:35:15.725+0000 7f61aa1df9c0 20 add_watcher() i=7 2024-09-12T00:35:15.830 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:35:15.725+0000 7f61aa1df9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:15.830 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding auth protocol: cephx 2024-09-12T00:35:15.830 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding auth protocol: cephx 2024-09-12T00:35:15.830 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding auth protocol: cephx 2024-09-12T00:35:15.831 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: secure 2024-09-12T00:35:15.831 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: crc 2024-09-12T00:35:15.831 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: secure 2024-09-12T00:35:15.831 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: crc 2024-09-12T00:35:15.831 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:35:15.729+0000 7f605dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:15.831 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: secure 2024-09-12T00:35:15.831 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: crc 2024-09-12T00:35:15.831 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: crc 2024-09-12T00:35:15.831 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: secure 2024-09-12T00:35:15.831 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: crc 2024-09-12T00:35:15.831 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: secure 2024-09-12T00:35:15.831 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: crc 2024-09-12T00:35:15.831 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: secure 2024-09-12T00:35:15.832 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.832 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:15.832 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:15.832 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command cache list hook 0x55e3de720d10 2024-09-12T00:35:15.832 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command cache inspect hook 0x55e3de720d10 2024-09-12T00:35:15.832 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command cache erase hook 0x55e3de720d10 2024-09-12T00:35:15.832 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command cache zap hook 0x55e3de720d10 2024-09-12T00:35:15.832 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 note: GC not initialized 2024-09-12T00:35:15.832 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:35:15.729+0000 7f605cfe1640 20 reqs_thread_entry: start 2024-09-12T00:35:15.832 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command sync trace show hook 0x7f619c010050 2024-09-12T00:35:15.832 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command sync trace history hook 0x7f619c010050 2024-09-12T00:35:15.832 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command sync trace active hook 0x7f619c010050 2024-09-12T00:35:15.832 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command sync trace active_short hook 0x7f619c010050 2024-09-12T00:35:15.833 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:15.833 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 20 Filter name: none 2024-09-12T00:35:15.833 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:35:15.733+0000 7f5fd67fc640 20 reqs_thread_entry: start 2024-09-12T00:35:15.833 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:35:15.833 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.833 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:15.833 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:35:15.833 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:35:15.833 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 : miss 2024-09-12T00:35:15.833 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.833 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:35:15.833 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 info.flags=0x17 2024-09-12T00:35:15.833 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to cache LRU end 2024-09-12T00:35:15.834 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:15.834 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:15.834 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 2024-09-12T00:35:15.834 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:35:15.745+0000 7f61aa1df9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 info.flags=0x17 2024-09-12T00:35:15.834 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:35:15.745+0000 7f61aa1df9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to cache LRU end 2024-09-12T00:35:15.834 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:35:15.745+0000 7f61aa1df9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:15.834 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:35:15.745+0000 7f61aa1df9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27, ofs0, ns] 2024-09-12T00:35:15.834 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:35:15.745+0000 7f6086ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333545 cookie 94437178320160 notifier 6515 bl.length()=939 2024-09-12T00:35:15.834 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:35:15.745+0000 7f6086ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 info.flags=0x17 2024-09-12T00:35:15.834 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:35:15.745+0000 7f6086ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to cache LRU end 2024-09-12T00:35:15.834 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:35:15.745+0000 7f6086ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:15.834 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:35:15.749+0000 7f61aa1df9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): orig_sources= new_sources= 2024-09-12T00:35:15.835 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:35:15.749+0000 7f61aa1df9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): potential sources added=[] removed=[] 2024-09-12T00:35:15.835 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:35:15.749+0000 7f61aa1df9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): orig_dests= new_dests= 2024-09-12T00:35:15.835 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:35:15.749+0000 7f61aa1df9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): potential dests added=[] removed=[] 2024-09-12T00:35:15.835 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:35:15.749+0000 7f61aa1df9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f61aa1df9c0 time 2024-09-12T00:35:15.751360+0000 2024-09-12T00:35:15.835 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:15.835 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.835 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:15.835 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f61adab92eb] 2024-09-12T00:35:15.835 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f61adab949f] 2024-09-12T00:35:15.835 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e3dbf4ecc1] 2024-09-12T00:35:15.835 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422a3e) [0x55e3dc9aca3e] 2024-09-12T00:35:15.835 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e3dbf63ced] 2024-09-12T00:35:15.836 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:35:15.836 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f61ac91fd90] 2024-09-12T00:35:15.836 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:35:15.836 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:35:15.836 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.836 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:35:15.753+0000 7f61aa1df9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:15.836 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f61aa1df9c0 thread_name:radosgw-admin 2024-09-12T00:35:15.836 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.836 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:15.836 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f61ac938520] 2024-09-12T00:35:15.836 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:35:15.836 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:35:15.836 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:35:15.837 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f61adab9345] 2024-09-12T00:35:15.837 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f61adab949f] 2024-09-12T00:35:15.837 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e3dbf4ecc1] 2024-09-12T00:35:15.837 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422a3e) [0x55e3dc9aca3e] 2024-09-12T00:35:15.837 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e3dbf63ced] 2024-09-12T00:35:15.837 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:35:15.837 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f61ac91fd90] 2024-09-12T00:35:15.837 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:35:15.837 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:35:15.837 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:15.837 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.837 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:35:15.837 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:35:15.838 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:35:15.838 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:35:15.838 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:35:15.838 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:35:15.838 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:35:15.838 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:35:15.838 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:35:15.838 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:35:15.838 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:35:15.838 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:35:15.838 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:35:15.838 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:35:15.838 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:35:15.839 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:35:15.839 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:35:15.839 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:35:15.839 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:35:15.839 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:35:15.839 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:35:15.839 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:35:15.839 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:35:15.839 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:35:15.839 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:35:15.839 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:35:15.839 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:35:15.839 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:35:15.840 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:35:15.840 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:35:15.840 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:35:15.840 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:35:15.840 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:35:15.840 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:35:15.840 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:35:15.840 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:35:15.840 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:35:15.840 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:35:15.840 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:35:15.840 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:35:15.840 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:35:15.841 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:35:15.841 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:35:15.841 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:35:15.841 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:35:15.841 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:35:15.841 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:35:15.841 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:35:15.841 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:35:15.841 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:35:15.841 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:35:15.841 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:35:15.841 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:35:15.841 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:35:15.842 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:35:15.842 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:35:15.842 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:35:15.842 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:35:15.842 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:35:15.842 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:35:15.842 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:35:15.842 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:35:15.842 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:35:15.842 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:35:15.842 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:35:15.842 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:35:15.842 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:35:15.843 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:35:15.843 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:35:15.843 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:35:15.843 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:35:15.843 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:35:15.843 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:35:15.843 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:35:15.843 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:35:15.843 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:35:15.843 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:35:15.843 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:35:15.843 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:35:15.843 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:35:15.843 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:35:15.844 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:35:15.844 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:35:15.844 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:35:15.844 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:35:15.844 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:35:15.844 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:35:15.844 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:35:15.844 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:35:15.844 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:35:15.844 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:35:15.844 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:35:15.844 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:35:15.844 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:35:15.845 INFO:tasks.workunit.client.0.smithi138.stderr: 7f5fd67fc640 / http_manager 2024-09-12T00:35:15.845 INFO:tasks.workunit.client.0.smithi138.stderr: 7f605cfe1640 / http_manager 2024-09-12T00:35:15.845 INFO:tasks.workunit.client.0.smithi138.stderr: 7f605dfe3640 / rgw_dt_lg_renew 2024-09-12T00:35:15.845 INFO:tasks.workunit.client.0.smithi138.stderr: 7f60857fa640 / ms_dispatch 2024-09-12T00:35:15.845 INFO:tasks.workunit.client.0.smithi138.stderr: 7f6086ffd640 / io_context_pool 2024-09-12T00:35:15.845 INFO:tasks.workunit.client.0.smithi138.stderr: 7f608d7fa640 / ms_dispatch 2024-09-12T00:35:15.845 INFO:tasks.workunit.client.0.smithi138.stderr: 7f608ffff640 / ms_dispatch 2024-09-12T00:35:15.845 INFO:tasks.workunit.client.0.smithi138.stderr: 7f6095e0b640 / io_context_pool 2024-09-12T00:35:15.845 INFO:tasks.workunit.client.0.smithi138.stderr: 7f61a74e4640 / msgr-worker-2 2024-09-12T00:35:15.845 INFO:tasks.workunit.client.0.smithi138.stderr: 7f61a7ce5640 / msgr-worker-1 2024-09-12T00:35:15.845 INFO:tasks.workunit.client.0.smithi138.stderr: 7f61a84e6640 / msgr-worker-0 2024-09-12T00:35:15.845 INFO:tasks.workunit.client.0.smithi138.stderr: 7f61a8ce7640 / io_context_pool 2024-09-12T00:35:15.845 INFO:tasks.workunit.client.0.smithi138.stderr: 7f61aa1df9c0 / radosgw-admin 2024-09-12T00:35:15.846 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:35:15.846 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:35:15.846 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.99412.log 2024-09-12T00:35:15.846 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:35:15.846 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:35:15.846 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.846 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.846 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.846 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:35:15.441+0000 7f61a7ce5640 10 monclient(hunting): handle_auth_done global_id 6503 payload 274 2024-09-12T00:35:15.846 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:35:15.441+0000 7f61a7ce5640 10 monclient: _finish_hunting 0 2024-09-12T00:35:15.846 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:35:15.441+0000 7f61a7ce5640 1 monclient: found mon.noname-c 2024-09-12T00:35:15.846 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:35:15.441+0000 7f61a7ce5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.846 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.846 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:15.847 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: dump: 2024-09-12T00:35:15.847 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.847 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.847 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.847 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.847 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.847 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.847 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.847 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.847 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.847 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.847 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: _finish_auth 0 2024-09-12T00:35:15.847 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: _check_auth_tickets 2024-09-12T00:35:15.848 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:15.848 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.848 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:15.848 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:35:15.441+0000 7f6095e0b640 10 monclient: dump: 2024-09-12T00:35:15.848 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.848 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.848 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.848 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.848 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.848 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.848 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.848 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.848 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.849 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.849 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 monclient: authenticate success, global_id 6503 2024-09-12T00:35:15.849 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:15.849 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 4 set_mon_vals no callback set 2024-09-12T00:35:15.849 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient: shutdown 2024-09-12T00:35:15.849 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) unregister_commands rotate-key 2024-09-12T00:35:15.849 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient: build_initial_monmap 2024-09-12T00:35:15.849 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:15.849 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient: monmap: 2024-09-12T00:35:15.849 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:35:15.849 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:15.849 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:35:15.849 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:35:15.849 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:15.850 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.850 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:35:15.850 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:35:15.850 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:35:15.850 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.850 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding auth protocol: cephx 2024-09-12T00:35:15.850 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding auth protocol: cephx 2024-09-12T00:35:15.850 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding auth protocol: cephx 2024-09-12T00:35:15.850 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: secure 2024-09-12T00:35:15.850 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: crc 2024-09-12T00:35:15.850 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: secure 2024-09-12T00:35:15.850 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: crc 2024-09-12T00:35:15.850 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: secure 2024-09-12T00:35:15.851 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: crc 2024-09-12T00:35:15.851 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: crc 2024-09-12T00:35:15.851 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: secure 2024-09-12T00:35:15.851 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: crc 2024-09-12T00:35:15.851 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: secure 2024-09-12T00:35:15.851 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: crc 2024-09-12T00:35:15.851 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de683880) adding con mode: secure 2024-09-12T00:35:15.851 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.851 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 1 librados: starting msgr at 2024-09-12T00:35:15.851 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 1 librados: starting objecter 2024-09-12T00:35:15.851 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command objecter_requests hook 0x55e3de682df0 2024-09-12T00:35:15.851 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 1 librados: setting wanted keys 2024-09-12T00:35:15.851 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 1 librados: calling monclient init 2024-09-12T00:35:15.851 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient: init 2024-09-12T00:35:15.852 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding auth protocol: cephx 2024-09-12T00:35:15.852 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding auth protocol: cephx 2024-09-12T00:35:15.852 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding auth protocol: cephx 2024-09-12T00:35:15.852 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: secure 2024-09-12T00:35:15.852 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: crc 2024-09-12T00:35:15.852 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: secure 2024-09-12T00:35:15.852 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: crc 2024-09-12T00:35:15.852 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: secure 2024-09-12T00:35:15.852 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: crc 2024-09-12T00:35:15.852 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: crc 2024-09-12T00:35:15.852 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: secure 2024-09-12T00:35:15.852 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: crc 2024-09-12T00:35:15.852 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: secure 2024-09-12T00:35:15.853 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: crc 2024-09-12T00:35:15.853 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de67e530) adding con mode: secure 2024-09-12T00:35:15.853 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.853 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.853 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command rotate-key hook 0x55e3de67e678 2024-09-12T00:35:15.853 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:15.853 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:35:15.853 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-b con 0x55e3de52e5b0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:35:15.853 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-c con 0x55e3de5c3b00 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:35:15.853 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-a con 0x55e3de5c6d10 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:35:15.853 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.853 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.853 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.854 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:15.854 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:35:15.441+0000 7f61aa1df9c0 10 monclient(hunting): authenticate will time out at 2168.787367s 2024-09-12T00:35:15.854 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): get_auth_request con 0x55e3de5c3b00 auth_method 0 2024-09-12T00:35:15.854 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.854 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.854 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.854 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:35:15.441+0000 7f61a84e6640 10 monclient(hunting): get_auth_request con 0x55e3de5c6d10 auth_method 0 2024-09-12T00:35:15.854 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:35:15.441+0000 7f61a84e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.854 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:35:15.441+0000 7f61a84e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.854 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:35:15.441+0000 7f61a84e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.854 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.854 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.854 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.854 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:35:15.441+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.855 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:35:15.441+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.855 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:35:15.441+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.855 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:35:15.441+0000 7f61a7ce5640 10 monclient(hunting): get_auth_request con 0x55e3de52e5b0 auth_method 0 2024-09-12T00:35:15.855 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:35:15.441+0000 7f61a7ce5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.855 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:35:15.441+0000 7f61a7ce5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.855 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:35:15.441+0000 7f61a7ce5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.855 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient(hunting): handle_auth_done global_id 6506 payload 824 2024-09-12T00:35:15.855 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient: _finish_hunting 0 2024-09-12T00:35:15.855 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:35:15.441+0000 7f61a74e4640 1 monclient: found mon.noname-c 2024-09-12T00:35:15.855 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:35:15.441+0000 7f61a74e4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.855 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.855 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:15.855 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: dump: 2024-09-12T00:35:15.856 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.856 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.856 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.856 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.856 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.856 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.856 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.856 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.856 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.856 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.856 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: _finish_auth 0 2024-09-12T00:35:15.856 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:35:15.856 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:15.857 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.857 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:15.857 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:35:15.445+0000 7f608ffff640 10 monclient: dump: 2024-09-12T00:35:15.857 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.857 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.857 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.857 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.857 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.857 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.857 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.857 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.857 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.857 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.858 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:35:15.445+0000 7f61aa1df9c0 5 monclient: authenticate success, global_id 6506 2024-09-12T00:35:15.858 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:35:15.445+0000 7f61aa1df9c0 10 monclient: _renew_subs 2024-09-12T00:35:15.858 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:35:15.445+0000 7f6095e0b640 4 set_mon_vals no callback set 2024-09-12T00:35:15.858 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:35:15.445+0000 7f61aa1df9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.858 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:35:15.445+0000 7f61aa1df9c0 10 monclient: _renew_subs 2024-09-12T00:35:15.858 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:35:15.445+0000 7f61aa1df9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.858 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:35:15.445+0000 7f61aa1df9c0 1 librados: init done 2024-09-12T00:35:15.858 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:35:15.445+0000 7f608ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:15.858 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:35:15.445+0000 7f608ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:15.858 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:35:15.445+0000 7f608ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:15.858 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:35:15.445+0000 7f61a7ce5640 10 monclient: get_auth_request con 0x7f6090070b10 auth_method 0 2024-09-12T00:35:15.858 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:35:15.445+0000 7f61a84e6640 10 monclient: get_auth_request con 0x55e3de6c7560 auth_method 0 2024-09-12T00:35:15.858 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:35:15.449+0000 7f61a7ce5640 10 monclient: get_auth_request con 0x55e3de6ca740 auth_method 0 2024-09-12T00:35:15.859 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:35:15.449+0000 7f61a74e4640 10 monclient: get_auth_request con 0x55e3de6ce930 auth_method 0 2024-09-12T00:35:15.859 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 10 monclient: build_initial_monmap 2024-09-12T00:35:15.859 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:15.859 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 10 monclient: monmap: 2024-09-12T00:35:15.859 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:35:15.859 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:15.859 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:35:15.859 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:35:15.859 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:15.859 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.859 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:35:15.859 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:35:15.859 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:35:15.859 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.860 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding auth protocol: cephx 2024-09-12T00:35:15.860 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding auth protocol: cephx 2024-09-12T00:35:15.860 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding auth protocol: cephx 2024-09-12T00:35:15.860 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: secure 2024-09-12T00:35:15.860 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: crc 2024-09-12T00:35:15.860 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: secure 2024-09-12T00:35:15.860 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: crc 2024-09-12T00:35:15.860 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: secure 2024-09-12T00:35:15.860 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: crc 2024-09-12T00:35:15.860 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: crc 2024-09-12T00:35:15.860 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: secure 2024-09-12T00:35:15.860 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: crc 2024-09-12T00:35:15.860 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: secure 2024-09-12T00:35:15.861 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: crc 2024-09-12T00:35:15.861 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d34e0) adding con mode: secure 2024-09-12T00:35:15.861 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.861 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command objecter_requests cmddesc objecter_requests hook 0x55e3de6d6dc0 EEXIST 2024-09-12T00:35:15.861 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 10 monclient: init 2024-09-12T00:35:15.861 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding auth protocol: cephx 2024-09-12T00:35:15.861 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding auth protocol: cephx 2024-09-12T00:35:15.861 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding auth protocol: cephx 2024-09-12T00:35:15.861 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: secure 2024-09-12T00:35:15.861 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: crc 2024-09-12T00:35:15.861 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: secure 2024-09-12T00:35:15.861 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: crc 2024-09-12T00:35:15.862 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: secure 2024-09-12T00:35:15.862 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: crc 2024-09-12T00:35:15.862 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: crc 2024-09-12T00:35:15.862 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: secure 2024-09-12T00:35:15.862 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: crc 2024-09-12T00:35:15.862 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: secure 2024-09-12T00:35:15.862 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: crc 2024-09-12T00:35:15.862 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6d1bb8) adding con mode: secure 2024-09-12T00:35:15.862 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.862 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.862 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command rotate-key cmddesc rotate-key hook 0x55e3de6d1d00 EEXIST 2024-09-12T00:35:15.862 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:15.862 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:35:15.449+0000 7f61aa1df9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:35:15.863 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-a con 0x55e3de6faf70 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:35:15.863 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-b con 0x55e3de6fa8a0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:35:15.863 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-c con 0x55e3de6f9280 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:35:15.863 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.863 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.863 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.863 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:15.863 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient(hunting): authenticate will time out at 2168.796043s 2024-09-12T00:35:15.863 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient(hunting): get_auth_request con 0x55e3de6faf70 auth_method 0 2024-09-12T00:35:15.863 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.863 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.863 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.863 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:35:15.453+0000 7f61a84e6640 10 monclient(hunting): get_auth_request con 0x55e3de6f9280 auth_method 0 2024-09-12T00:35:15.864 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:35:15.453+0000 7f61a84e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.864 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:35:15.453+0000 7f61a84e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.864 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:35:15.453+0000 7f61a84e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.864 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.864 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.864 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.864 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:35:15.453+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.864 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:35:15.453+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.864 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:35:15.453+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.864 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient(hunting): handle_auth_done global_id 6897 payload 824 2024-09-12T00:35:15.864 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient: _finish_hunting 0 2024-09-12T00:35:15.864 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 1 monclient: found mon.noname-a 2024-09-12T00:35:15.864 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:35:15.453+0000 7f61a7ce5640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:35:15.865 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:35:15.453+0000 7f61a74e4640 10 monclient: get_auth_request con 0x55e3de6fa8a0 auth_method 0 2024-09-12T00:35:15.865 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.865 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:15.865 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: dump: 2024-09-12T00:35:15.865 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.865 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.865 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.865 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.865 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.865 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.865 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.865 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.865 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.865 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.866 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:35:15.866 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:35:15.866 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:15.866 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.866 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:15.866 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:35:15.453+0000 7f608d7fa640 10 monclient: dump: 2024-09-12T00:35:15.866 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.866 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.866 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.866 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.866 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.866 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.866 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.866 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.867 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.867 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.867 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 monclient: authenticate success, global_id 6897 2024-09-12T00:35:15.867 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient: _renew_subs 2024-09-12T00:35:15.867 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:35:15.867 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:35:15.453+0000 7f61a8ce7640 4 set_mon_vals no callback set 2024-09-12T00:35:15.867 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient: _renew_subs 2024-09-12T00:35:15.867 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:35:15.867 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:35:15.453+0000 7f608d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:15.867 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:35:15.453+0000 7f608d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:15.867 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:35:15.453+0000 7f608d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:15.867 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient: get_monmap_and_config 2024-09-12T00:35:15.867 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient: build_initial_monmap 2024-09-12T00:35:15.868 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:15.868 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient: monmap: 2024-09-12T00:35:15.868 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:35:15.868 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:15.868 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:35:15.868 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:35:15.868 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:15.868 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.868 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:35:15.868 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:35:15.868 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:35:15.868 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.868 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding auth protocol: cephx 2024-09-12T00:35:15.868 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding auth protocol: cephx 2024-09-12T00:35:15.869 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding auth protocol: cephx 2024-09-12T00:35:15.869 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: secure 2024-09-12T00:35:15.869 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: crc 2024-09-12T00:35:15.869 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: secure 2024-09-12T00:35:15.869 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: crc 2024-09-12T00:35:15.869 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: secure 2024-09-12T00:35:15.869 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: crc 2024-09-12T00:35:15.869 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: crc 2024-09-12T00:35:15.869 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: secure 2024-09-12T00:35:15.869 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: crc 2024-09-12T00:35:15.869 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: secure 2024-09-12T00:35:15.869 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: crc 2024-09-12T00:35:15.869 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de71a840) adding con mode: secure 2024-09-12T00:35:15.870 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:35:15.453+0000 7f61a74e4640 10 monclient: get_auth_request con 0x7f6080070bc0 auth_method 0 2024-09-12T00:35:15.870 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.870 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 10 monclient: init 2024-09-12T00:35:15.870 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding auth protocol: cephx 2024-09-12T00:35:15.870 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding auth protocol: cephx 2024-09-12T00:35:15.870 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding auth protocol: cephx 2024-09-12T00:35:15.870 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: secure 2024-09-12T00:35:15.870 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: crc 2024-09-12T00:35:15.870 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: secure 2024-09-12T00:35:15.870 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: crc 2024-09-12T00:35:15.870 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: secure 2024-09-12T00:35:15.870 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: crc 2024-09-12T00:35:15.870 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: crc 2024-09-12T00:35:15.870 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: secure 2024-09-12T00:35:15.871 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: crc 2024-09-12T00:35:15.871 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: secure 2024-09-12T00:35:15.871 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: crc 2024-09-12T00:35:15.871 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032f6c0) adding con mode: secure 2024-09-12T00:35:15.871 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.871 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:35:15.453+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.871 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command rotate-key cmddesc rotate-key hook 0x7ffee032f808 EEXIST 2024-09-12T00:35:15.871 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:15.871 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:35:15.871 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-a con 0x55e3de74ed20 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:35:15.871 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-c con 0x55e3de71fdc0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:35:15.871 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-b con 0x55e3de74a6c0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:35:15.871 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.872 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.872 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.872 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:15.872 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): authenticate will time out at 2168.800081s 2024-09-12T00:35:15.872 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): get_auth_request con 0x55e3de71fdc0 auth_method 0 2024-09-12T00:35:15.872 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.872 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.872 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.872 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:35:15.457+0000 7f61a7ce5640 10 monclient(hunting): get_auth_request con 0x55e3de74ed20 auth_method 0 2024-09-12T00:35:15.872 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:35:15.457+0000 7f61a7ce5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.872 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:35:15.457+0000 7f61a7ce5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.872 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:35:15.457+0000 7f61a7ce5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.872 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.873 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.873 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.873 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:35:15.457+0000 7f61a7ce5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.873 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:35:15.457+0000 7f61a7ce5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.873 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:35:15.457+0000 7f61a7ce5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.873 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): handle_auth_done global_id 6512 payload 274 2024-09-12T00:35:15.873 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient: _finish_hunting 0 2024-09-12T00:35:15.873 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:35:15.457+0000 7f61a74e4640 1 monclient: found mon.noname-c 2024-09-12T00:35:15.873 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.873 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.873 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:15.873 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: dump: 2024-09-12T00:35:15.873 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.874 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.874 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.874 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.874 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.874 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.874 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.874 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.874 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.874 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.874 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: _finish_auth 0 2024-09-12T00:35:15.874 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:35:15.874 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:15.874 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.875 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:15.875 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:35:15.457+0000 7f6086ffd640 10 monclient: dump: 2024-09-12T00:35:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.875 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.875 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 monclient: authenticate success, global_id 6512 2024-09-12T00:35:15.875 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:15.876 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 4 set_mon_vals no callback set 2024-09-12T00:35:15.876 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: shutdown 2024-09-12T00:35:15.876 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: build_initial_monmap 2024-09-12T00:35:15.876 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:15.876 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: monmap: 2024-09-12T00:35:15.876 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:35:15.876 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:15.876 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:35:15.876 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:35:15.876 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:15.876 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.876 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:35:15.876 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:35:15.877 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:35:15.877 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.877 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding auth protocol: cephx 2024-09-12T00:35:15.877 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding auth protocol: cephx 2024-09-12T00:35:15.877 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding auth protocol: cephx 2024-09-12T00:35:15.877 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: secure 2024-09-12T00:35:15.877 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: crc 2024-09-12T00:35:15.877 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: secure 2024-09-12T00:35:15.877 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: crc 2024-09-12T00:35:15.877 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: secure 2024-09-12T00:35:15.877 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: crc 2024-09-12T00:35:15.877 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: crc 2024-09-12T00:35:15.877 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: secure 2024-09-12T00:35:15.878 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: crc 2024-09-12T00:35:15.878 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: secure 2024-09-12T00:35:15.878 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: crc 2024-09-12T00:35:15.878 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de741070) adding con mode: secure 2024-09-12T00:35:15.878 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.878 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 1 librados: starting msgr at 2024-09-12T00:35:15.878 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 1 librados: starting objecter 2024-09-12T00:35:15.878 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command objecter_requests cmddesc objecter_requests hook 0x55e3de71d3c0 EEXIST 2024-09-12T00:35:15.878 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 1 librados: setting wanted keys 2024-09-12T00:35:15.878 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 1 librados: calling monclient init 2024-09-12T00:35:15.878 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: init 2024-09-12T00:35:15.878 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding auth protocol: cephx 2024-09-12T00:35:15.878 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding auth protocol: cephx 2024-09-12T00:35:15.878 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding auth protocol: cephx 2024-09-12T00:35:15.879 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: secure 2024-09-12T00:35:15.879 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: crc 2024-09-12T00:35:15.879 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: secure 2024-09-12T00:35:15.879 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: crc 2024-09-12T00:35:15.879 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: secure 2024-09-12T00:35:15.879 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: crc 2024-09-12T00:35:15.879 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: crc 2024-09-12T00:35:15.879 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: secure 2024-09-12T00:35:15.879 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: crc 2024-09-12T00:35:15.879 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: secure 2024-09-12T00:35:15.879 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: crc 2024-09-12T00:35:15.880 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 AuthRegistry(0x55e3de6fcd90) adding con mode: secure 2024-09-12T00:35:15.880 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.880 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.880 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command rotate-key cmddesc rotate-key hook 0x55e3de6fced8 EEXIST 2024-09-12T00:35:15.880 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:15.880 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:35:15.880 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-b con 0x55e3de74a6c0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:35:15.880 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-a con 0x55e3de74ed20 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:35:15.880 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): picked mon.noname-c con 0x55e3de752980 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:35:15.880 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.880 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.880 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:15.880 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:15.881 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient(hunting): authenticate will time out at 2168.802677s 2024-09-12T00:35:15.881 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient(hunting): get_auth_request con 0x55e3de752980 auth_method 0 2024-09-12T00:35:15.881 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.881 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.881 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.881 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): get_auth_request con 0x55e3de74ed20 auth_method 0 2024-09-12T00:35:15.881 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:15.881 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:15.881 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:15.881 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.881 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.881 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.881 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:15.882 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:15.882 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:35:15.457+0000 7f61a74e4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:15.882 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient(hunting): handle_auth_done global_id 6515 payload 824 2024-09-12T00:35:15.882 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient: _finish_hunting 0 2024-09-12T00:35:15.882 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:35:15.457+0000 7f61a84e6640 1 monclient: found mon.noname-c 2024-09-12T00:35:15.882 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:35:15.457+0000 7f61a84e6640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.882 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:35:15.457+0000 7f61a7ce5640 10 monclient: get_auth_request con 0x55e3de74a6c0 auth_method 0 2024-09-12T00:35:15.882 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.882 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:15.882 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: dump: 2024-09-12T00:35:15.882 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.882 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.882 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.882 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.883 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.883 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.883 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.883 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.883 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.883 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.883 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: _finish_auth 0 2024-09-12T00:35:15.883 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: _check_auth_tickets 2024-09-12T00:35:15.883 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:15.883 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:15.883 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:15.883 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:35:15.457+0000 7f60857fa640 10 monclient: dump: 2024-09-12T00:35:15.883 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:15.884 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:15.884 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.884 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:15.884 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:15.884 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:15.884 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:15.884 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:15.884 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:15.884 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.884 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:35:15.457+0000 7f6086ffd640 4 set_mon_vals no callback set 2024-09-12T00:35:15.884 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 monclient: authenticate success, global_id 6515 2024-09-12T00:35:15.884 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: _renew_subs 2024-09-12T00:35:15.884 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.884 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: _renew_subs 2024-09-12T00:35:15.885 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.885 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 1 librados: init done 2024-09-12T00:35:15.885 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:35:15.457+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command cr dump hook 0x55e3de754288 2024-09-12T00:35:15.885 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:35:15.461+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.885 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:35:15.461+0000 7f60857fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:15.885 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:35:15.461+0000 7f60857fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:15.885 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:35:15.461+0000 7f60857fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:15.885 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:35:15.461+0000 7f61a7ce5640 10 monclient: get_auth_request con 0x7f6070070ae0 auth_method 0 2024-09-12T00:35:15.885 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:35:15.461+0000 7f61a74e4640 10 monclient: get_auth_request con 0x55e3de768e80 auth_method 0 2024-09-12T00:35:15.885 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:35:15.461+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.885 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:35:15.461+0000 7f61aa1df9c0 20 realm 2024-09-12T00:35:15.885 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:35:15.461+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.885 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.886 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:15.886 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.886 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.886 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.886 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:35:15.465+0000 7f61a7ce5640 10 monclient: get_auth_request con 0x55e3de76d130 auth_method 0 2024-09-12T00:35:15.886 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:15.886 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.886 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:35:15.465+0000 7f61a74e4640 10 monclient: get_auth_request con 0x55e3de770990 auth_method 0 2024-09-12T00:35:15.886 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:15.886 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:35:15.465+0000 7f61aa1df9c0 20 searching for the correct realm 2024-09-12T00:35:15.886 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:35:15.465+0000 7f61a84e6640 10 monclient: get_auth_request con 0x55e3de7756c0 auth_method 0 2024-09-12T00:35:15.886 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:35:15.469+0000 7f61a7ce5640 10 monclient: get_auth_request con 0x7f61a00fc370 auth_method 0 2024-09-12T00:35:15.886 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:35:15.469+0000 7f61a74e4640 10 monclient: get_auth_request con 0x7f619808a040 auth_method 0 2024-09-12T00:35:15.887 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:35:15.469+0000 7f61a84e6640 0 -- 172.21.15.138:0/438939887 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f61a0104f10 msgr2=0x7f61a012f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:15.887 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:35:15.673+0000 7f61a84e6640 10 monclient: get_auth_request con 0x7f61a0104f10 auth_method 0 2024-09-12T00:35:15.887 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:35:15.677+0000 7f61a7ce5640 10 monclient: get_auth_request con 0x7f61980653a0 auth_method 0 2024-09-12T00:35:15.887 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:35:15.685+0000 7f61a84e6640 0 -- 172.21.15.138:0/438939887 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55e3de7756c0 msgr2=0x55e3de777b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:15.887 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:35:15.685+0000 7f60857fa640 1 client.6515.objecter ms_handle_reset 0x55e3de7756c0 session 0x55e3de775040 osd.4 2024-09-12T00:35:15.887 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:35:15.685+0000 7f60857fa640 10 monclient: _renew_subs 2024-09-12T00:35:15.887 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:35:15.685+0000 7f60857fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:15.887 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:35:15.685+0000 7f61a84e6640 10 monclient: get_auth_request con 0x7f6070080e00 auth_method 0 2024-09-12T00:35:15.887 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:15.887 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:15.887 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:15.887 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:15.887 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:15.888 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:15.888 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:35:15.693+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.888 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.888 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.888 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:15.888 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.888 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:15.888 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 zone default found 2024-09-12T00:35:15.888 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 4 Realm: () 2024-09-12T00:35:15.888 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:15.888 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:15.888 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:15.888 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 zonegroup default 2024-09-12T00:35:15.889 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.889 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.889 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.889 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.889 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:35:15.697+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.889 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:35:15.701+0000 7f61aa1df9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.889 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:35:15.701+0000 7f61aa1df9c0 20 started sync module instance, tier type = 2024-09-12T00:35:15.889 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:35:15.701+0000 7f61aa1df9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:15.889 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=0 2024-09-12T00:35:15.889 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=1 2024-09-12T00:35:15.889 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=2 2024-09-12T00:35:15.889 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=3 2024-09-12T00:35:15.889 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=4 2024-09-12T00:35:15.890 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=5 2024-09-12T00:35:15.890 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:35:15.721+0000 7f61aa1df9c0 20 add_watcher() i=6 2024-09-12T00:35:15.890 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:35:15.725+0000 7f61aa1df9c0 20 add_watcher() i=7 2024-09-12T00:35:15.890 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:35:15.725+0000 7f61aa1df9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:15.890 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding auth protocol: cephx 2024-09-12T00:35:15.890 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding auth protocol: cephx 2024-09-12T00:35:15.890 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding auth protocol: cephx 2024-09-12T00:35:15.890 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: secure 2024-09-12T00:35:15.890 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: crc 2024-09-12T00:35:15.890 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: secure 2024-09-12T00:35:15.890 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: crc 2024-09-12T00:35:15.890 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:35:15.729+0000 7f605dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:15.890 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: secure 2024-09-12T00:35:15.890 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: crc 2024-09-12T00:35:15.891 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: crc 2024-09-12T00:35:15.891 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: secure 2024-09-12T00:35:15.891 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: crc 2024-09-12T00:35:15.891 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: secure 2024-09-12T00:35:15.891 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: crc 2024-09-12T00:35:15.891 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 AuthRegistry(0x7ffee032fba0) adding con mode: secure 2024-09-12T00:35:15.891 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:15.891 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:15.891 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:15.891 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command cache list hook 0x55e3de720d10 2024-09-12T00:35:15.891 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command cache inspect hook 0x55e3de720d10 2024-09-12T00:35:15.891 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command cache erase hook 0x55e3de720d10 2024-09-12T00:35:15.891 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command cache zap hook 0x55e3de720d10 2024-09-12T00:35:15.892 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 note: GC not initialized 2024-09-12T00:35:15.892 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:35:15.729+0000 7f605cfe1640 20 reqs_thread_entry: start 2024-09-12T00:35:15.892 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command sync trace show hook 0x7f619c010050 2024-09-12T00:35:15.892 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command sync trace history hook 0x7f619c010050 2024-09-12T00:35:15.892 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command sync trace active hook 0x7f619c010050 2024-09-12T00:35:15.892 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 5 asok(0x55e3de4742b0) register_command sync trace active_short hook 0x7f619c010050 2024-09-12T00:35:15.892 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:15.892 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:35:15.729+0000 7f61aa1df9c0 20 Filter name: none 2024-09-12T00:35:15.892 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:35:15.733+0000 7f5fd67fc640 20 reqs_thread_entry: start 2024-09-12T00:35:15.892 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:35:15.892 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.892 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:15.892 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:35:15.893 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:35:15.893 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 : miss 2024-09-12T00:35:15.893 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.893 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:35:15.893 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 info.flags=0x17 2024-09-12T00:35:15.893 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to cache LRU end 2024-09-12T00:35:15.893 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:15.893 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:15.893 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:35:15.733+0000 7f61aa1df9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 2024-09-12T00:35:15.893 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:35:15.745+0000 7f61aa1df9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 info.flags=0x17 2024-09-12T00:35:15.893 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:35:15.745+0000 7f61aa1df9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to cache LRU end 2024-09-12T00:35:15.893 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:35:15.745+0000 7f61aa1df9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:15.893 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:35:15.745+0000 7f61aa1df9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27, ofs0, ns] 2024-09-12T00:35:15.894 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:35:15.745+0000 7f6086ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333545 cookie 94437178320160 notifier 6515 bl.length()=939 2024-09-12T00:35:15.894 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:35:15.745+0000 7f6086ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 info.flags=0x17 2024-09-12T00:35:15.894 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:35:15.745+0000 7f6086ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to cache LRU end 2024-09-12T00:35:15.894 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:35:15.745+0000 7f6086ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:15.894 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:35:15.749+0000 7f61aa1df9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): orig_sources= new_sources= 2024-09-12T00:35:15.894 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:35:15.749+0000 7f61aa1df9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): potential sources added=[] removed=[] 2024-09-12T00:35:15.894 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:35:15.749+0000 7f61aa1df9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): orig_dests= new_dests= 2024-09-12T00:35:15.894 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:35:15.749+0000 7f61aa1df9c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): potential dests added=[] removed=[] 2024-09-12T00:35:15.894 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:35:15.749+0000 7f61aa1df9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f61aa1df9c0 time 2024-09-12T00:35:15.751360+0000 2024-09-12T00:35:15.894 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:15.894 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.894 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:15.894 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f61adab92eb] 2024-09-12T00:35:15.895 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f61adab949f] 2024-09-12T00:35:15.895 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e3dbf4ecc1] 2024-09-12T00:35:15.895 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422a3e) [0x55e3dc9aca3e] 2024-09-12T00:35:15.895 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e3dbf63ced] 2024-09-12T00:35:15.895 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:35:15.895 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f61ac91fd90] 2024-09-12T00:35:15.895 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:35:15.895 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:35:15.895 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.895 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:35:15.753+0000 7f61aa1df9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:15.895 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f61aa1df9c0 thread_name:radosgw-admin 2024-09-12T00:35:15.895 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.895 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:15.896 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f61ac938520] 2024-09-12T00:35:15.896 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:35:15.896 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:35:15.896 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:35:15.896 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f61adab9345] 2024-09-12T00:35:15.896 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f61adab949f] 2024-09-12T00:35:15.896 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e3dbf4ecc1] 2024-09-12T00:35:15.896 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422a3e) [0x55e3dc9aca3e] 2024-09-12T00:35:15.896 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55e3dbf63ced] 2024-09-12T00:35:15.896 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:35:15.896 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f61ac91fd90] 2024-09-12T00:35:15.896 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:35:15.896 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:35:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:15.897 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:35:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:35:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:35:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:35:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:35:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:35:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:35:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:35:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:35:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:35:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:35:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:35:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:35:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:35:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:35:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:35:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:35:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:35:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:35:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:35:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:35:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:35:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:35:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:35:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:35:15.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:35:15.899 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:35:15.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:35:15.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:35:15.899 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:35:15.899 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:35:15.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:35:15.899 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:35:15.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:35:15.899 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:35:15.899 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:35:15.899 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:35:15.899 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:35:15.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:35:15.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:35:15.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:35:15.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:35:15.900 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:35:15.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:35:15.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:35:15.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:35:15.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:35:15.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:35:15.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:35:15.900 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:35:15.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:35:15.900 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:35:15.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:35:15.901 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:35:15.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:35:15.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:35:15.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:35:15.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:35:15.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:35:15.901 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:35:15.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:35:15.901 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:35:15.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:35:15.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:35:15.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:35:15.902 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:35:15.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:35:15.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:35:15.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:35:15.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:35:15.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:35:15.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:35:15.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:35:15.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:35:15.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:35:15.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:35:15.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:35:15.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:35:15.902 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:35:15.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:35:15.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:35:15.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:35:15.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:35:15.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:35:15.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:35:15.903 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:35:15.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:35:15.903 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:35:15.903 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:35:15.903 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:35:15.903 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:35:15.904 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:35:15.904 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:35:15.904 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:35:15.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f5fd67fc640 / http_manager 2024-09-12T00:35:15.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f605cfe1640 / http_manager 2024-09-12T00:35:15.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f605dfe3640 / rgw_dt_lg_renew 2024-09-12T00:35:15.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f60857fa640 / ms_dispatch 2024-09-12T00:35:15.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f6086ffd640 / io_context_pool 2024-09-12T00:35:15.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f608d7fa640 / ms_dispatch 2024-09-12T00:35:15.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f608ffff640 / ms_dispatch 2024-09-12T00:35:15.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f6095e0b640 / io_context_pool 2024-09-12T00:35:15.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f61a74e4640 / msgr-worker-2 2024-09-12T00:35:15.904 INFO:tasks.workunit.client.0.smithi138.stderr: 7f61a7ce5640 / msgr-worker-1 2024-09-12T00:35:15.905 INFO:tasks.workunit.client.0.smithi138.stderr: 7f61a84e6640 / msgr-worker-0 2024-09-12T00:35:15.905 INFO:tasks.workunit.client.0.smithi138.stderr: 7f61a8ce7640 / io_context_pool 2024-09-12T00:35:15.905 INFO:tasks.workunit.client.0.smithi138.stderr: 7f61aa1df9c0 / radosgw-admin 2024-09-12T00:35:15.905 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:35:15.905 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:35:15.905 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:35:15.758240Z_dd71f04c-bcd4-4511-b5f7-8576905a4750/log 2024-09-12T00:35:15.905 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:35:15.905 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-12T00:35:15.905 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:35:15.907 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:15.907 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:15.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.841+0000 7f4ed4f339c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.845+0000 7f4ed4f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.845+0000 7f4ed4f339c0 20 realm 2024-09-12T00:35:15.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.845+0000 7f4ed4f339c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.845+0000 7f4ed4f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.845+0000 7f4ed4f339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:15.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.845+0000 7f4ed4f339c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.845+0000 7f4ed4f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:15.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.845+0000 7f4ed4f339c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.845+0000 7f4ed4f339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:15.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.845+0000 7f4ed4f339c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:15.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.845+0000 7f4ed4f339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:15.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.845+0000 7f4ed4f339c0 20 searching for the correct realm 2024-09-12T00:35:15.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:15.849+0000 7f4ed2a39640 0 -- 172.21.15.138:0/652080042 >> [v2:172.21.15.138:6816/3496313381,v1:172.21.15.138:6817/3496313381] conn(0x562528d409a0 msgr2=0x7f4ec4086a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:16.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.061+0000 7f4ed2238640 0 -- 172.21.15.138:0/652080042 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x562528f70150 msgr2=0x562528f72590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:16.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.081+0000 7f4ed4f339c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:16.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.081+0000 7f4ed4f339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:16.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.081+0000 7f4ed4f339c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:16.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.081+0000 7f4ed4f339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:16.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.081+0000 7f4ed4f339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:16.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.081+0000 7f4ed4f339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:16.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.081+0000 7f4ed4f339c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.081+0000 7f4ed4f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.081+0000 7f4ed4f339c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.081+0000 7f4ed4f339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:16.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.081+0000 7f4ed4f339c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.085+0000 7f4ed4f339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:16.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.085+0000 7f4ed4f339c0 20 zone default found 2024-09-12T00:35:16.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.085+0000 7f4ed4f339c0 4 Realm: () 2024-09-12T00:35:16.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.085+0000 7f4ed4f339c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:16.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.085+0000 7f4ed4f339c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:16.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.085+0000 7f4ed4f339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:16.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.085+0000 7f4ed4f339c0 20 zonegroup default 2024-09-12T00:35:16.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.085+0000 7f4ed4f339c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.085+0000 7f4ed4f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.085+0000 7f4ed4f339c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.085+0000 7f4ed4f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.085+0000 7f4ed4f339c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.085+0000 7f4ed4f339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.085+0000 7f4ed4f339c0 20 started sync module instance, tier type = 2024-09-12T00:35:16.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.085+0000 7f4ed4f339c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:16.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.109+0000 7f4ed4f339c0 20 add_watcher() i=0 2024-09-12T00:35:16.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.109+0000 7f4ed4f339c0 20 add_watcher() i=1 2024-09-12T00:35:16.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.109+0000 7f4ed4f339c0 20 add_watcher() i=2 2024-09-12T00:35:16.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.109+0000 7f4ed4f339c0 20 add_watcher() i=3 2024-09-12T00:35:16.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.109+0000 7f4ed4f339c0 20 add_watcher() i=4 2024-09-12T00:35:16.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.109+0000 7f4ed4f339c0 20 add_watcher() i=5 2024-09-12T00:35:16.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.109+0000 7f4ed4f339c0 20 add_watcher() i=6 2024-09-12T00:35:16.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.109+0000 7f4ed4f339c0 20 add_watcher() i=7 2024-09-12T00:35:16.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.109+0000 7f4ed4f339c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:16.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.117+0000 7f4d897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:16.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.117+0000 7f4ed4f339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:16.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.117+0000 7f4ed4f339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:16.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.117+0000 7f4ed4f339c0 5 note: GC not initialized 2024-09-12T00:35:16.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.117+0000 7f4d03fff640 20 reqs_thread_entry: start 2024-09-12T00:35:16.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.117+0000 7f4ed4f339c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:16.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.117+0000 7f4ed4f339c0 20 Filter name: none 2024-09-12T00:35:16.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.117+0000 7f4d01ffb640 20 reqs_thread_entry: start 2024-09-12T00:35:16.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.117+0000 7f4ed4f339c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.117+0000 7f4ed4f339c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:16.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.117+0000 7f4ed4f339c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.121+0000 7f4ed4f339c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:35:16.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.121+0000 7f4ed4f339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:16.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.121+0000 7f4ed4f339c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.121+0000 7f4ed4f339c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:16.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.121+0000 7f4ed4f339c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.121+0000 7f4ed4f339c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:35:16.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.121+0000 7f4ed4f339c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:16.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.125+0000 7f4d897e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:16.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.129+0000 7f4ed4f339c0 20 remove_watcher() i=0 2024-09-12T00:35:16.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.129+0000 7f4ed4f339c0 2 removed watcher, disabling cache 2024-09-12T00:35:16.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.133+0000 7f4ed4f339c0 20 remove_watcher() i=1 2024-09-12T00:35:16.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.133+0000 7f4ed4f339c0 20 remove_watcher() i=2 2024-09-12T00:35:16.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.137+0000 7f4ed4f339c0 20 remove_watcher() i=3 2024-09-12T00:35:16.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.137+0000 7f4ed4f339c0 20 remove_watcher() i=4 2024-09-12T00:35:16.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.141+0000 7f4ed4f339c0 20 remove_watcher() i=5 2024-09-12T00:35:16.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.141+0000 7f4ed4f339c0 20 remove_watcher() i=6 2024-09-12T00:35:16.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.145+0000 7f4ed4f339c0 20 remove_watcher() i=7 2024-09-12T00:35:16.162 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:16.162 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:35:16.163 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-trim-reshard-log-entries id: e2043445-c131-4520-984d-b4d52f038a6b.4538.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:35:16.163 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:16.163 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:16.164 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:16.175 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:16.175 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:16.222 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:35:16.258 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:16.258 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:16.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.305+0000 7fe8504469c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.309+0000 7fe8504469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.309+0000 7fe8504469c0 20 realm 2024-09-12T00:35:16.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.309+0000 7fe8504469c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.309+0000 7fe8504469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.309+0000 7fe8504469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:16.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.309+0000 7fe8504469c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.309+0000 7fe8504469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.309+0000 7fe8504469c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.313+0000 7fe8504469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:16.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.313+0000 7fe8504469c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.313+0000 7fe8504469c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:16.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.313+0000 7fe8504469c0 20 searching for the correct realm 2024-09-12T00:35:16.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.317+0000 7fe84e74d640 0 -- 172.21.15.138:0/2673189725 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fe848008040 msgr2=0x7fe84805f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:16.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.533+0000 7fe84e74d640 0 -- 172.21.15.138:0/2673189725 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55d1c85c9a50 msgr2=0x55d1c85cbf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:16.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.541+0000 7fe8504469c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:16.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.541+0000 7fe8504469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:16.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.541+0000 7fe8504469c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:16.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.541+0000 7fe8504469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:16.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.541+0000 7fe8504469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:16.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.541+0000 7fe8504469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:16.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.541+0000 7fe8504469c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.541+0000 7fe8504469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.541+0000 7fe8504469c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.541+0000 7fe8504469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:16.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.541+0000 7fe8504469c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.541+0000 7fe8504469c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:16.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.541+0000 7fe8504469c0 20 zone default found 2024-09-12T00:35:16.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.545+0000 7fe8504469c0 4 Realm: () 2024-09-12T00:35:16.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.545+0000 7fe8504469c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:16.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.545+0000 7fe8504469c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:16.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.545+0000 7fe8504469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:16.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.545+0000 7fe8504469c0 20 zonegroup default 2024-09-12T00:35:16.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.545+0000 7fe8504469c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.545+0000 7fe8504469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.545+0000 7fe8504469c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.545+0000 7fe8504469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.545+0000 7fe8504469c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.545+0000 7fe8504469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:16.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.545+0000 7fe8504469c0 20 started sync module instance, tier type = 2024-09-12T00:35:16.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.545+0000 7fe8504469c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:16.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.577+0000 7fe8504469c0 20 add_watcher() i=0 2024-09-12T00:35:16.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.577+0000 7fe8504469c0 20 add_watcher() i=1 2024-09-12T00:35:16.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.577+0000 7fe8504469c0 20 add_watcher() i=2 2024-09-12T00:35:16.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.577+0000 7fe8504469c0 20 add_watcher() i=3 2024-09-12T00:35:16.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.577+0000 7fe8504469c0 20 add_watcher() i=4 2024-09-12T00:35:16.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.577+0000 7fe8504469c0 20 add_watcher() i=5 2024-09-12T00:35:16.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.577+0000 7fe8504469c0 20 add_watcher() i=6 2024-09-12T00:35:16.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.577+0000 7fe8504469c0 20 add_watcher() i=7 2024-09-12T00:35:16.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.577+0000 7fe8504469c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:16.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.581+0000 7fe6ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:16.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:16.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:16.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 5 note: GC not initialized 2024-09-12T00:35:16.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe6fe7fc640 20 reqs_thread_entry: start 2024-09-12T00:35:16.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:16.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 20 Filter name: none 2024-09-12T00:35:16.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe66ffff640 20 reqs_thread_entry: start 2024-09-12T00:35:16.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:35:16.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:16.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:35:16.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:35:16.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 : miss 2024-09-12T00:35:16.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:16.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:35:16.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 info.flags=0x17 2024-09-12T00:35:16.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to cache LRU end 2024-09-12T00:35:16.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:16.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:16.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.585+0000 7fe8504469c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 2024-09-12T00:35:16.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.589+0000 7fe8504469c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to be held by another RGW process; skipping for now 2024-09-12T00:35:16.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.589+0000 7fe6ff7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:16.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.597+0000 7fe8504469c0 20 remove_watcher() i=0 2024-09-12T00:35:16.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.597+0000 7fe8504469c0 2 removed watcher, disabling cache 2024-09-12T00:35:16.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.597+0000 7fe8504469c0 20 remove_watcher() i=1 2024-09-12T00:35:16.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.601+0000 7fe8504469c0 20 remove_watcher() i=2 2024-09-12T00:35:16.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.601+0000 7fe8504469c0 20 remove_watcher() i=3 2024-09-12T00:35:16.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.605+0000 7fe8504469c0 20 remove_watcher() i=4 2024-09-12T00:35:16.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.605+0000 7fe8504469c0 20 remove_watcher() i=5 2024-09-12T00:35:16.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.609+0000 7fe8504469c0 20 remove_watcher() i=6 2024-09-12T00:35:16.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:16.613+0000 7fe8504469c0 20 remove_watcher() i=7 2024-09-12T00:35:16.623 INFO:tasks.workunit.client.0.smithi138.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:35:46.655 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:35:46.692 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:46.692 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:46.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.736+0000 7ff6991d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.740+0000 7ff6991d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:46.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.740+0000 7ff6991d39c0 20 realm 2024-09-12T00:35:46.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.740+0000 7ff6991d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.740+0000 7ff6991d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:46.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.740+0000 7ff6991d39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:46.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.740+0000 7ff6991d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.740+0000 7ff6991d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:46.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.740+0000 7ff6991d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.740+0000 7ff6991d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:46.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.740+0000 7ff6991d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.744+0000 7ff6991d39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:46.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.744+0000 7ff6991d39c0 20 searching for the correct realm 2024-09-12T00:35:46.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.748+0000 7ff6974da640 0 -- 172.21.15.138:0/3268220912 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x557f7aa0f840 msgr2=0x557f7aa11d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:46.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.752+0000 7ff6964d8640 0 -- 172.21.15.138:0/3268220912 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x557f7aa0aac0 msgr2=0x557f7aa0ceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:46.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.760+0000 7ff6991d39c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:46.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.760+0000 7ff6991d39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:46.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.760+0000 7ff6991d39c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:46.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.760+0000 7ff6991d39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:46.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.760+0000 7ff6991d39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:46.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.760+0000 7ff6991d39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:46.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.760+0000 7ff6991d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:46.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:46.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:46.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 20 zone default found 2024-09-12T00:35:46.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 4 Realm: () 2024-09-12T00:35:46.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:46.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:46.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:46.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 20 zonegroup default 2024-09-12T00:35:46.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:46.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:46.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:46.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 20 started sync module instance, tier type = 2024-09-12T00:35:46.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.764+0000 7ff6991d39c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:46.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.796+0000 7ff6991d39c0 20 add_watcher() i=0 2024-09-12T00:35:46.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.796+0000 7ff6991d39c0 20 add_watcher() i=1 2024-09-12T00:35:46.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.796+0000 7ff6991d39c0 20 add_watcher() i=2 2024-09-12T00:35:46.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.796+0000 7ff6991d39c0 20 add_watcher() i=3 2024-09-12T00:35:46.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.796+0000 7ff6991d39c0 20 add_watcher() i=4 2024-09-12T00:35:46.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.796+0000 7ff6991d39c0 20 add_watcher() i=5 2024-09-12T00:35:46.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.796+0000 7ff6991d39c0 20 add_watcher() i=6 2024-09-12T00:35:46.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.796+0000 7ff6991d39c0 20 add_watcher() i=7 2024-09-12T00:35:46.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.796+0000 7ff6991d39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:46.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.800+0000 7ff54d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:46.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.800+0000 7ff6991d39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:46.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.800+0000 7ff6991d39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:46.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.800+0000 7ff6991d39c0 5 note: GC not initialized 2024-09-12T00:35:46.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.800+0000 7ff4c7fff640 20 reqs_thread_entry: start 2024-09-12T00:35:46.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.800+0000 7ff6991d39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:46.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.800+0000 7ff6991d39c0 20 Filter name: none 2024-09-12T00:35:46.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.800+0000 7ff4c5ffb640 20 reqs_thread_entry: start 2024-09-12T00:35:46.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.800+0000 7ff6991d39c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:35:46.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.800+0000 7ff6991d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.804+0000 7ff6991d39c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:46.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.804+0000 7ff6991d39c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:35:46.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.804+0000 7ff6991d39c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:35:46.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.804+0000 7ff6991d39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 : miss 2024-09-12T00:35:46.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.804+0000 7ff6991d39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.804+0000 7ff6991d39c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:35:46.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.804+0000 7ff6991d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 info.flags=0x17 2024-09-12T00:35:46.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.804+0000 7ff6991d39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to cache LRU end 2024-09-12T00:35:46.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.804+0000 7ff6991d39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:46.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.804+0000 7ff6991d39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:46.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.804+0000 7ff6991d39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 2024-09-12T00:35:46.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.804+0000 7ff6991d39c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:35:46.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.820+0000 7ff6991d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 info.flags=0x17 2024-09-12T00:35:46.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.820+0000 7ff6991d39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to cache LRU end 2024-09-12T00:35:46.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.820+0000 7ff6991d39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:46.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.820+0000 7ff6991d39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27, ofs0, ns] 2024-09-12T00:35:46.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.820+0000 7ff579ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333546 cookie 94006006592320 notifier 6960 bl.length()=939 2024-09-12T00:35:46.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.820+0000 7ff579ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 info.flags=0x17 2024-09-12T00:35:46.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.820+0000 7ff579ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to cache LRU end 2024-09-12T00:35:46.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.820+0000 7ff579ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:46.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.820+0000 7ff6991d39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): orig_sources= new_sources= 2024-09-12T00:35:46.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.820+0000 7ff6991d39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): potential sources added=[] removed=[] 2024-09-12T00:35:46.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.820+0000 7ff6991d39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): orig_dests= new_dests= 2024-09-12T00:35:46.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.820+0000 7ff6991d39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): potential dests added=[] removed=[] 2024-09-12T00:35:46.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.0 2024-09-12T00:35:46.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.0 2024-09-12T00:35:46.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.1 2024-09-12T00:35:46.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.1 2024-09-12T00:35:46.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.2 2024-09-12T00:35:46.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.2 2024-09-12T00:35:46.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.3 2024-09-12T00:35:46.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.3 2024-09-12T00:35:46.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.4 2024-09-12T00:35:46.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.4 2024-09-12T00:35:46.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.5 2024-09-12T00:35:46.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.5 2024-09-12T00:35:46.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.6 2024-09-12T00:35:46.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.6 2024-09-12T00:35:46.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.7 2024-09-12T00:35:46.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.7 2024-09-12T00:35:46.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.8 2024-09-12T00:35:46.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.8 2024-09-12T00:35:46.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.9 2024-09-12T00:35:46.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.9 2024-09-12T00:35:46.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.10 2024-09-12T00:35:46.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.10 2024-09-12T00:35:46.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.11 2024-09-12T00:35:46.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2.11 2024-09-12T00:35:46.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.0 2024-09-12T00:35:46.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.832+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.1 2024-09-12T00:35:46.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.836+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2 2024-09-12T00:35:46.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.836+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.3 2024-09-12T00:35:46.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.836+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.4 2024-09-12T00:35:46.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.836+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.5 2024-09-12T00:35:46.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.840+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.6 2024-09-12T00:35:46.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.840+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.7 2024-09-12T00:35:46.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.840+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.8 2024-09-12T00:35:46.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.840+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.9 2024-09-12T00:35:46.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.840+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.10 2024-09-12T00:35:46.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.848+0000 7ff6991d39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:46.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.848+0000 7ff6991d39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 2024-09-12T00:35:46.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.852+0000 7ff6991d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 info.flags=0x17 2024-09-12T00:35:46.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.852+0000 7ff6991d39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to cache LRU end 2024-09-12T00:35:46.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.852+0000 7ff6991d39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:46.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.852+0000 7ff6991d39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27, ofs0, ns] 2024-09-12T00:35:46.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.852+0000 7ff579ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333547 cookie 94006006592320 notifier 6960 bl.length()=939 2024-09-12T00:35:46.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.852+0000 7ff579ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 info.flags=0x17 2024-09-12T00:35:46.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.852+0000 7ff579ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to cache LRU end 2024-09-12T00:35:46.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.852+0000 7ff579ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:46.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.852+0000 7ff6991d39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): orig_sources= new_sources= 2024-09-12T00:35:46.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.852+0000 7ff6991d39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): potential sources added=[] removed=[] 2024-09-12T00:35:46.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.852+0000 7ff6991d39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): orig_dests= new_dests= 2024-09-12T00:35:46.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.852+0000 7ff6991d39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): potential dests added=[] removed=[] 2024-09-12T00:35:46.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.860+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.0 2024-09-12T00:35:46.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.860+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.1 2024-09-12T00:35:46.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.860+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.2 2024-09-12T00:35:46.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.860+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.3 2024-09-12T00:35:46.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.864+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.4 2024-09-12T00:35:46.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.864+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.5 2024-09-12T00:35:46.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.864+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.6 2024-09-12T00:35:46.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.864+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.7 2024-09-12T00:35:46.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.864+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.8 2024-09-12T00:35:46.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.864+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.9 2024-09-12T00:35:46.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.864+0000 7ff6991d39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.27.10 2024-09-12T00:35:46.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.868+0000 7ff6991d39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:46.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.868+0000 7ff6991d39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 2024-09-12T00:35:46.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.868+0000 7ff6991d39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 info.flags=0x17 2024-09-12T00:35:46.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.868+0000 7ff6991d39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to cache LRU end 2024-09-12T00:35:46.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.868+0000 7ff6991d39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:46.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.868+0000 7ff6991d39c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27, ofs0, ns] 2024-09-12T00:35:46.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.872+0000 7ff57a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333548 cookie 94006006592320 notifier 6960 bl.length()=907 2024-09-12T00:35:46.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.872+0000 7ff57a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 info.flags=0x17 2024-09-12T00:35:46.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.872+0000 7ff57a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:e2043445-c131-4520-984d-b4d52f038a6b.4538.27 to cache LRU end 2024-09-12T00:35:46.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.872+0000 7ff57a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:46.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.872+0000 7ff6991d39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): orig_sources= new_sources= 2024-09-12T00:35:46.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.872+0000 7ff6991d39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): potential sources added=[] removed=[] 2024-09-12T00:35:46.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.872+0000 7ff6991d39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): orig_dests= new_dests= 2024-09-12T00:35:46.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.872+0000 7ff6991d39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[e2043445-c131-4520-984d-b4d52f038a6b.4538.27]): potential dests added=[] removed=[] 2024-09-12T00:35:46.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.876+0000 7ff6991d39c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:35:46.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.880+0000 7ff54d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:46.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.884+0000 7ff6991d39c0 20 remove_watcher() i=0 2024-09-12T00:35:46.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.884+0000 7ff6991d39c0 2 removed watcher, disabling cache 2024-09-12T00:35:46.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.888+0000 7ff6991d39c0 20 remove_watcher() i=1 2024-09-12T00:35:46.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.888+0000 7ff6991d39c0 20 remove_watcher() i=2 2024-09-12T00:35:46.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.892+0000 7ff6991d39c0 20 remove_watcher() i=3 2024-09-12T00:35:46.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.892+0000 7ff6991d39c0 20 remove_watcher() i=4 2024-09-12T00:35:46.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.896+0000 7ff6991d39c0 20 remove_watcher() i=5 2024-09-12T00:35:46.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.896+0000 7ff6991d39c0 20 remove_watcher() i=6 2024-09-12T00:35:46.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.900+0000 7ff6991d39c0 20 remove_watcher() i=7 2024-09-12T00:35:46.916 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:35:46.946 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:46.947 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:46.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.992+0000 7f8bfad879c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.992+0000 7f8bfad879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:46.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.992+0000 7f8bfad879c0 20 realm 2024-09-12T00:35:46.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.992+0000 7f8bfad879c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.992+0000 7f8bfad879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:46.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.992+0000 7f8bfad879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:46.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.992+0000 7f8bfad879c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.996+0000 7f8bfad879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:46.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.996+0000 7f8bfad879c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.996+0000 7f8bfad879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:46.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.996+0000 7f8bfad879c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:46.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.996+0000 7f8bfad879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:46.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:46.996+0000 7f8bfad879c0 20 searching for the correct realm 2024-09-12T00:35:46.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.000+0000 7f8bf908e640 0 -- 172.21.15.138:0/4033223465 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f8bf40b2900 msgr2=0x7f8bf40b1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:47.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.216+0000 7f8bf908e640 0 -- 172.21.15.138:0/4033223465 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x563847955460 msgr2=0x563847957920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:47.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.224+0000 7f8bfad879c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:47.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.224+0000 7f8bfad879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:47.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.224+0000 7f8bfad879c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:47.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.224+0000 7f8bfad879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:47.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.224+0000 7f8bfad879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:47.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.224+0000 7f8bfad879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:47.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.224+0000 7f8bfad879c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:47.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.224+0000 7f8bfad879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:47.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.224+0000 7f8bfad879c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:47.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.224+0000 7f8bfad879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:47.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.224+0000 7f8bfad879c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:47.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.228+0000 7f8bfad879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:47.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.228+0000 7f8bfad879c0 20 zone default found 2024-09-12T00:35:47.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.228+0000 7f8bfad879c0 4 Realm: () 2024-09-12T00:35:47.225 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.228+0000 7f8bfad879c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:47.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.228+0000 7f8bfad879c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:47.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.228+0000 7f8bfad879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:47.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.228+0000 7f8bfad879c0 20 zonegroup default 2024-09-12T00:35:47.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.228+0000 7f8bfad879c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:47.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.228+0000 7f8bfad879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:47.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.228+0000 7f8bfad879c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:47.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.228+0000 7f8bfad879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:47.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.228+0000 7f8bfad879c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:47.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.228+0000 7f8bfad879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:47.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.228+0000 7f8bfad879c0 20 started sync module instance, tier type = 2024-09-12T00:35:47.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.228+0000 7f8bfad879c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:47.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.252+0000 7f8bfad879c0 20 add_watcher() i=0 2024-09-12T00:35:47.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.252+0000 7f8bfad879c0 20 add_watcher() i=1 2024-09-12T00:35:47.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.252+0000 7f8bfad879c0 20 add_watcher() i=2 2024-09-12T00:35:47.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.252+0000 7f8bfad879c0 20 add_watcher() i=3 2024-09-12T00:35:47.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.252+0000 7f8bfad879c0 20 add_watcher() i=4 2024-09-12T00:35:47.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.252+0000 7f8bfad879c0 20 add_watcher() i=5 2024-09-12T00:35:47.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.252+0000 7f8bfad879c0 20 add_watcher() i=6 2024-09-12T00:35:47.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.252+0000 7f8bfad879c0 20 add_watcher() i=7 2024-09-12T00:35:47.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.252+0000 7f8bfad879c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:47.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.256+0000 7f8aaefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:47.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.256+0000 7f8bfad879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:47.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.256+0000 7f8bfad879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:47.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.256+0000 7f8bfad879c0 5 note: GC not initialized 2024-09-12T00:35:47.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.256+0000 7f8aadfe3640 20 reqs_thread_entry: start 2024-09-12T00:35:47.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.256+0000 7f8bfad879c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:47.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.260+0000 7f8bfad879c0 20 Filter name: none 2024-09-12T00:35:47.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.260+0000 7f8a1f7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:47.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.260+0000 7f8bfad879c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:47.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.260+0000 7f8bfad879c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:47.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.260+0000 7f8bfad879c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:47.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.260+0000 7f8bfad879c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:35:47.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.260+0000 7f8bfad879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:47.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.260+0000 7f8bfad879c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:47.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.260+0000 7f8bfad879c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:35:47.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.260+0000 7f8bfad879c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:47.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.260+0000 7f8bfad879c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:35:47.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.260+0000 7f8bfad879c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:47.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.264+0000 7f8aaefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:47.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.268+0000 7f8bfad879c0 20 remove_watcher() i=0 2024-09-12T00:35:47.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.268+0000 7f8bfad879c0 2 removed watcher, disabling cache 2024-09-12T00:35:47.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.272+0000 7f8bfad879c0 20 remove_watcher() i=1 2024-09-12T00:35:47.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.272+0000 7f8bfad879c0 20 remove_watcher() i=2 2024-09-12T00:35:47.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.276+0000 7f8bfad879c0 20 remove_watcher() i=3 2024-09-12T00:35:47.276 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.276+0000 7f8bfad879c0 20 remove_watcher() i=4 2024-09-12T00:35:47.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.280+0000 7f8bfad879c0 20 remove_watcher() i=5 2024-09-12T00:35:47.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.284+0000 7f8bfad879c0 20 remove_watcher() i=6 2024-09-12T00:35:47.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.284+0000 7f8bfad879c0 20 remove_watcher() i=7 2024-09-12T00:35:47.301 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:47.301 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:35:47.301 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-trim-reshard-log-entries id: e2043445-c131-4520-984d-b4d52f038a6b.4538.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:35:47.301 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:47.303 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.303 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.307 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.307 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.356 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.356 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.405 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T00:35:47.405 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:47.407 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.407 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.432 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.432 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.480 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.481 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.502 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.502 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.522 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.522 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.542 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.542 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.565 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.566 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.586 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.586 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.607 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.607 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.630 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.630 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.651 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.651 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.671 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.671 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.694 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.694 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.716 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.716 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.737 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.738 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.759 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.759 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.781 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.781 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.801 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.802 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.822 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.822 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.844 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.844 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.865 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.866 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.887 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:47.887 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:47.906 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:35:47.937 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:47.938 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:47.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.984+0000 7f12e46a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:47.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.984+0000 7f12e46a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:47.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.984+0000 7f12e46a79c0 20 realm 2024-09-12T00:35:47.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.984+0000 7f12e46a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:47.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.988+0000 7f12e46a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:47.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.988+0000 7f12e46a79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:47.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.988+0000 7f12e46a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:47.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.988+0000 7f12e46a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:47.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.988+0000 7f12e46a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:47.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.988+0000 7f12e46a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:47.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.988+0000 7f12e46a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:47.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.988+0000 7f12e46a79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:47.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.988+0000 7f12e46a79c0 20 searching for the correct realm 2024-09-12T00:35:47.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:47.992+0000 7f12e29ae640 0 -- 172.21.15.138:0/3618405772 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5607e7290480 msgr2=0x5607e7292940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:47.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.000+0000 7f12e19ac640 0 -- 172.21.15.138:0/3618405772 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x5607e728b730 msgr2=0x5607e728db20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:48.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:48.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:48.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:48.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:48.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:48.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:48.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:48.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:48.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 20 zone default found 2024-09-12T00:35:48.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 4 Realm: () 2024-09-12T00:35:48.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:48.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:48.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:48.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 20 zonegroup default 2024-09-12T00:35:48.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.008+0000 7f12e46a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.012+0000 7f12e46a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.012+0000 7f12e46a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.012+0000 7f12e46a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.012+0000 7f12e46a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.012+0000 7f12e46a79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.012+0000 7f12e46a79c0 20 started sync module instance, tier type = 2024-09-12T00:35:48.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.012+0000 7f12e46a79c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:48.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.028+0000 7f12e46a79c0 20 add_watcher() i=0 2024-09-12T00:35:48.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.028+0000 7f12e46a79c0 20 add_watcher() i=1 2024-09-12T00:35:48.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.028+0000 7f12e46a79c0 20 add_watcher() i=2 2024-09-12T00:35:48.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.028+0000 7f12e46a79c0 20 add_watcher() i=3 2024-09-12T00:35:48.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.028+0000 7f12e46a79c0 20 add_watcher() i=4 2024-09-12T00:35:48.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.028+0000 7f12e46a79c0 20 add_watcher() i=5 2024-09-12T00:35:48.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.028+0000 7f12e46a79c0 20 add_watcher() i=6 2024-09-12T00:35:48.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.032+0000 7f12e46a79c0 20 add_watcher() i=7 2024-09-12T00:35:48.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.032+0000 7f12e46a79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:48.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f1198fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:48.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f12e46a79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:48.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f12e46a79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:48.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f12e46a79c0 5 note: GC not initialized 2024-09-12T00:35:48.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f11137fe640 20 reqs_thread_entry: start 2024-09-12T00:35:48.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f12e46a79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:48.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f12e46a79c0 20 Filter name: none 2024-09-12T00:35:48.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f11117fa640 20 reqs_thread_entry: start 2024-09-12T00:35:48.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f12e46a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f12e46a79c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:35:48.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f12e46a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f12e46a79c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:35:48.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f12e46a79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:48.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f12e46a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f12e46a79c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:35:48.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f12e46a79c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f12e46a79c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:35:48.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.036+0000 7f12e46a79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:48.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.040+0000 7f1198fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:48.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.044+0000 7f12e46a79c0 20 remove_watcher() i=0 2024-09-12T00:35:48.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.044+0000 7f12e46a79c0 2 removed watcher, disabling cache 2024-09-12T00:35:48.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.048+0000 7f12e46a79c0 20 remove_watcher() i=1 2024-09-12T00:35:48.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.048+0000 7f12e46a79c0 20 remove_watcher() i=2 2024-09-12T00:35:48.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.052+0000 7f12e46a79c0 20 remove_watcher() i=3 2024-09-12T00:35:48.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.052+0000 7f12e46a79c0 20 remove_watcher() i=4 2024-09-12T00:35:48.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.056+0000 7f12e46a79c0 20 remove_watcher() i=5 2024-09-12T00:35:48.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.056+0000 7f12e46a79c0 20 remove_watcher() i=6 2024-09-12T00:35:48.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.060+0000 7f12e46a79c0 20 remove_watcher() i=7 2024-09-12T00:35:48.072 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:48.073 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:35:48.073 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-block-writes id: e2043445-c131-4520-984d-b4d52f038a6b.4538.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:35:48.073 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:48.073 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T00:35:48.105 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:48.105 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:48.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.148+0000 7f6a8eb189c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.152+0000 7f6a8eb189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.152+0000 7f6a8eb189c0 20 realm 2024-09-12T00:35:48.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.152+0000 7f6a8eb189c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.152+0000 7f6a8eb189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.152+0000 7f6a8eb189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:48.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.152+0000 7f6a8eb189c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.152+0000 7f6a8eb189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.152+0000 7f6a8eb189c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.152+0000 7f6a8eb189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:48.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.152+0000 7f6a8eb189c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.152+0000 7f6a8eb189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:48.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.152+0000 7f6a8eb189c0 20 searching for the correct realm 2024-09-12T00:35:48.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.160+0000 7f6a8ce1f640 0 -- 172.21.15.138:0/3975079564 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f6a84021440 msgr2=0x7f6a840218a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:48.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.376+0000 7f6a8ce1f640 0 -- 172.21.15.138:0/3975079564 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5595dfa8e6f0 msgr2=0x5595dfa90bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:48.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.384+0000 7f6a8eb189c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:48.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.384+0000 7f6a8eb189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:48.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.384+0000 7f6a8eb189c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:48.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.384+0000 7f6a8eb189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:48.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.384+0000 7f6a8eb189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:48.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.384+0000 7f6a8eb189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:48.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.384+0000 7f6a8eb189c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.388+0000 7f6a8eb189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.388+0000 7f6a8eb189c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.388+0000 7f6a8eb189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:48.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.388+0000 7f6a8eb189c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.388+0000 7f6a8eb189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:48.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.388+0000 7f6a8eb189c0 20 zone default found 2024-09-12T00:35:48.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.388+0000 7f6a8eb189c0 4 Realm: () 2024-09-12T00:35:48.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.388+0000 7f6a8eb189c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:48.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.388+0000 7f6a8eb189c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:48.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.388+0000 7f6a8eb189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:48.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.388+0000 7f6a8eb189c0 20 zonegroup default 2024-09-12T00:35:48.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.388+0000 7f6a8eb189c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.388+0000 7f6a8eb189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.388+0000 7f6a8eb189c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.388+0000 7f6a8eb189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.388+0000 7f6a8eb189c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.392+0000 7f6a8eb189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.392+0000 7f6a8eb189c0 20 started sync module instance, tier type = 2024-09-12T00:35:48.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.392+0000 7f6a8eb189c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:48.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.412+0000 7f6a8eb189c0 20 add_watcher() i=0 2024-09-12T00:35:48.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.412+0000 7f6a8eb189c0 20 add_watcher() i=1 2024-09-12T00:35:48.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.412+0000 7f6a8eb189c0 20 add_watcher() i=2 2024-09-12T00:35:48.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.412+0000 7f6a8eb189c0 20 add_watcher() i=3 2024-09-12T00:35:48.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.412+0000 7f6a8eb189c0 20 add_watcher() i=4 2024-09-12T00:35:48.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.412+0000 7f6a8eb189c0 20 add_watcher() i=5 2024-09-12T00:35:48.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.412+0000 7f6a8eb189c0 20 add_watcher() i=6 2024-09-12T00:35:48.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.416+0000 7f6a8eb189c0 20 add_watcher() i=7 2024-09-12T00:35:48.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.416+0000 7f6a8eb189c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:48.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.420+0000 7f6942fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:48.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.420+0000 7f6a8eb189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:48.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.420+0000 7f6a8eb189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:48.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.420+0000 7f6a8eb189c0 5 note: GC not initialized 2024-09-12T00:35:48.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.420+0000 7f6941fdb640 20 reqs_thread_entry: start 2024-09-12T00:35:48.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.424+0000 7f6a8eb189c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:48.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.424+0000 7f6a8eb189c0 20 Filter name: none 2024-09-12T00:35:48.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.424+0000 7f68b37fe640 20 reqs_thread_entry: start 2024-09-12T00:35:48.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.424+0000 7f6a8eb189c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:35:48.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.424+0000 7f6a8eb189c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.424+0000 7f6a8eb189c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:35:48.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.424+0000 7f6a8eb189c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:35:48.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.424+0000 7f6a8eb189c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:35:48.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.424+0000 7f6a8eb189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 : miss 2024-09-12T00:35:48.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.424+0000 7f6a8eb189c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.424+0000 7f6a8eb189c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:35:48.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.424+0000 7f6a8eb189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 info.flags=0x17 2024-09-12T00:35:48.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.424+0000 7f6a8eb189c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 to cache LRU end 2024-09-12T00:35:48.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.424+0000 7f6a8eb189c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:48.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.424+0000 7f6a8eb189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:48.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.424+0000 7f6a8eb189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 2024-09-12T00:35:48.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.436+0000 7f6a8eb189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 info.flags=0x17 2024-09-12T00:35:48.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.436+0000 7f6a8eb189c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 to cache LRU end 2024-09-12T00:35:48.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.436+0000 7f6a8eb189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:48.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.436+0000 7f6a8eb189c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28, ofs0, ns] 2024-09-12T00:35:48.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.436+0000 7f69637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333551 cookie 94102190906640 notifier 6617 bl.length()=915 2024-09-12T00:35:48.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.436+0000 7f69637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 info.flags=0x17 2024-09-12T00:35:48.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.436+0000 7f69637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 to cache LRU end 2024-09-12T00:35:48.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.436+0000 7f69637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:48.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.436+0000 7f6a8eb189c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): orig_sources= new_sources= 2024-09-12T00:35:48.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.436+0000 7f6a8eb189c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): potential sources added=[] removed=[] 2024-09-12T00:35:48.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.436+0000 7f6a8eb189c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): orig_dests= new_dests= 2024-09-12T00:35:48.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.436+0000 7f6a8eb189c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): potential dests added=[] removed=[] 2024-09-12T00:35:48.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.0 2024-09-12T00:35:48.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.0 2024-09-12T00:35:48.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.1 2024-09-12T00:35:48.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.1 2024-09-12T00:35:48.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.2 2024-09-12T00:35:48.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.2 2024-09-12T00:35:48.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.3 2024-09-12T00:35:48.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.3 2024-09-12T00:35:48.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.4 2024-09-12T00:35:48.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.4 2024-09-12T00:35:48.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.5 2024-09-12T00:35:48.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.5 2024-09-12T00:35:48.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.6 2024-09-12T00:35:48.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.6 2024-09-12T00:35:48.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.7 2024-09-12T00:35:48.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.7 2024-09-12T00:35:48.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.8 2024-09-12T00:35:48.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.8 2024-09-12T00:35:48.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.9 2024-09-12T00:35:48.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.9 2024-09-12T00:35:48.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.10 2024-09-12T00:35:48.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.10 2024-09-12T00:35:48.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.11 2024-09-12T00:35:48.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.11 2024-09-12T00:35:48.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.448+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.0 2024-09-12T00:35:48.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.452+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1 2024-09-12T00:35:48.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.452+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.2 2024-09-12T00:35:48.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.452+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.3 2024-09-12T00:35:48.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.456+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.4 2024-09-12T00:35:48.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.456+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.5 2024-09-12T00:35:48.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.456+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.6 2024-09-12T00:35:48.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.456+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.7 2024-09-12T00:35:48.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.456+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.8 2024-09-12T00:35:48.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.460+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.9 2024-09-12T00:35:48.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.460+0000 7f6a8eb189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.10 2024-09-12T00:35:48.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.468+0000 7f6a8eb189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:48.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.468+0000 7f6a8eb189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 2024-09-12T00:35:48.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.472+0000 7f6a8eb189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 info.flags=0x17 2024-09-12T00:35:48.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.472+0000 7f6a8eb189c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 to cache LRU end 2024-09-12T00:35:48.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.472+0000 7f6a8eb189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:48.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.472+0000 7f6a8eb189c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28, ofs0, ns] 2024-09-12T00:35:48.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.472+0000 7f6962ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333552 cookie 94102190906640 notifier 6617 bl.length()=915 2024-09-12T00:35:48.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.472+0000 7f6962ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 info.flags=0x17 2024-09-12T00:35:48.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.472+0000 7f6962ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 to cache LRU end 2024-09-12T00:35:48.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.472+0000 7f6962ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:48.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.472+0000 7f6a8eb189c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): orig_sources= new_sources= 2024-09-12T00:35:48.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.472+0000 7f6a8eb189c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): potential sources added=[] removed=[] 2024-09-12T00:35:48.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.472+0000 7f6a8eb189c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): orig_dests= new_dests= 2024-09-12T00:35:48.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.472+0000 7f6a8eb189c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): potential dests added=[] removed=[] 2024-09-12T00:35:48.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.472+0000 7f6a8eb189c0 -1 Injecting error=-5 at location=block_writes 2024-09-12T00:35:48.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.472+0000 7f6a8eb189c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:35:48.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.484+0000 7f6a8eb189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:48.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.484+0000 7f6a8eb189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 2024-09-12T00:35:48.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.488+0000 7f6a8eb189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 info.flags=0x17 2024-09-12T00:35:48.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.488+0000 7f6a8eb189c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 to cache LRU end 2024-09-12T00:35:48.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.488+0000 7f6a8eb189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:48.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.488+0000 7f6a8eb189c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28, ofs0, ns] 2024-09-12T00:35:48.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.488+0000 7f69637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333553 cookie 94102190906640 notifier 6617 bl.length()=883 2024-09-12T00:35:48.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.488+0000 7f69637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 info.flags=0x17 2024-09-12T00:35:48.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.488+0000 7f69637fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 to cache LRU end 2024-09-12T00:35:48.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.488+0000 7f69637fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:48.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.488+0000 7f6a8eb189c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): orig_sources= new_sources= 2024-09-12T00:35:48.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.488+0000 7f6a8eb189c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): potential sources added=[] removed=[] 2024-09-12T00:35:48.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.488+0000 7f6a8eb189c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): orig_dests= new_dests= 2024-09-12T00:35:48.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.488+0000 7f6a8eb189c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): potential dests added=[] removed=[] 2024-09-12T00:35:48.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.496+0000 7f6a8eb189c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T00:35:48.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.500+0000 7f6942fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:48.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.504+0000 7f6a8eb189c0 20 remove_watcher() i=0 2024-09-12T00:35:48.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.504+0000 7f6a8eb189c0 2 removed watcher, disabling cache 2024-09-12T00:35:48.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.508+0000 7f6a8eb189c0 20 remove_watcher() i=1 2024-09-12T00:35:48.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.508+0000 7f6a8eb189c0 20 remove_watcher() i=2 2024-09-12T00:35:48.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.512+0000 7f6a8eb189c0 20 remove_watcher() i=3 2024-09-12T00:35:48.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.512+0000 7f6a8eb189c0 20 remove_watcher() i=4 2024-09-12T00:35:48.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.516+0000 7f6a8eb189c0 20 remove_watcher() i=5 2024-09-12T00:35:48.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.516+0000 7f6a8eb189c0 20 remove_watcher() i=6 2024-09-12T00:35:48.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.520+0000 7f6a8eb189c0 20 remove_watcher() i=7 2024-09-12T00:35:48.535 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:35:48.565 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:48.566 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:48.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.608+0000 7fe12ce719c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.612+0000 7fe12ce719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.612+0000 7fe12ce719c0 20 realm 2024-09-12T00:35:48.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.612+0000 7fe12ce719c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.612+0000 7fe12ce719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.612+0000 7fe12ce719c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:48.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.612+0000 7fe12ce719c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.612+0000 7fe12ce719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.612+0000 7fe12ce719c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.612+0000 7fe12ce719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:48.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.612+0000 7fe12ce719c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.616+0000 7fe12ce719c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:48.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.616+0000 7fe12ce719c0 20 searching for the correct realm 2024-09-12T00:35:48.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.616+0000 7fe12a977640 0 -- 172.21.15.138:0/1780825350 >> [v2:172.21.15.138:6816/3496313381,v1:172.21.15.138:6817/3496313381] conn(0x7fe114003ac0 msgr2=0x7fe12402e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:48.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.624+0000 7fe12a977640 0 -- 172.21.15.138:0/1780825350 >> [v2:172.21.15.138:6800/1437861584,v1:172.21.15.138:6801/1437861584] conn(0x7fe114003ac0 msgr2=0x7fdff4085bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:48.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.844+0000 7fe12ce719c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:48.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.844+0000 7fe12ce719c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:48.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.844+0000 7fe12ce719c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:48.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.844+0000 7fe12ce719c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:48.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.844+0000 7fe12ce719c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:48.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.844+0000 7fe12ce719c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:48.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.844+0000 7fe12ce719c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.848+0000 7fe12ce719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.848+0000 7fe12ce719c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.848+0000 7fe12ce719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:48.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.848+0000 7fe12ce719c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.848+0000 7fe12ce719c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:48.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.848+0000 7fe12ce719c0 20 zone default found 2024-09-12T00:35:48.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.848+0000 7fe12ce719c0 4 Realm: () 2024-09-12T00:35:48.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.848+0000 7fe12ce719c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:48.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.848+0000 7fe12ce719c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:48.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.848+0000 7fe12ce719c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:48.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.848+0000 7fe12ce719c0 20 zonegroup default 2024-09-12T00:35:48.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.848+0000 7fe12ce719c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.848+0000 7fe12ce719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.848+0000 7fe12ce719c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.848+0000 7fe12ce719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.848+0000 7fe12ce719c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.852+0000 7fe12ce719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:48.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.852+0000 7fe12ce719c0 20 started sync module instance, tier type = 2024-09-12T00:35:48.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.852+0000 7fe12ce719c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:48.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.872+0000 7fe12ce719c0 20 add_watcher() i=0 2024-09-12T00:35:48.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.872+0000 7fe12ce719c0 20 add_watcher() i=1 2024-09-12T00:35:48.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.872+0000 7fe12ce719c0 20 add_watcher() i=2 2024-09-12T00:35:48.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.872+0000 7fe12ce719c0 20 add_watcher() i=3 2024-09-12T00:35:48.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.872+0000 7fe12ce719c0 20 add_watcher() i=4 2024-09-12T00:35:48.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.872+0000 7fe12ce719c0 20 add_watcher() i=5 2024-09-12T00:35:48.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.872+0000 7fe12ce719c0 20 add_watcher() i=6 2024-09-12T00:35:48.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.876+0000 7fe12ce719c0 20 add_watcher() i=7 2024-09-12T00:35:48.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.876+0000 7fe12ce719c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:48.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.880+0000 7fdfe17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:48.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.880+0000 7fe12ce719c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:48.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.880+0000 7fe12ce719c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:48.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.880+0000 7fe12ce719c0 5 note: GC not initialized 2024-09-12T00:35:48.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.880+0000 7fdf5bfff640 20 reqs_thread_entry: start 2024-09-12T00:35:48.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.880+0000 7fe12ce719c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:48.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.880+0000 7fe12ce719c0 20 Filter name: none 2024-09-12T00:35:48.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.880+0000 7fdf59ffb640 20 reqs_thread_entry: start 2024-09-12T00:35:48.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.884+0000 7fe12ce719c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.884+0000 7fe12ce719c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:35:48.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.884+0000 7fe12ce719c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.884+0000 7fe12ce719c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:35:48.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.884+0000 7fe12ce719c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:48.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.884+0000 7fe12ce719c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.884+0000 7fe12ce719c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:35:48.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.884+0000 7fe12ce719c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:48.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.884+0000 7fe12ce719c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:35:48.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.884+0000 7fe12ce719c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:48.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.888+0000 7fdfe17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:48.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.896+0000 7fe12ce719c0 20 remove_watcher() i=0 2024-09-12T00:35:48.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.896+0000 7fe12ce719c0 2 removed watcher, disabling cache 2024-09-12T00:35:48.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.896+0000 7fe12ce719c0 20 remove_watcher() i=1 2024-09-12T00:35:48.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.896+0000 7fe12ce719c0 20 remove_watcher() i=2 2024-09-12T00:35:48.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.900+0000 7fe12ce719c0 20 remove_watcher() i=3 2024-09-12T00:35:48.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.900+0000 7fe12ce719c0 20 remove_watcher() i=4 2024-09-12T00:35:48.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.904+0000 7fe12ce719c0 20 remove_watcher() i=5 2024-09-12T00:35:48.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.908+0000 7fe12ce719c0 20 remove_watcher() i=6 2024-09-12T00:35:48.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:48.908+0000 7fe12ce719c0 20 remove_watcher() i=7 2024-09-12T00:35:48.922 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:48.922 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:35:48.923 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-block-writes id: e2043445-c131-4520-984d-b4d52f038a6b.4538.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:35:48.923 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:48.923 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:48.924 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:48.936 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:48.936 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:48.982 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:35:49.020 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:49.020 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:49.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.068+0000 7fd978d729c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.068+0000 7fd978d729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:49.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.068+0000 7fd978d729c0 20 realm 2024-09-12T00:35:49.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.068+0000 7fd978d729c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.068+0000 7fd978d729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:49.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.068+0000 7fd978d729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:49.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.068+0000 7fd978d729c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.072+0000 7fd978d729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:49.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.072+0000 7fd978d729c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.072+0000 7fd978d729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:49.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.072+0000 7fd978d729c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.072+0000 7fd978d729c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:49.070 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.072+0000 7fd978d729c0 20 searching for the correct realm 2024-09-12T00:35:49.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.076+0000 7fd977079640 0 -- 172.21.15.138:0/1432627954 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55876c694de0 msgr2=0x55876c6972a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:49.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.084+0000 7fd976077640 0 -- 172.21.15.138:0/1432627954 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55876c6900e0 msgr2=0x55876c6924d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:49.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.092+0000 7fd978d729c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:49.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.092+0000 7fd978d729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:49.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.092+0000 7fd978d729c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:49.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.092+0000 7fd978d729c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:49.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.092+0000 7fd978d729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:49.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.092+0000 7fd978d729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:49.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.092+0000 7fd978d729c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.092+0000 7fd978d729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:49.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.092+0000 7fd978d729c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.092+0000 7fd978d729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:49.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.092+0000 7fd978d729c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.096+0000 7fd978d729c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:49.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.096+0000 7fd978d729c0 20 zone default found 2024-09-12T00:35:49.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.096+0000 7fd978d729c0 4 Realm: () 2024-09-12T00:35:49.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.096+0000 7fd978d729c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:49.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.096+0000 7fd978d729c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:49.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.096+0000 7fd978d729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:49.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.096+0000 7fd978d729c0 20 zonegroup default 2024-09-12T00:35:49.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.096+0000 7fd978d729c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.096+0000 7fd978d729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:49.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.096+0000 7fd978d729c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.096+0000 7fd978d729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:49.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.096+0000 7fd978d729c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.096+0000 7fd978d729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:49.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.096+0000 7fd978d729c0 20 started sync module instance, tier type = 2024-09-12T00:35:49.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.096+0000 7fd978d729c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:49.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.116+0000 7fd978d729c0 20 add_watcher() i=0 2024-09-12T00:35:49.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.116+0000 7fd978d729c0 20 add_watcher() i=1 2024-09-12T00:35:49.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.116+0000 7fd978d729c0 20 add_watcher() i=2 2024-09-12T00:35:49.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.116+0000 7fd978d729c0 20 add_watcher() i=3 2024-09-12T00:35:49.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.116+0000 7fd978d729c0 20 add_watcher() i=4 2024-09-12T00:35:49.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.116+0000 7fd978d729c0 20 add_watcher() i=5 2024-09-12T00:35:49.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.116+0000 7fd978d729c0 20 add_watcher() i=6 2024-09-12T00:35:49.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.116+0000 7fd978d729c0 20 add_watcher() i=7 2024-09-12T00:35:49.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.116+0000 7fd978d729c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:49.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.120+0000 7fd82dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:49.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.120+0000 7fd978d729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:49.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.120+0000 7fd978d729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:49.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.120+0000 7fd978d729c0 5 note: GC not initialized 2024-09-12T00:35:49.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.120+0000 7fd82cfe1640 20 reqs_thread_entry: start 2024-09-12T00:35:49.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.120+0000 7fd978d729c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:49.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.120+0000 7fd978d729c0 20 Filter name: none 2024-09-12T00:35:49.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.120+0000 7fd825ffb640 20 reqs_thread_entry: start 2024-09-12T00:35:49.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.124+0000 7fd978d729c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:35:49.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.124+0000 7fd978d729c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.124+0000 7fd978d729c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:35:49.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.124+0000 7fd978d729c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:35:49.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.124+0000 7fd978d729c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:35:49.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.124+0000 7fd978d729c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 : miss 2024-09-12T00:35:49.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.124+0000 7fd978d729c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.124+0000 7fd978d729c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:35:49.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.124+0000 7fd978d729c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 info.flags=0x17 2024-09-12T00:35:49.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.124+0000 7fd978d729c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 to cache LRU end 2024-09-12T00:35:49.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.124+0000 7fd978d729c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:49.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.124+0000 7fd978d729c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:49.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.124+0000 7fd978d729c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 2024-09-12T00:35:49.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.132+0000 7fd978d729c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 info.flags=0x17 2024-09-12T00:35:49.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.132+0000 7fd978d729c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 to cache LRU end 2024-09-12T00:35:49.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.132+0000 7fd978d729c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:49.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.132+0000 7fd978d729c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28, ofs0, ns] 2024-09-12T00:35:49.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.132+0000 7fd85a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333554 cookie 94040127806208 notifier 7053 bl.length()=915 2024-09-12T00:35:49.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.132+0000 7fd85a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 info.flags=0x17 2024-09-12T00:35:49.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.132+0000 7fd85a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 to cache LRU end 2024-09-12T00:35:49.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.132+0000 7fd85a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:49.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.136+0000 7fd978d729c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): orig_sources= new_sources= 2024-09-12T00:35:49.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.136+0000 7fd978d729c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): potential sources added=[] removed=[] 2024-09-12T00:35:49.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.136+0000 7fd978d729c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): orig_dests= new_dests= 2024-09-12T00:35:49.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.136+0000 7fd978d729c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): potential dests added=[] removed=[] 2024-09-12T00:35:49.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.0 2024-09-12T00:35:49.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.0 2024-09-12T00:35:49.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.1 2024-09-12T00:35:49.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.1 2024-09-12T00:35:49.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.2 2024-09-12T00:35:49.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.2 2024-09-12T00:35:49.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.3 2024-09-12T00:35:49.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.3 2024-09-12T00:35:49.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.4 2024-09-12T00:35:49.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.4 2024-09-12T00:35:49.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.5 2024-09-12T00:35:49.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.5 2024-09-12T00:35:49.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.6 2024-09-12T00:35:49.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.6 2024-09-12T00:35:49.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.7 2024-09-12T00:35:49.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.7 2024-09-12T00:35:49.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.8 2024-09-12T00:35:49.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.8 2024-09-12T00:35:49.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.9 2024-09-12T00:35:49.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.9 2024-09-12T00:35:49.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.10 2024-09-12T00:35:49.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.10 2024-09-12T00:35:49.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.11 2024-09-12T00:35:49.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1.11 2024-09-12T00:35:49.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.148+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.0 2024-09-12T00:35:49.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.152+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1 2024-09-12T00:35:49.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.152+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.2 2024-09-12T00:35:49.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.152+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.3 2024-09-12T00:35:49.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.152+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.4 2024-09-12T00:35:49.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.156+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.5 2024-09-12T00:35:49.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.156+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.6 2024-09-12T00:35:49.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.156+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.7 2024-09-12T00:35:49.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.156+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.8 2024-09-12T00:35:49.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.156+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.9 2024-09-12T00:35:49.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.160+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.10 2024-09-12T00:35:49.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.168+0000 7fd978d729c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:49.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.168+0000 7fd978d729c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 2024-09-12T00:35:49.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.168+0000 7fd978d729c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 info.flags=0x17 2024-09-12T00:35:49.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.168+0000 7fd978d729c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 to cache LRU end 2024-09-12T00:35:49.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.168+0000 7fd978d729c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:49.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.168+0000 7fd978d729c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28, ofs0, ns] 2024-09-12T00:35:49.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.172+0000 7fd85a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333555 cookie 94040127806208 notifier 7053 bl.length()=915 2024-09-12T00:35:49.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.172+0000 7fd85a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 info.flags=0x17 2024-09-12T00:35:49.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.172+0000 7fd85a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 to cache LRU end 2024-09-12T00:35:49.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.172+0000 7fd85a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:49.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.172+0000 7fd978d729c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): orig_sources= new_sources= 2024-09-12T00:35:49.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.172+0000 7fd978d729c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): potential sources added=[] removed=[] 2024-09-12T00:35:49.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.172+0000 7fd978d729c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): orig_dests= new_dests= 2024-09-12T00:35:49.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.172+0000 7fd978d729c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): potential dests added=[] removed=[] 2024-09-12T00:35:49.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.176+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.0 2024-09-12T00:35:49.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.180+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.1 2024-09-12T00:35:49.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.180+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.2 2024-09-12T00:35:49.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.180+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.3 2024-09-12T00:35:49.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.180+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.4 2024-09-12T00:35:49.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.180+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.5 2024-09-12T00:35:49.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.184+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.6 2024-09-12T00:35:49.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.184+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.7 2024-09-12T00:35:49.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.184+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.8 2024-09-12T00:35:49.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.184+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.9 2024-09-12T00:35:49.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.184+0000 7fd978d729c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.28.10 2024-09-12T00:35:49.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.184+0000 7fd978d729c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:49.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.184+0000 7fd978d729c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 2024-09-12T00:35:49.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.188+0000 7fd978d729c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 info.flags=0x17 2024-09-12T00:35:49.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.188+0000 7fd978d729c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 to cache LRU end 2024-09-12T00:35:49.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.188+0000 7fd978d729c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:49.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.188+0000 7fd978d729c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28, ofs0, ns] 2024-09-12T00:35:49.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.188+0000 7fd85a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333556 cookie 94040127806208 notifier 7053 bl.length()=883 2024-09-12T00:35:49.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.188+0000 7fd85a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 info.flags=0x17 2024-09-12T00:35:49.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.188+0000 7fd85a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.28 to cache LRU end 2024-09-12T00:35:49.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.188+0000 7fd85a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:49.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.188+0000 7fd978d729c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): orig_sources= new_sources= 2024-09-12T00:35:49.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.188+0000 7fd978d729c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): potential sources added=[] removed=[] 2024-09-12T00:35:49.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.188+0000 7fd978d729c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): orig_dests= new_dests= 2024-09-12T00:35:49.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.188+0000 7fd978d729c0 20 handle_bi_update(): bucket=:error-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.28]): potential dests added=[] removed=[] 2024-09-12T00:35:49.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.196+0000 7fd978d729c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:35:49.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.200+0000 7fd82dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:49.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.204+0000 7fd978d729c0 20 remove_watcher() i=0 2024-09-12T00:35:49.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.204+0000 7fd978d729c0 2 removed watcher, disabling cache 2024-09-12T00:35:49.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.204+0000 7fd978d729c0 20 remove_watcher() i=1 2024-09-12T00:35:49.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.208+0000 7fd978d729c0 20 remove_watcher() i=2 2024-09-12T00:35:49.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.208+0000 7fd978d729c0 20 remove_watcher() i=3 2024-09-12T00:35:49.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.212+0000 7fd978d729c0 20 remove_watcher() i=4 2024-09-12T00:35:49.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.212+0000 7fd978d729c0 20 remove_watcher() i=5 2024-09-12T00:35:49.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.216+0000 7fd978d729c0 20 remove_watcher() i=6 2024-09-12T00:35:49.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.216+0000 7fd978d729c0 20 remove_watcher() i=7 2024-09-12T00:35:49.234 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:35:49.262 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:49.262 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:49.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.304+0000 7f93550c59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.308+0000 7f93550c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:49.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.308+0000 7f93550c59c0 20 realm 2024-09-12T00:35:49.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.308+0000 7f93550c59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.308+0000 7f93550c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:49.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.308+0000 7f93550c59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:49.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.308+0000 7f93550c59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.308+0000 7f93550c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:49.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.308+0000 7f93550c59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.312+0000 7f93550c59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:49.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.312+0000 7f93550c59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.312+0000 7f93550c59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:49.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.312+0000 7f93550c59c0 20 searching for the correct realm 2024-09-12T00:35:49.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.316+0000 7f93533cc640 0 -- 172.21.15.138:0/411990578 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f934c06a450 msgr2=0x7f934c0860d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:49.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.532+0000 7f93533cc640 0 -- 172.21.15.138:0/411990578 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x558c711ef8a0 msgr2=0x558c711f1d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:49.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.540+0000 7f93550c59c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:49.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.540+0000 7f93550c59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:49.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.540+0000 7f93550c59c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:49.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.540+0000 7f93550c59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:49.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.540+0000 7f93550c59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:49.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.540+0000 7f93550c59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:49.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.540+0000 7f93550c59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.540+0000 7f93550c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:49.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.540+0000 7f93550c59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.540+0000 7f93550c59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:49.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.540+0000 7f93550c59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.544+0000 7f93550c59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:49.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.544+0000 7f93550c59c0 20 zone default found 2024-09-12T00:35:49.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.544+0000 7f93550c59c0 4 Realm: () 2024-09-12T00:35:49.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.544+0000 7f93550c59c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:49.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.544+0000 7f93550c59c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:49.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.544+0000 7f93550c59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:49.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.544+0000 7f93550c59c0 20 zonegroup default 2024-09-12T00:35:49.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.544+0000 7f93550c59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.544+0000 7f93550c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:49.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.544+0000 7f93550c59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.544+0000 7f93550c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:49.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.544+0000 7f93550c59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.544+0000 7f93550c59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:49.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.544+0000 7f93550c59c0 20 started sync module instance, tier type = 2024-09-12T00:35:49.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.544+0000 7f93550c59c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:49.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.564+0000 7f93550c59c0 20 add_watcher() i=0 2024-09-12T00:35:49.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.564+0000 7f93550c59c0 20 add_watcher() i=1 2024-09-12T00:35:49.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.564+0000 7f93550c59c0 20 add_watcher() i=2 2024-09-12T00:35:49.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.564+0000 7f93550c59c0 20 add_watcher() i=3 2024-09-12T00:35:49.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.564+0000 7f93550c59c0 20 add_watcher() i=4 2024-09-12T00:35:49.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.564+0000 7f93550c59c0 20 add_watcher() i=5 2024-09-12T00:35:49.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.564+0000 7f93550c59c0 20 add_watcher() i=6 2024-09-12T00:35:49.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.568+0000 7f93550c59c0 20 add_watcher() i=7 2024-09-12T00:35:49.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.568+0000 7f93550c59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:49.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.572+0000 7f92037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:49.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.572+0000 7f93550c59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:49.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.572+0000 7f93550c59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:49.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.572+0000 7f93550c59c0 5 note: GC not initialized 2024-09-12T00:35:49.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.572+0000 7f92027fc640 20 reqs_thread_entry: start 2024-09-12T00:35:49.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.572+0000 7f93550c59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:49.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.572+0000 7f93550c59c0 20 Filter name: none 2024-09-12T00:35:49.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.572+0000 7f9173fff640 20 reqs_thread_entry: start 2024-09-12T00:35:49.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.572+0000 7f93550c59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.572+0000 7f93550c59c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:35:49.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.572+0000 7f93550c59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.576+0000 7f93550c59c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:35:49.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.576+0000 7f93550c59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:49.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.576+0000 7f93550c59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.576+0000 7f93550c59c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:35:49.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.576+0000 7f93550c59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:49.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.576+0000 7f93550c59c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:35:49.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.576+0000 7f93550c59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:49.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.580+0000 7f92037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:49.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.584+0000 7f93550c59c0 20 remove_watcher() i=0 2024-09-12T00:35:49.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.584+0000 7f93550c59c0 2 removed watcher, disabling cache 2024-09-12T00:35:49.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.584+0000 7f93550c59c0 20 remove_watcher() i=1 2024-09-12T00:35:49.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.588+0000 7f93550c59c0 20 remove_watcher() i=2 2024-09-12T00:35:49.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.588+0000 7f93550c59c0 20 remove_watcher() i=3 2024-09-12T00:35:49.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.592+0000 7f93550c59c0 20 remove_watcher() i=4 2024-09-12T00:35:49.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.592+0000 7f93550c59c0 20 remove_watcher() i=5 2024-09-12T00:35:49.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.596+0000 7f93550c59c0 20 remove_watcher() i=6 2024-09-12T00:35:49.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:49.600+0000 7f93550c59c0 20 remove_watcher() i=7 2024-09-12T00:35:49.613 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:49.613 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:35:49.613 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-block-writes id: e2043445-c131-4520-984d-b4d52f038a6b.4538.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:35:49.613 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:49.614 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:49.614 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:49.617 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:49.618 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:49.664 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:49.664 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:49.714 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T00:35:49.714 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:49.717 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:49.717 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:49.739 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:49.740 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:49.788 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:49.788 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:49.810 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:49.810 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:49.833 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:49.834 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:49.857 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:49.858 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:49.879 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:49.879 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:49.900 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:49.900 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:49.922 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:49.922 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:49.942 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:49.942 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:49.964 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:49.964 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:49.984 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:49.984 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:50.006 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:50.006 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:50.026 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:50.027 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:50.047 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:50.048 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:50.068 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:50.069 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:50.089 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:50.089 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:50.113 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:50.113 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:50.134 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:50.134 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:50.154 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:50.154 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:50.176 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:50.176 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:50.196 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:50.196 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:50.215 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:35:50.245 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:50.245 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:50.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.292+0000 7f4fc121c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.292+0000 7f4fc121c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.292+0000 7f4fc121c9c0 20 realm 2024-09-12T00:35:50.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.292+0000 7f4fc121c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.292+0000 7f4fc121c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.292+0000 7f4fc121c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:50.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.292+0000 7f4fc121c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.296+0000 7f4fc121c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.296+0000 7f4fc121c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.296+0000 7f4fc121c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:50.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.296+0000 7f4fc121c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.296+0000 7f4fc121c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:50.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.296+0000 7f4fc121c9c0 20 searching for the correct realm 2024-09-12T00:35:50.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.300+0000 7f4fbf523640 0 -- 172.21.15.138:0/3495611874 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5575ca845950 msgr2=0x5575ca847de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:50.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.308+0000 7f4fbe521640 0 -- 172.21.15.138:0/3495611874 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x5575ca840c20 msgr2=0x5575ca843010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:50.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:50.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:50.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:50.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:50.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:50.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:50.314 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:50.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:50.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 zone default found 2024-09-12T00:35:50.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 4 Realm: () 2024-09-12T00:35:50.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:50.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:50.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:50.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 zonegroup default 2024-09-12T00:35:50.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.316+0000 7f4fc121c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.320+0000 7f4fc121c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.320+0000 7f4fc121c9c0 20 started sync module instance, tier type = 2024-09-12T00:35:50.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.320+0000 7f4fc121c9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:50.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.336+0000 7f4fc121c9c0 20 add_watcher() i=0 2024-09-12T00:35:50.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.336+0000 7f4fc121c9c0 20 add_watcher() i=1 2024-09-12T00:35:50.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.336+0000 7f4fc121c9c0 20 add_watcher() i=2 2024-09-12T00:35:50.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.336+0000 7f4fc121c9c0 20 add_watcher() i=3 2024-09-12T00:35:50.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.336+0000 7f4fc121c9c0 20 add_watcher() i=4 2024-09-12T00:35:50.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.336+0000 7f4fc121c9c0 20 add_watcher() i=5 2024-09-12T00:35:50.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.336+0000 7f4fc121c9c0 20 add_watcher() i=6 2024-09-12T00:35:50.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.340+0000 7f4fc121c9c0 20 add_watcher() i=7 2024-09-12T00:35:50.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.340+0000 7f4fc121c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:50.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.344+0000 7f4e757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:50.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.344+0000 7f4fc121c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:50.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.344+0000 7f4fc121c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:50.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.344+0000 7f4fc121c9c0 5 note: GC not initialized 2024-09-12T00:35:50.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.344+0000 7f4deffff640 20 reqs_thread_entry: start 2024-09-12T00:35:50.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.344+0000 7f4fc121c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:50.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.344+0000 7f4fc121c9c0 20 Filter name: none 2024-09-12T00:35:50.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.344+0000 7f4dedffb640 20 reqs_thread_entry: start 2024-09-12T00:35:50.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.344+0000 7f4fc121c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.344+0000 7f4fc121c9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:35:50.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.344+0000 7f4fc121c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.344+0000 7f4fc121c9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:35:50.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.344+0000 7f4fc121c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:50.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.344+0000 7f4fc121c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.348+0000 7f4fc121c9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:35:50.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.348+0000 7f4fc121c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.348+0000 7f4fc121c9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:35:50.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.348+0000 7f4fc121c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:50.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.348+0000 7f4e757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:50.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.352+0000 7f4fc121c9c0 20 remove_watcher() i=0 2024-09-12T00:35:50.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.352+0000 7f4fc121c9c0 2 removed watcher, disabling cache 2024-09-12T00:35:50.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.356+0000 7f4fc121c9c0 20 remove_watcher() i=1 2024-09-12T00:35:50.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.356+0000 7f4fc121c9c0 20 remove_watcher() i=2 2024-09-12T00:35:50.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.360+0000 7f4fc121c9c0 20 remove_watcher() i=3 2024-09-12T00:35:50.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.360+0000 7f4fc121c9c0 20 remove_watcher() i=4 2024-09-12T00:35:50.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.364+0000 7f4fc121c9c0 20 remove_watcher() i=5 2024-09-12T00:35:50.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.364+0000 7f4fc121c9c0 20 remove_watcher() i=6 2024-09-12T00:35:50.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.368+0000 7f4fc121c9c0 20 remove_watcher() i=7 2024-09-12T00:35:50.380 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:50.380 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:35:50.380 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-block-writes id: e2043445-c131-4520-984d-b4d52f038a6b.4538.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:35:50.380 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:50.381 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T00:35:50.413 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:50.414 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:50.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.460+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.460+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.460+0000 7f15b9ed89c0 20 realm 2024-09-12T00:35:50.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.460+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.464+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.464+0000 7f15b9ed89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:50.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.464+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.464+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.464+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.668+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:50.668 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.668+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.672+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:50.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.672+0000 7f15b9ed89c0 20 searching for the correct realm 2024-09-12T00:35:50.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.676+0000 7f15b71dd640 0 -- 172.21.15.138:0/595432236 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f15a8052060 msgr2=0x7f15a809c280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:50.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.892+0000 7f15b71dd640 0 -- 172.21.15.138:0/595432236 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55d4fd1fd8e0 msgr2=0x55d4fd1ffcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:50.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:50.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:50.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:50.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:50.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:50.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:50.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:50.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:50.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 zone default found 2024-09-12T00:35:50.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.908+0000 7f15b9ed89c0 4 Realm: () 2024-09-12T00:35:50.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.908+0000 7f15b9ed89c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:50.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.908+0000 7f15b9ed89c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:50.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.908+0000 7f15b9ed89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:50.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 zonegroup default 2024-09-12T00:35:50.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.912+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.912+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.912+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:50.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.912+0000 7f15b9ed89c0 20 started sync module instance, tier type = 2024-09-12T00:35:50.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.912+0000 7f15b9ed89c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:50.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=0 2024-09-12T00:35:50.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=1 2024-09-12T00:35:50.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=2 2024-09-12T00:35:50.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=3 2024-09-12T00:35:50.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=4 2024-09-12T00:35:50.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=5 2024-09-12T00:35:50.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=6 2024-09-12T00:35:50.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=7 2024-09-12T00:35:50.936 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.936+0000 7f15b9ed89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:50.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.940+0000 7f146dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:50.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:50.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:50.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 note: GC not initialized 2024-09-12T00:35:50.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.944+0000 7f146cfe1640 20 reqs_thread_entry: start 2024-09-12T00:35:50.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:50.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 Filter name: none 2024-09-12T00:35:50.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.944+0000 7f13e67fc640 20 reqs_thread_entry: start 2024-09-12T00:35:50.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.944+0000 7f15b9ed89c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:35:50.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:35:50.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.944+0000 7f15b9ed89c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:35:50.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.944+0000 7f15b9ed89c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:35:50.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.944+0000 7f15b9ed89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 : miss 2024-09-12T00:35:50.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:50.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.948+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:35:50.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.948+0000 7f15b9ed89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:35:50.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.948+0000 7f15b9ed89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:35:50.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.948+0000 7f15b9ed89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:50.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.948+0000 7f15b9ed89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:50.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.948+0000 7f15b9ed89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 2024-09-12T00:35:50.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.960+0000 7f15b9ed89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:35:50.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.960+0000 7f15b9ed89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:35:50.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.960+0000 7f15b9ed89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:50.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.960+0000 7f15b9ed89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29, ofs0, ns] 2024-09-12T00:35:50.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.960+0000 7f1496ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333559 cookie 94373268197456 notifier 6701 bl.length()=915 2024-09-12T00:35:50.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.960+0000 7f1496ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:35:50.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.960+0000 7f1496ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:35:50.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.960+0000 7f1496ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:50.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.960+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_sources= new_sources= 2024-09-12T00:35:50.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.960+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential sources added=[] removed=[] 2024-09-12T00:35:50.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.960+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_dests= new_dests= 2024-09-12T00:35:50.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.960+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential dests added=[] removed=[] 2024-09-12T00:35:50.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.0 2024-09-12T00:35:50.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.0 2024-09-12T00:35:50.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.1 2024-09-12T00:35:50.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.1 2024-09-12T00:35:50.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.2 2024-09-12T00:35:50.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.2 2024-09-12T00:35:50.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.3 2024-09-12T00:35:50.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.3 2024-09-12T00:35:50.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.4 2024-09-12T00:35:50.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.4 2024-09-12T00:35:50.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.5 2024-09-12T00:35:50.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.5 2024-09-12T00:35:50.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.6 2024-09-12T00:35:50.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.6 2024-09-12T00:35:50.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.7 2024-09-12T00:35:50.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.7 2024-09-12T00:35:50.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.8 2024-09-12T00:35:50.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.8 2024-09-12T00:35:50.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.9 2024-09-12T00:35:50.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.9 2024-09-12T00:35:50.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.10 2024-09-12T00:35:50.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.10 2024-09-12T00:35:50.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.11 2024-09-12T00:35:50.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.11 2024-09-12T00:35:50.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.0 2024-09-12T00:35:50.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1 2024-09-12T00:35:50.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2 2024-09-12T00:35:50.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.3 2024-09-12T00:35:50.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.980+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.4 2024-09-12T00:35:50.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.980+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.5 2024-09-12T00:35:50.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.980+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.6 2024-09-12T00:35:50.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.980+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.7 2024-09-12T00:35:50.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.984+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.8 2024-09-12T00:35:50.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.984+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.9 2024-09-12T00:35:50.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.984+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.10 2024-09-12T00:35:50.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:50.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 2024-09-12T00:35:50.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:35:50.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:35:50.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:50.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29, ofs0, ns] 2024-09-12T00:35:50.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.992+0000 7f14967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333560 cookie 94373268197456 notifier 6701 bl.length()=915 2024-09-12T00:35:50.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.992+0000 7f14967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:35:50.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.992+0000 7f14967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:35:50.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.992+0000 7f14967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:50.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.996+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_sources= new_sources= 2024-09-12T00:35:50.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.996+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential sources added=[] removed=[] 2024-09-12T00:35:50.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.996+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_dests= new_dests= 2024-09-12T00:35:50.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.996+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential dests added=[] removed=[] 2024-09-12T00:35:50.993 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f15b9ed89c0 time 2024-09-12T00:35:50.999998+0000 2024-09-12T00:35:50.994 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:50.994 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:50.994 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f15bd7b22eb] 2024-09-12T00:35:50.995 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f15bd7b249f] 2024-09-12T00:35:50.995 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d4fb73fcc1] 2024-09-12T00:35:50.995 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55d4fb754086] 2024-09-12T00:35:50.995 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55d4fb7556a4] 2024-09-12T00:35:50.995 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:35:50.995 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f15bc618d90] 2024-09-12T00:35:50.995 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:35:50.995 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:35:50.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.996+0000 7f15b9ed89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f15b9ed89c0 time 2024-09-12T00:35:50.999998+0000 2024-09-12T00:35:50.995 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:50.995 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:50.995 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:50.995 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f15bd7b22eb] 2024-09-12T00:35:50.996 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f15bd7b249f] 2024-09-12T00:35:50.996 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d4fb73fcc1] 2024-09-12T00:35:50.996 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55d4fb754086] 2024-09-12T00:35:50.996 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55d4fb7556a4] 2024-09-12T00:35:50.996 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:35:50.996 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f15bc618d90] 2024-09-12T00:35:50.996 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:35:50.996 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:35:50.996 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:50.996 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:35:50.996 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f15b9ed89c0 thread_name:radosgw-admin 2024-09-12T00:35:51.007 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:51.007 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f15bc631520] 2024-09-12T00:35:51.007 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:35:51.007 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:35:51.007 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:35:51.007 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f15bd7b2345] 2024-09-12T00:35:51.007 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f15bd7b249f] 2024-09-12T00:35:51.007 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d4fb73fcc1] 2024-09-12T00:35:51.007 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55d4fb754086] 2024-09-12T00:35:51.007 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55d4fb7556a4] 2024-09-12T00:35:51.007 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:35:51.008 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f15bc618d90] 2024-09-12T00:35:51.008 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:35:51.008 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:35:51.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:50.996+0000 7f15b9ed89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:51.008 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f15b9ed89c0 thread_name:radosgw-admin 2024-09-12T00:35:51.008 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.008 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:51.008 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f15bc631520] 2024-09-12T00:35:51.008 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:35:51.008 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:35:51.008 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:35:51.008 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f15bd7b2345] 2024-09-12T00:35:51.008 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f15bd7b249f] 2024-09-12T00:35:51.009 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d4fb73fcc1] 2024-09-12T00:35:51.009 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55d4fb754086] 2024-09-12T00:35:51.009 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55d4fb7556a4] 2024-09-12T00:35:51.009 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:35:51.009 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f15bc618d90] 2024-09-12T00:35:51.009 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:35:51.009 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:35:51.009 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:51.009 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.009 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:35:51.009 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: crc 2024-09-12T00:35:51.009 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: secure 2024-09-12T00:35:51.010 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: crc 2024-09-12T00:35:51.010 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: secure 2024-09-12T00:35:51.010 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: crc 2024-09-12T00:35:51.010 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: crc 2024-09-12T00:35:51.010 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: secure 2024-09-12T00:35:51.010 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: crc 2024-09-12T00:35:51.010 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: secure 2024-09-12T00:35:51.010 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: crc 2024-09-12T00:35:51.010 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: secure 2024-09-12T00:35:51.010 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.010 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.010 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command rotate-key hook 0x55d4fd10e748 2024-09-12T00:35:51.011 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:51.011 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:35:51.011 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-b con 0x55d4fcfbe5b0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:35:51.011 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-c con 0x55d4fd056d10 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:35:51.011 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-a con 0x55d4fd05a210 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:35:51.011 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.011 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.011 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.011 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:51.011 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient(hunting): authenticate will time out at 2203.785660s 2024-09-12T00:35:51.011 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient(hunting): get_auth_request con 0x55d4fd056d10 auth_method 0 2024-09-12T00:35:51.011 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:51.011 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:51.012 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:51.012 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:35:50.440+0000 7f15b81df640 10 monclient(hunting): get_auth_request con 0x55d4fd05a210 auth_method 0 2024-09-12T00:35:51.012 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:35:50.440+0000 7f15b81df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:51.012 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:35:50.440+0000 7f15b81df640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:51.012 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:35:50.440+0000 7f15b81df640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:51.012 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:51.012 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:51.012 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:51.012 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:35:50.440+0000 7f15b81df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:51.012 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:35:50.440+0000 7f15b81df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:51.012 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:35:50.440+0000 7f15b81df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:51.012 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient(hunting): handle_auth_done global_id 6692 payload 824 2024-09-12T00:35:51.012 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient: _finish_hunting 0 2024-09-12T00:35:51.013 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:35:50.440+0000 7f15b71dd640 1 monclient: found mon.noname-c 2024-09-12T00:35:51.013 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.013 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:35:50.440+0000 7f15b79de640 10 monclient: get_auth_request con 0x55d4fcfbe5b0 auth_method 0 2024-09-12T00:35:51.013 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:51.013 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:51.013 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: dump: 2024-09-12T00:35:51.013 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:51.013 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:51.013 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.013 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.013 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:51.013 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.014 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:51.014 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:51.014 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:51.014 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.014 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: _finish_auth 0 2024-09-12T00:35:51.014 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:35:51.014 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:51.014 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:51.014 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:51.014 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: dump: 2024-09-12T00:35:51.014 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:51.014 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:51.015 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.015 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.015 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:51.015 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.015 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:51.015 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:51.015 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:51.015 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.015 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 monclient: authenticate success, global_id 6692 2024-09-12T00:35:51.015 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient: _renew_subs 2024-09-12T00:35:51.015 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:35:50.440+0000 7f14a5e0b640 4 set_mon_vals no callback set 2024-09-12T00:35:51.015 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.015 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient: _renew_subs 2024-09-12T00:35:51.015 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.016 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 1 librados: init done 2024-09-12T00:35:51.016 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:35:50.444+0000 7f149ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:51.016 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:35:50.444+0000 7f149ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:51.016 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:35:50.444+0000 7f149ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:51.016 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:35:50.444+0000 7f15b79de640 10 monclient: get_auth_request con 0x7f14a0070ae0 auth_method 0 2024-09-12T00:35:51.016 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:35:50.444+0000 7f15b81df640 10 monclient: get_auth_request con 0x55d4fd136b00 auth_method 0 2024-09-12T00:35:51.016 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:35:50.444+0000 7f15b79de640 10 monclient: get_auth_request con 0x55d4fd15a510 auth_method 0 2024-09-12T00:35:51.016 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:35:50.444+0000 7f149ffff640 1 client.6692.objecter ms_handle_reset 0x55d4fd15a510 session 0x55d4fd143370 osd.1 2024-09-12T00:35:51.016 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:35:50.444+0000 7f149ffff640 10 monclient: _renew_subs 2024-09-12T00:35:51.016 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:35:50.444+0000 7f149ffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.016 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:35:50.444+0000 7f15b79de640 10 monclient: get_auth_request con 0x7f14a0080e00 auth_method 0 2024-09-12T00:35:51.016 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:35:50.448+0000 7f15b71dd640 10 monclient: get_auth_request con 0x55d4fd15be10 auth_method 0 2024-09-12T00:35:51.016 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient: build_initial_monmap 2024-09-12T00:35:51.016 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:51.017 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient: monmap: 2024-09-12T00:35:51.017 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:35:51.017 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:51.017 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:35:51.017 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:35:51.017 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:51.017 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.017 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:35:51.017 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:35:51.017 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:35:51.017 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.017 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding auth protocol: cephx 2024-09-12T00:35:51.018 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding auth protocol: cephx 2024-09-12T00:35:51.018 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding auth protocol: cephx 2024-09-12T00:35:51.018 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: secure 2024-09-12T00:35:51.018 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: crc 2024-09-12T00:35:51.018 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: secure 2024-09-12T00:35:51.018 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: crc 2024-09-12T00:35:51.018 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: secure 2024-09-12T00:35:51.018 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: crc 2024-09-12T00:35:51.018 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: crc 2024-09-12T00:35:51.018 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: secure 2024-09-12T00:35:51.018 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: crc 2024-09-12T00:35:51.018 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: secure 2024-09-12T00:35:51.018 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: crc 2024-09-12T00:35:51.019 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: secure 2024-09-12T00:35:51.019 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.019 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d4fd164900 EEXIST 2024-09-12T00:35:51.019 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient: init 2024-09-12T00:35:51.019 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding auth protocol: cephx 2024-09-12T00:35:51.019 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding auth protocol: cephx 2024-09-12T00:35:51.019 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding auth protocol: cephx 2024-09-12T00:35:51.019 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: secure 2024-09-12T00:35:51.019 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: crc 2024-09-12T00:35:51.019 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: secure 2024-09-12T00:35:51.019 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: crc 2024-09-12T00:35:51.019 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: secure 2024-09-12T00:35:51.019 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: crc 2024-09-12T00:35:51.020 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: crc 2024-09-12T00:35:51.020 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: secure 2024-09-12T00:35:51.020 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: crc 2024-09-12T00:35:51.020 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: secure 2024-09-12T00:35:51.020 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: crc 2024-09-12T00:35:51.020 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: secure 2024-09-12T00:35:51.020 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.020 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.020 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command rotate-key cmddesc rotate-key hook 0x55d4fd15f8f0 EEXIST 2024-09-12T00:35:51.020 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:51.020 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:35:51.020 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-b con 0x55d4fd188ab0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:35:51.020 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-a con 0x55d4fd1883e0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:35:51.021 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-c con 0x55d4fd186dc0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:35:51.021 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.021 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.021 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.021 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:51.021 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient(hunting): authenticate will time out at 2203.795663s 2024-09-12T00:35:51.021 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:35:50.448+0000 7f15b71dd640 10 monclient(hunting): get_auth_request con 0x55d4fd1883e0 auth_method 0 2024-09-12T00:35:51.021 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:35:50.448+0000 7f15b71dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:51.021 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:35:50.448+0000 7f15b71dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:51.021 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:35:50.448+0000 7f15b71dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:51.021 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:35:50.448+0000 7f15b81df640 10 monclient(hunting): get_auth_request con 0x55d4fd186dc0 auth_method 0 2024-09-12T00:35:51.021 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:35:50.448+0000 7f15b81df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:51.021 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:35:50.448+0000 7f15b81df640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:51.022 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:35:50.448+0000 7f15b81df640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:51.022 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:35:50.448+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:51.022 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:35:50.448+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:51.022 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:35:50.448+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:51.022 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:35:50.448+0000 7f15b81df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:51.022 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:35:50.448+0000 7f15b81df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:51.022 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:35:50.448+0000 7f15b81df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:51.022 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:35:50.452+0000 7f15b71dd640 10 monclient(hunting): handle_auth_done global_id 7104 payload 824 2024-09-12T00:35:51.022 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:35:50.452+0000 7f15b71dd640 10 monclient: _finish_hunting 0 2024-09-12T00:35:51.022 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:35:50.452+0000 7f15b71dd640 1 monclient: found mon.noname-a 2024-09-12T00:35:51.022 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:35:50.452+0000 7f15b71dd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:35:51.022 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:35:50.452+0000 7f15b79de640 10 monclient: get_auth_request con 0x55d4fd188ab0 auth_method 0 2024-09-12T00:35:51.022 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:51.023 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:51.023 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: dump: 2024-09-12T00:35:51.023 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:51.023 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:51.023 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.023 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.023 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:51.023 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.023 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:51.023 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:51.023 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:51.023 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.023 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:35:51.023 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:35:51.024 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 monclient: authenticate success, global_id 7104 2024-09-12T00:35:51.024 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: _renew_subs 2024-09-12T00:35:51.024 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:35:51.024 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:51.024 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:51.024 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:51.024 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: dump: 2024-09-12T00:35:51.024 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:51.024 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:51.024 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.024 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.024 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:51.025 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.025 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:51.025 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:51.025 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:51.025 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.025 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:35:50.452+0000 7f15b89e0640 4 set_mon_vals no callback set 2024-09-12T00:35:51.025 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: _renew_subs 2024-09-12T00:35:51.025 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:35:51.025 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:35:50.452+0000 7f149d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:51.025 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:35:50.452+0000 7f149d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:51.025 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:35:50.452+0000 7f149d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:51.025 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: get_monmap_and_config 2024-09-12T00:35:51.025 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: build_initial_monmap 2024-09-12T00:35:51.026 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:51.026 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: monmap: 2024-09-12T00:35:51.026 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:35:51.026 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:51.026 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:35:51.026 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:35:51.026 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:51.026 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.026 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:35:51.026 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:35:51.026 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:35:51.026 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.026 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding auth protocol: cephx 2024-09-12T00:35:51.027 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding auth protocol: cephx 2024-09-12T00:35:51.027 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding auth protocol: cephx 2024-09-12T00:35:51.027 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: secure 2024-09-12T00:35:51.027 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: crc 2024-09-12T00:35:51.027 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: secure 2024-09-12T00:35:51.027 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: crc 2024-09-12T00:35:51.027 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: secure 2024-09-12T00:35:51.027 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: crc 2024-09-12T00:35:51.027 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: crc 2024-09-12T00:35:51.027 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: secure 2024-09-12T00:35:51.027 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: crc 2024-09-12T00:35:51.027 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: secure 2024-09-12T00:35:51.027 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: crc 2024-09-12T00:35:51.028 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: secure 2024-09-12T00:35:51.028 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:35:50.452+0000 7f15b79de640 10 monclient: get_auth_request con 0x7f1490070a10 auth_method 0 2024-09-12T00:35:51.028 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.028 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: init 2024-09-12T00:35:51.028 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding auth protocol: cephx 2024-09-12T00:35:51.028 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding auth protocol: cephx 2024-09-12T00:35:51.028 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding auth protocol: cephx 2024-09-12T00:35:51.028 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: secure 2024-09-12T00:35:51.028 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: crc 2024-09-12T00:35:51.028 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: secure 2024-09-12T00:35:51.028 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: crc 2024-09-12T00:35:51.028 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: secure 2024-09-12T00:35:51.029 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: crc 2024-09-12T00:35:51.029 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: crc 2024-09-12T00:35:51.029 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: secure 2024-09-12T00:35:51.029 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: crc 2024-09-12T00:35:51.029 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: secure 2024-09-12T00:35:51.029 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: crc 2024-09-12T00:35:51.029 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: secure 2024-09-12T00:35:51.029 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.029 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.029 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc9eb533e8 EEXIST 2024-09-12T00:35:51.029 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:51.029 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:35:51.029 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-c con 0x55d4fd1dc2e0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:35:51.030 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-a con 0x55d4fd1d76d0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:35:51.030 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-b con 0x55d4fd1cddd0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:35:51.030 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.030 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.030 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.030 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:51.030 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): authenticate will time out at 2203.800013s 2024-09-12T00:35:51.030 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): get_auth_request con 0x55d4fd1dc2e0 auth_method 0 2024-09-12T00:35:51.030 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:51.030 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:51.030 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:51.030 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): get_auth_request con 0x55d4fd1d76d0 auth_method 0 2024-09-12T00:35:51.030 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:51.031 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:51.031 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:51.031 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:51.031 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:51.031 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:51.031 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:51.031 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:51.031 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:51.031 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): handle_auth_done global_id 6698 payload 274 2024-09-12T00:35:51.031 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient: _finish_hunting 0 2024-09-12T00:35:51.031 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:35:50.456+0000 7f15b79de640 1 monclient: found mon.noname-c 2024-09-12T00:35:51.031 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.031 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:51.032 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:51.032 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: dump: 2024-09-12T00:35:51.032 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:51.032 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:51.032 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.032 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.032 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:51.032 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.032 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:51.032 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:51.032 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:51.032 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.033 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: _finish_auth 0 2024-09-12T00:35:51.033 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:35:51.033 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:51.033 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 monclient: authenticate success, global_id 6698 2024-09-12T00:35:51.033 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:51.033 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 4 set_mon_vals no callback set 2024-09-12T00:35:51.033 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:51.033 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:51.033 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: dump: 2024-09-12T00:35:51.033 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:51.033 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:51.034 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.034 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.034 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:51.034 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.034 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:51.034 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:51.034 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:51.034 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.034 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: shutdown 2024-09-12T00:35:51.034 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: build_initial_monmap 2024-09-12T00:35:51.034 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:51.034 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: monmap: 2024-09-12T00:35:51.034 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:35:51.034 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:51.035 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:35:51.035 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:35:51.035 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:51.035 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.035 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:35:51.035 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:35:51.035 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:35:51.035 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.035 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding auth protocol: cephx 2024-09-12T00:35:51.035 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding auth protocol: cephx 2024-09-12T00:35:51.035 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding auth protocol: cephx 2024-09-12T00:35:51.035 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: secure 2024-09-12T00:35:51.035 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: crc 2024-09-12T00:35:51.036 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: secure 2024-09-12T00:35:51.036 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: crc 2024-09-12T00:35:51.036 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: secure 2024-09-12T00:35:51.036 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: crc 2024-09-12T00:35:51.036 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: crc 2024-09-12T00:35:51.036 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: secure 2024-09-12T00:35:51.036 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: crc 2024-09-12T00:35:51.036 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: secure 2024-09-12T00:35:51.036 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: crc 2024-09-12T00:35:51.036 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: secure 2024-09-12T00:35:51.036 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.036 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 1 librados: starting msgr at 2024-09-12T00:35:51.036 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 1 librados: starting objecter 2024-09-12T00:35:51.037 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d4fd1d6250 EEXIST 2024-09-12T00:35:51.037 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 1 librados: setting wanted keys 2024-09-12T00:35:51.037 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 1 librados: calling monclient init 2024-09-12T00:35:51.037 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: init 2024-09-12T00:35:51.037 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding auth protocol: cephx 2024-09-12T00:35:51.037 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding auth protocol: cephx 2024-09-12T00:35:51.037 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding auth protocol: cephx 2024-09-12T00:35:51.037 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: secure 2024-09-12T00:35:51.037 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: crc 2024-09-12T00:35:51.037 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: secure 2024-09-12T00:35:51.037 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: crc 2024-09-12T00:35:51.037 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: secure 2024-09-12T00:35:51.037 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: crc 2024-09-12T00:35:51.037 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: crc 2024-09-12T00:35:51.038 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: secure 2024-09-12T00:35:51.038 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: crc 2024-09-12T00:35:51.038 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: secure 2024-09-12T00:35:51.038 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: crc 2024-09-12T00:35:51.038 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: secure 2024-09-12T00:35:51.038 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.038 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.038 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command rotate-key cmddesc rotate-key hook 0x55d4fd18aa18 EEXIST 2024-09-12T00:35:51.038 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:51.038 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:35:51.038 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-c con 0x55d4fd1cddd0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:35:51.038 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-a con 0x55d4fd1d76d0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:35:51.038 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-b con 0x55d4fd1dc2e0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:35:51.039 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.039 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.039 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.039 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:51.039 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): authenticate will time out at 2203.802795s 2024-09-12T00:35:51.039 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): get_auth_request con 0x55d4fd1cddd0 auth_method 0 2024-09-12T00:35:51.039 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:51.039 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:51.039 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:51.039 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): get_auth_request con 0x55d4fd1d76d0 auth_method 0 2024-09-12T00:35:51.039 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:51.039 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:51.039 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:51.040 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:51.040 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:51.040 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:51.040 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:51.040 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:51.040 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:51.040 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): handle_auth_done global_id 6701 payload 824 2024-09-12T00:35:51.040 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient: _finish_hunting 0 2024-09-12T00:35:51.040 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:35:50.456+0000 7f15b79de640 1 monclient: found mon.noname-c 2024-09-12T00:35:51.040 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.040 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:51.040 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:51.040 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: dump: 2024-09-12T00:35:51.040 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:51.041 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:51.041 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.041 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.041 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:51.041 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.041 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:51.041 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:51.041 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:51.041 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.041 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: _finish_auth 0 2024-09-12T00:35:51.041 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: _check_auth_tickets 2024-09-12T00:35:51.041 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 monclient: authenticate success, global_id 6701 2024-09-12T00:35:51.041 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:51.042 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:51.042 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:51.042 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: dump: 2024-09-12T00:35:51.042 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:51.042 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:51.042 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.042 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.042 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:51.042 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.042 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:51.042 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:51.042 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:51.043 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.043 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: _renew_subs 2024-09-12T00:35:51.043 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:35:50.456+0000 7f1496ffd640 4 set_mon_vals no callback set 2024-09-12T00:35:51.043 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.043 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: _renew_subs 2024-09-12T00:35:51.043 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.043 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 1 librados: init done 2024-09-12T00:35:51.043 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command cr dump hook 0x55d4fd1d5388 2024-09-12T00:35:51.043 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:35:50.460+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.043 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:35:50.460+0000 7f14957fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:51.043 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:35:50.460+0000 7f14957fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:51.043 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:35:50.460+0000 7f14957fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:51.043 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:35:50.460+0000 7f15b71dd640 10 monclient: get_auth_request con 0x7f1480070ae0 auth_method 0 2024-09-12T00:35:51.044 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:35:50.460+0000 7f15b81df640 10 monclient: get_auth_request con 0x55d4fd1f5e80 auth_method 0 2024-09-12T00:35:51.044 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:35:50.460+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.044 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:35:50.460+0000 7f15b9ed89c0 20 realm 2024-09-12T00:35:51.044 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:35:50.460+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.044 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:35:50.464+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.044 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:35:50.464+0000 7f15b9ed89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:51.044 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:35:50.464+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.044 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:35:50.464+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.044 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:35:50.464+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.044 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:35:50.668+0000 7f15b79de640 10 monclient: get_auth_request con 0x55d4fd1fa080 auth_method 0 2024-09-12T00:35:51.044 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:35:50.668+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:51.044 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:35:50.668+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.045 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:35:50.668+0000 7f15b71dd640 10 monclient: get_auth_request con 0x55d4fd1fd8e0 auth_method 0 2024-09-12T00:35:51.045 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:35:50.672+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:51.045 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:35:50.672+0000 7f15b9ed89c0 20 searching for the correct realm 2024-09-12T00:35:51.045 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:35:50.672+0000 7f15b81df640 10 monclient: get_auth_request con 0x55d4fd202660 auth_method 0 2024-09-12T00:35:51.045 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:35:50.672+0000 7f15b79de640 10 monclient: get_auth_request con 0x7f15b00c3410 auth_method 0 2024-09-12T00:35:51.045 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:35:50.676+0000 7f15b71dd640 10 monclient: get_auth_request con 0x7f15a8052060 auth_method 0 2024-09-12T00:35:51.045 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:35:50.676+0000 7f15b71dd640 0 -- 172.21.15.138:0/595432236 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f15a8052060 msgr2=0x7f15a809c280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:51.045 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:35:50.880+0000 7f15b71dd640 10 monclient: get_auth_request con 0x7f15a8052060 auth_method 0 2024-09-12T00:35:51.045 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:35:50.884+0000 7f15b81df640 10 monclient: get_auth_request con 0x7f15b00cf900 auth_method 0 2024-09-12T00:35:51.045 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:35:50.888+0000 7f15b79de640 10 monclient: get_auth_request con 0x7f15a8008050 auth_method 0 2024-09-12T00:35:51.045 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:35:50.892+0000 7f15b71dd640 0 -- 172.21.15.138:0/595432236 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55d4fd1fd8e0 msgr2=0x55d4fd1ffcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:51.045 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:35:50.892+0000 7f14957fa640 1 client.6701.objecter ms_handle_reset 0x55d4fd1fd8e0 session 0x55d4fd1f9410 osd.3 2024-09-12T00:35:51.045 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:35:50.892+0000 7f14957fa640 10 monclient: _renew_subs 2024-09-12T00:35:51.045 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:35:50.892+0000 7f14957fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.046 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:35:50.892+0000 7f15b71dd640 10 monclient: get_auth_request con 0x7f1480080e00 auth_method 0 2024-09-12T00:35:51.046 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:51.046 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:51.046 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:51.046 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:51.046 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:51.046 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:51.046 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.046 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.046 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.046 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:51.046 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.046 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:51.047 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 zone default found 2024-09-12T00:35:51.047 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 4 Realm: () 2024-09-12T00:35:51.047 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:51.047 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:51.047 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:51.047 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 zonegroup default 2024-09-12T00:35:51.047 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.047 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.047 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.047 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:35:50.912+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.047 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:35:50.912+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.047 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:35:50.912+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.047 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:35:50.912+0000 7f15b9ed89c0 20 started sync module instance, tier type = 2024-09-12T00:35:51.048 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:35:50.912+0000 7f15b9ed89c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:51.048 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=0 2024-09-12T00:35:51.048 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=1 2024-09-12T00:35:51.048 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=2 2024-09-12T00:35:51.048 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=3 2024-09-12T00:35:51.048 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=4 2024-09-12T00:35:51.048 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=5 2024-09-12T00:35:51.048 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=6 2024-09-12T00:35:51.048 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=7 2024-09-12T00:35:51.048 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:51.048 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding auth protocol: cephx 2024-09-12T00:35:51.048 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding auth protocol: cephx 2024-09-12T00:35:51.048 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding auth protocol: cephx 2024-09-12T00:35:51.048 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: secure 2024-09-12T00:35:51.049 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: crc 2024-09-12T00:35:51.049 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: secure 2024-09-12T00:35:51.049 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: crc 2024-09-12T00:35:51.049 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: secure 2024-09-12T00:35:51.049 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: crc 2024-09-12T00:35:51.049 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: crc 2024-09-12T00:35:51.049 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: secure 2024-09-12T00:35:51.049 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: crc 2024-09-12T00:35:51.049 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: secure 2024-09-12T00:35:51.049 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: crc 2024-09-12T00:35:51.049 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: secure 2024-09-12T00:35:51.049 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:35:50.940+0000 7f146dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:51.049 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.050 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:51.050 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:51.050 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command cache list hook 0x55d4fd1d52a0 2024-09-12T00:35:51.050 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command cache inspect hook 0x55d4fd1d52a0 2024-09-12T00:35:51.050 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command cache erase hook 0x55d4fd1d52a0 2024-09-12T00:35:51.050 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command cache zap hook 0x55d4fd1d52a0 2024-09-12T00:35:51.050 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 note: GC not initialized 2024-09-12T00:35:51.050 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:35:50.944+0000 7f146cfe1640 20 reqs_thread_entry: start 2024-09-12T00:35:51.050 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command sync trace show hook 0x7f15a8004550 2024-09-12T00:35:51.050 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command sync trace history hook 0x7f15a8004550 2024-09-12T00:35:51.050 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command sync trace active hook 0x7f15a8004550 2024-09-12T00:35:51.050 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command sync trace active_short hook 0x7f15a8004550 2024-09-12T00:35:51.050 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:51.050 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 Filter name: none 2024-09-12T00:35:51.051 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:35:50.944+0000 7f13e67fc640 20 reqs_thread_entry: start 2024-09-12T00:35:51.051 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:35:51.051 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.051 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:35:51.051 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:35:51.051 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:35:51.051 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 : miss 2024-09-12T00:35:51.051 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.051 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:35:50.948+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:35:51.051 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:35:50.948+0000 7f15b9ed89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:35:51.051 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:35:50.948+0000 7f15b9ed89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:35:51.051 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:35:50.948+0000 7f15b9ed89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:51.051 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:35:50.948+0000 7f15b9ed89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:51.052 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:35:50.948+0000 7f15b9ed89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 2024-09-12T00:35:51.052 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:35:50.960+0000 7f15b9ed89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:35:51.052 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:35:50.960+0000 7f15b9ed89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:35:51.052 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:35:50.960+0000 7f15b9ed89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:51.052 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:35:50.960+0000 7f15b9ed89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29, ofs0, ns] 2024-09-12T00:35:51.052 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:35:50.960+0000 7f1496ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333559 cookie 94373268197456 notifier 6701 bl.length()=915 2024-09-12T00:35:51.052 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:35:50.960+0000 7f1496ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:35:51.052 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:35:50.960+0000 7f1496ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:35:51.052 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:35:50.960+0000 7f1496ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:51.052 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:35:50.960+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_sources= new_sources= 2024-09-12T00:35:51.052 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:35:50.960+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential sources added=[] removed=[] 2024-09-12T00:35:51.052 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:35:50.960+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_dests= new_dests= 2024-09-12T00:35:51.053 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:35:50.960+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential dests added=[] removed=[] 2024-09-12T00:35:51.053 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.0 2024-09-12T00:35:51.053 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.0 2024-09-12T00:35:51.053 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.1 2024-09-12T00:35:51.053 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.1 2024-09-12T00:35:51.053 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.2 2024-09-12T00:35:51.053 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.2 2024-09-12T00:35:51.053 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.3 2024-09-12T00:35:51.053 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.3 2024-09-12T00:35:51.053 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.4 2024-09-12T00:35:51.053 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.4 2024-09-12T00:35:51.053 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.5 2024-09-12T00:35:51.054 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.5 2024-09-12T00:35:51.054 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.6 2024-09-12T00:35:51.054 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.6 2024-09-12T00:35:51.054 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.7 2024-09-12T00:35:51.054 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.7 2024-09-12T00:35:51.054 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.8 2024-09-12T00:35:51.054 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.8 2024-09-12T00:35:51.054 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.9 2024-09-12T00:35:51.054 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.9 2024-09-12T00:35:51.054 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.10 2024-09-12T00:35:51.054 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.10 2024-09-12T00:35:51.054 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.11 2024-09-12T00:35:51.054 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.11 2024-09-12T00:35:51.055 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.0 2024-09-12T00:35:51.055 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1 2024-09-12T00:35:51.055 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2 2024-09-12T00:35:51.055 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.3 2024-09-12T00:35:51.055 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:35:50.980+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.4 2024-09-12T00:35:51.055 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:35:50.980+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.5 2024-09-12T00:35:51.055 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:35:50.980+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.6 2024-09-12T00:35:51.055 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:35:50.980+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.7 2024-09-12T00:35:51.055 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:35:50.984+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.8 2024-09-12T00:35:51.055 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:35:50.984+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.9 2024-09-12T00:35:51.055 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:35:50.984+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.10 2024-09-12T00:35:51.055 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:51.055 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 2024-09-12T00:35:51.056 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:35:51.056 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:35:51.056 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:51.056 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29, ofs0, ns] 2024-09-12T00:35:51.056 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:35:50.992+0000 7f14967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333560 cookie 94373268197456 notifier 6701 bl.length()=915 2024-09-12T00:35:51.056 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:35:50.992+0000 7f14967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:35:51.056 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:35:50.992+0000 7f14967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:35:51.056 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:35:50.992+0000 7f14967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:51.056 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:35:50.996+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_sources= new_sources= 2024-09-12T00:35:51.056 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:35:50.996+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential sources added=[] removed=[] 2024-09-12T00:35:51.056 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:35:50.996+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_dests= new_dests= 2024-09-12T00:35:51.056 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:35:50.996+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential dests added=[] removed=[] 2024-09-12T00:35:51.056 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:35:50.996+0000 7f15b9ed89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f15b9ed89c0 time 2024-09-12T00:35:50.999998+0000 2024-09-12T00:35:51.057 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:51.057 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.057 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:51.057 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f15bd7b22eb] 2024-09-12T00:35:51.057 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f15bd7b249f] 2024-09-12T00:35:51.057 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d4fb73fcc1] 2024-09-12T00:35:51.057 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55d4fb754086] 2024-09-12T00:35:51.057 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55d4fb7556a4] 2024-09-12T00:35:51.057 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:35:51.057 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f15bc618d90] 2024-09-12T00:35:51.057 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:35:51.057 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:35:51.057 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.058 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:35:50.996+0000 7f15b9ed89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:51.058 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f15b9ed89c0 thread_name:radosgw-admin 2024-09-12T00:35:51.058 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.058 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:51.058 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f15bc631520] 2024-09-12T00:35:51.058 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:35:51.058 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:35:51.058 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:35:51.058 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f15bd7b2345] 2024-09-12T00:35:51.058 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f15bd7b249f] 2024-09-12T00:35:51.058 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d4fb73fcc1] 2024-09-12T00:35:51.058 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55d4fb754086] 2024-09-12T00:35:51.058 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55d4fb7556a4] 2024-09-12T00:35:51.059 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:35:51.059 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f15bc618d90] 2024-09-12T00:35:51.059 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:35:51.059 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:35:51.059 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:51.059 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.059 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:35:51.059 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:35:51.059 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:35:51.059 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:35:51.059 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:35:51.059 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:35:51.060 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:35:51.060 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:35:51.060 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:35:51.060 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:35:51.060 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:35:51.060 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:35:51.060 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:35:51.060 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:35:51.060 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:35:51.060 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:35:51.060 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:35:51.060 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:35:51.060 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:35:51.061 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:35:51.061 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:35:51.061 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:35:51.061 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:35:51.061 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:35:51.061 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:35:51.061 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:35:51.061 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:35:51.061 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:35:51.061 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:35:51.061 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:35:51.061 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:35:51.061 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:35:51.061 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:35:51.062 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:35:51.062 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:35:51.062 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:35:51.062 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:35:51.062 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:35:51.062 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:35:51.062 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:35:51.062 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:35:51.062 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:35:51.062 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:35:51.062 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:35:51.062 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:35:51.063 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:35:51.063 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:35:51.063 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:35:51.063 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:35:51.063 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:35:51.063 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:35:51.063 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:35:51.063 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:35:51.063 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:35:51.063 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:35:51.063 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:35:51.063 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:35:51.063 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:35:51.064 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:35:51.064 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:35:51.064 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:35:51.064 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:35:51.064 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:35:51.064 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:35:51.064 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:35:51.064 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:35:51.064 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:35:51.064 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:35:51.064 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:35:51.064 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:35:51.064 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:35:51.064 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:35:51.065 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:35:51.065 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:35:51.065 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:35:51.065 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:35:51.065 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:35:51.065 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:35:51.065 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:35:51.065 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:35:51.065 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:35:51.065 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:35:51.065 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:35:51.065 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:35:51.065 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:35:51.066 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:35:51.066 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:35:51.066 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:35:51.066 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:35:51.066 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:35:51.066 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:35:51.066 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:35:51.066 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:35:51.066 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:35:51.066 INFO:tasks.workunit.client.0.smithi138.stderr: 7f13e67fc640 / http_manager 2024-09-12T00:35:51.066 INFO:tasks.workunit.client.0.smithi138.stderr: 7f146cfe1640 / http_manager 2024-09-12T00:35:51.066 INFO:tasks.workunit.client.0.smithi138.stderr: 7f146dfe3640 / rgw_dt_lg_renew 2024-09-12T00:35:51.066 INFO:tasks.workunit.client.0.smithi138.stderr: 7f14957fa640 / ms_dispatch 2024-09-12T00:35:51.067 INFO:tasks.workunit.client.0.smithi138.stderr: 7f14967fc640 / io_context_pool 2024-09-12T00:35:51.067 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1496ffd640 / io_context_pool 2024-09-12T00:35:51.067 INFO:tasks.workunit.client.0.smithi138.stderr: 7f149d7fa640 / ms_dispatch 2024-09-12T00:35:51.067 INFO:tasks.workunit.client.0.smithi138.stderr: 7f149ffff640 / ms_dispatch 2024-09-12T00:35:51.067 INFO:tasks.workunit.client.0.smithi138.stderr: 7f14a5e0b640 / io_context_pool 2024-09-12T00:35:51.067 INFO:tasks.workunit.client.0.smithi138.stderr: 7f15b71dd640 / msgr-worker-2 2024-09-12T00:35:51.067 INFO:tasks.workunit.client.0.smithi138.stderr: 7f15b79de640 / msgr-worker-1 2024-09-12T00:35:51.067 INFO:tasks.workunit.client.0.smithi138.stderr: 7f15b81df640 / msgr-worker-0 2024-09-12T00:35:51.067 INFO:tasks.workunit.client.0.smithi138.stderr: 7f15b89e0640 / io_context_pool 2024-09-12T00:35:51.067 INFO:tasks.workunit.client.0.smithi138.stderr: 7f15b9ed89c0 / radosgw-admin 2024-09-12T00:35:51.067 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:35:51.067 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:35:51.067 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.105904.log 2024-09-12T00:35:51.068 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:35:51.068 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:35:51.068 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: crc 2024-09-12T00:35:51.068 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: secure 2024-09-12T00:35:51.068 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: crc 2024-09-12T00:35:51.068 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: secure 2024-09-12T00:35:51.068 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: crc 2024-09-12T00:35:51.068 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: crc 2024-09-12T00:35:51.068 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: secure 2024-09-12T00:35:51.068 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: crc 2024-09-12T00:35:51.068 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: secure 2024-09-12T00:35:51.068 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: crc 2024-09-12T00:35:51.069 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd10e600) adding con mode: secure 2024-09-12T00:35:51.069 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.069 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.069 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command rotate-key hook 0x55d4fd10e748 2024-09-12T00:35:51.069 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:51.069 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:35:51.069 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-b con 0x55d4fcfbe5b0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:35:51.069 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-c con 0x55d4fd056d10 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:35:51.069 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-a con 0x55d4fd05a210 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:35:51.069 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.069 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.069 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.069 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:51.070 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient(hunting): authenticate will time out at 2203.785660s 2024-09-12T00:35:51.070 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient(hunting): get_auth_request con 0x55d4fd056d10 auth_method 0 2024-09-12T00:35:51.070 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:51.070 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:51.070 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:51.070 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:35:50.440+0000 7f15b81df640 10 monclient(hunting): get_auth_request con 0x55d4fd05a210 auth_method 0 2024-09-12T00:35:51.070 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:35:50.440+0000 7f15b81df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:51.070 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:35:50.440+0000 7f15b81df640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:51.070 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:35:50.440+0000 7f15b81df640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:51.070 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:51.070 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:51.070 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:51.070 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:35:50.440+0000 7f15b81df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:51.071 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:35:50.440+0000 7f15b81df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:51.071 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:35:50.440+0000 7f15b81df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:51.071 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient(hunting): handle_auth_done global_id 6692 payload 824 2024-09-12T00:35:51.071 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient: _finish_hunting 0 2024-09-12T00:35:51.071 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:35:50.440+0000 7f15b71dd640 1 monclient: found mon.noname-c 2024-09-12T00:35:51.071 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:35:50.440+0000 7f15b71dd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.071 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:35:50.440+0000 7f15b79de640 10 monclient: get_auth_request con 0x55d4fcfbe5b0 auth_method 0 2024-09-12T00:35:51.071 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:51.071 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:51.071 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: dump: 2024-09-12T00:35:51.071 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:51.071 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:51.072 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.072 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.072 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:51.072 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.072 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:51.072 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:51.072 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:51.072 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.072 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: _finish_auth 0 2024-09-12T00:35:51.072 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:35:51.072 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:51.072 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:51.073 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:51.073 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:35:50.440+0000 7f149ffff640 10 monclient: dump: 2024-09-12T00:35:51.073 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:51.073 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:51.073 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.073 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.073 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:51.073 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.073 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:51.073 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:51.073 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:51.073 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.073 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 5 monclient: authenticate success, global_id 6692 2024-09-12T00:35:51.074 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient: _renew_subs 2024-09-12T00:35:51.074 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:35:50.440+0000 7f14a5e0b640 4 set_mon_vals no callback set 2024-09-12T00:35:51.074 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.074 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient: _renew_subs 2024-09-12T00:35:51.074 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.074 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:35:50.440+0000 7f15b9ed89c0 1 librados: init done 2024-09-12T00:35:51.074 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:35:50.444+0000 7f149ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:51.074 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:35:50.444+0000 7f149ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:51.074 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:35:50.444+0000 7f149ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:51.074 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:35:50.444+0000 7f15b79de640 10 monclient: get_auth_request con 0x7f14a0070ae0 auth_method 0 2024-09-12T00:35:51.074 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:35:50.444+0000 7f15b81df640 10 monclient: get_auth_request con 0x55d4fd136b00 auth_method 0 2024-09-12T00:35:51.074 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:35:50.444+0000 7f15b79de640 10 monclient: get_auth_request con 0x55d4fd15a510 auth_method 0 2024-09-12T00:35:51.075 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:35:50.444+0000 7f149ffff640 1 client.6692.objecter ms_handle_reset 0x55d4fd15a510 session 0x55d4fd143370 osd.1 2024-09-12T00:35:51.075 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:35:50.444+0000 7f149ffff640 10 monclient: _renew_subs 2024-09-12T00:35:51.075 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:35:50.444+0000 7f149ffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.075 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:35:50.444+0000 7f15b79de640 10 monclient: get_auth_request con 0x7f14a0080e00 auth_method 0 2024-09-12T00:35:51.075 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:35:50.448+0000 7f15b71dd640 10 monclient: get_auth_request con 0x55d4fd15be10 auth_method 0 2024-09-12T00:35:51.075 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient: build_initial_monmap 2024-09-12T00:35:51.075 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:51.075 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient: monmap: 2024-09-12T00:35:51.075 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:35:51.075 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:51.075 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:35:51.075 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:35:51.075 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:51.076 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.076 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:35:51.076 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:35:51.076 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:35:51.076 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.076 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding auth protocol: cephx 2024-09-12T00:35:51.076 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding auth protocol: cephx 2024-09-12T00:35:51.076 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding auth protocol: cephx 2024-09-12T00:35:51.076 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: secure 2024-09-12T00:35:51.076 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: crc 2024-09-12T00:35:51.076 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: secure 2024-09-12T00:35:51.076 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: crc 2024-09-12T00:35:51.076 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: secure 2024-09-12T00:35:51.077 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: crc 2024-09-12T00:35:51.077 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: crc 2024-09-12T00:35:51.077 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: secure 2024-09-12T00:35:51.077 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: crc 2024-09-12T00:35:51.077 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: secure 2024-09-12T00:35:51.077 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: crc 2024-09-12T00:35:51.077 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd160f70) adding con mode: secure 2024-09-12T00:35:51.077 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.077 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d4fd164900 EEXIST 2024-09-12T00:35:51.077 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient: init 2024-09-12T00:35:51.077 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding auth protocol: cephx 2024-09-12T00:35:51.077 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding auth protocol: cephx 2024-09-12T00:35:51.077 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding auth protocol: cephx 2024-09-12T00:35:51.078 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: secure 2024-09-12T00:35:51.078 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: crc 2024-09-12T00:35:51.078 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: secure 2024-09-12T00:35:51.078 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: crc 2024-09-12T00:35:51.078 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: secure 2024-09-12T00:35:51.078 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: crc 2024-09-12T00:35:51.078 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: crc 2024-09-12T00:35:51.078 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: secure 2024-09-12T00:35:51.078 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: crc 2024-09-12T00:35:51.078 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: secure 2024-09-12T00:35:51.078 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: crc 2024-09-12T00:35:51.078 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd15f7a8) adding con mode: secure 2024-09-12T00:35:51.078 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.078 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.079 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command rotate-key cmddesc rotate-key hook 0x55d4fd15f8f0 EEXIST 2024-09-12T00:35:51.079 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:51.079 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:35:51.079 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-b con 0x55d4fd188ab0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:35:51.079 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-a con 0x55d4fd1883e0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:35:51.079 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-c con 0x55d4fd186dc0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:35:51.079 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.079 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.079 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.079 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:51.079 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:35:50.448+0000 7f15b9ed89c0 10 monclient(hunting): authenticate will time out at 2203.795663s 2024-09-12T00:35:51.079 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:35:50.448+0000 7f15b71dd640 10 monclient(hunting): get_auth_request con 0x55d4fd1883e0 auth_method 0 2024-09-12T00:35:51.079 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:35:50.448+0000 7f15b71dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:51.080 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:35:50.448+0000 7f15b71dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:51.080 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:35:50.448+0000 7f15b71dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:51.080 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:35:50.448+0000 7f15b81df640 10 monclient(hunting): get_auth_request con 0x55d4fd186dc0 auth_method 0 2024-09-12T00:35:51.080 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:35:50.448+0000 7f15b81df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:51.080 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:35:50.448+0000 7f15b81df640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:51.080 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:35:50.448+0000 7f15b81df640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:51.080 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:35:50.448+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:51.080 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:35:50.448+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:51.080 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:35:50.448+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:51.080 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:35:50.448+0000 7f15b81df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:51.080 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:35:50.448+0000 7f15b81df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:51.080 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:35:50.448+0000 7f15b81df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:51.080 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:35:50.452+0000 7f15b71dd640 10 monclient(hunting): handle_auth_done global_id 7104 payload 824 2024-09-12T00:35:51.081 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:35:50.452+0000 7f15b71dd640 10 monclient: _finish_hunting 0 2024-09-12T00:35:51.081 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:35:50.452+0000 7f15b71dd640 1 monclient: found mon.noname-a 2024-09-12T00:35:51.081 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:35:50.452+0000 7f15b71dd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:35:51.081 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:35:50.452+0000 7f15b79de640 10 monclient: get_auth_request con 0x55d4fd188ab0 auth_method 0 2024-09-12T00:35:51.081 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:51.081 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:51.081 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: dump: 2024-09-12T00:35:51.081 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:51.081 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:51.081 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.081 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.081 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:51.081 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.082 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:51.082 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:51.082 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:51.082 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.082 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:35:51.082 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:35:51.082 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 monclient: authenticate success, global_id 7104 2024-09-12T00:35:51.082 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: _renew_subs 2024-09-12T00:35:51.082 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:35:51.082 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:51.082 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:51.082 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:51.082 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:35:50.452+0000 7f149d7fa640 10 monclient: dump: 2024-09-12T00:35:51.083 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:51.083 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:51.083 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.083 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.083 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:51.083 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.083 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:51.083 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:51.083 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:51.083 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.083 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:35:50.452+0000 7f15b89e0640 4 set_mon_vals no callback set 2024-09-12T00:35:51.083 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: _renew_subs 2024-09-12T00:35:51.083 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:35:51.084 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:35:50.452+0000 7f149d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:51.084 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:35:50.452+0000 7f149d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:51.084 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:35:50.452+0000 7f149d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:51.084 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: get_monmap_and_config 2024-09-12T00:35:51.084 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: build_initial_monmap 2024-09-12T00:35:51.084 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:51.084 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: monmap: 2024-09-12T00:35:51.084 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:35:51.084 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:51.084 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:35:51.084 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:35:51.084 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:51.084 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.085 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:35:51.085 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:35:51.085 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:35:51.085 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.085 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding auth protocol: cephx 2024-09-12T00:35:51.085 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding auth protocol: cephx 2024-09-12T00:35:51.085 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding auth protocol: cephx 2024-09-12T00:35:51.085 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: secure 2024-09-12T00:35:51.085 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: crc 2024-09-12T00:35:51.085 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: secure 2024-09-12T00:35:51.085 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: crc 2024-09-12T00:35:51.085 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: secure 2024-09-12T00:35:51.085 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: crc 2024-09-12T00:35:51.086 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: crc 2024-09-12T00:35:51.086 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: secure 2024-09-12T00:35:51.086 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: crc 2024-09-12T00:35:51.086 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: secure 2024-09-12T00:35:51.086 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: crc 2024-09-12T00:35:51.086 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1a7d80) adding con mode: secure 2024-09-12T00:35:51.086 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:35:50.452+0000 7f15b79de640 10 monclient: get_auth_request con 0x7f1490070a10 auth_method 0 2024-09-12T00:35:51.086 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.086 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: init 2024-09-12T00:35:51.087 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding auth protocol: cephx 2024-09-12T00:35:51.087 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding auth protocol: cephx 2024-09-12T00:35:51.087 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding auth protocol: cephx 2024-09-12T00:35:51.087 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: secure 2024-09-12T00:35:51.087 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: crc 2024-09-12T00:35:51.087 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: secure 2024-09-12T00:35:51.087 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: crc 2024-09-12T00:35:51.087 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: secure 2024-09-12T00:35:51.087 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: crc 2024-09-12T00:35:51.087 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: crc 2024-09-12T00:35:51.087 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: secure 2024-09-12T00:35:51.087 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: crc 2024-09-12T00:35:51.087 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: secure 2024-09-12T00:35:51.088 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: crc 2024-09-12T00:35:51.088 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb532a0) adding con mode: secure 2024-09-12T00:35:51.088 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.088 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.088 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc9eb533e8 EEXIST 2024-09-12T00:35:51.088 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:51.088 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:35:51.088 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-c con 0x55d4fd1dc2e0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:35:51.088 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-a con 0x55d4fd1d76d0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:35:51.088 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-b con 0x55d4fd1cddd0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:35:51.089 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.089 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:35:50.452+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.089 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.089 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:51.089 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): authenticate will time out at 2203.800013s 2024-09-12T00:35:51.089 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): get_auth_request con 0x55d4fd1dc2e0 auth_method 0 2024-09-12T00:35:51.089 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:51.089 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:51.089 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:51.089 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): get_auth_request con 0x55d4fd1d76d0 auth_method 0 2024-09-12T00:35:51.089 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:51.089 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:51.089 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:51.090 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:51.090 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:51.090 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:51.090 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:51.090 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:51.090 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:51.090 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): handle_auth_done global_id 6698 payload 274 2024-09-12T00:35:51.090 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient: _finish_hunting 0 2024-09-12T00:35:51.090 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:35:50.456+0000 7f15b79de640 1 monclient: found mon.noname-c 2024-09-12T00:35:51.090 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.090 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:51.090 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:51.090 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: dump: 2024-09-12T00:35:51.091 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:51.091 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:51.091 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.091 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.091 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:51.091 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.091 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:51.091 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:51.091 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:51.091 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.091 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: _finish_auth 0 2024-09-12T00:35:51.091 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:35:51.091 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:51.092 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 monclient: authenticate success, global_id 6698 2024-09-12T00:35:51.092 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:51.092 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 4 set_mon_vals no callback set 2024-09-12T00:35:51.092 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:51.092 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:51.092 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:35:50.456+0000 7f1496ffd640 10 monclient: dump: 2024-09-12T00:35:51.092 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:51.092 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:51.092 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.092 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.092 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:51.092 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.092 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:51.093 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:51.093 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:51.093 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.093 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: shutdown 2024-09-12T00:35:51.093 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: build_initial_monmap 2024-09-12T00:35:51.093 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:51.093 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: monmap: 2024-09-12T00:35:51.093 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:35:51.093 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:51.093 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:35:51.093 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:35:51.093 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:51.093 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.094 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:35:51.094 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:35:51.094 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:35:51.094 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.094 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding auth protocol: cephx 2024-09-12T00:35:51.094 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding auth protocol: cephx 2024-09-12T00:35:51.094 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding auth protocol: cephx 2024-09-12T00:35:51.094 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: secure 2024-09-12T00:35:51.094 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: crc 2024-09-12T00:35:51.094 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: secure 2024-09-12T00:35:51.094 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: crc 2024-09-12T00:35:51.094 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: secure 2024-09-12T00:35:51.094 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: crc 2024-09-12T00:35:51.095 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: crc 2024-09-12T00:35:51.095 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: secure 2024-09-12T00:35:51.095 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: crc 2024-09-12T00:35:51.095 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: secure 2024-09-12T00:35:51.095 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: crc 2024-09-12T00:35:51.095 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd1d8540) adding con mode: secure 2024-09-12T00:35:51.095 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.095 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 1 librados: starting msgr at 2024-09-12T00:35:51.095 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 1 librados: starting objecter 2024-09-12T00:35:51.095 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command objecter_requests cmddesc objecter_requests hook 0x55d4fd1d6250 EEXIST 2024-09-12T00:35:51.095 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 1 librados: setting wanted keys 2024-09-12T00:35:51.095 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 1 librados: calling monclient init 2024-09-12T00:35:51.095 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: init 2024-09-12T00:35:51.096 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding auth protocol: cephx 2024-09-12T00:35:51.096 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding auth protocol: cephx 2024-09-12T00:35:51.096 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding auth protocol: cephx 2024-09-12T00:35:51.096 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: secure 2024-09-12T00:35:51.096 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: crc 2024-09-12T00:35:51.096 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: secure 2024-09-12T00:35:51.096 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: crc 2024-09-12T00:35:51.096 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: secure 2024-09-12T00:35:51.096 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: crc 2024-09-12T00:35:51.096 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: crc 2024-09-12T00:35:51.096 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: secure 2024-09-12T00:35:51.096 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: crc 2024-09-12T00:35:51.096 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: secure 2024-09-12T00:35:51.097 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: crc 2024-09-12T00:35:51.097 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 AuthRegistry(0x55d4fd18a8d0) adding con mode: secure 2024-09-12T00:35:51.097 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.097 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.097 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command rotate-key cmddesc rotate-key hook 0x55d4fd18aa18 EEXIST 2024-09-12T00:35:51.097 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:51.097 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:35:51.097 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-c con 0x55d4fd1cddd0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:35:51.097 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-a con 0x55d4fd1d76d0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:35:51.097 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): picked mon.noname-b con 0x55d4fd1dc2e0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:35:51.097 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.097 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.097 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:51.098 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:51.098 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient(hunting): authenticate will time out at 2203.802795s 2024-09-12T00:35:51.098 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): get_auth_request con 0x55d4fd1cddd0 auth_method 0 2024-09-12T00:35:51.098 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:51.098 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:51.098 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:51.098 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): get_auth_request con 0x55d4fd1d76d0 auth_method 0 2024-09-12T00:35:51.098 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:51.098 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:51.098 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:51.098 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:51.098 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:51.098 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:51.099 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:51.099 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:51.099 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:35:50.456+0000 7f15b71dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:51.099 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient(hunting): handle_auth_done global_id 6701 payload 824 2024-09-12T00:35:51.099 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient: _finish_hunting 0 2024-09-12T00:35:51.099 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:35:50.456+0000 7f15b79de640 1 monclient: found mon.noname-c 2024-09-12T00:35:51.099 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:35:50.456+0000 7f15b79de640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.099 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:51.099 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:51.099 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: dump: 2024-09-12T00:35:51.099 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:51.099 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:51.099 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.100 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.100 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:51.100 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.100 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:51.100 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:51.100 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:51.100 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.100 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: _finish_auth 0 2024-09-12T00:35:51.100 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: _check_auth_tickets 2024-09-12T00:35:51.100 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 monclient: authenticate success, global_id 6701 2024-09-12T00:35:51.100 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:51.100 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:51.101 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:51.101 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:35:50.456+0000 7f14957fa640 10 monclient: dump: 2024-09-12T00:35:51.101 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:35:51.101 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:35:51.101 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.101 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:35:51.101 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:51.101 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:35:51.101 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:35:51.101 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:35:51.101 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:35:51.101 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.102 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: _renew_subs 2024-09-12T00:35:51.102 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:35:50.456+0000 7f1496ffd640 4 set_mon_vals no callback set 2024-09-12T00:35:51.102 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.102 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: _renew_subs 2024-09-12T00:35:51.102 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.102 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 1 librados: init done 2024-09-12T00:35:51.102 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:35:50.456+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command cr dump hook 0x55d4fd1d5388 2024-09-12T00:35:51.102 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:35:50.460+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.102 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:35:50.460+0000 7f14957fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:51.102 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:35:50.460+0000 7f14957fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:51.102 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:35:50.460+0000 7f14957fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:35:51.102 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:35:50.460+0000 7f15b71dd640 10 monclient: get_auth_request con 0x7f1480070ae0 auth_method 0 2024-09-12T00:35:51.102 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:35:50.460+0000 7f15b81df640 10 monclient: get_auth_request con 0x55d4fd1f5e80 auth_method 0 2024-09-12T00:35:51.103 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:35:50.460+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.103 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:35:50.460+0000 7f15b9ed89c0 20 realm 2024-09-12T00:35:51.103 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:35:50.460+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.103 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:35:50.464+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.103 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:35:50.464+0000 7f15b9ed89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:51.103 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:35:50.464+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.103 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:35:50.464+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.103 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:35:50.464+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.103 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:35:50.668+0000 7f15b79de640 10 monclient: get_auth_request con 0x55d4fd1fa080 auth_method 0 2024-09-12T00:35:51.103 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:35:50.668+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:51.103 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:35:50.668+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.103 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:35:50.668+0000 7f15b71dd640 10 monclient: get_auth_request con 0x55d4fd1fd8e0 auth_method 0 2024-09-12T00:35:51.103 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:35:50.672+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:51.104 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:35:50.672+0000 7f15b9ed89c0 20 searching for the correct realm 2024-09-12T00:35:51.104 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:35:50.672+0000 7f15b81df640 10 monclient: get_auth_request con 0x55d4fd202660 auth_method 0 2024-09-12T00:35:51.104 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:35:50.672+0000 7f15b79de640 10 monclient: get_auth_request con 0x7f15b00c3410 auth_method 0 2024-09-12T00:35:51.104 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:35:50.676+0000 7f15b71dd640 10 monclient: get_auth_request con 0x7f15a8052060 auth_method 0 2024-09-12T00:35:51.104 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:35:50.676+0000 7f15b71dd640 0 -- 172.21.15.138:0/595432236 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f15a8052060 msgr2=0x7f15a809c280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:51.104 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:35:50.880+0000 7f15b71dd640 10 monclient: get_auth_request con 0x7f15a8052060 auth_method 0 2024-09-12T00:35:51.104 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:35:50.884+0000 7f15b81df640 10 monclient: get_auth_request con 0x7f15b00cf900 auth_method 0 2024-09-12T00:35:51.104 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:35:50.888+0000 7f15b79de640 10 monclient: get_auth_request con 0x7f15a8008050 auth_method 0 2024-09-12T00:35:51.104 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:35:50.892+0000 7f15b71dd640 0 -- 172.21.15.138:0/595432236 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55d4fd1fd8e0 msgr2=0x55d4fd1ffcd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:51.104 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:35:50.892+0000 7f14957fa640 1 client.6701.objecter ms_handle_reset 0x55d4fd1fd8e0 session 0x55d4fd1f9410 osd.3 2024-09-12T00:35:51.104 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:35:50.892+0000 7f14957fa640 10 monclient: _renew_subs 2024-09-12T00:35:51.104 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:35:50.892+0000 7f14957fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:35:51.104 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:35:50.892+0000 7f15b71dd640 10 monclient: get_auth_request con 0x7f1480080e00 auth_method 0 2024-09-12T00:35:51.105 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:51.105 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:51.105 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:51.105 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:51.105 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:51.105 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:51.105 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:35:50.904+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.105 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.105 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.105 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:51.105 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.105 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:51.105 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 zone default found 2024-09-12T00:35:51.106 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 4 Realm: () 2024-09-12T00:35:51.106 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:51.106 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:51.106 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:51.106 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 zonegroup default 2024-09-12T00:35:51.106 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.106 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.106 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:35:50.908+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.106 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:35:50.912+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.106 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:35:50.912+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.106 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:35:50.912+0000 7f15b9ed89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.106 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:35:50.912+0000 7f15b9ed89c0 20 started sync module instance, tier type = 2024-09-12T00:35:51.106 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:35:50.912+0000 7f15b9ed89c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:51.106 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=0 2024-09-12T00:35:51.107 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=1 2024-09-12T00:35:51.107 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=2 2024-09-12T00:35:51.107 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=3 2024-09-12T00:35:51.107 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=4 2024-09-12T00:35:51.107 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=5 2024-09-12T00:35:51.107 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=6 2024-09-12T00:35:51.107 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 20 add_watcher() i=7 2024-09-12T00:35:51.107 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:35:50.936+0000 7f15b9ed89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:51.107 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding auth protocol: cephx 2024-09-12T00:35:51.107 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding auth protocol: cephx 2024-09-12T00:35:51.107 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding auth protocol: cephx 2024-09-12T00:35:51.107 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: secure 2024-09-12T00:35:51.107 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: crc 2024-09-12T00:35:51.108 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: secure 2024-09-12T00:35:51.108 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: crc 2024-09-12T00:35:51.108 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: secure 2024-09-12T00:35:51.108 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: crc 2024-09-12T00:35:51.108 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: crc 2024-09-12T00:35:51.108 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: secure 2024-09-12T00:35:51.108 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: crc 2024-09-12T00:35:51.108 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: secure 2024-09-12T00:35:51.108 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: crc 2024-09-12T00:35:51.108 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:35:50.940+0000 7f15b9ed89c0 5 AuthRegistry(0x7ffc9eb53780) adding con mode: secure 2024-09-12T00:35:51.108 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:35:50.940+0000 7f146dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:51.108 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:51.108 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:51.109 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:51.109 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command cache list hook 0x55d4fd1d52a0 2024-09-12T00:35:51.109 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command cache inspect hook 0x55d4fd1d52a0 2024-09-12T00:35:51.109 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command cache erase hook 0x55d4fd1d52a0 2024-09-12T00:35:51.109 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command cache zap hook 0x55d4fd1d52a0 2024-09-12T00:35:51.109 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 note: GC not initialized 2024-09-12T00:35:51.109 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:35:50.944+0000 7f146cfe1640 20 reqs_thread_entry: start 2024-09-12T00:35:51.109 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command sync trace show hook 0x7f15a8004550 2024-09-12T00:35:51.109 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command sync trace history hook 0x7f15a8004550 2024-09-12T00:35:51.109 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command sync trace active hook 0x7f15a8004550 2024-09-12T00:35:51.109 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 5 asok(0x55d4fcf042b0) register_command sync trace active_short hook 0x7f15a8004550 2024-09-12T00:35:51.109 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:51.109 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 Filter name: none 2024-09-12T00:35:51.109 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:35:50.944+0000 7f13e67fc640 20 reqs_thread_entry: start 2024-09-12T00:35:51.110 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:35:51.110 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.110 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:35:51.110 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:35:51.110 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:35:51.110 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 : miss 2024-09-12T00:35:51.110 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:35:50.944+0000 7f15b9ed89c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.110 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:35:50.948+0000 7f15b9ed89c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:35:51.110 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:35:50.948+0000 7f15b9ed89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:35:51.110 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:35:50.948+0000 7f15b9ed89c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:35:51.110 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:35:50.948+0000 7f15b9ed89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:51.110 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:35:50.948+0000 7f15b9ed89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:51.111 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:35:50.948+0000 7f15b9ed89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 2024-09-12T00:35:51.111 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:35:50.960+0000 7f15b9ed89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:35:51.111 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:35:50.960+0000 7f15b9ed89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:35:51.111 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:35:50.960+0000 7f15b9ed89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:51.111 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:35:50.960+0000 7f15b9ed89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29, ofs0, ns] 2024-09-12T00:35:51.111 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:35:50.960+0000 7f1496ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333559 cookie 94373268197456 notifier 6701 bl.length()=915 2024-09-12T00:35:51.111 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:35:50.960+0000 7f1496ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:35:51.111 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:35:50.960+0000 7f1496ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:35:51.111 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:35:50.960+0000 7f1496ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:51.111 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:35:50.960+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_sources= new_sources= 2024-09-12T00:35:51.111 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:35:50.960+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential sources added=[] removed=[] 2024-09-12T00:35:51.111 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:35:50.960+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_dests= new_dests= 2024-09-12T00:35:51.111 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:35:50.960+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential dests added=[] removed=[] 2024-09-12T00:35:51.111 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.0 2024-09-12T00:35:51.112 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.0 2024-09-12T00:35:51.112 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.1 2024-09-12T00:35:51.112 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.1 2024-09-12T00:35:51.112 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.2 2024-09-12T00:35:51.112 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.2 2024-09-12T00:35:51.112 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.3 2024-09-12T00:35:51.112 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.3 2024-09-12T00:35:51.112 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.4 2024-09-12T00:35:51.112 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.4 2024-09-12T00:35:51.112 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.5 2024-09-12T00:35:51.112 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.5 2024-09-12T00:35:51.112 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.6 2024-09-12T00:35:51.112 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.6 2024-09-12T00:35:51.113 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.7 2024-09-12T00:35:51.113 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.7 2024-09-12T00:35:51.113 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.8 2024-09-12T00:35:51.113 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.8 2024-09-12T00:35:51.113 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.9 2024-09-12T00:35:51.113 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.9 2024-09-12T00:35:51.113 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.10 2024-09-12T00:35:51.113 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.10 2024-09-12T00:35:51.113 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.11 2024-09-12T00:35:51.113 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1.11 2024-09-12T00:35:51.113 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.0 2024-09-12T00:35:51.113 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1 2024-09-12T00:35:51.113 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2 2024-09-12T00:35:51.114 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:35:50.976+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.3 2024-09-12T00:35:51.114 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:35:50.980+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.4 2024-09-12T00:35:51.114 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:35:50.980+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.5 2024-09-12T00:35:51.114 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:35:50.980+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.6 2024-09-12T00:35:51.114 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:35:50.980+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.7 2024-09-12T00:35:51.114 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:35:50.984+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.8 2024-09-12T00:35:51.114 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:35:50.984+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.9 2024-09-12T00:35:51.114 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:35:50.984+0000 7f15b9ed89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.10 2024-09-12T00:35:51.114 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:35:51.114 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 2024-09-12T00:35:51.114 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:35:51.114 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:35:51.114 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:51.115 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:35:50.992+0000 7f15b9ed89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29, ofs0, ns] 2024-09-12T00:35:51.115 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:35:50.992+0000 7f14967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333560 cookie 94373268197456 notifier 6701 bl.length()=915 2024-09-12T00:35:51.115 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:35:50.992+0000 7f14967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:35:51.115 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:35:50.992+0000 7f14967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:35:51.115 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:35:50.992+0000 7f14967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:51.115 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:35:50.996+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_sources= new_sources= 2024-09-12T00:35:51.115 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:35:50.996+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential sources added=[] removed=[] 2024-09-12T00:35:51.115 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:35:50.996+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_dests= new_dests= 2024-09-12T00:35:51.115 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:35:50.996+0000 7f15b9ed89c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential dests added=[] removed=[] 2024-09-12T00:35:51.115 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:35:50.996+0000 7f15b9ed89c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f15b9ed89c0 time 2024-09-12T00:35:50.999998+0000 2024-09-12T00:35:51.115 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:51.115 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.115 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:51.115 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f15bd7b22eb] 2024-09-12T00:35:51.116 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f15bd7b249f] 2024-09-12T00:35:51.116 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d4fb73fcc1] 2024-09-12T00:35:51.116 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55d4fb754086] 2024-09-12T00:35:51.116 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55d4fb7556a4] 2024-09-12T00:35:51.116 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:35:51.116 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f15bc618d90] 2024-09-12T00:35:51.116 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:35:51.116 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:35:51.116 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.116 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:35:50.996+0000 7f15b9ed89c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:51.116 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f15b9ed89c0 thread_name:radosgw-admin 2024-09-12T00:35:51.116 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.117 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:51.117 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f15bc631520] 2024-09-12T00:35:51.117 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:35:51.117 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:35:51.117 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:35:51.117 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f15bd7b2345] 2024-09-12T00:35:51.117 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f15bd7b249f] 2024-09-12T00:35:51.117 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d4fb73fcc1] 2024-09-12T00:35:51.117 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x55d4fb754086] 2024-09-12T00:35:51.117 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55d4fb7556a4] 2024-09-12T00:35:51.117 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:35:51.117 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f15bc618d90] 2024-09-12T00:35:51.118 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:35:51.118 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:35:51.118 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:51.118 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.118 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:35:51.118 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:35:51.118 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:35:51.118 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:35:51.118 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:35:51.118 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:35:51.118 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:35:51.118 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:35:51.118 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:35:51.119 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:35:51.119 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:35:51.119 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:35:51.119 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:35:51.119 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:35:51.119 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:35:51.119 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:35:51.119 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:35:51.119 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:35:51.119 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:35:51.119 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:35:51.119 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:35:51.119 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:35:51.119 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:35:51.120 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:35:51.120 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:35:51.120 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:35:51.120 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:35:51.120 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:35:51.120 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:35:51.120 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:35:51.120 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:35:51.120 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:35:51.120 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:35:51.120 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:35:51.120 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:35:51.120 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:35:51.121 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:35:51.121 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:35:51.121 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:35:51.121 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:35:51.121 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:35:51.121 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:35:51.121 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:35:51.121 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:35:51.121 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:35:51.121 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:35:51.121 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:35:51.121 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:35:51.121 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:35:51.122 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:35:51.122 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:35:51.122 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:35:51.122 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:35:51.122 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:35:51.122 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:35:51.122 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:35:51.122 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:35:51.122 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:35:51.122 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:35:51.122 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:35:51.122 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:35:51.122 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:35:51.122 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:35:51.123 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:35:51.123 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:35:51.123 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:35:51.123 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:35:51.123 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:35:51.123 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:35:51.123 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:35:51.123 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:35:51.123 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:35:51.123 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:35:51.123 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:35:51.123 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:35:51.123 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:35:51.123 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:35:51.124 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:35:51.124 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:35:51.124 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:35:51.124 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:35:51.124 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:35:51.124 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:35:51.124 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:35:51.124 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:35:51.124 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:35:51.124 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:35:51.124 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:35:51.124 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:35:51.124 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:35:51.125 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:35:51.125 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:35:51.125 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:35:51.125 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:35:51.125 INFO:tasks.workunit.client.0.smithi138.stderr: 7f13e67fc640 / http_manager 2024-09-12T00:35:51.125 INFO:tasks.workunit.client.0.smithi138.stderr: 7f146cfe1640 / http_manager 2024-09-12T00:35:51.125 INFO:tasks.workunit.client.0.smithi138.stderr: 7f146dfe3640 / rgw_dt_lg_renew 2024-09-12T00:35:51.125 INFO:tasks.workunit.client.0.smithi138.stderr: 7f14957fa640 / ms_dispatch 2024-09-12T00:35:51.125 INFO:tasks.workunit.client.0.smithi138.stderr: 7f14967fc640 / io_context_pool 2024-09-12T00:35:51.125 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1496ffd640 / io_context_pool 2024-09-12T00:35:51.125 INFO:tasks.workunit.client.0.smithi138.stderr: 7f149d7fa640 / ms_dispatch 2024-09-12T00:35:51.125 INFO:tasks.workunit.client.0.smithi138.stderr: 7f149ffff640 / ms_dispatch 2024-09-12T00:35:51.125 INFO:tasks.workunit.client.0.smithi138.stderr: 7f14a5e0b640 / io_context_pool 2024-09-12T00:35:51.125 INFO:tasks.workunit.client.0.smithi138.stderr: 7f15b71dd640 / msgr-worker-2 2024-09-12T00:35:51.126 INFO:tasks.workunit.client.0.smithi138.stderr: 7f15b79de640 / msgr-worker-1 2024-09-12T00:35:51.126 INFO:tasks.workunit.client.0.smithi138.stderr: 7f15b81df640 / msgr-worker-0 2024-09-12T00:35:51.126 INFO:tasks.workunit.client.0.smithi138.stderr: 7f15b89e0640 / io_context_pool 2024-09-12T00:35:51.126 INFO:tasks.workunit.client.0.smithi138.stderr: 7f15b9ed89c0 / radosgw-admin 2024-09-12T00:35:51.126 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:35:51.126 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:35:51.126 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:35:51.002382Z_6e8ab65c-6511-492c-8cb5-56f2b0f385ee/log 2024-09-12T00:35:51.126 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:35:51.126 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-12T00:35:51.128 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:35:51.129 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:51.129 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:51.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.084+0000 7f189b6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.088+0000 7f189b6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.088+0000 7f189b6f69c0 20 realm 2024-09-12T00:35:51.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.088+0000 7f189b6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.088+0000 7f189b6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.088+0000 7f189b6f69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:51.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.088+0000 7f189b6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.088+0000 7f189b6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.088+0000 7f189b6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.088+0000 7f189b6f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:51.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.088+0000 7f189b6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.092+0000 7f189b6f69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:51.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.092+0000 7f189b6f69c0 20 searching for the correct realm 2024-09-12T00:35:51.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.096+0000 7f18999fd640 0 -- 172.21.15.138:0/3510658205 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f1894061f70 msgr2=0x7f1894069870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:51.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.104+0000 7f18991fc640 0 -- 172.21.15.138:0/3510658205 >> [v2:172.21.15.138:6800/1437861584,v1:172.21.15.138:6801/1437861584] conn(0x55be457ab5c0 msgr2=0x55be457ad9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:51.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.108+0000 7f189b6f69c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:51.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.108+0000 7f189b6f69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:51.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.108+0000 7f189b6f69c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:51.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.108+0000 7f189b6f69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:51.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.108+0000 7f189b6f69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:51.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.108+0000 7f189b6f69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:51.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.108+0000 7f189b6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:51.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:51.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 20 zone default found 2024-09-12T00:35:51.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 4 Realm: () 2024-09-12T00:35:51.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:51.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:51.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:51.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 20 zonegroup default 2024-09-12T00:35:51.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 20 started sync module instance, tier type = 2024-09-12T00:35:51.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.112+0000 7f189b6f69c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:51.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.132+0000 7f189b6f69c0 20 add_watcher() i=0 2024-09-12T00:35:51.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.132+0000 7f189b6f69c0 20 add_watcher() i=1 2024-09-12T00:35:51.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.132+0000 7f189b6f69c0 20 add_watcher() i=2 2024-09-12T00:35:51.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.132+0000 7f189b6f69c0 20 add_watcher() i=3 2024-09-12T00:35:51.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.132+0000 7f189b6f69c0 20 add_watcher() i=4 2024-09-12T00:35:51.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.132+0000 7f189b6f69c0 20 add_watcher() i=5 2024-09-12T00:35:51.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.132+0000 7f189b6f69c0 20 add_watcher() i=6 2024-09-12T00:35:51.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.132+0000 7f189b6f69c0 20 add_watcher() i=7 2024-09-12T00:35:51.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.132+0000 7f189b6f69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:51.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.136+0000 7f174f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:51.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.136+0000 7f189b6f69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:51.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.136+0000 7f189b6f69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:51.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.140+0000 7f189b6f69c0 5 note: GC not initialized 2024-09-12T00:35:51.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.140+0000 7f174e7e4640 20 reqs_thread_entry: start 2024-09-12T00:35:51.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.140+0000 7f189b6f69c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:51.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.140+0000 7f189b6f69c0 20 Filter name: none 2024-09-12T00:35:51.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.140+0000 7f16bffff640 20 reqs_thread_entry: start 2024-09-12T00:35:51.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.140+0000 7f189b6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.140+0000 7f189b6f69c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:35:51.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.140+0000 7f189b6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.140+0000 7f189b6f69c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:35:51.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.140+0000 7f189b6f69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:51.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.140+0000 7f189b6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.140+0000 7f189b6f69c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:35:51.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.140+0000 7f189b6f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.140+0000 7f189b6f69c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:35:51.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.140+0000 7f189b6f69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:51.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.144+0000 7f174f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:51.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.148+0000 7f189b6f69c0 20 remove_watcher() i=0 2024-09-12T00:35:51.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.148+0000 7f189b6f69c0 2 removed watcher, disabling cache 2024-09-12T00:35:51.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.152+0000 7f189b6f69c0 20 remove_watcher() i=1 2024-09-12T00:35:51.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.152+0000 7f189b6f69c0 20 remove_watcher() i=2 2024-09-12T00:35:51.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.152+0000 7f189b6f69c0 20 remove_watcher() i=3 2024-09-12T00:35:51.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.156+0000 7f189b6f69c0 20 remove_watcher() i=4 2024-09-12T00:35:51.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.156+0000 7f189b6f69c0 20 remove_watcher() i=5 2024-09-12T00:35:51.159 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.160+0000 7f189b6f69c0 20 remove_watcher() i=6 2024-09-12T00:35:51.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.164+0000 7f189b6f69c0 20 remove_watcher() i=7 2024-09-12T00:35:51.176 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.176 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:35:51.176 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-block-writes id: e2043445-c131-4520-984d-b4d52f038a6b.4538.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:35:51.176 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:35:51.177 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:51.177 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:51.189 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:35:51.189 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:35:51.233 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:35:51.272 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:51.272 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:51.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.320+0000 7f4e32c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.320+0000 7f4e32c9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.320+0000 7f4e32c9b9c0 20 realm 2024-09-12T00:35:51.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.320+0000 7f4e32c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.320+0000 7f4e32c9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.320+0000 7f4e32c9b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:51.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.320+0000 7f4e32c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.324+0000 7f4e32c9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.324+0000 7f4e32c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.324+0000 7f4e32c9b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:51.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.324+0000 7f4e32c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.324+0000 7f4e32c9b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:51.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.324+0000 7f4e32c9b9c0 20 searching for the correct realm 2024-09-12T00:35:51.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.328+0000 7f4e2ffa0640 0 -- 172.21.15.138:0/4107492856 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f4e20078c20 msgr2=0x7f4e20062120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:51.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.336+0000 7f4e2ffa0640 0 -- 172.21.15.138:0/4107492856 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x555a2bd8f180 msgr2=0x555a2bd91570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:51.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:35:51.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:51.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:35:51.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:51.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:51.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:51.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:51.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:51.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 zone default found 2024-09-12T00:35:51.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 4 Realm: () 2024-09-12T00:35:51.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:35:51.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:35:51.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:51.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 zonegroup default 2024-09-12T00:35:51.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:51.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 started sync module instance, tier type = 2024-09-12T00:35:51.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.344+0000 7f4e32c9b9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:35:51.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.364+0000 7f4e32c9b9c0 20 add_watcher() i=0 2024-09-12T00:35:51.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.364+0000 7f4e32c9b9c0 20 add_watcher() i=1 2024-09-12T00:35:51.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.364+0000 7f4e32c9b9c0 20 add_watcher() i=2 2024-09-12T00:35:51.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.364+0000 7f4e32c9b9c0 20 add_watcher() i=3 2024-09-12T00:35:51.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.364+0000 7f4e32c9b9c0 20 add_watcher() i=4 2024-09-12T00:35:51.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.364+0000 7f4e32c9b9c0 20 add_watcher() i=5 2024-09-12T00:35:51.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.364+0000 7f4e32c9b9c0 20 add_watcher() i=6 2024-09-12T00:35:51.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.364+0000 7f4e32c9b9c0 20 add_watcher() i=7 2024-09-12T00:35:51.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.364+0000 7f4e32c9b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:51.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.368+0000 7f4ce6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:51.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.368+0000 7f4e32c9b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:51.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.368+0000 7f4e32c9b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:51.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.368+0000 7f4e32c9b9c0 5 note: GC not initialized 2024-09-12T00:35:51.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.372+0000 7f4ce5fdb640 20 reqs_thread_entry: start 2024-09-12T00:35:51.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.372+0000 7f4e32c9b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:51.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.372+0000 7f4e32c9b9c0 20 Filter name: none 2024-09-12T00:35:51.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.372+0000 7f4c577fe640 20 reqs_thread_entry: start 2024-09-12T00:35:51.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.372+0000 7f4e32c9b9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:35:51.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.372+0000 7f4e32c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.372+0000 7f4e32c9b9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:35:51.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.372+0000 7f4e32c9b9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:35:51.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.372+0000 7f4e32c9b9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:35:51.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.372+0000 7f4e32c9b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 : miss 2024-09-12T00:35:51.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.372+0000 7f4e32c9b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:51.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.372+0000 7f4e32c9b9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:35:51.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.372+0000 7f4e32c9b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:35:51.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.372+0000 7f4e32c9b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:35:51.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.372+0000 7f4e32c9b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:51.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.372+0000 7f4e32c9b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:35:51.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.372+0000 7f4e32c9b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 2024-09-12T00:35:51.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.376+0000 7f4e32c9b9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to be held by another RGW process; skipping for now 2024-09-12T00:35:51.374 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.376+0000 7f4ce6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:51.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.380+0000 7f4e32c9b9c0 20 remove_watcher() i=0 2024-09-12T00:35:51.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.380+0000 7f4e32c9b9c0 2 removed watcher, disabling cache 2024-09-12T00:35:51.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.380+0000 7f4e32c9b9c0 20 remove_watcher() i=1 2024-09-12T00:35:51.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.384+0000 7f4e32c9b9c0 20 remove_watcher() i=2 2024-09-12T00:35:51.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.384+0000 7f4e32c9b9c0 20 remove_watcher() i=3 2024-09-12T00:35:51.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.388+0000 7f4e32c9b9c0 20 remove_watcher() i=4 2024-09-12T00:35:51.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.392+0000 7f4e32c9b9c0 20 remove_watcher() i=5 2024-09-12T00:35:51.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.392+0000 7f4e32c9b9c0 20 remove_watcher() i=6 2024-09-12T00:35:51.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:35:51.396+0000 7f4e32c9b9c0 20 remove_watcher() i=7 2024-09-12T00:35:51.408 INFO:tasks.workunit.client.0.smithi138.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:36:21.412 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:36:21.447 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:21.447 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:21.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.495+0000 7f135a3059c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.499+0000 7f135a3059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.499+0000 7f135a3059c0 20 realm 2024-09-12T00:36:21.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.499+0000 7f135a3059c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.499+0000 7f135a3059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.499+0000 7f135a3059c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:21.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.499+0000 7f135a3059c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.499+0000 7f135a3059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.499+0000 7f135a3059c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.499+0000 7f135a3059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:21.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.499+0000 7f135a3059c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.703+0000 7f135a3059c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:21.703 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.703+0000 7f135a3059c0 20 searching for the correct realm 2024-09-12T00:36:21.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.711+0000 7f135860c640 0 -- 172.21.15.138:0/1946373804 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x561fc30b1150 msgr2=0x561fc30b3610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:21.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.723+0000 7f135760a640 0 -- 172.21.15.138:0/1946373804 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x561fc30ac430 msgr2=0x561fc30ae840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:21.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.735+0000 7f135a3059c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:21.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.735+0000 7f135a3059c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:21.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.735+0000 7f135a3059c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:21.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.735+0000 7f135a3059c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:21.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.735+0000 7f135a3059c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:21.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.735+0000 7f135a3059c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:21.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.735+0000 7f135a3059c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.735+0000 7f135a3059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.735+0000 7f135a3059c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.735+0000 7f135a3059c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:21.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.735+0000 7f135a3059c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.739+0000 7f135a3059c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:21.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.739+0000 7f135a3059c0 20 zone default found 2024-09-12T00:36:21.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.739+0000 7f135a3059c0 4 Realm: () 2024-09-12T00:36:21.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.739+0000 7f135a3059c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:21.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.739+0000 7f135a3059c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:21.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.739+0000 7f135a3059c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:21.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.739+0000 7f135a3059c0 20 zonegroup default 2024-09-12T00:36:21.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.739+0000 7f135a3059c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.739+0000 7f135a3059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.739+0000 7f135a3059c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.739+0000 7f135a3059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.739+0000 7f135a3059c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.739+0000 7f135a3059c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.739+0000 7f135a3059c0 20 started sync module instance, tier type = 2024-09-12T00:36:21.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.739+0000 7f135a3059c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:21.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.763+0000 7f135a3059c0 20 add_watcher() i=0 2024-09-12T00:36:21.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.763+0000 7f135a3059c0 20 add_watcher() i=1 2024-09-12T00:36:21.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.763+0000 7f135a3059c0 20 add_watcher() i=2 2024-09-12T00:36:21.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.763+0000 7f135a3059c0 20 add_watcher() i=3 2024-09-12T00:36:21.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.763+0000 7f135a3059c0 20 add_watcher() i=4 2024-09-12T00:36:21.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.763+0000 7f135a3059c0 20 add_watcher() i=5 2024-09-12T00:36:21.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.763+0000 7f135a3059c0 20 add_watcher() i=6 2024-09-12T00:36:21.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.767+0000 7f135a3059c0 20 add_watcher() i=7 2024-09-12T00:36:21.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.767+0000 7f135a3059c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:21.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.771+0000 7f120dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:21.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.771+0000 7f135a3059c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:21.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.771+0000 7f135a3059c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:21.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.771+0000 7f135a3059c0 5 note: GC not initialized 2024-09-12T00:36:21.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.771+0000 7f120cfe1640 20 reqs_thread_entry: start 2024-09-12T00:36:21.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.771+0000 7f135a3059c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:21.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.771+0000 7f135a3059c0 20 Filter name: none 2024-09-12T00:36:21.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.771+0000 7f11867fc640 20 reqs_thread_entry: start 2024-09-12T00:36:21.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.771+0000 7f135a3059c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:36:21.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.771+0000 7f135a3059c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.775+0000 7f135a3059c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:36:21.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.775+0000 7f135a3059c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:36:21.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.775+0000 7f135a3059c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:36:21.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.775+0000 7f135a3059c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 : miss 2024-09-12T00:36:21.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.775+0000 7f135a3059c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.775+0000 7f135a3059c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:36:21.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.775+0000 7f135a3059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:36:21.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.775+0000 7f135a3059c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:36:21.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.775+0000 7f135a3059c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:21.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.775+0000 7f135a3059c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:21.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.775+0000 7f135a3059c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 2024-09-12T00:36:21.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.779+0000 7f135a3059c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:36:21.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.795+0000 7f135a3059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:36:21.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.795+0000 7f135a3059c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:36:21.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.795+0000 7f135a3059c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:21.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.795+0000 7f135a3059c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29, ofs0, ns] 2024-09-12T00:36:21.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.795+0000 7f1236ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333561 cookie 94694416274112 notifier 6752 bl.length()=915 2024-09-12T00:36:21.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.795+0000 7f1236ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:36:21.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.795+0000 7f1236ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:36:21.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.795+0000 7f1236ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:21.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.795+0000 7f135a3059c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_sources= new_sources= 2024-09-12T00:36:21.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.795+0000 7f135a3059c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential sources added=[] removed=[] 2024-09-12T00:36:21.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.795+0000 7f135a3059c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_dests= new_dests= 2024-09-12T00:36:21.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.795+0000 7f135a3059c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential dests added=[] removed=[] 2024-09-12T00:36:21.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.0 2024-09-12T00:36:21.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.0 2024-09-12T00:36:21.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.1 2024-09-12T00:36:21.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.1 2024-09-12T00:36:21.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.2 2024-09-12T00:36:21.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.2 2024-09-12T00:36:21.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.3 2024-09-12T00:36:21.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.3 2024-09-12T00:36:21.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.4 2024-09-12T00:36:21.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.4 2024-09-12T00:36:21.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.5 2024-09-12T00:36:21.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.5 2024-09-12T00:36:21.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.6 2024-09-12T00:36:21.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.6 2024-09-12T00:36:21.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.7 2024-09-12T00:36:21.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.7 2024-09-12T00:36:21.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.8 2024-09-12T00:36:21.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.8 2024-09-12T00:36:21.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.9 2024-09-12T00:36:21.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.9 2024-09-12T00:36:21.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.10 2024-09-12T00:36:21.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.10 2024-09-12T00:36:21.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.11 2024-09-12T00:36:21.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2.11 2024-09-12T00:36:21.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.0 2024-09-12T00:36:21.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1 2024-09-12T00:36:21.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.807+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2 2024-09-12T00:36:21.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.811+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.3 2024-09-12T00:36:21.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.811+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.4 2024-09-12T00:36:21.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.811+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.5 2024-09-12T00:36:21.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.811+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.6 2024-09-12T00:36:21.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.811+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.7 2024-09-12T00:36:21.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.815+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.8 2024-09-12T00:36:21.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.815+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.9 2024-09-12T00:36:21.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.815+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.10 2024-09-12T00:36:21.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.823+0000 7f135a3059c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:21.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.823+0000 7f135a3059c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 2024-09-12T00:36:21.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.823+0000 7f135a3059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:36:21.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.823+0000 7f135a3059c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:36:21.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.823+0000 7f135a3059c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:21.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.823+0000 7f135a3059c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29, ofs0, ns] 2024-09-12T00:36:21.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.827+0000 7f1236ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333562 cookie 94694416274112 notifier 6752 bl.length()=915 2024-09-12T00:36:21.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.827+0000 7f1236ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:36:21.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.827+0000 7f1236ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:36:21.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.827+0000 7f1236ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:21.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.827+0000 7f135a3059c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_sources= new_sources= 2024-09-12T00:36:21.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.827+0000 7f135a3059c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential sources added=[] removed=[] 2024-09-12T00:36:21.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.827+0000 7f135a3059c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_dests= new_dests= 2024-09-12T00:36:21.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.827+0000 7f135a3059c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential dests added=[] removed=[] 2024-09-12T00:36:21.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.831+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.0 2024-09-12T00:36:21.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.835+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.1 2024-09-12T00:36:21.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.835+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.2 2024-09-12T00:36:21.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.835+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.3 2024-09-12T00:36:21.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.835+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.4 2024-09-12T00:36:21.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.835+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.5 2024-09-12T00:36:21.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.835+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.6 2024-09-12T00:36:21.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.835+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.7 2024-09-12T00:36:21.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.839+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.8 2024-09-12T00:36:21.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.839+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.9 2024-09-12T00:36:21.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.839+0000 7f135a3059c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.29.10 2024-09-12T00:36:21.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.839+0000 7f135a3059c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:21.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.839+0000 7f135a3059c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 2024-09-12T00:36:21.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.843+0000 7f135a3059c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:36:21.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.843+0000 7f135a3059c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:36:21.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.843+0000 7f135a3059c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:21.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.843+0000 7f135a3059c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29, ofs0, ns] 2024-09-12T00:36:21.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.843+0000 7f12367fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333563 cookie 94694416274112 notifier 6752 bl.length()=883 2024-09-12T00:36:21.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.843+0000 7f12367fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 info.flags=0x17 2024-09-12T00:36:21.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.843+0000 7f12367fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.29 to cache LRU end 2024-09-12T00:36:21.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.843+0000 7f12367fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:21.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.843+0000 7f135a3059c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_sources= new_sources= 2024-09-12T00:36:21.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.843+0000 7f135a3059c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential sources added=[] removed=[] 2024-09-12T00:36:21.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.843+0000 7f135a3059c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): orig_dests= new_dests= 2024-09-12T00:36:21.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.843+0000 7f135a3059c0 20 handle_bi_update(): bucket=:abort-at-block-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.29]): potential dests added=[] removed=[] 2024-09-12T00:36:21.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.847+0000 7f135a3059c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:36:21.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.851+0000 7f120dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:21.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.855+0000 7f135a3059c0 20 remove_watcher() i=0 2024-09-12T00:36:21.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.855+0000 7f135a3059c0 2 removed watcher, disabling cache 2024-09-12T00:36:21.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.859+0000 7f135a3059c0 20 remove_watcher() i=1 2024-09-12T00:36:21.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.859+0000 7f135a3059c0 20 remove_watcher() i=2 2024-09-12T00:36:21.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.863+0000 7f135a3059c0 20 remove_watcher() i=3 2024-09-12T00:36:21.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.863+0000 7f135a3059c0 20 remove_watcher() i=4 2024-09-12T00:36:21.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.867+0000 7f135a3059c0 20 remove_watcher() i=5 2024-09-12T00:36:21.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.871+0000 7f135a3059c0 20 remove_watcher() i=6 2024-09-12T00:36:21.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.871+0000 7f135a3059c0 20 remove_watcher() i=7 2024-09-12T00:36:21.888 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:36:21.918 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:21.918 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:21.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.963+0000 7f403f0989c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.963+0000 7f403f0989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.963+0000 7f403f0989c0 20 realm 2024-09-12T00:36:21.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.963+0000 7f403f0989c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.963+0000 7f403f0989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.963+0000 7f403f0989c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:21.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.963+0000 7f403f0989c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.967+0000 7f403f0989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.967+0000 7f403f0989c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.967+0000 7f403f0989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:21.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.967+0000 7f403f0989c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.967+0000 7f403f0989c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:21.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.967+0000 7f403f0989c0 20 searching for the correct realm 2024-09-12T00:36:21.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.971+0000 7f403d39f640 0 -- 172.21.15.138:0/3601245302 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5559f34f5140 msgr2=0x5559f34f75e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:21.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.979+0000 7f403c39d640 0 -- 172.21.15.138:0/3601245302 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x5559f34e8980 msgr2=0x5559f34eae40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:21.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:21.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:21.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:21.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:21.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:21.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:21.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:21.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:21.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 zone default found 2024-09-12T00:36:21.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 4 Realm: () 2024-09-12T00:36:21.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:21.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:21.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:21.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 zonegroup default 2024-09-12T00:36:21.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.987+0000 7f403f0989c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:21.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.991+0000 7f403f0989c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:21.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.991+0000 7f403f0989c0 20 started sync module instance, tier type = 2024-09-12T00:36:21.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:21.991+0000 7f403f0989c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:22.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.007+0000 7f403f0989c0 20 add_watcher() i=0 2024-09-12T00:36:22.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.007+0000 7f403f0989c0 20 add_watcher() i=1 2024-09-12T00:36:22.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.007+0000 7f403f0989c0 20 add_watcher() i=2 2024-09-12T00:36:22.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.007+0000 7f403f0989c0 20 add_watcher() i=3 2024-09-12T00:36:22.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.007+0000 7f403f0989c0 20 add_watcher() i=4 2024-09-12T00:36:22.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.007+0000 7f403f0989c0 20 add_watcher() i=5 2024-09-12T00:36:22.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.007+0000 7f403f0989c0 20 add_watcher() i=6 2024-09-12T00:36:22.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.011+0000 7f403f0989c0 20 add_watcher() i=7 2024-09-12T00:36:22.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.011+0000 7f403f0989c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:22.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.011+0000 7f3ef2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:22.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.011+0000 7f403f0989c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:22.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.011+0000 7f403f0989c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:22.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.015+0000 7f403f0989c0 5 note: GC not initialized 2024-09-12T00:36:22.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.015+0000 7f3ef1fe3640 20 reqs_thread_entry: start 2024-09-12T00:36:22.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.015+0000 7f403f0989c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:22.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.015+0000 7f403f0989c0 20 Filter name: none 2024-09-12T00:36:22.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.015+0000 7f3e637fe640 20 reqs_thread_entry: start 2024-09-12T00:36:22.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.015+0000 7f403f0989c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.015+0000 7f403f0989c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:36:22.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.015+0000 7f403f0989c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.015+0000 7f403f0989c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:36:22.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.015+0000 7f403f0989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:22.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.015+0000 7f403f0989c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.015+0000 7f403f0989c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:36:22.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.015+0000 7f403f0989c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.015+0000 7f403f0989c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:36:22.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.015+0000 7f403f0989c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:22.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.019+0000 7f3ef2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:22.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.023+0000 7f403f0989c0 20 remove_watcher() i=0 2024-09-12T00:36:22.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.023+0000 7f403f0989c0 2 removed watcher, disabling cache 2024-09-12T00:36:22.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.027+0000 7f403f0989c0 20 remove_watcher() i=1 2024-09-12T00:36:22.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.027+0000 7f403f0989c0 20 remove_watcher() i=2 2024-09-12T00:36:22.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.027+0000 7f403f0989c0 20 remove_watcher() i=3 2024-09-12T00:36:22.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.031+0000 7f403f0989c0 20 remove_watcher() i=4 2024-09-12T00:36:22.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.031+0000 7f403f0989c0 20 remove_watcher() i=5 2024-09-12T00:36:22.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.035+0000 7f403f0989c0 20 remove_watcher() i=6 2024-09-12T00:36:22.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.039+0000 7f403f0989c0 20 remove_watcher() i=7 2024-09-12T00:36:22.051 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:22.052 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:36:22.052 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-block-writes id: e2043445-c131-4520-984d-b4d52f038a6b.4538.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:36:22.052 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:22.053 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.053 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.056 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.056 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.106 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.106 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.157 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T00:36:22.157 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:22.158 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.158 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.178 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.178 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.223 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.223 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.243 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.244 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.265 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.265 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.288 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.288 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.308 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.308 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.330 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.330 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.351 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.352 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.373 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.374 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.394 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.394 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.416 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.416 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.437 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.437 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.462 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.462 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.482 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.482 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.505 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.505 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.525 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.525 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.545 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.545 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.566 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.566 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.587 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.588 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.609 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.609 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.630 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:22.630 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:22.649 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:36:22.682 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:22.682 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:22.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.727+0000 7f1af80179c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.731+0000 7f1af80179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.731+0000 7f1af80179c0 20 realm 2024-09-12T00:36:22.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.731+0000 7f1af80179c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.731+0000 7f1af80179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.731+0000 7f1af80179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:22.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.731+0000 7f1af80179c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.731+0000 7f1af80179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.731+0000 7f1af80179c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.731+0000 7f1af80179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:22.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.731+0000 7f1af80179c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.731+0000 7f1af80179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:22.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.731+0000 7f1af80179c0 20 searching for the correct realm 2024-09-12T00:36:22.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.739+0000 7f1af631e640 0 -- 172.21.15.138:0/4086562230 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x56346a64b860 msgr2=0x7f1af0081730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:22.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.951+0000 7f1af531c640 0 -- 172.21.15.138:0/4086562230 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x56346a880ac0 msgr2=0x56346a882eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:22.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:22.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:22.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:22.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:22.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:22.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:22.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:22.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:22.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 20 zone default found 2024-09-12T00:36:22.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 4 Realm: () 2024-09-12T00:36:22.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:22.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:22.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:22.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 20 zonegroup default 2024-09-12T00:36:22.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.967+0000 7f1af80179c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.971+0000 7f1af80179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.971+0000 7f1af80179c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.971+0000 7f1af80179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.971+0000 7f1af80179c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:22.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.971+0000 7f1af80179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:22.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.971+0000 7f1af80179c0 20 started sync module instance, tier type = 2024-09-12T00:36:22.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.971+0000 7f1af80179c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:22.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.991+0000 7f1af80179c0 20 add_watcher() i=0 2024-09-12T00:36:22.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.991+0000 7f1af80179c0 20 add_watcher() i=1 2024-09-12T00:36:22.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.991+0000 7f1af80179c0 20 add_watcher() i=2 2024-09-12T00:36:22.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.991+0000 7f1af80179c0 20 add_watcher() i=3 2024-09-12T00:36:22.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.991+0000 7f1af80179c0 20 add_watcher() i=4 2024-09-12T00:36:22.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.991+0000 7f1af80179c0 20 add_watcher() i=5 2024-09-12T00:36:22.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.991+0000 7f1af80179c0 20 add_watcher() i=6 2024-09-12T00:36:22.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.995+0000 7f1af80179c0 20 add_watcher() i=7 2024-09-12T00:36:22.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.995+0000 7f1af80179c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:22.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.999+0000 7f19a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:22.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.999+0000 7f1af80179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:22.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.999+0000 7f1af80179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:22.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.999+0000 7f1af80179c0 5 note: GC not initialized 2024-09-12T00:36:22.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.999+0000 7f19a67fc640 20 reqs_thread_entry: start 2024-09-12T00:36:22.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.999+0000 7f1af80179c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:22.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.999+0000 7f1af80179c0 20 Filter name: none 2024-09-12T00:36:22.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.999+0000 7f1917fff640 20 reqs_thread_entry: start 2024-09-12T00:36:22.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.999+0000 7f1af80179c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.999+0000 7f1af80179c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:23.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.999+0000 7f1af80179c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.999+0000 7f1af80179c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:23.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.999+0000 7f1af80179c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:23.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:22.999+0000 7f1af80179c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.003+0000 7f1af80179c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:23.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.003+0000 7f1af80179c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.003+0000 7f1af80179c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:23.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.003+0000 7f1af80179c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:23.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.003+0000 7f19a77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:23.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.007+0000 7f1af80179c0 20 remove_watcher() i=0 2024-09-12T00:36:23.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.007+0000 7f1af80179c0 2 removed watcher, disabling cache 2024-09-12T00:36:23.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.011+0000 7f1af80179c0 20 remove_watcher() i=1 2024-09-12T00:36:23.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.011+0000 7f1af80179c0 20 remove_watcher() i=2 2024-09-12T00:36:23.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.015+0000 7f1af80179c0 20 remove_watcher() i=3 2024-09-12T00:36:23.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.015+0000 7f1af80179c0 20 remove_watcher() i=4 2024-09-12T00:36:23.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.019+0000 7f1af80179c0 20 remove_watcher() i=5 2024-09-12T00:36:23.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.023+0000 7f1af80179c0 20 remove_watcher() i=6 2024-09-12T00:36:23.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.027+0000 7f1af80179c0 20 remove_watcher() i=7 2024-09-12T00:36:23.038 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:23.039 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:36:23.039 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-commit-target-layout id: e2043445-c131-4520-984d-b4d52f038a6b.4538.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:36:23.039 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:23.039 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T00:36:23.071 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:23.071 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:23.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.115+0000 7f3c74a0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.115+0000 7f3c74a0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.115+0000 7f3c74a0b9c0 20 realm 2024-09-12T00:36:23.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.115+0000 7f3c74a0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.115+0000 7f3c74a0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.115+0000 7f3c74a0b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:23.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.115+0000 7f3c74a0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.119+0000 7f3c74a0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.119+0000 7f3c74a0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.119+0000 7f3c74a0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:23.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.119+0000 7f3c74a0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.119+0000 7f3c74a0b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:23.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.119+0000 7f3c74a0b9c0 20 searching for the correct realm 2024-09-12T00:36:23.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.123+0000 7f3c72d12640 0 -- 172.21.15.138:0/1411977748 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f3c6405ea50 msgr2=0x7f3c640819a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:23.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.339+0000 7f3c72d12640 0 -- 172.21.15.138:0/1411977748 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5593a71a8650 msgr2=0x5593a71aab10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:23.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.347+0000 7f3c74a0b9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:23.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.347+0000 7f3c74a0b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:23.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.347+0000 7f3c74a0b9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:23.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.347+0000 7f3c74a0b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:23.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.347+0000 7f3c74a0b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:23.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.347+0000 7f3c74a0b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:23.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.347+0000 7f3c74a0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.351+0000 7f3c74a0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.351+0000 7f3c74a0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.351+0000 7f3c74a0b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:23.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.351+0000 7f3c74a0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.351+0000 7f3c74a0b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:23.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.351+0000 7f3c74a0b9c0 20 zone default found 2024-09-12T00:36:23.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.351+0000 7f3c74a0b9c0 4 Realm: () 2024-09-12T00:36:23.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.351+0000 7f3c74a0b9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:23.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.351+0000 7f3c74a0b9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:23.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.351+0000 7f3c74a0b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:23.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.351+0000 7f3c74a0b9c0 20 zonegroup default 2024-09-12T00:36:23.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.351+0000 7f3c74a0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.351+0000 7f3c74a0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.351+0000 7f3c74a0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.351+0000 7f3c74a0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.351+0000 7f3c74a0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.355+0000 7f3c74a0b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.355+0000 7f3c74a0b9c0 20 started sync module instance, tier type = 2024-09-12T00:36:23.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.355+0000 7f3c74a0b9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:23.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.375+0000 7f3c74a0b9c0 20 add_watcher() i=0 2024-09-12T00:36:23.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.375+0000 7f3c74a0b9c0 20 add_watcher() i=1 2024-09-12T00:36:23.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.375+0000 7f3c74a0b9c0 20 add_watcher() i=2 2024-09-12T00:36:23.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.375+0000 7f3c74a0b9c0 20 add_watcher() i=3 2024-09-12T00:36:23.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.375+0000 7f3c74a0b9c0 20 add_watcher() i=4 2024-09-12T00:36:23.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.375+0000 7f3c74a0b9c0 20 add_watcher() i=5 2024-09-12T00:36:23.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.375+0000 7f3c74a0b9c0 20 add_watcher() i=6 2024-09-12T00:36:23.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.379+0000 7f3c74a0b9c0 20 add_watcher() i=7 2024-09-12T00:36:23.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.379+0000 7f3c74a0b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:23.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.383+0000 7f3b28fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:23.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.383+0000 7f3c74a0b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:23.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.383+0000 7f3c74a0b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:23.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.383+0000 7f3c74a0b9c0 5 note: GC not initialized 2024-09-12T00:36:23.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.387+0000 7f3aa37fe640 20 reqs_thread_entry: start 2024-09-12T00:36:23.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.387+0000 7f3c74a0b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:23.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.387+0000 7f3c74a0b9c0 20 Filter name: none 2024-09-12T00:36:23.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.387+0000 7f3aa17fa640 20 reqs_thread_entry: start 2024-09-12T00:36:23.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.387+0000 7f3c74a0b9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:36:23.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.387+0000 7f3c74a0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.387+0000 7f3c74a0b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:23.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.387+0000 7f3c74a0b9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:36:23.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.387+0000 7f3c74a0b9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:36:23.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.387+0000 7f3c74a0b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 : miss 2024-09-12T00:36:23.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.387+0000 7f3c74a0b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.387+0000 7f3c74a0b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:23.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.387+0000 7f3c74a0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 info.flags=0x17 2024-09-12T00:36:23.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.387+0000 7f3c74a0b9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 to cache LRU end 2024-09-12T00:36:23.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.387+0000 7f3c74a0b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:23.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.387+0000 7f3c74a0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:23.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.387+0000 7f3c74a0b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 2024-09-12T00:36:23.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.399+0000 7f3c74a0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 info.flags=0x17 2024-09-12T00:36:23.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.399+0000 7f3c74a0b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 to cache LRU end 2024-09-12T00:36:23.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.399+0000 7f3c74a0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:23.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.399+0000 7f3c74a0b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30, ofs0, ns] 2024-09-12T00:36:23.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.399+0000 7f3b557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333469 cookie 94092652104608 notifier 6806 bl.length()=931 2024-09-12T00:36:23.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.399+0000 7f3b557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 info.flags=0x17 2024-09-12T00:36:23.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.399+0000 7f3b557fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 to cache LRU end 2024-09-12T00:36:23.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.399+0000 7f3b557fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:23.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.399+0000 7f3c74a0b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): orig_sources= new_sources= 2024-09-12T00:36:23.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.399+0000 7f3c74a0b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): potential sources added=[] removed=[] 2024-09-12T00:36:23.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.399+0000 7f3c74a0b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): orig_dests= new_dests= 2024-09-12T00:36:23.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.399+0000 7f3c74a0b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): potential dests added=[] removed=[] 2024-09-12T00:36:23.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.0 2024-09-12T00:36:23.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.0 2024-09-12T00:36:23.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.1 2024-09-12T00:36:23.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.1 2024-09-12T00:36:23.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.2 2024-09-12T00:36:23.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.2 2024-09-12T00:36:23.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.3 2024-09-12T00:36:23.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.3 2024-09-12T00:36:23.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.4 2024-09-12T00:36:23.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.4 2024-09-12T00:36:23.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.5 2024-09-12T00:36:23.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.5 2024-09-12T00:36:23.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.6 2024-09-12T00:36:23.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.6 2024-09-12T00:36:23.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.7 2024-09-12T00:36:23.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.7 2024-09-12T00:36:23.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.8 2024-09-12T00:36:23.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.8 2024-09-12T00:36:23.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.9 2024-09-12T00:36:23.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.9 2024-09-12T00:36:23.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.10 2024-09-12T00:36:23.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.10 2024-09-12T00:36:23.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.11 2024-09-12T00:36:23.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1.11 2024-09-12T00:36:23.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.0 2024-09-12T00:36:23.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1 2024-09-12T00:36:23.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2 2024-09-12T00:36:23.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.411+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.3 2024-09-12T00:36:23.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.415+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.4 2024-09-12T00:36:23.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.415+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.5 2024-09-12T00:36:23.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.415+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.6 2024-09-12T00:36:23.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.419+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.7 2024-09-12T00:36:23.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.419+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.8 2024-09-12T00:36:23.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.419+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.9 2024-09-12T00:36:23.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.419+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.10 2024-09-12T00:36:23.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.427+0000 7f3c74a0b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:23.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.427+0000 7f3c74a0b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 2024-09-12T00:36:23.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.427+0000 7f3c74a0b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 info.flags=0x17 2024-09-12T00:36:23.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.427+0000 7f3c74a0b9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 to cache LRU end 2024-09-12T00:36:23.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.427+0000 7f3c74a0b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:23.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.427+0000 7f3c74a0b9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30, ofs0, ns] 2024-09-12T00:36:23.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.427+0000 7f3b557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333470 cookie 94092652104608 notifier 6806 bl.length()=931 2024-09-12T00:36:23.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.427+0000 7f3b557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 info.flags=0x17 2024-09-12T00:36:23.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.427+0000 7f3b557fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 to cache LRU end 2024-09-12T00:36:23.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.427+0000 7f3b557fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:23.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.431+0000 7f3c74a0b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): orig_sources= new_sources= 2024-09-12T00:36:23.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.431+0000 7f3c74a0b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): potential sources added=[] removed=[] 2024-09-12T00:36:23.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.431+0000 7f3c74a0b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): orig_dests= new_dests= 2024-09-12T00:36:23.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.431+0000 7f3c74a0b9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): potential dests added=[] removed=[] 2024-09-12T00:36:23.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.435+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.0 2024-09-12T00:36:23.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.435+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1 2024-09-12T00:36:23.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.435+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2 2024-09-12T00:36:23.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.439+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.3 2024-09-12T00:36:23.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.439+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.4 2024-09-12T00:36:23.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.439+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.5 2024-09-12T00:36:23.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.439+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.6 2024-09-12T00:36:23.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.439+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.7 2024-09-12T00:36:23.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.443+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.8 2024-09-12T00:36:23.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.443+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.9 2024-09-12T00:36:23.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.443+0000 7f3c74a0b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.10 2024-09-12T00:36:23.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.443+0000 7f3c74a0b9c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T00:36:23.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.443+0000 7f3c74a0b9c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T00:36:23.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.451+0000 7f3b28fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:23.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.455+0000 7f3c74a0b9c0 20 remove_watcher() i=0 2024-09-12T00:36:23.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.455+0000 7f3c74a0b9c0 2 removed watcher, disabling cache 2024-09-12T00:36:23.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.459+0000 7f3c74a0b9c0 20 remove_watcher() i=1 2024-09-12T00:36:23.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.459+0000 7f3c74a0b9c0 20 remove_watcher() i=2 2024-09-12T00:36:23.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.463+0000 7f3c74a0b9c0 20 remove_watcher() i=3 2024-09-12T00:36:23.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.467+0000 7f3c74a0b9c0 20 remove_watcher() i=4 2024-09-12T00:36:23.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.467+0000 7f3c74a0b9c0 20 remove_watcher() i=5 2024-09-12T00:36:23.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.471+0000 7f3c74a0b9c0 20 remove_watcher() i=6 2024-09-12T00:36:23.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.471+0000 7f3c74a0b9c0 20 remove_watcher() i=7 2024-09-12T00:36:23.489 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:36:23.520 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:23.520 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:23.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.563+0000 7f60c8d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.563+0000 7f60c8d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.563+0000 7f60c8d0d9c0 20 realm 2024-09-12T00:36:23.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.563+0000 7f60c8d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.567+0000 7f60c8d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.567+0000 7f60c8d0d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:23.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.567+0000 7f60c8d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.567+0000 7f60c8d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.567+0000 7f60c8d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.567+0000 7f60c8d0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.567+0000 7f60c8d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.567+0000 7f60c8d0d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:23.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.567+0000 7f60c8d0d9c0 20 searching for the correct realm 2024-09-12T00:36:23.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.571+0000 7f60c7014640 0 -- 172.21.15.138:0/1903082037 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f60c0002c20 msgr2=0x7f60c005a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:23.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.787+0000 7f60c7014640 0 -- 172.21.15.138:0/1903082037 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x556c812a7710 msgr2=0x556c812a9bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:23.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.795+0000 7f60c8d0d9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:23.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.795+0000 7f60c8d0d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:23.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.795+0000 7f60c8d0d9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:23.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.795+0000 7f60c8d0d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:23.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.795+0000 7f60c8d0d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:23.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.795+0000 7f60c8d0d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:23.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.795+0000 7f60c8d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.795+0000 7f60c8d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.799+0000 7f60c8d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.799+0000 7f60c8d0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:23.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.799+0000 7f60c8d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.799+0000 7f60c8d0d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:23.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.799+0000 7f60c8d0d9c0 20 zone default found 2024-09-12T00:36:23.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.799+0000 7f60c8d0d9c0 4 Realm: () 2024-09-12T00:36:23.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.799+0000 7f60c8d0d9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:23.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.799+0000 7f60c8d0d9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:23.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.799+0000 7f60c8d0d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:23.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.799+0000 7f60c8d0d9c0 20 zonegroup default 2024-09-12T00:36:23.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.799+0000 7f60c8d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.799+0000 7f60c8d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.799+0000 7f60c8d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.799+0000 7f60c8d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.799+0000 7f60c8d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.803+0000 7f60c8d0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:23.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.803+0000 7f60c8d0d9c0 20 started sync module instance, tier type = 2024-09-12T00:36:23.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.803+0000 7f60c8d0d9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:23.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.823+0000 7f60c8d0d9c0 20 add_watcher() i=0 2024-09-12T00:36:23.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.823+0000 7f60c8d0d9c0 20 add_watcher() i=1 2024-09-12T00:36:23.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.823+0000 7f60c8d0d9c0 20 add_watcher() i=2 2024-09-12T00:36:23.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.823+0000 7f60c8d0d9c0 20 add_watcher() i=3 2024-09-12T00:36:23.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.823+0000 7f60c8d0d9c0 20 add_watcher() i=4 2024-09-12T00:36:23.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.823+0000 7f60c8d0d9c0 20 add_watcher() i=5 2024-09-12T00:36:23.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.823+0000 7f60c8d0d9c0 20 add_watcher() i=6 2024-09-12T00:36:23.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.827+0000 7f60c8d0d9c0 20 add_watcher() i=7 2024-09-12T00:36:23.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.827+0000 7f60c8d0d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:23.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.831+0000 7f5f7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:23.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.831+0000 7f60c8d0d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:23.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.831+0000 7f60c8d0d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:23.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.831+0000 7f60c8d0d9c0 5 note: GC not initialized 2024-09-12T00:36:23.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.831+0000 7f5ef7fff640 20 reqs_thread_entry: start 2024-09-12T00:36:23.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.831+0000 7f60c8d0d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:23.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.831+0000 7f60c8d0d9c0 20 Filter name: none 2024-09-12T00:36:23.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.831+0000 7f5ef5ffb640 20 reqs_thread_entry: start 2024-09-12T00:36:23.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.831+0000 7f60c8d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.835+0000 7f60c8d0d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:23.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.835+0000 7f60c8d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.835+0000 7f60c8d0d9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:36:23.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.835+0000 7f60c8d0d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:23.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.835+0000 7f60c8d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.835+0000 7f60c8d0d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:23.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.835+0000 7f60c8d0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:23.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.835+0000 7f60c8d0d9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:36:23.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.835+0000 7f60c8d0d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:23.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.839+0000 7f5f7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:23.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.843+0000 7f60c8d0d9c0 20 remove_watcher() i=0 2024-09-12T00:36:23.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.843+0000 7f60c8d0d9c0 2 removed watcher, disabling cache 2024-09-12T00:36:23.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.847+0000 7f60c8d0d9c0 20 remove_watcher() i=1 2024-09-12T00:36:23.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.847+0000 7f60c8d0d9c0 20 remove_watcher() i=2 2024-09-12T00:36:23.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.851+0000 7f60c8d0d9c0 20 remove_watcher() i=3 2024-09-12T00:36:23.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.851+0000 7f60c8d0d9c0 20 remove_watcher() i=4 2024-09-12T00:36:23.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.855+0000 7f60c8d0d9c0 20 remove_watcher() i=5 2024-09-12T00:36:23.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.859+0000 7f60c8d0d9c0 20 remove_watcher() i=6 2024-09-12T00:36:23.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:23.859+0000 7f60c8d0d9c0 20 remove_watcher() i=7 2024-09-12T00:36:23.875 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:23.876 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:36:23.876 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-commit-target-layout id: e2043445-c131-4520-984d-b4d52f038a6b.4538.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:36:23.876 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:23.876 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:23.877 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:23.888 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:23.888 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:23.938 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:36:23.973 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:23.973 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:24.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.015+0000 7f9d8a9fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.019+0000 7f9d8a9fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.019+0000 7f9d8a9fb9c0 20 realm 2024-09-12T00:36:24.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.019+0000 7f9d8a9fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.019+0000 7f9d8a9fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.019+0000 7f9d8a9fb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:24.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.019+0000 7f9d8a9fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.019+0000 7f9d8a9fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.019+0000 7f9d8a9fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.023+0000 7f9d8a9fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:24.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.023+0000 7f9d8a9fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.023+0000 7f9d8a9fb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:24.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.023+0000 7f9d8a9fb9c0 20 searching for the correct realm 2024-09-12T00:36:24.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.027+0000 7f9d88d02640 0 -- 172.21.15.138:0/38105123 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f9d800be400 msgr2=0x7f9d800be880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:24.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.243+0000 7f9d88d02640 0 -- 172.21.15.138:0/38105123 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55f4f2032e00 msgr2=0x55f4f20352c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:24.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.251+0000 7f9d8a9fb9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:24.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.251+0000 7f9d8a9fb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:24.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.251+0000 7f9d8a9fb9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:24.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.251+0000 7f9d8a9fb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:24.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.251+0000 7f9d8a9fb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:24.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.251+0000 7f9d8a9fb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:24.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.251+0000 7f9d8a9fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.251+0000 7f9d8a9fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.251+0000 7f9d8a9fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.255+0000 7f9d8a9fb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:24.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.255+0000 7f9d8a9fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.254 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.255+0000 7f9d8a9fb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:24.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.255+0000 7f9d8a9fb9c0 20 zone default found 2024-09-12T00:36:24.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.255+0000 7f9d8a9fb9c0 4 Realm: () 2024-09-12T00:36:24.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.255+0000 7f9d8a9fb9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:24.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.255+0000 7f9d8a9fb9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:24.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.255+0000 7f9d8a9fb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:24.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.255+0000 7f9d8a9fb9c0 20 zonegroup default 2024-09-12T00:36:24.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.255+0000 7f9d8a9fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.255+0000 7f9d8a9fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.255+0000 7f9d8a9fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.255+0000 7f9d8a9fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.255+0000 7f9d8a9fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.259+0000 7f9d8a9fb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.259+0000 7f9d8a9fb9c0 20 started sync module instance, tier type = 2024-09-12T00:36:24.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.259+0000 7f9d8a9fb9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:24.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.279+0000 7f9d8a9fb9c0 20 add_watcher() i=0 2024-09-12T00:36:24.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.279+0000 7f9d8a9fb9c0 20 add_watcher() i=1 2024-09-12T00:36:24.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.279+0000 7f9d8a9fb9c0 20 add_watcher() i=2 2024-09-12T00:36:24.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.279+0000 7f9d8a9fb9c0 20 add_watcher() i=3 2024-09-12T00:36:24.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.279+0000 7f9d8a9fb9c0 20 add_watcher() i=4 2024-09-12T00:36:24.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.279+0000 7f9d8a9fb9c0 20 add_watcher() i=5 2024-09-12T00:36:24.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.279+0000 7f9d8a9fb9c0 20 add_watcher() i=6 2024-09-12T00:36:24.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.283+0000 7f9d8a9fb9c0 20 add_watcher() i=7 2024-09-12T00:36:24.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.283+0000 7f9d8a9fb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:24.286 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.287+0000 7f9c3efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:24.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.287+0000 7f9d8a9fb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:24.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.287+0000 7f9d8a9fb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:24.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.287+0000 7f9d8a9fb9c0 5 note: GC not initialized 2024-09-12T00:36:24.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.287+0000 7f9c3dfdb640 20 reqs_thread_entry: start 2024-09-12T00:36:24.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.287+0000 7f9d8a9fb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:24.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.287+0000 7f9d8a9fb9c0 20 Filter name: none 2024-09-12T00:36:24.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.291+0000 7f9baf7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:24.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.291+0000 7f9d8a9fb9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:36:24.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.291+0000 7f9d8a9fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.291+0000 7f9d8a9fb9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:24.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.291+0000 7f9d8a9fb9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:36:24.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.291+0000 7f9d8a9fb9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:36:24.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.291+0000 7f9d8a9fb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 : miss 2024-09-12T00:36:24.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.291+0000 7f9d8a9fb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.291+0000 7f9d8a9fb9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:36:24.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.291+0000 7f9d8a9fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 info.flags=0x17 2024-09-12T00:36:24.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.291+0000 7f9d8a9fb9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 to cache LRU end 2024-09-12T00:36:24.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.291+0000 7f9d8a9fb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:24.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.291+0000 7f9d8a9fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:24.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.291+0000 7f9d8a9fb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 2024-09-12T00:36:24.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.291+0000 7f9d8a9fb9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:36:24.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.307+0000 7f9d8a9fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 info.flags=0x17 2024-09-12T00:36:24.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.307+0000 7f9d8a9fb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 to cache LRU end 2024-09-12T00:36:24.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.307+0000 7f9d8a9fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:24.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.307+0000 7f9d8a9fb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30, ofs0, ns] 2024-09-12T00:36:24.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.307+0000 7f9c5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333471 cookie 94510520691568 notifier 6842 bl.length()=931 2024-09-12T00:36:24.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.307+0000 7f9c5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 info.flags=0x17 2024-09-12T00:36:24.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.307+0000 7f9c5f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 to cache LRU end 2024-09-12T00:36:24.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.307+0000 7f9c5f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:24.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.307+0000 7f9d8a9fb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): orig_sources= new_sources= 2024-09-12T00:36:24.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.307+0000 7f9d8a9fb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): potential sources added=[] removed=[] 2024-09-12T00:36:24.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.307+0000 7f9d8a9fb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): orig_dests= new_dests= 2024-09-12T00:36:24.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.307+0000 7f9d8a9fb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): potential dests added=[] removed=[] 2024-09-12T00:36:24.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.0 2024-09-12T00:36:24.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.0 2024-09-12T00:36:24.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.1 2024-09-12T00:36:24.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.1 2024-09-12T00:36:24.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.2 2024-09-12T00:36:24.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.2 2024-09-12T00:36:24.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.3 2024-09-12T00:36:24.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.3 2024-09-12T00:36:24.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.4 2024-09-12T00:36:24.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.4 2024-09-12T00:36:24.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.5 2024-09-12T00:36:24.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.5 2024-09-12T00:36:24.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.6 2024-09-12T00:36:24.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.6 2024-09-12T00:36:24.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.7 2024-09-12T00:36:24.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.7 2024-09-12T00:36:24.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.8 2024-09-12T00:36:24.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.8 2024-09-12T00:36:24.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.9 2024-09-12T00:36:24.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.9 2024-09-12T00:36:24.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.10 2024-09-12T00:36:24.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.10 2024-09-12T00:36:24.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.11 2024-09-12T00:36:24.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2.11 2024-09-12T00:36:24.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.0 2024-09-12T00:36:24.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1 2024-09-12T00:36:24.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2 2024-09-12T00:36:24.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.319+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.3 2024-09-12T00:36:24.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.323+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.4 2024-09-12T00:36:24.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.323+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.5 2024-09-12T00:36:24.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.323+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.6 2024-09-12T00:36:24.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.323+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.7 2024-09-12T00:36:24.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.327+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.8 2024-09-12T00:36:24.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.327+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.9 2024-09-12T00:36:24.327 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.327+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.10 2024-09-12T00:36:24.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.335+0000 7f9d8a9fb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:24.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.335+0000 7f9d8a9fb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 2024-09-12T00:36:24.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.335+0000 7f9d8a9fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 info.flags=0x17 2024-09-12T00:36:24.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.335+0000 7f9d8a9fb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 to cache LRU end 2024-09-12T00:36:24.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.335+0000 7f9d8a9fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:24.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.335+0000 7f9d8a9fb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30, ofs0, ns] 2024-09-12T00:36:24.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.335+0000 7f9c5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333472 cookie 94510520691568 notifier 6842 bl.length()=931 2024-09-12T00:36:24.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.335+0000 7f9c5effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 info.flags=0x17 2024-09-12T00:36:24.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.335+0000 7f9c5effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 to cache LRU end 2024-09-12T00:36:24.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.335+0000 7f9c5effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:24.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.335+0000 7f9d8a9fb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): orig_sources= new_sources= 2024-09-12T00:36:24.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.335+0000 7f9d8a9fb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): potential sources added=[] removed=[] 2024-09-12T00:36:24.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.335+0000 7f9d8a9fb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): orig_dests= new_dests= 2024-09-12T00:36:24.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.335+0000 7f9d8a9fb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): potential dests added=[] removed=[] 2024-09-12T00:36:24.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.339+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.0 2024-09-12T00:36:24.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.343+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.1 2024-09-12T00:36:24.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.343+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.2 2024-09-12T00:36:24.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.343+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.3 2024-09-12T00:36:24.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.343+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.4 2024-09-12T00:36:24.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.343+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.5 2024-09-12T00:36:24.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.343+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.6 2024-09-12T00:36:24.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.347+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.7 2024-09-12T00:36:24.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.347+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.8 2024-09-12T00:36:24.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.347+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.9 2024-09-12T00:36:24.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.347+0000 7f9d8a9fb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.30.10 2024-09-12T00:36:24.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.347+0000 7f9d8a9fb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:24.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.347+0000 7f9d8a9fb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 2024-09-12T00:36:24.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.351+0000 7f9d8a9fb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 info.flags=0x17 2024-09-12T00:36:24.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.351+0000 7f9d8a9fb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 to cache LRU end 2024-09-12T00:36:24.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.351+0000 7f9d8a9fb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:24.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.351+0000 7f9d8a9fb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30, ofs0, ns] 2024-09-12T00:36:24.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.351+0000 7f9c5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333473 cookie 94510520691568 notifier 6842 bl.length()=899 2024-09-12T00:36:24.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.351+0000 7f9c5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 info.flags=0x17 2024-09-12T00:36:24.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.351+0000 7f9c5f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.30 to cache LRU end 2024-09-12T00:36:24.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.351+0000 7f9c5f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:24.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.351+0000 7f9d8a9fb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): orig_sources= new_sources= 2024-09-12T00:36:24.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.351+0000 7f9d8a9fb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): potential sources added=[] removed=[] 2024-09-12T00:36:24.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.351+0000 7f9d8a9fb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): orig_dests= new_dests= 2024-09-12T00:36:24.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.351+0000 7f9d8a9fb9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.30]): potential dests added=[] removed=[] 2024-09-12T00:36:24.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.355+0000 7f9d8a9fb9c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:36:24.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.359+0000 7f9c3efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:24.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.363+0000 7f9d8a9fb9c0 20 remove_watcher() i=0 2024-09-12T00:36:24.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.363+0000 7f9d8a9fb9c0 2 removed watcher, disabling cache 2024-09-12T00:36:24.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.367+0000 7f9d8a9fb9c0 20 remove_watcher() i=1 2024-09-12T00:36:24.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.367+0000 7f9d8a9fb9c0 20 remove_watcher() i=2 2024-09-12T00:36:24.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.371+0000 7f9d8a9fb9c0 20 remove_watcher() i=3 2024-09-12T00:36:24.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.371+0000 7f9d8a9fb9c0 20 remove_watcher() i=4 2024-09-12T00:36:24.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.375+0000 7f9d8a9fb9c0 20 remove_watcher() i=5 2024-09-12T00:36:24.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.375+0000 7f9d8a9fb9c0 20 remove_watcher() i=6 2024-09-12T00:36:24.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.379+0000 7f9d8a9fb9c0 20 remove_watcher() i=7 2024-09-12T00:36:24.398 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:36:24.429 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:24.429 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:24.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.471+0000 7f1b908d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.475+0000 7f1b908d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.475+0000 7f1b908d99c0 20 realm 2024-09-12T00:36:24.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.475+0000 7f1b908d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.475+0000 7f1b908d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.475+0000 7f1b908d99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:24.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.475+0000 7f1b908d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.475+0000 7f1b908d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.475+0000 7f1b908d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.479+0000 7f1b908d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:24.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.479+0000 7f1b908d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.479+0000 7f1b908d99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:24.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.479+0000 7f1b908d99c0 20 searching for the correct realm 2024-09-12T00:36:24.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.483+0000 7f1b8ebe0640 0 -- 172.21.15.138:0/709196324 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f1b880ab070 msgr2=0x7f1b881011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:24.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.699+0000 7f1b8ebe0640 0 -- 172.21.15.138:0/709196324 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55b6292fc380 msgr2=0x55b6292fe820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:24.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.707+0000 7f1b908d99c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:24.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.707+0000 7f1b908d99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:24.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.707+0000 7f1b908d99c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:24.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.707+0000 7f1b908d99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:24.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.707+0000 7f1b908d99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:24.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.707+0000 7f1b908d99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:24.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.707+0000 7f1b908d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:24.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:24.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 20 zone default found 2024-09-12T00:36:24.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 4 Realm: () 2024-09-12T00:36:24.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:24.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:24.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:24.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 20 zonegroup default 2024-09-12T00:36:24.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:24.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 20 started sync module instance, tier type = 2024-09-12T00:36:24.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.711+0000 7f1b908d99c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:24.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.735+0000 7f1b908d99c0 20 add_watcher() i=0 2024-09-12T00:36:24.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.735+0000 7f1b908d99c0 20 add_watcher() i=1 2024-09-12T00:36:24.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.735+0000 7f1b908d99c0 20 add_watcher() i=2 2024-09-12T00:36:24.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.735+0000 7f1b908d99c0 20 add_watcher() i=3 2024-09-12T00:36:24.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.735+0000 7f1b908d99c0 20 add_watcher() i=4 2024-09-12T00:36:24.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.735+0000 7f1b908d99c0 20 add_watcher() i=5 2024-09-12T00:36:24.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.735+0000 7f1b908d99c0 20 add_watcher() i=6 2024-09-12T00:36:24.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.739+0000 7f1b908d99c0 20 add_watcher() i=7 2024-09-12T00:36:24.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.739+0000 7f1b908d99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:24.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.743+0000 7f1a44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:24.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.743+0000 7f1b908d99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:24.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.743+0000 7f1b908d99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:24.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.743+0000 7f1b908d99c0 5 note: GC not initialized 2024-09-12T00:36:24.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.743+0000 7f19bf7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:24.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.743+0000 7f1b908d99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:24.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.747+0000 7f1b908d99c0 20 Filter name: none 2024-09-12T00:36:24.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.747+0000 7f19bd7fa640 20 reqs_thread_entry: start 2024-09-12T00:36:24.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.747+0000 7f1b908d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.747+0000 7f1b908d99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:24.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.747+0000 7f1b908d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.747+0000 7f1b908d99c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:24.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.747+0000 7f1b908d99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:24.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.747+0000 7f1b908d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.747+0000 7f1b908d99c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:24.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.747+0000 7f1b908d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:24.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.747+0000 7f1b908d99c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:24.748 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.747+0000 7f1b908d99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:24.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.751+0000 7f1a44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:24.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.755+0000 7f1b908d99c0 20 remove_watcher() i=0 2024-09-12T00:36:24.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.755+0000 7f1b908d99c0 2 removed watcher, disabling cache 2024-09-12T00:36:24.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.759+0000 7f1b908d99c0 20 remove_watcher() i=1 2024-09-12T00:36:24.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.759+0000 7f1b908d99c0 20 remove_watcher() i=2 2024-09-12T00:36:24.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.763+0000 7f1b908d99c0 20 remove_watcher() i=3 2024-09-12T00:36:24.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.763+0000 7f1b908d99c0 20 remove_watcher() i=4 2024-09-12T00:36:24.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.767+0000 7f1b908d99c0 20 remove_watcher() i=5 2024-09-12T00:36:24.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.767+0000 7f1b908d99c0 20 remove_watcher() i=6 2024-09-12T00:36:24.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:24.771+0000 7f1b908d99c0 20 remove_watcher() i=7 2024-09-12T00:36:24.787 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:24.787 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:36:24.787 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-commit-target-layout id: e2043445-c131-4520-984d-b4d52f038a6b.4538.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:36:24.787 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:24.788 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.788 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:24.792 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.792 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:24.844 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.844 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:24.893 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T00:36:24.894 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:24.895 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.895 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:24.915 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.915 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:24.960 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.960 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:24.981 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:24.981 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.002 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.002 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.023 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.023 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.044 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.044 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.067 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.068 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.088 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.088 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.109 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.109 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.128 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.129 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.148 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.148 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.169 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.169 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.189 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.189 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.209 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.209 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.229 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.229 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.249 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.250 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.269 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.269 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.290 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.290 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.310 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.310 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.330 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.350 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:25.350 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:25.372 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:36:25.403 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:25.403 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:25.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.447+0000 7fde9917c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.451+0000 7fde9917c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.451+0000 7fde9917c9c0 20 realm 2024-09-12T00:36:25.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.451+0000 7fde9917c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.451+0000 7fde9917c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.451+0000 7fde9917c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:25.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.451+0000 7fde9917c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.451+0000 7fde9917c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.451+0000 7fde9917c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.451+0000 7fde9917c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:25.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.451+0000 7fde9917c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.451+0000 7fde9917c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:25.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.451+0000 7fde9917c9c0 20 searching for the correct realm 2024-09-12T00:36:25.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.459+0000 7fde97483640 0 -- 172.21.15.138:0/3538625209 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fde90062c20 msgr2=0x7fde90083280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:25.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.675+0000 7fde97483640 0 -- 172.21.15.138:0/3538625209 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x560727b60170 msgr2=0x560727b62610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:25.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.683+0000 7fde9917c9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:25.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.683+0000 7fde9917c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:25.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.683+0000 7fde9917c9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:25.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.683+0000 7fde9917c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:25.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.683+0000 7fde9917c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:25.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.683+0000 7fde9917c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:25.684 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.683+0000 7fde9917c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.683+0000 7fde9917c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.683+0000 7fde9917c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.687+0000 7fde9917c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:25.685 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.687+0000 7fde9917c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.687+0000 7fde9917c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:25.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.687+0000 7fde9917c9c0 20 zone default found 2024-09-12T00:36:25.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.687+0000 7fde9917c9c0 4 Realm: () 2024-09-12T00:36:25.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.687+0000 7fde9917c9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:25.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.687+0000 7fde9917c9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:25.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.687+0000 7fde9917c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:25.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.687+0000 7fde9917c9c0 20 zonegroup default 2024-09-12T00:36:25.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.687+0000 7fde9917c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.687+0000 7fde9917c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.687+0000 7fde9917c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.687+0000 7fde9917c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.687+0000 7fde9917c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.687+0000 7fde9917c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.687+0000 7fde9917c9c0 20 started sync module instance, tier type = 2024-09-12T00:36:25.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.687+0000 7fde9917c9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:25.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.715+0000 7fde9917c9c0 20 add_watcher() i=0 2024-09-12T00:36:25.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.715+0000 7fde9917c9c0 20 add_watcher() i=1 2024-09-12T00:36:25.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.715+0000 7fde9917c9c0 20 add_watcher() i=2 2024-09-12T00:36:25.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.715+0000 7fde9917c9c0 20 add_watcher() i=3 2024-09-12T00:36:25.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.715+0000 7fde9917c9c0 20 add_watcher() i=4 2024-09-12T00:36:25.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.715+0000 7fde9917c9c0 20 add_watcher() i=5 2024-09-12T00:36:25.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.715+0000 7fde9917c9c0 20 add_watcher() i=6 2024-09-12T00:36:25.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.715+0000 7fde9917c9c0 20 add_watcher() i=7 2024-09-12T00:36:25.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.715+0000 7fde9917c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:25.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.719+0000 7fdd4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:25.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.723+0000 7fde9917c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:25.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.723+0000 7fde9917c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:25.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.723+0000 7fde9917c9c0 5 note: GC not initialized 2024-09-12T00:36:25.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.723+0000 7fdcc7fff640 20 reqs_thread_entry: start 2024-09-12T00:36:25.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.723+0000 7fde9917c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:25.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.723+0000 7fde9917c9c0 20 Filter name: none 2024-09-12T00:36:25.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.723+0000 7fdcc5ffb640 20 reqs_thread_entry: start 2024-09-12T00:36:25.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.723+0000 7fde9917c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.723+0000 7fde9917c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:25.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.723+0000 7fde9917c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.723+0000 7fde9917c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:25.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.723+0000 7fde9917c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:25.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.723+0000 7fde9917c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.727+0000 7fde9917c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:25.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.727+0000 7fde9917c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.727+0000 7fde9917c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:25.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.727+0000 7fde9917c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:25.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.731+0000 7fdd4d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:25.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.735+0000 7fde9917c9c0 20 remove_watcher() i=0 2024-09-12T00:36:25.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.735+0000 7fde9917c9c0 2 removed watcher, disabling cache 2024-09-12T00:36:25.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.735+0000 7fde9917c9c0 20 remove_watcher() i=1 2024-09-12T00:36:25.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.739+0000 7fde9917c9c0 20 remove_watcher() i=2 2024-09-12T00:36:25.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.739+0000 7fde9917c9c0 20 remove_watcher() i=3 2024-09-12T00:36:25.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.743+0000 7fde9917c9c0 20 remove_watcher() i=4 2024-09-12T00:36:25.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.747+0000 7fde9917c9c0 20 remove_watcher() i=5 2024-09-12T00:36:25.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.747+0000 7fde9917c9c0 20 remove_watcher() i=6 2024-09-12T00:36:25.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.751+0000 7fde9917c9c0 20 remove_watcher() i=7 2024-09-12T00:36:25.767 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:25.767 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:36:25.767 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-commit-target-layout id: e2043445-c131-4520-984d-b4d52f038a6b.4538.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:36:25.767 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:25.768 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T00:36:25.803 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:25.803 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:25.846 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.847+0000 7fca02e8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.847+0000 7fca02e8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.847+0000 7fca02e8e9c0 20 realm 2024-09-12T00:36:25.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.847+0000 7fca02e8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.847+0000 7fca02e8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.847+0000 7fca02e8e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:25.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.847+0000 7fca02e8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.851+0000 7fca02e8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:25.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.851+0000 7fca02e8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.851+0000 7fca02e8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:25.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.851+0000 7fca02e8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:25.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.851+0000 7fca02e8e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:25.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.851+0000 7fca02e8e9c0 20 searching for the correct realm 2024-09-12T00:36:25.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:25.855+0000 7fca01195640 0 -- 172.21.15.138:0/3462203384 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fc9f800e040 msgr2=0x7fc9f802e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:26.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.071+0000 7fca01195640 0 -- 172.21.15.138:0/3462203384 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55a05eb07750 msgr2=0x55a05eb09c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:26.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.079+0000 7fca02e8e9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:26.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.079+0000 7fca02e8e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:26.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.079+0000 7fca02e8e9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:26.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.079+0000 7fca02e8e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:26.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.079+0000 7fca02e8e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:26.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.079+0000 7fca02e8e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:26.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.079+0000 7fca02e8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.079+0000 7fca02e8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.079+0000 7fca02e8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.083+0000 7fca02e8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:26.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.083+0000 7fca02e8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.083+0000 7fca02e8e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:26.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.083+0000 7fca02e8e9c0 20 zone default found 2024-09-12T00:36:26.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.083+0000 7fca02e8e9c0 4 Realm: () 2024-09-12T00:36:26.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.083+0000 7fca02e8e9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:26.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.083+0000 7fca02e8e9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:26.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.083+0000 7fca02e8e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:26.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.083+0000 7fca02e8e9c0 20 zonegroup default 2024-09-12T00:36:26.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.083+0000 7fca02e8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.083+0000 7fca02e8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.083+0000 7fca02e8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.083+0000 7fca02e8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.083+0000 7fca02e8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.083+0000 7fca02e8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.087+0000 7fca02e8e9c0 20 started sync module instance, tier type = 2024-09-12T00:36:26.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.087+0000 7fca02e8e9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:26.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.107+0000 7fca02e8e9c0 20 add_watcher() i=0 2024-09-12T00:36:26.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.107+0000 7fca02e8e9c0 20 add_watcher() i=1 2024-09-12T00:36:26.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.107+0000 7fca02e8e9c0 20 add_watcher() i=2 2024-09-12T00:36:26.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.107+0000 7fca02e8e9c0 20 add_watcher() i=3 2024-09-12T00:36:26.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.107+0000 7fca02e8e9c0 20 add_watcher() i=4 2024-09-12T00:36:26.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.107+0000 7fca02e8e9c0 20 add_watcher() i=5 2024-09-12T00:36:26.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.107+0000 7fca02e8e9c0 20 add_watcher() i=6 2024-09-12T00:36:26.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.111+0000 7fca02e8e9c0 20 add_watcher() i=7 2024-09-12T00:36:26.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.111+0000 7fca02e8e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:26.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.115+0000 7fc8b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:26.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.115+0000 7fca02e8e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:26.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.115+0000 7fca02e8e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:26.116 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.115+0000 7fca02e8e9c0 5 note: GC not initialized 2024-09-12T00:36:26.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.119+0000 7fc8b67e4640 20 reqs_thread_entry: start 2024-09-12T00:36:26.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.119+0000 7fca02e8e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:26.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.119+0000 7fca02e8e9c0 20 Filter name: none 2024-09-12T00:36:26.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.119+0000 7fc8af7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:26.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.119+0000 7fca02e8e9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:36:26.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.119+0000 7fca02e8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.119+0000 7fca02e8e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:26.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.119+0000 7fca02e8e9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:36:26.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.119+0000 7fca02e8e9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:36:26.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.119+0000 7fca02e8e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 : miss 2024-09-12T00:36:26.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.119+0000 7fca02e8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.119+0000 7fca02e8e9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:26.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.119+0000 7fca02e8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 info.flags=0x17 2024-09-12T00:36:26.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.119+0000 7fca02e8e9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 to cache LRU end 2024-09-12T00:36:26.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.119+0000 7fca02e8e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:26.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.119+0000 7fca02e8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:26.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.119+0000 7fca02e8e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 2024-09-12T00:36:26.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.131+0000 7fca02e8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 info.flags=0x17 2024-09-12T00:36:26.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.131+0000 7fca02e8e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 to cache LRU end 2024-09-12T00:36:26.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.131+0000 7fca02e8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:26.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.131+0000 7fca02e8e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31, ofs0, ns] 2024-09-12T00:36:26.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.131+0000 7fc8d77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333476 cookie 94147271770928 notifier 7317 bl.length()=931 2024-09-12T00:36:26.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.131+0000 7fc8d77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 info.flags=0x17 2024-09-12T00:36:26.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.131+0000 7fc8d77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 to cache LRU end 2024-09-12T00:36:26.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.131+0000 7fc8d77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:26.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.131+0000 7fca02e8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.31]): orig_sources= new_sources= 2024-09-12T00:36:26.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.131+0000 7fca02e8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.31]): potential sources added=[] removed=[] 2024-09-12T00:36:26.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.131+0000 7fca02e8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.31]): orig_dests= new_dests= 2024-09-12T00:36:26.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.131+0000 7fca02e8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.31]): potential dests added=[] removed=[] 2024-09-12T00:36:26.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.0 2024-09-12T00:36:26.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.0 2024-09-12T00:36:26.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.1 2024-09-12T00:36:26.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.1 2024-09-12T00:36:26.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.2 2024-09-12T00:36:26.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.2 2024-09-12T00:36:26.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.3 2024-09-12T00:36:26.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.3 2024-09-12T00:36:26.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.4 2024-09-12T00:36:26.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.4 2024-09-12T00:36:26.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.5 2024-09-12T00:36:26.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.5 2024-09-12T00:36:26.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.6 2024-09-12T00:36:26.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.6 2024-09-12T00:36:26.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.7 2024-09-12T00:36:26.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.7 2024-09-12T00:36:26.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.8 2024-09-12T00:36:26.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.8 2024-09-12T00:36:26.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.9 2024-09-12T00:36:26.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.9 2024-09-12T00:36:26.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.10 2024-09-12T00:36:26.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.10 2024-09-12T00:36:26.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.11 2024-09-12T00:36:26.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1.11 2024-09-12T00:36:26.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.0 2024-09-12T00:36:26.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1 2024-09-12T00:36:26.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.2 2024-09-12T00:36:26.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.3 2024-09-12T00:36:26.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.4 2024-09-12T00:36:26.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.147+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.5 2024-09-12T00:36:26.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.151+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.6 2024-09-12T00:36:26.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.151+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.7 2024-09-12T00:36:26.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.151+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.8 2024-09-12T00:36:26.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.151+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.9 2024-09-12T00:36:26.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.155+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.10 2024-09-12T00:36:26.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.163+0000 7fca02e8e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:26.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.163+0000 7fca02e8e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 2024-09-12T00:36:26.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.163+0000 7fca02e8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 info.flags=0x17 2024-09-12T00:36:26.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.163+0000 7fca02e8e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 to cache LRU end 2024-09-12T00:36:26.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.163+0000 7fca02e8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:26.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.163+0000 7fca02e8e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31, ofs0, ns] 2024-09-12T00:36:26.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.163+0000 7fc8d77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333477 cookie 94147271770928 notifier 7317 bl.length()=931 2024-09-12T00:36:26.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.163+0000 7fc8d77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 info.flags=0x17 2024-09-12T00:36:26.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.163+0000 7fc8d77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 to cache LRU end 2024-09-12T00:36:26.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.163+0000 7fc8d77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:26.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.163+0000 7fca02e8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.31]): orig_sources= new_sources= 2024-09-12T00:36:26.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.163+0000 7fca02e8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.31]): potential sources added=[] removed=[] 2024-09-12T00:36:26.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.163+0000 7fca02e8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.31]): orig_dests= new_dests= 2024-09-12T00:36:26.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.163+0000 7fca02e8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.31]): potential dests added=[] removed=[] 2024-09-12T00:36:26.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.171+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.0 2024-09-12T00:36:26.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.171+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.1 2024-09-12T00:36:26.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.171+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.2 2024-09-12T00:36:26.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.171+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.3 2024-09-12T00:36:26.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.171+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.4 2024-09-12T00:36:26.171 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.171+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.5 2024-09-12T00:36:26.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.171+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.6 2024-09-12T00:36:26.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.175+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.7 2024-09-12T00:36:26.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.175+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.8 2024-09-12T00:36:26.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.175+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.9 2024-09-12T00:36:26.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.175+0000 7fca02e8e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.31.10 2024-09-12T00:36:26.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.175+0000 7fca02e8e9c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T00:36:26.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.175+0000 7fca02e8e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:26.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.175+0000 7fca02e8e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 2024-09-12T00:36:26.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.179+0000 7fca02e8e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 info.flags=0x17 2024-09-12T00:36:26.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.179+0000 7fca02e8e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 to cache LRU end 2024-09-12T00:36:26.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.179+0000 7fca02e8e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:26.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.179+0000 7fca02e8e9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31, ofs0, ns] 2024-09-12T00:36:26.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.179+0000 7fc8d77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333478 cookie 94147271770928 notifier 7317 bl.length()=899 2024-09-12T00:36:26.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.179+0000 7fc8d77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 info.flags=0x17 2024-09-12T00:36:26.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.179+0000 7fc8d77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.31 to cache LRU end 2024-09-12T00:36:26.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.179+0000 7fc8d77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:26.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.179+0000 7fca02e8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.31]): orig_sources= new_sources= 2024-09-12T00:36:26.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.179+0000 7fca02e8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.31]): potential sources added=[] removed=[] 2024-09-12T00:36:26.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.179+0000 7fca02e8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.31]): orig_dests= new_dests= 2024-09-12T00:36:26.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.179+0000 7fca02e8e9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.31]): potential dests added=[] removed=[] 2024-09-12T00:36:26.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.183+0000 7fca02e8e9c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:36:26.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.187+0000 7fc8b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:26.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.195+0000 7fca02e8e9c0 20 remove_watcher() i=0 2024-09-12T00:36:26.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.195+0000 7fca02e8e9c0 2 removed watcher, disabling cache 2024-09-12T00:36:26.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.195+0000 7fca02e8e9c0 20 remove_watcher() i=1 2024-09-12T00:36:26.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.199+0000 7fca02e8e9c0 20 remove_watcher() i=2 2024-09-12T00:36:26.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.199+0000 7fca02e8e9c0 20 remove_watcher() i=3 2024-09-12T00:36:26.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.203+0000 7fca02e8e9c0 20 remove_watcher() i=4 2024-09-12T00:36:26.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.203+0000 7fca02e8e9c0 20 remove_watcher() i=5 2024-09-12T00:36:26.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.207+0000 7fca02e8e9c0 20 remove_watcher() i=6 2024-09-12T00:36:26.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.207+0000 7fca02e8e9c0 20 remove_watcher() i=7 2024-09-12T00:36:26.223 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:36:26.250 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:26.251 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:26.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.295+0000 7f8a8bfa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.299+0000 7f8a8bfa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.299+0000 7f8a8bfa59c0 20 realm 2024-09-12T00:36:26.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.299+0000 7f8a8bfa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.299+0000 7f8a8bfa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.299+0000 7f8a8bfa59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:26.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.299+0000 7f8a8bfa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.299+0000 7f8a8bfa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.299+0000 7f8a8bfa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.299+0000 7f8a8bfa59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:26.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.299+0000 7f8a8bfa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.299+0000 7f8a8bfa59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:26.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.299+0000 7f8a8bfa59c0 20 searching for the correct realm 2024-09-12T00:36:26.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.307+0000 7f8a8a2ac640 0 -- 172.21.15.138:0/1155231808 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55e2a2e6d9b0 msgr2=0x55e2a2e6fe70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:26.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.311+0000 7f8a892aa640 0 -- 172.21.15.138:0/1155231808 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55e2a2e68c50 msgr2=0x55e2a2e6b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:26.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.319+0000 7f8a8bfa59c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:26.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.319+0000 7f8a8bfa59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:26.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.319+0000 7f8a8bfa59c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:26.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.319+0000 7f8a8bfa59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:26.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.319+0000 7f8a8bfa59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:26.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.319+0000 7f8a8bfa59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:26.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.319+0000 7f8a8bfa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.319+0000 7f8a8bfa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.319+0000 7f8a8bfa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.319+0000 7f8a8bfa59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:26.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.319+0000 7f8a8bfa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.323+0000 7f8a8bfa59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:26.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.323+0000 7f8a8bfa59c0 20 zone default found 2024-09-12T00:36:26.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.323+0000 7f8a8bfa59c0 4 Realm: () 2024-09-12T00:36:26.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.323+0000 7f8a8bfa59c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:26.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.323+0000 7f8a8bfa59c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:26.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.323+0000 7f8a8bfa59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:26.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.323+0000 7f8a8bfa59c0 20 zonegroup default 2024-09-12T00:36:26.321 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.323+0000 7f8a8bfa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.323+0000 7f8a8bfa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.323+0000 7f8a8bfa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.323+0000 7f8a8bfa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.323+0000 7f8a8bfa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.323+0000 7f8a8bfa59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:26.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.323+0000 7f8a8bfa59c0 20 started sync module instance, tier type = 2024-09-12T00:36:26.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.323+0000 7f8a8bfa59c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:26.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.339+0000 7f8a8bfa59c0 20 add_watcher() i=0 2024-09-12T00:36:26.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.339+0000 7f8a8bfa59c0 20 add_watcher() i=1 2024-09-12T00:36:26.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.339+0000 7f8a8bfa59c0 20 add_watcher() i=2 2024-09-12T00:36:26.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.339+0000 7f8a8bfa59c0 20 add_watcher() i=3 2024-09-12T00:36:26.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.339+0000 7f8a8bfa59c0 20 add_watcher() i=4 2024-09-12T00:36:26.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.339+0000 7f8a8bfa59c0 20 add_watcher() i=5 2024-09-12T00:36:26.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.339+0000 7f8a8bfa59c0 20 add_watcher() i=6 2024-09-12T00:36:26.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.343+0000 7f8a8bfa59c0 20 add_watcher() i=7 2024-09-12T00:36:26.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.343+0000 7f8a8bfa59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:26.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.347+0000 7f893b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:26.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.347+0000 7f8a8bfa59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:26.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.347+0000 7f8a8bfa59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:26.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.347+0000 7f8a8bfa59c0 5 note: GC not initialized 2024-09-12T00:36:26.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.347+0000 7f893a7fc640 20 reqs_thread_entry: start 2024-09-12T00:36:26.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.347+0000 7f8a8bfa59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:26.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.347+0000 7f8a8bfa59c0 20 Filter name: none 2024-09-12T00:36:26.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.347+0000 7f88abfff640 20 reqs_thread_entry: start 2024-09-12T00:36:26.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.347+0000 7f8a8bfa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.347+0000 7f8a8bfa59c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:26.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.347+0000 7f8a8bfa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.347+0000 7f8a8bfa59c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:26.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.351+0000 7f8a8bfa59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:26.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.351+0000 7f8a8bfa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.351+0000 7f8a8bfa59c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:26.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.351+0000 7f8a8bfa59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:26.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.351+0000 7f8a8bfa59c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:26.350 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.351+0000 7f8a8bfa59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:26.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.351+0000 7f893b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:26.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.359+0000 7f8a8bfa59c0 20 remove_watcher() i=0 2024-09-12T00:36:26.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.359+0000 7f8a8bfa59c0 2 removed watcher, disabling cache 2024-09-12T00:36:26.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.359+0000 7f8a8bfa59c0 20 remove_watcher() i=1 2024-09-12T00:36:26.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.363+0000 7f8a8bfa59c0 20 remove_watcher() i=2 2024-09-12T00:36:26.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.363+0000 7f8a8bfa59c0 20 remove_watcher() i=3 2024-09-12T00:36:26.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.367+0000 7f8a8bfa59c0 20 remove_watcher() i=4 2024-09-12T00:36:26.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.367+0000 7f8a8bfa59c0 20 remove_watcher() i=5 2024-09-12T00:36:26.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.371+0000 7f8a8bfa59c0 20 remove_watcher() i=6 2024-09-12T00:36:26.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:26.371+0000 7f8a8bfa59c0 20 remove_watcher() i=7 2024-09-12T00:36:26.386 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:26.386 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:36:26.386 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-commit-target-layout id: e2043445-c131-4520-984d-b4d52f038a6b.4538.31 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:36:26.386 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:26.388 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.389 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.393 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.393 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.446 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.446 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.495 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T00:36:26.495 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:26.498 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.499 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.519 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.520 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.567 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.567 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.587 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.587 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.608 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.609 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.630 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.630 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.651 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.652 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.673 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.673 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.694 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.694 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.714 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.714 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.736 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.736 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.757 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.757 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.778 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.778 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.799 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.799 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.820 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.821 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.844 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.844 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.865 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.865 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.886 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.886 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.906 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.906 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.930 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.930 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.951 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.951 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.973 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:26.973 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:26.991 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:36:27.022 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:27.023 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:27.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.067+0000 7f13bd5c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.071+0000 7f13bd5c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.071+0000 7f13bd5c29c0 20 realm 2024-09-12T00:36:27.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.071+0000 7f13bd5c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.071+0000 7f13bd5c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.071+0000 7f13bd5c29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:27.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.071+0000 7f13bd5c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.071+0000 7f13bd5c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.071+0000 7f13bd5c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.071+0000 7f13bd5c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:27.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.071+0000 7f13bd5c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.075+0000 7f13bd5c29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:27.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.075+0000 7f13bd5c29c0 20 searching for the correct realm 2024-09-12T00:36:27.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.079+0000 7f13bb8c9640 0 -- 172.21.15.138:0/3770376680 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f13b40cf440 msgr2=0x7f13b40cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:27.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.291+0000 7f13bb8c9640 0 -- 172.21.15.138:0/3770376680 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x55e779473ab0 msgr2=0x55e779475ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:27.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:27.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:27.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:27.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:27.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:27.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:27.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:27.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:27.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 20 zone default found 2024-09-12T00:36:27.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 4 Realm: () 2024-09-12T00:36:27.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:27.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:27.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:27.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 20 zonegroup default 2024-09-12T00:36:27.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.307+0000 7f13bd5c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.311+0000 7f13bd5c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.311+0000 7f13bd5c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.311+0000 7f13bd5c29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.311+0000 7f13bd5c29c0 20 started sync module instance, tier type = 2024-09-12T00:36:27.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.311+0000 7f13bd5c29c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:27.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.331+0000 7f13bd5c29c0 20 add_watcher() i=0 2024-09-12T00:36:27.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.331+0000 7f13bd5c29c0 20 add_watcher() i=1 2024-09-12T00:36:27.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.331+0000 7f13bd5c29c0 20 add_watcher() i=2 2024-09-12T00:36:27.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.331+0000 7f13bd5c29c0 20 add_watcher() i=3 2024-09-12T00:36:27.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.331+0000 7f13bd5c29c0 20 add_watcher() i=4 2024-09-12T00:36:27.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.331+0000 7f13bd5c29c0 20 add_watcher() i=5 2024-09-12T00:36:27.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.335+0000 7f13bd5c29c0 20 add_watcher() i=6 2024-09-12T00:36:27.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.335+0000 7f13bd5c29c0 20 add_watcher() i=7 2024-09-12T00:36:27.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.335+0000 7f13bd5c29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:27.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.339+0000 7f1271fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:27.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.339+0000 7f13bd5c29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:27.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.339+0000 7f13bd5c29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:27.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.339+0000 7f13bd5c29c0 5 note: GC not initialized 2024-09-12T00:36:27.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.339+0000 7f1270fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:27.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.339+0000 7f13bd5c29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:27.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.339+0000 7f13bd5c29c0 20 Filter name: none 2024-09-12T00:36:27.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.343+0000 7f11ea7fc640 20 reqs_thread_entry: start 2024-09-12T00:36:27.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.343+0000 7f13bd5c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.343+0000 7f13bd5c29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:27.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.343+0000 7f13bd5c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.343+0000 7f13bd5c29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:27.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.343+0000 7f13bd5c29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:27.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.343+0000 7f13bd5c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.343+0000 7f13bd5c29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:27.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.343+0000 7f13bd5c29c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.347+0000 7f13bd5c29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:27.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.347+0000 7f13bd5c29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:27.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.351+0000 7f1271fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:27.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.355+0000 7f13bd5c29c0 20 remove_watcher() i=0 2024-09-12T00:36:27.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.355+0000 7f13bd5c29c0 2 removed watcher, disabling cache 2024-09-12T00:36:27.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.355+0000 7f13bd5c29c0 20 remove_watcher() i=1 2024-09-12T00:36:27.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.355+0000 7f13bd5c29c0 20 remove_watcher() i=2 2024-09-12T00:36:27.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.359+0000 7f13bd5c29c0 20 remove_watcher() i=3 2024-09-12T00:36:27.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.363+0000 7f13bd5c29c0 20 remove_watcher() i=4 2024-09-12T00:36:27.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.363+0000 7f13bd5c29c0 20 remove_watcher() i=5 2024-09-12T00:36:27.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.367+0000 7f13bd5c29c0 20 remove_watcher() i=6 2024-09-12T00:36:27.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.367+0000 7f13bd5c29c0 20 remove_watcher() i=7 2024-09-12T00:36:27.382 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.382 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:36:27.382 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-commit-target-layout id: e2043445-c131-4520-984d-b4d52f038a6b.4538.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:36:27.382 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.383 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T00:36:27.419 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:27.420 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:27.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.463+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.463+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.463+0000 7fbbea1429c0 20 realm 2024-09-12T00:36:27.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.463+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.467+0000 7fbbea1429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:27.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:27.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:27.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 searching for the correct realm 2024-09-12T00:36:27.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.471+0000 7fbbe8449640 0 -- 172.21.15.138:0/2079816834 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fbbe007eb70 msgr2=0x7fbbe0082190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:27.686 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.687+0000 7fbbe8449640 0 -- 172.21.15.138:0/2079816834 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55a8e7fc2030 msgr2=0x55a8e7fc44f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:27.694 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:27.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:27.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:27.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:27.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:27.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:27.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.695 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:27.696 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:27.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 zone default found 2024-09-12T00:36:27.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.699+0000 7fbbea1429c0 4 Realm: () 2024-09-12T00:36:27.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.699+0000 7fbbea1429c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:27.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.699+0000 7fbbea1429c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:27.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.699+0000 7fbbea1429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:27.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 zonegroup default 2024-09-12T00:36:27.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 started sync module instance, tier type = 2024-09-12T00:36:27.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:27.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=0 2024-09-12T00:36:27.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=1 2024-09-12T00:36:27.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=2 2024-09-12T00:36:27.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=3 2024-09-12T00:36:27.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=4 2024-09-12T00:36:27.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=5 2024-09-12T00:36:27.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.723+0000 7fbbea1429c0 20 add_watcher() i=6 2024-09-12T00:36:27.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.723+0000 7fbbea1429c0 20 add_watcher() i=7 2024-09-12T00:36:27.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.723+0000 7fbbea1429c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:27.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.727+0000 7fba9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:27.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.727+0000 7fbbea1429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:27.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.727+0000 7fbbea1429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:27.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fbbea1429c0 5 note: GC not initialized 2024-09-12T00:36:27.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fba9cfe1640 20 reqs_thread_entry: start 2024-09-12T00:36:27.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:27.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 Filter name: none 2024-09-12T00:36:27.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fba167fc640 20 reqs_thread_entry: start 2024-09-12T00:36:27.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:36:27.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:27.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:36:27.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:36:27.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 : miss 2024-09-12T00:36:27.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:27.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:27.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:27.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:27.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:27.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 2024-09-12T00:36:27.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.743+0000 7fbbea1429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:27.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.743+0000 7fbbea1429c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:27.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.743+0000 7fbbea1429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:27.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.743+0000 7fbbea1429c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32, ofs0, ns] 2024-09-12T00:36:27.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.747+0000 7fbac67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333538 cookie 94183934939056 notifier 6941 bl.length()=931 2024-09-12T00:36:27.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.747+0000 7fbac67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:27.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.747+0000 7fbac67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:27.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.747+0000 7fbac67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:27.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.747+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_sources= new_sources= 2024-09-12T00:36:27.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.747+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential sources added=[] removed=[] 2024-09-12T00:36:27.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.747+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_dests= new_dests= 2024-09-12T00:36:27.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.747+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential dests added=[] removed=[] 2024-09-12T00:36:27.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.0 2024-09-12T00:36:27.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.0 2024-09-12T00:36:27.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.1 2024-09-12T00:36:27.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.1 2024-09-12T00:36:27.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.2 2024-09-12T00:36:27.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.2 2024-09-12T00:36:27.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.3 2024-09-12T00:36:27.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.3 2024-09-12T00:36:27.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.4 2024-09-12T00:36:27.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.4 2024-09-12T00:36:27.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.5 2024-09-12T00:36:27.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.5 2024-09-12T00:36:27.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.6 2024-09-12T00:36:27.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.6 2024-09-12T00:36:27.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.7 2024-09-12T00:36:27.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.7 2024-09-12T00:36:27.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.8 2024-09-12T00:36:27.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.8 2024-09-12T00:36:27.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.9 2024-09-12T00:36:27.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.9 2024-09-12T00:36:27.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.10 2024-09-12T00:36:27.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.10 2024-09-12T00:36:27.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.11 2024-09-12T00:36:27.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.11 2024-09-12T00:36:27.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.0 2024-09-12T00:36:27.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1 2024-09-12T00:36:27.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.2 2024-09-12T00:36:27.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.3 2024-09-12T00:36:27.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.763+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.4 2024-09-12T00:36:27.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.763+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.5 2024-09-12T00:36:27.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.763+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.6 2024-09-12T00:36:27.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.767+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.7 2024-09-12T00:36:27.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.767+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.8 2024-09-12T00:36:27.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.767+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.9 2024-09-12T00:36:27.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.771+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.10 2024-09-12T00:36:27.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.779+0000 7fbbea1429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:27.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.779+0000 7fbbea1429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 2024-09-12T00:36:27.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.783+0000 7fbbea1429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:27.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.783+0000 7fbbea1429c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:27.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.783+0000 7fbbea1429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:27.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.783+0000 7fbbea1429c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32, ofs0, ns] 2024-09-12T00:36:27.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.783+0000 7fbac67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333539 cookie 94183934939056 notifier 6941 bl.length()=931 2024-09-12T00:36:27.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.783+0000 7fbac67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:27.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.783+0000 7fbac67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:27.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.783+0000 7fbac67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:27.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.783+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_sources= new_sources= 2024-09-12T00:36:27.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.783+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential sources added=[] removed=[] 2024-09-12T00:36:27.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.783+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_dests= new_dests= 2024-09-12T00:36:27.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.783+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential dests added=[] removed=[] 2024-09-12T00:36:27.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.787+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.0 2024-09-12T00:36:27.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.787+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1 2024-09-12T00:36:27.789 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.791+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.2 2024-09-12T00:36:27.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.791+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.3 2024-09-12T00:36:27.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.791+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.4 2024-09-12T00:36:27.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.791+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.5 2024-09-12T00:36:27.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.791+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.6 2024-09-12T00:36:27.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.795+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.7 2024-09-12T00:36:27.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.795+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.8 2024-09-12T00:36:27.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.795+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.9 2024-09-12T00:36:27.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.795+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.10 2024-09-12T00:36:27.796 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbbea1429c0 time 2024-09-12T00:36:27.802859+0000 2024-09-12T00:36:27.796 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:27.799 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:27.799 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fbbeda1c2eb] 2024-09-12T00:36:27.799 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fbbeda1c49f] 2024-09-12T00:36:27.799 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8e5334cc1] 2024-09-12T00:36:27.799 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55a8e5349fc7] 2024-09-12T00:36:27.799 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-12T00:36:27.799 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fbbec882d90] 2024-09-12T00:36:27.799 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-12T00:36:27.799 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-12T00:36:27.800 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:36:27.800 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fbbea1429c0 thread_name:radosgw-admin 2024-09-12T00:36:27.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.799+0000 7fbbea1429c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbbea1429c0 time 2024-09-12T00:36:27.802859+0000 2024-09-12T00:36:27.800 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:27.800 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.800 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:27.800 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fbbeda1c2eb] 2024-09-12T00:36:27.800 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fbbeda1c49f] 2024-09-12T00:36:27.800 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8e5334cc1] 2024-09-12T00:36:27.800 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55a8e5349fc7] 2024-09-12T00:36:27.800 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-12T00:36:27.800 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fbbec882d90] 2024-09-12T00:36:27.801 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-12T00:36:27.801 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-12T00:36:27.801 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.802 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:27.802 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fbbec89b520] 2024-09-12T00:36:27.802 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:36:27.802 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:36:27.802 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:36:27.802 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fbbeda1c345] 2024-09-12T00:36:27.803 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fbbeda1c49f] 2024-09-12T00:36:27.803 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8e5334cc1] 2024-09-12T00:36:27.803 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55a8e5349fc7] 2024-09-12T00:36:27.803 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-12T00:36:27.803 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fbbec882d90] 2024-09-12T00:36:27.803 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-12T00:36:27.803 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-12T00:36:27.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.803+0000 7fbbea1429c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:27.803 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fbbea1429c0 thread_name:radosgw-admin 2024-09-12T00:36:27.803 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.803 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:27.803 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fbbec89b520] 2024-09-12T00:36:27.803 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:36:27.803 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:36:27.804 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:36:27.804 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fbbeda1c345] 2024-09-12T00:36:27.804 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fbbeda1c49f] 2024-09-12T00:36:27.804 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8e5334cc1] 2024-09-12T00:36:27.804 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55a8e5349fc7] 2024-09-12T00:36:27.804 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-12T00:36:27.804 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fbbec882d90] 2024-09-12T00:36:27.804 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-12T00:36:27.804 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-12T00:36:27.804 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:27.804 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.804 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:36:27.830 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command rotate-key hook 0x55a8e7ecbc38 2024-09-12T00:36:27.830 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:27.830 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:36:27.830 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-b con 0x55a8e7d58de0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:36:27.830 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-a con 0x55a8e7d83730 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:36:27.830 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-c con 0x55a8e7ecea20 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:36:27.830 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.831 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.831 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.831 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:27.831 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient(hunting): authenticate will time out at 2240.791191s 2024-09-12T00:36:27.831 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:36:27.443+0000 7fbbe7447640 10 monclient(hunting): get_auth_request con 0x55a8e7d83730 auth_method 0 2024-09-12T00:36:27.831 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:36:27.443+0000 7fbbe7447640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.831 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:36:27.443+0000 7fbbe7447640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.831 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:36:27.443+0000 7fbbe7447640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.831 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient(hunting): get_auth_request con 0x55a8e7ecea20 auth_method 0 2024-09-12T00:36:27.831 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.831 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.831 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.831 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:27.832 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:27.832 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:27.832 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:36:27.443+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:27.832 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:36:27.443+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:27.832 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:36:27.443+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:27.832 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:36:27.443+0000 7fbbe7c48640 10 monclient(hunting): get_auth_request con 0x55a8e7d58de0 auth_method 0 2024-09-12T00:36:27.832 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:36:27.443+0000 7fbbe7c48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.832 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:36:27.443+0000 7fbbe7c48640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.832 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:36:27.443+0000 7fbbe7c48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.832 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient(hunting): handle_auth_done global_id 6932 payload 824 2024-09-12T00:36:27.832 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient: _finish_hunting 0 2024-09-12T00:36:27.833 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:36:27.443+0000 7fbbe8449640 1 monclient: found mon.noname-c 2024-09-12T00:36:27.833 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:36:27.833 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:36:27.443+0000 7fbacffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:27.835 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:36:27.443+0000 7fbacffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:27.836 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:36:27.443+0000 7fbacffff640 10 monclient: dump: 2024-09-12T00:36:27.836 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:36:27.836 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:36:27.836 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.836 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.836 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:27.836 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.836 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:36:27.836 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:36:27.836 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:36:27.836 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.836 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:36:27.443+0000 7fbacffff640 10 monclient: _finish_auth 0 2024-09-12T00:36:27.836 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:36:27.443+0000 7fbacffff640 10 monclient: _check_auth_tickets 2024-09-12T00:36:27.837 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:36:27.443+0000 7fbacffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:27.837 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:36:27.443+0000 7fbacffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:27.837 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:36:27.447+0000 7fbacffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:27.837 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:36:27.447+0000 7fbacffff640 10 monclient: dump: 2024-09-12T00:36:27.837 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:36:27.837 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:36:27.837 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.837 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.837 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:27.837 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.837 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:36:27.837 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:36:27.838 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:36:27.838 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.838 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:36:27.447+0000 7fbad5e0b640 4 set_mon_vals no callback set 2024-09-12T00:36:27.838 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:36:27.447+0000 7fbbea1429c0 5 monclient: authenticate success, global_id 6932 2024-09-12T00:36:27.838 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:36:27.447+0000 7fbbea1429c0 10 monclient: _renew_subs 2024-09-12T00:36:27.838 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:36:27.447+0000 7fbbea1429c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:36:27.838 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:36:27.447+0000 7fbbea1429c0 10 monclient: _renew_subs 2024-09-12T00:36:27.838 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:36:27.447+0000 7fbbea1429c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:36:27.838 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:36:27.447+0000 7fbbea1429c0 1 librados: init done 2024-09-12T00:36:27.838 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:36:27.447+0000 7fbacffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:27.838 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:36:27.447+0000 7fbacffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:36:27.838 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:36:27.447+0000 7fbacffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:36:27.838 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:36:27.447+0000 7fbbe7c48640 10 monclient: get_auth_request con 0x7fbad0070ae0 auth_method 0 2024-09-12T00:36:27.839 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:36:27.447+0000 7fbbe7447640 10 monclient: get_auth_request con 0x55a8e7ef3da0 auth_method 0 2024-09-12T00:36:27.839 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:36:27.451+0000 7fbbe7c48640 10 monclient: get_auth_request con 0x55a8e7f16930 auth_method 0 2024-09-12T00:36:27.839 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:36:27.451+0000 7fbbe7447640 10 monclient: get_auth_request con 0x55a8e7f1ada0 auth_method 0 2024-09-12T00:36:27.839 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 10 monclient: build_initial_monmap 2024-09-12T00:36:27.839 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:27.839 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 10 monclient: monmap: 2024-09-12T00:36:27.839 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:36:27.839 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:27.839 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:36:27.839 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:36:27.839 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:27.839 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.839 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:36:27.840 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:36:27.840 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:36:27.840 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.840 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding auth protocol: cephx 2024-09-12T00:36:27.840 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding auth protocol: cephx 2024-09-12T00:36:27.840 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding auth protocol: cephx 2024-09-12T00:36:27.840 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: secure 2024-09-12T00:36:27.840 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: crc 2024-09-12T00:36:27.840 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: secure 2024-09-12T00:36:27.840 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: crc 2024-09-12T00:36:27.840 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: secure 2024-09-12T00:36:27.840 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: crc 2024-09-12T00:36:27.841 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: crc 2024-09-12T00:36:27.841 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: secure 2024-09-12T00:36:27.841 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: crc 2024-09-12T00:36:27.841 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: secure 2024-09-12T00:36:27.841 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: crc 2024-09-12T00:36:27.841 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: secure 2024-09-12T00:36:27.841 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.841 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a8e7f235b0 EEXIST 2024-09-12T00:36:27.841 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 10 monclient: init 2024-09-12T00:36:27.841 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding auth protocol: cephx 2024-09-12T00:36:27.841 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding auth protocol: cephx 2024-09-12T00:36:27.841 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding auth protocol: cephx 2024-09-12T00:36:27.842 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: secure 2024-09-12T00:36:27.842 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: crc 2024-09-12T00:36:27.842 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: secure 2024-09-12T00:36:27.842 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: crc 2024-09-12T00:36:27.842 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: secure 2024-09-12T00:36:27.842 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: crc 2024-09-12T00:36:27.842 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: crc 2024-09-12T00:36:27.842 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: secure 2024-09-12T00:36:27.842 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: crc 2024-09-12T00:36:27.842 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: secure 2024-09-12T00:36:27.842 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: crc 2024-09-12T00:36:27.842 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: secure 2024-09-12T00:36:27.842 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.843 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.843 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command rotate-key cmddesc rotate-key hook 0x55a8e7f1e480 EEXIST 2024-09-12T00:36:27.843 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:27.843 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:36:27.843 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-b con 0x55a8e7f47760 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:36:27.843 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-a con 0x55a8e7f47090 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:36:27.843 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-c con 0x55a8e7f45a70 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:36:27.843 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.843 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.843 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.843 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:27.843 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient(hunting): authenticate will time out at 2240.800208s 2024-09-12T00:36:27.844 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:36:27.455+0000 7fbbe8449640 10 monclient(hunting): get_auth_request con 0x55a8e7f45a70 auth_method 0 2024-09-12T00:36:27.844 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:36:27.455+0000 7fbbe8449640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.844 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:36:27.455+0000 7fbbe8449640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.844 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:36:27.455+0000 7fbbe8449640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.844 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient(hunting): get_auth_request con 0x55a8e7f47090 auth_method 0 2024-09-12T00:36:27.844 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.844 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.844 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.844 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:36:27.455+0000 7fbbe8449640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:27.844 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:36:27.455+0000 7fbbe8449640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:27.844 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:36:27.455+0000 7fbbe8449640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:27.844 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:27.844 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:36:27.455+0000 7fbbe7c48640 10 monclient(hunting): get_auth_request con 0x55a8e7f47760 auth_method 0 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:36:27.455+0000 7fbbe7c48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:36:27.455+0000 7fbbe7c48640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:36:27.455+0000 7fbbe7c48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient(hunting): handle_auth_done global_id 7368 payload 824 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient: _finish_hunting 0 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:36:27.455+0000 7fbbe7447640 1 monclient: found mon.noname-a 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:27.845 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: dump: 2024-09-12T00:36:27.846 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:36:27.846 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:36:27.846 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.846 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.846 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:27.846 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.846 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:36:27.846 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:36:27.846 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:36:27.846 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.846 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: _finish_auth 0 2024-09-12T00:36:27.846 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:36:27.846 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: dump: 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:36:27.847 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.848 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 monclient: authenticate success, global_id 7368 2024-09-12T00:36:27.848 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:36:27.455+0000 7fbbe8c4a640 4 set_mon_vals no callback set 2024-09-12T00:36:27.848 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: _renew_subs 2024-09-12T00:36:27.848 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:36:27.848 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: _renew_subs 2024-09-12T00:36:27.848 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:36:27.848 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:27.848 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:36:27.848 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:36:27.849 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: get_monmap_and_config 2024-09-12T00:36:27.849 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: build_initial_monmap 2024-09-12T00:36:27.849 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:27.849 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: monmap: 2024-09-12T00:36:27.849 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:36:27.849 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:27.849 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:36:27.849 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:36:27.849 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:27.850 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.850 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:36:27.850 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:36:27.850 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:36:27.850 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.850 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding auth protocol: cephx 2024-09-12T00:36:27.850 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding auth protocol: cephx 2024-09-12T00:36:27.850 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding auth protocol: cephx 2024-09-12T00:36:27.850 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: secure 2024-09-12T00:36:27.850 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: crc 2024-09-12T00:36:27.850 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: secure 2024-09-12T00:36:27.850 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: crc 2024-09-12T00:36:27.851 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: secure 2024-09-12T00:36:27.851 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: crc 2024-09-12T00:36:27.851 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: crc 2024-09-12T00:36:27.851 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: secure 2024-09-12T00:36:27.851 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: crc 2024-09-12T00:36:27.851 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: secure 2024-09-12T00:36:27.851 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: crc 2024-09-12T00:36:27.851 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: secure 2024-09-12T00:36:27.851 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:36:27.455+0000 7fbbe7c48640 10 monclient: get_auth_request con 0x7fbac0070a20 auth_method 0 2024-09-12T00:36:27.851 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.851 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: init 2024-09-12T00:36:27.851 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding auth protocol: cephx 2024-09-12T00:36:27.851 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding auth protocol: cephx 2024-09-12T00:36:27.852 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding auth protocol: cephx 2024-09-12T00:36:27.852 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: secure 2024-09-12T00:36:27.852 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: crc 2024-09-12T00:36:27.852 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: secure 2024-09-12T00:36:27.852 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: crc 2024-09-12T00:36:27.852 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: secure 2024-09-12T00:36:27.852 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: crc 2024-09-12T00:36:27.852 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: crc 2024-09-12T00:36:27.852 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: secure 2024-09-12T00:36:27.852 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: crc 2024-09-12T00:36:27.852 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: secure 2024-09-12T00:36:27.852 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: crc 2024-09-12T00:36:27.852 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: secure 2024-09-12T00:36:27.853 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.853 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.853 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command rotate-key cmddesc rotate-key hook 0x7ffff36ff418 EEXIST 2024-09-12T00:36:27.853 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:27.853 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:36:27.853 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-c con 0x55a8e7f9b3d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:36:27.853 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-b con 0x55a8e7f9b7b0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:36:27.853 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-a con 0x55a8e7f95b70 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:36:27.853 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.853 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.853 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.853 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:27.853 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): authenticate will time out at 2240.804489s 2024-09-12T00:36:27.854 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): get_auth_request con 0x55a8e7f9b3d0 auth_method 0 2024-09-12T00:36:27.854 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.854 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.854 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.854 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:36:27.459+0000 7fbbe8449640 10 monclient(hunting): get_auth_request con 0x55a8e7f95b70 auth_method 0 2024-09-12T00:36:27.854 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:36:27.459+0000 7fbbe8449640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.854 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:36:27.459+0000 7fbbe8449640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.854 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:36:27.459+0000 7fbbe8449640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.854 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:27.854 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:27.854 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:27.854 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): get_auth_request con 0x55a8e7f9b7b0 auth_method 0 2024-09-12T00:36:27.854 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.855 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.855 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.855 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): handle_auth_done global_id 6938 payload 274 2024-09-12T00:36:27.855 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient: _finish_hunting 0 2024-09-12T00:36:27.855 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 1 monclient: found mon.noname-c 2024-09-12T00:36:27.855 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:36:27.855 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:27.855 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:27.855 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: dump: 2024-09-12T00:36:27.855 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:36:27.855 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:36:27.855 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.856 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.856 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:27.856 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.856 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:36:27.856 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:36:27.856 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:36:27.856 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.856 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:36:27.856 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:36:27.856 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:27.856 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 monclient: authenticate success, global_id 6938 2024-09-12T00:36:27.856 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: get_monmap_and_config success 2024-09-12T00:36:27.856 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 4 set_mon_vals no callback set 2024-09-12T00:36:27.857 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:27.857 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:27.857 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: dump: 2024-09-12T00:36:27.857 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:36:27.857 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:36:27.857 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.857 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.857 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:27.857 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.857 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:36:27.857 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:36:27.857 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:36:27.857 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.858 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: shutdown 2024-09-12T00:36:27.858 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: build_initial_monmap 2024-09-12T00:36:27.858 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:27.858 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: monmap: 2024-09-12T00:36:27.858 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:36:27.858 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:27.858 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:36:27.858 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:36:27.858 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:27.858 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.858 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:36:27.858 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:36:27.858 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:36:27.859 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.859 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding auth protocol: cephx 2024-09-12T00:36:27.859 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding auth protocol: cephx 2024-09-12T00:36:27.859 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding auth protocol: cephx 2024-09-12T00:36:27.859 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: secure 2024-09-12T00:36:27.859 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: crc 2024-09-12T00:36:27.859 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: secure 2024-09-12T00:36:27.859 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: crc 2024-09-12T00:36:27.859 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: secure 2024-09-12T00:36:27.859 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: crc 2024-09-12T00:36:27.859 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: crc 2024-09-12T00:36:27.859 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: secure 2024-09-12T00:36:27.860 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: crc 2024-09-12T00:36:27.860 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: secure 2024-09-12T00:36:27.860 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: crc 2024-09-12T00:36:27.860 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: secure 2024-09-12T00:36:27.860 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.860 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 1 librados: starting msgr at 2024-09-12T00:36:27.860 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 1 librados: starting objecter 2024-09-12T00:36:27.860 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a8e7f91bc0 EEXIST 2024-09-12T00:36:27.860 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 1 librados: setting wanted keys 2024-09-12T00:36:27.860 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 1 librados: calling monclient init 2024-09-12T00:36:27.860 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: init 2024-09-12T00:36:27.860 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding auth protocol: cephx 2024-09-12T00:36:27.860 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding auth protocol: cephx 2024-09-12T00:36:27.861 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding auth protocol: cephx 2024-09-12T00:36:27.861 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: secure 2024-09-12T00:36:27.861 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: crc 2024-09-12T00:36:27.861 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: secure 2024-09-12T00:36:27.861 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: crc 2024-09-12T00:36:27.861 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: secure 2024-09-12T00:36:27.861 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: crc 2024-09-12T00:36:27.861 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: crc 2024-09-12T00:36:27.861 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: secure 2024-09-12T00:36:27.861 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: crc 2024-09-12T00:36:27.861 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: secure 2024-09-12T00:36:27.861 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: crc 2024-09-12T00:36:27.861 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: secure 2024-09-12T00:36:27.862 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.862 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.862 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command rotate-key cmddesc rotate-key hook 0x55a8e7f496c8 EEXIST 2024-09-12T00:36:27.862 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:27.862 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:36:27.862 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-a con 0x55a8e7f95b70 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:36:27.862 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-c con 0x55a8e7f9b3d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:36:27.862 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-b con 0x55a8e7f94fd0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:36:27.862 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.862 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.862 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.862 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): authenticate will time out at 2240.807184s 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): get_auth_request con 0x55a8e7f95b70 auth_method 0 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): get_auth_request con 0x55a8e7f9b3d0 auth_method 0 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:27.863 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:27.864 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:27.864 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:27.864 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): handle_auth_done global_id 6941 payload 824 2024-09-12T00:36:27.864 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient: _finish_hunting 0 2024-09-12T00:36:27.864 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:36:27.459+0000 7fbbe7447640 1 monclient: found mon.noname-c 2024-09-12T00:36:27.864 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:36:27.864 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:27.864 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:27.864 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: dump: 2024-09-12T00:36:27.864 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:36:27.864 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:36:27.864 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.864 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.865 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:27.865 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.865 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:36:27.865 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:36:27.865 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:36:27.865 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.865 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: _finish_auth 0 2024-09-12T00:36:27.865 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: _check_auth_tickets 2024-09-12T00:36:27.865 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:27.865 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:27.865 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:27.865 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: dump: 2024-09-12T00:36:27.865 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:36:27.866 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:36:27.866 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.866 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.866 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:27.866 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.866 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:36:27.866 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:36:27.866 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:36:27.866 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.866 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 4 set_mon_vals no callback set 2024-09-12T00:36:27.866 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 5 monclient: authenticate success, global_id 6941 2024-09-12T00:36:27.866 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 10 monclient: _renew_subs 2024-09-12T00:36:27.867 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:36:27.867 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 10 monclient: _renew_subs 2024-09-12T00:36:27.867 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:36:27.867 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 1 librados: init done 2024-09-12T00:36:27.867 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command cr dump hook 0x55a8e7f94a08 2024-09-12T00:36:27.867 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.867 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:36:27.463+0000 7fbac57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:27.867 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:36:27.463+0000 7fbac57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:36:27.867 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:36:27.463+0000 7fbac57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:36:27.867 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:36:27.463+0000 7fbbe7c48640 10 monclient: get_auth_request con 0x7fbab0070b10 auth_method 0 2024-09-12T00:36:27.867 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:36:27.463+0000 7fbbe8449640 10 monclient: get_auth_request con 0x55a8e7fb5820 auth_method 0 2024-09-12T00:36:27.867 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.867 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 20 realm 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:36:27.467+0000 7fbbe7c48640 10 monclient: get_auth_request con 0x55a8e7fb9980 auth_method 0 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:36:27.467+0000 7fbbe7447640 10 monclient: get_auth_request con 0x55a8e7fbd270 auth_method 0 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 searching for the correct realm 2024-09-12T00:36:27.868 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:36:27.467+0000 7fbbe8449640 10 monclient: get_auth_request con 0x55a8e7fc2030 auth_method 0 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:36:27.467+0000 7fbbe7c48640 10 monclient: get_auth_request con 0x7fbbe0066720 auth_method 0 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:36:27.471+0000 7fbbe7447640 10 monclient: get_auth_request con 0x7fbbd80f1070 auth_method 0 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:36:27.471+0000 7fbbe8449640 0 -- 172.21.15.138:0/2079816834 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fbbe007eb70 msgr2=0x7fbbe0082190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:36:27.675+0000 7fbbe8449640 10 monclient: get_auth_request con 0x7fbbe007eb70 auth_method 0 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:36:27.679+0000 7fbbe7c48640 10 monclient: get_auth_request con 0x7fbbd80e6b60 auth_method 0 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:36:27.687+0000 7fbbe8449640 0 -- 172.21.15.138:0/2079816834 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55a8e7fc2030 msgr2=0x55a8e7fc44f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:36:27.687+0000 7fbac57fa640 1 client.6941.objecter ms_handle_reset 0x55a8e7fc2030 session 0x55a8e7fc19b0 osd.4 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:36:27.687+0000 7fbac57fa640 10 monclient: _renew_subs 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:36:27.687+0000 7fbac57fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:36:27.687+0000 7fbbe8449640 10 monclient: get_auth_request con 0x7fbab0080e30 auth_method 0 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:27.869 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:27.870 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:27.870 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:27.870 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:27.870 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.870 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.870 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.870 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:27.870 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.870 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:27.870 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 zone default found 2024-09-12T00:36:27.870 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 4 Realm: () 2024-09-12T00:36:27.870 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:27.871 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:27.871 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:27.871 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 zonegroup default 2024-09-12T00:36:27.871 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.871 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.871 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.871 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.871 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.871 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.871 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 started sync module instance, tier type = 2024-09-12T00:36:27.871 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:27.871 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=0 2024-09-12T00:36:27.871 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=1 2024-09-12T00:36:27.872 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=2 2024-09-12T00:36:27.872 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=3 2024-09-12T00:36:27.872 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=4 2024-09-12T00:36:27.872 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=5 2024-09-12T00:36:27.872 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:36:27.723+0000 7fbbea1429c0 20 add_watcher() i=6 2024-09-12T00:36:27.872 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:36:27.723+0000 7fbbea1429c0 20 add_watcher() i=7 2024-09-12T00:36:27.872 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:36:27.723+0000 7fbbea1429c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:27.872 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding auth protocol: cephx 2024-09-12T00:36:27.872 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding auth protocol: cephx 2024-09-12T00:36:27.872 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding auth protocol: cephx 2024-09-12T00:36:27.872 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: secure 2024-09-12T00:36:27.872 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: crc 2024-09-12T00:36:27.872 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: secure 2024-09-12T00:36:27.873 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: crc 2024-09-12T00:36:27.873 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: secure 2024-09-12T00:36:27.873 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: crc 2024-09-12T00:36:27.873 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: crc 2024-09-12T00:36:27.873 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: secure 2024-09-12T00:36:27.873 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: crc 2024-09-12T00:36:27.873 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: secure 2024-09-12T00:36:27.873 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: crc 2024-09-12T00:36:27.873 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: secure 2024-09-12T00:36:27.873 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:36:27.727+0000 7fba9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:27.873 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.873 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:27.873 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:27.874 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command cache list hook 0x55a8e7fa0720 2024-09-12T00:36:27.874 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command cache inspect hook 0x55a8e7fa0720 2024-09-12T00:36:27.874 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command cache erase hook 0x55a8e7fa0720 2024-09-12T00:36:27.874 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command cache zap hook 0x55a8e7fa0720 2024-09-12T00:36:27.874 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 5 note: GC not initialized 2024-09-12T00:36:27.874 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:36:27.731+0000 7fba9cfe1640 20 reqs_thread_entry: start 2024-09-12T00:36:27.874 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command sync trace show hook 0x7fbbd80adea0 2024-09-12T00:36:27.874 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command sync trace history hook 0x7fbbd80adea0 2024-09-12T00:36:27.874 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command sync trace active hook 0x7fbbd80adea0 2024-09-12T00:36:27.874 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command sync trace active_short hook 0x7fbbd80adea0 2024-09-12T00:36:27.874 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:27.874 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 Filter name: none 2024-09-12T00:36:27.874 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:36:27.731+0000 7fba167fc640 20 reqs_thread_entry: start 2024-09-12T00:36:27.875 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:36:27.875 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.875 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:27.875 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:36:27.875 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:36:27.875 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 : miss 2024-09-12T00:36:27.875 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.875 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:27.875 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:27.875 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:27.875 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:27.875 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:27.875 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 2024-09-12T00:36:27.876 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:36:27.743+0000 7fbbea1429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:27.876 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:36:27.743+0000 7fbbea1429c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:27.876 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:36:27.743+0000 7fbbea1429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:27.876 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:36:27.743+0000 7fbbea1429c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32, ofs0, ns] 2024-09-12T00:36:27.876 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:36:27.747+0000 7fbac67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333538 cookie 94183934939056 notifier 6941 bl.length()=931 2024-09-12T00:36:27.876 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:36:27.747+0000 7fbac67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:27.876 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:36:27.747+0000 7fbac67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:27.876 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:36:27.747+0000 7fbac67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:27.876 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:36:27.747+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_sources= new_sources= 2024-09-12T00:36:27.876 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:36:27.747+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential sources added=[] removed=[] 2024-09-12T00:36:27.876 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:36:27.747+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_dests= new_dests= 2024-09-12T00:36:27.876 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:36:27.747+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential dests added=[] removed=[] 2024-09-12T00:36:27.876 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.0 2024-09-12T00:36:27.877 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.0 2024-09-12T00:36:27.877 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.1 2024-09-12T00:36:27.877 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.1 2024-09-12T00:36:27.877 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.2 2024-09-12T00:36:27.877 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.2 2024-09-12T00:36:27.877 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.3 2024-09-12T00:36:27.877 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.3 2024-09-12T00:36:27.877 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.4 2024-09-12T00:36:27.877 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.4 2024-09-12T00:36:27.877 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.5 2024-09-12T00:36:27.877 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.5 2024-09-12T00:36:27.877 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.6 2024-09-12T00:36:27.877 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.6 2024-09-12T00:36:27.878 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.7 2024-09-12T00:36:27.878 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.7 2024-09-12T00:36:27.878 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.8 2024-09-12T00:36:27.878 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.8 2024-09-12T00:36:27.878 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.9 2024-09-12T00:36:27.878 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.9 2024-09-12T00:36:27.878 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.10 2024-09-12T00:36:27.878 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.10 2024-09-12T00:36:27.878 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.11 2024-09-12T00:36:27.878 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.11 2024-09-12T00:36:27.878 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.0 2024-09-12T00:36:27.878 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1 2024-09-12T00:36:27.878 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.2 2024-09-12T00:36:27.879 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.3 2024-09-12T00:36:27.879 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:36:27.763+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.4 2024-09-12T00:36:27.879 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:36:27.763+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.5 2024-09-12T00:36:27.879 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:36:27.763+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.6 2024-09-12T00:36:27.879 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:36:27.767+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.7 2024-09-12T00:36:27.879 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:36:27.767+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.8 2024-09-12T00:36:27.879 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:36:27.767+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.9 2024-09-12T00:36:27.879 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:36:27.771+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.10 2024-09-12T00:36:27.879 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:36:27.779+0000 7fbbea1429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:27.879 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:36:27.779+0000 7fbbea1429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 2024-09-12T00:36:27.879 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:36:27.783+0000 7fbbea1429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:27.879 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:36:27.783+0000 7fbbea1429c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:27.879 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:36:27.783+0000 7fbbea1429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:27.880 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:36:27.783+0000 7fbbea1429c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32, ofs0, ns] 2024-09-12T00:36:27.880 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:36:27.783+0000 7fbac67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333539 cookie 94183934939056 notifier 6941 bl.length()=931 2024-09-12T00:36:27.880 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:36:27.783+0000 7fbac67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:27.880 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:36:27.783+0000 7fbac67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:27.880 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:36:27.783+0000 7fbac67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:27.880 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:36:27.783+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_sources= new_sources= 2024-09-12T00:36:27.880 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:36:27.783+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential sources added=[] removed=[] 2024-09-12T00:36:27.880 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:36:27.783+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_dests= new_dests= 2024-09-12T00:36:27.880 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:36:27.783+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential dests added=[] removed=[] 2024-09-12T00:36:27.880 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:36:27.787+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.0 2024-09-12T00:36:27.880 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:36:27.787+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1 2024-09-12T00:36:27.880 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:36:27.791+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.2 2024-09-12T00:36:27.880 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:36:27.791+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.3 2024-09-12T00:36:27.881 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:36:27.791+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.4 2024-09-12T00:36:27.881 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:36:27.791+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.5 2024-09-12T00:36:27.881 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:36:27.791+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.6 2024-09-12T00:36:27.881 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:36:27.795+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.7 2024-09-12T00:36:27.881 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:36:27.795+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.8 2024-09-12T00:36:27.881 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:36:27.795+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.9 2024-09-12T00:36:27.881 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:36:27.795+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.10 2024-09-12T00:36:27.881 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:36:27.799+0000 7fbbea1429c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbbea1429c0 time 2024-09-12T00:36:27.802859+0000 2024-09-12T00:36:27.881 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:27.881 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.881 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:27.881 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fbbeda1c2eb] 2024-09-12T00:36:27.882 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fbbeda1c49f] 2024-09-12T00:36:27.882 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8e5334cc1] 2024-09-12T00:36:27.882 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55a8e5349fc7] 2024-09-12T00:36:27.882 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-12T00:36:27.882 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fbbec882d90] 2024-09-12T00:36:27.882 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-12T00:36:27.882 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-12T00:36:27.882 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.882 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:36:27.803+0000 7fbbea1429c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:27.882 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fbbea1429c0 thread_name:radosgw-admin 2024-09-12T00:36:27.882 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.882 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:27.882 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fbbec89b520] 2024-09-12T00:36:27.883 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:36:27.883 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:36:27.883 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:36:27.883 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fbbeda1c345] 2024-09-12T00:36:27.883 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fbbeda1c49f] 2024-09-12T00:36:27.883 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8e5334cc1] 2024-09-12T00:36:27.883 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55a8e5349fc7] 2024-09-12T00:36:27.883 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-12T00:36:27.883 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fbbec882d90] 2024-09-12T00:36:27.883 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-12T00:36:27.883 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-12T00:36:27.883 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:27.883 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.884 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:36:27.884 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:36:27.884 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:36:27.884 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:36:27.884 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:36:27.884 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:36:27.884 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:36:27.884 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:36:27.884 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:36:27.884 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:36:27.884 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:36:27.884 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:36:27.884 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:36:27.885 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:36:27.885 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:36:27.885 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:36:27.885 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:36:27.885 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:36:27.885 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:36:27.885 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:36:27.885 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:36:27.885 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:36:27.885 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:36:27.885 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:36:27.885 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:36:27.885 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:36:27.886 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:36:27.886 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:36:27.886 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:36:27.886 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:36:27.886 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:36:27.886 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:36:27.886 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:36:27.886 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:36:27.886 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:36:27.886 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:36:27.886 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:36:27.886 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:36:27.886 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:36:27.887 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:36:27.887 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:36:27.887 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:36:27.887 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:36:27.887 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:36:27.887 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:36:27.887 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:36:27.887 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:36:27.887 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:36:27.887 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:36:27.887 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:36:27.887 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:36:27.887 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:36:27.888 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:36:27.888 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:36:27.888 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:36:27.888 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:36:27.888 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:36:27.888 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:36:27.888 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:36:27.888 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:36:27.888 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:36:27.888 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:36:27.888 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:36:27.888 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:36:27.888 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:36:27.889 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:36:27.889 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:36:27.889 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:36:27.889 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:36:27.889 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:36:27.889 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:36:27.889 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:36:27.889 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:36:27.889 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:36:27.889 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:36:27.889 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:36:27.889 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:36:27.889 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:36:27.890 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:36:27.890 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:36:27.890 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:36:27.890 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:36:27.890 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:36:27.890 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:36:27.890 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:36:27.890 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:36:27.890 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:36:27.890 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:36:27.890 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:36:27.890 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:36:27.890 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:36:27.891 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:36:27.891 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:36:27.891 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:36:27.891 INFO:tasks.workunit.client.0.smithi138.stderr: 7fba167fc640 / http_manager 2024-09-12T00:36:27.891 INFO:tasks.workunit.client.0.smithi138.stderr: 7fba9cfe1640 / http_manager 2024-09-12T00:36:27.891 INFO:tasks.workunit.client.0.smithi138.stderr: 7fba9dfe3640 / rgw_dt_lg_renew 2024-09-12T00:36:27.891 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbac57fa640 / ms_dispatch 2024-09-12T00:36:27.891 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbac67fc640 / io_context_pool 2024-09-12T00:36:27.891 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbac6ffd640 / io_context_pool 2024-09-12T00:36:27.891 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbacd7fa640 / ms_dispatch 2024-09-12T00:36:27.891 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbacffff640 / ms_dispatch 2024-09-12T00:36:27.891 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbad5e0b640 / io_context_pool 2024-09-12T00:36:27.891 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbbe7447640 / msgr-worker-2 2024-09-12T00:36:27.892 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbbe7c48640 / msgr-worker-1 2024-09-12T00:36:27.892 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbbe8449640 / msgr-worker-0 2024-09-12T00:36:27.892 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbbe8c4a640 / io_context_pool 2024-09-12T00:36:27.892 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbbea1429c0 / radosgw-admin 2024-09-12T00:36:27.892 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:36:27.892 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:36:27.892 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.114165.log 2024-09-12T00:36:27.892 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:36:27.892 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:36:27.892 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command rotate-key hook 0x55a8e7ecbc38 2024-09-12T00:36:27.892 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:27.892 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:36:27.893 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-b con 0x55a8e7d58de0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:36:27.893 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-a con 0x55a8e7d83730 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:36:27.893 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-c con 0x55a8e7ecea20 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:36:27.893 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.893 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.893 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.893 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:27.893 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:36:27.443+0000 7fbbea1429c0 10 monclient(hunting): authenticate will time out at 2240.791191s 2024-09-12T00:36:27.893 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:36:27.443+0000 7fbbe7447640 10 monclient(hunting): get_auth_request con 0x55a8e7d83730 auth_method 0 2024-09-12T00:36:27.893 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:36:27.443+0000 7fbbe7447640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.893 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:36:27.443+0000 7fbbe7447640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.893 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:36:27.443+0000 7fbbe7447640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.893 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient(hunting): get_auth_request con 0x55a8e7ecea20 auth_method 0 2024-09-12T00:36:27.894 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.894 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.894 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.894 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:27.894 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:27.894 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:27.894 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:36:27.443+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:27.894 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:36:27.443+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:27.894 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:36:27.443+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:27.894 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:36:27.443+0000 7fbbe7c48640 10 monclient(hunting): get_auth_request con 0x55a8e7d58de0 auth_method 0 2024-09-12T00:36:27.894 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:36:27.443+0000 7fbbe7c48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.894 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:36:27.443+0000 7fbbe7c48640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.894 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:36:27.443+0000 7fbbe7c48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.895 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient(hunting): handle_auth_done global_id 6932 payload 824 2024-09-12T00:36:27.895 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient: _finish_hunting 0 2024-09-12T00:36:27.895 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:36:27.443+0000 7fbbe8449640 1 monclient: found mon.noname-c 2024-09-12T00:36:27.895 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:36:27.443+0000 7fbbe8449640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:36:27.895 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:36:27.443+0000 7fbacffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:27.895 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:36:27.443+0000 7fbacffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:27.895 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:36:27.443+0000 7fbacffff640 10 monclient: dump: 2024-09-12T00:36:27.895 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:36:27.895 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:36:27.895 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.895 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.895 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:27.895 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.896 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:36:27.896 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:36:27.896 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:36:27.896 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.896 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:36:27.443+0000 7fbacffff640 10 monclient: _finish_auth 0 2024-09-12T00:36:27.896 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:36:27.443+0000 7fbacffff640 10 monclient: _check_auth_tickets 2024-09-12T00:36:27.896 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:36:27.443+0000 7fbacffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:27.896 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:36:27.443+0000 7fbacffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:27.896 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:36:27.447+0000 7fbacffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:27.896 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:36:27.447+0000 7fbacffff640 10 monclient: dump: 2024-09-12T00:36:27.896 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:36:27.896 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:36:27.896 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.897 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.897 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:27.897 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.897 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:36:27.897 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:36:27.897 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:36:27.897 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.897 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:36:27.447+0000 7fbad5e0b640 4 set_mon_vals no callback set 2024-09-12T00:36:27.897 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:36:27.447+0000 7fbbea1429c0 5 monclient: authenticate success, global_id 6932 2024-09-12T00:36:27.897 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:36:27.447+0000 7fbbea1429c0 10 monclient: _renew_subs 2024-09-12T00:36:27.897 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:36:27.447+0000 7fbbea1429c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:36:27.897 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:36:27.447+0000 7fbbea1429c0 10 monclient: _renew_subs 2024-09-12T00:36:27.897 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:36:27.447+0000 7fbbea1429c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:36:27.898 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:36:27.447+0000 7fbbea1429c0 1 librados: init done 2024-09-12T00:36:27.898 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:36:27.447+0000 7fbacffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:27.898 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:36:27.447+0000 7fbacffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:36:27.898 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:36:27.447+0000 7fbacffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:36:27.898 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:36:27.447+0000 7fbbe7c48640 10 monclient: get_auth_request con 0x7fbad0070ae0 auth_method 0 2024-09-12T00:36:27.898 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:36:27.447+0000 7fbbe7447640 10 monclient: get_auth_request con 0x55a8e7ef3da0 auth_method 0 2024-09-12T00:36:27.898 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:36:27.451+0000 7fbbe7c48640 10 monclient: get_auth_request con 0x55a8e7f16930 auth_method 0 2024-09-12T00:36:27.898 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:36:27.451+0000 7fbbe7447640 10 monclient: get_auth_request con 0x55a8e7f1ada0 auth_method 0 2024-09-12T00:36:27.898 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 10 monclient: build_initial_monmap 2024-09-12T00:36:27.898 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:27.898 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 10 monclient: monmap: 2024-09-12T00:36:27.898 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:36:27.898 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:27.898 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:36:27.899 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:36:27.899 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:27.899 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.899 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:36:27.899 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:36:27.899 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:36:27.899 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.899 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding auth protocol: cephx 2024-09-12T00:36:27.899 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding auth protocol: cephx 2024-09-12T00:36:27.899 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding auth protocol: cephx 2024-09-12T00:36:27.899 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: secure 2024-09-12T00:36:27.899 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: crc 2024-09-12T00:36:27.900 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: secure 2024-09-12T00:36:27.900 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: crc 2024-09-12T00:36:27.900 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: secure 2024-09-12T00:36:27.900 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: crc 2024-09-12T00:36:27.900 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: crc 2024-09-12T00:36:27.900 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: secure 2024-09-12T00:36:27.900 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: crc 2024-09-12T00:36:27.900 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: secure 2024-09-12T00:36:27.900 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: crc 2024-09-12T00:36:27.900 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1fbc0) adding con mode: secure 2024-09-12T00:36:27.900 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.900 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a8e7f235b0 EEXIST 2024-09-12T00:36:27.901 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 10 monclient: init 2024-09-12T00:36:27.901 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding auth protocol: cephx 2024-09-12T00:36:27.901 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding auth protocol: cephx 2024-09-12T00:36:27.901 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding auth protocol: cephx 2024-09-12T00:36:27.901 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: secure 2024-09-12T00:36:27.901 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: crc 2024-09-12T00:36:27.901 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: secure 2024-09-12T00:36:27.901 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: crc 2024-09-12T00:36:27.901 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: secure 2024-09-12T00:36:27.901 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: crc 2024-09-12T00:36:27.901 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: crc 2024-09-12T00:36:27.901 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: secure 2024-09-12T00:36:27.901 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: crc 2024-09-12T00:36:27.902 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: secure 2024-09-12T00:36:27.902 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: crc 2024-09-12T00:36:27.902 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f1e338) adding con mode: secure 2024-09-12T00:36:27.902 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:36:27.451+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.902 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.902 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command rotate-key cmddesc rotate-key hook 0x55a8e7f1e480 EEXIST 2024-09-12T00:36:27.902 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:27.902 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:36:27.902 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-b con 0x55a8e7f47760 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:36:27.902 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-a con 0x55a8e7f47090 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:36:27.902 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-c con 0x55a8e7f45a70 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:36:27.902 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.902 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient(hunting): authenticate will time out at 2240.800208s 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:36:27.455+0000 7fbbe8449640 10 monclient(hunting): get_auth_request con 0x55a8e7f45a70 auth_method 0 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:36:27.455+0000 7fbbe8449640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:36:27.455+0000 7fbbe8449640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:36:27.455+0000 7fbbe8449640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient(hunting): get_auth_request con 0x55a8e7f47090 auth_method 0 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:36:27.455+0000 7fbbe8449640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:27.903 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:36:27.455+0000 7fbbe8449640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:27.904 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:36:27.455+0000 7fbbe8449640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:27.904 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:27.904 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:27.904 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:27.904 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:36:27.455+0000 7fbbe7c48640 10 monclient(hunting): get_auth_request con 0x55a8e7f47760 auth_method 0 2024-09-12T00:36:27.904 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:36:27.455+0000 7fbbe7c48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.904 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:36:27.455+0000 7fbbe7c48640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.904 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:36:27.455+0000 7fbbe7c48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.904 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient(hunting): handle_auth_done global_id 7368 payload 824 2024-09-12T00:36:27.904 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient: _finish_hunting 0 2024-09-12T00:36:27.904 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:36:27.455+0000 7fbbe7447640 1 monclient: found mon.noname-a 2024-09-12T00:36:27.904 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:36:27.455+0000 7fbbe7447640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:36:27.904 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:27.905 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:27.905 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: dump: 2024-09-12T00:36:27.905 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:36:27.905 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:36:27.905 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.905 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.905 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:27.905 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.905 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:36:27.905 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:36:27.905 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:36:27.905 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.905 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: _finish_auth 0 2024-09-12T00:36:27.906 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:36:27.906 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:27.906 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:27.906 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:27.906 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 10 monclient: dump: 2024-09-12T00:36:27.906 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:36:27.906 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:36:27.906 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.906 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.906 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:27.906 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.906 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:36:27.906 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:36:27.907 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:36:27.907 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.907 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 monclient: authenticate success, global_id 7368 2024-09-12T00:36:27.907 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:36:27.455+0000 7fbbe8c4a640 4 set_mon_vals no callback set 2024-09-12T00:36:27.907 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: _renew_subs 2024-09-12T00:36:27.907 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:36:27.907 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: _renew_subs 2024-09-12T00:36:27.907 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:36:27.907 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:27.907 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:36:27.907 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:36:27.455+0000 7fbacd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:36:27.907 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: get_monmap_and_config 2024-09-12T00:36:27.907 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: build_initial_monmap 2024-09-12T00:36:27.907 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:27.908 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: monmap: 2024-09-12T00:36:27.908 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:36:27.908 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:27.908 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:36:27.908 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:36:27.908 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:27.908 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.908 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:36:27.908 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:36:27.908 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:36:27.908 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.908 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding auth protocol: cephx 2024-09-12T00:36:27.908 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding auth protocol: cephx 2024-09-12T00:36:27.909 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding auth protocol: cephx 2024-09-12T00:36:27.909 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: secure 2024-09-12T00:36:27.909 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: crc 2024-09-12T00:36:27.909 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: secure 2024-09-12T00:36:27.909 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: crc 2024-09-12T00:36:27.909 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: secure 2024-09-12T00:36:27.909 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: crc 2024-09-12T00:36:27.909 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: crc 2024-09-12T00:36:27.909 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: secure 2024-09-12T00:36:27.909 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: crc 2024-09-12T00:36:27.909 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: secure 2024-09-12T00:36:27.909 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: crc 2024-09-12T00:36:27.909 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f670e0) adding con mode: secure 2024-09-12T00:36:27.910 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:36:27.455+0000 7fbbe7c48640 10 monclient: get_auth_request con 0x7fbac0070a20 auth_method 0 2024-09-12T00:36:27.910 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.910 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 10 monclient: init 2024-09-12T00:36:27.910 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding auth protocol: cephx 2024-09-12T00:36:27.910 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding auth protocol: cephx 2024-09-12T00:36:27.910 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding auth protocol: cephx 2024-09-12T00:36:27.910 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: secure 2024-09-12T00:36:27.910 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: crc 2024-09-12T00:36:27.910 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: secure 2024-09-12T00:36:27.910 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: crc 2024-09-12T00:36:27.910 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: secure 2024-09-12T00:36:27.910 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: crc 2024-09-12T00:36:27.910 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: crc 2024-09-12T00:36:27.911 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: secure 2024-09-12T00:36:27.911 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: crc 2024-09-12T00:36:27.911 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: secure 2024-09-12T00:36:27.911 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: crc 2024-09-12T00:36:27.911 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:36:27.455+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff2d0) adding con mode: secure 2024-09-12T00:36:27.911 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.911 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.911 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command rotate-key cmddesc rotate-key hook 0x7ffff36ff418 EEXIST 2024-09-12T00:36:27.911 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:27.911 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:36:27.911 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-c con 0x55a8e7f9b3d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:36:27.911 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-b con 0x55a8e7f9b7b0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:36:27.912 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-a con 0x55a8e7f95b70 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:36:27.912 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.912 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.912 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.912 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:27.912 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): authenticate will time out at 2240.804489s 2024-09-12T00:36:27.912 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): get_auth_request con 0x55a8e7f9b3d0 auth_method 0 2024-09-12T00:36:27.912 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.912 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.912 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.912 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:36:27.459+0000 7fbbe8449640 10 monclient(hunting): get_auth_request con 0x55a8e7f95b70 auth_method 0 2024-09-12T00:36:27.912 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:36:27.459+0000 7fbbe8449640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.912 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:36:27.459+0000 7fbbe8449640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.913 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:36:27.459+0000 7fbbe8449640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.913 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:27.913 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:27.913 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:27.913 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): get_auth_request con 0x55a8e7f9b7b0 auth_method 0 2024-09-12T00:36:27.913 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.913 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.913 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.913 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): handle_auth_done global_id 6938 payload 274 2024-09-12T00:36:27.913 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient: _finish_hunting 0 2024-09-12T00:36:27.913 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 1 monclient: found mon.noname-c 2024-09-12T00:36:27.913 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:36:27.913 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:27.914 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:27.914 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: dump: 2024-09-12T00:36:27.914 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:36:27.914 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:36:27.914 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.914 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.914 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:27.914 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.914 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:36:27.914 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:36:27.914 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:36:27.914 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.914 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:36:27.915 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:36:27.915 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:27.915 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 monclient: authenticate success, global_id 6938 2024-09-12T00:36:27.915 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: get_monmap_and_config success 2024-09-12T00:36:27.915 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 4 set_mon_vals no callback set 2024-09-12T00:36:27.915 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:27.915 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:27.915 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 10 monclient: dump: 2024-09-12T00:36:27.915 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:36:27.915 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:36:27.915 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.915 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.915 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:27.915 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.916 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:36:27.916 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:36:27.916 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:36:27.916 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.916 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: shutdown 2024-09-12T00:36:27.916 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: build_initial_monmap 2024-09-12T00:36:27.916 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:27.916 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: monmap: 2024-09-12T00:36:27.916 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:36:27.916 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:27.916 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:36:27.916 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:36:27.917 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:27.917 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.917 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:36:27.917 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:36:27.917 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:36:27.917 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.917 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding auth protocol: cephx 2024-09-12T00:36:27.917 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding auth protocol: cephx 2024-09-12T00:36:27.917 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding auth protocol: cephx 2024-09-12T00:36:27.917 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: secure 2024-09-12T00:36:27.917 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: crc 2024-09-12T00:36:27.917 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: secure 2024-09-12T00:36:27.918 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: crc 2024-09-12T00:36:27.918 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: secure 2024-09-12T00:36:27.918 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: crc 2024-09-12T00:36:27.918 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: crc 2024-09-12T00:36:27.918 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: secure 2024-09-12T00:36:27.918 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: crc 2024-09-12T00:36:27.918 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: secure 2024-09-12T00:36:27.918 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: crc 2024-09-12T00:36:27.918 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f97810) adding con mode: secure 2024-09-12T00:36:27.918 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.918 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 1 librados: starting msgr at 2024-09-12T00:36:27.918 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 1 librados: starting objecter 2024-09-12T00:36:27.918 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command objecter_requests cmddesc objecter_requests hook 0x55a8e7f91bc0 EEXIST 2024-09-12T00:36:27.918 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 1 librados: setting wanted keys 2024-09-12T00:36:27.919 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 1 librados: calling monclient init 2024-09-12T00:36:27.919 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: init 2024-09-12T00:36:27.919 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding auth protocol: cephx 2024-09-12T00:36:27.919 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding auth protocol: cephx 2024-09-12T00:36:27.919 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding auth protocol: cephx 2024-09-12T00:36:27.919 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: secure 2024-09-12T00:36:27.919 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: crc 2024-09-12T00:36:27.919 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: secure 2024-09-12T00:36:27.919 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: crc 2024-09-12T00:36:27.919 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: secure 2024-09-12T00:36:27.919 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: crc 2024-09-12T00:36:27.919 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: crc 2024-09-12T00:36:27.919 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: secure 2024-09-12T00:36:27.920 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: crc 2024-09-12T00:36:27.920 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: secure 2024-09-12T00:36:27.920 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: crc 2024-09-12T00:36:27.920 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 AuthRegistry(0x55a8e7f49580) adding con mode: secure 2024-09-12T00:36:27.920 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.920 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.920 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command rotate-key cmddesc rotate-key hook 0x55a8e7f496c8 EEXIST 2024-09-12T00:36:27.920 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:27.920 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:36:27.920 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-a con 0x55a8e7f95b70 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:36:27.920 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-c con 0x55a8e7f9b3d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:36:27.920 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): picked mon.noname-b con 0x55a8e7f94fd0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:36:27.920 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.921 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.921 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:27.921 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:27.921 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:36:27.459+0000 7fbbea1429c0 10 monclient(hunting): authenticate will time out at 2240.807184s 2024-09-12T00:36:27.921 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): get_auth_request con 0x55a8e7f95b70 auth_method 0 2024-09-12T00:36:27.921 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.921 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.921 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.921 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): get_auth_request con 0x55a8e7f9b3d0 auth_method 0 2024-09-12T00:36:27.921 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:27.921 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:27.921 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:27.922 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:27.922 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:27.922 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:36:27.459+0000 7fbbe7c48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:27.922 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:27.922 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:27.922 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:27.922 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient(hunting): handle_auth_done global_id 6941 payload 824 2024-09-12T00:36:27.922 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient: _finish_hunting 0 2024-09-12T00:36:27.922 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:36:27.459+0000 7fbbe7447640 1 monclient: found mon.noname-c 2024-09-12T00:36:27.922 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:36:27.459+0000 7fbbe7447640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:36:27.922 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:27.922 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:27.923 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: dump: 2024-09-12T00:36:27.923 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:36:27.923 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:36:27.923 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.923 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.923 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:27.923 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.923 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:36:27.923 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:36:27.923 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:36:27.923 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.923 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: _finish_auth 0 2024-09-12T00:36:27.923 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: _check_auth_tickets 2024-09-12T00:36:27.924 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:27.924 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:27.924 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:27.924 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:36:27.459+0000 7fbac57fa640 10 monclient: dump: 2024-09-12T00:36:27.924 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:36:27.924 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:36:27.924 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.924 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:36:27.924 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:27.924 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:36:27.924 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:36:27.924 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:36:27.924 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:36:27.924 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.925 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:36:27.459+0000 7fbac6ffd640 4 set_mon_vals no callback set 2024-09-12T00:36:27.925 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 5 monclient: authenticate success, global_id 6941 2024-09-12T00:36:27.925 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 10 monclient: _renew_subs 2024-09-12T00:36:27.925 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:36:27.925 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 10 monclient: _renew_subs 2024-09-12T00:36:27.925 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:36:27.925 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 1 librados: init done 2024-09-12T00:36:27.925 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command cr dump hook 0x55a8e7f94a08 2024-09-12T00:36:27.925 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.926 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:36:27.463+0000 7fbac57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:27.926 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:36:27.463+0000 7fbac57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:36:27.926 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:36:27.463+0000 7fbac57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:36:27.926 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:36:27.463+0000 7fbbe7c48640 10 monclient: get_auth_request con 0x7fbab0070b10 auth_method 0 2024-09-12T00:36:27.926 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:36:27.463+0000 7fbbe8449640 10 monclient: get_auth_request con 0x55a8e7fb5820 auth_method 0 2024-09-12T00:36:27.926 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.926 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 20 realm 2024-09-12T00:36:27.926 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:36:27.463+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.926 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.926 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:27.927 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.927 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.927 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.927 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:36:27.467+0000 7fbbe7c48640 10 monclient: get_auth_request con 0x55a8e7fb9980 auth_method 0 2024-09-12T00:36:27.927 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:27.927 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.927 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:36:27.467+0000 7fbbe7447640 10 monclient: get_auth_request con 0x55a8e7fbd270 auth_method 0 2024-09-12T00:36:27.927 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:27.927 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:36:27.467+0000 7fbbea1429c0 20 searching for the correct realm 2024-09-12T00:36:27.927 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:36:27.467+0000 7fbbe8449640 10 monclient: get_auth_request con 0x55a8e7fc2030 auth_method 0 2024-09-12T00:36:27.927 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:36:27.467+0000 7fbbe7c48640 10 monclient: get_auth_request con 0x7fbbe0066720 auth_method 0 2024-09-12T00:36:27.927 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:36:27.471+0000 7fbbe7447640 10 monclient: get_auth_request con 0x7fbbd80f1070 auth_method 0 2024-09-12T00:36:27.927 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:36:27.471+0000 7fbbe8449640 0 -- 172.21.15.138:0/2079816834 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fbbe007eb70 msgr2=0x7fbbe0082190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:27.928 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:36:27.675+0000 7fbbe8449640 10 monclient: get_auth_request con 0x7fbbe007eb70 auth_method 0 2024-09-12T00:36:27.928 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:36:27.679+0000 7fbbe7c48640 10 monclient: get_auth_request con 0x7fbbd80e6b60 auth_method 0 2024-09-12T00:36:27.928 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:36:27.687+0000 7fbbe8449640 0 -- 172.21.15.138:0/2079816834 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55a8e7fc2030 msgr2=0x55a8e7fc44f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:27.928 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:36:27.687+0000 7fbac57fa640 1 client.6941.objecter ms_handle_reset 0x55a8e7fc2030 session 0x55a8e7fc19b0 osd.4 2024-09-12T00:36:27.928 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:36:27.687+0000 7fbac57fa640 10 monclient: _renew_subs 2024-09-12T00:36:27.928 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:36:27.687+0000 7fbac57fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:36:27.928 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:36:27.687+0000 7fbbe8449640 10 monclient: get_auth_request con 0x7fbab0080e30 auth_method 0 2024-09-12T00:36:27.928 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:27.928 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:27.928 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:27.928 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:27.929 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:27.929 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:27.929 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.929 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.929 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.929 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:27.929 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:36:27.695+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.929 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:27.929 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 zone default found 2024-09-12T00:36:27.929 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 4 Realm: () 2024-09-12T00:36:27.929 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:27.929 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:27.929 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:27.930 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 zonegroup default 2024-09-12T00:36:27.930 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.930 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.930 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.930 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.930 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.930 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.930 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 started sync module instance, tier type = 2024-09-12T00:36:27.930 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:36:27.699+0000 7fbbea1429c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:27.930 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=0 2024-09-12T00:36:27.930 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=1 2024-09-12T00:36:27.930 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=2 2024-09-12T00:36:27.930 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=3 2024-09-12T00:36:27.931 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=4 2024-09-12T00:36:27.931 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:36:27.719+0000 7fbbea1429c0 20 add_watcher() i=5 2024-09-12T00:36:27.931 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:36:27.723+0000 7fbbea1429c0 20 add_watcher() i=6 2024-09-12T00:36:27.931 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:36:27.723+0000 7fbbea1429c0 20 add_watcher() i=7 2024-09-12T00:36:27.931 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:36:27.723+0000 7fbbea1429c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:27.931 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding auth protocol: cephx 2024-09-12T00:36:27.931 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding auth protocol: cephx 2024-09-12T00:36:27.931 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding auth protocol: cephx 2024-09-12T00:36:27.931 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: secure 2024-09-12T00:36:27.931 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: crc 2024-09-12T00:36:27.931 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: secure 2024-09-12T00:36:27.931 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: crc 2024-09-12T00:36:27.932 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: secure 2024-09-12T00:36:27.932 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: crc 2024-09-12T00:36:27.932 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: crc 2024-09-12T00:36:27.932 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: secure 2024-09-12T00:36:27.932 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: crc 2024-09-12T00:36:27.932 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: secure 2024-09-12T00:36:27.932 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: crc 2024-09-12T00:36:27.932 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 AuthRegistry(0x7ffff36ff7b0) adding con mode: secure 2024-09-12T00:36:27.932 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:36:27.727+0000 7fba9dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:27.932 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:27.932 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:27.932 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:27.932 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command cache list hook 0x55a8e7fa0720 2024-09-12T00:36:27.933 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command cache inspect hook 0x55a8e7fa0720 2024-09-12T00:36:27.933 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command cache erase hook 0x55a8e7fa0720 2024-09-12T00:36:27.933 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:36:27.727+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command cache zap hook 0x55a8e7fa0720 2024-09-12T00:36:27.933 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 5 note: GC not initialized 2024-09-12T00:36:27.933 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:36:27.731+0000 7fba9cfe1640 20 reqs_thread_entry: start 2024-09-12T00:36:27.933 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command sync trace show hook 0x7fbbd80adea0 2024-09-12T00:36:27.933 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command sync trace history hook 0x7fbbd80adea0 2024-09-12T00:36:27.933 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command sync trace active hook 0x7fbbd80adea0 2024-09-12T00:36:27.933 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 5 asok(0x55a8e7cc02b0) register_command sync trace active_short hook 0x7fbbd80adea0 2024-09-12T00:36:27.933 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:27.933 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 Filter name: none 2024-09-12T00:36:27.933 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:36:27.731+0000 7fba167fc640 20 reqs_thread_entry: start 2024-09-12T00:36:27.933 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:36:27.934 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.934 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:27.934 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:36:27.934 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:36:27.934 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 : miss 2024-09-12T00:36:27.934 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.934 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:27.934 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:27.934 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:27.934 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:27.934 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:27.934 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:36:27.731+0000 7fbbea1429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 2024-09-12T00:36:27.934 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:36:27.743+0000 7fbbea1429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:27.935 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:36:27.743+0000 7fbbea1429c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:27.935 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:36:27.743+0000 7fbbea1429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:27.935 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:36:27.743+0000 7fbbea1429c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32, ofs0, ns] 2024-09-12T00:36:27.935 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:36:27.747+0000 7fbac67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333538 cookie 94183934939056 notifier 6941 bl.length()=931 2024-09-12T00:36:27.935 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:36:27.747+0000 7fbac67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:27.935 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:36:27.747+0000 7fbac67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:27.935 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:36:27.747+0000 7fbac67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:27.935 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:36:27.747+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_sources= new_sources= 2024-09-12T00:36:27.935 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:36:27.747+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential sources added=[] removed=[] 2024-09-12T00:36:27.935 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:36:27.747+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_dests= new_dests= 2024-09-12T00:36:27.935 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:36:27.747+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential dests added=[] removed=[] 2024-09-12T00:36:27.935 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.0 2024-09-12T00:36:27.935 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.0 2024-09-12T00:36:27.936 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.1 2024-09-12T00:36:27.936 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.1 2024-09-12T00:36:27.936 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.2 2024-09-12T00:36:27.936 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.2 2024-09-12T00:36:27.936 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.3 2024-09-12T00:36:27.936 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.3 2024-09-12T00:36:27.936 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.4 2024-09-12T00:36:27.936 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.4 2024-09-12T00:36:27.936 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.5 2024-09-12T00:36:27.936 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.5 2024-09-12T00:36:27.936 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.6 2024-09-12T00:36:27.936 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.6 2024-09-12T00:36:27.937 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.7 2024-09-12T00:36:27.937 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.7 2024-09-12T00:36:27.937 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.8 2024-09-12T00:36:27.937 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.8 2024-09-12T00:36:27.937 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.9 2024-09-12T00:36:27.937 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.9 2024-09-12T00:36:27.937 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.10 2024-09-12T00:36:27.937 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.10 2024-09-12T00:36:27.937 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.11 2024-09-12T00:36:27.937 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.11 2024-09-12T00:36:27.937 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.0 2024-09-12T00:36:27.937 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1 2024-09-12T00:36:27.938 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.2 2024-09-12T00:36:27.938 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:36:27.759+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.3 2024-09-12T00:36:27.938 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:36:27.763+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.4 2024-09-12T00:36:27.938 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:36:27.763+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.5 2024-09-12T00:36:27.938 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:36:27.763+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.6 2024-09-12T00:36:27.938 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:36:27.767+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.7 2024-09-12T00:36:27.938 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:36:27.767+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.8 2024-09-12T00:36:27.938 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:36:27.767+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.9 2024-09-12T00:36:27.938 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:36:27.771+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.10 2024-09-12T00:36:27.938 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:36:27.779+0000 7fbbea1429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:27.938 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:36:27.779+0000 7fbbea1429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 2024-09-12T00:36:27.938 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:36:27.783+0000 7fbbea1429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:27.938 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:36:27.783+0000 7fbbea1429c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:27.938 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:36:27.783+0000 7fbbea1429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:27.939 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:36:27.783+0000 7fbbea1429c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32, ofs0, ns] 2024-09-12T00:36:27.939 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:36:27.783+0000 7fbac67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333539 cookie 94183934939056 notifier 6941 bl.length()=931 2024-09-12T00:36:27.939 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:36:27.783+0000 7fbac67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:27.939 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:36:27.783+0000 7fbac67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:27.939 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:36:27.783+0000 7fbac67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:27.939 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:36:27.783+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_sources= new_sources= 2024-09-12T00:36:27.939 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:36:27.783+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential sources added=[] removed=[] 2024-09-12T00:36:27.939 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:36:27.783+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_dests= new_dests= 2024-09-12T00:36:27.939 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:36:27.783+0000 7fbbea1429c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential dests added=[] removed=[] 2024-09-12T00:36:27.939 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:36:27.787+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.0 2024-09-12T00:36:27.939 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:36:27.787+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1 2024-09-12T00:36:27.939 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:36:27.791+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.2 2024-09-12T00:36:27.940 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:36:27.791+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.3 2024-09-12T00:36:27.940 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:36:27.791+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.4 2024-09-12T00:36:27.940 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:36:27.791+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.5 2024-09-12T00:36:27.940 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:36:27.791+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.6 2024-09-12T00:36:27.940 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:36:27.795+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.7 2024-09-12T00:36:27.940 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:36:27.795+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.8 2024-09-12T00:36:27.940 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:36:27.795+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.9 2024-09-12T00:36:27.940 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:36:27.795+0000 7fbbea1429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.10 2024-09-12T00:36:27.940 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:36:27.799+0000 7fbbea1429c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbbea1429c0 time 2024-09-12T00:36:27.802859+0000 2024-09-12T00:36:27.940 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:27.940 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.940 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:27.941 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fbbeda1c2eb] 2024-09-12T00:36:27.941 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fbbeda1c49f] 2024-09-12T00:36:27.941 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8e5334cc1] 2024-09-12T00:36:27.941 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55a8e5349fc7] 2024-09-12T00:36:27.941 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-12T00:36:27.941 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fbbec882d90] 2024-09-12T00:36:27.941 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-12T00:36:27.941 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-12T00:36:27.941 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.941 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:36:27.803+0000 7fbbea1429c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:27.941 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fbbea1429c0 thread_name:radosgw-admin 2024-09-12T00:36:27.941 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.941 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:27.942 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fbbec89b520] 2024-09-12T00:36:27.942 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:36:27.942 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:36:27.942 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:36:27.942 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fbbeda1c345] 2024-09-12T00:36:27.942 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fbbeda1c49f] 2024-09-12T00:36:27.942 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a8e5334cc1] 2024-09-12T00:36:27.942 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x55a8e5349fc7] 2024-09-12T00:36:27.942 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-12T00:36:27.942 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fbbec882d90] 2024-09-12T00:36:27.942 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-12T00:36:27.942 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-12T00:36:27.942 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:27.943 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:27.943 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:36:27.943 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:36:27.943 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:36:27.943 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:36:27.943 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:36:27.943 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:36:27.943 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:36:27.943 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:36:27.943 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:36:27.943 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:36:27.943 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:36:27.944 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:36:27.944 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:36:27.944 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:36:27.944 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:36:27.944 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:36:27.944 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:36:27.944 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:36:27.944 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:36:27.944 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:36:27.944 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:36:27.944 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:36:27.944 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:36:27.945 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:36:27.945 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:36:27.945 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:36:27.945 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:36:27.945 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:36:27.945 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:36:27.945 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:36:27.945 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:36:27.945 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:36:27.945 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:36:27.945 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:36:27.945 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:36:27.945 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:36:27.946 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:36:27.946 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:36:27.946 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:36:27.946 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:36:27.946 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:36:27.946 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:36:27.946 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:36:27.946 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:36:27.946 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:36:27.946 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:36:27.946 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:36:27.946 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:36:27.946 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:36:27.947 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:36:27.947 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:36:27.947 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:36:27.947 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:36:27.947 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:36:27.947 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:36:27.947 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:36:27.947 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:36:27.947 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:36:27.947 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:36:27.947 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:36:27.947 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:36:27.947 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:36:27.948 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:36:27.948 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:36:27.948 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:36:27.948 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:36:27.948 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:36:27.948 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:36:27.948 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:36:27.948 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:36:27.948 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:36:27.948 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:36:27.948 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:36:27.948 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:36:27.948 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:36:27.949 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:36:27.949 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:36:27.949 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:36:27.949 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:36:27.949 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:36:27.949 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:36:27.949 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:36:27.949 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:36:27.949 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:36:27.949 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:36:27.949 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:36:27.949 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:36:27.949 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:36:27.950 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:36:27.950 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:36:27.950 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:36:27.950 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:36:27.950 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:36:27.950 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:36:27.950 INFO:tasks.workunit.client.0.smithi138.stderr: 7fba167fc640 / http_manager 2024-09-12T00:36:27.950 INFO:tasks.workunit.client.0.smithi138.stderr: 7fba9cfe1640 / http_manager 2024-09-12T00:36:27.950 INFO:tasks.workunit.client.0.smithi138.stderr: 7fba9dfe3640 / rgw_dt_lg_renew 2024-09-12T00:36:27.950 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbac57fa640 / ms_dispatch 2024-09-12T00:36:27.950 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbac67fc640 / io_context_pool 2024-09-12T00:36:27.950 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbac6ffd640 / io_context_pool 2024-09-12T00:36:27.950 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbacd7fa640 / ms_dispatch 2024-09-12T00:36:27.950 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbacffff640 / ms_dispatch 2024-09-12T00:36:27.951 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbad5e0b640 / io_context_pool 2024-09-12T00:36:27.951 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbbe7447640 / msgr-worker-2 2024-09-12T00:36:27.951 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbbe7c48640 / msgr-worker-1 2024-09-12T00:36:27.951 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbbe8449640 / msgr-worker-0 2024-09-12T00:36:27.951 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbbe8c4a640 / io_context_pool 2024-09-12T00:36:27.951 INFO:tasks.workunit.client.0.smithi138.stderr: 7fbbea1429c0 / radosgw-admin 2024-09-12T00:36:27.951 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:36:27.951 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:36:27.951 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:36:27.808452Z_81b012b9-8f3f-410d-9532-228a6239c468/log 2024-09-12T00:36:27.951 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:36:27.951 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-12T00:36:27.951 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:36:27.953 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:27.953 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:27.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.891+0000 7fd8f02499c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.895+0000 7fd8f02499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.895+0000 7fd8f02499c0 20 realm 2024-09-12T00:36:27.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.895+0000 7fd8f02499c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.895+0000 7fd8f02499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.895+0000 7fd8f02499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:27.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.895+0000 7fd8f02499c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.895+0000 7fd8f02499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:27.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.895+0000 7fd8f02499c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.899+0000 7fd8f02499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:27.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.899+0000 7fd8f02499c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:27.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.899+0000 7fd8f02499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:27.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.899+0000 7fd8f02499c0 20 searching for the correct realm 2024-09-12T00:36:27.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:27.903+0000 7fd8ee550640 0 -- 172.21.15.138:0/2763867262 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fd8e8076bd0 msgr2=0x7fd8e8001af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:28.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.119+0000 7fd8ee550640 0 -- 172.21.15.138:0/2763867262 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5603c945e6d0 msgr2=0x5603c9460b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.127+0000 7fd8f02499c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.127+0000 7fd8f02499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.127+0000 7fd8f02499c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.127+0000 7fd8f02499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:28.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.127+0000 7fd8f02499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:28.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.127+0000 7fd8f02499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:28.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.127+0000 7fd8f02499c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.127+0000 7fd8f02499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.127+0000 7fd8f02499c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.131+0000 7fd8f02499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:28.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.131+0000 7fd8f02499c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.131+0000 7fd8f02499c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.131+0000 7fd8f02499c0 20 zone default found 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.131+0000 7fd8f02499c0 4 Realm: () 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.131+0000 7fd8f02499c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.131+0000 7fd8f02499c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.131+0000 7fd8f02499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:28.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.131+0000 7fd8f02499c0 20 zonegroup default 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.131+0000 7fd8f02499c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.131+0000 7fd8f02499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.131+0000 7fd8f02499c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.131+0000 7fd8f02499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.131+0000 7fd8f02499c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.131+0000 7fd8f02499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:28.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.131+0000 7fd8f02499c0 20 started sync module instance, tier type = 2024-09-12T00:36:28.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.131+0000 7fd8f02499c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.155+0000 7fd8f02499c0 20 add_watcher() i=0 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.155+0000 7fd8f02499c0 20 add_watcher() i=1 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.155+0000 7fd8f02499c0 20 add_watcher() i=2 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.155+0000 7fd8f02499c0 20 add_watcher() i=3 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.155+0000 7fd8f02499c0 20 add_watcher() i=4 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.155+0000 7fd8f02499c0 20 add_watcher() i=5 2024-09-12T00:36:28.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.155+0000 7fd8f02499c0 20 add_watcher() i=6 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.159+0000 7fd8f02499c0 20 add_watcher() i=7 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.159+0000 7fd8f02499c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:28.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.163+0000 7fd79f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.163+0000 7fd8f02499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.163+0000 7fd8f02499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.163+0000 7fd8f02499c0 5 note: GC not initialized 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.163+0000 7fd79e7fc640 20 reqs_thread_entry: start 2024-09-12T00:36:28.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.163+0000 7fd8f02499c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:28.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.163+0000 7fd8f02499c0 20 Filter name: none 2024-09-12T00:36:28.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.163+0000 7fd70ffff640 20 reqs_thread_entry: start 2024-09-12T00:36:28.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.163+0000 7fd8f02499c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.167+0000 7fd8f02499c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:28.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.167+0000 7fd8f02499c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.167+0000 7fd8f02499c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:36:28.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.167+0000 7fd8f02499c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:28.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.167+0000 7fd8f02499c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.167+0000 7fd8f02499c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:28.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.167+0000 7fd8f02499c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.171+0000 7fd8f02499c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:36:28.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.171+0000 7fd8f02499c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:28.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.171+0000 7fd79f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:28.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.179+0000 7fd8f02499c0 20 remove_watcher() i=0 2024-09-12T00:36:28.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.179+0000 7fd8f02499c0 2 removed watcher, disabling cache 2024-09-12T00:36:28.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.179+0000 7fd8f02499c0 20 remove_watcher() i=1 2024-09-12T00:36:28.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.183+0000 7fd8f02499c0 20 remove_watcher() i=2 2024-09-12T00:36:28.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.183+0000 7fd8f02499c0 20 remove_watcher() i=3 2024-09-12T00:36:28.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.187+0000 7fd8f02499c0 20 remove_watcher() i=4 2024-09-12T00:36:28.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.187+0000 7fd8f02499c0 20 remove_watcher() i=5 2024-09-12T00:36:28.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.191+0000 7fd8f02499c0 20 remove_watcher() i=6 2024-09-12T00:36:28.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:28.195+0000 7fd8f02499c0 20 remove_watcher() i=7 2024-09-12T00:36:28.208 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:28.208 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:36:28.208 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-commit-target-layout id: e2043445-c131-4520-984d-b4d52f038a6b.4538.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:36:28.208 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:28.209 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:28.209 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:58.292 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:58.293 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:58.338 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:36:58.375 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:58.376 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:58.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.423+0000 7f5bfa6709c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.427+0000 7f5bfa6709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.427+0000 7f5bfa6709c0 20 realm 2024-09-12T00:36:58.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.427+0000 7f5bfa6709c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.427+0000 7f5bfa6709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.427+0000 7f5bfa6709c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:58.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.427+0000 7f5bfa6709c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.427+0000 7f5bfa6709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.427+0000 7f5bfa6709c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.431+0000 7f5bfa6709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:58.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.431+0000 7f5bfa6709c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.431+0000 7f5bfa6709c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:58.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.431+0000 7f5bfa6709c0 20 searching for the correct realm 2024-09-12T00:36:58.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.435+0000 7f5bf7975640 0 -- 172.21.15.138:0/2424731278 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f5be006e0e0 msgr2=0x7f5be00663b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:58.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.439+0000 7f5bf7975640 0 -- 172.21.15.138:0/2424731278 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x5588a4f25470 msgr2=0x5588a4f27860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:58.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:58.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:58.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:58.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:58.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:58.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:58.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:58.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:58.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 zone default found 2024-09-12T00:36:58.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 4 Realm: () 2024-09-12T00:36:58.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:58.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:58.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:58.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 zonegroup default 2024-09-12T00:36:58.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 started sync module instance, tier type = 2024-09-12T00:36:58.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.451+0000 7f5bfa6709c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:58.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.471+0000 7f5bfa6709c0 20 add_watcher() i=0 2024-09-12T00:36:58.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.471+0000 7f5bfa6709c0 20 add_watcher() i=1 2024-09-12T00:36:58.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.471+0000 7f5bfa6709c0 20 add_watcher() i=2 2024-09-12T00:36:58.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.471+0000 7f5bfa6709c0 20 add_watcher() i=3 2024-09-12T00:36:58.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.471+0000 7f5bfa6709c0 20 add_watcher() i=4 2024-09-12T00:36:58.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.471+0000 7f5bfa6709c0 20 add_watcher() i=5 2024-09-12T00:36:58.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.471+0000 7f5bfa6709c0 20 add_watcher() i=6 2024-09-12T00:36:58.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.475+0000 7f5bfa6709c0 20 add_watcher() i=7 2024-09-12T00:36:58.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.475+0000 7f5bfa6709c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:58.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5aaefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:58.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:58.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:58.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 5 note: GC not initialized 2024-09-12T00:36:58.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5aadfdb640 20 reqs_thread_entry: start 2024-09-12T00:36:58.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:58.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 20 Filter name: none 2024-09-12T00:36:58.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5a1f7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:58.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:36:58.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:58.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:36:58.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:36:58.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 : miss 2024-09-12T00:36:58.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:58.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:58.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:58.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:58.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:58.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.479+0000 7f5bfa6709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 2024-09-12T00:36:58.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.491+0000 7f5bfa6709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:58.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.491+0000 7f5bfa6709c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:58.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.491+0000 7f5bfa6709c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:58.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.491+0000 7f5bfa6709c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32, ofs0, ns] 2024-09-12T00:36:58.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.491+0000 7f5acf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333541 cookie 94045371265824 notifier 6971 bl.length()=931 2024-09-12T00:36:58.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.491+0000 7f5acf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:58.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.491+0000 7f5acf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:58.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.491+0000 7f5acf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:58.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.491+0000 7f5bfa6709c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_sources= new_sources= 2024-09-12T00:36:58.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.491+0000 7f5bfa6709c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential sources added=[] removed=[] 2024-09-12T00:36:58.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.491+0000 7f5bfa6709c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_dests= new_dests= 2024-09-12T00:36:58.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.491+0000 7f5bfa6709c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential dests added=[] removed=[] 2024-09-12T00:36:58.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.0 2024-09-12T00:36:58.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.0 2024-09-12T00:36:58.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.1 2024-09-12T00:36:58.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.1 2024-09-12T00:36:58.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.2 2024-09-12T00:36:58.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.2 2024-09-12T00:36:58.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.3 2024-09-12T00:36:58.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.3 2024-09-12T00:36:58.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.4 2024-09-12T00:36:58.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.4 2024-09-12T00:36:58.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.5 2024-09-12T00:36:58.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.5 2024-09-12T00:36:58.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.6 2024-09-12T00:36:58.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.6 2024-09-12T00:36:58.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.7 2024-09-12T00:36:58.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.7 2024-09-12T00:36:58.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.8 2024-09-12T00:36:58.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.8 2024-09-12T00:36:58.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.9 2024-09-12T00:36:58.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.9 2024-09-12T00:36:58.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.10 2024-09-12T00:36:58.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.10 2024-09-12T00:36:58.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.11 2024-09-12T00:36:58.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1.11 2024-09-12T00:36:58.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.0 2024-09-12T00:36:58.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1 2024-09-12T00:36:58.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.507+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.2 2024-09-12T00:36:58.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.511+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.3 2024-09-12T00:36:58.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.511+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.4 2024-09-12T00:36:58.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.511+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.5 2024-09-12T00:36:58.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.515+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.6 2024-09-12T00:36:58.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.515+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.7 2024-09-12T00:36:58.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.515+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.8 2024-09-12T00:36:58.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.515+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.9 2024-09-12T00:36:58.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.519+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.10 2024-09-12T00:36:58.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.523+0000 7f5bfa6709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:58.519 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.523+0000 7f5bfa6709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 2024-09-12T00:36:58.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.527+0000 7f5bfa6709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:58.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.527+0000 7f5bfa6709c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:58.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.527+0000 7f5bfa6709c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:58.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.527+0000 7f5bfa6709c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32, ofs0, ns] 2024-09-12T00:36:58.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.527+0000 7f5aceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333542 cookie 94045371265824 notifier 6971 bl.length()=931 2024-09-12T00:36:58.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.527+0000 7f5aceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:58.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.527+0000 7f5aceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:58.522 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.527+0000 7f5aceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:58.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.527+0000 7f5bfa6709c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_sources= new_sources= 2024-09-12T00:36:58.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.527+0000 7f5bfa6709c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential sources added=[] removed=[] 2024-09-12T00:36:58.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.527+0000 7f5bfa6709c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_dests= new_dests= 2024-09-12T00:36:58.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.527+0000 7f5bfa6709c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential dests added=[] removed=[] 2024-09-12T00:36:58.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.531+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.0 2024-09-12T00:36:58.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.531+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.1 2024-09-12T00:36:58.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.535+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.2 2024-09-12T00:36:58.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.535+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.3 2024-09-12T00:36:58.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.535+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.4 2024-09-12T00:36:58.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.535+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.5 2024-09-12T00:36:58.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.535+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.6 2024-09-12T00:36:58.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.539+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.7 2024-09-12T00:36:58.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.539+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.8 2024-09-12T00:36:58.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.539+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.9 2024-09-12T00:36:58.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.539+0000 7f5bfa6709c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.32.10 2024-09-12T00:36:58.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.539+0000 7f5bfa6709c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:58.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.539+0000 7f5bfa6709c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 2024-09-12T00:36:58.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.543+0000 7f5bfa6709c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:58.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.543+0000 7f5bfa6709c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:58.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.543+0000 7f5bfa6709c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:58.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.543+0000 7f5bfa6709c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32, ofs0, ns] 2024-09-12T00:36:58.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.543+0000 7f5acf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333543 cookie 94045371265824 notifier 6971 bl.length()=899 2024-09-12T00:36:58.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.543+0000 7f5acf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 info.flags=0x17 2024-09-12T00:36:58.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.543+0000 7f5acf7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:e2043445-c131-4520-984d-b4d52f038a6b.4538.32 to cache LRU end 2024-09-12T00:36:58.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.543+0000 7f5acf7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:36:58.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.543+0000 7f5bfa6709c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_sources= new_sources= 2024-09-12T00:36:58.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.543+0000 7f5bfa6709c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential sources added=[] removed=[] 2024-09-12T00:36:58.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.543+0000 7f5bfa6709c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): orig_dests= new_dests= 2024-09-12T00:36:58.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.543+0000 7f5bfa6709c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[e2043445-c131-4520-984d-b4d52f038a6b.4538.32]): potential dests added=[] removed=[] 2024-09-12T00:36:58.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.551+0000 7f5bfa6709c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:36:58.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.555+0000 7f5aaefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:58.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.559+0000 7f5bfa6709c0 20 remove_watcher() i=0 2024-09-12T00:36:58.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.559+0000 7f5bfa6709c0 2 removed watcher, disabling cache 2024-09-12T00:36:58.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.559+0000 7f5bfa6709c0 20 remove_watcher() i=1 2024-09-12T00:36:58.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.563+0000 7f5bfa6709c0 20 remove_watcher() i=2 2024-09-12T00:36:58.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.567+0000 7f5bfa6709c0 20 remove_watcher() i=3 2024-09-12T00:36:58.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.567+0000 7f5bfa6709c0 20 remove_watcher() i=4 2024-09-12T00:36:58.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.571+0000 7f5bfa6709c0 20 remove_watcher() i=5 2024-09-12T00:36:58.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.571+0000 7f5bfa6709c0 20 remove_watcher() i=6 2024-09-12T00:36:58.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.575+0000 7f5bfa6709c0 20 remove_watcher() i=7 2024-09-12T00:36:58.589 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:36:58.618 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:58.618 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:58.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.667+0000 7f87b597a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.667+0000 7f87b597a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.667+0000 7f87b597a9c0 20 realm 2024-09-12T00:36:58.665 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.667+0000 7f87b597a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.671+0000 7f87b597a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.671+0000 7f87b597a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:58.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.671+0000 7f87b597a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.671+0000 7f87b597a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.671+0000 7f87b597a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.671+0000 7f87b597a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:58.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.671+0000 7f87b597a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.671+0000 7f87b597a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:58.667 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.671+0000 7f87b597a9c0 20 searching for the correct realm 2024-09-12T00:36:58.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.675+0000 7f87b2c7f640 0 -- 172.21.15.138:0/579454351 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f87a40c2ba0 msgr2=0x7f87a40e8ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:58.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.887+0000 7f87b2c7f640 0 -- 172.21.15.138:0/579454351 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x559b6aa0da80 msgr2=0x559b6aa0fe70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:58.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.903+0000 7f87b597a9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:58.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.903+0000 7f87b597a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:58.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.903+0000 7f87b597a9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:58.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.903+0000 7f87b597a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:58.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.903+0000 7f87b597a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:58.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.903+0000 7f87b597a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:58.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.903+0000 7f87b597a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.903+0000 7f87b597a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.903+0000 7f87b597a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.907+0000 7f87b597a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:58.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.907+0000 7f87b597a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.907+0000 7f87b597a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:58.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.907+0000 7f87b597a9c0 20 zone default found 2024-09-12T00:36:58.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.907+0000 7f87b597a9c0 4 Realm: () 2024-09-12T00:36:58.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.907+0000 7f87b597a9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:58.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.907+0000 7f87b597a9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:58.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.907+0000 7f87b597a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:58.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.907+0000 7f87b597a9c0 20 zonegroup default 2024-09-12T00:36:58.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.907+0000 7f87b597a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.907+0000 7f87b597a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.907+0000 7f87b597a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.907+0000 7f87b597a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.907+0000 7f87b597a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.907+0000 7f87b597a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:58.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.907+0000 7f87b597a9c0 20 started sync module instance, tier type = 2024-09-12T00:36:58.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.907+0000 7f87b597a9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:58.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.931+0000 7f87b597a9c0 20 add_watcher() i=0 2024-09-12T00:36:58.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.931+0000 7f87b597a9c0 20 add_watcher() i=1 2024-09-12T00:36:58.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.931+0000 7f87b597a9c0 20 add_watcher() i=2 2024-09-12T00:36:58.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.931+0000 7f87b597a9c0 20 add_watcher() i=3 2024-09-12T00:36:58.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.931+0000 7f87b597a9c0 20 add_watcher() i=4 2024-09-12T00:36:58.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.931+0000 7f87b597a9c0 20 add_watcher() i=5 2024-09-12T00:36:58.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.931+0000 7f87b597a9c0 20 add_watcher() i=6 2024-09-12T00:36:58.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.935+0000 7f87b597a9c0 20 add_watcher() i=7 2024-09-12T00:36:58.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.935+0000 7f87b597a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:58.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.939+0000 7f8669fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:58.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.939+0000 7f87b597a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:58.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.939+0000 7f87b597a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:58.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.939+0000 7f87b597a9c0 5 note: GC not initialized 2024-09-12T00:36:58.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.939+0000 7f8668fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:58.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.939+0000 7f87b597a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:58.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.939+0000 7f87b597a9c0 20 Filter name: none 2024-09-12T00:36:58.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.939+0000 7f85e27fc640 20 reqs_thread_entry: start 2024-09-12T00:36:58.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.939+0000 7f87b597a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.939+0000 7f87b597a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:58.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.939+0000 7f87b597a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.939+0000 7f87b597a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:58.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.939+0000 7f87b597a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:58.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.939+0000 7f87b597a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.943+0000 7f87b597a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:36:58.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.943+0000 7f87b597a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:58.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.943+0000 7f87b597a9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:36:58.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.943+0000 7f87b597a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:58.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.947+0000 7f8669fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:58.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.951+0000 7f87b597a9c0 20 remove_watcher() i=0 2024-09-12T00:36:58.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.951+0000 7f87b597a9c0 2 removed watcher, disabling cache 2024-09-12T00:36:58.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.951+0000 7f87b597a9c0 20 remove_watcher() i=1 2024-09-12T00:36:58.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.955+0000 7f87b597a9c0 20 remove_watcher() i=2 2024-09-12T00:36:58.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.955+0000 7f87b597a9c0 20 remove_watcher() i=3 2024-09-12T00:36:58.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.959+0000 7f87b597a9c0 20 remove_watcher() i=4 2024-09-12T00:36:58.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.959+0000 7f87b597a9c0 20 remove_watcher() i=5 2024-09-12T00:36:58.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.963+0000 7f87b597a9c0 20 remove_watcher() i=6 2024-09-12T00:36:58.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:58.967+0000 7f87b597a9c0 20 remove_watcher() i=7 2024-09-12T00:36:58.977 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:58.977 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:36:58.977 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-commit-target-layout id: e2043445-c131-4520-984d-b4d52f038a6b.4538.32 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:36:58.977 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:58.978 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:58.978 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:58.982 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:58.982 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.028 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.028 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.089 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T00:36:59.089 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:59.092 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.092 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.126 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.126 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.172 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.172 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.193 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.193 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.208 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.208 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.228 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.229 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.251 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.251 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.271 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.271 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.295 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.296 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.317 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.317 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.391 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.392 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.409 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.409 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.428 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.428 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.449 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.449 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.469 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.469 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.490 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.490 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.510 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.510 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.530 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.530 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.553 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.553 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.574 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.574 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.595 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.595 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.614 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:36:59.614 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:36:59.633 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:36:59.666 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:59.666 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:59.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.715+0000 7fae7e05c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.719+0000 7fae7e05c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.719+0000 7fae7e05c9c0 20 realm 2024-09-12T00:36:59.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.719+0000 7fae7e05c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.719+0000 7fae7e05c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.719+0000 7fae7e05c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:59.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.719+0000 7fae7e05c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.719+0000 7fae7e05c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.719+0000 7fae7e05c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.719+0000 7fae7e05c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:59.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.719+0000 7fae7e05c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.719+0000 7fae7e05c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:59.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.719+0000 7fae7e05c9c0 20 searching for the correct realm 2024-09-12T00:36:59.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.723+0000 7fae7c363640 0 -- 172.21.15.138:0/1117532896 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5620dfdd9f00 msgr2=0x5620dfddc3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:59.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.731+0000 7fae7c363640 0 -- 172.21.15.138:0/1117532896 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x5620dfdcd6b0 msgr2=0x5620dfdcfb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:59.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.739+0000 7fae7e05c9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:36:59.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.739+0000 7fae7e05c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:59.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.739+0000 7fae7e05c9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:36:59.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.739+0000 7fae7e05c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:59.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.739+0000 7fae7e05c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:59.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.739+0000 7fae7e05c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:59.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.739+0000 7fae7e05c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.739+0000 7fae7e05c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.739+0000 7fae7e05c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.739+0000 7fae7e05c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:59.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.739+0000 7fae7e05c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.743+0000 7fae7e05c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:59.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.743+0000 7fae7e05c9c0 20 zone default found 2024-09-12T00:36:59.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.743+0000 7fae7e05c9c0 4 Realm: () 2024-09-12T00:36:59.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.743+0000 7fae7e05c9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:36:59.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.743+0000 7fae7e05c9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:36:59.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.743+0000 7fae7e05c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:59.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.743+0000 7fae7e05c9c0 20 zonegroup default 2024-09-12T00:36:59.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.743+0000 7fae7e05c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.743+0000 7fae7e05c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.743+0000 7fae7e05c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.743+0000 7fae7e05c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.743+0000 7fae7e05c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.743+0000 7fae7e05c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.743+0000 7fae7e05c9c0 20 started sync module instance, tier type = 2024-09-12T00:36:59.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.743+0000 7fae7e05c9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:36:59.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.763+0000 7fae7e05c9c0 20 add_watcher() i=0 2024-09-12T00:36:59.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.763+0000 7fae7e05c9c0 20 add_watcher() i=1 2024-09-12T00:36:59.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.763+0000 7fae7e05c9c0 20 add_watcher() i=2 2024-09-12T00:36:59.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.763+0000 7fae7e05c9c0 20 add_watcher() i=3 2024-09-12T00:36:59.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.763+0000 7fae7e05c9c0 20 add_watcher() i=4 2024-09-12T00:36:59.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.763+0000 7fae7e05c9c0 20 add_watcher() i=5 2024-09-12T00:36:59.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.763+0000 7fae7e05c9c0 20 add_watcher() i=6 2024-09-12T00:36:59.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.763+0000 7fae7e05c9c0 20 add_watcher() i=7 2024-09-12T00:36:59.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.763+0000 7fae7e05c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:59.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.771+0000 7fad31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:59.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.771+0000 7fae7e05c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:59.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.771+0000 7fae7e05c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:59.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.771+0000 7fae7e05c9c0 5 note: GC not initialized 2024-09-12T00:36:59.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.771+0000 7fad30fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:59.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.771+0000 7fae7e05c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:59.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.771+0000 7fae7e05c9c0 20 Filter name: none 2024-09-12T00:36:59.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.771+0000 7facaa7fc640 20 reqs_thread_entry: start 2024-09-12T00:36:59.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.771+0000 7fae7e05c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.771+0000 7fae7e05c9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:36:59.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.771+0000 7fae7e05c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.775+0000 7fae7e05c9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:36:59.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.775+0000 7fae7e05c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:59.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.775+0000 7fae7e05c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.775+0000 7fae7e05c9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:36:59.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.775+0000 7fae7e05c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.775+0000 7fae7e05c9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:36:59.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.775+0000 7fae7e05c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:59.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.779+0000 7fad31fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:59.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.783+0000 7fae7e05c9c0 20 remove_watcher() i=0 2024-09-12T00:36:59.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.783+0000 7fae7e05c9c0 2 removed watcher, disabling cache 2024-09-12T00:36:59.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.783+0000 7fae7e05c9c0 20 remove_watcher() i=1 2024-09-12T00:36:59.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.787+0000 7fae7e05c9c0 20 remove_watcher() i=2 2024-09-12T00:36:59.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.787+0000 7fae7e05c9c0 20 remove_watcher() i=3 2024-09-12T00:36:59.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.791+0000 7fae7e05c9c0 20 remove_watcher() i=4 2024-09-12T00:36:59.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.791+0000 7fae7e05c9c0 20 remove_watcher() i=5 2024-09-12T00:36:59.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.795+0000 7fae7e05c9c0 20 remove_watcher() i=6 2024-09-12T00:36:59.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.799+0000 7fae7e05c9c0 20 remove_watcher() i=7 2024-09-12T00:36:59.807 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:59.807 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:36:59.807 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-do-reshard id: e2043445-c131-4520-984d-b4d52f038a6b.4538.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:36:59.807 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:36:59.808 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T00:36:59.841 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:59.841 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:59.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.887+0000 7fd97abc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.891+0000 7fd97abc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.891+0000 7fd97abc89c0 20 realm 2024-09-12T00:36:59.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.891+0000 7fd97abc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.891+0000 7fd97abc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.891+0000 7fd97abc89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:59.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.891+0000 7fd97abc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.891+0000 7fd97abc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:59.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.891+0000 7fd97abc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.891+0000 7fd97abc89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:59.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.891+0000 7fd97abc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:59.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.895+0000 7fd97abc89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:59.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.895+0000 7fd97abc89c0 20 searching for the correct realm 2024-09-12T00:36:59.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:36:59.899+0000 7fd978ecf640 0 -- 172.21.15.138:0/2837189362 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fd970024900 msgr2=0x7fd9700183f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:00.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.115+0000 7fd978ecf640 0 -- 172.21.15.138:0/2837189362 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5619ef5f17c0 msgr2=0x5619ef5f3c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:00.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.123+0000 7fd97abc89c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:00.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.123+0000 7fd97abc89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:00.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.123+0000 7fd97abc89c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:00.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.123+0000 7fd97abc89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:00.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.123+0000 7fd97abc89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:00.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.123+0000 7fd97abc89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:00.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.123+0000 7fd97abc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.123+0000 7fd97abc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.123+0000 7fd97abc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.123+0000 7fd97abc89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:00.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.123+0000 7fd97abc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.127+0000 7fd97abc89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:00.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.127+0000 7fd97abc89c0 20 zone default found 2024-09-12T00:37:00.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.127+0000 7fd97abc89c0 4 Realm: () 2024-09-12T00:37:00.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.127+0000 7fd97abc89c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:00.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.127+0000 7fd97abc89c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:00.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.127+0000 7fd97abc89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:00.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.127+0000 7fd97abc89c0 20 zonegroup default 2024-09-12T00:37:00.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.127+0000 7fd97abc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.127+0000 7fd97abc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.127+0000 7fd97abc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.127+0000 7fd97abc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.127+0000 7fd97abc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.127+0000 7fd97abc89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.127+0000 7fd97abc89c0 20 started sync module instance, tier type = 2024-09-12T00:37:00.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.127+0000 7fd97abc89c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:00.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.147+0000 7fd97abc89c0 20 add_watcher() i=0 2024-09-12T00:37:00.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.147+0000 7fd97abc89c0 20 add_watcher() i=1 2024-09-12T00:37:00.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.147+0000 7fd97abc89c0 20 add_watcher() i=2 2024-09-12T00:37:00.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.147+0000 7fd97abc89c0 20 add_watcher() i=3 2024-09-12T00:37:00.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.147+0000 7fd97abc89c0 20 add_watcher() i=4 2024-09-12T00:37:00.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.147+0000 7fd97abc89c0 20 add_watcher() i=5 2024-09-12T00:37:00.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.147+0000 7fd97abc89c0 20 add_watcher() i=6 2024-09-12T00:37:00.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.151+0000 7fd97abc89c0 20 add_watcher() i=7 2024-09-12T00:37:00.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.151+0000 7fd97abc89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:00.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.155+0000 7fd82e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:00.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.155+0000 7fd97abc89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:00.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.155+0000 7fd97abc89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:00.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.155+0000 7fd97abc89c0 5 note: GC not initialized 2024-09-12T00:37:00.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.155+0000 7fd82d7e2640 20 reqs_thread_entry: start 2024-09-12T00:37:00.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.155+0000 7fd97abc89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:00.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.155+0000 7fd97abc89c0 20 Filter name: none 2024-09-12T00:37:00.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.155+0000 7fd79effd640 20 reqs_thread_entry: start 2024-09-12T00:37:00.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.155+0000 7fd97abc89c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:37:00.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.155+0000 7fd97abc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.159+0000 7fd97abc89c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:37:00.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.159+0000 7fd97abc89c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:37:00.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.159+0000 7fd97abc89c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:37:00.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.159+0000 7fd97abc89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 : miss 2024-09-12T00:37:00.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.159+0000 7fd97abc89c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.159+0000 7fd97abc89c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:37:00.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.159+0000 7fd97abc89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 info.flags=0x17 2024-09-12T00:37:00.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.159+0000 7fd97abc89c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 to cache LRU end 2024-09-12T00:37:00.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.159+0000 7fd97abc89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:00.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.159+0000 7fd97abc89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:00.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.159+0000 7fd97abc89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 2024-09-12T00:37:00.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.171+0000 7fd97abc89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 info.flags=0x17 2024-09-12T00:37:00.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.171+0000 7fd97abc89c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 to cache LRU end 2024-09-12T00:37:00.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.171+0000 7fd97abc89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:00.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.171+0000 7fd97abc89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33, ofs0, ns] 2024-09-12T00:37:00.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.171+0000 7fd8577fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333566 cookie 94669390183936 notifier 7022 bl.length()=911 2024-09-12T00:37:00.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.171+0000 7fd8577fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 info.flags=0x17 2024-09-12T00:37:00.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.171+0000 7fd8577fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 to cache LRU end 2024-09-12T00:37:00.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.171+0000 7fd8577fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:00.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.171+0000 7fd97abc89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): orig_sources= new_sources= 2024-09-12T00:37:00.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.171+0000 7fd97abc89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): potential sources added=[] removed=[] 2024-09-12T00:37:00.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.171+0000 7fd97abc89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): orig_dests= new_dests= 2024-09-12T00:37:00.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.171+0000 7fd97abc89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): potential dests added=[] removed=[] 2024-09-12T00:37:00.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.183+0000 7fd97abc89c0 -1 Injecting error=-5 at location=do_reshard 2024-09-12T00:37:00.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.195+0000 7fd97abc89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:00.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.195+0000 7fd97abc89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 2024-09-12T00:37:00.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.199+0000 7fd97abc89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 info.flags=0x17 2024-09-12T00:37:00.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.199+0000 7fd97abc89c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 to cache LRU end 2024-09-12T00:37:00.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.199+0000 7fd97abc89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:00.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.199+0000 7fd97abc89c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33, ofs0, ns] 2024-09-12T00:37:00.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.199+0000 7fd856ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333567 cookie 94669390183936 notifier 7022 bl.length()=879 2024-09-12T00:37:00.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.199+0000 7fd856ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 info.flags=0x17 2024-09-12T00:37:00.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.199+0000 7fd856ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 to cache LRU end 2024-09-12T00:37:00.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.199+0000 7fd856ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:00.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.203+0000 7fd97abc89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): orig_sources= new_sources= 2024-09-12T00:37:00.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.203+0000 7fd97abc89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): potential sources added=[] removed=[] 2024-09-12T00:37:00.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.203+0000 7fd97abc89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): orig_dests= new_dests= 2024-09-12T00:37:00.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.203+0000 7fd97abc89c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): potential dests added=[] removed=[] 2024-09-12T00:37:00.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.203+0000 7fd97abc89c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T00:37:00.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.203+0000 7fd82e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:00.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.207+0000 7fd97abc89c0 20 remove_watcher() i=0 2024-09-12T00:37:00.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.207+0000 7fd97abc89c0 2 removed watcher, disabling cache 2024-09-12T00:37:00.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.211+0000 7fd97abc89c0 20 remove_watcher() i=1 2024-09-12T00:37:00.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.211+0000 7fd97abc89c0 20 remove_watcher() i=2 2024-09-12T00:37:00.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.215+0000 7fd97abc89c0 20 remove_watcher() i=3 2024-09-12T00:37:00.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.215+0000 7fd97abc89c0 20 remove_watcher() i=4 2024-09-12T00:37:00.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.219+0000 7fd97abc89c0 20 remove_watcher() i=5 2024-09-12T00:37:00.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.219+0000 7fd97abc89c0 20 remove_watcher() i=6 2024-09-12T00:37:00.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.223+0000 7fd97abc89c0 20 remove_watcher() i=7 2024-09-12T00:37:00.234 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:37:00.264 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:00.264 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:00.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.311+0000 7f49f0b249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.315+0000 7f49f0b249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.315+0000 7f49f0b249c0 20 realm 2024-09-12T00:37:00.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.315+0000 7f49f0b249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.315+0000 7f49f0b249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.315+0000 7f49f0b249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:00.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.315+0000 7f49f0b249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.315+0000 7f49f0b249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.315+0000 7f49f0b249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.315+0000 7f49f0b249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:00.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.315+0000 7f49f0b249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.315+0000 7f49f0b249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:00.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.315+0000 7f49f0b249c0 20 searching for the correct realm 2024-09-12T00:37:00.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.323+0000 7f49eee2b640 0 -- 172.21.15.138:0/318450429 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f49e8004040 msgr2=0x7f49e8104280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:00.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.539+0000 7f49eee2b640 0 -- 172.21.15.138:0/318450429 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55869bfd0890 msgr2=0x55869bfd2d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:00.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:00.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:00.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:00.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:00.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:00.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:00.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:00.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:00.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 20 zone default found 2024-09-12T00:37:00.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 4 Realm: () 2024-09-12T00:37:00.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:00.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:00.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:00.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 20 zonegroup default 2024-09-12T00:37:00.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.547+0000 7f49f0b249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.551+0000 7f49f0b249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.551+0000 7f49f0b249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.551+0000 7f49f0b249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.551+0000 7f49f0b249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.551+0000 7f49f0b249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.551+0000 7f49f0b249c0 20 started sync module instance, tier type = 2024-09-12T00:37:00.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.551+0000 7f49f0b249c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:00.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.575+0000 7f49f0b249c0 20 add_watcher() i=0 2024-09-12T00:37:00.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.575+0000 7f49f0b249c0 20 add_watcher() i=1 2024-09-12T00:37:00.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.575+0000 7f49f0b249c0 20 add_watcher() i=2 2024-09-12T00:37:00.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.575+0000 7f49f0b249c0 20 add_watcher() i=3 2024-09-12T00:37:00.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.575+0000 7f49f0b249c0 20 add_watcher() i=4 2024-09-12T00:37:00.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.575+0000 7f49f0b249c0 20 add_watcher() i=5 2024-09-12T00:37:00.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.575+0000 7f49f0b249c0 20 add_watcher() i=6 2024-09-12T00:37:00.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.575+0000 7f49f0b249c0 20 add_watcher() i=7 2024-09-12T00:37:00.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.575+0000 7f49f0b249c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:00.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.579+0000 7f48a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:00.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.579+0000 7f49f0b249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:00.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.579+0000 7f49f0b249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:00.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.579+0000 7f49f0b249c0 5 note: GC not initialized 2024-09-12T00:37:00.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.579+0000 7f481f7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:00.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.579+0000 7f49f0b249c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:00.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.579+0000 7f49f0b249c0 20 Filter name: none 2024-09-12T00:37:00.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.579+0000 7f481d7fa640 20 reqs_thread_entry: start 2024-09-12T00:37:00.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.579+0000 7f49f0b249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.583+0000 7f49f0b249c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:37:00.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.583+0000 7f49f0b249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.583+0000 7f49f0b249c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:37:00.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.583+0000 7f49f0b249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:00.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.583+0000 7f49f0b249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.583+0000 7f49f0b249c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:37:00.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.583+0000 7f49f0b249c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.583+0000 7f49f0b249c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:37:00.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.583+0000 7f49f0b249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:00.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.587+0000 7f48a4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:00.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.591+0000 7f49f0b249c0 20 remove_watcher() i=0 2024-09-12T00:37:00.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.591+0000 7f49f0b249c0 2 removed watcher, disabling cache 2024-09-12T00:37:00.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.591+0000 7f49f0b249c0 20 remove_watcher() i=1 2024-09-12T00:37:00.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.595+0000 7f49f0b249c0 20 remove_watcher() i=2 2024-09-12T00:37:00.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.595+0000 7f49f0b249c0 20 remove_watcher() i=3 2024-09-12T00:37:00.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.599+0000 7f49f0b249c0 20 remove_watcher() i=4 2024-09-12T00:37:00.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.603+0000 7f49f0b249c0 20 remove_watcher() i=5 2024-09-12T00:37:00.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.603+0000 7f49f0b249c0 20 remove_watcher() i=6 2024-09-12T00:37:00.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.607+0000 7f49f0b249c0 20 remove_watcher() i=7 2024-09-12T00:37:00.618 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:00.618 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:37:00.618 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-do-reshard id: e2043445-c131-4520-984d-b4d52f038a6b.4538.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:00.618 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:00.619 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:00.620 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:00.634 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:00.634 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:00.678 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:37:00.714 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:00.714 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:00.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.763+0000 7fa420fd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.767+0000 7fa420fd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.767+0000 7fa420fd09c0 20 realm 2024-09-12T00:37:00.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.767+0000 7fa420fd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.767+0000 7fa420fd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.767+0000 7fa420fd09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:00.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.767+0000 7fa420fd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.767+0000 7fa420fd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.767+0000 7fa420fd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.771+0000 7fa420fd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:00.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.771+0000 7fa420fd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.771+0000 7fa420fd09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:00.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.771+0000 7fa420fd09c0 20 searching for the correct realm 2024-09-12T00:37:00.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.775+0000 7fa41f2d7640 0 -- 172.21.15.138:0/3392039849 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fa418069600 msgr2=0x7fa418016740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:00.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.991+0000 7fa41f2d7640 0 -- 172.21.15.138:0/3392039849 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55648f757880 msgr2=0x55648f759d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:00.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.999+0000 7fa420fd09c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:00.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.999+0000 7fa420fd09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:00.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.999+0000 7fa420fd09c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:00.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.999+0000 7fa420fd09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:00.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.999+0000 7fa420fd09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:00.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.999+0000 7fa420fd09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:00.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.999+0000 7fa420fd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.999+0000 7fa420fd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.999+0000 7fa420fd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.999+0000 7fa420fd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:00.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:00.999+0000 7fa420fd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.003+0000 7fa420fd09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:00.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.003+0000 7fa420fd09c0 20 zone default found 2024-09-12T00:37:00.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.003+0000 7fa420fd09c0 4 Realm: () 2024-09-12T00:37:00.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.003+0000 7fa420fd09c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:00.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.003+0000 7fa420fd09c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:00.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.003+0000 7fa420fd09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:00.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.003+0000 7fa420fd09c0 20 zonegroup default 2024-09-12T00:37:00.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.003+0000 7fa420fd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.003+0000 7fa420fd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.998 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.003+0000 7fa420fd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:00.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.003+0000 7fa420fd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:00.999 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.003+0000 7fa420fd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.003+0000 7fa420fd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.003+0000 7fa420fd09c0 20 started sync module instance, tier type = 2024-09-12T00:37:01.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.003+0000 7fa420fd09c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:01.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.027+0000 7fa420fd09c0 20 add_watcher() i=0 2024-09-12T00:37:01.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.027+0000 7fa420fd09c0 20 add_watcher() i=1 2024-09-12T00:37:01.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.027+0000 7fa420fd09c0 20 add_watcher() i=2 2024-09-12T00:37:01.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.027+0000 7fa420fd09c0 20 add_watcher() i=3 2024-09-12T00:37:01.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.027+0000 7fa420fd09c0 20 add_watcher() i=4 2024-09-12T00:37:01.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.027+0000 7fa420fd09c0 20 add_watcher() i=5 2024-09-12T00:37:01.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.027+0000 7fa420fd09c0 20 add_watcher() i=6 2024-09-12T00:37:01.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.031+0000 7fa420fd09c0 20 add_watcher() i=7 2024-09-12T00:37:01.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.031+0000 7fa420fd09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:01.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.035+0000 7fa2d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:01.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.035+0000 7fa420fd09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:01.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.035+0000 7fa420fd09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:01.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.035+0000 7fa420fd09c0 5 note: GC not initialized 2024-09-12T00:37:01.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.035+0000 7fa24ffff640 20 reqs_thread_entry: start 2024-09-12T00:37:01.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.035+0000 7fa420fd09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:01.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.035+0000 7fa420fd09c0 20 Filter name: none 2024-09-12T00:37:01.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.035+0000 7fa24dffb640 20 reqs_thread_entry: start 2024-09-12T00:37:01.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.039+0000 7fa420fd09c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:37:01.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.039+0000 7fa420fd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.039+0000 7fa420fd09c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:37:01.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.039+0000 7fa420fd09c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:37:01.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.039+0000 7fa420fd09c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:37:01.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.039+0000 7fa420fd09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 : miss 2024-09-12T00:37:01.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.039+0000 7fa420fd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.039+0000 7fa420fd09c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:37:01.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.039+0000 7fa420fd09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 info.flags=0x17 2024-09-12T00:37:01.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.039+0000 7fa420fd09c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 to cache LRU end 2024-09-12T00:37:01.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.039+0000 7fa420fd09c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:01.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.039+0000 7fa420fd09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:01.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.039+0000 7fa420fd09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 2024-09-12T00:37:01.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.051+0000 7fa420fd09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 info.flags=0x17 2024-09-12T00:37:01.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.051+0000 7fa420fd09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 to cache LRU end 2024-09-12T00:37:01.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.051+0000 7fa420fd09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:01.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.051+0000 7fa420fd09c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33, ofs0, ns] 2024-09-12T00:37:01.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.051+0000 7fa3027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333568 cookie 93890391960320 notifier 7509 bl.length()=911 2024-09-12T00:37:01.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.051+0000 7fa3027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 info.flags=0x17 2024-09-12T00:37:01.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.051+0000 7fa3027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 to cache LRU end 2024-09-12T00:37:01.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.051+0000 7fa3027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:01.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.051+0000 7fa420fd09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): orig_sources= new_sources= 2024-09-12T00:37:01.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.051+0000 7fa420fd09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): potential sources added=[] removed=[] 2024-09-12T00:37:01.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.051+0000 7fa420fd09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): orig_dests= new_dests= 2024-09-12T00:37:01.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.051+0000 7fa420fd09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): potential dests added=[] removed=[] 2024-09-12T00:37:01.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.0 2024-09-12T00:37:01.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.0 2024-09-12T00:37:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.1 2024-09-12T00:37:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.1 2024-09-12T00:37:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.2 2024-09-12T00:37:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.2 2024-09-12T00:37:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.3 2024-09-12T00:37:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.3 2024-09-12T00:37:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.4 2024-09-12T00:37:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.4 2024-09-12T00:37:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.5 2024-09-12T00:37:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.5 2024-09-12T00:37:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.6 2024-09-12T00:37:01.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.6 2024-09-12T00:37:01.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.7 2024-09-12T00:37:01.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.7 2024-09-12T00:37:01.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.8 2024-09-12T00:37:01.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.8 2024-09-12T00:37:01.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.9 2024-09-12T00:37:01.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.9 2024-09-12T00:37:01.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.10 2024-09-12T00:37:01.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.10 2024-09-12T00:37:01.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.11 2024-09-12T00:37:01.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1.11 2024-09-12T00:37:01.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.063+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.0 2024-09-12T00:37:01.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.067+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1 2024-09-12T00:37:01.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.067+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.2 2024-09-12T00:37:01.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.067+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.3 2024-09-12T00:37:01.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.067+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.4 2024-09-12T00:37:01.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.071+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.5 2024-09-12T00:37:01.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.071+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.6 2024-09-12T00:37:01.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.071+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.7 2024-09-12T00:37:01.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.071+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.8 2024-09-12T00:37:01.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.071+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.9 2024-09-12T00:37:01.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.075+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.10 2024-09-12T00:37:01.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.083+0000 7fa420fd09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:01.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.083+0000 7fa420fd09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 2024-09-12T00:37:01.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.087+0000 7fa420fd09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 info.flags=0x17 2024-09-12T00:37:01.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.087+0000 7fa420fd09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 to cache LRU end 2024-09-12T00:37:01.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.087+0000 7fa420fd09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:01.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.087+0000 7fa420fd09c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33, ofs0, ns] 2024-09-12T00:37:01.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.087+0000 7fa3027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333569 cookie 93890391960320 notifier 7509 bl.length()=911 2024-09-12T00:37:01.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.087+0000 7fa3027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 info.flags=0x17 2024-09-12T00:37:01.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.087+0000 7fa3027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 to cache LRU end 2024-09-12T00:37:01.083 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.087+0000 7fa3027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:01.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.087+0000 7fa420fd09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): orig_sources= new_sources= 2024-09-12T00:37:01.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.087+0000 7fa420fd09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): potential sources added=[] removed=[] 2024-09-12T00:37:01.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.087+0000 7fa420fd09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): orig_dests= new_dests= 2024-09-12T00:37:01.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.087+0000 7fa420fd09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): potential dests added=[] removed=[] 2024-09-12T00:37:01.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.095+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.0 2024-09-12T00:37:01.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.095+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.1 2024-09-12T00:37:01.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.095+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.2 2024-09-12T00:37:01.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.095+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.3 2024-09-12T00:37:01.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.099+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.4 2024-09-12T00:37:01.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.099+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.5 2024-09-12T00:37:01.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.099+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.6 2024-09-12T00:37:01.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.099+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.7 2024-09-12T00:37:01.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.099+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.8 2024-09-12T00:37:01.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.099+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.9 2024-09-12T00:37:01.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.099+0000 7fa420fd09c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.33.10 2024-09-12T00:37:01.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.099+0000 7fa420fd09c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:01.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.099+0000 7fa420fd09c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 2024-09-12T00:37:01.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.103+0000 7fa420fd09c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 info.flags=0x17 2024-09-12T00:37:01.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.103+0000 7fa420fd09c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 to cache LRU end 2024-09-12T00:37:01.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.103+0000 7fa420fd09c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:01.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.103+0000 7fa420fd09c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33, ofs0, ns] 2024-09-12T00:37:01.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.103+0000 7fa3027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333570 cookie 93890391960320 notifier 7509 bl.length()=879 2024-09-12T00:37:01.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.103+0000 7fa3027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 info.flags=0x17 2024-09-12T00:37:01.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.103+0000 7fa3027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.33 to cache LRU end 2024-09-12T00:37:01.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.103+0000 7fa3027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:01.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.107+0000 7fa420fd09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): orig_sources= new_sources= 2024-09-12T00:37:01.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.107+0000 7fa420fd09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): potential sources added=[] removed=[] 2024-09-12T00:37:01.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.107+0000 7fa420fd09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): orig_dests= new_dests= 2024-09-12T00:37:01.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.107+0000 7fa420fd09c0 20 handle_bi_update(): bucket=:error-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.33]): potential dests added=[] removed=[] 2024-09-12T00:37:01.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.111+0000 7fa420fd09c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T00:37:01.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.115+0000 7fa2d57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:01.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.119+0000 7fa420fd09c0 20 remove_watcher() i=0 2024-09-12T00:37:01.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.119+0000 7fa420fd09c0 2 removed watcher, disabling cache 2024-09-12T00:37:01.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.123+0000 7fa420fd09c0 20 remove_watcher() i=1 2024-09-12T00:37:01.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.123+0000 7fa420fd09c0 20 remove_watcher() i=2 2024-09-12T00:37:01.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.127+0000 7fa420fd09c0 20 remove_watcher() i=3 2024-09-12T00:37:01.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.127+0000 7fa420fd09c0 20 remove_watcher() i=4 2024-09-12T00:37:01.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.131+0000 7fa420fd09c0 20 remove_watcher() i=5 2024-09-12T00:37:01.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.131+0000 7fa420fd09c0 20 remove_watcher() i=6 2024-09-12T00:37:01.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.135+0000 7fa420fd09c0 20 remove_watcher() i=7 2024-09-12T00:37:01.147 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:37:01.177 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:01.177 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:01.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.223+0000 7f159fc479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.227+0000 7f159fc479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.227+0000 7f159fc479c0 20 realm 2024-09-12T00:37:01.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.227+0000 7f159fc479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.227+0000 7f159fc479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.227+0000 7f159fc479c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:01.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.227+0000 7f159fc479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.227+0000 7f159fc479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.227+0000 7f159fc479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.227+0000 7f159fc479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:01.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.227+0000 7f159fc479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.227+0000 7f159fc479c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:01.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.227+0000 7f159fc479c0 20 searching for the correct realm 2024-09-12T00:37:01.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.235+0000 7f159df4e640 0 -- 172.21.15.138:0/2180263767 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f1598068350 msgr2=0x7f1598092140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:01.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.451+0000 7f159df4e640 0 -- 172.21.15.138:0/2180263767 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55c4e07226e0 msgr2=0x55c4e0724ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:01.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.459+0000 7f159fc479c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:01.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.459+0000 7f159fc479c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:01.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.459+0000 7f159fc479c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:01.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.459+0000 7f159fc479c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:01.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.459+0000 7f159fc479c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:01.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.459+0000 7f159fc479c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:01.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.459+0000 7f159fc479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.463+0000 7f159fc479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.463+0000 7f159fc479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.463+0000 7f159fc479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:01.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.463+0000 7f159fc479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.463+0000 7f159fc479c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:01.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.463+0000 7f159fc479c0 20 zone default found 2024-09-12T00:37:01.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.463+0000 7f159fc479c0 4 Realm: () 2024-09-12T00:37:01.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.463+0000 7f159fc479c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:01.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.463+0000 7f159fc479c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:01.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.463+0000 7f159fc479c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:01.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.463+0000 7f159fc479c0 20 zonegroup default 2024-09-12T00:37:01.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.463+0000 7f159fc479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.463+0000 7f159fc479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.463+0000 7f159fc479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.463+0000 7f159fc479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.463+0000 7f159fc479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.467+0000 7f159fc479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:01.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.467+0000 7f159fc479c0 20 started sync module instance, tier type = 2024-09-12T00:37:01.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.467+0000 7f159fc479c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:01.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.487+0000 7f159fc479c0 20 add_watcher() i=0 2024-09-12T00:37:01.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.487+0000 7f159fc479c0 20 add_watcher() i=1 2024-09-12T00:37:01.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.487+0000 7f159fc479c0 20 add_watcher() i=2 2024-09-12T00:37:01.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.487+0000 7f159fc479c0 20 add_watcher() i=3 2024-09-12T00:37:01.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.487+0000 7f159fc479c0 20 add_watcher() i=4 2024-09-12T00:37:01.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.487+0000 7f159fc479c0 20 add_watcher() i=5 2024-09-12T00:37:01.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.487+0000 7f159fc479c0 20 add_watcher() i=6 2024-09-12T00:37:01.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.491+0000 7f159fc479c0 20 add_watcher() i=7 2024-09-12T00:37:01.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.491+0000 7f159fc479c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:01.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.495+0000 7f14537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:01.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.495+0000 7f159fc479c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:01.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.495+0000 7f159fc479c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:01.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.495+0000 7f159fc479c0 5 note: GC not initialized 2024-09-12T00:37:01.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.495+0000 7f14527e4640 20 reqs_thread_entry: start 2024-09-12T00:37:01.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.495+0000 7f159fc479c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:01.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.495+0000 7f159fc479c0 20 Filter name: none 2024-09-12T00:37:01.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.495+0000 7f13c3fff640 20 reqs_thread_entry: start 2024-09-12T00:37:01.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.495+0000 7f159fc479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.495+0000 7f159fc479c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:37:01.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.495+0000 7f159fc479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.495+0000 7f159fc479c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:37:01.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.495+0000 7f159fc479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:01.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.495+0000 7f159fc479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.499+0000 7f159fc479c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:37:01.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.499+0000 7f159fc479c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:01.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.499+0000 7f159fc479c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:37:01.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.499+0000 7f159fc479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:01.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.503+0000 7f14537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:01.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.507+0000 7f159fc479c0 20 remove_watcher() i=0 2024-09-12T00:37:01.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.507+0000 7f159fc479c0 2 removed watcher, disabling cache 2024-09-12T00:37:01.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.507+0000 7f159fc479c0 20 remove_watcher() i=1 2024-09-12T00:37:01.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.511+0000 7f159fc479c0 20 remove_watcher() i=2 2024-09-12T00:37:01.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.511+0000 7f159fc479c0 20 remove_watcher() i=3 2024-09-12T00:37:01.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.515+0000 7f159fc479c0 20 remove_watcher() i=4 2024-09-12T00:37:01.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.515+0000 7f159fc479c0 20 remove_watcher() i=5 2024-09-12T00:37:01.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.519+0000 7f159fc479c0 20 remove_watcher() i=6 2024-09-12T00:37:01.517 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:01.523+0000 7f159fc479c0 20 remove_watcher() i=7 2024-09-12T00:37:01.533 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:01.533 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:37:01.533 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-do-reshard id: e2043445-c131-4520-984d-b4d52f038a6b.4538.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:37:01.533 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:01.534 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.534 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.538 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.538 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.585 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.585 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.639 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T00:37:01.639 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:01.640 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.640 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.667 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.667 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.716 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.717 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.737 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.738 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.759 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.759 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.779 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.779 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.800 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.800 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.819 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.820 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.841 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.841 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.862 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.862 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.883 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.884 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.904 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.904 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.925 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.925 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.947 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.947 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.966 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.966 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:01.988 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:01.988 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:02.009 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.010 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:02.032 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.032 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:02.053 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.054 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:02.075 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.076 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:02.096 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.097 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:02.121 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:02.121 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:02.139 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:37:02.171 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:02.171 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:02.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.219+0000 7f91531589c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.223+0000 7f91531589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.223+0000 7f91531589c0 20 realm 2024-09-12T00:37:02.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.223+0000 7f91531589c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.223+0000 7f91531589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.223+0000 7f91531589c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:02.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.223+0000 7f91531589c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.223+0000 7f91531589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.223+0000 7f91531589c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.223+0000 7f91531589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:02.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.223+0000 7f91531589c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.227+0000 7f91531589c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:02.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.227+0000 7f91531589c0 20 searching for the correct realm 2024-09-12T00:37:02.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.231+0000 7f915145f640 0 -- 172.21.15.138:0/1087897672 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f9148018940 msgr2=0x7f9148030410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:02.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.447+0000 7f915145f640 0 -- 172.21.15.138:0/1087897672 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x563b554944a0 msgr2=0x563b55496960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:02.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.455+0000 7f91531589c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:02.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.455+0000 7f91531589c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:02.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.455+0000 7f91531589c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:02.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.455+0000 7f91531589c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:02.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.455+0000 7f91531589c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:02.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.455+0000 7f91531589c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:02.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.455+0000 7f91531589c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.459+0000 7f91531589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.459+0000 7f91531589c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.459+0000 7f91531589c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:02.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.459+0000 7f91531589c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.459+0000 7f91531589c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:02.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.459+0000 7f91531589c0 20 zone default found 2024-09-12T00:37:02.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.459+0000 7f91531589c0 4 Realm: () 2024-09-12T00:37:02.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.459+0000 7f91531589c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:02.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.459+0000 7f91531589c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:02.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.459+0000 7f91531589c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:02.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.459+0000 7f91531589c0 20 zonegroup default 2024-09-12T00:37:02.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.459+0000 7f91531589c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.459+0000 7f91531589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.459+0000 7f91531589c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.459+0000 7f91531589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.459+0000 7f91531589c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.463+0000 7f91531589c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.463+0000 7f91531589c0 20 started sync module instance, tier type = 2024-09-12T00:37:02.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.463+0000 7f91531589c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:02.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.483+0000 7f91531589c0 20 add_watcher() i=0 2024-09-12T00:37:02.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.483+0000 7f91531589c0 20 add_watcher() i=1 2024-09-12T00:37:02.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.483+0000 7f91531589c0 20 add_watcher() i=2 2024-09-12T00:37:02.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.483+0000 7f91531589c0 20 add_watcher() i=3 2024-09-12T00:37:02.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.483+0000 7f91531589c0 20 add_watcher() i=4 2024-09-12T00:37:02.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.483+0000 7f91531589c0 20 add_watcher() i=5 2024-09-12T00:37:02.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.483+0000 7f91531589c0 20 add_watcher() i=6 2024-09-12T00:37:02.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.487+0000 7f91531589c0 20 add_watcher() i=7 2024-09-12T00:37:02.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.487+0000 7f91531589c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:02.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.491+0000 7f9006fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:02.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.491+0000 7f91531589c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:02.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.491+0000 7f91531589c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:02.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.491+0000 7f91531589c0 5 note: GC not initialized 2024-09-12T00:37:02.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.491+0000 7f9005fe3640 20 reqs_thread_entry: start 2024-09-12T00:37:02.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.491+0000 7f91531589c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:02.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.491+0000 7f91531589c0 20 Filter name: none 2024-09-12T00:37:02.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.491+0000 7f8f777fe640 20 reqs_thread_entry: start 2024-09-12T00:37:02.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.491+0000 7f91531589c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.491+0000 7f91531589c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:37:02.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.491+0000 7f91531589c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.495+0000 7f91531589c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:37:02.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.495+0000 7f91531589c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:02.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.495+0000 7f91531589c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.495+0000 7f91531589c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:37:02.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.495+0000 7f91531589c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.495+0000 7f91531589c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:37:02.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.495+0000 7f91531589c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:02.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.499+0000 7f9006fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:02.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.503+0000 7f91531589c0 20 remove_watcher() i=0 2024-09-12T00:37:02.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.503+0000 7f91531589c0 2 removed watcher, disabling cache 2024-09-12T00:37:02.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.507+0000 7f91531589c0 20 remove_watcher() i=1 2024-09-12T00:37:02.504 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.507+0000 7f91531589c0 20 remove_watcher() i=2 2024-09-12T00:37:02.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.511+0000 7f91531589c0 20 remove_watcher() i=3 2024-09-12T00:37:02.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.515+0000 7f91531589c0 20 remove_watcher() i=4 2024-09-12T00:37:02.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.515+0000 7f91531589c0 20 remove_watcher() i=5 2024-09-12T00:37:02.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.519+0000 7f91531589c0 20 remove_watcher() i=6 2024-09-12T00:37:02.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.519+0000 7f91531589c0 20 remove_watcher() i=7 2024-09-12T00:37:02.530 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.530 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:37:02.531 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-do-reshard id: e2043445-c131-4520-984d-b4d52f038a6b.4538.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:02.531 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.531 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:37:02.568 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:02.568 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:02.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.615+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 realm 2024-09-12T00:37:02.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.619+0000 7f1c785c99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:02.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:02.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:02.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 searching for the correct realm 2024-09-12T00:37:02.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.627+0000 7f1c768d0640 0 -- 172.21.15.138:0/3168596662 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f1c700639f0 msgr2=0x7f1c70061890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:02.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.843+0000 7f1c768d0640 0 -- 172.21.15.138:0/3168596662 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x564c1ff05a70 msgr2=0x564c1ff07f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:02.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:02.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:02.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:02.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:02.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:02.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:02.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:02.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:02.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 zone default found 2024-09-12T00:37:02.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.855+0000 7f1c785c99c0 4 Realm: () 2024-09-12T00:37:02.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.855+0000 7f1c785c99c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:02.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.855+0000 7f1c785c99c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:02.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.855+0000 7f1c785c99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:02.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 zonegroup default 2024-09-12T00:37:02.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.859+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.859+0000 7f1c785c99c0 20 started sync module instance, tier type = 2024-09-12T00:37:02.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.859+0000 7f1c785c99c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:02.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=0 2024-09-12T00:37:02.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=1 2024-09-12T00:37:02.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=2 2024-09-12T00:37:02.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=3 2024-09-12T00:37:02.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=4 2024-09-12T00:37:02.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=5 2024-09-12T00:37:02.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=6 2024-09-12T00:37:02.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=7 2024-09-12T00:37:02.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.891+0000 7f1c785c99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:02.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.895+0000 7f1b2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:02.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:02.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:02.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 note: GC not initialized 2024-09-12T00:37:02.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1aa77fe640 20 reqs_thread_entry: start 2024-09-12T00:37:02.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:02.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 Filter name: none 2024-09-12T00:37:02.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1aa57fa640 20 reqs_thread_entry: start 2024-09-12T00:37:02.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:37:02.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:37:02.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:37:02.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:37:02.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 : miss 2024-09-12T00:37:02.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:37:02.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 info.flags=0x17 2024-09-12T00:37:02.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to cache LRU end 2024-09-12T00:37:02.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:02.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:02.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 2024-09-12T00:37:02.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.915+0000 7f1c785c99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 info.flags=0x17 2024-09-12T00:37:02.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.915+0000 7f1c785c99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to cache LRU end 2024-09-12T00:37:02.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.915+0000 7f1c785c99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:02.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.915+0000 7f1c785c99c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34, ofs0, ns] 2024-09-12T00:37:02.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.915+0000 7f1b59ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333574 cookie 94884953371120 notifier 7109 bl.length()=911 2024-09-12T00:37:02.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.915+0000 7f1b59ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 info.flags=0x17 2024-09-12T00:37:02.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.915+0000 7f1b59ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to cache LRU end 2024-09-12T00:37:02.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.915+0000 7f1b59ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:02.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.915+0000 7f1c785c99c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): orig_sources= new_sources= 2024-09-12T00:37:02.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.915+0000 7f1c785c99c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): potential sources added=[] removed=[] 2024-09-12T00:37:02.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.915+0000 7f1c785c99c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): orig_dests= new_dests= 2024-09-12T00:37:02.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.915+0000 7f1c785c99c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): potential dests added=[] removed=[] 2024-09-12T00:37:02.922 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1c785c99c0 time 2024-09-12T00:37:02.928617+0000 2024-09-12T00:37:02.922 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:02.923 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:02.923 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1c7bea32eb] 2024-09-12T00:37:02.923 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1c7bea349f] 2024-09-12T00:37:02.923 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564c1de79cc1] 2024-09-12T00:37:02.923 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564c1de8ed5a] 2024-09-12T00:37:02.923 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-12T00:37:02.923 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1c7ad09d90] 2024-09-12T00:37:02.924 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-12T00:37:02.924 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-12T00:37:02.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.927+0000 7f1c785c99c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1c785c99c0 time 2024-09-12T00:37:02.928617+0000 2024-09-12T00:37:02.924 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:02.924 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.924 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:02.924 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1c7bea32eb] 2024-09-12T00:37:02.924 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1c7bea349f] 2024-09-12T00:37:02.924 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564c1de79cc1] 2024-09-12T00:37:02.924 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564c1de8ed5a] 2024-09-12T00:37:02.924 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-12T00:37:02.925 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1c7ad09d90] 2024-09-12T00:37:02.925 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-12T00:37:02.925 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-12T00:37:02.925 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.925 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:37:02.925 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f1c785c99c0 thread_name:radosgw-admin 2024-09-12T00:37:02.931 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:02.931 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1c7ad22520] 2024-09-12T00:37:02.931 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:37:02.931 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:37:02.931 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:37:02.931 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1c7bea3345] 2024-09-12T00:37:02.931 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1c7bea349f] 2024-09-12T00:37:02.931 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564c1de79cc1] 2024-09-12T00:37:02.931 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564c1de8ed5a] 2024-09-12T00:37:02.931 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-12T00:37:02.931 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1c7ad09d90] 2024-09-12T00:37:02.932 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-12T00:37:02.932 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-12T00:37:02.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:02.927+0000 7f1c785c99c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:02.932 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f1c785c99c0 thread_name:radosgw-admin 2024-09-12T00:37:02.932 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.932 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:02.932 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1c7ad22520] 2024-09-12T00:37:02.932 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:37:02.932 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:37:02.932 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:37:02.932 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1c7bea3345] 2024-09-12T00:37:02.932 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1c7bea349f] 2024-09-12T00:37:02.932 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564c1de79cc1] 2024-09-12T00:37:02.933 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564c1de8ed5a] 2024-09-12T00:37:02.933 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-12T00:37:02.933 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1c7ad09d90] 2024-09-12T00:37:02.933 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-12T00:37:02.933 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-12T00:37:02.933 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:02.933 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.933 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:37:02.933 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:02.933 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:37:02.595+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:02.933 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:37:02.595+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:02.933 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:37:02.595+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:02.934 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:02.934 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:02.934 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:02.934 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:37:02.595+0000 7f1c758ce640 10 monclient(hunting): handle_auth_done global_id 7097 payload 274 2024-09-12T00:37:02.934 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:37:02.595+0000 7f1c758ce640 10 monclient: _finish_hunting 0 2024-09-12T00:37:02.934 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:37:02.595+0000 7f1c758ce640 1 monclient: found mon.noname-c 2024-09-12T00:37:02.934 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:37:02.595+0000 7f1c758ce640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:37:02.934 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient: get_auth_request con 0x564c1fe13bd0 auth_method 0 2024-09-12T00:37:02.934 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:02.934 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:02.934 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: dump: 2024-09-12T00:37:02.934 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:02.934 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:02.935 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.935 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.935 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:02.935 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:02.935 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:02.935 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:02.935 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:02.935 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.935 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: _finish_auth 0 2024-09-12T00:37:02.935 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: _check_auth_tickets 2024-09-12T00:37:02.935 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 monclient: authenticate success, global_id 7097 2024-09-12T00:37:02.935 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:02.935 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:02.936 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:02.936 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: dump: 2024-09-12T00:37:02.936 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:02.936 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:02.936 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.936 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.936 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:02.936 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:02.936 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:02.936 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:02.936 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:02.936 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.936 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:02.937 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 4 set_mon_vals no callback set 2024-09-12T00:37:02.937 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient: shutdown 2024-09-12T00:37:02.937 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) unregister_commands rotate-key 2024-09-12T00:37:02.937 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient: build_initial_monmap 2024-09-12T00:37:02.937 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:02.937 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient: monmap: 2024-09-12T00:37:02.937 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:37:02.937 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:02.937 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:37:02.937 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:37:02.937 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:02.937 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:02.937 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:37:02.937 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:37:02.938 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:37:02.938 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.938 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding auth protocol: cephx 2024-09-12T00:37:02.938 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding auth protocol: cephx 2024-09-12T00:37:02.938 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding auth protocol: cephx 2024-09-12T00:37:02.938 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: secure 2024-09-12T00:37:02.938 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: crc 2024-09-12T00:37:02.938 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: secure 2024-09-12T00:37:02.938 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: crc 2024-09-12T00:37:02.938 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: secure 2024-09-12T00:37:02.938 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: crc 2024-09-12T00:37:02.938 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: crc 2024-09-12T00:37:02.938 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: secure 2024-09-12T00:37:02.939 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: crc 2024-09-12T00:37:02.939 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: secure 2024-09-12T00:37:02.939 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: crc 2024-09-12T00:37:02.939 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: secure 2024-09-12T00:37:02.939 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:02.939 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 1 librados: starting msgr at 2024-09-12T00:37:02.939 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 1 librados: starting objecter 2024-09-12T00:37:02.939 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command objecter_requests hook 0x564c1fe3de40 2024-09-12T00:37:02.939 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 1 librados: setting wanted keys 2024-09-12T00:37:02.939 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 1 librados: calling monclient init 2024-09-12T00:37:02.939 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient: init 2024-09-12T00:37:02.939 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding auth protocol: cephx 2024-09-12T00:37:02.939 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding auth protocol: cephx 2024-09-12T00:37:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding auth protocol: cephx 2024-09-12T00:37:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: secure 2024-09-12T00:37:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: crc 2024-09-12T00:37:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: secure 2024-09-12T00:37:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: crc 2024-09-12T00:37:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: secure 2024-09-12T00:37:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: crc 2024-09-12T00:37:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: crc 2024-09-12T00:37:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: secure 2024-09-12T00:37:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: crc 2024-09-12T00:37:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: secure 2024-09-12T00:37:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: crc 2024-09-12T00:37:02.940 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: secure 2024-09-12T00:37:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command rotate-key hook 0x564c1fe0d5a8 2024-09-12T00:37:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:37:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-a con 0x564c1fc9ade0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:37:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-b con 0x564c1fcc5730 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:37:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-c con 0x564c1fe13bd0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:37:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:02.941 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient(hunting): authenticate will time out at 2275.939284s 2024-09-12T00:37:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): get_auth_request con 0x564c1fc9ade0 auth_method 0 2024-09-12T00:37:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient(hunting): get_auth_request con 0x564c1fe13bd0 auth_method 0 2024-09-12T00:37:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:02.942 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient(hunting): handle_auth_done global_id 7100 payload 824 2024-09-12T00:37:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient: _finish_hunting 0 2024-09-12T00:37:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:37:02.595+0000 7f1c768d0640 1 monclient: found mon.noname-c 2024-09-12T00:37:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:37:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:02.943 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: dump: 2024-09-12T00:37:02.943 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:02.943 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:02.944 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.944 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.944 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:02.944 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:02.944 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:02.944 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:02.944 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:02.944 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.944 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: _finish_auth 0 2024-09-12T00:37:02.945 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: _check_auth_tickets 2024-09-12T00:37:02.945 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:02.945 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:02.945 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:02.945 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: dump: 2024-09-12T00:37:02.945 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:02.945 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:02.945 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.945 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.945 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:02.946 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:02.946 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:02.946 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:02.946 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:02.946 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.946 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:37:02.599+0000 7f1c785c99c0 5 monclient: authenticate success, global_id 7100 2024-09-12T00:37:02.946 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:37:02.599+0000 7f1c785c99c0 10 monclient: _renew_subs 2024-09-12T00:37:02.946 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:37:02.599+0000 7f1b64608640 4 set_mon_vals no callback set 2024-09-12T00:37:02.946 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:37:02.599+0000 7f1c785c99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:37:02.946 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:37:02.599+0000 7f1c785c99c0 10 monclient: _renew_subs 2024-09-12T00:37:02.947 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:37:02.599+0000 7f1c785c99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:37:02.947 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:37:02.599+0000 7f1c785c99c0 1 librados: init done 2024-09-12T00:37:02.947 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:37:02.599+0000 7f1b62e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:02.947 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:37:02.599+0000 7f1b62e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:02.947 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:37:02.599+0000 7f1b62e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:02.947 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:37:02.599+0000 7f1c760cf640 10 monclient: get_auth_request con 0x7f1b5c070ae0 auth_method 0 2024-09-12T00:37:02.947 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:37:02.599+0000 7f1c758ce640 10 monclient: get_auth_request con 0x564c1fe34ea0 auth_method 0 2024-09-12T00:37:02.947 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:37:02.603+0000 7f1c760cf640 10 monclient: get_auth_request con 0x564c1fe57ee0 auth_method 0 2024-09-12T00:37:02.947 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:37:02.603+0000 7f1c758ce640 10 monclient: get_auth_request con 0x564c1fe5c350 auth_method 0 2024-09-12T00:37:02.947 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 10 monclient: build_initial_monmap 2024-09-12T00:37:02.947 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:02.948 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 10 monclient: monmap: 2024-09-12T00:37:02.948 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:37:02.948 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:02.948 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:37:02.948 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:37:02.948 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:02.948 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:02.948 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:37:02.948 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:37:02.948 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:37:02.948 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.948 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding auth protocol: cephx 2024-09-12T00:37:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding auth protocol: cephx 2024-09-12T00:37:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding auth protocol: cephx 2024-09-12T00:37:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: secure 2024-09-12T00:37:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: crc 2024-09-12T00:37:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: secure 2024-09-12T00:37:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: crc 2024-09-12T00:37:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: secure 2024-09-12T00:37:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: crc 2024-09-12T00:37:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: crc 2024-09-12T00:37:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: secure 2024-09-12T00:37:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: crc 2024-09-12T00:37:02.949 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: secure 2024-09-12T00:37:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: crc 2024-09-12T00:37:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: secure 2024-09-12T00:37:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command objecter_requests cmddesc objecter_requests hook 0x564c1fe64b80 EEXIST 2024-09-12T00:37:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 10 monclient: init 2024-09-12T00:37:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding auth protocol: cephx 2024-09-12T00:37:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding auth protocol: cephx 2024-09-12T00:37:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding auth protocol: cephx 2024-09-12T00:37:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: secure 2024-09-12T00:37:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: crc 2024-09-12T00:37:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: secure 2024-09-12T00:37:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: crc 2024-09-12T00:37:02.950 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: secure 2024-09-12T00:37:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: crc 2024-09-12T00:37:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: crc 2024-09-12T00:37:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: secure 2024-09-12T00:37:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: crc 2024-09-12T00:37:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: secure 2024-09-12T00:37:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: crc 2024-09-12T00:37:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: secure 2024-09-12T00:37:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command rotate-key cmddesc rotate-key hook 0x564c1fe5fa10 EEXIST 2024-09-12T00:37:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:37:02.951 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-c con 0x564c1fe88d30 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:37:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-a con 0x564c1fe88660 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:37:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-b con 0x564c1fe87040 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:37:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient(hunting): authenticate will time out at 2275.948440s 2024-09-12T00:37:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient(hunting): get_auth_request con 0x564c1fe88d30 auth_method 0 2024-09-12T00:37:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:37:02.607+0000 7f1c758ce640 10 monclient(hunting): get_auth_request con 0x564c1fe88660 auth_method 0 2024-09-12T00:37:02.952 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:37:02.607+0000 7f1c758ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:02.953 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:37:02.607+0000 7f1c758ce640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:02.953 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:37:02.607+0000 7f1c758ce640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:02.953 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:02.953 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:02.953 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:02.953 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:37:02.607+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:02.953 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:37:02.607+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:02.953 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:37:02.607+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:02.953 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient(hunting): handle_auth_done global_id 7103 payload 824 2024-09-12T00:37:02.953 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient: _finish_hunting 0 2024-09-12T00:37:02.953 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:37:02.607+0000 7f1c760cf640 1 monclient: found mon.noname-c 2024-09-12T00:37:02.953 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:37:02.954 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:02.954 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:02.954 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: dump: 2024-09-12T00:37:02.954 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:02.954 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:02.954 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.954 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.954 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:02.954 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:02.954 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:02.954 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:02.954 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:02.954 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.955 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: _finish_auth 0 2024-09-12T00:37:02.955 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:37:02.955 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:02.955 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:02.955 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:02.955 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: dump: 2024-09-12T00:37:02.955 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:02.955 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:02.955 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.955 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.955 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:02.955 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:02.956 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:02.956 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:02.956 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 monclient: authenticate success, global_id 7103 2024-09-12T00:37:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: _renew_subs 2024-09-12T00:37:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:37:02.607+0000 7f1c750cd640 4 set_mon_vals no callback set 2024-09-12T00:37:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:37:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: _renew_subs 2024-09-12T00:37:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:37:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:02.956 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:02.957 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: get_monmap_and_config 2024-09-12T00:37:02.957 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: build_initial_monmap 2024-09-12T00:37:02.957 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:02.957 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: monmap: 2024-09-12T00:37:02.957 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:37:02.957 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:02.957 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:37:02.957 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:37:02.957 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:02.957 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:02.957 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:37:02.957 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:37:02.958 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:37:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding auth protocol: cephx 2024-09-12T00:37:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding auth protocol: cephx 2024-09-12T00:37:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding auth protocol: cephx 2024-09-12T00:37:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: secure 2024-09-12T00:37:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: crc 2024-09-12T00:37:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: secure 2024-09-12T00:37:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: crc 2024-09-12T00:37:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: secure 2024-09-12T00:37:02.958 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: crc 2024-09-12T00:37:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: crc 2024-09-12T00:37:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: secure 2024-09-12T00:37:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: crc 2024-09-12T00:37:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: secure 2024-09-12T00:37:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: crc 2024-09-12T00:37:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: secure 2024-09-12T00:37:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:37:02.607+0000 7f1c758ce640 10 monclient: get_auth_request con 0x7f1b50070a20 auth_method 0 2024-09-12T00:37:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: init 2024-09-12T00:37:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding auth protocol: cephx 2024-09-12T00:37:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding auth protocol: cephx 2024-09-12T00:37:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding auth protocol: cephx 2024-09-12T00:37:02.959 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: secure 2024-09-12T00:37:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: crc 2024-09-12T00:37:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: secure 2024-09-12T00:37:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: crc 2024-09-12T00:37:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: secure 2024-09-12T00:37:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: crc 2024-09-12T00:37:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: crc 2024-09-12T00:37:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: secure 2024-09-12T00:37:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: crc 2024-09-12T00:37:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: secure 2024-09-12T00:37:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: crc 2024-09-12T00:37:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: secure 2024-09-12T00:37:02.960 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command rotate-key cmddesc rotate-key hook 0x7fffe2f45458 EEXIST 2024-09-12T00:37:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:37:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-b con 0x564c1fedcc30 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:37:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-c con 0x564c1feada30 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:37:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-a con 0x564c1fed8530 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:37:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): authenticate will time out at 2275.952748s 2024-09-12T00:37:02.961 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): get_auth_request con 0x564c1fed8530 auth_method 0 2024-09-12T00:37:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:37:02.611+0000 7f1c758ce640 10 monclient(hunting): get_auth_request con 0x564c1feada30 auth_method 0 2024-09-12T00:37:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:37:02.611+0000 7f1c758ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:37:02.611+0000 7f1c758ce640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:37:02.611+0000 7f1c758ce640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:37:02.611+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:37:02.611+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:02.962 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:37:02.611+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:02.963 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): handle_auth_done global_id 7560 payload 274 2024-09-12T00:37:02.963 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient: _finish_hunting 0 2024-09-12T00:37:02.963 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:37:02.611+0000 7f1c768d0640 1 monclient: found mon.noname-a 2024-09-12T00:37:02.963 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:37:02.963 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:02.963 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:02.963 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: dump: 2024-09-12T00:37:02.963 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:02.963 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:02.963 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.963 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.963 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:02.963 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:02.963 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:02.964 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:02.964 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:02.964 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.964 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: _finish_auth 0 2024-09-12T00:37:02.964 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:37:02.964 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:02.964 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:02.964 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:02.964 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: dump: 2024-09-12T00:37:02.964 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:02.964 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:02.964 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.964 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.965 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:02.965 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:02.965 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:02.965 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:02.965 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:02.965 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.965 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 monclient: authenticate success, global_id 7560 2024-09-12T00:37:02.965 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:02.965 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 4 set_mon_vals no callback set 2024-09-12T00:37:02.965 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: shutdown 2024-09-12T00:37:02.965 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: build_initial_monmap 2024-09-12T00:37:02.965 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:02.965 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: monmap: 2024-09-12T00:37:02.966 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:37:02.966 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:02.966 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:37:02.966 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:37:02.966 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:02.966 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:02.966 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:37:02.966 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:37:02.966 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:37:02.966 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.966 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding auth protocol: cephx 2024-09-12T00:37:02.966 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding auth protocol: cephx 2024-09-12T00:37:02.966 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding auth protocol: cephx 2024-09-12T00:37:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: secure 2024-09-12T00:37:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: crc 2024-09-12T00:37:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: secure 2024-09-12T00:37:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: crc 2024-09-12T00:37:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: secure 2024-09-12T00:37:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: crc 2024-09-12T00:37:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: crc 2024-09-12T00:37:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: secure 2024-09-12T00:37:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: crc 2024-09-12T00:37:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: secure 2024-09-12T00:37:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: crc 2024-09-12T00:37:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: secure 2024-09-12T00:37:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:02.967 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 1 librados: starting msgr at 2024-09-12T00:37:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 1 librados: starting objecter 2024-09-12T00:37:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command objecter_requests cmddesc objecter_requests hook 0x564c1fed72d0 EEXIST 2024-09-12T00:37:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 1 librados: setting wanted keys 2024-09-12T00:37:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 1 librados: calling monclient init 2024-09-12T00:37:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: init 2024-09-12T00:37:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding auth protocol: cephx 2024-09-12T00:37:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding auth protocol: cephx 2024-09-12T00:37:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding auth protocol: cephx 2024-09-12T00:37:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: secure 2024-09-12T00:37:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: crc 2024-09-12T00:37:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: secure 2024-09-12T00:37:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: crc 2024-09-12T00:37:02.968 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: secure 2024-09-12T00:37:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: crc 2024-09-12T00:37:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: crc 2024-09-12T00:37:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: secure 2024-09-12T00:37:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: crc 2024-09-12T00:37:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: secure 2024-09-12T00:37:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: crc 2024-09-12T00:37:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: secure 2024-09-12T00:37:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command rotate-key cmddesc rotate-key hook 0x564c1fe8ac98 EEXIST 2024-09-12T00:37:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:37:02.969 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-c con 0x564c1fed8530 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-b con 0x564c1fedcc30 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-a con 0x564c1feceec0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): authenticate will time out at 2275.955310s 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient(hunting): get_auth_request con 0x564c1fed8530 auth_method 0 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): get_auth_request con 0x564c1feceec0 auth_method 0 2024-09-12T00:37:02.970 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient(hunting): handle_auth_done global_id 7109 payload 824 2024-09-12T00:37:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient: _finish_hunting 0 2024-09-12T00:37:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:37:02.611+0000 7f1c760cf640 1 monclient: found mon.noname-c 2024-09-12T00:37:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:37:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:02.971 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:02.972 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: dump: 2024-09-12T00:37:02.972 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:02.972 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:02.972 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.972 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.972 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:02.972 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:02.972 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:02.972 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:02.972 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:02.972 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.972 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: _finish_auth 0 2024-09-12T00:37:02.972 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: _check_auth_tickets 2024-09-12T00:37:02.973 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:02.973 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:02.973 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:02.973 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: dump: 2024-09-12T00:37:02.973 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:02.973 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:02.973 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.973 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.973 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:02.973 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:02.973 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:02.973 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:02.973 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:37:02.615+0000 7f1b59ffb640 4 set_mon_vals no callback set 2024-09-12T00:37:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:37:02.615+0000 7f1c785c99c0 5 monclient: authenticate success, global_id 7109 2024-09-12T00:37:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:37:02.615+0000 7f1c785c99c0 10 monclient: _renew_subs 2024-09-12T00:37:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:37:02.615+0000 7f1c785c99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:37:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:37:02.615+0000 7f1c785c99c0 10 monclient: _renew_subs 2024-09-12T00:37:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:37:02.615+0000 7f1c785c99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:37:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:37:02.615+0000 7f1c785c99c0 1 librados: init done 2024-09-12T00:37:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:37:02.615+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command cr dump hook 0x564c1fed1bf8 2024-09-12T00:37:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:37:02.615+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:37:02.615+0000 7f1b47fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:37:02.615+0000 7f1b47fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:37:02.615+0000 7f1b47fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:02.974 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:37:02.615+0000 7f1c758ce640 10 monclient: get_auth_request con 0x7f1b40070ae0 auth_method 0 2024-09-12T00:37:02.975 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:37:02.615+0000 7f1c768d0640 10 monclient: get_auth_request con 0x564c1fef9290 auth_method 0 2024-09-12T00:37:02.975 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.975 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 realm 2024-09-12T00:37:02.975 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.975 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.975 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:02.975 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.975 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.975 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.975 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:37:02.619+0000 7f1c760cf640 10 monclient: get_auth_request con 0x564c1fefd4b0 auth_method 0 2024-09-12T00:37:02.975 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:02.975 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.975 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:37:02.619+0000 7f1c758ce640 10 monclient: get_auth_request con 0x564c1ff00cf0 auth_method 0 2024-09-12T00:37:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 searching for the correct realm 2024-09-12T00:37:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:37:02.619+0000 7f1c768d0640 10 monclient: get_auth_request con 0x564c1ff05a70 auth_method 0 2024-09-12T00:37:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:37:02.623+0000 7f1c760cf640 10 monclient: get_auth_request con 0x7f1c7005ac10 auth_method 0 2024-09-12T00:37:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:37:02.623+0000 7f1c758ce640 10 monclient: get_auth_request con 0x7f1c68069030 auth_method 0 2024-09-12T00:37:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:37:02.627+0000 7f1c768d0640 10 monclient: get_auth_request con 0x7f1c700639f0 auth_method 0 2024-09-12T00:37:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:37:02.627+0000 7f1c768d0640 0 -- 172.21.15.138:0/3168596662 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f1c700639f0 msgr2=0x7f1c70061890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:37:02.831+0000 7f1c768d0640 10 monclient: get_auth_request con 0x7f1c700639f0 auth_method 0 2024-09-12T00:37:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:37:02.835+0000 7f1c760cf640 10 monclient: get_auth_request con 0x7f1c6803a060 auth_method 0 2024-09-12T00:37:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:37:02.843+0000 7f1c768d0640 0 -- 172.21.15.138:0/3168596662 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x564c1ff05a70 msgr2=0x564c1ff07f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:37:02.843+0000 7f1b47fff640 1 client.7109.objecter ms_handle_reset 0x564c1ff05a70 session 0x564c1ff053f0 osd.4 2024-09-12T00:37:02.976 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:37:02.843+0000 7f1b47fff640 10 monclient: _renew_subs 2024-09-12T00:37:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:37:02.843+0000 7f1b47fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:37:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:37:02.843+0000 7f1c768d0640 10 monclient: get_auth_request con 0x7f1b40080e00 auth_method 0 2024-09-12T00:37:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.977 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 zone default found 2024-09-12T00:37:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 4 Realm: () 2024-09-12T00:37:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 zonegroup default 2024-09-12T00:37:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:37:02.859+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:02.978 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:37:02.859+0000 7f1c785c99c0 20 started sync module instance, tier type = 2024-09-12T00:37:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:37:02.859+0000 7f1c785c99c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=0 2024-09-12T00:37:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=1 2024-09-12T00:37:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=2 2024-09-12T00:37:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=3 2024-09-12T00:37:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=4 2024-09-12T00:37:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=5 2024-09-12T00:37:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=6 2024-09-12T00:37:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=7 2024-09-12T00:37:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding auth protocol: cephx 2024-09-12T00:37:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding auth protocol: cephx 2024-09-12T00:37:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding auth protocol: cephx 2024-09-12T00:37:02.979 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: secure 2024-09-12T00:37:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: crc 2024-09-12T00:37:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: secure 2024-09-12T00:37:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: crc 2024-09-12T00:37:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: secure 2024-09-12T00:37:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: crc 2024-09-12T00:37:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: crc 2024-09-12T00:37:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: secure 2024-09-12T00:37:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: crc 2024-09-12T00:37:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: secure 2024-09-12T00:37:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:37:02.895+0000 7f1b2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: crc 2024-09-12T00:37:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: secure 2024-09-12T00:37:02.980 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command cache list hook 0x564c1fecf300 2024-09-12T00:37:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command cache inspect hook 0x564c1fecf300 2024-09-12T00:37:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command cache erase hook 0x564c1fecf300 2024-09-12T00:37:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command cache zap hook 0x564c1fecf300 2024-09-12T00:37:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 note: GC not initialized 2024-09-12T00:37:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:37:02.899+0000 7f1aa77fe640 20 reqs_thread_entry: start 2024-09-12T00:37:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command sync trace show hook 0x7f1c68004d70 2024-09-12T00:37:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command sync trace history hook 0x7f1c68004d70 2024-09-12T00:37:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command sync trace active hook 0x7f1c68004d70 2024-09-12T00:37:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command sync trace active_short hook 0x7f1c68004d70 2024-09-12T00:37:02.981 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 Filter name: none 2024-09-12T00:37:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:37:02.899+0000 7f1aa57fa640 20 reqs_thread_entry: start 2024-09-12T00:37:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:37:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:37:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:37:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:37:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 : miss 2024-09-12T00:37:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:37:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 info.flags=0x17 2024-09-12T00:37:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to cache LRU end 2024-09-12T00:37:02.982 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:02.983 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:02.983 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 2024-09-12T00:37:02.983 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:37:02.915+0000 7f1c785c99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 info.flags=0x17 2024-09-12T00:37:02.983 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:37:02.915+0000 7f1c785c99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to cache LRU end 2024-09-12T00:37:02.983 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:37:02.915+0000 7f1c785c99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:02.983 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:37:02.915+0000 7f1c785c99c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34, ofs0, ns] 2024-09-12T00:37:02.983 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:37:02.915+0000 7f1b59ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333574 cookie 94884953371120 notifier 7109 bl.length()=911 2024-09-12T00:37:02.983 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:37:02.915+0000 7f1b59ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 info.flags=0x17 2024-09-12T00:37:02.983 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:37:02.915+0000 7f1b59ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to cache LRU end 2024-09-12T00:37:02.983 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:37:02.915+0000 7f1b59ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:02.983 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:37:02.915+0000 7f1c785c99c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): orig_sources= new_sources= 2024-09-12T00:37:02.983 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:37:02.915+0000 7f1c785c99c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): potential sources added=[] removed=[] 2024-09-12T00:37:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:37:02.915+0000 7f1c785c99c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): orig_dests= new_dests= 2024-09-12T00:37:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:37:02.915+0000 7f1c785c99c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): potential dests added=[] removed=[] 2024-09-12T00:37:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:37:02.927+0000 7f1c785c99c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1c785c99c0 time 2024-09-12T00:37:02.928617+0000 2024-09-12T00:37:02.984 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1c7bea32eb] 2024-09-12T00:37:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1c7bea349f] 2024-09-12T00:37:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564c1de79cc1] 2024-09-12T00:37:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564c1de8ed5a] 2024-09-12T00:37:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-12T00:37:02.984 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1c7ad09d90] 2024-09-12T00:37:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-12T00:37:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-12T00:37:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:37:02.927+0000 7f1c785c99c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f1c785c99c0 thread_name:radosgw-admin 2024-09-12T00:37:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1c7ad22520] 2024-09-12T00:37:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:37:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:37:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:37:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1c7bea3345] 2024-09-12T00:37:02.985 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1c7bea349f] 2024-09-12T00:37:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564c1de79cc1] 2024-09-12T00:37:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564c1de8ed5a] 2024-09-12T00:37:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-12T00:37:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1c7ad09d90] 2024-09-12T00:37:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-12T00:37:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-12T00:37:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.986 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:37:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:37:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:37:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:37:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:37:02.986 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:37:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:37:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:37:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:37:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:37:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:37:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:37:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:37:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:37:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:37:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:37:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:37:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:37:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:37:02.987 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:37:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:37:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:37:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:37:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:37:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:37:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:37:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:37:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:37:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:37:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:37:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:37:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:37:02.988 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:37:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:37:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:37:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:37:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:37:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:37:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:37:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:37:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:37:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:37:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:37:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:37:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:37:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:37:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:37:02.989 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:37:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:37:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:37:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:37:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:37:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:37:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:37:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:37:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:37:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:37:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:37:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:37:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:37:02.990 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:37:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:37:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:37:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:37:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:37:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:37:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:37:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:37:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:37:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:37:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:37:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:37:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:37:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:37:02.991 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:37:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:37:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:37:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:37:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:37:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:37:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:37:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:37:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:37:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:37:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:37:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:37:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:37:02.992 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:37:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:37:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:37:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:37:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:37:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:37:02.993 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:37:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1aa57fa640 / http_manager 2024-09-12T00:37:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1aa77fe640 / http_manager 2024-09-12T00:37:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1b2cfe1640 / rgw_dt_lg_renew 2024-09-12T00:37:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1b47fff640 / ms_dispatch 2024-09-12T00:37:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1b59ffb640 / io_context_pool 2024-09-12T00:37:02.993 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1b5bfff640 / ms_dispatch 2024-09-12T00:37:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1b62e05640 / ms_dispatch 2024-09-12T00:37:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1b64608640 / io_context_pool 2024-09-12T00:37:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1c750cd640 / io_context_pool 2024-09-12T00:37:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1c758ce640 / msgr-worker-2 2024-09-12T00:37:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1c760cf640 / msgr-worker-1 2024-09-12T00:37:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1c768d0640 / msgr-worker-0 2024-09-12T00:37:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1c785c99c0 / radosgw-admin 2024-09-12T00:37:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:37:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:37:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.120066.log 2024-09-12T00:37:02.994 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:37:02.994 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:37:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:02.994 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:37:02.595+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:37:02.595+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:37:02.595+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:37:02.595+0000 7f1c758ce640 10 monclient(hunting): handle_auth_done global_id 7097 payload 274 2024-09-12T00:37:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:37:02.595+0000 7f1c758ce640 10 monclient: _finish_hunting 0 2024-09-12T00:37:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:37:02.595+0000 7f1c758ce640 1 monclient: found mon.noname-c 2024-09-12T00:37:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:37:02.595+0000 7f1c758ce640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:37:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient: get_auth_request con 0x564c1fe13bd0 auth_method 0 2024-09-12T00:37:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:02.995 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: dump: 2024-09-12T00:37:02.996 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:02.996 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:02.996 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.996 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.996 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:02.996 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:02.996 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:02.996 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:02.996 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:02.996 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.996 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: _finish_auth 0 2024-09-12T00:37:02.996 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: _check_auth_tickets 2024-09-12T00:37:02.997 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 monclient: authenticate success, global_id 7097 2024-09-12T00:37:02.997 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:02.997 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:02.997 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:02.997 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:37:02.595+0000 7f1b64608640 10 monclient: dump: 2024-09-12T00:37:02.997 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:02.997 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:02.997 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.997 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:02.997 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:02.997 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:02.997 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:02.997 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:02.998 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 4 set_mon_vals no callback set 2024-09-12T00:37:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient: shutdown 2024-09-12T00:37:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) unregister_commands rotate-key 2024-09-12T00:37:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient: build_initial_monmap 2024-09-12T00:37:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:02.998 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient: monmap: 2024-09-12T00:37:02.998 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:37:02.998 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:02.998 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:37:02.998 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:37:02.998 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:02.999 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:02.999 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:37:02.999 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:37:02.999 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:37:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding auth protocol: cephx 2024-09-12T00:37:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding auth protocol: cephx 2024-09-12T00:37:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding auth protocol: cephx 2024-09-12T00:37:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: secure 2024-09-12T00:37:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: crc 2024-09-12T00:37:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: secure 2024-09-12T00:37:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: crc 2024-09-12T00:37:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: secure 2024-09-12T00:37:02.999 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: crc 2024-09-12T00:37:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: crc 2024-09-12T00:37:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: secure 2024-09-12T00:37:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: crc 2024-09-12T00:37:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: secure 2024-09-12T00:37:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: crc 2024-09-12T00:37:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe10540) adding con mode: secure 2024-09-12T00:37:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 1 librados: starting msgr at 2024-09-12T00:37:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 1 librados: starting objecter 2024-09-12T00:37:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command objecter_requests hook 0x564c1fe3de40 2024-09-12T00:37:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 1 librados: setting wanted keys 2024-09-12T00:37:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 1 librados: calling monclient init 2024-09-12T00:37:03.000 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient: init 2024-09-12T00:37:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding auth protocol: cephx 2024-09-12T00:37:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding auth protocol: cephx 2024-09-12T00:37:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding auth protocol: cephx 2024-09-12T00:37:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: secure 2024-09-12T00:37:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: crc 2024-09-12T00:37:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: secure 2024-09-12T00:37:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: crc 2024-09-12T00:37:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: secure 2024-09-12T00:37:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: crc 2024-09-12T00:37:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: crc 2024-09-12T00:37:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: secure 2024-09-12T00:37:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: crc 2024-09-12T00:37:03.001 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: secure 2024-09-12T00:37:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: crc 2024-09-12T00:37:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe0d460) adding con mode: secure 2024-09-12T00:37:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command rotate-key hook 0x564c1fe0d5a8 2024-09-12T00:37:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:37:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-a con 0x564c1fc9ade0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:37:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-b con 0x564c1fcc5730 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:37:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-c con 0x564c1fe13bd0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:37:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.002 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:37:02.595+0000 7f1c785c99c0 10 monclient(hunting): authenticate will time out at 2275.939284s 2024-09-12T00:37:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): get_auth_request con 0x564c1fc9ade0 auth_method 0 2024-09-12T00:37:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient(hunting): get_auth_request con 0x564c1fe13bd0 auth_method 0 2024-09-12T00:37:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.003 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:37:02.595+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient(hunting): handle_auth_done global_id 7100 payload 824 2024-09-12T00:37:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient: _finish_hunting 0 2024-09-12T00:37:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:37:02.595+0000 7f1c768d0640 1 monclient: found mon.noname-c 2024-09-12T00:37:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:37:02.595+0000 7f1c768d0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:37:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:03.004 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: dump: 2024-09-12T00:37:03.004 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:03.005 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:03.005 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:03.005 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:03.005 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.005 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:03.005 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:03.005 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:03.005 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:03.005 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:03.005 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: _finish_auth 0 2024-09-12T00:37:03.005 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: _check_auth_tickets 2024-09-12T00:37:03.005 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:03.005 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.006 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:03.006 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:37:02.599+0000 7f1b62e05640 10 monclient: dump: 2024-09-12T00:37:03.006 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:03.006 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:03.006 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:03.006 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:03.006 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.006 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:03.006 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:03.006 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:03.006 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:03.006 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:37:02.599+0000 7f1c785c99c0 5 monclient: authenticate success, global_id 7100 2024-09-12T00:37:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:37:02.599+0000 7f1c785c99c0 10 monclient: _renew_subs 2024-09-12T00:37:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:37:02.599+0000 7f1b64608640 4 set_mon_vals no callback set 2024-09-12T00:37:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:37:02.599+0000 7f1c785c99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:37:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:37:02.599+0000 7f1c785c99c0 10 monclient: _renew_subs 2024-09-12T00:37:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:37:02.599+0000 7f1c785c99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:37:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:37:02.599+0000 7f1c785c99c0 1 librados: init done 2024-09-12T00:37:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:37:02.599+0000 7f1b62e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:37:02.599+0000 7f1b62e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:37:02.599+0000 7f1b62e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:37:02.599+0000 7f1c760cf640 10 monclient: get_auth_request con 0x7f1b5c070ae0 auth_method 0 2024-09-12T00:37:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:37:02.599+0000 7f1c758ce640 10 monclient: get_auth_request con 0x564c1fe34ea0 auth_method 0 2024-09-12T00:37:03.007 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:37:02.603+0000 7f1c760cf640 10 monclient: get_auth_request con 0x564c1fe57ee0 auth_method 0 2024-09-12T00:37:03.008 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:37:02.603+0000 7f1c758ce640 10 monclient: get_auth_request con 0x564c1fe5c350 auth_method 0 2024-09-12T00:37:03.008 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 10 monclient: build_initial_monmap 2024-09-12T00:37:03.008 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:03.008 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 10 monclient: monmap: 2024-09-12T00:37:03.008 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:37:03.008 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:03.008 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:37:03.008 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:37:03.008 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:03.008 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:03.008 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:37:03.008 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:37:03.008 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:37:03.009 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:03.009 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding auth protocol: cephx 2024-09-12T00:37:03.009 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding auth protocol: cephx 2024-09-12T00:37:03.009 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding auth protocol: cephx 2024-09-12T00:37:03.009 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: secure 2024-09-12T00:37:03.009 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: crc 2024-09-12T00:37:03.009 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: secure 2024-09-12T00:37:03.009 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: crc 2024-09-12T00:37:03.009 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: secure 2024-09-12T00:37:03.009 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: crc 2024-09-12T00:37:03.009 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: crc 2024-09-12T00:37:03.009 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: secure 2024-09-12T00:37:03.009 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: crc 2024-09-12T00:37:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: secure 2024-09-12T00:37:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: crc 2024-09-12T00:37:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe611f0) adding con mode: secure 2024-09-12T00:37:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command objecter_requests cmddesc objecter_requests hook 0x564c1fe64b80 EEXIST 2024-09-12T00:37:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 10 monclient: init 2024-09-12T00:37:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding auth protocol: cephx 2024-09-12T00:37:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding auth protocol: cephx 2024-09-12T00:37:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding auth protocol: cephx 2024-09-12T00:37:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: secure 2024-09-12T00:37:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: crc 2024-09-12T00:37:03.010 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: secure 2024-09-12T00:37:03.011 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: crc 2024-09-12T00:37:03.011 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: secure 2024-09-12T00:37:03.011 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: crc 2024-09-12T00:37:03.011 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: crc 2024-09-12T00:37:03.011 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: secure 2024-09-12T00:37:03.011 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: crc 2024-09-12T00:37:03.011 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: secure 2024-09-12T00:37:03.011 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: crc 2024-09-12T00:37:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:37:02.603+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe5f8c8) adding con mode: secure 2024-09-12T00:37:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command rotate-key cmddesc rotate-key hook 0x564c1fe5fa10 EEXIST 2024-09-12T00:37:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:37:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-c con 0x564c1fe88d30 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:37:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-a con 0x564c1fe88660 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:37:03.012 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-b con 0x564c1fe87040 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:37:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient(hunting): authenticate will time out at 2275.948440s 2024-09-12T00:37:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient(hunting): get_auth_request con 0x564c1fe88d30 auth_method 0 2024-09-12T00:37:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.013 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:37:02.607+0000 7f1c758ce640 10 monclient(hunting): get_auth_request con 0x564c1fe88660 auth_method 0 2024-09-12T00:37:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:37:02.607+0000 7f1c758ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:37:02.607+0000 7f1c758ce640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:37:02.607+0000 7f1c758ce640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.014 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:37:02.607+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:37:02.607+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:37:02.607+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient(hunting): handle_auth_done global_id 7103 payload 824 2024-09-12T00:37:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient: _finish_hunting 0 2024-09-12T00:37:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:37:02.607+0000 7f1c760cf640 1 monclient: found mon.noname-c 2024-09-12T00:37:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:37:02.607+0000 7f1c760cf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:37:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:03.015 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: dump: 2024-09-12T00:37:03.015 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:03.015 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:03.016 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:03.016 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:03.016 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.016 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:03.016 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:03.016 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:03.016 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: _finish_auth 0 2024-09-12T00:37:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:37:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.016 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:03.017 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 10 monclient: dump: 2024-09-12T00:37:03.017 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:03.017 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:03.017 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:03.017 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:03.017 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.017 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:03.017 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:03.017 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:03.017 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:03.017 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:03.017 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 monclient: authenticate success, global_id 7103 2024-09-12T00:37:03.017 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: _renew_subs 2024-09-12T00:37:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:37:02.607+0000 7f1c750cd640 4 set_mon_vals no callback set 2024-09-12T00:37:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:37:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: _renew_subs 2024-09-12T00:37:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:37:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:37:02.607+0000 7f1b5bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: get_monmap_and_config 2024-09-12T00:37:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: build_initial_monmap 2024-09-12T00:37:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:03.018 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 10 monclient: monmap: 2024-09-12T00:37:03.018 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:37:03.018 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:03.019 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:37:03.019 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:37:03.019 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:03.019 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:03.019 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:37:03.019 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:37:03.019 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:37:03.019 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:03.019 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding auth protocol: cephx 2024-09-12T00:37:03.019 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding auth protocol: cephx 2024-09-12T00:37:03.019 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding auth protocol: cephx 2024-09-12T00:37:03.019 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: secure 2024-09-12T00:37:03.019 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: crc 2024-09-12T00:37:03.019 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: secure 2024-09-12T00:37:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: crc 2024-09-12T00:37:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: secure 2024-09-12T00:37:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: crc 2024-09-12T00:37:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: crc 2024-09-12T00:37:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: secure 2024-09-12T00:37:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: crc 2024-09-12T00:37:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: secure 2024-09-12T00:37:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: crc 2024-09-12T00:37:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fea8740) adding con mode: secure 2024-09-12T00:37:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:37:02.607+0000 7f1c758ce640 10 monclient: get_auth_request con 0x7f1b50070a20 auth_method 0 2024-09-12T00:37:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:37:02.607+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: init 2024-09-12T00:37:03.020 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding auth protocol: cephx 2024-09-12T00:37:03.021 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding auth protocol: cephx 2024-09-12T00:37:03.021 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding auth protocol: cephx 2024-09-12T00:37:03.021 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: secure 2024-09-12T00:37:03.021 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: crc 2024-09-12T00:37:03.021 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: secure 2024-09-12T00:37:03.021 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: crc 2024-09-12T00:37:03.021 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: secure 2024-09-12T00:37:03.021 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: crc 2024-09-12T00:37:03.021 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: crc 2024-09-12T00:37:03.021 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: secure 2024-09-12T00:37:03.021 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: crc 2024-09-12T00:37:03.021 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: secure 2024-09-12T00:37:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: crc 2024-09-12T00:37:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f45310) adding con mode: secure 2024-09-12T00:37:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command rotate-key cmddesc rotate-key hook 0x7fffe2f45458 EEXIST 2024-09-12T00:37:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:37:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-b con 0x564c1fedcc30 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:37:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-c con 0x564c1feada30 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:37:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-a con 0x564c1fed8530 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:37:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:03.022 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): authenticate will time out at 2275.952748s 2024-09-12T00:37:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): get_auth_request con 0x564c1fed8530 auth_method 0 2024-09-12T00:37:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:37:02.611+0000 7f1c758ce640 10 monclient(hunting): get_auth_request con 0x564c1feada30 auth_method 0 2024-09-12T00:37:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:37:02.611+0000 7f1c758ce640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:37:02.611+0000 7f1c758ce640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:37:02.611+0000 7f1c758ce640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:37:02.611+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:37:02.611+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.023 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:37:02.611+0000 7f1c758ce640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): handle_auth_done global_id 7560 payload 274 2024-09-12T00:37:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient: _finish_hunting 0 2024-09-12T00:37:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:37:02.611+0000 7f1c768d0640 1 monclient: found mon.noname-a 2024-09-12T00:37:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:37:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:03.024 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: dump: 2024-09-12T00:37:03.024 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:03.024 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:03.024 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:03.024 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:03.024 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.024 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:03.025 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:03.025 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:03.025 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: _finish_auth 0 2024-09-12T00:37:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:37:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:03.025 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:37:02.611+0000 7f1b59ffb640 10 monclient: dump: 2024-09-12T00:37:03.025 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:03.025 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:03.025 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:03.025 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:03.026 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.026 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:03.026 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:03.026 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:03.026 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 monclient: authenticate success, global_id 7560 2024-09-12T00:37:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 4 set_mon_vals no callback set 2024-09-12T00:37:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: shutdown 2024-09-12T00:37:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: build_initial_monmap 2024-09-12T00:37:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:03.026 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: monmap: 2024-09-12T00:37:03.026 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:37:03.027 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:03.027 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:37:03.027 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:37:03.027 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:03.027 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:03.027 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:37:03.027 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:37:03.027 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:37:03.027 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:03.027 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding auth protocol: cephx 2024-09-12T00:37:03.027 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding auth protocol: cephx 2024-09-12T00:37:03.027 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding auth protocol: cephx 2024-09-12T00:37:03.027 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: secure 2024-09-12T00:37:03.027 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: crc 2024-09-12T00:37:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: secure 2024-09-12T00:37:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: crc 2024-09-12T00:37:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: secure 2024-09-12T00:37:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: crc 2024-09-12T00:37:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: crc 2024-09-12T00:37:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: secure 2024-09-12T00:37:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: crc 2024-09-12T00:37:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: secure 2024-09-12T00:37:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: crc 2024-09-12T00:37:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fcbc170) adding con mode: secure 2024-09-12T00:37:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 1 librados: starting msgr at 2024-09-12T00:37:03.028 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 1 librados: starting objecter 2024-09-12T00:37:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command objecter_requests cmddesc objecter_requests hook 0x564c1fed72d0 EEXIST 2024-09-12T00:37:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 1 librados: setting wanted keys 2024-09-12T00:37:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 1 librados: calling monclient init 2024-09-12T00:37:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: init 2024-09-12T00:37:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding auth protocol: cephx 2024-09-12T00:37:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding auth protocol: cephx 2024-09-12T00:37:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding auth protocol: cephx 2024-09-12T00:37:03.029 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: secure 2024-09-12T00:37:03.030 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: crc 2024-09-12T00:37:03.030 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: secure 2024-09-12T00:37:03.030 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: crc 2024-09-12T00:37:03.030 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: secure 2024-09-12T00:37:03.030 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: crc 2024-09-12T00:37:03.030 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: crc 2024-09-12T00:37:03.030 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: secure 2024-09-12T00:37:03.030 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: crc 2024-09-12T00:37:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: secure 2024-09-12T00:37:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: crc 2024-09-12T00:37:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 AuthRegistry(0x564c1fe8ab50) adding con mode: secure 2024-09-12T00:37:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command rotate-key cmddesc rotate-key hook 0x564c1fe8ac98 EEXIST 2024-09-12T00:37:03.031 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:37:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-c con 0x564c1fed8530 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:37:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-b con 0x564c1fedcc30 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:37:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): picked mon.noname-a con 0x564c1feceec0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:37:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:03.032 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:37:02.611+0000 7f1c785c99c0 10 monclient(hunting): authenticate will time out at 2275.955310s 2024-09-12T00:37:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient(hunting): get_auth_request con 0x564c1fed8530 auth_method 0 2024-09-12T00:37:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): get_auth_request con 0x564c1feceec0 auth_method 0 2024-09-12T00:37:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.033 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:37:02.611+0000 7f1c768d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient(hunting): handle_auth_done global_id 7109 payload 824 2024-09-12T00:37:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient: _finish_hunting 0 2024-09-12T00:37:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:37:02.611+0000 7f1c760cf640 1 monclient: found mon.noname-c 2024-09-12T00:37:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:37:02.611+0000 7f1c760cf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:37:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:03.034 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: dump: 2024-09-12T00:37:03.034 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:03.034 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:03.034 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:03.035 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:03.035 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.035 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:03.035 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:03.035 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:03.035 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: _finish_auth 0 2024-09-12T00:37:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: _check_auth_tickets 2024-09-12T00:37:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:03.035 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:37:02.615+0000 7f1b47fff640 10 monclient: dump: 2024-09-12T00:37:03.036 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:03.036 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:03.036 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:03.036 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:03.036 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:03.036 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:03.036 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:03.036 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:03.036 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:03.036 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:03.036 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:37:02.615+0000 7f1b59ffb640 4 set_mon_vals no callback set 2024-09-12T00:37:03.036 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:37:02.615+0000 7f1c785c99c0 5 monclient: authenticate success, global_id 7109 2024-09-12T00:37:03.036 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:37:02.615+0000 7f1c785c99c0 10 monclient: _renew_subs 2024-09-12T00:37:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:37:02.615+0000 7f1c785c99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:37:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:37:02.615+0000 7f1c785c99c0 10 monclient: _renew_subs 2024-09-12T00:37:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:37:02.615+0000 7f1c785c99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:37:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:37:02.615+0000 7f1c785c99c0 1 librados: init done 2024-09-12T00:37:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:37:02.615+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command cr dump hook 0x564c1fed1bf8 2024-09-12T00:37:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:37:02.615+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:37:02.615+0000 7f1b47fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:37:02.615+0000 7f1b47fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:37:02.615+0000 7f1b47fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:37:02.615+0000 7f1c758ce640 10 monclient: get_auth_request con 0x7f1b40070ae0 auth_method 0 2024-09-12T00:37:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:37:02.615+0000 7f1c768d0640 10 monclient: get_auth_request con 0x564c1fef9290 auth_method 0 2024-09-12T00:37:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 realm 2024-09-12T00:37:03.037 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.038 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.038 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:03.038 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.038 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.038 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.038 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:37:02.619+0000 7f1c760cf640 10 monclient: get_auth_request con 0x564c1fefd4b0 auth_method 0 2024-09-12T00:37:03.038 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:03.038 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.038 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:37:02.619+0000 7f1c758ce640 10 monclient: get_auth_request con 0x564c1ff00cf0 auth_method 0 2024-09-12T00:37:03.038 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:03.038 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:37:02.619+0000 7f1c785c99c0 20 searching for the correct realm 2024-09-12T00:37:03.038 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:37:02.619+0000 7f1c768d0640 10 monclient: get_auth_request con 0x564c1ff05a70 auth_method 0 2024-09-12T00:37:03.038 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:37:02.623+0000 7f1c760cf640 10 monclient: get_auth_request con 0x7f1c7005ac10 auth_method 0 2024-09-12T00:37:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:37:02.623+0000 7f1c758ce640 10 monclient: get_auth_request con 0x7f1c68069030 auth_method 0 2024-09-12T00:37:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:37:02.627+0000 7f1c768d0640 10 monclient: get_auth_request con 0x7f1c700639f0 auth_method 0 2024-09-12T00:37:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:37:02.627+0000 7f1c768d0640 0 -- 172.21.15.138:0/3168596662 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f1c700639f0 msgr2=0x7f1c70061890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:37:02.831+0000 7f1c768d0640 10 monclient: get_auth_request con 0x7f1c700639f0 auth_method 0 2024-09-12T00:37:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:37:02.835+0000 7f1c760cf640 10 monclient: get_auth_request con 0x7f1c6803a060 auth_method 0 2024-09-12T00:37:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:37:02.843+0000 7f1c768d0640 0 -- 172.21.15.138:0/3168596662 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x564c1ff05a70 msgr2=0x564c1ff07f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:37:02.843+0000 7f1b47fff640 1 client.7109.objecter ms_handle_reset 0x564c1ff05a70 session 0x564c1ff053f0 osd.4 2024-09-12T00:37:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:37:02.843+0000 7f1b47fff640 10 monclient: _renew_subs 2024-09-12T00:37:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:37:02.843+0000 7f1b47fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:37:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:37:02.843+0000 7f1c768d0640 10 monclient: get_auth_request con 0x7f1b40080e00 auth_method 0 2024-09-12T00:37:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:03.039 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:03.040 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:03.040 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:03.040 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:03.040 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:37:02.851+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.040 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.040 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.040 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:03.040 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.040 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:03.040 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 zone default found 2024-09-12T00:37:03.040 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 4 Realm: () 2024-09-12T00:37:03.040 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:03.040 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:03.040 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 zonegroup default 2024-09-12T00:37:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:37:02.855+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:37:02.859+0000 7f1c785c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:37:02.859+0000 7f1c785c99c0 20 started sync module instance, tier type = 2024-09-12T00:37:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:37:02.859+0000 7f1c785c99c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=0 2024-09-12T00:37:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=1 2024-09-12T00:37:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=2 2024-09-12T00:37:03.041 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=3 2024-09-12T00:37:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=4 2024-09-12T00:37:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=5 2024-09-12T00:37:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=6 2024-09-12T00:37:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 20 add_watcher() i=7 2024-09-12T00:37:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:37:02.891+0000 7f1c785c99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding auth protocol: cephx 2024-09-12T00:37:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding auth protocol: cephx 2024-09-12T00:37:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding auth protocol: cephx 2024-09-12T00:37:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: secure 2024-09-12T00:37:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: crc 2024-09-12T00:37:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: secure 2024-09-12T00:37:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: crc 2024-09-12T00:37:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: secure 2024-09-12T00:37:03.042 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: crc 2024-09-12T00:37:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: crc 2024-09-12T00:37:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: secure 2024-09-12T00:37:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: crc 2024-09-12T00:37:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: secure 2024-09-12T00:37:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:37:02.895+0000 7f1b2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: crc 2024-09-12T00:37:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:37:02.895+0000 7f1c785c99c0 5 AuthRegistry(0x7fffe2f457f0) adding con mode: secure 2024-09-12T00:37:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command cache list hook 0x564c1fecf300 2024-09-12T00:37:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command cache inspect hook 0x564c1fecf300 2024-09-12T00:37:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command cache erase hook 0x564c1fecf300 2024-09-12T00:37:03.043 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command cache zap hook 0x564c1fecf300 2024-09-12T00:37:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 note: GC not initialized 2024-09-12T00:37:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:37:02.899+0000 7f1aa77fe640 20 reqs_thread_entry: start 2024-09-12T00:37:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command sync trace show hook 0x7f1c68004d70 2024-09-12T00:37:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command sync trace history hook 0x7f1c68004d70 2024-09-12T00:37:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command sync trace active hook 0x7f1c68004d70 2024-09-12T00:37:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 5 asok(0x564c1fc022b0) register_command sync trace active_short hook 0x7f1c68004d70 2024-09-12T00:37:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 Filter name: none 2024-09-12T00:37:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:37:02.899+0000 7f1aa57fa640 20 reqs_thread_entry: start 2024-09-12T00:37:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:37:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:37:03.044 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:37:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:37:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 : miss 2024-09-12T00:37:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:37:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 info.flags=0x17 2024-09-12T00:37:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to cache LRU end 2024-09-12T00:37:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:37:02.899+0000 7f1c785c99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 2024-09-12T00:37:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:37:02.915+0000 7f1c785c99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 info.flags=0x17 2024-09-12T00:37:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:37:02.915+0000 7f1c785c99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to cache LRU end 2024-09-12T00:37:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:37:02.915+0000 7f1c785c99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:37:02.915+0000 7f1c785c99c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34, ofs0, ns] 2024-09-12T00:37:03.045 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:37:02.915+0000 7f1b59ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333574 cookie 94884953371120 notifier 7109 bl.length()=911 2024-09-12T00:37:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:37:02.915+0000 7f1b59ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 info.flags=0x17 2024-09-12T00:37:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:37:02.915+0000 7f1b59ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to cache LRU end 2024-09-12T00:37:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:37:02.915+0000 7f1b59ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:37:02.915+0000 7f1c785c99c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): orig_sources= new_sources= 2024-09-12T00:37:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:37:02.915+0000 7f1c785c99c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): potential sources added=[] removed=[] 2024-09-12T00:37:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:37:02.915+0000 7f1c785c99c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): orig_dests= new_dests= 2024-09-12T00:37:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:37:02.915+0000 7f1c785c99c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): potential dests added=[] removed=[] 2024-09-12T00:37:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:37:02.927+0000 7f1c785c99c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1c785c99c0 time 2024-09-12T00:37:02.928617+0000 2024-09-12T00:37:03.046 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1c7bea32eb] 2024-09-12T00:37:03.046 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1c7bea349f] 2024-09-12T00:37:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564c1de79cc1] 2024-09-12T00:37:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564c1de8ed5a] 2024-09-12T00:37:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-12T00:37:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1c7ad09d90] 2024-09-12T00:37:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-12T00:37:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-12T00:37:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:37:02.927+0000 7f1c785c99c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f1c785c99c0 thread_name:radosgw-admin 2024-09-12T00:37:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1c7ad22520] 2024-09-12T00:37:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:37:03.047 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:37:03.048 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:37:03.048 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1c7bea3345] 2024-09-12T00:37:03.048 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1c7bea349f] 2024-09-12T00:37:03.048 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564c1de79cc1] 2024-09-12T00:37:03.048 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x564c1de8ed5a] 2024-09-12T00:37:03.048 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-12T00:37:03.048 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1c7ad09d90] 2024-09-12T00:37:03.048 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-12T00:37:03.048 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-12T00:37:03.048 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:03.048 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:03.048 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:37:03.048 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:37:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:37:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:37:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:37:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:37:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:37:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:37:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:37:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:37:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:37:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:37:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:37:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:37:03.049 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:37:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:37:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:37:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:37:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:37:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:37:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:37:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:37:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:37:03.050 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:37:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:37:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:37:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:37:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:37:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:37:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:37:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:37:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:37:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:37:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:37:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:37:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:37:03.051 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:37:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:37:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:37:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:37:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:37:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:37:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:37:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:37:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:37:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:37:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:37:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:37:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:37:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:37:03.052 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:37:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:37:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:37:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:37:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:37:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:37:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:37:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:37:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:37:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:37:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:37:03.053 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:37:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:37:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:37:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:37:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:37:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:37:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:37:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:37:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:37:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:37:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:37:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:37:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:37:03.054 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:37:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:37:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:37:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:37:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:37:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:37:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:37:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:37:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:37:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:37:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:37:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:37:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:37:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:37:03.055 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:37:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:37:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:37:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:37:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:37:03.056 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:37:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1aa57fa640 / http_manager 2024-09-12T00:37:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1aa77fe640 / http_manager 2024-09-12T00:37:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1b2cfe1640 / rgw_dt_lg_renew 2024-09-12T00:37:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1b47fff640 / ms_dispatch 2024-09-12T00:37:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1b59ffb640 / io_context_pool 2024-09-12T00:37:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1b5bfff640 / ms_dispatch 2024-09-12T00:37:03.056 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1b62e05640 / ms_dispatch 2024-09-12T00:37:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1b64608640 / io_context_pool 2024-09-12T00:37:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1c750cd640 / io_context_pool 2024-09-12T00:37:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1c758ce640 / msgr-worker-2 2024-09-12T00:37:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1c760cf640 / msgr-worker-1 2024-09-12T00:37:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1c768d0640 / msgr-worker-0 2024-09-12T00:37:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: 7f1c785c99c0 / radosgw-admin 2024-09-12T00:37:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:37:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:37:03.057 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:37:02.930655Z_63cbe932-b5b0-4dc7-9b87-d1fe7a19d556/log 2024-09-12T00:37:03.057 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:37:03.059 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-12T00:37:03.059 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:37:03.059 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:03.059 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:03.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.015+0000 7fbcbf5e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.015+0000 7fbcbf5e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.015+0000 7fbcbf5e09c0 20 realm 2024-09-12T00:37:03.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.015+0000 7fbcbf5e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.019+0000 7fbcbf5e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.019+0000 7fbcbf5e09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:03.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.019+0000 7fbcbf5e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.019+0000 7fbcbf5e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.019+0000 7fbcbf5e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.019+0000 7fbcbf5e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:03.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.019+0000 7fbcbf5e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.019+0000 7fbcbf5e09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:03.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.019+0000 7fbcbf5e09c0 20 searching for the correct realm 2024-09-12T00:37:03.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.023+0000 7fbcbd0e6640 0 -- 172.21.15.138:0/1087600176 >> [v2:172.21.15.138:6800/1437861584,v1:172.21.15.138:6801/1437861584] conn(0x556d2fe1b950 msgr2=0x556d2fe1dd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:03.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.031+0000 7fbcbd0e6640 0 -- 172.21.15.138:0/1087600176 >> [v2:172.21.15.178:6811/2062234204,v1:172.21.15.178:6813/2062234204] conn(0x7fbcb008d0b0 msgr2=0x7fbcb005dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:03.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.251+0000 7fbcbf5e09c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.251+0000 7fbcbf5e09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.251+0000 7fbcbf5e09c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.251+0000 7fbcbf5e09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.251+0000 7fbcbf5e09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.251+0000 7fbcbf5e09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.251+0000 7fbcbf5e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.251+0000 7fbcbf5e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.251+0000 7fbcbf5e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.251+0000 7fbcbf5e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:03.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.251+0000 7fbcbf5e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.255+0000 7fbcbf5e09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.255+0000 7fbcbf5e09c0 20 zone default found 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.255+0000 7fbcbf5e09c0 4 Realm: () 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.255+0000 7fbcbf5e09c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.255+0000 7fbcbf5e09c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.255+0000 7fbcbf5e09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.255+0000 7fbcbf5e09c0 20 zonegroup default 2024-09-12T00:37:03.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.255+0000 7fbcbf5e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.255+0000 7fbcbf5e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.255+0000 7fbcbf5e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.255+0000 7fbcbf5e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.255+0000 7fbcbf5e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.255+0000 7fbcbf5e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.255+0000 7fbcbf5e09c0 20 started sync module instance, tier type = 2024-09-12T00:37:03.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.255+0000 7fbcbf5e09c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.287+0000 7fbcbf5e09c0 20 add_watcher() i=0 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.287+0000 7fbcbf5e09c0 20 add_watcher() i=1 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.287+0000 7fbcbf5e09c0 20 add_watcher() i=2 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.287+0000 7fbcbf5e09c0 20 add_watcher() i=3 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.287+0000 7fbcbf5e09c0 20 add_watcher() i=4 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.287+0000 7fbcbf5e09c0 20 add_watcher() i=5 2024-09-12T00:37:03.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.287+0000 7fbcbf5e09c0 20 add_watcher() i=6 2024-09-12T00:37:03.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.291+0000 7fbcbf5e09c0 20 add_watcher() i=7 2024-09-12T00:37:03.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.291+0000 7fbcbf5e09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:03.289 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.295+0000 7fbb737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:03.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.295+0000 7fbcbf5e09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:03.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.295+0000 7fbcbf5e09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:03.290 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.295+0000 7fbcbf5e09c0 5 note: GC not initialized 2024-09-12T00:37:03.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.295+0000 7fbb727e4640 20 reqs_thread_entry: start 2024-09-12T00:37:03.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.295+0000 7fbcbf5e09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.295+0000 7fbcbf5e09c0 20 Filter name: none 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.295+0000 7fbae3fff640 20 reqs_thread_entry: start 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.295+0000 7fbcbf5e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.295+0000 7fbcbf5e09c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:37:03.292 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.295+0000 7fbcbf5e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.299+0000 7fbcbf5e09c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:37:03.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.299+0000 7fbcbf5e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:03.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.299+0000 7fbcbf5e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.299+0000 7fbcbf5e09c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:37:03.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.299+0000 7fbcbf5e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.299+0000 7fbcbf5e09c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:37:03.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.299+0000 7fbcbf5e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:03.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.303+0000 7fbb737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:03.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.307+0000 7fbcbf5e09c0 20 remove_watcher() i=0 2024-09-12T00:37:03.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.307+0000 7fbcbf5e09c0 2 removed watcher, disabling cache 2024-09-12T00:37:03.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.311+0000 7fbcbf5e09c0 20 remove_watcher() i=1 2024-09-12T00:37:03.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.311+0000 7fbcbf5e09c0 20 remove_watcher() i=2 2024-09-12T00:37:03.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.319+0000 7fbcbf5e09c0 20 remove_watcher() i=3 2024-09-12T00:37:03.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.319+0000 7fbcbf5e09c0 20 remove_watcher() i=4 2024-09-12T00:37:03.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.323+0000 7fbcbf5e09c0 20 remove_watcher() i=5 2024-09-12T00:37:03.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.323+0000 7fbcbf5e09c0 20 remove_watcher() i=6 2024-09-12T00:37:03.323 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.327+0000 7fbcbf5e09c0 20 remove_watcher() i=7 2024-09-12T00:37:03.337 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:03.337 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:37:03.337 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-do-reshard id: e2043445-c131-4520-984d-b4d52f038a6b.4538.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:03.338 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:03.338 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:03.338 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:03.351 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:03.351 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:03.393 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:37:03.426 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:03.427 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:03.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.475+0000 7fec87ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.475+0000 7fec87ad69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.475+0000 7fec87ad69c0 20 realm 2024-09-12T00:37:03.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.475+0000 7fec87ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.479+0000 7fec87ad69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.479+0000 7fec87ad69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:03.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.479+0000 7fec87ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.479+0000 7fec87ad69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.479+0000 7fec87ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.479+0000 7fec87ad69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:03.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.479+0000 7fec87ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.479+0000 7fec87ad69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:03.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.479+0000 7fec87ad69c0 20 searching for the correct realm 2024-09-12T00:37:03.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.487+0000 7fec85ddd640 0 -- 172.21.15.138:0/2967718372 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fec78064eb0 msgr2=0x7fec78060050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:03.699 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.703+0000 7fec85ddd640 0 -- 172.21.15.138:0/2967718372 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55b9f8a2d120 msgr2=0x55b9f8a2f5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:03.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:03.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:03.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:03.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:03.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:03.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:03.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:03.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:03.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 20 zone default found 2024-09-12T00:37:03.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 4 Realm: () 2024-09-12T00:37:03.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:03.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:03.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:03.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 20 zonegroup default 2024-09-12T00:37:03.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.715+0000 7fec87ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.719+0000 7fec87ad69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.719+0000 7fec87ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.719+0000 7fec87ad69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:03.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.719+0000 7fec87ad69c0 20 started sync module instance, tier type = 2024-09-12T00:37:03.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.719+0000 7fec87ad69c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:03.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.743+0000 7fec87ad69c0 20 add_watcher() i=0 2024-09-12T00:37:03.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.743+0000 7fec87ad69c0 20 add_watcher() i=1 2024-09-12T00:37:03.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.743+0000 7fec87ad69c0 20 add_watcher() i=2 2024-09-12T00:37:03.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.743+0000 7fec87ad69c0 20 add_watcher() i=3 2024-09-12T00:37:03.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.743+0000 7fec87ad69c0 20 add_watcher() i=4 2024-09-12T00:37:03.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.743+0000 7fec87ad69c0 20 add_watcher() i=5 2024-09-12T00:37:03.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.743+0000 7fec87ad69c0 20 add_watcher() i=6 2024-09-12T00:37:03.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.743+0000 7fec87ad69c0 20 add_watcher() i=7 2024-09-12T00:37:03.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.743+0000 7fec87ad69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:03.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.747+0000 7feb3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:03.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.747+0000 7fec87ad69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:03.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.747+0000 7fec87ad69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:03.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.747+0000 7fec87ad69c0 5 note: GC not initialized 2024-09-12T00:37:03.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.747+0000 7feb3a7e4640 20 reqs_thread_entry: start 2024-09-12T00:37:03.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.747+0000 7fec87ad69c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:03.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.747+0000 7fec87ad69c0 20 Filter name: none 2024-09-12T00:37:03.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.751+0000 7feaabfff640 20 reqs_thread_entry: start 2024-09-12T00:37:03.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.751+0000 7fec87ad69c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:37:03.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.751+0000 7fec87ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.751+0000 7fec87ad69c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:37:03.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.751+0000 7fec87ad69c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:37:03.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.751+0000 7fec87ad69c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:37:03.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.751+0000 7fec87ad69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 : miss 2024-09-12T00:37:03.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.751+0000 7fec87ad69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:03.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.751+0000 7fec87ad69c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:37:03.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.751+0000 7fec87ad69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 info.flags=0x17 2024-09-12T00:37:03.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.751+0000 7fec87ad69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to cache LRU end 2024-09-12T00:37:03.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.751+0000 7fec87ad69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:03.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.751+0000 7fec87ad69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:03.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.751+0000 7fec87ad69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 2024-09-12T00:37:03.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.755+0000 7fec87ad69c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to be held by another RGW process; skipping for now 2024-09-12T00:37:03.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.755+0000 7feb3b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:03.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.759+0000 7fec87ad69c0 20 remove_watcher() i=0 2024-09-12T00:37:03.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.759+0000 7fec87ad69c0 2 removed watcher, disabling cache 2024-09-12T00:37:03.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.763+0000 7fec87ad69c0 20 remove_watcher() i=1 2024-09-12T00:37:03.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.763+0000 7fec87ad69c0 20 remove_watcher() i=2 2024-09-12T00:37:03.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.767+0000 7fec87ad69c0 20 remove_watcher() i=3 2024-09-12T00:37:03.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.767+0000 7fec87ad69c0 20 remove_watcher() i=4 2024-09-12T00:37:03.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.771+0000 7fec87ad69c0 20 remove_watcher() i=5 2024-09-12T00:37:03.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.771+0000 7fec87ad69c0 20 remove_watcher() i=6 2024-09-12T00:37:03.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:03.775+0000 7fec87ad69c0 20 remove_watcher() i=7 2024-09-12T00:37:03.787 INFO:tasks.workunit.client.0.smithi138.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:37:33.818 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:37:33.854 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:33.854 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:33.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.902+0000 7facff5139c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.906+0000 7facff5139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.906+0000 7facff5139c0 20 realm 2024-09-12T00:37:33.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.906+0000 7facff5139c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.906+0000 7facff5139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.906+0000 7facff5139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:33.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.906+0000 7facff5139c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.906+0000 7facff5139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.906+0000 7facff5139c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.906+0000 7facff5139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:33.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.906+0000 7facff5139c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.906+0000 7facff5139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:33.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.906+0000 7facff5139c0 20 searching for the correct realm 2024-09-12T00:37:33.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.914+0000 7facfd81a640 0 -- 172.21.15.138:0/1261560370 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55e4c7809c20 msgr2=0x55e4c780c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:33.914 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.918+0000 7facfc818640 0 -- 172.21.15.138:0/1261560370 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55e4c7804ea0 msgr2=0x55e4c7807290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:33.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:33.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:33.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:33.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:33.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:33.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:33.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:33.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:33.924 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 20 zone default found 2024-09-12T00:37:33.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 4 Realm: () 2024-09-12T00:37:33.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:33.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:33.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:33.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 20 zonegroup default 2024-09-12T00:37:33.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.926+0000 7facff5139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.930+0000 7facff5139c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.930+0000 7facff5139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.930+0000 7facff5139c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.930+0000 7facff5139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:33.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.930+0000 7facff5139c0 20 started sync module instance, tier type = 2024-09-12T00:37:33.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.930+0000 7facff5139c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:33.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.946+0000 7facff5139c0 20 add_watcher() i=0 2024-09-12T00:37:33.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.946+0000 7facff5139c0 20 add_watcher() i=1 2024-09-12T00:37:33.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.946+0000 7facff5139c0 20 add_watcher() i=2 2024-09-12T00:37:33.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.946+0000 7facff5139c0 20 add_watcher() i=3 2024-09-12T00:37:33.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.946+0000 7facff5139c0 20 add_watcher() i=4 2024-09-12T00:37:33.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.946+0000 7facff5139c0 20 add_watcher() i=5 2024-09-12T00:37:33.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.946+0000 7facff5139c0 20 add_watcher() i=6 2024-09-12T00:37:33.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.950+0000 7facff5139c0 20 add_watcher() i=7 2024-09-12T00:37:33.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.950+0000 7facff5139c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:33.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.954+0000 7fabb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:33.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.954+0000 7facff5139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:33.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.954+0000 7facff5139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:33.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.954+0000 7facff5139c0 5 note: GC not initialized 2024-09-12T00:37:33.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.954+0000 7fabb27e4640 20 reqs_thread_entry: start 2024-09-12T00:37:33.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.954+0000 7facff5139c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:33.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.954+0000 7facff5139c0 20 Filter name: none 2024-09-12T00:37:33.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.954+0000 7fab23fff640 20 reqs_thread_entry: start 2024-09-12T00:37:33.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.954+0000 7facff5139c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:37:33.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.954+0000 7facff5139c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.954+0000 7facff5139c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:37:33.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.954+0000 7facff5139c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:37:33.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.954+0000 7facff5139c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:37:33.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.954+0000 7facff5139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 : miss 2024-09-12T00:37:33.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.954+0000 7facff5139c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:33.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.958+0000 7facff5139c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:37:33.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.958+0000 7facff5139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 info.flags=0x17 2024-09-12T00:37:33.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.958+0000 7facff5139c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to cache LRU end 2024-09-12T00:37:33.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.958+0000 7facff5139c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:33.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.958+0000 7facff5139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:33.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.958+0000 7facff5139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 2024-09-12T00:37:33.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.958+0000 7facff5139c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:37:33.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.978+0000 7facff5139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 info.flags=0x17 2024-09-12T00:37:33.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.978+0000 7facff5139c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to cache LRU end 2024-09-12T00:37:33.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.978+0000 7facff5139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:33.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.978+0000 7facff5139c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34, ofs0, ns] 2024-09-12T00:37:33.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.978+0000 7fabcffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333575 cookie 94441088016784 notifier 7623 bl.length()=911 2024-09-12T00:37:33.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.978+0000 7fabcffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 info.flags=0x17 2024-09-12T00:37:33.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.978+0000 7fabcffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to cache LRU end 2024-09-12T00:37:33.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.978+0000 7fabcffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:33.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.978+0000 7facff5139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): orig_sources= new_sources= 2024-09-12T00:37:33.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.978+0000 7facff5139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): potential sources added=[] removed=[] 2024-09-12T00:37:33.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.978+0000 7facff5139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): orig_dests= new_dests= 2024-09-12T00:37:33.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.978+0000 7facff5139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): potential dests added=[] removed=[] 2024-09-12T00:37:33.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.0 2024-09-12T00:37:33.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.0 2024-09-12T00:37:33.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.1 2024-09-12T00:37:33.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.1 2024-09-12T00:37:33.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.2 2024-09-12T00:37:33.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.2 2024-09-12T00:37:33.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.3 2024-09-12T00:37:33.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.3 2024-09-12T00:37:33.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.4 2024-09-12T00:37:33.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.4 2024-09-12T00:37:33.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.5 2024-09-12T00:37:33.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.5 2024-09-12T00:37:33.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.6 2024-09-12T00:37:33.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.6 2024-09-12T00:37:33.989 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.7 2024-09-12T00:37:33.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.7 2024-09-12T00:37:33.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.8 2024-09-12T00:37:33.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.8 2024-09-12T00:37:33.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.9 2024-09-12T00:37:33.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.9 2024-09-12T00:37:33.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.10 2024-09-12T00:37:33.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.10 2024-09-12T00:37:33.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.11 2024-09-12T00:37:33.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2.11 2024-09-12T00:37:33.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.0 2024-09-12T00:37:33.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.990+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.1 2024-09-12T00:37:33.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.994+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2 2024-09-12T00:37:33.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.994+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.3 2024-09-12T00:37:33.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.994+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.4 2024-09-12T00:37:33.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.994+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.5 2024-09-12T00:37:33.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.994+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.6 2024-09-12T00:37:33.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.998+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.7 2024-09-12T00:37:33.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.998+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.8 2024-09-12T00:37:33.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.998+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.9 2024-09-12T00:37:33.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:33.998+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.10 2024-09-12T00:37:34.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.006+0000 7facff5139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:34.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.006+0000 7facff5139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 2024-09-12T00:37:34.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.010+0000 7facff5139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 info.flags=0x17 2024-09-12T00:37:34.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.010+0000 7facff5139c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to cache LRU end 2024-09-12T00:37:34.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.010+0000 7facff5139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:34.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.010+0000 7facff5139c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34, ofs0, ns] 2024-09-12T00:37:34.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.010+0000 7fabcffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333576 cookie 94441088016784 notifier 7623 bl.length()=911 2024-09-12T00:37:34.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.010+0000 7fabcffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 info.flags=0x17 2024-09-12T00:37:34.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.010+0000 7fabcffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to cache LRU end 2024-09-12T00:37:34.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.010+0000 7fabcffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:34.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.014+0000 7facff5139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): orig_sources= new_sources= 2024-09-12T00:37:34.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.014+0000 7facff5139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): potential sources added=[] removed=[] 2024-09-12T00:37:34.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.014+0000 7facff5139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): orig_dests= new_dests= 2024-09-12T00:37:34.009 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.014+0000 7facff5139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): potential dests added=[] removed=[] 2024-09-12T00:37:34.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.018+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.0 2024-09-12T00:37:34.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.018+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.1 2024-09-12T00:37:34.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.018+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.2 2024-09-12T00:37:34.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.018+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.3 2024-09-12T00:37:34.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.022+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.4 2024-09-12T00:37:34.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.022+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.5 2024-09-12T00:37:34.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.022+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.6 2024-09-12T00:37:34.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.022+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.7 2024-09-12T00:37:34.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.022+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.8 2024-09-12T00:37:34.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.022+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.9 2024-09-12T00:37:34.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.026+0000 7facff5139c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.34.10 2024-09-12T00:37:34.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.026+0000 7facff5139c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:34.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.026+0000 7facff5139c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 2024-09-12T00:37:34.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.030+0000 7facff5139c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 info.flags=0x17 2024-09-12T00:37:34.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.030+0000 7facff5139c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to cache LRU end 2024-09-12T00:37:34.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.030+0000 7facff5139c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:34.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.030+0000 7facff5139c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34, ofs0, ns] 2024-09-12T00:37:34.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.030+0000 7fabcffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333577 cookie 94441088016784 notifier 7623 bl.length()=879 2024-09-12T00:37:34.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.030+0000 7fabcffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 info.flags=0x17 2024-09-12T00:37:34.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.030+0000 7fabcffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:e2043445-c131-4520-984d-b4d52f038a6b.4538.34 to cache LRU end 2024-09-12T00:37:34.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.030+0000 7fabcffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:34.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.030+0000 7facff5139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): orig_sources= new_sources= 2024-09-12T00:37:34.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.030+0000 7facff5139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): potential sources added=[] removed=[] 2024-09-12T00:37:34.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.030+0000 7facff5139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): orig_dests= new_dests= 2024-09-12T00:37:34.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.030+0000 7facff5139c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[e2043445-c131-4520-984d-b4d52f038a6b.4538.34]): potential dests added=[] removed=[] 2024-09-12T00:37:34.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.034+0000 7facff5139c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T00:37:34.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.038+0000 7fabb37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:34.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.042+0000 7facff5139c0 20 remove_watcher() i=0 2024-09-12T00:37:34.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.042+0000 7facff5139c0 2 removed watcher, disabling cache 2024-09-12T00:37:34.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.046+0000 7facff5139c0 20 remove_watcher() i=1 2024-09-12T00:37:34.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.046+0000 7facff5139c0 20 remove_watcher() i=2 2024-09-12T00:37:34.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.050+0000 7facff5139c0 20 remove_watcher() i=3 2024-09-12T00:37:34.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.050+0000 7facff5139c0 20 remove_watcher() i=4 2024-09-12T00:37:34.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.054+0000 7facff5139c0 20 remove_watcher() i=5 2024-09-12T00:37:34.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.058+0000 7facff5139c0 20 remove_watcher() i=6 2024-09-12T00:37:34.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.058+0000 7facff5139c0 20 remove_watcher() i=7 2024-09-12T00:37:34.073 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:37:34.104 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:34.104 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:34.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.150+0000 7f43ec46e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.154+0000 7f43ec46e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.154+0000 7f43ec46e9c0 20 realm 2024-09-12T00:37:34.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.154+0000 7f43ec46e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.154+0000 7f43ec46e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.154+0000 7f43ec46e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:34.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.154+0000 7f43ec46e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.154+0000 7f43ec46e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.154+0000 7f43ec46e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.154+0000 7f43ec46e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:34.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.154+0000 7f43ec46e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.158+0000 7f43ec46e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:34.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.158+0000 7f43ec46e9c0 20 searching for the correct realm 2024-09-12T00:37:34.158 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.162+0000 7f43ea775640 0 -- 172.21.15.138:0/3646389280 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f43e4014030 msgr2=0x7f43e4065040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:34.375 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.378+0000 7f43ea775640 0 -- 172.21.15.138:0/3646389280 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5633e91f5460 msgr2=0x5633e91f7920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:34.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.386+0000 7f43ec46e9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:34.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.386+0000 7f43ec46e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:34.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.386+0000 7f43ec46e9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:34.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.386+0000 7f43ec46e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:34.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.386+0000 7f43ec46e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:34.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.386+0000 7f43ec46e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:34.384 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.386+0000 7f43ec46e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.390+0000 7f43ec46e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.390+0000 7f43ec46e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.390+0000 7f43ec46e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:34.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.390+0000 7f43ec46e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.390+0000 7f43ec46e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:34.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.390+0000 7f43ec46e9c0 20 zone default found 2024-09-12T00:37:34.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.390+0000 7f43ec46e9c0 4 Realm: () 2024-09-12T00:37:34.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.390+0000 7f43ec46e9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:34.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.390+0000 7f43ec46e9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:34.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.390+0000 7f43ec46e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:34.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.390+0000 7f43ec46e9c0 20 zonegroup default 2024-09-12T00:37:34.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.390+0000 7f43ec46e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.390+0000 7f43ec46e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.390+0000 7f43ec46e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.390+0000 7f43ec46e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.390+0000 7f43ec46e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.394+0000 7f43ec46e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:34.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.394+0000 7f43ec46e9c0 20 started sync module instance, tier type = 2024-09-12T00:37:34.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.394+0000 7f43ec46e9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:34.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.414+0000 7f43ec46e9c0 20 add_watcher() i=0 2024-09-12T00:37:34.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.414+0000 7f43ec46e9c0 20 add_watcher() i=1 2024-09-12T00:37:34.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.414+0000 7f43ec46e9c0 20 add_watcher() i=2 2024-09-12T00:37:34.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.414+0000 7f43ec46e9c0 20 add_watcher() i=3 2024-09-12T00:37:34.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.414+0000 7f43ec46e9c0 20 add_watcher() i=4 2024-09-12T00:37:34.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.414+0000 7f43ec46e9c0 20 add_watcher() i=5 2024-09-12T00:37:34.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.414+0000 7f43ec46e9c0 20 add_watcher() i=6 2024-09-12T00:37:34.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.418+0000 7f43ec46e9c0 20 add_watcher() i=7 2024-09-12T00:37:34.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.418+0000 7f43ec46e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:34.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.422+0000 7f429b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:34.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.422+0000 7f43ec46e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:34.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.422+0000 7f43ec46e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:34.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.422+0000 7f43ec46e9c0 5 note: GC not initialized 2024-09-12T00:37:34.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.422+0000 7f429a7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:34.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.422+0000 7f43ec46e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:34.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.422+0000 7f43ec46e9c0 20 Filter name: none 2024-09-12T00:37:34.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.422+0000 7f420bfff640 20 reqs_thread_entry: start 2024-09-12T00:37:34.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.426+0000 7f43ec46e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.426+0000 7f43ec46e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:37:34.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.426+0000 7f43ec46e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.426+0000 7f43ec46e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:37:34.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.426+0000 7f43ec46e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:34.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.426+0000 7f43ec46e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.426+0000 7f43ec46e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:37:34.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.426+0000 7f43ec46e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:34.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.426+0000 7f43ec46e9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:37:34.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.426+0000 7f43ec46e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:34.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.430+0000 7f429b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:34.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.434+0000 7f43ec46e9c0 20 remove_watcher() i=0 2024-09-12T00:37:34.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.434+0000 7f43ec46e9c0 2 removed watcher, disabling cache 2024-09-12T00:37:34.434 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.438+0000 7f43ec46e9c0 20 remove_watcher() i=1 2024-09-12T00:37:34.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.442+0000 7f43ec46e9c0 20 remove_watcher() i=2 2024-09-12T00:37:34.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.442+0000 7f43ec46e9c0 20 remove_watcher() i=3 2024-09-12T00:37:34.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.446+0000 7f43ec46e9c0 20 remove_watcher() i=4 2024-09-12T00:37:34.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.446+0000 7f43ec46e9c0 20 remove_watcher() i=5 2024-09-12T00:37:34.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.450+0000 7f43ec46e9c0 20 remove_watcher() i=6 2024-09-12T00:37:34.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:34.454+0000 7f43ec46e9c0 20 remove_watcher() i=7 2024-09-12T00:37:34.472 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:34.472 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:37:34.473 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-do-reshard id: e2043445-c131-4520-984d-b4d52f038a6b.4538.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:37:34.473 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:34.474 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.474 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.477 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.478 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.528 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.528 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.579 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T00:37:34.579 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:34.580 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.581 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.599 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.600 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.645 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.645 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.666 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.666 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.687 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.687 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.709 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.709 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.731 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.732 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.752 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.752 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.772 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.772 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.793 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.794 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.815 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.815 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.837 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.837 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.858 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.858 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.878 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.878 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.899 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.899 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.920 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.920 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.942 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.942 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.963 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.963 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:34.984 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:34.985 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:35.005 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:35.005 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:35.027 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:35.027 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:35.048 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:35.048 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:35.067 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:37:35.100 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:35.100 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:35.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.146+0000 7fb2af4929c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.150+0000 7fb2af4929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.150+0000 7fb2af4929c0 20 realm 2024-09-12T00:37:35.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.150+0000 7fb2af4929c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.150+0000 7fb2af4929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.150+0000 7fb2af4929c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:35.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.150+0000 7fb2af4929c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.150+0000 7fb2af4929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.150+0000 7fb2af4929c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.150+0000 7fb2af4929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:35.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.150+0000 7fb2af4929c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.150+0000 7fb2af4929c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:35.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.150+0000 7fb2af4929c0 20 searching for the correct realm 2024-09-12T00:37:35.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.158+0000 7fb2ad799640 0 -- 172.21.15.138:0/2726582352 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fb2a4085c20 msgr2=0x7fb2a408d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:35.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.374+0000 7fb2ad799640 0 -- 172.21.15.138:0/2726582352 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5560d463be30 msgr2=0x5560d463e2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:35.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.382+0000 7fb2af4929c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:35.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.382+0000 7fb2af4929c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:35.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.382+0000 7fb2af4929c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:35.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.382+0000 7fb2af4929c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:35.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.382+0000 7fb2af4929c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:35.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.382+0000 7fb2af4929c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:35.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.382+0000 7fb2af4929c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.382+0000 7fb2af4929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.382+0000 7fb2af4929c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.382+0000 7fb2af4929c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:35.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.382+0000 7fb2af4929c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.386+0000 7fb2af4929c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:35.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.386+0000 7fb2af4929c0 20 zone default found 2024-09-12T00:37:35.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.386+0000 7fb2af4929c0 4 Realm: () 2024-09-12T00:37:35.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.386+0000 7fb2af4929c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:35.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.386+0000 7fb2af4929c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:35.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.386+0000 7fb2af4929c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:35.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.386+0000 7fb2af4929c0 20 zonegroup default 2024-09-12T00:37:35.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.386+0000 7fb2af4929c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.386+0000 7fb2af4929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.386+0000 7fb2af4929c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.386+0000 7fb2af4929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.386+0000 7fb2af4929c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.386+0000 7fb2af4929c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.386+0000 7fb2af4929c0 20 started sync module instance, tier type = 2024-09-12T00:37:35.383 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.386+0000 7fb2af4929c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:35.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.410+0000 7fb2af4929c0 20 add_watcher() i=0 2024-09-12T00:37:35.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.410+0000 7fb2af4929c0 20 add_watcher() i=1 2024-09-12T00:37:35.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.410+0000 7fb2af4929c0 20 add_watcher() i=2 2024-09-12T00:37:35.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.410+0000 7fb2af4929c0 20 add_watcher() i=3 2024-09-12T00:37:35.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.410+0000 7fb2af4929c0 20 add_watcher() i=4 2024-09-12T00:37:35.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.410+0000 7fb2af4929c0 20 add_watcher() i=5 2024-09-12T00:37:35.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.410+0000 7fb2af4929c0 20 add_watcher() i=6 2024-09-12T00:37:35.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.410+0000 7fb2af4929c0 20 add_watcher() i=7 2024-09-12T00:37:35.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.410+0000 7fb2af4929c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:35.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.414+0000 7fb162fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:35.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.418+0000 7fb2af4929c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:35.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.418+0000 7fb2af4929c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:35.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.418+0000 7fb2af4929c0 5 note: GC not initialized 2024-09-12T00:37:35.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.418+0000 7fb161fe3640 20 reqs_thread_entry: start 2024-09-12T00:37:35.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.418+0000 7fb2af4929c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:35.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.418+0000 7fb2af4929c0 20 Filter name: none 2024-09-12T00:37:35.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.418+0000 7fb0d37fe640 20 reqs_thread_entry: start 2024-09-12T00:37:35.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.418+0000 7fb2af4929c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.418+0000 7fb2af4929c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:37:35.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.418+0000 7fb2af4929c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.418+0000 7fb2af4929c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:37:35.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.418+0000 7fb2af4929c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:35.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.418+0000 7fb2af4929c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.422+0000 7fb2af4929c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:37:35.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.422+0000 7fb2af4929c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.422+0000 7fb2af4929c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:37:35.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.422+0000 7fb2af4929c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:35.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.422+0000 7fb162fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:35.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.426+0000 7fb2af4929c0 20 remove_watcher() i=0 2024-09-12T00:37:35.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.426+0000 7fb2af4929c0 2 removed watcher, disabling cache 2024-09-12T00:37:35.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.430+0000 7fb2af4929c0 20 remove_watcher() i=1 2024-09-12T00:37:35.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.430+0000 7fb2af4929c0 20 remove_watcher() i=2 2024-09-12T00:37:35.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.434+0000 7fb2af4929c0 20 remove_watcher() i=3 2024-09-12T00:37:35.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.434+0000 7fb2af4929c0 20 remove_watcher() i=4 2024-09-12T00:37:35.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.438+0000 7fb2af4929c0 20 remove_watcher() i=5 2024-09-12T00:37:35.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.442+0000 7fb2af4929c0 20 remove_watcher() i=6 2024-09-12T00:37:35.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.442+0000 7fb2af4929c0 20 remove_watcher() i=7 2024-09-12T00:37:35.454 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:35.454 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:37:35.454 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-logrecord-writes id: e2043445-c131-4520-984d-b4d52f038a6b.4538.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:35.454 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:35.454 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T00:37:35.486 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:35.486 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:35.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.530+0000 7fe9c79679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.534+0000 7fe9c79679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.534+0000 7fe9c79679c0 20 realm 2024-09-12T00:37:35.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.534+0000 7fe9c79679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.534+0000 7fe9c79679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.534+0000 7fe9c79679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:35.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.534+0000 7fe9c79679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.534+0000 7fe9c79679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.534+0000 7fe9c79679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.534+0000 7fe9c79679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:35.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.534+0000 7fe9c79679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.538+0000 7fe9c79679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:35.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.538+0000 7fe9c79679c0 20 searching for the correct realm 2024-09-12T00:37:35.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.542+0000 7fe9c4c6c640 0 -- 172.21.15.138:0/3493626293 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7fe9c001c040 msgr2=0x7fe9c0069140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:35.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.758+0000 7fe9c4c6c640 0 -- 172.21.15.138:0/3493626293 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55888febde90 msgr2=0x55888fec0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:35.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.770+0000 7fe9c79679c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:35.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.770+0000 7fe9c79679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:35.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.770+0000 7fe9c79679c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:35.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.770+0000 7fe9c79679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:35.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.770+0000 7fe9c79679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:35.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.770+0000 7fe9c79679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:35.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.770+0000 7fe9c79679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.770+0000 7fe9c79679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.770+0000 7fe9c79679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.774+0000 7fe9c79679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:35.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.774+0000 7fe9c79679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.774+0000 7fe9c79679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:35.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.774+0000 7fe9c79679c0 20 zone default found 2024-09-12T00:37:35.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.774+0000 7fe9c79679c0 4 Realm: () 2024-09-12T00:37:35.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.774+0000 7fe9c79679c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:35.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.774+0000 7fe9c79679c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:35.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.774+0000 7fe9c79679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:35.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.774+0000 7fe9c79679c0 20 zonegroup default 2024-09-12T00:37:35.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.774+0000 7fe9c79679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.774+0000 7fe9c79679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.774+0000 7fe9c79679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.774+0000 7fe9c79679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.774+0000 7fe9c79679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.774+0000 7fe9c79679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.774+0000 7fe9c79679c0 20 started sync module instance, tier type = 2024-09-12T00:37:35.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.778+0000 7fe9c79679c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:35.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.798+0000 7fe9c79679c0 20 add_watcher() i=0 2024-09-12T00:37:35.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.798+0000 7fe9c79679c0 20 add_watcher() i=1 2024-09-12T00:37:35.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.798+0000 7fe9c79679c0 20 add_watcher() i=2 2024-09-12T00:37:35.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.798+0000 7fe9c79679c0 20 add_watcher() i=3 2024-09-12T00:37:35.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.798+0000 7fe9c79679c0 20 add_watcher() i=4 2024-09-12T00:37:35.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.798+0000 7fe9c79679c0 20 add_watcher() i=5 2024-09-12T00:37:35.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.798+0000 7fe9c79679c0 20 add_watcher() i=6 2024-09-12T00:37:35.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.798+0000 7fe9c79679c0 20 add_watcher() i=7 2024-09-12T00:37:35.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.798+0000 7fe9c79679c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:35.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe87b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:35.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:35.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:35.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 5 note: GC not initialized 2024-09-12T00:37:35.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe87a7e4640 20 reqs_thread_entry: start 2024-09-12T00:37:35.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:35.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 20 Filter name: none 2024-09-12T00:37:35.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe7ebfff640 20 reqs_thread_entry: start 2024-09-12T00:37:35.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:37:35.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:37:35.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:37:35.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:37:35.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 : miss 2024-09-12T00:37:35.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:37:35.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 info.flags=0x17 2024-09-12T00:37:35.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 to cache LRU end 2024-09-12T00:37:35.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:35.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:35.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.806+0000 7fe9c79679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 2024-09-12T00:37:35.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.818+0000 7fe9c79679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 info.flags=0x17 2024-09-12T00:37:35.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.818+0000 7fe9c79679c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 to cache LRU end 2024-09-12T00:37:35.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.818+0000 7fe9c79679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:35.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.818+0000 7fe9c79679c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35, ofs0, ns] 2024-09-12T00:37:35.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.818+0000 7fe8a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333548 cookie 94045018520880 notifier 7680 bl.length()=923 2024-09-12T00:37:35.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.818+0000 7fe8a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 info.flags=0x17 2024-09-12T00:37:35.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.818+0000 7fe8a8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 to cache LRU end 2024-09-12T00:37:35.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.818+0000 7fe8a8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:35.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.822+0000 7fe9c79679c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): orig_sources= new_sources= 2024-09-12T00:37:35.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.822+0000 7fe9c79679c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): potential sources added=[] removed=[] 2024-09-12T00:37:35.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.822+0000 7fe9c79679c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): orig_dests= new_dests= 2024-09-12T00:37:35.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.822+0000 7fe9c79679c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): potential dests added=[] removed=[] 2024-09-12T00:37:35.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.826+0000 7fe9c79679c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T00:37:35.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.826+0000 7fe9c79679c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:37:35.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.838+0000 7fe9c79679c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:35.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.838+0000 7fe9c79679c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 2024-09-12T00:37:35.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.838+0000 7fe9c79679c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 info.flags=0x17 2024-09-12T00:37:35.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.838+0000 7fe9c79679c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 to cache LRU end 2024-09-12T00:37:35.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.838+0000 7fe9c79679c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:35.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.838+0000 7fe9c79679c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35, ofs0, ns] 2024-09-12T00:37:35.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.838+0000 7fe897fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333549 cookie 94045018520880 notifier 7680 bl.length()=891 2024-09-12T00:37:35.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.838+0000 7fe897fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 info.flags=0x17 2024-09-12T00:37:35.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.838+0000 7fe897fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 to cache LRU end 2024-09-12T00:37:35.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.838+0000 7fe897fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:35.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.842+0000 7fe9c79679c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): orig_sources= new_sources= 2024-09-12T00:37:35.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.842+0000 7fe9c79679c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): potential sources added=[] removed=[] 2024-09-12T00:37:35.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.842+0000 7fe9c79679c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): orig_dests= new_dests= 2024-09-12T00:37:35.837 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.842+0000 7fe9c79679c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): potential dests added=[] removed=[] 2024-09-12T00:37:35.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.846+0000 7fe87b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:35.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.850+0000 7fe9c79679c0 20 remove_watcher() i=0 2024-09-12T00:37:35.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.850+0000 7fe9c79679c0 2 removed watcher, disabling cache 2024-09-12T00:37:35.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.850+0000 7fe9c79679c0 20 remove_watcher() i=1 2024-09-12T00:37:35.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.854+0000 7fe9c79679c0 20 remove_watcher() i=2 2024-09-12T00:37:35.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.854+0000 7fe9c79679c0 20 remove_watcher() i=3 2024-09-12T00:37:35.853 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.858+0000 7fe9c79679c0 20 remove_watcher() i=4 2024-09-12T00:37:35.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.858+0000 7fe9c79679c0 20 remove_watcher() i=5 2024-09-12T00:37:35.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.862+0000 7fe9c79679c0 20 remove_watcher() i=6 2024-09-12T00:37:35.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.866+0000 7fe9c79679c0 20 remove_watcher() i=7 2024-09-12T00:37:35.876 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:37:35.905 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:35.905 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:35.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.950+0000 7fbf08e6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.954+0000 7fbf08e6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.954+0000 7fbf08e6b9c0 20 realm 2024-09-12T00:37:35.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.954+0000 7fbf08e6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.954+0000 7fbf08e6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.954+0000 7fbf08e6b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:35.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.954+0000 7fbf08e6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.954+0000 7fbf08e6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:35.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.954+0000 7fbf08e6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.954+0000 7fbf08e6b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:35.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.954+0000 7fbf08e6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:35.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.958+0000 7fbf08e6b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:35.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.958+0000 7fbf08e6b9c0 20 searching for the correct realm 2024-09-12T00:37:35.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:35.962+0000 7fbf07172640 0 -- 172.21.15.138:0/3827792739 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fbf0000e040 msgr2=0x7fbf00093390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:36.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.178+0000 7fbf07172640 0 -- 172.21.15.138:0/3827792739 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55b2ad5e0480 msgr2=0x55b2ad5e28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:36.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.186+0000 7fbf08e6b9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:36.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.186+0000 7fbf08e6b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:36.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.186+0000 7fbf08e6b9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:36.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.186+0000 7fbf08e6b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:36.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.186+0000 7fbf08e6b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:36.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.186+0000 7fbf08e6b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:36.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.186+0000 7fbf08e6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.190+0000 7fbf08e6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:36.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.190+0000 7fbf08e6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.190+0000 7fbf08e6b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:36.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.190+0000 7fbf08e6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.190+0000 7fbf08e6b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:36.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.190+0000 7fbf08e6b9c0 20 zone default found 2024-09-12T00:37:36.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.190+0000 7fbf08e6b9c0 4 Realm: () 2024-09-12T00:37:36.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.190+0000 7fbf08e6b9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:36.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.190+0000 7fbf08e6b9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:36.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.190+0000 7fbf08e6b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:36.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.190+0000 7fbf08e6b9c0 20 zonegroup default 2024-09-12T00:37:36.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.190+0000 7fbf08e6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.190+0000 7fbf08e6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:36.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.190+0000 7fbf08e6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.194+0000 7fbf08e6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:36.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.194+0000 7fbf08e6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.194+0000 7fbf08e6b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:36.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.194+0000 7fbf08e6b9c0 20 started sync module instance, tier type = 2024-09-12T00:37:36.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.194+0000 7fbf08e6b9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:36.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.214+0000 7fbf08e6b9c0 20 add_watcher() i=0 2024-09-12T00:37:36.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.214+0000 7fbf08e6b9c0 20 add_watcher() i=1 2024-09-12T00:37:36.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.214+0000 7fbf08e6b9c0 20 add_watcher() i=2 2024-09-12T00:37:36.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.214+0000 7fbf08e6b9c0 20 add_watcher() i=3 2024-09-12T00:37:36.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.214+0000 7fbf08e6b9c0 20 add_watcher() i=4 2024-09-12T00:37:36.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.214+0000 7fbf08e6b9c0 20 add_watcher() i=5 2024-09-12T00:37:36.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.214+0000 7fbf08e6b9c0 20 add_watcher() i=6 2024-09-12T00:37:36.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.218+0000 7fbf08e6b9c0 20 add_watcher() i=7 2024-09-12T00:37:36.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.218+0000 7fbf08e6b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:36.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.222+0000 7fbdbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:36.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.222+0000 7fbf08e6b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:36.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.222+0000 7fbf08e6b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:36.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.222+0000 7fbf08e6b9c0 5 note: GC not initialized 2024-09-12T00:37:36.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.222+0000 7fbd37fff640 20 reqs_thread_entry: start 2024-09-12T00:37:36.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.222+0000 7fbf08e6b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:36.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.222+0000 7fbf08e6b9c0 20 Filter name: none 2024-09-12T00:37:36.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.222+0000 7fbd35ffb640 20 reqs_thread_entry: start 2024-09-12T00:37:36.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.226+0000 7fbf08e6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.226+0000 7fbf08e6b9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:37:36.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.226+0000 7fbf08e6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.226+0000 7fbf08e6b9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:37:36.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.226+0000 7fbf08e6b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:36.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.226+0000 7fbf08e6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.226+0000 7fbf08e6b9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:37:36.223 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.226+0000 7fbf08e6b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.226+0000 7fbf08e6b9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:37:36.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.226+0000 7fbf08e6b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:36.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.230+0000 7fbdbd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:36.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.234+0000 7fbf08e6b9c0 20 remove_watcher() i=0 2024-09-12T00:37:36.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.234+0000 7fbf08e6b9c0 2 removed watcher, disabling cache 2024-09-12T00:37:36.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.238+0000 7fbf08e6b9c0 20 remove_watcher() i=1 2024-09-12T00:37:36.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.238+0000 7fbf08e6b9c0 20 remove_watcher() i=2 2024-09-12T00:37:36.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.242+0000 7fbf08e6b9c0 20 remove_watcher() i=3 2024-09-12T00:37:36.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.242+0000 7fbf08e6b9c0 20 remove_watcher() i=4 2024-09-12T00:37:36.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.246+0000 7fbf08e6b9c0 20 remove_watcher() i=5 2024-09-12T00:37:36.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.246+0000 7fbf08e6b9c0 20 remove_watcher() i=6 2024-09-12T00:37:36.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.250+0000 7fbf08e6b9c0 20 remove_watcher() i=7 2024-09-12T00:37:36.265 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:36.265 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:37:36.265 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-logrecord-writes id: e2043445-c131-4520-984d-b4d52f038a6b.4538.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:36.265 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:36.266 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.266 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:36.281 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:36.281 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:36.326 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:37:36.362 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:36.362 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:36.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.410+0000 7f318009f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.410+0000 7f318009f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:36.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.410+0000 7f318009f9c0 20 realm 2024-09-12T00:37:36.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.410+0000 7f318009f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.410+0000 7f318009f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:36.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.410+0000 7f318009f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:36.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.410+0000 7f318009f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.414+0000 7f318009f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:36.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.414+0000 7f318009f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.414+0000 7f318009f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:36.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.414+0000 7f318009f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.414+0000 7f318009f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:36.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.414+0000 7f318009f9c0 20 searching for the correct realm 2024-09-12T00:37:36.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.418+0000 7f317e3a6640 0 -- 172.21.15.138:0/3718872377 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f3178066040 msgr2=0x7f317805bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:36.631 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.634+0000 7f317e3a6640 0 -- 172.21.15.138:0/3718872377 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5630d150e4b0 msgr2=0x5630d1510970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:36.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:36.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:36.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:36.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:36.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:36.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:36.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:36.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:36.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:36.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 20 zone default found 2024-09-12T00:37:36.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 4 Realm: () 2024-09-12T00:37:36.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:36.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:36.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:36.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 20 zonegroup default 2024-09-12T00:37:36.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.646+0000 7f318009f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.650+0000 7f318009f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:36.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.650+0000 7f318009f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.650+0000 7f318009f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:36.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.650+0000 7f318009f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.650+0000 7f318009f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:36.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.650+0000 7f318009f9c0 20 started sync module instance, tier type = 2024-09-12T00:37:36.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.650+0000 7f318009f9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:36.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.674+0000 7f318009f9c0 20 add_watcher() i=0 2024-09-12T00:37:36.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.674+0000 7f318009f9c0 20 add_watcher() i=1 2024-09-12T00:37:36.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.674+0000 7f318009f9c0 20 add_watcher() i=2 2024-09-12T00:37:36.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.674+0000 7f318009f9c0 20 add_watcher() i=3 2024-09-12T00:37:36.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.674+0000 7f318009f9c0 20 add_watcher() i=4 2024-09-12T00:37:36.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.674+0000 7f318009f9c0 20 add_watcher() i=5 2024-09-12T00:37:36.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.674+0000 7f318009f9c0 20 add_watcher() i=6 2024-09-12T00:37:36.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.678+0000 7f318009f9c0 20 add_watcher() i=7 2024-09-12T00:37:36.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.678+0000 7f318009f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:36.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f302f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:36.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:36.677 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:36.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 5 note: GC not initialized 2024-09-12T00:37:36.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f302e7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:36.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:36.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 20 Filter name: none 2024-09-12T00:37:36.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f2f9ffff640 20 reqs_thread_entry: start 2024-09-12T00:37:36.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:37:36.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:37:36.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:37:36.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:37:36.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 : miss 2024-09-12T00:37:36.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:37:36.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 info.flags=0x17 2024-09-12T00:37:36.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 to cache LRU end 2024-09-12T00:37:36.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:36.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:36.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.682+0000 7f318009f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 2024-09-12T00:37:36.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.694+0000 7f318009f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 info.flags=0x17 2024-09-12T00:37:36.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.694+0000 7f318009f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 to cache LRU end 2024-09-12T00:37:36.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.694+0000 7f318009f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:36.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.694+0000 7f318009f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35, ofs0, ns] 2024-09-12T00:37:36.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.694+0000 7f30617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333550 cookie 94767670166384 notifier 7719 bl.length()=923 2024-09-12T00:37:36.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.694+0000 7f30617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 info.flags=0x17 2024-09-12T00:37:36.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.694+0000 7f30617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 to cache LRU end 2024-09-12T00:37:36.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.694+0000 7f30617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:36.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.694+0000 7f318009f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): orig_sources= new_sources= 2024-09-12T00:37:36.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.694+0000 7f318009f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): potential sources added=[] removed=[] 2024-09-12T00:37:36.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.694+0000 7f318009f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): orig_dests= new_dests= 2024-09-12T00:37:36.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.694+0000 7f318009f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): potential dests added=[] removed=[] 2024-09-12T00:37:36.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.0 2024-09-12T00:37:36.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.0 2024-09-12T00:37:36.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.1 2024-09-12T00:37:36.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.1 2024-09-12T00:37:36.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.2 2024-09-12T00:37:36.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.2 2024-09-12T00:37:36.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.3 2024-09-12T00:37:36.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.3 2024-09-12T00:37:36.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.4 2024-09-12T00:37:36.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.4 2024-09-12T00:37:36.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.5 2024-09-12T00:37:36.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.5 2024-09-12T00:37:36.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.6 2024-09-12T00:37:36.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.6 2024-09-12T00:37:36.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.7 2024-09-12T00:37:36.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.7 2024-09-12T00:37:36.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.8 2024-09-12T00:37:36.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.8 2024-09-12T00:37:36.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.9 2024-09-12T00:37:36.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.9 2024-09-12T00:37:36.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.10 2024-09-12T00:37:36.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.10 2024-09-12T00:37:36.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.11 2024-09-12T00:37:36.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1.11 2024-09-12T00:37:36.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.706+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.0 2024-09-12T00:37:36.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.710+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1 2024-09-12T00:37:36.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.710+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.2 2024-09-12T00:37:36.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.710+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.3 2024-09-12T00:37:36.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.710+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.4 2024-09-12T00:37:36.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.714+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.5 2024-09-12T00:37:36.710 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.714+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.6 2024-09-12T00:37:36.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.714+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.7 2024-09-12T00:37:36.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.718+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.8 2024-09-12T00:37:36.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.718+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.9 2024-09-12T00:37:36.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.718+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.10 2024-09-12T00:37:36.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.726+0000 7f318009f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:36.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.726+0000 7f318009f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 2024-09-12T00:37:36.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.726+0000 7f318009f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 info.flags=0x17 2024-09-12T00:37:36.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.726+0000 7f318009f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 to cache LRU end 2024-09-12T00:37:36.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.726+0000 7f318009f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:36.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.726+0000 7f318009f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35, ofs0, ns] 2024-09-12T00:37:36.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.726+0000 7f30617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333551 cookie 94767670166384 notifier 7719 bl.length()=923 2024-09-12T00:37:36.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.726+0000 7f30617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 info.flags=0x17 2024-09-12T00:37:36.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.726+0000 7f30617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 to cache LRU end 2024-09-12T00:37:36.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.726+0000 7f30617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:36.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.726+0000 7f318009f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): orig_sources= new_sources= 2024-09-12T00:37:36.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.726+0000 7f318009f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): potential sources added=[] removed=[] 2024-09-12T00:37:36.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.726+0000 7f318009f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): orig_dests= new_dests= 2024-09-12T00:37:36.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.726+0000 7f318009f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): potential dests added=[] removed=[] 2024-09-12T00:37:36.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.734+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.0 2024-09-12T00:37:36.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.734+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.1 2024-09-12T00:37:36.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.734+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.2 2024-09-12T00:37:36.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.734+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.3 2024-09-12T00:37:36.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.734+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.4 2024-09-12T00:37:36.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.738+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.5 2024-09-12T00:37:36.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.738+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.6 2024-09-12T00:37:36.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.738+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.7 2024-09-12T00:37:36.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.738+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.8 2024-09-12T00:37:36.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.738+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.9 2024-09-12T00:37:36.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.742+0000 7f318009f9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.35.10 2024-09-12T00:37:36.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.742+0000 7f318009f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:37:36.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.742+0000 7f318009f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 2024-09-12T00:37:36.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.742+0000 7f318009f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 info.flags=0x17 2024-09-12T00:37:36.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.742+0000 7f318009f9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 to cache LRU end 2024-09-12T00:37:36.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.742+0000 7f318009f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:36.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.742+0000 7f318009f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35, ofs0, ns] 2024-09-12T00:37:36.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.742+0000 7f30617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333552 cookie 94767670166384 notifier 7719 bl.length()=891 2024-09-12T00:37:36.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.742+0000 7f30617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 info.flags=0x17 2024-09-12T00:37:36.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.742+0000 7f30617fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.35 to cache LRU end 2024-09-12T00:37:36.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.742+0000 7f30617fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:36.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.746+0000 7f318009f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): orig_sources= new_sources= 2024-09-12T00:37:36.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.746+0000 7f318009f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): potential sources added=[] removed=[] 2024-09-12T00:37:36.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.746+0000 7f318009f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): orig_dests= new_dests= 2024-09-12T00:37:36.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.746+0000 7f318009f9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.35]): potential dests added=[] removed=[] 2024-09-12T00:37:36.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.750+0000 7f318009f9c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:37:36.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.754+0000 7f302f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:36.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.758+0000 7f318009f9c0 20 remove_watcher() i=0 2024-09-12T00:37:36.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.758+0000 7f318009f9c0 2 removed watcher, disabling cache 2024-09-12T00:37:36.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.762+0000 7f318009f9c0 20 remove_watcher() i=1 2024-09-12T00:37:36.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.762+0000 7f318009f9c0 20 remove_watcher() i=2 2024-09-12T00:37:36.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.766+0000 7f318009f9c0 20 remove_watcher() i=3 2024-09-12T00:37:36.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.766+0000 7f318009f9c0 20 remove_watcher() i=4 2024-09-12T00:37:36.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.770+0000 7f318009f9c0 20 remove_watcher() i=5 2024-09-12T00:37:36.768 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.770+0000 7f318009f9c0 20 remove_watcher() i=6 2024-09-12T00:37:36.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.774+0000 7f318009f9c0 20 remove_watcher() i=7 2024-09-12T00:37:36.787 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:37:36.817 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:36.817 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:36.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.866+0000 7fa9156b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.866+0000 7fa9156b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:36.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.866+0000 7fa9156b49c0 20 realm 2024-09-12T00:37:36.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.866+0000 7fa9156b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.866+0000 7fa9156b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:36.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.866+0000 7fa9156b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:36.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.866+0000 7fa9156b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.866+0000 7fa9156b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:36.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.866+0000 7fa9156b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.870+0000 7fa9156b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:36.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.870+0000 7fa9156b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:36.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.870+0000 7fa9156b49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:36.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.870+0000 7fa9156b49c0 20 searching for the correct realm 2024-09-12T00:37:36.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.874+0000 7fa9131ba640 0 -- 172.21.15.138:0/963170324 >> [v2:172.21.15.138:6800/1437861584,v1:172.21.15.138:6801/1437861584] conn(0x55f59c2109b0 msgr2=0x55f59c212e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:36.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:36.878+0000 7fa9131ba640 0 -- 172.21.15.138:0/963170324 >> [v2:172.21.15.178:6811/2062234204,v1:172.21.15.178:6813/2062234204] conn(0x7fa904029040 msgr2=0x7fa90400e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:37.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:37.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:37.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:37.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:37.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:37.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:37.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:37.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:37.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 20 zone default found 2024-09-12T00:37:37.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 4 Realm: () 2024-09-12T00:37:37.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:37.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:37.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:37.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 20 zonegroup default 2024-09-12T00:37:37.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.098+0000 7fa9156b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.102+0000 7fa9156b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.102+0000 7fa9156b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.102+0000 7fa9156b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.102+0000 7fa9156b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.102+0000 7fa9156b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.102+0000 7fa9156b49c0 20 started sync module instance, tier type = 2024-09-12T00:37:37.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.102+0000 7fa9156b49c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:37.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.122+0000 7fa9156b49c0 20 add_watcher() i=0 2024-09-12T00:37:37.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.122+0000 7fa9156b49c0 20 add_watcher() i=1 2024-09-12T00:37:37.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.122+0000 7fa9156b49c0 20 add_watcher() i=2 2024-09-12T00:37:37.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.122+0000 7fa9156b49c0 20 add_watcher() i=3 2024-09-12T00:37:37.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.122+0000 7fa9156b49c0 20 add_watcher() i=4 2024-09-12T00:37:37.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.122+0000 7fa9156b49c0 20 add_watcher() i=5 2024-09-12T00:37:37.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.122+0000 7fa9156b49c0 20 add_watcher() i=6 2024-09-12T00:37:37.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.126+0000 7fa9156b49c0 20 add_watcher() i=7 2024-09-12T00:37:37.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.126+0000 7fa9156b49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:37.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.130+0000 7fa7c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:37.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.130+0000 7fa9156b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:37.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.130+0000 7fa9156b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:37.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.130+0000 7fa9156b49c0 5 note: GC not initialized 2024-09-12T00:37:37.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.130+0000 7fa7c8fe1640 20 reqs_thread_entry: start 2024-09-12T00:37:37.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.130+0000 7fa9156b49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:37.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.130+0000 7fa9156b49c0 20 Filter name: none 2024-09-12T00:37:37.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.130+0000 7fa7427fc640 20 reqs_thread_entry: start 2024-09-12T00:37:37.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.130+0000 7fa9156b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.130+0000 7fa9156b49c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:37:37.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.130+0000 7fa9156b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.130+0000 7fa9156b49c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:37:37.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.130+0000 7fa9156b49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:37.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.130+0000 7fa9156b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.130+0000 7fa9156b49c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:37:37.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.134+0000 7fa9156b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.134+0000 7fa9156b49c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:37:37.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.134+0000 7fa9156b49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:37.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.138+0000 7fa7c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:37.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.142+0000 7fa9156b49c0 20 remove_watcher() i=0 2024-09-12T00:37:37.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.142+0000 7fa9156b49c0 2 removed watcher, disabling cache 2024-09-12T00:37:37.139 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.142+0000 7fa9156b49c0 20 remove_watcher() i=1 2024-09-12T00:37:37.141 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.146+0000 7fa9156b49c0 20 remove_watcher() i=2 2024-09-12T00:37:37.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.146+0000 7fa9156b49c0 20 remove_watcher() i=3 2024-09-12T00:37:37.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.150+0000 7fa9156b49c0 20 remove_watcher() i=4 2024-09-12T00:37:37.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.150+0000 7fa9156b49c0 20 remove_watcher() i=5 2024-09-12T00:37:37.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.154+0000 7fa9156b49c0 20 remove_watcher() i=6 2024-09-12T00:37:37.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.158+0000 7fa9156b49c0 20 remove_watcher() i=7 2024-09-12T00:37:37.168 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:37.169 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:37:37.169 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-logrecord-writes id: e2043445-c131-4520-984d-b4d52f038a6b.4538.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:37:37.169 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:37.170 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.170 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.174 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.174 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.228 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.228 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.272 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T00:37:37.273 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:37.274 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.274 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.296 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.296 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.344 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.345 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.366 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.366 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.387 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.387 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.412 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.412 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.435 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.435 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.455 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.455 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.475 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.475 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.494 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.495 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.516 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.516 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.536 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.536 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.558 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.558 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.579 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.579 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.599 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.600 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.621 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.621 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.644 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.644 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.664 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.664 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.685 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.685 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.706 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.706 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.731 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.731 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.801 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:37.801 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:37.820 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:37:37.851 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:37.852 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:37.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.898+0000 7fdbff8f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.902+0000 7fdbff8f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.902+0000 7fdbff8f49c0 20 realm 2024-09-12T00:37:37.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.902+0000 7fdbff8f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.902+0000 7fdbff8f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.902+0000 7fdbff8f49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:37.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.902+0000 7fdbff8f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.902+0000 7fdbff8f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:37.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.902+0000 7fdbff8f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.902+0000 7fdbff8f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:37.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.902+0000 7fdbff8f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:37.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.902+0000 7fdbff8f49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:37.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:37.902+0000 7fdbff8f49c0 20 searching for the correct realm 2024-09-12T00:37:38.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.114+0000 7fdbfcbf9640 0 -- 172.21.15.138:0/1089086479 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7fdbf00c0040 msgr2=0x7fdbf0135780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.122+0000 7fdbfcbf9640 0 -- 172.21.15.138:0/1089086479 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55cff827d760 msgr2=0x55cff827fb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:38.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:38.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:38.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:38.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:38.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:38.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:38.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 20 zone default found 2024-09-12T00:37:38.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 4 Realm: () 2024-09-12T00:37:38.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:38.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:38.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:38.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 20 zonegroup default 2024-09-12T00:37:38.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.138+0000 7fdbff8f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.142+0000 7fdbff8f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.142+0000 7fdbff8f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.142+0000 7fdbff8f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.142+0000 7fdbff8f49c0 20 started sync module instance, tier type = 2024-09-12T00:37:38.138 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.142+0000 7fdbff8f49c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:38.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.166+0000 7fdbff8f49c0 20 add_watcher() i=0 2024-09-12T00:37:38.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.166+0000 7fdbff8f49c0 20 add_watcher() i=1 2024-09-12T00:37:38.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.166+0000 7fdbff8f49c0 20 add_watcher() i=2 2024-09-12T00:37:38.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.166+0000 7fdbff8f49c0 20 add_watcher() i=3 2024-09-12T00:37:38.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.166+0000 7fdbff8f49c0 20 add_watcher() i=4 2024-09-12T00:37:38.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.166+0000 7fdbff8f49c0 20 add_watcher() i=5 2024-09-12T00:37:38.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.166+0000 7fdbff8f49c0 20 add_watcher() i=6 2024-09-12T00:37:38.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.166+0000 7fdbff8f49c0 20 add_watcher() i=7 2024-09-12T00:37:38.163 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.166+0000 7fdbff8f49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:38.167 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.170+0000 7fdab37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:38.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.170+0000 7fdbff8f49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:38.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.170+0000 7fdbff8f49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:38.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.174+0000 7fdbff8f49c0 5 note: GC not initialized 2024-09-12T00:37:38.169 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.174+0000 7fdab27e4640 20 reqs_thread_entry: start 2024-09-12T00:37:38.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.174+0000 7fdbff8f49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:38.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.174+0000 7fdbff8f49c0 20 Filter name: none 2024-09-12T00:37:38.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.174+0000 7fda23fff640 20 reqs_thread_entry: start 2024-09-12T00:37:38.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.174+0000 7fdbff8f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.174+0000 7fdbff8f49c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:37:38.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.174+0000 7fdbff8f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.174+0000 7fdbff8f49c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:37:38.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.174+0000 7fdbff8f49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:38.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.174+0000 7fdbff8f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.178+0000 7fdbff8f49c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:37:38.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.178+0000 7fdbff8f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.178+0000 7fdbff8f49c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:37:38.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.178+0000 7fdbff8f49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:38.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.182+0000 7fdab37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:38.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.186+0000 7fdbff8f49c0 20 remove_watcher() i=0 2024-09-12T00:37:38.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.186+0000 7fdbff8f49c0 2 removed watcher, disabling cache 2024-09-12T00:37:38.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.186+0000 7fdbff8f49c0 20 remove_watcher() i=1 2024-09-12T00:37:38.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.190+0000 7fdbff8f49c0 20 remove_watcher() i=2 2024-09-12T00:37:38.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.190+0000 7fdbff8f49c0 20 remove_watcher() i=3 2024-09-12T00:37:38.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.194+0000 7fdbff8f49c0 20 remove_watcher() i=4 2024-09-12T00:37:38.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.198+0000 7fdbff8f49c0 20 remove_watcher() i=5 2024-09-12T00:37:38.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.198+0000 7fdbff8f49c0 20 remove_watcher() i=6 2024-09-12T00:37:38.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.202+0000 7fdbff8f49c0 20 remove_watcher() i=7 2024-09-12T00:37:38.213 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.214 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:37:38.214 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-logrecord-writes id: e2043445-c131-4520-984d-b4d52f038a6b.4538.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:38.214 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.214 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:37:38.251 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:38.251 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:38.294 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.298+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.298+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.298+0000 7f4be9dda9c0 20 realm 2024-09-12T00:37:38.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.298+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.302+0000 7f4be9dda9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:38.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:38.299 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 searching for the correct realm 2024-09-12T00:37:38.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.306+0000 7f4be80e1640 0 -- 172.21.15.138:0/3120592061 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f4be00d0910 msgr2=0x7f4be00b83e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.518 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.522+0000 7f4be80e1640 0 -- 172.21.15.138:0/3120592061 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55684ace4aa0 msgr2=0x55684ace6f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:38.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:38.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:38.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:38.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:38.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:38.528 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.529 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:38.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 zone default found 2024-09-12T00:37:38.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.534+0000 7f4be9dda9c0 4 Realm: () 2024-09-12T00:37:38.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.534+0000 7f4be9dda9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:38.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.534+0000 7f4be9dda9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:38.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.534+0000 7f4be9dda9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:38.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 zonegroup default 2024-09-12T00:37:38.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.530 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 started sync module instance, tier type = 2024-09-12T00:37:38.532 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:38.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=0 2024-09-12T00:37:38.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=1 2024-09-12T00:37:38.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=2 2024-09-12T00:37:38.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=3 2024-09-12T00:37:38.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=4 2024-09-12T00:37:38.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=5 2024-09-12T00:37:38.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=6 2024-09-12T00:37:38.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.562+0000 7f4be9dda9c0 20 add_watcher() i=7 2024-09-12T00:37:38.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.562+0000 7f4be9dda9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:38.561 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.566+0000 7f4a9e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:38.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:38.562 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:38.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 note: GC not initialized 2024-09-12T00:37:38.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.566+0000 7f4a9d7e2640 20 reqs_thread_entry: start 2024-09-12T00:37:38.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:38.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 Filter name: none 2024-09-12T00:37:38.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.566+0000 7f4a967fc640 20 reqs_thread_entry: start 2024-09-12T00:37:38.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.566+0000 7f4be9dda9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:37:38.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:37:38.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.566+0000 7f4be9dda9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:37:38.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.566+0000 7f4be9dda9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:37:38.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.566+0000 7f4be9dda9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 : miss 2024-09-12T00:37:38.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.570+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:37:38.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.570+0000 7f4be9dda9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 info.flags=0x17 2024-09-12T00:37:38.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.570+0000 7f4be9dda9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to cache LRU end 2024-09-12T00:37:38.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.570+0000 7f4be9dda9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:38.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.570+0000 7f4be9dda9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.570+0000 7f4be9dda9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 2024-09-12T00:37:38.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.578+0000 7f4be9dda9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 info.flags=0x17 2024-09-12T00:37:38.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.578+0000 7f4be9dda9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to cache LRU end 2024-09-12T00:37:38.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.578+0000 7f4be9dda9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.578+0000 7f4be9dda9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36, ofs0, ns] 2024-09-12T00:37:38.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.578+0000 7f4ac6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333470 cookie 93906419999216 notifier 7773 bl.length()=923 2024-09-12T00:37:38.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.578+0000 7f4ac6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 info.flags=0x17 2024-09-12T00:37:38.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.578+0000 7f4ac6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to cache LRU end 2024-09-12T00:37:38.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.578+0000 7f4ac6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.582+0000 7f4be9dda9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): orig_sources= new_sources= 2024-09-12T00:37:38.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.582+0000 7f4be9dda9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): potential sources added=[] removed=[] 2024-09-12T00:37:38.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.582+0000 7f4be9dda9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): orig_dests= new_dests= 2024-09-12T00:37:38.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.582+0000 7f4be9dda9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): potential dests added=[] removed=[] 2024-09-12T00:37:38.583 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4be9dda9c0 time 2024-09-12T00:37:38.589417+0000 2024-09-12T00:37:38.583 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:38.584 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:38.584 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4bed6b42eb] 2024-09-12T00:37:38.585 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4bed6b449f] 2024-09-12T00:37:38.585 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55684909dcc1] 2024-09-12T00:37:38.585 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422aac) [0x556849afbaac] 2024-09-12T00:37:38.585 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5568490b2ced] 2024-09-12T00:37:38.585 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:37:38.585 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4bec51ad90] 2024-09-12T00:37:38.586 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:37:38.586 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:37:38.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.586+0000 7f4be9dda9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4be9dda9c0 time 2024-09-12T00:37:38.589417+0000 2024-09-12T00:37:38.586 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:38.586 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.586 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:38.587 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4bed6b42eb] 2024-09-12T00:37:38.587 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4bed6b449f] 2024-09-12T00:37:38.587 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55684909dcc1] 2024-09-12T00:37:38.587 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422aac) [0x556849afbaac] 2024-09-12T00:37:38.587 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5568490b2ced] 2024-09-12T00:37:38.588 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:37:38.588 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4bec51ad90] 2024-09-12T00:37:38.588 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:37:38.588 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:37:38.588 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.588 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:37:38.589 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f4be9dda9c0 thread_name:radosgw-admin 2024-09-12T00:37:38.599 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:38.599 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4bec533520] 2024-09-12T00:37:38.599 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:37:38.599 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:37:38.599 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:37:38.599 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4bed6b4345] 2024-09-12T00:37:38.600 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4bed6b449f] 2024-09-12T00:37:38.600 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55684909dcc1] 2024-09-12T00:37:38.600 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422aac) [0x556849afbaac] 2024-09-12T00:37:38.600 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5568490b2ced] 2024-09-12T00:37:38.600 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:37:38.600 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4bec51ad90] 2024-09-12T00:37:38.600 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:37:38.600 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:37:38.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.590+0000 7f4be9dda9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:38.601 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f4be9dda9c0 thread_name:radosgw-admin 2024-09-12T00:37:38.601 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.601 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:38.601 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4bec533520] 2024-09-12T00:37:38.601 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:37:38.601 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:37:38.601 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:37:38.601 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4bed6b4345] 2024-09-12T00:37:38.601 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4bed6b449f] 2024-09-12T00:37:38.601 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55684909dcc1] 2024-09-12T00:37:38.602 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422aac) [0x556849afbaac] 2024-09-12T00:37:38.602 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5568490b2ced] 2024-09-12T00:37:38.602 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:37:38.602 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4bec51ad90] 2024-09-12T00:37:38.602 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:37:38.602 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:37:38.602 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:38.602 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.603 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:37:38.603 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient(hunting): handle_auth_done global_id 7274 payload 274 2024-09-12T00:37:38.603 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.603 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:37:38.278+0000 7f4be70df640 1 monclient: found mon.noname-c 2024-09-12T00:37:38.603 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:37:38.603 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.603 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:38.603 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: dump: 2024-09-12T00:37:38.603 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.603 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.603 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.603 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.604 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.604 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.604 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.604 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.604 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.604 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.604 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.604 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.604 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.604 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.604 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:38.604 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: dump: 2024-09-12T00:37:38.604 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.605 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.605 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.605 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.605 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.605 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.605 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.605 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.605 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.605 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.605 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 monclient: authenticate success, global_id 7274 2024-09-12T00:37:38.605 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:38.605 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 4 set_mon_vals no callback set 2024-09-12T00:37:38.605 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: shutdown 2024-09-12T00:37:38.606 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) unregister_commands rotate-key 2024-09-12T00:37:38.606 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: build_initial_monmap 2024-09-12T00:37:38.606 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:38.606 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: monmap: 2024-09-12T00:37:38.606 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:37:38.606 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:38.606 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:37:38.606 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:37:38.606 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:38.606 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.606 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:37:38.606 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:37:38.606 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:37:38.606 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.607 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding auth protocol: cephx 2024-09-12T00:37:38.607 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding auth protocol: cephx 2024-09-12T00:37:38.607 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding auth protocol: cephx 2024-09-12T00:37:38.607 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: secure 2024-09-12T00:37:38.607 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: crc 2024-09-12T00:37:38.607 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: secure 2024-09-12T00:37:38.607 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: crc 2024-09-12T00:37:38.607 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: secure 2024-09-12T00:37:38.607 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: crc 2024-09-12T00:37:38.607 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: crc 2024-09-12T00:37:38.607 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: secure 2024-09-12T00:37:38.607 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: crc 2024-09-12T00:37:38.607 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: secure 2024-09-12T00:37:38.608 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: crc 2024-09-12T00:37:38.608 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: secure 2024-09-12T00:37:38.608 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.608 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 1 librados: starting msgr at 2024-09-12T00:37:38.608 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 1 librados: starting objecter 2024-09-12T00:37:38.608 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command objecter_requests hook 0x55684a9c6fa0 2024-09-12T00:37:38.608 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 1 librados: setting wanted keys 2024-09-12T00:37:38.608 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 1 librados: calling monclient init 2024-09-12T00:37:38.608 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: init 2024-09-12T00:37:38.608 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding auth protocol: cephx 2024-09-12T00:37:38.608 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding auth protocol: cephx 2024-09-12T00:37:38.608 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding auth protocol: cephx 2024-09-12T00:37:38.608 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: secure 2024-09-12T00:37:38.609 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: crc 2024-09-12T00:37:38.609 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: secure 2024-09-12T00:37:38.609 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: crc 2024-09-12T00:37:38.609 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: secure 2024-09-12T00:37:38.609 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: crc 2024-09-12T00:37:38.609 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: crc 2024-09-12T00:37:38.609 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: secure 2024-09-12T00:37:38.609 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: crc 2024-09-12T00:37:38.609 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: secure 2024-09-12T00:37:38.609 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: crc 2024-09-12T00:37:38.609 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: secure 2024-09-12T00:37:38.609 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.609 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.610 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command rotate-key hook 0x55684abee668 2024-09-12T00:37:38.610 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:38.610 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:37:38.610 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-a con 0x55684aa9e5b0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:37:38.610 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-c con 0x55684ab33b00 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:37:38.610 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-b con 0x55684ab36d10 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:37:38.610 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.610 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.610 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.610 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:38.610 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient(hunting): authenticate will time out at 2311.622734s 2024-09-12T00:37:38.610 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient(hunting): get_auth_request con 0x55684aa9e5b0 auth_method 0 2024-09-12T00:37:38.611 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.611 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.611 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.611 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient(hunting): get_auth_request con 0x55684ab33b00 auth_method 0 2024-09-12T00:37:38.611 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.611 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.611 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.611 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.611 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.611 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.611 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.611 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.611 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.612 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:37:38.278+0000 7f4be80e1640 10 monclient(hunting): get_auth_request con 0x55684ab36d10 auth_method 0 2024-09-12T00:37:38.612 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:37:38.278+0000 7f4be80e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.612 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:37:38.278+0000 7f4be80e1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.612 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:37:38.278+0000 7f4be80e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.612 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient(hunting): handle_auth_done global_id 7764 payload 824 2024-09-12T00:37:38.612 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.612 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:37:38.278+0000 7f4be78e0640 1 monclient: found mon.noname-a 2024-09-12T00:37:38.612 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.612 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.612 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:38.612 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: dump: 2024-09-12T00:37:38.612 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.613 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.613 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.613 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.613 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.613 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.613 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.613 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.613 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.613 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.613 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.613 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.613 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.613 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.614 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:38.614 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: dump: 2024-09-12T00:37:38.614 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.614 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.614 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.614 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.614 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.614 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.614 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.614 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.614 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.614 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.614 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 4 set_mon_vals no callback set 2024-09-12T00:37:38.614 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 monclient: authenticate success, global_id 7764 2024-09-12T00:37:38.615 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: _renew_subs 2024-09-12T00:37:38.615 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.615 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:37:38.282+0000 7f4be9dda9c0 10 monclient: _renew_subs 2024-09-12T00:37:38.615 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:37:38.282+0000 7f4be9dda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.615 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:37:38.282+0000 7f4be9dda9c0 1 librados: init done 2024-09-12T00:37:38.615 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:37:38.282+0000 7f4acffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:38.615 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:37:38.282+0000 7f4acffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:38.615 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:37:38.282+0000 7f4acffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:38.615 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:37:38.282+0000 7f4be70df640 10 monclient: get_auth_request con 0x7f4ad0070ae0 auth_method 0 2024-09-12T00:37:38.615 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:37:38.282+0000 7f4be80e1640 10 monclient: get_auth_request con 0x55684ac17b10 auth_method 0 2024-09-12T00:37:38.615 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:37:38.286+0000 7f4be78e0640 10 monclient: get_auth_request con 0x55684ac3a3c0 auth_method 0 2024-09-12T00:37:38.615 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:37:38.286+0000 7f4be70df640 10 monclient: get_auth_request con 0x55684ac3e720 auth_method 0 2024-09-12T00:37:38.615 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 10 monclient: build_initial_monmap 2024-09-12T00:37:38.616 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:38.616 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 10 monclient: monmap: 2024-09-12T00:37:38.616 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:37:38.616 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:38.616 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:37:38.616 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:37:38.616 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:38.616 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.616 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:37:38.616 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:37:38.616 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:37:38.616 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.616 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding auth protocol: cephx 2024-09-12T00:37:38.617 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding auth protocol: cephx 2024-09-12T00:37:38.617 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding auth protocol: cephx 2024-09-12T00:37:38.617 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: secure 2024-09-12T00:37:38.617 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: crc 2024-09-12T00:37:38.617 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: secure 2024-09-12T00:37:38.617 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: crc 2024-09-12T00:37:38.617 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: secure 2024-09-12T00:37:38.617 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: crc 2024-09-12T00:37:38.617 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: crc 2024-09-12T00:37:38.617 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: secure 2024-09-12T00:37:38.617 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: crc 2024-09-12T00:37:38.617 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: secure 2024-09-12T00:37:38.618 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: crc 2024-09-12T00:37:38.618 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: secure 2024-09-12T00:37:38.618 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.618 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command objecter_requests cmddesc objecter_requests hook 0x55684ac46e80 EEXIST 2024-09-12T00:37:38.618 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 10 monclient: init 2024-09-12T00:37:38.618 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding auth protocol: cephx 2024-09-12T00:37:38.618 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding auth protocol: cephx 2024-09-12T00:37:38.618 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding auth protocol: cephx 2024-09-12T00:37:38.618 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: secure 2024-09-12T00:37:38.618 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: crc 2024-09-12T00:37:38.618 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: secure 2024-09-12T00:37:38.618 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: crc 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: secure 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: crc 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: crc 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: secure 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: crc 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: secure 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: crc 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: secure 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command rotate-key cmddesc rotate-key hook 0x55684ac41d10 EEXIST 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:37:38.620 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-a con 0x55684ac6b030 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:37:38.620 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-c con 0x55684ac6a960 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:37:38.620 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-b con 0x55684ac69340 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:37:38.620 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.620 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.620 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.620 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:38.620 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient(hunting): authenticate will time out at 2311.632518s 2024-09-12T00:37:38.620 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient(hunting): get_auth_request con 0x55684ac6b030 auth_method 0 2024-09-12T00:37:38.620 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.620 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.620 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.621 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:37:38.290+0000 7f4be70df640 10 monclient(hunting): get_auth_request con 0x55684ac6a960 auth_method 0 2024-09-12T00:37:38.621 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:37:38.290+0000 7f4be70df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.621 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:37:38.290+0000 7f4be70df640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.621 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:37:38.290+0000 7f4be70df640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.621 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.621 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.621 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.621 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:37:38.290+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.621 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:37:38.290+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.621 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:37:38.290+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.621 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:37:38.290+0000 7f4be80e1640 10 monclient(hunting): get_auth_request con 0x55684ac69340 auth_method 0 2024-09-12T00:37:38.621 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:37:38.290+0000 7f4be80e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.622 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:37:38.290+0000 7f4be80e1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.622 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:37:38.290+0000 7f4be80e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.622 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient(hunting): handle_auth_done global_id 7767 payload 824 2024-09-12T00:37:38.622 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.622 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:37:38.290+0000 7f4be78e0640 1 monclient: found mon.noname-a 2024-09-12T00:37:38.622 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.622 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.622 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:38.622 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: dump: 2024-09-12T00:37:38.623 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.623 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.623 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.623 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.623 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.623 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.623 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.623 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.623 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.623 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.624 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.624 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.624 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.624 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.624 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:38.624 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: dump: 2024-09-12T00:37:38.624 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.624 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.624 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.624 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.624 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.624 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.625 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.625 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.625 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.625 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.625 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 monclient: authenticate success, global_id 7767 2024-09-12T00:37:38.625 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:37:38.290+0000 7f4be88e2640 4 set_mon_vals no callback set 2024-09-12T00:37:38.625 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: _renew_subs 2024-09-12T00:37:38.625 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.625 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: _renew_subs 2024-09-12T00:37:38.625 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.625 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:38.625 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:38.625 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:38.626 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: get_monmap_and_config 2024-09-12T00:37:38.626 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: build_initial_monmap 2024-09-12T00:37:38.626 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:38.626 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: monmap: 2024-09-12T00:37:38.626 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:37:38.626 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:38.626 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:37:38.626 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:37:38.626 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:38.626 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.626 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:37:38.626 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:37:38.627 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:37:38.627 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.627 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding auth protocol: cephx 2024-09-12T00:37:38.627 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding auth protocol: cephx 2024-09-12T00:37:38.627 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding auth protocol: cephx 2024-09-12T00:37:38.627 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: secure 2024-09-12T00:37:38.627 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: crc 2024-09-12T00:37:38.627 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: secure 2024-09-12T00:37:38.627 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: crc 2024-09-12T00:37:38.627 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: secure 2024-09-12T00:37:38.627 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: crc 2024-09-12T00:37:38.627 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: crc 2024-09-12T00:37:38.628 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: secure 2024-09-12T00:37:38.628 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: crc 2024-09-12T00:37:38.628 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: secure 2024-09-12T00:37:38.628 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: crc 2024-09-12T00:37:38.628 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: secure 2024-09-12T00:37:38.628 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:37:38.290+0000 7f4be70df640 10 monclient: get_auth_request con 0x7f4ac0070a20 auth_method 0 2024-09-12T00:37:38.628 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.628 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: init 2024-09-12T00:37:38.628 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding auth protocol: cephx 2024-09-12T00:37:38.628 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding auth protocol: cephx 2024-09-12T00:37:38.628 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding auth protocol: cephx 2024-09-12T00:37:38.628 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: secure 2024-09-12T00:37:38.628 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: crc 2024-09-12T00:37:38.629 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: secure 2024-09-12T00:37:38.629 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: crc 2024-09-12T00:37:38.629 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: secure 2024-09-12T00:37:38.629 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: crc 2024-09-12T00:37:38.629 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: crc 2024-09-12T00:37:38.629 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: secure 2024-09-12T00:37:38.629 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: crc 2024-09-12T00:37:38.629 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: secure 2024-09-12T00:37:38.629 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: crc 2024-09-12T00:37:38.629 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: secure 2024-09-12T00:37:38.629 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.629 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.629 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe33b40dd8 EEXIST 2024-09-12T00:37:38.629 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:38.630 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:37:38.630 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-a con 0x55684acb9110 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:37:38.630 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-b con 0x55684ac8bf50 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:37:38.630 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-c con 0x55684acba9f0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:37:38.630 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.630 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.630 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.630 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:38.630 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): authenticate will time out at 2311.636550s 2024-09-12T00:37:38.630 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): get_auth_request con 0x55684acb9110 auth_method 0 2024-09-12T00:37:38.630 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.630 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.631 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.631 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:37:38.294+0000 7f4be80e1640 10 monclient(hunting): get_auth_request con 0x55684acba9f0 auth_method 0 2024-09-12T00:37:38.631 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:37:38.294+0000 7f4be80e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.631 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:37:38.294+0000 7f4be80e1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.631 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:37:38.294+0000 7f4be80e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.631 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.631 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.631 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.631 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:37:38.294+0000 7f4be80e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.631 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:37:38.294+0000 7f4be80e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.631 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:37:38.294+0000 7f4be80e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.631 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): handle_auth_done global_id 7770 payload 274 2024-09-12T00:37:38.631 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.631 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:37:38.294+0000 7f4be78e0640 1 monclient: found mon.noname-a 2024-09-12T00:37:38.632 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.632 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.632 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:38.632 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: dump: 2024-09-12T00:37:38.632 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.632 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.632 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.632 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.632 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.633 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.633 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.633 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.633 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.633 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.633 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.633 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.633 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.633 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 monclient: authenticate success, global_id 7770 2024-09-12T00:37:38.633 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:38.633 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 4 set_mon_vals no callback set 2024-09-12T00:37:38.633 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.633 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:38.634 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: dump: 2024-09-12T00:37:38.634 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.634 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.634 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.634 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.634 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.634 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.634 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.634 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.634 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.634 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.634 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: shutdown 2024-09-12T00:37:38.634 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: build_initial_monmap 2024-09-12T00:37:38.635 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:38.635 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: monmap: 2024-09-12T00:37:38.635 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:37:38.635 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:38.635 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:37:38.635 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:37:38.635 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:38.635 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.635 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:37:38.635 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:37:38.635 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:37:38.635 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.635 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding auth protocol: cephx 2024-09-12T00:37:38.635 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding auth protocol: cephx 2024-09-12T00:37:38.636 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding auth protocol: cephx 2024-09-12T00:37:38.636 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: secure 2024-09-12T00:37:38.636 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: crc 2024-09-12T00:37:38.636 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: secure 2024-09-12T00:37:38.636 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: crc 2024-09-12T00:37:38.636 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: secure 2024-09-12T00:37:38.636 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: crc 2024-09-12T00:37:38.636 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: crc 2024-09-12T00:37:38.637 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: secure 2024-09-12T00:37:38.637 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: crc 2024-09-12T00:37:38.637 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: secure 2024-09-12T00:37:38.637 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: crc 2024-09-12T00:37:38.637 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: secure 2024-09-12T00:37:38.637 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.638 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 1 librados: starting msgr at 2024-09-12T00:37:38.638 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 1 librados: starting objecter 2024-09-12T00:37:38.638 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command objecter_requests cmddesc objecter_requests hook 0x55684acba370 EEXIST 2024-09-12T00:37:38.638 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 1 librados: setting wanted keys 2024-09-12T00:37:38.638 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 1 librados: calling monclient init 2024-09-12T00:37:38.638 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: init 2024-09-12T00:37:38.639 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding auth protocol: cephx 2024-09-12T00:37:38.639 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding auth protocol: cephx 2024-09-12T00:37:38.639 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding auth protocol: cephx 2024-09-12T00:37:38.639 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: secure 2024-09-12T00:37:38.639 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: crc 2024-09-12T00:37:38.639 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: secure 2024-09-12T00:37:38.639 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: crc 2024-09-12T00:37:38.639 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: secure 2024-09-12T00:37:38.640 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: crc 2024-09-12T00:37:38.640 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: crc 2024-09-12T00:37:38.640 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: secure 2024-09-12T00:37:38.640 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: crc 2024-09-12T00:37:38.640 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: secure 2024-09-12T00:37:38.640 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: crc 2024-09-12T00:37:38.641 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: secure 2024-09-12T00:37:38.641 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.641 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.641 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command rotate-key cmddesc rotate-key hook 0x55684ac6cf98 EEXIST 2024-09-12T00:37:38.641 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:38.641 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:37:38.642 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-a con 0x55684ac8bf50 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:37:38.642 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-c con 0x55684acb9110 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:37:38.642 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-b con 0x55684acba9f0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:37:38.642 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.642 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.642 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.643 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:38.643 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): authenticate will time out at 2311.639021s 2024-09-12T00:37:38.643 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): get_auth_request con 0x55684ac8bf50 auth_method 0 2024-09-12T00:37:38.643 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.643 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.643 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.643 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:37:38.294+0000 7f4be70df640 10 monclient(hunting): get_auth_request con 0x55684acb9110 auth_method 0 2024-09-12T00:37:38.644 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:37:38.294+0000 7f4be70df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.644 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:37:38.294+0000 7f4be70df640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.644 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:37:38.294+0000 7f4be70df640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.644 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.644 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.644 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.645 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:37:38.294+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.645 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:37:38.294+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.645 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:37:38.294+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.645 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): handle_auth_done global_id 7773 payload 824 2024-09-12T00:37:38.645 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.645 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:37:38.294+0000 7f4be78e0640 1 monclient: found mon.noname-a 2024-09-12T00:37:38.646 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.646 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.646 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:38.646 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: dump: 2024-09-12T00:37:38.646 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.647 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.647 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.647 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.647 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.647 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.647 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.647 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.647 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.647 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.647 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.647 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.647 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.648 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.648 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:38.648 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: dump: 2024-09-12T00:37:38.648 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.648 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.648 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.648 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.648 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.648 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.648 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.648 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.648 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.649 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.649 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 monclient: authenticate success, global_id 7773 2024-09-12T00:37:38.649 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 4 set_mon_vals no callback set 2024-09-12T00:37:38.649 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: _renew_subs 2024-09-12T00:37:38.649 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.649 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: _renew_subs 2024-09-12T00:37:38.649 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.649 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 1 librados: init done 2024-09-12T00:37:38.649 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command cr dump hook 0x55684acbd858 2024-09-12T00:37:38.649 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:37:38.298+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.649 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:37:38.298+0000 7f4ac57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:38.649 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:37:38.298+0000 7f4ac57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:38.649 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:37:38.298+0000 7f4ac57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:38.650 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:37:38.298+0000 7f4be70df640 10 monclient: get_auth_request con 0x7f4ab0070b10 auth_method 0 2024-09-12T00:37:38.650 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:37:38.298+0000 7f4be80e1640 10 monclient: get_auth_request con 0x55684acd8250 auth_method 0 2024-09-12T00:37:38.650 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:37:38.298+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.650 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:37:38.298+0000 7f4be9dda9c0 20 realm 2024-09-12T00:37:38.650 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:37:38.298+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.650 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.650 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:38.650 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.650 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.650 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.650 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:37:38.302+0000 7f4be78e0640 10 monclient: get_auth_request con 0x55684acdc480 auth_method 0 2024-09-12T00:37:38.650 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.650 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.651 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:37:38.302+0000 7f4be70df640 10 monclient: get_auth_request con 0x55684acdfce0 auth_method 0 2024-09-12T00:37:38.651 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:38.651 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 searching for the correct realm 2024-09-12T00:37:38.651 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:37:38.302+0000 7f4be80e1640 10 monclient: get_auth_request con 0x55684ace4aa0 auth_method 0 2024-09-12T00:37:38.651 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:37:38.306+0000 7f4be78e0640 10 monclient: get_auth_request con 0x7f4be00c2410 auth_method 0 2024-09-12T00:37:38.651 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:37:38.306+0000 7f4be70df640 10 monclient: get_auth_request con 0x7f4bd8096070 auth_method 0 2024-09-12T00:37:38.651 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:37:38.306+0000 7f4be80e1640 10 monclient: get_auth_request con 0x7f4be00d0910 auth_method 0 2024-09-12T00:37:38.651 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:37:38.306+0000 7f4be80e1640 0 -- 172.21.15.138:0/3120592061 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f4be00d0910 msgr2=0x7f4be00b83e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.651 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:37:38.510+0000 7f4be80e1640 10 monclient: get_auth_request con 0x7f4be00d0910 auth_method 0 2024-09-12T00:37:38.651 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:37:38.514+0000 7f4be78e0640 10 monclient: get_auth_request con 0x7f4bd8022060 auth_method 0 2024-09-12T00:37:38.651 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:37:38.522+0000 7f4be80e1640 0 -- 172.21.15.138:0/3120592061 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55684ace4aa0 msgr2=0x55684ace6f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.651 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:37:38.522+0000 7f4ac57fa640 1 client.7773.objecter ms_handle_reset 0x55684ace4aa0 session 0x55684ace4420 osd.4 2024-09-12T00:37:38.651 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:37:38.522+0000 7f4ac57fa640 10 monclient: _renew_subs 2024-09-12T00:37:38.652 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:37:38.522+0000 7f4ac57fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.652 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:37:38.522+0000 7f4be80e1640 10 monclient: get_auth_request con 0x7f4ab0080e30 auth_method 0 2024-09-12T00:37:38.652 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:38.652 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:38.652 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:38.652 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:38.652 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:38.652 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:38.652 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.652 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.652 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.652 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.653 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.653 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:38.653 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 zone default found 2024-09-12T00:37:38.653 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 4 Realm: () 2024-09-12T00:37:38.653 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:38.653 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:38.653 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:38.653 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 zonegroup default 2024-09-12T00:37:38.653 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.653 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.654 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.654 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.654 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.654 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.654 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 started sync module instance, tier type = 2024-09-12T00:37:38.654 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:38.654 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=0 2024-09-12T00:37:38.654 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=1 2024-09-12T00:37:38.654 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=2 2024-09-12T00:37:38.654 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=3 2024-09-12T00:37:38.654 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=4 2024-09-12T00:37:38.654 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=5 2024-09-12T00:37:38.655 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=6 2024-09-12T00:37:38.655 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:37:38.562+0000 7f4be9dda9c0 20 add_watcher() i=7 2024-09-12T00:37:38.655 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:37:38.562+0000 7f4be9dda9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:38.655 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding auth protocol: cephx 2024-09-12T00:37:38.655 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding auth protocol: cephx 2024-09-12T00:37:38.655 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding auth protocol: cephx 2024-09-12T00:37:38.655 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: secure 2024-09-12T00:37:38.655 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: crc 2024-09-12T00:37:38.655 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: secure 2024-09-12T00:37:38.655 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: crc 2024-09-12T00:37:38.655 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: secure 2024-09-12T00:37:38.655 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:37:38.566+0000 7f4a9e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:38.655 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: crc 2024-09-12T00:37:38.655 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: crc 2024-09-12T00:37:38.655 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: secure 2024-09-12T00:37:38.656 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: crc 2024-09-12T00:37:38.656 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: secure 2024-09-12T00:37:38.656 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: crc 2024-09-12T00:37:38.656 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: secure 2024-09-12T00:37:38.656 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.656 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:38.656 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:38.656 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command cache list hook 0x55684acace30 2024-09-12T00:37:38.656 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command cache inspect hook 0x55684acace30 2024-09-12T00:37:38.656 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command cache erase hook 0x55684acace30 2024-09-12T00:37:38.656 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command cache zap hook 0x55684acace30 2024-09-12T00:37:38.656 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 note: GC not initialized 2024-09-12T00:37:38.656 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:37:38.566+0000 7f4a9d7e2640 20 reqs_thread_entry: start 2024-09-12T00:37:38.657 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command sync trace show hook 0x7f4bd8082070 2024-09-12T00:37:38.657 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command sync trace history hook 0x7f4bd8082070 2024-09-12T00:37:38.657 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command sync trace active hook 0x7f4bd8082070 2024-09-12T00:37:38.657 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command sync trace active_short hook 0x7f4bd8082070 2024-09-12T00:37:38.657 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:38.657 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 Filter name: none 2024-09-12T00:37:38.657 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:37:38.566+0000 7f4a967fc640 20 reqs_thread_entry: start 2024-09-12T00:37:38.657 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:37:38.657 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.657 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:37:38.657 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:37:38.657 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:37:38.657 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 : miss 2024-09-12T00:37:38.658 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.658 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:37:38.570+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:37:38.658 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:37:38.570+0000 7f4be9dda9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 info.flags=0x17 2024-09-12T00:37:38.658 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:37:38.570+0000 7f4be9dda9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to cache LRU end 2024-09-12T00:37:38.658 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:37:38.570+0000 7f4be9dda9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:38.658 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:37:38.570+0000 7f4be9dda9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.658 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:37:38.570+0000 7f4be9dda9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 2024-09-12T00:37:38.658 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:37:38.578+0000 7f4be9dda9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 info.flags=0x17 2024-09-12T00:37:38.658 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:37:38.578+0000 7f4be9dda9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to cache LRU end 2024-09-12T00:37:38.658 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:37:38.578+0000 7f4be9dda9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.658 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:37:38.578+0000 7f4be9dda9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36, ofs0, ns] 2024-09-12T00:37:38.658 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:37:38.578+0000 7f4ac6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333470 cookie 93906419999216 notifier 7773 bl.length()=923 2024-09-12T00:37:38.658 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:37:38.578+0000 7f4ac6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 info.flags=0x17 2024-09-12T00:37:38.659 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:37:38.578+0000 7f4ac6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to cache LRU end 2024-09-12T00:37:38.659 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:37:38.578+0000 7f4ac6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.659 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:37:38.582+0000 7f4be9dda9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): orig_sources= new_sources= 2024-09-12T00:37:38.659 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:37:38.582+0000 7f4be9dda9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): potential sources added=[] removed=[] 2024-09-12T00:37:38.659 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:37:38.582+0000 7f4be9dda9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): orig_dests= new_dests= 2024-09-12T00:37:38.659 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:37:38.582+0000 7f4be9dda9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): potential dests added=[] removed=[] 2024-09-12T00:37:38.659 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:37:38.586+0000 7f4be9dda9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4be9dda9c0 time 2024-09-12T00:37:38.589417+0000 2024-09-12T00:37:38.659 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:38.659 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.659 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:38.659 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4bed6b42eb] 2024-09-12T00:37:38.659 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4bed6b449f] 2024-09-12T00:37:38.659 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55684909dcc1] 2024-09-12T00:37:38.660 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422aac) [0x556849afbaac] 2024-09-12T00:37:38.660 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5568490b2ced] 2024-09-12T00:37:38.660 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:37:38.660 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4bec51ad90] 2024-09-12T00:37:38.660 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:37:38.660 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:37:38.660 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.660 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:37:38.590+0000 7f4be9dda9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:38.660 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f4be9dda9c0 thread_name:radosgw-admin 2024-09-12T00:37:38.660 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.660 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:38.660 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4bec533520] 2024-09-12T00:37:38.661 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:37:38.661 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:37:38.661 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:37:38.661 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4bed6b4345] 2024-09-12T00:37:38.661 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4bed6b449f] 2024-09-12T00:37:38.661 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55684909dcc1] 2024-09-12T00:37:38.661 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422aac) [0x556849afbaac] 2024-09-12T00:37:38.661 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5568490b2ced] 2024-09-12T00:37:38.661 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:37:38.661 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4bec51ad90] 2024-09-12T00:37:38.661 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:37:38.661 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:37:38.662 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:38.662 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.662 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:37:38.662 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:37:38.662 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:37:38.662 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:37:38.662 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:37:38.662 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:37:38.662 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:37:38.662 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:37:38.662 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:37:38.662 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:37:38.662 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:37:38.662 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:37:38.663 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:37:38.663 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:37:38.663 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:37:38.663 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:37:38.663 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:37:38.663 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:37:38.663 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:37:38.663 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:37:38.663 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:37:38.663 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:37:38.663 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:37:38.663 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:37:38.663 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:37:38.663 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:37:38.664 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:37:38.664 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:37:38.664 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:37:38.664 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:37:38.664 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:37:38.664 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:37:38.664 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:37:38.664 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:37:38.664 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:37:38.664 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:37:38.664 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:37:38.664 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:37:38.664 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:37:38.665 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:37:38.665 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:37:38.665 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:37:38.665 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:37:38.665 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:37:38.665 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:37:38.665 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:37:38.665 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:37:38.665 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:37:38.665 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:37:38.665 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:37:38.665 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:37:38.666 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:37:38.666 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:37:38.666 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:37:38.666 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:37:38.666 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:37:38.666 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:37:38.666 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:37:38.666 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:37:38.666 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:37:38.666 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:37:38.666 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:37:38.666 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:37:38.666 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:37:38.667 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:37:38.667 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:37:38.667 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:37:38.667 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:37:38.667 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:37:38.667 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:37:38.667 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:37:38.667 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:37:38.667 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:37:38.667 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:37:38.667 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:37:38.668 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:37:38.668 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:37:38.668 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:37:38.668 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:37:38.668 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:37:38.668 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:37:38.668 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:37:38.668 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:37:38.668 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:37:38.668 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:37:38.668 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:37:38.668 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:37:38.668 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:37:38.669 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:37:38.669 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:37:38.669 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:37:38.669 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:37:38.669 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:37:38.669 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:37:38.669 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4a967fc640 / http_manager 2024-09-12T00:37:38.669 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4a9d7e2640 / http_manager 2024-09-12T00:37:38.669 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4a9e7e4640 / rgw_dt_lg_renew 2024-09-12T00:37:38.669 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4ac57fa640 / ms_dispatch 2024-09-12T00:37:38.669 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4ac6ffd640 / io_context_pool 2024-09-12T00:37:38.669 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4acd7fa640 / ms_dispatch 2024-09-12T00:37:38.669 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4acffff640 / ms_dispatch 2024-09-12T00:37:38.670 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4ad5e0b640 / io_context_pool 2024-09-12T00:37:38.670 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4be70df640 / msgr-worker-2 2024-09-12T00:37:38.670 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4be78e0640 / msgr-worker-1 2024-09-12T00:37:38.670 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4be80e1640 / msgr-worker-0 2024-09-12T00:37:38.670 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4be88e2640 / io_context_pool 2024-09-12T00:37:38.670 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4be9dda9c0 / radosgw-admin 2024-09-12T00:37:38.670 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:37:38.670 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:37:38.670 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.126556.log 2024-09-12T00:37:38.670 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:37:38.671 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:37:38.671 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient(hunting): handle_auth_done global_id 7274 payload 274 2024-09-12T00:37:38.671 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.671 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:37:38.278+0000 7f4be70df640 1 monclient: found mon.noname-c 2024-09-12T00:37:38.671 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:37:38.671 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.671 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:37:38.671 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: dump: 2024-09-12T00:37:38.671 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.671 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.671 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.671 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.671 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.672 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.672 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.672 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.672 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.672 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.672 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.672 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.672 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.672 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.673 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:37:38.673 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 10 monclient: dump: 2024-09-12T00:37:38.673 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.673 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.673 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.673 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.673 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.673 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.674 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.674 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.674 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.674 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.674 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 monclient: authenticate success, global_id 7274 2024-09-12T00:37:38.674 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:38.674 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 4 set_mon_vals no callback set 2024-09-12T00:37:38.674 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: shutdown 2024-09-12T00:37:38.675 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) unregister_commands rotate-key 2024-09-12T00:37:38.675 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: build_initial_monmap 2024-09-12T00:37:38.675 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:38.675 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: monmap: 2024-09-12T00:37:38.675 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:37:38.675 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:38.675 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:37:38.675 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:37:38.675 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:38.676 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.676 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:37:38.676 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:37:38.676 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:37:38.676 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.676 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding auth protocol: cephx 2024-09-12T00:37:38.677 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding auth protocol: cephx 2024-09-12T00:37:38.677 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding auth protocol: cephx 2024-09-12T00:37:38.677 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: secure 2024-09-12T00:37:38.677 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: crc 2024-09-12T00:37:38.677 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: secure 2024-09-12T00:37:38.677 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: crc 2024-09-12T00:37:38.678 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: secure 2024-09-12T00:37:38.678 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: crc 2024-09-12T00:37:38.678 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: crc 2024-09-12T00:37:38.678 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: secure 2024-09-12T00:37:38.678 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: crc 2024-09-12T00:37:38.678 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: secure 2024-09-12T00:37:38.679 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: crc 2024-09-12T00:37:38.679 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abf3a70) adding con mode: secure 2024-09-12T00:37:38.679 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.679 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 1 librados: starting msgr at 2024-09-12T00:37:38.679 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 1 librados: starting objecter 2024-09-12T00:37:38.679 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command objecter_requests hook 0x55684a9c6fa0 2024-09-12T00:37:38.680 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 1 librados: setting wanted keys 2024-09-12T00:37:38.680 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 1 librados: calling monclient init 2024-09-12T00:37:38.680 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: init 2024-09-12T00:37:38.680 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding auth protocol: cephx 2024-09-12T00:37:38.680 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding auth protocol: cephx 2024-09-12T00:37:38.680 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding auth protocol: cephx 2024-09-12T00:37:38.681 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: secure 2024-09-12T00:37:38.681 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: crc 2024-09-12T00:37:38.681 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: secure 2024-09-12T00:37:38.681 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: crc 2024-09-12T00:37:38.682 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: secure 2024-09-12T00:37:38.682 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: crc 2024-09-12T00:37:38.682 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: crc 2024-09-12T00:37:38.682 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: secure 2024-09-12T00:37:38.682 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: crc 2024-09-12T00:37:38.682 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: secure 2024-09-12T00:37:38.683 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: crc 2024-09-12T00:37:38.683 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 AuthRegistry(0x55684abee520) adding con mode: secure 2024-09-12T00:37:38.683 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.683 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.683 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command rotate-key hook 0x55684abee668 2024-09-12T00:37:38.684 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:38.684 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:37:38.684 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-a con 0x55684aa9e5b0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:37:38.684 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-c con 0x55684ab33b00 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:37:38.684 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-b con 0x55684ab36d10 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:37:38.684 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.685 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.685 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.685 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:38.685 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient(hunting): authenticate will time out at 2311.622734s 2024-09-12T00:37:38.685 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient(hunting): get_auth_request con 0x55684aa9e5b0 auth_method 0 2024-09-12T00:37:38.685 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.686 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.686 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.686 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient(hunting): get_auth_request con 0x55684ab33b00 auth_method 0 2024-09-12T00:37:38.686 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.686 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.687 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.687 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.687 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.687 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.687 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.687 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.688 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:37:38.278+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.688 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:37:38.278+0000 7f4be80e1640 10 monclient(hunting): get_auth_request con 0x55684ab36d10 auth_method 0 2024-09-12T00:37:38.688 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:37:38.278+0000 7f4be80e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.688 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:37:38.278+0000 7f4be80e1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.688 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:37:38.278+0000 7f4be80e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.688 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient(hunting): handle_auth_done global_id 7764 payload 824 2024-09-12T00:37:38.689 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.689 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:37:38.278+0000 7f4be78e0640 1 monclient: found mon.noname-a 2024-09-12T00:37:38.689 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:37:38.278+0000 7f4be78e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.689 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.689 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:38.689 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: dump: 2024-09-12T00:37:38.690 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.690 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.690 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.690 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.690 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.690 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.691 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.691 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.691 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.691 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.691 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.691 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.692 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.692 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.692 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:38.692 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:37:38.278+0000 7f4acffff640 10 monclient: dump: 2024-09-12T00:37:38.692 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.693 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.693 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.693 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.693 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.693 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.693 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.694 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.694 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.694 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.694 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:37:38.278+0000 7f4ad5e0b640 4 set_mon_vals no callback set 2024-09-12T00:37:38.694 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 5 monclient: authenticate success, global_id 7764 2024-09-12T00:37:38.694 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: _renew_subs 2024-09-12T00:37:38.695 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:37:38.278+0000 7f4be9dda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.695 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:37:38.282+0000 7f4be9dda9c0 10 monclient: _renew_subs 2024-09-12T00:37:38.695 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:37:38.282+0000 7f4be9dda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.695 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:37:38.282+0000 7f4be9dda9c0 1 librados: init done 2024-09-12T00:37:38.695 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:37:38.282+0000 7f4acffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:38.695 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:37:38.282+0000 7f4acffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:38.696 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:37:38.282+0000 7f4acffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:38.696 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:37:38.282+0000 7f4be70df640 10 monclient: get_auth_request con 0x7f4ad0070ae0 auth_method 0 2024-09-12T00:37:38.696 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:37:38.282+0000 7f4be80e1640 10 monclient: get_auth_request con 0x55684ac17b10 auth_method 0 2024-09-12T00:37:38.696 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:37:38.286+0000 7f4be78e0640 10 monclient: get_auth_request con 0x55684ac3a3c0 auth_method 0 2024-09-12T00:37:38.696 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:37:38.286+0000 7f4be70df640 10 monclient: get_auth_request con 0x55684ac3e720 auth_method 0 2024-09-12T00:37:38.696 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 10 monclient: build_initial_monmap 2024-09-12T00:37:38.697 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:38.697 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 10 monclient: monmap: 2024-09-12T00:37:38.697 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:37:38.697 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:38.697 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:37:38.697 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:37:38.698 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:38.698 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.698 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:37:38.698 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:37:38.698 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:37:38.698 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.699 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding auth protocol: cephx 2024-09-12T00:37:38.699 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding auth protocol: cephx 2024-09-12T00:37:38.699 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding auth protocol: cephx 2024-09-12T00:37:38.699 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: secure 2024-09-12T00:37:38.700 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: crc 2024-09-12T00:37:38.700 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: secure 2024-09-12T00:37:38.700 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: crc 2024-09-12T00:37:38.700 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: secure 2024-09-12T00:37:38.700 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: crc 2024-09-12T00:37:38.701 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: crc 2024-09-12T00:37:38.701 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: secure 2024-09-12T00:37:38.701 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: crc 2024-09-12T00:37:38.701 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: secure 2024-09-12T00:37:38.701 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: crc 2024-09-12T00:37:38.702 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac43540) adding con mode: secure 2024-09-12T00:37:38.702 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.702 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command objecter_requests cmddesc objecter_requests hook 0x55684ac46e80 EEXIST 2024-09-12T00:37:38.702 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 10 monclient: init 2024-09-12T00:37:38.702 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding auth protocol: cephx 2024-09-12T00:37:38.702 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding auth protocol: cephx 2024-09-12T00:37:38.703 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding auth protocol: cephx 2024-09-12T00:37:38.703 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: secure 2024-09-12T00:37:38.703 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: crc 2024-09-12T00:37:38.703 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: secure 2024-09-12T00:37:38.703 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: crc 2024-09-12T00:37:38.703 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: secure 2024-09-12T00:37:38.704 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: crc 2024-09-12T00:37:38.704 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: crc 2024-09-12T00:37:38.704 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: secure 2024-09-12T00:37:38.704 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: crc 2024-09-12T00:37:38.704 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: secure 2024-09-12T00:37:38.705 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: crc 2024-09-12T00:37:38.705 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:37:38.286+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac41bc8) adding con mode: secure 2024-09-12T00:37:38.705 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.705 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.705 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command rotate-key cmddesc rotate-key hook 0x55684ac41d10 EEXIST 2024-09-12T00:37:38.705 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:38.706 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:37:38.706 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-a con 0x55684ac6b030 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:37:38.706 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-c con 0x55684ac6a960 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:37:38.706 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-b con 0x55684ac69340 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:37:38.706 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.706 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.707 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.707 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:38.707 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient(hunting): authenticate will time out at 2311.632518s 2024-09-12T00:37:38.707 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient(hunting): get_auth_request con 0x55684ac6b030 auth_method 0 2024-09-12T00:37:38.707 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.708 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.708 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.708 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:37:38.290+0000 7f4be70df640 10 monclient(hunting): get_auth_request con 0x55684ac6a960 auth_method 0 2024-09-12T00:37:38.708 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:37:38.290+0000 7f4be70df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.708 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:37:38.290+0000 7f4be70df640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.708 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:37:38.290+0000 7f4be70df640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.709 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.709 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.709 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.709 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:37:38.290+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.709 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:37:38.290+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.709 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:37:38.290+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.710 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:37:38.290+0000 7f4be80e1640 10 monclient(hunting): get_auth_request con 0x55684ac69340 auth_method 0 2024-09-12T00:37:38.710 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:37:38.290+0000 7f4be80e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.710 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:37:38.290+0000 7f4be80e1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.710 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:37:38.290+0000 7f4be80e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.710 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient(hunting): handle_auth_done global_id 7767 payload 824 2024-09-12T00:37:38.711 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.711 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:37:38.290+0000 7f4be78e0640 1 monclient: found mon.noname-a 2024-09-12T00:37:38.711 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:37:38.290+0000 7f4be78e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.711 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.711 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:38.711 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: dump: 2024-09-12T00:37:38.712 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.712 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.712 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.712 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.712 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.712 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.713 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.713 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.713 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.713 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.713 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.713 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.714 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.714 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.714 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:38.714 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 10 monclient: dump: 2024-09-12T00:37:38.714 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.714 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.715 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.715 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.715 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.715 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.715 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.716 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.716 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.716 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.716 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 monclient: authenticate success, global_id 7767 2024-09-12T00:37:38.716 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:37:38.290+0000 7f4be88e2640 4 set_mon_vals no callback set 2024-09-12T00:37:38.716 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: _renew_subs 2024-09-12T00:37:38.717 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.717 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: _renew_subs 2024-09-12T00:37:38.717 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.717 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:38.717 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:38.717 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:37:38.290+0000 7f4acd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:38.718 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: get_monmap_and_config 2024-09-12T00:37:38.718 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: build_initial_monmap 2024-09-12T00:37:38.718 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:38.718 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: monmap: 2024-09-12T00:37:38.718 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:37:38.718 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:38.719 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:37:38.719 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:37:38.719 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:38.719 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.719 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:37:38.719 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:37:38.720 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:37:38.720 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.720 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding auth protocol: cephx 2024-09-12T00:37:38.720 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding auth protocol: cephx 2024-09-12T00:37:38.720 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding auth protocol: cephx 2024-09-12T00:37:38.720 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: secure 2024-09-12T00:37:38.721 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: crc 2024-09-12T00:37:38.721 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: secure 2024-09-12T00:37:38.721 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: crc 2024-09-12T00:37:38.721 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: secure 2024-09-12T00:37:38.721 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: crc 2024-09-12T00:37:38.721 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: crc 2024-09-12T00:37:38.721 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: secure 2024-09-12T00:37:38.721 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: crc 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: secure 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: crc 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac8a980) adding con mode: secure 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:37:38.290+0000 7f4be70df640 10 monclient: get_auth_request con 0x7f4ac0070a20 auth_method 0 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 10 monclient: init 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding auth protocol: cephx 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding auth protocol: cephx 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding auth protocol: cephx 2024-09-12T00:37:38.722 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: secure 2024-09-12T00:37:38.723 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: crc 2024-09-12T00:37:38.723 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: secure 2024-09-12T00:37:38.723 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: crc 2024-09-12T00:37:38.723 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: secure 2024-09-12T00:37:38.723 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: crc 2024-09-12T00:37:38.723 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: crc 2024-09-12T00:37:38.723 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: secure 2024-09-12T00:37:38.723 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: crc 2024-09-12T00:37:38.723 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: secure 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: crc 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:37:38.290+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b40c90) adding con mode: secure 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe33b40dd8 EEXIST 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-a con 0x55684acb9110 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:37:38.724 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-b con 0x55684ac8bf50 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:37:38.725 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-c con 0x55684acba9f0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:37:38.725 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.725 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.725 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.725 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:38.725 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): authenticate will time out at 2311.636550s 2024-09-12T00:37:38.725 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): get_auth_request con 0x55684acb9110 auth_method 0 2024-09-12T00:37:38.725 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.725 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.725 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.726 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:37:38.294+0000 7f4be80e1640 10 monclient(hunting): get_auth_request con 0x55684acba9f0 auth_method 0 2024-09-12T00:37:38.726 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:37:38.294+0000 7f4be80e1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.726 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:37:38.294+0000 7f4be80e1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.726 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:37:38.294+0000 7f4be80e1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.726 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.726 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.726 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.726 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:37:38.294+0000 7f4be80e1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.727 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:37:38.294+0000 7f4be80e1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.727 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:37:38.294+0000 7f4be80e1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.727 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): handle_auth_done global_id 7770 payload 274 2024-09-12T00:37:38.727 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.727 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:37:38.294+0000 7f4be78e0640 1 monclient: found mon.noname-a 2024-09-12T00:37:38.727 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.727 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.727 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:38.727 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: dump: 2024-09-12T00:37:38.728 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.728 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.728 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.728 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.728 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.728 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.728 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.728 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.728 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.729 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.729 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.729 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.729 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.729 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 monclient: authenticate success, global_id 7770 2024-09-12T00:37:38.729 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:37:38.729 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 4 set_mon_vals no callback set 2024-09-12T00:37:38.729 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.729 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:38.730 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 10 monclient: dump: 2024-09-12T00:37:38.730 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.730 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.730 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.730 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.730 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.730 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.730 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.730 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.731 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.731 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.731 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: shutdown 2024-09-12T00:37:38.731 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: build_initial_monmap 2024-09-12T00:37:38.731 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 1 build_initial for_mkfs: 0 2024-09-12T00:37:38.731 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: monmap: 2024-09-12T00:37:38.731 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:37:38.731 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:37:38.731 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:37:38.732 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:37:38.732 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:37:38.732 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.732 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:37:38.732 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:37:38.732 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:37:38.732 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.733 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding auth protocol: cephx 2024-09-12T00:37:38.733 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding auth protocol: cephx 2024-09-12T00:37:38.733 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding auth protocol: cephx 2024-09-12T00:37:38.733 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: secure 2024-09-12T00:37:38.733 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: crc 2024-09-12T00:37:38.734 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: secure 2024-09-12T00:37:38.734 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: crc 2024-09-12T00:37:38.734 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: secure 2024-09-12T00:37:38.734 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: crc 2024-09-12T00:37:38.734 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: crc 2024-09-12T00:37:38.734 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: secure 2024-09-12T00:37:38.735 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: crc 2024-09-12T00:37:38.735 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: secure 2024-09-12T00:37:38.735 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: crc 2024-09-12T00:37:38.735 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684acaf870) adding con mode: secure 2024-09-12T00:37:38.735 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.735 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 1 librados: starting msgr at 2024-09-12T00:37:38.736 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 1 librados: starting objecter 2024-09-12T00:37:38.736 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command objecter_requests cmddesc objecter_requests hook 0x55684acba370 EEXIST 2024-09-12T00:37:38.736 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 1 librados: setting wanted keys 2024-09-12T00:37:38.736 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 1 librados: calling monclient init 2024-09-12T00:37:38.736 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: init 2024-09-12T00:37:38.737 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding auth protocol: cephx 2024-09-12T00:37:38.737 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding auth protocol: cephx 2024-09-12T00:37:38.737 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding auth protocol: cephx 2024-09-12T00:37:38.737 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: secure 2024-09-12T00:37:38.737 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: crc 2024-09-12T00:37:38.737 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: secure 2024-09-12T00:37:38.738 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: crc 2024-09-12T00:37:38.738 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: secure 2024-09-12T00:37:38.738 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: crc 2024-09-12T00:37:38.738 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: crc 2024-09-12T00:37:38.738 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: secure 2024-09-12T00:37:38.738 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: crc 2024-09-12T00:37:38.739 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: secure 2024-09-12T00:37:38.739 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: crc 2024-09-12T00:37:38.739 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 AuthRegistry(0x55684ac6ce50) adding con mode: secure 2024-09-12T00:37:38.739 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.739 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.740 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command rotate-key cmddesc rotate-key hook 0x55684ac6cf98 EEXIST 2024-09-12T00:37:38.740 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:37:38.740 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:37:38.740 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-a con 0x55684ac8bf50 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:37:38.740 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-c con 0x55684acb9110 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:37:38.740 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): picked mon.noname-b con 0x55684acba9f0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:37:38.741 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.741 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.741 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:37:38.741 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:37:38.741 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient(hunting): authenticate will time out at 2311.639021s 2024-09-12T00:37:38.741 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): get_auth_request con 0x55684ac8bf50 auth_method 0 2024-09-12T00:37:38.742 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.742 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.742 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.742 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:37:38.294+0000 7f4be70df640 10 monclient(hunting): get_auth_request con 0x55684acb9110 auth_method 0 2024-09-12T00:37:38.742 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:37:38.294+0000 7f4be70df640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:37:38.743 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:37:38.294+0000 7f4be70df640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:37:38.743 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:37:38.294+0000 7f4be70df640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:37:38.743 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.743 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.743 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.743 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:37:38.294+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:37:38.744 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:37:38.294+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:37:38.744 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:37:38.294+0000 7f4be70df640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:37:38.744 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient(hunting): handle_auth_done global_id 7773 payload 824 2024-09-12T00:37:38.744 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient: _finish_hunting 0 2024-09-12T00:37:38.744 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:37:38.294+0000 7f4be78e0640 1 monclient: found mon.noname-a 2024-09-12T00:37:38.745 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:37:38.294+0000 7f4be78e0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.745 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.745 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:37:38.745 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: dump: 2024-09-12T00:37:38.745 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.745 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.746 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.746 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.746 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.746 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.746 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.746 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.746 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.746 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.747 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: _finish_auth 0 2024-09-12T00:37:38.747 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: _check_auth_tickets 2024-09-12T00:37:38.747 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:37:38.747 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:37:38.747 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:37:38.747 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:37:38.294+0000 7f4ac57fa640 10 monclient: dump: 2024-09-12T00:37:38.747 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:37:38.747 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:37:38.748 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.748 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:37:38.748 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:37:38.748 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:37:38.748 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:37:38.748 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:37:38.748 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:37:38.748 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.749 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 monclient: authenticate success, global_id 7773 2024-09-12T00:37:38.749 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:37:38.294+0000 7f4ac6ffd640 4 set_mon_vals no callback set 2024-09-12T00:37:38.749 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: _renew_subs 2024-09-12T00:37:38.749 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.749 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: _renew_subs 2024-09-12T00:37:38.749 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.749 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 1 librados: init done 2024-09-12T00:37:38.749 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:37:38.294+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command cr dump hook 0x55684acbd858 2024-09-12T00:37:38.750 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:37:38.298+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.750 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:37:38.298+0000 7f4ac57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:37:38.750 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:37:38.298+0000 7f4ac57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:38.750 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:37:38.298+0000 7f4ac57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:37:38.750 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:37:38.298+0000 7f4be70df640 10 monclient: get_auth_request con 0x7f4ab0070b10 auth_method 0 2024-09-12T00:37:38.750 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:37:38.298+0000 7f4be80e1640 10 monclient: get_auth_request con 0x55684acd8250 auth_method 0 2024-09-12T00:37:38.750 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:37:38.298+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.750 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:37:38.298+0000 7f4be9dda9c0 20 realm 2024-09-12T00:37:38.750 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:37:38.298+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.750 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.750 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:38.750 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.750 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.751 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.751 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:37:38.302+0000 7f4be78e0640 10 monclient: get_auth_request con 0x55684acdc480 auth_method 0 2024-09-12T00:37:38.751 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.751 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.751 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:37:38.302+0000 7f4be70df640 10 monclient: get_auth_request con 0x55684acdfce0 auth_method 0 2024-09-12T00:37:38.751 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:38.751 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:37:38.302+0000 7f4be9dda9c0 20 searching for the correct realm 2024-09-12T00:37:38.751 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:37:38.302+0000 7f4be80e1640 10 monclient: get_auth_request con 0x55684ace4aa0 auth_method 0 2024-09-12T00:37:38.751 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:37:38.306+0000 7f4be78e0640 10 monclient: get_auth_request con 0x7f4be00c2410 auth_method 0 2024-09-12T00:37:38.751 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:37:38.306+0000 7f4be70df640 10 monclient: get_auth_request con 0x7f4bd8096070 auth_method 0 2024-09-12T00:37:38.751 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:37:38.306+0000 7f4be80e1640 10 monclient: get_auth_request con 0x7f4be00d0910 auth_method 0 2024-09-12T00:37:38.751 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:37:38.306+0000 7f4be80e1640 0 -- 172.21.15.138:0/3120592061 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f4be00d0910 msgr2=0x7f4be00b83e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.751 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:37:38.510+0000 7f4be80e1640 10 monclient: get_auth_request con 0x7f4be00d0910 auth_method 0 2024-09-12T00:37:38.752 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:37:38.514+0000 7f4be78e0640 10 monclient: get_auth_request con 0x7f4bd8022060 auth_method 0 2024-09-12T00:37:38.752 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:37:38.522+0000 7f4be80e1640 0 -- 172.21.15.138:0/3120592061 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55684ace4aa0 msgr2=0x55684ace6f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.752 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:37:38.522+0000 7f4ac57fa640 1 client.7773.objecter ms_handle_reset 0x55684ace4aa0 session 0x55684ace4420 osd.4 2024-09-12T00:37:38.752 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:37:38.522+0000 7f4ac57fa640 10 monclient: _renew_subs 2024-09-12T00:37:38.752 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:37:38.522+0000 7f4ac57fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:37:38.752 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:37:38.522+0000 7f4be80e1640 10 monclient: get_auth_request con 0x7f4ab0080e30 auth_method 0 2024-09-12T00:37:38.752 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:38.752 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:38.752 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:38.752 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:38.752 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:38.752 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:38.753 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.753 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.753 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.753 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.753 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:37:38.530+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.753 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:38.753 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 zone default found 2024-09-12T00:37:38.753 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 4 Realm: () 2024-09-12T00:37:38.753 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:38.753 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:38.753 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:38.753 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 zonegroup default 2024-09-12T00:37:38.753 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.753 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.754 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.754 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.754 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.754 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.754 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 started sync module instance, tier type = 2024-09-12T00:37:38.754 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:37:38.534+0000 7f4be9dda9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:38.754 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=0 2024-09-12T00:37:38.754 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=1 2024-09-12T00:37:38.754 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=2 2024-09-12T00:37:38.754 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=3 2024-09-12T00:37:38.754 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=4 2024-09-12T00:37:38.754 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=5 2024-09-12T00:37:38.754 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:37:38.558+0000 7f4be9dda9c0 20 add_watcher() i=6 2024-09-12T00:37:38.755 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:37:38.562+0000 7f4be9dda9c0 20 add_watcher() i=7 2024-09-12T00:37:38.755 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:37:38.562+0000 7f4be9dda9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:38.755 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding auth protocol: cephx 2024-09-12T00:37:38.755 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding auth protocol: cephx 2024-09-12T00:37:38.755 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding auth protocol: cephx 2024-09-12T00:37:38.755 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: secure 2024-09-12T00:37:38.755 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: crc 2024-09-12T00:37:38.755 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: secure 2024-09-12T00:37:38.755 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: crc 2024-09-12T00:37:38.755 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: secure 2024-09-12T00:37:38.755 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:37:38.566+0000 7f4a9e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:38.755 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: crc 2024-09-12T00:37:38.755 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: crc 2024-09-12T00:37:38.756 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: secure 2024-09-12T00:37:38.756 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: crc 2024-09-12T00:37:38.756 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: secure 2024-09-12T00:37:38.756 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: crc 2024-09-12T00:37:38.756 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 AuthRegistry(0x7ffe33b41170) adding con mode: secure 2024-09-12T00:37:38.756 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:37:38.756 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:38.756 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:38.756 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command cache list hook 0x55684acace30 2024-09-12T00:37:38.756 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command cache inspect hook 0x55684acace30 2024-09-12T00:37:38.756 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command cache erase hook 0x55684acace30 2024-09-12T00:37:38.756 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command cache zap hook 0x55684acace30 2024-09-12T00:37:38.756 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 note: GC not initialized 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:37:38.566+0000 7f4a9d7e2640 20 reqs_thread_entry: start 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command sync trace show hook 0x7f4bd8082070 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command sync trace history hook 0x7f4bd8082070 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command sync trace active hook 0x7f4bd8082070 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 5 asok(0x55684a9e42b0) register_command sync trace active_short hook 0x7f4bd8082070 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 Filter name: none 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:37:38.566+0000 7f4a967fc640 20 reqs_thread_entry: start 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:37:38.757 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 : miss 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:37:38.566+0000 7f4be9dda9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:37:38.570+0000 7f4be9dda9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:37:38.570+0000 7f4be9dda9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 info.flags=0x17 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:37:38.570+0000 7f4be9dda9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to cache LRU end 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:37:38.570+0000 7f4be9dda9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:37:38.570+0000 7f4be9dda9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:37:38.570+0000 7f4be9dda9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:37:38.578+0000 7f4be9dda9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 info.flags=0x17 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:37:38.578+0000 7f4be9dda9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to cache LRU end 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:37:38.578+0000 7f4be9dda9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:37:38.578+0000 7f4be9dda9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36, ofs0, ns] 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:37:38.578+0000 7f4ac6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333470 cookie 93906419999216 notifier 7773 bl.length()=923 2024-09-12T00:37:38.758 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:37:38.578+0000 7f4ac6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 info.flags=0x17 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:37:38.578+0000 7f4ac6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to cache LRU end 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:37:38.578+0000 7f4ac6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:37:38.582+0000 7f4be9dda9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): orig_sources= new_sources= 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:37:38.582+0000 7f4be9dda9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): potential sources added=[] removed=[] 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:37:38.582+0000 7f4be9dda9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): orig_dests= new_dests= 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:37:38.582+0000 7f4be9dda9c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): potential dests added=[] removed=[] 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:37:38.586+0000 7f4be9dda9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f4be9dda9c0 time 2024-09-12T00:37:38.589417+0000 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f4bed6b42eb] 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4bed6b449f] 2024-09-12T00:37:38.759 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55684909dcc1] 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422aac) [0x556849afbaac] 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5568490b2ced] 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4bec51ad90] 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:37:38.590+0000 7f4be9dda9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f4be9dda9c0 thread_name:radosgw-admin 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f4bec533520] 2024-09-12T00:37:38.760 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f4bed6b4345] 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f4bed6b449f] 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55684909dcc1] 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422aac) [0x556849afbaac] 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5568490b2ced] 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f4bec51ad90] 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:37:38.761 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.762 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:37:38.762 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:37:38.762 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:37:38.762 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:37:38.762 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:37:38.762 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:37:38.762 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:37:38.762 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:37:38.762 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:37:38.762 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:37:38.762 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:37:38.762 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:37:38.762 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:37:38.763 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:37:38.763 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:37:38.763 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:37:38.763 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:37:38.763 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:37:38.763 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:37:38.763 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:37:38.763 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:37:38.763 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:37:38.763 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:37:38.763 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:37:38.763 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:37:38.763 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:37:38.763 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:37:38.764 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:37:38.764 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:37:38.764 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:37:38.764 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:37:38.764 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:37:38.764 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:37:38.764 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:37:38.764 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:37:38.764 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:37:38.764 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:37:38.764 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:37:38.764 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:37:38.764 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:37:38.765 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:37:38.765 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:37:38.765 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:37:38.765 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:37:38.765 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:37:38.765 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:37:38.765 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:37:38.765 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:37:38.765 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:37:38.765 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:37:38.765 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:37:38.765 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:37:38.765 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:37:38.765 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:37:38.766 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:37:38.766 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:37:38.766 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:37:38.766 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:37:38.766 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:37:38.766 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:37:38.766 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:37:38.766 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:37:38.766 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:37:38.766 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:37:38.766 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:37:38.766 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:37:38.766 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:37:38.767 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:37:38.767 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:37:38.767 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:37:38.767 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:37:38.767 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:37:38.767 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:37:38.767 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:37:38.767 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:37:38.767 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:37:38.767 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:37:38.767 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:37:38.767 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:37:38.767 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:37:38.767 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:37:38.768 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:37:38.768 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:37:38.768 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:37:38.768 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:37:38.768 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:37:38.768 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:37:38.768 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:37:38.768 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:37:38.768 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:37:38.768 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:37:38.768 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:37:38.768 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:37:38.768 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:37:38.769 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4a967fc640 / http_manager 2024-09-12T00:37:38.769 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4a9d7e2640 / http_manager 2024-09-12T00:37:38.769 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4a9e7e4640 / rgw_dt_lg_renew 2024-09-12T00:37:38.769 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4ac57fa640 / ms_dispatch 2024-09-12T00:37:38.769 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4ac6ffd640 / io_context_pool 2024-09-12T00:37:38.769 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4acd7fa640 / ms_dispatch 2024-09-12T00:37:38.769 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4acffff640 / ms_dispatch 2024-09-12T00:37:38.769 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4ad5e0b640 / io_context_pool 2024-09-12T00:37:38.769 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4be70df640 / msgr-worker-2 2024-09-12T00:37:38.769 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4be78e0640 / msgr-worker-1 2024-09-12T00:37:38.769 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4be80e1640 / msgr-worker-0 2024-09-12T00:37:38.769 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4be88e2640 / io_context_pool 2024-09-12T00:37:38.769 INFO:tasks.workunit.client.0.smithi138.stderr: 7f4be9dda9c0 / radosgw-admin 2024-09-12T00:37:38.769 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:37:38.770 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:37:38.770 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:37:38.591929Z_c4df0e47-5ac1-413a-a755-dd8538a50961/log 2024-09-12T00:37:38.770 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:37:38.770 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-12T00:37:38.770 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:37:38.771 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:38.771 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:38.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.670+0000 7f9d7a1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.674+0000 7f9d7a1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.674+0000 7f9d7a1ad9c0 20 realm 2024-09-12T00:37:38.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.674+0000 7f9d7a1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.674+0000 7f9d7a1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.674+0000 7f9d7a1ad9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:38.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.674+0000 7f9d7a1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.674+0000 7f9d7a1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.674+0000 7f9d7a1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.674+0000 7f9d7a1ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.674+0000 7f9d7a1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.674+0000 7f9d7a1ad9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:38.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.674+0000 7f9d7a1ad9c0 20 searching for the correct realm 2024-09-12T00:37:38.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.682+0000 7f9d784b4640 0 -- 172.21.15.138:0/4136519620 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f9d68033400 msgr2=0x7f9d68033880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.898+0000 7f9d784b4640 0 -- 172.21.15.138:0/4136519620 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5630d5889c70 msgr2=0x5630d588c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.906+0000 7f9d7a1ad9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.906+0000 7f9d7a1ad9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.906+0000 7f9d7a1ad9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.906+0000 7f9d7a1ad9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:38.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.906+0000 7f9d7a1ad9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.906+0000 7f9d7a1ad9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.906+0000 7f9d7a1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.906+0000 7f9d7a1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.906+0000 7f9d7a1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.910+0000 7f9d7a1ad9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.910+0000 7f9d7a1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.910+0000 7f9d7a1ad9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.910+0000 7f9d7a1ad9c0 20 zone default found 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.910+0000 7f9d7a1ad9c0 4 Realm: () 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.910+0000 7f9d7a1ad9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.910+0000 7f9d7a1ad9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:38.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.910+0000 7f9d7a1ad9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:38.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.910+0000 7f9d7a1ad9c0 20 zonegroup default 2024-09-12T00:37:38.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.910+0000 7f9d7a1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.910+0000 7f9d7a1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.910+0000 7f9d7a1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.910+0000 7f9d7a1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.910+0000 7f9d7a1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.910+0000 7f9d7a1ad9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:38.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.910+0000 7f9d7a1ad9c0 20 started sync module instance, tier type = 2024-09-12T00:37:38.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.910+0000 7f9d7a1ad9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:38.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.934+0000 7f9d7a1ad9c0 20 add_watcher() i=0 2024-09-12T00:37:38.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.934+0000 7f9d7a1ad9c0 20 add_watcher() i=1 2024-09-12T00:37:38.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.934+0000 7f9d7a1ad9c0 20 add_watcher() i=2 2024-09-12T00:37:38.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.934+0000 7f9d7a1ad9c0 20 add_watcher() i=3 2024-09-12T00:37:38.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.934+0000 7f9d7a1ad9c0 20 add_watcher() i=4 2024-09-12T00:37:38.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.934+0000 7f9d7a1ad9c0 20 add_watcher() i=5 2024-09-12T00:37:38.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.934+0000 7f9d7a1ad9c0 20 add_watcher() i=6 2024-09-12T00:37:38.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.938+0000 7f9d7a1ad9c0 20 add_watcher() i=7 2024-09-12T00:37:38.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.938+0000 7f9d7a1ad9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:38.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.942+0000 7f9c2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:38.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.942+0000 7f9d7a1ad9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:38.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.942+0000 7f9d7a1ad9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:38.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.942+0000 7f9d7a1ad9c0 5 note: GC not initialized 2024-09-12T00:37:38.939 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.942+0000 7f9c2cfe1640 20 reqs_thread_entry: start 2024-09-12T00:37:38.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.942+0000 7f9d7a1ad9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:38.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.942+0000 7f9d7a1ad9c0 20 Filter name: none 2024-09-12T00:37:38.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.942+0000 7f9ba67fc640 20 reqs_thread_entry: start 2024-09-12T00:37:38.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.942+0000 7f9d7a1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.946+0000 7f9d7a1ad9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:37:38.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.946+0000 7f9d7a1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.946+0000 7f9d7a1ad9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:38.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.946+0000 7f9d7a1ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:38.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.946+0000 7f9d7a1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.946+0000 7f9d7a1ad9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:37:38.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.946+0000 7f9d7a1ad9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:38.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.946+0000 7f9d7a1ad9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:38.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.946+0000 7f9d7a1ad9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:37:38.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.950+0000 7f9c2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:38.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.954+0000 7f9d7a1ad9c0 20 remove_watcher() i=0 2024-09-12T00:37:38.952 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.954+0000 7f9d7a1ad9c0 2 removed watcher, disabling cache 2024-09-12T00:37:38.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.958+0000 7f9d7a1ad9c0 20 remove_watcher() i=1 2024-09-12T00:37:38.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.958+0000 7f9d7a1ad9c0 20 remove_watcher() i=2 2024-09-12T00:37:38.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.962+0000 7f9d7a1ad9c0 20 remove_watcher() i=3 2024-09-12T00:37:38.959 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.962+0000 7f9d7a1ad9c0 20 remove_watcher() i=4 2024-09-12T00:37:38.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.966+0000 7f9d7a1ad9c0 20 remove_watcher() i=5 2024-09-12T00:37:38.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.970+0000 7f9d7a1ad9c0 20 remove_watcher() i=6 2024-09-12T00:37:38.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:38.970+0000 7f9d7a1ad9c0 20 remove_watcher() i=7 2024-09-12T00:37:38.983 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.983 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:37:38.983 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-logrecord-writes id: e2043445-c131-4520-984d-b4d52f038a6b.4538.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:37:38.983 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:37:38.984 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:38.984 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:38.999 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:37:38.999 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:37:39.042 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:37:39.078 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:39.079 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:39.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.134+0000 7f01062b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.138+0000 7f01062b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.138+0000 7f01062b69c0 20 realm 2024-09-12T00:37:39.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.138+0000 7f01062b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.138+0000 7f01062b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.138+0000 7f01062b69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:39.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.138+0000 7f01062b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.138+0000 7f01062b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.138+0000 7f01062b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.138+0000 7f01062b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:39.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.138+0000 7f01062b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.142+0000 7f01062b69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:39.137 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.142+0000 7f01062b69c0 20 searching for the correct realm 2024-09-12T00:37:39.143 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.146+0000 7f01045bd640 0 -- 172.21.15.138:0/2563325770 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f00fc07c970 msgr2=0x7f00fc060be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:39.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.362+0000 7f01045bd640 0 -- 172.21.15.138:0/2563325770 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x558ff3e917f0 msgr2=0x558ff3e93cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:39.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.370+0000 7f01062b69c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:37:39.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.370+0000 7f01062b69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:39.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.370+0000 7f01062b69c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:37:39.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.370+0000 7f01062b69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:39.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.370+0000 7f01062b69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:39.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.370+0000 7f01062b69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:39.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.370+0000 7f01062b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.374+0000 7f01062b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.374+0000 7f01062b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.374+0000 7f01062b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:39.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.374+0000 7f01062b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.374+0000 7f01062b69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:39.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.374+0000 7f01062b69c0 20 zone default found 2024-09-12T00:37:39.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.374+0000 7f01062b69c0 4 Realm: () 2024-09-12T00:37:39.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.374+0000 7f01062b69c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:37:39.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.374+0000 7f01062b69c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:37:39.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.374+0000 7f01062b69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:39.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.374+0000 7f01062b69c0 20 zonegroup default 2024-09-12T00:37:39.371 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.374+0000 7f01062b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.374+0000 7f01062b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.374+0000 7f01062b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.374+0000 7f01062b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.374+0000 7f01062b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.378+0000 7f01062b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:39.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.378+0000 7f01062b69c0 20 started sync module instance, tier type = 2024-09-12T00:37:39.373 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.378+0000 7f01062b69c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:37:39.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.398+0000 7f01062b69c0 20 add_watcher() i=0 2024-09-12T00:37:39.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.398+0000 7f01062b69c0 20 add_watcher() i=1 2024-09-12T00:37:39.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.398+0000 7f01062b69c0 20 add_watcher() i=2 2024-09-12T00:37:39.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.398+0000 7f01062b69c0 20 add_watcher() i=3 2024-09-12T00:37:39.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.398+0000 7f01062b69c0 20 add_watcher() i=4 2024-09-12T00:37:39.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.398+0000 7f01062b69c0 20 add_watcher() i=5 2024-09-12T00:37:39.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.398+0000 7f01062b69c0 20 add_watcher() i=6 2024-09-12T00:37:39.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.402+0000 7f01062b69c0 20 add_watcher() i=7 2024-09-12T00:37:39.399 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.402+0000 7f01062b69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:39.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.406+0000 7effbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:39.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.406+0000 7f01062b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:39.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.406+0000 7f01062b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:39.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.406+0000 7f01062b69c0 5 note: GC not initialized 2024-09-12T00:37:39.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.410+0000 7effbcfe1640 20 reqs_thread_entry: start 2024-09-12T00:37:39.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.410+0000 7f01062b69c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:39.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.410+0000 7f01062b69c0 20 Filter name: none 2024-09-12T00:37:39.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.410+0000 7effae7fc640 20 reqs_thread_entry: start 2024-09-12T00:37:39.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.410+0000 7f01062b69c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:37:39.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.410+0000 7f01062b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.410+0000 7f01062b69c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:37:39.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.410+0000 7f01062b69c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:37:39.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.410+0000 7f01062b69c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:37:39.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.410+0000 7f01062b69c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 : miss 2024-09-12T00:37:39.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.410+0000 7f01062b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:39.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.410+0000 7f01062b69c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:37:39.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.410+0000 7f01062b69c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 info.flags=0x17 2024-09-12T00:37:39.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.410+0000 7f01062b69c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to cache LRU end 2024-09-12T00:37:39.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.410+0000 7f01062b69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:37:39.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.410+0000 7f01062b69c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:37:39.408 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.410+0000 7f01062b69c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 2024-09-12T00:37:39.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.414+0000 7f01062b69c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to be held by another RGW process; skipping for now 2024-09-12T00:37:39.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.414+0000 7effbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:39.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.418+0000 7f01062b69c0 20 remove_watcher() i=0 2024-09-12T00:37:39.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.418+0000 7f01062b69c0 2 removed watcher, disabling cache 2024-09-12T00:37:39.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.422+0000 7f01062b69c0 20 remove_watcher() i=1 2024-09-12T00:37:39.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.422+0000 7f01062b69c0 20 remove_watcher() i=2 2024-09-12T00:37:39.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.426+0000 7f01062b69c0 20 remove_watcher() i=3 2024-09-12T00:37:39.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.426+0000 7f01062b69c0 20 remove_watcher() i=4 2024-09-12T00:37:39.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.430+0000 7f01062b69c0 20 remove_watcher() i=5 2024-09-12T00:37:39.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.434+0000 7f01062b69c0 20 remove_watcher() i=6 2024-09-12T00:37:39.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:37:39.434+0000 7f01062b69c0 20 remove_watcher() i=7 2024-09-12T00:37:39.447 INFO:tasks.workunit.client.0.smithi138.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:38:09.475 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:38:09.511 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:09.511 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:09.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.557+0000 7f5e345459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.561+0000 7f5e345459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.561+0000 7f5e345459c0 20 realm 2024-09-12T00:38:09.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.561+0000 7f5e345459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.561+0000 7f5e345459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.561+0000 7f5e345459c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:09.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.561+0000 7f5e345459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.561+0000 7f5e345459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.561+0000 7f5e345459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.561+0000 7f5e345459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:09.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.561+0000 7f5e345459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.561+0000 7f5e345459c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:09.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.561+0000 7f5e345459c0 20 searching for the correct realm 2024-09-12T00:38:09.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.569+0000 7f5e3284c640 0 -- 172.21.15.138:0/3812554189 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f5e2c05dca0 msgr2=0x7f5e2c066040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:09.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.785+0000 7f5e3284c640 0 -- 172.21.15.138:0/3812554189 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5597dbcbb2b0 msgr2=0x5597dbcbd770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:09.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.793+0000 7f5e345459c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:09.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.793+0000 7f5e345459c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:09.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.793+0000 7f5e345459c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:09.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.793+0000 7f5e345459c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:09.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.793+0000 7f5e345459c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:09.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.793+0000 7f5e345459c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:09.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.793+0000 7f5e345459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.793+0000 7f5e345459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.792 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.793+0000 7f5e345459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.797+0000 7f5e345459c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:09.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.797+0000 7f5e345459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.797+0000 7f5e345459c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:09.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.797+0000 7f5e345459c0 20 zone default found 2024-09-12T00:38:09.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.797+0000 7f5e345459c0 4 Realm: () 2024-09-12T00:38:09.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.797+0000 7f5e345459c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:09.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.797+0000 7f5e345459c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:09.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.797+0000 7f5e345459c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:09.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.797+0000 7f5e345459c0 20 zonegroup default 2024-09-12T00:38:09.794 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.797+0000 7f5e345459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.797+0000 7f5e345459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.797+0000 7f5e345459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.797+0000 7f5e345459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.797+0000 7f5e345459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.797+0000 7f5e345459c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:09.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.797+0000 7f5e345459c0 20 started sync module instance, tier type = 2024-09-12T00:38:09.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.797+0000 7f5e345459c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:09.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.821+0000 7f5e345459c0 20 add_watcher() i=0 2024-09-12T00:38:09.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.821+0000 7f5e345459c0 20 add_watcher() i=1 2024-09-12T00:38:09.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.821+0000 7f5e345459c0 20 add_watcher() i=2 2024-09-12T00:38:09.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.821+0000 7f5e345459c0 20 add_watcher() i=3 2024-09-12T00:38:09.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.821+0000 7f5e345459c0 20 add_watcher() i=4 2024-09-12T00:38:09.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.821+0000 7f5e345459c0 20 add_watcher() i=5 2024-09-12T00:38:09.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.821+0000 7f5e345459c0 20 add_watcher() i=6 2024-09-12T00:38:09.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.821+0000 7f5e345459c0 20 add_watcher() i=7 2024-09-12T00:38:09.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.821+0000 7f5e345459c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:09.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5ce8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:09.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:09.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:09.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 5 note: GC not initialized 2024-09-12T00:38:09.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5c637fe640 20 reqs_thread_entry: start 2024-09-12T00:38:09.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:09.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 20 Filter name: none 2024-09-12T00:38:09.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5c617fa640 20 reqs_thread_entry: start 2024-09-12T00:38:09.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:38:09.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:38:09.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:38:09.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:38:09.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 : miss 2024-09-12T00:38:09.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:09.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:38:09.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 info.flags=0x17 2024-09-12T00:38:09.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to cache LRU end 2024-09-12T00:38:09.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:09.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:09.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.829+0000 7f5e345459c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 2024-09-12T00:38:09.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.833+0000 7f5e345459c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:38:09.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.849+0000 7f5e345459c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 info.flags=0x17 2024-09-12T00:38:09.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.849+0000 7f5e345459c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to cache LRU end 2024-09-12T00:38:09.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.849+0000 7f5e345459c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:09.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.849+0000 7f5e345459c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36, ofs0, ns] 2024-09-12T00:38:09.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.853+0000 7f5d157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333471 cookie 94110715988288 notifier 7337 bl.length()=923 2024-09-12T00:38:09.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.853+0000 7f5d157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 info.flags=0x17 2024-09-12T00:38:09.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.853+0000 7f5d157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to cache LRU end 2024-09-12T00:38:09.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.853+0000 7f5d157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:09.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.853+0000 7f5e345459c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): orig_sources= new_sources= 2024-09-12T00:38:09.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.853+0000 7f5e345459c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): potential sources added=[] removed=[] 2024-09-12T00:38:09.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.853+0000 7f5e345459c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): orig_dests= new_dests= 2024-09-12T00:38:09.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.853+0000 7f5e345459c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): potential dests added=[] removed=[] 2024-09-12T00:38:09.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.0 2024-09-12T00:38:09.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.0 2024-09-12T00:38:09.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.1 2024-09-12T00:38:09.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.1 2024-09-12T00:38:09.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.2 2024-09-12T00:38:09.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.2 2024-09-12T00:38:09.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.3 2024-09-12T00:38:09.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.3 2024-09-12T00:38:09.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.4 2024-09-12T00:38:09.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.4 2024-09-12T00:38:09.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.5 2024-09-12T00:38:09.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.5 2024-09-12T00:38:09.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.6 2024-09-12T00:38:09.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.6 2024-09-12T00:38:09.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.7 2024-09-12T00:38:09.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.7 2024-09-12T00:38:09.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.8 2024-09-12T00:38:09.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.8 2024-09-12T00:38:09.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.9 2024-09-12T00:38:09.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.9 2024-09-12T00:38:09.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.10 2024-09-12T00:38:09.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.10 2024-09-12T00:38:09.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.11 2024-09-12T00:38:09.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2.11 2024-09-12T00:38:09.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.0 2024-09-12T00:38:09.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.1 2024-09-12T00:38:09.865 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.865+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2 2024-09-12T00:38:09.866 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.869+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.3 2024-09-12T00:38:09.867 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.869+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.4 2024-09-12T00:38:09.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.873+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.5 2024-09-12T00:38:09.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.873+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.6 2024-09-12T00:38:09.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.873+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.7 2024-09-12T00:38:09.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.873+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.8 2024-09-12T00:38:09.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.877+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.9 2024-09-12T00:38:09.874 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.877+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.10 2024-09-12T00:38:09.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.885+0000 7f5e345459c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:09.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.885+0000 7f5e345459c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 2024-09-12T00:38:09.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.889+0000 7f5e345459c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 info.flags=0x17 2024-09-12T00:38:09.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.889+0000 7f5e345459c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to cache LRU end 2024-09-12T00:38:09.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.889+0000 7f5e345459c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:09.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.889+0000 7f5e345459c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36, ofs0, ns] 2024-09-12T00:38:09.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.889+0000 7f5d157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333472 cookie 94110715988288 notifier 7337 bl.length()=923 2024-09-12T00:38:09.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.889+0000 7f5d157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 info.flags=0x17 2024-09-12T00:38:09.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.889+0000 7f5d157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to cache LRU end 2024-09-12T00:38:09.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.889+0000 7f5d157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:09.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.889+0000 7f5e345459c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): orig_sources= new_sources= 2024-09-12T00:38:09.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.889+0000 7f5e345459c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): potential sources added=[] removed=[] 2024-09-12T00:38:09.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.889+0000 7f5e345459c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): orig_dests= new_dests= 2024-09-12T00:38:09.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.889+0000 7f5e345459c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): potential dests added=[] removed=[] 2024-09-12T00:38:09.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.897+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.0 2024-09-12T00:38:09.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.897+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.1 2024-09-12T00:38:09.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.897+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.2 2024-09-12T00:38:09.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.901+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.3 2024-09-12T00:38:09.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.901+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.4 2024-09-12T00:38:09.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.901+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.5 2024-09-12T00:38:09.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.901+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.6 2024-09-12T00:38:09.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.901+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.7 2024-09-12T00:38:09.901 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.905+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.8 2024-09-12T00:38:09.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.905+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.9 2024-09-12T00:38:09.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.905+0000 7f5e345459c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.36.10 2024-09-12T00:38:09.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.905+0000 7f5e345459c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:09.903 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.905+0000 7f5e345459c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 2024-09-12T00:38:09.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.909+0000 7f5e345459c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 info.flags=0x17 2024-09-12T00:38:09.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.909+0000 7f5e345459c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to cache LRU end 2024-09-12T00:38:09.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.909+0000 7f5e345459c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:09.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.909+0000 7f5e345459c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36, ofs0, ns] 2024-09-12T00:38:09.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.909+0000 7f5d15ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333473 cookie 94110715988288 notifier 7337 bl.length()=891 2024-09-12T00:38:09.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.909+0000 7f5d15ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 info.flags=0x17 2024-09-12T00:38:09.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.909+0000 7f5d15ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:e2043445-c131-4520-984d-b4d52f038a6b.4538.36 to cache LRU end 2024-09-12T00:38:09.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.909+0000 7f5d15ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:09.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.909+0000 7f5e345459c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): orig_sources= new_sources= 2024-09-12T00:38:09.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.909+0000 7f5e345459c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): potential sources added=[] removed=[] 2024-09-12T00:38:09.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.909+0000 7f5e345459c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): orig_dests= new_dests= 2024-09-12T00:38:09.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.909+0000 7f5e345459c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[e2043445-c131-4520-984d-b4d52f038a6b.4538.36]): potential dests added=[] removed=[] 2024-09-12T00:38:09.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.917+0000 7f5e345459c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:38:09.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.921+0000 7f5ce8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:09.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.925+0000 7f5e345459c0 20 remove_watcher() i=0 2024-09-12T00:38:09.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.925+0000 7f5e345459c0 2 removed watcher, disabling cache 2024-09-12T00:38:09.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.929+0000 7f5e345459c0 20 remove_watcher() i=1 2024-09-12T00:38:09.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.929+0000 7f5e345459c0 20 remove_watcher() i=2 2024-09-12T00:38:09.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.933+0000 7f5e345459c0 20 remove_watcher() i=3 2024-09-12T00:38:09.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.933+0000 7f5e345459c0 20 remove_watcher() i=4 2024-09-12T00:38:09.934 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.937+0000 7f5e345459c0 20 remove_watcher() i=5 2024-09-12T00:38:09.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.941+0000 7f5e345459c0 20 remove_watcher() i=6 2024-09-12T00:38:09.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:09.941+0000 7f5e345459c0 20 remove_watcher() i=7 2024-09-12T00:38:09.956 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:38:09.986 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:09.986 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:10.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.037+0000 7fe6359209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.037+0000 7fe6359209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.037+0000 7fe6359209c0 20 realm 2024-09-12T00:38:10.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.037+0000 7fe6359209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.037+0000 7fe6359209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.037+0000 7fe6359209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:10.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.037+0000 7fe6359209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.037+0000 7fe6359209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.037+0000 7fe6359209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.041+0000 7fe6359209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:10.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.041+0000 7fe6359209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.041+0000 7fe6359209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:10.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.041+0000 7fe6359209c0 20 searching for the correct realm 2024-09-12T00:38:10.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.041+0000 7fe633426640 0 -- 172.21.15.138:0/1144125790 >> [v2:172.21.15.138:6816/3496313381,v1:172.21.15.138:6817/3496313381] conn(0x7fe61c003be0 msgr2=0x7fe62c05dac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:10.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.049+0000 7fe633c27640 0 -- 172.21.15.138:0/1144125790 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x562dad559bb0 msgr2=0x562dad55c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:10.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:10.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:10.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:10.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:10.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:10.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:10.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:10.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:10.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 zone default found 2024-09-12T00:38:10.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 4 Realm: () 2024-09-12T00:38:10.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:10.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:10.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:10.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 zonegroup default 2024-09-12T00:38:10.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 started sync module instance, tier type = 2024-09-12T00:38:10.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.061+0000 7fe6359209c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:10.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.081+0000 7fe6359209c0 20 add_watcher() i=0 2024-09-12T00:38:10.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.081+0000 7fe6359209c0 20 add_watcher() i=1 2024-09-12T00:38:10.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.081+0000 7fe6359209c0 20 add_watcher() i=2 2024-09-12T00:38:10.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.081+0000 7fe6359209c0 20 add_watcher() i=3 2024-09-12T00:38:10.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.081+0000 7fe6359209c0 20 add_watcher() i=4 2024-09-12T00:38:10.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.081+0000 7fe6359209c0 20 add_watcher() i=5 2024-09-12T00:38:10.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.081+0000 7fe6359209c0 20 add_watcher() i=6 2024-09-12T00:38:10.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.081+0000 7fe6359209c0 20 add_watcher() i=7 2024-09-12T00:38:10.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.081+0000 7fe6359209c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:10.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.085+0000 7fe4e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:10.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.085+0000 7fe6359209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:10.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.085+0000 7fe6359209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:10.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.085+0000 7fe6359209c0 5 note: GC not initialized 2024-09-12T00:38:10.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.085+0000 7fe4e8fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:10.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.089+0000 7fe6359209c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:10.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.089+0000 7fe6359209c0 20 Filter name: none 2024-09-12T00:38:10.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.089+0000 7fe4627fc640 20 reqs_thread_entry: start 2024-09-12T00:38:10.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.089+0000 7fe6359209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.089+0000 7fe6359209c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:38:10.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.089+0000 7fe6359209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.089+0000 7fe6359209c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:38:10.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.089+0000 7fe6359209c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:10.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.089+0000 7fe6359209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.089+0000 7fe6359209c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:38:10.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.089+0000 7fe6359209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.089+0000 7fe6359209c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:38:10.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.089+0000 7fe6359209c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:10.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.093+0000 7fe4e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:10.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.097+0000 7fe6359209c0 20 remove_watcher() i=0 2024-09-12T00:38:10.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.097+0000 7fe6359209c0 2 removed watcher, disabling cache 2024-09-12T00:38:10.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.097+0000 7fe6359209c0 20 remove_watcher() i=1 2024-09-12T00:38:10.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.101+0000 7fe6359209c0 20 remove_watcher() i=2 2024-09-12T00:38:10.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.101+0000 7fe6359209c0 20 remove_watcher() i=3 2024-09-12T00:38:10.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.105+0000 7fe6359209c0 20 remove_watcher() i=4 2024-09-12T00:38:10.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.109+0000 7fe6359209c0 20 remove_watcher() i=5 2024-09-12T00:38:10.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.109+0000 7fe6359209c0 20 remove_watcher() i=6 2024-09-12T00:38:10.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.113+0000 7fe6359209c0 20 remove_watcher() i=7 2024-09-12T00:38:10.124 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:10.124 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:38:10.124 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-logrecord-writes id: e2043445-c131-4520-984d-b4d52f038a6b.4538.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:38:10.124 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:10.126 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.126 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.129 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.129 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.181 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.181 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.228 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T00:38:10.228 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:10.230 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.230 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.248 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.249 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.296 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.296 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.318 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.318 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.339 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.339 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.361 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.361 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.382 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.382 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.404 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.404 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.426 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.426 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.446 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.446 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.468 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.468 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.490 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.490 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.510 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.511 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.534 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.534 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.556 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.556 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.577 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.577 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.598 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.599 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.619 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.619 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.642 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.642 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.664 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.665 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.685 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.686 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.707 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:10.707 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:10.726 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:38:10.758 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:10.758 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:10.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.805+0000 7f04b22e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.809+0000 7f04b22e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.809+0000 7f04b22e29c0 20 realm 2024-09-12T00:38:10.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.809+0000 7f04b22e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.809+0000 7f04b22e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.809+0000 7f04b22e29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:10.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.809+0000 7f04b22e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.809+0000 7f04b22e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:10.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.809+0000 7f04b22e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.809+0000 7f04b22e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:10.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.809+0000 7f04b22e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:10.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.813+0000 7f04b22e29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:10.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.813+0000 7f04b22e29c0 20 searching for the correct realm 2024-09-12T00:38:10.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:10.817+0000 7f04b05e9640 0 -- 172.21.15.138:0/2498617830 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f04a805ccc0 msgr2=0x7f04a805ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:11.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.033+0000 7f04b05e9640 0 -- 172.21.15.138:0/2498617830 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55b9285c48d0 msgr2=0x55b9285c6d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:11.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.041+0000 7f04b22e29c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:11.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.041+0000 7f04b22e29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:11.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.041+0000 7f04b22e29c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:11.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.041+0000 7f04b22e29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:11.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.041+0000 7f04b22e29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:11.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.041+0000 7f04b22e29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:11.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.041+0000 7f04b22e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.041+0000 7f04b22e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.041+0000 7f04b22e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.041+0000 7f04b22e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:11.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.041+0000 7f04b22e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.045+0000 7f04b22e29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:11.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.045+0000 7f04b22e29c0 20 zone default found 2024-09-12T00:38:11.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.045+0000 7f04b22e29c0 4 Realm: () 2024-09-12T00:38:11.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.045+0000 7f04b22e29c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:11.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.045+0000 7f04b22e29c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:11.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.045+0000 7f04b22e29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:11.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.045+0000 7f04b22e29c0 20 zonegroup default 2024-09-12T00:38:11.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.045+0000 7f04b22e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.045+0000 7f04b22e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.045+0000 7f04b22e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.045+0000 7f04b22e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.045+0000 7f04b22e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.045+0000 7f04b22e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.045+0000 7f04b22e29c0 20 started sync module instance, tier type = 2024-09-12T00:38:11.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.045+0000 7f04b22e29c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:11.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.069+0000 7f04b22e29c0 20 add_watcher() i=0 2024-09-12T00:38:11.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.069+0000 7f04b22e29c0 20 add_watcher() i=1 2024-09-12T00:38:11.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.069+0000 7f04b22e29c0 20 add_watcher() i=2 2024-09-12T00:38:11.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.069+0000 7f04b22e29c0 20 add_watcher() i=3 2024-09-12T00:38:11.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.069+0000 7f04b22e29c0 20 add_watcher() i=4 2024-09-12T00:38:11.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.069+0000 7f04b22e29c0 20 add_watcher() i=5 2024-09-12T00:38:11.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.069+0000 7f04b22e29c0 20 add_watcher() i=6 2024-09-12T00:38:11.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.073+0000 7f04b22e29c0 20 add_watcher() i=7 2024-09-12T00:38:11.069 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.073+0000 7f04b22e29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:11.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.077+0000 7f0365fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:11.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.077+0000 7f04b22e29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:11.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.077+0000 7f04b22e29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:11.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.077+0000 7f04b22e29c0 5 note: GC not initialized 2024-09-12T00:38:11.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.077+0000 7f0364fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:11.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.077+0000 7f04b22e29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:11.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.077+0000 7f04b22e29c0 20 Filter name: none 2024-09-12T00:38:11.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.077+0000 7f02de7fc640 20 reqs_thread_entry: start 2024-09-12T00:38:11.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.077+0000 7f04b22e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.077+0000 7f04b22e29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:11.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.077+0000 7f04b22e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.081+0000 7f04b22e29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:11.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.081+0000 7f04b22e29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:11.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.081+0000 7f04b22e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.081+0000 7f04b22e29c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:11.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.081+0000 7f04b22e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.081+0000 7f04b22e29c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:11.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.081+0000 7f04b22e29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:11.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.081+0000 7f0365fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:11.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.089+0000 7f04b22e29c0 20 remove_watcher() i=0 2024-09-12T00:38:11.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.089+0000 7f04b22e29c0 2 removed watcher, disabling cache 2024-09-12T00:38:11.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.089+0000 7f04b22e29c0 20 remove_watcher() i=1 2024-09-12T00:38:11.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.093+0000 7f04b22e29c0 20 remove_watcher() i=2 2024-09-12T00:38:11.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.093+0000 7f04b22e29c0 20 remove_watcher() i=3 2024-09-12T00:38:11.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.097+0000 7f04b22e29c0 20 remove_watcher() i=4 2024-09-12T00:38:11.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.097+0000 7f04b22e29c0 20 remove_watcher() i=5 2024-09-12T00:38:11.099 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.101+0000 7f04b22e29c0 20 remove_watcher() i=6 2024-09-12T00:38:11.104 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.105+0000 7f04b22e29c0 20 remove_watcher() i=7 2024-09-12T00:38:11.122 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:11.122 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:38:11.122 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-change-reshard-state id: e2043445-c131-4520-984d-b4d52f038a6b.4538.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:11.122 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:11.122 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T00:38:11.156 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:11.156 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:11.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.413+0000 7fee342539c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.417+0000 7fee342539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.417+0000 7fee342539c0 20 realm 2024-09-12T00:38:11.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.417+0000 7fee342539c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.417+0000 7fee342539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.417+0000 7fee342539c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:11.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.417+0000 7fee342539c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.417+0000 7fee342539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.417+0000 7fee342539c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.417+0000 7fee342539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:11.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.417+0000 7fee342539c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.417+0000 7fee342539c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:11.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.417+0000 7fee342539c0 20 searching for the correct realm 2024-09-12T00:38:11.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.425+0000 7fee3255a640 0 -- 172.21.15.138:0/1295134938 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55dbb83c6b70 msgr2=0x55dbb83c9030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:11.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.429+0000 7fee31558640 0 -- 172.21.15.138:0/1295134938 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55dbb83c1db0 msgr2=0x55dbb83c41c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:11.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:11.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:11.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:11.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:11.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:11.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:11.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:11.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:11.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 20 zone default found 2024-09-12T00:38:11.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 4 Realm: () 2024-09-12T00:38:11.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:11.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:11.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:11.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 20 zonegroup default 2024-09-12T00:38:11.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.441+0000 7fee342539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.445+0000 7fee342539c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.445+0000 7fee342539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.445+0000 7fee342539c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.445+0000 7fee342539c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.445+0000 7fee342539c0 20 started sync module instance, tier type = 2024-09-12T00:38:11.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.445+0000 7fee342539c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:11.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.465+0000 7fee342539c0 20 add_watcher() i=0 2024-09-12T00:38:11.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.465+0000 7fee342539c0 20 add_watcher() i=1 2024-09-12T00:38:11.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.465+0000 7fee342539c0 20 add_watcher() i=2 2024-09-12T00:38:11.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.465+0000 7fee342539c0 20 add_watcher() i=3 2024-09-12T00:38:11.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.465+0000 7fee342539c0 20 add_watcher() i=4 2024-09-12T00:38:11.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.465+0000 7fee342539c0 20 add_watcher() i=5 2024-09-12T00:38:11.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.465+0000 7fee342539c0 20 add_watcher() i=6 2024-09-12T00:38:11.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.469+0000 7fee342539c0 20 add_watcher() i=7 2024-09-12T00:38:11.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.469+0000 7fee342539c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:11.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.469+0000 7fece37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:11.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:11.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:11.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 5 note: GC not initialized 2024-09-12T00:38:11.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fece27fc640 20 reqs_thread_entry: start 2024-09-12T00:38:11.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:11.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 20 Filter name: none 2024-09-12T00:38:11.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fec53fff640 20 reqs_thread_entry: start 2024-09-12T00:38:11.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:38:11.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:11.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:38:11.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:38:11.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 : miss 2024-09-12T00:38:11.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:11.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 info.flags=0x17 2024-09-12T00:38:11.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 to cache LRU end 2024-09-12T00:38:11.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:11.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.473+0000 7fee342539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 2024-09-12T00:38:11.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.485+0000 7fee342539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 info.flags=0x17 2024-09-12T00:38:11.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.485+0000 7fee342539c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 to cache LRU end 2024-09-12T00:38:11.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.485+0000 7fee342539c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.485+0000 7fee342539c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37, ofs0, ns] 2024-09-12T00:38:11.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.485+0000 7fed14ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333557 cookie 94402177150896 notifier 7887 bl.length()=931 2024-09-12T00:38:11.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.485+0000 7fed14ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 info.flags=0x17 2024-09-12T00:38:11.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.485+0000 7fed14ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 to cache LRU end 2024-09-12T00:38:11.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.485+0000 7fed14ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.485+0000 7fee342539c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): orig_sources= new_sources= 2024-09-12T00:38:11.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.485+0000 7fee342539c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): potential sources added=[] removed=[] 2024-09-12T00:38:11.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.485+0000 7fee342539c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): orig_dests= new_dests= 2024-09-12T00:38:11.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.485+0000 7fee342539c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): potential dests added=[] removed=[] 2024-09-12T00:38:11.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.0 2024-09-12T00:38:11.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.0 2024-09-12T00:38:11.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.1 2024-09-12T00:38:11.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.1 2024-09-12T00:38:11.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.2 2024-09-12T00:38:11.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.2 2024-09-12T00:38:11.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.3 2024-09-12T00:38:11.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.3 2024-09-12T00:38:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.4 2024-09-12T00:38:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.4 2024-09-12T00:38:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.5 2024-09-12T00:38:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.5 2024-09-12T00:38:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.6 2024-09-12T00:38:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.6 2024-09-12T00:38:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.7 2024-09-12T00:38:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.7 2024-09-12T00:38:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.8 2024-09-12T00:38:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.8 2024-09-12T00:38:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.9 2024-09-12T00:38:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.9 2024-09-12T00:38:11.494 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.10 2024-09-12T00:38:11.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.10 2024-09-12T00:38:11.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.11 2024-09-12T00:38:11.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.11 2024-09-12T00:38:11.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.0 2024-09-12T00:38:11.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1 2024-09-12T00:38:11.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.2 2024-09-12T00:38:11.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.497+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.3 2024-09-12T00:38:11.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.501+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.4 2024-09-12T00:38:11.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.501+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.5 2024-09-12T00:38:11.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.501+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.6 2024-09-12T00:38:11.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.501+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.7 2024-09-12T00:38:11.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.501+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.8 2024-09-12T00:38:11.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.505+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.9 2024-09-12T00:38:11.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.505+0000 7fee342539c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.10 2024-09-12T00:38:11.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.513+0000 7fee342539c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T00:38:11.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.513+0000 7fee342539c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T00:38:11.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.533+0000 7fee342539c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:11.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.533+0000 7fee342539c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 2024-09-12T00:38:11.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.537+0000 7fee342539c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 info.flags=0x17 2024-09-12T00:38:11.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.537+0000 7fee342539c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 to cache LRU end 2024-09-12T00:38:11.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.537+0000 7fee342539c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.537+0000 7fee342539c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37, ofs0, ns] 2024-09-12T00:38:11.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.537+0000 7fed157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333558 cookie 94402177150896 notifier 7887 bl.length()=899 2024-09-12T00:38:11.533 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.537+0000 7fed157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 info.flags=0x17 2024-09-12T00:38:11.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.537+0000 7fed157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 to cache LRU end 2024-09-12T00:38:11.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.537+0000 7fed157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:11.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.537+0000 7fee342539c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): orig_sources= new_sources= 2024-09-12T00:38:11.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.537+0000 7fee342539c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): potential sources added=[] removed=[] 2024-09-12T00:38:11.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.537+0000 7fee342539c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): orig_dests= new_dests= 2024-09-12T00:38:11.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.537+0000 7fee342539c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): potential dests added=[] removed=[] 2024-09-12T00:38:11.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.537+0000 7fee342539c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T00:38:11.536 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.537+0000 7fece37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:11.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.545+0000 7fee342539c0 20 remove_watcher() i=0 2024-09-12T00:38:11.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.545+0000 7fee342539c0 2 removed watcher, disabling cache 2024-09-12T00:38:11.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.545+0000 7fee342539c0 20 remove_watcher() i=1 2024-09-12T00:38:11.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.549+0000 7fee342539c0 20 remove_watcher() i=2 2024-09-12T00:38:11.547 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.549+0000 7fee342539c0 20 remove_watcher() i=3 2024-09-12T00:38:11.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.553+0000 7fee342539c0 20 remove_watcher() i=4 2024-09-12T00:38:11.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.553+0000 7fee342539c0 20 remove_watcher() i=5 2024-09-12T00:38:11.554 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.557+0000 7fee342539c0 20 remove_watcher() i=6 2024-09-12T00:38:11.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.561+0000 7fee342539c0 20 remove_watcher() i=7 2024-09-12T00:38:11.573 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:38:11.603 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:11.603 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:11.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.649+0000 7f0f879309c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.649+0000 7f0f879309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.649+0000 7f0f879309c0 20 realm 2024-09-12T00:38:11.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.649+0000 7f0f879309c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.649+0000 7f0f879309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.649+0000 7f0f879309c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:11.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.649+0000 7f0f879309c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.649+0000 7f0f879309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.649+0000 7f0f879309c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.653+0000 7f0f879309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:11.649 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.653+0000 7f0f879309c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.653+0000 7f0f879309c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:11.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.653+0000 7f0f879309c0 20 searching for the correct realm 2024-09-12T00:38:11.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.657+0000 7f0f85c37640 0 -- 172.21.15.138:0/2127685556 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f0f8006a940 msgr2=0x7f0f8005ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:11.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.873+0000 7f0f85c37640 0 -- 172.21.15.138:0/2127685556 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55b86f8a3aa0 msgr2=0x55b86f8a5f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:11.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.881+0000 7f0f879309c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:11.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.881+0000 7f0f879309c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:11.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.881+0000 7f0f879309c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:11.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.881+0000 7f0f879309c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:11.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.881+0000 7f0f879309c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:11.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.881+0000 7f0f879309c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:11.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.881+0000 7f0f879309c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.885+0000 7f0f879309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.885+0000 7f0f879309c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.885+0000 7f0f879309c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:11.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.885+0000 7f0f879309c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.885+0000 7f0f879309c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:11.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.885+0000 7f0f879309c0 20 zone default found 2024-09-12T00:38:11.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.885+0000 7f0f879309c0 4 Realm: () 2024-09-12T00:38:11.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.885+0000 7f0f879309c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:11.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.885+0000 7f0f879309c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:11.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.885+0000 7f0f879309c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:11.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.885+0000 7f0f879309c0 20 zonegroup default 2024-09-12T00:38:11.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.885+0000 7f0f879309c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.885+0000 7f0f879309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.885+0000 7f0f879309c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.889+0000 7f0f879309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.889+0000 7f0f879309c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.889+0000 7f0f879309c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:11.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.889+0000 7f0f879309c0 20 started sync module instance, tier type = 2024-09-12T00:38:11.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.889+0000 7f0f879309c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:11.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.913+0000 7f0f879309c0 20 add_watcher() i=0 2024-09-12T00:38:11.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.913+0000 7f0f879309c0 20 add_watcher() i=1 2024-09-12T00:38:11.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.913+0000 7f0f879309c0 20 add_watcher() i=2 2024-09-12T00:38:11.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.913+0000 7f0f879309c0 20 add_watcher() i=3 2024-09-12T00:38:11.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.913+0000 7f0f879309c0 20 add_watcher() i=4 2024-09-12T00:38:11.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.913+0000 7f0f879309c0 20 add_watcher() i=5 2024-09-12T00:38:11.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.913+0000 7f0f879309c0 20 add_watcher() i=6 2024-09-12T00:38:11.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.913+0000 7f0f879309c0 20 add_watcher() i=7 2024-09-12T00:38:11.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.913+0000 7f0f879309c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:11.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.917+0000 7f0e3bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:11.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.917+0000 7f0f879309c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:11.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.917+0000 7f0f879309c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:11.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.917+0000 7f0f879309c0 5 note: GC not initialized 2024-09-12T00:38:11.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.921+0000 7f0e3afe5640 20 reqs_thread_entry: start 2024-09-12T00:38:11.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.921+0000 7f0f879309c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:11.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.921+0000 7f0f879309c0 20 Filter name: none 2024-09-12T00:38:11.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.921+0000 7f0e38fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:11.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.921+0000 7f0f879309c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.921+0000 7f0f879309c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:11.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.921+0000 7f0f879309c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.921+0000 7f0f879309c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:11.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.921+0000 7f0f879309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:11.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.921+0000 7f0f879309c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.921+0000 7f0f879309c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:11.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.921+0000 7f0f879309c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:11.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.921+0000 7f0f879309c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:11.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.921+0000 7f0f879309c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:11.923 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.925+0000 7f0e3bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:11.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.929+0000 7f0f879309c0 20 remove_watcher() i=0 2024-09-12T00:38:11.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.929+0000 7f0f879309c0 2 removed watcher, disabling cache 2024-09-12T00:38:11.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.933+0000 7f0f879309c0 20 remove_watcher() i=1 2024-09-12T00:38:11.931 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.933+0000 7f0f879309c0 20 remove_watcher() i=2 2024-09-12T00:38:11.933 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.937+0000 7f0f879309c0 20 remove_watcher() i=3 2024-09-12T00:38:11.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.937+0000 7f0f879309c0 20 remove_watcher() i=4 2024-09-12T00:38:11.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.941+0000 7f0f879309c0 20 remove_watcher() i=5 2024-09-12T00:38:11.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.941+0000 7f0f879309c0 20 remove_watcher() i=6 2024-09-12T00:38:11.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:11.945+0000 7f0f879309c0 20 remove_watcher() i=7 2024-09-12T00:38:11.962 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:11.962 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:38:11.962 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-change-reshard-state id: e2043445-c131-4520-984d-b4d52f038a6b.4538.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:11.962 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:11.963 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:11.963 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:11.974 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:11.974 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:12.018 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:38:12.053 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:12.053 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:12.098 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.101+0000 7f9d239429c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.101+0000 7f9d239429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.101+0000 7f9d239429c0 20 realm 2024-09-12T00:38:12.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.101+0000 7f9d239429c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.105+0000 7f9d239429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.105+0000 7f9d239429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:12.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.105+0000 7f9d239429c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.105+0000 7f9d239429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.105+0000 7f9d239429c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.105+0000 7f9d239429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:12.102 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.105+0000 7f9d239429c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.105+0000 7f9d239429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:12.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.105+0000 7f9d239429c0 20 searching for the correct realm 2024-09-12T00:38:12.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.109+0000 7f9d20c47640 0 -- 172.21.15.138:0/1756158838 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f9d140e0950 msgr2=0x7f9d140eb430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:12.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.117+0000 7f9d20c47640 0 -- 172.21.15.138:0/1756158838 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55ba6a661440 msgr2=0x55ba6a663830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:12.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:12.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:12.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:12.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:12.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:12.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:12.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:12.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:12.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 20 zone default found 2024-09-12T00:38:12.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 4 Realm: () 2024-09-12T00:38:12.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:12.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:12.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:12.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 20 zonegroup default 2024-09-12T00:38:12.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.125+0000 7f9d239429c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.129+0000 7f9d239429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.129+0000 7f9d239429c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.129+0000 7f9d239429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.129+0000 7f9d239429c0 20 started sync module instance, tier type = 2024-09-12T00:38:12.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.129+0000 7f9d239429c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:12.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.145+0000 7f9d239429c0 20 add_watcher() i=0 2024-09-12T00:38:12.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.145+0000 7f9d239429c0 20 add_watcher() i=1 2024-09-12T00:38:12.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.145+0000 7f9d239429c0 20 add_watcher() i=2 2024-09-12T00:38:12.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.145+0000 7f9d239429c0 20 add_watcher() i=3 2024-09-12T00:38:12.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.145+0000 7f9d239429c0 20 add_watcher() i=4 2024-09-12T00:38:12.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.145+0000 7f9d239429c0 20 add_watcher() i=5 2024-09-12T00:38:12.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.145+0000 7f9d239429c0 20 add_watcher() i=6 2024-09-12T00:38:12.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.149+0000 7f9d239429c0 20 add_watcher() i=7 2024-09-12T00:38:12.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.149+0000 7f9d239429c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:12.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9bd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:12.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:12.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:12.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 5 note: GC not initialized 2024-09-12T00:38:12.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9bd67e4640 20 reqs_thread_entry: start 2024-09-12T00:38:12.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:12.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 20 Filter name: none 2024-09-12T00:38:12.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9b47fff640 20 reqs_thread_entry: start 2024-09-12T00:38:12.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:38:12.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:12.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:38:12.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:38:12.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 : miss 2024-09-12T00:38:12.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:12.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 info.flags=0x17 2024-09-12T00:38:12.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 to cache LRU end 2024-09-12T00:38:12.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:12.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:12.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.153+0000 7f9d239429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 2024-09-12T00:38:12.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.165+0000 7f9d239429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 info.flags=0x17 2024-09-12T00:38:12.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.165+0000 7f9d239429c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 to cache LRU end 2024-09-12T00:38:12.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.165+0000 7f9d239429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:12.161 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.165+0000 7f9d239429c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37, ofs0, ns] 2024-09-12T00:38:12.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.165+0000 7f9c04ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333559 cookie 94259137385600 notifier 7415 bl.length()=931 2024-09-12T00:38:12.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.165+0000 7f9c04ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 info.flags=0x17 2024-09-12T00:38:12.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.165+0000 7f9c04ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 to cache LRU end 2024-09-12T00:38:12.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.165+0000 7f9c04ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:12.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.165+0000 7f9d239429c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): orig_sources= new_sources= 2024-09-12T00:38:12.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.165+0000 7f9d239429c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): potential sources added=[] removed=[] 2024-09-12T00:38:12.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.165+0000 7f9d239429c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): orig_dests= new_dests= 2024-09-12T00:38:12.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.165+0000 7f9d239429c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): potential dests added=[] removed=[] 2024-09-12T00:38:12.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.0 2024-09-12T00:38:12.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.0 2024-09-12T00:38:12.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.1 2024-09-12T00:38:12.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.1 2024-09-12T00:38:12.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.2 2024-09-12T00:38:12.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.2 2024-09-12T00:38:12.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.3 2024-09-12T00:38:12.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.3 2024-09-12T00:38:12.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.4 2024-09-12T00:38:12.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.4 2024-09-12T00:38:12.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.5 2024-09-12T00:38:12.172 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.5 2024-09-12T00:38:12.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.6 2024-09-12T00:38:12.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.6 2024-09-12T00:38:12.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.7 2024-09-12T00:38:12.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.7 2024-09-12T00:38:12.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.8 2024-09-12T00:38:12.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.8 2024-09-12T00:38:12.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.9 2024-09-12T00:38:12.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.9 2024-09-12T00:38:12.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.10 2024-09-12T00:38:12.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.10 2024-09-12T00:38:12.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.11 2024-09-12T00:38:12.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1.11 2024-09-12T00:38:12.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.173+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.0 2024-09-12T00:38:12.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.177+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1 2024-09-12T00:38:12.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.177+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.2 2024-09-12T00:38:12.174 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.177+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.3 2024-09-12T00:38:12.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.177+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.4 2024-09-12T00:38:12.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.177+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.5 2024-09-12T00:38:12.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.177+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.6 2024-09-12T00:38:12.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.181+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.7 2024-09-12T00:38:12.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.181+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.8 2024-09-12T00:38:12.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.181+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.9 2024-09-12T00:38:12.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.181+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.10 2024-09-12T00:38:12.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.189+0000 7f9d239429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:12.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.189+0000 7f9d239429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 2024-09-12T00:38:12.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.193+0000 7f9d239429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 info.flags=0x17 2024-09-12T00:38:12.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.193+0000 7f9d239429c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 to cache LRU end 2024-09-12T00:38:12.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.193+0000 7f9d239429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:12.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.193+0000 7f9d239429c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37, ofs0, ns] 2024-09-12T00:38:12.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.193+0000 7f9c04ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333560 cookie 94259137385600 notifier 7415 bl.length()=931 2024-09-12T00:38:12.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.193+0000 7f9c04ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 info.flags=0x17 2024-09-12T00:38:12.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.193+0000 7f9c04ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 to cache LRU end 2024-09-12T00:38:12.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.193+0000 7f9c04ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:12.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.193+0000 7f9d239429c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): orig_sources= new_sources= 2024-09-12T00:38:12.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.193+0000 7f9d239429c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): potential sources added=[] removed=[] 2024-09-12T00:38:12.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.193+0000 7f9d239429c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): orig_dests= new_dests= 2024-09-12T00:38:12.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.193+0000 7f9d239429c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): potential dests added=[] removed=[] 2024-09-12T00:38:12.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.197+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.0 2024-09-12T00:38:12.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.197+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.1 2024-09-12T00:38:12.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.197+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.2 2024-09-12T00:38:12.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.197+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.3 2024-09-12T00:38:12.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.201+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.4 2024-09-12T00:38:12.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.201+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.5 2024-09-12T00:38:12.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.201+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.6 2024-09-12T00:38:12.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.201+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.7 2024-09-12T00:38:12.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.201+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.8 2024-09-12T00:38:12.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.201+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.9 2024-09-12T00:38:12.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.201+0000 7f9d239429c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.37.10 2024-09-12T00:38:12.200 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.205+0000 7f9d239429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:12.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.205+0000 7f9d239429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 2024-09-12T00:38:12.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.205+0000 7f9d239429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 info.flags=0x17 2024-09-12T00:38:12.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.205+0000 7f9d239429c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 to cache LRU end 2024-09-12T00:38:12.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.205+0000 7f9d239429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:12.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.205+0000 7f9d239429c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37, ofs0, ns] 2024-09-12T00:38:12.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.205+0000 7f9bf3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333561 cookie 94259137385600 notifier 7415 bl.length()=899 2024-09-12T00:38:12.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.205+0000 7f9bf3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 info.flags=0x17 2024-09-12T00:38:12.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.205+0000 7f9bf3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.37 to cache LRU end 2024-09-12T00:38:12.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.205+0000 7f9bf3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:12.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.205+0000 7f9d239429c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): orig_sources= new_sources= 2024-09-12T00:38:12.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.205+0000 7f9d239429c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): potential sources added=[] removed=[] 2024-09-12T00:38:12.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.205+0000 7f9d239429c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): orig_dests= new_dests= 2024-09-12T00:38:12.204 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.205+0000 7f9d239429c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.37]): potential dests added=[] removed=[] 2024-09-12T00:38:12.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.209+0000 7f9d239429c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:38:12.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.213+0000 7f9bd77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:12.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.217+0000 7f9d239429c0 20 remove_watcher() i=0 2024-09-12T00:38:12.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.217+0000 7f9d239429c0 2 removed watcher, disabling cache 2024-09-12T00:38:12.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.217+0000 7f9d239429c0 20 remove_watcher() i=1 2024-09-12T00:38:12.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.221+0000 7f9d239429c0 20 remove_watcher() i=2 2024-09-12T00:38:12.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.221+0000 7f9d239429c0 20 remove_watcher() i=3 2024-09-12T00:38:12.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.225+0000 7f9d239429c0 20 remove_watcher() i=4 2024-09-12T00:38:12.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.225+0000 7f9d239429c0 20 remove_watcher() i=5 2024-09-12T00:38:12.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.229+0000 7f9d239429c0 20 remove_watcher() i=6 2024-09-12T00:38:12.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.233+0000 7f9d239429c0 20 remove_watcher() i=7 2024-09-12T00:38:12.244 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:38:12.270 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:12.270 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:12.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.313+0000 7f7e741ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.317+0000 7f7e741ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.317+0000 7f7e741ef9c0 20 realm 2024-09-12T00:38:12.315 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.317+0000 7f7e741ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.317+0000 7f7e741ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.317+0000 7f7e741ef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:12.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.317+0000 7f7e741ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.317+0000 7f7e741ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.317+0000 7f7e741ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.321+0000 7f7e741ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:12.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.321+0000 7f7e741ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.321+0000 7f7e741ef9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:12.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.321+0000 7f7e741ef9c0 20 searching for the correct realm 2024-09-12T00:38:12.322 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.325+0000 7f7e714f4640 0 -- 172.21.15.138:0/557883067 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f7e640e8040 msgr2=0x7f7e640cf410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:12.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.329+0000 7f7e71cf5640 0 -- 172.21.15.138:0/557883067 >> [v2:172.21.15.178:6811/2062234204,v1:172.21.15.178:6813/2062234204] conn(0x7f7e640c2040 msgr2=0x7f7e6410c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:12.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.549+0000 7f7e741ef9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:12.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.549+0000 7f7e741ef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:12.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.549+0000 7f7e741ef9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:12.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.549+0000 7f7e741ef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:12.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.549+0000 7f7e741ef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:12.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.549+0000 7f7e741ef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:12.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.549+0000 7f7e741ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.549+0000 7f7e741ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.549+0000 7f7e741ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.549+0000 7f7e741ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:12.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.549+0000 7f7e741ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.553+0000 7f7e741ef9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:12.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.553+0000 7f7e741ef9c0 20 zone default found 2024-09-12T00:38:12.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.553+0000 7f7e741ef9c0 4 Realm: () 2024-09-12T00:38:12.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.553+0000 7f7e741ef9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:12.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.553+0000 7f7e741ef9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:12.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.553+0000 7f7e741ef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:12.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.553+0000 7f7e741ef9c0 20 zonegroup default 2024-09-12T00:38:12.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.553+0000 7f7e741ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.553+0000 7f7e741ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.553+0000 7f7e741ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.553+0000 7f7e741ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.553+0000 7f7e741ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.553+0000 7f7e741ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:12.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.553+0000 7f7e741ef9c0 20 started sync module instance, tier type = 2024-09-12T00:38:12.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.553+0000 7f7e741ef9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:12.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.577+0000 7f7e741ef9c0 20 add_watcher() i=0 2024-09-12T00:38:12.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.577+0000 7f7e741ef9c0 20 add_watcher() i=1 2024-09-12T00:38:12.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.577+0000 7f7e741ef9c0 20 add_watcher() i=2 2024-09-12T00:38:12.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.577+0000 7f7e741ef9c0 20 add_watcher() i=3 2024-09-12T00:38:12.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.577+0000 7f7e741ef9c0 20 add_watcher() i=4 2024-09-12T00:38:12.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.577+0000 7f7e741ef9c0 20 add_watcher() i=5 2024-09-12T00:38:12.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.577+0000 7f7e741ef9c0 20 add_watcher() i=6 2024-09-12T00:38:12.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.581+0000 7f7e741ef9c0 20 add_watcher() i=7 2024-09-12T00:38:12.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.581+0000 7f7e741ef9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:12.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.585+0000 7f7d237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:12.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.585+0000 7f7e741ef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:12.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.585+0000 7f7e741ef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:12.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.585+0000 7f7e741ef9c0 5 note: GC not initialized 2024-09-12T00:38:12.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.585+0000 7f7d227fc640 20 reqs_thread_entry: start 2024-09-12T00:38:12.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.585+0000 7f7e741ef9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:12.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.585+0000 7f7e741ef9c0 20 Filter name: none 2024-09-12T00:38:12.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.585+0000 7f7c93fff640 20 reqs_thread_entry: start 2024-09-12T00:38:12.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.585+0000 7f7e741ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.585+0000 7f7e741ef9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:12.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.585+0000 7f7e741ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.589+0000 7f7e741ef9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:12.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.589+0000 7f7e741ef9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:12.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.589+0000 7f7e741ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.589+0000 7f7e741ef9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:12.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.589+0000 7f7e741ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:12.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.589+0000 7f7e741ef9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:12.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.589+0000 7f7e741ef9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:12.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.593+0000 7f7d237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:12.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.597+0000 7f7e741ef9c0 20 remove_watcher() i=0 2024-09-12T00:38:12.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.597+0000 7f7e741ef9c0 2 removed watcher, disabling cache 2024-09-12T00:38:12.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.601+0000 7f7e741ef9c0 20 remove_watcher() i=1 2024-09-12T00:38:12.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.601+0000 7f7e741ef9c0 20 remove_watcher() i=2 2024-09-12T00:38:12.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.605+0000 7f7e741ef9c0 20 remove_watcher() i=3 2024-09-12T00:38:12.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.605+0000 7f7e741ef9c0 20 remove_watcher() i=4 2024-09-12T00:38:12.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.609+0000 7f7e741ef9c0 20 remove_watcher() i=5 2024-09-12T00:38:12.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.609+0000 7f7e741ef9c0 20 remove_watcher() i=6 2024-09-12T00:38:12.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:12.613+0000 7f7e741ef9c0 20 remove_watcher() i=7 2024-09-12T00:38:12.631 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:12.631 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:38:12.631 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-change-reshard-state id: e2043445-c131-4520-984d-b4d52f038a6b.4538.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:38:12.631 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:12.633 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.634 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:12.639 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.639 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:12.692 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.692 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:12.745 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T00:38:12.745 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:12.746 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.746 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:12.769 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.769 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:12.816 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.816 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:12.836 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.837 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:12.857 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.857 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:12.876 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.876 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:12.899 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.899 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:12.919 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.919 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:12.939 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.939 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:12.959 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.960 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:12.980 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.980 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:12.998 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:12.998 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:13.019 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:13.019 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:13.040 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:13.040 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:13.063 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:13.064 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:13.087 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:13.087 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:13.108 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:13.108 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:13.128 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:13.128 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:13.149 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:13.149 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:13.170 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:13.170 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:13.188 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:13.188 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:13.209 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:13.209 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:13.227 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:38:13.259 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:13.259 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:13.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.305+0000 7f36356409c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.309+0000 7f36356409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.309+0000 7f36356409c0 20 realm 2024-09-12T00:38:13.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.309+0000 7f36356409c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.309+0000 7f36356409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.309+0000 7f36356409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:13.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.309+0000 7f36356409c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.309+0000 7f36356409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.309+0000 7f36356409c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.309+0000 7f36356409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:13.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.309+0000 7f36356409c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.309+0000 7f36356409c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:13.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.309+0000 7f36356409c0 20 searching for the correct realm 2024-09-12T00:38:13.313 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.317+0000 7f3633947640 0 -- 172.21.15.138:0/3695914625 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f362c106410 msgr2=0x7f362c0fdfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:13.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.533+0000 7f3633947640 0 -- 172.21.15.138:0/3695914625 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55f2abe47640 msgr2=0x55f2abe49ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:13.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.541+0000 7f36356409c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:13.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.541+0000 7f36356409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:13.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.541+0000 7f36356409c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:13.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.541+0000 7f36356409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:13.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.541+0000 7f36356409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:13.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.541+0000 7f36356409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:13.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.541+0000 7f36356409c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.545+0000 7f36356409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.545+0000 7f36356409c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.545+0000 7f36356409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:13.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.545+0000 7f36356409c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.545+0000 7f36356409c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:13.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.545+0000 7f36356409c0 20 zone default found 2024-09-12T00:38:13.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.545+0000 7f36356409c0 4 Realm: () 2024-09-12T00:38:13.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.545+0000 7f36356409c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:13.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.545+0000 7f36356409c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:13.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.545+0000 7f36356409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:13.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.545+0000 7f36356409c0 20 zonegroup default 2024-09-12T00:38:13.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.545+0000 7f36356409c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.545+0000 7f36356409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.545+0000 7f36356409c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.545+0000 7f36356409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.545+0000 7f36356409c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.549+0000 7f36356409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.549+0000 7f36356409c0 20 started sync module instance, tier type = 2024-09-12T00:38:13.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.549+0000 7f36356409c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:13.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.569+0000 7f36356409c0 20 add_watcher() i=0 2024-09-12T00:38:13.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.569+0000 7f36356409c0 20 add_watcher() i=1 2024-09-12T00:38:13.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.569+0000 7f36356409c0 20 add_watcher() i=2 2024-09-12T00:38:13.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.569+0000 7f36356409c0 20 add_watcher() i=3 2024-09-12T00:38:13.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.569+0000 7f36356409c0 20 add_watcher() i=4 2024-09-12T00:38:13.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.569+0000 7f36356409c0 20 add_watcher() i=5 2024-09-12T00:38:13.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.569+0000 7f36356409c0 20 add_watcher() i=6 2024-09-12T00:38:13.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.573+0000 7f36356409c0 20 add_watcher() i=7 2024-09-12T00:38:13.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.573+0000 7f36356409c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:13.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.577+0000 7f34e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:13.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.577+0000 7f36356409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:13.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.577+0000 7f36356409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:13.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.577+0000 7f36356409c0 5 note: GC not initialized 2024-09-12T00:38:13.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.577+0000 7f34e8fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:13.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.577+0000 7f36356409c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:13.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.577+0000 7f36356409c0 20 Filter name: none 2024-09-12T00:38:13.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.577+0000 7f34627fc640 20 reqs_thread_entry: start 2024-09-12T00:38:13.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.577+0000 7f36356409c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.581+0000 7f36356409c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:13.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.581+0000 7f36356409c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.581+0000 7f36356409c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:13.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.581+0000 7f36356409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:13.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.581+0000 7f36356409c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.581+0000 7f36356409c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:13.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.581+0000 7f36356409c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.585+0000 7f36356409c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:13.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.585+0000 7f36356409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:13.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.589+0000 7f34e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:13.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.593+0000 7f36356409c0 20 remove_watcher() i=0 2024-09-12T00:38:13.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.593+0000 7f36356409c0 2 removed watcher, disabling cache 2024-09-12T00:38:13.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.593+0000 7f36356409c0 20 remove_watcher() i=1 2024-09-12T00:38:13.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.597+0000 7f36356409c0 20 remove_watcher() i=2 2024-09-12T00:38:13.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.597+0000 7f36356409c0 20 remove_watcher() i=3 2024-09-12T00:38:13.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.601+0000 7f36356409c0 20 remove_watcher() i=4 2024-09-12T00:38:13.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.601+0000 7f36356409c0 20 remove_watcher() i=5 2024-09-12T00:38:13.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.605+0000 7f36356409c0 20 remove_watcher() i=6 2024-09-12T00:38:13.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.609+0000 7f36356409c0 20 remove_watcher() i=7 2024-09-12T00:38:13.621 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:13.621 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:38:13.622 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-change-reshard-state id: e2043445-c131-4520-984d-b4d52f038a6b.4538.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:13.622 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:13.622 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T00:38:13.657 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:13.657 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:13.702 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.705+0000 7f9e4a1329c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.705+0000 7f9e4a1329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.705+0000 7f9e4a1329c0 20 realm 2024-09-12T00:38:13.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.705+0000 7f9e4a1329c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.709+0000 7f9e4a1329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.709+0000 7f9e4a1329c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:13.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.709+0000 7f9e4a1329c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.709+0000 7f9e4a1329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.709+0000 7f9e4a1329c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.709+0000 7f9e4a1329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:13.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.709+0000 7f9e4a1329c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.709+0000 7f9e4a1329c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:13.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.709+0000 7f9e4a1329c0 20 searching for the correct realm 2024-09-12T00:38:13.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.713+0000 7f9e47437640 0 -- 172.21.15.138:0/3729140473 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f9e38107300 msgr2=0x7f9e3812a980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:13.925 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.929+0000 7f9e47437640 0 -- 172.21.15.138:0/3729140473 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55b02ceebb40 msgr2=0x55b02ceedf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:13.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.941+0000 7f9e4a1329c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:13.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.941+0000 7f9e4a1329c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:13.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.941+0000 7f9e4a1329c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:13.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.941+0000 7f9e4a1329c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:13.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.941+0000 7f9e4a1329c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:13.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.941+0000 7f9e4a1329c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:13.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.941+0000 7f9e4a1329c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.941+0000 7f9e4a1329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.941+0000 7f9e4a1329c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.945+0000 7f9e4a1329c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:13.941 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.945+0000 7f9e4a1329c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.945+0000 7f9e4a1329c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:13.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.945+0000 7f9e4a1329c0 20 zone default found 2024-09-12T00:38:13.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.945+0000 7f9e4a1329c0 4 Realm: () 2024-09-12T00:38:13.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.945+0000 7f9e4a1329c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:13.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.945+0000 7f9e4a1329c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:13.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.945+0000 7f9e4a1329c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:13.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.945+0000 7f9e4a1329c0 20 zonegroup default 2024-09-12T00:38:13.943 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.945+0000 7f9e4a1329c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.945+0000 7f9e4a1329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.945+0000 7f9e4a1329c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.945+0000 7f9e4a1329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.944 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.945+0000 7f9e4a1329c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.949+0000 7f9e4a1329c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:13.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.949+0000 7f9e4a1329c0 20 started sync module instance, tier type = 2024-09-12T00:38:13.945 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.949+0000 7f9e4a1329c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:13.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.969+0000 7f9e4a1329c0 20 add_watcher() i=0 2024-09-12T00:38:13.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.969+0000 7f9e4a1329c0 20 add_watcher() i=1 2024-09-12T00:38:13.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.969+0000 7f9e4a1329c0 20 add_watcher() i=2 2024-09-12T00:38:13.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.969+0000 7f9e4a1329c0 20 add_watcher() i=3 2024-09-12T00:38:13.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.969+0000 7f9e4a1329c0 20 add_watcher() i=4 2024-09-12T00:38:13.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.969+0000 7f9e4a1329c0 20 add_watcher() i=5 2024-09-12T00:38:13.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.969+0000 7f9e4a1329c0 20 add_watcher() i=6 2024-09-12T00:38:13.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.973+0000 7f9e4a1329c0 20 add_watcher() i=7 2024-09-12T00:38:13.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.973+0000 7f9e4a1329c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:13.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.977+0000 7f9cfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:13.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.977+0000 7f9e4a1329c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:13.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.977+0000 7f9e4a1329c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:13.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.977+0000 7f9e4a1329c0 5 note: GC not initialized 2024-09-12T00:38:13.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.977+0000 7f9cfcfe1640 20 reqs_thread_entry: start 2024-09-12T00:38:13.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.981+0000 7f9e4a1329c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:13.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.981+0000 7f9e4a1329c0 20 Filter name: none 2024-09-12T00:38:13.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.981+0000 7f9c767fc640 20 reqs_thread_entry: start 2024-09-12T00:38:13.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.981+0000 7f9e4a1329c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:38:13.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.981+0000 7f9e4a1329c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.981+0000 7f9e4a1329c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:13.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.981+0000 7f9e4a1329c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:38:13.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.981+0000 7f9e4a1329c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:38:13.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.981+0000 7f9e4a1329c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 : miss 2024-09-12T00:38:13.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.981+0000 7f9e4a1329c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:13.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.981+0000 7f9e4a1329c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:13.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.981+0000 7f9e4a1329c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 info.flags=0x17 2024-09-12T00:38:13.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.981+0000 7f9e4a1329c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 to cache LRU end 2024-09-12T00:38:13.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.981+0000 7f9e4a1329c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:13.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.981+0000 7f9e4a1329c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:13.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.981+0000 7f9e4a1329c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 2024-09-12T00:38:13.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.993+0000 7f9e4a1329c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 info.flags=0x17 2024-09-12T00:38:13.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.993+0000 7f9e4a1329c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 to cache LRU end 2024-09-12T00:38:13.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.993+0000 7f9e4a1329c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:13.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.993+0000 7f9e4a1329c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38, ofs0, ns] 2024-09-12T00:38:13.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.993+0000 7f9d267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333566 cookie 94215156480064 notifier 7469 bl.length()=931 2024-09-12T00:38:13.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.993+0000 7f9d267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 info.flags=0x17 2024-09-12T00:38:13.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.993+0000 7f9d267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 to cache LRU end 2024-09-12T00:38:13.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.993+0000 7f9d267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:13.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.993+0000 7f9e4a1329c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.38]): orig_sources= new_sources= 2024-09-12T00:38:13.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.993+0000 7f9e4a1329c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.38]): potential sources added=[] removed=[] 2024-09-12T00:38:13.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.993+0000 7f9e4a1329c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.38]): orig_dests= new_dests= 2024-09-12T00:38:13.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:13.993+0000 7f9e4a1329c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.38]): potential dests added=[] removed=[] 2024-09-12T00:38:14.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.0 2024-09-12T00:38:14.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.0 2024-09-12T00:38:14.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.1 2024-09-12T00:38:14.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.1 2024-09-12T00:38:14.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.2 2024-09-12T00:38:14.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.2 2024-09-12T00:38:14.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.3 2024-09-12T00:38:14.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.3 2024-09-12T00:38:14.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.4 2024-09-12T00:38:14.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.4 2024-09-12T00:38:14.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.5 2024-09-12T00:38:14.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.5 2024-09-12T00:38:14.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.6 2024-09-12T00:38:14.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.6 2024-09-12T00:38:14.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.7 2024-09-12T00:38:14.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.7 2024-09-12T00:38:14.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.8 2024-09-12T00:38:14.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.8 2024-09-12T00:38:14.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.9 2024-09-12T00:38:14.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.9 2024-09-12T00:38:14.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.10 2024-09-12T00:38:14.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.10 2024-09-12T00:38:14.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.11 2024-09-12T00:38:14.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1.11 2024-09-12T00:38:14.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.0 2024-09-12T00:38:14.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1 2024-09-12T00:38:14.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.009+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.2 2024-09-12T00:38:14.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.013+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.3 2024-09-12T00:38:14.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.013+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.4 2024-09-12T00:38:14.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.013+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.5 2024-09-12T00:38:14.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.017+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.6 2024-09-12T00:38:14.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.017+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.7 2024-09-12T00:38:14.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.017+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.8 2024-09-12T00:38:14.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.021+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.9 2024-09-12T00:38:14.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.021+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.10 2024-09-12T00:38:14.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.029+0000 7f9e4a1329c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T00:38:14.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.029+0000 7f9e4a1329c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:14.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.029+0000 7f9e4a1329c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 2024-09-12T00:38:14.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.033+0000 7f9e4a1329c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 info.flags=0x17 2024-09-12T00:38:14.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.033+0000 7f9e4a1329c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 to cache LRU end 2024-09-12T00:38:14.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.033+0000 7f9e4a1329c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:14.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.033+0000 7f9e4a1329c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38, ofs0, ns] 2024-09-12T00:38:14.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.033+0000 7f9d26ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333567 cookie 94215156480064 notifier 7469 bl.length()=931 2024-09-12T00:38:14.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.033+0000 7f9d26ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 info.flags=0x17 2024-09-12T00:38:14.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.033+0000 7f9d26ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 to cache LRU end 2024-09-12T00:38:14.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.033+0000 7f9d26ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:14.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.033+0000 7f9e4a1329c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.38]): orig_sources= new_sources= 2024-09-12T00:38:14.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.033+0000 7f9e4a1329c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.38]): potential sources added=[] removed=[] 2024-09-12T00:38:14.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.033+0000 7f9e4a1329c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.38]): orig_dests= new_dests= 2024-09-12T00:38:14.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.033+0000 7f9e4a1329c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.38]): potential dests added=[] removed=[] 2024-09-12T00:38:14.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.045+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.0 2024-09-12T00:38:14.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.045+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.1 2024-09-12T00:38:14.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.045+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.2 2024-09-12T00:38:14.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.045+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.3 2024-09-12T00:38:14.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.049+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.4 2024-09-12T00:38:14.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.049+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.5 2024-09-12T00:38:14.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.049+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.6 2024-09-12T00:38:14.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.049+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.7 2024-09-12T00:38:14.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.049+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.8 2024-09-12T00:38:14.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.053+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.9 2024-09-12T00:38:14.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.053+0000 7f9e4a1329c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.38.10 2024-09-12T00:38:14.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.053+0000 7f9e4a1329c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:14.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.053+0000 7f9e4a1329c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 2024-09-12T00:38:14.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.057+0000 7f9e4a1329c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 info.flags=0x17 2024-09-12T00:38:14.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.057+0000 7f9e4a1329c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 to cache LRU end 2024-09-12T00:38:14.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.057+0000 7f9e4a1329c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:14.054 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.057+0000 7f9e4a1329c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38, ofs0, ns] 2024-09-12T00:38:14.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.057+0000 7f9d267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333568 cookie 94215156480064 notifier 7469 bl.length()=899 2024-09-12T00:38:14.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.057+0000 7f9d267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 info.flags=0x17 2024-09-12T00:38:14.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.057+0000 7f9d267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.38 to cache LRU end 2024-09-12T00:38:14.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.057+0000 7f9d267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:14.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.057+0000 7f9e4a1329c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.38]): orig_sources= new_sources= 2024-09-12T00:38:14.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.057+0000 7f9e4a1329c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.38]): potential sources added=[] removed=[] 2024-09-12T00:38:14.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.057+0000 7f9e4a1329c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.38]): orig_dests= new_dests= 2024-09-12T00:38:14.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.057+0000 7f9e4a1329c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.38]): potential dests added=[] removed=[] 2024-09-12T00:38:14.063 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.065+0000 7f9e4a1329c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:38:14.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.069+0000 7f9cfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:14.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.073+0000 7f9e4a1329c0 20 remove_watcher() i=0 2024-09-12T00:38:14.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.073+0000 7f9e4a1329c0 2 removed watcher, disabling cache 2024-09-12T00:38:14.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.077+0000 7f9e4a1329c0 20 remove_watcher() i=1 2024-09-12T00:38:14.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.081+0000 7f9e4a1329c0 20 remove_watcher() i=2 2024-09-12T00:38:14.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.081+0000 7f9e4a1329c0 20 remove_watcher() i=3 2024-09-12T00:38:14.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.085+0000 7f9e4a1329c0 20 remove_watcher() i=4 2024-09-12T00:38:14.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.085+0000 7f9e4a1329c0 20 remove_watcher() i=5 2024-09-12T00:38:14.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.089+0000 7f9e4a1329c0 20 remove_watcher() i=6 2024-09-12T00:38:14.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.093+0000 7f9e4a1329c0 20 remove_watcher() i=7 2024-09-12T00:38:14.107 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:38:14.138 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:14.138 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:14.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.185+0000 7f043ef6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:14.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.185+0000 7f043ef6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:14.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.185+0000 7f043ef6d9c0 20 realm 2024-09-12T00:38:14.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.185+0000 7f043ef6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:14.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.185+0000 7f043ef6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:14.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.185+0000 7f043ef6d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:14.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.185+0000 7f043ef6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:14.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.185+0000 7f043ef6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:14.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.185+0000 7f043ef6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:14.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.189+0000 7f043ef6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:14.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.189+0000 7f043ef6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:14.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.189+0000 7f043ef6d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:14.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.189+0000 7f043ef6d9c0 20 searching for the correct realm 2024-09-12T00:38:14.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.193+0000 7f043d274640 0 -- 172.21.15.138:0/1565806134 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f0434103ac0 msgr2=0x7f04340ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:14.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.409+0000 7f043d274640 0 -- 172.21.15.138:0/1565806134 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55e79b69dcc0 msgr2=0x55e79b6a0180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:14.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.417+0000 7f043ef6d9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:14.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.417+0000 7f043ef6d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:14.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.417+0000 7f043ef6d9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:14.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.417+0000 7f043ef6d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:14.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.417+0000 7f043ef6d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:14.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.417+0000 7f043ef6d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:14.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.417+0000 7f043ef6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:14.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.421+0000 7f043ef6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:14.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.421+0000 7f043ef6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:14.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.421+0000 7f043ef6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:14.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.421+0000 7f043ef6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:14.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.421+0000 7f043ef6d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:14.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.421+0000 7f043ef6d9c0 20 zone default found 2024-09-12T00:38:14.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.421+0000 7f043ef6d9c0 4 Realm: () 2024-09-12T00:38:14.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.421+0000 7f043ef6d9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:14.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.421+0000 7f043ef6d9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:14.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.421+0000 7f043ef6d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:14.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.421+0000 7f043ef6d9c0 20 zonegroup default 2024-09-12T00:38:14.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.421+0000 7f043ef6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:14.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.421+0000 7f043ef6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:14.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.421+0000 7f043ef6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:14.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.425+0000 7f043ef6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:14.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.425+0000 7f043ef6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:14.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.425+0000 7f043ef6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:14.422 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.425+0000 7f043ef6d9c0 20 started sync module instance, tier type = 2024-09-12T00:38:14.423 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.425+0000 7f043ef6d9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:14.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.445+0000 7f043ef6d9c0 20 add_watcher() i=0 2024-09-12T00:38:14.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.445+0000 7f043ef6d9c0 20 add_watcher() i=1 2024-09-12T00:38:14.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.445+0000 7f043ef6d9c0 20 add_watcher() i=2 2024-09-12T00:38:14.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.445+0000 7f043ef6d9c0 20 add_watcher() i=3 2024-09-12T00:38:14.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.445+0000 7f043ef6d9c0 20 add_watcher() i=4 2024-09-12T00:38:14.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.445+0000 7f043ef6d9c0 20 add_watcher() i=5 2024-09-12T00:38:14.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.449+0000 7f043ef6d9c0 20 add_watcher() i=6 2024-09-12T00:38:14.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.449+0000 7f043ef6d9c0 20 add_watcher() i=7 2024-09-12T00:38:14.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.449+0000 7f043ef6d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:14.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.453+0000 7f02f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:14.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.453+0000 7f043ef6d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:14.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.453+0000 7f043ef6d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:14.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.453+0000 7f043ef6d9c0 5 note: GC not initialized 2024-09-12T00:38:14.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.453+0000 7f02f1fe3640 20 reqs_thread_entry: start 2024-09-12T00:38:14.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.453+0000 7f043ef6d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:14.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.457+0000 7f043ef6d9c0 20 Filter name: none 2024-09-12T00:38:14.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.457+0000 7f02637fe640 20 reqs_thread_entry: start 2024-09-12T00:38:14.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.457+0000 7f043ef6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:14.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.457+0000 7f043ef6d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:14.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.457+0000 7f043ef6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:14.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.457+0000 7f043ef6d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:14.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.457+0000 7f043ef6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:14.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.457+0000 7f043ef6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:14.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.457+0000 7f043ef6d9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:14.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.457+0000 7f043ef6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:14.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.461+0000 7f043ef6d9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:14.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.461+0000 7f043ef6d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:14.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.465+0000 7f02f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:14.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.469+0000 7f043ef6d9c0 20 remove_watcher() i=0 2024-09-12T00:38:14.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.469+0000 7f043ef6d9c0 2 removed watcher, disabling cache 2024-09-12T00:38:14.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.469+0000 7f043ef6d9c0 20 remove_watcher() i=1 2024-09-12T00:38:14.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.473+0000 7f043ef6d9c0 20 remove_watcher() i=2 2024-09-12T00:38:14.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.477+0000 7f043ef6d9c0 20 remove_watcher() i=3 2024-09-12T00:38:14.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.477+0000 7f043ef6d9c0 20 remove_watcher() i=4 2024-09-12T00:38:14.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.481+0000 7f043ef6d9c0 20 remove_watcher() i=5 2024-09-12T00:38:14.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.481+0000 7f043ef6d9c0 20 remove_watcher() i=6 2024-09-12T00:38:14.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:14.485+0000 7f043ef6d9c0 20 remove_watcher() i=7 2024-09-12T00:38:14.504 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:14.504 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:38:14.504 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: error-at-change-reshard-state id: e2043445-c131-4520-984d-b4d52f038a6b.4538.38 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:38:14.504 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:14.505 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.506 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.509 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.509 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.560 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.560 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.610 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T00:38:14.610 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:14.611 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.611 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.633 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.633 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.680 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.680 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.701 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.701 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.722 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.722 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.743 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.743 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.764 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.764 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.786 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.786 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.806 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.806 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.829 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.829 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.850 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.850 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.872 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.872 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.893 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.893 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.913 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.913 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.936 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.936 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.957 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.957 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:14.979 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:14.979 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:15.000 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:15.000 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:15.022 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:15.022 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:15.043 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:15.044 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:15.065 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:15.065 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:15.088 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:15.088 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:15.107 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:38:15.138 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:15.138 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:15.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.185+0000 7f3bee35e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.189+0000 7f3bee35e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.189+0000 7f3bee35e9c0 20 realm 2024-09-12T00:38:15.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.189+0000 7f3bee35e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.189+0000 7f3bee35e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.189+0000 7f3bee35e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:15.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.189+0000 7f3bee35e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.189+0000 7f3bee35e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.189+0000 7f3bee35e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.189+0000 7f3bee35e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:15.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.189+0000 7f3bee35e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.189+0000 7f3bee35e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:15.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.189+0000 7f3bee35e9c0 20 searching for the correct realm 2024-09-12T00:38:15.192 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.193+0000 7f3bec665640 0 -- 172.21.15.138:0/3164584339 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f3be40ab3e0 msgr2=0x7f3be40ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:15.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.409+0000 7f3bec665640 0 -- 172.21.15.138:0/3164584339 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55b951e05f70 msgr2=0x55b951e08430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:15.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.417+0000 7f3bee35e9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:15.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.417+0000 7f3bee35e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:15.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.417+0000 7f3bee35e9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:15.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.417+0000 7f3bee35e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:15.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.417+0000 7f3bee35e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:15.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.417+0000 7f3bee35e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:15.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.417+0000 7f3bee35e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.417+0000 7f3bee35e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.417+0000 7f3bee35e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.421+0000 7f3bee35e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:15.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.421+0000 7f3bee35e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.421+0000 7f3bee35e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:15.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.421+0000 7f3bee35e9c0 20 zone default found 2024-09-12T00:38:15.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.421+0000 7f3bee35e9c0 4 Realm: () 2024-09-12T00:38:15.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.421+0000 7f3bee35e9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:15.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.421+0000 7f3bee35e9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:15.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.421+0000 7f3bee35e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:15.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.421+0000 7f3bee35e9c0 20 zonegroup default 2024-09-12T00:38:15.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.421+0000 7f3bee35e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.421+0000 7f3bee35e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.421+0000 7f3bee35e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.421+0000 7f3bee35e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.421+0000 7f3bee35e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.421+0000 7f3bee35e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.421+0000 7f3bee35e9c0 20 started sync module instance, tier type = 2024-09-12T00:38:15.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.421+0000 7f3bee35e9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:15.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.445+0000 7f3bee35e9c0 20 add_watcher() i=0 2024-09-12T00:38:15.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.445+0000 7f3bee35e9c0 20 add_watcher() i=1 2024-09-12T00:38:15.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.445+0000 7f3bee35e9c0 20 add_watcher() i=2 2024-09-12T00:38:15.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.445+0000 7f3bee35e9c0 20 add_watcher() i=3 2024-09-12T00:38:15.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.445+0000 7f3bee35e9c0 20 add_watcher() i=4 2024-09-12T00:38:15.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.445+0000 7f3bee35e9c0 20 add_watcher() i=5 2024-09-12T00:38:15.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.445+0000 7f3bee35e9c0 20 add_watcher() i=6 2024-09-12T00:38:15.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.445+0000 7f3bee35e9c0 20 add_watcher() i=7 2024-09-12T00:38:15.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.445+0000 7f3bee35e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:15.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.453+0000 7f3aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:15.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.453+0000 7f3bee35e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:15.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.453+0000 7f3bee35e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:15.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.453+0000 7f3bee35e9c0 5 note: GC not initialized 2024-09-12T00:38:15.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.453+0000 7f3aa0fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:15.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.453+0000 7f3bee35e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:15.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.453+0000 7f3bee35e9c0 20 Filter name: none 2024-09-12T00:38:15.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.453+0000 7f3a1a7fc640 20 reqs_thread_entry: start 2024-09-12T00:38:15.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.453+0000 7f3bee35e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.453+0000 7f3bee35e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:15.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.453+0000 7f3bee35e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.457+0000 7f3bee35e9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:15.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.457+0000 7f3bee35e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:15.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.457+0000 7f3bee35e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.457+0000 7f3bee35e9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:15.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.457+0000 7f3bee35e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.457+0000 7f3bee35e9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:15.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.457+0000 7f3bee35e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:15.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.461+0000 7f3aa1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:15.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.465+0000 7f3bee35e9c0 20 remove_watcher() i=0 2024-09-12T00:38:15.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.465+0000 7f3bee35e9c0 2 removed watcher, disabling cache 2024-09-12T00:38:15.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.469+0000 7f3bee35e9c0 20 remove_watcher() i=1 2024-09-12T00:38:15.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.469+0000 7f3bee35e9c0 20 remove_watcher() i=2 2024-09-12T00:38:15.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.473+0000 7f3bee35e9c0 20 remove_watcher() i=3 2024-09-12T00:38:15.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.473+0000 7f3bee35e9c0 20 remove_watcher() i=4 2024-09-12T00:38:15.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.477+0000 7f3bee35e9c0 20 remove_watcher() i=5 2024-09-12T00:38:15.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.477+0000 7f3bee35e9c0 20 remove_watcher() i=6 2024-09-12T00:38:15.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.481+0000 7f3bee35e9c0 20 remove_watcher() i=7 2024-09-12T00:38:15.495 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.495 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:38:15.495 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-change-reshard-state id: e2043445-c131-4520-984d-b4d52f038a6b.4538.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:15.495 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.496 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:38:15.529 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:15.529 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:15.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 realm 2024-09-12T00:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:15.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.581+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:15.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.581+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.785+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:15.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.785+0000 7f09ffb4b9c0 20 searching for the correct realm 2024-09-12T00:38:15.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.793+0000 7f09fde52640 0 -- 172.21.15.138:0/1179187352 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55f391726e30 msgr2=0x55f3917292f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:15.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.805+0000 7f09fde52640 0 -- 172.21.15.138:0/1179187352 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x55f39171a660 msgr2=0x55f39171ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:15.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:15.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:15.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:15.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:15.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:15.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:15.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.813 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:15.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.814 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:15.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 zone default found 2024-09-12T00:38:15.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 4 Realm: () 2024-09-12T00:38:15.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:15.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:15.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:15.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 zonegroup default 2024-09-12T00:38:15.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.815 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.821+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.821+0000 7f09ffb4b9c0 20 started sync module instance, tier type = 2024-09-12T00:38:15.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.821+0000 7f09ffb4b9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:15.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=0 2024-09-12T00:38:15.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=1 2024-09-12T00:38:15.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=2 2024-09-12T00:38:15.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=3 2024-09-12T00:38:15.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=4 2024-09-12T00:38:15.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=5 2024-09-12T00:38:15.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=6 2024-09-12T00:38:15.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.845+0000 7f09ffb4b9c0 20 add_watcher() i=7 2024-09-12T00:38:15.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.845+0000 7f09ffb4b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:15.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.849+0000 7f08b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:15.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:15.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:15.848 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 note: GC not initialized 2024-09-12T00:38:15.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.853+0000 7f08b27e4640 20 reqs_thread_entry: start 2024-09-12T00:38:15.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:15.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 Filter name: none 2024-09-12T00:38:15.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.853+0000 7f0823fff640 20 reqs_thread_entry: start 2024-09-12T00:38:15.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:38:15.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:15.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:38:15.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:38:15.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 : miss 2024-09-12T00:38:15.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:15.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 info.flags=0x17 2024-09-12T00:38:15.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to cache LRU end 2024-09-12T00:38:15.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:15.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:15.852 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 2024-09-12T00:38:15.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 info.flags=0x17 2024-09-12T00:38:15.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to cache LRU end 2024-09-12T00:38:15.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:15.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39, ofs0, ns] 2024-09-12T00:38:15.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.865+0000 7f08e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333476 cookie 94504605564144 notifier 7517 bl.length()=931 2024-09-12T00:38:15.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.865+0000 7f08e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 info.flags=0x17 2024-09-12T00:38:15.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.865+0000 7f08e0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to cache LRU end 2024-09-12T00:38:15.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.865+0000 7f08e0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:15.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): orig_sources= new_sources= 2024-09-12T00:38:15.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): potential sources added=[] removed=[] 2024-09-12T00:38:15.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): orig_dests= new_dests= 2024-09-12T00:38:15.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): potential dests added=[] removed=[] 2024-09-12T00:38:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.0 2024-09-12T00:38:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.0 2024-09-12T00:38:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.1 2024-09-12T00:38:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.1 2024-09-12T00:38:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.2 2024-09-12T00:38:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.2 2024-09-12T00:38:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.3 2024-09-12T00:38:15.875 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.3 2024-09-12T00:38:15.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.4 2024-09-12T00:38:15.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.4 2024-09-12T00:38:15.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.5 2024-09-12T00:38:15.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.5 2024-09-12T00:38:15.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.6 2024-09-12T00:38:15.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.6 2024-09-12T00:38:15.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.7 2024-09-12T00:38:15.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.7 2024-09-12T00:38:15.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.8 2024-09-12T00:38:15.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.8 2024-09-12T00:38:15.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.9 2024-09-12T00:38:15.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.9 2024-09-12T00:38:15.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.10 2024-09-12T00:38:15.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.10 2024-09-12T00:38:15.877 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.11 2024-09-12T00:38:15.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.11 2024-09-12T00:38:15.878 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.0 2024-09-12T00:38:15.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1 2024-09-12T00:38:15.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2 2024-09-12T00:38:15.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.881+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.3 2024-09-12T00:38:15.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.881+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.4 2024-09-12T00:38:15.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.881+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.5 2024-09-12T00:38:15.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.885+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.6 2024-09-12T00:38:15.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.885+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.7 2024-09-12T00:38:15.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.885+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.8 2024-09-12T00:38:15.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.889+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.9 2024-09-12T00:38:15.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.889+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.10 2024-09-12T00:38:15.895 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f09ffb4b9c0 time 2024-09-12T00:38:15.901704+0000 2024-09-12T00:38:15.895 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:15.896 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:15.896 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0a034252eb] 2024-09-12T00:38:15.896 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0a0342549f] 2024-09-12T00:38:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f38f73acc1] 2024-09-12T00:38:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55f38f74f01c] 2024-09-12T00:38:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55f38f7506a4] 2024-09-12T00:38:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:38:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0a0228bd90] 2024-09-12T00:38:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:38:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:38:15.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.897+0000 7f09ffb4b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f09ffb4b9c0 time 2024-09-12T00:38:15.901704+0000 2024-09-12T00:38:15.897 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.897 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0a034252eb] 2024-09-12T00:38:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0a0342549f] 2024-09-12T00:38:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f38f73acc1] 2024-09-12T00:38:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55f38f74f01c] 2024-09-12T00:38:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55f38f7506a4] 2024-09-12T00:38:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:38:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0a0228bd90] 2024-09-12T00:38:15.898 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:38:15.899 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:38:15.899 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.899 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:38:15.899 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f09ffb4b9c0 thread_name:radosgw-admin 2024-09-12T00:38:15.910 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:15.910 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0a022a4520] 2024-09-12T00:38:15.910 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:38:15.910 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:38:15.910 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:38:15.911 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0a03425345] 2024-09-12T00:38:15.911 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0a0342549f] 2024-09-12T00:38:15.911 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f38f73acc1] 2024-09-12T00:38:15.911 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55f38f74f01c] 2024-09-12T00:38:15.911 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55f38f7506a4] 2024-09-12T00:38:15.911 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:38:15.911 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0a0228bd90] 2024-09-12T00:38:15.911 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:38:15.911 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:38:15.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.901+0000 7f09ffb4b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:15.912 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f09ffb4b9c0 thread_name:radosgw-admin 2024-09-12T00:38:15.912 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.912 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:15.912 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0a022a4520] 2024-09-12T00:38:15.912 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:38:15.912 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:38:15.912 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:38:15.912 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0a03425345] 2024-09-12T00:38:15.912 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0a0342549f] 2024-09-12T00:38:15.912 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f38f73acc1] 2024-09-12T00:38:15.912 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55f38f74f01c] 2024-09-12T00:38:15.913 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55f38f7506a4] 2024-09-12T00:38:15.913 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:38:15.913 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0a0228bd90] 2024-09-12T00:38:15.913 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:38:15.913 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:38:15.913 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:15.913 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.913 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:38:15.913 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:38:15.553+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916331e0) adding con mode: secure 2024-09-12T00:38:15.913 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:38:15.553+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916331e0) adding con mode: crc 2024-09-12T00:38:15.913 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:38:15.553+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916331e0) adding con mode: secure 2024-09-12T00:38:15.913 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:38:15.553+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916331e0) adding con mode: crc 2024-09-12T00:38:15.913 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:38:15.553+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916331e0) adding con mode: secure 2024-09-12T00:38:15.914 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.914 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 1 librados: starting msgr at 2024-09-12T00:38:15.914 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 1 librados: starting objecter 2024-09-12T00:38:15.914 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command objecter_requests hook 0x55f391455930 2024-09-12T00:38:15.914 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 1 librados: setting wanted keys 2024-09-12T00:38:15.914 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 1 librados: calling monclient init 2024-09-12T00:38:15.914 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient: init 2024-09-12T00:38:15.914 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding auth protocol: cephx 2024-09-12T00:38:15.914 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding auth protocol: cephx 2024-09-12T00:38:15.914 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding auth protocol: cephx 2024-09-12T00:38:15.914 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: secure 2024-09-12T00:38:15.914 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: crc 2024-09-12T00:38:15.914 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: secure 2024-09-12T00:38:15.915 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: crc 2024-09-12T00:38:15.915 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: secure 2024-09-12T00:38:15.915 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: crc 2024-09-12T00:38:15.915 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: crc 2024-09-12T00:38:15.915 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: secure 2024-09-12T00:38:15.915 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: crc 2024-09-12T00:38:15.915 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: secure 2024-09-12T00:38:15.915 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: crc 2024-09-12T00:38:15.915 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: secure 2024-09-12T00:38:15.915 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.915 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.915 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command rotate-key hook 0x55f391631538 2024-09-12T00:38:15.915 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:15.916 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:38:15.916 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f3914bddf0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:38:15.916 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f3914e1ea0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:38:15.916 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f391576db0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:38:15.916 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.916 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.916 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.916 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:15.916 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient(hunting): authenticate will time out at 2348.901032s 2024-09-12T00:38:15.916 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient(hunting): get_auth_request con 0x55f3914bddf0 auth_method 0 2024-09-12T00:38:15.917 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:15.917 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:15.917 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:15.917 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:38:15.557+0000 7f09fde52640 10 monclient(hunting): get_auth_request con 0x55f391576db0 auth_method 0 2024-09-12T00:38:15.917 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:38:15.557+0000 7f09fde52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:15.917 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:38:15.557+0000 7f09fde52640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:15.917 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:38:15.557+0000 7f09fde52640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:15.917 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:15.917 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:15.917 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:15.918 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:38:15.557+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:15.918 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:38:15.557+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:15.918 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:38:15.557+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:15.918 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient(hunting): handle_auth_done global_id 8031 payload 824 2024-09-12T00:38:15.918 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient: _finish_hunting 0 2024-09-12T00:38:15.918 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:38:15.557+0000 7f09fd651640 1 monclient: found mon.noname-a 2024-09-12T00:38:15.918 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:38:15.918 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:38:15.557+0000 7f09fce50640 10 monclient: get_auth_request con 0x55f3914e1ea0 auth_method 0 2024-09-12T00:38:15.918 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:15.918 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:15.918 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: dump: 2024-09-12T00:38:15.918 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:15.918 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:15.919 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.919 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.919 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:15.919 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:15.919 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:15.919 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:15.919 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:15.919 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.919 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: _finish_auth 0 2024-09-12T00:38:15.919 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: _check_auth_tickets 2024-09-12T00:38:15.919 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:15.919 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:15.919 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:15.920 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: dump: 2024-09-12T00:38:15.920 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:15.920 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:15.920 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.920 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.920 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:15.920 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:15.920 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:15.920 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:15.920 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:15.920 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.920 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:38:15.557+0000 7f08eb606640 4 set_mon_vals no callback set 2024-09-12T00:38:15.921 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 monclient: authenticate success, global_id 8031 2024-09-12T00:38:15.921 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient: _renew_subs 2024-09-12T00:38:15.921 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:38:15.921 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient: _renew_subs 2024-09-12T00:38:15.921 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:38:15.921 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 1 librados: init done 2024-09-12T00:38:15.921 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:38:15.561+0000 7f08e9e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:15.922 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:38:15.561+0000 7f08e9e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:15.922 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:38:15.561+0000 7f08e9e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:15.922 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:38:15.561+0000 7f09fce50640 10 monclient: get_auth_request con 0x7f08e4070ae0 auth_method 0 2024-09-12T00:38:15.922 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:38:15.561+0000 7f09fde52640 10 monclient: get_auth_request con 0x55f39166f2c0 auth_method 0 2024-09-12T00:38:15.922 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:38:15.561+0000 7f09fd651640 10 monclient: get_auth_request con 0x55f39167bba0 auth_method 0 2024-09-12T00:38:15.922 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:38:15.561+0000 7f09fce50640 10 monclient: get_auth_request con 0x55f391680270 auth_method 0 2024-09-12T00:38:15.922 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: build_initial_monmap 2024-09-12T00:38:15.922 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:15.922 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: monmap: 2024-09-12T00:38:15.922 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:38:15.922 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:15.922 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:38:15.923 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:38:15.923 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:15.923 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:15.923 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:38:15.923 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:38:15.923 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:38:15.923 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.924 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding auth protocol: cephx 2024-09-12T00:38:15.924 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding auth protocol: cephx 2024-09-12T00:38:15.924 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding auth protocol: cephx 2024-09-12T00:38:15.924 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: secure 2024-09-12T00:38:15.924 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: crc 2024-09-12T00:38:15.924 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: secure 2024-09-12T00:38:15.924 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: crc 2024-09-12T00:38:15.924 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: secure 2024-09-12T00:38:15.924 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: crc 2024-09-12T00:38:15.924 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: crc 2024-09-12T00:38:15.924 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: secure 2024-09-12T00:38:15.924 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: crc 2024-09-12T00:38:15.925 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: secure 2024-09-12T00:38:15.925 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: crc 2024-09-12T00:38:15.925 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: secure 2024-09-12T00:38:15.925 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.925 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f3916889e0 EEXIST 2024-09-12T00:38:15.925 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: init 2024-09-12T00:38:15.925 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding auth protocol: cephx 2024-09-12T00:38:15.925 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding auth protocol: cephx 2024-09-12T00:38:15.925 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding auth protocol: cephx 2024-09-12T00:38:15.925 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: secure 2024-09-12T00:38:15.925 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: crc 2024-09-12T00:38:15.926 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: secure 2024-09-12T00:38:15.926 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: crc 2024-09-12T00:38:15.926 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: secure 2024-09-12T00:38:15.926 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: crc 2024-09-12T00:38:15.926 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: crc 2024-09-12T00:38:15.926 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: secure 2024-09-12T00:38:15.926 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: crc 2024-09-12T00:38:15.926 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: secure 2024-09-12T00:38:15.926 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: crc 2024-09-12T00:38:15.926 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: secure 2024-09-12T00:38:15.926 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.926 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.927 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command rotate-key cmddesc rotate-key hook 0x55f3916837c0 EEXIST 2024-09-12T00:38:15.927 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:15.927 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:38:15.927 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f3916acb90 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:38:15.927 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f3916ac4c0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:38:15.927 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f3916aaea0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:38:15.928 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.928 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.928 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.928 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:15.928 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient(hunting): authenticate will time out at 2348.910686s 2024-09-12T00:38:15.928 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient(hunting): get_auth_request con 0x55f3916ac4c0 auth_method 0 2024-09-12T00:38:15.929 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:15.929 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:15.929 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:15.929 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:38:15.565+0000 7f09fde52640 10 monclient(hunting): get_auth_request con 0x55f3916aaea0 auth_method 0 2024-09-12T00:38:15.929 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:38:15.565+0000 7f09fde52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:15.929 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:38:15.565+0000 7f09fde52640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:15.929 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:38:15.565+0000 7f09fde52640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:15.929 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:15.929 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:15.929 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:15.929 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:38:15.565+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:15.929 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:38:15.565+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:15.930 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:38:15.565+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:15.930 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient(hunting): handle_auth_done global_id 7511 payload 824 2024-09-12T00:38:15.930 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient: _finish_hunting 0 2024-09-12T00:38:15.930 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:38:15.565+0000 7f09fce50640 1 monclient: found mon.noname-c 2024-09-12T00:38:15.930 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:38:15.930 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:38:15.565+0000 7f09fd651640 10 monclient: get_auth_request con 0x55f3916acb90 auth_method 0 2024-09-12T00:38:15.930 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:15.930 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:15.930 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: dump: 2024-09-12T00:38:15.930 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:15.930 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:15.930 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.930 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.931 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:15.931 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:15.931 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:15.931 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:15.931 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:15.931 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.931 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:38:15.931 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:38:15.931 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:15.931 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:15.931 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:15.931 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: dump: 2024-09-12T00:38:15.931 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:15.932 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:15.932 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.932 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.932 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:15.932 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:15.932 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:15.932 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:15.933 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:15.933 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.933 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 monclient: authenticate success, global_id 7511 2024-09-12T00:38:15.933 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: _renew_subs 2024-09-12T00:38:15.933 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:38:15.565+0000 7f09fe653640 4 set_mon_vals no callback set 2024-09-12T00:38:15.933 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:38:15.933 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: _renew_subs 2024-09-12T00:38:15.933 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:38:15.933 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:38:15.569+0000 7f08e2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:15.933 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:38:15.569+0000 7f08e2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:15.933 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:38:15.569+0000 7f08e2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:15.933 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient: get_monmap_and_config 2024-09-12T00:38:15.934 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient: build_initial_monmap 2024-09-12T00:38:15.934 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:15.934 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient: monmap: 2024-09-12T00:38:15.934 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:38:15.934 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:15.934 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:38:15.934 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:38:15.934 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:15.934 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:15.934 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:38:15.934 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:38:15.934 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:38:15.934 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.935 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding auth protocol: cephx 2024-09-12T00:38:15.935 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding auth protocol: cephx 2024-09-12T00:38:15.935 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding auth protocol: cephx 2024-09-12T00:38:15.935 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: secure 2024-09-12T00:38:15.935 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: crc 2024-09-12T00:38:15.935 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: secure 2024-09-12T00:38:15.935 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: crc 2024-09-12T00:38:15.935 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: secure 2024-09-12T00:38:15.936 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: crc 2024-09-12T00:38:15.936 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: crc 2024-09-12T00:38:15.936 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: secure 2024-09-12T00:38:15.936 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: crc 2024-09-12T00:38:15.936 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: secure 2024-09-12T00:38:15.936 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: crc 2024-09-12T00:38:15.936 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: secure 2024-09-12T00:38:15.936 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient: get_auth_request con 0x7f08d8070a20 auth_method 0 2024-09-12T00:38:15.936 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.936 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient: init 2024-09-12T00:38:15.936 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding auth protocol: cephx 2024-09-12T00:38:15.937 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding auth protocol: cephx 2024-09-12T00:38:15.937 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding auth protocol: cephx 2024-09-12T00:38:15.937 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: secure 2024-09-12T00:38:15.937 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: crc 2024-09-12T00:38:15.937 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: secure 2024-09-12T00:38:15.937 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: crc 2024-09-12T00:38:15.937 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: secure 2024-09-12T00:38:15.937 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: crc 2024-09-12T00:38:15.937 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: crc 2024-09-12T00:38:15.937 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: secure 2024-09-12T00:38:15.937 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: crc 2024-09-12T00:38:15.937 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: secure 2024-09-12T00:38:15.938 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: crc 2024-09-12T00:38:15.938 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: secure 2024-09-12T00:38:15.938 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.938 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.938 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command rotate-key cmddesc rotate-key hook 0x7fff749d0b98 EEXIST 2024-09-12T00:38:15.938 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:15.938 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:38:15.938 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f3916d0480 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:38:15.938 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f3916fa8d0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:38:15.938 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f3916fbc60 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:38:15.939 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.939 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.939 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.939 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:15.939 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient(hunting): authenticate will time out at 2348.915170s 2024-09-12T00:38:15.939 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient(hunting): get_auth_request con 0x55f3916d0480 auth_method 0 2024-09-12T00:38:15.939 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:15.939 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:15.939 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:15.939 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:38:15.569+0000 7f09fde52640 10 monclient(hunting): get_auth_request con 0x55f3916fbc60 auth_method 0 2024-09-12T00:38:15.939 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:38:15.569+0000 7f09fde52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:15.939 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:38:15.569+0000 7f09fde52640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:15.939 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:38:15.569+0000 7f09fde52640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:15.940 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:15.940 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:15.940 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:15.940 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:38:15.569+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:15.940 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:38:15.569+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:15.940 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:38:15.569+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:15.940 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient(hunting): handle_auth_done global_id 8037 payload 274 2024-09-12T00:38:15.940 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient: _finish_hunting 0 2024-09-12T00:38:15.940 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:38:15.569+0000 7f09fd651640 1 monclient: found mon.noname-a 2024-09-12T00:38:15.940 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:38:15.940 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:15.940 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:15.941 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: dump: 2024-09-12T00:38:15.941 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:15.941 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:15.941 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.941 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.941 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:15.941 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:15.941 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:15.941 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:15.941 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:15.941 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.941 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: _finish_auth 0 2024-09-12T00:38:15.941 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:38:15.942 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:15.942 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 monclient: authenticate success, global_id 8037 2024-09-12T00:38:15.942 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:38:15.942 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 4 set_mon_vals no callback set 2024-09-12T00:38:15.942 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:15.942 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:15.942 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: dump: 2024-09-12T00:38:15.942 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:15.942 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:15.942 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.942 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.942 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:15.942 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:15.943 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:15.943 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:15.943 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:15.943 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.943 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: shutdown 2024-09-12T00:38:15.943 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: build_initial_monmap 2024-09-12T00:38:15.944 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:15.944 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: monmap: 2024-09-12T00:38:15.944 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:38:15.944 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:15.944 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:38:15.944 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:38:15.944 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:15.945 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:15.945 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:38:15.945 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:38:15.945 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:38:15.945 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.945 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding auth protocol: cephx 2024-09-12T00:38:15.945 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding auth protocol: cephx 2024-09-12T00:38:15.945 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding auth protocol: cephx 2024-09-12T00:38:15.945 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: secure 2024-09-12T00:38:15.945 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: crc 2024-09-12T00:38:15.945 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: secure 2024-09-12T00:38:15.945 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: crc 2024-09-12T00:38:15.946 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: secure 2024-09-12T00:38:15.946 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: crc 2024-09-12T00:38:15.946 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: crc 2024-09-12T00:38:15.946 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: secure 2024-09-12T00:38:15.946 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: crc 2024-09-12T00:38:15.946 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: secure 2024-09-12T00:38:15.946 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: crc 2024-09-12T00:38:15.946 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: secure 2024-09-12T00:38:15.946 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.946 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 1 librados: starting msgr at 2024-09-12T00:38:15.946 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 1 librados: starting objecter 2024-09-12T00:38:15.946 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f39157b160 EEXIST 2024-09-12T00:38:15.946 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 1 librados: setting wanted keys 2024-09-12T00:38:15.947 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 1 librados: calling monclient init 2024-09-12T00:38:15.947 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: init 2024-09-12T00:38:15.947 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding auth protocol: cephx 2024-09-12T00:38:15.947 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding auth protocol: cephx 2024-09-12T00:38:15.947 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding auth protocol: cephx 2024-09-12T00:38:15.947 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: secure 2024-09-12T00:38:15.947 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: crc 2024-09-12T00:38:15.947 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: secure 2024-09-12T00:38:15.947 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: crc 2024-09-12T00:38:15.947 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: secure 2024-09-12T00:38:15.947 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: crc 2024-09-12T00:38:15.947 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: crc 2024-09-12T00:38:15.947 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: secure 2024-09-12T00:38:15.947 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: crc 2024-09-12T00:38:15.948 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: secure 2024-09-12T00:38:15.948 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: crc 2024-09-12T00:38:15.948 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: secure 2024-09-12T00:38:15.948 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.948 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.948 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command rotate-key cmddesc rotate-key hook 0x55f3916aeaf8 EEXIST 2024-09-12T00:38:15.948 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:15.948 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:38:15.949 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f3916d0480 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:38:15.949 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f3916fa8d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:38:15.949 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f3916fbc60 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:38:15.949 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.949 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.949 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.949 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:15.949 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient(hunting): authenticate will time out at 2348.917806s 2024-09-12T00:38:15.949 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient(hunting): get_auth_request con 0x55f3916fa8d0 auth_method 0 2024-09-12T00:38:15.949 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:15.949 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:15.949 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:15.949 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:38:15.573+0000 7f09fde52640 10 monclient(hunting): get_auth_request con 0x55f3916fbc60 auth_method 0 2024-09-12T00:38:15.950 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:38:15.573+0000 7f09fde52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:15.950 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:38:15.573+0000 7f09fde52640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:15.950 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:38:15.573+0000 7f09fde52640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:15.950 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:15.950 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:15.950 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:15.950 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:38:15.573+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:15.950 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:38:15.573+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:15.950 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:38:15.573+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:15.950 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient(hunting): handle_auth_done global_id 7517 payload 824 2024-09-12T00:38:15.950 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient: _finish_hunting 0 2024-09-12T00:38:15.950 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:38:15.573+0000 7f09fce50640 1 monclient: found mon.noname-c 2024-09-12T00:38:15.950 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:38:15.950 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:15.951 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:15.951 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: dump: 2024-09-12T00:38:15.951 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:15.951 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:15.951 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.951 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.951 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:15.951 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:15.951 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:15.951 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:15.951 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:15.951 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.951 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: _finish_auth 0 2024-09-12T00:38:15.951 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: _check_auth_tickets 2024-09-12T00:38:15.952 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 monclient: authenticate success, global_id 7517 2024-09-12T00:38:15.952 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:15.952 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:15.952 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:15.952 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: dump: 2024-09-12T00:38:15.952 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:15.952 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:15.952 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.952 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.952 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:15.953 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:15.953 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:15.953 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:15.953 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:15.953 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.953 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: _renew_subs 2024-09-12T00:38:15.953 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:38:15.573+0000 7f08e0ff9640 4 set_mon_vals no callback set 2024-09-12T00:38:15.953 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:38:15.953 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: _renew_subs 2024-09-12T00:38:15.953 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:38:15.953 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 1 librados: init done 2024-09-12T00:38:15.953 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command cr dump hook 0x55f3916f3fd8 2024-09-12T00:38:15.954 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.954 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:38:15.577+0000 7f08ceffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:15.954 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:38:15.577+0000 7f08ceffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:15.954 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:38:15.577+0000 7f08ceffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:15.954 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:38:15.577+0000 7f09fd651640 10 monclient: get_auth_request con 0x7f08c8070b10 auth_method 0 2024-09-12T00:38:15.954 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:38:15.577+0000 7f09fde52640 10 monclient: get_auth_request con 0x55f39171a660 auth_method 0 2024-09-12T00:38:15.954 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.954 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 realm 2024-09-12T00:38:15.955 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.955 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.955 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:15.955 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.955 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.955 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.955 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:38:15.577+0000 7f09fd651640 10 monclient: get_auth_request con 0x55f39171e7a0 auth_method 0 2024-09-12T00:38:15.955 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:38:15.581+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:15.955 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:38:15.581+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.955 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:38:15.581+0000 7f09fce50640 10 monclient: get_auth_request con 0x55f391722090 auth_method 0 2024-09-12T00:38:15.955 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:38:15.785+0000 7f09fce50640 10 monclient: get_auth_request con 0x55f391722090 auth_method 0 2024-09-12T00:38:15.955 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:38:15.785+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:15.955 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:38:15.785+0000 7f09ffb4b9c0 20 searching for the correct realm 2024-09-12T00:38:15.955 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:38:15.785+0000 7f09fde52640 10 monclient: get_auth_request con 0x55f391726e30 auth_method 0 2024-09-12T00:38:15.956 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:38:15.789+0000 7f09fd651640 10 monclient: get_auth_request con 0x7f09f8018420 auth_method 0 2024-09-12T00:38:15.956 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:38:15.793+0000 7f09fce50640 10 monclient: get_auth_request con 0x7f09f0100040 auth_method 0 2024-09-12T00:38:15.956 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:38:15.793+0000 7f09fde52640 0 -- 172.21.15.138:0/1179187352 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55f391726e30 msgr2=0x55f3917292f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:15.956 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:38:15.793+0000 7f08ceffd640 1 client.7517.objecter ms_handle_reset 0x55f391726e30 session 0x55f3917267b0 osd.4 2024-09-12T00:38:15.956 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:38:15.793+0000 7f08ceffd640 10 monclient: _renew_subs 2024-09-12T00:38:15.956 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:38:15.793+0000 7f08ceffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:38:15.956 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:38:15.793+0000 7f09fde52640 10 monclient: get_auth_request con 0x7f08c8080db0 auth_method 0 2024-09-12T00:38:15.956 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:38:15.793+0000 7f09fde52640 10 monclient: get_auth_request con 0x7f09f8015900 auth_method 0 2024-09-12T00:38:15.956 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:38:15.801+0000 7f09fd651640 10 monclient: get_auth_request con 0x7f09f0118270 auth_method 0 2024-09-12T00:38:15.956 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:38:15.805+0000 7f09fde52640 0 -- 172.21.15.138:0/1179187352 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x55f39171a660 msgr2=0x55f39171ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:15.957 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:38:15.805+0000 7f08ceffd640 1 client.7517.objecter ms_handle_reset 0x55f39171a660 session 0x55f391719fe0 osd.6 2024-09-12T00:38:15.957 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:38:15.805+0000 7f09fde52640 10 monclient: get_auth_request con 0x55f391726e30 auth_method 0 2024-09-12T00:38:15.957 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:15.957 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:15.957 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:15.957 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:15.957 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:15.957 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:15.957 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.957 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.957 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.957 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:15.957 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.958 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:15.958 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 zone default found 2024-09-12T00:38:15.958 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 4 Realm: () 2024-09-12T00:38:15.958 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:15.958 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:15.958 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:15.958 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 zonegroup default 2024-09-12T00:38:15.958 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.958 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.958 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.958 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.959 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.959 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:38:15.821+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:15.959 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:38:15.821+0000 7f09ffb4b9c0 20 started sync module instance, tier type = 2024-09-12T00:38:15.959 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:38:15.821+0000 7f09ffb4b9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:15.959 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=0 2024-09-12T00:38:15.959 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=1 2024-09-12T00:38:15.959 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=2 2024-09-12T00:38:15.959 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=3 2024-09-12T00:38:15.959 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=4 2024-09-12T00:38:15.959 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=5 2024-09-12T00:38:15.959 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=6 2024-09-12T00:38:15.959 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:38:15.845+0000 7f09ffb4b9c0 20 add_watcher() i=7 2024-09-12T00:38:15.959 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:38:15.845+0000 7f09ffb4b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:15.960 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding auth protocol: cephx 2024-09-12T00:38:15.960 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding auth protocol: cephx 2024-09-12T00:38:15.960 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding auth protocol: cephx 2024-09-12T00:38:15.960 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: secure 2024-09-12T00:38:15.960 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: crc 2024-09-12T00:38:15.960 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: secure 2024-09-12T00:38:15.960 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: crc 2024-09-12T00:38:15.960 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: secure 2024-09-12T00:38:15.960 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: crc 2024-09-12T00:38:15.960 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: crc 2024-09-12T00:38:15.960 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: secure 2024-09-12T00:38:15.960 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:38:15.849+0000 7f08b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:15.960 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: crc 2024-09-12T00:38:15.961 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: secure 2024-09-12T00:38:15.961 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: crc 2024-09-12T00:38:15.961 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: secure 2024-09-12T00:38:15.961 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.961 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:15.961 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:15.961 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command cache list hook 0x55f3916f4ee0 2024-09-12T00:38:15.961 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command cache inspect hook 0x55f3916f4ee0 2024-09-12T00:38:15.961 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command cache erase hook 0x55f3916f4ee0 2024-09-12T00:38:15.961 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command cache zap hook 0x55f3916f4ee0 2024-09-12T00:38:15.961 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 note: GC not initialized 2024-09-12T00:38:15.961 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:38:15.853+0000 7f08b27e4640 20 reqs_thread_entry: start 2024-09-12T00:38:15.961 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command sync trace show hook 0x7f09f00bb040 2024-09-12T00:38:15.962 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command sync trace history hook 0x7f09f00bb040 2024-09-12T00:38:15.962 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command sync trace active hook 0x7f09f00bb040 2024-09-12T00:38:15.962 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command sync trace active_short hook 0x7f09f00bb040 2024-09-12T00:38:15.962 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:15.962 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 Filter name: none 2024-09-12T00:38:15.962 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:38:15.853+0000 7f0823fff640 20 reqs_thread_entry: start 2024-09-12T00:38:15.962 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:38:15.962 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.962 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:15.962 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:38:15.962 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:38:15.962 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 : miss 2024-09-12T00:38:15.962 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:15.962 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:15.963 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 info.flags=0x17 2024-09-12T00:38:15.963 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to cache LRU end 2024-09-12T00:38:15.963 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:15.963 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:15.963 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 2024-09-12T00:38:15.963 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 info.flags=0x17 2024-09-12T00:38:15.963 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to cache LRU end 2024-09-12T00:38:15.963 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:15.963 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39, ofs0, ns] 2024-09-12T00:38:15.963 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:38:15.865+0000 7f08e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333476 cookie 94504605564144 notifier 7517 bl.length()=931 2024-09-12T00:38:15.963 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:38:15.865+0000 7f08e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 info.flags=0x17 2024-09-12T00:38:15.963 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:38:15.865+0000 7f08e0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to cache LRU end 2024-09-12T00:38:15.963 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:38:15.865+0000 7f08e0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:15.963 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): orig_sources= new_sources= 2024-09-12T00:38:15.964 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): potential sources added=[] removed=[] 2024-09-12T00:38:15.964 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): orig_dests= new_dests= 2024-09-12T00:38:15.964 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): potential dests added=[] removed=[] 2024-09-12T00:38:15.964 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.0 2024-09-12T00:38:15.964 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.0 2024-09-12T00:38:15.964 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.1 2024-09-12T00:38:15.964 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.1 2024-09-12T00:38:15.964 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.2 2024-09-12T00:38:15.964 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.2 2024-09-12T00:38:15.964 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.3 2024-09-12T00:38:15.965 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.3 2024-09-12T00:38:15.965 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.4 2024-09-12T00:38:15.965 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.4 2024-09-12T00:38:15.965 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.5 2024-09-12T00:38:15.965 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.5 2024-09-12T00:38:15.965 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.6 2024-09-12T00:38:15.965 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.6 2024-09-12T00:38:15.965 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.7 2024-09-12T00:38:15.965 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.7 2024-09-12T00:38:15.966 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.8 2024-09-12T00:38:15.966 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.8 2024-09-12T00:38:15.966 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.9 2024-09-12T00:38:15.966 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.9 2024-09-12T00:38:15.966 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.10 2024-09-12T00:38:15.966 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.10 2024-09-12T00:38:15.966 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.11 2024-09-12T00:38:15.966 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.11 2024-09-12T00:38:15.966 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.0 2024-09-12T00:38:15.966 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1 2024-09-12T00:38:15.966 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2 2024-09-12T00:38:15.966 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:38:15.881+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.3 2024-09-12T00:38:15.967 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:38:15.881+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.4 2024-09-12T00:38:15.967 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:38:15.881+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.5 2024-09-12T00:38:15.967 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:38:15.885+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.6 2024-09-12T00:38:15.967 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:38:15.885+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.7 2024-09-12T00:38:15.967 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:38:15.885+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.8 2024-09-12T00:38:15.967 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:38:15.889+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.9 2024-09-12T00:38:15.967 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:38:15.889+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.10 2024-09-12T00:38:15.967 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:38:15.897+0000 7f09ffb4b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f09ffb4b9c0 time 2024-09-12T00:38:15.901704+0000 2024-09-12T00:38:15.967 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:15.967 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.967 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:15.968 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0a034252eb] 2024-09-12T00:38:15.968 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0a0342549f] 2024-09-12T00:38:15.968 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f38f73acc1] 2024-09-12T00:38:15.968 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55f38f74f01c] 2024-09-12T00:38:15.968 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55f38f7506a4] 2024-09-12T00:38:15.968 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:38:15.968 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0a0228bd90] 2024-09-12T00:38:15.968 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:38:15.968 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:38:15.969 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.969 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:38:15.901+0000 7f09ffb4b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:15.969 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f09ffb4b9c0 thread_name:radosgw-admin 2024-09-12T00:38:15.969 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.969 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:15.969 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0a022a4520] 2024-09-12T00:38:15.969 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:38:15.969 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:38:15.970 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:38:15.970 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0a03425345] 2024-09-12T00:38:15.970 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0a0342549f] 2024-09-12T00:38:15.970 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f38f73acc1] 2024-09-12T00:38:15.970 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55f38f74f01c] 2024-09-12T00:38:15.970 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55f38f7506a4] 2024-09-12T00:38:15.970 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:38:15.970 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0a0228bd90] 2024-09-12T00:38:15.970 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:38:15.970 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:38:15.970 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:15.970 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.971 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:38:15.971 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:38:15.971 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:38:15.971 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:38:15.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:38:15.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:38:15.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:38:15.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:38:15.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:38:15.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:38:15.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:38:15.971 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:38:15.971 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:38:15.971 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:38:15.972 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:38:15.972 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:38:15.972 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:38:15.972 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:38:15.972 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:38:15.972 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:38:15.972 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:38:15.972 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:38:15.972 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:38:15.972 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:38:15.972 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:38:15.972 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:38:15.973 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:38:15.973 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:38:15.973 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:38:15.973 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:38:15.973 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:38:15.973 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:38:15.973 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:38:15.973 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:38:15.973 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:38:15.973 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:38:15.973 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:38:15.974 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:38:15.974 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:38:15.974 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:38:15.974 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:38:15.974 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:38:15.974 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:38:15.974 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:38:15.974 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:38:15.974 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:38:15.974 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:38:15.975 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:38:15.975 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:38:15.975 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:38:15.975 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:38:15.975 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:38:15.975 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:38:15.975 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:38:15.975 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:38:15.975 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:38:15.975 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:38:15.975 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:38:15.976 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:38:15.976 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:38:15.976 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:38:15.976 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:38:15.976 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:38:15.976 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:38:15.976 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:38:15.976 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:38:15.977 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:38:15.977 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:38:15.977 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:38:15.977 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:38:15.977 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:38:15.977 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:38:15.977 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:38:15.977 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:38:15.977 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:38:15.977 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:38:15.977 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:38:15.978 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:38:15.978 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:38:15.978 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:38:15.978 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:38:15.978 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:38:15.978 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:38:15.978 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:38:15.978 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:38:15.978 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:38:15.978 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:38:15.979 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:38:15.979 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:38:15.979 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:38:15.979 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:38:15.979 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:38:15.979 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:38:15.979 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:38:15.979 INFO:tasks.workunit.client.0.smithi138.stderr: 7f0823fff640 / http_manager 2024-09-12T00:38:15.979 INFO:tasks.workunit.client.0.smithi138.stderr: 7f08b27e4640 / http_manager 2024-09-12T00:38:15.979 INFO:tasks.workunit.client.0.smithi138.stderr: 7f08b37e6640 / rgw_dt_lg_renew 2024-09-12T00:38:15.980 INFO:tasks.workunit.client.0.smithi138.stderr: 7f08ceffd640 / ms_dispatch 2024-09-12T00:38:15.980 INFO:tasks.workunit.client.0.smithi138.stderr: 7f08e0ff9640 / io_context_pool 2024-09-12T00:38:15.980 INFO:tasks.workunit.client.0.smithi138.stderr: 7f08e2ffd640 / ms_dispatch 2024-09-12T00:38:15.980 INFO:tasks.workunit.client.0.smithi138.stderr: 7f08e9e03640 / ms_dispatch 2024-09-12T00:38:15.980 INFO:tasks.workunit.client.0.smithi138.stderr: 7f08eb606640 / io_context_pool 2024-09-12T00:38:15.980 INFO:tasks.workunit.client.0.smithi138.stderr: 7f09fce50640 / msgr-worker-2 2024-09-12T00:38:15.980 INFO:tasks.workunit.client.0.smithi138.stderr: 7f09fd651640 / msgr-worker-1 2024-09-12T00:38:15.980 INFO:tasks.workunit.client.0.smithi138.stderr: 7f09fde52640 / msgr-worker-0 2024-09-12T00:38:15.980 INFO:tasks.workunit.client.0.smithi138.stderr: 7f09fe653640 / io_context_pool 2024-09-12T00:38:15.980 INFO:tasks.workunit.client.0.smithi138.stderr: 7f09ffb4b9c0 / radosgw-admin 2024-09-12T00:38:15.981 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:38:15.981 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:38:15.981 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.134817.log 2024-09-12T00:38:15.981 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:38:15.981 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:38:15.981 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:38:15.553+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916331e0) adding con mode: secure 2024-09-12T00:38:15.981 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:38:15.553+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916331e0) adding con mode: crc 2024-09-12T00:38:15.981 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:38:15.553+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916331e0) adding con mode: secure 2024-09-12T00:38:15.981 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:38:15.553+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916331e0) adding con mode: crc 2024-09-12T00:38:15.981 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:38:15.553+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916331e0) adding con mode: secure 2024-09-12T00:38:15.981 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.981 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 1 librados: starting msgr at 2024-09-12T00:38:15.981 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 1 librados: starting objecter 2024-09-12T00:38:15.982 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command objecter_requests hook 0x55f391455930 2024-09-12T00:38:15.982 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 1 librados: setting wanted keys 2024-09-12T00:38:15.982 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 1 librados: calling monclient init 2024-09-12T00:38:15.982 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient: init 2024-09-12T00:38:15.982 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding auth protocol: cephx 2024-09-12T00:38:15.982 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding auth protocol: cephx 2024-09-12T00:38:15.982 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding auth protocol: cephx 2024-09-12T00:38:15.982 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: secure 2024-09-12T00:38:15.982 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: crc 2024-09-12T00:38:15.982 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: secure 2024-09-12T00:38:15.982 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: crc 2024-09-12T00:38:15.982 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: secure 2024-09-12T00:38:15.982 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: crc 2024-09-12T00:38:15.983 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: crc 2024-09-12T00:38:15.983 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: secure 2024-09-12T00:38:15.983 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: crc 2024-09-12T00:38:15.983 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: secure 2024-09-12T00:38:15.983 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: crc 2024-09-12T00:38:15.983 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916313f0) adding con mode: secure 2024-09-12T00:38:15.983 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.983 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.983 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command rotate-key hook 0x55f391631538 2024-09-12T00:38:15.983 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:15.983 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:38:15.983 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f3914bddf0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:38:15.983 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f3914e1ea0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:38:15.984 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f391576db0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:38:15.984 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.984 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.984 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.984 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:15.984 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient(hunting): authenticate will time out at 2348.901032s 2024-09-12T00:38:15.984 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient(hunting): get_auth_request con 0x55f3914bddf0 auth_method 0 2024-09-12T00:38:15.984 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:15.984 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:15.984 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:15.985 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:38:15.557+0000 7f09fde52640 10 monclient(hunting): get_auth_request con 0x55f391576db0 auth_method 0 2024-09-12T00:38:15.985 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:38:15.557+0000 7f09fde52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:15.985 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:38:15.557+0000 7f09fde52640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:15.985 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:38:15.557+0000 7f09fde52640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:15.985 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:15.985 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:15.985 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:15.985 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:38:15.557+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:15.985 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:38:15.557+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:15.985 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:38:15.557+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:15.985 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient(hunting): handle_auth_done global_id 8031 payload 824 2024-09-12T00:38:15.985 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient: _finish_hunting 0 2024-09-12T00:38:15.985 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:38:15.557+0000 7f09fd651640 1 monclient: found mon.noname-a 2024-09-12T00:38:15.986 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:38:15.557+0000 7f09fd651640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:38:15.986 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:38:15.557+0000 7f09fce50640 10 monclient: get_auth_request con 0x55f3914e1ea0 auth_method 0 2024-09-12T00:38:15.986 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:15.986 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:15.986 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: dump: 2024-09-12T00:38:15.986 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:15.986 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:15.986 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.986 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.987 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:15.987 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:15.987 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:15.987 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:15.987 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:15.987 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.987 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: _finish_auth 0 2024-09-12T00:38:15.987 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: _check_auth_tickets 2024-09-12T00:38:15.987 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:15.987 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:15.988 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:15.988 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:38:15.557+0000 7f08e9e03640 10 monclient: dump: 2024-09-12T00:38:15.988 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:15.988 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:15.988 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.988 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.988 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:15.988 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:15.988 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:15.988 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:15.988 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:15.988 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.988 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:38:15.557+0000 7f08eb606640 4 set_mon_vals no callback set 2024-09-12T00:38:15.989 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 5 monclient: authenticate success, global_id 8031 2024-09-12T00:38:15.989 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient: _renew_subs 2024-09-12T00:38:15.989 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:38:15.989 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient: _renew_subs 2024-09-12T00:38:15.989 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:38:15.989 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:38:15.557+0000 7f09ffb4b9c0 1 librados: init done 2024-09-12T00:38:15.989 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:38:15.561+0000 7f08e9e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:15.989 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:38:15.561+0000 7f08e9e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:15.990 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:38:15.561+0000 7f08e9e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:15.990 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:38:15.561+0000 7f09fce50640 10 monclient: get_auth_request con 0x7f08e4070ae0 auth_method 0 2024-09-12T00:38:15.990 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:38:15.561+0000 7f09fde52640 10 monclient: get_auth_request con 0x55f39166f2c0 auth_method 0 2024-09-12T00:38:15.990 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:38:15.561+0000 7f09fd651640 10 monclient: get_auth_request con 0x55f39167bba0 auth_method 0 2024-09-12T00:38:15.990 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:38:15.561+0000 7f09fce50640 10 monclient: get_auth_request con 0x55f391680270 auth_method 0 2024-09-12T00:38:15.990 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: build_initial_monmap 2024-09-12T00:38:15.990 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:15.990 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: monmap: 2024-09-12T00:38:15.990 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:38:15.991 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:15.991 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:38:15.991 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:38:15.991 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:15.991 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:15.991 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:38:15.991 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:38:15.991 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:38:15.991 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.991 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding auth protocol: cephx 2024-09-12T00:38:15.991 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding auth protocol: cephx 2024-09-12T00:38:15.991 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding auth protocol: cephx 2024-09-12T00:38:15.991 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: secure 2024-09-12T00:38:15.992 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: crc 2024-09-12T00:38:15.992 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: secure 2024-09-12T00:38:15.992 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: crc 2024-09-12T00:38:15.992 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: secure 2024-09-12T00:38:15.992 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: crc 2024-09-12T00:38:15.992 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: crc 2024-09-12T00:38:15.992 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: secure 2024-09-12T00:38:15.992 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: crc 2024-09-12T00:38:15.992 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: secure 2024-09-12T00:38:15.992 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: crc 2024-09-12T00:38:15.993 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391684ff0) adding con mode: secure 2024-09-12T00:38:15.993 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.993 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f3916889e0 EEXIST 2024-09-12T00:38:15.993 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: init 2024-09-12T00:38:15.993 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding auth protocol: cephx 2024-09-12T00:38:15.993 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding auth protocol: cephx 2024-09-12T00:38:15.993 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding auth protocol: cephx 2024-09-12T00:38:15.993 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: secure 2024-09-12T00:38:15.993 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: crc 2024-09-12T00:38:15.993 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: secure 2024-09-12T00:38:15.993 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: crc 2024-09-12T00:38:15.993 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: secure 2024-09-12T00:38:15.993 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: crc 2024-09-12T00:38:15.993 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: crc 2024-09-12T00:38:15.994 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: secure 2024-09-12T00:38:15.994 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: crc 2024-09-12T00:38:15.994 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: secure 2024-09-12T00:38:15.994 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: crc 2024-09-12T00:38:15.994 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f391683678) adding con mode: secure 2024-09-12T00:38:15.994 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.994 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:15.994 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command rotate-key cmddesc rotate-key hook 0x55f3916837c0 EEXIST 2024-09-12T00:38:15.994 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:15.994 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:38:15.994 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f3916acb90 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:38:15.994 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f3916ac4c0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:38:15.995 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f3916aaea0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:38:15.995 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.995 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.995 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:15.995 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:15.995 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient(hunting): authenticate will time out at 2348.910686s 2024-09-12T00:38:15.995 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient(hunting): get_auth_request con 0x55f3916ac4c0 auth_method 0 2024-09-12T00:38:15.995 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:15.995 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:15.995 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:15.995 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:38:15.565+0000 7f09fde52640 10 monclient(hunting): get_auth_request con 0x55f3916aaea0 auth_method 0 2024-09-12T00:38:15.995 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:38:15.565+0000 7f09fde52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:15.996 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:38:15.565+0000 7f09fde52640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:15.996 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:38:15.565+0000 7f09fde52640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:15.996 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:15.996 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:15.996 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:15.996 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:38:15.565+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:15.996 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:38:15.565+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:15.996 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:38:15.565+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:15.996 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient(hunting): handle_auth_done global_id 7511 payload 824 2024-09-12T00:38:15.996 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient: _finish_hunting 0 2024-09-12T00:38:15.996 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:38:15.565+0000 7f09fce50640 1 monclient: found mon.noname-c 2024-09-12T00:38:15.996 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:38:15.565+0000 7f09fce50640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:38:15.996 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:38:15.565+0000 7f09fd651640 10 monclient: get_auth_request con 0x55f3916acb90 auth_method 0 2024-09-12T00:38:15.997 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:15.997 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:15.997 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: dump: 2024-09-12T00:38:15.997 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:15.997 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:15.997 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.997 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.997 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:15.997 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:15.998 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:15.998 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:15.998 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:15.998 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.998 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:38:15.998 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:38:15.998 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:15.998 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:15.998 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:15.998 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:38:15.565+0000 7f08e2ffd640 10 monclient: dump: 2024-09-12T00:38:15.998 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:15.999 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:15.999 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.999 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:15.999 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:15.999 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:15.999 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:15.999 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:15.999 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:15.999 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:15.999 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 5 monclient: authenticate success, global_id 7511 2024-09-12T00:38:15.999 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: _renew_subs 2024-09-12T00:38:15.999 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:38:15.565+0000 7f09fe653640 4 set_mon_vals no callback set 2024-09-12T00:38:16.000 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:38:16.000 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: _renew_subs 2024-09-12T00:38:16.000 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:38:15.565+0000 7f09ffb4b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:38:16.000 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:38:15.569+0000 7f08e2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:16.000 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:38:15.569+0000 7f08e2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:16.000 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:38:15.569+0000 7f08e2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:16.000 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient: get_monmap_and_config 2024-09-12T00:38:16.000 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient: build_initial_monmap 2024-09-12T00:38:16.000 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:16.000 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient: monmap: 2024-09-12T00:38:16.000 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:38:16.001 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:16.001 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:38:16.001 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:38:16.001 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:16.001 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:16.001 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:38:16.001 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:38:16.001 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:38:16.001 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:16.002 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding auth protocol: cephx 2024-09-12T00:38:16.002 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding auth protocol: cephx 2024-09-12T00:38:16.002 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding auth protocol: cephx 2024-09-12T00:38:16.002 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: secure 2024-09-12T00:38:16.002 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: crc 2024-09-12T00:38:16.002 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: secure 2024-09-12T00:38:16.002 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: crc 2024-09-12T00:38:16.002 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: secure 2024-09-12T00:38:16.002 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: crc 2024-09-12T00:38:16.002 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: crc 2024-09-12T00:38:16.002 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: secure 2024-09-12T00:38:16.003 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: crc 2024-09-12T00:38:16.003 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: secure 2024-09-12T00:38:16.003 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: crc 2024-09-12T00:38:16.003 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916cc320) adding con mode: secure 2024-09-12T00:38:16.003 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient: get_auth_request con 0x7f08d8070a20 auth_method 0 2024-09-12T00:38:16.003 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:16.003 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient: init 2024-09-12T00:38:16.003 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding auth protocol: cephx 2024-09-12T00:38:16.003 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding auth protocol: cephx 2024-09-12T00:38:16.003 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding auth protocol: cephx 2024-09-12T00:38:16.003 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: secure 2024-09-12T00:38:16.003 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: crc 2024-09-12T00:38:16.004 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: secure 2024-09-12T00:38:16.004 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: crc 2024-09-12T00:38:16.004 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: secure 2024-09-12T00:38:16.004 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: crc 2024-09-12T00:38:16.004 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: crc 2024-09-12T00:38:16.004 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: secure 2024-09-12T00:38:16.004 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: crc 2024-09-12T00:38:16.004 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: secure 2024-09-12T00:38:16.004 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: crc 2024-09-12T00:38:16.004 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0a50) adding con mode: secure 2024-09-12T00:38:16.004 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:16.005 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:16.005 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command rotate-key cmddesc rotate-key hook 0x7fff749d0b98 EEXIST 2024-09-12T00:38:16.005 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:16.005 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:38:16.005 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f3916d0480 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:38:16.005 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f3916fa8d0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:38:16.005 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f3916fbc60 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:38:16.005 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:16.005 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:16.005 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:16.005 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:16.005 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient(hunting): authenticate will time out at 2348.915170s 2024-09-12T00:38:16.005 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient(hunting): get_auth_request con 0x55f3916d0480 auth_method 0 2024-09-12T00:38:16.006 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:16.006 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:16.006 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:16.006 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:38:15.569+0000 7f09fde52640 10 monclient(hunting): get_auth_request con 0x55f3916fbc60 auth_method 0 2024-09-12T00:38:16.006 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:38:15.569+0000 7f09fde52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:16.006 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:38:15.569+0000 7f09fde52640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:16.006 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:38:15.569+0000 7f09fde52640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:16.006 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:16.006 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:16.006 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:16.006 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:38:15.569+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:16.007 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:38:15.569+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:16.007 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:38:15.569+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:16.007 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient(hunting): handle_auth_done global_id 8037 payload 274 2024-09-12T00:38:16.007 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient: _finish_hunting 0 2024-09-12T00:38:16.007 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:38:15.569+0000 7f09fd651640 1 monclient: found mon.noname-a 2024-09-12T00:38:16.007 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:38:15.569+0000 7f09fd651640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:38:16.007 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:16.007 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:16.007 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: dump: 2024-09-12T00:38:16.007 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:16.007 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:16.007 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:16.008 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:16.008 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:16.008 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:16.008 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:16.008 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:16.008 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:16.008 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:16.009 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: _finish_auth 0 2024-09-12T00:38:16.009 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:38:16.009 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:16.009 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 5 monclient: authenticate success, global_id 8037 2024-09-12T00:38:16.009 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:38:16.009 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:38:15.569+0000 7f09ffb4b9c0 4 set_mon_vals no callback set 2024-09-12T00:38:16.009 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:16.009 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:16.009 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:38:15.569+0000 7f08e0ff9640 10 monclient: dump: 2024-09-12T00:38:16.009 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:16.009 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:16.010 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:16.010 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:16.010 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:16.010 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:16.010 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:16.010 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:16.010 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:16.010 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:16.010 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: shutdown 2024-09-12T00:38:16.010 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: build_initial_monmap 2024-09-12T00:38:16.011 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:16.011 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: monmap: 2024-09-12T00:38:16.011 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:38:16.011 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:16.011 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:38:16.011 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:38:16.011 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:16.011 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:16.011 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:38:16.011 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:38:16.011 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:38:16.012 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:16.012 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding auth protocol: cephx 2024-09-12T00:38:16.012 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding auth protocol: cephx 2024-09-12T00:38:16.012 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding auth protocol: cephx 2024-09-12T00:38:16.012 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: secure 2024-09-12T00:38:16.012 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: crc 2024-09-12T00:38:16.012 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: secure 2024-09-12T00:38:16.012 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: crc 2024-09-12T00:38:16.012 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: secure 2024-09-12T00:38:16.012 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: crc 2024-09-12T00:38:16.012 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: crc 2024-09-12T00:38:16.012 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: secure 2024-09-12T00:38:16.012 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: crc 2024-09-12T00:38:16.013 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: secure 2024-09-12T00:38:16.013 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: crc 2024-09-12T00:38:16.013 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916d1000) adding con mode: secure 2024-09-12T00:38:16.013 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:16.013 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 1 librados: starting msgr at 2024-09-12T00:38:16.013 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 1 librados: starting objecter 2024-09-12T00:38:16.013 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command objecter_requests cmddesc objecter_requests hook 0x55f39157b160 EEXIST 2024-09-12T00:38:16.013 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 1 librados: setting wanted keys 2024-09-12T00:38:16.014 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 1 librados: calling monclient init 2024-09-12T00:38:16.014 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: init 2024-09-12T00:38:16.014 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding auth protocol: cephx 2024-09-12T00:38:16.014 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding auth protocol: cephx 2024-09-12T00:38:16.014 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding auth protocol: cephx 2024-09-12T00:38:16.014 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: secure 2024-09-12T00:38:16.014 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: crc 2024-09-12T00:38:16.014 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: secure 2024-09-12T00:38:16.014 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: crc 2024-09-12T00:38:16.014 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: secure 2024-09-12T00:38:16.014 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: crc 2024-09-12T00:38:16.015 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: crc 2024-09-12T00:38:16.015 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: secure 2024-09-12T00:38:16.015 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: crc 2024-09-12T00:38:16.015 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: secure 2024-09-12T00:38:16.015 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: crc 2024-09-12T00:38:16.015 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 AuthRegistry(0x55f3916ae9b0) adding con mode: secure 2024-09-12T00:38:16.015 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:16.015 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:16.015 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command rotate-key cmddesc rotate-key hook 0x55f3916aeaf8 EEXIST 2024-09-12T00:38:16.015 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:16.015 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:38:16.015 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-b con 0x55f3916d0480 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:38:16.015 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-c con 0x55f3916fa8d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:38:16.015 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient(hunting): picked mon.noname-a con 0x55f3916fbc60 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:38:16.016 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:16.016 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:16.016 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:16.016 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:16.016 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient(hunting): authenticate will time out at 2348.917806s 2024-09-12T00:38:16.016 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient(hunting): get_auth_request con 0x55f3916fa8d0 auth_method 0 2024-09-12T00:38:16.016 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:16.016 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:16.016 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:16.016 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:38:15.573+0000 7f09fde52640 10 monclient(hunting): get_auth_request con 0x55f3916fbc60 auth_method 0 2024-09-12T00:38:16.016 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:38:15.573+0000 7f09fde52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:16.016 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:38:15.573+0000 7f09fde52640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:16.016 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:38:15.573+0000 7f09fde52640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:16.017 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:16.017 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:16.017 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:16.017 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:38:15.573+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:16.017 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:38:15.573+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:16.017 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:38:15.573+0000 7f09fde52640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:16.017 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient(hunting): handle_auth_done global_id 7517 payload 824 2024-09-12T00:38:16.017 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient: _finish_hunting 0 2024-09-12T00:38:16.017 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:38:15.573+0000 7f09fce50640 1 monclient: found mon.noname-c 2024-09-12T00:38:16.017 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:38:15.573+0000 7f09fce50640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:38:16.017 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:16.017 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:16.017 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: dump: 2024-09-12T00:38:16.018 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:16.018 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:16.018 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:16.018 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:16.018 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:16.018 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:16.018 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:16.018 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:16.018 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:16.018 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:16.018 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: _finish_auth 0 2024-09-12T00:38:16.018 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: _check_auth_tickets 2024-09-12T00:38:16.018 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 monclient: authenticate success, global_id 7517 2024-09-12T00:38:16.018 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:16.019 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:16.019 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:16.019 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:38:15.573+0000 7f08ceffd640 10 monclient: dump: 2024-09-12T00:38:16.019 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:16.019 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:16.019 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:16.019 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:16.020 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:16.020 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:16.020 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:16.020 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:16.020 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:16.020 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:16.020 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: _renew_subs 2024-09-12T00:38:16.020 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:38:15.573+0000 7f08e0ff9640 4 set_mon_vals no callback set 2024-09-12T00:38:16.020 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:38:16.021 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: _renew_subs 2024-09-12T00:38:16.021 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:38:16.021 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 1 librados: init done 2024-09-12T00:38:16.021 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:38:15.573+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command cr dump hook 0x55f3916f3fd8 2024-09-12T00:38:16.021 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.021 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:38:15.577+0000 7f08ceffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:16.021 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:38:15.577+0000 7f08ceffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:16.021 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:38:15.577+0000 7f08ceffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:16.021 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:38:15.577+0000 7f09fd651640 10 monclient: get_auth_request con 0x7f08c8070b10 auth_method 0 2024-09-12T00:38:16.021 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:38:15.577+0000 7f09fde52640 10 monclient: get_auth_request con 0x55f39171a660 auth_method 0 2024-09-12T00:38:16.021 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.021 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 realm 2024-09-12T00:38:16.022 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.022 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.022 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:16.022 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.022 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.022 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:38:15.577+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.023 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:38:15.577+0000 7f09fd651640 10 monclient: get_auth_request con 0x55f39171e7a0 auth_method 0 2024-09-12T00:38:16.023 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:38:15.581+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:16.023 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:38:15.581+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.023 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:38:15.581+0000 7f09fce50640 10 monclient: get_auth_request con 0x55f391722090 auth_method 0 2024-09-12T00:38:16.023 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:38:15.785+0000 7f09fce50640 10 monclient: get_auth_request con 0x55f391722090 auth_method 0 2024-09-12T00:38:16.023 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:38:15.785+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:16.024 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:38:15.785+0000 7f09ffb4b9c0 20 searching for the correct realm 2024-09-12T00:38:16.024 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:38:15.785+0000 7f09fde52640 10 monclient: get_auth_request con 0x55f391726e30 auth_method 0 2024-09-12T00:38:16.024 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:38:15.789+0000 7f09fd651640 10 monclient: get_auth_request con 0x7f09f8018420 auth_method 0 2024-09-12T00:38:16.024 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:38:15.793+0000 7f09fce50640 10 monclient: get_auth_request con 0x7f09f0100040 auth_method 0 2024-09-12T00:38:16.024 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:38:15.793+0000 7f09fde52640 0 -- 172.21.15.138:0/1179187352 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55f391726e30 msgr2=0x55f3917292f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:16.024 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:38:15.793+0000 7f08ceffd640 1 client.7517.objecter ms_handle_reset 0x55f391726e30 session 0x55f3917267b0 osd.4 2024-09-12T00:38:16.025 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:38:15.793+0000 7f08ceffd640 10 monclient: _renew_subs 2024-09-12T00:38:16.025 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:38:15.793+0000 7f08ceffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:38:16.025 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:38:15.793+0000 7f09fde52640 10 monclient: get_auth_request con 0x7f08c8080db0 auth_method 0 2024-09-12T00:38:16.025 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:38:15.793+0000 7f09fde52640 10 monclient: get_auth_request con 0x7f09f8015900 auth_method 0 2024-09-12T00:38:16.025 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:38:15.801+0000 7f09fd651640 10 monclient: get_auth_request con 0x7f09f0118270 auth_method 0 2024-09-12T00:38:16.025 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:38:15.805+0000 7f09fde52640 0 -- 172.21.15.138:0/1179187352 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x55f39171a660 msgr2=0x55f39171ca80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:16.025 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:38:15.805+0000 7f08ceffd640 1 client.7517.objecter ms_handle_reset 0x55f39171a660 session 0x55f391719fe0 osd.6 2024-09-12T00:38:16.025 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:38:15.805+0000 7f09fde52640 10 monclient: get_auth_request con 0x55f391726e30 auth_method 0 2024-09-12T00:38:16.025 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:16.025 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:16.025 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:16.025 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:16.026 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:16.026 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:16.026 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:38:15.813+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.026 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.026 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.026 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:16.026 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.026 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:16.026 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 zone default found 2024-09-12T00:38:16.026 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 4 Realm: () 2024-09-12T00:38:16.026 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:16.026 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:16.027 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:16.027 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 zonegroup default 2024-09-12T00:38:16.027 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.027 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.027 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.027 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.027 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:38:15.817+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.027 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:38:15.821+0000 7f09ffb4b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.027 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:38:15.821+0000 7f09ffb4b9c0 20 started sync module instance, tier type = 2024-09-12T00:38:16.027 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:38:15.821+0000 7f09ffb4b9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:16.027 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=0 2024-09-12T00:38:16.027 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=1 2024-09-12T00:38:16.027 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=2 2024-09-12T00:38:16.028 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=3 2024-09-12T00:38:16.028 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=4 2024-09-12T00:38:16.028 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=5 2024-09-12T00:38:16.028 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:38:15.841+0000 7f09ffb4b9c0 20 add_watcher() i=6 2024-09-12T00:38:16.028 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:38:15.845+0000 7f09ffb4b9c0 20 add_watcher() i=7 2024-09-12T00:38:16.028 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:38:15.845+0000 7f09ffb4b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:16.028 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding auth protocol: cephx 2024-09-12T00:38:16.028 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding auth protocol: cephx 2024-09-12T00:38:16.028 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding auth protocol: cephx 2024-09-12T00:38:16.028 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: secure 2024-09-12T00:38:16.028 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: crc 2024-09-12T00:38:16.028 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: secure 2024-09-12T00:38:16.028 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: crc 2024-09-12T00:38:16.029 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: secure 2024-09-12T00:38:16.029 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: crc 2024-09-12T00:38:16.029 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: crc 2024-09-12T00:38:16.029 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: secure 2024-09-12T00:38:16.029 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:38:15.849+0000 7f08b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:16.029 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: crc 2024-09-12T00:38:16.029 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: secure 2024-09-12T00:38:16.029 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: crc 2024-09-12T00:38:16.029 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 AuthRegistry(0x7fff749d0f30) adding con mode: secure 2024-09-12T00:38:16.029 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:16.029 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:16.029 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:16.030 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command cache list hook 0x55f3916f4ee0 2024-09-12T00:38:16.030 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command cache inspect hook 0x55f3916f4ee0 2024-09-12T00:38:16.030 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command cache erase hook 0x55f3916f4ee0 2024-09-12T00:38:16.030 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command cache zap hook 0x55f3916f4ee0 2024-09-12T00:38:16.030 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:38:15.849+0000 7f09ffb4b9c0 5 note: GC not initialized 2024-09-12T00:38:16.030 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:38:15.853+0000 7f08b27e4640 20 reqs_thread_entry: start 2024-09-12T00:38:16.030 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command sync trace show hook 0x7f09f00bb040 2024-09-12T00:38:16.031 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command sync trace history hook 0x7f09f00bb040 2024-09-12T00:38:16.031 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command sync trace active hook 0x7f09f00bb040 2024-09-12T00:38:16.031 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 5 asok(0x55f3914242b0) register_command sync trace active_short hook 0x7f09f00bb040 2024-09-12T00:38:16.031 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:16.031 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 Filter name: none 2024-09-12T00:38:16.031 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:38:15.853+0000 7f0823fff640 20 reqs_thread_entry: start 2024-09-12T00:38:16.031 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:38:16.031 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.031 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:16.031 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:38:16.031 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:38:16.032 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 : miss 2024-09-12T00:38:16.032 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.032 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:16.032 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 info.flags=0x17 2024-09-12T00:38:16.032 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to cache LRU end 2024-09-12T00:38:16.032 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:16.032 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:16.032 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:38:15.853+0000 7f09ffb4b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 2024-09-12T00:38:16.032 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 info.flags=0x17 2024-09-12T00:38:16.032 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to cache LRU end 2024-09-12T00:38:16.032 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:16.032 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39, ofs0, ns] 2024-09-12T00:38:16.033 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:38:15.865+0000 7f08e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333476 cookie 94504605564144 notifier 7517 bl.length()=931 2024-09-12T00:38:16.033 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:38:15.865+0000 7f08e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 info.flags=0x17 2024-09-12T00:38:16.033 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:38:15.865+0000 7f08e0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to cache LRU end 2024-09-12T00:38:16.033 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:38:15.865+0000 7f08e0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:16.033 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): orig_sources= new_sources= 2024-09-12T00:38:16.033 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): potential sources added=[] removed=[] 2024-09-12T00:38:16.033 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): orig_dests= new_dests= 2024-09-12T00:38:16.033 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:38:15.865+0000 7f09ffb4b9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): potential dests added=[] removed=[] 2024-09-12T00:38:16.033 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.0 2024-09-12T00:38:16.033 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.0 2024-09-12T00:38:16.033 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.1 2024-09-12T00:38:16.033 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.1 2024-09-12T00:38:16.033 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.2 2024-09-12T00:38:16.034 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.2 2024-09-12T00:38:16.034 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.3 2024-09-12T00:38:16.034 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.3 2024-09-12T00:38:16.034 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.4 2024-09-12T00:38:16.034 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.4 2024-09-12T00:38:16.034 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.5 2024-09-12T00:38:16.035 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.5 2024-09-12T00:38:16.035 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.6 2024-09-12T00:38:16.035 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.6 2024-09-12T00:38:16.035 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.7 2024-09-12T00:38:16.035 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.7 2024-09-12T00:38:16.035 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.8 2024-09-12T00:38:16.036 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.8 2024-09-12T00:38:16.036 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.9 2024-09-12T00:38:16.036 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.9 2024-09-12T00:38:16.036 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.10 2024-09-12T00:38:16.036 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.10 2024-09-12T00:38:16.036 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.11 2024-09-12T00:38:16.037 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1.11 2024-09-12T00:38:16.037 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.0 2024-09-12T00:38:16.037 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1 2024-09-12T00:38:16.037 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:38:15.877+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2 2024-09-12T00:38:16.037 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:38:15.881+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.3 2024-09-12T00:38:16.037 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:38:15.881+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.4 2024-09-12T00:38:16.038 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:38:15.881+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.5 2024-09-12T00:38:16.038 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:38:15.885+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.6 2024-09-12T00:38:16.038 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:38:15.885+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.7 2024-09-12T00:38:16.038 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:38:15.885+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.8 2024-09-12T00:38:16.038 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:38:15.889+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.9 2024-09-12T00:38:16.038 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:38:15.889+0000 7f09ffb4b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.10 2024-09-12T00:38:16.039 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:38:15.897+0000 7f09ffb4b9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f09ffb4b9c0 time 2024-09-12T00:38:15.901704+0000 2024-09-12T00:38:16.039 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:16.039 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:16.039 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:16.039 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0a034252eb] 2024-09-12T00:38:16.039 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0a0342549f] 2024-09-12T00:38:16.040 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f38f73acc1] 2024-09-12T00:38:16.040 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55f38f74f01c] 2024-09-12T00:38:16.040 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55f38f7506a4] 2024-09-12T00:38:16.040 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:38:16.040 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0a0228bd90] 2024-09-12T00:38:16.040 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:38:16.040 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:38:16.041 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:16.041 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:38:15.901+0000 7f09ffb4b9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:16.041 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f09ffb4b9c0 thread_name:radosgw-admin 2024-09-12T00:38:16.041 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:16.041 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:16.041 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0a022a4520] 2024-09-12T00:38:16.042 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:38:16.042 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:38:16.042 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:38:16.042 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0a03425345] 2024-09-12T00:38:16.042 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0a0342549f] 2024-09-12T00:38:16.042 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f38f73acc1] 2024-09-12T00:38:16.042 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55f38f74f01c] 2024-09-12T00:38:16.043 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55f38f7506a4] 2024-09-12T00:38:16.043 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:38:16.043 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0a0228bd90] 2024-09-12T00:38:16.043 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:38:16.043 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:38:16.043 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:16.043 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:16.043 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:38:16.044 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:38:16.044 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:38:16.044 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:38:16.044 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:38:16.044 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:38:16.044 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:38:16.045 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:38:16.045 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:38:16.045 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:38:16.045 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:38:16.046 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:38:16.046 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:38:16.046 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:38:16.046 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:38:16.046 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:38:16.046 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:38:16.047 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:38:16.047 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:38:16.047 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:38:16.047 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:38:16.047 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:38:16.047 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:38:16.048 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:38:16.048 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:38:16.048 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:38:16.048 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:38:16.048 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:38:16.048 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:38:16.048 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:38:16.048 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:38:16.049 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:38:16.049 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:38:16.049 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:38:16.049 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:38:16.049 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:38:16.049 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:38:16.049 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:38:16.049 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:38:16.050 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:38:16.050 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:38:16.050 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:38:16.050 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:38:16.050 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:38:16.050 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:38:16.050 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:38:16.050 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:38:16.051 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:38:16.051 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:38:16.051 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:38:16.051 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:38:16.051 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:38:16.051 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:38:16.051 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:38:16.052 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:38:16.052 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:38:16.052 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:38:16.052 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:38:16.052 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:38:16.052 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:38:16.053 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:38:16.053 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:38:16.053 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:38:16.053 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:38:16.053 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:38:16.053 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:38:16.054 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:38:16.054 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:38:16.054 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:38:16.054 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:38:16.054 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:38:16.054 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:38:16.055 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:38:16.055 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:38:16.055 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:38:16.055 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:38:16.055 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:38:16.055 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:38:16.056 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:38:16.056 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:38:16.056 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:38:16.056 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:38:16.056 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:38:16.056 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:38:16.056 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:38:16.056 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:38:16.056 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:38:16.057 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:38:16.057 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:38:16.057 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:38:16.057 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:38:16.057 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:38:16.057 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:38:16.057 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:38:16.057 INFO:tasks.workunit.client.0.smithi138.stderr: 7f0823fff640 / http_manager 2024-09-12T00:38:16.057 INFO:tasks.workunit.client.0.smithi138.stderr: 7f08b27e4640 / http_manager 2024-09-12T00:38:16.057 INFO:tasks.workunit.client.0.smithi138.stderr: 7f08b37e6640 / rgw_dt_lg_renew 2024-09-12T00:38:16.058 INFO:tasks.workunit.client.0.smithi138.stderr: 7f08ceffd640 / ms_dispatch 2024-09-12T00:38:16.058 INFO:tasks.workunit.client.0.smithi138.stderr: 7f08e0ff9640 / io_context_pool 2024-09-12T00:38:16.058 INFO:tasks.workunit.client.0.smithi138.stderr: 7f08e2ffd640 / ms_dispatch 2024-09-12T00:38:16.058 INFO:tasks.workunit.client.0.smithi138.stderr: 7f08e9e03640 / ms_dispatch 2024-09-12T00:38:16.058 INFO:tasks.workunit.client.0.smithi138.stderr: 7f08eb606640 / io_context_pool 2024-09-12T00:38:16.058 INFO:tasks.workunit.client.0.smithi138.stderr: 7f09fce50640 / msgr-worker-2 2024-09-12T00:38:16.058 INFO:tasks.workunit.client.0.smithi138.stderr: 7f09fd651640 / msgr-worker-1 2024-09-12T00:38:16.058 INFO:tasks.workunit.client.0.smithi138.stderr: 7f09fde52640 / msgr-worker-0 2024-09-12T00:38:16.058 INFO:tasks.workunit.client.0.smithi138.stderr: 7f09fe653640 / io_context_pool 2024-09-12T00:38:16.058 INFO:tasks.workunit.client.0.smithi138.stderr: 7f09ffb4b9c0 / radosgw-admin 2024-09-12T00:38:16.058 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:38:16.058 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:38:16.058 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:38:15.904644Z_613c9b49-e816-4cf2-852b-337d9d8e2619/log 2024-09-12T00:38:16.059 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:38:16.059 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-12T00:38:16.059 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:38:16.060 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:16.060 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:16.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.981+0000 7fb95acfb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.985+0000 7fb95acfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.985+0000 7fb95acfb9c0 20 realm 2024-09-12T00:38:16.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.985+0000 7fb95acfb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.985+0000 7fb95acfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.985+0000 7fb95acfb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:16.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.985+0000 7fb95acfb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.985+0000 7fb95acfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.985+0000 7fb95acfb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.985+0000 7fb95acfb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:16.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.985+0000 7fb95acfb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.989+0000 7fb95acfb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:16.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.989+0000 7fb95acfb9c0 20 searching for the correct realm 2024-09-12T00:38:16.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:15.993+0000 7fb959002640 0 -- 172.21.15.138:0/3209740673 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fb9500650f0 msgr2=0x7fb95005a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:16.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.209+0000 7fb959002640 0 -- 172.21.15.138:0/3209740673 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x56160402f930 msgr2=0x561604031df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:16.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.217+0000 7fb95acfb9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:16.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.217+0000 7fb95acfb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:16.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.217+0000 7fb95acfb9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:16.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.217+0000 7fb95acfb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:16.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.217+0000 7fb95acfb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:16.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.217+0000 7fb95acfb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:16.216 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.217+0000 7fb95acfb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.217+0000 7fb95acfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:16.217 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:16.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 20 zone default found 2024-09-12T00:38:16.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 4 Realm: () 2024-09-12T00:38:16.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:16.218 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:16.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:16.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 20 zonegroup default 2024-09-12T00:38:16.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.219 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 20 started sync module instance, tier type = 2024-09-12T00:38:16.220 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.221+0000 7fb95acfb9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:16.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.245+0000 7fb95acfb9c0 20 add_watcher() i=0 2024-09-12T00:38:16.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.245+0000 7fb95acfb9c0 20 add_watcher() i=1 2024-09-12T00:38:16.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.245+0000 7fb95acfb9c0 20 add_watcher() i=2 2024-09-12T00:38:16.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.245+0000 7fb95acfb9c0 20 add_watcher() i=3 2024-09-12T00:38:16.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.245+0000 7fb95acfb9c0 20 add_watcher() i=4 2024-09-12T00:38:16.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.245+0000 7fb95acfb9c0 20 add_watcher() i=5 2024-09-12T00:38:16.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.245+0000 7fb95acfb9c0 20 add_watcher() i=6 2024-09-12T00:38:16.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.245+0000 7fb95acfb9c0 20 add_watcher() i=7 2024-09-12T00:38:16.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.245+0000 7fb95acfb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:16.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.249+0000 7fb80efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:16.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.249+0000 7fb95acfb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:16.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.249+0000 7fb95acfb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:16.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.253+0000 7fb95acfb9c0 5 note: GC not initialized 2024-09-12T00:38:16.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.253+0000 7fb80dfdb640 20 reqs_thread_entry: start 2024-09-12T00:38:16.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.253+0000 7fb95acfb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:16.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.253+0000 7fb95acfb9c0 20 Filter name: none 2024-09-12T00:38:16.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.253+0000 7fb77f7fe640 20 reqs_thread_entry: start 2024-09-12T00:38:16.249 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.253+0000 7fb95acfb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.253+0000 7fb95acfb9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:16.250 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.253+0000 7fb95acfb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.253+0000 7fb95acfb9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:38:16.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.253+0000 7fb95acfb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:16.251 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.253+0000 7fb95acfb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.253+0000 7fb95acfb9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:16.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.253+0000 7fb95acfb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.253+0000 7fb95acfb9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:38:16.252 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.253+0000 7fb95acfb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:16.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.257+0000 7fb80efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:16.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.261+0000 7fb95acfb9c0 20 remove_watcher() i=0 2024-09-12T00:38:16.260 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.261+0000 7fb95acfb9c0 2 removed watcher, disabling cache 2024-09-12T00:38:16.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.265+0000 7fb95acfb9c0 20 remove_watcher() i=1 2024-09-12T00:38:16.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.265+0000 7fb95acfb9c0 20 remove_watcher() i=2 2024-09-12T00:38:16.266 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.269+0000 7fb95acfb9c0 20 remove_watcher() i=3 2024-09-12T00:38:16.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.269+0000 7fb95acfb9c0 20 remove_watcher() i=4 2024-09-12T00:38:16.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.273+0000 7fb95acfb9c0 20 remove_watcher() i=5 2024-09-12T00:38:16.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.273+0000 7fb95acfb9c0 20 remove_watcher() i=6 2024-09-12T00:38:16.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.277+0000 7fb95acfb9c0 20 remove_watcher() i=7 2024-09-12T00:38:16.290 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:16.290 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:38:16.290 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-change-reshard-state id: e2043445-c131-4520-984d-b4d52f038a6b.4538.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:38:16.290 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:16.291 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:16.291 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:16.304 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:16.304 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:16.354 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:38:16.391 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:16.391 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:16.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.441+0000 7fd3871609c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.441+0000 7fd3871609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.441+0000 7fd3871609c0 20 realm 2024-09-12T00:38:16.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.441+0000 7fd3871609c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.441+0000 7fd3871609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.441+0000 7fd3871609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.441+0000 7fd3871609c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.441+0000 7fd3871609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.441+0000 7fd3871609c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.445+0000 7fd3871609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:16.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.445+0000 7fd3871609c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.445+0000 7fd3871609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:16.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.445+0000 7fd3871609c0 20 searching for the correct realm 2024-09-12T00:38:16.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.449+0000 7fd385467640 0 -- 172.21.15.138:0/2814725511 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fd37c124a10 msgr2=0x7fd37c120d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:16.662 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.665+0000 7fd385467640 0 -- 172.21.15.138:0/2814725511 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55a6c3c0ac40 msgr2=0x55a6c3c0d100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:16.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.673+0000 7fd3871609c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:16.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.673+0000 7fd3871609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:16.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.673+0000 7fd3871609c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:16.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.673+0000 7fd3871609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:16.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.673+0000 7fd3871609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:16.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.673+0000 7fd3871609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:16.671 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.673+0000 7fd3871609c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.673+0000 7fd3871609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.673+0000 7fd3871609c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.673+0000 7fd3871609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:16.672 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.673+0000 7fd3871609c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.677+0000 7fd3871609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:16.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.677+0000 7fd3871609c0 20 zone default found 2024-09-12T00:38:16.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.677+0000 7fd3871609c0 4 Realm: () 2024-09-12T00:38:16.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.677+0000 7fd3871609c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:16.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.677+0000 7fd3871609c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:16.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.677+0000 7fd3871609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:16.673 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.677+0000 7fd3871609c0 20 zonegroup default 2024-09-12T00:38:16.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.677+0000 7fd3871609c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.677+0000 7fd3871609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.674 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.677+0000 7fd3871609c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.677+0000 7fd3871609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.677+0000 7fd3871609c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.675 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.677+0000 7fd3871609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:16.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.677+0000 7fd3871609c0 20 started sync module instance, tier type = 2024-09-12T00:38:16.676 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.677+0000 7fd3871609c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:16.697 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.701+0000 7fd3871609c0 20 add_watcher() i=0 2024-09-12T00:38:16.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.701+0000 7fd3871609c0 20 add_watcher() i=1 2024-09-12T00:38:16.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.701+0000 7fd3871609c0 20 add_watcher() i=2 2024-09-12T00:38:16.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.701+0000 7fd3871609c0 20 add_watcher() i=3 2024-09-12T00:38:16.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.701+0000 7fd3871609c0 20 add_watcher() i=4 2024-09-12T00:38:16.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.701+0000 7fd3871609c0 20 add_watcher() i=5 2024-09-12T00:38:16.698 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.701+0000 7fd3871609c0 20 add_watcher() i=6 2024-09-12T00:38:16.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.701+0000 7fd3871609c0 20 add_watcher() i=7 2024-09-12T00:38:16.700 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.701+0000 7fd3871609c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:16.704 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.705+0000 7fd23b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:16.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.709+0000 7fd3871609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:16.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.709+0000 7fd3871609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:16.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.709+0000 7fd3871609c0 5 note: GC not initialized 2024-09-12T00:38:16.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.709+0000 7fd23a7e4640 20 reqs_thread_entry: start 2024-09-12T00:38:16.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.709+0000 7fd3871609c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:16.706 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.709+0000 7fd3871609c0 20 Filter name: none 2024-09-12T00:38:16.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.709+0000 7fd2337fe640 20 reqs_thread_entry: start 2024-09-12T00:38:16.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.709+0000 7fd3871609c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:38:16.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.709+0000 7fd3871609c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.709+0000 7fd3871609c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:16.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.709+0000 7fd3871609c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:38:16.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.709+0000 7fd3871609c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:38:16.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.709+0000 7fd3871609c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 : miss 2024-09-12T00:38:16.708 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.709+0000 7fd3871609c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:16.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.713+0000 7fd3871609c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:38:16.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.713+0000 7fd3871609c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 info.flags=0x17 2024-09-12T00:38:16.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.713+0000 7fd3871609c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to cache LRU end 2024-09-12T00:38:16.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.713+0000 7fd3871609c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:16.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.713+0000 7fd3871609c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:16.709 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.713+0000 7fd3871609c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 2024-09-12T00:38:16.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.713+0000 7fd3871609c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to be held by another RGW process; skipping for now 2024-09-12T00:38:16.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.713+0000 7fd23b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:16.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.721+0000 7fd3871609c0 20 remove_watcher() i=0 2024-09-12T00:38:16.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.721+0000 7fd3871609c0 2 removed watcher, disabling cache 2024-09-12T00:38:16.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.721+0000 7fd3871609c0 20 remove_watcher() i=1 2024-09-12T00:38:16.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.725+0000 7fd3871609c0 20 remove_watcher() i=2 2024-09-12T00:38:16.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.725+0000 7fd3871609c0 20 remove_watcher() i=3 2024-09-12T00:38:16.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.729+0000 7fd3871609c0 20 remove_watcher() i=4 2024-09-12T00:38:16.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.729+0000 7fd3871609c0 20 remove_watcher() i=5 2024-09-12T00:38:16.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.733+0000 7fd3871609c0 20 remove_watcher() i=6 2024-09-12T00:38:16.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:16.737+0000 7fd3871609c0 20 remove_watcher() i=7 2024-09-12T00:38:16.749 INFO:tasks.workunit.client.0.smithi138.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:38:46.758 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:38:46.794 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:46.794 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:46.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:46.841+0000 7f5c44a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:46.845+0000 7f5c44a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:46.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:46.845+0000 7f5c44a2a9c0 20 realm 2024-09-12T00:38:46.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:46.845+0000 7f5c44a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:46.845+0000 7f5c44a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:46.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:46.845+0000 7f5c44a2a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:46.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:46.845+0000 7f5c44a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:46.845+0000 7f5c44a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:46.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:46.845+0000 7f5c44a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:46.845+0000 7f5c44a2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:46.843 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:46.845+0000 7f5c44a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:46.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:46.845+0000 7f5c44a2a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:46.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:46.845+0000 7f5c44a2a9c0 20 searching for the correct realm 2024-09-12T00:38:46.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:46.853+0000 7f5c42d31640 0 -- 172.21.15.138:0/53844747 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f5c3c030040 msgr2=0x7f5c3c008920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:47.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.069+0000 7f5c42d31640 0 -- 172.21.15.138:0/53844747 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x56293270b4b0 msgr2=0x56293270d970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:47.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.077+0000 7f5c44a2a9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:47.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.077+0000 7f5c44a2a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:47.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.077+0000 7f5c44a2a9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:47.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.077+0000 7f5c44a2a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.077+0000 7f5c44a2a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.077+0000 7f5c44a2a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.077+0000 7f5c44a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.077+0000 7f5c44a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.077+0000 7f5c44a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.081+0000 7f5c44a2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:47.077 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.081+0000 7f5c44a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.081+0000 7f5c44a2a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:47.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.081+0000 7f5c44a2a9c0 20 zone default found 2024-09-12T00:38:47.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.081+0000 7f5c44a2a9c0 4 Realm: () 2024-09-12T00:38:47.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.081+0000 7f5c44a2a9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:47.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.081+0000 7f5c44a2a9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:47.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.081+0000 7f5c44a2a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:47.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.081+0000 7f5c44a2a9c0 20 zonegroup default 2024-09-12T00:38:47.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.081+0000 7f5c44a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.081+0000 7f5c44a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.081+0000 7f5c44a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.081+0000 7f5c44a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.081+0000 7f5c44a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.081+0000 7f5c44a2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.081+0000 7f5c44a2a9c0 20 started sync module instance, tier type = 2024-09-12T00:38:47.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.081+0000 7f5c44a2a9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:47.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.105+0000 7f5c44a2a9c0 20 add_watcher() i=0 2024-09-12T00:38:47.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.105+0000 7f5c44a2a9c0 20 add_watcher() i=1 2024-09-12T00:38:47.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.105+0000 7f5c44a2a9c0 20 add_watcher() i=2 2024-09-12T00:38:47.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.105+0000 7f5c44a2a9c0 20 add_watcher() i=3 2024-09-12T00:38:47.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.105+0000 7f5c44a2a9c0 20 add_watcher() i=4 2024-09-12T00:38:47.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.105+0000 7f5c44a2a9c0 20 add_watcher() i=5 2024-09-12T00:38:47.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.105+0000 7f5c44a2a9c0 20 add_watcher() i=6 2024-09-12T00:38:47.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.109+0000 7f5c44a2a9c0 20 add_watcher() i=7 2024-09-12T00:38:47.106 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.109+0000 7f5c44a2a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:47.110 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.113+0000 7f5af8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:47.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.113+0000 7f5c44a2a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:47.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.113+0000 7f5c44a2a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:47.111 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.113+0000 7f5c44a2a9c0 5 note: GC not initialized 2024-09-12T00:38:47.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.113+0000 7f5a737fe640 20 reqs_thread_entry: start 2024-09-12T00:38:47.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.113+0000 7f5c44a2a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:47.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.113+0000 7f5c44a2a9c0 20 Filter name: none 2024-09-12T00:38:47.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.113+0000 7f5a717fa640 20 reqs_thread_entry: start 2024-09-12T00:38:47.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.117+0000 7f5c44a2a9c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:38:47.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.117+0000 7f5c44a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.113 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.117+0000 7f5c44a2a9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:47.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.117+0000 7f5c44a2a9c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:38:47.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.117+0000 7f5c44a2a9c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:38:47.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.117+0000 7f5c44a2a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 : miss 2024-09-12T00:38:47.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.117+0000 7f5c44a2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.117+0000 7f5c44a2a9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:38:47.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.117+0000 7f5c44a2a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 info.flags=0x17 2024-09-12T00:38:47.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.117+0000 7f5c44a2a9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to cache LRU end 2024-09-12T00:38:47.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.117+0000 7f5c44a2a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:47.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.117+0000 7f5c44a2a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:47.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.117+0000 7f5c44a2a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 2024-09-12T00:38:47.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.121+0000 7f5c44a2a9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:38:47.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.133+0000 7f5c44a2a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 info.flags=0x17 2024-09-12T00:38:47.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.133+0000 7f5c44a2a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to cache LRU end 2024-09-12T00:38:47.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.133+0000 7f5c44a2a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:47.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.133+0000 7f5c44a2a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39, ofs0, ns] 2024-09-12T00:38:47.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.133+0000 7f5b257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333477 cookie 94734939900800 notifier 8094 bl.length()=931 2024-09-12T00:38:47.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.133+0000 7f5b257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 info.flags=0x17 2024-09-12T00:38:47.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.133+0000 7f5b257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to cache LRU end 2024-09-12T00:38:47.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.133+0000 7f5b257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:47.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.133+0000 7f5c44a2a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): orig_sources= new_sources= 2024-09-12T00:38:47.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.133+0000 7f5c44a2a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): potential sources added=[] removed=[] 2024-09-12T00:38:47.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.133+0000 7f5c44a2a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): orig_dests= new_dests= 2024-09-12T00:38:47.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.133+0000 7f5c44a2a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): potential dests added=[] removed=[] 2024-09-12T00:38:47.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.0 2024-09-12T00:38:47.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.0 2024-09-12T00:38:47.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.1 2024-09-12T00:38:47.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.1 2024-09-12T00:38:47.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.2 2024-09-12T00:38:47.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.2 2024-09-12T00:38:47.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.3 2024-09-12T00:38:47.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.3 2024-09-12T00:38:47.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.4 2024-09-12T00:38:47.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.4 2024-09-12T00:38:47.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.5 2024-09-12T00:38:47.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.5 2024-09-12T00:38:47.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.6 2024-09-12T00:38:47.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.6 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.7 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.7 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.8 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.8 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.9 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.9 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.10 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.10 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.11 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2.11 2024-09-12T00:38:47.147 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.0 2024-09-12T00:38:47.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1 2024-09-12T00:38:47.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2 2024-09-12T00:38:47.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.149+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.3 2024-09-12T00:38:47.149 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.153+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.4 2024-09-12T00:38:47.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.153+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.5 2024-09-12T00:38:47.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.153+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.6 2024-09-12T00:38:47.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.157+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.7 2024-09-12T00:38:47.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.157+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.8 2024-09-12T00:38:47.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.157+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.9 2024-09-12T00:38:47.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.161+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.10 2024-09-12T00:38:47.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.165+0000 7f5c44a2a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:47.162 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.165+0000 7f5c44a2a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 2024-09-12T00:38:47.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.169+0000 7f5c44a2a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 info.flags=0x17 2024-09-12T00:38:47.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.169+0000 7f5c44a2a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to cache LRU end 2024-09-12T00:38:47.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.169+0000 7f5c44a2a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:47.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.169+0000 7f5c44a2a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39, ofs0, ns] 2024-09-12T00:38:47.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.169+0000 7f5b257fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333478 cookie 94734939900800 notifier 8094 bl.length()=931 2024-09-12T00:38:47.165 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.169+0000 7f5b257fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 info.flags=0x17 2024-09-12T00:38:47.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.169+0000 7f5b257fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to cache LRU end 2024-09-12T00:38:47.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.169+0000 7f5b257fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:47.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.169+0000 7f5c44a2a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): orig_sources= new_sources= 2024-09-12T00:38:47.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.169+0000 7f5c44a2a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): potential sources added=[] removed=[] 2024-09-12T00:38:47.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.169+0000 7f5c44a2a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): orig_dests= new_dests= 2024-09-12T00:38:47.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.169+0000 7f5c44a2a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): potential dests added=[] removed=[] 2024-09-12T00:38:47.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.177+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.0 2024-09-12T00:38:47.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.177+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.1 2024-09-12T00:38:47.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.177+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.2 2024-09-12T00:38:47.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.177+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.3 2024-09-12T00:38:47.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.177+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.4 2024-09-12T00:38:47.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.181+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.5 2024-09-12T00:38:47.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.181+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.6 2024-09-12T00:38:47.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.181+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.7 2024-09-12T00:38:47.179 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.181+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.8 2024-09-12T00:38:47.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.181+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.9 2024-09-12T00:38:47.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.185+0000 7f5c44a2a9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.39.10 2024-09-12T00:38:47.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.185+0000 7f5c44a2a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:38:47.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.185+0000 7f5c44a2a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 2024-09-12T00:38:47.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.185+0000 7f5c44a2a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 info.flags=0x17 2024-09-12T00:38:47.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.185+0000 7f5c44a2a9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to cache LRU end 2024-09-12T00:38:47.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.185+0000 7f5c44a2a9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:47.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.185+0000 7f5c44a2a9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39, ofs0, ns] 2024-09-12T00:38:47.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.189+0000 7f5b25ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333479 cookie 94734939900800 notifier 8094 bl.length()=899 2024-09-12T00:38:47.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.189+0000 7f5b25ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 info.flags=0x17 2024-09-12T00:38:47.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.189+0000 7f5b25ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:e2043445-c131-4520-984d-b4d52f038a6b.4538.39 to cache LRU end 2024-09-12T00:38:47.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.189+0000 7f5b25ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:38:47.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.189+0000 7f5c44a2a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): orig_sources= new_sources= 2024-09-12T00:38:47.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.189+0000 7f5c44a2a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): potential sources added=[] removed=[] 2024-09-12T00:38:47.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.189+0000 7f5c44a2a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): orig_dests= new_dests= 2024-09-12T00:38:47.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.189+0000 7f5c44a2a9c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[e2043445-c131-4520-984d-b4d52f038a6b.4538.39]): potential dests added=[] removed=[] 2024-09-12T00:38:47.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.193+0000 7f5c44a2a9c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:38:47.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.197+0000 7f5af8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:47.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.201+0000 7f5c44a2a9c0 20 remove_watcher() i=0 2024-09-12T00:38:47.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.201+0000 7f5c44a2a9c0 2 removed watcher, disabling cache 2024-09-12T00:38:47.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.201+0000 7f5c44a2a9c0 20 remove_watcher() i=1 2024-09-12T00:38:47.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.205+0000 7f5c44a2a9c0 20 remove_watcher() i=2 2024-09-12T00:38:47.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.205+0000 7f5c44a2a9c0 20 remove_watcher() i=3 2024-09-12T00:38:47.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.209+0000 7f5c44a2a9c0 20 remove_watcher() i=4 2024-09-12T00:38:47.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.209+0000 7f5c44a2a9c0 20 remove_watcher() i=5 2024-09-12T00:38:47.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.213+0000 7f5c44a2a9c0 20 remove_watcher() i=6 2024-09-12T00:38:47.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.217+0000 7f5c44a2a9c0 20 remove_watcher() i=7 2024-09-12T00:38:47.229 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:38:47.261 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:47.261 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:47.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.305+0000 7fac33d3b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.309+0000 7fac33d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.309+0000 7fac33d3b9c0 20 realm 2024-09-12T00:38:47.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.309+0000 7fac33d3b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.309+0000 7fac33d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.309+0000 7fac33d3b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:47.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.309+0000 7fac33d3b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.309+0000 7fac33d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.309+0000 7fac33d3b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.309+0000 7fac33d3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:47.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.309+0000 7fac33d3b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.309+0000 7fac33d3b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:47.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.309+0000 7fac33d3b9c0 20 searching for the correct realm 2024-09-12T00:38:47.312 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.317+0000 7fac32042640 0 -- 172.21.15.138:0/946888498 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fac2c029410 msgr2=0x7fac2c029890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:47.531 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.533+0000 7fac32042640 0 -- 172.21.15.138:0/946888498 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55c07bd74c40 msgr2=0x55c07bd77100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:47.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.541+0000 7fac33d3b9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:47.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.541+0000 7fac33d3b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:47.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.541+0000 7fac33d3b9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:47.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.541+0000 7fac33d3b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:47.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.541+0000 7fac33d3b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:47.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.541+0000 7fac33d3b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:47.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.541+0000 7fac33d3b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.545+0000 7fac33d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.541 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.545+0000 7fac33d3b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.545+0000 7fac33d3b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:47.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.545+0000 7fac33d3b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.545+0000 7fac33d3b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:47.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.545+0000 7fac33d3b9c0 20 zone default found 2024-09-12T00:38:47.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.545+0000 7fac33d3b9c0 4 Realm: () 2024-09-12T00:38:47.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.545+0000 7fac33d3b9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:47.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.545+0000 7fac33d3b9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:47.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.545+0000 7fac33d3b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:47.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.545+0000 7fac33d3b9c0 20 zonegroup default 2024-09-12T00:38:47.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.545+0000 7fac33d3b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.545+0000 7fac33d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.545+0000 7fac33d3b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.549+0000 7fac33d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.549+0000 7fac33d3b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.549+0000 7fac33d3b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.549+0000 7fac33d3b9c0 20 started sync module instance, tier type = 2024-09-12T00:38:47.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.549+0000 7fac33d3b9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:47.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.573+0000 7fac33d3b9c0 20 add_watcher() i=0 2024-09-12T00:38:47.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.573+0000 7fac33d3b9c0 20 add_watcher() i=1 2024-09-12T00:38:47.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.573+0000 7fac33d3b9c0 20 add_watcher() i=2 2024-09-12T00:38:47.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.573+0000 7fac33d3b9c0 20 add_watcher() i=3 2024-09-12T00:38:47.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.573+0000 7fac33d3b9c0 20 add_watcher() i=4 2024-09-12T00:38:47.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.573+0000 7fac33d3b9c0 20 add_watcher() i=5 2024-09-12T00:38:47.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.573+0000 7fac33d3b9c0 20 add_watcher() i=6 2024-09-12T00:38:47.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.577+0000 7fac33d3b9c0 20 add_watcher() i=7 2024-09-12T00:38:47.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.577+0000 7fac33d3b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:47.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.581+0000 7faae37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:47.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.581+0000 7fac33d3b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:47.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.581+0000 7fac33d3b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:47.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.581+0000 7fac33d3b9c0 5 note: GC not initialized 2024-09-12T00:38:47.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.581+0000 7faae27fc640 20 reqs_thread_entry: start 2024-09-12T00:38:47.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.581+0000 7fac33d3b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:47.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.581+0000 7fac33d3b9c0 20 Filter name: none 2024-09-12T00:38:47.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.581+0000 7faa53fff640 20 reqs_thread_entry: start 2024-09-12T00:38:47.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.581+0000 7fac33d3b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.581+0000 7fac33d3b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:47.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.581+0000 7fac33d3b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.585+0000 7fac33d3b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:47.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.585+0000 7fac33d3b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:47.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.585+0000 7fac33d3b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.585+0000 7fac33d3b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:38:47.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.585+0000 7fac33d3b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.585+0000 7fac33d3b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:38:47.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.585+0000 7fac33d3b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:47.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.589+0000 7faae37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:47.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.593+0000 7fac33d3b9c0 20 remove_watcher() i=0 2024-09-12T00:38:47.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.593+0000 7fac33d3b9c0 2 removed watcher, disabling cache 2024-09-12T00:38:47.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.593+0000 7fac33d3b9c0 20 remove_watcher() i=1 2024-09-12T00:38:47.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.597+0000 7fac33d3b9c0 20 remove_watcher() i=2 2024-09-12T00:38:47.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.601+0000 7fac33d3b9c0 20 remove_watcher() i=3 2024-09-12T00:38:47.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.601+0000 7fac33d3b9c0 20 remove_watcher() i=4 2024-09-12T00:38:47.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.605+0000 7fac33d3b9c0 20 remove_watcher() i=5 2024-09-12T00:38:47.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.605+0000 7fac33d3b9c0 20 remove_watcher() i=6 2024-09-12T00:38:47.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.609+0000 7fac33d3b9c0 20 remove_watcher() i=7 2024-09-12T00:38:47.621 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:47.621 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:38:47.621 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: abort-at-change-reshard-state id: e2043445-c131-4520-984d-b4d52f038a6b.4538.39 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:38:47.621 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:47.624 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.624 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:47.628 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.628 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:47.681 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:47.681 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:47.730 INFO:tasks.workunit.client.0.smithi138.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T00:38:47.731 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:38:47.758 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:47.758 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:47.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.805+0000 7f77703139c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.805+0000 7f77703139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.805+0000 7f77703139c0 20 realm 2024-09-12T00:38:47.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.805+0000 7f77703139c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.805+0000 7f77703139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.805+0000 7f77703139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:47.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.805+0000 7f77703139c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.805+0000 7f77703139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:47.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.805+0000 7f77703139c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.809+0000 7f77703139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:47.805 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.809+0000 7f77703139c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:47.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.809+0000 7f77703139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:47.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.809+0000 7f77703139c0 20 searching for the correct realm 2024-09-12T00:38:47.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:47.813+0000 7f776e61a640 0 -- 172.21.15.138:0/3161575729 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f77681230b0 msgr2=0x7f77680ceae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:48.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.029+0000 7f776e61a640 0 -- 172.21.15.138:0/3161575729 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55af4e530e40 msgr2=0x55af4e5332e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:48.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.037+0000 7f77703139c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:48.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.037+0000 7f77703139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:48.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.037+0000 7f77703139c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:48.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.037+0000 7f77703139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:48.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.037+0000 7f77703139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:48.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.037+0000 7f77703139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:48.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.037+0000 7f77703139c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.041+0000 7f77703139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.041+0000 7f77703139c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.041+0000 7f77703139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:48.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.041+0000 7f77703139c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.041+0000 7f77703139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:48.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.041+0000 7f77703139c0 20 zone default found 2024-09-12T00:38:48.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.041+0000 7f77703139c0 4 Realm: () 2024-09-12T00:38:48.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.041+0000 7f77703139c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:48.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.041+0000 7f77703139c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:48.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.041+0000 7f77703139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:48.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.041+0000 7f77703139c0 20 zonegroup default 2024-09-12T00:38:48.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.041+0000 7f77703139c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.041+0000 7f77703139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.041+0000 7f77703139c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.041+0000 7f77703139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.041+0000 7f77703139c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.045+0000 7f77703139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.045+0000 7f77703139c0 20 started sync module instance, tier type = 2024-09-12T00:38:48.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.045+0000 7f77703139c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:48.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.065+0000 7f77703139c0 20 add_watcher() i=0 2024-09-12T00:38:48.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.065+0000 7f77703139c0 20 add_watcher() i=1 2024-09-12T00:38:48.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.065+0000 7f77703139c0 20 add_watcher() i=2 2024-09-12T00:38:48.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.065+0000 7f77703139c0 20 add_watcher() i=3 2024-09-12T00:38:48.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.065+0000 7f77703139c0 20 add_watcher() i=4 2024-09-12T00:38:48.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.065+0000 7f77703139c0 20 add_watcher() i=5 2024-09-12T00:38:48.065 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.065+0000 7f77703139c0 20 add_watcher() i=6 2024-09-12T00:38:48.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.069+0000 7f77703139c0 20 add_watcher() i=7 2024-09-12T00:38:48.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.069+0000 7f77703139c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:48.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.073+0000 7f761f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:48.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.073+0000 7f77703139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:48.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.073+0000 7f77703139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:48.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.073+0000 7f77703139c0 5 note: GC not initialized 2024-09-12T00:38:48.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.077+0000 7f761e7fc640 20 reqs_thread_entry: start 2024-09-12T00:38:48.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.077+0000 7f77703139c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:48.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.077+0000 7f77703139c0 20 Filter name: none 2024-09-12T00:38:48.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.077+0000 7f758ffff640 20 reqs_thread_entry: start 2024-09-12T00:38:48.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.077+0000 7f77703139c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.077+0000 7f77703139c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:38:48.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.077+0000 7f77703139c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.077+0000 7f77703139c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:38:48.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.077+0000 7f77703139c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:48.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.077+0000 7f77703139c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.075 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.077+0000 7f77703139c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:38:48.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.077+0000 7f77703139c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.077+0000 7f77703139c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:38:48.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.077+0000 7f77703139c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:48.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.081+0000 7f761f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:48.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.085+0000 7f77703139c0 20 remove_watcher() i=0 2024-09-12T00:38:48.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.085+0000 7f77703139c0 2 removed watcher, disabling cache 2024-09-12T00:38:48.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.089+0000 7f77703139c0 20 remove_watcher() i=1 2024-09-12T00:38:48.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.089+0000 7f77703139c0 20 remove_watcher() i=2 2024-09-12T00:38:48.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.093+0000 7f77703139c0 20 remove_watcher() i=3 2024-09-12T00:38:48.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.093+0000 7f77703139c0 20 remove_watcher() i=4 2024-09-12T00:38:48.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.097+0000 7f77703139c0 20 remove_watcher() i=5 2024-09-12T00:38:48.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.101+0000 7f77703139c0 20 remove_watcher() i=6 2024-09-12T00:38:48.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.101+0000 7f77703139c0 20 remove_watcher() i=7 2024-09-12T00:38:48.117 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.117 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:38:48.117 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: a-bucket id: e2043445-c131-4520-984d-b4d52f038a6b.4538.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T00:38:48.117 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.117 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:38:48.146 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:48.146 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:48.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.193+0000 7efd1e8999c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.197+0000 7efd1e8999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.197+0000 7efd1e8999c0 20 realm 2024-09-12T00:38:48.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.197+0000 7efd1e8999c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.197+0000 7efd1e8999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.197+0000 7efd1e8999c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:48.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.197+0000 7efd1e8999c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.197+0000 7efd1e8999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.197+0000 7efd1e8999c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.197+0000 7efd1e8999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:48.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.197+0000 7efd1e8999c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.197+0000 7efd1e8999c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:48.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.197+0000 7efd1e8999c0 20 searching for the correct realm 2024-09-12T00:38:48.202 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.205+0000 7efd1cba0640 0 -- 172.21.15.138:0/649898416 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7efd14120460 msgr2=0x7efd140f6500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:48.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.421+0000 7efd1cba0640 0 -- 172.21.15.138:0/649898416 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55c408014110 msgr2=0x55c4080165b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:48.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.429+0000 7efd1e8999c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:48.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.429+0000 7efd1e8999c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:48.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.429+0000 7efd1e8999c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:48.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.429+0000 7efd1e8999c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:48.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.429+0000 7efd1e8999c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:48.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.429+0000 7efd1e8999c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:48.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.429+0000 7efd1e8999c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.433+0000 7efd1e8999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.433+0000 7efd1e8999c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.433+0000 7efd1e8999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:48.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.433+0000 7efd1e8999c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.433+0000 7efd1e8999c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:48.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.433+0000 7efd1e8999c0 20 zone default found 2024-09-12T00:38:48.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.433+0000 7efd1e8999c0 4 Realm: () 2024-09-12T00:38:48.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.433+0000 7efd1e8999c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:48.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.433+0000 7efd1e8999c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:48.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.433+0000 7efd1e8999c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:48.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.433+0000 7efd1e8999c0 20 zonegroup default 2024-09-12T00:38:48.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.433+0000 7efd1e8999c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.433+0000 7efd1e8999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.433+0000 7efd1e8999c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.437+0000 7efd1e8999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.437+0000 7efd1e8999c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.437+0000 7efd1e8999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.437+0000 7efd1e8999c0 20 started sync module instance, tier type = 2024-09-12T00:38:48.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.437+0000 7efd1e8999c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:48.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.457+0000 7efd1e8999c0 20 add_watcher() i=0 2024-09-12T00:38:48.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.457+0000 7efd1e8999c0 20 add_watcher() i=1 2024-09-12T00:38:48.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.457+0000 7efd1e8999c0 20 add_watcher() i=2 2024-09-12T00:38:48.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.457+0000 7efd1e8999c0 20 add_watcher() i=3 2024-09-12T00:38:48.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.457+0000 7efd1e8999c0 20 add_watcher() i=4 2024-09-12T00:38:48.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.457+0000 7efd1e8999c0 20 add_watcher() i=5 2024-09-12T00:38:48.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.457+0000 7efd1e8999c0 20 add_watcher() i=6 2024-09-12T00:38:48.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.461+0000 7efd1e8999c0 20 add_watcher() i=7 2024-09-12T00:38:48.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.461+0000 7efd1e8999c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:48.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.465+0000 7efbd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:48.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.465+0000 7efd1e8999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:48.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.465+0000 7efd1e8999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:48.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.465+0000 7efd1e8999c0 5 note: GC not initialized 2024-09-12T00:38:48.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.465+0000 7efbd1fdb640 20 reqs_thread_entry: start 2024-09-12T00:38:48.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.465+0000 7efd1e8999c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:48.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.465+0000 7efd1e8999c0 20 Filter name: none 2024-09-12T00:38:48.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.465+0000 7efb437fe640 20 reqs_thread_entry: start 2024-09-12T00:38:48.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.465+0000 7efd1e8999c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.469+0000 7efd1e8999c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:38:48.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.469+0000 7efd1e8999c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.469+0000 7efd1e8999c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:38:48.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.469+0000 7efd1e8999c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:48.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.469+0000 7efd1e8999c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.469+0000 7efd1e8999c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:38:48.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.469+0000 7efd1e8999c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.469+0000 7efd1e8999c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:38:48.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.469+0000 7efd1e8999c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:48.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.473+0000 7efbd2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:48.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.477+0000 7efd1e8999c0 20 remove_watcher() i=0 2024-09-12T00:38:48.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.477+0000 7efd1e8999c0 2 removed watcher, disabling cache 2024-09-12T00:38:48.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.481+0000 7efd1e8999c0 20 remove_watcher() i=1 2024-09-12T00:38:48.479 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.481+0000 7efd1e8999c0 20 remove_watcher() i=2 2024-09-12T00:38:48.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.485+0000 7efd1e8999c0 20 remove_watcher() i=3 2024-09-12T00:38:48.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.485+0000 7efd1e8999c0 20 remove_watcher() i=4 2024-09-12T00:38:48.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.489+0000 7efd1e8999c0 20 remove_watcher() i=5 2024-09-12T00:38:48.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.489+0000 7efd1e8999c0 20 remove_watcher() i=6 2024-09-12T00:38:48.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.493+0000 7efd1e8999c0 20 remove_watcher() i=7 2024-09-12T00:38:48.505 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:38:48.543 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:48.543 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:48.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 realm 2024-09-12T00:38:48.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:48.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.588 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:48.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:48.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 searching for the correct realm 2024-09-12T00:38:48.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.597+0000 7fdbcf0c1640 0 -- 172.21.15.138:0/1805390078 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fdbc8015b10 msgr2=0x7fdbc8075880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:48.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.813+0000 7fdbcf0c1640 0 -- 172.21.15.138:0/1805390078 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5592955c2010 msgr2=0x5592955c44d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:48.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:48.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 zone default found 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 4 Realm: () 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 zonegroup default 2024-09-12T00:38:48.823 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.829+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.829+0000 7fdbd0dba9c0 20 started sync module instance, tier type = 2024-09-12T00:38:48.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.829+0000 7fdbd0dba9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=0 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=1 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=2 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=3 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=4 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=5 2024-09-12T00:38:48.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=6 2024-09-12T00:38:48.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.853+0000 7fdbd0dba9c0 20 add_watcher() i=7 2024-09-12T00:38:48.849 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.853+0000 7fdbd0dba9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:48.854 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.857+0000 7fda857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:48.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:48.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:48.855 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 note: GC not initialized 2024-09-12T00:38:48.856 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.857+0000 7fd9fffff640 20 reqs_thread_entry: start 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 20 Filter name: none 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.857+0000 7fd9fdffb640 20 reqs_thread_entry: start 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:38:48.857 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:38:48.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:38:48.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:38:48.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:48.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:38:48.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:38:48.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:38:48.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:38:48.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:38:48.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.873+0000 7fdab27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333571 cookie 94088059436128 notifier 8172 bl.length()=827 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.873+0000 7fdab27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.873+0000 7fdab27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.873+0000 7fdab27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:38:48.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:38:48.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:38:48.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.0 2024-09-12T00:38:48.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.0 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.1 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.1 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.2 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.2 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.3 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.3 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.4 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.4 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.5 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.5 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.6 2024-09-12T00:38:48.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.6 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.7 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.7 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.8 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.8 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.9 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.9 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.10 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.10 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.11 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.11 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.12 2024-09-12T00:38:48.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.12 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.13 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.13 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:38:48.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:38:48.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:38:48.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:38:48.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:38:48.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:38:48.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:38:48.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:38:48.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:38:48.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:38:48.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:38:48.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:38:48.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:38:48.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:38:48.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.897+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:38:48.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.897+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:38:48.900 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdbd0dba9c0 time 2024-09-12T00:38:48.906883+0000 2024-09-12T00:38:48.900 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:48.901 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:48.901 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdbd46942eb] 2024-09-12T00:38:48.902 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdbd469449f] 2024-09-12T00:38:48.902 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559292566cc1] 2024-09-12T00:38:48.902 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55929257b01c] 2024-09-12T00:38:48.902 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55929257c6a4] 2024-09-12T00:38:48.902 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:38:48.902 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdbd34fad90] 2024-09-12T00:38:48.902 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:38:48.902 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:38:48.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.905+0000 7fdbd0dba9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdbd0dba9c0 time 2024-09-12T00:38:48.906883+0000 2024-09-12T00:38:48.902 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:48.902 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.902 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:48.903 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdbd46942eb] 2024-09-12T00:38:48.903 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdbd469449f] 2024-09-12T00:38:48.903 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559292566cc1] 2024-09-12T00:38:48.903 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55929257b01c] 2024-09-12T00:38:48.903 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55929257c6a4] 2024-09-12T00:38:48.903 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:38:48.903 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdbd34fad90] 2024-09-12T00:38:48.903 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:38:48.903 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:38:48.903 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.903 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:38:48.903 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fdbd0dba9c0 thread_name:radosgw-admin 2024-09-12T00:38:48.914 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:48.914 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdbd3513520] 2024-09-12T00:38:48.914 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:38:48.914 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:38:48.914 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:38:48.914 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdbd4694345] 2024-09-12T00:38:48.914 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdbd469449f] 2024-09-12T00:38:48.914 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559292566cc1] 2024-09-12T00:38:48.915 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55929257b01c] 2024-09-12T00:38:48.915 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55929257c6a4] 2024-09-12T00:38:48.915 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:38:48.915 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdbd34fad90] 2024-09-12T00:38:48.915 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:38:48.915 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:38:48.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.905+0000 7fdbd0dba9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:48.915 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fdbd0dba9c0 thread_name:radosgw-admin 2024-09-12T00:38:48.915 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.915 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:48.915 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdbd3513520] 2024-09-12T00:38:48.915 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:38:48.915 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:38:48.916 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:38:48.916 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdbd4694345] 2024-09-12T00:38:48.916 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdbd469449f] 2024-09-12T00:38:48.916 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559292566cc1] 2024-09-12T00:38:48.916 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55929257b01c] 2024-09-12T00:38:48.916 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55929257c6a4] 2024-09-12T00:38:48.916 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:38:48.916 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdbd34fad90] 2024-09-12T00:38:48.916 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:38:48.916 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:38:48.917 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:48.917 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.917 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:38:48.917 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: crc 2024-09-12T00:38:48.917 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: secure 2024-09-12T00:38:48.917 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: crc 2024-09-12T00:38:48.917 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: crc 2024-09-12T00:38:48.917 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: secure 2024-09-12T00:38:48.917 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: crc 2024-09-12T00:38:48.917 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: secure 2024-09-12T00:38:48.917 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: crc 2024-09-12T00:38:48.917 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: secure 2024-09-12T00:38:48.918 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.918 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.918 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command rotate-key hook 0x5592954cc388 2024-09-12T00:38:48.918 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:48.918 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:38:48.918 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-b con 0x559295357b70 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:38:48.918 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-c con 0x559295357f50 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:38:48.918 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-a con 0x5592954121a0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:38:48.918 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.918 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.918 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.918 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:48.918 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient(hunting): authenticate will time out at 2381.913963s 2024-09-12T00:38:48.919 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient(hunting): get_auth_request con 0x559295357f50 auth_method 0 2024-09-12T00:38:48.919 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.919 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.919 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.919 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:38:48.569+0000 7fdbcf0c1640 10 monclient(hunting): get_auth_request con 0x5592954121a0 auth_method 0 2024-09-12T00:38:48.919 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:38:48.569+0000 7fdbcf0c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.919 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:38:48.569+0000 7fdbcf0c1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.919 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:38:48.569+0000 7fdbcf0c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.919 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.919 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.919 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.919 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:38:48.569+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.919 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:38:48.569+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.920 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:38:48.569+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.920 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient(hunting): handle_auth_done global_id 7625 payload 824 2024-09-12T00:38:48.920 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient: _finish_hunting 0 2024-09-12T00:38:48.920 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 1 monclient: found mon.noname-c 2024-09-12T00:38:48.920 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:38:48.920 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.920 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:48.920 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: dump: 2024-09-12T00:38:48.920 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:48.920 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:48.920 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.920 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.921 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.921 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.921 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:48.921 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:48.921 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:48.921 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.921 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: _finish_auth 0 2024-09-12T00:38:48.921 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: _check_auth_tickets 2024-09-12T00:38:48.921 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 monclient: authenticate success, global_id 7625 2024-09-12T00:38:48.921 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient: _renew_subs 2024-09-12T00:38:48.921 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:38:48.921 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:48.921 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.922 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:48.922 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: dump: 2024-09-12T00:38:48.922 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:48.922 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:48.922 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.922 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.922 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.922 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.922 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:48.922 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:48.922 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:48.922 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.922 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:38:48.569+0000 7fdabce09640 4 set_mon_vals no callback set 2024-09-12T00:38:48.923 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient: _renew_subs 2024-09-12T00:38:48.923 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:38:48.923 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 1 librados: init done 2024-09-12T00:38:48.923 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:38:48.573+0000 7fdabb606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:48.923 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:38:48.573+0000 7fdabb606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:48.923 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:38:48.573+0000 7fdabb606640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:48.923 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:38:48.573+0000 7fdbce8c0640 10 monclient: get_auth_request con 0x7fdab4070ae0 auth_method 0 2024-09-12T00:38:48.923 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:38:48.573+0000 7fdbcf0c1640 10 monclient: get_auth_request con 0x55929550a200 auth_method 0 2024-09-12T00:38:48.923 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:38:48.573+0000 7fdbce8c0640 10 monclient: get_auth_request con 0x559295516b60 auth_method 0 2024-09-12T00:38:48.923 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:38:48.577+0000 7fdbce0bf640 10 monclient: get_auth_request con 0x55929551af20 auth_method 0 2024-09-12T00:38:48.923 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient: build_initial_monmap 2024-09-12T00:38:48.923 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:48.923 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient: monmap: 2024-09-12T00:38:48.924 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:38:48.924 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:48.924 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:38:48.924 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:38:48.924 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:48.924 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.924 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:38:48.924 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:38:48.924 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:38:48.924 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.924 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding auth protocol: cephx 2024-09-12T00:38:48.924 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding auth protocol: cephx 2024-09-12T00:38:48.925 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding auth protocol: cephx 2024-09-12T00:38:48.925 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: secure 2024-09-12T00:38:48.925 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: crc 2024-09-12T00:38:48.925 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: secure 2024-09-12T00:38:48.925 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: crc 2024-09-12T00:38:48.925 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: secure 2024-09-12T00:38:48.925 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: crc 2024-09-12T00:38:48.925 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: crc 2024-09-12T00:38:48.925 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: secure 2024-09-12T00:38:48.925 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: crc 2024-09-12T00:38:48.925 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: secure 2024-09-12T00:38:48.925 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: crc 2024-09-12T00:38:48.925 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: secure 2024-09-12T00:38:48.926 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.926 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command objecter_requests cmddesc objecter_requests hook 0x559295523720 EEXIST 2024-09-12T00:38:48.926 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient: init 2024-09-12T00:38:48.926 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding auth protocol: cephx 2024-09-12T00:38:48.926 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding auth protocol: cephx 2024-09-12T00:38:48.926 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding auth protocol: cephx 2024-09-12T00:38:48.926 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: secure 2024-09-12T00:38:48.926 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: crc 2024-09-12T00:38:48.926 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: secure 2024-09-12T00:38:48.926 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: crc 2024-09-12T00:38:48.926 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: secure 2024-09-12T00:38:48.926 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: crc 2024-09-12T00:38:48.926 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: crc 2024-09-12T00:38:48.927 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: secure 2024-09-12T00:38:48.927 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: crc 2024-09-12T00:38:48.927 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: secure 2024-09-12T00:38:48.927 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: crc 2024-09-12T00:38:48.927 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: secure 2024-09-12T00:38:48.927 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.927 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.927 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command rotate-key cmddesc rotate-key hook 0x55929551e5b0 EEXIST 2024-09-12T00:38:48.927 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:48.927 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:38:48.927 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-c con 0x5592955478d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:38:48.927 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-b con 0x559295547200 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:38:48.927 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-a con 0x559295545be0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:38:48.928 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.928 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.928 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.928 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:48.928 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient(hunting): authenticate will time out at 2381.922898s 2024-09-12T00:38:48.928 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:38:48.577+0000 7fdbce8c0640 10 monclient(hunting): get_auth_request con 0x5592955478d0 auth_method 0 2024-09-12T00:38:48.928 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:38:48.577+0000 7fdbce8c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.928 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:38:48.577+0000 7fdbce8c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.928 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:38:48.577+0000 7fdbce8c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.928 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient(hunting): get_auth_request con 0x559295545be0 auth_method 0 2024-09-12T00:38:48.928 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.928 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.928 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.929 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:38:48.577+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.929 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:38:48.577+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.929 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:38:48.577+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.929 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.929 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.929 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.929 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_done global_id 8166 payload 824 2024-09-12T00:38:48.929 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient: _finish_hunting 0 2024-09-12T00:38:48.929 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 1 monclient: found mon.noname-a 2024-09-12T00:38:48.929 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:38:48.929 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:38:48.577+0000 7fdbce0bf640 10 monclient: get_auth_request con 0x559295547200 auth_method 0 2024-09-12T00:38:48.929 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.929 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:48.930 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: dump: 2024-09-12T00:38:48.930 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:48.930 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:48.930 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.930 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.930 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.930 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.930 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:48.930 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:48.930 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:48.930 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.930 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: _finish_auth 0 2024-09-12T00:38:48.930 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: _check_auth_tickets 2024-09-12T00:38:48.931 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:48.931 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.931 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:48.931 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: dump: 2024-09-12T00:38:48.931 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:48.931 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:48.931 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.931 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.931 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.931 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.931 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:48.931 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:48.931 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:48.932 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.932 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:38:48.577+0000 7fdbcf8c2640 4 set_mon_vals no callback set 2024-09-12T00:38:48.932 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 monclient: authenticate success, global_id 8166 2024-09-12T00:38:48.932 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: _renew_subs 2024-09-12T00:38:48.932 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:38:48.932 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: _renew_subs 2024-09-12T00:38:48.932 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:38:48.932 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:38:48.581+0000 7fdab8e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:48.932 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:38:48.581+0000 7fdab8e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:48.932 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:38:48.581+0000 7fdab8e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:48.932 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: get_monmap_and_config 2024-09-12T00:38:48.932 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: build_initial_monmap 2024-09-12T00:38:48.932 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:48.933 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: monmap: 2024-09-12T00:38:48.933 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:38:48.933 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:48.933 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:38:48.933 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:38:48.933 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:48.933 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.933 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:38:48.933 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:38:48.933 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:38:48.933 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.933 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding auth protocol: cephx 2024-09-12T00:38:48.934 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding auth protocol: cephx 2024-09-12T00:38:48.934 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding auth protocol: cephx 2024-09-12T00:38:48.934 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: secure 2024-09-12T00:38:48.934 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: crc 2024-09-12T00:38:48.934 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: secure 2024-09-12T00:38:48.934 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: crc 2024-09-12T00:38:48.934 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: secure 2024-09-12T00:38:48.934 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: crc 2024-09-12T00:38:48.934 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: crc 2024-09-12T00:38:48.934 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: secure 2024-09-12T00:38:48.934 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: crc 2024-09-12T00:38:48.934 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: secure 2024-09-12T00:38:48.934 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: crc 2024-09-12T00:38:48.934 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: secure 2024-09-12T00:38:48.935 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:38:48.581+0000 7fdbce8c0640 10 monclient: get_auth_request con 0x7fdaa8070a20 auth_method 0 2024-09-12T00:38:48.935 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.935 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: init 2024-09-12T00:38:48.935 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding auth protocol: cephx 2024-09-12T00:38:48.935 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding auth protocol: cephx 2024-09-12T00:38:48.935 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding auth protocol: cephx 2024-09-12T00:38:48.935 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: secure 2024-09-12T00:38:48.935 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: crc 2024-09-12T00:38:48.935 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: secure 2024-09-12T00:38:48.936 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: crc 2024-09-12T00:38:48.936 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: secure 2024-09-12T00:38:48.936 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: crc 2024-09-12T00:38:48.936 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: crc 2024-09-12T00:38:48.936 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: secure 2024-09-12T00:38:48.936 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: crc 2024-09-12T00:38:48.936 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: secure 2024-09-12T00:38:48.936 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: crc 2024-09-12T00:38:48.936 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: secure 2024-09-12T00:38:48.936 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.936 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.936 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd96c52388 EEXIST 2024-09-12T00:38:48.937 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:48.937 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:38:48.937 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-c con 0x55929559b560 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:38:48.937 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-b con 0x55929559b940 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:38:48.937 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-a con 0x559295597120 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:38:48.937 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.937 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.937 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.937 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:48.937 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient(hunting): authenticate will time out at 2381.927388s 2024-09-12T00:38:48.937 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:38:48.581+0000 7fdbce8c0640 10 monclient(hunting): get_auth_request con 0x55929559b560 auth_method 0 2024-09-12T00:38:48.937 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:38:48.581+0000 7fdbce8c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.937 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:38:48.581+0000 7fdbce8c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.938 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:38:48.581+0000 7fdbce8c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.938 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient(hunting): get_auth_request con 0x559295597120 auth_method 0 2024-09-12T00:38:48.938 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.938 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.938 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.938 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.938 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.938 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.938 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:38:48.581+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.938 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:38:48.581+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.938 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:38:48.581+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.938 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_done global_id 8169 payload 274 2024-09-12T00:38:48.938 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient: _finish_hunting 0 2024-09-12T00:38:48.939 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 1 monclient: found mon.noname-a 2024-09-12T00:38:48.939 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:38:48.939 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.939 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:48.939 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: dump: 2024-09-12T00:38:48.939 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:48.939 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:48.939 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.939 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.939 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.939 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.939 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:48.939 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:48.940 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:48.940 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.940 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: _finish_auth 0 2024-09-12T00:38:48.940 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: _check_auth_tickets 2024-09-12T00:38:48.940 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 monclient: authenticate success, global_id 8169 2024-09-12T00:38:48.940 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:48.940 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:38:48.940 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 4 set_mon_vals no callback set 2024-09-12T00:38:48.940 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.940 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:48.940 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: dump: 2024-09-12T00:38:48.940 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:48.941 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:48.941 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.941 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.941 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.941 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.941 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:48.941 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:48.941 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:48.941 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.941 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: shutdown 2024-09-12T00:38:48.941 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: build_initial_monmap 2024-09-12T00:38:48.941 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:48.941 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: monmap: 2024-09-12T00:38:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:38:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:38:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:38:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:38:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:38:48.942 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:38:48.942 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.942 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding auth protocol: cephx 2024-09-12T00:38:48.942 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding auth protocol: cephx 2024-09-12T00:38:48.942 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding auth protocol: cephx 2024-09-12T00:38:48.943 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: secure 2024-09-12T00:38:48.943 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: crc 2024-09-12T00:38:48.943 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: secure 2024-09-12T00:38:48.943 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: crc 2024-09-12T00:38:48.943 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: secure 2024-09-12T00:38:48.943 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: crc 2024-09-12T00:38:48.943 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: crc 2024-09-12T00:38:48.943 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: secure 2024-09-12T00:38:48.943 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: crc 2024-09-12T00:38:48.943 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: secure 2024-09-12T00:38:48.943 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: crc 2024-09-12T00:38:48.943 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: secure 2024-09-12T00:38:48.944 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.944 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 1 librados: starting msgr at 2024-09-12T00:38:48.944 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 1 librados: starting objecter 2024-09-12T00:38:48.944 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55929558e790 EEXIST 2024-09-12T00:38:48.944 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 1 librados: setting wanted keys 2024-09-12T00:38:48.944 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 1 librados: calling monclient init 2024-09-12T00:38:48.944 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: init 2024-09-12T00:38:48.944 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding auth protocol: cephx 2024-09-12T00:38:48.944 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding auth protocol: cephx 2024-09-12T00:38:48.944 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding auth protocol: cephx 2024-09-12T00:38:48.944 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: secure 2024-09-12T00:38:48.944 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: crc 2024-09-12T00:38:48.945 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: secure 2024-09-12T00:38:48.945 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: crc 2024-09-12T00:38:48.945 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: secure 2024-09-12T00:38:48.945 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: crc 2024-09-12T00:38:48.945 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: crc 2024-09-12T00:38:48.945 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: secure 2024-09-12T00:38:48.945 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: crc 2024-09-12T00:38:48.945 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: secure 2024-09-12T00:38:48.945 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: crc 2024-09-12T00:38:48.945 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: secure 2024-09-12T00:38:48.945 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.945 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.945 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command rotate-key cmddesc rotate-key hook 0x559295549838 EEXIST 2024-09-12T00:38:48.946 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:48.946 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:38:48.946 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-a con 0x559295597120 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:38:48.946 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-c con 0x55929559b560 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:38:48.946 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-b con 0x5592955a88c0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:38:48.946 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.946 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.946 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.946 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:48.946 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient(hunting): authenticate will time out at 2381.929926s 2024-09-12T00:38:48.946 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient(hunting): get_auth_request con 0x559295597120 auth_method 0 2024-09-12T00:38:48.946 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.946 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.947 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.947 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:38:48.585+0000 7fdbce0bf640 10 monclient(hunting): get_auth_request con 0x55929559b560 auth_method 0 2024-09-12T00:38:48.947 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:38:48.585+0000 7fdbce0bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.947 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:38:48.585+0000 7fdbce0bf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.947 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:38:48.585+0000 7fdbce0bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.947 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.947 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.947 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.947 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:38:48.585+0000 7fdbce0bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.947 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:38:48.585+0000 7fdbce0bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.947 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:38:48.585+0000 7fdbce0bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.947 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_done global_id 8172 payload 824 2024-09-12T00:38:48.947 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient: _finish_hunting 0 2024-09-12T00:38:48.948 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 1 monclient: found mon.noname-a 2024-09-12T00:38:48.948 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:38:48.948 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.948 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:48.948 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: dump: 2024-09-12T00:38:48.948 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:48.948 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:48.948 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.948 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.948 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.948 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.948 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:48.949 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:48.949 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:48.949 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.949 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: _finish_auth 0 2024-09-12T00:38:48.949 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:38:48.949 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:48.949 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.949 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:48.949 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: dump: 2024-09-12T00:38:48.949 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:48.949 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:48.949 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.949 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.950 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.950 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.950 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:48.950 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:48.950 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:48.950 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.950 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:38:48.585+0000 7fdab27fc640 4 set_mon_vals no callback set 2024-09-12T00:38:48.950 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 monclient: authenticate success, global_id 8172 2024-09-12T00:38:48.950 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: _renew_subs 2024-09-12T00:38:48.950 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:38:48.950 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: _renew_subs 2024-09-12T00:38:48.950 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:38:48.951 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 1 librados: init done 2024-09-12T00:38:48.951 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command cr dump hook 0x55929558dae8 2024-09-12T00:38:48.951 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.951 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:38:48.589+0000 7fdab0ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:48.951 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:38:48.589+0000 7fdab0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:48.951 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:38:48.589+0000 7fdab0ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:48.951 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:38:48.589+0000 7fdbce0bf640 10 monclient: get_auth_request con 0x7fda98070ae0 auth_method 0 2024-09-12T00:38:48.951 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:38:48.589+0000 7fdbcf0c1640 10 monclient: get_auth_request con 0x5592955b5810 auth_method 0 2024-09-12T00:38:48.951 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.951 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 realm 2024-09-12T00:38:48.951 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.951 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.951 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:48.952 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.952 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.952 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.952 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:38:48.593+0000 7fdbce8c0640 10 monclient: get_auth_request con 0x5592955b9a30 auth_method 0 2024-09-12T00:38:48.952 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:48.952 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.952 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:38:48.593+0000 7fdbce0bf640 10 monclient: get_auth_request con 0x5592955bd290 auth_method 0 2024-09-12T00:38:48.952 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:48.952 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 searching for the correct realm 2024-09-12T00:38:48.952 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:38:48.593+0000 7fdbcf0c1640 10 monclient: get_auth_request con 0x5592955c2010 auth_method 0 2024-09-12T00:38:48.952 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:38:48.593+0000 7fdbce8c0640 10 monclient: get_auth_request con 0x7fdbc8067b60 auth_method 0 2024-09-12T00:38:48.952 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:38:48.597+0000 7fdbce0bf640 10 monclient: get_auth_request con 0x7fdbc40eb030 auth_method 0 2024-09-12T00:38:48.953 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:38:48.597+0000 7fdbcf0c1640 0 -- 172.21.15.138:0/1805390078 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fdbc8015b10 msgr2=0x7fdbc8075880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:48.953 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:38:48.597+0000 7fdbcf0c1640 10 monclient: get_auth_request con 0x7fdbc8015b10 auth_method 0 2024-09-12T00:38:48.953 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:38:48.801+0000 7fdbcf0c1640 10 monclient: get_auth_request con 0x7fdbc8015b10 auth_method 0 2024-09-12T00:38:48.953 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:38:48.805+0000 7fdbce8c0640 10 monclient: get_auth_request con 0x7fdbc40039b0 auth_method 0 2024-09-12T00:38:48.953 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:38:48.813+0000 7fdbcf0c1640 0 -- 172.21.15.138:0/1805390078 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5592955c2010 msgr2=0x5592955c44d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:48.953 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:38:48.813+0000 7fdab0ff9640 1 client.8172.objecter ms_handle_reset 0x5592955c2010 session 0x5592955c1990 osd.4 2024-09-12T00:38:48.953 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:38:48.813+0000 7fdab0ff9640 10 monclient: _renew_subs 2024-09-12T00:38:48.953 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:38:48.813+0000 7fdab0ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:38:48.953 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:38:48.813+0000 7fdbcf0c1640 10 monclient: get_auth_request con 0x7fda98080e00 auth_method 0 2024-09-12T00:38:48.953 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:48.953 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:48.953 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:48.953 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:48.954 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:48.954 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:48.954 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.954 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.954 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.954 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:48.954 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.954 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:48.954 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 zone default found 2024-09-12T00:38:48.954 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 4 Realm: () 2024-09-12T00:38:48.954 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:48.954 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:48.954 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:48.955 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 zonegroup default 2024-09-12T00:38:48.955 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.955 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.955 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.955 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.955 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.955 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:38:48.829+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:48.955 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:38:48.829+0000 7fdbd0dba9c0 20 started sync module instance, tier type = 2024-09-12T00:38:48.955 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:38:48.829+0000 7fdbd0dba9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:48.955 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=0 2024-09-12T00:38:48.955 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=1 2024-09-12T00:38:48.955 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=2 2024-09-12T00:38:48.956 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=3 2024-09-12T00:38:48.956 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=4 2024-09-12T00:38:48.956 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=5 2024-09-12T00:38:48.956 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=6 2024-09-12T00:38:48.956 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:38:48.853+0000 7fdbd0dba9c0 20 add_watcher() i=7 2024-09-12T00:38:48.956 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:38:48.853+0000 7fdbd0dba9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:48.956 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding auth protocol: cephx 2024-09-12T00:38:48.956 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding auth protocol: cephx 2024-09-12T00:38:48.956 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding auth protocol: cephx 2024-09-12T00:38:48.956 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: secure 2024-09-12T00:38:48.956 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: crc 2024-09-12T00:38:48.956 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: secure 2024-09-12T00:38:48.956 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: crc 2024-09-12T00:38:48.957 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: secure 2024-09-12T00:38:48.957 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: crc 2024-09-12T00:38:48.957 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: crc 2024-09-12T00:38:48.957 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: secure 2024-09-12T00:38:48.957 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:38:48.857+0000 7fda857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:48.957 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: crc 2024-09-12T00:38:48.957 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: secure 2024-09-12T00:38:48.957 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: crc 2024-09-12T00:38:48.957 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: secure 2024-09-12T00:38:48.957 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.957 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:48.957 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:48.957 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command cache list hook 0x559295595ca0 2024-09-12T00:38:48.958 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command cache inspect hook 0x559295595ca0 2024-09-12T00:38:48.958 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command cache erase hook 0x559295595ca0 2024-09-12T00:38:48.958 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command cache zap hook 0x559295595ca0 2024-09-12T00:38:48.958 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 note: GC not initialized 2024-09-12T00:38:48.958 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:38:48.857+0000 7fd9fffff640 20 reqs_thread_entry: start 2024-09-12T00:38:48.958 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command sync trace show hook 0x7fdbc801b070 2024-09-12T00:38:48.958 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command sync trace history hook 0x7fdbc801b070 2024-09-12T00:38:48.958 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command sync trace active hook 0x7fdbc801b070 2024-09-12T00:38:48.958 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command sync trace active_short hook 0x7fdbc801b070 2024-09-12T00:38:48.958 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:48.958 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 20 Filter name: none 2024-09-12T00:38:48.958 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:38:48.857+0000 7fd9fdffb640 20 reqs_thread_entry: start 2024-09-12T00:38:48.958 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:38:48.959 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.959 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:38:48.959 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:38:48.959 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:38:48.959 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:38:48.959 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:48.959 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:38:48.959 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:38:48.959 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:38:48.959 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:48.959 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:38:48.959 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:38:48.959 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:38:48.960 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:38:48.960 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:38:48.960 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:38:48.960 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:38:48.873+0000 7fdab27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333571 cookie 94088059436128 notifier 8172 bl.length()=827 2024-09-12T00:38:48.960 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:38:48.873+0000 7fdab27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:38:48.960 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:38:48.873+0000 7fdab27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:38:48.960 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:38:48.873+0000 7fdab27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:38:48.960 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:38:48.960 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:38:48.960 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:38:48.960 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:38:48.960 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.0 2024-09-12T00:38:48.961 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.0 2024-09-12T00:38:48.961 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.1 2024-09-12T00:38:48.961 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.1 2024-09-12T00:38:48.961 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.2 2024-09-12T00:38:48.961 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.2 2024-09-12T00:38:48.961 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.3 2024-09-12T00:38:48.961 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.3 2024-09-12T00:38:48.961 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.4 2024-09-12T00:38:48.961 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.4 2024-09-12T00:38:48.961 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.5 2024-09-12T00:38:48.961 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.5 2024-09-12T00:38:48.961 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.6 2024-09-12T00:38:48.961 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.6 2024-09-12T00:38:48.962 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.7 2024-09-12T00:38:48.962 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.7 2024-09-12T00:38:48.962 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.8 2024-09-12T00:38:48.962 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.8 2024-09-12T00:38:48.962 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.9 2024-09-12T00:38:48.962 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.9 2024-09-12T00:38:48.962 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.10 2024-09-12T00:38:48.962 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.10 2024-09-12T00:38:48.962 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.11 2024-09-12T00:38:48.962 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.11 2024-09-12T00:38:48.962 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.12 2024-09-12T00:38:48.962 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.12 2024-09-12T00:38:48.962 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.13 2024-09-12T00:38:48.963 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.13 2024-09-12T00:38:48.963 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:38:48.963 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:38:48.963 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:38:48.963 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:38:48.963 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:38:48.963 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:38:48.963 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:38:48.963 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:38:48.963 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:38:48.963 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:38:48.963 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:38:48.963 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:38:48.964 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:38:48.964 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:38:48.964 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:38:48.964 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:38:48.964 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:38:48.964 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:38:48.964 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:38:48.964 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:38:48.964 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:38:48.964 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:38:48.964 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:38:48.964 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:38:48.965 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:38:48.897+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:38:48.965 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:38:48.897+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:38:48.965 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:38:48.897+0000 7fdab0ff9640 1 client.8172.objecter ms_handle_reset 0x7fdbc8015b10 session 0x7fdbc805c4a0 osd.5 2024-09-12T00:38:48.965 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:38:48.897+0000 7fdbcf0c1640 10 monclient: get_auth_request con 0x5592955c2010 auth_method 0 2024-09-12T00:38:48.965 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:38:48.905+0000 7fdbd0dba9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdbd0dba9c0 time 2024-09-12T00:38:48.906883+0000 2024-09-12T00:38:48.965 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:48.965 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.965 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:48.965 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdbd46942eb] 2024-09-12T00:38:48.965 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdbd469449f] 2024-09-12T00:38:48.965 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559292566cc1] 2024-09-12T00:38:48.965 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55929257b01c] 2024-09-12T00:38:48.965 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55929257c6a4] 2024-09-12T00:38:48.966 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:38:48.966 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdbd34fad90] 2024-09-12T00:38:48.966 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:38:48.966 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:38:48.966 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.966 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:38:48.905+0000 7fdbd0dba9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:48.966 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fdbd0dba9c0 thread_name:radosgw-admin 2024-09-12T00:38:48.966 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.966 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:48.966 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdbd3513520] 2024-09-12T00:38:48.966 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:38:48.966 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:38:48.966 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:38:48.967 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdbd4694345] 2024-09-12T00:38:48.967 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdbd469449f] 2024-09-12T00:38:48.967 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559292566cc1] 2024-09-12T00:38:48.967 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55929257b01c] 2024-09-12T00:38:48.967 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55929257c6a4] 2024-09-12T00:38:48.967 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:38:48.967 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdbd34fad90] 2024-09-12T00:38:48.967 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:38:48.967 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:38:48.967 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:48.967 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.967 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:38:48.968 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:38:48.968 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:38:48.968 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:38:48.968 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:38:48.968 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:38:48.968 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:38:48.968 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:38:48.968 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:38:48.968 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:38:48.968 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:38:48.968 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:38:48.968 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:38:48.968 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:38:48.969 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:38:48.969 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:38:48.969 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:38:48.969 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:38:48.969 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:38:48.969 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:38:48.969 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:38:48.969 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:38:48.969 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:38:48.969 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:38:48.969 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:38:48.969 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:38:48.970 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:38:48.970 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:38:48.970 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:38:48.970 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:38:48.970 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:38:48.970 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:38:48.970 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:38:48.970 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:38:48.970 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:38:48.970 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:38:48.970 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:38:48.970 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:38:48.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:38:48.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:38:48.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:38:48.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:38:48.971 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:38:48.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:38:48.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:38:48.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:38:48.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:38:48.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:38:48.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:38:48.971 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:38:48.971 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:38:48.972 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:38:48.972 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:38:48.972 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:38:48.972 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:38:48.972 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:38:48.972 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:38:48.972 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:38:48.972 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:38:48.972 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:38:48.972 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:38:48.972 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:38:48.972 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:38:48.972 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:38:48.973 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:38:48.973 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:38:48.973 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:38:48.973 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:38:48.973 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:38:48.973 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:38:48.973 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:38:48.973 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:38:48.973 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:38:48.973 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:38:48.973 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:38:48.973 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:38:48.973 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:38:48.974 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:38:48.974 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:38:48.974 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:38:48.974 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:38:48.974 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:38:48.974 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:38:48.974 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:38:48.974 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:38:48.974 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:38:48.974 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:38:48.974 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:38:48.974 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:38:48.974 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:38:48.975 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:38:48.975 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:38:48.975 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:38:48.975 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:38:48.975 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd9fdffb640 / http_manager 2024-09-12T00:38:48.975 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd9fffff640 / http_manager 2024-09-12T00:38:48.975 INFO:tasks.workunit.client.0.smithi138.stderr: 7fda857e2640 / rgw_dt_lg_renew 2024-09-12T00:38:48.975 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdab0ff9640 / ms_dispatch 2024-09-12T00:38:48.975 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdab27fc640 / io_context_pool 2024-09-12T00:38:48.975 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdab8e01640 / ms_dispatch 2024-09-12T00:38:48.975 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdabb606640 / ms_dispatch 2024-09-12T00:38:48.975 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdabce09640 / io_context_pool 2024-09-12T00:38:48.976 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbce0bf640 / msgr-worker-2 2024-09-12T00:38:48.976 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbce8c0640 / msgr-worker-1 2024-09-12T00:38:48.976 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbcf0c1640 / msgr-worker-0 2024-09-12T00:38:48.976 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbcf8c2640 / io_context_pool 2024-09-12T00:38:48.976 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbd0dba9c0 / radosgw-admin 2024-09-12T00:38:48.976 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:38:48.976 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:38:48.976 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.138947.log 2024-09-12T00:38:48.976 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:38:48.976 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:38:48.976 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: crc 2024-09-12T00:38:48.976 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: secure 2024-09-12T00:38:48.977 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: crc 2024-09-12T00:38:48.977 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: crc 2024-09-12T00:38:48.977 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: secure 2024-09-12T00:38:48.977 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: crc 2024-09-12T00:38:48.977 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: secure 2024-09-12T00:38:48.977 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: crc 2024-09-12T00:38:48.977 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592954cc240) adding con mode: secure 2024-09-12T00:38:48.977 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.977 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.977 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command rotate-key hook 0x5592954cc388 2024-09-12T00:38:48.977 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:48.977 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:38:48.977 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-b con 0x559295357b70 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:38:48.978 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-c con 0x559295357f50 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:38:48.978 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-a con 0x5592954121a0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:38:48.978 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.978 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.978 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.978 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:48.978 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient(hunting): authenticate will time out at 2381.913963s 2024-09-12T00:38:48.978 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient(hunting): get_auth_request con 0x559295357f50 auth_method 0 2024-09-12T00:38:48.978 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.978 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.978 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.978 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:38:48.569+0000 7fdbcf0c1640 10 monclient(hunting): get_auth_request con 0x5592954121a0 auth_method 0 2024-09-12T00:38:48.979 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:38:48.569+0000 7fdbcf0c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.979 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:38:48.569+0000 7fdbcf0c1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.979 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:38:48.569+0000 7fdbcf0c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.979 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.979 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.979 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.979 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:38:48.569+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.979 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:38:48.569+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.979 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:38:48.569+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.979 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient(hunting): handle_auth_done global_id 7625 payload 824 2024-09-12T00:38:48.979 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient: _finish_hunting 0 2024-09-12T00:38:48.979 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 1 monclient: found mon.noname-c 2024-09-12T00:38:48.979 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:38:48.569+0000 7fdbce0bf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:38:48.980 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.980 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:38:48.980 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: dump: 2024-09-12T00:38:48.980 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:48.980 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:48.980 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.980 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.980 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.980 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.980 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:48.980 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:48.980 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:48.981 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.981 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: _finish_auth 0 2024-09-12T00:38:48.981 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: _check_auth_tickets 2024-09-12T00:38:48.981 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 5 monclient: authenticate success, global_id 7625 2024-09-12T00:38:48.981 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient: _renew_subs 2024-09-12T00:38:48.981 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:38:48.981 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:48.981 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.981 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:38:48.981 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:38:48.569+0000 7fdabb606640 10 monclient: dump: 2024-09-12T00:38:48.981 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:48.981 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:48.982 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.982 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.982 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.982 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.982 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:48.982 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:48.982 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:48.982 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.982 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:38:48.569+0000 7fdabce09640 4 set_mon_vals no callback set 2024-09-12T00:38:48.982 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient: _renew_subs 2024-09-12T00:38:48.982 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:38:48.982 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:38:48.569+0000 7fdbd0dba9c0 1 librados: init done 2024-09-12T00:38:48.982 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:38:48.573+0000 7fdabb606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:48.982 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:38:48.573+0000 7fdabb606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:48.983 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:38:48.573+0000 7fdabb606640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:48.983 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:38:48.573+0000 7fdbce8c0640 10 monclient: get_auth_request con 0x7fdab4070ae0 auth_method 0 2024-09-12T00:38:48.983 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:38:48.573+0000 7fdbcf0c1640 10 monclient: get_auth_request con 0x55929550a200 auth_method 0 2024-09-12T00:38:48.983 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:38:48.573+0000 7fdbce8c0640 10 monclient: get_auth_request con 0x559295516b60 auth_method 0 2024-09-12T00:38:48.983 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:38:48.577+0000 7fdbce0bf640 10 monclient: get_auth_request con 0x55929551af20 auth_method 0 2024-09-12T00:38:48.983 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient: build_initial_monmap 2024-09-12T00:38:48.983 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:48.983 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient: monmap: 2024-09-12T00:38:48.983 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:38:48.983 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:48.983 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:38:48.983 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:38:48.983 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:48.984 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.984 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:38:48.984 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:38:48.984 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:38:48.984 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.984 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding auth protocol: cephx 2024-09-12T00:38:48.984 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding auth protocol: cephx 2024-09-12T00:38:48.984 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding auth protocol: cephx 2024-09-12T00:38:48.984 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: secure 2024-09-12T00:38:48.984 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: crc 2024-09-12T00:38:48.984 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: secure 2024-09-12T00:38:48.984 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: crc 2024-09-12T00:38:48.985 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: secure 2024-09-12T00:38:48.985 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: crc 2024-09-12T00:38:48.985 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: crc 2024-09-12T00:38:48.985 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: secure 2024-09-12T00:38:48.985 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: crc 2024-09-12T00:38:48.985 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: secure 2024-09-12T00:38:48.985 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: crc 2024-09-12T00:38:48.985 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551fd90) adding con mode: secure 2024-09-12T00:38:48.985 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.985 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command objecter_requests cmddesc objecter_requests hook 0x559295523720 EEXIST 2024-09-12T00:38:48.985 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient: init 2024-09-12T00:38:48.985 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding auth protocol: cephx 2024-09-12T00:38:48.986 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding auth protocol: cephx 2024-09-12T00:38:48.986 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding auth protocol: cephx 2024-09-12T00:38:48.986 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: secure 2024-09-12T00:38:48.986 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: crc 2024-09-12T00:38:48.986 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: secure 2024-09-12T00:38:48.986 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: crc 2024-09-12T00:38:48.986 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: secure 2024-09-12T00:38:48.986 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: crc 2024-09-12T00:38:48.986 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: crc 2024-09-12T00:38:48.986 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: secure 2024-09-12T00:38:48.986 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: crc 2024-09-12T00:38:48.986 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: secure 2024-09-12T00:38:48.986 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: crc 2024-09-12T00:38:48.987 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929551e468) adding con mode: secure 2024-09-12T00:38:48.987 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.987 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.987 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command rotate-key cmddesc rotate-key hook 0x55929551e5b0 EEXIST 2024-09-12T00:38:48.987 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:48.987 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:38:48.987 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-c con 0x5592955478d0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:38:48.987 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-b con 0x559295547200 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:38:48.987 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-a con 0x559295545be0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:38:48.987 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.987 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.987 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.987 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:48.987 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:38:48.577+0000 7fdbd0dba9c0 10 monclient(hunting): authenticate will time out at 2381.922898s 2024-09-12T00:38:48.988 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:38:48.577+0000 7fdbce8c0640 10 monclient(hunting): get_auth_request con 0x5592955478d0 auth_method 0 2024-09-12T00:38:48.988 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:38:48.577+0000 7fdbce8c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.988 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:38:48.577+0000 7fdbce8c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.988 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:38:48.577+0000 7fdbce8c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.988 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient(hunting): get_auth_request con 0x559295545be0 auth_method 0 2024-09-12T00:38:48.988 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.988 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.988 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.988 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:38:48.577+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.988 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:38:48.577+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.988 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:38:48.577+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.988 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.989 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.989 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.989 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_done global_id 8166 payload 824 2024-09-12T00:38:48.989 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient: _finish_hunting 0 2024-09-12T00:38:48.989 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 1 monclient: found mon.noname-a 2024-09-12T00:38:48.989 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:38:48.577+0000 7fdbcf0c1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:38:48.989 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:38:48.577+0000 7fdbce0bf640 10 monclient: get_auth_request con 0x559295547200 auth_method 0 2024-09-12T00:38:48.989 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.989 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:48.989 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: dump: 2024-09-12T00:38:48.989 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:48.989 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:48.990 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.990 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.990 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.990 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.990 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:48.990 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:48.990 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:48.990 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.990 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: _finish_auth 0 2024-09-12T00:38:48.990 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: _check_auth_tickets 2024-09-12T00:38:48.990 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:48.990 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.990 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:48.991 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:38:48.577+0000 7fdab8e01640 10 monclient: dump: 2024-09-12T00:38:48.991 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:48.991 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:48.991 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.991 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.991 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.991 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.991 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:48.991 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:48.991 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:48.991 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.991 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:38:48.577+0000 7fdbcf8c2640 4 set_mon_vals no callback set 2024-09-12T00:38:48.991 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 monclient: authenticate success, global_id 8166 2024-09-12T00:38:48.992 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: _renew_subs 2024-09-12T00:38:48.992 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:38:48.992 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: _renew_subs 2024-09-12T00:38:48.992 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:38:48.992 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:38:48.581+0000 7fdab8e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:48.992 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:38:48.581+0000 7fdab8e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:48.992 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:38:48.581+0000 7fdab8e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:48.992 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: get_monmap_and_config 2024-09-12T00:38:48.992 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: build_initial_monmap 2024-09-12T00:38:48.992 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:48.992 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: monmap: 2024-09-12T00:38:48.992 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:38:48.992 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:48.993 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:38:48.993 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:38:48.993 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:48.993 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.993 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:38:48.993 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:38:48.993 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:38:48.993 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.993 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding auth protocol: cephx 2024-09-12T00:38:48.993 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding auth protocol: cephx 2024-09-12T00:38:48.993 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding auth protocol: cephx 2024-09-12T00:38:48.993 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: secure 2024-09-12T00:38:48.994 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: crc 2024-09-12T00:38:48.994 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: secure 2024-09-12T00:38:48.994 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: crc 2024-09-12T00:38:48.994 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: secure 2024-09-12T00:38:48.994 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: crc 2024-09-12T00:38:48.994 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: crc 2024-09-12T00:38:48.994 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: secure 2024-09-12T00:38:48.994 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: crc 2024-09-12T00:38:48.994 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: secure 2024-09-12T00:38:48.994 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: crc 2024-09-12T00:38:48.994 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x559295567250) adding con mode: secure 2024-09-12T00:38:48.994 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:38:48.581+0000 7fdbce8c0640 10 monclient: get_auth_request con 0x7fdaa8070a20 auth_method 0 2024-09-12T00:38:48.994 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.994 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: init 2024-09-12T00:38:48.995 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding auth protocol: cephx 2024-09-12T00:38:48.995 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding auth protocol: cephx 2024-09-12T00:38:48.995 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding auth protocol: cephx 2024-09-12T00:38:48.995 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: secure 2024-09-12T00:38:48.995 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: crc 2024-09-12T00:38:48.995 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: secure 2024-09-12T00:38:48.995 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: crc 2024-09-12T00:38:48.995 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: secure 2024-09-12T00:38:48.995 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: crc 2024-09-12T00:38:48.995 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: crc 2024-09-12T00:38:48.995 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: secure 2024-09-12T00:38:48.995 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: crc 2024-09-12T00:38:48.995 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: secure 2024-09-12T00:38:48.996 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: crc 2024-09-12T00:38:48.996 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52240) adding con mode: secure 2024-09-12T00:38:48.996 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.996 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:48.996 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd96c52388 EEXIST 2024-09-12T00:38:48.996 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:48.996 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:38:48.996 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-c con 0x55929559b560 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:38:48.996 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-b con 0x55929559b940 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:38:48.996 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-a con 0x559295597120 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:38:48.996 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.996 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.997 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:48.997 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:48.997 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:38:48.581+0000 7fdbd0dba9c0 10 monclient(hunting): authenticate will time out at 2381.927388s 2024-09-12T00:38:48.997 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:38:48.581+0000 7fdbce8c0640 10 monclient(hunting): get_auth_request con 0x55929559b560 auth_method 0 2024-09-12T00:38:48.997 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:38:48.581+0000 7fdbce8c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.997 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:38:48.581+0000 7fdbce8c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.997 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:38:48.581+0000 7fdbce8c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.997 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient(hunting): get_auth_request con 0x559295597120 auth_method 0 2024-09-12T00:38:48.997 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:48.997 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:48.997 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:48.997 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.998 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.998 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.998 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:38:48.581+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:48.998 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:38:48.581+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:48.998 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:38:48.581+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:48.998 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient(hunting): handle_auth_done global_id 8169 payload 274 2024-09-12T00:38:48.998 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient: _finish_hunting 0 2024-09-12T00:38:48.998 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 1 monclient: found mon.noname-a 2024-09-12T00:38:48.998 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:38:48.581+0000 7fdbcf0c1640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:38:48.998 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:48.998 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:48.998 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: dump: 2024-09-12T00:38:48.998 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:48.999 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:48.999 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.999 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:48.999 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:48.999 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:48.999 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:48.999 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:48.999 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:48.999 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:48.999 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: _finish_auth 0 2024-09-12T00:38:48.999 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: _check_auth_tickets 2024-09-12T00:38:48.999 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 monclient: authenticate success, global_id 8169 2024-09-12T00:38:48.999 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:49.000 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:38:49.000 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 4 set_mon_vals no callback set 2024-09-12T00:38:49.000 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:49.000 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:49.000 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:38:48.585+0000 7fdab27fc640 10 monclient: dump: 2024-09-12T00:38:49.000 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:49.000 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:49.000 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:49.000 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:49.000 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:49.000 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:49.000 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:49.001 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:49.001 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:49.001 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:49.001 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: shutdown 2024-09-12T00:38:49.001 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: build_initial_monmap 2024-09-12T00:38:49.001 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 1 build_initial for_mkfs: 0 2024-09-12T00:38:49.001 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: monmap: 2024-09-12T00:38:49.001 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:38:49.001 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:38:49.001 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:38:49.001 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:38:49.001 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:38:49.002 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:49.002 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:38:49.002 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:38:49.002 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:38:49.002 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:49.002 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding auth protocol: cephx 2024-09-12T00:38:49.002 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding auth protocol: cephx 2024-09-12T00:38:49.002 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding auth protocol: cephx 2024-09-12T00:38:49.002 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: secure 2024-09-12T00:38:49.002 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: crc 2024-09-12T00:38:49.002 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: secure 2024-09-12T00:38:49.002 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: crc 2024-09-12T00:38:49.002 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: secure 2024-09-12T00:38:49.003 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: crc 2024-09-12T00:38:49.003 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: crc 2024-09-12T00:38:49.003 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: secure 2024-09-12T00:38:49.003 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: crc 2024-09-12T00:38:49.003 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: secure 2024-09-12T00:38:49.003 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: crc 2024-09-12T00:38:49.003 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x55929558bda0) adding con mode: secure 2024-09-12T00:38:49.003 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:49.003 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 1 librados: starting msgr at 2024-09-12T00:38:49.003 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 1 librados: starting objecter 2024-09-12T00:38:49.003 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55929558e790 EEXIST 2024-09-12T00:38:49.003 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 1 librados: setting wanted keys 2024-09-12T00:38:49.003 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 1 librados: calling monclient init 2024-09-12T00:38:49.004 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: init 2024-09-12T00:38:49.004 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding auth protocol: cephx 2024-09-12T00:38:49.004 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding auth protocol: cephx 2024-09-12T00:38:49.004 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding auth protocol: cephx 2024-09-12T00:38:49.004 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: secure 2024-09-12T00:38:49.004 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: crc 2024-09-12T00:38:49.004 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: secure 2024-09-12T00:38:49.004 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: crc 2024-09-12T00:38:49.004 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: secure 2024-09-12T00:38:49.004 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: crc 2024-09-12T00:38:49.004 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: crc 2024-09-12T00:38:49.004 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: secure 2024-09-12T00:38:49.004 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: crc 2024-09-12T00:38:49.005 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: secure 2024-09-12T00:38:49.005 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: crc 2024-09-12T00:38:49.005 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 AuthRegistry(0x5592955496f0) adding con mode: secure 2024-09-12T00:38:49.005 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:49.005 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:49.005 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command rotate-key cmddesc rotate-key hook 0x559295549838 EEXIST 2024-09-12T00:38:49.005 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:38:49.005 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:38:49.005 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-a con 0x559295597120 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:38:49.006 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-c con 0x55929559b560 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:38:49.006 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient(hunting): picked mon.noname-b con 0x5592955a88c0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:38:49.006 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:49.006 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:49.006 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:38:49.006 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:38:49.006 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient(hunting): authenticate will time out at 2381.929926s 2024-09-12T00:38:49.006 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient(hunting): get_auth_request con 0x559295597120 auth_method 0 2024-09-12T00:38:49.006 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:49.006 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:49.006 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:49.006 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:38:48.585+0000 7fdbce0bf640 10 monclient(hunting): get_auth_request con 0x55929559b560 auth_method 0 2024-09-12T00:38:49.007 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:38:48.585+0000 7fdbce0bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:38:49.007 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:38:48.585+0000 7fdbce0bf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:38:49.007 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:38:48.585+0000 7fdbce0bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:38:49.007 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:49.007 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:49.007 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:49.007 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:38:48.585+0000 7fdbce0bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:38:49.007 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:38:48.585+0000 7fdbce0bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:38:49.007 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:38:48.585+0000 7fdbce0bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:38:49.007 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient(hunting): handle_auth_done global_id 8172 payload 824 2024-09-12T00:38:49.007 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient: _finish_hunting 0 2024-09-12T00:38:49.007 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 1 monclient: found mon.noname-a 2024-09-12T00:38:49.007 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:38:48.585+0000 7fdbce8c0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:38:49.008 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:49.008 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:38:49.008 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: dump: 2024-09-12T00:38:49.008 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:49.008 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:49.008 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:49.008 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:49.008 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:49.008 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:49.008 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:49.008 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:49.008 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:49.008 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:49.009 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: _finish_auth 0 2024-09-12T00:38:49.009 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:38:49.009 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:38:49.009 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:38:49.009 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:38:49.009 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:38:48.585+0000 7fdab0ff9640 10 monclient: dump: 2024-09-12T00:38:49.009 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:38:49.009 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:38:49.009 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:49.009 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:38:49.009 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:38:49.009 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:38:49.009 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:38:49.010 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:38:49.010 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:38:49.010 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:49.010 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:38:48.585+0000 7fdab27fc640 4 set_mon_vals no callback set 2024-09-12T00:38:49.010 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 monclient: authenticate success, global_id 8172 2024-09-12T00:38:49.010 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: _renew_subs 2024-09-12T00:38:49.010 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:38:49.010 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: _renew_subs 2024-09-12T00:38:49.010 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:38:49.010 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 1 librados: init done 2024-09-12T00:38:49.010 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:38:48.585+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command cr dump hook 0x55929558dae8 2024-09-12T00:38:49.010 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.010 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:38:48.589+0000 7fdab0ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:38:49.011 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:38:48.589+0000 7fdab0ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:49.011 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:38:48.589+0000 7fdab0ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:38:49.011 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:38:48.589+0000 7fdbce0bf640 10 monclient: get_auth_request con 0x7fda98070ae0 auth_method 0 2024-09-12T00:38:49.011 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:38:48.589+0000 7fdbcf0c1640 10 monclient: get_auth_request con 0x5592955b5810 auth_method 0 2024-09-12T00:38:49.011 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.011 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 realm 2024-09-12T00:38:49.011 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.011 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.011 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:49.011 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:38:48.589+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.011 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.011 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.012 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:38:48.593+0000 7fdbce8c0640 10 monclient: get_auth_request con 0x5592955b9a30 auth_method 0 2024-09-12T00:38:49.012 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:49.012 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.012 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:38:48.593+0000 7fdbce0bf640 10 monclient: get_auth_request con 0x5592955bd290 auth_method 0 2024-09-12T00:38:49.012 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:49.012 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:38:48.593+0000 7fdbd0dba9c0 20 searching for the correct realm 2024-09-12T00:38:49.012 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:38:48.593+0000 7fdbcf0c1640 10 monclient: get_auth_request con 0x5592955c2010 auth_method 0 2024-09-12T00:38:49.012 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:38:48.593+0000 7fdbce8c0640 10 monclient: get_auth_request con 0x7fdbc8067b60 auth_method 0 2024-09-12T00:38:49.012 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:38:48.597+0000 7fdbce0bf640 10 monclient: get_auth_request con 0x7fdbc40eb030 auth_method 0 2024-09-12T00:38:49.012 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:38:48.597+0000 7fdbcf0c1640 0 -- 172.21.15.138:0/1805390078 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fdbc8015b10 msgr2=0x7fdbc8075880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:49.012 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:38:48.597+0000 7fdbcf0c1640 10 monclient: get_auth_request con 0x7fdbc8015b10 auth_method 0 2024-09-12T00:38:49.012 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:38:48.801+0000 7fdbcf0c1640 10 monclient: get_auth_request con 0x7fdbc8015b10 auth_method 0 2024-09-12T00:38:49.013 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:38:48.805+0000 7fdbce8c0640 10 monclient: get_auth_request con 0x7fdbc40039b0 auth_method 0 2024-09-12T00:38:49.013 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:38:48.813+0000 7fdbcf0c1640 0 -- 172.21.15.138:0/1805390078 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5592955c2010 msgr2=0x5592955c44d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:49.013 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:38:48.813+0000 7fdab0ff9640 1 client.8172.objecter ms_handle_reset 0x5592955c2010 session 0x5592955c1990 osd.4 2024-09-12T00:38:49.013 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:38:48.813+0000 7fdab0ff9640 10 monclient: _renew_subs 2024-09-12T00:38:49.013 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:38:48.813+0000 7fdab0ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:38:49.013 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:38:48.813+0000 7fdbcf0c1640 10 monclient: get_auth_request con 0x7fda98080e00 auth_method 0 2024-09-12T00:38:49.013 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:49.013 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:49.013 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:49.013 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:49.013 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:49.013 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:49.013 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.014 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:38:48.821+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.014 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.014 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:49.014 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.014 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:49.014 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 zone default found 2024-09-12T00:38:49.014 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 4 Realm: () 2024-09-12T00:38:49.014 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:49.014 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:49.014 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:49.014 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 zonegroup default 2024-09-12T00:38:49.014 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.014 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.015 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.015 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.015 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:38:48.825+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.015 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:38:48.829+0000 7fdbd0dba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.015 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:38:48.829+0000 7fdbd0dba9c0 20 started sync module instance, tier type = 2024-09-12T00:38:49.015 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:38:48.829+0000 7fdbd0dba9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:49.015 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=0 2024-09-12T00:38:49.015 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=1 2024-09-12T00:38:49.015 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=2 2024-09-12T00:38:49.015 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=3 2024-09-12T00:38:49.015 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=4 2024-09-12T00:38:49.015 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=5 2024-09-12T00:38:49.015 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:38:48.849+0000 7fdbd0dba9c0 20 add_watcher() i=6 2024-09-12T00:38:49.016 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:38:48.853+0000 7fdbd0dba9c0 20 add_watcher() i=7 2024-09-12T00:38:49.016 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:38:48.853+0000 7fdbd0dba9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:49.016 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding auth protocol: cephx 2024-09-12T00:38:49.016 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding auth protocol: cephx 2024-09-12T00:38:49.016 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding auth protocol: cephx 2024-09-12T00:38:49.016 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: secure 2024-09-12T00:38:49.016 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: crc 2024-09-12T00:38:49.016 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: secure 2024-09-12T00:38:49.016 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: crc 2024-09-12T00:38:49.016 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: secure 2024-09-12T00:38:49.016 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: crc 2024-09-12T00:38:49.017 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: crc 2024-09-12T00:38:49.017 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: secure 2024-09-12T00:38:49.017 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:38:48.857+0000 7fda857e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:49.017 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: crc 2024-09-12T00:38:49.017 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: secure 2024-09-12T00:38:49.017 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: crc 2024-09-12T00:38:49.017 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 AuthRegistry(0x7ffd96c52720) adding con mode: secure 2024-09-12T00:38:49.017 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:38:49.017 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:49.017 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:49.017 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command cache list hook 0x559295595ca0 2024-09-12T00:38:49.017 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command cache inspect hook 0x559295595ca0 2024-09-12T00:38:49.018 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command cache erase hook 0x559295595ca0 2024-09-12T00:38:49.018 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command cache zap hook 0x559295595ca0 2024-09-12T00:38:49.018 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 note: GC not initialized 2024-09-12T00:38:49.018 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:38:48.857+0000 7fd9fffff640 20 reqs_thread_entry: start 2024-09-12T00:38:49.018 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command sync trace show hook 0x7fdbc801b070 2024-09-12T00:38:49.018 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command sync trace history hook 0x7fdbc801b070 2024-09-12T00:38:49.018 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command sync trace active hook 0x7fdbc801b070 2024-09-12T00:38:49.018 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 5 asok(0x5592952bf2b0) register_command sync trace active_short hook 0x7fdbc801b070 2024-09-12T00:38:49.018 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:49.018 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 20 Filter name: none 2024-09-12T00:38:49.018 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:38:48.857+0000 7fd9fdffb640 20 reqs_thread_entry: start 2024-09-12T00:38:49.018 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:38:49.018 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:38:48.857+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.018 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:38:49.019 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:38:49.019 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:38:49.019 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:38:49.019 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.019 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:38:49.019 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:38:49.019 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:38:49.019 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:49.019 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:38:49.019 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:38:48.861+0000 7fdbd0dba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:38:49.019 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:38:49.019 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:38:49.020 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:38:49.020 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:38:49.020 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:38:48.873+0000 7fdab27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333571 cookie 94088059436128 notifier 8172 bl.length()=827 2024-09-12T00:38:49.020 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:38:48.873+0000 7fdab27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:38:49.020 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:38:48.873+0000 7fdab27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:38:49.020 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:38:48.873+0000 7fdab27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:38:49.020 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:38:49.020 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:38:49.020 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:38:49.020 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:38:48.873+0000 7fdbd0dba9c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:38:49.020 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.0 2024-09-12T00:38:49.020 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.0 2024-09-12T00:38:49.021 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.1 2024-09-12T00:38:49.021 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.1 2024-09-12T00:38:49.021 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.2 2024-09-12T00:38:49.021 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.2 2024-09-12T00:38:49.021 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.3 2024-09-12T00:38:49.021 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.3 2024-09-12T00:38:49.021 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.4 2024-09-12T00:38:49.021 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.4 2024-09-12T00:38:49.021 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.5 2024-09-12T00:38:49.021 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.5 2024-09-12T00:38:49.021 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.6 2024-09-12T00:38:49.021 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.6 2024-09-12T00:38:49.021 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.7 2024-09-12T00:38:49.022 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.7 2024-09-12T00:38:49.022 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.8 2024-09-12T00:38:49.022 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.8 2024-09-12T00:38:49.022 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.9 2024-09-12T00:38:49.022 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.9 2024-09-12T00:38:49.022 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.10 2024-09-12T00:38:49.022 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.10 2024-09-12T00:38:49.022 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.11 2024-09-12T00:38:49.022 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.11 2024-09-12T00:38:49.022 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.12 2024-09-12T00:38:49.022 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.12 2024-09-12T00:38:49.022 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.13 2024-09-12T00:38:49.022 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.13 2024-09-12T00:38:49.023 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:38:49.023 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:38:49.023 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:38:49.023 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:38:49.023 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:38:49.023 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:38:48.885+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:38:49.023 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:38:49.023 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:38:49.023 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:38:49.023 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:38:49.023 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:38:49.023 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:38:49.023 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:38:49.024 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:38:48.889+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:38:49.024 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:38:49.024 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:38:49.024 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:38:49.024 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:38:49.024 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:38:49.024 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:38:49.024 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:38:49.024 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:38:49.024 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:38:49.024 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:38:48.893+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:38:49.024 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:38:48.897+0000 7fdbd0dba9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:38:49.025 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:38:48.897+0000 7fdbd0dba9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:38:49.025 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:38:48.897+0000 7fdab0ff9640 1 client.8172.objecter ms_handle_reset 0x7fdbc8015b10 session 0x7fdbc805c4a0 osd.5 2024-09-12T00:38:49.025 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:38:48.897+0000 7fdbcf0c1640 10 monclient: get_auth_request con 0x5592955c2010 auth_method 0 2024-09-12T00:38:49.025 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:38:48.905+0000 7fdbd0dba9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fdbd0dba9c0 time 2024-09-12T00:38:48.906883+0000 2024-09-12T00:38:49.025 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:38:49.025 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:49.025 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:49.025 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fdbd46942eb] 2024-09-12T00:38:49.025 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdbd469449f] 2024-09-12T00:38:49.025 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559292566cc1] 2024-09-12T00:38:49.025 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55929257b01c] 2024-09-12T00:38:49.025 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55929257c6a4] 2024-09-12T00:38:49.025 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:38:49.026 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdbd34fad90] 2024-09-12T00:38:49.026 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:38:49.026 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:38:49.026 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:49.026 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:38:48.905+0000 7fdbd0dba9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:38:49.026 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7fdbd0dba9c0 thread_name:radosgw-admin 2024-09-12T00:38:49.026 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:49.026 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:38:49.026 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fdbd3513520] 2024-09-12T00:38:49.026 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:38:49.026 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:38:49.026 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:38:49.026 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fdbd4694345] 2024-09-12T00:38:49.027 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fdbd469449f] 2024-09-12T00:38:49.027 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559292566cc1] 2024-09-12T00:38:49.027 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x55929257b01c] 2024-09-12T00:38:49.027 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x55929257c6a4] 2024-09-12T00:38:49.027 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:38:49.027 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fdbd34fad90] 2024-09-12T00:38:49.027 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:38:49.027 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:38:49.027 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:38:49.027 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:38:49.027 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:38:49.027 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:38:49.027 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:38:49.028 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:38:49.028 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:38:49.028 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:38:49.028 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:38:49.028 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:38:49.028 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:38:49.028 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:38:49.028 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:38:49.028 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:38:49.028 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:38:49.028 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:38:49.028 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:38:49.028 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:38:49.029 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:38:49.029 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:38:49.029 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:38:49.029 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:38:49.029 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:38:49.029 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:38:49.029 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:38:49.029 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:38:49.029 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:38:49.029 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:38:49.029 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:38:49.029 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:38:49.029 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:38:49.030 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:38:49.030 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:38:49.030 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:38:49.030 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:38:49.030 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:38:49.030 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:38:49.030 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:38:49.030 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:38:49.030 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:38:49.030 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:38:49.030 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:38:49.030 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:38:49.030 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:38:49.031 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:38:49.031 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:38:49.031 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:38:49.031 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:38:49.031 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:38:49.031 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:38:49.031 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:38:49.031 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:38:49.031 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:38:49.031 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:38:49.031 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:38:49.031 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:38:49.031 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:38:49.032 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:38:49.032 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:38:49.032 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:38:49.032 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:38:49.032 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:38:49.032 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:38:49.032 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:38:49.032 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:38:49.032 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:38:49.032 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:38:49.032 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:38:49.032 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:38:49.032 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:38:49.033 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:38:49.033 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:38:49.033 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:38:49.033 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:38:49.033 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:38:49.033 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:38:49.033 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:38:49.033 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:38:49.033 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:38:49.033 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:38:49.033 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:38:49.033 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:38:49.033 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:38:49.034 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:38:49.034 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:38:49.034 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:38:49.034 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:38:49.034 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:38:49.034 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:38:49.034 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:38:49.034 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:38:49.034 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:38:49.034 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:38:49.034 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:38:49.034 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:38:49.034 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:38:49.035 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd9fdffb640 / http_manager 2024-09-12T00:38:49.035 INFO:tasks.workunit.client.0.smithi138.stderr: 7fd9fffff640 / http_manager 2024-09-12T00:38:49.035 INFO:tasks.workunit.client.0.smithi138.stderr: 7fda857e2640 / rgw_dt_lg_renew 2024-09-12T00:38:49.035 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdab0ff9640 / ms_dispatch 2024-09-12T00:38:49.035 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdab27fc640 / io_context_pool 2024-09-12T00:38:49.035 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdab8e01640 / ms_dispatch 2024-09-12T00:38:49.035 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdabb606640 / ms_dispatch 2024-09-12T00:38:49.035 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdabce09640 / io_context_pool 2024-09-12T00:38:49.035 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbce0bf640 / msgr-worker-2 2024-09-12T00:38:49.035 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbce8c0640 / msgr-worker-1 2024-09-12T00:38:49.035 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbcf0c1640 / msgr-worker-0 2024-09-12T00:38:49.035 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbcf8c2640 / io_context_pool 2024-09-12T00:38:49.035 INFO:tasks.workunit.client.0.smithi138.stderr: 7fdbd0dba9c0 / radosgw-admin 2024-09-12T00:38:49.035 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:38:49.036 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:38:49.036 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:38:48.910178Z_efcbb4f5-234d-470c-ae29-4954437f36d6/log 2024-09-12T00:38:49.036 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:38:49.038 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-12T00:38:49.038 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:38:49.038 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:49.038 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:49.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.989+0000 7fc71af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.993+0000 7fc71af2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.993+0000 7fc71af2a9c0 20 realm 2024-09-12T00:38:49.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.993+0000 7fc71af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.993+0000 7fc71af2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.993+0000 7fc71af2a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:49.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.993+0000 7fc71af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.993+0000 7fc71af2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.993+0000 7fc71af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.997+0000 7fc71af2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:49.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.997+0000 7fc71af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.997+0000 7fc71af2a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:49.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:48.997+0000 7fc71af2a9c0 20 searching for the correct realm 2024-09-12T00:38:49.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.001+0000 7fc719231640 0 -- 172.21.15.138:0/989913740 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fc710025410 msgr2=0x7fc710025890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:49.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.217+0000 7fc719231640 0 -- 172.21.15.138:0/989913740 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x561faea01f90 msgr2=0x561faea04450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:49.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.225+0000 7fc71af2a9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:49.226 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.225+0000 7fc71af2a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:49.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.225+0000 7fc71af2a9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:49.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.225+0000 7fc71af2a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:49.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.225+0000 7fc71af2a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:49.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.225+0000 7fc71af2a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:49.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.225+0000 7fc71af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.225+0000 7fc71af2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.225+0000 7fc71af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.229+0000 7fc71af2a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:49.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.229+0000 7fc71af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.229+0000 7fc71af2a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:49.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.229+0000 7fc71af2a9c0 20 zone default found 2024-09-12T00:38:49.227 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.229+0000 7fc71af2a9c0 4 Realm: () 2024-09-12T00:38:49.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.229+0000 7fc71af2a9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:49.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.229+0000 7fc71af2a9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:49.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.229+0000 7fc71af2a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:49.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.229+0000 7fc71af2a9c0 20 zonegroup default 2024-09-12T00:38:49.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.229+0000 7fc71af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.229+0000 7fc71af2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.229+0000 7fc71af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.229+0000 7fc71af2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.229+0000 7fc71af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.233+0000 7fc71af2a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.233+0000 7fc71af2a9c0 20 started sync module instance, tier type = 2024-09-12T00:38:49.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.233+0000 7fc71af2a9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:49.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.257+0000 7fc71af2a9c0 20 add_watcher() i=0 2024-09-12T00:38:49.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.257+0000 7fc71af2a9c0 20 add_watcher() i=1 2024-09-12T00:38:49.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.257+0000 7fc71af2a9c0 20 add_watcher() i=2 2024-09-12T00:38:49.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.257+0000 7fc71af2a9c0 20 add_watcher() i=3 2024-09-12T00:38:49.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.257+0000 7fc71af2a9c0 20 add_watcher() i=4 2024-09-12T00:38:49.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.257+0000 7fc71af2a9c0 20 add_watcher() i=5 2024-09-12T00:38:49.256 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.257+0000 7fc71af2a9c0 20 add_watcher() i=6 2024-09-12T00:38:49.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.261+0000 7fc71af2a9c0 20 add_watcher() i=7 2024-09-12T00:38:49.258 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.261+0000 7fc71af2a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:49.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.265+0000 7fc5cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:49.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.265+0000 7fc71af2a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:49.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.265+0000 7fc71af2a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:49.263 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.265+0000 7fc71af2a9c0 5 note: GC not initialized 2024-09-12T00:38:49.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.265+0000 7fc5cdfe3640 20 reqs_thread_entry: start 2024-09-12T00:38:49.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.265+0000 7fc71af2a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:49.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.269+0000 7fc71af2a9c0 20 Filter name: none 2024-09-12T00:38:49.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.269+0000 7fc53f7fe640 20 reqs_thread_entry: start 2024-09-12T00:38:49.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.269+0000 7fc71af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.269+0000 7fc71af2a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:38:49.265 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.269+0000 7fc71af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.269+0000 7fc71af2a9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:38:49.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.269+0000 7fc71af2a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:49.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.269+0000 7fc71af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.269+0000 7fc71af2a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:38:49.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.269+0000 7fc71af2a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.269+0000 7fc71af2a9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:38:49.268 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.269+0000 7fc71af2a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:38:49.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.273+0000 7fc5cefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:49.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.281+0000 7fc71af2a9c0 20 remove_watcher() i=0 2024-09-12T00:38:49.277 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.281+0000 7fc71af2a9c0 2 removed watcher, disabling cache 2024-09-12T00:38:49.279 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.281+0000 7fc71af2a9c0 20 remove_watcher() i=1 2024-09-12T00:38:49.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.285+0000 7fc71af2a9c0 20 remove_watcher() i=2 2024-09-12T00:38:49.285 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.289+0000 7fc71af2a9c0 20 remove_watcher() i=3 2024-09-12T00:38:49.287 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.289+0000 7fc71af2a9c0 20 remove_watcher() i=4 2024-09-12T00:38:49.291 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.293+0000 7fc71af2a9c0 20 remove_watcher() i=5 2024-09-12T00:38:49.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.297+0000 7fc71af2a9c0 20 remove_watcher() i=6 2024-09-12T00:38:49.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.305+0000 7fc71af2a9c0 20 remove_watcher() i=7 2024-09-12T00:38:49.322 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:38:49.322 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:38:49.336 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:38:49.367 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:49.367 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:49.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.413+0000 7fb8cac3c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.417+0000 7fb8cac3c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.417+0000 7fb8cac3c9c0 20 realm 2024-09-12T00:38:49.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.417+0000 7fb8cac3c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.417+0000 7fb8cac3c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.417+0000 7fb8cac3c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:49.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.417+0000 7fb8cac3c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.417+0000 7fb8cac3c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.417+0000 7fb8cac3c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.417+0000 7fb8cac3c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:49.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.417+0000 7fb8cac3c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.417+0000 7fb8cac3c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:49.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.417+0000 7fb8cac3c9c0 20 searching for the correct realm 2024-09-12T00:38:49.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.421+0000 7fb8c8742640 0 -- 172.21.15.138:0/3571948249 >> [v2:172.21.15.138:6816/3496313381,v1:172.21.15.138:6817/3496313381] conn(0x7fb8b4003c10 msgr2=0x7fb8c0060250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:49.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.425+0000 7fb8c8742640 0 -- 172.21.15.138:0/3571948249 >> [v2:172.21.15.138:6800/1437861584,v1:172.21.15.138:6801/1437861584] conn(0x558497994970 msgr2=0x558497996da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:49.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.437+0000 7fb8cac3c9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:38:49.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.437+0000 7fb8cac3c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:49.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.437+0000 7fb8cac3c9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:38:49.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.437+0000 7fb8cac3c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:49.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.437+0000 7fb8cac3c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:49.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.437+0000 7fb8cac3c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:49.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.437+0000 7fb8cac3c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.437+0000 7fb8cac3c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.437+0000 7fb8cac3c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.437+0000 7fb8cac3c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:49.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.437+0000 7fb8cac3c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.441+0000 7fb8cac3c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:49.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.441+0000 7fb8cac3c9c0 20 zone default found 2024-09-12T00:38:49.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.441+0000 7fb8cac3c9c0 4 Realm: () 2024-09-12T00:38:49.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.441+0000 7fb8cac3c9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:38:49.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.441+0000 7fb8cac3c9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:38:49.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.441+0000 7fb8cac3c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:49.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.441+0000 7fb8cac3c9c0 20 zonegroup default 2024-09-12T00:38:49.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.441+0000 7fb8cac3c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.441+0000 7fb8cac3c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.441+0000 7fb8cac3c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.441+0000 7fb8cac3c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.441+0000 7fb8cac3c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.441+0000 7fb8cac3c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:49.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.441+0000 7fb8cac3c9c0 20 started sync module instance, tier type = 2024-09-12T00:38:49.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.441+0000 7fb8cac3c9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:38:49.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.461+0000 7fb8cac3c9c0 20 add_watcher() i=0 2024-09-12T00:38:49.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.461+0000 7fb8cac3c9c0 20 add_watcher() i=1 2024-09-12T00:38:49.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.461+0000 7fb8cac3c9c0 20 add_watcher() i=2 2024-09-12T00:38:49.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.461+0000 7fb8cac3c9c0 20 add_watcher() i=3 2024-09-12T00:38:49.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.461+0000 7fb8cac3c9c0 20 add_watcher() i=4 2024-09-12T00:38:49.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.461+0000 7fb8cac3c9c0 20 add_watcher() i=5 2024-09-12T00:38:49.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.461+0000 7fb8cac3c9c0 20 add_watcher() i=6 2024-09-12T00:38:49.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.461+0000 7fb8cac3c9c0 20 add_watcher() i=7 2024-09-12T00:38:49.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.461+0000 7fb8cac3c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:49.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb77efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:49.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:49.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:49.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 5 note: GC not initialized 2024-09-12T00:38:49.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb77dfdb640 20 reqs_thread_entry: start 2024-09-12T00:38:49.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:49.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 20 Filter name: none 2024-09-12T00:38:49.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb6ef7fe640 20 reqs_thread_entry: start 2024-09-12T00:38:49.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:38:49.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:38:49.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:38:49.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:38:49.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:38:49.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:49.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:38:49.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:38:49.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:38:49.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:38:49.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:38:49.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:38:49.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:38:49.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.465+0000 7fb8cac3c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:38:49.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.469+0000 7fb8cac3c9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:38:49.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.469+0000 7fb8cac3c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:38:49.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.469+0000 7fb8cac3c9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:38:49.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.469+0000 7fb8cac3c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:38:49.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.469+0000 7fb8cac3c9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:38:49.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.469+0000 7fb8cac3c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:38:49.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.469+0000 7fb8cac3c9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:38:49.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.469+0000 7fb8cac3c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:38:49.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.469+0000 7fb8cac3c9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:38:49.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.469+0000 7fb8cac3c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:38:49.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.469+0000 7fb8cac3c9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:38:49.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.469+0000 7fb8cac3c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:38:49.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.473+0000 7fb8cac3c9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:38:49.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.473+0000 7fb8cac3c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:38:49.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.473+0000 7fb8cac3c9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:38:49.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.473+0000 7fb8cac3c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:38:49.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.473+0000 7fb8cac3c9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:38:49.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.473+0000 7fb8cac3c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:38:49.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.473+0000 7fb8cac3c9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:38:49.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.473+0000 7fb8cac3c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:38:49.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.473+0000 7fb8cac3c9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:38:49.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.473+0000 7fb8cac3c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:38:49.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.473+0000 7fb8cac3c9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:38:49.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.473+0000 7fb8cac3c9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:38:49.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.477+0000 7fb77efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:49.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.481+0000 7fb8cac3c9c0 20 remove_watcher() i=0 2024-09-12T00:38:49.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.481+0000 7fb8cac3c9c0 2 removed watcher, disabling cache 2024-09-12T00:38:49.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.481+0000 7fb8cac3c9c0 20 remove_watcher() i=1 2024-09-12T00:38:49.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.485+0000 7fb8cac3c9c0 20 remove_watcher() i=2 2024-09-12T00:38:49.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.485+0000 7fb8cac3c9c0 20 remove_watcher() i=3 2024-09-12T00:38:49.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.485+0000 7fb8cac3c9c0 20 remove_watcher() i=4 2024-09-12T00:38:49.486 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.489+0000 7fb8cac3c9c0 20 remove_watcher() i=5 2024-09-12T00:38:49.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.493+0000 7fb8cac3c9c0 20 remove_watcher() i=6 2024-09-12T00:38:49.492 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:38:49.493+0000 7fb8cac3c9c0 20 remove_watcher() i=7 2024-09-12T00:39:19.519 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:39:19.551 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:19.551 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:19.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.596+0000 7f3c72d379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.600+0000 7f3c72d379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.600+0000 7f3c72d379c0 20 realm 2024-09-12T00:39:19.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.600+0000 7f3c72d379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.600+0000 7f3c72d379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.600+0000 7f3c72d379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:19.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.600+0000 7f3c72d379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.600+0000 7f3c72d379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.600+0000 7f3c72d379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.600+0000 7f3c72d379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:19.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.600+0000 7f3c72d379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.604+0000 7f3c72d379c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:19.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.604+0000 7f3c72d379c0 20 searching for the correct realm 2024-09-12T00:39:19.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.608+0000 7f3c7103e640 0 -- 172.21.15.138:0/3070194378 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f3c680cf040 msgr2=0x7f3c681317f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:19.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.824+0000 7f3c7103e640 0 -- 172.21.15.138:0/3070194378 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55dbfeb38f50 msgr2=0x55dbfeb3b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:19.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.832+0000 7f3c72d379c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:39:19.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.832+0000 7f3c72d379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:19.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.832+0000 7f3c72d379c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:39:19.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.832+0000 7f3c72d379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:19.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.832+0000 7f3c72d379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:19.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.832+0000 7f3c72d379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:19.831 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.832+0000 7f3c72d379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.832+0000 7f3c72d379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.832+0000 7f3c72d379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.832+0000 7f3c72d379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:19.832 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.832+0000 7f3c72d379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.833 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.836+0000 7f3c72d379c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:19.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.836+0000 7f3c72d379c0 20 zone default found 2024-09-12T00:39:19.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.836+0000 7f3c72d379c0 4 Realm: () 2024-09-12T00:39:19.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.836+0000 7f3c72d379c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:39:19.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.836+0000 7f3c72d379c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:39:19.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.836+0000 7f3c72d379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:19.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.836+0000 7f3c72d379c0 20 zonegroup default 2024-09-12T00:39:19.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.836+0000 7f3c72d379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.836+0000 7f3c72d379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.836+0000 7f3c72d379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.836+0000 7f3c72d379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.836+0000 7f3c72d379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.836+0000 7f3c72d379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:19.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.836+0000 7f3c72d379c0 20 started sync module instance, tier type = 2024-09-12T00:39:19.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.836+0000 7f3c72d379c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:39:19.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.864+0000 7f3c72d379c0 20 add_watcher() i=0 2024-09-12T00:39:19.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.864+0000 7f3c72d379c0 20 add_watcher() i=1 2024-09-12T00:39:19.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.864+0000 7f3c72d379c0 20 add_watcher() i=2 2024-09-12T00:39:19.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.864+0000 7f3c72d379c0 20 add_watcher() i=3 2024-09-12T00:39:19.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.864+0000 7f3c72d379c0 20 add_watcher() i=4 2024-09-12T00:39:19.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.864+0000 7f3c72d379c0 20 add_watcher() i=5 2024-09-12T00:39:19.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.864+0000 7f3c72d379c0 20 add_watcher() i=6 2024-09-12T00:39:19.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.864+0000 7f3c72d379c0 20 add_watcher() i=7 2024-09-12T00:39:19.864 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.864+0000 7f3c72d379c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:19.868 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.868+0000 7f3b26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:19.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.872+0000 7f3c72d379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:19.869 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.872+0000 7f3c72d379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:19.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.872+0000 7f3c72d379c0 5 note: GC not initialized 2024-09-12T00:39:19.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.872+0000 7f3b25fe3640 20 reqs_thread_entry: start 2024-09-12T00:39:19.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.872+0000 7f3c72d379c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:19.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.872+0000 7f3c72d379c0 20 Filter name: none 2024-09-12T00:39:19.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.872+0000 7f3a977fe640 20 reqs_thread_entry: start 2024-09-12T00:39:19.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.872+0000 7f3c72d379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.872+0000 7f3c72d379c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:19.871 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.872+0000 7f3c72d379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.872+0000 7f3c72d379c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:39:19.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.872+0000 7f3c72d379c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:19.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.872+0000 7f3c72d379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.872+0000 7f3c72d379c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:19.872 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.872+0000 7f3c72d379c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:19.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.876+0000 7f3c72d379c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:39:19.873 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.876+0000 7f3c72d379c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:19.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.880+0000 7f3b26fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:19.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.888+0000 7f3c72d379c0 20 remove_watcher() i=0 2024-09-12T00:39:19.884 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.888+0000 7f3c72d379c0 2 removed watcher, disabling cache 2024-09-12T00:39:19.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.888+0000 7f3c72d379c0 20 remove_watcher() i=1 2024-09-12T00:39:19.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.892+0000 7f3c72d379c0 20 remove_watcher() i=2 2024-09-12T00:39:19.891 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.892+0000 7f3c72d379c0 20 remove_watcher() i=3 2024-09-12T00:39:19.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.896+0000 7f3c72d379c0 20 remove_watcher() i=4 2024-09-12T00:39:19.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.896+0000 7f3c72d379c0 20 remove_watcher() i=5 2024-09-12T00:39:19.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.900+0000 7f3c72d379c0 20 remove_watcher() i=6 2024-09-12T00:39:19.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:19.900+0000 7f3c72d379c0 20 remove_watcher() i=7 2024-09-12T00:39:19.919 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:19.919 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:39:19.961 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:39:19.991 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:19.991 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:20.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.036+0000 7fb7886ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.036+0000 7fb7886ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.036+0000 7fb7886ef9c0 20 realm 2024-09-12T00:39:20.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.036+0000 7fb7886ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.040+0000 7fb7886ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.040+0000 7fb7886ef9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:20.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.040+0000 7fb7886ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.040+0000 7fb7886ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.040+0000 7fb7886ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.040+0000 7fb7886ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:20.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.040+0000 7fb7886ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.040+0000 7fb7886ef9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:20.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.040+0000 7fb7886ef9c0 20 searching for the correct realm 2024-09-12T00:39:20.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.044+0000 7fb7869f6640 0 -- 172.21.15.138:0/1399050784 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55bcf3ee4500 msgr2=0x55bcf3ee69c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:20.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.052+0000 7fb7859f4640 0 -- 172.21.15.138:0/1399050784 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55bcf3edf740 msgr2=0x55bcf3ee1b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:20.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:39:20.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:20.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:39:20.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:20.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:20.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:20.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:20.059 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:20.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 20 zone default found 2024-09-12T00:39:20.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 4 Realm: () 2024-09-12T00:39:20.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:39:20.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:39:20.060 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:20.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 20 zonegroup default 2024-09-12T00:39:20.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.060+0000 7fb7886ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.064+0000 7fb7886ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.064+0000 7fb7886ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.064+0000 7fb7886ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.061 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.064+0000 7fb7886ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.064+0000 7fb7886ef9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.064+0000 7fb7886ef9c0 20 started sync module instance, tier type = 2024-09-12T00:39:20.062 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.064+0000 7fb7886ef9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:39:20.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.080+0000 7fb7886ef9c0 20 add_watcher() i=0 2024-09-12T00:39:20.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.080+0000 7fb7886ef9c0 20 add_watcher() i=1 2024-09-12T00:39:20.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.080+0000 7fb7886ef9c0 20 add_watcher() i=2 2024-09-12T00:39:20.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.080+0000 7fb7886ef9c0 20 add_watcher() i=3 2024-09-12T00:39:20.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.080+0000 7fb7886ef9c0 20 add_watcher() i=4 2024-09-12T00:39:20.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.080+0000 7fb7886ef9c0 20 add_watcher() i=5 2024-09-12T00:39:20.079 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.080+0000 7fb7886ef9c0 20 add_watcher() i=6 2024-09-12T00:39:20.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.084+0000 7fb7886ef9c0 20 add_watcher() i=7 2024-09-12T00:39:20.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.084+0000 7fb7886ef9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:20.084 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb63cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:20.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:20.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:20.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 5 note: GC not initialized 2024-09-12T00:39:20.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb5b77fe640 20 reqs_thread_entry: start 2024-09-12T00:39:20.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:20.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 20 Filter name: none 2024-09-12T00:39:20.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb5b57fa640 20 reqs_thread_entry: start 2024-09-12T00:39:20.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:39:20.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.086 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:20.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:39:20.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:39:20.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:39:20.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:20.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:20.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:20.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:20.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:20.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:39:20.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:39:20.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:39:20.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:39:20.088 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:39:20.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:39:20.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.088+0000 7fb7886ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:39:20.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.092+0000 7fb7886ef9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:39:20.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.092+0000 7fb7886ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:39:20.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.092+0000 7fb7886ef9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:39:20.089 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.092+0000 7fb7886ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:39:20.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.092+0000 7fb7886ef9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:39:20.090 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.092+0000 7fb7886ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:39:20.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.092+0000 7fb7886ef9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:39:20.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.092+0000 7fb7886ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:39:20.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.092+0000 7fb7886ef9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:39:20.091 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.092+0000 7fb7886ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:39:20.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.092+0000 7fb7886ef9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:39:20.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.092+0000 7fb7886ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:39:20.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.096+0000 7fb7886ef9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:39:20.092 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.096+0000 7fb7886ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:39:20.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.096+0000 7fb7886ef9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:39:20.093 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.096+0000 7fb7886ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:39:20.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.096+0000 7fb7886ef9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:39:20.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.096+0000 7fb7886ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:39:20.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.096+0000 7fb7886ef9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:39:20.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.096+0000 7fb7886ef9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:39:20.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.096+0000 7fb63cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:20.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.100+0000 7fb7886ef9c0 20 remove_watcher() i=0 2024-09-12T00:39:20.100 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.100+0000 7fb7886ef9c0 2 removed watcher, disabling cache 2024-09-12T00:39:20.101 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.104+0000 7fb7886ef9c0 20 remove_watcher() i=1 2024-09-12T00:39:20.103 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.104+0000 7fb7886ef9c0 20 remove_watcher() i=2 2024-09-12T00:39:20.105 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.108+0000 7fb7886ef9c0 20 remove_watcher() i=3 2024-09-12T00:39:20.107 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.108+0000 7fb7886ef9c0 20 remove_watcher() i=4 2024-09-12T00:39:20.109 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.112+0000 7fb7886ef9c0 20 remove_watcher() i=5 2024-09-12T00:39:20.112 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.112+0000 7fb7886ef9c0 20 remove_watcher() i=6 2024-09-12T00:39:20.114 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.116+0000 7fb7886ef9c0 20 remove_watcher() i=7 2024-09-12T00:39:20.131 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:39:20.161 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:20.162 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:20.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.204+0000 7f124962d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.208+0000 7f124962d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.208+0000 7f124962d9c0 20 realm 2024-09-12T00:39:20.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.208+0000 7f124962d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.208+0000 7f124962d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.208+0000 7f124962d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:20.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.208+0000 7f124962d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.208+0000 7f124962d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.208+0000 7f124962d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.208+0000 7f124962d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:20.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.208+0000 7f124962d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.212+0000 7f124962d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:20.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.212+0000 7f124962d9c0 20 searching for the correct realm 2024-09-12T00:39:20.214 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.216+0000 7f1247934640 0 -- 172.21.15.138:0/4076272956 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f12400d1910 msgr2=0x7f12400b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:20.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.432+0000 7f1247934640 0 -- 172.21.15.138:0/4076272956 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5653472946a0 msgr2=0x565347296b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:20.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.440+0000 7f124962d9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:39:20.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.440+0000 7f124962d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:20.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.440+0000 7f124962d9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:39:20.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.440+0000 7f124962d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:20.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.440+0000 7f124962d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:20.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.440+0000 7f124962d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:20.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.440+0000 7f124962d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.440+0000 7f124962d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.440+0000 7f124962d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.444+0000 7f124962d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:20.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.444+0000 7f124962d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.444+0000 7f124962d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:20.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.444+0000 7f124962d9c0 20 zone default found 2024-09-12T00:39:20.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.444+0000 7f124962d9c0 4 Realm: () 2024-09-12T00:39:20.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.444+0000 7f124962d9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:39:20.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.444+0000 7f124962d9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:39:20.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.444+0000 7f124962d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:20.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.444+0000 7f124962d9c0 20 zonegroup default 2024-09-12T00:39:20.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.444+0000 7f124962d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.444+0000 7f124962d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.444+0000 7f124962d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.444+0000 7f124962d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.444+0000 7f124962d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.448+0000 7f124962d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.448+0000 7f124962d9c0 20 started sync module instance, tier type = 2024-09-12T00:39:20.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.448+0000 7f124962d9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:39:20.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.468+0000 7f124962d9c0 20 add_watcher() i=0 2024-09-12T00:39:20.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.468+0000 7f124962d9c0 20 add_watcher() i=1 2024-09-12T00:39:20.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.468+0000 7f124962d9c0 20 add_watcher() i=2 2024-09-12T00:39:20.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.468+0000 7f124962d9c0 20 add_watcher() i=3 2024-09-12T00:39:20.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.468+0000 7f124962d9c0 20 add_watcher() i=4 2024-09-12T00:39:20.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.468+0000 7f124962d9c0 20 add_watcher() i=5 2024-09-12T00:39:20.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.468+0000 7f124962d9c0 20 add_watcher() i=6 2024-09-12T00:39:20.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.472+0000 7f124962d9c0 20 add_watcher() i=7 2024-09-12T00:39:20.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.472+0000 7f124962d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:20.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.476+0000 7f10fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:20.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.476+0000 7f124962d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:20.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.476+0000 7f124962d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:20.475 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.476+0000 7f124962d9c0 5 note: GC not initialized 2024-09-12T00:39:20.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.476+0000 7f10fcfe1640 20 reqs_thread_entry: start 2024-09-12T00:39:20.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.476+0000 7f124962d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:20.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.476+0000 7f124962d9c0 20 Filter name: none 2024-09-12T00:39:20.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.476+0000 7f10767fc640 20 reqs_thread_entry: start 2024-09-12T00:39:20.476 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.476+0000 7f124962d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.480+0000 7f124962d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:20.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.480+0000 7f124962d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.480+0000 7f124962d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:20.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.480+0000 7f124962d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:20.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.480+0000 7f124962d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.480+0000 7f124962d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:20.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.480+0000 7f124962d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.480+0000 7f124962d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:20.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.480+0000 7f124962d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:20.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.484+0000 7f10fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:20.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.488+0000 7f124962d9c0 20 remove_watcher() i=0 2024-09-12T00:39:20.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.488+0000 7f124962d9c0 2 removed watcher, disabling cache 2024-09-12T00:39:20.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.492+0000 7f124962d9c0 20 remove_watcher() i=1 2024-09-12T00:39:20.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.492+0000 7f124962d9c0 20 remove_watcher() i=2 2024-09-12T00:39:20.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.496+0000 7f124962d9c0 20 remove_watcher() i=3 2024-09-12T00:39:20.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.496+0000 7f124962d9c0 20 remove_watcher() i=4 2024-09-12T00:39:20.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.500+0000 7f124962d9c0 20 remove_watcher() i=5 2024-09-12T00:39:20.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.500+0000 7f124962d9c0 20 remove_watcher() i=6 2024-09-12T00:39:20.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.504+0000 7f124962d9c0 20 remove_watcher() i=7 2024-09-12T00:39:20.518 INFO:tasks.workunit.client.0.smithi138.stderr: test: duplicated entries should be purged before reshard 2024-09-12T00:39:20.518 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:39:20.546 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:20.547 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:20.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.592+0000 7fe4bc51c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.596+0000 7fe4bc51c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.596+0000 7fe4bc51c9c0 20 realm 2024-09-12T00:39:20.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.596+0000 7fe4bc51c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.596+0000 7fe4bc51c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.596+0000 7fe4bc51c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:20.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.596+0000 7fe4bc51c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.596+0000 7fe4bc51c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.596+0000 7fe4bc51c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.596+0000 7fe4bc51c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:20.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.596+0000 7fe4bc51c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.596+0000 7fe4bc51c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:20.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.596+0000 7fe4bc51c9c0 20 searching for the correct realm 2024-09-12T00:39:20.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.600+0000 7fe4b9821640 0 -- 172.21.15.138:0/1542066948 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7fe4ac042920 msgr2=0x7fe4ac050400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:20.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.608+0000 7fe4b9821640 0 -- 172.21.15.138:0/1542066948 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x564f66bd1cc0 msgr2=0x564f66bd40b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:20.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:39:20.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:20.614 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:39:20.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:20.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:20.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:20.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:20.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:20.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 20 zone default found 2024-09-12T00:39:20.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 4 Realm: () 2024-09-12T00:39:20.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:39:20.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:39:20.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:20.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 20 zonegroup default 2024-09-12T00:39:20.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.616+0000 7fe4bc51c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.620+0000 7fe4bc51c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.620+0000 7fe4bc51c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.620+0000 7fe4bc51c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.620+0000 7fe4bc51c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.620+0000 7fe4bc51c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.620+0000 7fe4bc51c9c0 20 started sync module instance, tier type = 2024-09-12T00:39:20.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.620+0000 7fe4bc51c9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:39:20.635 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.636+0000 7fe4bc51c9c0 20 add_watcher() i=0 2024-09-12T00:39:20.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.636+0000 7fe4bc51c9c0 20 add_watcher() i=1 2024-09-12T00:39:20.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.636+0000 7fe4bc51c9c0 20 add_watcher() i=2 2024-09-12T00:39:20.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.636+0000 7fe4bc51c9c0 20 add_watcher() i=3 2024-09-12T00:39:20.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.636+0000 7fe4bc51c9c0 20 add_watcher() i=4 2024-09-12T00:39:20.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.636+0000 7fe4bc51c9c0 20 add_watcher() i=5 2024-09-12T00:39:20.636 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.636+0000 7fe4bc51c9c0 20 add_watcher() i=6 2024-09-12T00:39:20.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.640+0000 7fe4bc51c9c0 20 add_watcher() i=7 2024-09-12T00:39:20.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.640+0000 7fe4bc51c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:20.642 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.644+0000 7fe370fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:20.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.644+0000 7fe4bc51c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:20.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.644+0000 7fe4bc51c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:20.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.644+0000 7fe4bc51c9c0 5 note: GC not initialized 2024-09-12T00:39:20.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.644+0000 7fe2eb7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:20.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.644+0000 7fe4bc51c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:20.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.644+0000 7fe4bc51c9c0 20 Filter name: none 2024-09-12T00:39:20.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.644+0000 7fe2e97fa640 20 reqs_thread_entry: start 2024-09-12T00:39:20.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.644+0000 7fe4bc51c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.644+0000 7fe4bc51c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:20.644 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.644+0000 7fe4bc51c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.644+0000 7fe4bc51c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:20.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.644+0000 7fe4bc51c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:20.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.644+0000 7fe4bc51c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.644+0000 7fe4bc51c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:20.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.644+0000 7fe4bc51c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.648+0000 7fe4bc51c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:20.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.648+0000 7fe4bc51c9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:20.647 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.648+0000 7fe370fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:20.651 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.652+0000 7fe4bc51c9c0 20 remove_watcher() i=0 2024-09-12T00:39:20.652 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.652+0000 7fe4bc51c9c0 2 removed watcher, disabling cache 2024-09-12T00:39:20.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.656+0000 7fe4bc51c9c0 20 remove_watcher() i=1 2024-09-12T00:39:20.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.656+0000 7fe4bc51c9c0 20 remove_watcher() i=2 2024-09-12T00:39:20.657 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.660+0000 7fe4bc51c9c0 20 remove_watcher() i=3 2024-09-12T00:39:20.659 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.660+0000 7fe4bc51c9c0 20 remove_watcher() i=4 2024-09-12T00:39:20.661 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.664+0000 7fe4bc51c9c0 20 remove_watcher() i=5 2024-09-12T00:39:20.663 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.664+0000 7fe4bc51c9c0 20 remove_watcher() i=6 2024-09-12T00:39:20.666 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.668+0000 7fe4bc51c9c0 20 remove_watcher() i=7 2024-09-12T00:39:20.681 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:20.681 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:39:20.681 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: a-bucket id: e2043445-c131-4520-984d-b4d52f038a6b.4538.17 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-12T00:39:20.681 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:20.681 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:39:20.713 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:20.714 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:20.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.756+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 realm 2024-09-12T00:39:20.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.760+0000 7f8e5a6949c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:20.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:20.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.764+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:20.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.764+0000 7f8e5a6949c0 20 searching for the correct realm 2024-09-12T00:39:20.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.768+0000 7f8e5899b640 0 -- 172.21.15.138:0/2978218272 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f8e50017410 msgr2=0x7f8e50017890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:20.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.984+0000 7f8e5899b640 0 -- 172.21.15.138:0/2978218272 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x561187040550 msgr2=0x561187042a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:20.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:39:20.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:20.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:39:20.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:20.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:20.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:20.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:20.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:20.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 zone default found 2024-09-12T00:39:20.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.996+0000 7f8e5a6949c0 4 Realm: () 2024-09-12T00:39:20.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.996+0000 7f8e5a6949c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:39:20.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.996+0000 7f8e5a6949c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:39:20.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.996+0000 7f8e5a6949c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:20.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 zonegroup default 2024-09-12T00:39:20.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:20.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.000+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:20.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.000+0000 7f8e5a6949c0 20 started sync module instance, tier type = 2024-09-12T00:39:20.996 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.000+0000 7f8e5a6949c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:39:21.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=0 2024-09-12T00:39:21.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=1 2024-09-12T00:39:21.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=2 2024-09-12T00:39:21.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=3 2024-09-12T00:39:21.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=4 2024-09-12T00:39:21.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=5 2024-09-12T00:39:21.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=6 2024-09-12T00:39:21.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.024+0000 7f8e5a6949c0 20 add_watcher() i=7 2024-09-12T00:39:21.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.024+0000 7f8e5a6949c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:21.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.028+0000 7f8d0efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:21.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.028+0000 7f8e5a6949c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:21.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.028+0000 7f8e5a6949c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:21.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 note: GC not initialized 2024-09-12T00:39:21.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.028+0000 7f8d0dfdb640 20 reqs_thread_entry: start 2024-09-12T00:39:21.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:21.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 Filter name: none 2024-09-12T00:39:21.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.032+0000 7f8c7f7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:21.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:39:21.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:21.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:39:21.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:39:21.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:39:21.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:21.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:21.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:21.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:21.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:21.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:39:21.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.044+0000 7f8e5a6949c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:21.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.044+0000 7f8e5a6949c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:21.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.044+0000 7f8e5a6949c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:21.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.044+0000 7f8e5a6949c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:39:21.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.044+0000 7f8d2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333573 cookie 94633279629488 notifier 7748 bl.length()=827 2024-09-12T00:39:21.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.044+0000 7f8d2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:21.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.044+0000 7f8d2effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:21.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.044+0000 7f8d2effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:21.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.044+0000 7f8e5a6949c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:39:21.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.044+0000 7f8e5a6949c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:39:21.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.044+0000 7f8e5a6949c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:39:21.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.044+0000 7f8e5a6949c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:39:21.054 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8e5a6949c0 time 2024-09-12T00:39:21.061450+0000 2024-09-12T00:39:21.055 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:21.056 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:21.056 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f8e5df6e2eb] 2024-09-12T00:39:21.056 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8e5df6e49f] 2024-09-12T00:39:21.056 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56118582ccc1] 2024-09-12T00:39:21.056 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561185841d5a] 2024-09-12T00:39:21.056 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-12T00:39:21.056 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8e5cdd4d90] 2024-09-12T00:39:21.056 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-12T00:39:21.056 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-12T00:39:21.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.056+0000 7f8e5a6949c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8e5a6949c0 time 2024-09-12T00:39:21.061450+0000 2024-09-12T00:39:21.057 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:21.057 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.057 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:21.057 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f8e5df6e2eb] 2024-09-12T00:39:21.057 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8e5df6e49f] 2024-09-12T00:39:21.057 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56118582ccc1] 2024-09-12T00:39:21.057 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561185841d5a] 2024-09-12T00:39:21.057 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-12T00:39:21.057 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8e5cdd4d90] 2024-09-12T00:39:21.057 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-12T00:39:21.057 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-12T00:39:21.057 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.057 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:39:21.058 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f8e5a6949c0 thread_name:radosgw-admin 2024-09-12T00:39:21.066 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:21.066 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f8e5cded520] 2024-09-12T00:39:21.066 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:39:21.066 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:39:21.066 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:39:21.066 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f8e5df6e345] 2024-09-12T00:39:21.066 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8e5df6e49f] 2024-09-12T00:39:21.066 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56118582ccc1] 2024-09-12T00:39:21.066 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561185841d5a] 2024-09-12T00:39:21.066 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-12T00:39:21.067 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8e5cdd4d90] 2024-09-12T00:39:21.067 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-12T00:39:21.067 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-12T00:39:21.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.060+0000 7f8e5a6949c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:21.067 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f8e5a6949c0 thread_name:radosgw-admin 2024-09-12T00:39:21.067 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.067 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:21.067 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f8e5cded520] 2024-09-12T00:39:21.067 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:39:21.067 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:39:21.067 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:39:21.067 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f8e5df6e345] 2024-09-12T00:39:21.067 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8e5df6e49f] 2024-09-12T00:39:21.068 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56118582ccc1] 2024-09-12T00:39:21.068 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561185841d5a] 2024-09-12T00:39:21.068 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-12T00:39:21.068 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8e5cdd4d90] 2024-09-12T00:39:21.068 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-12T00:39:21.068 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-12T00:39:21.068 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:21.068 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.068 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:39:21.068 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:39:20.736+0000 7f8e57999640 10 monclient(hunting): handle_auth_done global_id 7736 payload 274 2024-09-12T00:39:21.068 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:39:20.736+0000 7f8e57999640 10 monclient: _finish_hunting 0 2024-09-12T00:39:21.069 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:39:20.736+0000 7f8e57999640 1 monclient: found mon.noname-c 2024-09-12T00:39:21.069 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:39:20.736+0000 7f8e57999640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:39:21.069 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.069 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:21.069 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: dump: 2024-09-12T00:39:21.069 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.069 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.069 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.069 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.069 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.069 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.069 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.070 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.070 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.070 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.070 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: _finish_auth 0 2024-09-12T00:39:21.070 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: _check_auth_tickets 2024-09-12T00:39:21.070 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:21.070 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.070 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:21.070 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: dump: 2024-09-12T00:39:21.070 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.071 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.071 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.071 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.071 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.071 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.071 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.071 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.071 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.071 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.071 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:39:20.736+0000 7f8e5a6949c0 5 monclient: authenticate success, global_id 7736 2024-09-12T00:39:21.071 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:39:20.736+0000 7f8e5a6949c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:21.071 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:39:20.736+0000 7f8e5a6949c0 4 set_mon_vals no callback set 2024-09-12T00:39:21.072 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: shutdown 2024-09-12T00:39:21.072 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) unregister_commands rotate-key 2024-09-12T00:39:21.072 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: build_initial_monmap 2024-09-12T00:39:21.072 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:21.072 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: monmap: 2024-09-12T00:39:21.072 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:39:21.072 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:21.072 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:39:21.072 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:39:21.072 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:21.072 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.072 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:39:21.072 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:39:21.073 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:39:21.073 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.073 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding auth protocol: cephx 2024-09-12T00:39:21.073 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding auth protocol: cephx 2024-09-12T00:39:21.073 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding auth protocol: cephx 2024-09-12T00:39:21.073 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: secure 2024-09-12T00:39:21.073 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: crc 2024-09-12T00:39:21.073 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: secure 2024-09-12T00:39:21.073 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: crc 2024-09-12T00:39:21.073 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: secure 2024-09-12T00:39:21.073 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: crc 2024-09-12T00:39:21.073 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: crc 2024-09-12T00:39:21.073 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: secure 2024-09-12T00:39:21.074 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: crc 2024-09-12T00:39:21.074 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: secure 2024-09-12T00:39:21.074 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: crc 2024-09-12T00:39:21.074 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: secure 2024-09-12T00:39:21.074 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.074 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 1 librados: starting msgr at 2024-09-12T00:39:21.074 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 1 librados: starting objecter 2024-09-12T00:39:21.074 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command objecter_requests hook 0x561186ce7230 2024-09-12T00:39:21.074 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 1 librados: setting wanted keys 2024-09-12T00:39:21.074 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 1 librados: calling monclient init 2024-09-12T00:39:21.074 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: init 2024-09-12T00:39:21.074 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding auth protocol: cephx 2024-09-12T00:39:21.074 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding auth protocol: cephx 2024-09-12T00:39:21.074 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding auth protocol: cephx 2024-09-12T00:39:21.075 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: secure 2024-09-12T00:39:21.075 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: crc 2024-09-12T00:39:21.075 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: secure 2024-09-12T00:39:21.075 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: crc 2024-09-12T00:39:21.075 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: secure 2024-09-12T00:39:21.075 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: crc 2024-09-12T00:39:21.075 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: crc 2024-09-12T00:39:21.075 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: secure 2024-09-12T00:39:21.075 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: crc 2024-09-12T00:39:21.075 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: secure 2024-09-12T00:39:21.075 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: crc 2024-09-12T00:39:21.075 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: secure 2024-09-12T00:39:21.075 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.076 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.076 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command rotate-key hook 0x561186f4b988 2024-09-12T00:39:21.076 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:21.076 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:39:21.076 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-c con 0x561186dd7df0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:39:21.076 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-a con 0x561186dfbea0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:39:21.076 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-b con 0x561186f79f40 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:39:21.076 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.076 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.076 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.076 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:21.076 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient(hunting): authenticate will time out at 2414.085687s 2024-09-12T00:39:21.076 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient(hunting): get_auth_request con 0x561186dd7df0 auth_method 0 2024-09-12T00:39:21.077 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.077 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.077 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.077 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:39:20.740+0000 7f8e57999640 10 monclient(hunting): get_auth_request con 0x561186dfbea0 auth_method 0 2024-09-12T00:39:21.077 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:39:20.740+0000 7f8e57999640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.077 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:39:20.740+0000 7f8e57999640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.077 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:39:20.740+0000 7f8e57999640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.077 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:21.077 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:21.077 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:21.077 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:39:20.740+0000 7f8e57999640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:21.077 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:39:20.740+0000 7f8e57999640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:21.078 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:39:20.740+0000 7f8e57999640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:21.078 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:39:20.740+0000 7f8e5899b640 10 monclient(hunting): get_auth_request con 0x561186f79f40 auth_method 0 2024-09-12T00:39:21.078 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:39:20.740+0000 7f8e5899b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.078 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:39:20.740+0000 7f8e5899b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.078 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:39:20.740+0000 7f8e5899b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.078 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient(hunting): handle_auth_done global_id 7739 payload 824 2024-09-12T00:39:21.078 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient: _finish_hunting 0 2024-09-12T00:39:21.078 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:39:20.740+0000 7f8e5819a640 1 monclient: found mon.noname-c 2024-09-12T00:39:21.078 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:39:21.078 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.078 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:21.078 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: dump: 2024-09-12T00:39:21.078 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.078 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.079 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.079 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.079 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.079 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.079 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.079 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.079 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.079 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.079 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: _finish_auth 0 2024-09-12T00:39:21.080 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: _check_auth_tickets 2024-09-12T00:39:21.080 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:21.080 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.080 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:21.080 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: dump: 2024-09-12T00:39:21.080 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.080 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.080 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.080 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.080 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.080 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.080 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.080 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.081 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.081 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.081 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 monclient: authenticate success, global_id 7739 2024-09-12T00:39:21.081 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: _renew_subs 2024-09-12T00:39:21.081 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:39:20.740+0000 7f8d4660c640 4 set_mon_vals no callback set 2024-09-12T00:39:21.081 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:39:21.081 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: _renew_subs 2024-09-12T00:39:21.082 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:39:21.082 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 1 librados: init done 2024-09-12T00:39:21.082 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:39:20.744+0000 7f8d44e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:21.082 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:39:20.744+0000 7f8d44e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:21.082 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:39:20.744+0000 7f8d44e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:21.082 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:39:20.744+0000 7f8e57999640 10 monclient: get_auth_request con 0x7f8d40070ae0 auth_method 0 2024-09-12T00:39:21.082 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:39:20.744+0000 7f8e5899b640 10 monclient: get_auth_request con 0x561186f77050 auth_method 0 2024-09-12T00:39:21.082 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:39:20.744+0000 7f8e5819a640 10 monclient: get_auth_request con 0x561186f960b0 auth_method 0 2024-09-12T00:39:21.082 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:39:20.744+0000 7f8e57999640 10 monclient: get_auth_request con 0x561186f9a2f0 auth_method 0 2024-09-12T00:39:21.083 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: build_initial_monmap 2024-09-12T00:39:21.083 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:21.083 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: monmap: 2024-09-12T00:39:21.083 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:39:21.083 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:21.083 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:39:21.083 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:39:21.083 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:21.083 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.083 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:39:21.083 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:39:21.083 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:39:21.083 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.084 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding auth protocol: cephx 2024-09-12T00:39:21.084 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding auth protocol: cephx 2024-09-12T00:39:21.084 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding auth protocol: cephx 2024-09-12T00:39:21.084 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: secure 2024-09-12T00:39:21.084 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: crc 2024-09-12T00:39:21.084 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: secure 2024-09-12T00:39:21.084 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: crc 2024-09-12T00:39:21.084 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: secure 2024-09-12T00:39:21.084 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: crc 2024-09-12T00:39:21.084 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: crc 2024-09-12T00:39:21.084 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: secure 2024-09-12T00:39:21.084 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: crc 2024-09-12T00:39:21.084 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: secure 2024-09-12T00:39:21.085 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: crc 2024-09-12T00:39:21.085 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: secure 2024-09-12T00:39:21.085 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.085 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command objecter_requests cmddesc objecter_requests hook 0x561186fa2b20 EEXIST 2024-09-12T00:39:21.085 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: init 2024-09-12T00:39:21.085 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding auth protocol: cephx 2024-09-12T00:39:21.085 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding auth protocol: cephx 2024-09-12T00:39:21.085 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding auth protocol: cephx 2024-09-12T00:39:21.085 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: secure 2024-09-12T00:39:21.085 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: crc 2024-09-12T00:39:21.085 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: secure 2024-09-12T00:39:21.085 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: crc 2024-09-12T00:39:21.085 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: secure 2024-09-12T00:39:21.086 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: crc 2024-09-12T00:39:21.086 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: crc 2024-09-12T00:39:21.086 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: secure 2024-09-12T00:39:21.086 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: crc 2024-09-12T00:39:21.086 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: secure 2024-09-12T00:39:21.086 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: crc 2024-09-12T00:39:21.086 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: secure 2024-09-12T00:39:21.086 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.086 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.086 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command rotate-key cmddesc rotate-key hook 0x561186f9d980 EEXIST 2024-09-12T00:39:21.086 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:21.086 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:39:21.086 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-a con 0x561186fc6cd0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:39:21.087 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-b con 0x561186fc6600 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:39:21.087 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-c con 0x561186fc4fe0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:39:21.087 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.087 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.087 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.087 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:21.087 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient(hunting): authenticate will time out at 2414.094275s 2024-09-12T00:39:21.087 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient(hunting): get_auth_request con 0x561186fc6cd0 auth_method 0 2024-09-12T00:39:21.087 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.087 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.087 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.087 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:39:20.748+0000 7f8e5899b640 10 monclient(hunting): get_auth_request con 0x561186fc4fe0 auth_method 0 2024-09-12T00:39:21.087 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:39:20.748+0000 7f8e5899b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.088 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:39:20.748+0000 7f8e5899b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.088 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:39:20.748+0000 7f8e5899b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.088 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:21.088 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:21.088 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:21.088 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:39:20.748+0000 7f8e5899b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:21.088 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:39:20.748+0000 7f8e5899b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:21.088 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:39:20.748+0000 7f8e5899b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:21.088 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:39:20.748+0000 7f8e57999640 10 monclient(hunting): get_auth_request con 0x561186fc6600 auth_method 0 2024-09-12T00:39:21.088 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:39:20.748+0000 7f8e57999640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.088 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:39:20.748+0000 7f8e57999640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.088 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:39:20.748+0000 7f8e57999640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.088 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient(hunting): handle_auth_done global_id 8292 payload 824 2024-09-12T00:39:21.089 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient: _finish_hunting 0 2024-09-12T00:39:21.089 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:39:20.748+0000 7f8e5819a640 1 monclient: found mon.noname-a 2024-09-12T00:39:21.089 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:39:21.089 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.089 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:21.089 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: dump: 2024-09-12T00:39:21.089 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.089 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.089 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.089 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.089 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.089 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.089 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.090 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.090 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.090 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.090 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: _finish_auth 0 2024-09-12T00:39:21.090 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: _check_auth_tickets 2024-09-12T00:39:21.090 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:21.090 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.090 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:21.090 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: dump: 2024-09-12T00:39:21.090 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.090 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.090 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.090 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.090 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.091 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.091 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.091 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.091 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.091 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.091 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:39:20.748+0000 7f8e5919c640 4 set_mon_vals no callback set 2024-09-12T00:39:21.091 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 monclient: authenticate success, global_id 8292 2024-09-12T00:39:21.091 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: _renew_subs 2024-09-12T00:39:21.091 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:39:21.091 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: _renew_subs 2024-09-12T00:39:21.091 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:39:21.091 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:39:20.752+0000 7f8d3dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:21.091 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:39:20.752+0000 7f8d3dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:21.092 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:39:20.752+0000 7f8d3dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:21.092 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient: get_monmap_and_config 2024-09-12T00:39:21.092 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient: build_initial_monmap 2024-09-12T00:39:21.092 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:21.092 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient: monmap: 2024-09-12T00:39:21.092 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:39:21.092 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:21.092 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:39:21.092 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:39:21.092 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:21.092 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.092 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:39:21.092 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:39:21.093 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:39:21.093 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.093 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding auth protocol: cephx 2024-09-12T00:39:21.093 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding auth protocol: cephx 2024-09-12T00:39:21.093 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding auth protocol: cephx 2024-09-12T00:39:21.093 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: secure 2024-09-12T00:39:21.093 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: crc 2024-09-12T00:39:21.093 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: secure 2024-09-12T00:39:21.093 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: crc 2024-09-12T00:39:21.093 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: secure 2024-09-12T00:39:21.093 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: crc 2024-09-12T00:39:21.093 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: crc 2024-09-12T00:39:21.093 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: secure 2024-09-12T00:39:21.094 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: crc 2024-09-12T00:39:21.094 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: secure 2024-09-12T00:39:21.094 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: crc 2024-09-12T00:39:21.094 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: secure 2024-09-12T00:39:21.094 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:39:20.752+0000 7f8e57999640 10 monclient: get_auth_request con 0x7f8d30070a20 auth_method 0 2024-09-12T00:39:21.094 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.094 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient: init 2024-09-12T00:39:21.094 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding auth protocol: cephx 2024-09-12T00:39:21.094 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding auth protocol: cephx 2024-09-12T00:39:21.094 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding auth protocol: cephx 2024-09-12T00:39:21.094 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: secure 2024-09-12T00:39:21.094 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: crc 2024-09-12T00:39:21.094 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: secure 2024-09-12T00:39:21.095 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: crc 2024-09-12T00:39:21.095 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: secure 2024-09-12T00:39:21.095 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: crc 2024-09-12T00:39:21.095 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: crc 2024-09-12T00:39:21.095 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: secure 2024-09-12T00:39:21.095 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: crc 2024-09-12T00:39:21.095 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: secure 2024-09-12T00:39:21.095 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: crc 2024-09-12T00:39:21.095 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: secure 2024-09-12T00:39:21.095 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.095 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.095 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc27d56358 EEXIST 2024-09-12T00:39:21.095 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:21.095 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:39:21.096 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-a con 0x561186fea790 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:39:21.096 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-b con 0x561187014db0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:39:21.096 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-c con 0x561187015fc0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:39:21.096 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.096 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.096 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.096 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:21.096 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient(hunting): authenticate will time out at 2414.098893s 2024-09-12T00:39:21.096 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient(hunting): get_auth_request con 0x561186fea790 auth_method 0 2024-09-12T00:39:21.096 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.096 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.096 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.097 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:39:20.752+0000 7f8e5899b640 10 monclient(hunting): get_auth_request con 0x561187015fc0 auth_method 0 2024-09-12T00:39:21.097 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:39:20.752+0000 7f8e5899b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.097 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:39:20.752+0000 7f8e5899b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.097 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:39:20.752+0000 7f8e5899b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.097 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:21.097 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:21.097 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:21.097 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:39:20.752+0000 7f8e5899b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:21.097 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:39:20.752+0000 7f8e5899b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:21.097 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:39:20.752+0000 7f8e5899b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:21.097 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient(hunting): handle_auth_done global_id 8295 payload 274 2024-09-12T00:39:21.097 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient: _finish_hunting 0 2024-09-12T00:39:21.097 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:39:20.752+0000 7f8e5819a640 1 monclient: found mon.noname-a 2024-09-12T00:39:21.098 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:39:21.098 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.098 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:21.098 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: dump: 2024-09-12T00:39:21.098 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.098 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.098 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.098 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.098 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.098 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.098 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.098 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.099 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.099 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.099 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: _finish_auth 0 2024-09-12T00:39:21.099 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:39:21.099 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:21.100 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.100 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:21.100 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: dump: 2024-09-12T00:39:21.100 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.100 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.100 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.100 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.100 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.100 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.100 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.100 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.100 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.100 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.101 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 monclient: authenticate success, global_id 8295 2024-09-12T00:39:21.101 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:21.101 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 4 set_mon_vals no callback set 2024-09-12T00:39:21.101 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: shutdown 2024-09-12T00:39:21.101 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: build_initial_monmap 2024-09-12T00:39:21.101 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:21.101 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: monmap: 2024-09-12T00:39:21.101 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:39:21.101 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:21.102 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:39:21.102 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:39:21.102 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:21.102 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.102 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:39:21.102 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:39:21.102 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:39:21.102 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.102 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding auth protocol: cephx 2024-09-12T00:39:21.102 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding auth protocol: cephx 2024-09-12T00:39:21.102 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding auth protocol: cephx 2024-09-12T00:39:21.102 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: secure 2024-09-12T00:39:21.102 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: crc 2024-09-12T00:39:21.103 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: secure 2024-09-12T00:39:21.103 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: crc 2024-09-12T00:39:21.103 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: secure 2024-09-12T00:39:21.103 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: crc 2024-09-12T00:39:21.103 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: crc 2024-09-12T00:39:21.103 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: secure 2024-09-12T00:39:21.103 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: crc 2024-09-12T00:39:21.103 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: secure 2024-09-12T00:39:21.103 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: crc 2024-09-12T00:39:21.103 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: secure 2024-09-12T00:39:21.103 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.103 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 1 librados: starting msgr at 2024-09-12T00:39:21.104 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 1 librados: starting objecter 2024-09-12T00:39:21.104 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command objecter_requests cmddesc objecter_requests hook 0x56118701b180 EEXIST 2024-09-12T00:39:21.104 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 1 librados: setting wanted keys 2024-09-12T00:39:21.104 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 1 librados: calling monclient init 2024-09-12T00:39:21.104 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: init 2024-09-12T00:39:21.104 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding auth protocol: cephx 2024-09-12T00:39:21.104 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding auth protocol: cephx 2024-09-12T00:39:21.104 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding auth protocol: cephx 2024-09-12T00:39:21.104 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: secure 2024-09-12T00:39:21.104 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: crc 2024-09-12T00:39:21.104 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: secure 2024-09-12T00:39:21.104 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: crc 2024-09-12T00:39:21.104 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: secure 2024-09-12T00:39:21.105 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: crc 2024-09-12T00:39:21.105 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: crc 2024-09-12T00:39:21.105 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: secure 2024-09-12T00:39:21.105 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: crc 2024-09-12T00:39:21.106 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: secure 2024-09-12T00:39:21.106 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: crc 2024-09-12T00:39:21.106 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: secure 2024-09-12T00:39:21.106 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.106 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.106 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command rotate-key cmddesc rotate-key hook 0x561186fc8c38 EEXIST 2024-09-12T00:39:21.106 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:21.106 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:39:21.106 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-c con 0x561186fea790 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:39:21.106 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-a con 0x561187014db0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:39:21.106 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-b con 0x561187015fc0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:39:21.107 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.107 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.107 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.107 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:21.107 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient(hunting): authenticate will time out at 2414.101434s 2024-09-12T00:39:21.107 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient(hunting): get_auth_request con 0x561186fea790 auth_method 0 2024-09-12T00:39:21.107 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.107 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.107 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.107 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:39:20.756+0000 7f8e57999640 10 monclient(hunting): get_auth_request con 0x561187014db0 auth_method 0 2024-09-12T00:39:21.107 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:39:20.756+0000 7f8e57999640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.107 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:39:20.756+0000 7f8e57999640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.107 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:39:20.756+0000 7f8e57999640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.108 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:21.108 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:21.108 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:21.108 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:39:20.756+0000 7f8e57999640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:21.108 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:39:20.756+0000 7f8e57999640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:21.108 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:39:20.756+0000 7f8e57999640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:21.108 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient(hunting): handle_auth_done global_id 7748 payload 824 2024-09-12T00:39:21.108 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient: _finish_hunting 0 2024-09-12T00:39:21.108 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:39:20.756+0000 7f8e5819a640 1 monclient: found mon.noname-c 2024-09-12T00:39:21.108 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:39:21.108 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.108 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:21.109 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: dump: 2024-09-12T00:39:21.109 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.109 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.109 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.109 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.109 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.109 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.109 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.109 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.109 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.109 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.109 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: _finish_auth 0 2024-09-12T00:39:21.109 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: _check_auth_tickets 2024-09-12T00:39:21.110 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:21.110 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.110 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:21.110 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: dump: 2024-09-12T00:39:21.110 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.110 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.110 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.110 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.110 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.110 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.110 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.110 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.110 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.111 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.111 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 monclient: authenticate success, global_id 7748 2024-09-12T00:39:21.111 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:39:20.756+0000 7f8d2f7fe640 4 set_mon_vals no callback set 2024-09-12T00:39:21.111 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: _renew_subs 2024-09-12T00:39:21.111 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:39:21.111 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: _renew_subs 2024-09-12T00:39:21.111 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:39:21.111 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 1 librados: init done 2024-09-12T00:39:21.111 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command cr dump hook 0x561187009798 2024-09-12T00:39:21.111 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.111 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:39:20.760+0000 7f8d2dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:21.111 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:39:20.760+0000 7f8d2dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:21.111 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:39:20.760+0000 7f8d2dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:21.112 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:39:20.760+0000 7f8e57999640 10 monclient: get_auth_request con 0x7f8d20070ae0 auth_method 0 2024-09-12T00:39:21.112 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:39:20.760+0000 7f8e5899b640 10 monclient: get_auth_request con 0x561187033c50 auth_method 0 2024-09-12T00:39:21.112 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.112 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 realm 2024-09-12T00:39:21.112 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.112 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.112 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:21.112 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.112 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.112 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.112 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:39:20.760+0000 7f8e5819a640 10 monclient: get_auth_request con 0x561187038050 auth_method 0 2024-09-12T00:39:21.112 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:21.112 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.113 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:39:20.760+0000 7f8e57999640 10 monclient: get_auth_request con 0x56118703b790 auth_method 0 2024-09-12T00:39:21.113 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:39:20.764+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:21.113 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:39:20.764+0000 7f8e5a6949c0 20 searching for the correct realm 2024-09-12T00:39:21.113 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:39:20.764+0000 7f8e5899b640 10 monclient: get_auth_request con 0x561187040550 auth_method 0 2024-09-12T00:39:21.113 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:39:20.764+0000 7f8e5819a640 10 monclient: get_auth_request con 0x7f8e50018040 auth_method 0 2024-09-12T00:39:21.113 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:39:20.764+0000 7f8e57999640 10 monclient: get_auth_request con 0x7f8e48008040 auth_method 0 2024-09-12T00:39:21.113 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:39:20.768+0000 7f8e5899b640 10 monclient: get_auth_request con 0x7f8e50017410 auth_method 0 2024-09-12T00:39:21.113 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:39:20.768+0000 7f8e5899b640 0 -- 172.21.15.138:0/2978218272 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f8e50017410 msgr2=0x7f8e50017890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:21.113 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:39:20.972+0000 7f8e5899b640 10 monclient: get_auth_request con 0x7f8e50017410 auth_method 0 2024-09-12T00:39:21.113 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:39:20.976+0000 7f8e5819a640 10 monclient: get_auth_request con 0x7f8e4802a040 auth_method 0 2024-09-12T00:39:21.113 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:39:20.984+0000 7f8e5899b640 0 -- 172.21.15.138:0/2978218272 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x561187040550 msgr2=0x561187042a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:21.113 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:39:20.984+0000 7f8d2dffb640 1 client.7748.objecter ms_handle_reset 0x561187040550 session 0x56118703fed0 osd.4 2024-09-12T00:39:21.114 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:39:20.984+0000 7f8d2dffb640 10 monclient: _renew_subs 2024-09-12T00:39:21.114 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:39:20.984+0000 7f8d2dffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:39:21.114 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:39:20.984+0000 7f8e5899b640 10 monclient: get_auth_request con 0x7f8d20080e00 auth_method 0 2024-09-12T00:39:21.114 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:39:21.114 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:21.114 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:39:21.114 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:21.114 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:21.114 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:21.114 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.114 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.114 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.114 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:21.115 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.115 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:21.115 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 zone default found 2024-09-12T00:39:21.115 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 4 Realm: () 2024-09-12T00:39:21.115 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:39:21.115 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:39:21.115 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:21.115 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 zonegroup default 2024-09-12T00:39:21.115 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.115 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.115 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.115 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.115 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.116 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:39:21.000+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.116 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:39:21.000+0000 7f8e5a6949c0 20 started sync module instance, tier type = 2024-09-12T00:39:21.116 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:39:21.000+0000 7f8e5a6949c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:39:21.116 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=0 2024-09-12T00:39:21.116 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=1 2024-09-12T00:39:21.116 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=2 2024-09-12T00:39:21.116 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=3 2024-09-12T00:39:21.116 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=4 2024-09-12T00:39:21.117 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=5 2024-09-12T00:39:21.117 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=6 2024-09-12T00:39:21.117 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:39:21.024+0000 7f8e5a6949c0 20 add_watcher() i=7 2024-09-12T00:39:21.117 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:39:21.024+0000 7f8e5a6949c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:21.117 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding auth protocol: cephx 2024-09-12T00:39:21.117 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding auth protocol: cephx 2024-09-12T00:39:21.117 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding auth protocol: cephx 2024-09-12T00:39:21.117 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: secure 2024-09-12T00:39:21.117 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: crc 2024-09-12T00:39:21.117 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: secure 2024-09-12T00:39:21.117 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: crc 2024-09-12T00:39:21.117 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: secure 2024-09-12T00:39:21.117 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: crc 2024-09-12T00:39:21.118 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: crc 2024-09-12T00:39:21.118 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:39:21.028+0000 7f8d0efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:21.118 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: secure 2024-09-12T00:39:21.118 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: crc 2024-09-12T00:39:21.118 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: secure 2024-09-12T00:39:21.118 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: crc 2024-09-12T00:39:21.118 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: secure 2024-09-12T00:39:21.118 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.118 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:21.118 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:21.118 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command cache list hook 0x5611870107b0 2024-09-12T00:39:21.118 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command cache inspect hook 0x5611870107b0 2024-09-12T00:39:21.118 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command cache erase hook 0x5611870107b0 2024-09-12T00:39:21.119 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command cache zap hook 0x5611870107b0 2024-09-12T00:39:21.119 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 note: GC not initialized 2024-09-12T00:39:21.119 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:39:21.028+0000 7f8d0dfdb640 20 reqs_thread_entry: start 2024-09-12T00:39:21.119 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command sync trace show hook 0x7f8e48083070 2024-09-12T00:39:21.119 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command sync trace history hook 0x7f8e48083070 2024-09-12T00:39:21.119 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command sync trace active hook 0x7f8e48083070 2024-09-12T00:39:21.119 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command sync trace active_short hook 0x7f8e48083070 2024-09-12T00:39:21.119 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:21.119 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 Filter name: none 2024-09-12T00:39:21.119 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:39:21.032+0000 7f8c7f7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:21.119 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:39:21.119 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.120 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:21.120 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:39:21.120 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:39:21.120 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:39:21.120 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.120 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:21.120 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:21.120 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:21.120 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:21.120 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:21.120 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:39:21.120 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:39:21.044+0000 7f8e5a6949c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:21.120 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:39:21.044+0000 7f8e5a6949c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:21.121 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:39:21.044+0000 7f8e5a6949c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:21.121 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:39:21.044+0000 7f8e5a6949c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:39:21.121 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:39:21.044+0000 7f8d2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333573 cookie 94633279629488 notifier 7748 bl.length()=827 2024-09-12T00:39:21.121 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:39:21.044+0000 7f8d2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:21.121 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:39:21.044+0000 7f8d2effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:21.121 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:39:21.044+0000 7f8d2effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:21.121 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:39:21.044+0000 7f8e5a6949c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:39:21.121 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:39:21.044+0000 7f8e5a6949c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:39:21.121 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:39:21.044+0000 7f8e5a6949c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:39:21.121 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:39:21.044+0000 7f8e5a6949c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:39:21.121 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:39:21.056+0000 7f8e5a6949c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8e5a6949c0 time 2024-09-12T00:39:21.061450+0000 2024-09-12T00:39:21.121 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:21.121 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.122 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:21.122 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f8e5df6e2eb] 2024-09-12T00:39:21.122 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8e5df6e49f] 2024-09-12T00:39:21.122 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56118582ccc1] 2024-09-12T00:39:21.122 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561185841d5a] 2024-09-12T00:39:21.122 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-12T00:39:21.122 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8e5cdd4d90] 2024-09-12T00:39:21.122 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-12T00:39:21.122 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-12T00:39:21.122 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.122 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:39:21.060+0000 7f8e5a6949c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:21.122 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f8e5a6949c0 thread_name:radosgw-admin 2024-09-12T00:39:21.122 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.123 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:21.123 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f8e5cded520] 2024-09-12T00:39:21.123 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:39:21.123 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:39:21.123 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:39:21.123 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f8e5df6e345] 2024-09-12T00:39:21.123 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8e5df6e49f] 2024-09-12T00:39:21.123 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56118582ccc1] 2024-09-12T00:39:21.123 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561185841d5a] 2024-09-12T00:39:21.123 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-12T00:39:21.123 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8e5cdd4d90] 2024-09-12T00:39:21.123 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-12T00:39:21.123 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-12T00:39:21.123 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:21.124 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.124 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:39:21.124 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:39:21.124 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:39:21.124 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:39:21.124 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:39:21.124 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:39:21.124 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:39:21.124 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:39:21.124 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:39:21.124 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:39:21.124 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:39:21.124 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:39:21.125 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:39:21.125 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:39:21.125 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:39:21.125 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:39:21.125 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:39:21.125 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:39:21.125 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:39:21.125 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:39:21.125 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:39:21.125 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:39:21.125 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:39:21.125 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:39:21.125 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:39:21.125 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:39:21.126 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:39:21.126 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:39:21.126 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:39:21.126 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:39:21.126 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:39:21.126 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:39:21.126 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:39:21.126 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:39:21.126 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:39:21.126 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:39:21.126 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:39:21.126 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:39:21.126 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:39:21.127 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:39:21.127 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:39:21.127 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:39:21.127 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:39:21.127 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:39:21.127 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:39:21.127 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:39:21.127 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:39:21.127 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:39:21.127 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:39:21.127 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:39:21.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:39:21.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:39:21.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:39:21.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:39:21.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:39:21.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:39:21.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:39:21.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:39:21.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:39:21.128 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:39:21.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:39:21.128 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:39:21.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:39:21.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:39:21.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:39:21.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:39:21.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:39:21.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:39:21.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:39:21.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:39:21.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:39:21.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:39:21.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:39:21.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:39:21.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:39:21.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:39:21.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8c7f7fe640 / http_manager 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8d0dfdb640 / http_manager 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8d0efdd640 / rgw_dt_lg_renew 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8d2dffb640 / ms_dispatch 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8d2effd640 / io_context_pool 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8d2f7fe640 / io_context_pool 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8d3dffb640 / ms_dispatch 2024-09-12T00:39:21.131 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8d44e09640 / ms_dispatch 2024-09-12T00:39:21.132 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8d4660c640 / io_context_pool 2024-09-12T00:39:21.132 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8e57999640 / msgr-worker-2 2024-09-12T00:39:21.132 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8e5819a640 / msgr-worker-1 2024-09-12T00:39:21.132 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8e5899b640 / msgr-worker-0 2024-09-12T00:39:21.132 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8e5919c640 / io_context_pool 2024-09-12T00:39:21.132 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8e5a6949c0 / radosgw-admin 2024-09-12T00:39:21.132 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:39:21.132 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:39:21.132 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.143078.log 2024-09-12T00:39:21.132 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:39:21.132 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:39:21.132 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:39:20.736+0000 7f8e57999640 10 monclient(hunting): handle_auth_done global_id 7736 payload 274 2024-09-12T00:39:21.132 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:39:20.736+0000 7f8e57999640 10 monclient: _finish_hunting 0 2024-09-12T00:39:21.133 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:39:20.736+0000 7f8e57999640 1 monclient: found mon.noname-c 2024-09-12T00:39:21.133 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:39:20.736+0000 7f8e57999640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:39:21.133 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.133 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:21.133 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: dump: 2024-09-12T00:39:21.133 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.133 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.133 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.133 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.133 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.133 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.133 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.133 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.134 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.134 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.134 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: _finish_auth 0 2024-09-12T00:39:21.134 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: _check_auth_tickets 2024-09-12T00:39:21.134 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:21.134 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.134 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:21.134 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:39:20.736+0000 7f8d4660c640 10 monclient: dump: 2024-09-12T00:39:21.134 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.134 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.134 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.134 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.134 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.135 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.135 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.135 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.135 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.135 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.135 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:39:20.736+0000 7f8e5a6949c0 5 monclient: authenticate success, global_id 7736 2024-09-12T00:39:21.135 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:39:20.736+0000 7f8e5a6949c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:21.135 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:39:20.736+0000 7f8e5a6949c0 4 set_mon_vals no callback set 2024-09-12T00:39:21.135 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: shutdown 2024-09-12T00:39:21.135 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) unregister_commands rotate-key 2024-09-12T00:39:21.135 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: build_initial_monmap 2024-09-12T00:39:21.135 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:21.135 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: monmap: 2024-09-12T00:39:21.136 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:39:21.136 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:21.136 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:39:21.136 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:39:21.136 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:21.136 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.136 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:39:21.136 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:39:21.136 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:39:21.136 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.136 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding auth protocol: cephx 2024-09-12T00:39:21.136 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding auth protocol: cephx 2024-09-12T00:39:21.136 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding auth protocol: cephx 2024-09-12T00:39:21.137 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: secure 2024-09-12T00:39:21.137 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: crc 2024-09-12T00:39:21.137 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: secure 2024-09-12T00:39:21.137 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: crc 2024-09-12T00:39:21.137 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: secure 2024-09-12T00:39:21.137 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: crc 2024-09-12T00:39:21.137 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: crc 2024-09-12T00:39:21.137 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: secure 2024-09-12T00:39:21.137 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: crc 2024-09-12T00:39:21.138 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: secure 2024-09-12T00:39:21.138 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: crc 2024-09-12T00:39:21.138 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4e6b0) adding con mode: secure 2024-09-12T00:39:21.138 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.138 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 1 librados: starting msgr at 2024-09-12T00:39:21.138 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 1 librados: starting objecter 2024-09-12T00:39:21.138 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command objecter_requests hook 0x561186ce7230 2024-09-12T00:39:21.138 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 1 librados: setting wanted keys 2024-09-12T00:39:21.139 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 1 librados: calling monclient init 2024-09-12T00:39:21.139 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: init 2024-09-12T00:39:21.139 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding auth protocol: cephx 2024-09-12T00:39:21.139 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding auth protocol: cephx 2024-09-12T00:39:21.139 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding auth protocol: cephx 2024-09-12T00:39:21.139 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: secure 2024-09-12T00:39:21.139 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: crc 2024-09-12T00:39:21.139 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: secure 2024-09-12T00:39:21.139 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: crc 2024-09-12T00:39:21.139 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: secure 2024-09-12T00:39:21.139 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: crc 2024-09-12T00:39:21.139 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: crc 2024-09-12T00:39:21.139 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: secure 2024-09-12T00:39:21.140 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: crc 2024-09-12T00:39:21.140 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: secure 2024-09-12T00:39:21.140 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: crc 2024-09-12T00:39:21.140 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f4b840) adding con mode: secure 2024-09-12T00:39:21.140 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.140 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.140 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command rotate-key hook 0x561186f4b988 2024-09-12T00:39:21.140 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:21.140 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:39:21.140 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-c con 0x561186dd7df0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:39:21.140 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-a con 0x561186dfbea0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:39:21.141 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-b con 0x561186f79f40 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:39:21.141 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.141 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.141 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.141 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:21.141 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient(hunting): authenticate will time out at 2414.085687s 2024-09-12T00:39:21.141 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient(hunting): get_auth_request con 0x561186dd7df0 auth_method 0 2024-09-12T00:39:21.141 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.141 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.141 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.141 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:39:20.740+0000 7f8e57999640 10 monclient(hunting): get_auth_request con 0x561186dfbea0 auth_method 0 2024-09-12T00:39:21.141 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:39:20.740+0000 7f8e57999640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.141 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:39:20.740+0000 7f8e57999640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.141 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:39:20.740+0000 7f8e57999640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.142 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:21.142 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:21.142 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:21.142 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:39:20.740+0000 7f8e57999640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:21.142 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:39:20.740+0000 7f8e57999640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:21.142 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:39:20.740+0000 7f8e57999640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:21.142 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:39:20.740+0000 7f8e5899b640 10 monclient(hunting): get_auth_request con 0x561186f79f40 auth_method 0 2024-09-12T00:39:21.142 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:39:20.740+0000 7f8e5899b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.142 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:39:20.740+0000 7f8e5899b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.142 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:39:20.740+0000 7f8e5899b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.142 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient(hunting): handle_auth_done global_id 7739 payload 824 2024-09-12T00:39:21.142 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient: _finish_hunting 0 2024-09-12T00:39:21.143 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:39:20.740+0000 7f8e5819a640 1 monclient: found mon.noname-c 2024-09-12T00:39:21.143 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:39:20.740+0000 7f8e5819a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:39:21.143 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.143 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:21.143 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: dump: 2024-09-12T00:39:21.143 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.143 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.143 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.143 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.143 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.143 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.143 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.143 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.144 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.144 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.144 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: _finish_auth 0 2024-09-12T00:39:21.144 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: _check_auth_tickets 2024-09-12T00:39:21.144 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:21.144 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.144 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:21.144 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:39:20.740+0000 7f8d44e09640 10 monclient: dump: 2024-09-12T00:39:21.144 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.144 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.144 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.144 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.145 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.145 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.145 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.145 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.145 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.145 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.145 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 5 monclient: authenticate success, global_id 7739 2024-09-12T00:39:21.145 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: _renew_subs 2024-09-12T00:39:21.145 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:39:20.740+0000 7f8d4660c640 4 set_mon_vals no callback set 2024-09-12T00:39:21.145 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:39:21.145 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: _renew_subs 2024-09-12T00:39:21.145 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:39:21.145 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:39:20.740+0000 7f8e5a6949c0 1 librados: init done 2024-09-12T00:39:21.146 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:39:20.744+0000 7f8d44e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:21.146 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:39:20.744+0000 7f8d44e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:21.146 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:39:20.744+0000 7f8d44e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:21.146 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:39:20.744+0000 7f8e57999640 10 monclient: get_auth_request con 0x7f8d40070ae0 auth_method 0 2024-09-12T00:39:21.146 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:39:20.744+0000 7f8e5899b640 10 monclient: get_auth_request con 0x561186f77050 auth_method 0 2024-09-12T00:39:21.146 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:39:20.744+0000 7f8e5819a640 10 monclient: get_auth_request con 0x561186f960b0 auth_method 0 2024-09-12T00:39:21.146 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:39:20.744+0000 7f8e57999640 10 monclient: get_auth_request con 0x561186f9a2f0 auth_method 0 2024-09-12T00:39:21.146 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: build_initial_monmap 2024-09-12T00:39:21.146 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:21.146 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: monmap: 2024-09-12T00:39:21.146 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:39:21.146 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:21.146 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:39:21.147 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:39:21.147 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:21.147 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.147 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:39:21.147 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:39:21.147 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:39:21.147 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.147 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding auth protocol: cephx 2024-09-12T00:39:21.147 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding auth protocol: cephx 2024-09-12T00:39:21.147 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding auth protocol: cephx 2024-09-12T00:39:21.147 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: secure 2024-09-12T00:39:21.147 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: crc 2024-09-12T00:39:21.147 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: secure 2024-09-12T00:39:21.147 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: crc 2024-09-12T00:39:21.147 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: secure 2024-09-12T00:39:21.148 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: crc 2024-09-12T00:39:21.148 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: crc 2024-09-12T00:39:21.148 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: secure 2024-09-12T00:39:21.148 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: crc 2024-09-12T00:39:21.148 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: secure 2024-09-12T00:39:21.148 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: crc 2024-09-12T00:39:21.148 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9f110) adding con mode: secure 2024-09-12T00:39:21.148 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.148 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command objecter_requests cmddesc objecter_requests hook 0x561186fa2b20 EEXIST 2024-09-12T00:39:21.148 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: init 2024-09-12T00:39:21.148 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding auth protocol: cephx 2024-09-12T00:39:21.148 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding auth protocol: cephx 2024-09-12T00:39:21.149 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding auth protocol: cephx 2024-09-12T00:39:21.149 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: secure 2024-09-12T00:39:21.149 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: crc 2024-09-12T00:39:21.149 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: secure 2024-09-12T00:39:21.149 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: crc 2024-09-12T00:39:21.149 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: secure 2024-09-12T00:39:21.149 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: crc 2024-09-12T00:39:21.149 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: crc 2024-09-12T00:39:21.149 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: secure 2024-09-12T00:39:21.149 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: crc 2024-09-12T00:39:21.149 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: secure 2024-09-12T00:39:21.149 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: crc 2024-09-12T00:39:21.149 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 AuthRegistry(0x561186f9d838) adding con mode: secure 2024-09-12T00:39:21.150 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.150 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.150 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command rotate-key cmddesc rotate-key hook 0x561186f9d980 EEXIST 2024-09-12T00:39:21.150 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:21.150 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:39:21.150 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-a con 0x561186fc6cd0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:39:21.150 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-b con 0x561186fc6600 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:39:21.150 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-c con 0x561186fc4fe0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:39:21.150 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.150 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.150 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.150 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:21.150 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient(hunting): authenticate will time out at 2414.094275s 2024-09-12T00:39:21.151 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient(hunting): get_auth_request con 0x561186fc6cd0 auth_method 0 2024-09-12T00:39:21.151 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.151 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.151 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.151 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:39:20.748+0000 7f8e5899b640 10 monclient(hunting): get_auth_request con 0x561186fc4fe0 auth_method 0 2024-09-12T00:39:21.151 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:39:20.748+0000 7f8e5899b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.151 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:39:20.748+0000 7f8e5899b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.151 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:39:20.748+0000 7f8e5899b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.151 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:21.151 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:21.151 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:21.151 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:39:20.748+0000 7f8e5899b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:21.151 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:39:20.748+0000 7f8e5899b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:21.152 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:39:20.748+0000 7f8e5899b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:21.152 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:39:20.748+0000 7f8e57999640 10 monclient(hunting): get_auth_request con 0x561186fc6600 auth_method 0 2024-09-12T00:39:21.152 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:39:20.748+0000 7f8e57999640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.152 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:39:20.748+0000 7f8e57999640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.152 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:39:20.748+0000 7f8e57999640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.152 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient(hunting): handle_auth_done global_id 8292 payload 824 2024-09-12T00:39:21.152 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient: _finish_hunting 0 2024-09-12T00:39:21.152 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:39:20.748+0000 7f8e5819a640 1 monclient: found mon.noname-a 2024-09-12T00:39:21.152 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:39:20.748+0000 7f8e5819a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:39:21.152 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.152 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:21.152 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: dump: 2024-09-12T00:39:21.152 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.153 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.153 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.153 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.153 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.153 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.153 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.153 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.153 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.153 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.153 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: _finish_auth 0 2024-09-12T00:39:21.153 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: _check_auth_tickets 2024-09-12T00:39:21.153 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:21.153 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.154 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:21.154 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:39:20.748+0000 7f8d3dffb640 10 monclient: dump: 2024-09-12T00:39:21.154 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.154 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.154 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.154 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.154 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.154 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.154 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.154 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.154 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.154 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.154 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:39:20.748+0000 7f8e5919c640 4 set_mon_vals no callback set 2024-09-12T00:39:21.155 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 5 monclient: authenticate success, global_id 8292 2024-09-12T00:39:21.155 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: _renew_subs 2024-09-12T00:39:21.155 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:39:21.155 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: _renew_subs 2024-09-12T00:39:21.155 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:39:20.748+0000 7f8e5a6949c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:39:21.155 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:39:20.752+0000 7f8d3dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:21.155 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:39:20.752+0000 7f8d3dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:21.155 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:39:20.752+0000 7f8d3dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:21.155 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient: get_monmap_and_config 2024-09-12T00:39:21.155 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient: build_initial_monmap 2024-09-12T00:39:21.155 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:21.155 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient: monmap: 2024-09-12T00:39:21.155 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:39:21.156 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:21.156 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:39:21.156 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:39:21.156 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:21.156 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.156 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:39:21.156 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:39:21.156 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:39:21.156 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.156 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding auth protocol: cephx 2024-09-12T00:39:21.156 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding auth protocol: cephx 2024-09-12T00:39:21.156 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding auth protocol: cephx 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: secure 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: crc 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: secure 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: crc 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: secure 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: crc 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: crc 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: secure 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: crc 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: secure 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: crc 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fe6650) adding con mode: secure 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:39:20.752+0000 7f8e57999640 10 monclient: get_auth_request con 0x7f8d30070a20 auth_method 0 2024-09-12T00:39:21.157 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.158 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient: init 2024-09-12T00:39:21.158 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding auth protocol: cephx 2024-09-12T00:39:21.158 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding auth protocol: cephx 2024-09-12T00:39:21.158 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding auth protocol: cephx 2024-09-12T00:39:21.158 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: secure 2024-09-12T00:39:21.158 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: crc 2024-09-12T00:39:21.158 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: secure 2024-09-12T00:39:21.158 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: crc 2024-09-12T00:39:21.158 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: secure 2024-09-12T00:39:21.158 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: crc 2024-09-12T00:39:21.158 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: crc 2024-09-12T00:39:21.158 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: secure 2024-09-12T00:39:21.158 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: crc 2024-09-12T00:39:21.159 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: secure 2024-09-12T00:39:21.159 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: crc 2024-09-12T00:39:21.159 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d56210) adding con mode: secure 2024-09-12T00:39:21.159 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.159 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.159 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc27d56358 EEXIST 2024-09-12T00:39:21.159 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:21.159 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:39:21.159 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-a con 0x561186fea790 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:39:21.159 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-b con 0x561187014db0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:39:21.159 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-c con 0x561187015fc0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:39:21.159 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.159 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.159 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.160 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:21.160 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient(hunting): authenticate will time out at 2414.098893s 2024-09-12T00:39:21.160 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient(hunting): get_auth_request con 0x561186fea790 auth_method 0 2024-09-12T00:39:21.160 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.160 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.160 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.160 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:39:20.752+0000 7f8e5899b640 10 monclient(hunting): get_auth_request con 0x561187015fc0 auth_method 0 2024-09-12T00:39:21.160 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:39:20.752+0000 7f8e5899b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.160 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:39:20.752+0000 7f8e5899b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.160 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:39:20.752+0000 7f8e5899b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.160 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:21.160 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:21.161 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:21.161 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:39:20.752+0000 7f8e5899b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:21.161 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:39:20.752+0000 7f8e5899b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:21.161 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:39:20.752+0000 7f8e5899b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:21.161 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient(hunting): handle_auth_done global_id 8295 payload 274 2024-09-12T00:39:21.161 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient: _finish_hunting 0 2024-09-12T00:39:21.161 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:39:20.752+0000 7f8e5819a640 1 monclient: found mon.noname-a 2024-09-12T00:39:21.161 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:39:20.752+0000 7f8e5819a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:39:21.161 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.161 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:21.161 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: dump: 2024-09-12T00:39:21.161 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.162 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.162 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.162 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.162 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.162 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.162 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.162 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.162 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.162 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.162 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: _finish_auth 0 2024-09-12T00:39:21.162 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:39:21.162 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:21.162 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.163 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:21.163 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:39:20.752+0000 7f8d2f7fe640 10 monclient: dump: 2024-09-12T00:39:21.163 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.163 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.163 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.163 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.163 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.163 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.163 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.163 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.163 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.163 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.163 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 5 monclient: authenticate success, global_id 8295 2024-09-12T00:39:21.163 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:21.164 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:39:20.752+0000 7f8e5a6949c0 4 set_mon_vals no callback set 2024-09-12T00:39:21.164 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: shutdown 2024-09-12T00:39:21.164 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: build_initial_monmap 2024-09-12T00:39:21.164 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:21.164 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: monmap: 2024-09-12T00:39:21.164 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:39:21.164 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:21.164 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:39:21.164 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:39:21.164 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:21.164 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.164 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:39:21.165 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:39:21.165 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:39:21.165 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.165 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding auth protocol: cephx 2024-09-12T00:39:21.165 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding auth protocol: cephx 2024-09-12T00:39:21.165 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding auth protocol: cephx 2024-09-12T00:39:21.165 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: secure 2024-09-12T00:39:21.165 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: crc 2024-09-12T00:39:21.165 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: secure 2024-09-12T00:39:21.165 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: crc 2024-09-12T00:39:21.165 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: secure 2024-09-12T00:39:21.165 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: crc 2024-09-12T00:39:21.166 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: crc 2024-09-12T00:39:21.166 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: secure 2024-09-12T00:39:21.166 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: crc 2024-09-12T00:39:21.166 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: secure 2024-09-12T00:39:21.166 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: crc 2024-09-12T00:39:21.166 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561187016dc0) adding con mode: secure 2024-09-12T00:39:21.166 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.166 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 1 librados: starting msgr at 2024-09-12T00:39:21.166 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 1 librados: starting objecter 2024-09-12T00:39:21.166 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command objecter_requests cmddesc objecter_requests hook 0x56118701b180 EEXIST 2024-09-12T00:39:21.166 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 1 librados: setting wanted keys 2024-09-12T00:39:21.166 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 1 librados: calling monclient init 2024-09-12T00:39:21.167 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: init 2024-09-12T00:39:21.167 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding auth protocol: cephx 2024-09-12T00:39:21.167 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding auth protocol: cephx 2024-09-12T00:39:21.167 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding auth protocol: cephx 2024-09-12T00:39:21.167 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: secure 2024-09-12T00:39:21.167 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: crc 2024-09-12T00:39:21.167 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: secure 2024-09-12T00:39:21.167 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: crc 2024-09-12T00:39:21.167 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: secure 2024-09-12T00:39:21.167 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: crc 2024-09-12T00:39:21.167 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: crc 2024-09-12T00:39:21.167 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: secure 2024-09-12T00:39:21.168 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: crc 2024-09-12T00:39:21.168 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: secure 2024-09-12T00:39:21.168 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: crc 2024-09-12T00:39:21.168 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 AuthRegistry(0x561186fc8af0) adding con mode: secure 2024-09-12T00:39:21.168 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.168 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.168 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command rotate-key cmddesc rotate-key hook 0x561186fc8c38 EEXIST 2024-09-12T00:39:21.168 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:21.168 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:39:21.168 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-c con 0x561186fea790 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:39:21.168 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-a con 0x561187014db0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:39:21.169 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient(hunting): picked mon.noname-b con 0x561187015fc0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:39:21.169 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.169 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.169 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:21.169 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:21.169 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient(hunting): authenticate will time out at 2414.101434s 2024-09-12T00:39:21.169 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient(hunting): get_auth_request con 0x561186fea790 auth_method 0 2024-09-12T00:39:21.169 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.169 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.169 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.169 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:39:20.756+0000 7f8e57999640 10 monclient(hunting): get_auth_request con 0x561187014db0 auth_method 0 2024-09-12T00:39:21.169 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:39:20.756+0000 7f8e57999640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:21.169 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:39:20.756+0000 7f8e57999640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:21.170 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:39:20.756+0000 7f8e57999640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:21.170 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:21.170 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:21.170 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:21.170 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:39:20.756+0000 7f8e57999640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:21.170 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:39:20.756+0000 7f8e57999640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:21.170 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:39:20.756+0000 7f8e57999640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:21.170 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient(hunting): handle_auth_done global_id 7748 payload 824 2024-09-12T00:39:21.170 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient: _finish_hunting 0 2024-09-12T00:39:21.170 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:39:20.756+0000 7f8e5819a640 1 monclient: found mon.noname-c 2024-09-12T00:39:21.170 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:39:20.756+0000 7f8e5819a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:39:21.170 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.170 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:21.171 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: dump: 2024-09-12T00:39:21.171 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.171 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.171 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.171 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.171 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.171 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.171 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.171 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.171 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.171 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.171 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: _finish_auth 0 2024-09-12T00:39:21.171 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: _check_auth_tickets 2024-09-12T00:39:21.172 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:21.172 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:21.172 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:21.172 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:39:20.756+0000 7f8d2dffb640 10 monclient: dump: 2024-09-12T00:39:21.172 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:21.172 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:21.172 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.172 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:21.172 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:21.172 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:21.172 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:21.172 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:21.172 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:21.173 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.173 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 monclient: authenticate success, global_id 7748 2024-09-12T00:39:21.173 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:39:20.756+0000 7f8d2f7fe640 4 set_mon_vals no callback set 2024-09-12T00:39:21.173 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: _renew_subs 2024-09-12T00:39:21.173 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:39:21.173 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: _renew_subs 2024-09-12T00:39:21.173 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:39:21.173 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 1 librados: init done 2024-09-12T00:39:21.173 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command cr dump hook 0x561187009798 2024-09-12T00:39:21.173 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:39:20.756+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.173 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:39:20.760+0000 7f8d2dffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:21.173 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:39:20.760+0000 7f8d2dffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:21.174 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:39:20.760+0000 7f8d2dffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:21.174 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:39:20.760+0000 7f8e57999640 10 monclient: get_auth_request con 0x7f8d20070ae0 auth_method 0 2024-09-12T00:39:21.174 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:39:20.760+0000 7f8e5899b640 10 monclient: get_auth_request con 0x561187033c50 auth_method 0 2024-09-12T00:39:21.174 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.174 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 realm 2024-09-12T00:39:21.174 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.174 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.174 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:21.174 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.174 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.174 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.174 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:39:20.760+0000 7f8e5819a640 10 monclient: get_auth_request con 0x561187038050 auth_method 0 2024-09-12T00:39:21.174 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:21.174 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:39:20.760+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.175 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:39:20.760+0000 7f8e57999640 10 monclient: get_auth_request con 0x56118703b790 auth_method 0 2024-09-12T00:39:21.175 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:39:20.764+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:21.175 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:39:20.764+0000 7f8e5a6949c0 20 searching for the correct realm 2024-09-12T00:39:21.175 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:39:20.764+0000 7f8e5899b640 10 monclient: get_auth_request con 0x561187040550 auth_method 0 2024-09-12T00:39:21.175 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:39:20.764+0000 7f8e5819a640 10 monclient: get_auth_request con 0x7f8e50018040 auth_method 0 2024-09-12T00:39:21.175 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:39:20.764+0000 7f8e57999640 10 monclient: get_auth_request con 0x7f8e48008040 auth_method 0 2024-09-12T00:39:21.175 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:39:20.768+0000 7f8e5899b640 10 monclient: get_auth_request con 0x7f8e50017410 auth_method 0 2024-09-12T00:39:21.175 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:39:20.768+0000 7f8e5899b640 0 -- 172.21.15.138:0/2978218272 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f8e50017410 msgr2=0x7f8e50017890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:21.175 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:39:20.972+0000 7f8e5899b640 10 monclient: get_auth_request con 0x7f8e50017410 auth_method 0 2024-09-12T00:39:21.175 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:39:20.976+0000 7f8e5819a640 10 monclient: get_auth_request con 0x7f8e4802a040 auth_method 0 2024-09-12T00:39:21.175 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:39:20.984+0000 7f8e5899b640 0 -- 172.21.15.138:0/2978218272 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x561187040550 msgr2=0x561187042a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:21.175 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:39:20.984+0000 7f8d2dffb640 1 client.7748.objecter ms_handle_reset 0x561187040550 session 0x56118703fed0 osd.4 2024-09-12T00:39:21.175 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:39:20.984+0000 7f8d2dffb640 10 monclient: _renew_subs 2024-09-12T00:39:21.176 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:39:20.984+0000 7f8d2dffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:39:21.176 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:39:20.984+0000 7f8e5899b640 10 monclient: get_auth_request con 0x7f8d20080e00 auth_method 0 2024-09-12T00:39:21.176 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:39:21.176 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:21.176 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:39:21.176 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:21.176 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:21.176 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:21.176 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:39:20.992+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.176 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.176 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.176 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:21.177 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.177 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:21.177 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 zone default found 2024-09-12T00:39:21.177 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 4 Realm: () 2024-09-12T00:39:21.177 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:39:21.177 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:39:21.177 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:21.177 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 zonegroup default 2024-09-12T00:39:21.177 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.177 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.177 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.177 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.178 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:39:20.996+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.178 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:39:21.000+0000 7f8e5a6949c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.178 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:39:21.000+0000 7f8e5a6949c0 20 started sync module instance, tier type = 2024-09-12T00:39:21.178 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:39:21.000+0000 7f8e5a6949c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:39:21.178 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=0 2024-09-12T00:39:21.178 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=1 2024-09-12T00:39:21.178 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=2 2024-09-12T00:39:21.178 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=3 2024-09-12T00:39:21.178 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=4 2024-09-12T00:39:21.178 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=5 2024-09-12T00:39:21.178 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:39:21.020+0000 7f8e5a6949c0 20 add_watcher() i=6 2024-09-12T00:39:21.178 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:39:21.024+0000 7f8e5a6949c0 20 add_watcher() i=7 2024-09-12T00:39:21.178 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:39:21.024+0000 7f8e5a6949c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:21.179 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding auth protocol: cephx 2024-09-12T00:39:21.179 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding auth protocol: cephx 2024-09-12T00:39:21.179 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding auth protocol: cephx 2024-09-12T00:39:21.179 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: secure 2024-09-12T00:39:21.179 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: crc 2024-09-12T00:39:21.179 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: secure 2024-09-12T00:39:21.179 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: crc 2024-09-12T00:39:21.179 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: secure 2024-09-12T00:39:21.179 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: crc 2024-09-12T00:39:21.179 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: crc 2024-09-12T00:39:21.179 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:39:21.028+0000 7f8d0efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:21.179 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: secure 2024-09-12T00:39:21.180 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: crc 2024-09-12T00:39:21.180 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: secure 2024-09-12T00:39:21.180 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: crc 2024-09-12T00:39:21.180 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 AuthRegistry(0x7ffc27d566f0) adding con mode: secure 2024-09-12T00:39:21.180 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:21.180 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:21.180 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:21.180 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command cache list hook 0x5611870107b0 2024-09-12T00:39:21.180 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command cache inspect hook 0x5611870107b0 2024-09-12T00:39:21.180 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command cache erase hook 0x5611870107b0 2024-09-12T00:39:21.180 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command cache zap hook 0x5611870107b0 2024-09-12T00:39:21.180 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 note: GC not initialized 2024-09-12T00:39:21.181 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:39:21.028+0000 7f8d0dfdb640 20 reqs_thread_entry: start 2024-09-12T00:39:21.181 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command sync trace show hook 0x7f8e48083070 2024-09-12T00:39:21.181 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command sync trace history hook 0x7f8e48083070 2024-09-12T00:39:21.181 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command sync trace active hook 0x7f8e48083070 2024-09-12T00:39:21.181 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:39:21.028+0000 7f8e5a6949c0 5 asok(0x561186d3e2b0) register_command sync trace active_short hook 0x7f8e48083070 2024-09-12T00:39:21.181 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:21.181 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 Filter name: none 2024-09-12T00:39:21.181 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:39:21.032+0000 7f8c7f7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:21.181 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:39:21.181 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.181 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:21.181 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:39:21.182 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:39:21.182 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:39:21.182 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.182 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:39:21.182 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:21.182 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:21.182 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:21.182 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:21.182 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:39:21.032+0000 7f8e5a6949c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:39:21.183 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:39:21.044+0000 7f8e5a6949c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:21.183 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:39:21.044+0000 7f8e5a6949c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:21.183 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:39:21.044+0000 7f8e5a6949c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:21.183 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:39:21.044+0000 7f8e5a6949c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:39:21.183 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:39:21.044+0000 7f8d2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333573 cookie 94633279629488 notifier 7748 bl.length()=827 2024-09-12T00:39:21.183 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:39:21.044+0000 7f8d2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:21.183 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:39:21.044+0000 7f8d2effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:21.183 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:39:21.044+0000 7f8d2effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:21.183 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:39:21.044+0000 7f8e5a6949c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:39:21.183 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:39:21.044+0000 7f8e5a6949c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:39:21.183 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:39:21.044+0000 7f8e5a6949c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:39:21.183 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:39:21.044+0000 7f8e5a6949c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:39:21.184 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:39:21.056+0000 7f8e5a6949c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8e5a6949c0 time 2024-09-12T00:39:21.061450+0000 2024-09-12T00:39:21.184 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:21.184 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.184 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:21.184 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f8e5df6e2eb] 2024-09-12T00:39:21.184 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8e5df6e49f] 2024-09-12T00:39:21.184 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56118582ccc1] 2024-09-12T00:39:21.184 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561185841d5a] 2024-09-12T00:39:21.184 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-12T00:39:21.184 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8e5cdd4d90] 2024-09-12T00:39:21.184 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-12T00:39:21.184 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-12T00:39:21.184 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.185 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:39:21.060+0000 7f8e5a6949c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:21.185 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f8e5a6949c0 thread_name:radosgw-admin 2024-09-12T00:39:21.185 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.185 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:21.185 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f8e5cded520] 2024-09-12T00:39:21.185 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:39:21.185 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:39:21.185 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:39:21.185 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f8e5df6e345] 2024-09-12T00:39:21.185 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f8e5df6e49f] 2024-09-12T00:39:21.185 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56118582ccc1] 2024-09-12T00:39:21.185 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x561185841d5a] 2024-09-12T00:39:21.186 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-12T00:39:21.186 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f8e5cdd4d90] 2024-09-12T00:39:21.186 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-12T00:39:21.186 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-12T00:39:21.186 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:21.186 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:21.186 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:39:21.186 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:39:21.186 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:39:21.186 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:39:21.186 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:39:21.186 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:39:21.186 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:39:21.187 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:39:21.187 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:39:21.187 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:39:21.187 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:39:21.187 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:39:21.187 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:39:21.187 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:39:21.187 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:39:21.187 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:39:21.187 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:39:21.187 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:39:21.187 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:39:21.187 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:39:21.187 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:39:21.188 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:39:21.188 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:39:21.188 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:39:21.188 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:39:21.188 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:39:21.188 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:39:21.188 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:39:21.188 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:39:21.188 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:39:21.188 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:39:21.188 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:39:21.189 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:39:21.189 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:39:21.189 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:39:21.189 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:39:21.189 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:39:21.189 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:39:21.189 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:39:21.189 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:39:21.189 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:39:21.189 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:39:21.189 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:39:21.189 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:39:21.189 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:39:21.190 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:39:21.190 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:39:21.190 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:39:21.190 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:39:21.190 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:39:21.190 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:39:21.190 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:39:21.190 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:39:21.190 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:39:21.191 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:39:21.191 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:39:21.191 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:39:21.191 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:39:21.191 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:39:21.191 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:39:21.191 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:39:21.191 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:39:21.191 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:39:21.191 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:39:21.192 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:39:21.192 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:39:21.192 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:39:21.192 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:39:21.192 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:39:21.192 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:39:21.192 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:39:21.192 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:39:21.192 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:39:21.193 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:39:21.193 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:39:21.193 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:39:21.193 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:39:21.193 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:39:21.193 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:39:21.193 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:39:21.193 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:39:21.193 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:39:21.193 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:39:21.193 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:39:21.193 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:39:21.194 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:39:21.194 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:39:21.194 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:39:21.194 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:39:21.194 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:39:21.194 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:39:21.194 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:39:21.194 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:39:21.194 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:39:21.194 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8c7f7fe640 / http_manager 2024-09-12T00:39:21.194 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8d0dfdb640 / http_manager 2024-09-12T00:39:21.194 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8d0efdd640 / rgw_dt_lg_renew 2024-09-12T00:39:21.194 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8d2dffb640 / ms_dispatch 2024-09-12T00:39:21.194 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8d2effd640 / io_context_pool 2024-09-12T00:39:21.195 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8d2f7fe640 / io_context_pool 2024-09-12T00:39:21.195 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8d3dffb640 / ms_dispatch 2024-09-12T00:39:21.195 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8d44e09640 / ms_dispatch 2024-09-12T00:39:21.195 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8d4660c640 / io_context_pool 2024-09-12T00:39:21.195 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8e57999640 / msgr-worker-2 2024-09-12T00:39:21.195 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8e5819a640 / msgr-worker-1 2024-09-12T00:39:21.195 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8e5899b640 / msgr-worker-0 2024-09-12T00:39:21.195 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8e5919c640 / io_context_pool 2024-09-12T00:39:21.195 INFO:tasks.workunit.client.0.smithi138.stderr: 7f8e5a6949c0 / radosgw-admin 2024-09-12T00:39:21.195 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:39:21.195 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:39:21.195 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:39:21.064253Z_7de9eb47-5d0a-4b77-b806-875300e590c4/log 2024-09-12T00:39:21.196 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:39:21.197 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-12T00:39:21.197 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:39:21.197 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:21.197 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:21.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.144+0000 7f57587679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.144+0000 7f57587679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.144+0000 7f57587679c0 20 realm 2024-09-12T00:39:21.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.144+0000 7f57587679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.144+0000 7f57587679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.144+0000 7f57587679c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:21.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.144+0000 7f57587679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.144+0000 7f57587679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.144+0000 7f57587679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.148+0000 7f57587679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:21.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.148+0000 7f57587679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.148+0000 7f57587679c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:21.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.148+0000 7f57587679c0 20 searching for the correct realm 2024-09-12T00:39:21.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.152+0000 7f5756a6e640 0 -- 172.21.15.138:0/2264232972 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f57500e1400 msgr2=0x7f57500e1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:21.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.368+0000 7f5756a6e640 0 -- 172.21.15.138:0/2264232972 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x558f74823c70 msgr2=0x558f74826130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:21.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.376+0000 7f57587679c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:39:21.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.376+0000 7f57587679c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:21.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.376+0000 7f57587679c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:39:21.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.376+0000 7f57587679c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:21.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.376+0000 7f57587679c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:21.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.376+0000 7f57587679c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:21.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.376+0000 7f57587679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.380+0000 7f57587679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.380+0000 7f57587679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.380+0000 7f57587679c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:21.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.380+0000 7f57587679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.380+0000 7f57587679c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:21.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.380+0000 7f57587679c0 20 zone default found 2024-09-12T00:39:21.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.380+0000 7f57587679c0 4 Realm: () 2024-09-12T00:39:21.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.380+0000 7f57587679c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:39:21.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.380+0000 7f57587679c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:39:21.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.380+0000 7f57587679c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:21.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.380+0000 7f57587679c0 20 zonegroup default 2024-09-12T00:39:21.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.380+0000 7f57587679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.380+0000 7f57587679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.380+0000 7f57587679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.384+0000 7f57587679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.384+0000 7f57587679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.384+0000 7f57587679c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.384+0000 7f57587679c0 20 started sync module instance, tier type = 2024-09-12T00:39:21.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.384+0000 7f57587679c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:39:21.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.408+0000 7f57587679c0 20 add_watcher() i=0 2024-09-12T00:39:21.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.408+0000 7f57587679c0 20 add_watcher() i=1 2024-09-12T00:39:21.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.408+0000 7f57587679c0 20 add_watcher() i=2 2024-09-12T00:39:21.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.408+0000 7f57587679c0 20 add_watcher() i=3 2024-09-12T00:39:21.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.408+0000 7f57587679c0 20 add_watcher() i=4 2024-09-12T00:39:21.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.408+0000 7f57587679c0 20 add_watcher() i=5 2024-09-12T00:39:21.405 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.408+0000 7f57587679c0 20 add_watcher() i=6 2024-09-12T00:39:21.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.408+0000 7f57587679c0 20 add_watcher() i=7 2024-09-12T00:39:21.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.408+0000 7f57587679c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:21.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.412+0000 7f560cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:21.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.412+0000 7f57587679c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:21.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.412+0000 7f57587679c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:21.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.412+0000 7f57587679c0 5 note: GC not initialized 2024-09-12T00:39:21.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.416+0000 7f55877fe640 20 reqs_thread_entry: start 2024-09-12T00:39:21.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.416+0000 7f57587679c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:21.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.416+0000 7f57587679c0 20 Filter name: none 2024-09-12T00:39:21.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.416+0000 7f55857fa640 20 reqs_thread_entry: start 2024-09-12T00:39:21.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.416+0000 7f57587679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.416+0000 7f57587679c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:21.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.416+0000 7f57587679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.416+0000 7f57587679c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:39:21.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.416+0000 7f57587679c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:21.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.416+0000 7f57587679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.416+0000 7f57587679c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:21.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.416+0000 7f57587679c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.416+0000 7f57587679c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:39:21.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.416+0000 7f57587679c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:39:21.421 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.424+0000 7f560cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:21.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.428+0000 7f57587679c0 20 remove_watcher() i=0 2024-09-12T00:39:21.425 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.428+0000 7f57587679c0 2 removed watcher, disabling cache 2024-09-12T00:39:21.427 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.428+0000 7f57587679c0 20 remove_watcher() i=1 2024-09-12T00:39:21.429 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.432+0000 7f57587679c0 20 remove_watcher() i=2 2024-09-12T00:39:21.431 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.432+0000 7f57587679c0 20 remove_watcher() i=3 2024-09-12T00:39:21.433 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.436+0000 7f57587679c0 20 remove_watcher() i=4 2024-09-12T00:39:21.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.436+0000 7f57587679c0 20 remove_watcher() i=5 2024-09-12T00:39:21.438 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.440+0000 7f57587679c0 20 remove_watcher() i=6 2024-09-12T00:39:21.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.444+0000 7f57587679c0 20 remove_watcher() i=7 2024-09-12T00:39:21.460 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:39:21.460 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:39:21.474 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:39:21.504 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:21.504 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:21.548 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.548+0000 7f81ce3cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.552+0000 7f81ce3cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.552+0000 7f81ce3cd9c0 20 realm 2024-09-12T00:39:21.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.552+0000 7f81ce3cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.550 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.552+0000 7f81ce3cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.552+0000 7f81ce3cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:21.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.552+0000 7f81ce3cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.552+0000 7f81ce3cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.552+0000 7f81ce3cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.552+0000 7f81ce3cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:21.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.552+0000 7f81ce3cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.556+0000 7f81ce3cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:21.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.556+0000 7f81ce3cd9c0 20 searching for the correct realm 2024-09-12T00:39:21.557 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.560+0000 7f81cc6d4640 0 -- 172.21.15.138:0/2201265625 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f81c4017020 msgr2=0x7f81c408a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:21.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.776+0000 7f81cc6d4640 0 -- 172.21.15.138:0/2201265625 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55c8c41a84e0 msgr2=0x55c8c41aa9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:21.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.784+0000 7f81ce3cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:39:21.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.784+0000 7f81ce3cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:21.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.784+0000 7f81ce3cd9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:39:21.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.784+0000 7f81ce3cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:21.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.784+0000 7f81ce3cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:21.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.784+0000 7f81ce3cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:21.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.784+0000 7f81ce3cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:21.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:21.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 20 zone default found 2024-09-12T00:39:21.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 4 Realm: () 2024-09-12T00:39:21.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:39:21.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:39:21.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:21.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 20 zonegroup default 2024-09-12T00:39:21.786 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:21.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 20 started sync module instance, tier type = 2024-09-12T00:39:21.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.788+0000 7f81ce3cd9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:39:21.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.812+0000 7f81ce3cd9c0 20 add_watcher() i=0 2024-09-12T00:39:21.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.812+0000 7f81ce3cd9c0 20 add_watcher() i=1 2024-09-12T00:39:21.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.812+0000 7f81ce3cd9c0 20 add_watcher() i=2 2024-09-12T00:39:21.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.812+0000 7f81ce3cd9c0 20 add_watcher() i=3 2024-09-12T00:39:21.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.812+0000 7f81ce3cd9c0 20 add_watcher() i=4 2024-09-12T00:39:21.810 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.812+0000 7f81ce3cd9c0 20 add_watcher() i=5 2024-09-12T00:39:21.811 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.812+0000 7f81ce3cd9c0 20 add_watcher() i=6 2024-09-12T00:39:21.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.816+0000 7f81ce3cd9c0 20 add_watcher() i=7 2024-09-12T00:39:21.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.816+0000 7f81ce3cd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:21.816 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f8081fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:21.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:21.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:21.817 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 5 note: GC not initialized 2024-09-12T00:39:21.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f8080fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:21.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:21.818 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 20 Filter name: none 2024-09-12T00:39:21.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f7ffa7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:21.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:39:21.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:21.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:39:21.819 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:39:21.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:39:21.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:21.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:39:21.820 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:21.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:21.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:21.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:21.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:39:21.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:39:21.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.820+0000 7f81ce3cd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:39:21.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.824+0000 7f81ce3cd9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:39:21.821 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.824+0000 7f81ce3cd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:39:21.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.824+0000 7f81ce3cd9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:39:21.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.824+0000 7f81ce3cd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:39:21.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.824+0000 7f81ce3cd9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:39:21.822 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.824+0000 7f81ce3cd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:39:21.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.824+0000 7f81ce3cd9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:39:21.824 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.824+0000 7f81ce3cd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:39:21.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.824+0000 7f81ce3cd9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:39:21.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.824+0000 7f81ce3cd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:39:21.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.824+0000 7f81ce3cd9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:39:21.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.824+0000 7f81ce3cd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:39:21.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.828+0000 7f81ce3cd9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:39:21.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.828+0000 7f81ce3cd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:39:21.825 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.828+0000 7f81ce3cd9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:39:21.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.828+0000 7f81ce3cd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:39:21.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.828+0000 7f81ce3cd9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:39:21.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.828+0000 7f81ce3cd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:39:21.826 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.828+0000 7f81ce3cd9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:39:21.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.828+0000 7f81ce3cd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:39:21.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.828+0000 7f81ce3cd9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:39:21.827 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.828+0000 7f81ce3cd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:39:21.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.832+0000 7f81ce3cd9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:39:21.828 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.832+0000 7f81ce3cd9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:39:21.830 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.832+0000 7f8081fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:21.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.836+0000 7f81ce3cd9c0 20 remove_watcher() i=0 2024-09-12T00:39:21.834 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.836+0000 7f81ce3cd9c0 2 removed watcher, disabling cache 2024-09-12T00:39:21.836 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.836+0000 7f81ce3cd9c0 20 remove_watcher() i=1 2024-09-12T00:39:21.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.840+0000 7f81ce3cd9c0 20 remove_watcher() i=2 2024-09-12T00:39:21.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.844+0000 7f81ce3cd9c0 20 remove_watcher() i=3 2024-09-12T00:39:21.842 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.844+0000 7f81ce3cd9c0 20 remove_watcher() i=4 2024-09-12T00:39:21.845 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.848+0000 7f81ce3cd9c0 20 remove_watcher() i=5 2024-09-12T00:39:21.847 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.848+0000 7f81ce3cd9c0 20 remove_watcher() i=6 2024-09-12T00:39:21.850 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:21.852+0000 7f81ce3cd9c0 20 remove_watcher() i=7 2024-09-12T00:39:51.878 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:39:51.916 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:51.916 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:51.961 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:51.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:51.962 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.963+0000 7f018dc199c0 20 realm 2024-09-12T00:39:51.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:51.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:51.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.963+0000 7f018dc199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:51.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:51.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:51.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:51.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.967+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:51.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.967+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:51.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.967+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:51.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.967+0000 7f018dc199c0 20 searching for the correct realm 2024-09-12T00:39:51.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.971+0000 7f018af1e640 0 -- 172.21.15.138:0/3794014062 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f0184032070 msgr2=0x7f018403f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:51.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.975+0000 7f018af1e640 0 -- 172.21.15.138:0/3794014062 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x557cb56625f0 msgr2=0x557cb56649e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:51.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:39:51.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:51.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:39:51.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:51.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:51.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:51.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:51.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:51.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:51.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:51.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:51.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:51.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 20 zone default found 2024-09-12T00:39:51.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 4 Realm: () 2024-09-12T00:39:51.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:39:51.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:39:51.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:51.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 20 zonegroup default 2024-09-12T00:39:51.987 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:51.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:51.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:51.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:51.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:51.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:51.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 20 started sync module instance, tier type = 2024-09-12T00:39:51.988 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:51.987+0000 7f018dc199c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:39:52.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=0 2024-09-12T00:39:52.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=1 2024-09-12T00:39:52.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=2 2024-09-12T00:39:52.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=3 2024-09-12T00:39:52.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=4 2024-09-12T00:39:52.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=5 2024-09-12T00:39:52.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=6 2024-09-12T00:39:52.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=7 2024-09-12T00:39:52.008 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.007+0000 7f018dc199c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:52.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.011+0000 7f0041fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:52.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.011+0000 7f018dc199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:52.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.011+0000 7f018dc199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:52.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.011+0000 7f018dc199c0 5 note: GC not initialized 2024-09-12T00:39:52.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.011+0000 7f0040fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:52.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.011+0000 7f018dc199c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:52.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.011+0000 7f018dc199c0 20 Filter name: none 2024-09-12T00:39:52.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.011+0000 7effba7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:52.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.011+0000 7f018dc199c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:39:52.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.011+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.015+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:52.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.015+0000 7f018dc199c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:39:52.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.015+0000 7f018dc199c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:39:52.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.015+0000 7f018dc199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:39:52.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.015+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.015+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:39:52.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.015+0000 7f018dc199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:52.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.015+0000 7f018dc199c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:52.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.015+0000 7f018dc199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:52.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.015+0000 7f018dc199c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:52.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.015+0000 7f018dc199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:39:52.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.015+0000 7f018dc199c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:39:52.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.035+0000 7f018dc199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:52.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.035+0000 7f018dc199c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:52.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.035+0000 7f018dc199c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:52.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.035+0000 7f018dc199c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:39:52.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.035+0000 7f006effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333574 cookie 93994107710032 notifier 7799 bl.length()=827 2024-09-12T00:39:52.033 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.035+0000 7f006effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:52.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.035+0000 7f006effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:52.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.035+0000 7f006effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:52.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.035+0000 7f018dc199c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:39:52.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.035+0000 7f018dc199c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:39:52.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.035+0000 7f018dc199c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:39:52.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.035+0000 7f018dc199c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:39:52.039 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f018dc199c0 time 2024-09-12T00:39:52.046415+0000 2024-09-12T00:39:52.039 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:52.040 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:52.041 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f01914f32eb] 2024-09-12T00:39:52.041 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f01914f349f] 2024-09-12T00:39:52.041 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557cb2557cc1] 2024-09-12T00:39:52.041 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422aac) [0x557cb2fb5aac] 2024-09-12T00:39:52.041 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557cb256cced] 2024-09-12T00:39:52.041 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:39:52.041 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0190359d90] 2024-09-12T00:39:52.041 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:39:52.041 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:39:52.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.043+0000 7f018dc199c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f018dc199c0 time 2024-09-12T00:39:52.046415+0000 2024-09-12T00:39:52.041 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:52.042 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.042 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:52.042 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f01914f32eb] 2024-09-12T00:39:52.042 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f01914f349f] 2024-09-12T00:39:52.042 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557cb2557cc1] 2024-09-12T00:39:52.043 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422aac) [0x557cb2fb5aac] 2024-09-12T00:39:52.043 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557cb256cced] 2024-09-12T00:39:52.043 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:39:52.043 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0190359d90] 2024-09-12T00:39:52.043 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:39:52.043 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:39:52.043 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.044 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:39:52.044 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f018dc199c0 thread_name:radosgw-admin 2024-09-12T00:39:52.064 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:52.065 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0190372520] 2024-09-12T00:39:52.065 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:39:52.065 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:39:52.065 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:39:52.065 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f01914f3345] 2024-09-12T00:39:52.065 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f01914f349f] 2024-09-12T00:39:52.065 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557cb2557cc1] 2024-09-12T00:39:52.065 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422aac) [0x557cb2fb5aac] 2024-09-12T00:39:52.065 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557cb256cced] 2024-09-12T00:39:52.065 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:39:52.065 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0190359d90] 2024-09-12T00:39:52.065 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:39:52.066 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:39:52.066 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.043+0000 7f018dc199c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:52.066 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f018dc199c0 thread_name:radosgw-admin 2024-09-12T00:39:52.066 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.066 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:52.066 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0190372520] 2024-09-12T00:39:52.066 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:39:52.066 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:39:52.066 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:39:52.066 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f01914f3345] 2024-09-12T00:39:52.066 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f01914f349f] 2024-09-12T00:39:52.066 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557cb2557cc1] 2024-09-12T00:39:52.066 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422aac) [0x557cb2fb5aac] 2024-09-12T00:39:52.067 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557cb256cced] 2024-09-12T00:39:52.067 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:39:52.067 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0190359d90] 2024-09-12T00:39:52.067 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:39:52.067 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:39:52.067 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:52.067 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.067 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:39:52.067 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:39:51.939+0000 7f007960a640 10 monclient: dump: 2024-09-12T00:39:52.067 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.067 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.067 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.068 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.068 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.068 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.068 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.068 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.068 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.068 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.068 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:39:51.939+0000 7f007960a640 10 monclient: _finish_auth 0 2024-09-12T00:39:52.068 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:39:51.939+0000 7f007960a640 10 monclient: _check_auth_tickets 2024-09-12T00:39:52.068 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:39:51.939+0000 7f018dc199c0 5 monclient: authenticate success, global_id 8343 2024-09-12T00:39:52.068 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:39:51.939+0000 7f007960a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:52.068 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:39:51.939+0000 7f007960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.069 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:39:51.939+0000 7f007960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:52.069 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:39:51.939+0000 7f007960a640 10 monclient: dump: 2024-09-12T00:39:52.069 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.069 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.069 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.069 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.069 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.069 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.069 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.069 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.069 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.069 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.069 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:39:51.939+0000 7f018dc199c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:52.070 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:39:51.939+0000 7f018dc199c0 4 set_mon_vals no callback set 2024-09-12T00:39:52.070 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:39:51.939+0000 7f018dc199c0 10 monclient: shutdown 2024-09-12T00:39:52.070 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:39:51.939+0000 7f018dc199c0 5 asok(0x557cb53662b0) unregister_commands rotate-key 2024-09-12T00:39:52.070 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: build_initial_monmap 2024-09-12T00:39:52.070 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:39:51.943+0000 7f018dc199c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:52.070 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: monmap: 2024-09-12T00:39:52.070 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:39:52.070 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:52.070 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:39:52.070 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:39:52.070 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:52.070 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.070 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:39:52.070 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:39:52.071 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:39:52.071 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.071 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding auth protocol: cephx 2024-09-12T00:39:52.071 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding auth protocol: cephx 2024-09-12T00:39:52.071 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding auth protocol: cephx 2024-09-12T00:39:52.071 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: secure 2024-09-12T00:39:52.071 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: crc 2024-09-12T00:39:52.071 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: secure 2024-09-12T00:39:52.071 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: crc 2024-09-12T00:39:52.071 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: secure 2024-09-12T00:39:52.071 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: crc 2024-09-12T00:39:52.071 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: crc 2024-09-12T00:39:52.071 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: secure 2024-09-12T00:39:52.072 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: crc 2024-09-12T00:39:52.072 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: secure 2024-09-12T00:39:52.072 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: crc 2024-09-12T00:39:52.072 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: secure 2024-09-12T00:39:52.072 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:39:51.943+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.072 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:39:51.943+0000 7f018dc199c0 1 librados: starting msgr at 2024-09-12T00:39:52.072 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:39:51.943+0000 7f018dc199c0 1 librados: starting objecter 2024-09-12T00:39:52.072 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command objecter_requests hook 0x557cb55a2120 2024-09-12T00:39:52.072 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:39:51.943+0000 7f018dc199c0 1 librados: setting wanted keys 2024-09-12T00:39:52.072 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:39:51.943+0000 7f018dc199c0 1 librados: calling monclient init 2024-09-12T00:39:52.072 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: init 2024-09-12T00:39:52.072 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding auth protocol: cephx 2024-09-12T00:39:52.072 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding auth protocol: cephx 2024-09-12T00:39:52.073 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding auth protocol: cephx 2024-09-12T00:39:52.073 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: secure 2024-09-12T00:39:52.073 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: crc 2024-09-12T00:39:52.073 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: secure 2024-09-12T00:39:52.073 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: crc 2024-09-12T00:39:52.073 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: secure 2024-09-12T00:39:52.073 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: crc 2024-09-12T00:39:52.073 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: crc 2024-09-12T00:39:52.073 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: secure 2024-09-12T00:39:52.073 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: crc 2024-09-12T00:39:52.073 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: secure 2024-09-12T00:39:52.073 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: crc 2024-09-12T00:39:52.073 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: secure 2024-09-12T00:39:52.074 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:39:51.943+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.074 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:39:51.943+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.074 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command rotate-key hook 0x557cb5570fc8 2024-09-12T00:39:52.074 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:52.074 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:39:52.074 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-b con 0x557cb53fede0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:39:52.074 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-c con 0x557cb54ba300 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:39:52.074 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-a con 0x557cb55aefc0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:39:52.074 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.074 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.074 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.074 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:52.075 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient(hunting): authenticate will time out at 2445.289175s 2024-09-12T00:39:52.075 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient(hunting): get_auth_request con 0x557cb55aefc0 auth_method 0 2024-09-12T00:39:52.075 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.076 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.076 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.076 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:39:51.943+0000 7f018af1e640 10 monclient(hunting): get_auth_request con 0x557cb54ba300 auth_method 0 2024-09-12T00:39:52.076 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:39:51.943+0000 7f018af1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.076 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:39:51.943+0000 7f018af1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.076 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:39:51.943+0000 7f018af1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.076 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:52.076 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:52.076 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:52.076 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:39:51.943+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:52.076 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:39:51.943+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:52.076 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:39:51.943+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:52.076 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient(hunting): handle_auth_done global_id 8346 payload 824 2024-09-12T00:39:52.077 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient: _finish_hunting 0 2024-09-12T00:39:52.077 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:39:51.943+0000 7f018bf20640 1 monclient: found mon.noname-a 2024-09-12T00:39:52.077 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:39:52.077 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.077 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:52.077 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: dump: 2024-09-12T00:39:52.077 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.077 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.077 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.077 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.077 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.077 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.077 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.078 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.078 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.078 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.078 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: _finish_auth 0 2024-09-12T00:39:52.078 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: _check_auth_tickets 2024-09-12T00:39:52.078 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:52.078 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.078 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:52.078 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: dump: 2024-09-12T00:39:52.078 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.078 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.078 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.078 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.079 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.079 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.079 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.079 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.079 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.079 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.079 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 monclient: authenticate success, global_id 8346 2024-09-12T00:39:52.079 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: _renew_subs 2024-09-12T00:39:52.079 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:39:52.079 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:39:51.943+0000 7f007960a640 4 set_mon_vals no callback set 2024-09-12T00:39:52.079 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: _renew_subs 2024-09-12T00:39:52.079 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:39:52.080 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:39:51.943+0000 7f018dc199c0 1 librados: init done 2024-09-12T00:39:52.080 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:39:51.947+0000 7f0077e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:52.080 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:39:51.947+0000 7f0077e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:52.080 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:39:51.947+0000 7f0077e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:52.080 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:39:51.947+0000 7f018b71f640 10 monclient: get_auth_request con 0x7f0070070ae0 auth_method 0 2024-09-12T00:39:52.080 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:39:51.947+0000 7f018af1e640 10 monclient: get_auth_request con 0x557cb55b9380 auth_method 0 2024-09-12T00:39:52.080 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:39:51.947+0000 7f018b71f640 10 monclient: get_auth_request con 0x557cb55bc560 auth_method 0 2024-09-12T00:39:52.080 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:39:51.947+0000 7f018af1e640 10 monclient: get_auth_request con 0x557cb55c0750 auth_method 0 2024-09-12T00:39:52.080 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: build_initial_monmap 2024-09-12T00:39:52.080 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:39:51.951+0000 7f018dc199c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:52.080 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: monmap: 2024-09-12T00:39:52.080 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:39:52.080 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:52.081 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:39:52.081 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:39:52.081 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:52.081 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.081 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:39:52.081 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:39:52.081 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:39:52.081 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.081 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding auth protocol: cephx 2024-09-12T00:39:52.081 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding auth protocol: cephx 2024-09-12T00:39:52.081 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding auth protocol: cephx 2024-09-12T00:39:52.081 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: secure 2024-09-12T00:39:52.082 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: crc 2024-09-12T00:39:52.082 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: secure 2024-09-12T00:39:52.082 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: crc 2024-09-12T00:39:52.082 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: secure 2024-09-12T00:39:52.082 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: crc 2024-09-12T00:39:52.082 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: crc 2024-09-12T00:39:52.082 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: secure 2024-09-12T00:39:52.082 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: crc 2024-09-12T00:39:52.082 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: secure 2024-09-12T00:39:52.082 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: crc 2024-09-12T00:39:52.082 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: secure 2024-09-12T00:39:52.082 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:39:51.951+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.082 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command objecter_requests cmddesc objecter_requests hook 0x557cb55c8b30 EEXIST 2024-09-12T00:39:52.083 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: init 2024-09-12T00:39:52.083 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding auth protocol: cephx 2024-09-12T00:39:52.083 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding auth protocol: cephx 2024-09-12T00:39:52.083 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding auth protocol: cephx 2024-09-12T00:39:52.083 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: secure 2024-09-12T00:39:52.083 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: crc 2024-09-12T00:39:52.083 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: secure 2024-09-12T00:39:52.083 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: crc 2024-09-12T00:39:52.083 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: secure 2024-09-12T00:39:52.083 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: crc 2024-09-12T00:39:52.083 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: crc 2024-09-12T00:39:52.083 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: secure 2024-09-12T00:39:52.083 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: crc 2024-09-12T00:39:52.083 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: secure 2024-09-12T00:39:52.084 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: crc 2024-09-12T00:39:52.084 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: secure 2024-09-12T00:39:52.084 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:39:51.951+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.084 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:39:51.951+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.084 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command rotate-key cmddesc rotate-key hook 0x557cb55c3b20 EEXIST 2024-09-12T00:39:52.084 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:52.085 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:39:52.085 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-c con 0x557cb55ecce0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:39:52.085 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-a con 0x557cb55ec610 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:39:52.085 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-b con 0x557cb55eaff0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:39:52.085 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.085 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.085 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.085 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:52.085 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient(hunting): authenticate will time out at 2445.298022s 2024-09-12T00:39:52.085 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient(hunting): get_auth_request con 0x557cb55ec610 auth_method 0 2024-09-12T00:39:52.085 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.086 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.086 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.086 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:39:51.951+0000 7f018b71f640 10 monclient(hunting): get_auth_request con 0x557cb55ecce0 auth_method 0 2024-09-12T00:39:52.086 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:39:51.951+0000 7f018b71f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.086 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:39:51.951+0000 7f018b71f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.086 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:39:51.951+0000 7f018b71f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.086 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:52.086 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:52.086 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:52.086 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:39:51.951+0000 7f018b71f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:52.086 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:39:51.951+0000 7f018b71f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:52.087 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:39:51.951+0000 7f018b71f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:52.087 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:39:51.951+0000 7f018bf20640 10 monclient(hunting): get_auth_request con 0x557cb55eaff0 auth_method 0 2024-09-12T00:39:52.087 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:39:51.951+0000 7f018bf20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.087 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:39:51.951+0000 7f018bf20640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.087 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:39:51.951+0000 7f018bf20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.087 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient(hunting): handle_auth_done global_id 8349 payload 824 2024-09-12T00:39:52.087 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient: _finish_hunting 0 2024-09-12T00:39:52.087 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:39:51.951+0000 7f018af1e640 1 monclient: found mon.noname-a 2024-09-12T00:39:52.087 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:39:52.087 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.087 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:52.087 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: dump: 2024-09-12T00:39:52.087 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.088 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.088 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.088 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.088 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.088 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.088 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.088 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.088 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.088 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.088 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: _finish_auth 0 2024-09-12T00:39:52.089 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: _check_auth_tickets 2024-09-12T00:39:52.089 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:52.089 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.089 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:52.089 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: dump: 2024-09-12T00:39:52.089 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.089 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.089 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.089 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.089 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.089 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.089 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.089 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.090 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.090 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.090 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:39:51.951+0000 7f018c721640 4 set_mon_vals no callback set 2024-09-12T00:39:52.090 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 monclient: authenticate success, global_id 8349 2024-09-12T00:39:52.090 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: _renew_subs 2024-09-12T00:39:52.090 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:39:52.090 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: _renew_subs 2024-09-12T00:39:52.090 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:39:52.090 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:39:51.955+0000 7f0075602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:52.090 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:39:51.955+0000 7f0075602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:52.090 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:39:51.955+0000 7f0075602640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:52.090 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient: get_monmap_and_config 2024-09-12T00:39:52.091 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient: build_initial_monmap 2024-09-12T00:39:52.091 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:39:51.955+0000 7f018dc199c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:52.091 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient: monmap: 2024-09-12T00:39:52.091 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:39:52.091 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:52.091 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:39:52.091 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:39:52.091 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:52.091 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.091 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:39:52.091 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:39:52.091 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:39:52.091 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.092 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding auth protocol: cephx 2024-09-12T00:39:52.092 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding auth protocol: cephx 2024-09-12T00:39:52.092 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding auth protocol: cephx 2024-09-12T00:39:52.092 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: secure 2024-09-12T00:39:52.092 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: crc 2024-09-12T00:39:52.092 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: secure 2024-09-12T00:39:52.092 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: crc 2024-09-12T00:39:52.092 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: secure 2024-09-12T00:39:52.092 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: crc 2024-09-12T00:39:52.092 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: crc 2024-09-12T00:39:52.092 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: secure 2024-09-12T00:39:52.092 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: crc 2024-09-12T00:39:52.092 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: secure 2024-09-12T00:39:52.093 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: crc 2024-09-12T00:39:52.093 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: secure 2024-09-12T00:39:52.093 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:39:51.955+0000 7f018b71f640 10 monclient: get_auth_request con 0x7f0064070a20 auth_method 0 2024-09-12T00:39:52.093 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:39:51.955+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.093 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient: init 2024-09-12T00:39:52.093 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding auth protocol: cephx 2024-09-12T00:39:52.093 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding auth protocol: cephx 2024-09-12T00:39:52.093 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding auth protocol: cephx 2024-09-12T00:39:52.093 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: secure 2024-09-12T00:39:52.093 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: crc 2024-09-12T00:39:52.093 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: secure 2024-09-12T00:39:52.093 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: crc 2024-09-12T00:39:52.094 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: secure 2024-09-12T00:39:52.094 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: crc 2024-09-12T00:39:52.094 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: crc 2024-09-12T00:39:52.094 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: secure 2024-09-12T00:39:52.094 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: crc 2024-09-12T00:39:52.094 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: secure 2024-09-12T00:39:52.094 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: crc 2024-09-12T00:39:52.094 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: secure 2024-09-12T00:39:52.094 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:39:51.955+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.094 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:39:51.955+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.094 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd3517b768 EEXIST 2024-09-12T00:39:52.094 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:52.094 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:39:52.094 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-b con 0x557cb56409c0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:39:52.095 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-a con 0x557cb5640da0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:39:52.095 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-c con 0x557cb563b140 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:39:52.095 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.095 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.095 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.095 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:52.095 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient(hunting): authenticate will time out at 2445.303226s 2024-09-12T00:39:52.095 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:39:51.955+0000 7f018bf20640 10 monclient(hunting): get_auth_request con 0x557cb563b140 auth_method 0 2024-09-12T00:39:52.095 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:39:51.955+0000 7f018bf20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.095 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:39:51.955+0000 7f018bf20640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.095 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:39:51.955+0000 7f018bf20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.095 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient(hunting): get_auth_request con 0x557cb5640da0 auth_method 0 2024-09-12T00:39:52.096 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.096 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.096 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.096 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:52.096 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:52.096 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:52.096 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:39:51.955+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:52.096 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:39:51.955+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:52.096 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:39:51.955+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:52.096 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:39:51.955+0000 7f018b71f640 10 monclient(hunting): get_auth_request con 0x557cb56409c0 auth_method 0 2024-09-12T00:39:52.096 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:39:51.955+0000 7f018b71f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.096 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:39:51.955+0000 7f018b71f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.097 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:39:51.955+0000 7f018b71f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.097 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient(hunting): handle_auth_done global_id 8352 payload 274 2024-09-12T00:39:52.097 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient: _finish_hunting 0 2024-09-12T00:39:52.097 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:39:51.955+0000 7f018af1e640 1 monclient: found mon.noname-a 2024-09-12T00:39:52.097 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:39:52.097 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.097 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:52.097 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: dump: 2024-09-12T00:39:52.097 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.097 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.097 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.097 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.097 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.098 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.098 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.098 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.098 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.098 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.098 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: _finish_auth 0 2024-09-12T00:39:52.098 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: _check_auth_tickets 2024-09-12T00:39:52.098 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:52.098 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 monclient: authenticate success, global_id 8352 2024-09-12T00:39:52.098 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:52.098 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:39:51.955+0000 7f018dc199c0 4 set_mon_vals no callback set 2024-09-12T00:39:52.098 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.098 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:52.099 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: dump: 2024-09-12T00:39:52.099 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.099 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.099 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.099 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.099 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.099 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.099 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.099 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.099 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.099 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.099 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: shutdown 2024-09-12T00:39:52.099 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: build_initial_monmap 2024-09-12T00:39:52.100 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:39:51.959+0000 7f018dc199c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:52.100 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: monmap: 2024-09-12T00:39:52.100 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:39:52.100 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:52.100 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:39:52.100 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:39:52.100 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:52.100 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.100 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:39:52.100 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:39:52.100 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:39:52.100 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.100 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding auth protocol: cephx 2024-09-12T00:39:52.101 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding auth protocol: cephx 2024-09-12T00:39:52.101 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding auth protocol: cephx 2024-09-12T00:39:52.101 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: secure 2024-09-12T00:39:52.101 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: crc 2024-09-12T00:39:52.101 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: secure 2024-09-12T00:39:52.101 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: crc 2024-09-12T00:39:52.101 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: secure 2024-09-12T00:39:52.101 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: crc 2024-09-12T00:39:52.101 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: crc 2024-09-12T00:39:52.101 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: secure 2024-09-12T00:39:52.101 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: crc 2024-09-12T00:39:52.101 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: secure 2024-09-12T00:39:52.101 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: crc 2024-09-12T00:39:52.102 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: secure 2024-09-12T00:39:52.102 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:39:51.959+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.102 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:39:51.959+0000 7f018dc199c0 1 librados: starting msgr at 2024-09-12T00:39:52.102 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:39:51.959+0000 7f018dc199c0 1 librados: starting objecter 2024-09-12T00:39:52.102 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command objecter_requests cmddesc objecter_requests hook 0x557cb55b2a90 EEXIST 2024-09-12T00:39:52.102 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:39:51.959+0000 7f018dc199c0 1 librados: setting wanted keys 2024-09-12T00:39:52.102 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:39:51.959+0000 7f018dc199c0 1 librados: calling monclient init 2024-09-12T00:39:52.102 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: init 2024-09-12T00:39:52.102 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding auth protocol: cephx 2024-09-12T00:39:52.102 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding auth protocol: cephx 2024-09-12T00:39:52.102 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding auth protocol: cephx 2024-09-12T00:39:52.102 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: secure 2024-09-12T00:39:52.102 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: crc 2024-09-12T00:39:52.103 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: secure 2024-09-12T00:39:52.103 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: crc 2024-09-12T00:39:52.103 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: secure 2024-09-12T00:39:52.103 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: crc 2024-09-12T00:39:52.103 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: crc 2024-09-12T00:39:52.103 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: secure 2024-09-12T00:39:52.103 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: crc 2024-09-12T00:39:52.103 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: secure 2024-09-12T00:39:52.103 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: crc 2024-09-12T00:39:52.103 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: secure 2024-09-12T00:39:52.103 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:39:51.959+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.103 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:39:51.959+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.104 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command rotate-key cmddesc rotate-key hook 0x557cb55eec48 EEXIST 2024-09-12T00:39:52.104 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:52.104 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:39:52.104 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-b con 0x557cb563b140 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:39:52.104 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-c con 0x557cb56409c0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:39:52.104 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-a con 0x557cb564dfb0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:39:52.104 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.105 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.105 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.105 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:52.105 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient(hunting): authenticate will time out at 2445.305960s 2024-09-12T00:39:52.105 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient(hunting): get_auth_request con 0x557cb56409c0 auth_method 0 2024-09-12T00:39:52.105 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.105 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.105 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.105 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:39:51.959+0000 7f018bf20640 10 monclient(hunting): get_auth_request con 0x557cb564dfb0 auth_method 0 2024-09-12T00:39:52.105 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:39:51.959+0000 7f018bf20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.105 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:39:51.959+0000 7f018bf20640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.105 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:39:51.959+0000 7f018bf20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.105 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:52.106 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:52.106 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:52.106 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:39:51.959+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:52.106 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:39:51.959+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:52.106 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:39:51.959+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:52.106 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:39:51.959+0000 7f018b71f640 10 monclient(hunting): get_auth_request con 0x557cb563b140 auth_method 0 2024-09-12T00:39:52.106 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:39:51.959+0000 7f018b71f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.106 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:39:51.959+0000 7f018b71f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.106 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:39:51.959+0000 7f018b71f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.106 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient(hunting): handle_auth_done global_id 7799 payload 824 2024-09-12T00:39:52.106 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient: _finish_hunting 0 2024-09-12T00:39:52.107 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:39:51.959+0000 7f018af1e640 1 monclient: found mon.noname-c 2024-09-12T00:39:52.107 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:39:52.107 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.107 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:52.107 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: dump: 2024-09-12T00:39:52.107 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.107 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.107 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.107 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.107 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.107 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.107 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.108 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.108 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.108 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.108 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:39:52.108 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:39:52.108 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 monclient: authenticate success, global_id 7799 2024-09-12T00:39:52.108 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: _renew_subs 2024-09-12T00:39:52.108 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:39:52.108 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:52.108 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.108 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:52.108 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: dump: 2024-09-12T00:39:52.109 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.109 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.109 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.109 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.109 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.109 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.109 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.109 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.109 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.109 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.109 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:39:51.959+0000 7f006effd640 4 set_mon_vals no callback set 2024-09-12T00:39:52.109 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: _renew_subs 2024-09-12T00:39:52.110 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:39:52.110 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:39:51.959+0000 7f018dc199c0 1 librados: init done 2024-09-12T00:39:52.110 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command cr dump hook 0x557cb564ab38 2024-09-12T00:39:52.110 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.110 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:39:51.963+0000 7f006d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:52.110 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:39:51.963+0000 7f006d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:52.110 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:39:51.963+0000 7f006d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:52.110 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:39:51.963+0000 7f018b71f640 10 monclient: get_auth_request con 0x7f0054070b10 auth_method 0 2024-09-12T00:39:52.110 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:39:51.963+0000 7f018bf20640 10 monclient: get_auth_request con 0x557cb565aba0 auth_method 0 2024-09-12T00:39:52.110 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.110 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:39:51.963+0000 7f018dc199c0 20 realm 2024-09-12T00:39:52.110 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.111 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.111 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:39:51.963+0000 7f018dc199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:52.111 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.111 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.111 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.111 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:39:51.963+0000 7f018b71f640 10 monclient: get_auth_request con 0x557cb565edb0 auth_method 0 2024-09-12T00:39:52.111 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:39:51.967+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:52.111 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:39:51.967+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.111 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:39:51.967+0000 7f018af1e640 10 monclient: get_auth_request con 0x557cb56625f0 auth_method 0 2024-09-12T00:39:52.111 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:39:51.967+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:52.111 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:39:51.967+0000 7f018dc199c0 20 searching for the correct realm 2024-09-12T00:39:52.111 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:39:51.967+0000 7f018bf20640 10 monclient: get_auth_request con 0x557cb5667390 auth_method 0 2024-09-12T00:39:52.111 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:39:51.967+0000 7f018b71f640 10 monclient: get_auth_request con 0x7f017c12d040 auth_method 0 2024-09-12T00:39:52.112 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:39:51.971+0000 7f018af1e640 10 monclient: get_auth_request con 0x7f0184032070 auth_method 0 2024-09-12T00:39:52.112 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:39:51.971+0000 7f018af1e640 0 -- 172.21.15.138:0/3794014062 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f0184032070 msgr2=0x7f018403f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:52.112 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:39:51.971+0000 7f006d7fa640 1 client.7799.objecter ms_handle_reset 0x7f0184032070 session 0x7f0184004420 osd.0 2024-09-12T00:39:52.112 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:39:51.971+0000 7f006d7fa640 10 monclient: _renew_subs 2024-09-12T00:39:52.112 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:39:51.971+0000 7f006d7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:39:52.112 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:39:51.971+0000 7f018af1e640 10 monclient: get_auth_request con 0x7f0054080db0 auth_method 0 2024-09-12T00:39:52.112 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:39:51.971+0000 7f018bf20640 10 monclient: get_auth_request con 0x7f017c100a90 auth_method 0 2024-09-12T00:39:52.112 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:39:51.975+0000 7f018b71f640 10 monclient: get_auth_request con 0x7f0184004b60 auth_method 0 2024-09-12T00:39:52.112 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:39:51.975+0000 7f018af1e640 0 -- 172.21.15.138:0/3794014062 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x557cb56625f0 msgr2=0x557cb56649e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:52.112 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:39:51.975+0000 7f006d7fa640 1 client.7799.objecter ms_handle_reset 0x557cb56625f0 session 0x557cb565e140 osd.3 2024-09-12T00:39:52.112 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:39:51.975+0000 7f018af1e640 10 monclient: get_auth_request con 0x7f0184032070 auth_method 0 2024-09-12T00:39:52.112 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:39:52.113 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:52.113 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:39:52.113 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:52.113 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:52.113 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:52.113 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.113 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.113 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.113 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:52.114 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.114 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:52.114 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 zone default found 2024-09-12T00:39:52.114 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:39:51.987+0000 7f018dc199c0 4 Realm: () 2024-09-12T00:39:52.114 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:39:51.987+0000 7f018dc199c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:39:52.114 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:39:51.987+0000 7f018dc199c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:39:52.114 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:39:51.987+0000 7f018dc199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:52.114 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 zonegroup default 2024-09-12T00:39:52.114 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.114 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.114 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.114 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.115 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.115 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.115 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 started sync module instance, tier type = 2024-09-12T00:39:52.115 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:39:52.115 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=0 2024-09-12T00:39:52.115 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=1 2024-09-12T00:39:52.115 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=2 2024-09-12T00:39:52.115 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=3 2024-09-12T00:39:52.115 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=4 2024-09-12T00:39:52.115 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=5 2024-09-12T00:39:52.116 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=6 2024-09-12T00:39:52.116 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=7 2024-09-12T00:39:52.116 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:39:52.007+0000 7f018dc199c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:52.116 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding auth protocol: cephx 2024-09-12T00:39:52.116 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding auth protocol: cephx 2024-09-12T00:39:52.116 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding auth protocol: cephx 2024-09-12T00:39:52.116 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: secure 2024-09-12T00:39:52.116 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: crc 2024-09-12T00:39:52.116 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: secure 2024-09-12T00:39:52.116 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: crc 2024-09-12T00:39:52.117 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: secure 2024-09-12T00:39:52.117 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: crc 2024-09-12T00:39:52.117 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: crc 2024-09-12T00:39:52.117 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:39:52.011+0000 7f0041fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:52.117 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: secure 2024-09-12T00:39:52.117 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: crc 2024-09-12T00:39:52.117 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: secure 2024-09-12T00:39:52.117 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: crc 2024-09-12T00:39:52.117 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: secure 2024-09-12T00:39:52.117 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:39:52.011+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.117 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:39:52.011+0000 7f018dc199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:52.117 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:39:52.011+0000 7f018dc199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:52.118 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command cache list hook 0x557cb564e3b0 2024-09-12T00:39:52.118 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command cache inspect hook 0x557cb564e3b0 2024-09-12T00:39:52.118 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command cache erase hook 0x557cb564e3b0 2024-09-12T00:39:52.118 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command cache zap hook 0x557cb564e3b0 2024-09-12T00:39:52.118 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 note: GC not initialized 2024-09-12T00:39:52.118 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:39:52.011+0000 7f0040fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:52.118 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command sync trace show hook 0x7f0180004830 2024-09-12T00:39:52.118 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command sync trace history hook 0x7f0180004830 2024-09-12T00:39:52.118 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command sync trace active hook 0x7f0180004830 2024-09-12T00:39:52.118 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command sync trace active_short hook 0x7f0180004830 2024-09-12T00:39:52.118 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:39:52.011+0000 7f018dc199c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:52.119 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:39:52.011+0000 7f018dc199c0 20 Filter name: none 2024-09-12T00:39:52.119 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:39:52.011+0000 7effba7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:52.119 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:39:52.011+0000 7f018dc199c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:39:52.119 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:39:52.011+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.119 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:39:52.015+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:52.119 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:39:52.119 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:39:52.119 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:39:52.119 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:39:52.015+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.119 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:39:52.015+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:39:52.119 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:52.119 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:52.120 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:52.120 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:52.120 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:39:52.120 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:39:52.120 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:39:52.035+0000 7f018dc199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:52.120 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:39:52.035+0000 7f018dc199c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:52.120 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:39:52.035+0000 7f018dc199c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:52.120 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:39:52.035+0000 7f018dc199c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:39:52.120 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:39:52.035+0000 7f006effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333574 cookie 93994107710032 notifier 7799 bl.length()=827 2024-09-12T00:39:52.121 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:39:52.035+0000 7f006effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:52.121 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:39:52.035+0000 7f006effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:52.121 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:39:52.035+0000 7f006effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:52.121 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:39:52.035+0000 7f018dc199c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:39:52.121 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:39:52.035+0000 7f018dc199c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:39:52.121 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:39:52.035+0000 7f018dc199c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:39:52.121 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:39:52.035+0000 7f018dc199c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:39:52.121 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:39:52.043+0000 7f018dc199c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f018dc199c0 time 2024-09-12T00:39:52.046415+0000 2024-09-12T00:39:52.121 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:52.121 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.121 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:52.121 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f01914f32eb] 2024-09-12T00:39:52.124 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f01914f349f] 2024-09-12T00:39:52.124 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557cb2557cc1] 2024-09-12T00:39:52.124 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422aac) [0x557cb2fb5aac] 2024-09-12T00:39:52.125 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557cb256cced] 2024-09-12T00:39:52.125 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:39:52.125 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0190359d90] 2024-09-12T00:39:52.125 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:39:52.125 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:39:52.125 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.125 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:39:52.043+0000 7f018dc199c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:52.125 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f018dc199c0 thread_name:radosgw-admin 2024-09-12T00:39:52.125 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.125 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:52.125 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0190372520] 2024-09-12T00:39:52.125 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:39:52.126 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:39:52.126 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:39:52.126 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f01914f3345] 2024-09-12T00:39:52.126 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f01914f349f] 2024-09-12T00:39:52.126 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557cb2557cc1] 2024-09-12T00:39:52.126 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422aac) [0x557cb2fb5aac] 2024-09-12T00:39:52.126 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557cb256cced] 2024-09-12T00:39:52.126 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:39:52.126 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0190359d90] 2024-09-12T00:39:52.126 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:39:52.126 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:39:52.126 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:52.127 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.127 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:39:52.127 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:39:52.127 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:39:52.127 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:39:52.127 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:39:52.127 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:39:52.127 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:39:52.127 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:39:52.127 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:39:52.127 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:39:52.127 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:39:52.127 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:39:52.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:39:52.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:39:52.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:39:52.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:39:52.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:39:52.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:39:52.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:39:52.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:39:52.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:39:52.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:39:52.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:39:52.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:39:52.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:39:52.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:39:52.129 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:39:52.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:39:52.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:39:52.129 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:39:52.129 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:39:52.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:39:52.129 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:39:52.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:39:52.129 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:39:52.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:39:52.129 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:39:52.129 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:39:52.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:39:52.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:39:52.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:39:52.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:39:52.130 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:39:52.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:39:52.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:39:52.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:39:52.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:39:52.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:39:52.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:39:52.130 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:39:52.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:39:52.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:39:52.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:39:52.131 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:39:52.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:39:52.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:39:52.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:39:52.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:39:52.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:39:52.131 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:39:52.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:39:52.131 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:39:52.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:39:52.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:39:52.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:39:52.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:39:52.132 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:39:52.132 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:39:52.132 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:39:52.132 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:39:52.132 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:39:52.132 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:39:52.132 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:39:52.132 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:39:52.132 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:39:52.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:39:52.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:39:52.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:39:52.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:39:52.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:39:52.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:39:52.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:39:52.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:39:52.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:39:52.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:39:52.133 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:39:52.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:39:52.133 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:39:52.134 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:39:52.134 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:39:52.134 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:39:52.134 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:39:52.134 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:39:52.134 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:39:52.134 INFO:tasks.workunit.client.0.smithi138.stderr: 7effba7fc640 / http_manager 2024-09-12T00:39:52.134 INFO:tasks.workunit.client.0.smithi138.stderr: 7f0040fe1640 / http_manager 2024-09-12T00:39:52.134 INFO:tasks.workunit.client.0.smithi138.stderr: 7f0041fe3640 / rgw_dt_lg_renew 2024-09-12T00:39:52.134 INFO:tasks.workunit.client.0.smithi138.stderr: 7f006d7fa640 / ms_dispatch 2024-09-12T00:39:52.134 INFO:tasks.workunit.client.0.smithi138.stderr: 7f006effd640 / io_context_pool 2024-09-12T00:39:52.134 INFO:tasks.workunit.client.0.smithi138.stderr: 7f0075602640 / ms_dispatch 2024-09-12T00:39:52.134 INFO:tasks.workunit.client.0.smithi138.stderr: 7f0077e07640 / ms_dispatch 2024-09-12T00:39:52.134 INFO:tasks.workunit.client.0.smithi138.stderr: 7f007960a640 / io_context_pool 2024-09-12T00:39:52.135 INFO:tasks.workunit.client.0.smithi138.stderr: 7f018af1e640 / msgr-worker-2 2024-09-12T00:39:52.135 INFO:tasks.workunit.client.0.smithi138.stderr: 7f018b71f640 / msgr-worker-1 2024-09-12T00:39:52.135 INFO:tasks.workunit.client.0.smithi138.stderr: 7f018bf20640 / msgr-worker-0 2024-09-12T00:39:52.135 INFO:tasks.workunit.client.0.smithi138.stderr: 7f018c721640 / io_context_pool 2024-09-12T00:39:52.135 INFO:tasks.workunit.client.0.smithi138.stderr: 7f018dc199c0 / radosgw-admin 2024-09-12T00:39:52.135 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:39:52.135 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:39:52.135 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.144848.log 2024-09-12T00:39:52.135 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:39:52.135 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:39:52.135 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:39:51.939+0000 7f007960a640 10 monclient: dump: 2024-09-12T00:39:52.135 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.135 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.136 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.136 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.136 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.136 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.136 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.136 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.136 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.136 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.136 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:39:51.939+0000 7f007960a640 10 monclient: _finish_auth 0 2024-09-12T00:39:52.136 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:39:51.939+0000 7f007960a640 10 monclient: _check_auth_tickets 2024-09-12T00:39:52.136 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:39:51.939+0000 7f018dc199c0 5 monclient: authenticate success, global_id 8343 2024-09-12T00:39:52.136 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:39:51.939+0000 7f007960a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:52.137 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:39:51.939+0000 7f007960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.137 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:39:51.939+0000 7f007960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:52.137 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:39:51.939+0000 7f007960a640 10 monclient: dump: 2024-09-12T00:39:52.137 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.137 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.137 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.137 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.137 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.137 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.137 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.137 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.137 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.137 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.138 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:39:51.939+0000 7f018dc199c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:52.138 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:39:51.939+0000 7f018dc199c0 4 set_mon_vals no callback set 2024-09-12T00:39:52.138 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:39:51.939+0000 7f018dc199c0 10 monclient: shutdown 2024-09-12T00:39:52.138 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:39:51.939+0000 7f018dc199c0 5 asok(0x557cb53662b0) unregister_commands rotate-key 2024-09-12T00:39:52.138 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: build_initial_monmap 2024-09-12T00:39:52.138 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:39:51.943+0000 7f018dc199c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:52.138 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: monmap: 2024-09-12T00:39:52.138 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:39:52.138 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:52.138 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:39:52.138 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:39:52.138 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:52.139 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.139 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:39:52.139 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:39:52.139 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:39:52.139 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.139 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding auth protocol: cephx 2024-09-12T00:39:52.139 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding auth protocol: cephx 2024-09-12T00:39:52.139 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding auth protocol: cephx 2024-09-12T00:39:52.139 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: secure 2024-09-12T00:39:52.139 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: crc 2024-09-12T00:39:52.139 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: secure 2024-09-12T00:39:52.139 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: crc 2024-09-12T00:39:52.139 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: secure 2024-09-12T00:39:52.140 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: crc 2024-09-12T00:39:52.140 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: crc 2024-09-12T00:39:52.140 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: secure 2024-09-12T00:39:52.140 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: crc 2024-09-12T00:39:52.140 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: secure 2024-09-12T00:39:52.140 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: crc 2024-09-12T00:39:52.140 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb55761d0) adding con mode: secure 2024-09-12T00:39:52.140 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:39:51.943+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.140 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:39:51.943+0000 7f018dc199c0 1 librados: starting msgr at 2024-09-12T00:39:52.140 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:39:51.943+0000 7f018dc199c0 1 librados: starting objecter 2024-09-12T00:39:52.140 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command objecter_requests hook 0x557cb55a2120 2024-09-12T00:39:52.140 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:39:51.943+0000 7f018dc199c0 1 librados: setting wanted keys 2024-09-12T00:39:52.140 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:39:51.943+0000 7f018dc199c0 1 librados: calling monclient init 2024-09-12T00:39:52.141 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: init 2024-09-12T00:39:52.141 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding auth protocol: cephx 2024-09-12T00:39:52.141 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding auth protocol: cephx 2024-09-12T00:39:52.141 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding auth protocol: cephx 2024-09-12T00:39:52.141 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: secure 2024-09-12T00:39:52.141 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: crc 2024-09-12T00:39:52.141 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: secure 2024-09-12T00:39:52.141 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: crc 2024-09-12T00:39:52.141 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: secure 2024-09-12T00:39:52.141 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: crc 2024-09-12T00:39:52.141 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: crc 2024-09-12T00:39:52.141 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: secure 2024-09-12T00:39:52.141 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: crc 2024-09-12T00:39:52.142 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: secure 2024-09-12T00:39:52.142 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: crc 2024-09-12T00:39:52.142 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 AuthRegistry(0x557cb5570e80) adding con mode: secure 2024-09-12T00:39:52.142 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:39:51.943+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.142 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:39:51.943+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.142 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command rotate-key hook 0x557cb5570fc8 2024-09-12T00:39:52.142 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:52.142 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:39:52.142 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-b con 0x557cb53fede0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:39:52.142 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-c con 0x557cb54ba300 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:39:52.142 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-a con 0x557cb55aefc0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:39:52.142 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.142 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.143 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.143 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:52.143 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient(hunting): authenticate will time out at 2445.289175s 2024-09-12T00:39:52.143 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient(hunting): get_auth_request con 0x557cb55aefc0 auth_method 0 2024-09-12T00:39:52.143 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.143 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.143 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.143 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:39:51.943+0000 7f018af1e640 10 monclient(hunting): get_auth_request con 0x557cb54ba300 auth_method 0 2024-09-12T00:39:52.143 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:39:51.943+0000 7f018af1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.143 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:39:51.943+0000 7f018af1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.143 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:39:51.943+0000 7f018af1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.143 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:52.144 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:52.144 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:52.144 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:39:51.943+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:52.144 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:39:51.943+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:52.144 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:39:51.943+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:52.144 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient(hunting): handle_auth_done global_id 8346 payload 824 2024-09-12T00:39:52.144 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient: _finish_hunting 0 2024-09-12T00:39:52.144 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:39:51.943+0000 7f018bf20640 1 monclient: found mon.noname-a 2024-09-12T00:39:52.144 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:39:51.943+0000 7f018bf20640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:39:52.144 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.144 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:52.144 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: dump: 2024-09-12T00:39:52.144 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.145 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.145 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.145 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.145 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.145 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.145 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.145 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.145 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.145 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.145 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: _finish_auth 0 2024-09-12T00:39:52.145 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: _check_auth_tickets 2024-09-12T00:39:52.145 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:52.146 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.146 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:52.146 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:39:51.943+0000 7f0077e07640 10 monclient: dump: 2024-09-12T00:39:52.146 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.146 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.146 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.146 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.146 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.146 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.146 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.146 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.146 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.146 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.147 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:39:51.943+0000 7f018dc199c0 5 monclient: authenticate success, global_id 8346 2024-09-12T00:39:52.147 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: _renew_subs 2024-09-12T00:39:52.147 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:39:52.147 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:39:51.943+0000 7f007960a640 4 set_mon_vals no callback set 2024-09-12T00:39:52.147 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: _renew_subs 2024-09-12T00:39:52.147 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:39:51.943+0000 7f018dc199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:39:52.147 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:39:51.943+0000 7f018dc199c0 1 librados: init done 2024-09-12T00:39:52.147 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:39:51.947+0000 7f0077e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:52.147 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:39:51.947+0000 7f0077e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:52.147 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:39:51.947+0000 7f0077e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:52.147 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:39:51.947+0000 7f018b71f640 10 monclient: get_auth_request con 0x7f0070070ae0 auth_method 0 2024-09-12T00:39:52.147 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:39:51.947+0000 7f018af1e640 10 monclient: get_auth_request con 0x557cb55b9380 auth_method 0 2024-09-12T00:39:52.147 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:39:51.947+0000 7f018b71f640 10 monclient: get_auth_request con 0x557cb55bc560 auth_method 0 2024-09-12T00:39:52.148 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:39:51.947+0000 7f018af1e640 10 monclient: get_auth_request con 0x557cb55c0750 auth_method 0 2024-09-12T00:39:52.148 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: build_initial_monmap 2024-09-12T00:39:52.148 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:39:51.951+0000 7f018dc199c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:52.148 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: monmap: 2024-09-12T00:39:52.148 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:39:52.148 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:52.148 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:39:52.148 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:39:52.148 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:52.148 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.149 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:39:52.149 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:39:52.149 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:39:52.149 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.149 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding auth protocol: cephx 2024-09-12T00:39:52.149 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding auth protocol: cephx 2024-09-12T00:39:52.149 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding auth protocol: cephx 2024-09-12T00:39:52.149 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: secure 2024-09-12T00:39:52.149 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: crc 2024-09-12T00:39:52.149 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: secure 2024-09-12T00:39:52.149 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: crc 2024-09-12T00:39:52.149 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: secure 2024-09-12T00:39:52.149 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: crc 2024-09-12T00:39:52.150 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: crc 2024-09-12T00:39:52.150 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: secure 2024-09-12T00:39:52.150 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: crc 2024-09-12T00:39:52.150 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: secure 2024-09-12T00:39:52.150 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: crc 2024-09-12T00:39:52.150 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c5210) adding con mode: secure 2024-09-12T00:39:52.150 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:39:51.951+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.150 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command objecter_requests cmddesc objecter_requests hook 0x557cb55c8b30 EEXIST 2024-09-12T00:39:52.150 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: init 2024-09-12T00:39:52.150 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding auth protocol: cephx 2024-09-12T00:39:52.150 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding auth protocol: cephx 2024-09-12T00:39:52.150 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding auth protocol: cephx 2024-09-12T00:39:52.150 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: secure 2024-09-12T00:39:52.151 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: crc 2024-09-12T00:39:52.151 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: secure 2024-09-12T00:39:52.151 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: crc 2024-09-12T00:39:52.151 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: secure 2024-09-12T00:39:52.151 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: crc 2024-09-12T00:39:52.151 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: crc 2024-09-12T00:39:52.151 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: secure 2024-09-12T00:39:52.151 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: crc 2024-09-12T00:39:52.151 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: secure 2024-09-12T00:39:52.151 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: crc 2024-09-12T00:39:52.151 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 AuthRegistry(0x557cb55c39d8) adding con mode: secure 2024-09-12T00:39:52.151 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:39:51.951+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.152 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:39:51.951+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.152 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command rotate-key cmddesc rotate-key hook 0x557cb55c3b20 EEXIST 2024-09-12T00:39:52.152 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:52.152 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:39:52.152 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-c con 0x557cb55ecce0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:39:52.152 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-a con 0x557cb55ec610 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:39:52.152 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-b con 0x557cb55eaff0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:39:52.152 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.152 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.152 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.152 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:52.152 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient(hunting): authenticate will time out at 2445.298022s 2024-09-12T00:39:52.153 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient(hunting): get_auth_request con 0x557cb55ec610 auth_method 0 2024-09-12T00:39:52.153 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.153 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.153 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.153 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:39:51.951+0000 7f018b71f640 10 monclient(hunting): get_auth_request con 0x557cb55ecce0 auth_method 0 2024-09-12T00:39:52.153 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:39:51.951+0000 7f018b71f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.153 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:39:51.951+0000 7f018b71f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.153 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:39:51.951+0000 7f018b71f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.153 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:52.153 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:52.153 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:52.153 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:39:51.951+0000 7f018b71f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:52.153 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:39:51.951+0000 7f018b71f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:52.154 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:39:51.951+0000 7f018b71f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:52.154 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:39:51.951+0000 7f018bf20640 10 monclient(hunting): get_auth_request con 0x557cb55eaff0 auth_method 0 2024-09-12T00:39:52.154 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:39:51.951+0000 7f018bf20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.154 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:39:51.951+0000 7f018bf20640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.154 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:39:51.951+0000 7f018bf20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.154 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient(hunting): handle_auth_done global_id 8349 payload 824 2024-09-12T00:39:52.154 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient: _finish_hunting 0 2024-09-12T00:39:52.154 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:39:51.951+0000 7f018af1e640 1 monclient: found mon.noname-a 2024-09-12T00:39:52.154 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:39:51.951+0000 7f018af1e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:39:52.154 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.154 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:52.154 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: dump: 2024-09-12T00:39:52.154 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.154 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.155 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.155 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.155 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.155 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.155 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.155 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.155 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.155 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.155 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: _finish_auth 0 2024-09-12T00:39:52.155 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: _check_auth_tickets 2024-09-12T00:39:52.155 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:52.155 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.156 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:52.156 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:39:51.951+0000 7f0075602640 10 monclient: dump: 2024-09-12T00:39:52.156 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.156 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.156 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.156 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.156 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.156 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.156 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.156 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.156 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.156 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.156 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:39:51.951+0000 7f018c721640 4 set_mon_vals no callback set 2024-09-12T00:39:52.157 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:39:51.951+0000 7f018dc199c0 5 monclient: authenticate success, global_id 8349 2024-09-12T00:39:52.157 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: _renew_subs 2024-09-12T00:39:52.157 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:39:52.157 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: _renew_subs 2024-09-12T00:39:52.157 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:39:51.951+0000 7f018dc199c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:39:52.157 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:39:51.955+0000 7f0075602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:52.157 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:39:51.955+0000 7f0075602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:52.157 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:39:51.955+0000 7f0075602640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:52.157 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient: get_monmap_and_config 2024-09-12T00:39:52.157 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient: build_initial_monmap 2024-09-12T00:39:52.157 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:39:51.955+0000 7f018dc199c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:52.157 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient: monmap: 2024-09-12T00:39:52.158 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:39:52.158 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:52.158 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:39:52.158 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:39:52.158 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:52.158 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.158 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:39:52.158 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:39:52.158 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:39:52.158 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.158 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding auth protocol: cephx 2024-09-12T00:39:52.158 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding auth protocol: cephx 2024-09-12T00:39:52.158 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding auth protocol: cephx 2024-09-12T00:39:52.159 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: secure 2024-09-12T00:39:52.159 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: crc 2024-09-12T00:39:52.159 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: secure 2024-09-12T00:39:52.159 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: crc 2024-09-12T00:39:52.159 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: secure 2024-09-12T00:39:52.159 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: crc 2024-09-12T00:39:52.159 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: crc 2024-09-12T00:39:52.159 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: secure 2024-09-12T00:39:52.159 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: crc 2024-09-12T00:39:52.159 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: secure 2024-09-12T00:39:52.159 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: crc 2024-09-12T00:39:52.159 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x557cb560c6a0) adding con mode: secure 2024-09-12T00:39:52.159 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:39:51.955+0000 7f018b71f640 10 monclient: get_auth_request con 0x7f0064070a20 auth_method 0 2024-09-12T00:39:52.160 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:39:51.955+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.160 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient: init 2024-09-12T00:39:52.160 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding auth protocol: cephx 2024-09-12T00:39:52.160 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding auth protocol: cephx 2024-09-12T00:39:52.160 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding auth protocol: cephx 2024-09-12T00:39:52.160 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: secure 2024-09-12T00:39:52.160 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: crc 2024-09-12T00:39:52.160 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: secure 2024-09-12T00:39:52.160 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: crc 2024-09-12T00:39:52.160 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: secure 2024-09-12T00:39:52.160 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: crc 2024-09-12T00:39:52.161 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: crc 2024-09-12T00:39:52.161 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: secure 2024-09-12T00:39:52.161 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: crc 2024-09-12T00:39:52.161 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: secure 2024-09-12T00:39:52.161 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: crc 2024-09-12T00:39:52.161 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517b620) adding con mode: secure 2024-09-12T00:39:52.161 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:39:51.955+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.161 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:39:51.955+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.161 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd3517b768 EEXIST 2024-09-12T00:39:52.161 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:52.161 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:39:52.161 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-b con 0x557cb56409c0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:39:52.162 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-a con 0x557cb5640da0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:39:52.162 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-c con 0x557cb563b140 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:39:52.162 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.162 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.162 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.162 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:52.162 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient(hunting): authenticate will time out at 2445.303226s 2024-09-12T00:39:52.162 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:39:51.955+0000 7f018bf20640 10 monclient(hunting): get_auth_request con 0x557cb563b140 auth_method 0 2024-09-12T00:39:52.162 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:39:51.955+0000 7f018bf20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.162 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:39:51.955+0000 7f018bf20640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.162 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:39:51.955+0000 7f018bf20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.162 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient(hunting): get_auth_request con 0x557cb5640da0 auth_method 0 2024-09-12T00:39:52.162 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.163 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.163 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.163 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:52.163 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:52.163 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:52.163 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:39:51.955+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:52.163 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:39:51.955+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:52.163 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:39:51.955+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:52.163 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:39:51.955+0000 7f018b71f640 10 monclient(hunting): get_auth_request con 0x557cb56409c0 auth_method 0 2024-09-12T00:39:52.163 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:39:51.955+0000 7f018b71f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.163 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:39:51.955+0000 7f018b71f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.163 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:39:51.955+0000 7f018b71f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.163 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient(hunting): handle_auth_done global_id 8352 payload 274 2024-09-12T00:39:52.164 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient: _finish_hunting 0 2024-09-12T00:39:52.164 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:39:51.955+0000 7f018af1e640 1 monclient: found mon.noname-a 2024-09-12T00:39:52.164 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:39:51.955+0000 7f018af1e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:39:52.164 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.164 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:39:52.164 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: dump: 2024-09-12T00:39:52.164 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.164 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.165 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.165 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.165 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.165 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.165 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.165 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.165 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.165 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.165 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: _finish_auth 0 2024-09-12T00:39:52.165 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: _check_auth_tickets 2024-09-12T00:39:52.165 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:52.165 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:39:51.955+0000 7f018dc199c0 5 monclient: authenticate success, global_id 8352 2024-09-12T00:39:52.165 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:39:51.955+0000 7f018dc199c0 10 monclient: get_monmap_and_config success 2024-09-12T00:39:52.166 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:39:51.955+0000 7f018dc199c0 4 set_mon_vals no callback set 2024-09-12T00:39:52.166 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.166 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:39:52.166 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:39:51.955+0000 7f006effd640 10 monclient: dump: 2024-09-12T00:39:52.166 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.166 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.166 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.166 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.166 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.166 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.167 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.167 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.167 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.167 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.167 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: shutdown 2024-09-12T00:39:52.167 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: build_initial_monmap 2024-09-12T00:39:52.167 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:39:51.959+0000 7f018dc199c0 1 build_initial for_mkfs: 0 2024-09-12T00:39:52.167 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: monmap: 2024-09-12T00:39:52.167 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:39:52.167 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:39:52.167 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:39:52.167 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:39:52.167 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:39:52.168 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.168 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:39:52.168 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:39:52.168 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:39:52.168 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.168 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding auth protocol: cephx 2024-09-12T00:39:52.168 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding auth protocol: cephx 2024-09-12T00:39:52.168 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding auth protocol: cephx 2024-09-12T00:39:52.168 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: secure 2024-09-12T00:39:52.168 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: crc 2024-09-12T00:39:52.168 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: secure 2024-09-12T00:39:52.168 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: crc 2024-09-12T00:39:52.169 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: secure 2024-09-12T00:39:52.169 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: crc 2024-09-12T00:39:52.169 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: crc 2024-09-12T00:39:52.169 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: secure 2024-09-12T00:39:52.169 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: crc 2024-09-12T00:39:52.169 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: secure 2024-09-12T00:39:52.169 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: crc 2024-09-12T00:39:52.169 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb563ccf0) adding con mode: secure 2024-09-12T00:39:52.169 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:39:51.959+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.169 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:39:51.959+0000 7f018dc199c0 1 librados: starting msgr at 2024-09-12T00:39:52.169 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:39:51.959+0000 7f018dc199c0 1 librados: starting objecter 2024-09-12T00:39:52.169 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command objecter_requests cmddesc objecter_requests hook 0x557cb55b2a90 EEXIST 2024-09-12T00:39:52.169 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:39:51.959+0000 7f018dc199c0 1 librados: setting wanted keys 2024-09-12T00:39:52.170 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:39:51.959+0000 7f018dc199c0 1 librados: calling monclient init 2024-09-12T00:39:52.170 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: init 2024-09-12T00:39:52.170 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding auth protocol: cephx 2024-09-12T00:39:52.170 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding auth protocol: cephx 2024-09-12T00:39:52.170 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding auth protocol: cephx 2024-09-12T00:39:52.170 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: secure 2024-09-12T00:39:52.170 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: crc 2024-09-12T00:39:52.170 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: secure 2024-09-12T00:39:52.170 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: crc 2024-09-12T00:39:52.170 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: secure 2024-09-12T00:39:52.170 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: crc 2024-09-12T00:39:52.170 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: crc 2024-09-12T00:39:52.171 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: secure 2024-09-12T00:39:52.171 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: crc 2024-09-12T00:39:52.171 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: secure 2024-09-12T00:39:52.171 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: crc 2024-09-12T00:39:52.171 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 AuthRegistry(0x557cb55eeb00) adding con mode: secure 2024-09-12T00:39:52.171 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:39:51.959+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.171 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:39:51.959+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.171 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command rotate-key cmddesc rotate-key hook 0x557cb55eec48 EEXIST 2024-09-12T00:39:52.171 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: _reopen_session rank -1 2024-09-12T00:39:52.171 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:39:52.171 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-b con 0x557cb563b140 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:39:52.171 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-c con 0x557cb56409c0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:39:52.171 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient(hunting): picked mon.noname-a con 0x557cb564dfb0 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:39:52.172 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.172 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.172 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:39:52.172 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient(hunting): _renew_subs 2024-09-12T00:39:52.172 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient(hunting): authenticate will time out at 2445.305960s 2024-09-12T00:39:52.172 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient(hunting): get_auth_request con 0x557cb56409c0 auth_method 0 2024-09-12T00:39:52.172 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.172 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.172 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.172 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:39:51.959+0000 7f018bf20640 10 monclient(hunting): get_auth_request con 0x557cb564dfb0 auth_method 0 2024-09-12T00:39:52.172 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:39:51.959+0000 7f018bf20640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.172 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:39:51.959+0000 7f018bf20640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.173 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:39:51.959+0000 7f018bf20640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.173 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:52.173 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:52.173 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:52.173 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:39:51.959+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:39:52.173 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:39:51.959+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:39:52.173 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:39:51.959+0000 7f018bf20640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:39:52.173 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:39:51.959+0000 7f018b71f640 10 monclient(hunting): get_auth_request con 0x557cb563b140 auth_method 0 2024-09-12T00:39:52.173 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:39:51.959+0000 7f018b71f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:39:52.173 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:39:51.959+0000 7f018b71f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:39:52.173 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:39:51.959+0000 7f018b71f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:39:52.173 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient(hunting): handle_auth_done global_id 7799 payload 824 2024-09-12T00:39:52.173 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient: _finish_hunting 0 2024-09-12T00:39:52.174 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:39:51.959+0000 7f018af1e640 1 monclient: found mon.noname-c 2024-09-12T00:39:52.174 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:39:51.959+0000 7f018af1e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:39:52.174 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.174 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:39:52.174 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: dump: 2024-09-12T00:39:52.174 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.174 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.174 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.174 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.175 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.175 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.175 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.175 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.175 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.175 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.175 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:39:52.175 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:39:52.175 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 monclient: authenticate success, global_id 7799 2024-09-12T00:39:52.175 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: _renew_subs 2024-09-12T00:39:52.175 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:39:52.175 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:39:52.176 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:39:52.176 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:39:52.176 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:39:51.959+0000 7f006d7fa640 10 monclient: dump: 2024-09-12T00:39:52.176 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:39:52.176 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:39:52.176 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.176 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:39:52.176 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:39:52.176 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:39:52.176 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:39:52.176 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:39:52.177 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:39:52.177 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.177 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:39:51.959+0000 7f006effd640 4 set_mon_vals no callback set 2024-09-12T00:39:52.177 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: _renew_subs 2024-09-12T00:39:52.177 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:39:51.959+0000 7f018dc199c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:39:52.177 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:39:51.959+0000 7f018dc199c0 1 librados: init done 2024-09-12T00:39:52.177 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:39:51.959+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command cr dump hook 0x557cb564ab38 2024-09-12T00:39:52.177 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.177 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:39:51.963+0000 7f006d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:39:52.177 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:39:51.963+0000 7f006d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:52.177 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:39:51.963+0000 7f006d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:39:52.178 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:39:51.963+0000 7f018b71f640 10 monclient: get_auth_request con 0x7f0054070b10 auth_method 0 2024-09-12T00:39:52.178 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:39:51.963+0000 7f018bf20640 10 monclient: get_auth_request con 0x557cb565aba0 auth_method 0 2024-09-12T00:39:52.178 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.178 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:39:51.963+0000 7f018dc199c0 20 realm 2024-09-12T00:39:52.178 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.178 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.178 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:39:51.963+0000 7f018dc199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:52.178 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.178 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.178 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:39:51.963+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.178 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:39:51.963+0000 7f018b71f640 10 monclient: get_auth_request con 0x557cb565edb0 auth_method 0 2024-09-12T00:39:52.178 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:39:51.967+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:52.178 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:39:51.967+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.179 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:39:51.967+0000 7f018af1e640 10 monclient: get_auth_request con 0x557cb56625f0 auth_method 0 2024-09-12T00:39:52.179 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:39:51.967+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:52.179 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:39:51.967+0000 7f018dc199c0 20 searching for the correct realm 2024-09-12T00:39:52.179 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:39:51.967+0000 7f018bf20640 10 monclient: get_auth_request con 0x557cb5667390 auth_method 0 2024-09-12T00:39:52.179 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:39:51.967+0000 7f018b71f640 10 monclient: get_auth_request con 0x7f017c12d040 auth_method 0 2024-09-12T00:39:52.179 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:39:51.971+0000 7f018af1e640 10 monclient: get_auth_request con 0x7f0184032070 auth_method 0 2024-09-12T00:39:52.179 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:39:51.971+0000 7f018af1e640 0 -- 172.21.15.138:0/3794014062 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f0184032070 msgr2=0x7f018403f400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:52.179 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:39:51.971+0000 7f006d7fa640 1 client.7799.objecter ms_handle_reset 0x7f0184032070 session 0x7f0184004420 osd.0 2024-09-12T00:39:52.179 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:39:51.971+0000 7f006d7fa640 10 monclient: _renew_subs 2024-09-12T00:39:52.179 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:39:51.971+0000 7f006d7fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:39:52.179 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:39:51.971+0000 7f018af1e640 10 monclient: get_auth_request con 0x7f0054080db0 auth_method 0 2024-09-12T00:39:52.179 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:39:51.971+0000 7f018bf20640 10 monclient: get_auth_request con 0x7f017c100a90 auth_method 0 2024-09-12T00:39:52.179 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:39:51.975+0000 7f018b71f640 10 monclient: get_auth_request con 0x7f0184004b60 auth_method 0 2024-09-12T00:39:52.180 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:39:51.975+0000 7f018af1e640 0 -- 172.21.15.138:0/3794014062 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x557cb56625f0 msgr2=0x557cb56649e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:52.180 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:39:51.975+0000 7f006d7fa640 1 client.7799.objecter ms_handle_reset 0x557cb56625f0 session 0x557cb565e140 osd.3 2024-09-12T00:39:52.180 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:39:51.975+0000 7f018af1e640 10 monclient: get_auth_request con 0x7f0184032070 auth_method 0 2024-09-12T00:39:52.180 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:39:52.180 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:52.180 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:39:52.180 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:52.180 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:52.180 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:39:51.983+0000 7f018dc199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:52.180 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.180 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.180 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.181 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:52.181 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.181 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:52.181 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 zone default found 2024-09-12T00:39:52.181 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:39:51.987+0000 7f018dc199c0 4 Realm: () 2024-09-12T00:39:52.181 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:39:51.987+0000 7f018dc199c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:39:52.181 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:39:51.987+0000 7f018dc199c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:39:52.181 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:39:51.987+0000 7f018dc199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:52.181 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 zonegroup default 2024-09-12T00:39:52.181 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.181 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.181 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.182 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.182 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.182 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.182 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 started sync module instance, tier type = 2024-09-12T00:39:52.182 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:39:51.987+0000 7f018dc199c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:39:52.182 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=0 2024-09-12T00:39:52.182 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=1 2024-09-12T00:39:52.182 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=2 2024-09-12T00:39:52.182 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=3 2024-09-12T00:39:52.182 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=4 2024-09-12T00:39:52.182 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=5 2024-09-12T00:39:52.182 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=6 2024-09-12T00:39:52.182 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:39:52.007+0000 7f018dc199c0 20 add_watcher() i=7 2024-09-12T00:39:52.183 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:39:52.007+0000 7f018dc199c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:52.183 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding auth protocol: cephx 2024-09-12T00:39:52.183 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding auth protocol: cephx 2024-09-12T00:39:52.183 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding auth protocol: cephx 2024-09-12T00:39:52.183 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: secure 2024-09-12T00:39:52.183 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: crc 2024-09-12T00:39:52.183 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: secure 2024-09-12T00:39:52.183 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: crc 2024-09-12T00:39:52.183 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: secure 2024-09-12T00:39:52.183 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: crc 2024-09-12T00:39:52.183 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: crc 2024-09-12T00:39:52.183 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:39:52.011+0000 7f0041fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:52.183 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: secure 2024-09-12T00:39:52.184 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: crc 2024-09-12T00:39:52.184 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: secure 2024-09-12T00:39:52.184 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: crc 2024-09-12T00:39:52.184 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 AuthRegistry(0x7ffd3517bb00) adding con mode: secure 2024-09-12T00:39:52.184 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:39:52.011+0000 7f018dc199c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:39:52.184 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:39:52.011+0000 7f018dc199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:52.184 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:39:52.011+0000 7f018dc199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:52.184 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command cache list hook 0x557cb564e3b0 2024-09-12T00:39:52.184 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command cache inspect hook 0x557cb564e3b0 2024-09-12T00:39:52.184 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command cache erase hook 0x557cb564e3b0 2024-09-12T00:39:52.185 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command cache zap hook 0x557cb564e3b0 2024-09-12T00:39:52.185 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 note: GC not initialized 2024-09-12T00:39:52.185 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:39:52.011+0000 7f0040fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:52.185 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command sync trace show hook 0x7f0180004830 2024-09-12T00:39:52.185 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command sync trace history hook 0x7f0180004830 2024-09-12T00:39:52.185 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command sync trace active hook 0x7f0180004830 2024-09-12T00:39:52.185 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:39:52.011+0000 7f018dc199c0 5 asok(0x557cb53662b0) register_command sync trace active_short hook 0x7f0180004830 2024-09-12T00:39:52.185 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:39:52.011+0000 7f018dc199c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:52.185 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:39:52.011+0000 7f018dc199c0 20 Filter name: none 2024-09-12T00:39:52.185 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:39:52.011+0000 7effba7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:52.185 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:39:52.011+0000 7f018dc199c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:39:52.185 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:39:52.011+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.185 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:39:52.015+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:52.186 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:39:52.186 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:39:52.186 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:39:52.186 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:39:52.015+0000 7f018dc199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.186 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:39:52.015+0000 7f018dc199c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:39:52.186 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:52.186 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:52.186 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:52.186 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:52.186 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:39:52.186 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:39:52.015+0000 7f018dc199c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:39:52.186 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:39:52.035+0000 7f018dc199c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:52.187 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:39:52.035+0000 7f018dc199c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:52.187 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:39:52.035+0000 7f018dc199c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:52.187 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:39:52.035+0000 7f018dc199c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:39:52.187 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:39:52.035+0000 7f006effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333574 cookie 93994107710032 notifier 7799 bl.length()=827 2024-09-12T00:39:52.187 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:39:52.035+0000 7f006effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:52.187 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:39:52.035+0000 7f006effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:52.187 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:39:52.035+0000 7f006effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:52.187 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:39:52.035+0000 7f018dc199c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:39:52.187 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:39:52.035+0000 7f018dc199c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:39:52.187 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:39:52.035+0000 7f018dc199c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:39:52.187 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:39:52.035+0000 7f018dc199c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:39:52.187 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:39:52.043+0000 7f018dc199c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f018dc199c0 time 2024-09-12T00:39:52.046415+0000 2024-09-12T00:39:52.188 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:39:52.188 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.188 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:52.188 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f01914f32eb] 2024-09-12T00:39:52.188 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f01914f349f] 2024-09-12T00:39:52.188 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557cb2557cc1] 2024-09-12T00:39:52.188 INFO:tasks.workunit.client.0.smithi138.stderr: 4: radosgw-admin(+0x1422aac) [0x557cb2fb5aac] 2024-09-12T00:39:52.188 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557cb256cced] 2024-09-12T00:39:52.188 INFO:tasks.workunit.client.0.smithi138.stderr: 6: main() 2024-09-12T00:39:52.188 INFO:tasks.workunit.client.0.smithi138.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0190359d90] 2024-09-12T00:39:52.188 INFO:tasks.workunit.client.0.smithi138.stderr: 8: __libc_start_main() 2024-09-12T00:39:52.188 INFO:tasks.workunit.client.0.smithi138.stderr: 9: _start() 2024-09-12T00:39:52.189 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.189 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:39:52.043+0000 7f018dc199c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:39:52.189 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f018dc199c0 thread_name:radosgw-admin 2024-09-12T00:39:52.189 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.189 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:39:52.189 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0190372520] 2024-09-12T00:39:52.189 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:39:52.189 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:39:52.189 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:39:52.189 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f01914f3345] 2024-09-12T00:39:52.189 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f01914f349f] 2024-09-12T00:39:52.189 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557cb2557cc1] 2024-09-12T00:39:52.190 INFO:tasks.workunit.client.0.smithi138.stderr: 8: radosgw-admin(+0x1422aac) [0x557cb2fb5aac] 2024-09-12T00:39:52.190 INFO:tasks.workunit.client.0.smithi138.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557cb256cced] 2024-09-12T00:39:52.190 INFO:tasks.workunit.client.0.smithi138.stderr: 10: main() 2024-09-12T00:39:52.190 INFO:tasks.workunit.client.0.smithi138.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0190359d90] 2024-09-12T00:39:52.190 INFO:tasks.workunit.client.0.smithi138.stderr: 12: __libc_start_main() 2024-09-12T00:39:52.190 INFO:tasks.workunit.client.0.smithi138.stderr: 13: _start() 2024-09-12T00:39:52.190 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:39:52.190 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:39:52.190 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:39:52.190 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:39:52.190 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:39:52.190 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:39:52.190 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:39:52.191 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:39:52.191 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:39:52.191 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:39:52.191 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:39:52.191 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:39:52.191 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:39:52.191 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:39:52.191 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:39:52.191 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:39:52.191 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:39:52.191 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:39:52.191 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:39:52.191 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:39:52.191 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:39:52.192 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:39:52.192 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:39:52.192 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:39:52.192 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:39:52.192 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:39:52.192 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:39:52.192 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:39:52.192 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:39:52.192 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:39:52.192 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:39:52.192 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:39:52.192 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:39:52.192 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:39:52.193 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:39:52.193 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:39:52.193 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:39:52.193 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:39:52.193 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:39:52.193 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:39:52.193 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:39:52.193 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:39:52.193 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:39:52.193 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:39:52.193 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:39:52.193 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:39:52.193 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:39:52.194 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:39:52.194 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:39:52.194 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:39:52.194 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:39:52.194 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:39:52.194 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:39:52.194 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:39:52.194 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:39:52.194 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:39:52.194 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:39:52.194 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:39:52.194 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:39:52.194 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:39:52.195 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:39:52.195 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:39:52.195 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:39:52.195 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:39:52.195 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:39:52.195 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:39:52.195 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:39:52.195 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:39:52.195 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:39:52.195 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:39:52.195 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:39:52.195 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:39:52.195 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:39:52.196 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:39:52.196 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:39:52.196 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:39:52.196 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:39:52.196 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:39:52.196 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:39:52.196 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:39:52.196 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:39:52.196 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:39:52.196 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:39:52.196 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:39:52.196 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:39:52.197 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:39:52.197 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:39:52.197 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:39:52.197 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:39:52.197 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:39:52.197 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:39:52.197 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:39:52.197 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:39:52.197 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:39:52.197 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:39:52.197 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:39:52.197 INFO:tasks.workunit.client.0.smithi138.stderr: 7effba7fc640 / http_manager 2024-09-12T00:39:52.197 INFO:tasks.workunit.client.0.smithi138.stderr: 7f0040fe1640 / http_manager 2024-09-12T00:39:52.197 INFO:tasks.workunit.client.0.smithi138.stderr: 7f0041fe3640 / rgw_dt_lg_renew 2024-09-12T00:39:52.198 INFO:tasks.workunit.client.0.smithi138.stderr: 7f006d7fa640 / ms_dispatch 2024-09-12T00:39:52.198 INFO:tasks.workunit.client.0.smithi138.stderr: 7f006effd640 / io_context_pool 2024-09-12T00:39:52.198 INFO:tasks.workunit.client.0.smithi138.stderr: 7f0075602640 / ms_dispatch 2024-09-12T00:39:52.198 INFO:tasks.workunit.client.0.smithi138.stderr: 7f0077e07640 / ms_dispatch 2024-09-12T00:39:52.198 INFO:tasks.workunit.client.0.smithi138.stderr: 7f007960a640 / io_context_pool 2024-09-12T00:39:52.198 INFO:tasks.workunit.client.0.smithi138.stderr: 7f018af1e640 / msgr-worker-2 2024-09-12T00:39:52.198 INFO:tasks.workunit.client.0.smithi138.stderr: 7f018b71f640 / msgr-worker-1 2024-09-12T00:39:52.198 INFO:tasks.workunit.client.0.smithi138.stderr: 7f018bf20640 / msgr-worker-0 2024-09-12T00:39:52.198 INFO:tasks.workunit.client.0.smithi138.stderr: 7f018c721640 / io_context_pool 2024-09-12T00:39:52.198 INFO:tasks.workunit.client.0.smithi138.stderr: 7f018dc199c0 / radosgw-admin 2024-09-12T00:39:52.198 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:39:52.198 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:39:52.198 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:39:52.048948Z_09def850-a620-4caa-80bd-a361d4af4d7b/log 2024-09-12T00:39:52.199 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:39:52.199 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-12T00:39:52.199 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:39:52.205 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:52.205 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:52.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.127+0000 7fb4f6deb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.127+0000 7fb4f6deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.127+0000 7fb4f6deb9c0 20 realm 2024-09-12T00:39:52.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.127+0000 7fb4f6deb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.127+0000 7fb4f6deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.127+0000 7fb4f6deb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:52.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.127+0000 7fb4f6deb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.127+0000 7fb4f6deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.127+0000 7fb4f6deb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.131+0000 7fb4f6deb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:52.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.131+0000 7fb4f6deb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.131+0000 7fb4f6deb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:52.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.131+0000 7fb4f6deb9c0 20 searching for the correct realm 2024-09-12T00:39:52.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.131+0000 7fb4f40f0640 0 -- 172.21.15.138:0/973574242 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x55d4ce13c8f0 msgr2=0x55d4ce13ed90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:52.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.139+0000 7fb4f48f1640 0 -- 172.21.15.138:0/973574242 >> [v2:172.21.15.138:6800/1437861584,v1:172.21.15.138:6801/1437861584] conn(0x55d4ce140a20 msgr2=0x55d4ce142ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:52.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:39:52.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:52.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:39:52.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:52.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:52.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:52.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.206 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:52.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:52.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 zone default found 2024-09-12T00:39:52.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 4 Realm: () 2024-09-12T00:39:52.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:39:52.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:39:52.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:52.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 zonegroup default 2024-09-12T00:39:52.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.207 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.151+0000 7fb4f6deb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.155+0000 7fb4f6deb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:52.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.155+0000 7fb4f6deb9c0 20 started sync module instance, tier type = 2024-09-12T00:39:52.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.155+0000 7fb4f6deb9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:39:52.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.171+0000 7fb4f6deb9c0 20 add_watcher() i=0 2024-09-12T00:39:52.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.171+0000 7fb4f6deb9c0 20 add_watcher() i=1 2024-09-12T00:39:52.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.171+0000 7fb4f6deb9c0 20 add_watcher() i=2 2024-09-12T00:39:52.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.171+0000 7fb4f6deb9c0 20 add_watcher() i=3 2024-09-12T00:39:52.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.171+0000 7fb4f6deb9c0 20 add_watcher() i=4 2024-09-12T00:39:52.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.171+0000 7fb4f6deb9c0 20 add_watcher() i=5 2024-09-12T00:39:52.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.171+0000 7fb4f6deb9c0 20 add_watcher() i=6 2024-09-12T00:39:52.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.175+0000 7fb4f6deb9c0 20 add_watcher() i=7 2024-09-12T00:39:52.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.175+0000 7fb4f6deb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:52.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb3aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:52.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:52.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:52.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 5 note: GC not initialized 2024-09-12T00:39:52.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb3a9fe3640 20 reqs_thread_entry: start 2024-09-12T00:39:52.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:52.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 20 Filter name: none 2024-09-12T00:39:52.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb31b7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:52.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:39:52.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:39:52.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:39:52.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:39:52.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:39:52.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:52.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:39:52.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:39:52.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:39:52.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:52.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:39:52.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:39:52.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:39:52.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:39:52.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:39:52.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:39:52.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:39:52.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.179+0000 7fb4f6deb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:39:52.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.183+0000 7fb4f6deb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:39:52.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.183+0000 7fb4f6deb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:39:52.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.183+0000 7fb4f6deb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:39:52.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.183+0000 7fb4f6deb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:39:52.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.183+0000 7fb4f6deb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:39:52.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.183+0000 7fb4f6deb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:39:52.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.183+0000 7fb4f6deb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:39:52.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.183+0000 7fb4f6deb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:39:52.211 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.183+0000 7fb4f6deb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:39:52.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.183+0000 7fb4f6deb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:39:52.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.187+0000 7fb4f6deb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:39:52.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.187+0000 7fb4f6deb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:39:52.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.187+0000 7fb4f6deb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:39:52.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.187+0000 7fb4f6deb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:39:52.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.187+0000 7fb4f6deb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:39:52.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.187+0000 7fb4f6deb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:39:52.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.187+0000 7fb4f6deb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:39:52.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.187+0000 7fb4f6deb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:39:52.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.187+0000 7fb4f6deb9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:39:52.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.187+0000 7fb4f6deb9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:39:52.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.187+0000 7fb3aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:52.212 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.191+0000 7fb4f6deb9c0 20 remove_watcher() i=0 2024-09-12T00:39:52.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.191+0000 7fb4f6deb9c0 2 removed watcher, disabling cache 2024-09-12T00:39:52.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.195+0000 7fb4f6deb9c0 20 remove_watcher() i=1 2024-09-12T00:39:52.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.195+0000 7fb4f6deb9c0 20 remove_watcher() i=2 2024-09-12T00:39:52.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.199+0000 7fb4f6deb9c0 20 remove_watcher() i=3 2024-09-12T00:39:52.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.199+0000 7fb4f6deb9c0 20 remove_watcher() i=4 2024-09-12T00:39:52.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.203+0000 7fb4f6deb9c0 20 remove_watcher() i=5 2024-09-12T00:39:52.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.207+0000 7fb4f6deb9c0 20 remove_watcher() i=6 2024-09-12T00:39:52.213 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:39:52.207+0000 7fb4f6deb9c0 20 remove_watcher() i=7 2024-09-12T00:39:52.220 INFO:tasks.workunit.client.0.smithi138.stderr: test: duplicated entries can be purged manually 2024-09-12T00:40:22.251 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:40:22.283 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:22.283 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:22.328 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.331+0000 7fcc203ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.331+0000 7fcc203ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:22.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.331+0000 7fcc203ee9c0 20 realm 2024-09-12T00:40:22.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.331+0000 7fcc203ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.331+0000 7fcc203ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:22.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.331+0000 7fcc203ee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:22.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.331+0000 7fcc203ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.331+0000 7fcc203ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:22.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.331+0000 7fcc203ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.335+0000 7fcc203ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:22.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.335+0000 7fcc203ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.335+0000 7fcc203ee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:22.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.335+0000 7fcc203ee9c0 20 searching for the correct realm 2024-09-12T00:40:22.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.339+0000 7fcc1e6f5640 0 -- 172.21.15.138:0/1825280899 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fcc180ff570 msgr2=0x7fcc18117a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:22.555 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.555+0000 7fcc1e6f5640 0 -- 172.21.15.138:0/1825280899 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x562eac392b00 msgr2=0x562eac394fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:22.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.563+0000 7fcc203ee9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:22.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.563+0000 7fcc203ee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:22.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.563+0000 7fcc203ee9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:22.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.563+0000 7fcc203ee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:22.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.563+0000 7fcc203ee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:22.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.563+0000 7fcc203ee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:22.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.563+0000 7fcc203ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.567+0000 7fcc203ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:22.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.567+0000 7fcc203ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.567+0000 7fcc203ee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:22.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.567+0000 7fcc203ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.567+0000 7fcc203ee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:22.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.567+0000 7fcc203ee9c0 20 zone default found 2024-09-12T00:40:22.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.567+0000 7fcc203ee9c0 4 Realm: () 2024-09-12T00:40:22.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.567+0000 7fcc203ee9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:22.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.567+0000 7fcc203ee9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:22.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.567+0000 7fcc203ee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:22.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.567+0000 7fcc203ee9c0 20 zonegroup default 2024-09-12T00:40:22.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.567+0000 7fcc203ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.567+0000 7fcc203ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:22.568 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.567+0000 7fcc203ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.567+0000 7fcc203ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:22.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.567+0000 7fcc203ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.571+0000 7fcc203ee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:22.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.571+0000 7fcc203ee9c0 20 started sync module instance, tier type = 2024-09-12T00:40:22.569 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.571+0000 7fcc203ee9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:22.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.591+0000 7fcc203ee9c0 20 add_watcher() i=0 2024-09-12T00:40:22.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.591+0000 7fcc203ee9c0 20 add_watcher() i=1 2024-09-12T00:40:22.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.591+0000 7fcc203ee9c0 20 add_watcher() i=2 2024-09-12T00:40:22.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.591+0000 7fcc203ee9c0 20 add_watcher() i=3 2024-09-12T00:40:22.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.591+0000 7fcc203ee9c0 20 add_watcher() i=4 2024-09-12T00:40:22.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.591+0000 7fcc203ee9c0 20 add_watcher() i=5 2024-09-12T00:40:22.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.591+0000 7fcc203ee9c0 20 add_watcher() i=6 2024-09-12T00:40:22.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.595+0000 7fcc203ee9c0 20 add_watcher() i=7 2024-09-12T00:40:22.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.595+0000 7fcc203ee9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:22.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.599+0000 7fcacf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:22.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.599+0000 7fcc203ee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:22.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.599+0000 7fcc203ee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:22.599 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.599+0000 7fcc203ee9c0 5 note: GC not initialized 2024-09-12T00:40:22.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.599+0000 7fcace7fc640 20 reqs_thread_entry: start 2024-09-12T00:40:22.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.603+0000 7fcc203ee9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:22.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.603+0000 7fcc203ee9c0 20 Filter name: none 2024-09-12T00:40:22.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.603+0000 7fca3ffff640 20 reqs_thread_entry: start 2024-09-12T00:40:22.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.603+0000 7fcc203ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.603+0000 7fcc203ee9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:40:22.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.603+0000 7fcc203ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.603+0000 7fcc203ee9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:40:22.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.603+0000 7fcc203ee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:22.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.603+0000 7fcc203ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.603+0000 7fcc203ee9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:40:22.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.603+0000 7fcc203ee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.603+0000 7fcc203ee9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:40:22.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.603+0000 7fcc203ee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:22.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.607+0000 7fcacf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:22.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.611+0000 7fcc203ee9c0 20 remove_watcher() i=0 2024-09-12T00:40:22.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.611+0000 7fcc203ee9c0 2 removed watcher, disabling cache 2024-09-12T00:40:22.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.615+0000 7fcc203ee9c0 20 remove_watcher() i=1 2024-09-12T00:40:22.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.615+0000 7fcc203ee9c0 20 remove_watcher() i=2 2024-09-12T00:40:22.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.619+0000 7fcc203ee9c0 20 remove_watcher() i=3 2024-09-12T00:40:22.619 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.619+0000 7fcc203ee9c0 20 remove_watcher() i=4 2024-09-12T00:40:22.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.623+0000 7fcc203ee9c0 20 remove_watcher() i=5 2024-09-12T00:40:22.624 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.627+0000 7fcc203ee9c0 20 remove_watcher() i=6 2024-09-12T00:40:22.627 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.627+0000 7fcc203ee9c0 20 remove_watcher() i=7 2024-09-12T00:40:22.649 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:22.649 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:40:22.649 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: a-bucket id: e2043445-c131-4520-984d-b4d52f038a6b.4538.17 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-12T00:40:22.649 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:22.649 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:40:22.685 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:22.685 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:22.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.731+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.731+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:22.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.731+0000 7f7226a049c0 20 realm 2024-09-12T00:40:22.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.731+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:22.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.735+0000 7f7226a049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:22.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:22.733 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:22.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.734 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:22.735 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.735+0000 7f7226a049c0 20 searching for the correct realm 2024-09-12T00:40:22.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.743+0000 7f7224d0b640 0 -- 172.21.15.138:0/3251602216 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f721c0459d0 msgr2=0x7f721c049130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:22.958 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.959+0000 7f7224d0b640 0 -- 172.21.15.138:0/3251602216 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55acd6bff250 msgr2=0x55acd6c01710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:22.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:22.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:22.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:22.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:22.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:22.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:22.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.967+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:22.968 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:22.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:22.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 20 zone default found 2024-09-12T00:40:22.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 4 Realm: () 2024-09-12T00:40:22.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:22.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:22.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:22.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 20 zonegroup default 2024-09-12T00:40:22.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:22.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:22.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:22.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:22.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 20 started sync module instance, tier type = 2024-09-12T00:40:22.972 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.971+0000 7f7226a049c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:22.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=0 2024-09-12T00:40:22.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=1 2024-09-12T00:40:22.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=2 2024-09-12T00:40:22.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=3 2024-09-12T00:40:22.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=4 2024-09-12T00:40:22.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=5 2024-09-12T00:40:22.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=6 2024-09-12T00:40:22.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.999+0000 7f7226a049c0 20 add_watcher() i=7 2024-09-12T00:40:22.997 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:22.999+0000 7f7226a049c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:23.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.003+0000 7f70db7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:23.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.003+0000 7f7226a049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:23.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.003+0000 7f7226a049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:23.002 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.003+0000 7f7226a049c0 5 note: GC not initialized 2024-09-12T00:40:23.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.003+0000 7f70da7dc640 20 reqs_thread_entry: start 2024-09-12T00:40:23.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.003+0000 7f7226a049c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:23.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.003+0000 7f7226a049c0 20 Filter name: none 2024-09-12T00:40:23.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.003+0000 7f70d37fe640 20 reqs_thread_entry: start 2024-09-12T00:40:23.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.003+0000 7f7226a049c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:40:23.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.003+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.007+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:40:23.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.007+0000 7f7226a049c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:40:23.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.007+0000 7f7226a049c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:40:23.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.007+0000 7f7226a049c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:40:23.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.007+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.007+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:40:23.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.007+0000 7f7226a049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:23.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.007+0000 7f7226a049c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:23.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.007+0000 7f7226a049c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:23.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.007+0000 7f7226a049c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:23.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.007+0000 7f7226a049c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:40:23.007 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.007+0000 7f7226a049c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:40:23.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.027+0000 7f7226a049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:23.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.027+0000 7f7226a049c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:23.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.027+0000 7f7226a049c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:23.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.027+0000 7f7226a049c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:40:23.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.027+0000 7f70faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333575 cookie 94200825655648 notifier 7847 bl.length()=827 2024-09-12T00:40:23.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.027+0000 7f70faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:23.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.027+0000 7f70faffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:23.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.027+0000 7f70faffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:23.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.027+0000 7f7226a049c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:40:23.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.027+0000 7f7226a049c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:40:23.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.027+0000 7f7226a049c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:40:23.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.027+0000 7f7226a049c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:40:23.038 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7226a049c0 time 2024-09-12T00:40:23.045423+0000 2024-09-12T00:40:23.038 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:23.041 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:23.041 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f722a2de2eb] 2024-09-12T00:40:23.041 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f722a2de49f] 2024-09-12T00:40:23.041 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acd4370cc1] 2024-09-12T00:40:23.041 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55acd4385d5a] 2024-09-12T00:40:23.041 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-12T00:40:23.041 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7229144d90] 2024-09-12T00:40:23.042 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-12T00:40:23.042 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-12T00:40:23.042 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.043+0000 7f7226a049c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7226a049c0 time 2024-09-12T00:40:23.045423+0000 2024-09-12T00:40:23.042 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:23.042 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.042 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:23.042 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f722a2de2eb] 2024-09-12T00:40:23.042 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f722a2de49f] 2024-09-12T00:40:23.042 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acd4370cc1] 2024-09-12T00:40:23.042 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55acd4385d5a] 2024-09-12T00:40:23.042 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-12T00:40:23.042 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7229144d90] 2024-09-12T00:40:23.042 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-12T00:40:23.043 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-12T00:40:23.043 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.043 INFO:tasks.workunit.client.0.smithi138.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:40:23.043 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f7226a049c0 thread_name:radosgw-admin 2024-09-12T00:40:23.044 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:23.044 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f722915d520] 2024-09-12T00:40:23.044 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:40:23.045 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:40:23.045 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:40:23.045 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f722a2de345] 2024-09-12T00:40:23.045 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f722a2de49f] 2024-09-12T00:40:23.045 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acd4370cc1] 2024-09-12T00:40:23.045 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55acd4385d5a] 2024-09-12T00:40:23.045 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-12T00:40:23.045 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7229144d90] 2024-09-12T00:40:23.045 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-12T00:40:23.045 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-12T00:40:23.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.047+0000 7f7226a049c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:23.046 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f7226a049c0 thread_name:radosgw-admin 2024-09-12T00:40:23.046 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.046 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:23.046 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f722915d520] 2024-09-12T00:40:23.046 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:40:23.046 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:40:23.046 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:40:23.047 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f722a2de345] 2024-09-12T00:40:23.047 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f722a2de49f] 2024-09-12T00:40:23.047 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acd4370cc1] 2024-09-12T00:40:23.047 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55acd4385d5a] 2024-09-12T00:40:23.047 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-12T00:40:23.047 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7229144d90] 2024-09-12T00:40:23.047 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-12T00:40:23.047 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-12T00:40:23.047 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:23.047 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.047 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:40:23.065 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:40:22.707+0000 7f7223d09640 10 monclient(hunting): handle_auth_done global_id 7835 payload 274 2024-09-12T00:40:23.066 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:40:22.707+0000 7f7223d09640 10 monclient: _finish_hunting 0 2024-09-12T00:40:23.066 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:40:22.707+0000 7f7223d09640 1 monclient: found mon.noname-c 2024-09-12T00:40:23.066 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:40:22.707+0000 7f7223d09640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.066 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.066 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:23.066 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: dump: 2024-09-12T00:40:23.066 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.066 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.066 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.066 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.067 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.067 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.067 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.067 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.067 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.067 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.067 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: _finish_auth 0 2024-09-12T00:40:23.067 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: _check_auth_tickets 2024-09-12T00:40:23.067 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:23.067 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.067 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:23.067 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: dump: 2024-09-12T00:40:23.067 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.068 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.068 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.068 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.068 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.068 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.068 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.068 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.068 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.068 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.068 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:40:22.707+0000 7f7226a049c0 5 monclient: authenticate success, global_id 7835 2024-09-12T00:40:23.068 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:40:22.707+0000 7f7226a049c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:23.068 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:40:22.707+0000 7f7226a049c0 4 set_mon_vals no callback set 2024-09-12T00:40:23.069 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: shutdown 2024-09-12T00:40:23.069 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) unregister_commands rotate-key 2024-09-12T00:40:23.069 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: build_initial_monmap 2024-09-12T00:40:23.069 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:40:22.711+0000 7f7226a049c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:23.069 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: monmap: 2024-09-12T00:40:23.069 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:40:23.069 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:23.069 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:40:23.069 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:40:23.069 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:23.069 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.069 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:40:23.070 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:40:23.070 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:40:23.070 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.070 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding auth protocol: cephx 2024-09-12T00:40:23.070 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding auth protocol: cephx 2024-09-12T00:40:23.070 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding auth protocol: cephx 2024-09-12T00:40:23.070 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: secure 2024-09-12T00:40:23.070 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: crc 2024-09-12T00:40:23.070 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: secure 2024-09-12T00:40:23.070 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: crc 2024-09-12T00:40:23.070 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: secure 2024-09-12T00:40:23.070 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: crc 2024-09-12T00:40:23.071 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: crc 2024-09-12T00:40:23.071 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: secure 2024-09-12T00:40:23.071 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: crc 2024-09-12T00:40:23.071 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: secure 2024-09-12T00:40:23.071 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: crc 2024-09-12T00:40:23.071 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: secure 2024-09-12T00:40:23.071 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:40:22.711+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.071 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:40:22.711+0000 7f7226a049c0 1 librados: starting msgr at 2024-09-12T00:40:23.071 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:40:22.711+0000 7f7226a049c0 1 librados: starting objecter 2024-09-12T00:40:23.072 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command objecter_requests hook 0x55acd6b0e0d0 2024-09-12T00:40:23.072 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:40:22.711+0000 7f7226a049c0 1 librados: setting wanted keys 2024-09-12T00:40:23.072 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:40:22.711+0000 7f7226a049c0 1 librados: calling monclient init 2024-09-12T00:40:23.072 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: init 2024-09-12T00:40:23.072 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding auth protocol: cephx 2024-09-12T00:40:23.072 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding auth protocol: cephx 2024-09-12T00:40:23.072 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding auth protocol: cephx 2024-09-12T00:40:23.072 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: secure 2024-09-12T00:40:23.072 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: crc 2024-09-12T00:40:23.073 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: secure 2024-09-12T00:40:23.073 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: crc 2024-09-12T00:40:23.073 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: secure 2024-09-12T00:40:23.073 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: crc 2024-09-12T00:40:23.073 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: crc 2024-09-12T00:40:23.073 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: secure 2024-09-12T00:40:23.073 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: crc 2024-09-12T00:40:23.073 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: secure 2024-09-12T00:40:23.073 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: crc 2024-09-12T00:40:23.073 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: secure 2024-09-12T00:40:23.073 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:40:22.711+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.073 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:40:22.711+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.073 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command rotate-key hook 0x55acd6b094b8 2024-09-12T00:40:23.074 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:23.074 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:40:23.074 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-b con 0x55acd6996de0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:40:23.074 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-a con 0x55acd69c1730 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:40:23.074 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-c con 0x55acd6b32be0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:40:23.074 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.074 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.074 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.074 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:23.074 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient(hunting): authenticate will time out at 2476.058026s 2024-09-12T00:40:23.074 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient(hunting): get_auth_request con 0x55acd6b32be0 auth_method 0 2024-09-12T00:40:23.074 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.075 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.075 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.075 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:40:22.711+0000 7f7223d09640 10 monclient(hunting): get_auth_request con 0x55acd69c1730 auth_method 0 2024-09-12T00:40:23.075 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:40:22.711+0000 7f7223d09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.075 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:40:22.711+0000 7f7223d09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.075 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:40:22.711+0000 7f7223d09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.075 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:23.075 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:23.075 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:23.075 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:40:22.711+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:23.075 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:40:22.711+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:23.075 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:40:22.711+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:23.075 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:40:22.711+0000 7f722450a640 10 monclient(hunting): get_auth_request con 0x55acd6996de0 auth_method 0 2024-09-12T00:40:23.076 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:40:22.711+0000 7f722450a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.076 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:40:22.711+0000 7f722450a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.076 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:40:22.711+0000 7f722450a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.076 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient(hunting): handle_auth_done global_id 7838 payload 824 2024-09-12T00:40:23.076 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient: _finish_hunting 0 2024-09-12T00:40:23.076 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:40:22.711+0000 7f7224d0b640 1 monclient: found mon.noname-c 2024-09-12T00:40:23.076 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.076 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.076 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:23.077 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: dump: 2024-09-12T00:40:23.077 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.077 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.077 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.077 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.077 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.077 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.077 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.077 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.077 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.078 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.078 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: _finish_auth 0 2024-09-12T00:40:23.078 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: _check_auth_tickets 2024-09-12T00:40:23.078 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:23.078 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.078 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:23.078 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: dump: 2024-09-12T00:40:23.078 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.078 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.078 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.078 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.079 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.079 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.079 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.079 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.079 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.079 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.079 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 monclient: authenticate success, global_id 7838 2024-09-12T00:40:23.079 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: _renew_subs 2024-09-12T00:40:23.079 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:40:22.711+0000 7f711260c640 4 set_mon_vals no callback set 2024-09-12T00:40:23.079 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.079 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: _renew_subs 2024-09-12T00:40:23.079 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.079 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:40:22.711+0000 7f7226a049c0 1 librados: init done 2024-09-12T00:40:23.080 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:40:22.715+0000 7f7110e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:23.080 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:40:22.715+0000 7f7110e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:40:23.080 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:40:22.715+0000 7f7110e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:40:23.080 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:40:22.715+0000 7f722450a640 10 monclient: get_auth_request con 0x7f710c070cb0 auth_method 0 2024-09-12T00:40:23.080 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:40:22.715+0000 7f7223d09640 10 monclient: get_auth_request con 0x55acd6b3a870 auth_method 0 2024-09-12T00:40:23.080 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:40:22.715+0000 7f722450a640 10 monclient: get_auth_request con 0x55acd6b54310 auth_method 0 2024-09-12T00:40:23.080 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient: get_auth_request con 0x55acd6b58550 auth_method 0 2024-09-12T00:40:23.080 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient: build_initial_monmap 2024-09-12T00:40:23.080 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:40:22.719+0000 7f7226a049c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:23.080 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient: monmap: 2024-09-12T00:40:23.080 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:40:23.080 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:23.081 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:40:23.081 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:40:23.081 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:23.081 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.081 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:40:23.081 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:40:23.081 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:40:23.081 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.081 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding auth protocol: cephx 2024-09-12T00:40:23.081 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding auth protocol: cephx 2024-09-12T00:40:23.081 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding auth protocol: cephx 2024-09-12T00:40:23.081 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: secure 2024-09-12T00:40:23.082 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: crc 2024-09-12T00:40:23.082 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: secure 2024-09-12T00:40:23.082 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: crc 2024-09-12T00:40:23.082 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: secure 2024-09-12T00:40:23.082 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: crc 2024-09-12T00:40:23.082 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: crc 2024-09-12T00:40:23.083 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: secure 2024-09-12T00:40:23.083 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: crc 2024-09-12T00:40:23.083 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: secure 2024-09-12T00:40:23.083 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: crc 2024-09-12T00:40:23.083 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: secure 2024-09-12T00:40:23.083 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:40:22.719+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.083 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55acd6b60d50 EEXIST 2024-09-12T00:40:23.084 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient: init 2024-09-12T00:40:23.084 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding auth protocol: cephx 2024-09-12T00:40:23.084 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding auth protocol: cephx 2024-09-12T00:40:23.084 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding auth protocol: cephx 2024-09-12T00:40:23.084 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: secure 2024-09-12T00:40:23.084 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: crc 2024-09-12T00:40:23.084 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: secure 2024-09-12T00:40:23.085 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: crc 2024-09-12T00:40:23.085 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: secure 2024-09-12T00:40:23.085 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: crc 2024-09-12T00:40:23.085 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: crc 2024-09-12T00:40:23.085 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: secure 2024-09-12T00:40:23.085 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: crc 2024-09-12T00:40:23.085 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: secure 2024-09-12T00:40:23.085 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: crc 2024-09-12T00:40:23.085 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: secure 2024-09-12T00:40:23.085 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:40:22.719+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.085 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:40:22.719+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.085 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command rotate-key cmddesc rotate-key hook 0x55acd6b5bc00 EEXIST 2024-09-12T00:40:23.086 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:23.086 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:40:23.086 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-c con 0x55acd6b84f00 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:40:23.086 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-a con 0x55acd6b84830 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:40:23.086 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-b con 0x55acd6b83210 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:40:23.086 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.086 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.087 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.087 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:23.087 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient(hunting): authenticate will time out at 2476.067283s 2024-09-12T00:40:23.087 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient(hunting): get_auth_request con 0x55acd6b84830 auth_method 0 2024-09-12T00:40:23.087 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.087 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.087 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.088 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:40:22.719+0000 7f722450a640 10 monclient(hunting): get_auth_request con 0x55acd6b84f00 auth_method 0 2024-09-12T00:40:23.088 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:40:22.719+0000 7f722450a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.088 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:40:22.719+0000 7f722450a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.088 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:40:22.719+0000 7f722450a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.088 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:23.088 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:23.089 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:23.089 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:40:22.719+0000 7f722450a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:23.089 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:40:22.719+0000 7f722450a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:23.089 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:40:22.719+0000 7f722450a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:23.089 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:40:22.719+0000 7f7224d0b640 10 monclient(hunting): get_auth_request con 0x55acd6b83210 auth_method 0 2024-09-12T00:40:23.089 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:40:22.719+0000 7f7224d0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.089 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:40:22.719+0000 7f7224d0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.090 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:40:22.719+0000 7f7224d0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.090 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient(hunting): handle_auth_done global_id 8406 payload 824 2024-09-12T00:40:23.090 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient: _finish_hunting 0 2024-09-12T00:40:23.090 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:40:22.719+0000 7f7223d09640 1 monclient: found mon.noname-a 2024-09-12T00:40:23.090 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:40:23.090 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.090 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:23.090 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: dump: 2024-09-12T00:40:23.090 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.090 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.091 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.091 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.091 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.091 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.091 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.091 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.091 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.091 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.091 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: _finish_auth 0 2024-09-12T00:40:23.091 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:40:23.092 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:23.092 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.092 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:23.092 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: dump: 2024-09-12T00:40:23.092 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.092 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.092 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.092 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.092 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.092 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.092 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.092 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.092 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.093 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.093 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:40:22.723+0000 7f722550c640 4 set_mon_vals no callback set 2024-09-12T00:40:23.093 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 monclient: authenticate success, global_id 8406 2024-09-12T00:40:23.093 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:40:22.723+0000 7f7226a049c0 10 monclient: _renew_subs 2024-09-12T00:40:23.093 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:40:22.723+0000 7f7226a049c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:40:23.093 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:40:22.723+0000 7f7226a049c0 10 monclient: _renew_subs 2024-09-12T00:40:23.093 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:40:22.723+0000 7f7226a049c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:40:23.093 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:40:22.723+0000 7f7109ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:23.093 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:40:22.723+0000 7f7109ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:40:23.093 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:40:22.723+0000 7f7109ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:40:23.093 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:40:22.723+0000 7f7226a049c0 10 monclient: get_monmap_and_config 2024-09-12T00:40:23.093 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:40:22.723+0000 7f7226a049c0 10 monclient: build_initial_monmap 2024-09-12T00:40:23.093 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:40:22.723+0000 7f7226a049c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:23.094 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:40:22.723+0000 7f7226a049c0 10 monclient: monmap: 2024-09-12T00:40:23.094 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:40:23.094 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:23.094 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:40:23.094 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:40:23.094 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:23.094 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.094 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:40:23.094 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:40:23.094 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:40:23.094 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.095 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding auth protocol: cephx 2024-09-12T00:40:23.095 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding auth protocol: cephx 2024-09-12T00:40:23.095 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding auth protocol: cephx 2024-09-12T00:40:23.095 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: secure 2024-09-12T00:40:23.095 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: crc 2024-09-12T00:40:23.095 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: secure 2024-09-12T00:40:23.095 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: crc 2024-09-12T00:40:23.095 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: secure 2024-09-12T00:40:23.095 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: crc 2024-09-12T00:40:23.095 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: crc 2024-09-12T00:40:23.096 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: secure 2024-09-12T00:40:23.096 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: crc 2024-09-12T00:40:23.096 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: secure 2024-09-12T00:40:23.096 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: crc 2024-09-12T00:40:23.096 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: secure 2024-09-12T00:40:23.096 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:40:22.723+0000 7f722450a640 10 monclient: get_auth_request con 0x7f70fc070a20 auth_method 0 2024-09-12T00:40:23.096 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:40:22.723+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.096 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:40:22.723+0000 7f7226a049c0 10 monclient: init 2024-09-12T00:40:23.096 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding auth protocol: cephx 2024-09-12T00:40:23.096 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding auth protocol: cephx 2024-09-12T00:40:23.096 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding auth protocol: cephx 2024-09-12T00:40:23.096 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: secure 2024-09-12T00:40:23.097 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: crc 2024-09-12T00:40:23.097 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: secure 2024-09-12T00:40:23.097 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: crc 2024-09-12T00:40:23.097 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: secure 2024-09-12T00:40:23.097 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: crc 2024-09-12T00:40:23.097 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: crc 2024-09-12T00:40:23.098 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: secure 2024-09-12T00:40:23.098 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: crc 2024-09-12T00:40:23.098 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: secure 2024-09-12T00:40:23.098 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: crc 2024-09-12T00:40:23.098 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: secure 2024-09-12T00:40:23.098 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:40:22.727+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.098 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:40:22.727+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.099 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe2ef757b8 EEXIST 2024-09-12T00:40:23.099 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:23.099 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:40:23.099 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-b con 0x55acd6ba86a0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:40:23.099 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-a con 0x55acd6bd8d50 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:40:23.099 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-c con 0x55acd6bd3f00 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:40:23.099 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.099 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.099 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.099 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:23.099 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): authenticate will time out at 2476.072356s 2024-09-12T00:40:23.099 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient(hunting): get_auth_request con 0x55acd6bd3f00 auth_method 0 2024-09-12T00:40:23.099 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.100 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.100 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.100 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): get_auth_request con 0x55acd6bd8d50 auth_method 0 2024-09-12T00:40:23.100 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.100 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.100 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.100 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:23.101 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:23.101 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:23.101 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:23.101 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:23.101 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:23.101 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient(hunting): handle_auth_done global_id 7844 payload 274 2024-09-12T00:40:23.101 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient: _finish_hunting 0 2024-09-12T00:40:23.101 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:40:22.727+0000 7f7224d0b640 1 monclient: found mon.noname-c 2024-09-12T00:40:23.101 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.101 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.101 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:23.101 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: dump: 2024-09-12T00:40:23.101 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.102 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.102 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.102 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.102 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.102 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.102 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.102 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.102 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.102 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.103 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: _finish_auth 0 2024-09-12T00:40:23.103 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:40:23.103 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:23.103 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 monclient: authenticate success, global_id 7844 2024-09-12T00:40:23.103 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:23.103 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:40:22.727+0000 7f7226a049c0 4 set_mon_vals no callback set 2024-09-12T00:40:23.103 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.103 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:23.103 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: dump: 2024-09-12T00:40:23.103 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.103 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.103 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.103 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.104 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.104 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.104 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.104 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.104 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.104 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.104 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: shutdown 2024-09-12T00:40:23.104 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: build_initial_monmap 2024-09-12T00:40:23.104 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:40:22.727+0000 7f7226a049c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:23.104 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: monmap: 2024-09-12T00:40:23.104 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:40:23.104 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:23.104 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:40:23.105 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:40:23.105 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:23.105 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.105 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:40:23.105 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:40:23.105 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:40:23.105 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.105 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding auth protocol: cephx 2024-09-12T00:40:23.105 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding auth protocol: cephx 2024-09-12T00:40:23.105 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding auth protocol: cephx 2024-09-12T00:40:23.105 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: secure 2024-09-12T00:40:23.105 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: crc 2024-09-12T00:40:23.106 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: secure 2024-09-12T00:40:23.106 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: crc 2024-09-12T00:40:23.106 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: secure 2024-09-12T00:40:23.106 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: crc 2024-09-12T00:40:23.106 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: crc 2024-09-12T00:40:23.106 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: secure 2024-09-12T00:40:23.106 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: crc 2024-09-12T00:40:23.106 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: secure 2024-09-12T00:40:23.106 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: crc 2024-09-12T00:40:23.106 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: secure 2024-09-12T00:40:23.106 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:40:22.727+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.106 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:40:22.727+0000 7f7226a049c0 1 librados: starting msgr at 2024-09-12T00:40:23.106 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:40:22.727+0000 7f7226a049c0 1 librados: starting objecter 2024-09-12T00:40:23.106 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55acd6b82e80 EEXIST 2024-09-12T00:40:23.107 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:40:22.727+0000 7f7226a049c0 1 librados: setting wanted keys 2024-09-12T00:40:23.107 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:40:22.727+0000 7f7226a049c0 1 librados: calling monclient init 2024-09-12T00:40:23.107 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: init 2024-09-12T00:40:23.107 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding auth protocol: cephx 2024-09-12T00:40:23.107 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding auth protocol: cephx 2024-09-12T00:40:23.107 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding auth protocol: cephx 2024-09-12T00:40:23.107 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: secure 2024-09-12T00:40:23.107 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: crc 2024-09-12T00:40:23.107 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: secure 2024-09-12T00:40:23.108 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: crc 2024-09-12T00:40:23.108 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: secure 2024-09-12T00:40:23.108 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: crc 2024-09-12T00:40:23.108 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: crc 2024-09-12T00:40:23.108 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: secure 2024-09-12T00:40:23.108 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: crc 2024-09-12T00:40:23.108 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: secure 2024-09-12T00:40:23.108 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: crc 2024-09-12T00:40:23.109 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: secure 2024-09-12T00:40:23.109 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:40:22.727+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.109 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:40:22.727+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.109 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command rotate-key cmddesc rotate-key hook 0x55acd6b86e68 EEXIST 2024-09-12T00:40:23.109 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:23.109 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:40:23.109 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-c con 0x55acd6ba86a0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:40:23.109 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-a con 0x55acd6bd3f00 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:40:23.109 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-b con 0x55acd6bd8d50 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:40:23.109 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.109 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.109 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.110 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:23.110 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): authenticate will time out at 2476.075020s 2024-09-12T00:40:23.110 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient(hunting): get_auth_request con 0x55acd6ba86a0 auth_method 0 2024-09-12T00:40:23.110 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.110 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.110 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.110 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): get_auth_request con 0x55acd6bd3f00 auth_method 0 2024-09-12T00:40:23.110 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.110 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.110 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.110 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:23.110 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:23.110 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:23.111 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:23.111 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:23.111 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:23.111 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient(hunting): handle_auth_done global_id 7847 payload 824 2024-09-12T00:40:23.111 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient: _finish_hunting 0 2024-09-12T00:40:23.111 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:40:22.727+0000 7f722450a640 1 monclient: found mon.noname-c 2024-09-12T00:40:23.111 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.111 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.111 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:23.112 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: dump: 2024-09-12T00:40:23.112 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.112 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.112 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.112 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.112 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.112 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.112 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.112 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.112 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.112 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.112 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:40:23.112 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:40:23.113 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:23.113 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.113 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:23.113 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: dump: 2024-09-12T00:40:23.113 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.113 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.114 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.114 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.114 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.114 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.114 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.114 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.115 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.115 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.115 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 monclient: authenticate success, global_id 7847 2024-09-12T00:40:23.115 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 4 set_mon_vals no callback set 2024-09-12T00:40:23.115 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: _renew_subs 2024-09-12T00:40:23.115 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.115 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: _renew_subs 2024-09-12T00:40:23.115 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.115 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:40:22.727+0000 7f7226a049c0 1 librados: init done 2024-09-12T00:40:23.115 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:40:22.731+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command cr dump hook 0x55acd6bc7a78 2024-09-12T00:40:23.115 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:40:22.731+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.115 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:40:22.731+0000 7f70f9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:23.115 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:40:22.731+0000 7f70f9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:40:23.116 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:40:22.731+0000 7f70f9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:40:23.116 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:40:22.731+0000 7f7223d09640 10 monclient: get_auth_request con 0x7f70ec070b10 auth_method 0 2024-09-12T00:40:23.116 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:40:22.731+0000 7f7224d0b640 10 monclient: get_auth_request con 0x55acd6bf2a60 auth_method 0 2024-09-12T00:40:23.116 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:40:22.731+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.116 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:40:22.731+0000 7f7226a049c0 20 realm 2024-09-12T00:40:23.116 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:40:22.731+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.116 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.116 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:40:22.735+0000 7f7226a049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:23.116 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.116 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.116 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.116 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:40:22.735+0000 7f722450a640 10 monclient: get_auth_request con 0x55acd6bf6c50 auth_method 0 2024-09-12T00:40:23.117 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:23.117 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.117 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:40:22.735+0000 7f7223d09640 10 monclient: get_auth_request con 0x55acd6bfa4b0 auth_method 0 2024-09-12T00:40:23.117 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:23.117 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:40:22.735+0000 7f7226a049c0 20 searching for the correct realm 2024-09-12T00:40:23.117 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:40:22.735+0000 7f7224d0b640 10 monclient: get_auth_request con 0x55acd6bff250 auth_method 0 2024-09-12T00:40:23.117 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:40:22.739+0000 7f722450a640 10 monclient: get_auth_request con 0x7f721c064d50 auth_method 0 2024-09-12T00:40:23.117 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:40:22.739+0000 7f7223d09640 10 monclient: get_auth_request con 0x7f720c0ea060 auth_method 0 2024-09-12T00:40:23.117 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:40:22.743+0000 7f7224d0b640 0 -- 172.21.15.138:0/3251602216 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f721c0459d0 msgr2=0x7f721c049130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:23.117 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:40:22.947+0000 7f7224d0b640 10 monclient: get_auth_request con 0x7f721c0459d0 auth_method 0 2024-09-12T00:40:23.118 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:40:22.951+0000 7f722450a640 10 monclient: get_auth_request con 0x7f720c10b5f0 auth_method 0 2024-09-12T00:40:23.118 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:40:22.959+0000 7f7224d0b640 0 -- 172.21.15.138:0/3251602216 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55acd6bff250 msgr2=0x55acd6c01710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:23.118 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:40:22.959+0000 7f70f9ffb640 1 client.7847.objecter ms_handle_reset 0x55acd6bff250 session 0x55acd6bfebd0 osd.4 2024-09-12T00:40:23.118 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:40:22.959+0000 7f70f9ffb640 10 monclient: _renew_subs 2024-09-12T00:40:23.118 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:40:22.959+0000 7f70f9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.118 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:40:22.959+0000 7f7224d0b640 10 monclient: get_auth_request con 0x7f70ec080db0 auth_method 0 2024-09-12T00:40:23.118 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:23.118 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:23.118 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:23.118 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:23.118 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:23.119 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:23.119 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:40:22.967+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.119 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.119 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.119 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:23.119 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.119 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:23.119 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 zone default found 2024-09-12T00:40:23.119 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:40:22.971+0000 7f7226a049c0 4 Realm: () 2024-09-12T00:40:23.119 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:40:22.971+0000 7f7226a049c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:23.119 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:40:22.971+0000 7f7226a049c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:23.119 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:40:22.971+0000 7f7226a049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:23.119 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 zonegroup default 2024-09-12T00:40:23.120 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.120 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.120 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.120 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.120 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.120 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.120 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 started sync module instance, tier type = 2024-09-12T00:40:23.120 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:23.120 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=0 2024-09-12T00:40:23.120 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=1 2024-09-12T00:40:23.120 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=2 2024-09-12T00:40:23.120 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=3 2024-09-12T00:40:23.120 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=4 2024-09-12T00:40:23.121 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=5 2024-09-12T00:40:23.121 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=6 2024-09-12T00:40:23.121 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:40:22.999+0000 7f7226a049c0 20 add_watcher() i=7 2024-09-12T00:40:23.121 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:40:22.999+0000 7f7226a049c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:23.121 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding auth protocol: cephx 2024-09-12T00:40:23.121 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding auth protocol: cephx 2024-09-12T00:40:23.121 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding auth protocol: cephx 2024-09-12T00:40:23.121 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: secure 2024-09-12T00:40:23.121 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: crc 2024-09-12T00:40:23.121 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: secure 2024-09-12T00:40:23.121 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: crc 2024-09-12T00:40:23.121 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: secure 2024-09-12T00:40:23.121 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: crc 2024-09-12T00:40:23.121 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: crc 2024-09-12T00:40:23.122 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: secure 2024-09-12T00:40:23.122 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:40:23.003+0000 7f70db7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:23.122 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: crc 2024-09-12T00:40:23.122 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: secure 2024-09-12T00:40:23.122 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: crc 2024-09-12T00:40:23.122 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: secure 2024-09-12T00:40:23.122 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:40:23.003+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.122 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:40:23.003+0000 7f7226a049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:23.122 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:40:23.003+0000 7f7226a049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:23.122 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command cache list hook 0x55acd6bc8d50 2024-09-12T00:40:23.122 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command cache inspect hook 0x55acd6bc8d50 2024-09-12T00:40:23.122 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command cache erase hook 0x55acd6bc8d50 2024-09-12T00:40:23.122 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command cache zap hook 0x55acd6bc8d50 2024-09-12T00:40:23.122 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 note: GC not initialized 2024-09-12T00:40:23.122 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:40:23.003+0000 7f70da7dc640 20 reqs_thread_entry: start 2024-09-12T00:40:23.123 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command sync trace show hook 0x7f720c0ab430 2024-09-12T00:40:23.123 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command sync trace history hook 0x7f720c0ab430 2024-09-12T00:40:23.123 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command sync trace active hook 0x7f720c0ab430 2024-09-12T00:40:23.123 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command sync trace active_short hook 0x7f720c0ab430 2024-09-12T00:40:23.123 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:40:23.003+0000 7f7226a049c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:23.123 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:40:23.003+0000 7f7226a049c0 20 Filter name: none 2024-09-12T00:40:23.123 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:40:23.003+0000 7f70d37fe640 20 reqs_thread_entry: start 2024-09-12T00:40:23.123 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:40:23.003+0000 7f7226a049c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:40:23.123 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:40:23.003+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.123 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:40:23.007+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:40:23.123 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:40:23.123 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:40:23.123 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:40:23.123 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:40:23.007+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.124 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:40:23.007+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:40:23.124 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:23.124 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:23.124 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:23.124 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:23.124 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:40:23.124 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:40:23.124 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:40:23.027+0000 7f7226a049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:23.124 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:40:23.027+0000 7f7226a049c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:23.124 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:40:23.027+0000 7f7226a049c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:23.124 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:40:23.027+0000 7f7226a049c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:40:23.124 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:40:23.027+0000 7f70faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333575 cookie 94200825655648 notifier 7847 bl.length()=827 2024-09-12T00:40:23.124 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:40:23.027+0000 7f70faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:23.125 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:40:23.027+0000 7f70faffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:23.125 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:40:23.027+0000 7f70faffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:23.125 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:40:23.027+0000 7f7226a049c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:40:23.125 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:40:23.027+0000 7f7226a049c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:40:23.125 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:40:23.027+0000 7f7226a049c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:40:23.125 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:40:23.027+0000 7f7226a049c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:40:23.125 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:40:23.043+0000 7f7226a049c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7226a049c0 time 2024-09-12T00:40:23.045423+0000 2024-09-12T00:40:23.125 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:23.125 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.125 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:23.125 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f722a2de2eb] 2024-09-12T00:40:23.125 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f722a2de49f] 2024-09-12T00:40:23.126 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acd4370cc1] 2024-09-12T00:40:23.126 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55acd4385d5a] 2024-09-12T00:40:23.126 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-12T00:40:23.126 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7229144d90] 2024-09-12T00:40:23.126 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-12T00:40:23.126 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-12T00:40:23.126 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.126 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:40:23.047+0000 7f7226a049c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:23.126 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f7226a049c0 thread_name:radosgw-admin 2024-09-12T00:40:23.126 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.126 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:23.126 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f722915d520] 2024-09-12T00:40:23.126 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:40:23.127 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:40:23.127 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:40:23.127 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f722a2de345] 2024-09-12T00:40:23.127 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f722a2de49f] 2024-09-12T00:40:23.127 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acd4370cc1] 2024-09-12T00:40:23.127 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55acd4385d5a] 2024-09-12T00:40:23.127 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-12T00:40:23.127 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7229144d90] 2024-09-12T00:40:23.127 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-12T00:40:23.127 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-12T00:40:23.127 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:23.127 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.127 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:40:23.127 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:40:23.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:40:23.128 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:40:23.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:40:23.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:40:23.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:40:23.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:40:23.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:40:23.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:40:23.128 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:40:23.128 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:40:23.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:40:23.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:40:23.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:40:23.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:40:23.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:40:23.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:40:23.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:40:23.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:40:23.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:40:23.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:40:23.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:40:23.129 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:40:23.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:40:23.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:40:23.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:40:23.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:40:23.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:40:23.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:40:23.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:40:23.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:40:23.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:40:23.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:40:23.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:40:23.130 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:40:23.130 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:40:23.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:40:23.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:40:23.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:40:23.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:40:23.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:40:23.131 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:40:23.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:40:23.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:40:23.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:40:23.131 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:40:23.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:40:23.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:40:23.132 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:40:23.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:40:23.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:40:23.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:40:23.132 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:40:23.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:40:23.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:40:23.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:40:23.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:40:23.132 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:40:23.133 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:40:23.133 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:40:23.133 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:40:23.133 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:40:23.133 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:40:23.133 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:40:23.133 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:40:23.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:40:23.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:40:23.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:40:23.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:40:23.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:40:23.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:40:23.133 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:40:23.134 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:40:23.134 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:40:23.134 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:40:23.134 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:40:23.134 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:40:23.134 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:40:23.134 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:40:23.134 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:40:23.134 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:40:23.134 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:40:23.134 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:40:23.134 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:40:23.134 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:40:23.134 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:40:23.134 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:40:23.135 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:40:23.135 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:40:23.135 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:40:23.135 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:40:23.135 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:40:23.135 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:40:23.135 INFO:tasks.workunit.client.0.smithi138.stderr: 7f70d37fe640 / http_manager 2024-09-12T00:40:23.135 INFO:tasks.workunit.client.0.smithi138.stderr: 7f70da7dc640 / http_manager 2024-09-12T00:40:23.135 INFO:tasks.workunit.client.0.smithi138.stderr: 7f70db7de640 / rgw_dt_lg_renew 2024-09-12T00:40:23.135 INFO:tasks.workunit.client.0.smithi138.stderr: 7f70f9ffb640 / ms_dispatch 2024-09-12T00:40:23.135 INFO:tasks.workunit.client.0.smithi138.stderr: 7f70faffd640 / io_context_pool 2024-09-12T00:40:23.136 INFO:tasks.workunit.client.0.smithi138.stderr: 7f70fb7fe640 / io_context_pool 2024-09-12T00:40:23.136 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7109ffb640 / ms_dispatch 2024-09-12T00:40:23.136 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7110e09640 / ms_dispatch 2024-09-12T00:40:23.136 INFO:tasks.workunit.client.0.smithi138.stderr: 7f711260c640 / io_context_pool 2024-09-12T00:40:23.136 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7223d09640 / msgr-worker-2 2024-09-12T00:40:23.136 INFO:tasks.workunit.client.0.smithi138.stderr: 7f722450a640 / msgr-worker-1 2024-09-12T00:40:23.136 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7224d0b640 / msgr-worker-0 2024-09-12T00:40:23.136 INFO:tasks.workunit.client.0.smithi138.stderr: 7f722550c640 / io_context_pool 2024-09-12T00:40:23.136 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7226a049c0 / radosgw-admin 2024-09-12T00:40:23.136 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:40:23.136 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:40:23.136 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/log/ceph/ceph-client.admin.146618.log 2024-09-12T00:40:23.136 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:40:23.136 INFO:tasks.workunit.client.0.smithi138.stderr:--- begin dump of recent events --- 2024-09-12T00:40:23.137 INFO:tasks.workunit.client.0.smithi138.stderr: -499> 2024-09-12T00:40:22.707+0000 7f7223d09640 10 monclient(hunting): handle_auth_done global_id 7835 payload 274 2024-09-12T00:40:23.137 INFO:tasks.workunit.client.0.smithi138.stderr: -498> 2024-09-12T00:40:22.707+0000 7f7223d09640 10 monclient: _finish_hunting 0 2024-09-12T00:40:23.137 INFO:tasks.workunit.client.0.smithi138.stderr: -497> 2024-09-12T00:40:22.707+0000 7f7223d09640 1 monclient: found mon.noname-c 2024-09-12T00:40:23.137 INFO:tasks.workunit.client.0.smithi138.stderr: -496> 2024-09-12T00:40:22.707+0000 7f7223d09640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.137 INFO:tasks.workunit.client.0.smithi138.stderr: -495> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.137 INFO:tasks.workunit.client.0.smithi138.stderr: -494> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:23.137 INFO:tasks.workunit.client.0.smithi138.stderr: -493> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: dump: 2024-09-12T00:40:23.137 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.137 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.137 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.137 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.137 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.137 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.138 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.138 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.138 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.138 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.138 INFO:tasks.workunit.client.0.smithi138.stderr: -492> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: _finish_auth 0 2024-09-12T00:40:23.138 INFO:tasks.workunit.client.0.smithi138.stderr: -491> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: _check_auth_tickets 2024-09-12T00:40:23.138 INFO:tasks.workunit.client.0.smithi138.stderr: -490> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:23.138 INFO:tasks.workunit.client.0.smithi138.stderr: -489> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.138 INFO:tasks.workunit.client.0.smithi138.stderr: -488> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:23.138 INFO:tasks.workunit.client.0.smithi138.stderr: -487> 2024-09-12T00:40:22.707+0000 7f711260c640 10 monclient: dump: 2024-09-12T00:40:23.138 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.138 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.139 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.139 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.139 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.139 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.139 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.139 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.139 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.139 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.139 INFO:tasks.workunit.client.0.smithi138.stderr: -486> 2024-09-12T00:40:22.707+0000 7f7226a049c0 5 monclient: authenticate success, global_id 7835 2024-09-12T00:40:23.139 INFO:tasks.workunit.client.0.smithi138.stderr: -485> 2024-09-12T00:40:22.707+0000 7f7226a049c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:23.139 INFO:tasks.workunit.client.0.smithi138.stderr: -484> 2024-09-12T00:40:22.707+0000 7f7226a049c0 4 set_mon_vals no callback set 2024-09-12T00:40:23.139 INFO:tasks.workunit.client.0.smithi138.stderr: -483> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: shutdown 2024-09-12T00:40:23.140 INFO:tasks.workunit.client.0.smithi138.stderr: -482> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) unregister_commands rotate-key 2024-09-12T00:40:23.140 INFO:tasks.workunit.client.0.smithi138.stderr: -481> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: build_initial_monmap 2024-09-12T00:40:23.140 INFO:tasks.workunit.client.0.smithi138.stderr: -480> 2024-09-12T00:40:22.711+0000 7f7226a049c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:23.140 INFO:tasks.workunit.client.0.smithi138.stderr: -479> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: monmap: 2024-09-12T00:40:23.140 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:40:23.140 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:23.140 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:40:23.140 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:40:23.140 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:23.140 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.140 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:40:23.140 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:40:23.140 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:40:23.141 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.141 INFO:tasks.workunit.client.0.smithi138.stderr: -478> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding auth protocol: cephx 2024-09-12T00:40:23.141 INFO:tasks.workunit.client.0.smithi138.stderr: -477> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding auth protocol: cephx 2024-09-12T00:40:23.141 INFO:tasks.workunit.client.0.smithi138.stderr: -476> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding auth protocol: cephx 2024-09-12T00:40:23.141 INFO:tasks.workunit.client.0.smithi138.stderr: -475> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: secure 2024-09-12T00:40:23.141 INFO:tasks.workunit.client.0.smithi138.stderr: -474> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: crc 2024-09-12T00:40:23.141 INFO:tasks.workunit.client.0.smithi138.stderr: -473> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: secure 2024-09-12T00:40:23.141 INFO:tasks.workunit.client.0.smithi138.stderr: -472> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: crc 2024-09-12T00:40:23.141 INFO:tasks.workunit.client.0.smithi138.stderr: -471> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: secure 2024-09-12T00:40:23.141 INFO:tasks.workunit.client.0.smithi138.stderr: -470> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: crc 2024-09-12T00:40:23.141 INFO:tasks.workunit.client.0.smithi138.stderr: -469> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: crc 2024-09-12T00:40:23.141 INFO:tasks.workunit.client.0.smithi138.stderr: -468> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: secure 2024-09-12T00:40:23.141 INFO:tasks.workunit.client.0.smithi138.stderr: -467> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: crc 2024-09-12T00:40:23.142 INFO:tasks.workunit.client.0.smithi138.stderr: -466> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: secure 2024-09-12T00:40:23.142 INFO:tasks.workunit.client.0.smithi138.stderr: -465> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: crc 2024-09-12T00:40:23.142 INFO:tasks.workunit.client.0.smithi138.stderr: -464> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b0b160) adding con mode: secure 2024-09-12T00:40:23.142 INFO:tasks.workunit.client.0.smithi138.stderr: -463> 2024-09-12T00:40:22.711+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.142 INFO:tasks.workunit.client.0.smithi138.stderr: -462> 2024-09-12T00:40:22.711+0000 7f7226a049c0 1 librados: starting msgr at 2024-09-12T00:40:23.142 INFO:tasks.workunit.client.0.smithi138.stderr: -461> 2024-09-12T00:40:22.711+0000 7f7226a049c0 1 librados: starting objecter 2024-09-12T00:40:23.142 INFO:tasks.workunit.client.0.smithi138.stderr: -460> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command objecter_requests hook 0x55acd6b0e0d0 2024-09-12T00:40:23.142 INFO:tasks.workunit.client.0.smithi138.stderr: -459> 2024-09-12T00:40:22.711+0000 7f7226a049c0 1 librados: setting wanted keys 2024-09-12T00:40:23.142 INFO:tasks.workunit.client.0.smithi138.stderr: -458> 2024-09-12T00:40:22.711+0000 7f7226a049c0 1 librados: calling monclient init 2024-09-12T00:40:23.142 INFO:tasks.workunit.client.0.smithi138.stderr: -457> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: init 2024-09-12T00:40:23.142 INFO:tasks.workunit.client.0.smithi138.stderr: -456> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding auth protocol: cephx 2024-09-12T00:40:23.142 INFO:tasks.workunit.client.0.smithi138.stderr: -455> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding auth protocol: cephx 2024-09-12T00:40:23.142 INFO:tasks.workunit.client.0.smithi138.stderr: -454> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding auth protocol: cephx 2024-09-12T00:40:23.143 INFO:tasks.workunit.client.0.smithi138.stderr: -453> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: secure 2024-09-12T00:40:23.143 INFO:tasks.workunit.client.0.smithi138.stderr: -452> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: crc 2024-09-12T00:40:23.143 INFO:tasks.workunit.client.0.smithi138.stderr: -451> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: secure 2024-09-12T00:40:23.143 INFO:tasks.workunit.client.0.smithi138.stderr: -450> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: crc 2024-09-12T00:40:23.143 INFO:tasks.workunit.client.0.smithi138.stderr: -449> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: secure 2024-09-12T00:40:23.143 INFO:tasks.workunit.client.0.smithi138.stderr: -448> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: crc 2024-09-12T00:40:23.143 INFO:tasks.workunit.client.0.smithi138.stderr: -447> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: crc 2024-09-12T00:40:23.143 INFO:tasks.workunit.client.0.smithi138.stderr: -446> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: secure 2024-09-12T00:40:23.143 INFO:tasks.workunit.client.0.smithi138.stderr: -445> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: crc 2024-09-12T00:40:23.143 INFO:tasks.workunit.client.0.smithi138.stderr: -444> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: secure 2024-09-12T00:40:23.143 INFO:tasks.workunit.client.0.smithi138.stderr: -443> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: crc 2024-09-12T00:40:23.143 INFO:tasks.workunit.client.0.smithi138.stderr: -442> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b09370) adding con mode: secure 2024-09-12T00:40:23.143 INFO:tasks.workunit.client.0.smithi138.stderr: -441> 2024-09-12T00:40:22.711+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.144 INFO:tasks.workunit.client.0.smithi138.stderr: -440> 2024-09-12T00:40:22.711+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.144 INFO:tasks.workunit.client.0.smithi138.stderr: -439> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command rotate-key hook 0x55acd6b094b8 2024-09-12T00:40:23.144 INFO:tasks.workunit.client.0.smithi138.stderr: -438> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:23.144 INFO:tasks.workunit.client.0.smithi138.stderr: -437> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:40:23.144 INFO:tasks.workunit.client.0.smithi138.stderr: -436> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-b con 0x55acd6996de0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:40:23.144 INFO:tasks.workunit.client.0.smithi138.stderr: -435> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-a con 0x55acd69c1730 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:40:23.144 INFO:tasks.workunit.client.0.smithi138.stderr: -434> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-c con 0x55acd6b32be0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:40:23.144 INFO:tasks.workunit.client.0.smithi138.stderr: -433> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.144 INFO:tasks.workunit.client.0.smithi138.stderr: -432> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.144 INFO:tasks.workunit.client.0.smithi138.stderr: -431> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.145 INFO:tasks.workunit.client.0.smithi138.stderr: -430> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:23.145 INFO:tasks.workunit.client.0.smithi138.stderr: -429> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient(hunting): authenticate will time out at 2476.058026s 2024-09-12T00:40:23.145 INFO:tasks.workunit.client.0.smithi138.stderr: -428> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient(hunting): get_auth_request con 0x55acd6b32be0 auth_method 0 2024-09-12T00:40:23.145 INFO:tasks.workunit.client.0.smithi138.stderr: -427> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.145 INFO:tasks.workunit.client.0.smithi138.stderr: -426> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.145 INFO:tasks.workunit.client.0.smithi138.stderr: -425> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.145 INFO:tasks.workunit.client.0.smithi138.stderr: -424> 2024-09-12T00:40:22.711+0000 7f7223d09640 10 monclient(hunting): get_auth_request con 0x55acd69c1730 auth_method 0 2024-09-12T00:40:23.145 INFO:tasks.workunit.client.0.smithi138.stderr: -423> 2024-09-12T00:40:22.711+0000 7f7223d09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.145 INFO:tasks.workunit.client.0.smithi138.stderr: -422> 2024-09-12T00:40:22.711+0000 7f7223d09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.145 INFO:tasks.workunit.client.0.smithi138.stderr: -421> 2024-09-12T00:40:22.711+0000 7f7223d09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.145 INFO:tasks.workunit.client.0.smithi138.stderr: -420> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:23.145 INFO:tasks.workunit.client.0.smithi138.stderr: -419> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:23.145 INFO:tasks.workunit.client.0.smithi138.stderr: -418> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:23.146 INFO:tasks.workunit.client.0.smithi138.stderr: -417> 2024-09-12T00:40:22.711+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:23.146 INFO:tasks.workunit.client.0.smithi138.stderr: -416> 2024-09-12T00:40:22.711+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:23.146 INFO:tasks.workunit.client.0.smithi138.stderr: -415> 2024-09-12T00:40:22.711+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:23.146 INFO:tasks.workunit.client.0.smithi138.stderr: -414> 2024-09-12T00:40:22.711+0000 7f722450a640 10 monclient(hunting): get_auth_request con 0x55acd6996de0 auth_method 0 2024-09-12T00:40:23.146 INFO:tasks.workunit.client.0.smithi138.stderr: -413> 2024-09-12T00:40:22.711+0000 7f722450a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.146 INFO:tasks.workunit.client.0.smithi138.stderr: -412> 2024-09-12T00:40:22.711+0000 7f722450a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.146 INFO:tasks.workunit.client.0.smithi138.stderr: -411> 2024-09-12T00:40:22.711+0000 7f722450a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.146 INFO:tasks.workunit.client.0.smithi138.stderr: -410> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient(hunting): handle_auth_done global_id 7838 payload 824 2024-09-12T00:40:23.146 INFO:tasks.workunit.client.0.smithi138.stderr: -409> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient: _finish_hunting 0 2024-09-12T00:40:23.146 INFO:tasks.workunit.client.0.smithi138.stderr: -408> 2024-09-12T00:40:22.711+0000 7f7224d0b640 1 monclient: found mon.noname-c 2024-09-12T00:40:23.146 INFO:tasks.workunit.client.0.smithi138.stderr: -407> 2024-09-12T00:40:22.711+0000 7f7224d0b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.146 INFO:tasks.workunit.client.0.smithi138.stderr: -406> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.147 INFO:tasks.workunit.client.0.smithi138.stderr: -405> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:23.147 INFO:tasks.workunit.client.0.smithi138.stderr: -404> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: dump: 2024-09-12T00:40:23.147 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.147 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.147 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.147 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.147 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.147 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.147 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.147 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.147 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.147 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.147 INFO:tasks.workunit.client.0.smithi138.stderr: -403> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: _finish_auth 0 2024-09-12T00:40:23.148 INFO:tasks.workunit.client.0.smithi138.stderr: -402> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: _check_auth_tickets 2024-09-12T00:40:23.148 INFO:tasks.workunit.client.0.smithi138.stderr: -401> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:23.148 INFO:tasks.workunit.client.0.smithi138.stderr: -400> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.148 INFO:tasks.workunit.client.0.smithi138.stderr: -399> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:23.148 INFO:tasks.workunit.client.0.smithi138.stderr: -398> 2024-09-12T00:40:22.711+0000 7f7110e09640 10 monclient: dump: 2024-09-12T00:40:23.148 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.148 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.148 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.148 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.148 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.148 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.148 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.149 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.149 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.149 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.149 INFO:tasks.workunit.client.0.smithi138.stderr: -397> 2024-09-12T00:40:22.711+0000 7f7226a049c0 5 monclient: authenticate success, global_id 7838 2024-09-12T00:40:23.149 INFO:tasks.workunit.client.0.smithi138.stderr: -396> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: _renew_subs 2024-09-12T00:40:23.149 INFO:tasks.workunit.client.0.smithi138.stderr: -395> 2024-09-12T00:40:22.711+0000 7f711260c640 4 set_mon_vals no callback set 2024-09-12T00:40:23.150 INFO:tasks.workunit.client.0.smithi138.stderr: -394> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.150 INFO:tasks.workunit.client.0.smithi138.stderr: -393> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: _renew_subs 2024-09-12T00:40:23.150 INFO:tasks.workunit.client.0.smithi138.stderr: -392> 2024-09-12T00:40:22.711+0000 7f7226a049c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.150 INFO:tasks.workunit.client.0.smithi138.stderr: -391> 2024-09-12T00:40:22.711+0000 7f7226a049c0 1 librados: init done 2024-09-12T00:40:23.150 INFO:tasks.workunit.client.0.smithi138.stderr: -390> 2024-09-12T00:40:22.715+0000 7f7110e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:23.150 INFO:tasks.workunit.client.0.smithi138.stderr: -389> 2024-09-12T00:40:22.715+0000 7f7110e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:40:23.151 INFO:tasks.workunit.client.0.smithi138.stderr: -388> 2024-09-12T00:40:22.715+0000 7f7110e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:40:23.151 INFO:tasks.workunit.client.0.smithi138.stderr: -387> 2024-09-12T00:40:22.715+0000 7f722450a640 10 monclient: get_auth_request con 0x7f710c070cb0 auth_method 0 2024-09-12T00:40:23.151 INFO:tasks.workunit.client.0.smithi138.stderr: -386> 2024-09-12T00:40:22.715+0000 7f7223d09640 10 monclient: get_auth_request con 0x55acd6b3a870 auth_method 0 2024-09-12T00:40:23.151 INFO:tasks.workunit.client.0.smithi138.stderr: -385> 2024-09-12T00:40:22.715+0000 7f722450a640 10 monclient: get_auth_request con 0x55acd6b54310 auth_method 0 2024-09-12T00:40:23.151 INFO:tasks.workunit.client.0.smithi138.stderr: -384> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient: get_auth_request con 0x55acd6b58550 auth_method 0 2024-09-12T00:40:23.151 INFO:tasks.workunit.client.0.smithi138.stderr: -383> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient: build_initial_monmap 2024-09-12T00:40:23.152 INFO:tasks.workunit.client.0.smithi138.stderr: -382> 2024-09-12T00:40:22.719+0000 7f7226a049c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:23.152 INFO:tasks.workunit.client.0.smithi138.stderr: -381> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient: monmap: 2024-09-12T00:40:23.152 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:40:23.152 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:23.152 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:40:23.152 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:40:23.153 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:23.153 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.153 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:40:23.153 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:40:23.153 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:40:23.153 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.154 INFO:tasks.workunit.client.0.smithi138.stderr: -380> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding auth protocol: cephx 2024-09-12T00:40:23.154 INFO:tasks.workunit.client.0.smithi138.stderr: -379> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding auth protocol: cephx 2024-09-12T00:40:23.154 INFO:tasks.workunit.client.0.smithi138.stderr: -378> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding auth protocol: cephx 2024-09-12T00:40:23.154 INFO:tasks.workunit.client.0.smithi138.stderr: -377> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: secure 2024-09-12T00:40:23.154 INFO:tasks.workunit.client.0.smithi138.stderr: -376> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: crc 2024-09-12T00:40:23.154 INFO:tasks.workunit.client.0.smithi138.stderr: -375> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: secure 2024-09-12T00:40:23.155 INFO:tasks.workunit.client.0.smithi138.stderr: -374> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: crc 2024-09-12T00:40:23.155 INFO:tasks.workunit.client.0.smithi138.stderr: -373> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: secure 2024-09-12T00:40:23.155 INFO:tasks.workunit.client.0.smithi138.stderr: -372> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: crc 2024-09-12T00:40:23.155 INFO:tasks.workunit.client.0.smithi138.stderr: -371> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: crc 2024-09-12T00:40:23.155 INFO:tasks.workunit.client.0.smithi138.stderr: -370> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: secure 2024-09-12T00:40:23.155 INFO:tasks.workunit.client.0.smithi138.stderr: -369> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: crc 2024-09-12T00:40:23.155 INFO:tasks.workunit.client.0.smithi138.stderr: -368> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: secure 2024-09-12T00:40:23.156 INFO:tasks.workunit.client.0.smithi138.stderr: -367> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: crc 2024-09-12T00:40:23.156 INFO:tasks.workunit.client.0.smithi138.stderr: -366> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5d3e0) adding con mode: secure 2024-09-12T00:40:23.156 INFO:tasks.workunit.client.0.smithi138.stderr: -365> 2024-09-12T00:40:22.719+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.156 INFO:tasks.workunit.client.0.smithi138.stderr: -364> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55acd6b60d50 EEXIST 2024-09-12T00:40:23.156 INFO:tasks.workunit.client.0.smithi138.stderr: -363> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient: init 2024-09-12T00:40:23.156 INFO:tasks.workunit.client.0.smithi138.stderr: -362> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding auth protocol: cephx 2024-09-12T00:40:23.157 INFO:tasks.workunit.client.0.smithi138.stderr: -361> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding auth protocol: cephx 2024-09-12T00:40:23.157 INFO:tasks.workunit.client.0.smithi138.stderr: -360> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding auth protocol: cephx 2024-09-12T00:40:23.157 INFO:tasks.workunit.client.0.smithi138.stderr: -359> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: secure 2024-09-12T00:40:23.157 INFO:tasks.workunit.client.0.smithi138.stderr: -358> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: crc 2024-09-12T00:40:23.157 INFO:tasks.workunit.client.0.smithi138.stderr: -357> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: secure 2024-09-12T00:40:23.157 INFO:tasks.workunit.client.0.smithi138.stderr: -356> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: crc 2024-09-12T00:40:23.158 INFO:tasks.workunit.client.0.smithi138.stderr: -355> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: secure 2024-09-12T00:40:23.158 INFO:tasks.workunit.client.0.smithi138.stderr: -354> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: crc 2024-09-12T00:40:23.158 INFO:tasks.workunit.client.0.smithi138.stderr: -353> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: crc 2024-09-12T00:40:23.158 INFO:tasks.workunit.client.0.smithi138.stderr: -352> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: secure 2024-09-12T00:40:23.158 INFO:tasks.workunit.client.0.smithi138.stderr: -351> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: crc 2024-09-12T00:40:23.158 INFO:tasks.workunit.client.0.smithi138.stderr: -350> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: secure 2024-09-12T00:40:23.158 INFO:tasks.workunit.client.0.smithi138.stderr: -349> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: crc 2024-09-12T00:40:23.158 INFO:tasks.workunit.client.0.smithi138.stderr: -348> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b5bab8) adding con mode: secure 2024-09-12T00:40:23.158 INFO:tasks.workunit.client.0.smithi138.stderr: -347> 2024-09-12T00:40:22.719+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.158 INFO:tasks.workunit.client.0.smithi138.stderr: -346> 2024-09-12T00:40:22.719+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.159 INFO:tasks.workunit.client.0.smithi138.stderr: -345> 2024-09-12T00:40:22.719+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command rotate-key cmddesc rotate-key hook 0x55acd6b5bc00 EEXIST 2024-09-12T00:40:23.159 INFO:tasks.workunit.client.0.smithi138.stderr: -344> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:23.159 INFO:tasks.workunit.client.0.smithi138.stderr: -343> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:40:23.159 INFO:tasks.workunit.client.0.smithi138.stderr: -342> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-c con 0x55acd6b84f00 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:40:23.159 INFO:tasks.workunit.client.0.smithi138.stderr: -341> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-a con 0x55acd6b84830 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:40:23.159 INFO:tasks.workunit.client.0.smithi138.stderr: -340> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-b con 0x55acd6b83210 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:40:23.159 INFO:tasks.workunit.client.0.smithi138.stderr: -339> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.159 INFO:tasks.workunit.client.0.smithi138.stderr: -338> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.159 INFO:tasks.workunit.client.0.smithi138.stderr: -337> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.159 INFO:tasks.workunit.client.0.smithi138.stderr: -336> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:23.160 INFO:tasks.workunit.client.0.smithi138.stderr: -335> 2024-09-12T00:40:22.719+0000 7f7226a049c0 10 monclient(hunting): authenticate will time out at 2476.067283s 2024-09-12T00:40:23.160 INFO:tasks.workunit.client.0.smithi138.stderr: -334> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient(hunting): get_auth_request con 0x55acd6b84830 auth_method 0 2024-09-12T00:40:23.160 INFO:tasks.workunit.client.0.smithi138.stderr: -333> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.160 INFO:tasks.workunit.client.0.smithi138.stderr: -332> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.160 INFO:tasks.workunit.client.0.smithi138.stderr: -331> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.160 INFO:tasks.workunit.client.0.smithi138.stderr: -330> 2024-09-12T00:40:22.719+0000 7f722450a640 10 monclient(hunting): get_auth_request con 0x55acd6b84f00 auth_method 0 2024-09-12T00:40:23.160 INFO:tasks.workunit.client.0.smithi138.stderr: -329> 2024-09-12T00:40:22.719+0000 7f722450a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.160 INFO:tasks.workunit.client.0.smithi138.stderr: -328> 2024-09-12T00:40:22.719+0000 7f722450a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.160 INFO:tasks.workunit.client.0.smithi138.stderr: -327> 2024-09-12T00:40:22.719+0000 7f722450a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.160 INFO:tasks.workunit.client.0.smithi138.stderr: -326> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:23.160 INFO:tasks.workunit.client.0.smithi138.stderr: -325> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:23.160 INFO:tasks.workunit.client.0.smithi138.stderr: -324> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:23.161 INFO:tasks.workunit.client.0.smithi138.stderr: -323> 2024-09-12T00:40:22.719+0000 7f722450a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:23.161 INFO:tasks.workunit.client.0.smithi138.stderr: -322> 2024-09-12T00:40:22.719+0000 7f722450a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:23.161 INFO:tasks.workunit.client.0.smithi138.stderr: -321> 2024-09-12T00:40:22.719+0000 7f722450a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:23.161 INFO:tasks.workunit.client.0.smithi138.stderr: -320> 2024-09-12T00:40:22.719+0000 7f7224d0b640 10 monclient(hunting): get_auth_request con 0x55acd6b83210 auth_method 0 2024-09-12T00:40:23.161 INFO:tasks.workunit.client.0.smithi138.stderr: -319> 2024-09-12T00:40:22.719+0000 7f7224d0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.161 INFO:tasks.workunit.client.0.smithi138.stderr: -318> 2024-09-12T00:40:22.719+0000 7f7224d0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.161 INFO:tasks.workunit.client.0.smithi138.stderr: -317> 2024-09-12T00:40:22.719+0000 7f7224d0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.161 INFO:tasks.workunit.client.0.smithi138.stderr: -316> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient(hunting): handle_auth_done global_id 8406 payload 824 2024-09-12T00:40:23.161 INFO:tasks.workunit.client.0.smithi138.stderr: -315> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient: _finish_hunting 0 2024-09-12T00:40:23.161 INFO:tasks.workunit.client.0.smithi138.stderr: -314> 2024-09-12T00:40:22.719+0000 7f7223d09640 1 monclient: found mon.noname-a 2024-09-12T00:40:23.161 INFO:tasks.workunit.client.0.smithi138.stderr: -313> 2024-09-12T00:40:22.719+0000 7f7223d09640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.138:3300/0 2024-09-12T00:40:23.161 INFO:tasks.workunit.client.0.smithi138.stderr: -312> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.161 INFO:tasks.workunit.client.0.smithi138.stderr: -311> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:40:23.162 INFO:tasks.workunit.client.0.smithi138.stderr: -310> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: dump: 2024-09-12T00:40:23.162 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.162 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.162 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.162 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.162 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.162 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.162 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.162 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.162 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.162 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.163 INFO:tasks.workunit.client.0.smithi138.stderr: -309> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: _finish_auth 0 2024-09-12T00:40:23.163 INFO:tasks.workunit.client.0.smithi138.stderr: -308> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:40:23.163 INFO:tasks.workunit.client.0.smithi138.stderr: -307> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:23.163 INFO:tasks.workunit.client.0.smithi138.stderr: -306> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.163 INFO:tasks.workunit.client.0.smithi138.stderr: -305> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:40:23.163 INFO:tasks.workunit.client.0.smithi138.stderr: -304> 2024-09-12T00:40:22.723+0000 7f7109ffb640 10 monclient: dump: 2024-09-12T00:40:23.163 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.163 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.163 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.163 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.163 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.163 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.163 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.164 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.164 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.164 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.164 INFO:tasks.workunit.client.0.smithi138.stderr: -303> 2024-09-12T00:40:22.723+0000 7f722550c640 4 set_mon_vals no callback set 2024-09-12T00:40:23.164 INFO:tasks.workunit.client.0.smithi138.stderr: -302> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 monclient: authenticate success, global_id 8406 2024-09-12T00:40:23.164 INFO:tasks.workunit.client.0.smithi138.stderr: -301> 2024-09-12T00:40:22.723+0000 7f7226a049c0 10 monclient: _renew_subs 2024-09-12T00:40:23.164 INFO:tasks.workunit.client.0.smithi138.stderr: -300> 2024-09-12T00:40:22.723+0000 7f7226a049c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:40:23.164 INFO:tasks.workunit.client.0.smithi138.stderr: -299> 2024-09-12T00:40:22.723+0000 7f7226a049c0 10 monclient: _renew_subs 2024-09-12T00:40:23.164 INFO:tasks.workunit.client.0.smithi138.stderr: -298> 2024-09-12T00:40:22.723+0000 7f7226a049c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.138:3300/0 2024-09-12T00:40:23.164 INFO:tasks.workunit.client.0.smithi138.stderr: -297> 2024-09-12T00:40:22.723+0000 7f7109ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:23.164 INFO:tasks.workunit.client.0.smithi138.stderr: -296> 2024-09-12T00:40:22.723+0000 7f7109ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:40:23.164 INFO:tasks.workunit.client.0.smithi138.stderr: -295> 2024-09-12T00:40:22.723+0000 7f7109ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:40:23.165 INFO:tasks.workunit.client.0.smithi138.stderr: -294> 2024-09-12T00:40:22.723+0000 7f7226a049c0 10 monclient: get_monmap_and_config 2024-09-12T00:40:23.165 INFO:tasks.workunit.client.0.smithi138.stderr: -293> 2024-09-12T00:40:22.723+0000 7f7226a049c0 10 monclient: build_initial_monmap 2024-09-12T00:40:23.165 INFO:tasks.workunit.client.0.smithi138.stderr: -292> 2024-09-12T00:40:22.723+0000 7f7226a049c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:23.165 INFO:tasks.workunit.client.0.smithi138.stderr: -291> 2024-09-12T00:40:22.723+0000 7f7226a049c0 10 monclient: monmap: 2024-09-12T00:40:23.165 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:40:23.165 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:23.165 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:40:23.165 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:40:23.165 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:23.165 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.165 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:40:23.165 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:40:23.166 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:40:23.166 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.166 INFO:tasks.workunit.client.0.smithi138.stderr: -290> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding auth protocol: cephx 2024-09-12T00:40:23.166 INFO:tasks.workunit.client.0.smithi138.stderr: -289> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding auth protocol: cephx 2024-09-12T00:40:23.166 INFO:tasks.workunit.client.0.smithi138.stderr: -288> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding auth protocol: cephx 2024-09-12T00:40:23.166 INFO:tasks.workunit.client.0.smithi138.stderr: -287> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: secure 2024-09-12T00:40:23.166 INFO:tasks.workunit.client.0.smithi138.stderr: -286> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: crc 2024-09-12T00:40:23.166 INFO:tasks.workunit.client.0.smithi138.stderr: -285> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: secure 2024-09-12T00:40:23.166 INFO:tasks.workunit.client.0.smithi138.stderr: -284> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: crc 2024-09-12T00:40:23.166 INFO:tasks.workunit.client.0.smithi138.stderr: -283> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: secure 2024-09-12T00:40:23.166 INFO:tasks.workunit.client.0.smithi138.stderr: -282> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: crc 2024-09-12T00:40:23.167 INFO:tasks.workunit.client.0.smithi138.stderr: -281> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: crc 2024-09-12T00:40:23.167 INFO:tasks.workunit.client.0.smithi138.stderr: -280> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: secure 2024-09-12T00:40:23.167 INFO:tasks.workunit.client.0.smithi138.stderr: -279> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: crc 2024-09-12T00:40:23.167 INFO:tasks.workunit.client.0.smithi138.stderr: -278> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: secure 2024-09-12T00:40:23.167 INFO:tasks.workunit.client.0.smithi138.stderr: -277> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: crc 2024-09-12T00:40:23.167 INFO:tasks.workunit.client.0.smithi138.stderr: -276> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x55acd6ba45e0) adding con mode: secure 2024-09-12T00:40:23.167 INFO:tasks.workunit.client.0.smithi138.stderr: -275> 2024-09-12T00:40:22.723+0000 7f722450a640 10 monclient: get_auth_request con 0x7f70fc070a20 auth_method 0 2024-09-12T00:40:23.167 INFO:tasks.workunit.client.0.smithi138.stderr: -274> 2024-09-12T00:40:22.723+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.167 INFO:tasks.workunit.client.0.smithi138.stderr: -273> 2024-09-12T00:40:22.723+0000 7f7226a049c0 10 monclient: init 2024-09-12T00:40:23.167 INFO:tasks.workunit.client.0.smithi138.stderr: -272> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding auth protocol: cephx 2024-09-12T00:40:23.167 INFO:tasks.workunit.client.0.smithi138.stderr: -271> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding auth protocol: cephx 2024-09-12T00:40:23.167 INFO:tasks.workunit.client.0.smithi138.stderr: -270> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding auth protocol: cephx 2024-09-12T00:40:23.167 INFO:tasks.workunit.client.0.smithi138.stderr: -269> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: secure 2024-09-12T00:40:23.168 INFO:tasks.workunit.client.0.smithi138.stderr: -268> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: crc 2024-09-12T00:40:23.168 INFO:tasks.workunit.client.0.smithi138.stderr: -267> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: secure 2024-09-12T00:40:23.168 INFO:tasks.workunit.client.0.smithi138.stderr: -266> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: crc 2024-09-12T00:40:23.168 INFO:tasks.workunit.client.0.smithi138.stderr: -265> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: secure 2024-09-12T00:40:23.168 INFO:tasks.workunit.client.0.smithi138.stderr: -264> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: crc 2024-09-12T00:40:23.168 INFO:tasks.workunit.client.0.smithi138.stderr: -263> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: crc 2024-09-12T00:40:23.168 INFO:tasks.workunit.client.0.smithi138.stderr: -262> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: secure 2024-09-12T00:40:23.168 INFO:tasks.workunit.client.0.smithi138.stderr: -261> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: crc 2024-09-12T00:40:23.168 INFO:tasks.workunit.client.0.smithi138.stderr: -260> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: secure 2024-09-12T00:40:23.168 INFO:tasks.workunit.client.0.smithi138.stderr: -259> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: crc 2024-09-12T00:40:23.168 INFO:tasks.workunit.client.0.smithi138.stderr: -258> 2024-09-12T00:40:22.723+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75670) adding con mode: secure 2024-09-12T00:40:23.168 INFO:tasks.workunit.client.0.smithi138.stderr: -257> 2024-09-12T00:40:22.727+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.169 INFO:tasks.workunit.client.0.smithi138.stderr: -256> 2024-09-12T00:40:22.727+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.169 INFO:tasks.workunit.client.0.smithi138.stderr: -255> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffe2ef757b8 EEXIST 2024-09-12T00:40:23.169 INFO:tasks.workunit.client.0.smithi138.stderr: -254> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:23.169 INFO:tasks.workunit.client.0.smithi138.stderr: -253> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:40:23.169 INFO:tasks.workunit.client.0.smithi138.stderr: -252> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-b con 0x55acd6ba86a0 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:40:23.169 INFO:tasks.workunit.client.0.smithi138.stderr: -251> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-a con 0x55acd6bd8d50 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:40:23.169 INFO:tasks.workunit.client.0.smithi138.stderr: -250> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-c con 0x55acd6bd3f00 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:40:23.169 INFO:tasks.workunit.client.0.smithi138.stderr: -249> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.170 INFO:tasks.workunit.client.0.smithi138.stderr: -248> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.170 INFO:tasks.workunit.client.0.smithi138.stderr: -247> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.170 INFO:tasks.workunit.client.0.smithi138.stderr: -246> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:23.170 INFO:tasks.workunit.client.0.smithi138.stderr: -245> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): authenticate will time out at 2476.072356s 2024-09-12T00:40:23.170 INFO:tasks.workunit.client.0.smithi138.stderr: -244> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient(hunting): get_auth_request con 0x55acd6bd3f00 auth_method 0 2024-09-12T00:40:23.170 INFO:tasks.workunit.client.0.smithi138.stderr: -243> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.170 INFO:tasks.workunit.client.0.smithi138.stderr: -242> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.170 INFO:tasks.workunit.client.0.smithi138.stderr: -241> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.170 INFO:tasks.workunit.client.0.smithi138.stderr: -240> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): get_auth_request con 0x55acd6bd8d50 auth_method 0 2024-09-12T00:40:23.170 INFO:tasks.workunit.client.0.smithi138.stderr: -239> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.171 INFO:tasks.workunit.client.0.smithi138.stderr: -238> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.171 INFO:tasks.workunit.client.0.smithi138.stderr: -237> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.171 INFO:tasks.workunit.client.0.smithi138.stderr: -236> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:23.171 INFO:tasks.workunit.client.0.smithi138.stderr: -235> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:23.171 INFO:tasks.workunit.client.0.smithi138.stderr: -234> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:23.171 INFO:tasks.workunit.client.0.smithi138.stderr: -233> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:23.171 INFO:tasks.workunit.client.0.smithi138.stderr: -232> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:23.171 INFO:tasks.workunit.client.0.smithi138.stderr: -231> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:23.171 INFO:tasks.workunit.client.0.smithi138.stderr: -230> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient(hunting): handle_auth_done global_id 7844 payload 274 2024-09-12T00:40:23.171 INFO:tasks.workunit.client.0.smithi138.stderr: -229> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient: _finish_hunting 0 2024-09-12T00:40:23.171 INFO:tasks.workunit.client.0.smithi138.stderr: -228> 2024-09-12T00:40:22.727+0000 7f7224d0b640 1 monclient: found mon.noname-c 2024-09-12T00:40:23.171 INFO:tasks.workunit.client.0.smithi138.stderr: -227> 2024-09-12T00:40:22.727+0000 7f7224d0b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.172 INFO:tasks.workunit.client.0.smithi138.stderr: -226> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.172 INFO:tasks.workunit.client.0.smithi138.stderr: -225> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:23.172 INFO:tasks.workunit.client.0.smithi138.stderr: -224> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: dump: 2024-09-12T00:40:23.172 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.172 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.172 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.173 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.173 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.173 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.173 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.173 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.173 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.173 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.173 INFO:tasks.workunit.client.0.smithi138.stderr: -223> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: _finish_auth 0 2024-09-12T00:40:23.173 INFO:tasks.workunit.client.0.smithi138.stderr: -222> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:40:23.173 INFO:tasks.workunit.client.0.smithi138.stderr: -221> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:23.173 INFO:tasks.workunit.client.0.smithi138.stderr: -220> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 monclient: authenticate success, global_id 7844 2024-09-12T00:40:23.173 INFO:tasks.workunit.client.0.smithi138.stderr: -219> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: get_monmap_and_config success 2024-09-12T00:40:23.174 INFO:tasks.workunit.client.0.smithi138.stderr: -218> 2024-09-12T00:40:22.727+0000 7f7226a049c0 4 set_mon_vals no callback set 2024-09-12T00:40:23.174 INFO:tasks.workunit.client.0.smithi138.stderr: -217> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.174 INFO:tasks.workunit.client.0.smithi138.stderr: -216> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:23.174 INFO:tasks.workunit.client.0.smithi138.stderr: -215> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 10 monclient: dump: 2024-09-12T00:40:23.174 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.174 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.174 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.174 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.174 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.174 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.174 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.174 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.174 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.174 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.175 INFO:tasks.workunit.client.0.smithi138.stderr: -214> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: shutdown 2024-09-12T00:40:23.175 INFO:tasks.workunit.client.0.smithi138.stderr: -213> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: build_initial_monmap 2024-09-12T00:40:23.175 INFO:tasks.workunit.client.0.smithi138.stderr: -212> 2024-09-12T00:40:22.727+0000 7f7226a049c0 1 build_initial for_mkfs: 0 2024-09-12T00:40:23.175 INFO:tasks.workunit.client.0.smithi138.stderr: -211> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: monmap: 2024-09-12T00:40:23.175 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 0 2024-09-12T00:40:23.175 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:40:23.175 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 0.000000 2024-09-12T00:40:23.175 INFO:tasks.workunit.client.0.smithi138.stderr:created 0.000000 2024-09-12T00:40:23.175 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 0 (unknown) 2024-09-12T00:40:23.175 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.175 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.noname-a 2024-09-12T00:40:23.175 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.noname-b 2024-09-12T00:40:23.175 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.noname-c 2024-09-12T00:40:23.176 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.176 INFO:tasks.workunit.client.0.smithi138.stderr: -210> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding auth protocol: cephx 2024-09-12T00:40:23.176 INFO:tasks.workunit.client.0.smithi138.stderr: -209> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding auth protocol: cephx 2024-09-12T00:40:23.176 INFO:tasks.workunit.client.0.smithi138.stderr: -208> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding auth protocol: cephx 2024-09-12T00:40:23.176 INFO:tasks.workunit.client.0.smithi138.stderr: -207> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: secure 2024-09-12T00:40:23.176 INFO:tasks.workunit.client.0.smithi138.stderr: -206> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: crc 2024-09-12T00:40:23.176 INFO:tasks.workunit.client.0.smithi138.stderr: -205> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: secure 2024-09-12T00:40:23.176 INFO:tasks.workunit.client.0.smithi138.stderr: -204> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: crc 2024-09-12T00:40:23.176 INFO:tasks.workunit.client.0.smithi138.stderr: -203> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: secure 2024-09-12T00:40:23.176 INFO:tasks.workunit.client.0.smithi138.stderr: -202> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: crc 2024-09-12T00:40:23.176 INFO:tasks.workunit.client.0.smithi138.stderr: -201> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: crc 2024-09-12T00:40:23.176 INFO:tasks.workunit.client.0.smithi138.stderr: -200> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: secure 2024-09-12T00:40:23.177 INFO:tasks.workunit.client.0.smithi138.stderr: -199> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: crc 2024-09-12T00:40:23.177 INFO:tasks.workunit.client.0.smithi138.stderr: -198> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: secure 2024-09-12T00:40:23.177 INFO:tasks.workunit.client.0.smithi138.stderr: -197> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: crc 2024-09-12T00:40:23.177 INFO:tasks.workunit.client.0.smithi138.stderr: -196> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6bcb060) adding con mode: secure 2024-09-12T00:40:23.177 INFO:tasks.workunit.client.0.smithi138.stderr: -195> 2024-09-12T00:40:22.727+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.177 INFO:tasks.workunit.client.0.smithi138.stderr: -194> 2024-09-12T00:40:22.727+0000 7f7226a049c0 1 librados: starting msgr at 2024-09-12T00:40:23.177 INFO:tasks.workunit.client.0.smithi138.stderr: -193> 2024-09-12T00:40:22.727+0000 7f7226a049c0 1 librados: starting objecter 2024-09-12T00:40:23.177 INFO:tasks.workunit.client.0.smithi138.stderr: -192> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55acd6b82e80 EEXIST 2024-09-12T00:40:23.177 INFO:tasks.workunit.client.0.smithi138.stderr: -191> 2024-09-12T00:40:22.727+0000 7f7226a049c0 1 librados: setting wanted keys 2024-09-12T00:40:23.177 INFO:tasks.workunit.client.0.smithi138.stderr: -190> 2024-09-12T00:40:22.727+0000 7f7226a049c0 1 librados: calling monclient init 2024-09-12T00:40:23.177 INFO:tasks.workunit.client.0.smithi138.stderr: -189> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: init 2024-09-12T00:40:23.177 INFO:tasks.workunit.client.0.smithi138.stderr: -188> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding auth protocol: cephx 2024-09-12T00:40:23.178 INFO:tasks.workunit.client.0.smithi138.stderr: -187> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding auth protocol: cephx 2024-09-12T00:40:23.178 INFO:tasks.workunit.client.0.smithi138.stderr: -186> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding auth protocol: cephx 2024-09-12T00:40:23.178 INFO:tasks.workunit.client.0.smithi138.stderr: -185> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: secure 2024-09-12T00:40:23.178 INFO:tasks.workunit.client.0.smithi138.stderr: -184> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: crc 2024-09-12T00:40:23.178 INFO:tasks.workunit.client.0.smithi138.stderr: -183> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: secure 2024-09-12T00:40:23.178 INFO:tasks.workunit.client.0.smithi138.stderr: -182> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: crc 2024-09-12T00:40:23.178 INFO:tasks.workunit.client.0.smithi138.stderr: -181> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: secure 2024-09-12T00:40:23.178 INFO:tasks.workunit.client.0.smithi138.stderr: -180> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: crc 2024-09-12T00:40:23.178 INFO:tasks.workunit.client.0.smithi138.stderr: -179> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: crc 2024-09-12T00:40:23.178 INFO:tasks.workunit.client.0.smithi138.stderr: -178> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: secure 2024-09-12T00:40:23.178 INFO:tasks.workunit.client.0.smithi138.stderr: -177> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: crc 2024-09-12T00:40:23.178 INFO:tasks.workunit.client.0.smithi138.stderr: -176> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: secure 2024-09-12T00:40:23.178 INFO:tasks.workunit.client.0.smithi138.stderr: -175> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: crc 2024-09-12T00:40:23.179 INFO:tasks.workunit.client.0.smithi138.stderr: -174> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 AuthRegistry(0x55acd6b86d20) adding con mode: secure 2024-09-12T00:40:23.179 INFO:tasks.workunit.client.0.smithi138.stderr: -173> 2024-09-12T00:40:22.727+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.179 INFO:tasks.workunit.client.0.smithi138.stderr: -172> 2024-09-12T00:40:22.727+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.179 INFO:tasks.workunit.client.0.smithi138.stderr: -171> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command rotate-key cmddesc rotate-key hook 0x55acd6b86e68 EEXIST 2024-09-12T00:40:23.179 INFO:tasks.workunit.client.0.smithi138.stderr: -170> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: _reopen_session rank -1 2024-09-12T00:40:23.179 INFO:tasks.workunit.client.0.smithi138.stderr: -169> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:40:23.179 INFO:tasks.workunit.client.0.smithi138.stderr: -168> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-c con 0x55acd6ba86a0 addr [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] 2024-09-12T00:40:23.179 INFO:tasks.workunit.client.0.smithi138.stderr: -167> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-a con 0x55acd6bd3f00 addr [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] 2024-09-12T00:40:23.179 INFO:tasks.workunit.client.0.smithi138.stderr: -166> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): picked mon.noname-b con 0x55acd6bd8d50 addr [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] 2024-09-12T00:40:23.179 INFO:tasks.workunit.client.0.smithi138.stderr: -165> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.179 INFO:tasks.workunit.client.0.smithi138.stderr: -164> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.180 INFO:tasks.workunit.client.0.smithi138.stderr: -163> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:40:23.180 INFO:tasks.workunit.client.0.smithi138.stderr: -162> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): _renew_subs 2024-09-12T00:40:23.180 INFO:tasks.workunit.client.0.smithi138.stderr: -161> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient(hunting): authenticate will time out at 2476.075020s 2024-09-12T00:40:23.180 INFO:tasks.workunit.client.0.smithi138.stderr: -160> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient(hunting): get_auth_request con 0x55acd6ba86a0 auth_method 0 2024-09-12T00:40:23.180 INFO:tasks.workunit.client.0.smithi138.stderr: -159> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.180 INFO:tasks.workunit.client.0.smithi138.stderr: -158> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.180 INFO:tasks.workunit.client.0.smithi138.stderr: -157> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.180 INFO:tasks.workunit.client.0.smithi138.stderr: -156> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): get_auth_request con 0x55acd6bd3f00 auth_method 0 2024-09-12T00:40:23.180 INFO:tasks.workunit.client.0.smithi138.stderr: -155> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:40:23.181 INFO:tasks.workunit.client.0.smithi138.stderr: -154> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:40:23.181 INFO:tasks.workunit.client.0.smithi138.stderr: -153> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:40:23.181 INFO:tasks.workunit.client.0.smithi138.stderr: -152> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:23.181 INFO:tasks.workunit.client.0.smithi138.stderr: -151> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:23.181 INFO:tasks.workunit.client.0.smithi138.stderr: -150> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:23.181 INFO:tasks.workunit.client.0.smithi138.stderr: -149> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:40:23.181 INFO:tasks.workunit.client.0.smithi138.stderr: -148> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:40:23.181 INFO:tasks.workunit.client.0.smithi138.stderr: -147> 2024-09-12T00:40:22.727+0000 7f7223d09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:40:23.181 INFO:tasks.workunit.client.0.smithi138.stderr: -146> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient(hunting): handle_auth_done global_id 7847 payload 824 2024-09-12T00:40:23.181 INFO:tasks.workunit.client.0.smithi138.stderr: -145> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient: _finish_hunting 0 2024-09-12T00:40:23.181 INFO:tasks.workunit.client.0.smithi138.stderr: -144> 2024-09-12T00:40:22.727+0000 7f722450a640 1 monclient: found mon.noname-c 2024-09-12T00:40:23.181 INFO:tasks.workunit.client.0.smithi138.stderr: -143> 2024-09-12T00:40:22.727+0000 7f722450a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.182 INFO:tasks.workunit.client.0.smithi138.stderr: -142> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.182 INFO:tasks.workunit.client.0.smithi138.stderr: -141> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:40:23.182 INFO:tasks.workunit.client.0.smithi138.stderr: -140> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: dump: 2024-09-12T00:40:23.182 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.182 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.182 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.182 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.182 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.182 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.182 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.182 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.182 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.182 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.182 INFO:tasks.workunit.client.0.smithi138.stderr: -139> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:40:23.183 INFO:tasks.workunit.client.0.smithi138.stderr: -138> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:40:23.183 INFO:tasks.workunit.client.0.smithi138.stderr: -137> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:40:23.183 INFO:tasks.workunit.client.0.smithi138.stderr: -136> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:40:23.183 INFO:tasks.workunit.client.0.smithi138.stderr: -135> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:40:23.183 INFO:tasks.workunit.client.0.smithi138.stderr: -134> 2024-09-12T00:40:22.727+0000 7f70f9ffb640 10 monclient: dump: 2024-09-12T00:40:23.183 INFO:tasks.workunit.client.0.smithi138.stderr:epoch 1 2024-09-12T00:40:23.183 INFO:tasks.workunit.client.0.smithi138.stderr:fsid 16f746b5-6307-4fbc-8384-d9f6a260b7cb 2024-09-12T00:40:23.183 INFO:tasks.workunit.client.0.smithi138.stderr:last_changed 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.183 INFO:tasks.workunit.client.0.smithi138.stderr:created 2024-09-12T00:14:41.850451+0000 2024-09-12T00:40:23.183 INFO:tasks.workunit.client.0.smithi138.stderr:min_mon_release 19 (squid) 2024-09-12T00:40:23.183 INFO:tasks.workunit.client.0.smithi138.stderr:election_strategy: 1 2024-09-12T00:40:23.183 INFO:tasks.workunit.client.0.smithi138.stderr:0: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.a 2024-09-12T00:40:23.183 INFO:tasks.workunit.client.0.smithi138.stderr:1: [v2:172.21.15.178:3300/0,v1:172.21.15.178:6789/0] mon.b 2024-09-12T00:40:23.183 INFO:tasks.workunit.client.0.smithi138.stderr:2: [v2:172.21.15.138:3301/0,v1:172.21.15.138:6790/0] mon.c 2024-09-12T00:40:23.184 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.184 INFO:tasks.workunit.client.0.smithi138.stderr: -133> 2024-09-12T00:40:22.727+0000 7f7226a049c0 5 monclient: authenticate success, global_id 7847 2024-09-12T00:40:23.184 INFO:tasks.workunit.client.0.smithi138.stderr: -132> 2024-09-12T00:40:22.727+0000 7f70fb7fe640 4 set_mon_vals no callback set 2024-09-12T00:40:23.184 INFO:tasks.workunit.client.0.smithi138.stderr: -131> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: _renew_subs 2024-09-12T00:40:23.184 INFO:tasks.workunit.client.0.smithi138.stderr: -130> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.184 INFO:tasks.workunit.client.0.smithi138.stderr: -129> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: _renew_subs 2024-09-12T00:40:23.184 INFO:tasks.workunit.client.0.smithi138.stderr: -128> 2024-09-12T00:40:22.727+0000 7f7226a049c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.184 INFO:tasks.workunit.client.0.smithi138.stderr: -127> 2024-09-12T00:40:22.727+0000 7f7226a049c0 1 librados: init done 2024-09-12T00:40:23.184 INFO:tasks.workunit.client.0.smithi138.stderr: -126> 2024-09-12T00:40:22.731+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command cr dump hook 0x55acd6bc7a78 2024-09-12T00:40:23.184 INFO:tasks.workunit.client.0.smithi138.stderr: -125> 2024-09-12T00:40:22.731+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.184 INFO:tasks.workunit.client.0.smithi138.stderr: -124> 2024-09-12T00:40:22.731+0000 7f70f9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:40:23.184 INFO:tasks.workunit.client.0.smithi138.stderr: -123> 2024-09-12T00:40:22.731+0000 7f70f9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:40:23.184 INFO:tasks.workunit.client.0.smithi138.stderr: -122> 2024-09-12T00:40:22.731+0000 7f70f9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.178:6832/7055904,v1:172.21.15.178:6833/7055904] 2024-09-12T00:40:23.184 INFO:tasks.workunit.client.0.smithi138.stderr: -121> 2024-09-12T00:40:22.731+0000 7f7223d09640 10 monclient: get_auth_request con 0x7f70ec070b10 auth_method 0 2024-09-12T00:40:23.185 INFO:tasks.workunit.client.0.smithi138.stderr: -120> 2024-09-12T00:40:22.731+0000 7f7224d0b640 10 monclient: get_auth_request con 0x55acd6bf2a60 auth_method 0 2024-09-12T00:40:23.185 INFO:tasks.workunit.client.0.smithi138.stderr: -119> 2024-09-12T00:40:22.731+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.185 INFO:tasks.workunit.client.0.smithi138.stderr: -118> 2024-09-12T00:40:22.731+0000 7f7226a049c0 20 realm 2024-09-12T00:40:23.185 INFO:tasks.workunit.client.0.smithi138.stderr: -117> 2024-09-12T00:40:22.731+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.185 INFO:tasks.workunit.client.0.smithi138.stderr: -116> 2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.185 INFO:tasks.workunit.client.0.smithi138.stderr: -115> 2024-09-12T00:40:22.735+0000 7f7226a049c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:23.185 INFO:tasks.workunit.client.0.smithi138.stderr: -114> 2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.185 INFO:tasks.workunit.client.0.smithi138.stderr: -113> 2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.185 INFO:tasks.workunit.client.0.smithi138.stderr: -112> 2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.185 INFO:tasks.workunit.client.0.smithi138.stderr: -111> 2024-09-12T00:40:22.735+0000 7f722450a640 10 monclient: get_auth_request con 0x55acd6bf6c50 auth_method 0 2024-09-12T00:40:23.185 INFO:tasks.workunit.client.0.smithi138.stderr: -110> 2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:23.185 INFO:tasks.workunit.client.0.smithi138.stderr: -109> 2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.185 INFO:tasks.workunit.client.0.smithi138.stderr: -108> 2024-09-12T00:40:22.735+0000 7f7223d09640 10 monclient: get_auth_request con 0x55acd6bfa4b0 auth_method 0 2024-09-12T00:40:23.186 INFO:tasks.workunit.client.0.smithi138.stderr: -107> 2024-09-12T00:40:22.735+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:23.186 INFO:tasks.workunit.client.0.smithi138.stderr: -106> 2024-09-12T00:40:22.735+0000 7f7226a049c0 20 searching for the correct realm 2024-09-12T00:40:23.186 INFO:tasks.workunit.client.0.smithi138.stderr: -105> 2024-09-12T00:40:22.735+0000 7f7224d0b640 10 monclient: get_auth_request con 0x55acd6bff250 auth_method 0 2024-09-12T00:40:23.186 INFO:tasks.workunit.client.0.smithi138.stderr: -104> 2024-09-12T00:40:22.739+0000 7f722450a640 10 monclient: get_auth_request con 0x7f721c064d50 auth_method 0 2024-09-12T00:40:23.186 INFO:tasks.workunit.client.0.smithi138.stderr: -103> 2024-09-12T00:40:22.739+0000 7f7223d09640 10 monclient: get_auth_request con 0x7f720c0ea060 auth_method 0 2024-09-12T00:40:23.186 INFO:tasks.workunit.client.0.smithi138.stderr: -102> 2024-09-12T00:40:22.743+0000 7f7224d0b640 0 -- 172.21.15.138:0/3251602216 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f721c0459d0 msgr2=0x7f721c049130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:23.186 INFO:tasks.workunit.client.0.smithi138.stderr: -101> 2024-09-12T00:40:22.947+0000 7f7224d0b640 10 monclient: get_auth_request con 0x7f721c0459d0 auth_method 0 2024-09-12T00:40:23.186 INFO:tasks.workunit.client.0.smithi138.stderr: -100> 2024-09-12T00:40:22.951+0000 7f722450a640 10 monclient: get_auth_request con 0x7f720c10b5f0 auth_method 0 2024-09-12T00:40:23.186 INFO:tasks.workunit.client.0.smithi138.stderr: -99> 2024-09-12T00:40:22.959+0000 7f7224d0b640 0 -- 172.21.15.138:0/3251602216 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55acd6bff250 msgr2=0x55acd6c01710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:23.186 INFO:tasks.workunit.client.0.smithi138.stderr: -98> 2024-09-12T00:40:22.959+0000 7f70f9ffb640 1 client.7847.objecter ms_handle_reset 0x55acd6bff250 session 0x55acd6bfebd0 osd.4 2024-09-12T00:40:23.186 INFO:tasks.workunit.client.0.smithi138.stderr: -97> 2024-09-12T00:40:22.959+0000 7f70f9ffb640 10 monclient: _renew_subs 2024-09-12T00:40:23.186 INFO:tasks.workunit.client.0.smithi138.stderr: -96> 2024-09-12T00:40:22.959+0000 7f70f9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.138:3301/0 2024-09-12T00:40:23.186 INFO:tasks.workunit.client.0.smithi138.stderr: -95> 2024-09-12T00:40:22.959+0000 7f7224d0b640 10 monclient: get_auth_request con 0x7f70ec080db0 auth_method 0 2024-09-12T00:40:23.186 INFO:tasks.workunit.client.0.smithi138.stderr: -94> 2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:23.187 INFO:tasks.workunit.client.0.smithi138.stderr: -93> 2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:23.187 INFO:tasks.workunit.client.0.smithi138.stderr: -92> 2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:23.187 INFO:tasks.workunit.client.0.smithi138.stderr: -91> 2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:23.187 INFO:tasks.workunit.client.0.smithi138.stderr: -90> 2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:23.187 INFO:tasks.workunit.client.0.smithi138.stderr: -89> 2024-09-12T00:40:22.967+0000 7f7226a049c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:23.187 INFO:tasks.workunit.client.0.smithi138.stderr: -88> 2024-09-12T00:40:22.967+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.187 INFO:tasks.workunit.client.0.smithi138.stderr: -87> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.187 INFO:tasks.workunit.client.0.smithi138.stderr: -86> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.187 INFO:tasks.workunit.client.0.smithi138.stderr: -85> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:23.187 INFO:tasks.workunit.client.0.smithi138.stderr: -84> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.187 INFO:tasks.workunit.client.0.smithi138.stderr: -83> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:23.187 INFO:tasks.workunit.client.0.smithi138.stderr: -82> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 zone default found 2024-09-12T00:40:23.187 INFO:tasks.workunit.client.0.smithi138.stderr: -81> 2024-09-12T00:40:22.971+0000 7f7226a049c0 4 Realm: () 2024-09-12T00:40:23.187 INFO:tasks.workunit.client.0.smithi138.stderr: -80> 2024-09-12T00:40:22.971+0000 7f7226a049c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:23.187 INFO:tasks.workunit.client.0.smithi138.stderr: -79> 2024-09-12T00:40:22.971+0000 7f7226a049c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:23.188 INFO:tasks.workunit.client.0.smithi138.stderr: -78> 2024-09-12T00:40:22.971+0000 7f7226a049c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:23.188 INFO:tasks.workunit.client.0.smithi138.stderr: -77> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 zonegroup default 2024-09-12T00:40:23.188 INFO:tasks.workunit.client.0.smithi138.stderr: -76> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.188 INFO:tasks.workunit.client.0.smithi138.stderr: -75> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.188 INFO:tasks.workunit.client.0.smithi138.stderr: -74> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.188 INFO:tasks.workunit.client.0.smithi138.stderr: -73> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.188 INFO:tasks.workunit.client.0.smithi138.stderr: -72> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.188 INFO:tasks.workunit.client.0.smithi138.stderr: -71> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.188 INFO:tasks.workunit.client.0.smithi138.stderr: -70> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 started sync module instance, tier type = 2024-09-12T00:40:23.188 INFO:tasks.workunit.client.0.smithi138.stderr: -69> 2024-09-12T00:40:22.971+0000 7f7226a049c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:23.188 INFO:tasks.workunit.client.0.smithi138.stderr: -68> 2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=0 2024-09-12T00:40:23.189 INFO:tasks.workunit.client.0.smithi138.stderr: -67> 2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=1 2024-09-12T00:40:23.189 INFO:tasks.workunit.client.0.smithi138.stderr: -66> 2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=2 2024-09-12T00:40:23.189 INFO:tasks.workunit.client.0.smithi138.stderr: -65> 2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=3 2024-09-12T00:40:23.189 INFO:tasks.workunit.client.0.smithi138.stderr: -64> 2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=4 2024-09-12T00:40:23.189 INFO:tasks.workunit.client.0.smithi138.stderr: -63> 2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=5 2024-09-12T00:40:23.189 INFO:tasks.workunit.client.0.smithi138.stderr: -62> 2024-09-12T00:40:22.995+0000 7f7226a049c0 20 add_watcher() i=6 2024-09-12T00:40:23.189 INFO:tasks.workunit.client.0.smithi138.stderr: -61> 2024-09-12T00:40:22.999+0000 7f7226a049c0 20 add_watcher() i=7 2024-09-12T00:40:23.189 INFO:tasks.workunit.client.0.smithi138.stderr: -60> 2024-09-12T00:40:22.999+0000 7f7226a049c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:23.189 INFO:tasks.workunit.client.0.smithi138.stderr: -59> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding auth protocol: cephx 2024-09-12T00:40:23.189 INFO:tasks.workunit.client.0.smithi138.stderr: -58> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding auth protocol: cephx 2024-09-12T00:40:23.189 INFO:tasks.workunit.client.0.smithi138.stderr: -57> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding auth protocol: cephx 2024-09-12T00:40:23.189 INFO:tasks.workunit.client.0.smithi138.stderr: -56> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: secure 2024-09-12T00:40:23.190 INFO:tasks.workunit.client.0.smithi138.stderr: -55> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: crc 2024-09-12T00:40:23.190 INFO:tasks.workunit.client.0.smithi138.stderr: -54> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: secure 2024-09-12T00:40:23.190 INFO:tasks.workunit.client.0.smithi138.stderr: -53> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: crc 2024-09-12T00:40:23.190 INFO:tasks.workunit.client.0.smithi138.stderr: -52> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: secure 2024-09-12T00:40:23.190 INFO:tasks.workunit.client.0.smithi138.stderr: -51> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: crc 2024-09-12T00:40:23.190 INFO:tasks.workunit.client.0.smithi138.stderr: -50> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: crc 2024-09-12T00:40:23.190 INFO:tasks.workunit.client.0.smithi138.stderr: -49> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: secure 2024-09-12T00:40:23.190 INFO:tasks.workunit.client.0.smithi138.stderr: -48> 2024-09-12T00:40:23.003+0000 7f70db7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:23.190 INFO:tasks.workunit.client.0.smithi138.stderr: -47> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: crc 2024-09-12T00:40:23.190 INFO:tasks.workunit.client.0.smithi138.stderr: -46> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: secure 2024-09-12T00:40:23.190 INFO:tasks.workunit.client.0.smithi138.stderr: -45> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: crc 2024-09-12T00:40:23.191 INFO:tasks.workunit.client.0.smithi138.stderr: -44> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 AuthRegistry(0x7ffe2ef75b50) adding con mode: secure 2024-09-12T00:40:23.191 INFO:tasks.workunit.client.0.smithi138.stderr: -43> 2024-09-12T00:40:23.003+0000 7f7226a049c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:40:23.191 INFO:tasks.workunit.client.0.smithi138.stderr: -42> 2024-09-12T00:40:23.003+0000 7f7226a049c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:23.191 INFO:tasks.workunit.client.0.smithi138.stderr: -41> 2024-09-12T00:40:23.003+0000 7f7226a049c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:23.191 INFO:tasks.workunit.client.0.smithi138.stderr: -40> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command cache list hook 0x55acd6bc8d50 2024-09-12T00:40:23.191 INFO:tasks.workunit.client.0.smithi138.stderr: -39> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command cache inspect hook 0x55acd6bc8d50 2024-09-12T00:40:23.191 INFO:tasks.workunit.client.0.smithi138.stderr: -38> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command cache erase hook 0x55acd6bc8d50 2024-09-12T00:40:23.191 INFO:tasks.workunit.client.0.smithi138.stderr: -37> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command cache zap hook 0x55acd6bc8d50 2024-09-12T00:40:23.191 INFO:tasks.workunit.client.0.smithi138.stderr: -36> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 note: GC not initialized 2024-09-12T00:40:23.192 INFO:tasks.workunit.client.0.smithi138.stderr: -35> 2024-09-12T00:40:23.003+0000 7f70da7dc640 20 reqs_thread_entry: start 2024-09-12T00:40:23.192 INFO:tasks.workunit.client.0.smithi138.stderr: -34> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command sync trace show hook 0x7f720c0ab430 2024-09-12T00:40:23.192 INFO:tasks.workunit.client.0.smithi138.stderr: -33> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command sync trace history hook 0x7f720c0ab430 2024-09-12T00:40:23.192 INFO:tasks.workunit.client.0.smithi138.stderr: -32> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command sync trace active hook 0x7f720c0ab430 2024-09-12T00:40:23.192 INFO:tasks.workunit.client.0.smithi138.stderr: -31> 2024-09-12T00:40:23.003+0000 7f7226a049c0 5 asok(0x55acd68fe2b0) register_command sync trace active_short hook 0x7f720c0ab430 2024-09-12T00:40:23.192 INFO:tasks.workunit.client.0.smithi138.stderr: -30> 2024-09-12T00:40:23.003+0000 7f7226a049c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:23.192 INFO:tasks.workunit.client.0.smithi138.stderr: -29> 2024-09-12T00:40:23.003+0000 7f7226a049c0 20 Filter name: none 2024-09-12T00:40:23.192 INFO:tasks.workunit.client.0.smithi138.stderr: -28> 2024-09-12T00:40:23.003+0000 7f70d37fe640 20 reqs_thread_entry: start 2024-09-12T00:40:23.192 INFO:tasks.workunit.client.0.smithi138.stderr: -27> 2024-09-12T00:40:23.003+0000 7f7226a049c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:40:23.193 INFO:tasks.workunit.client.0.smithi138.stderr: -26> 2024-09-12T00:40:23.003+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.193 INFO:tasks.workunit.client.0.smithi138.stderr: -25> 2024-09-12T00:40:23.007+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:40:23.193 INFO:tasks.workunit.client.0.smithi138.stderr: -24> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:40:23.193 INFO:tasks.workunit.client.0.smithi138.stderr: -23> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:40:23.193 INFO:tasks.workunit.client.0.smithi138.stderr: -22> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:40:23.193 INFO:tasks.workunit.client.0.smithi138.stderr: -21> 2024-09-12T00:40:23.007+0000 7f7226a049c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.193 INFO:tasks.workunit.client.0.smithi138.stderr: -20> 2024-09-12T00:40:23.007+0000 7f7226a049c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:40:23.194 INFO:tasks.workunit.client.0.smithi138.stderr: -19> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:23.194 INFO:tasks.workunit.client.0.smithi138.stderr: -18> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:23.194 INFO:tasks.workunit.client.0.smithi138.stderr: -17> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:23.194 INFO:tasks.workunit.client.0.smithi138.stderr: -16> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:23.194 INFO:tasks.workunit.client.0.smithi138.stderr: -15> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:40:23.194 INFO:tasks.workunit.client.0.smithi138.stderr: -14> 2024-09-12T00:40:23.007+0000 7f7226a049c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:40:23.194 INFO:tasks.workunit.client.0.smithi138.stderr: -13> 2024-09-12T00:40:23.027+0000 7f7226a049c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:23.194 INFO:tasks.workunit.client.0.smithi138.stderr: -12> 2024-09-12T00:40:23.027+0000 7f7226a049c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:23.194 INFO:tasks.workunit.client.0.smithi138.stderr: -11> 2024-09-12T00:40:23.027+0000 7f7226a049c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:23.194 INFO:tasks.workunit.client.0.smithi138.stderr: -10> 2024-09-12T00:40:23.027+0000 7f7226a049c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:40:23.194 INFO:tasks.workunit.client.0.smithi138.stderr: -9> 2024-09-12T00:40:23.027+0000 7f70faffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333575 cookie 94200825655648 notifier 7847 bl.length()=827 2024-09-12T00:40:23.194 INFO:tasks.workunit.client.0.smithi138.stderr: -8> 2024-09-12T00:40:23.027+0000 7f70faffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:23.194 INFO:tasks.workunit.client.0.smithi138.stderr: -7> 2024-09-12T00:40:23.027+0000 7f70faffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:23.195 INFO:tasks.workunit.client.0.smithi138.stderr: -6> 2024-09-12T00:40:23.027+0000 7f70faffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:23.195 INFO:tasks.workunit.client.0.smithi138.stderr: -5> 2024-09-12T00:40:23.027+0000 7f7226a049c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:40:23.195 INFO:tasks.workunit.client.0.smithi138.stderr: -4> 2024-09-12T00:40:23.027+0000 7f7226a049c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:40:23.195 INFO:tasks.workunit.client.0.smithi138.stderr: -3> 2024-09-12T00:40:23.027+0000 7f7226a049c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:40:23.195 INFO:tasks.workunit.client.0.smithi138.stderr: -2> 2024-09-12T00:40:23.027+0000 7f7226a049c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:40:23.195 INFO:tasks.workunit.client.0.smithi138.stderr: -1> 2024-09-12T00:40:23.043+0000 7f7226a049c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7226a049c0 time 2024-09-12T00:40:23.045423+0000 2024-09-12T00:40:23.195 INFO:tasks.workunit.client.0.smithi138.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:40:23.195 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.195 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:23.195 INFO:tasks.workunit.client.0.smithi138.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f722a2de2eb] 2024-09-12T00:40:23.196 INFO:tasks.workunit.client.0.smithi138.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f722a2de49f] 2024-09-12T00:40:23.196 INFO:tasks.workunit.client.0.smithi138.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acd4370cc1] 2024-09-12T00:40:23.196 INFO:tasks.workunit.client.0.smithi138.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55acd4385d5a] 2024-09-12T00:40:23.196 INFO:tasks.workunit.client.0.smithi138.stderr: 5: main() 2024-09-12T00:40:23.196 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7229144d90] 2024-09-12T00:40:23.196 INFO:tasks.workunit.client.0.smithi138.stderr: 7: __libc_start_main() 2024-09-12T00:40:23.196 INFO:tasks.workunit.client.0.smithi138.stderr: 8: _start() 2024-09-12T00:40:23.197 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.197 INFO:tasks.workunit.client.0.smithi138.stderr: 0> 2024-09-12T00:40:23.047+0000 7f7226a049c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:40:23.197 INFO:tasks.workunit.client.0.smithi138.stderr: in thread 7f7226a049c0 thread_name:radosgw-admin 2024-09-12T00:40:23.197 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.197 INFO:tasks.workunit.client.0.smithi138.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:40:23.197 INFO:tasks.workunit.client.0.smithi138.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f722915d520] 2024-09-12T00:40:23.197 INFO:tasks.workunit.client.0.smithi138.stderr: 2: pthread_kill() 2024-09-12T00:40:23.197 INFO:tasks.workunit.client.0.smithi138.stderr: 3: raise() 2024-09-12T00:40:23.197 INFO:tasks.workunit.client.0.smithi138.stderr: 4: abort() 2024-09-12T00:40:23.197 INFO:tasks.workunit.client.0.smithi138.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f722a2de345] 2024-09-12T00:40:23.198 INFO:tasks.workunit.client.0.smithi138.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f722a2de49f] 2024-09-12T00:40:23.198 INFO:tasks.workunit.client.0.smithi138.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55acd4370cc1] 2024-09-12T00:40:23.198 INFO:tasks.workunit.client.0.smithi138.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55acd4385d5a] 2024-09-12T00:40:23.198 INFO:tasks.workunit.client.0.smithi138.stderr: 9: main() 2024-09-12T00:40:23.198 INFO:tasks.workunit.client.0.smithi138.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7229144d90] 2024-09-12T00:40:23.198 INFO:tasks.workunit.client.0.smithi138.stderr: 11: __libc_start_main() 2024-09-12T00:40:23.198 INFO:tasks.workunit.client.0.smithi138.stderr: 12: _start() 2024-09-12T00:40:23.198 INFO:tasks.workunit.client.0.smithi138.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:40:23.198 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:23.198 INFO:tasks.workunit.client.0.smithi138.stderr:--- logging levels --- 2024-09-12T00:40:23.198 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 none 2024-09-12T00:40:23.198 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 lockdep 2024-09-12T00:40:23.198 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 context 2024-09-12T00:40:23.199 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 crush 2024-09-12T00:40:23.199 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds 2024-09-12T00:40:23.199 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_balancer 2024-09-12T00:40:23.199 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_locker 2024-09-12T00:40:23.199 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log 2024-09-12T00:40:23.199 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_log_expire 2024-09-12T00:40:23.199 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mds_migrator 2024-09-12T00:40:23.199 INFO:tasks.workunit.client.0.smithi138.stderr: 3/ 5 mds_quiesce 2024-09-12T00:40:23.199 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 buffer 2024-09-12T00:40:23.199 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 timer 2024-09-12T00:40:23.199 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 filer 2024-09-12T00:40:23.199 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 striper 2024-09-12T00:40:23.199 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 1 objecter 2024-09-12T00:40:23.199 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rados 2024-09-12T00:40:23.200 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd 2024-09-12T00:40:23.200 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_mirror 2024-09-12T00:40:23.200 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_replay 2024-09-12T00:40:23.200 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 rbd_pwl 2024-09-12T00:40:23.200 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 journaler 2024-09-12T00:40:23.200 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objectcacher 2024-09-12T00:40:23.200 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:40:23.200 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 client 2024-09-12T00:40:23.200 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 osd 2024-09-12T00:40:23.200 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 optracker 2024-09-12T00:40:23.200 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 objclass 2024-09-12T00:40:23.201 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 filestore 2024-09-12T00:40:23.201 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 journal 2024-09-12T00:40:23.201 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 ms 2024-09-12T00:40:23.201 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mon 2024-09-12T00:40:23.201 INFO:tasks.workunit.client.0.smithi138.stderr: 0/10 monc 2024-09-12T00:40:23.201 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 paxos 2024-09-12T00:40:23.201 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 tp 2024-09-12T00:40:23.201 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 auth 2024-09-12T00:40:23.201 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 crypto 2024-09-12T00:40:23.201 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 finisher 2024-09-12T00:40:23.202 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 reserver 2024-09-12T00:40:23.202 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 heartbeatmap 2024-09-12T00:40:23.202 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 perfcounter 2024-09-12T00:40:23.202 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw 2024-09-12T00:40:23.202 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_sync 2024-09-12T00:40:23.202 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_datacache 2024-09-12T00:40:23.202 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_access 2024-09-12T00:40:23.202 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:40:23.202 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_flight 2024-09-12T00:40:23.202 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:40:23.202 INFO:tasks.workunit.client.0.smithi138.stderr: 20/20 rgw_notification 2024-09-12T00:40:23.202 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 javaclient 2024-09-12T00:40:23.202 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 asok 2024-09-12T00:40:23.203 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 1 throttle 2024-09-12T00:40:23.203 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 0 refs 2024-09-12T00:40:23.203 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 compressor 2024-09-12T00:40:23.203 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluestore 2024-09-12T00:40:23.203 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 bluefs 2024-09-12T00:40:23.203 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 3 bdev 2024-09-12T00:40:23.203 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 kstore 2024-09-12T00:40:23.203 INFO:tasks.workunit.client.0.smithi138.stderr: 4/ 5 rocksdb 2024-09-12T00:40:23.203 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 fuse 2024-09-12T00:40:23.203 INFO:tasks.workunit.client.0.smithi138.stderr: 2/ 5 mgr 2024-09-12T00:40:23.203 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mgrc 2024-09-12T00:40:23.203 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 dpdk 2024-09-12T00:40:23.203 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 eventtrace 2024-09-12T00:40:23.203 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 prioritycache 2024-09-12T00:40:23.203 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 test 2024-09-12T00:40:23.204 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:40:23.204 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cephsqlite 2024-09-12T00:40:23.204 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:40:23.204 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore 2024-09-12T00:40:23.204 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_onode 2024-09-12T00:40:23.204 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_odata 2024-09-12T00:40:23.204 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_omap 2024-09-12T00:40:23.204 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_tm 2024-09-12T00:40:23.204 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_t 2024-09-12T00:40:23.204 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:40:23.204 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_epm 2024-09-12T00:40:23.204 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_lba 2024-09-12T00:40:23.204 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:40:23.204 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_cache 2024-09-12T00:40:23.205 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_journal 2024-09-12T00:40:23.205 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_device 2024-09-12T00:40:23.205 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 seastore_backref 2024-09-12T00:40:23.205 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 alienstore 2024-09-12T00:40:23.205 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 mclock 2024-09-12T00:40:23.205 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 cyanstore 2024-09-12T00:40:23.205 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 ceph_exporter 2024-09-12T00:40:23.205 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 memstore 2024-09-12T00:40:23.205 INFO:tasks.workunit.client.0.smithi138.stderr: 1/ 5 trace 2024-09-12T00:40:23.205 INFO:tasks.workunit.client.0.smithi138.stderr: 0/ 5 ceph_dedup 2024-09-12T00:40:23.205 INFO:tasks.workunit.client.0.smithi138.stderr: -2/-2 (syslog threshold) 2024-09-12T00:40:23.205 INFO:tasks.workunit.client.0.smithi138.stderr: 99/99 (stderr threshold) 2024-09-12T00:40:23.205 INFO:tasks.workunit.client.0.smithi138.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:40:23.205 INFO:tasks.workunit.client.0.smithi138.stderr: 7f70d37fe640 / http_manager 2024-09-12T00:40:23.206 INFO:tasks.workunit.client.0.smithi138.stderr: 7f70da7dc640 / http_manager 2024-09-12T00:40:23.206 INFO:tasks.workunit.client.0.smithi138.stderr: 7f70db7de640 / rgw_dt_lg_renew 2024-09-12T00:40:23.206 INFO:tasks.workunit.client.0.smithi138.stderr: 7f70f9ffb640 / ms_dispatch 2024-09-12T00:40:23.206 INFO:tasks.workunit.client.0.smithi138.stderr: 7f70faffd640 / io_context_pool 2024-09-12T00:40:23.206 INFO:tasks.workunit.client.0.smithi138.stderr: 7f70fb7fe640 / io_context_pool 2024-09-12T00:40:23.206 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7109ffb640 / ms_dispatch 2024-09-12T00:40:23.206 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7110e09640 / ms_dispatch 2024-09-12T00:40:23.206 INFO:tasks.workunit.client.0.smithi138.stderr: 7f711260c640 / io_context_pool 2024-09-12T00:40:23.206 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7223d09640 / msgr-worker-2 2024-09-12T00:40:23.206 INFO:tasks.workunit.client.0.smithi138.stderr: 7f722450a640 / msgr-worker-1 2024-09-12T00:40:23.206 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7224d0b640 / msgr-worker-0 2024-09-12T00:40:23.206 INFO:tasks.workunit.client.0.smithi138.stderr: 7f722550c640 / io_context_pool 2024-09-12T00:40:23.206 INFO:tasks.workunit.client.0.smithi138.stderr: 7f7226a049c0 / radosgw-admin 2024-09-12T00:40:23.206 INFO:tasks.workunit.client.0.smithi138.stderr: max_recent 500 2024-09-12T00:40:23.206 INFO:tasks.workunit.client.0.smithi138.stderr: max_new 1000 2024-09-12T00:40:23.207 INFO:tasks.workunit.client.0.smithi138.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:40:23.051146Z_e795cb64-c5df-4bf7-9dca-db4ce46aaa29/log 2024-09-12T00:40:23.207 INFO:tasks.workunit.client.0.smithi138.stderr:--- end dump of recent events --- 2024-09-12T00:40:23.208 INFO:tasks.workunit.client.0.smithi138.stderr:Aborted 2024-09-12T00:40:23.208 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:40:23.209 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:23.209 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:23.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.143+0000 7f915c1409c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.143+0000 7f915c1409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.143+0000 7f915c1409c0 20 realm 2024-09-12T00:40:23.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.143+0000 7f915c1409c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.147+0000 7f915c1409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.147+0000 7f915c1409c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:23.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.147+0000 7f915c1409c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.147+0000 7f915c1409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.147+0000 7f915c1409c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.209 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.147+0000 7f915c1409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:23.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.147+0000 7f915c1409c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.147+0000 7f915c1409c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:23.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.147+0000 7f915c1409c0 20 searching for the correct realm 2024-09-12T00:40:23.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.151+0000 7f915a447640 0 -- 172.21.15.138:0/3977560818 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f9154029420 msgr2=0x7f91540298a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:23.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.367+0000 7f915a447640 0 -- 172.21.15.138:0/3977560818 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55ad22232fc0 msgr2=0x55ad22235480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:23.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.375+0000 7f915c1409c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:23.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.375+0000 7f915c1409c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:23.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.375+0000 7f915c1409c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:23.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.375+0000 7f915c1409c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:23.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.375+0000 7f915c1409c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:23.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.375+0000 7f915c1409c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:23.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.379+0000 7f915c1409c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.379+0000 7f915c1409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.377 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.379+0000 7f915c1409c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.379+0000 7f915c1409c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:23.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.379+0000 7f915c1409c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.379+0000 7f915c1409c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:23.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.379+0000 7f915c1409c0 20 zone default found 2024-09-12T00:40:23.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.379+0000 7f915c1409c0 4 Realm: () 2024-09-12T00:40:23.378 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.379+0000 7f915c1409c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:23.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.379+0000 7f915c1409c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:23.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.379+0000 7f915c1409c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:23.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.379+0000 7f915c1409c0 20 zonegroup default 2024-09-12T00:40:23.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.379+0000 7f915c1409c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.379+0000 7f915c1409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.379 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.379+0000 7f915c1409c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.383+0000 7f915c1409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.383+0000 7f915c1409c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.383+0000 7f915c1409c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.383+0000 7f915c1409c0 20 started sync module instance, tier type = 2024-09-12T00:40:23.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.383+0000 7f915c1409c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:23.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.403+0000 7f915c1409c0 20 add_watcher() i=0 2024-09-12T00:40:23.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.403+0000 7f915c1409c0 20 add_watcher() i=1 2024-09-12T00:40:23.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.403+0000 7f915c1409c0 20 add_watcher() i=2 2024-09-12T00:40:23.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.403+0000 7f915c1409c0 20 add_watcher() i=3 2024-09-12T00:40:23.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.403+0000 7f915c1409c0 20 add_watcher() i=4 2024-09-12T00:40:23.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.403+0000 7f915c1409c0 20 add_watcher() i=5 2024-09-12T00:40:23.404 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.407+0000 7f915c1409c0 20 add_watcher() i=6 2024-09-12T00:40:23.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.407+0000 7f915c1409c0 20 add_watcher() i=7 2024-09-12T00:40:23.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.407+0000 7f915c1409c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:23.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.411+0000 7f900b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:23.411 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.411+0000 7f915c1409c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:23.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.411+0000 7f915c1409c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:23.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.411+0000 7f915c1409c0 5 note: GC not initialized 2024-09-12T00:40:23.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.415+0000 7f900a7fc640 20 reqs_thread_entry: start 2024-09-12T00:40:23.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.415+0000 7f915c1409c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:23.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.415+0000 7f915c1409c0 20 Filter name: none 2024-09-12T00:40:23.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.415+0000 7f8f7bfff640 20 reqs_thread_entry: start 2024-09-12T00:40:23.413 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.415+0000 7f915c1409c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.415+0000 7f915c1409c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:40:23.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.415+0000 7f915c1409c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.415+0000 7f915c1409c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:40:23.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.415+0000 7f915c1409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:23.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.415+0000 7f915c1409c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.415+0000 7f915c1409c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:40:23.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.415+0000 7f915c1409c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.419+0000 7f915c1409c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:40:23.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.419+0000 7f915c1409c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:23.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.423+0000 7f900b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:23.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.427+0000 7f915c1409c0 20 remove_watcher() i=0 2024-09-12T00:40:23.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.427+0000 7f915c1409c0 2 removed watcher, disabling cache 2024-09-12T00:40:23.426 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.427+0000 7f915c1409c0 20 remove_watcher() i=1 2024-09-12T00:40:23.428 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.431+0000 7f915c1409c0 20 remove_watcher() i=2 2024-09-12T00:40:23.430 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.431+0000 7f915c1409c0 20 remove_watcher() i=3 2024-09-12T00:40:23.432 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.435+0000 7f915c1409c0 20 remove_watcher() i=4 2024-09-12T00:40:23.435 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.435+0000 7f915c1409c0 20 remove_watcher() i=5 2024-09-12T00:40:23.437 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.439+0000 7f915c1409c0 20 remove_watcher() i=6 2024-09-12T00:40:23.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.439+0000 7f915c1409c0 20 remove_watcher() i=7 2024-09-12T00:40:23.456 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:23.456 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:40:23.469 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:40:23.496 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:23.496 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:23.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.539+0000 7f4de8dd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.543+0000 7f4de8dd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.543+0000 7f4de8dd39c0 20 realm 2024-09-12T00:40:23.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.543+0000 7f4de8dd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.543+0000 7f4de8dd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.543+0000 7f4de8dd39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:23.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.543+0000 7f4de8dd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.543+0000 7f4de8dd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.543+0000 7f4de8dd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.543+0000 7f4de8dd39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:23.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.543+0000 7f4de8dd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.547+0000 7f4de8dd39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:23.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.547+0000 7f4de8dd39c0 20 searching for the correct realm 2024-09-12T00:40:23.549 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.551+0000 7f4de70da640 0 -- 172.21.15.138:0/479441581 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5565ad4065b0 msgr2=0x5565ad408a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:23.556 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.559+0000 7f4de70da640 0 -- 172.21.15.138:0/479441581 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x5565ad3f9e40 msgr2=0x5565ad3fc2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:23.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.563+0000 7f4de8dd39c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:23.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.563+0000 7f4de8dd39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:23.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.563+0000 7f4de8dd39c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:23.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.563+0000 7f4de8dd39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:23.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.563+0000 7f4de8dd39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:23.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.563+0000 7f4de8dd39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:23.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.563+0000 7f4de8dd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.563+0000 7f4de8dd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.564 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:23.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.565 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 20 zone default found 2024-09-12T00:40:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 4 Realm: () 2024-09-12T00:40:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 20 zonegroup default 2024-09-12T00:40:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:23.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 20 started sync module instance, tier type = 2024-09-12T00:40:23.567 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.567+0000 7f4de8dd39c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:23.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.583+0000 7f4de8dd39c0 20 add_watcher() i=0 2024-09-12T00:40:23.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.583+0000 7f4de8dd39c0 20 add_watcher() i=1 2024-09-12T00:40:23.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.583+0000 7f4de8dd39c0 20 add_watcher() i=2 2024-09-12T00:40:23.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.583+0000 7f4de8dd39c0 20 add_watcher() i=3 2024-09-12T00:40:23.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.583+0000 7f4de8dd39c0 20 add_watcher() i=4 2024-09-12T00:40:23.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.583+0000 7f4de8dd39c0 20 add_watcher() i=5 2024-09-12T00:40:23.584 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.583+0000 7f4de8dd39c0 20 add_watcher() i=6 2024-09-12T00:40:23.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.587+0000 7f4de8dd39c0 20 add_watcher() i=7 2024-09-12T00:40:23.586 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.587+0000 7f4de8dd39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:23.589 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4c9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:23.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:23.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:23.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 5 note: GC not initialized 2024-09-12T00:40:23.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4c17fff640 20 reqs_thread_entry: start 2024-09-12T00:40:23.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:23.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 20 Filter name: none 2024-09-12T00:40:23.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4c15ffb640 20 reqs_thread_entry: start 2024-09-12T00:40:23.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:40:23.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.591 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:40:23.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:40:23.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:40:23.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:40:23.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:23.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:40:23.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:23.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:23.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:23.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:23.592 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:40:23.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:40:23.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:40:23.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:40:23.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:40:23.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:40:23.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.591+0000 7f4de8dd39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:40:23.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.595+0000 7f4de8dd39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:40:23.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.595+0000 7f4de8dd39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:40:23.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.595+0000 7f4de8dd39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:40:23.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.595+0000 7f4de8dd39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:40:23.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.595+0000 7f4de8dd39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:40:23.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.595+0000 7f4de8dd39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:40:23.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.595+0000 7f4de8dd39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:40:23.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.595+0000 7f4de8dd39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:40:23.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.595+0000 7f4de8dd39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:40:23.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.595+0000 7f4de8dd39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:40:23.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.599+0000 7f4de8dd39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:40:23.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.599+0000 7f4de8dd39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:40:23.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.599+0000 7f4de8dd39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:40:23.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.599+0000 7f4de8dd39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:40:23.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.599+0000 7f4de8dd39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:40:23.597 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.599+0000 7f4de8dd39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:40:23.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.599+0000 7f4de8dd39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:40:23.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.599+0000 7f4de8dd39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:40:23.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.599+0000 7f4de8dd39c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:40:23.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.599+0000 7f4de8dd39c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:40:23.600 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.603+0000 7f4c9d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:23.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.603+0000 7f4de8dd39c0 20 remove_watcher() i=0 2024-09-12T00:40:23.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.603+0000 7f4de8dd39c0 2 removed watcher, disabling cache 2024-09-12T00:40:23.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.607+0000 7f4de8dd39c0 20 remove_watcher() i=1 2024-09-12T00:40:23.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.607+0000 7f4de8dd39c0 20 remove_watcher() i=2 2024-09-12T00:40:23.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.611+0000 7f4de8dd39c0 20 remove_watcher() i=3 2024-09-12T00:40:23.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.611+0000 7f4de8dd39c0 20 remove_watcher() i=4 2024-09-12T00:40:23.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.615+0000 7f4de8dd39c0 20 remove_watcher() i=5 2024-09-12T00:40:23.615 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.615+0000 7f4de8dd39c0 20 remove_watcher() i=6 2024-09-12T00:40:23.618 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:23.619+0000 7f4de8dd39c0 20 remove_watcher() i=7 2024-09-12T00:40:53.663 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T00:40:53.695 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:53.695 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:53.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.746+0000 7f3c87bfd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.746+0000 7f3c87bfd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.746+0000 7f3c87bfd9c0 20 realm 2024-09-12T00:40:53.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.746+0000 7f3c87bfd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.746+0000 7f3c87bfd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.746+0000 7f3c87bfd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:53.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.746+0000 7f3c87bfd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.750+0000 7f3c87bfd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.750+0000 7f3c87bfd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.750+0000 7f3c87bfd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:53.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.750+0000 7f3c87bfd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.750+0000 7f3c87bfd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:53.746 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.750+0000 7f3c87bfd9c0 20 searching for the correct realm 2024-09-12T00:40:53.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.754+0000 7f3c85f04640 0 -- 172.21.15.138:0/1503702241 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f3c80101650 msgr2=0x7f3c8011d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:53.966 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.970+0000 7f3c85f04640 0 -- 172.21.15.138:0/1503702241 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x555af8ee0930 msgr2=0x555af8ee2df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:53.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.978+0000 7f3c87bfd9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:53.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.978+0000 7f3c87bfd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:53.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.978+0000 7f3c87bfd9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:53.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.978+0000 7f3c87bfd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:53.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.978+0000 7f3c87bfd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:53.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.978+0000 7f3c87bfd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:53.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.978+0000 7f3c87bfd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.978+0000 7f3c87bfd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.978+0000 7f3c87bfd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.982+0000 7f3c87bfd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:53.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.982+0000 7f3c87bfd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.977 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.982+0000 7f3c87bfd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:53.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.982+0000 7f3c87bfd9c0 20 zone default found 2024-09-12T00:40:53.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.982+0000 7f3c87bfd9c0 4 Realm: () 2024-09-12T00:40:53.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.982+0000 7f3c87bfd9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:53.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.982+0000 7f3c87bfd9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:53.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.982+0000 7f3c87bfd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:53.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.982+0000 7f3c87bfd9c0 20 zonegroup default 2024-09-12T00:40:53.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.982+0000 7f3c87bfd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.982+0000 7f3c87bfd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.982+0000 7f3c87bfd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.982+0000 7f3c87bfd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.979 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.982+0000 7f3c87bfd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:53.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.986+0000 7f3c87bfd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:53.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.986+0000 7f3c87bfd9c0 20 started sync module instance, tier type = 2024-09-12T00:40:53.980 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:53.986+0000 7f3c87bfd9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:54.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.006+0000 7f3c87bfd9c0 20 add_watcher() i=0 2024-09-12T00:40:54.003 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.006+0000 7f3c87bfd9c0 20 add_watcher() i=1 2024-09-12T00:40:54.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.006+0000 7f3c87bfd9c0 20 add_watcher() i=2 2024-09-12T00:40:54.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.006+0000 7f3c87bfd9c0 20 add_watcher() i=3 2024-09-12T00:40:54.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.006+0000 7f3c87bfd9c0 20 add_watcher() i=4 2024-09-12T00:40:54.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.006+0000 7f3c87bfd9c0 20 add_watcher() i=5 2024-09-12T00:40:54.004 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.006+0000 7f3c87bfd9c0 20 add_watcher() i=6 2024-09-12T00:40:54.005 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.010+0000 7f3c87bfd9c0 20 add_watcher() i=7 2024-09-12T00:40:54.006 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.010+0000 7f3c87bfd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:54.010 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.014+0000 7f3b3bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:54.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.014+0000 7f3c87bfd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:54.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.014+0000 7f3c87bfd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:54.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.014+0000 7f3c87bfd9c0 5 note: GC not initialized 2024-09-12T00:40:54.011 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.014+0000 7f3b3afe5640 20 reqs_thread_entry: start 2024-09-12T00:40:54.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.014+0000 7f3c87bfd9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:54.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.018+0000 7f3c87bfd9c0 20 Filter name: none 2024-09-12T00:40:54.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.018+0000 7f3b38fe1640 20 reqs_thread_entry: start 2024-09-12T00:40:54.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.018+0000 7f3c87bfd9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:40:54.012 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.018+0000 7f3c87bfd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.018+0000 7f3c87bfd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:40:54.013 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.018+0000 7f3c87bfd9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:40:54.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.018+0000 7f3c87bfd9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:40:54.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.018+0000 7f3c87bfd9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:40:54.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.018+0000 7f3c87bfd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.018+0000 7f3c87bfd9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:40:54.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.018+0000 7f3c87bfd9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:54.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.018+0000 7f3c87bfd9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:54.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.018+0000 7f3c87bfd9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:54.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.018+0000 7f3c87bfd9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:54.014 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.018+0000 7f3c87bfd9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:40:54.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.030+0000 7f3b3bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:54.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.034+0000 7f3c87bfd9c0 20 remove_watcher() i=0 2024-09-12T00:40:54.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.034+0000 7f3c87bfd9c0 2 removed watcher, disabling cache 2024-09-12T00:40:54.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.034+0000 7f3c87bfd9c0 20 remove_watcher() i=1 2024-09-12T00:40:54.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.038+0000 7f3c87bfd9c0 20 remove_watcher() i=2 2024-09-12T00:40:54.034 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.038+0000 7f3c87bfd9c0 20 remove_watcher() i=3 2024-09-12T00:40:54.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.042+0000 7f3c87bfd9c0 20 remove_watcher() i=4 2024-09-12T00:40:54.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.042+0000 7f3c87bfd9c0 20 remove_watcher() i=5 2024-09-12T00:40:54.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.046+0000 7f3c87bfd9c0 20 remove_watcher() i=6 2024-09-12T00:40:54.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.046+0000 7f3c87bfd9c0 20 remove_watcher() i=7 2024-09-12T00:40:54.057 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:40:54.088 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:54.088 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:54.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.134+0000 7f90ba8809c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.138+0000 7f90ba8809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.138+0000 7f90ba8809c0 20 realm 2024-09-12T00:40:54.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.138+0000 7f90ba8809c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.138+0000 7f90ba8809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.138+0000 7f90ba8809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:54.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.138+0000 7f90ba8809c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.138+0000 7f90ba8809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.138+0000 7f90ba8809c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.138+0000 7f90ba8809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:54.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.138+0000 7f90ba8809c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.138+0000 7f90ba8809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:54.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.138+0000 7f90ba8809c0 20 searching for the correct realm 2024-09-12T00:40:54.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.146+0000 7f90b8b87640 0 -- 172.21.15.138:0/595494835 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x562589dbe040 msgr2=0x562589dc0500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:54.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.150+0000 7f90b7b85640 0 -- 172.21.15.138:0/595494835 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x562589db9280 msgr2=0x562589dbb690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:54.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:54.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:54.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:54.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:54.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:54.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:54.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:54.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:54.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 20 zone default found 2024-09-12T00:40:54.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 4 Realm: () 2024-09-12T00:40:54.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:54.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:54.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:54.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 20 zonegroup default 2024-09-12T00:40:54.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.158+0000 7f90ba8809c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.162+0000 7f90ba8809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.162+0000 7f90ba8809c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.162+0000 7f90ba8809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.162+0000 7f90ba8809c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.162+0000 7f90ba8809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.162+0000 7f90ba8809c0 20 started sync module instance, tier type = 2024-09-12T00:40:54.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.162+0000 7f90ba8809c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:54.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.178+0000 7f90ba8809c0 20 add_watcher() i=0 2024-09-12T00:40:54.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.178+0000 7f90ba8809c0 20 add_watcher() i=1 2024-09-12T00:40:54.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.178+0000 7f90ba8809c0 20 add_watcher() i=2 2024-09-12T00:40:54.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.178+0000 7f90ba8809c0 20 add_watcher() i=3 2024-09-12T00:40:54.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.178+0000 7f90ba8809c0 20 add_watcher() i=4 2024-09-12T00:40:54.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.178+0000 7f90ba8809c0 20 add_watcher() i=5 2024-09-12T00:40:54.176 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.178+0000 7f90ba8809c0 20 add_watcher() i=6 2024-09-12T00:40:54.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.182+0000 7f90ba8809c0 20 add_watcher() i=7 2024-09-12T00:40:54.178 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.182+0000 7f90ba8809c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:54.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f8f6f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:54.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:54.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:54.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 5 note: GC not initialized 2024-09-12T00:40:54.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f8f6e7dc640 20 reqs_thread_entry: start 2024-09-12T00:40:54.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:54.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 20 Filter name: none 2024-09-12T00:40:54.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f8f677fe640 20 reqs_thread_entry: start 2024-09-12T00:40:54.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:40:54.182 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:40:54.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:40:54.184 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:40:54.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:40:54.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:40:54.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.186+0000 7f90ba8809c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:40:54.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.190+0000 7f90ba8809c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:40:54.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.190+0000 7f90ba8809c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:40:54.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.190+0000 7f90ba8809c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:40:54.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.190+0000 7f90ba8809c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:40:54.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.190+0000 7f90ba8809c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:40:54.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.190+0000 7f90ba8809c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:40:54.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.190+0000 7f90ba8809c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:40:54.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.190+0000 7f90ba8809c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:40:54.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.190+0000 7f90ba8809c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:40:54.187 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.190+0000 7f90ba8809c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:40:54.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.194+0000 7f90ba8809c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:40:54.188 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.194+0000 7f90ba8809c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:40:54.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.194+0000 7f90ba8809c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:40:54.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.194+0000 7f90ba8809c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:40:54.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.194+0000 7f90ba8809c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:40:54.189 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.194+0000 7f90ba8809c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:40:54.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.194+0000 7f90ba8809c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:40:54.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.194+0000 7f90ba8809c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:40:54.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.194+0000 7f90ba8809c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:40:54.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.194+0000 7f90ba8809c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:40:54.191 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.194+0000 7f8f6f7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:54.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.198+0000 7f90ba8809c0 20 remove_watcher() i=0 2024-09-12T00:40:54.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.198+0000 7f90ba8809c0 2 removed watcher, disabling cache 2024-09-12T00:40:54.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.202+0000 7f90ba8809c0 20 remove_watcher() i=1 2024-09-12T00:40:54.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.202+0000 7f90ba8809c0 20 remove_watcher() i=2 2024-09-12T00:40:54.201 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.206+0000 7f90ba8809c0 20 remove_watcher() i=3 2024-09-12T00:40:54.203 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.206+0000 7f90ba8809c0 20 remove_watcher() i=4 2024-09-12T00:40:54.205 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.210+0000 7f90ba8809c0 20 remove_watcher() i=5 2024-09-12T00:40:54.208 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.214+0000 7f90ba8809c0 20 remove_watcher() i=6 2024-09-12T00:40:54.210 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.214+0000 7f90ba8809c0 20 remove_watcher() i=7 2024-09-12T00:40:54.224 INFO:tasks.workunit.client.0.smithi138.stderr:check reshard logrecord successfully 2024-09-12T00:40:54.225 INFO:tasks.workunit.client.0.smithi138.stderr: test: reshard versioned bucket 2024-09-12T00:40:54.225 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:40:54.250 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:54.251 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:54.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.298+0000 7f9aa3e2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.298+0000 7f9aa3e2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.298+0000 7f9aa3e2b9c0 20 realm 2024-09-12T00:40:54.295 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.298+0000 7f9aa3e2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.302+0000 7f9aa3e2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.302+0000 7f9aa3e2b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:54.296 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.302+0000 7f9aa3e2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.302+0000 7f9aa3e2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.302+0000 7f9aa3e2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.302+0000 7f9aa3e2b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:54.297 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.302+0000 7f9aa3e2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.302+0000 7f9aa3e2b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:54.298 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.302+0000 7f9aa3e2b9c0 20 searching for the correct realm 2024-09-12T00:40:54.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.306+0000 7f9aa1130640 0 -- 172.21.15.138:0/3779816655 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f9a9c128040 msgr2=0x7f9a9c0c23b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:54.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.314+0000 7f9aa1130640 0 -- 172.21.15.138:0/3779816655 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x559569eb4790 msgr2=0x559569eb6b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:54.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:54.316 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:54.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:54.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:54.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:54.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:54.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.317 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:54.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:54.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 zone default found 2024-09-12T00:40:54.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 4 Realm: () 2024-09-12T00:40:54.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:54.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:54.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:54.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 zonegroup default 2024-09-12T00:40:54.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 started sync module instance, tier type = 2024-09-12T00:40:54.320 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.322+0000 7f9aa3e2b9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:54.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.342+0000 7f9aa3e2b9c0 20 add_watcher() i=0 2024-09-12T00:40:54.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.342+0000 7f9aa3e2b9c0 20 add_watcher() i=1 2024-09-12T00:40:54.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.342+0000 7f9aa3e2b9c0 20 add_watcher() i=2 2024-09-12T00:40:54.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.342+0000 7f9aa3e2b9c0 20 add_watcher() i=3 2024-09-12T00:40:54.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.342+0000 7f9aa3e2b9c0 20 add_watcher() i=4 2024-09-12T00:40:54.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.342+0000 7f9aa3e2b9c0 20 add_watcher() i=5 2024-09-12T00:40:54.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.342+0000 7f9aa3e2b9c0 20 add_watcher() i=6 2024-09-12T00:40:54.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.342+0000 7f9aa3e2b9c0 20 add_watcher() i=7 2024-09-12T00:40:54.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.342+0000 7f9aa3e2b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:54.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.346+0000 7f99537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:54.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.346+0000 7f9aa3e2b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:54.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.346+0000 7f9aa3e2b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:54.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.346+0000 7f9aa3e2b9c0 5 note: GC not initialized 2024-09-12T00:40:54.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.346+0000 7f99527fc640 20 reqs_thread_entry: start 2024-09-12T00:40:54.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.346+0000 7f9aa3e2b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:54.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.346+0000 7f9aa3e2b9c0 20 Filter name: none 2024-09-12T00:40:54.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.346+0000 7f98c3fff640 20 reqs_thread_entry: start 2024-09-12T00:40:54.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.346+0000 7f9aa3e2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.350+0000 7f9aa3e2b9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:40:54.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.350+0000 7f9aa3e2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.350+0000 7f9aa3e2b9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:40:54.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.350+0000 7f9aa3e2b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:54.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.350+0000 7f9aa3e2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.350+0000 7f9aa3e2b9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:40:54.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.350+0000 7f9aa3e2b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.354+0000 7f9aa3e2b9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:40:54.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.354+0000 7f9aa3e2b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:54.351 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.354+0000 7f99537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:54.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.358+0000 7f9aa3e2b9c0 20 remove_watcher() i=0 2024-09-12T00:40:54.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.358+0000 7f9aa3e2b9c0 2 removed watcher, disabling cache 2024-09-12T00:40:54.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.362+0000 7f9aa3e2b9c0 20 remove_watcher() i=1 2024-09-12T00:40:54.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.362+0000 7f9aa3e2b9c0 20 remove_watcher() i=2 2024-09-12T00:40:54.360 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.366+0000 7f9aa3e2b9c0 20 remove_watcher() i=3 2024-09-12T00:40:54.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.366+0000 7f9aa3e2b9c0 20 remove_watcher() i=4 2024-09-12T00:40:54.364 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.370+0000 7f9aa3e2b9c0 20 remove_watcher() i=5 2024-09-12T00:40:54.367 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.370+0000 7f9aa3e2b9c0 20 remove_watcher() i=6 2024-09-12T00:40:54.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.374+0000 7f9aa3e2b9c0 20 remove_watcher() i=7 2024-09-12T00:40:54.382 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:54.382 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:40:54.382 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: myver id: e2043445-c131-4520-984d-b4d52f038a6b.4538.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T00:40:54.383 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:54.383 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-12T00:40:54.411 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:54.412 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:54.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.458+0000 7fa4a33389c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.458+0000 7fa4a33389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.458+0000 7fa4a33389c0 20 realm 2024-09-12T00:40:54.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.458+0000 7fa4a33389c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.462+0000 7fa4a33389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.462+0000 7fa4a33389c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:54.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.462+0000 7fa4a33389c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.462+0000 7fa4a33389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.462+0000 7fa4a33389c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.462+0000 7fa4a33389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:54.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.462+0000 7fa4a33389c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.462+0000 7fa4a33389c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:54.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.462+0000 7fa4a33389c0 20 searching for the correct realm 2024-09-12T00:40:54.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.466+0000 7fa4a163f640 0 -- 172.21.15.138:0/3298684382 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fa498018920 msgr2=0x7fa498023390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:54.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.682+0000 7fa4a163f640 0 -- 172.21.15.138:0/3298684382 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x555e2e18c410 msgr2=0x555e2e18e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:54.687 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.690+0000 7fa4a33389c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:54.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.690+0000 7fa4a33389c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:54.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.690+0000 7fa4a33389c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:54.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.690+0000 7fa4a33389c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:54.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.690+0000 7fa4a33389c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:54.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.690+0000 7fa4a33389c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:54.688 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.690+0000 7fa4a33389c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.694+0000 7fa4a33389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.694+0000 7fa4a33389c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.694+0000 7fa4a33389c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:54.689 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.694+0000 7fa4a33389c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.694+0000 7fa4a33389c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:54.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.694+0000 7fa4a33389c0 20 zone default found 2024-09-12T00:40:54.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.694+0000 7fa4a33389c0 4 Realm: () 2024-09-12T00:40:54.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.694+0000 7fa4a33389c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:54.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.694+0000 7fa4a33389c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:54.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.694+0000 7fa4a33389c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:54.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.694+0000 7fa4a33389c0 20 zonegroup default 2024-09-12T00:40:54.690 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.694+0000 7fa4a33389c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.694+0000 7fa4a33389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.694+0000 7fa4a33389c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.691 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.694+0000 7fa4a33389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.694+0000 7fa4a33389c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.698+0000 7fa4a33389c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.698+0000 7fa4a33389c0 20 started sync module instance, tier type = 2024-09-12T00:40:54.692 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.698+0000 7fa4a33389c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:54.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.718+0000 7fa4a33389c0 20 add_watcher() i=0 2024-09-12T00:40:54.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.718+0000 7fa4a33389c0 20 add_watcher() i=1 2024-09-12T00:40:54.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.718+0000 7fa4a33389c0 20 add_watcher() i=2 2024-09-12T00:40:54.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.718+0000 7fa4a33389c0 20 add_watcher() i=3 2024-09-12T00:40:54.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.718+0000 7fa4a33389c0 20 add_watcher() i=4 2024-09-12T00:40:54.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.718+0000 7fa4a33389c0 20 add_watcher() i=5 2024-09-12T00:40:54.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.718+0000 7fa4a33389c0 20 add_watcher() i=6 2024-09-12T00:40:54.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.722+0000 7fa4a33389c0 20 add_watcher() i=7 2024-09-12T00:40:54.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.722+0000 7fa4a33389c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:54.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.726+0000 7fa356fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:54.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.726+0000 7fa4a33389c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:54.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.726+0000 7fa4a33389c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:54.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.726+0000 7fa4a33389c0 5 note: GC not initialized 2024-09-12T00:40:54.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.726+0000 7fa355fe3640 20 reqs_thread_entry: start 2024-09-12T00:40:54.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.726+0000 7fa4a33389c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:54.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.726+0000 7fa4a33389c0 20 Filter name: none 2024-09-12T00:40:54.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.726+0000 7fa2c77fe640 20 reqs_thread_entry: start 2024-09-12T00:40:54.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.726+0000 7fa4a33389c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:40:54.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.726+0000 7fa4a33389c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.726+0000 7fa4a33389c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:40:54.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.726+0000 7fa4a33389c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:40:54.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.726+0000 7fa4a33389c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:40:54.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.726+0000 7fa4a33389c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 : miss 2024-09-12T00:40:54.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.726+0000 7fa4a33389c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.730+0000 7fa4a33389c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:40:54.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.730+0000 7fa4a33389c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:40:54.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.730+0000 7fa4a33389c0 10 adding default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:40:54.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.730+0000 7fa4a33389c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:54.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.730+0000 7fa4a33389c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:54.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.730+0000 7fa4a33389c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 2024-09-12T00:40:54.736 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.742+0000 7fa4a33389c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:40:54.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.742+0000 7fa4a33389c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:40:54.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.742+0000 7fa4a33389c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:54.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.742+0000 7fa4a33389c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18, ofs0, ns] 2024-09-12T00:40:54.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.742+0000 7fa377fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333480 cookie 93862988678512 notifier 8529 bl.length()=821 2024-09-12T00:40:54.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.742+0000 7fa377fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:40:54.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.742+0000 7fa377fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:40:54.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.742+0000 7fa377fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:54.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.742+0000 7fa4a33389c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_sources= new_sources= 2024-09-12T00:40:54.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.742+0000 7fa4a33389c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential sources added=[] removed=[] 2024-09-12T00:40:54.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.742+0000 7fa4a33389c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_dests= new_dests= 2024-09-12T00:40:54.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.742+0000 7fa4a33389c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential dests added=[] removed=[] 2024-09-12T00:40:54.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.0 2024-09-12T00:40:54.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.0 2024-09-12T00:40:54.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.1 2024-09-12T00:40:54.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.1 2024-09-12T00:40:54.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.2 2024-09-12T00:40:54.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.2 2024-09-12T00:40:54.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.3 2024-09-12T00:40:54.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.3 2024-09-12T00:40:54.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.4 2024-09-12T00:40:54.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.4 2024-09-12T00:40:54.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.5 2024-09-12T00:40:54.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.5 2024-09-12T00:40:54.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.6 2024-09-12T00:40:54.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.6 2024-09-12T00:40:54.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.7 2024-09-12T00:40:54.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.7 2024-09-12T00:40:54.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.8 2024-09-12T00:40:54.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.8 2024-09-12T00:40:54.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.9 2024-09-12T00:40:54.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.9 2024-09-12T00:40:54.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.10 2024-09-12T00:40:54.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.10 2024-09-12T00:40:54.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.11 2024-09-12T00:40:54.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.11 2024-09-12T00:40:54.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.0 2024-09-12T00:40:54.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1 2024-09-12T00:40:54.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.754+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2 2024-09-12T00:40:54.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.758+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3 2024-09-12T00:40:54.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.758+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.4 2024-09-12T00:40:54.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.758+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.5 2024-09-12T00:40:54.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.758+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.6 2024-09-12T00:40:54.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.758+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.7 2024-09-12T00:40:54.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.762+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.8 2024-09-12T00:40:54.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.762+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.9 2024-09-12T00:40:54.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.762+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.10 2024-09-12T00:40:54.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.762+0000 7fa4a33389c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:54.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.762+0000 7fa4a33389c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 2024-09-12T00:40:54.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.766+0000 7fa4a33389c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:40:54.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.766+0000 7fa4a33389c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:40:54.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.766+0000 7fa4a33389c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:54.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.766+0000 7fa4a33389c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18, ofs0, ns] 2024-09-12T00:40:54.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.766+0000 7fa377fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333481 cookie 93862988678512 notifier 8529 bl.length()=821 2024-09-12T00:40:54.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.766+0000 7fa377fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:40:54.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.766+0000 7fa377fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:40:54.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.766+0000 7fa377fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:54.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.770+0000 7fa4a33389c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_sources= new_sources= 2024-09-12T00:40:54.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.770+0000 7fa4a33389c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential sources added=[] removed=[] 2024-09-12T00:40:54.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.770+0000 7fa4a33389c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_dests= new_dests= 2024-09-12T00:40:54.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.770+0000 7fa4a33389c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential dests added=[] removed=[] 2024-09-12T00:40:54.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.774+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.0 2024-09-12T00:40:54.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.774+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1 2024-09-12T00:40:54.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.774+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2 2024-09-12T00:40:54.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.778+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3 2024-09-12T00:40:54.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.778+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.4 2024-09-12T00:40:54.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.778+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.5 2024-09-12T00:40:54.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.778+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.6 2024-09-12T00:40:54.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.778+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.7 2024-09-12T00:40:54.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.778+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.8 2024-09-12T00:40:54.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.782+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.9 2024-09-12T00:40:54.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.782+0000 7fa4a33389c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.10 2024-09-12T00:40:54.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.782+0000 7fa4a33389c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:54.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.782+0000 7fa4a33389c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 2024-09-12T00:40:54.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.786+0000 7fa4a33389c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:40:54.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.786+0000 7fa4a33389c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:40:54.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.786+0000 7fa4a33389c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:54.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.786+0000 7fa4a33389c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18, ofs0, ns] 2024-09-12T00:40:54.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.786+0000 7fa377fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333482 cookie 93862988678512 notifier 8529 bl.length()=789 2024-09-12T00:40:54.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.786+0000 7fa377fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:40:54.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.786+0000 7fa377fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:40:54.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.786+0000 7fa377fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:54.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.786+0000 7fa4a33389c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_sources= new_sources= 2024-09-12T00:40:54.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.786+0000 7fa4a33389c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential sources added=[] removed=[] 2024-09-12T00:40:54.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.786+0000 7fa4a33389c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_dests= new_dests= 2024-09-12T00:40:54.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.786+0000 7fa4a33389c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential dests added=[] removed=[] 2024-09-12T00:40:54.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.794+0000 7fa4a33389c0 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-12T00:40:54.791 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.794+0000 7fa356fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:54.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.798+0000 7fa4a33389c0 20 remove_watcher() i=0 2024-09-12T00:40:54.796 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.798+0000 7fa4a33389c0 2 removed watcher, disabling cache 2024-09-12T00:40:54.798 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.802+0000 7fa4a33389c0 20 remove_watcher() i=1 2024-09-12T00:40:54.800 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.806+0000 7fa4a33389c0 20 remove_watcher() i=2 2024-09-12T00:40:54.802 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.806+0000 7fa4a33389c0 20 remove_watcher() i=3 2024-09-12T00:40:54.804 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.810+0000 7fa4a33389c0 20 remove_watcher() i=4 2024-09-12T00:40:54.806 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.810+0000 7fa4a33389c0 20 remove_watcher() i=5 2024-09-12T00:40:54.809 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.814+0000 7fa4a33389c0 20 remove_watcher() i=6 2024-09-12T00:40:54.812 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.818+0000 7fa4a33389c0 20 remove_watcher() i=7 2024-09-12T00:40:54.827 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:40:54.859 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:54.859 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:54.902 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.906+0000 7f8471eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.910+0000 7f8471eee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.910+0000 7f8471eee9c0 20 realm 2024-09-12T00:40:54.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.910+0000 7f8471eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.910+0000 7f8471eee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.910+0000 7f8471eee9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:54.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.910+0000 7f8471eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.910+0000 7f8471eee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.910+0000 7f8471eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.910+0000 7f8471eee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:54.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.910+0000 7f8471eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.910+0000 7f8471eee9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:54.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.910+0000 7f8471eee9c0 20 searching for the correct realm 2024-09-12T00:40:54.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.918+0000 7f84701f5640 0 -- 172.21.15.138:0/820870414 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55c5b698b7e0 msgr2=0x55c5b698dca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:54.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.922+0000 7f846f1f3640 0 -- 172.21.15.138:0/820870414 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55c5b6986a40 msgr2=0x55c5b6988e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:54.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:54.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:54.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:54.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:54.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:54.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:54.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.927 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:54.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:54.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 20 zone default found 2024-09-12T00:40:54.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 4 Realm: () 2024-09-12T00:40:54.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:54.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:54.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:54.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 20 zonegroup default 2024-09-12T00:40:54.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.930+0000 7f8471eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.934+0000 7f8471eee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.934+0000 7f8471eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.934+0000 7f8471eee9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:54.929 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.934+0000 7f8471eee9c0 20 started sync module instance, tier type = 2024-09-12T00:40:54.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.934+0000 7f8471eee9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:54.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.950+0000 7f8471eee9c0 20 add_watcher() i=0 2024-09-12T00:40:54.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.950+0000 7f8471eee9c0 20 add_watcher() i=1 2024-09-12T00:40:54.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.950+0000 7f8471eee9c0 20 add_watcher() i=2 2024-09-12T00:40:54.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.950+0000 7f8471eee9c0 20 add_watcher() i=3 2024-09-12T00:40:54.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.950+0000 7f8471eee9c0 20 add_watcher() i=4 2024-09-12T00:40:54.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.950+0000 7f8471eee9c0 20 add_watcher() i=5 2024-09-12T00:40:54.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.950+0000 7f8471eee9c0 20 add_watcher() i=6 2024-09-12T00:40:54.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.954+0000 7f8471eee9c0 20 add_watcher() i=7 2024-09-12T00:40:54.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.954+0000 7f8471eee9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:54.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.958+0000 7f83257ea640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:54.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.958+0000 7f8471eee9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:54.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.958+0000 7f8471eee9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:54.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.958+0000 7f8471eee9c0 5 note: GC not initialized 2024-09-12T00:40:54.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.958+0000 7f829ffff640 20 reqs_thread_entry: start 2024-09-12T00:40:54.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.958+0000 7f8471eee9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:54.953 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.958+0000 7f8471eee9c0 20 Filter name: none 2024-09-12T00:40:54.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.958+0000 7f829dffb640 20 reqs_thread_entry: start 2024-09-12T00:40:54.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.958+0000 7f8471eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.958+0000 7f8471eee9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:40:54.954 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.958+0000 7f8471eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.955 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.958+0000 7f8471eee9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:40:54.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.958+0000 7f8471eee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:54.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.958+0000 7f8471eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.962+0000 7f8471eee9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:40:54.956 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.962+0000 7f8471eee9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:54.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.962+0000 7f8471eee9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:40:54.957 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.962+0000 7f8471eee9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:54.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.966+0000 7f83257ea640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:54.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.966+0000 7f8471eee9c0 20 remove_watcher() i=0 2024-09-12T00:40:54.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.966+0000 7f8471eee9c0 2 removed watcher, disabling cache 2024-09-12T00:40:54.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.970+0000 7f8471eee9c0 20 remove_watcher() i=1 2024-09-12T00:40:54.967 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.970+0000 7f8471eee9c0 20 remove_watcher() i=2 2024-09-12T00:40:54.969 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.974+0000 7f8471eee9c0 20 remove_watcher() i=3 2024-09-12T00:40:54.971 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.974+0000 7f8471eee9c0 20 remove_watcher() i=4 2024-09-12T00:40:54.973 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.978+0000 7f8471eee9c0 20 remove_watcher() i=5 2024-09-12T00:40:54.975 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.978+0000 7f8471eee9c0 20 remove_watcher() i=6 2024-09-12T00:40:54.978 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:54.982+0000 7f8471eee9c0 20 remove_watcher() i=7 2024-09-12T00:40:54.991 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:54.992 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:40:54.992 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: myver id: e2043445-c131-4520-984d-b4d52f038a6b.4538.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:40:54.992 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:54.993 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:54.993 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:40:54.996 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:54.996 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:40:55.041 INFO:tasks.workunit.client.0.smithi138.stderr: test: reshard removes olh entries with empty name 2024-09-12T00:40:55.042 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:55.042 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:40:55.099 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:55.099 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:40:55.202 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:40:55.233 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:55.234 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:55.278 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.282+0000 7f927e3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.286+0000 7f927e3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.286+0000 7f927e3ff9c0 20 realm 2024-09-12T00:40:55.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.286+0000 7f927e3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.286+0000 7f927e3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.286+0000 7f927e3ff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:55.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.286+0000 7f927e3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.281 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.286+0000 7f927e3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.286+0000 7f927e3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.286+0000 7f927e3ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.282 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.286+0000 7f927e3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.286+0000 7f927e3ff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:55.283 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.286+0000 7f927e3ff9c0 20 searching for the correct realm 2024-09-12T00:40:55.288 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.294+0000 7f927c706640 0 -- 172.21.15.138:0/3832565509 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5646f49dde40 msgr2=0x5646f49e0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:55.293 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.298+0000 7f927b704640 0 -- 172.21.15.138:0/3832565509 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x5646f49d90e0 msgr2=0x5646f49db4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:55.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.306+0000 7f927e3ff9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:55.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.306+0000 7f927e3ff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:55.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.306+0000 7f927e3ff9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:55.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.306+0000 7f927e3ff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:55.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.306+0000 7f927e3ff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:55.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.306+0000 7f927e3ff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:55.303 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.306+0000 7f927e3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.306+0000 7f927e3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.304 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.306+0000 7f927e3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.306+0000 7f927e3ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.306+0000 7f927e3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.310+0000 7f927e3ff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:55.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.310+0000 7f927e3ff9c0 20 zone default found 2024-09-12T00:40:55.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.310+0000 7f927e3ff9c0 4 Realm: () 2024-09-12T00:40:55.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.310+0000 7f927e3ff9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:55.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.310+0000 7f927e3ff9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:55.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.310+0000 7f927e3ff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:55.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.310+0000 7f927e3ff9c0 20 zonegroup default 2024-09-12T00:40:55.305 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.310+0000 7f927e3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.310+0000 7f927e3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.310+0000 7f927e3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.310+0000 7f927e3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.310+0000 7f927e3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.310+0000 7f927e3ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.310+0000 7f927e3ff9c0 20 started sync module instance, tier type = 2024-09-12T00:40:55.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.310+0000 7f927e3ff9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:55.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.330+0000 7f927e3ff9c0 20 add_watcher() i=0 2024-09-12T00:40:55.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.330+0000 7f927e3ff9c0 20 add_watcher() i=1 2024-09-12T00:40:55.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.330+0000 7f927e3ff9c0 20 add_watcher() i=2 2024-09-12T00:40:55.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.330+0000 7f927e3ff9c0 20 add_watcher() i=3 2024-09-12T00:40:55.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.330+0000 7f927e3ff9c0 20 add_watcher() i=4 2024-09-12T00:40:55.324 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.330+0000 7f927e3ff9c0 20 add_watcher() i=5 2024-09-12T00:40:55.325 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.330+0000 7f927e3ff9c0 20 add_watcher() i=6 2024-09-12T00:40:55.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.330+0000 7f927e3ff9c0 20 add_watcher() i=7 2024-09-12T00:40:55.326 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.330+0000 7f927e3ff9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:55.330 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.334+0000 7f9131fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:55.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.334+0000 7f927e3ff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:55.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.334+0000 7f927e3ff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:55.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.334+0000 7f927e3ff9c0 5 note: GC not initialized 2024-09-12T00:40:55.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.334+0000 7f9130fe1640 20 reqs_thread_entry: start 2024-09-12T00:40:55.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.334+0000 7f927e3ff9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:55.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.334+0000 7f927e3ff9c0 20 Filter name: none 2024-09-12T00:40:55.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.334+0000 7f90aa7fc640 20 reqs_thread_entry: start 2024-09-12T00:40:55.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.334+0000 7f927e3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.334+0000 7f927e3ff9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:40:55.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.334+0000 7f927e3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.338+0000 7f927e3ff9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:40:55.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.338+0000 7f927e3ff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:55.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.338+0000 7f927e3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.338+0000 7f927e3ff9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:40:55.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.338+0000 7f927e3ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.338+0000 7f927e3ff9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:40:55.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.338+0000 7f927e3ff9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:55.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.338+0000 7f9131fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:55.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.342+0000 7f927e3ff9c0 20 remove_watcher() i=0 2024-09-12T00:40:55.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.342+0000 7f927e3ff9c0 2 removed watcher, disabling cache 2024-09-12T00:40:55.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.346+0000 7f927e3ff9c0 20 remove_watcher() i=1 2024-09-12T00:40:55.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.346+0000 7f927e3ff9c0 20 remove_watcher() i=2 2024-09-12T00:40:55.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.350+0000 7f927e3ff9c0 20 remove_watcher() i=3 2024-09-12T00:40:55.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.350+0000 7f927e3ff9c0 20 remove_watcher() i=4 2024-09-12T00:40:55.349 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.354+0000 7f927e3ff9c0 20 remove_watcher() i=5 2024-09-12T00:40:55.352 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.358+0000 7f927e3ff9c0 20 remove_watcher() i=6 2024-09-12T00:40:55.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.358+0000 7f927e3ff9c0 20 remove_watcher() i=7 2024-09-12T00:40:55.368 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:55.368 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:40:55.369 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: a-bucket id: e2043445-c131-4520-984d-b4d52f038a6b.4538.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-12T00:40:55.369 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:55.369 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T00:40:55.395 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:55.395 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:55.436 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.442+0000 7f491f4eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.442+0000 7f491f4eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.442+0000 7f491f4eb9c0 20 realm 2024-09-12T00:40:55.439 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.442+0000 7f491f4eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.442+0000 7f491f4eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.442+0000 7f491f4eb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.442+0000 7f491f4eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.446+0000 7f491f4eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.446+0000 7f491f4eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.440 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.446+0000 7f491f4eb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.446+0000 7f491f4eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.441 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.446+0000 7f491f4eb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:55.442 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.446+0000 7f491f4eb9c0 20 searching for the correct realm 2024-09-12T00:40:55.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.450+0000 7f491cff1640 0 -- 172.21.15.138:0/3878773095 >> [v2:172.21.15.138:6816/3496313381,v1:172.21.15.138:6817/3496313381] conn(0x7f49140c0020 msgr2=0x7f49140e42d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:55.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.458+0000 7f491cff1640 0 -- 172.21.15.138:0/3878773095 >> [v2:172.21.15.178:6811/2062234204,v1:172.21.15.178:6813/2062234204] conn(0x7f490c067ba0 msgr2=0x7f490c070040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:55.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:55.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:55.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:55.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:55.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:55.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:55.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:55.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 zone default found 2024-09-12T00:40:55.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 4 Realm: () 2024-09-12T00:40:55.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:55.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:55.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:55.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 zonegroup default 2024-09-12T00:40:55.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 started sync module instance, tier type = 2024-09-12T00:40:55.464 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.466+0000 7f491f4eb9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:55.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.486+0000 7f491f4eb9c0 20 add_watcher() i=0 2024-09-12T00:40:55.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.486+0000 7f491f4eb9c0 20 add_watcher() i=1 2024-09-12T00:40:55.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.486+0000 7f491f4eb9c0 20 add_watcher() i=2 2024-09-12T00:40:55.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.486+0000 7f491f4eb9c0 20 add_watcher() i=3 2024-09-12T00:40:55.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.486+0000 7f491f4eb9c0 20 add_watcher() i=4 2024-09-12T00:40:55.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.486+0000 7f491f4eb9c0 20 add_watcher() i=5 2024-09-12T00:40:55.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.486+0000 7f491f4eb9c0 20 add_watcher() i=6 2024-09-12T00:40:55.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.490+0000 7f491f4eb9c0 20 add_watcher() i=7 2024-09-12T00:40:55.484 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.490+0000 7f491f4eb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:55.487 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.490+0000 7f47d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:55.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.490+0000 7f491f4eb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:55.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.490+0000 7f491f4eb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:55.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.494+0000 7f491f4eb9c0 5 note: GC not initialized 2024-09-12T00:40:55.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.494+0000 7f47d1fe3640 20 reqs_thread_entry: start 2024-09-12T00:40:55.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.494+0000 7f491f4eb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:55.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.494+0000 7f491f4eb9c0 20 Filter name: none 2024-09-12T00:40:55.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.494+0000 7f47437fe640 20 reqs_thread_entry: start 2024-09-12T00:40:55.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.494+0000 7f491f4eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.494+0000 7f491f4eb9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:40:55.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.494+0000 7f491f4eb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.494+0000 7f491f4eb9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:40:55.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.494+0000 7f491f4eb9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:55.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.494+0000 7f47d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:55.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.498+0000 7f491f4eb9c0 20 remove_watcher() i=0 2024-09-12T00:40:55.495 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.498+0000 7f491f4eb9c0 2 removed watcher, disabling cache 2024-09-12T00:40:55.497 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.502+0000 7f491f4eb9c0 20 remove_watcher() i=1 2024-09-12T00:40:55.499 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.502+0000 7f491f4eb9c0 20 remove_watcher() i=2 2024-09-12T00:40:55.500 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.506+0000 7f491f4eb9c0 20 remove_watcher() i=3 2024-09-12T00:40:55.502 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.506+0000 7f491f4eb9c0 20 remove_watcher() i=4 2024-09-12T00:40:55.505 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.510+0000 7f491f4eb9c0 20 remove_watcher() i=5 2024-09-12T00:40:55.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.510+0000 7f491f4eb9c0 20 remove_watcher() i=6 2024-09-12T00:40:55.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.514+0000 7f491f4eb9c0 20 remove_watcher() i=7 2024-09-12T00:40:55.524 INFO:tasks.workunit.client.0.smithi138.stderr:rados -p default.rgw.buckets.index setomapval .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T00:40:55.550 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:55.551 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:55.570 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:40:55.595 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:55.595 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:55.637 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.638+0000 7f2d6531b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.642+0000 7f2d6531b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.642+0000 7f2d6531b9c0 20 realm 2024-09-12T00:40:55.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.642+0000 7f2d6531b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.642+0000 7f2d6531b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.642+0000 7f2d6531b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.642+0000 7f2d6531b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.642+0000 7f2d6531b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.639 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.642+0000 7f2d6531b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.646+0000 7f2d6531b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.646+0000 7f2d6531b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.646+0000 7f2d6531b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:55.641 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.646+0000 7f2d6531b9c0 20 searching for the correct realm 2024-09-12T00:40:55.646 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.650+0000 7f2d63622640 0 -- 172.21.15.138:0/1825727073 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f2d5c02f040 msgr2=0x7f2d5c00e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:55.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.866+0000 7f2d63622640 0 -- 172.21.15.138:0/1825727073 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55a336899660 msgr2=0x55a33689bb20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:55.870 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.874+0000 7f2d6531b9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:55.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.874+0000 7f2d6531b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:55.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.874+0000 7f2d6531b9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:55.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.874+0000 7f2d6531b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:55.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.874+0000 7f2d6531b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:55.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.874+0000 7f2d6531b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:55.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.874+0000 7f2d6531b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.874+0000 7f2d6531b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.874+0000 7f2d6531b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.878+0000 7f2d6531b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:55.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.878+0000 7f2d6531b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.878+0000 7f2d6531b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:55.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.878+0000 7f2d6531b9c0 20 zone default found 2024-09-12T00:40:55.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.878+0000 7f2d6531b9c0 4 Realm: () 2024-09-12T00:40:55.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.878+0000 7f2d6531b9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:55.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.878+0000 7f2d6531b9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:55.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.878+0000 7f2d6531b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:55.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.878+0000 7f2d6531b9c0 20 zonegroup default 2024-09-12T00:40:55.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.878+0000 7f2d6531b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.878+0000 7f2d6531b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.878+0000 7f2d6531b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.878+0000 7f2d6531b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.878+0000 7f2d6531b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.878+0000 7f2d6531b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:55.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.878+0000 7f2d6531b9c0 20 started sync module instance, tier type = 2024-09-12T00:40:55.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.878+0000 7f2d6531b9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:55.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.902+0000 7f2d6531b9c0 20 add_watcher() i=0 2024-09-12T00:40:55.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.902+0000 7f2d6531b9c0 20 add_watcher() i=1 2024-09-12T00:40:55.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.902+0000 7f2d6531b9c0 20 add_watcher() i=2 2024-09-12T00:40:55.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.902+0000 7f2d6531b9c0 20 add_watcher() i=3 2024-09-12T00:40:55.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.902+0000 7f2d6531b9c0 20 add_watcher() i=4 2024-09-12T00:40:55.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.902+0000 7f2d6531b9c0 20 add_watcher() i=5 2024-09-12T00:40:55.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.902+0000 7f2d6531b9c0 20 add_watcher() i=6 2024-09-12T00:40:55.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.906+0000 7f2d6531b9c0 20 add_watcher() i=7 2024-09-12T00:40:55.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.906+0000 7f2d6531b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:55.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.910+0000 7f2c197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:55.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.910+0000 7f2d6531b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:55.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.910+0000 7f2d6531b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:55.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.910+0000 7f2d6531b9c0 5 note: GC not initialized 2024-09-12T00:40:55.906 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.910+0000 7f2b93fff640 20 reqs_thread_entry: start 2024-09-12T00:40:55.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.910+0000 7f2d6531b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:55.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.910+0000 7f2d6531b9c0 20 Filter name: none 2024-09-12T00:40:55.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.910+0000 7f2b91ffb640 20 reqs_thread_entry: start 2024-09-12T00:40:55.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.910+0000 7f2d6531b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.910+0000 7f2d6531b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:40:55.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.910+0000 7f2d6531b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:55.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:40:55.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:55.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:40:55.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 20 INFO: main: starting shard=0 2024-09-12T00:40:55.908 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:40:55.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:40:55.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:40:55.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 20 INFO: main: starting shard=1 2024-09-12T00:40:55.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:40:55.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:40:55.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:40:55.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 20 INFO: main: starting shard=2 2024-09-12T00:40:55.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:40:55.910 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:40:55.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:40:55.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 20 INFO: main: starting shard=3 2024-09-12T00:40:55.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:40:55.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:40:55.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:40:55.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 20 INFO: main: starting shard=4 2024-09-12T00:40:55.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:40:55.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.914+0000 7f2d6531b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:40:55.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.918+0000 7f2d6531b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:40:55.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.918+0000 7f2d6531b9c0 20 INFO: main: starting shard=5 2024-09-12T00:40:55.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.918+0000 7f2d6531b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:40:55.912 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.918+0000 7f2d6531b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:40:55.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.918+0000 7f2d6531b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:40:55.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.918+0000 7f2d6531b9c0 20 INFO: main: starting shard=6 2024-09-12T00:40:55.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.918+0000 7f2d6531b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:40:55.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.918+0000 7f2d6531b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:40:55.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.918+0000 7f2d6531b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:40:55.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.918+0000 7f2d6531b9c0 20 INFO: main: starting shard=7 2024-09-12T00:40:55.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.918+0000 7f2d6531b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:40:55.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.918+0000 7f2d6531b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:40:55.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.918+0000 7f2d6531b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:40:55.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.918+0000 7f2d6531b9c0 20 INFO: main: starting shard=8 2024-09-12T00:40:55.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.918+0000 7f2d6531b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:40:55.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.918+0000 7f2d6531b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:40:55.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.922+0000 7f2d6531b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:40:55.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.922+0000 7f2d6531b9c0 20 INFO: main: starting shard=9 2024-09-12T00:40:55.916 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.922+0000 7f2d6531b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:40:55.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.922+0000 7f2d6531b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:40:55.917 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.922+0000 7f2d6531b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:40:55.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.922+0000 7f2d6531b9c0 20 INFO: main: starting shard=10 2024-09-12T00:40:55.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.922+0000 7f2d6531b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:40:55.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.922+0000 7f2d6531b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:40:55.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.922+0000 7f2d6531b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:40:55.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.922+0000 7f2d6531b9c0 20 INFO: main: starting shard=11 2024-09-12T00:40:55.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.922+0000 7f2d6531b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:40:55.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.922+0000 7f2d6531b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:40:55.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.922+0000 7f2d6531b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:40:55.919 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.922+0000 7f2d6531b9c0 20 INFO: main: starting shard=12 2024-09-12T00:40:55.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.922+0000 7f2d6531b9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:40:55.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.922+0000 7f2d6531b9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:40:55.920 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.926+0000 7f2d6531b9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:40:55.921 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.926+0000 7f2d6531b9c0 20 INFO: main: done 2024-09-12T00:40:55.922 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.926+0000 7f2c197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:55.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.930+0000 7f2d6531b9c0 20 remove_watcher() i=0 2024-09-12T00:40:55.926 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.930+0000 7f2d6531b9c0 2 removed watcher, disabling cache 2024-09-12T00:40:55.928 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.934+0000 7f2d6531b9c0 20 remove_watcher() i=1 2024-09-12T00:40:55.930 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.934+0000 7f2d6531b9c0 20 remove_watcher() i=2 2024-09-12T00:40:55.932 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.938+0000 7f2d6531b9c0 20 remove_watcher() i=3 2024-09-12T00:40:55.935 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.938+0000 7f2d6531b9c0 20 remove_watcher() i=4 2024-09-12T00:40:55.937 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.942+0000 7f2d6531b9c0 20 remove_watcher() i=5 2024-09-12T00:40:55.940 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.946+0000 7f2d6531b9c0 20 remove_watcher() i=6 2024-09-12T00:40:55.942 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:55.946+0000 7f2d6531b9c0 20 remove_watcher() i=7 2024-09-12T00:40:55.957 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T00:40:55.992 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:55.992 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:56.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.038+0000 7f96fcda89c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.042+0000 7f96fcda89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:56.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.042+0000 7f96fcda89c0 20 realm 2024-09-12T00:40:56.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.042+0000 7f96fcda89c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.042+0000 7f96fcda89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:56.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.042+0000 7f96fcda89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:56.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.042+0000 7f96fcda89c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.042+0000 7f96fcda89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:56.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.042+0000 7f96fcda89c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.042+0000 7f96fcda89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:56.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.042+0000 7f96fcda89c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.042+0000 7f96fcda89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:56.040 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.042+0000 7f96fcda89c0 20 searching for the correct realm 2024-09-12T00:40:56.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.050+0000 7f96fb0af640 0 -- 172.21.15.138:0/2836267241 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f96ec0dc400 msgr2=0x7f96ec0dc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:56.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.266+0000 7f96fb0af640 0 -- 172.21.15.138:0/2836267241 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x556d7e827990 msgr2=0x556d7e829e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:56.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.274+0000 7f96fcda89c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:56.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.274+0000 7f96fcda89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:56.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.274+0000 7f96fcda89c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:56.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.274+0000 7f96fcda89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:56.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.274+0000 7f96fcda89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:56.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.274+0000 7f96fcda89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:56.271 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.274+0000 7f96fcda89c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:56.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:56.272 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:56.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 20 zone default found 2024-09-12T00:40:56.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 4 Realm: () 2024-09-12T00:40:56.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:56.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:56.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:56.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 20 zonegroup default 2024-09-12T00:40:56.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:56.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:56.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:56.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 20 started sync module instance, tier type = 2024-09-12T00:40:56.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.278+0000 7f96fcda89c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:56.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.306+0000 7f96fcda89c0 20 add_watcher() i=0 2024-09-12T00:40:56.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.306+0000 7f96fcda89c0 20 add_watcher() i=1 2024-09-12T00:40:56.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.306+0000 7f96fcda89c0 20 add_watcher() i=2 2024-09-12T00:40:56.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.306+0000 7f96fcda89c0 20 add_watcher() i=3 2024-09-12T00:40:56.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.306+0000 7f96fcda89c0 20 add_watcher() i=4 2024-09-12T00:40:56.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.306+0000 7f96fcda89c0 20 add_watcher() i=5 2024-09-12T00:40:56.300 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.306+0000 7f96fcda89c0 20 add_watcher() i=6 2024-09-12T00:40:56.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.306+0000 7f96fcda89c0 20 add_watcher() i=7 2024-09-12T00:40:56.302 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.306+0000 7f96fcda89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:56.306 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.310+0000 7f95b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:56.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.310+0000 7f96fcda89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:56.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.310+0000 7f96fcda89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:56.307 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.310+0000 7f96fcda89c0 5 note: GC not initialized 2024-09-12T00:40:56.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.314+0000 7f952bfff640 20 reqs_thread_entry: start 2024-09-12T00:40:56.308 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.314+0000 7f96fcda89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:56.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.314+0000 7f96fcda89c0 20 Filter name: none 2024-09-12T00:40:56.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.314+0000 7f9529ffb640 20 reqs_thread_entry: start 2024-09-12T00:40:56.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.314+0000 7f96fcda89c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:40:56.309 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.314+0000 7f96fcda89c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.314+0000 7f96fcda89c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:40:56.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.314+0000 7f96fcda89c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:40:56.310 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.314+0000 7f96fcda89c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:40:56.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.314+0000 7f96fcda89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : miss 2024-09-12T00:40:56.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.314+0000 7f96fcda89c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.314+0000 7f96fcda89c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:40:56.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.314+0000 7f96fcda89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:56.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.314+0000 7f96fcda89c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:56.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.314+0000 7f96fcda89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:56.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.314+0000 7f96fcda89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:56.311 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.314+0000 7f96fcda89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:40:56.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.322+0000 7f96fcda89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:56.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.322+0000 7f96fcda89c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:56.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.322+0000 7f96fcda89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:56.318 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.322+0000 7f96fcda89c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:40:56.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.322+0000 7f95ddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333577 cookie 93928762283184 notifier 8634 bl.length()=827 2024-09-12T00:40:56.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.322+0000 7f95ddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:56.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.322+0000 7f95ddffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:56.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.322+0000 7f95ddffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:56.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.322+0000 7f96fcda89c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:40:56.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.322+0000 7f96fcda89c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:40:56.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.322+0000 7f96fcda89c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:40:56.319 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.322+0000 7f96fcda89c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:40:56.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.334+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.0 2024-09-12T00:40:56.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.334+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.0 2024-09-12T00:40:56.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.334+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:40:56.331 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.334+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:40:56.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.338+0000 7f96fcda89c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T00:40:56.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.338+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:40:56.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.338+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:40:56.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.338+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:40:56.332 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.338+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:40:56.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.338+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:40:56.333 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.338+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:40:56.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.338+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:40:56.334 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.338+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:40:56.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.338+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:40:56.335 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.338+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:40:56.337 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.342+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:40:56.338 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.342+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:40:56.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.342+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:40:56.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.342+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:40:56.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.342+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:40:56.339 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.342+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:40:56.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.346+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:40:56.340 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.346+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:40:56.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.346+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:40:56.341 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.346+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:40:56.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.346+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:40:56.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.346+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:40:56.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.346+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:40:56.343 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.346+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:40:56.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.350+0000 7f96fcda89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:56.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.350+0000 7f96fcda89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:40:56.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.350+0000 7f96fcda89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:56.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.350+0000 7f96fcda89c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:56.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.350+0000 7f96fcda89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:56.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.350+0000 7f96fcda89c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:40:56.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.350+0000 7f95de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333578 cookie 93928762283184 notifier 8634 bl.length()=827 2024-09-12T00:40:56.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.350+0000 7f95de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:56.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.350+0000 7f95de7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:56.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.350+0000 7f95de7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:56.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.350+0000 7f96fcda89c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:40:56.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.350+0000 7f96fcda89c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:40:56.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.350+0000 7f96fcda89c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:40:56.348 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.350+0000 7f96fcda89c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:40:56.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.358+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:40:56.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.358+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.0 2024-09-12T00:40:56.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.358+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:40:56.354 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.358+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.1 2024-09-12T00:40:56.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.358+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:40:56.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.358+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.2 2024-09-12T00:40:56.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.358+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:40:56.355 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.358+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.3 2024-09-12T00:40:56.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.362+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:40:56.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.362+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.4 2024-09-12T00:40:56.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.362+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:40:56.357 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.362+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.5 2024-09-12T00:40:56.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.362+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:40:56.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.362+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.6 2024-09-12T00:40:56.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.362+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:40:56.358 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.362+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.7 2024-09-12T00:40:56.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.362+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:40:56.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.362+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.8 2024-09-12T00:40:56.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.362+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:40:56.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.362+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.9 2024-09-12T00:40:56.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.366+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:40:56.361 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.366+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.10 2024-09-12T00:40:56.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.366+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:40:56.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.366+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.11 2024-09-12T00:40:56.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.366+0000 7f96fcda89c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:40:56.362 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.366+0000 7f96fcda89c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.2.12 2024-09-12T00:40:56.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.366+0000 7f96fcda89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:40:56.363 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.366+0000 7f96fcda89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 2024-09-12T00:40:56.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.370+0000 7f96fcda89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:56.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.370+0000 7f96fcda89c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:56.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.370+0000 7f96fcda89c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:56.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.370+0000 7f96fcda89c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17, ofs0, ns] 2024-09-12T00:40:56.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.370+0000 7f95ddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333579 cookie 93928762283184 notifier 8634 bl.length()=795 2024-09-12T00:40:56.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.370+0000 7f95ddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 info.flags=0x17 2024-09-12T00:40:56.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.370+0000 7f95ddffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.17 to cache LRU end 2024-09-12T00:40:56.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.370+0000 7f95ddffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:56.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.370+0000 7f96fcda89c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_sources= new_sources= 2024-09-12T00:40:56.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.370+0000 7f96fcda89c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential sources added=[] removed=[] 2024-09-12T00:40:56.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.370+0000 7f96fcda89c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): orig_dests= new_dests= 2024-09-12T00:40:56.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.370+0000 7f96fcda89c0 20 handle_bi_update(): bucket=:a-bucket[e2043445-c131-4520-984d-b4d52f038a6b.4538.17]): potential dests added=[] removed=[] 2024-09-12T00:40:56.372 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.378+0000 7f96fcda89c0 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-12T00:40:56.376 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.382+0000 7f95b17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:56.380 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.386+0000 7f96fcda89c0 20 remove_watcher() i=0 2024-09-12T00:40:56.381 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.386+0000 7f96fcda89c0 2 removed watcher, disabling cache 2024-09-12T00:40:56.382 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.386+0000 7f96fcda89c0 20 remove_watcher() i=1 2024-09-12T00:40:56.385 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.390+0000 7f96fcda89c0 20 remove_watcher() i=2 2024-09-12T00:40:56.386 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.390+0000 7f96fcda89c0 20 remove_watcher() i=3 2024-09-12T00:40:56.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.394+0000 7f96fcda89c0 20 remove_watcher() i=4 2024-09-12T00:40:56.391 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.394+0000 7f96fcda89c0 20 remove_watcher() i=5 2024-09-12T00:40:56.393 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.398+0000 7f96fcda89c0 20 remove_watcher() i=6 2024-09-12T00:40:56.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.402+0000 7f96fcda89c0 20 remove_watcher() i=7 2024-09-12T00:40:56.413 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:40:56.443 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:56.443 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:56.485 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.490+0000 7f3eab44e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.494+0000 7f3eab44e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:56.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.494+0000 7f3eab44e9c0 20 realm 2024-09-12T00:40:56.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.494+0000 7f3eab44e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.494+0000 7f3eab44e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:56.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.494+0000 7f3eab44e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:56.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.494+0000 7f3eab44e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.494+0000 7f3eab44e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:56.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.494+0000 7f3eab44e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.489 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.494+0000 7f3eab44e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:56.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.494+0000 7f3eab44e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.494+0000 7f3eab44e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:56.491 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.494+0000 7f3eab44e9c0 20 searching for the correct realm 2024-09-12T00:40:56.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.502+0000 7f3ea9755640 0 -- 172.21.15.138:0/4207577136 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f3ea0090050 msgr2=0x7f3ea0096210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:56.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.718+0000 7f3ea9755640 0 -- 172.21.15.138:0/4207577136 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x56166801e7e0 msgr2=0x561668020c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:56.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.726+0000 7f3eab44e9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:56.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.726+0000 7f3eab44e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:56.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.726+0000 7f3eab44e9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:56.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.726+0000 7f3eab44e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:56.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.726+0000 7f3eab44e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:56.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.726+0000 7f3eab44e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:56.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.726+0000 7f3eab44e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.726+0000 7f3eab44e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:56.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.726+0000 7f3eab44e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.726+0000 7f3eab44e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:56.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.726+0000 7f3eab44e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.730+0000 7f3eab44e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:56.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.730+0000 7f3eab44e9c0 20 zone default found 2024-09-12T00:40:56.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.730+0000 7f3eab44e9c0 4 Realm: () 2024-09-12T00:40:56.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.730+0000 7f3eab44e9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:56.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.730+0000 7f3eab44e9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:56.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.730+0000 7f3eab44e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:56.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.730+0000 7f3eab44e9c0 20 zonegroup default 2024-09-12T00:40:56.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.730+0000 7f3eab44e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.730+0000 7f3eab44e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:56.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.730+0000 7f3eab44e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.730+0000 7f3eab44e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:56.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.730+0000 7f3eab44e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.730+0000 7f3eab44e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:56.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.730+0000 7f3eab44e9c0 20 started sync module instance, tier type = 2024-09-12T00:40:56.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.730+0000 7f3eab44e9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:56.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.754+0000 7f3eab44e9c0 20 add_watcher() i=0 2024-09-12T00:40:56.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.754+0000 7f3eab44e9c0 20 add_watcher() i=1 2024-09-12T00:40:56.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.754+0000 7f3eab44e9c0 20 add_watcher() i=2 2024-09-12T00:40:56.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.754+0000 7f3eab44e9c0 20 add_watcher() i=3 2024-09-12T00:40:56.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.754+0000 7f3eab44e9c0 20 add_watcher() i=4 2024-09-12T00:40:56.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.754+0000 7f3eab44e9c0 20 add_watcher() i=5 2024-09-12T00:40:56.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.754+0000 7f3eab44e9c0 20 add_watcher() i=6 2024-09-12T00:40:56.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.754+0000 7f3eab44e9c0 20 add_watcher() i=7 2024-09-12T00:40:56.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.754+0000 7f3eab44e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:56.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.762+0000 7f3d5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:56.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.762+0000 7f3eab44e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:56.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.762+0000 7f3eab44e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:56.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.762+0000 7f3eab44e9c0 5 note: GC not initialized 2024-09-12T00:40:56.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.762+0000 7f3d5dfe3640 20 reqs_thread_entry: start 2024-09-12T00:40:56.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.762+0000 7f3eab44e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:56.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.762+0000 7f3eab44e9c0 20 Filter name: none 2024-09-12T00:40:56.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.762+0000 7f3ccf7fe640 20 reqs_thread_entry: start 2024-09-12T00:40:56.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.762+0000 7f3eab44e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.762+0000 7f3eab44e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:40:56.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.762+0000 7f3eab44e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.762+0000 7f3eab44e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:40:56.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.766+0000 7f3eab44e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:56.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.766+0000 7f3eab44e9c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T00:40:56.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.766+0000 7f3eab44e9c0 20 INFO: main: starting shard=0 2024-09-12T00:40:56.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.766+0000 7f3eab44e9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.0 2024-09-12T00:40:56.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.766+0000 7f3eab44e9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.17.3.0 2024-09-12T00:40:56.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.766+0000 7f3eab44e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:40:56.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.766+0000 7f3eab44e9c0 20 INFO: main: done 2024-09-12T00:40:56.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.766+0000 7f3d5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:56.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.770+0000 7f3eab44e9c0 20 remove_watcher() i=0 2024-09-12T00:40:56.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.770+0000 7f3eab44e9c0 2 removed watcher, disabling cache 2024-09-12T00:40:56.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.774+0000 7f3eab44e9c0 20 remove_watcher() i=1 2024-09-12T00:40:56.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.774+0000 7f3eab44e9c0 20 remove_watcher() i=2 2024-09-12T00:40:56.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.778+0000 7f3eab44e9c0 20 remove_watcher() i=3 2024-09-12T00:40:56.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.778+0000 7f3eab44e9c0 20 remove_watcher() i=4 2024-09-12T00:40:56.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.782+0000 7f3eab44e9c0 20 remove_watcher() i=5 2024-09-12T00:40:56.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.782+0000 7f3eab44e9c0 20 remove_watcher() i=6 2024-09-12T00:40:56.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.786+0000 7f3eab44e9c0 20 remove_watcher() i=7 2024-09-12T00:40:56.799 INFO:tasks.workunit.client.0.smithi138.stderr: test: PUT succeeds during reshard 2024-09-12T00:40:56.799 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:40:56.832 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:56.833 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:56.876 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.882+0000 7fa6ee6c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.882+0000 7fa6ee6c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:56.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.882+0000 7fa6ee6c19c0 20 realm 2024-09-12T00:40:56.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.882+0000 7fa6ee6c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.886+0000 7fa6ee6c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:56.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.886+0000 7fa6ee6c19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:56.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.886+0000 7fa6ee6c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.886+0000 7fa6ee6c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:56.881 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.886+0000 7fa6ee6c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.886+0000 7fa6ee6c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:56.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.886+0000 7fa6ee6c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:56.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.886+0000 7fa6ee6c19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:56.883 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.886+0000 7fa6ee6c19c0 20 searching for the correct realm 2024-09-12T00:40:56.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:56.894+0000 7fa6ec9c8640 0 -- 172.21.15.138:0/3927560613 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fa6e40cfba0 msgr2=0x7fa6e40b7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:57.108 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.114+0000 7fa6ec9c8640 0 -- 172.21.15.138:0/3927560613 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55fafb58e370 msgr2=0x55fafb590830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:57.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.122+0000 7fa6ee6c19c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:57.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.122+0000 7fa6ee6c19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:57.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.122+0000 7fa6ee6c19c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:57.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.122+0000 7fa6ee6c19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:57.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.122+0000 7fa6ee6c19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:57.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.122+0000 7fa6ee6c19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:57.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.122+0000 7fa6ee6c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.122+0000 7fa6ee6c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:57.118 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.122+0000 7fa6ee6c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.122+0000 7fa6ee6c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:57.119 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.122+0000 7fa6ee6c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.122+0000 7fa6ee6c19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:57.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.122+0000 7fa6ee6c19c0 20 zone default found 2024-09-12T00:40:57.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.122+0000 7fa6ee6c19c0 4 Realm: () 2024-09-12T00:40:57.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.126+0000 7fa6ee6c19c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:57.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.126+0000 7fa6ee6c19c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:57.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.126+0000 7fa6ee6c19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:57.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.126+0000 7fa6ee6c19c0 20 zonegroup default 2024-09-12T00:40:57.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.126+0000 7fa6ee6c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.126+0000 7fa6ee6c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:57.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.126+0000 7fa6ee6c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.126+0000 7fa6ee6c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:57.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.126+0000 7fa6ee6c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.126+0000 7fa6ee6c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:57.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.126+0000 7fa6ee6c19c0 20 started sync module instance, tier type = 2024-09-12T00:40:57.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.126+0000 7fa6ee6c19c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:57.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.150+0000 7fa6ee6c19c0 20 add_watcher() i=0 2024-09-12T00:40:57.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.150+0000 7fa6ee6c19c0 20 add_watcher() i=1 2024-09-12T00:40:57.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.150+0000 7fa6ee6c19c0 20 add_watcher() i=2 2024-09-12T00:40:57.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.150+0000 7fa6ee6c19c0 20 add_watcher() i=3 2024-09-12T00:40:57.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.150+0000 7fa6ee6c19c0 20 add_watcher() i=4 2024-09-12T00:40:57.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.150+0000 7fa6ee6c19c0 20 add_watcher() i=5 2024-09-12T00:40:57.145 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.150+0000 7fa6ee6c19c0 20 add_watcher() i=6 2024-09-12T00:40:57.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.150+0000 7fa6ee6c19c0 20 add_watcher() i=7 2024-09-12T00:40:57.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.150+0000 7fa6ee6c19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:57.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.154+0000 7fa5a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:57.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.154+0000 7fa6ee6c19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:57.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.154+0000 7fa6ee6c19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:57.151 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.154+0000 7fa6ee6c19c0 5 note: GC not initialized 2024-09-12T00:40:57.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.158+0000 7fa5a1fdb640 20 reqs_thread_entry: start 2024-09-12T00:40:57.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.158+0000 7fa6ee6c19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:57.152 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.158+0000 7fa6ee6c19c0 20 Filter name: none 2024-09-12T00:40:57.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.158+0000 7fa5137fe640 20 reqs_thread_entry: start 2024-09-12T00:40:57.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.158+0000 7fa6ee6c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.158+0000 7fa6ee6c19c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:40:57.154 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.158+0000 7fa6ee6c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.158+0000 7fa6ee6c19c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:40:57.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.158+0000 7fa6ee6c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:57.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.158+0000 7fa6ee6c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.162+0000 7fa6ee6c19c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:40:57.156 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.162+0000 7fa6ee6c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.162+0000 7fa6ee6c19c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:40:57.157 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.162+0000 7fa6ee6c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:40:57.160 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.166+0000 7fa5a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:57.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.170+0000 7fa6ee6c19c0 20 remove_watcher() i=0 2024-09-12T00:40:57.164 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.170+0000 7fa6ee6c19c0 2 removed watcher, disabling cache 2024-09-12T00:40:57.166 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.170+0000 7fa6ee6c19c0 20 remove_watcher() i=1 2024-09-12T00:40:57.168 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.174+0000 7fa6ee6c19c0 20 remove_watcher() i=2 2024-09-12T00:40:57.170 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.174+0000 7fa6ee6c19c0 20 remove_watcher() i=3 2024-09-12T00:40:57.173 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.178+0000 7fa6ee6c19c0 20 remove_watcher() i=4 2024-09-12T00:40:57.175 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.178+0000 7fa6ee6c19c0 20 remove_watcher() i=5 2024-09-12T00:40:57.177 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.182+0000 7fa6ee6c19c0 20 remove_watcher() i=6 2024-09-12T00:40:57.180 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.186+0000 7fa6ee6c19c0 20 remove_watcher() i=7 2024-09-12T00:40:57.195 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:57.195 INFO:tasks.workunit.client.0.smithi138.stderr:BUCKET_STATS: 2024-09-12T00:40:57.195 INFO:tasks.workunit.client.0.smithi138.stderr:bucket: myver id: e2043445-c131-4520-984d-b4d52f038a6b.4538.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:40:57.196 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:40:57.196 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-12T00:40:57.228 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:57.228 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:57.270 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.274+0000 7fb1bafa79c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.273 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.278+0000 7fb1bafa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:57.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.278+0000 7fb1bafa79c0 20 realm 2024-09-12T00:40:57.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.278+0000 7fb1bafa79c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.278+0000 7fb1bafa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:57.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.278+0000 7fb1bafa79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:40:57.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.278+0000 7fb1bafa79c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.278+0000 7fb1bafa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:57.274 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.278+0000 7fb1bafa79c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.278+0000 7fb1bafa79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:57.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.278+0000 7fb1bafa79c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.278+0000 7fb1bafa79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:40:57.275 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.278+0000 7fb1bafa79c0 20 searching for the correct realm 2024-09-12T00:40:57.280 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.286+0000 7fb1b92ae640 0 -- 172.21.15.138:0/3928501665 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fb1b0067a40 msgr2=0x7fb1b0094040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:40:57.498 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.502+0000 7fb1b92ae640 0 -- 172.21.15.138:0/3928501665 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x559c4552daa0 msgr2=0x559c4552ff60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:40:57.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.510+0000 7fb1bafa79c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:40:57.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.510+0000 7fb1bafa79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:40:57.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.510+0000 7fb1bafa79c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:40:57.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.510+0000 7fb1bafa79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:40:57.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.510+0000 7fb1bafa79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:40:57.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.510+0000 7fb1bafa79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:40:57.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.510+0000 7fb1bafa79c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.514+0000 7fb1bafa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:57.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.514+0000 7fb1bafa79c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.514+0000 7fb1bafa79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:40:57.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.514+0000 7fb1bafa79c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.514+0000 7fb1bafa79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:40:57.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.514+0000 7fb1bafa79c0 20 zone default found 2024-09-12T00:40:57.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.514+0000 7fb1bafa79c0 4 Realm: () 2024-09-12T00:40:57.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.514+0000 7fb1bafa79c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:40:57.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.514+0000 7fb1bafa79c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:40:57.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.514+0000 7fb1bafa79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:40:57.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.514+0000 7fb1bafa79c0 20 zonegroup default 2024-09-12T00:40:57.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.514+0000 7fb1bafa79c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.514+0000 7fb1bafa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:57.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.514+0000 7fb1bafa79c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.513 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.514+0000 7fb1bafa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:57.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.514+0000 7fb1bafa79c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.518+0000 7fb1bafa79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:40:57.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.518+0000 7fb1bafa79c0 20 started sync module instance, tier type = 2024-09-12T00:40:57.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.518+0000 7fb1bafa79c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:40:57.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.538+0000 7fb1bafa79c0 20 add_watcher() i=0 2024-09-12T00:40:57.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.538+0000 7fb1bafa79c0 20 add_watcher() i=1 2024-09-12T00:40:57.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.538+0000 7fb1bafa79c0 20 add_watcher() i=2 2024-09-12T00:40:57.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.538+0000 7fb1bafa79c0 20 add_watcher() i=3 2024-09-12T00:40:57.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.538+0000 7fb1bafa79c0 20 add_watcher() i=4 2024-09-12T00:40:57.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.538+0000 7fb1bafa79c0 20 add_watcher() i=5 2024-09-12T00:40:57.535 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.538+0000 7fb1bafa79c0 20 add_watcher() i=6 2024-09-12T00:40:57.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.542+0000 7fb1bafa79c0 20 add_watcher() i=7 2024-09-12T00:40:57.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.542+0000 7fb1bafa79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:40:57.542 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.546+0000 7fb06f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:40:57.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.546+0000 7fb1bafa79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:40:57.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.546+0000 7fb1bafa79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:40:57.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.546+0000 7fb1bafa79c0 5 note: GC not initialized 2024-09-12T00:40:57.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.546+0000 7fb06e7e4640 20 reqs_thread_entry: start 2024-09-12T00:40:57.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.546+0000 7fb1bafa79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:40:57.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.546+0000 7fb1bafa79c0 20 Filter name: none 2024-09-12T00:40:57.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.550+0000 7fb0677fe640 20 reqs_thread_entry: start 2024-09-12T00:40:57.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.550+0000 7fb1bafa79c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:40:57.544 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.550+0000 7fb1bafa79c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.550+0000 7fb1bafa79c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:40:57.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.550+0000 7fb1bafa79c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:40:57.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.550+0000 7fb1bafa79c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:40:57.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.550+0000 7fb1bafa79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 : miss 2024-09-12T00:40:57.545 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.550+0000 7fb1bafa79c0 20 rados->read ofs=0 len=0 2024-09-12T00:40:57.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.550+0000 7fb1bafa79c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:40:57.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.550+0000 7fb1bafa79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:40:57.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.550+0000 7fb1bafa79c0 10 adding default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:40:57.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.550+0000 7fb1bafa79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:40:57.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.550+0000 7fb1bafa79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:57.546 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.550+0000 7fb1bafa79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 2024-09-12T00:40:57.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.562+0000 7fb1bafa79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:40:57.558 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.562+0000 7fb1bafa79c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:40:57.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.562+0000 7fb1bafa79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:57.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.562+0000 7fb1bafa79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18, ofs0, ns] 2024-09-12T00:40:57.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.562+0000 7fb08f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333483 cookie 94129666332720 notifier 8093 bl.length()=821 2024-09-12T00:40:57.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.562+0000 7fb08f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:40:57.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.562+0000 7fb08f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:40:57.559 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.562+0000 7fb08f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:40:57.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.562+0000 7fb1bafa79c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_sources= new_sources= 2024-09-12T00:40:57.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.562+0000 7fb1bafa79c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential sources added=[] removed=[] 2024-09-12T00:40:57.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.562+0000 7fb1bafa79c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_dests= new_dests= 2024-09-12T00:40:57.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.562+0000 7fb1bafa79c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential dests added=[] removed=[] 2024-09-12T00:40:57.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:40:57.574+0000 7fb1bafa79c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T00:40:58.200 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:40:58.201 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:40:58.239 INFO:tasks.workunit.client.0.smithi138.stderr:put object successful 2024-09-12T00:41:02.570 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.0 2024-09-12T00:41:02.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.0 2024-09-12T00:41:02.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.1 2024-09-12T00:41:02.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.1 2024-09-12T00:41:02.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.2 2024-09-12T00:41:02.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.2 2024-09-12T00:41:02.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.3 2024-09-12T00:41:02.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.3 2024-09-12T00:41:02.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.4 2024-09-12T00:41:02.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.4 2024-09-12T00:41:02.571 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.5 2024-09-12T00:41:02.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.5 2024-09-12T00:41:02.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.6 2024-09-12T00:41:02.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.6 2024-09-12T00:41:02.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.7 2024-09-12T00:41:02.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.7 2024-09-12T00:41:02.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.8 2024-09-12T00:41:02.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.8 2024-09-12T00:41:02.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.9 2024-09-12T00:41:02.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.9 2024-09-12T00:41:02.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.10 2024-09-12T00:41:02.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.10 2024-09-12T00:41:02.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.11 2024-09-12T00:41:02.572 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.11 2024-09-12T00:41:02.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.12 2024-09-12T00:41:02.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.12 2024-09-12T00:41:02.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.0 2024-09-12T00:41:02.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.0 2024-09-12T00:41:02.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.1 2024-09-12T00:41:02.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.574+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.1 2024-09-12T00:41:02.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.578+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.2 2024-09-12T00:41:02.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.578+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.2 2024-09-12T00:41:02.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.578+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.3 2024-09-12T00:41:02.574 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.578+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.3 2024-09-12T00:41:02.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.578+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.4 2024-09-12T00:41:02.575 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.578+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.4 2024-09-12T00:41:02.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.582+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.5 2024-09-12T00:41:02.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.582+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.5 2024-09-12T00:41:02.578 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.582+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.6 2024-09-12T00:41:02.579 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.582+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.6 2024-09-12T00:41:02.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.586+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.7 2024-09-12T00:41:02.580 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.586+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.7 2024-09-12T00:41:02.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.586+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.8 2024-09-12T00:41:02.581 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.586+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.8 2024-09-12T00:41:02.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.586+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.9 2024-09-12T00:41:02.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.586+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.9 2024-09-12T00:41:02.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.586+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.10 2024-09-12T00:41:02.583 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.586+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.10 2024-09-12T00:41:02.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.590+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.11 2024-09-12T00:41:02.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.590+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.11 2024-09-12T00:41:02.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.594+0000 7fb1bafa79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:41:02.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.594+0000 7fb1bafa79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 2024-09-12T00:41:02.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.598+0000 7fb1bafa79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:41:02.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.598+0000 7fb1bafa79c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:41:02.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.598+0000 7fb1bafa79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:02.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.598+0000 7fb1bafa79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18, ofs0, ns] 2024-09-12T00:41:02.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.598+0000 7fb08f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333484 cookie 94129666332720 notifier 8093 bl.length()=821 2024-09-12T00:41:02.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.598+0000 7fb08f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:41:02.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.598+0000 7fb08f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:41:02.594 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.598+0000 7fb08f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:02.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.598+0000 7fb1bafa79c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_sources= new_sources= 2024-09-12T00:41:02.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.598+0000 7fb1bafa79c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential sources added=[] removed=[] 2024-09-12T00:41:02.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.598+0000 7fb1bafa79c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_dests= new_dests= 2024-09-12T00:41:02.595 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.598+0000 7fb1bafa79c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential dests added=[] removed=[] 2024-09-12T00:41:02.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.606+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.0 2024-09-12T00:41:02.602 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.606+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.0 2024-09-12T00:41:02.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.606+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.1 2024-09-12T00:41:02.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.606+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.1 2024-09-12T00:41:02.603 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.610+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.2 2024-09-12T00:41:02.604 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.610+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.2 2024-09-12T00:41:02.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.610+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.3 2024-09-12T00:41:02.605 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.610+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.3 2024-09-12T00:41:02.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.610+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.4 2024-09-12T00:41:02.606 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.610+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.4 2024-09-12T00:41:02.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.610+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.5 2024-09-12T00:41:02.607 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.610+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.5 2024-09-12T00:41:02.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.614+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.6 2024-09-12T00:41:02.608 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.614+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.6 2024-09-12T00:41:02.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.614+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.7 2024-09-12T00:41:02.609 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.614+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.7 2024-09-12T00:41:02.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.614+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.8 2024-09-12T00:41:02.610 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.614+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.8 2024-09-12T00:41:02.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.614+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.9 2024-09-12T00:41:02.611 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.614+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.9 2024-09-12T00:41:02.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.618+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.10 2024-09-12T00:41:02.612 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.618+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.10 2024-09-12T00:41:02.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.618+0000 7fb1bafa79c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.11 2024-09-12T00:41:02.613 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.618+0000 7fb1bafa79c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.1.11 2024-09-12T00:41:02.616 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.622+0000 7fb1bafa79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:41:02.617 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.622+0000 7fb1bafa79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 2024-09-12T00:41:02.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.626+0000 7fb1bafa79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:41:02.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.626+0000 7fb1bafa79c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:41:02.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.626+0000 7fb1bafa79c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:02.620 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.626+0000 7fb1bafa79c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18, ofs0, ns] 2024-09-12T00:41:02.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.626+0000 7fb08f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333485 cookie 94129666332720 notifier 8093 bl.length()=789 2024-09-12T00:41:02.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.626+0000 7fb08f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:41:02.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.626+0000 7fb08f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:41:02.621 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.626+0000 7fb08f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:02.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.626+0000 7fb1bafa79c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_sources= new_sources= 2024-09-12T00:41:02.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.626+0000 7fb1bafa79c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential sources added=[] removed=[] 2024-09-12T00:41:02.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.626+0000 7fb1bafa79c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_dests= new_dests= 2024-09-12T00:41:02.622 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.626+0000 7fb1bafa79c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential dests added=[] removed=[] 2024-09-12T00:41:02.628 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.634+0000 7fb1bafa79c0 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-12T00:41:02.633 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.638+0000 7fb06f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:02.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.642+0000 7fb1bafa79c0 20 remove_watcher() i=0 2024-09-12T00:41:02.638 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.642+0000 7fb1bafa79c0 2 removed watcher, disabling cache 2024-09-12T00:41:02.640 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.646+0000 7fb1bafa79c0 20 remove_watcher() i=1 2024-09-12T00:41:02.643 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.646+0000 7fb1bafa79c0 20 remove_watcher() i=2 2024-09-12T00:41:02.645 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.650+0000 7fb1bafa79c0 20 remove_watcher() i=3 2024-09-12T00:41:02.648 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.654+0000 7fb1bafa79c0 20 remove_watcher() i=4 2024-09-12T00:41:02.650 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.654+0000 7fb1bafa79c0 20 remove_watcher() i=5 2024-09-12T00:41:02.653 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.658+0000 7fb1bafa79c0 20 remove_watcher() i=6 2024-09-12T00:41:02.655 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:02.658+0000 7fb1bafa79c0 20 remove_watcher() i=7 2024-09-12T00:41:03.245 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T00:41:03.245 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T00:41:03.250 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:03.250 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:03.261 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:03.261 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:03.308 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:03.308 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:03.350 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:03.350 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:03.359 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:03.359 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:03.396 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:03.397 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:03.406 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:03.406 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:03.441 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:03.441 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:03.447 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:41:03.886 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:41:05.325 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:05.325 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:05.397 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:41:05.398 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T00:41:05.433 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:05.433 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:05.477 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.482+0000 7f8c7f2579c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.486+0000 7f8c7f2579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:05.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.486+0000 7f8c7f2579c0 20 realm 2024-09-12T00:41:05.480 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.486+0000 7f8c7f2579c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.486+0000 7f8c7f2579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:05.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.486+0000 7f8c7f2579c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:05.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.486+0000 7f8c7f2579c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.486+0000 7f8c7f2579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:05.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.486+0000 7f8c7f2579c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.486+0000 7f8c7f2579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:05.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.486+0000 7f8c7f2579c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.486+0000 7f8c7f2579c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:05.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.486+0000 7f8c7f2579c0 20 searching for the correct realm 2024-09-12T00:41:05.488 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.494+0000 7f8c7d55e640 0 -- 172.21.15.138:0/2413107345 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f8c741023a0 msgr2=0x7f8c74125a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:05.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.710+0000 7f8c7d55e640 0 -- 172.21.15.138:0/2413107345 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55c2221387a0 msgr2=0x55c22213ac60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:05.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.718+0000 7f8c7f2579c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:41:05.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.718+0000 7f8c7f2579c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:05.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.718+0000 7f8c7f2579c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:41:05.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.718+0000 7f8c7f2579c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:05.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.718+0000 7f8c7f2579c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:05.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.718+0000 7f8c7f2579c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:05.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.718+0000 7f8c7f2579c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.718+0000 7f8c7f2579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:05.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.718+0000 7f8c7f2579c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.718+0000 7f8c7f2579c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:05.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.718+0000 7f8c7f2579c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.722+0000 7f8c7f2579c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:05.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.722+0000 7f8c7f2579c0 20 zone default found 2024-09-12T00:41:05.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.722+0000 7f8c7f2579c0 4 Realm: () 2024-09-12T00:41:05.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.722+0000 7f8c7f2579c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:41:05.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.722+0000 7f8c7f2579c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:41:05.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.722+0000 7f8c7f2579c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:05.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.722+0000 7f8c7f2579c0 20 zonegroup default 2024-09-12T00:41:05.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.722+0000 7f8c7f2579c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.722+0000 7f8c7f2579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:05.717 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.722+0000 7f8c7f2579c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.722+0000 7f8c7f2579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:05.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.722+0000 7f8c7f2579c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.722+0000 7f8c7f2579c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:05.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.722+0000 7f8c7f2579c0 20 started sync module instance, tier type = 2024-09-12T00:41:05.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.722+0000 7f8c7f2579c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:41:05.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.746+0000 7f8c7f2579c0 20 add_watcher() i=0 2024-09-12T00:41:05.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.746+0000 7f8c7f2579c0 20 add_watcher() i=1 2024-09-12T00:41:05.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.746+0000 7f8c7f2579c0 20 add_watcher() i=2 2024-09-12T00:41:05.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.746+0000 7f8c7f2579c0 20 add_watcher() i=3 2024-09-12T00:41:05.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.746+0000 7f8c7f2579c0 20 add_watcher() i=4 2024-09-12T00:41:05.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.746+0000 7f8c7f2579c0 20 add_watcher() i=5 2024-09-12T00:41:05.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.746+0000 7f8c7f2579c0 20 add_watcher() i=6 2024-09-12T00:41:05.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.750+0000 7f8c7f2579c0 20 add_watcher() i=7 2024-09-12T00:41:05.744 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.750+0000 7f8c7f2579c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:05.749 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.754+0000 7f8b32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:05.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.754+0000 7f8c7f2579c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:05.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.754+0000 7f8c7f2579c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:05.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.754+0000 7f8c7f2579c0 5 note: GC not initialized 2024-09-12T00:41:05.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.754+0000 7f8b31fe3640 20 reqs_thread_entry: start 2024-09-12T00:41:05.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.754+0000 7f8c7f2579c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:05.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.754+0000 7f8c7f2579c0 20 Filter name: none 2024-09-12T00:41:05.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.754+0000 7f8aa37fe640 20 reqs_thread_entry: start 2024-09-12T00:41:05.751 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.754+0000 7f8c7f2579c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.758+0000 7f8c7f2579c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:41:05.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.758+0000 7f8c7f2579c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.758+0000 7f8c7f2579c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:41:05.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.758+0000 7f8c7f2579c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:05.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.758+0000 7f8c7f2579c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:41:05.753 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.758+0000 7f8c7f2579c0 20 INFO: main: starting shard=0 2024-09-12T00:41:05.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.758+0000 7f8c7f2579c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.0 2024-09-12T00:41:05.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.758+0000 7f8c7f2579c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.0 2024-09-12T00:41:05.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.758+0000 7f8c7f2579c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:05.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.758+0000 7f8c7f2579c0 20 INFO: main: starting shard=1 2024-09-12T00:41:05.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.758+0000 7f8c7f2579c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.1 2024-09-12T00:41:05.754 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.758+0000 7f8c7f2579c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.1 2024-09-12T00:41:05.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.758+0000 7f8c7f2579c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:05.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.758+0000 7f8c7f2579c0 20 INFO: main: starting shard=2 2024-09-12T00:41:05.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.758+0000 7f8c7f2579c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.2 2024-09-12T00:41:05.755 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.758+0000 7f8c7f2579c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.2 2024-09-12T00:41:05.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.762+0000 7f8c7f2579c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:05.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.762+0000 7f8c7f2579c0 20 INFO: main: starting shard=3 2024-09-12T00:41:05.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.762+0000 7f8c7f2579c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.3 2024-09-12T00:41:05.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.762+0000 7f8c7f2579c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.3 2024-09-12T00:41:05.757 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.762+0000 7f8c7f2579c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:05.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.762+0000 7f8c7f2579c0 20 INFO: main: starting shard=4 2024-09-12T00:41:05.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.762+0000 7f8c7f2579c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.4 2024-09-12T00:41:05.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.762+0000 7f8c7f2579c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.4 2024-09-12T00:41:05.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.762+0000 7f8c7f2579c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:05.758 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.762+0000 7f8c7f2579c0 20 INFO: main: starting shard=5 2024-09-12T00:41:05.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.762+0000 7f8c7f2579c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.5 2024-09-12T00:41:05.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.762+0000 7f8c7f2579c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.5 2024-09-12T00:41:05.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.762+0000 7f8c7f2579c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:41:05.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.762+0000 7f8c7f2579c0 20 INFO: main: starting shard=6 2024-09-12T00:41:05.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.762+0000 7f8c7f2579c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.6 2024-09-12T00:41:05.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.762+0000 7f8c7f2579c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.6 2024-09-12T00:41:05.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.766+0000 7f8c7f2579c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:05.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.766+0000 7f8c7f2579c0 20 INFO: main: starting shard=7 2024-09-12T00:41:05.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.766+0000 7f8c7f2579c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.7 2024-09-12T00:41:05.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.766+0000 7f8c7f2579c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.7 2024-09-12T00:41:05.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.766+0000 7f8c7f2579c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:05.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.766+0000 7f8c7f2579c0 20 INFO: main: starting shard=8 2024-09-12T00:41:05.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.766+0000 7f8c7f2579c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.8 2024-09-12T00:41:05.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.766+0000 7f8c7f2579c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.8 2024-09-12T00:41:05.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.766+0000 7f8c7f2579c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.766+0000 7f8c7f2579c0 20 INFO: main: starting shard=9 2024-09-12T00:41:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.766+0000 7f8c7f2579c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.9 2024-09-12T00:41:05.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.766+0000 7f8c7f2579c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.9 2024-09-12T00:41:05.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.770+0000 7f8c7f2579c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:05.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.770+0000 7f8c7f2579c0 20 INFO: main: starting shard=10 2024-09-12T00:41:05.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.770+0000 7f8c7f2579c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.10 2024-09-12T00:41:05.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.770+0000 7f8c7f2579c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.10 2024-09-12T00:41:05.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.770+0000 7f8c7f2579c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:05.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.770+0000 7f8c7f2579c0 20 INFO: main: starting shard=11 2024-09-12T00:41:05.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.770+0000 7f8c7f2579c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.11 2024-09-12T00:41:05.765 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.770+0000 7f8c7f2579c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.11 2024-09-12T00:41:05.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.770+0000 7f8c7f2579c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:05.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.770+0000 7f8c7f2579c0 20 INFO: main: starting shard=12 2024-09-12T00:41:05.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.770+0000 7f8c7f2579c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.12 2024-09-12T00:41:05.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.770+0000 7f8c7f2579c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.12 2024-09-12T00:41:05.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.770+0000 7f8c7f2579c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:05.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.770+0000 7f8c7f2579c0 20 INFO: main: done 2024-09-12T00:41:05.769 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.774+0000 7f8b32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:05.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.778+0000 7f8c7f2579c0 20 remove_watcher() i=0 2024-09-12T00:41:05.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.778+0000 7f8c7f2579c0 2 removed watcher, disabling cache 2024-09-12T00:41:05.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.782+0000 7f8c7f2579c0 20 remove_watcher() i=1 2024-09-12T00:41:05.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.782+0000 7f8c7f2579c0 20 remove_watcher() i=2 2024-09-12T00:41:05.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.786+0000 7f8c7f2579c0 20 remove_watcher() i=3 2024-09-12T00:41:05.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.786+0000 7f8c7f2579c0 20 remove_watcher() i=4 2024-09-12T00:41:05.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.790+0000 7f8c7f2579c0 20 remove_watcher() i=5 2024-09-12T00:41:05.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.790+0000 7f8c7f2579c0 20 remove_watcher() i=6 2024-09-12T00:41:05.790 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.794+0000 7f8c7f2579c0 20 remove_watcher() i=7 2024-09-12T00:41:05.809 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:05.809 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:05.814 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:05.815 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:05.881 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:41:05.881 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T00:41:05.916 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:05.916 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:05.960 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.966+0000 7f232b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.966+0000 7f232b0189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:05.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.966+0000 7f232b0189c0 20 realm 2024-09-12T00:41:05.963 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.966+0000 7f232b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.966+0000 7f232b0189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:05.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.966+0000 7f232b0189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:05.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.966+0000 7f232b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.970+0000 7f232b0189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:05.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.970+0000 7f232b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.970+0000 7f232b0189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:05.964 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.970+0000 7f232b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:05.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.970+0000 7f232b0189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:05.965 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.970+0000 7f232b0189c0 20 searching for the correct realm 2024-09-12T00:41:05.970 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:05.974+0000 7f232931f640 0 -- 172.21.15.138:0/194096288 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f23200aa3d0 msgr2=0x7f23200aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:06.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.190+0000 7f232931f640 0 -- 172.21.15.138:0/194096288 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55f489562260 msgr2=0x55f489564720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:06.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.198+0000 7f232b0189c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:41:06.193 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.198+0000 7f232b0189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:06.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.198+0000 7f232b0189c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:41:06.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.198+0000 7f232b0189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:06.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.198+0000 7f232b0189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:06.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.198+0000 7f232b0189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:06.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.198+0000 7f232b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.194 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.198+0000 7f232b0189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.198+0000 7f232b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.198+0000 7f232b0189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:06.195 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.198+0000 7f232b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.202+0000 7f232b0189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:06.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.202+0000 7f232b0189c0 20 zone default found 2024-09-12T00:41:06.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.202+0000 7f232b0189c0 4 Realm: () 2024-09-12T00:41:06.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.202+0000 7f232b0189c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:41:06.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.202+0000 7f232b0189c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:41:06.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.202+0000 7f232b0189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:06.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.202+0000 7f232b0189c0 20 zonegroup default 2024-09-12T00:41:06.196 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.202+0000 7f232b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.202+0000 7f232b0189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.202+0000 7f232b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.202+0000 7f232b0189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.197 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.202+0000 7f232b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.198 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.202+0000 7f232b0189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.202+0000 7f232b0189c0 20 started sync module instance, tier type = 2024-09-12T00:41:06.199 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.202+0000 7f232b0189c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:41:06.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.226+0000 7f232b0189c0 20 add_watcher() i=0 2024-09-12T00:41:06.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.226+0000 7f232b0189c0 20 add_watcher() i=1 2024-09-12T00:41:06.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.226+0000 7f232b0189c0 20 add_watcher() i=2 2024-09-12T00:41:06.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.226+0000 7f232b0189c0 20 add_watcher() i=3 2024-09-12T00:41:06.221 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.226+0000 7f232b0189c0 20 add_watcher() i=4 2024-09-12T00:41:06.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.226+0000 7f232b0189c0 20 add_watcher() i=5 2024-09-12T00:41:06.222 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.226+0000 7f232b0189c0 20 add_watcher() i=6 2024-09-12T00:41:06.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.230+0000 7f232b0189c0 20 add_watcher() i=7 2024-09-12T00:41:06.224 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.230+0000 7f232b0189c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:06.228 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.234+0000 7f21defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:06.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.234+0000 7f232b0189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:06.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.234+0000 7f232b0189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:06.229 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.234+0000 7f232b0189c0 5 note: GC not initialized 2024-09-12T00:41:06.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.234+0000 7f21ddfe3640 20 reqs_thread_entry: start 2024-09-12T00:41:06.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.234+0000 7f232b0189c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:06.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.234+0000 7f232b0189c0 20 Filter name: none 2024-09-12T00:41:06.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.234+0000 7f214f7fe640 20 reqs_thread_entry: start 2024-09-12T00:41:06.230 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.234+0000 7f232b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.234+0000 7f232b0189c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:41:06.231 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.234+0000 7f232b0189c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.238+0000 7f232b0189c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:41:06.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.238+0000 7f232b0189c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:06.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.238+0000 7f232b0189c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:41:06.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.238+0000 7f232b0189c0 20 INFO: main: starting shard=0 2024-09-12T00:41:06.232 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.238+0000 7f232b0189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.0 2024-09-12T00:41:06.233 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.238+0000 7f232b0189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.0 2024-09-12T00:41:06.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.238+0000 7f232b0189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.238+0000 7f232b0189c0 20 INFO: main: starting shard=1 2024-09-12T00:41:06.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.238+0000 7f232b0189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.1 2024-09-12T00:41:06.234 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.238+0000 7f232b0189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.1 2024-09-12T00:41:06.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.238+0000 7f232b0189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.238+0000 7f232b0189c0 20 INFO: main: starting shard=2 2024-09-12T00:41:06.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.238+0000 7f232b0189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.2 2024-09-12T00:41:06.235 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.238+0000 7f232b0189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.2 2024-09-12T00:41:06.236 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.242+0000 7f232b0189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.242+0000 7f232b0189c0 20 INFO: main: starting shard=3 2024-09-12T00:41:06.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.242+0000 7f232b0189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.3 2024-09-12T00:41:06.237 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.242+0000 7f232b0189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.3 2024-09-12T00:41:06.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.242+0000 7f232b0189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.242+0000 7f232b0189c0 20 INFO: main: starting shard=4 2024-09-12T00:41:06.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.242+0000 7f232b0189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.4 2024-09-12T00:41:06.238 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.242+0000 7f232b0189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.4 2024-09-12T00:41:06.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.242+0000 7f232b0189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.242+0000 7f232b0189c0 20 INFO: main: starting shard=5 2024-09-12T00:41:06.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.242+0000 7f232b0189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.5 2024-09-12T00:41:06.239 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.242+0000 7f232b0189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.5 2024-09-12T00:41:06.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 20 INFO: main: starting shard=6 2024-09-12T00:41:06.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.6 2024-09-12T00:41:06.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.6 2024-09-12T00:41:06.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.240 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 20 INFO: main: starting shard=7 2024-09-12T00:41:06.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.7 2024-09-12T00:41:06.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.7 2024-09-12T00:41:06.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 20 INFO: main: starting shard=8 2024-09-12T00:41:06.241 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.8 2024-09-12T00:41:06.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.8 2024-09-12T00:41:06.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 20 INFO: main: starting shard=9 2024-09-12T00:41:06.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.9 2024-09-12T00:41:06.242 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.9 2024-09-12T00:41:06.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:41:06.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 20 INFO: main: starting shard=10 2024-09-12T00:41:06.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.10 2024-09-12T00:41:06.243 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.246+0000 7f232b0189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.10 2024-09-12T00:41:06.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.250+0000 7f232b0189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.250+0000 7f232b0189c0 20 INFO: main: starting shard=11 2024-09-12T00:41:06.244 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.250+0000 7f232b0189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.11 2024-09-12T00:41:06.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.250+0000 7f232b0189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.11 2024-09-12T00:41:06.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.250+0000 7f232b0189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.245 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.250+0000 7f232b0189c0 20 INFO: main: starting shard=12 2024-09-12T00:41:06.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.250+0000 7f232b0189c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.12 2024-09-12T00:41:06.246 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.250+0000 7f232b0189c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.12 2024-09-12T00:41:06.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.250+0000 7f232b0189c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.247 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.250+0000 7f232b0189c0 20 INFO: main: done 2024-09-12T00:41:06.248 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.254+0000 7f21defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:06.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.258+0000 7f232b0189c0 20 remove_watcher() i=0 2024-09-12T00:41:06.253 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.258+0000 7f232b0189c0 2 removed watcher, disabling cache 2024-09-12T00:41:06.255 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.258+0000 7f232b0189c0 20 remove_watcher() i=1 2024-09-12T00:41:06.257 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.262+0000 7f232b0189c0 20 remove_watcher() i=2 2024-09-12T00:41:06.259 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.262+0000 7f232b0189c0 20 remove_watcher() i=3 2024-09-12T00:41:06.262 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.266+0000 7f232b0189c0 20 remove_watcher() i=4 2024-09-12T00:41:06.264 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.270+0000 7f232b0189c0 20 remove_watcher() i=5 2024-09-12T00:41:06.267 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.270+0000 7f232b0189c0 20 remove_watcher() i=6 2024-09-12T00:41:06.269 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.274+0000 7f232b0189c0 20 remove_watcher() i=7 2024-09-12T00:41:06.291 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:06.291 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:06.296 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:06.296 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:06.365 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:41:06.365 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T00:41:06.400 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:06.400 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:06.444 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.450+0000 7fcc784b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.450+0000 7fcc784b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.450+0000 7fcc784b29c0 20 realm 2024-09-12T00:41:06.446 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.450+0000 7fcc784b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.450+0000 7fcc784b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.450+0000 7fcc784b29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:06.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.450+0000 7fcc784b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.450+0000 7fcc784b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.447 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.450+0000 7fcc784b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.454+0000 7fcc784b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:06.448 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.454+0000 7fcc784b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.454+0000 7fcc784b29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:06.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.454+0000 7fcc784b29c0 20 searching for the correct realm 2024-09-12T00:41:06.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.458+0000 7fcc767b9640 0 -- 172.21.15.138:0/1608552102 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fcc70013030 msgr2=0x7fcc70013410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:06.669 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.674+0000 7fcc767b9640 0 -- 172.21.15.138:0/1608552102 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5649e08f9b20 msgr2=0x5649e08fbfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:06.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.682+0000 7fcc784b29c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:41:06.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.682+0000 7fcc784b29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:06.678 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.682+0000 7fcc784b29c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:41:06.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.682+0000 7fcc784b29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:06.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.682+0000 7fcc784b29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:06.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.682+0000 7fcc784b29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:06.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.682+0000 7fcc784b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.682+0000 7fcc784b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.679 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.682+0000 7fcc784b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.686+0000 7fcc784b29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:06.680 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.686+0000 7fcc784b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.686+0000 7fcc784b29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:06.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.686+0000 7fcc784b29c0 20 zone default found 2024-09-12T00:41:06.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.686+0000 7fcc784b29c0 4 Realm: () 2024-09-12T00:41:06.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.686+0000 7fcc784b29c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:41:06.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.686+0000 7fcc784b29c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:41:06.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.686+0000 7fcc784b29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:06.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.686+0000 7fcc784b29c0 20 zonegroup default 2024-09-12T00:41:06.681 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.686+0000 7fcc784b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.686+0000 7fcc784b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.686+0000 7fcc784b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.686+0000 7fcc784b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.682 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.686+0000 7fcc784b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.686+0000 7fcc784b29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:06.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.686+0000 7fcc784b29c0 20 started sync module instance, tier type = 2024-09-12T00:41:06.683 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.686+0000 7fcc784b29c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:41:06.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.710+0000 7fcc784b29c0 20 add_watcher() i=0 2024-09-12T00:41:06.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.710+0000 7fcc784b29c0 20 add_watcher() i=1 2024-09-12T00:41:06.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.710+0000 7fcc784b29c0 20 add_watcher() i=2 2024-09-12T00:41:06.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.710+0000 7fcc784b29c0 20 add_watcher() i=3 2024-09-12T00:41:06.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.710+0000 7fcc784b29c0 20 add_watcher() i=4 2024-09-12T00:41:06.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.710+0000 7fcc784b29c0 20 add_watcher() i=5 2024-09-12T00:41:06.705 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.710+0000 7fcc784b29c0 20 add_watcher() i=6 2024-09-12T00:41:06.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.710+0000 7fcc784b29c0 20 add_watcher() i=7 2024-09-12T00:41:06.707 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.710+0000 7fcc784b29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:06.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.714+0000 7fcb277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:06.712 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.718+0000 7fcc784b29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:06.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.718+0000 7fcc784b29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:06.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.718+0000 7fcc784b29c0 5 note: GC not initialized 2024-09-12T00:41:06.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.718+0000 7fcb267fc640 20 reqs_thread_entry: start 2024-09-12T00:41:06.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.718+0000 7fcc784b29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:06.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.718+0000 7fcc784b29c0 20 Filter name: none 2024-09-12T00:41:06.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.718+0000 7fca97fff640 20 reqs_thread_entry: start 2024-09-12T00:41:06.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.718+0000 7fcc784b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.718+0000 7fcc784b29c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:41:06.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.718+0000 7fcc784b29c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:06.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.722+0000 7fcc784b29c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:41:06.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.722+0000 7fcc784b29c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:06.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.722+0000 7fcc784b29c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:41:06.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.722+0000 7fcc784b29c0 20 INFO: main: starting shard=0 2024-09-12T00:41:06.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.722+0000 7fcc784b29c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.0 2024-09-12T00:41:06.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.722+0000 7fcc784b29c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.0 2024-09-12T00:41:06.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.722+0000 7fcc784b29c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:41:06.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.722+0000 7fcc784b29c0 20 INFO: main: starting shard=1 2024-09-12T00:41:06.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.722+0000 7fcc784b29c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.1 2024-09-12T00:41:06.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.722+0000 7fcc784b29c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.1 2024-09-12T00:41:06.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.722+0000 7fcc784b29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.718 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.722+0000 7fcc784b29c0 20 INFO: main: starting shard=2 2024-09-12T00:41:06.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.722+0000 7fcc784b29c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.2 2024-09-12T00:41:06.719 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.722+0000 7fcc784b29c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.2 2024-09-12T00:41:06.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 20 INFO: main: starting shard=3 2024-09-12T00:41:06.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.3 2024-09-12T00:41:06.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.3 2024-09-12T00:41:06.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 20 INFO: main: starting shard=4 2024-09-12T00:41:06.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.4 2024-09-12T00:41:06.721 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.4 2024-09-12T00:41:06.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 20 INFO: main: starting shard=5 2024-09-12T00:41:06.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.5 2024-09-12T00:41:06.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.5 2024-09-12T00:41:06.722 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 20 INFO: main: starting shard=6 2024-09-12T00:41:06.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.6 2024-09-12T00:41:06.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.6 2024-09-12T00:41:06.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 20 INFO: main: starting shard=7 2024-09-12T00:41:06.723 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.7 2024-09-12T00:41:06.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.726+0000 7fcc784b29c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.7 2024-09-12T00:41:06.724 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.730+0000 7fcc784b29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.730+0000 7fcc784b29c0 20 INFO: main: starting shard=8 2024-09-12T00:41:06.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.730+0000 7fcc784b29c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.8 2024-09-12T00:41:06.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.730+0000 7fcc784b29c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.8 2024-09-12T00:41:06.725 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.730+0000 7fcc784b29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.730+0000 7fcc784b29c0 20 INFO: main: starting shard=9 2024-09-12T00:41:06.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.730+0000 7fcc784b29c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.9 2024-09-12T00:41:06.726 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.730+0000 7fcc784b29c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.9 2024-09-12T00:41:06.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.730+0000 7fcc784b29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.730+0000 7fcc784b29c0 20 INFO: main: starting shard=10 2024-09-12T00:41:06.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.730+0000 7fcc784b29c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.10 2024-09-12T00:41:06.727 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.730+0000 7fcc784b29c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.10 2024-09-12T00:41:06.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.734+0000 7fcc784b29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.734+0000 7fcc784b29c0 20 INFO: main: starting shard=11 2024-09-12T00:41:06.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.734+0000 7fcc784b29c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.11 2024-09-12T00:41:06.728 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.734+0000 7fcc784b29c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.11 2024-09-12T00:41:06.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.734+0000 7fcc784b29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.734+0000 7fcc784b29c0 20 INFO: main: starting shard=12 2024-09-12T00:41:06.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.734+0000 7fcc784b29c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.12 2024-09-12T00:41:06.729 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.734+0000 7fcc784b29c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.12 2024-09-12T00:41:06.730 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.734+0000 7fcc784b29c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:41:06.731 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.734+0000 7fcc784b29c0 20 INFO: main: done 2024-09-12T00:41:06.732 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.738+0000 7fcb277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:06.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.742+0000 7fcc784b29c0 20 remove_watcher() i=0 2024-09-12T00:41:06.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.742+0000 7fcc784b29c0 2 removed watcher, disabling cache 2024-09-12T00:41:06.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.742+0000 7fcc784b29c0 20 remove_watcher() i=1 2024-09-12T00:41:06.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.746+0000 7fcc784b29c0 20 remove_watcher() i=2 2024-09-12T00:41:06.743 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.746+0000 7fcc784b29c0 20 remove_watcher() i=3 2024-09-12T00:41:06.745 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.750+0000 7fcc784b29c0 20 remove_watcher() i=4 2024-09-12T00:41:06.747 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.750+0000 7fcc784b29c0 20 remove_watcher() i=5 2024-09-12T00:41:06.750 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.754+0000 7fcc784b29c0 20 remove_watcher() i=6 2024-09-12T00:41:06.752 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:06.758+0000 7fcc784b29c0 20 remove_watcher() i=7 2024-09-12T00:41:06.778 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:06.778 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:06.781 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:41:07.219 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:41:07.645 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T00:41:07.672 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:07.672 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:07.711 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.714+0000 7fd830bce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.718+0000 7fd830bce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.718+0000 7fd830bce9c0 20 realm 2024-09-12T00:41:07.713 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.718+0000 7fd830bce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.718+0000 7fd830bce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.718+0000 7fd830bce9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:07.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.718+0000 7fd830bce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.718+0000 7fd830bce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.714 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.718+0000 7fd830bce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.718+0000 7fd830bce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:07.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.718+0000 7fd830bce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.715 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.722+0000 7fd830bce9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:07.716 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.722+0000 7fd830bce9c0 20 searching for the correct realm 2024-09-12T00:41:07.720 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.726+0000 7fd82eed5640 0 -- 172.21.15.138:0/1008844042 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fd828086330 msgr2=0x7fd82805c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:07.938 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.942+0000 7fd82eed5640 0 -- 172.21.15.138:0/1008844042 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55bf2ca6b9f0 msgr2=0x55bf2ca6deb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:07.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.950+0000 7fd830bce9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:41:07.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.950+0000 7fd830bce9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:07.946 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.950+0000 7fd830bce9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:41:07.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.950+0000 7fd830bce9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:07.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.950+0000 7fd830bce9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:07.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.950+0000 7fd830bce9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:07.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.950+0000 7fd830bce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.950+0000 7fd830bce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.947 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.950+0000 7fd830bce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.954+0000 7fd830bce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:07.948 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.954+0000 7fd830bce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.954+0000 7fd830bce9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:07.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.954+0000 7fd830bce9c0 20 zone default found 2024-09-12T00:41:07.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.954+0000 7fd830bce9c0 4 Realm: () 2024-09-12T00:41:07.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.954+0000 7fd830bce9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:41:07.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.954+0000 7fd830bce9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:41:07.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.954+0000 7fd830bce9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:07.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.954+0000 7fd830bce9c0 20 zonegroup default 2024-09-12T00:41:07.949 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.954+0000 7fd830bce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.954+0000 7fd830bce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.954+0000 7fd830bce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.954+0000 7fd830bce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.950 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.954+0000 7fd830bce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.954+0000 7fd830bce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:07.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.954+0000 7fd830bce9c0 20 started sync module instance, tier type = 2024-09-12T00:41:07.951 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.954+0000 7fd830bce9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:41:07.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.978+0000 7fd830bce9c0 20 add_watcher() i=0 2024-09-12T00:41:07.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.978+0000 7fd830bce9c0 20 add_watcher() i=1 2024-09-12T00:41:07.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.978+0000 7fd830bce9c0 20 add_watcher() i=2 2024-09-12T00:41:07.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.978+0000 7fd830bce9c0 20 add_watcher() i=3 2024-09-12T00:41:07.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.978+0000 7fd830bce9c0 20 add_watcher() i=4 2024-09-12T00:41:07.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.978+0000 7fd830bce9c0 20 add_watcher() i=5 2024-09-12T00:41:07.974 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.978+0000 7fd830bce9c0 20 add_watcher() i=6 2024-09-12T00:41:07.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.982+0000 7fd830bce9c0 20 add_watcher() i=7 2024-09-12T00:41:07.976 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.982+0000 7fd830bce9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:07.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.986+0000 7fd6e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:07.981 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.986+0000 7fd830bce9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:07.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.986+0000 7fd830bce9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:07.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.986+0000 7fd830bce9c0 5 note: GC not initialized 2024-09-12T00:41:07.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.986+0000 7fd65f7fe640 20 reqs_thread_entry: start 2024-09-12T00:41:07.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.986+0000 7fd830bce9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:07.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.986+0000 7fd830bce9c0 20 Filter name: none 2024-09-12T00:41:07.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.986+0000 7fd65d7fa640 20 reqs_thread_entry: start 2024-09-12T00:41:07.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.986+0000 7fd830bce9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:41:07.983 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.986+0000 7fd830bce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.990+0000 7fd830bce9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:41:07.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.990+0000 7fd830bce9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:41:07.984 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.990+0000 7fd830bce9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:41:07.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.990+0000 7fd830bce9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 : miss 2024-09-12T00:41:07.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.990+0000 7fd830bce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:07.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.990+0000 7fd830bce9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:41:07.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.990+0000 7fd830bce9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:41:07.985 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.990+0000 7fd830bce9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:41:07.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.990+0000 7fd830bce9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:07.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.990+0000 7fd830bce9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:07.986 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:07.990+0000 7fd830bce9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 2024-09-12T00:41:08.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.006+0000 7fd830bce9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:41:08.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.006+0000 7fd830bce9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:41:08.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.006+0000 7fd830bce9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:08.000 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.006+0000 7fd830bce9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18, ofs0, ns] 2024-09-12T00:41:08.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.006+0000 7fd711ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333486 cookie 94279576252592 notifier 8171 bl.length()=821 2024-09-12T00:41:08.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.006+0000 7fd711ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:41:08.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.006+0000 7fd711ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:41:08.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.006+0000 7fd711ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:08.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.006+0000 7fd830bce9c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_sources= new_sources= 2024-09-12T00:41:08.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.006+0000 7fd830bce9c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential sources added=[] removed=[] 2024-09-12T00:41:08.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.006+0000 7fd830bce9c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_dests= new_dests= 2024-09-12T00:41:08.001 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.006+0000 7fd830bce9c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential dests added=[] removed=[] 2024-09-12T00:41:08.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.0 2024-09-12T00:41:08.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.0 2024-09-12T00:41:08.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.1 2024-09-12T00:41:08.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.1 2024-09-12T00:41:08.015 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.2 2024-09-12T00:41:08.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.2 2024-09-12T00:41:08.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.3 2024-09-12T00:41:08.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.3 2024-09-12T00:41:08.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.4 2024-09-12T00:41:08.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.4 2024-09-12T00:41:08.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.5 2024-09-12T00:41:08.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.5 2024-09-12T00:41:08.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.6 2024-09-12T00:41:08.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.6 2024-09-12T00:41:08.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.7 2024-09-12T00:41:08.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.7 2024-09-12T00:41:08.016 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.8 2024-09-12T00:41:08.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.8 2024-09-12T00:41:08.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.10 2024-09-12T00:41:08.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.10 2024-09-12T00:41:08.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.11 2024-09-12T00:41:08.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.11 2024-09-12T00:41:08.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.12 2024-09-12T00:41:08.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.12 2024-09-12T00:41:08.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.13 2024-09-12T00:41:08.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.13 2024-09-12T00:41:08.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.14 2024-09-12T00:41:08.017 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.14 2024-09-12T00:41:08.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.15 2024-09-12T00:41:08.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.15 2024-09-12T00:41:08.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.16 2024-09-12T00:41:08.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.16 2024-09-12T00:41:08.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.0 2024-09-12T00:41:08.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.018+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.0 2024-09-12T00:41:08.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.022+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.1 2024-09-12T00:41:08.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.022+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.1 2024-09-12T00:41:08.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.022+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.2 2024-09-12T00:41:08.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.022+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.2 2024-09-12T00:41:08.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.022+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.3 2024-09-12T00:41:08.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.022+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.3 2024-09-12T00:41:08.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.022+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.4 2024-09-12T00:41:08.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.022+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.4 2024-09-12T00:41:08.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.022+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.5 2024-09-12T00:41:08.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.022+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.5 2024-09-12T00:41:08.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.026+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.6 2024-09-12T00:41:08.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.026+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.6 2024-09-12T00:41:08.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.026+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.7 2024-09-12T00:41:08.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.026+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.7 2024-09-12T00:41:08.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.026+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.8 2024-09-12T00:41:08.022 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.026+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.8 2024-09-12T00:41:08.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.026+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.9 2024-09-12T00:41:08.023 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.026+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.9 2024-09-12T00:41:08.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.030+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.10 2024-09-12T00:41:08.024 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.030+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.10 2024-09-12T00:41:08.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.030+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.11 2024-09-12T00:41:08.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.030+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.11 2024-09-12T00:41:08.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.030+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.12 2024-09-12T00:41:08.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.030+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.12 2024-09-12T00:41:08.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.038+0000 7fd830bce9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:41:08.032 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.038+0000 7fd830bce9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 2024-09-12T00:41:08.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.038+0000 7fd830bce9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:41:08.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.038+0000 7fd830bce9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:41:08.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.038+0000 7fd830bce9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:08.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.042+0000 7fd830bce9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18, ofs0, ns] 2024-09-12T00:41:08.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.042+0000 7fd711ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333487 cookie 94279576252592 notifier 8171 bl.length()=821 2024-09-12T00:41:08.036 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.042+0000 7fd711ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:41:08.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.042+0000 7fd711ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:41:08.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.042+0000 7fd711ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:08.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.042+0000 7fd830bce9c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_sources= new_sources= 2024-09-12T00:41:08.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.042+0000 7fd830bce9c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential sources added=[] removed=[] 2024-09-12T00:41:08.037 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.042+0000 7fd830bce9c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_dests= new_dests= 2024-09-12T00:41:08.038 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.042+0000 7fd830bce9c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential dests added=[] removed=[] 2024-09-12T00:41:08.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.050+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.0 2024-09-12T00:41:08.044 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.050+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.0 2024-09-12T00:41:08.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.050+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.1 2024-09-12T00:41:08.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.050+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.1 2024-09-12T00:41:08.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.050+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.2 2024-09-12T00:41:08.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.050+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.2 2024-09-12T00:41:08.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.050+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.3 2024-09-12T00:41:08.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.050+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.3 2024-09-12T00:41:08.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.050+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.4 2024-09-12T00:41:08.046 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.050+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.4 2024-09-12T00:41:08.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.050+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.5 2024-09-12T00:41:08.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.050+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.5 2024-09-12T00:41:08.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.054+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.6 2024-09-12T00:41:08.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.054+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.6 2024-09-12T00:41:08.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.054+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.7 2024-09-12T00:41:08.048 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.054+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.7 2024-09-12T00:41:08.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.054+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.8 2024-09-12T00:41:08.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.054+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.8 2024-09-12T00:41:08.049 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.054+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.9 2024-09-12T00:41:08.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.054+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.9 2024-09-12T00:41:08.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.054+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.10 2024-09-12T00:41:08.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.054+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.10 2024-09-12T00:41:08.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.054+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.11 2024-09-12T00:41:08.051 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.054+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.11 2024-09-12T00:41:08.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.058+0000 7fd830bce9c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.12 2024-09-12T00:41:08.052 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.058+0000 7fd830bce9c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.2.12 2024-09-12T00:41:08.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.058+0000 7fd830bce9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:41:08.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.058+0000 7fd830bce9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 2024-09-12T00:41:08.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.062+0000 7fd830bce9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:41:08.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.062+0000 7fd830bce9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:41:08.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.062+0000 7fd830bce9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:08.056 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.062+0000 7fd830bce9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18, ofs0, ns] 2024-09-12T00:41:08.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.062+0000 7fd711ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333488 cookie 94279576252592 notifier 8171 bl.length()=789 2024-09-12T00:41:08.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.062+0000 7fd711ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:41:08.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.062+0000 7fd711ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:41:08.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.062+0000 7fd711ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:08.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.062+0000 7fd830bce9c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_sources= new_sources= 2024-09-12T00:41:08.057 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.062+0000 7fd830bce9c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential sources added=[] removed=[] 2024-09-12T00:41:08.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.062+0000 7fd830bce9c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): orig_dests= new_dests= 2024-09-12T00:41:08.058 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.062+0000 7fd830bce9c0 20 handle_bi_update(): bucket=:myver[e2043445-c131-4520-984d-b4d52f038a6b.4538.18]): potential dests added=[] removed=[] 2024-09-12T00:41:08.064 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.070+0000 7fd830bce9c0 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-12T00:41:08.067 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.070+0000 7fd6e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:08.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.074+0000 7fd830bce9c0 20 remove_watcher() i=0 2024-09-12T00:41:08.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.074+0000 7fd830bce9c0 2 removed watcher, disabling cache 2024-09-12T00:41:08.074 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.078+0000 7fd830bce9c0 20 remove_watcher() i=1 2024-09-12T00:41:08.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.082+0000 7fd830bce9c0 20 remove_watcher() i=2 2024-09-12T00:41:08.078 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.082+0000 7fd830bce9c0 20 remove_watcher() i=3 2024-09-12T00:41:08.080 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.086+0000 7fd830bce9c0 20 remove_watcher() i=4 2024-09-12T00:41:08.082 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.086+0000 7fd830bce9c0 20 remove_watcher() i=5 2024-09-12T00:41:08.085 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.090+0000 7fd830bce9c0 20 remove_watcher() i=6 2024-09-12T00:41:08.087 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.094+0000 7fd830bce9c0 20 remove_watcher() i=7 2024-09-12T00:41:08.103 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:41:08.139 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:08.140 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:08.181 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.186+0000 7fc94c8009c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.186+0000 7fc94c8009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:08.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.186+0000 7fc94c8009c0 20 realm 2024-09-12T00:41:08.183 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.186+0000 7fc94c8009c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.190+0000 7fc94c8009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:08.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.190+0000 7fc94c8009c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:08.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.190+0000 7fc94c8009c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.190+0000 7fc94c8009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:08.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.190+0000 7fc94c8009c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.190+0000 7fc94c8009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:08.185 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.190+0000 7fc94c8009c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.190+0000 7fc94c8009c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:08.186 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.190+0000 7fc94c8009c0 20 searching for the correct realm 2024-09-12T00:41:08.190 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.194+0000 7fc94ab07640 0 -- 172.21.15.138:0/1863334083 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fc944034440 msgr2=0x7fc9440348c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:41:08.406 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.410+0000 7fc94ab07640 0 -- 172.21.15.138:0/1863334083 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x562528901920 msgr2=0x562528903de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:08.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.418+0000 7fc94c8009c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:41:08.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.418+0000 7fc94c8009c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:08.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.418+0000 7fc94c8009c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:41:08.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.418+0000 7fc94c8009c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:08.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.418+0000 7fc94c8009c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:08.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.418+0000 7fc94c8009c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:08.415 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.418+0000 7fc94c8009c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.418+0000 7fc94c8009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:08.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.418+0000 7fc94c8009c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.416 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.422+0000 7fc94c8009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:08.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.422+0000 7fc94c8009c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.422+0000 7fc94c8009c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:08.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.422+0000 7fc94c8009c0 20 zone default found 2024-09-12T00:41:08.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.422+0000 7fc94c8009c0 4 Realm: () 2024-09-12T00:41:08.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.422+0000 7fc94c8009c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:41:08.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.422+0000 7fc94c8009c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:41:08.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.422+0000 7fc94c8009c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:08.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.422+0000 7fc94c8009c0 20 zonegroup default 2024-09-12T00:41:08.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.422+0000 7fc94c8009c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.418 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.422+0000 7fc94c8009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:08.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.422+0000 7fc94c8009c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.422+0000 7fc94c8009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:08.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.422+0000 7fc94c8009c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.426+0000 7fc94c8009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:08.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.426+0000 7fc94c8009c0 20 started sync module instance, tier type = 2024-09-12T00:41:08.420 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.426+0000 7fc94c8009c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:41:08.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.446+0000 7fc94c8009c0 20 add_watcher() i=0 2024-09-12T00:41:08.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.446+0000 7fc94c8009c0 20 add_watcher() i=1 2024-09-12T00:41:08.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.446+0000 7fc94c8009c0 20 add_watcher() i=2 2024-09-12T00:41:08.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.446+0000 7fc94c8009c0 20 add_watcher() i=3 2024-09-12T00:41:08.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.446+0000 7fc94c8009c0 20 add_watcher() i=4 2024-09-12T00:41:08.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.446+0000 7fc94c8009c0 20 add_watcher() i=5 2024-09-12T00:41:08.443 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.446+0000 7fc94c8009c0 20 add_watcher() i=6 2024-09-12T00:41:08.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.450+0000 7fc94c8009c0 20 add_watcher() i=7 2024-09-12T00:41:08.445 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.450+0000 7fc94c8009c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:08.449 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.454+0000 7fc800fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:08.450 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.454+0000 7fc94c8009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:08.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.454+0000 7fc94c8009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:08.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.454+0000 7fc94c8009c0 5 note: GC not initialized 2024-09-12T00:41:08.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.454+0000 7fc77b7fe640 20 reqs_thread_entry: start 2024-09-12T00:41:08.451 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.454+0000 7fc94c8009c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:08.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.454+0000 7fc94c8009c0 20 Filter name: none 2024-09-12T00:41:08.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.454+0000 7fc7797fa640 20 reqs_thread_entry: start 2024-09-12T00:41:08.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:41:08.452 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:41:08.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:41:08.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:41:08.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 : miss 2024-09-12T00:41:08.453 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:41:08.454 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 info.flags=0x17 2024-09-12T00:41:08.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 10 adding default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 to cache LRU end 2024-09-12T00:41:08.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:41:08.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:41:08.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:e2043445-c131-4520-984d-b4d52f038a6b.4538.18 2024-09-12T00:41:08.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.0 2024-09-12T00:41:08.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.0 2024-09-12T00:41:08.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:41:08.455 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.1 2024-09-12T00:41:08.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.458+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.1 2024-09-12T00:41:08.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.462+0000 7fc94c8009c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:41:08.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.462+0000 7fc94c8009c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.2 2024-09-12T00:41:08.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.462+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.2 2024-09-12T00:41:08.456 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.462+0000 7fc94c8009c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:41:08.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.462+0000 7fc94c8009c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.3 2024-09-12T00:41:08.457 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.462+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.3 2024-09-12T00:41:08.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.462+0000 7fc94c8009c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:41:08.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.462+0000 7fc94c8009c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.4 2024-09-12T00:41:08.458 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.462+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.4 2024-09-12T00:41:08.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.462+0000 7fc94c8009c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:41:08.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.462+0000 7fc94c8009c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.5 2024-09-12T00:41:08.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.462+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.5 2024-09-12T00:41:08.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.462+0000 7fc94c8009c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T00:41:08.459 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.462+0000 7fc94c8009c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.6 2024-09-12T00:41:08.460 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.462+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.6 2024-09-12T00:41:08.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.466+0000 7fc94c8009c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:41:08.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.466+0000 7fc94c8009c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.7 2024-09-12T00:41:08.461 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.466+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.7 2024-09-12T00:41:08.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.466+0000 7fc94c8009c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:41:08.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.466+0000 7fc94c8009c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.8 2024-09-12T00:41:08.462 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.466+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.8 2024-09-12T00:41:08.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.466+0000 7fc94c8009c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T00:41:08.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.466+0000 7fc94c8009c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.463 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.466+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.470+0000 7fc94c8009c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.10 2024-09-12T00:41:08.465 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.470+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.10 2024-09-12T00:41:08.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.470+0000 7fc94c8009c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:41:08.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.470+0000 7fc94c8009c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.11 2024-09-12T00:41:08.466 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.470+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.11 2024-09-12T00:41:08.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.470+0000 7fc94c8009c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T00:41:08.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.470+0000 7fc94c8009c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.12 2024-09-12T00:41:08.467 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.470+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.12 2024-09-12T00:41:08.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.474+0000 7fc94c8009c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T00:41:08.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.474+0000 7fc94c8009c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.13 2024-09-12T00:41:08.468 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.474+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.13 2024-09-12T00:41:08.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.474+0000 7fc94c8009c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T00:41:08.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.474+0000 7fc94c8009c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.14 2024-09-12T00:41:08.469 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.474+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.14 2024-09-12T00:41:08.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.474+0000 7fc94c8009c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T00:41:08.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.474+0000 7fc94c8009c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.15 2024-09-12T00:41:08.470 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.474+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.15 2024-09-12T00:41:08.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.474+0000 7fc94c8009c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T00:41:08.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.474+0000 7fc94c8009c0 10 bucket_obj is .dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.16 2024-09-12T00:41:08.471 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.474+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.16 2024-09-12T00:41:08.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.478+0000 7fc94c8009c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T00:41:08.472 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.478+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.473 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.478+0000 7fc94c8009c0 20 get_obj_state: octx=0x5625285f13b0 obj=myver:x state=0x5625289377e8 s->prefetch_data=0 2024-09-12T00:41:08.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.478+0000 7fc94c8009c0 20 get_obj_state: setting s->obj_tag to skfieh1hdsuvjapa58w2gkwbnelyf79u 2024-09-12T00:41:08.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.478+0000 7fc94c8009c0 20 get_obj_state_impl: setting s->olh_tag to rf5679zvoy0y6yhgssesc4lz7qgby26z 2024-09-12T00:41:08.474 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.478+0000 7fc94c8009c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rf5679zvoy0y6yhgssesc4lz7qgby26z 2024-09-12T00:41:08.478 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.482+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.481 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.486+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.486+0000 7fc94c8009c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T00:41:08.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.486+0000 7fc94c8009c0 20 olh_log_entry: epoch=2 op=3 key=x[YScvl9xtmgGZP1EEBFisNAJuR1gE4k2] 2024-09-12T00:41:08.482 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.486+0000 7fc94c8009c0 20 get_obj_state: octx=0x5625285f13b0 obj=myver:_:YScvl9xtmgGZP1EEBFisNAJuR1gE4k2_x state=0x562528931c48 s->prefetch_data=0 2024-09-12T00:41:08.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.486+0000 7fc94c8009c0 10 manifest: total_size = 9 2024-09-12T00:41:08.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.486+0000 7fc94c8009c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.14416893454949564663 2024-09-12T00:41:08.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.486+0000 7fc94c8009c0 20 get_obj_state: octx=0x5625285f13b0 obj=myver:_:YScvl9xtmgGZP1EEBFisNAJuR1gE4k2_x state=0x562528931c48 s->prefetch_data=0 2024-09-12T00:41:08.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.486+0000 7fc94c8009c0 20 prepare_atomic_modification: state is not atomic. state=0x562528931c48 2024-09-12T00:41:08.483 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.486+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.494+0000 7fc94c8009c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:41:08.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.494+0000 7fc94c8009c0 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T00:41:08.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.494+0000 7fc94c8009c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:41:08.490 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.494+0000 7fc94c8009c0 5 delete_objs_inline: removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.18__shadow:YScvl9xtmgGZP1EEBFisNAJuR1gE4k2_.39LTfYxY5laucA-MoEfFis2oyo3Yk0Y_0 2024-09-12T00:41:08.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.498+0000 7fc94c8009c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:41:08.493 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.498+0000 7fc82d7fa640 20 handle_completion(): completion ok for obj=x[YScvl9xtmgGZP1EEBFisNAJuR1gE4k2] 2024-09-12T00:41:08.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.502+0000 7fc94c8009c0 20 get_obj_state: octx=0x5625285f13b0 obj=myver:x state=0x5625289377e8 s->prefetch_data=0 2024-09-12T00:41:08.496 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.502+0000 7fc94c8009c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rf5679zvoy0y6yhgssesc4lz7qgby26z 2024-09-12T00:41:08.503 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.506+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.510+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.510+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.507 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.514+0000 7fc94c8009c0 20 get_obj_state: octx=0x5625285f13b0 obj=myver:y state=0x5625289377e8 s->prefetch_data=0 2024-09-12T00:41:08.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.514+0000 7fc94c8009c0 20 get_obj_state: setting s->obj_tag to v6ryxsqak6bqyytgx0tzrl3q8waam4gg 2024-09-12T00:41:08.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.514+0000 7fc94c8009c0 20 get_obj_state_impl: setting s->olh_tag to 6ndcniw1qv9rixywktiicv45nyo23e75 2024-09-12T00:41:08.508 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.514+0000 7fc94c8009c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6ndcniw1qv9rixywktiicv45nyo23e75 2024-09-12T00:41:08.511 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.514+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.514 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.518+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.518+0000 7fc94c8009c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T00:41:08.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.518+0000 7fc94c8009c0 20 olh_log_entry: epoch=2 op=3 key=y[yb9O2ZvplXCd2PCzcaxwEOh4DPO6Hnt] 2024-09-12T00:41:08.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.518+0000 7fc94c8009c0 20 get_obj_state: octx=0x5625285f13b0 obj=myver:_:yb9O2ZvplXCd2PCzcaxwEOh4DPO6Hnt_y state=0x56252892cbf8 s->prefetch_data=0 2024-09-12T00:41:08.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.522+0000 7fc94c8009c0 10 manifest: total_size = 22 2024-09-12T00:41:08.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.522+0000 7fc94c8009c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.11123845057592639382 2024-09-12T00:41:08.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.522+0000 7fc94c8009c0 20 get_obj_state: octx=0x5625285f13b0 obj=myver:_:yb9O2ZvplXCd2PCzcaxwEOh4DPO6Hnt_y state=0x56252892cbf8 s->prefetch_data=0 2024-09-12T00:41:08.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.522+0000 7fc94c8009c0 20 prepare_atomic_modification: state is not atomic. state=0x56252892cbf8 2024-09-12T00:41:08.516 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.522+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.526+0000 7fc94c8009c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:41:08.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.526+0000 7fc94c8009c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:41:08.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.526+0000 7fc94c8009c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:41:08.521 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.526+0000 7fc94c8009c0 5 delete_objs_inline: removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.18__shadow:yb9O2ZvplXCd2PCzcaxwEOh4DPO6Hnt_.0DwWDSFfRi64E3i8iT4sJVUqC8fgGUq_0 2024-09-12T00:41:08.523 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.526+0000 7fc82dffb640 20 handle_completion(): completion ok for obj=y[yb9O2ZvplXCd2PCzcaxwEOh4DPO6Hnt] 2024-09-12T00:41:08.524 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.530+0000 7fc94c8009c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:41:08.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.530+0000 7fc94c8009c0 20 get_obj_state: octx=0x5625285f13b0 obj=myver:y state=0x5625289377e8 s->prefetch_data=0 2024-09-12T00:41:08.527 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.530+0000 7fc94c8009c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6ndcniw1qv9rixywktiicv45nyo23e75 2024-09-12T00:41:08.534 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.538+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.537 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.542+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.538 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.542+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.539 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.542+0000 7fc94c8009c0 20 get_obj_state: octx=0x5625285f13b0 obj=myver:z state=0x5625289377e8 s->prefetch_data=0 2024-09-12T00:41:08.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.546+0000 7fc94c8009c0 20 get_obj_state: setting s->obj_tag to b478j64tbqaboct216syyty4g0mgbsj8 2024-09-12T00:41:08.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.546+0000 7fc94c8009c0 20 get_obj_state_impl: setting s->olh_tag to rv36wo50f88hwnqwq8g9sgv0vwf5miar 2024-09-12T00:41:08.540 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.546+0000 7fc94c8009c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rv36wo50f88hwnqwq8g9sgv0vwf5miar 2024-09-12T00:41:08.543 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.546+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.551 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.554+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.558+0000 7fc94c8009c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T00:41:08.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.558+0000 7fc94c8009c0 20 olh_log_entry: epoch=2 op=3 key=z[gUDLZlOsU.PQHwEJfH5.UVYB2QeWtEM] 2024-09-12T00:41:08.552 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.558+0000 7fc94c8009c0 20 get_obj_state: octx=0x5625285f13b0 obj=myver:_:gUDLZlOsU.PQHwEJfH5.UVYB2QeWtEM_z state=0x56252892cbf8 s->prefetch_data=0 2024-09-12T00:41:08.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.558+0000 7fc94c8009c0 10 manifest: total_size = 22 2024-09-12T00:41:08.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.558+0000 7fc94c8009c0 20 get_obj_state: setting s->obj_tag to e2043445-c131-4520-984d-b4d52f038a6b.4538.8296096444563391924 2024-09-12T00:41:08.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.558+0000 7fc94c8009c0 20 get_obj_state: octx=0x5625285f13b0 obj=myver:_:gUDLZlOsU.PQHwEJfH5.UVYB2QeWtEM_z state=0x56252892cbf8 s->prefetch_data=0 2024-09-12T00:41:08.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.558+0000 7fc94c8009c0 20 prepare_atomic_modification: state is not atomic. state=0x56252892cbf8 2024-09-12T00:41:08.553 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.558+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.566+0000 7fc94c8009c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:41:08.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.566+0000 7fc94c8009c0 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:41:08.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.566+0000 7fc94c8009c0 0 deleting objects inline since gc isn't initialized 2024-09-12T00:41:08.560 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.566+0000 7fc94c8009c0 5 delete_objs_inline: removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.18__shadow:gUDLZlOsU.PQHwEJfH5.UVYB2QeWtEM_.OOJPrtLKjfbZp5O5xgJOcr_IvDgkDyo_0 2024-09-12T00:41:08.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.566+0000 7fc94c8009c0 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:41:08.563 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.566+0000 7fc82d7fa640 20 handle_completion(): completion ok for obj=z[gUDLZlOsU.PQHwEJfH5.UVYB2QeWtEM] 2024-09-12T00:41:08.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.570+0000 7fc94c8009c0 20 get_obj_state: octx=0x5625285f13b0 obj=myver:z state=0x5625289377e8 s->prefetch_data=0 2024-09-12T00:41:08.566 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.570+0000 7fc94c8009c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=rv36wo50f88hwnqwq8g9sgv0vwf5miar 2024-09-12T00:41:08.573 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.578+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.582+0000 7fc94c8009c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.18.3.9 2024-09-12T00:41:08.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.582+0000 7fc94c8009c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T00:41:08.576 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.582+0000 7fc94c8009c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T00:41:08.577 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.582+0000 7fc800fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:08.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.586+0000 7fc94c8009c0 20 remove_watcher() i=0 2024-09-12T00:41:08.582 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.586+0000 7fc94c8009c0 2 removed watcher, disabling cache 2024-09-12T00:41:08.585 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.590+0000 7fc94c8009c0 20 remove_watcher() i=1 2024-09-12T00:41:08.587 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.590+0000 7fc94c8009c0 20 remove_watcher() i=2 2024-09-12T00:41:08.590 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.594+0000 7fc94c8009c0 20 remove_watcher() i=3 2024-09-12T00:41:08.593 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.598+0000 7fc94c8009c0 20 remove_watcher() i=4 2024-09-12T00:41:08.596 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.602+0000 7fc94c8009c0 20 remove_watcher() i=5 2024-09-12T00:41:08.598 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.602+0000 7fc94c8009c0 20 remove_watcher() i=6 2024-09-12T00:41:08.601 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.606+0000 7fc94c8009c0 20 remove_watcher() i=7 2024-09-12T00:41:08.625 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:08.625 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:08.633 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:08.633 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:08.682 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:41:08.712 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:08.712 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:08.756 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.762+0000 7f0fd19d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.762+0000 7f0fd19d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:08.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.762+0000 7f0fd19d99c0 20 realm 2024-09-12T00:41:08.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.762+0000 7f0fd19d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.759 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.762+0000 7f0fd19d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:08.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.762+0000 7f0fd19d99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:08.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.766+0000 7f0fd19d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.766+0000 7f0fd19d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:08.760 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.766+0000 7f0fd19d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.766+0000 7f0fd19d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:08.761 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.766+0000 7f0fd19d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.766+0000 7f0fd19d99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:08.762 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.766+0000 7f0fd19d99c0 20 searching for the correct realm 2024-09-12T00:41:08.767 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.770+0000 7f0fcfce0640 0 -- 172.21.15.138:0/2546778690 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f0fc8032400 msgr2=0x7f0fc8032860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:41:08.982 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.986+0000 7f0fcfce0640 0 -- 172.21.15.138:0/2546778690 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x564450ec2410 msgr2=0x564450ec48d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:08.990 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.994+0000 7f0fd19d99c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:41:08.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.994+0000 7f0fd19d99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:08.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.994+0000 7f0fd19d99c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:41:08.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.994+0000 7f0fd19d99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:08.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.994+0000 7f0fd19d99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:08.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.994+0000 7f0fd19d99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:08.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.994+0000 7f0fd19d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.994+0000 7f0fd19d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:08.991 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.994+0000 7f0fd19d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.998+0000 7f0fd19d99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:08.992 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.998+0000 7f0fd19d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.998+0000 7f0fd19d99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:08.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.998+0000 7f0fd19d99c0 20 zone default found 2024-09-12T00:41:08.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.998+0000 7f0fd19d99c0 4 Realm: () 2024-09-12T00:41:08.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.998+0000 7f0fd19d99c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:41:08.993 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.998+0000 7f0fd19d99c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:41:08.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.998+0000 7f0fd19d99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:08.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.998+0000 7f0fd19d99c0 20 zonegroup default 2024-09-12T00:41:08.994 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.998+0000 7f0fd19d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.998+0000 7f0fd19d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:08.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.998+0000 7f0fd19d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.998+0000 7f0fd19d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:08.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.998+0000 7f0fd19d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:08.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.998+0000 7f0fd19d99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:08.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.998+0000 7f0fd19d99c0 20 started sync module instance, tier type = 2024-09-12T00:41:08.995 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:08.998+0000 7f0fd19d99c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:41:09.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.022+0000 7f0fd19d99c0 20 add_watcher() i=0 2024-09-12T00:41:09.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.022+0000 7f0fd19d99c0 20 add_watcher() i=1 2024-09-12T00:41:09.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.022+0000 7f0fd19d99c0 20 add_watcher() i=2 2024-09-12T00:41:09.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.022+0000 7f0fd19d99c0 20 add_watcher() i=3 2024-09-12T00:41:09.018 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.022+0000 7f0fd19d99c0 20 add_watcher() i=4 2024-09-12T00:41:09.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.022+0000 7f0fd19d99c0 20 add_watcher() i=5 2024-09-12T00:41:09.019 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.022+0000 7f0fd19d99c0 20 add_watcher() i=6 2024-09-12T00:41:09.020 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.026+0000 7f0fd19d99c0 20 add_watcher() i=7 2024-09-12T00:41:09.021 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.026+0000 7f0fd19d99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:09.025 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.030+0000 7f0e85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:09.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.030+0000 7f0fd19d99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:09.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.030+0000 7f0fd19d99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:09.026 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.030+0000 7f0fd19d99c0 5 note: GC not initialized 2024-09-12T00:41:09.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.030+0000 7f0e84fe1640 20 reqs_thread_entry: start 2024-09-12T00:41:09.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.030+0000 7f0fd19d99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:09.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.030+0000 7f0fd19d99c0 20 Filter name: none 2024-09-12T00:41:09.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.030+0000 7f0dfe7fc640 20 reqs_thread_entry: start 2024-09-12T00:41:09.027 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.030+0000 7f0fd19d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:09.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.034+0000 7f0fd19d99c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:41:09.028 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.034+0000 7f0fd19d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:09.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.034+0000 7f0fd19d99c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:41:09.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.034+0000 7f0fd19d99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:09.029 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.034+0000 7f0fd19d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:09.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.034+0000 7f0fd19d99c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:41:09.030 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.034+0000 7f0fd19d99c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:09.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.034+0000 7f0fd19d99c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:41:09.031 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.034+0000 7f0fd19d99c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:41:09.035 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.038+0000 7f0e85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:09.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.042+0000 7f0fd19d99c0 20 remove_watcher() i=0 2024-09-12T00:41:09.039 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.042+0000 7f0fd19d99c0 2 removed watcher, disabling cache 2024-09-12T00:41:09.041 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.046+0000 7f0fd19d99c0 20 remove_watcher() i=1 2024-09-12T00:41:09.043 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.046+0000 7f0fd19d99c0 20 remove_watcher() i=2 2024-09-12T00:41:09.045 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.050+0000 7f0fd19d99c0 20 remove_watcher() i=3 2024-09-12T00:41:09.047 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.050+0000 7f0fd19d99c0 20 remove_watcher() i=4 2024-09-12T00:41:09.050 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.054+0000 7f0fd19d99c0 20 remove_watcher() i=5 2024-09-12T00:41:09.053 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.058+0000 7f0fd19d99c0 20 remove_watcher() i=6 2024-09-12T00:41:09.055 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T00:41:09.058+0000 7f0fd19d99c0 20 remove_watcher() i=7 2024-09-12T00:41:09.076 INFO:tasks.workunit.client.0.smithi138.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:41:09.076 INFO:tasks.workunit.client.0.smithi138.stderr:Deleting bucket a-bucket 2024-09-12T00:41:09.077 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:09.078 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:09.082 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:09.082 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:09.111 INFO:tasks.workunit.client.0.smithi138.stderr:Deleting bucket myver 2024-09-12T00:41:09.112 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:09.112 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:09.159 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T00:41:09.159 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T00:41:09.245 INFO:tasks.workunit.client.0.smithi138.stderr:Completed resharding tests 2024-09-12T00:41:09.246 INFO:tasks.workunit.client.0.smithi138.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T00:41:09.246 INFO:tasks.workunit.client.0.smithi138.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T00:41:09.246 INFO:tasks.workunit.client.0.smithi138.stdout:connected to https://localhost:443 2024-09-12T00:41:09.365 INFO:tasks.workunit.client.0.smithi138.stderr:+ deactivate 2024-09-12T00:41:09.365 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T00:41:09.365 INFO:tasks.workunit.client.0.smithi138.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:41:09.365 INFO:tasks.workunit.client.0.smithi138.stderr:+ export PATH 2024-09-12T00:41:09.365 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:41:09.365 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n '' ']' 2024-09-12T00:41:09.365 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:41:09.366 INFO:tasks.workunit.client.0.smithi138.stderr:+ hash -r 2024-09-12T00:41:09.366 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n '' ']' 2024-09-12T00:41:09.366 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:41:09.366 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:41:09.366 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:41:09.366 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset -f deactivate 2024-09-12T00:41:09.366 INFO:tasks.workunit.client.0.smithi138.stderr:+ echo OK. 2024-09-12T00:41:09.367 INFO:tasks.workunit.client.0.smithi138.stdout:OK. 2024-09-12T00:41:09.368 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:41:09.368 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:41:09.423 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T00:41:09.423 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:41:09.873 DEBUG:teuthology.parallel:result is None 2024-09-12T00:41:09.874 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:41:09.887 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:41:09.887 DEBUG:teuthology.orchestra.run.smithi138:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:41:09.936 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:41:09.936 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T00:41:09.953 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T00:41:09.953 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T00:41:09.953 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T00:41:09.954 DEBUG:teuthology.orchestra.run.smithi138:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T00:41:09.985 INFO:teuthology.orchestra.run.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T00:41:14.730 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T00:41:14.731 DEBUG:teuthology.orchestra.run.smithi138:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T00:41:14.820 INFO:teuthology.orchestra.run.smithi138.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-12T00:41:14.881 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-09-12T00:41:15.095 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-09-12T00:41:15.096 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-09-12T00:41:15.313 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:41:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:41:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:41:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:41:15.313 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:41:15.314 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:41:15.314 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:41:15.314 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-09-12T00:41:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T00:41:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T00:41:15.316 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-09-12T00:41:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-12T00:41:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-12T00:41:15.317 INFO:teuthology.orchestra.run.smithi138.stdout: fonts-wqy-zenhei fonts-indic 2024-09-12T00:41:15.353 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-09-12T00:41:15.353 INFO:teuthology.orchestra.run.smithi138.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T00:41:15.354 INFO:teuthology.orchestra.run.smithi138.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T00:41:15.407 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:41:15.408 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 46.0 MB of archives. 2024-09-12T00:41:15.408 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-12T00:41:15.408 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-12T00:41:15.485 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-12T00:41:15.572 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-12T00:41:15.572 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-12T00:41:15.575 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-12T00:41:15.576 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-12T00:41:16.443 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-12T00:41:16.444 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-12T00:41:16.549 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-12T00:41:16.883 INFO:teuthology.orchestra.run.smithi138.stderr:debconf: unable to initialize frontend: Dialog 2024-09-12T00:41:16.883 INFO:teuthology.orchestra.run.smithi138.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-12T00:41:16.883 INFO:teuthology.orchestra.run.smithi138.stderr:debconf: falling back to frontend: Readline 2024-09-12T00:41:16.901 INFO:teuthology.orchestra.run.smithi138.stderr:debconf: unable to initialize frontend: Readline 2024-09-12T00:41:16.901 INFO:teuthology.orchestra.run.smithi138.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-12T00:41:16.901 INFO:teuthology.orchestra.run.smithi138.stderr:debconf: falling back to frontend: Teletype 2024-09-12T00:41:16.905 INFO:teuthology.orchestra.run.smithi138.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-12T00:41:16.938 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 46.0 MB in 1s (37.8 MB/s) 2024-09-12T00:41:17.050 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-12T00:41:17.149 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177243 files and directories currently installed.) 2024-09-12T00:41:17.156 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-12T00:41:17.215 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T00:41:17.552 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-12T00:41:17.581 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:41:17.661 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:41:18.124 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-12T00:41:18.152 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:41:18.190 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:41:18.443 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-12T00:41:18.459 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:41:18.501 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:41:18.779 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-12T00:41:18.808 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:41:18.845 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T00:41:19.241 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-12T00:41:19.270 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:41:19.311 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:41:20.896 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-12T00:41:20.925 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:41:20.966 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:41:21.392 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-12T00:41:21.421 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:41:21.463 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:41:22.254 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-12T00:41:22.283 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:41:22.324 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:41:22.683 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:41:23.830 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-12T00:41:24.123 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-12T00:41:24.198 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-12T00:41:24.621 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T00:41:24.789 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:41:25.166 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:41:25.258 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-12T00:41:25.318 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:41:25.409 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-12T00:41:25.438 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-12T00:41:25.465 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-12T00:41:25.489 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-12T00:41:25.609 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-12T00:41:25.751 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-12T00:41:25.886 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-12T00:41:25.980 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-12T00:41:26.031 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-12T00:41:26.082 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-12T00:41:26.107 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-12T00:41:26.133 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-12T00:41:26.189 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:41:26.315 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T00:41:26.432 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:41:26.534 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-12T00:41:26.626 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:41:26.753 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:41:27.812 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:41:27.946 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T00:41:28.231 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:41:28.722 INFO:teuthology.orchestra.run.smithi138.stdout: Gradle will be installed under /opt/gradle 2024-09-12T00:41:28.746 INFO:teuthology.orchestra.run.smithi138.stderr:--2024-09-12 00:41:28-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T00:41:28.750 INFO:teuthology.orchestra.run.smithi138.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-09-12T00:41:28.763 INFO:teuthology.orchestra.run.smithi138.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-12T00:41:28.817 INFO:teuthology.orchestra.run.smithi138.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T00:41:28.817 INFO:teuthology.orchestra.run.smithi138.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T00:41:28.817 INFO:teuthology.orchestra.run.smithi138.stderr:--2024-09-12 00:41:28-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T00:41:28.818 INFO:teuthology.orchestra.run.smithi138.stderr:Resolving github.com (github.com)... 140.82.114.4 2024-09-12T00:41:28.827 INFO:teuthology.orchestra.run.smithi138.stderr:Connecting to github.com (github.com)|140.82.114.4|:443... connected. 2024-09-12T00:41:28.916 INFO:teuthology.orchestra.run.smithi138.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T00:41:28.916 INFO:teuthology.orchestra.run.smithi138.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T004128Z&X-Amz-Expires=300&X-Amz-Signature=a81a61bc49c07066231ab30c7baaca328df1770fedea13092173f835bdedbd60&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T00:41:28.916 INFO:teuthology.orchestra.run.smithi138.stderr:--2024-09-12 00:41:28-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T004128Z&X-Amz-Expires=300&X-Amz-Signature=a81a61bc49c07066231ab30c7baaca328df1770fedea13092173f835bdedbd60&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T00:41:29.006 INFO:teuthology.orchestra.run.smithi138.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.109.133, 185.199.108.133, ... 2024-09-12T00:41:29.018 INFO:teuthology.orchestra.run.smithi138.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected. 2024-09-12T00:41:29.101 INFO:teuthology.orchestra.run.smithi138.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T00:41:29.101 INFO:teuthology.orchestra.run.smithi138.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T00:41:29.101 INFO:teuthology.orchestra.run.smithi138.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-12T00:41:29.103 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-12T00:41:29.115 INFO:teuthology.orchestra.run.smithi138.stderr: 0K .......... .......... .......... .......... .......... 0% 3.22M 28s 2024-09-12T00:41:29.125 INFO:teuthology.orchestra.run.smithi138.stderr: 50K .......... .......... .......... .......... .......... 0% 4.85M 23s 2024-09-12T00:41:29.128 INFO:teuthology.orchestra.run.smithi138.stderr: 100K .......... .......... .......... .......... .......... 0% 17.7M 17s 2024-09-12T00:41:29.131 INFO:teuthology.orchestra.run.smithi138.stderr: 150K .......... .......... .......... .......... .......... 0% 14.9M 14s 2024-09-12T00:41:29.138 INFO:teuthology.orchestra.run.smithi138.stderr: 200K .......... .......... .......... .......... .......... 0% 7.28M 14s 2024-09-12T00:41:29.140 INFO:teuthology.orchestra.run.smithi138.stderr: 250K .......... .......... .......... .......... .......... 0% 44.7M 12s 2024-09-12T00:41:29.142 INFO:teuthology.orchestra.run.smithi138.stderr: 300K .......... .......... .......... .......... .......... 0% 21.2M 11s 2024-09-12T00:41:29.143 INFO:teuthology.orchestra.run.smithi138.stderr: 350K .......... .......... .......... .......... .......... 0% 44.4M 10s 2024-09-12T00:41:29.144 INFO:teuthology.orchestra.run.smithi138.stderr: 400K .......... .......... .......... .......... .......... 0% 30.9M 9s 2024-09-12T00:41:29.152 INFO:teuthology.orchestra.run.smithi138.stderr: 450K .......... .......... .......... .......... .......... 0% 8.03M 9s 2024-09-12T00:41:29.152 INFO:teuthology.orchestra.run.smithi138.stderr: 500K .......... .......... .......... .......... .......... 0% 91.9M 9s 2024-09-12T00:41:29.152 INFO:teuthology.orchestra.run.smithi138.stderr: 550K .......... .......... .......... .......... .......... 0% 50.1M 8s 2024-09-12T00:41:29.153 INFO:teuthology.orchestra.run.smithi138.stderr: 600K .......... .......... .......... .......... .......... 0% 79.0M 7s 2024-09-12T00:41:29.158 INFO:teuthology.orchestra.run.smithi138.stderr: 650K .......... .......... .......... .......... .......... 0% 49.0M 7s 2024-09-12T00:41:29.158 INFO:teuthology.orchestra.run.smithi138.stderr: 700K .......... .......... .......... .......... .......... 0% 61.2M 7s 2024-09-12T00:41:29.158 INFO:teuthology.orchestra.run.smithi138.stderr: 750K .......... .......... .......... .......... .......... 0% 64.5M 6s 2024-09-12T00:41:29.158 INFO:teuthology.orchestra.run.smithi138.stderr: 800K .......... .......... .......... .......... .......... 0% 60.6M 6s 2024-09-12T00:41:29.158 INFO:teuthology.orchestra.run.smithi138.stderr: 850K .......... .......... .......... .......... .......... 0% 120M 6s 2024-09-12T00:41:29.158 INFO:teuthology.orchestra.run.smithi138.stderr: 900K .......... .......... .......... .......... .......... 1% 63.1M 5s 2024-09-12T00:41:29.161 INFO:teuthology.orchestra.run.smithi138.stderr: 950K .......... .......... .......... .......... .......... 1% 11.0M 6s 2024-09-12T00:41:30.160 INFO:teuthology.orchestra.run.smithi138.stderr: 1000K .......... .......... .......... .......... .......... 1% 35.8M 5s 2024-09-12T00:41:30.161 INFO:teuthology.orchestra.run.smithi138.stderr: 1050K .......... .......... .......... .......... .......... 1% 136M 5s 2024-09-12T00:41:30.161 INFO:teuthology.orchestra.run.smithi138.stderr: 1100K .......... .......... .......... .......... .......... 1% 94.4M 5s 2024-09-12T00:41:30.161 INFO:teuthology.orchestra.run.smithi138.stderr: 1150K .......... .......... .......... .......... .......... 1% 106M 5s 2024-09-12T00:41:30.161 INFO:teuthology.orchestra.run.smithi138.stderr: 1200K .......... .......... .......... .......... .......... 1% 113M 5s 2024-09-12T00:41:30.161 INFO:teuthology.orchestra.run.smithi138.stderr: 1250K .......... .......... .......... .......... .......... 1% 84.3M 5s 2024-09-12T00:41:30.161 INFO:teuthology.orchestra.run.smithi138.stderr: 1300K .......... .......... .......... .......... .......... 1% 97.8M 4s 2024-09-12T00:41:30.161 INFO:teuthology.orchestra.run.smithi138.stderr: 1350K .......... .......... .......... .......... .......... 1% 139M 4s 2024-09-12T00:41:30.161 INFO:teuthology.orchestra.run.smithi138.stderr: 1400K .......... .......... .......... .......... .......... 1% 123M 4s 2024-09-12T00:41:30.161 INFO:teuthology.orchestra.run.smithi138.stderr: 1450K .......... .......... .......... .......... .......... 1% 103M 4s 2024-09-12T00:41:30.161 INFO:teuthology.orchestra.run.smithi138.stderr: 1500K .......... .......... .......... .......... .......... 1% 75.2M 4s 2024-09-12T00:41:30.161 INFO:teuthology.orchestra.run.smithi138.stderr: 1550K .......... .......... .......... .......... .......... 1% 95.5M 4s 2024-09-12T00:41:30.162 INFO:teuthology.orchestra.run.smithi138.stderr: 1600K .......... .......... .......... .......... .......... 1% 109M 4s 2024-09-12T00:41:30.162 INFO:teuthology.orchestra.run.smithi138.stderr: 1650K .......... .......... .......... .......... .......... 1% 111M 4s 2024-09-12T00:41:30.162 INFO:teuthology.orchestra.run.smithi138.stderr: 1700K .......... .......... .......... .......... .......... 1% 105M 4s 2024-09-12T00:41:30.162 INFO:teuthology.orchestra.run.smithi138.stderr: 1750K .......... .......... .......... .......... .......... 1% 115M 4s 2024-09-12T00:41:30.162 INFO:teuthology.orchestra.run.smithi138.stderr: 1800K .......... .......... .......... .......... .......... 1% 153M 3s 2024-09-12T00:41:30.162 INFO:teuthology.orchestra.run.smithi138.stderr: 1850K .......... .......... .......... .......... .......... 2% 156M 3s 2024-09-12T00:41:30.162 INFO:teuthology.orchestra.run.smithi138.stderr: 1900K .......... .......... .......... .......... .......... 2% 124M 3s 2024-09-12T00:41:30.162 INFO:teuthology.orchestra.run.smithi138.stderr: 1950K .......... .......... .......... .......... .......... 2% 20.2M 3s 2024-09-12T00:41:30.162 INFO:teuthology.orchestra.run.smithi138.stderr: 2000K .......... .......... .......... .......... .......... 2% 44.4M 3s 2024-09-12T00:41:30.162 INFO:teuthology.orchestra.run.smithi138.stderr: 2050K .......... .......... .......... .......... .......... 2% 77.9M 3s 2024-09-12T00:41:30.162 INFO:teuthology.orchestra.run.smithi138.stderr: 2100K .......... .......... .......... .......... .......... 2% 87.0M 3s 2024-09-12T00:41:30.162 INFO:teuthology.orchestra.run.smithi138.stderr: 2150K .......... .......... .......... .......... .......... 2% 99.9M 3s 2024-09-12T00:41:30.162 INFO:teuthology.orchestra.run.smithi138.stderr: 2200K .......... .......... .......... .......... .......... 2% 88.2M 3s 2024-09-12T00:41:30.163 INFO:teuthology.orchestra.run.smithi138.stderr: 2250K .......... .......... .......... .......... .......... 2% 97.8M 3s 2024-09-12T00:41:30.163 INFO:teuthology.orchestra.run.smithi138.stderr: 2300K .......... .......... .......... .......... .......... 2% 82.1M 3s 2024-09-12T00:41:30.163 INFO:teuthology.orchestra.run.smithi138.stderr: 2350K .......... .......... .......... .......... .......... 2% 95.4M 3s 2024-09-12T00:41:30.163 INFO:teuthology.orchestra.run.smithi138.stderr: 2400K .......... .......... .......... .......... .......... 2% 95.8M 3s 2024-09-12T00:41:30.163 INFO:teuthology.orchestra.run.smithi138.stderr: 2450K .......... .......... .......... .......... .......... 2% 98.6M 3s 2024-09-12T00:41:30.163 INFO:teuthology.orchestra.run.smithi138.stderr: 2500K .......... .......... .......... .......... .......... 2% 65.7M 3s 2024-09-12T00:41:30.163 INFO:teuthology.orchestra.run.smithi138.stderr: 2550K .......... .......... .......... .......... .......... 2% 69.5M 3s 2024-09-12T00:41:30.163 INFO:teuthology.orchestra.run.smithi138.stderr: 2600K .......... .......... .......... .......... .......... 2% 59.4M 3s 2024-09-12T00:41:30.163 INFO:teuthology.orchestra.run.smithi138.stderr: 2650K .......... .......... .......... .......... .......... 2% 62.2M 3s 2024-09-12T00:41:30.163 INFO:teuthology.orchestra.run.smithi138.stderr: 2700K .......... .......... .......... .......... .......... 2% 118M 3s 2024-09-12T00:41:30.163 INFO:teuthology.orchestra.run.smithi138.stderr: 2750K .......... .......... .......... .......... .......... 3% 152M 3s 2024-09-12T00:41:30.163 INFO:teuthology.orchestra.run.smithi138.stderr: 2800K .......... .......... .......... .......... .......... 3% 152M 3s 2024-09-12T00:41:30.164 INFO:teuthology.orchestra.run.smithi138.stderr: 2850K .......... .......... .......... .......... .......... 3% 152M 3s 2024-09-12T00:41:30.164 INFO:teuthology.orchestra.run.smithi138.stderr: 2900K .......... .......... .......... .......... .......... 3% 132M 3s 2024-09-12T00:41:30.164 INFO:teuthology.orchestra.run.smithi138.stderr: 2950K .......... .......... .......... .......... .......... 3% 156M 3s 2024-09-12T00:41:30.164 INFO:teuthology.orchestra.run.smithi138.stderr: 3000K .......... .......... .......... .......... .......... 3% 154M 2s 2024-09-12T00:41:30.164 INFO:teuthology.orchestra.run.smithi138.stderr: 3050K .......... .......... .......... .......... .......... 3% 154M 2s 2024-09-12T00:41:30.164 INFO:teuthology.orchestra.run.smithi138.stderr: 3100K .......... .......... .......... .......... .......... 3% 103M 2s 2024-09-12T00:41:30.164 INFO:teuthology.orchestra.run.smithi138.stderr: 3150K .......... .......... .......... .......... .......... 3% 132M 2s 2024-09-12T00:41:30.164 INFO:teuthology.orchestra.run.smithi138.stderr: 3200K .......... .......... .......... .......... .......... 3% 154M 2s 2024-09-12T00:41:30.164 INFO:teuthology.orchestra.run.smithi138.stderr: 3250K .......... .......... .......... .......... .......... 3% 118M 2s 2024-09-12T00:41:30.164 INFO:teuthology.orchestra.run.smithi138.stderr: 3300K .......... .......... .......... .......... .......... 3% 78.7M 2s 2024-09-12T00:41:30.164 INFO:teuthology.orchestra.run.smithi138.stderr: 3350K .......... .......... .......... .......... .......... 3% 87.3M 2s 2024-09-12T00:41:30.164 INFO:teuthology.orchestra.run.smithi138.stderr: 3400K .......... .......... .......... .......... .......... 3% 55.8M 2s 2024-09-12T00:41:30.164 INFO:teuthology.orchestra.run.smithi138.stderr: 3450K .......... .......... .......... .......... .......... 3% 48.0M 2s 2024-09-12T00:41:30.165 INFO:teuthology.orchestra.run.smithi138.stderr: 3500K .......... .......... .......... .......... .......... 3% 78.3M 2s 2024-09-12T00:41:30.165 INFO:teuthology.orchestra.run.smithi138.stderr: 3550K .......... .......... .......... .......... .......... 3% 145M 2s 2024-09-12T00:41:30.165 INFO:teuthology.orchestra.run.smithi138.stderr: 3600K .......... .......... .......... .......... .......... 3% 116M 2s 2024-09-12T00:41:30.165 INFO:teuthology.orchestra.run.smithi138.stderr: 3650K .......... .......... .......... .......... .......... 3% 114M 2s 2024-09-12T00:41:30.165 INFO:teuthology.orchestra.run.smithi138.stderr: 3700K .......... .......... .......... .......... .......... 4% 90.0M 2s 2024-09-12T00:41:30.165 INFO:teuthology.orchestra.run.smithi138.stderr: 3750K .......... .......... .......... .......... .......... 4% 149M 2s 2024-09-12T00:41:30.165 INFO:teuthology.orchestra.run.smithi138.stderr: 3800K .......... .......... .......... .......... .......... 4% 123M 2s 2024-09-12T00:41:30.165 INFO:teuthology.orchestra.run.smithi138.stderr: 3850K .......... .......... .......... .......... .......... 4% 124M 2s 2024-09-12T00:41:30.165 INFO:teuthology.orchestra.run.smithi138.stderr: 3900K .......... .......... .......... .......... .......... 4% 99.2M 2s 2024-09-12T00:41:30.165 INFO:teuthology.orchestra.run.smithi138.stderr: 3950K .......... .......... .......... .......... .......... 4% 114M 2s 2024-09-12T00:41:30.165 INFO:teuthology.orchestra.run.smithi138.stderr: 4000K .......... .......... .......... .......... .......... 4% 128M 2s 2024-09-12T00:41:30.165 INFO:teuthology.orchestra.run.smithi138.stderr: 4050K .......... .......... .......... .......... .......... 4% 153M 2s 2024-09-12T00:41:30.165 INFO:teuthology.orchestra.run.smithi138.stderr: 4100K .......... .......... .......... .......... .......... 4% 136M 2s 2024-09-12T00:41:30.166 INFO:teuthology.orchestra.run.smithi138.stderr: 4150K .......... .......... .......... .......... .......... 4% 133M 2s 2024-09-12T00:41:30.166 INFO:teuthology.orchestra.run.smithi138.stderr: 4200K .......... .......... .......... .......... .......... 4% 92.2M 2s 2024-09-12T00:41:30.166 INFO:teuthology.orchestra.run.smithi138.stderr: 4250K .......... .......... .......... .......... .......... 4% 153M 2s 2024-09-12T00:41:30.166 INFO:teuthology.orchestra.run.smithi138.stderr: 4300K .......... .......... .......... .......... .......... 4% 128M 2s 2024-09-12T00:41:30.166 INFO:teuthology.orchestra.run.smithi138.stderr: 4350K .......... .......... .......... .......... .......... 4% 150M 2s 2024-09-12T00:41:30.166 INFO:teuthology.orchestra.run.smithi138.stderr: 4400K .......... .......... .......... .......... .......... 4% 143M 2s 2024-09-12T00:41:30.166 INFO:teuthology.orchestra.run.smithi138.stderr: 4450K .......... .......... .......... .......... .......... 4% 85.9M 2s 2024-09-12T00:41:30.166 INFO:teuthology.orchestra.run.smithi138.stderr: 4500K .......... .......... .......... .......... .......... 4% 99.3M 2s 2024-09-12T00:41:30.166 INFO:teuthology.orchestra.run.smithi138.stderr: 4550K .......... .......... .......... .......... .......... 4% 124M 2s 2024-09-12T00:41:30.166 INFO:teuthology.orchestra.run.smithi138.stderr: 4600K .......... .......... .......... .......... .......... 5% 101M 2s 2024-09-12T00:41:30.166 INFO:teuthology.orchestra.run.smithi138.stderr: 4650K .......... .......... .......... .......... .......... 5% 132M 2s 2024-09-12T00:41:30.166 INFO:teuthology.orchestra.run.smithi138.stderr: 4700K .......... .......... .......... .......... .......... 5% 115M 2s 2024-09-12T00:41:30.166 INFO:teuthology.orchestra.run.smithi138.stderr: 4750K .......... .......... .......... .......... .......... 5% 130M 2s 2024-09-12T00:41:30.167 INFO:teuthology.orchestra.run.smithi138.stderr: 4800K .......... .......... .......... .......... .......... 5% 139M 2s 2024-09-12T00:41:30.167 INFO:teuthology.orchestra.run.smithi138.stderr: 4850K .......... .......... .......... .......... .......... 5% 139M 2s 2024-09-12T00:41:30.167 INFO:teuthology.orchestra.run.smithi138.stderr: 4900K .......... .......... .......... .......... .......... 5% 130M 2s 2024-09-12T00:41:30.167 INFO:teuthology.orchestra.run.smithi138.stderr: 4950K .......... .......... .......... .......... .......... 5% 131M 2s 2024-09-12T00:41:30.167 INFO:teuthology.orchestra.run.smithi138.stderr: 5000K .......... .......... .......... .......... .......... 5% 133M 2s 2024-09-12T00:41:30.167 INFO:teuthology.orchestra.run.smithi138.stderr: 5050K .......... .......... .......... .......... .......... 5% 132M 2s 2024-09-12T00:41:30.167 INFO:teuthology.orchestra.run.smithi138.stderr: 5100K .......... .......... .......... .......... .......... 5% 121M 2s 2024-09-12T00:41:30.167 INFO:teuthology.orchestra.run.smithi138.stderr: 5150K .......... .......... .......... .......... .......... 5% 147M 2s 2024-09-12T00:41:30.167 INFO:teuthology.orchestra.run.smithi138.stderr: 5200K .......... .......... .......... .......... .......... 5% 127M 2s 2024-09-12T00:41:30.167 INFO:teuthology.orchestra.run.smithi138.stderr: 5250K .......... .......... .......... .......... .......... 5% 143M 2s 2024-09-12T00:41:30.167 INFO:teuthology.orchestra.run.smithi138.stderr: 5300K .......... .......... .......... .......... .......... 5% 133M 2s 2024-09-12T00:41:30.167 INFO:teuthology.orchestra.run.smithi138.stderr: 5350K .......... .......... .......... .......... .......... 5% 163M 2s 2024-09-12T00:41:30.167 INFO:teuthology.orchestra.run.smithi138.stderr: 5400K .......... .......... .......... .......... .......... 5% 154M 2s 2024-09-12T00:41:30.168 INFO:teuthology.orchestra.run.smithi138.stderr: 5450K .......... .......... .......... .......... .......... 5% 151M 2s 2024-09-12T00:41:30.168 INFO:teuthology.orchestra.run.smithi138.stderr: 5500K .......... .......... .......... .......... .......... 5% 132M 2s 2024-09-12T00:41:30.168 INFO:teuthology.orchestra.run.smithi138.stderr: 5550K .......... .......... .......... .......... .......... 6% 161M 2s 2024-09-12T00:41:30.168 INFO:teuthology.orchestra.run.smithi138.stderr: 5600K .......... .......... .......... .......... .......... 6% 160M 2s 2024-09-12T00:41:30.168 INFO:teuthology.orchestra.run.smithi138.stderr: 5650K .......... .......... .......... .......... .......... 6% 165M 2s 2024-09-12T00:41:30.168 INFO:teuthology.orchestra.run.smithi138.stderr: 5700K .......... .......... .......... .......... .......... 6% 137M 2s 2024-09-12T00:41:30.168 INFO:teuthology.orchestra.run.smithi138.stderr: 5750K .......... .......... .......... .......... .......... 6% 154M 2s 2024-09-12T00:41:30.168 INFO:teuthology.orchestra.run.smithi138.stderr: 5800K .......... .......... .......... .......... .......... 6% 159M 2s 2024-09-12T00:41:30.168 INFO:teuthology.orchestra.run.smithi138.stderr: 5850K .......... .......... .......... .......... .......... 6% 152M 2s 2024-09-12T00:41:30.168 INFO:teuthology.orchestra.run.smithi138.stderr: 5900K .......... .......... .......... .......... .......... 6% 134M 2s 2024-09-12T00:41:30.168 INFO:teuthology.orchestra.run.smithi138.stderr: 5950K .......... .......... .......... .......... .......... 6% 157M 2s 2024-09-12T00:41:30.168 INFO:teuthology.orchestra.run.smithi138.stderr: 6000K .......... .......... .......... .......... .......... 6% 156M 2s 2024-09-12T00:41:30.168 INFO:teuthology.orchestra.run.smithi138.stderr: 6050K .......... .......... .......... .......... .......... 6% 164M 2s 2024-09-12T00:41:30.169 INFO:teuthology.orchestra.run.smithi138.stderr: 6100K .......... .......... .......... .......... .......... 6% 158M 2s 2024-09-12T00:41:30.169 INFO:teuthology.orchestra.run.smithi138.stderr: 6150K .......... .......... .......... .......... .......... 6% 155M 2s 2024-09-12T00:41:30.169 INFO:teuthology.orchestra.run.smithi138.stderr: 6200K .......... .......... .......... .......... .......... 6% 161M 2s 2024-09-12T00:41:30.169 INFO:teuthology.orchestra.run.smithi138.stderr: 6250K .......... .......... .......... .......... .......... 6% 152M 2s 2024-09-12T00:41:30.169 INFO:teuthology.orchestra.run.smithi138.stderr: 6300K .......... .......... .......... .......... .......... 6% 136M 2s 2024-09-12T00:41:30.169 INFO:teuthology.orchestra.run.smithi138.stderr: 6350K .......... .......... .......... .......... .......... 6% 143M 1s 2024-09-12T00:41:30.169 INFO:teuthology.orchestra.run.smithi138.stderr: 6400K .......... .......... .......... .......... .......... 6% 164M 1s 2024-09-12T00:41:30.169 INFO:teuthology.orchestra.run.smithi138.stderr: 6450K .......... .......... .......... .......... .......... 6% 170M 1s 2024-09-12T00:41:30.169 INFO:teuthology.orchestra.run.smithi138.stderr: 6500K .......... .......... .......... .......... .......... 7% 137M 1s 2024-09-12T00:41:30.169 INFO:teuthology.orchestra.run.smithi138.stderr: 6550K .......... .......... .......... .......... .......... 7% 170M 1s 2024-09-12T00:41:30.169 INFO:teuthology.orchestra.run.smithi138.stderr: 6600K .......... .......... .......... .......... .......... 7% 184M 1s 2024-09-12T00:41:30.169 INFO:teuthology.orchestra.run.smithi138.stderr: 6650K .......... .......... .......... .......... .......... 7% 166M 1s 2024-09-12T00:41:30.169 INFO:teuthology.orchestra.run.smithi138.stderr: 6700K .......... .......... .......... .......... .......... 7% 136M 1s 2024-09-12T00:41:30.170 INFO:teuthology.orchestra.run.smithi138.stderr: 6750K .......... .......... .......... .......... .......... 7% 172M 1s 2024-09-12T00:41:30.170 INFO:teuthology.orchestra.run.smithi138.stderr: 6800K .......... .......... .......... .......... .......... 7% 159M 1s 2024-09-12T00:41:30.170 INFO:teuthology.orchestra.run.smithi138.stderr: 6850K .......... .......... .......... .......... .......... 7% 173M 1s 2024-09-12T00:41:30.170 INFO:teuthology.orchestra.run.smithi138.stderr: 6900K .......... .......... .......... .......... .......... 7% 166M 1s 2024-09-12T00:41:30.170 INFO:teuthology.orchestra.run.smithi138.stderr: 6950K .......... .......... .......... .......... .......... 7% 183M 1s 2024-09-12T00:41:30.170 INFO:teuthology.orchestra.run.smithi138.stderr: 7000K .......... .......... .......... .......... .......... 7% 163M 1s 2024-09-12T00:41:30.170 INFO:teuthology.orchestra.run.smithi138.stderr: 7050K .......... .......... .......... .......... .......... 7% 168M 1s 2024-09-12T00:41:30.170 INFO:teuthology.orchestra.run.smithi138.stderr: 7100K .......... .......... .......... .......... .......... 7% 144M 1s 2024-09-12T00:41:30.170 INFO:teuthology.orchestra.run.smithi138.stderr: 7150K .......... .......... .......... .......... .......... 7% 167M 1s 2024-09-12T00:41:30.170 INFO:teuthology.orchestra.run.smithi138.stderr: 7200K .......... .......... .......... .......... .......... 7% 191M 1s 2024-09-12T00:41:30.170 INFO:teuthology.orchestra.run.smithi138.stderr: 7250K .......... .......... .......... .......... .......... 7% 194M 1s 2024-09-12T00:41:30.170 INFO:teuthology.orchestra.run.smithi138.stderr: 7300K .......... .......... .......... .......... .......... 7% 168M 1s 2024-09-12T00:41:30.170 INFO:teuthology.orchestra.run.smithi138.stderr: 7350K .......... .......... .......... .......... .......... 7% 179M 1s 2024-09-12T00:41:30.171 INFO:teuthology.orchestra.run.smithi138.stderr: 7400K .......... .......... .......... .......... .......... 8% 177M 1s 2024-09-12T00:41:30.171 INFO:teuthology.orchestra.run.smithi138.stderr: 7450K .......... .......... .......... .......... .......... 8% 172M 1s 2024-09-12T00:41:30.171 INFO:teuthology.orchestra.run.smithi138.stderr: 7500K .......... .......... .......... .......... .......... 8% 147M 1s 2024-09-12T00:41:30.171 INFO:teuthology.orchestra.run.smithi138.stderr: 7550K .......... .......... .......... .......... .......... 8% 172M 1s 2024-09-12T00:41:30.171 INFO:teuthology.orchestra.run.smithi138.stderr: 7600K .......... .......... .......... .......... .......... 8% 192M 1s 2024-09-12T00:41:30.171 INFO:teuthology.orchestra.run.smithi138.stderr: 7650K .......... .......... .......... .......... .......... 8% 194M 1s 2024-09-12T00:41:30.171 INFO:teuthology.orchestra.run.smithi138.stderr: 7700K .......... .......... .......... .......... .......... 8% 167M 1s 2024-09-12T00:41:30.171 INFO:teuthology.orchestra.run.smithi138.stderr: 7750K .......... .......... .......... .......... .......... 8% 168M 1s 2024-09-12T00:41:30.171 INFO:teuthology.orchestra.run.smithi138.stderr: 7800K .......... .......... .......... .......... .......... 8% 174M 1s 2024-09-12T00:41:30.171 INFO:teuthology.orchestra.run.smithi138.stderr: 7850K .......... .......... .......... .......... .......... 8% 163M 1s 2024-09-12T00:41:30.171 INFO:teuthology.orchestra.run.smithi138.stderr: 7900K .......... .......... .......... .......... .......... 8% 159M 1s 2024-09-12T00:41:30.171 INFO:teuthology.orchestra.run.smithi138.stderr: 7950K .......... .......... .......... .......... .......... 8% 168M 1s 2024-09-12T00:41:30.171 INFO:teuthology.orchestra.run.smithi138.stderr: 8000K .......... .......... .......... .......... .......... 8% 183M 1s 2024-09-12T00:41:30.172 INFO:teuthology.orchestra.run.smithi138.stderr: 8050K .......... .......... .......... .......... .......... 8% 205M 1s 2024-09-12T00:41:30.172 INFO:teuthology.orchestra.run.smithi138.stderr: 8100K .......... .......... .......... .......... .......... 8% 180M 1s 2024-09-12T00:41:30.172 INFO:teuthology.orchestra.run.smithi138.stderr: 8150K .......... .......... .......... .......... .......... 8% 193M 1s 2024-09-12T00:41:30.172 INFO:teuthology.orchestra.run.smithi138.stderr: 8200K .......... .......... .......... .......... .......... 8% 197M 1s 2024-09-12T00:41:30.172 INFO:teuthology.orchestra.run.smithi138.stderr: 8250K .......... .......... .......... .......... .......... 8% 189M 1s 2024-09-12T00:41:30.172 INFO:teuthology.orchestra.run.smithi138.stderr: 8300K .......... .......... .......... .......... .......... 8% 128M 1s 2024-09-12T00:41:30.172 INFO:teuthology.orchestra.run.smithi138.stderr: 8350K .......... .......... .......... .......... .......... 9% 194M 1s 2024-09-12T00:41:30.172 INFO:teuthology.orchestra.run.smithi138.stderr: 8400K .......... .......... .......... .......... .......... 9% 204M 1s 2024-09-12T00:41:30.172 INFO:teuthology.orchestra.run.smithi138.stderr: 8450K .......... .......... .......... .......... .......... 9% 200M 1s 2024-09-12T00:41:30.172 INFO:teuthology.orchestra.run.smithi138.stderr: 8500K .......... .......... .......... .......... .......... 9% 166M 1s 2024-09-12T00:41:30.172 INFO:teuthology.orchestra.run.smithi138.stderr: 8550K .......... .......... .......... .......... .......... 9% 196M 1s 2024-09-12T00:41:30.172 INFO:teuthology.orchestra.run.smithi138.stderr: 8600K .......... .......... .......... .......... .......... 9% 197M 1s 2024-09-12T00:41:30.172 INFO:teuthology.orchestra.run.smithi138.stderr: 8650K .......... .......... .......... .......... .......... 9% 183M 1s 2024-09-12T00:41:30.173 INFO:teuthology.orchestra.run.smithi138.stderr: 8700K .......... .......... .......... .......... .......... 9% 173M 1s 2024-09-12T00:41:30.173 INFO:teuthology.orchestra.run.smithi138.stderr: 8750K .......... .......... .......... .......... .......... 9% 226M 1s 2024-09-12T00:41:30.173 INFO:teuthology.orchestra.run.smithi138.stderr: 8800K .......... .......... .......... .......... .......... 9% 216M 1s 2024-09-12T00:41:30.173 INFO:teuthology.orchestra.run.smithi138.stderr: 8850K .......... .......... .......... .......... .......... 9% 198M 1s 2024-09-12T00:41:30.173 INFO:teuthology.orchestra.run.smithi138.stderr: 8900K .......... .......... .......... .......... .......... 9% 200M 1s 2024-09-12T00:41:30.173 INFO:teuthology.orchestra.run.smithi138.stderr: 8950K .......... .......... .......... .......... .......... 9% 216M 1s 2024-09-12T00:41:30.173 INFO:teuthology.orchestra.run.smithi138.stderr: 9000K .......... .......... .......... .......... .......... 9% 203M 1s 2024-09-12T00:41:30.173 INFO:teuthology.orchestra.run.smithi138.stderr: 9050K .......... .......... .......... .......... .......... 9% 206M 1s 2024-09-12T00:41:30.173 INFO:teuthology.orchestra.run.smithi138.stderr: 9100K .......... .......... .......... .......... .......... 9% 180M 1s 2024-09-12T00:41:30.173 INFO:teuthology.orchestra.run.smithi138.stderr: 9150K .......... .......... .......... .......... .......... 9% 250M 1s 2024-09-12T00:41:30.173 INFO:teuthology.orchestra.run.smithi138.stderr: 9200K .......... .......... .......... .......... .......... 9% 185M 1s 2024-09-12T00:41:30.173 INFO:teuthology.orchestra.run.smithi138.stderr: 9250K .......... .......... .......... .......... .......... 10% 218M 1s 2024-09-12T00:41:30.173 INFO:teuthology.orchestra.run.smithi138.stderr: 9300K .......... .......... .......... .......... .......... 10% 187M 1s 2024-09-12T00:41:30.174 INFO:teuthology.orchestra.run.smithi138.stderr: 9350K .......... .......... .......... .......... .......... 10% 202M 1s 2024-09-12T00:41:30.174 INFO:teuthology.orchestra.run.smithi138.stderr: 9400K .......... .......... .......... .......... .......... 10% 208M 1s 2024-09-12T00:41:30.174 INFO:teuthology.orchestra.run.smithi138.stderr: 9450K .......... .......... .......... .......... .......... 10% 196M 1s 2024-09-12T00:41:30.174 INFO:teuthology.orchestra.run.smithi138.stderr: 9500K .......... .......... .......... .......... .......... 10% 194M 1s 2024-09-12T00:41:30.174 INFO:teuthology.orchestra.run.smithi138.stderr: 9550K .......... .......... .......... .......... .......... 10% 222M 1s 2024-09-12T00:41:30.174 INFO:teuthology.orchestra.run.smithi138.stderr: 9600K .......... .......... .......... .......... .......... 10% 227M 1s 2024-09-12T00:41:30.174 INFO:teuthology.orchestra.run.smithi138.stderr: 9650K .......... .......... .......... .......... .......... 10% 227M 1s 2024-09-12T00:41:30.174 INFO:teuthology.orchestra.run.smithi138.stderr: 9700K .......... .......... .......... .......... .......... 10% 193M 1s 2024-09-12T00:41:30.174 INFO:teuthology.orchestra.run.smithi138.stderr: 9750K .......... .......... .......... .......... .......... 10% 220M 1s 2024-09-12T00:41:30.174 INFO:teuthology.orchestra.run.smithi138.stderr: 9800K .......... .......... .......... .......... .......... 10% 223M 1s 2024-09-12T00:41:30.174 INFO:teuthology.orchestra.run.smithi138.stderr: 9850K .......... .......... .......... .......... .......... 10% 227M 1s 2024-09-12T00:41:30.174 INFO:teuthology.orchestra.run.smithi138.stderr: 9900K .......... .......... .......... .......... .......... 10% 201M 1s 2024-09-12T00:41:30.174 INFO:teuthology.orchestra.run.smithi138.stderr: 9950K .......... .......... .......... .......... .......... 10% 226M 1s 2024-09-12T00:41:30.175 INFO:teuthology.orchestra.run.smithi138.stderr: 10000K .......... .......... .......... .......... .......... 10% 242M 1s 2024-09-12T00:41:30.175 INFO:teuthology.orchestra.run.smithi138.stderr: 10050K .......... .......... .......... .......... .......... 10% 231M 1s 2024-09-12T00:41:30.175 INFO:teuthology.orchestra.run.smithi138.stderr: 10100K .......... .......... .......... .......... .......... 10% 212M 1s 2024-09-12T00:41:30.175 INFO:teuthology.orchestra.run.smithi138.stderr: 10150K .......... .......... .......... .......... .......... 10% 238M 1s 2024-09-12T00:41:30.175 INFO:teuthology.orchestra.run.smithi138.stderr: 10200K .......... .......... .......... .......... .......... 11% 211M 1s 2024-09-12T00:41:30.175 INFO:teuthology.orchestra.run.smithi138.stderr: 10250K .......... .......... .......... .......... .......... 11% 260M 1s 2024-09-12T00:41:30.175 INFO:teuthology.orchestra.run.smithi138.stderr: 10300K .......... .......... .......... .......... .......... 11% 175M 1s 2024-09-12T00:41:30.175 INFO:teuthology.orchestra.run.smithi138.stderr: 10350K .......... .......... .......... .......... .......... 11% 214M 1s 2024-09-12T00:41:30.175 INFO:teuthology.orchestra.run.smithi138.stderr: 10400K .......... .......... .......... .......... .......... 11% 250M 1s 2024-09-12T00:41:30.175 INFO:teuthology.orchestra.run.smithi138.stderr: 10450K .......... .......... .......... .......... .......... 11% 242M 1s 2024-09-12T00:41:30.175 INFO:teuthology.orchestra.run.smithi138.stderr: 10500K .......... .......... .......... .......... .......... 11% 213M 1s 2024-09-12T00:41:30.175 INFO:teuthology.orchestra.run.smithi138.stderr: 10550K .......... .......... .......... .......... .......... 11% 217M 1s 2024-09-12T00:41:30.175 INFO:teuthology.orchestra.run.smithi138.stderr: 10600K .......... .......... .......... .......... .......... 11% 236M 1s 2024-09-12T00:41:30.176 INFO:teuthology.orchestra.run.smithi138.stderr: 10650K .......... .......... .......... .......... .......... 11% 231M 1s 2024-09-12T00:41:30.176 INFO:teuthology.orchestra.run.smithi138.stderr: 10700K .......... .......... .......... .......... .......... 11% 178M 1s 2024-09-12T00:41:30.176 INFO:teuthology.orchestra.run.smithi138.stderr: 10750K .......... .......... .......... .......... .......... 11% 194M 1s 2024-09-12T00:41:30.176 INFO:teuthology.orchestra.run.smithi138.stderr: 10800K .......... .......... .......... .......... .......... 11% 214M 1s 2024-09-12T00:41:30.176 INFO:teuthology.orchestra.run.smithi138.stderr: 10850K .......... .......... .......... .......... .......... 11% 246M 1s 2024-09-12T00:41:30.176 INFO:teuthology.orchestra.run.smithi138.stderr: 10900K .......... .......... .......... .......... .......... 11% 195M 1s 2024-09-12T00:41:30.176 INFO:teuthology.orchestra.run.smithi138.stderr: 10950K .......... .......... .......... .......... .......... 11% 215M 1s 2024-09-12T00:41:30.176 INFO:teuthology.orchestra.run.smithi138.stderr: 11000K .......... .......... .......... .......... .......... 11% 247M 1s 2024-09-12T00:41:30.176 INFO:teuthology.orchestra.run.smithi138.stderr: 11050K .......... .......... .......... .......... .......... 11% 246M 1s 2024-09-12T00:41:30.176 INFO:teuthology.orchestra.run.smithi138.stderr: 11100K .......... .......... .......... .......... .......... 12% 198M 1s 2024-09-12T00:41:30.176 INFO:teuthology.orchestra.run.smithi138.stderr: 11150K .......... .......... .......... .......... .......... 12% 237M 1s 2024-09-12T00:41:30.176 INFO:teuthology.orchestra.run.smithi138.stderr: 11200K .......... .......... .......... .......... .......... 12% 222M 1s 2024-09-12T00:41:30.176 INFO:teuthology.orchestra.run.smithi138.stderr: 11250K .......... .......... .......... .......... .......... 12% 252M 1s 2024-09-12T00:41:30.177 INFO:teuthology.orchestra.run.smithi138.stderr: 11300K .......... .......... .......... .......... .......... 12% 219M 1s 2024-09-12T00:41:30.177 INFO:teuthology.orchestra.run.smithi138.stderr: 11350K .......... .......... .......... .......... .......... 12% 257M 1s 2024-09-12T00:41:30.177 INFO:teuthology.orchestra.run.smithi138.stderr: 11400K .......... .......... .......... .......... .......... 12% 255M 1s 2024-09-12T00:41:30.177 INFO:teuthology.orchestra.run.smithi138.stderr: 11450K .......... .......... .......... .......... .......... 12% 252M 1s 2024-09-12T00:41:30.177 INFO:teuthology.orchestra.run.smithi138.stderr: 11500K .......... .......... .......... .......... .......... 12% 198M 1s 2024-09-12T00:41:30.177 INFO:teuthology.orchestra.run.smithi138.stderr: 11550K .......... .......... .......... .......... .......... 12% 263M 1s 2024-09-12T00:41:30.177 INFO:teuthology.orchestra.run.smithi138.stderr: 11600K .......... .......... .......... .......... .......... 12% 259M 1s 2024-09-12T00:41:30.177 INFO:teuthology.orchestra.run.smithi138.stderr: 11650K .......... .......... .......... .......... .......... 12% 262M 1s 2024-09-12T00:41:30.177 INFO:teuthology.orchestra.run.smithi138.stderr: 11700K .......... .......... .......... .......... .......... 12% 227M 1s 2024-09-12T00:41:30.177 INFO:teuthology.orchestra.run.smithi138.stderr: 11750K .......... .......... .......... .......... .......... 12% 248M 1s 2024-09-12T00:41:30.177 INFO:teuthology.orchestra.run.smithi138.stderr: 11800K .......... .......... .......... .......... .......... 12% 236M 1s 2024-09-12T00:41:30.177 INFO:teuthology.orchestra.run.smithi138.stderr: 11850K .......... .......... .......... .......... .......... 12% 248M 1s 2024-09-12T00:41:30.177 INFO:teuthology.orchestra.run.smithi138.stderr: 11900K .......... .......... .......... .......... .......... 12% 219M 1s 2024-09-12T00:41:30.178 INFO:teuthology.orchestra.run.smithi138.stderr: 11950K .......... .......... .......... .......... .......... 12% 225M 1s 2024-09-12T00:41:30.178 INFO:teuthology.orchestra.run.smithi138.stderr: 12000K .......... .......... .......... .......... .......... 12% 227M 1s 2024-09-12T00:41:30.178 INFO:teuthology.orchestra.run.smithi138.stderr: 12050K .......... .......... .......... .......... .......... 13% 240M 1s 2024-09-12T00:41:30.178 INFO:teuthology.orchestra.run.smithi138.stderr: 12100K .......... .......... .......... .......... .......... 13% 223M 1s 2024-09-12T00:41:30.178 INFO:teuthology.orchestra.run.smithi138.stderr: 12150K .......... .......... .......... .......... .......... 13% 236M 1s 2024-09-12T00:41:30.178 INFO:teuthology.orchestra.run.smithi138.stderr: 12200K .......... .......... .......... .......... .......... 13% 250M 1s 2024-09-12T00:41:30.178 INFO:teuthology.orchestra.run.smithi138.stderr: 12250K .......... .......... .......... .......... .......... 13% 229M 1s 2024-09-12T00:41:30.178 INFO:teuthology.orchestra.run.smithi138.stderr: 12300K .......... .......... .......... .......... .......... 13% 218M 1s 2024-09-12T00:41:30.178 INFO:teuthology.orchestra.run.smithi138.stderr: 12350K .......... .......... .......... .......... .......... 13% 244M 1s 2024-09-12T00:41:30.178 INFO:teuthology.orchestra.run.smithi138.stderr: 12400K .......... .......... .......... .......... .......... 13% 212M 1s 2024-09-12T00:41:30.178 INFO:teuthology.orchestra.run.smithi138.stderr: 12450K .......... .......... .......... .......... .......... 13% 246M 1s 2024-09-12T00:41:30.178 INFO:teuthology.orchestra.run.smithi138.stderr: 12500K .......... .......... .......... .......... .......... 13% 220M 1s 2024-09-12T00:41:30.178 INFO:teuthology.orchestra.run.smithi138.stderr: 12550K .......... .......... .......... .......... .......... 13% 253M 1s 2024-09-12T00:41:30.178 INFO:teuthology.orchestra.run.smithi138.stderr: 12600K .......... .......... .......... .......... .......... 13% 248M 1s 2024-09-12T00:41:30.178 INFO:teuthology.orchestra.run.smithi138.stderr: 12650K .......... .......... .......... .......... .......... 13% 262M 1s 2024-09-12T00:41:30.179 INFO:teuthology.orchestra.run.smithi138.stderr: 12700K .......... .......... .......... .......... .......... 13% 222M 1s 2024-09-12T00:41:30.179 INFO:teuthology.orchestra.run.smithi138.stderr: 12750K .......... .......... .......... .......... .......... 13% 264M 1s 2024-09-12T00:41:30.179 INFO:teuthology.orchestra.run.smithi138.stderr: 12800K .......... .......... .......... .......... .......... 13% 277M 1s 2024-09-12T00:41:30.179 INFO:teuthology.orchestra.run.smithi138.stderr: 12850K .......... .......... .......... .......... .......... 13% 274M 1s 2024-09-12T00:41:30.179 INFO:teuthology.orchestra.run.smithi138.stderr: 12900K .......... .......... .......... .......... .......... 13% 248M 1s 2024-09-12T00:41:30.179 INFO:teuthology.orchestra.run.smithi138.stderr: 12950K .......... .......... .......... .......... .......... 13% 269M 1s 2024-09-12T00:41:30.179 INFO:teuthology.orchestra.run.smithi138.stderr: 13000K .......... .......... .......... .......... .......... 14% 262M 1s 2024-09-12T00:41:30.179 INFO:teuthology.orchestra.run.smithi138.stderr: 13050K .......... .......... .......... .......... .......... 14% 205M 1s 2024-09-12T00:41:30.179 INFO:teuthology.orchestra.run.smithi138.stderr: 13100K .......... .......... .......... .......... .......... 14% 194M 1s 2024-09-12T00:41:30.179 INFO:teuthology.orchestra.run.smithi138.stderr: 13150K .......... .......... .......... .......... .......... 14% 243M 1s 2024-09-12T00:41:30.179 INFO:teuthology.orchestra.run.smithi138.stderr: 13200K .......... .......... .......... .......... .......... 14% 245M 1s 2024-09-12T00:41:30.179 INFO:teuthology.orchestra.run.smithi138.stderr: 13250K .......... .......... .......... .......... .......... 14% 291M 1s 2024-09-12T00:41:30.179 INFO:teuthology.orchestra.run.smithi138.stderr: 13300K .......... .......... .......... .......... .......... 14% 239M 1s 2024-09-12T00:41:30.180 INFO:teuthology.orchestra.run.smithi138.stderr: 13350K .......... .......... .......... .......... .......... 14% 154M 1s 2024-09-12T00:41:30.180 INFO:teuthology.orchestra.run.smithi138.stderr: 13400K .......... .......... .......... .......... .......... 14% 257M 1s 2024-09-12T00:41:30.180 INFO:teuthology.orchestra.run.smithi138.stderr: 13450K .......... .......... .......... .......... .......... 14% 282M 1s 2024-09-12T00:41:30.180 INFO:teuthology.orchestra.run.smithi138.stderr: 13500K .......... .......... .......... .......... .......... 14% 208M 1s 2024-09-12T00:41:30.180 INFO:teuthology.orchestra.run.smithi138.stderr: 13550K .......... .......... .......... .......... .......... 14% 292M 1s 2024-09-12T00:41:30.180 INFO:teuthology.orchestra.run.smithi138.stderr: 13600K .......... .......... .......... .......... .......... 14% 296M 1s 2024-09-12T00:41:30.180 INFO:teuthology.orchestra.run.smithi138.stderr: 13650K .......... .......... .......... .......... .......... 14% 262M 1s 2024-09-12T00:41:30.180 INFO:teuthology.orchestra.run.smithi138.stderr: 13700K .......... .......... .......... .......... .......... 14% 243M 1s 2024-09-12T00:41:30.180 INFO:teuthology.orchestra.run.smithi138.stderr: 13750K .......... .......... .......... .......... .......... 14% 159M 1s 2024-09-12T00:41:30.180 INFO:teuthology.orchestra.run.smithi138.stderr: 13800K .......... .......... .......... .......... .......... 14% 276M 1s 2024-09-12T00:41:30.180 INFO:teuthology.orchestra.run.smithi138.stderr: 13850K .......... .......... .......... .......... .......... 14% 287M 1s 2024-09-12T00:41:30.180 INFO:teuthology.orchestra.run.smithi138.stderr: 13900K .......... .......... .......... .......... .......... 15% 233M 1s 2024-09-12T00:41:30.181 INFO:teuthology.orchestra.run.smithi138.stderr: 13950K .......... .......... .......... .......... .......... 15% 299M 1s 2024-09-12T00:41:30.181 INFO:teuthology.orchestra.run.smithi138.stderr: 14000K .......... .......... .......... .......... .......... 15% 263M 1s 2024-09-12T00:41:30.181 INFO:teuthology.orchestra.run.smithi138.stderr: 14050K .......... .......... .......... .......... .......... 15% 268M 1s 2024-09-12T00:41:30.181 INFO:teuthology.orchestra.run.smithi138.stderr: 14100K .......... .......... .......... .......... .......... 15% 250M 1s 2024-09-12T00:41:30.181 INFO:teuthology.orchestra.run.smithi138.stderr: 14150K .......... .......... .......... .......... .......... 15% 153M 1s 2024-09-12T00:41:30.181 INFO:teuthology.orchestra.run.smithi138.stderr: 14200K .......... .......... .......... .......... .......... 15% 274M 1s 2024-09-12T00:41:30.181 INFO:teuthology.orchestra.run.smithi138.stderr: 14250K .......... .......... .......... .......... .......... 15% 265M 1s 2024-09-12T00:41:30.181 INFO:teuthology.orchestra.run.smithi138.stderr: 14300K .......... .......... .......... .......... .......... 15% 237M 1s 2024-09-12T00:41:30.181 INFO:teuthology.orchestra.run.smithi138.stderr: 14350K .......... .......... .......... .......... .......... 15% 275M 1s 2024-09-12T00:41:30.181 INFO:teuthology.orchestra.run.smithi138.stderr: 14400K .......... .......... .......... .......... .......... 15% 299M 1s 2024-09-12T00:41:30.181 INFO:teuthology.orchestra.run.smithi138.stderr: 14450K .......... .......... .......... .......... .......... 15% 304M 1s 2024-09-12T00:41:30.181 INFO:teuthology.orchestra.run.smithi138.stderr: 14500K .......... .......... .......... .......... .......... 15% 217M 1s 2024-09-12T00:41:30.181 INFO:teuthology.orchestra.run.smithi138.stderr: 14550K .......... .......... .......... .......... .......... 15% 171M 1s 2024-09-12T00:41:30.182 INFO:teuthology.orchestra.run.smithi138.stderr: 14600K .......... .......... .......... .......... .......... 15% 167M 1s 2024-09-12T00:41:30.182 INFO:teuthology.orchestra.run.smithi138.stderr: 14650K .......... .......... .......... .......... .......... 15% 233M 1s 2024-09-12T00:41:30.182 INFO:teuthology.orchestra.run.smithi138.stderr: 14700K .......... .......... .......... .......... .......... 15% 140M 1s 2024-09-12T00:41:30.182 INFO:teuthology.orchestra.run.smithi138.stderr: 14750K .......... .......... .......... .......... .......... 15% 262M 1s 2024-09-12T00:41:30.182 INFO:teuthology.orchestra.run.smithi138.stderr: 14800K .......... .......... .......... .......... .......... 15% 285M 1s 2024-09-12T00:41:30.182 INFO:teuthology.orchestra.run.smithi138.stderr: 14850K .......... .......... .......... .......... .......... 16% 315M 1s 2024-09-12T00:41:30.182 INFO:teuthology.orchestra.run.smithi138.stderr: 14900K .......... .......... .......... .......... .......... 16% 244M 1s 2024-09-12T00:41:30.182 INFO:teuthology.orchestra.run.smithi138.stderr: 14950K .......... .......... .......... .......... .......... 16% 271M 1s 2024-09-12T00:41:30.182 INFO:teuthology.orchestra.run.smithi138.stderr: 15000K .......... .......... .......... .......... .......... 16% 273M 1s 2024-09-12T00:41:30.182 INFO:teuthology.orchestra.run.smithi138.stderr: 15050K .......... .......... .......... .......... .......... 16% 293M 1s 2024-09-12T00:41:30.182 INFO:teuthology.orchestra.run.smithi138.stderr: 15100K .......... .......... .......... .......... .......... 16% 149M 1s 2024-09-12T00:41:30.182 INFO:teuthology.orchestra.run.smithi138.stderr: 15150K .......... .......... .......... .......... .......... 16% 228M 1s 2024-09-12T00:41:30.182 INFO:teuthology.orchestra.run.smithi138.stderr: 15200K .......... .......... .......... .......... .......... 16% 274M 1s 2024-09-12T00:41:30.183 INFO:teuthology.orchestra.run.smithi138.stderr: 15250K .......... .......... .......... .......... .......... 16% 295M 1s 2024-09-12T00:41:30.183 INFO:teuthology.orchestra.run.smithi138.stderr: 15300K .......... .......... .......... .......... .......... 16% 284M 1s 2024-09-12T00:41:30.183 INFO:teuthology.orchestra.run.smithi138.stderr: 15350K .......... .......... .......... .......... .......... 16% 318M 1s 2024-09-12T00:41:30.183 INFO:teuthology.orchestra.run.smithi138.stderr: 15400K .......... .......... .......... .......... .......... 16% 182M 1s 2024-09-12T00:41:30.183 INFO:teuthology.orchestra.run.smithi138.stderr: 15450K .......... .......... .......... .......... .......... 16% 273M 1s 2024-09-12T00:41:30.183 INFO:teuthology.orchestra.run.smithi138.stderr: 15500K .......... .......... .......... .......... .......... 16% 238M 1s 2024-09-12T00:41:30.183 INFO:teuthology.orchestra.run.smithi138.stderr: 15550K .......... .......... .......... .......... .......... 16% 322M 1s 2024-09-12T00:41:30.183 INFO:teuthology.orchestra.run.smithi138.stderr: 15600K .......... .......... .......... .......... .......... 16% 328M 1s 2024-09-12T00:41:30.183 INFO:teuthology.orchestra.run.smithi138.stderr: 15650K .......... .......... .......... .......... .......... 16% 331M 1s 2024-09-12T00:41:30.183 INFO:teuthology.orchestra.run.smithi138.stderr: 15700K .......... .......... .......... .......... .......... 16% 258M 1s 2024-09-12T00:41:30.183 INFO:teuthology.orchestra.run.smithi138.stderr: 15750K .......... .......... .......... .......... .......... 17% 297M 1s 2024-09-12T00:41:30.183 INFO:teuthology.orchestra.run.smithi138.stderr: 15800K .......... .......... .......... .......... .......... 17% 325M 1s 2024-09-12T00:41:30.183 INFO:teuthology.orchestra.run.smithi138.stderr: 15850K .......... .......... .......... .......... .......... 17% 325M 1s 2024-09-12T00:41:30.184 INFO:teuthology.orchestra.run.smithi138.stderr: 15900K .......... .......... .......... .......... .......... 17% 83.7M 1s 2024-09-12T00:41:30.184 INFO:teuthology.orchestra.run.smithi138.stderr: 15950K .......... .......... .......... .......... .......... 17% 267M 1s 2024-09-12T00:41:30.184 INFO:teuthology.orchestra.run.smithi138.stderr: 16000K .......... .......... .......... .......... .......... 17% 291M 1s 2024-09-12T00:41:30.184 INFO:teuthology.orchestra.run.smithi138.stderr: 16050K .......... .......... .......... .......... .......... 17% 282M 1s 2024-09-12T00:41:30.184 INFO:teuthology.orchestra.run.smithi138.stderr: 16100K .......... .......... .......... .......... .......... 17% 103M 1s 2024-09-12T00:41:30.184 INFO:teuthology.orchestra.run.smithi138.stderr: 16150K .......... .......... .......... .......... .......... 17% 298M 1s 2024-09-12T00:41:30.184 INFO:teuthology.orchestra.run.smithi138.stderr: 16200K .......... .......... .......... .......... .......... 17% 301M 1s 2024-09-12T00:41:30.184 INFO:teuthology.orchestra.run.smithi138.stderr: 16250K .......... .......... .......... .......... .......... 17% 313M 1s 2024-09-12T00:41:30.184 INFO:teuthology.orchestra.run.smithi138.stderr: 16300K .......... .......... .......... .......... .......... 17% 261M 1s 2024-09-12T00:41:30.184 INFO:teuthology.orchestra.run.smithi138.stderr: 16350K .......... .......... .......... .......... .......... 17% 300M 1s 2024-09-12T00:41:30.184 INFO:teuthology.orchestra.run.smithi138.stderr: 16400K .......... .......... .......... .......... .......... 17% 300M 1s 2024-09-12T00:41:30.184 INFO:teuthology.orchestra.run.smithi138.stderr: 16450K .......... .......... .......... .......... .......... 17% 297M 1s 2024-09-12T00:41:30.184 INFO:teuthology.orchestra.run.smithi138.stderr: 16500K .......... .......... .......... .......... .......... 17% 207M 1s 2024-09-12T00:41:30.185 INFO:teuthology.orchestra.run.smithi138.stderr: 16550K .......... .......... .......... .......... .......... 17% 326M 1s 2024-09-12T00:41:30.185 INFO:teuthology.orchestra.run.smithi138.stderr: 16600K .......... .......... .......... .......... .......... 17% 307M 1s 2024-09-12T00:41:30.185 INFO:teuthology.orchestra.run.smithi138.stderr: 16650K .......... .......... .......... .......... .......... 17% 293M 1s 2024-09-12T00:41:30.185 INFO:teuthology.orchestra.run.smithi138.stderr: 16700K .......... .......... .......... .......... .......... 18% 260M 1s 2024-09-12T00:41:30.185 INFO:teuthology.orchestra.run.smithi138.stderr: 16750K .......... .......... .......... .......... .......... 18% 314M 1s 2024-09-12T00:41:30.185 INFO:teuthology.orchestra.run.smithi138.stderr: 16800K .......... .......... .......... .......... .......... 18% 305M 1s 2024-09-12T00:41:30.185 INFO:teuthology.orchestra.run.smithi138.stderr: 16850K .......... .......... .......... .......... .......... 18% 143M 1s 2024-09-12T00:41:30.185 INFO:teuthology.orchestra.run.smithi138.stderr: 16900K .......... .......... .......... .......... .......... 18% 264M 1s 2024-09-12T00:41:30.185 INFO:teuthology.orchestra.run.smithi138.stderr: 16950K .......... .......... .......... .......... .......... 18% 323M 1s 2024-09-12T00:41:30.185 INFO:teuthology.orchestra.run.smithi138.stderr: 17000K .......... .......... .......... .......... .......... 18% 195M 1s 2024-09-12T00:41:30.185 INFO:teuthology.orchestra.run.smithi138.stderr: 17050K .......... .......... .......... .......... .......... 18% 176M 1s 2024-09-12T00:41:30.185 INFO:teuthology.orchestra.run.smithi138.stderr: 17100K .......... .......... .......... .......... .......... 18% 259M 1s 2024-09-12T00:41:30.186 INFO:teuthology.orchestra.run.smithi138.stderr: 17150K .......... .......... .......... .......... .......... 18% 318M 1s 2024-09-12T00:41:30.186 INFO:teuthology.orchestra.run.smithi138.stderr: 17200K .......... .......... .......... .......... .......... 18% 314M 1s 2024-09-12T00:41:30.186 INFO:teuthology.orchestra.run.smithi138.stderr: 17250K .......... .......... .......... .......... .......... 18% 143M 1s 2024-09-12T00:41:30.186 INFO:teuthology.orchestra.run.smithi138.stderr: 17300K .......... .......... .......... .......... .......... 18% 252M 1s 2024-09-12T00:41:30.186 INFO:teuthology.orchestra.run.smithi138.stderr: 17350K .......... .......... .......... .......... .......... 18% 325M 1s 2024-09-12T00:41:30.186 INFO:teuthology.orchestra.run.smithi138.stderr: 17400K .......... .......... .......... .......... .......... 18% 330M 1s 2024-09-12T00:41:30.186 INFO:teuthology.orchestra.run.smithi138.stderr: 17450K .......... .......... .......... .......... .......... 18% 103M 1s 2024-09-12T00:41:30.186 INFO:teuthology.orchestra.run.smithi138.stderr: 17500K .......... .......... .......... .......... .......... 18% 237M 1s 2024-09-12T00:41:30.186 INFO:teuthology.orchestra.run.smithi138.stderr: 17550K .......... .......... .......... .......... .......... 18% 332M 1s 2024-09-12T00:41:30.186 INFO:teuthology.orchestra.run.smithi138.stderr: 17600K .......... .......... .......... .......... .......... 18% 170M 1s 2024-09-12T00:41:30.186 INFO:teuthology.orchestra.run.smithi138.stderr: 17650K .......... .......... .......... .......... .......... 19% 227M 1s 2024-09-12T00:41:30.186 INFO:teuthology.orchestra.run.smithi138.stderr: 17700K .......... .......... .......... .......... .......... 19% 89.0M 1s 2024-09-12T00:41:30.186 INFO:teuthology.orchestra.run.smithi138.stderr: 17750K .......... .......... .......... .......... .......... 19% 238M 1s 2024-09-12T00:41:30.186 INFO:teuthology.orchestra.run.smithi138.stderr: 17800K .......... .......... .......... .......... .......... 19% 250M 1s 2024-09-12T00:41:30.187 INFO:teuthology.orchestra.run.smithi138.stderr: 17850K .......... .......... .......... .......... .......... 19% 273M 1s 2024-09-12T00:41:30.187 INFO:teuthology.orchestra.run.smithi138.stderr: 17900K .......... .......... .......... .......... .......... 19% 190M 1s 2024-09-12T00:41:30.187 INFO:teuthology.orchestra.run.smithi138.stderr: 17950K .......... .......... .......... .......... .......... 19% 247M 1s 2024-09-12T00:41:30.187 INFO:teuthology.orchestra.run.smithi138.stderr: 18000K .......... .......... .......... .......... .......... 19% 310M 1s 2024-09-12T00:41:30.187 INFO:teuthology.orchestra.run.smithi138.stderr: 18050K .......... .......... .......... .......... .......... 19% 297M 1s 2024-09-12T00:41:30.187 INFO:teuthology.orchestra.run.smithi138.stderr: 18100K .......... .......... .......... .......... .......... 19% 290M 1s 2024-09-12T00:41:30.187 INFO:teuthology.orchestra.run.smithi138.stderr: 18150K .......... .......... .......... .......... .......... 19% 305M 1s 2024-09-12T00:41:30.187 INFO:teuthology.orchestra.run.smithi138.stderr: 18200K .......... .......... .......... .......... .......... 19% 282M 1s 2024-09-12T00:41:30.187 INFO:teuthology.orchestra.run.smithi138.stderr: 18250K .......... .......... .......... .......... .......... 19% 285M 1s 2024-09-12T00:41:30.187 INFO:teuthology.orchestra.run.smithi138.stderr: 18300K .......... .......... .......... .......... .......... 19% 259M 1s 2024-09-12T00:41:30.187 INFO:teuthology.orchestra.run.smithi138.stderr: 18350K .......... .......... .......... .......... .......... 19% 307M 1s 2024-09-12T00:41:30.187 INFO:teuthology.orchestra.run.smithi138.stderr: 18400K .......... .......... .......... .......... .......... 19% 282M 1s 2024-09-12T00:41:30.188 INFO:teuthology.orchestra.run.smithi138.stderr: 18450K .......... .......... .......... .......... .......... 19% 330M 1s 2024-09-12T00:41:30.188 INFO:teuthology.orchestra.run.smithi138.stderr: 18500K .......... .......... .......... .......... .......... 19% 269M 1s 2024-09-12T00:41:30.188 INFO:teuthology.orchestra.run.smithi138.stderr: 18550K .......... .......... .......... .......... .......... 20% 280M 1s 2024-09-12T00:41:30.188 INFO:teuthology.orchestra.run.smithi138.stderr: 18600K .......... .......... .......... .......... .......... 20% 306M 1s 2024-09-12T00:41:30.188 INFO:teuthology.orchestra.run.smithi138.stderr: 18650K .......... .......... .......... .......... .......... 20% 323M 1s 2024-09-12T00:41:30.188 INFO:teuthology.orchestra.run.smithi138.stderr: 18700K .......... .......... .......... .......... .......... 20% 260M 1s 2024-09-12T00:41:30.188 INFO:teuthology.orchestra.run.smithi138.stderr: 18750K .......... .......... .......... .......... .......... 20% 72.6M 1s 2024-09-12T00:41:30.188 INFO:teuthology.orchestra.run.smithi138.stderr: 18800K .......... .......... .......... .......... .......... 20% 231M 1s 2024-09-12T00:41:30.188 INFO:teuthology.orchestra.run.smithi138.stderr: 18850K .......... .......... .......... .......... .......... 20% 293M 1s 2024-09-12T00:41:30.188 INFO:teuthology.orchestra.run.smithi138.stderr: 18900K .......... .......... .......... .......... .......... 20% 231M 1s 2024-09-12T00:41:30.188 INFO:teuthology.orchestra.run.smithi138.stderr: 18950K .......... .......... .......... .......... .......... 20% 326M 1s 2024-09-12T00:41:30.188 INFO:teuthology.orchestra.run.smithi138.stderr: 19000K .......... .......... .......... .......... .......... 20% 293M 1s 2024-09-12T00:41:30.188 INFO:teuthology.orchestra.run.smithi138.stderr: 19050K .......... .......... .......... .......... .......... 20% 290M 1s 2024-09-12T00:41:30.189 INFO:teuthology.orchestra.run.smithi138.stderr: 19100K .......... .......... .......... .......... .......... 20% 280M 1s 2024-09-12T00:41:30.189 INFO:teuthology.orchestra.run.smithi138.stderr: 19150K .......... .......... .......... .......... .......... 20% 323M 1s 2024-09-12T00:41:30.189 INFO:teuthology.orchestra.run.smithi138.stderr: 19200K .......... .......... .......... .......... .......... 20% 318M 1s 2024-09-12T00:41:30.189 INFO:teuthology.orchestra.run.smithi138.stderr: 19250K .......... .......... .......... .......... .......... 20% 291M 1s 2024-09-12T00:41:30.189 INFO:teuthology.orchestra.run.smithi138.stderr: 19300K .......... .......... .......... .......... .......... 20% 259M 1s 2024-09-12T00:41:30.189 INFO:teuthology.orchestra.run.smithi138.stderr: 19350K .......... .......... .......... .......... .......... 20% 333M 1s 2024-09-12T00:41:30.189 INFO:teuthology.orchestra.run.smithi138.stderr: 19400K .......... .......... .......... .......... .......... 20% 331M 1s 2024-09-12T00:41:30.189 INFO:teuthology.orchestra.run.smithi138.stderr: 19450K .......... .......... .......... .......... .......... 20% 308M 1s 2024-09-12T00:41:30.189 INFO:teuthology.orchestra.run.smithi138.stderr: 19500K .......... .......... .......... .......... .......... 21% 284M 1s 2024-09-12T00:41:30.189 INFO:teuthology.orchestra.run.smithi138.stderr: 19550K .......... .......... .......... .......... .......... 21% 185M 1s 2024-09-12T00:41:30.189 INFO:teuthology.orchestra.run.smithi138.stderr: 19600K .......... .......... .......... .......... .......... 21% 295M 1s 2024-09-12T00:41:30.189 INFO:teuthology.orchestra.run.smithi138.stderr: 19650K .......... .......... .......... .......... .......... 21% 308M 1s 2024-09-12T00:41:30.189 INFO:teuthology.orchestra.run.smithi138.stderr: 19700K .......... .......... .......... .......... .......... 21% 274M 1s 2024-09-12T00:41:30.190 INFO:teuthology.orchestra.run.smithi138.stderr: 19750K .......... .......... .......... .......... .......... 21% 318M 1s 2024-09-12T00:41:30.190 INFO:teuthology.orchestra.run.smithi138.stderr: 19800K .......... .......... .......... .......... .......... 21% 165M 1s 2024-09-12T00:41:30.190 INFO:teuthology.orchestra.run.smithi138.stderr: 19850K .......... .......... .......... .......... .......... 21% 321M 1s 2024-09-12T00:41:30.190 INFO:teuthology.orchestra.run.smithi138.stderr: 19900K .......... .......... .......... .......... .......... 21% 85.8M 1s 2024-09-12T00:41:30.190 INFO:teuthology.orchestra.run.smithi138.stderr: 19950K .......... .......... .......... .......... .......... 21% 272M 1s 2024-09-12T00:41:30.190 INFO:teuthology.orchestra.run.smithi138.stderr: 20000K .......... .......... .......... .......... .......... 21% 285M 1s 2024-09-12T00:41:30.190 INFO:teuthology.orchestra.run.smithi138.stderr: 20050K .......... .......... .......... .......... .......... 21% 305M 1s 2024-09-12T00:41:30.190 INFO:teuthology.orchestra.run.smithi138.stderr: 20100K .......... .......... .......... .......... .......... 21% 265M 1s 2024-09-12T00:41:30.190 INFO:teuthology.orchestra.run.smithi138.stderr: 20150K .......... .......... .......... .......... .......... 21% 324M 1s 2024-09-12T00:41:30.190 INFO:teuthology.orchestra.run.smithi138.stderr: 20200K .......... .......... .......... .......... .......... 21% 324M 1s 2024-09-12T00:41:30.190 INFO:teuthology.orchestra.run.smithi138.stderr: 20250K .......... .......... .......... .......... .......... 21% 297M 1s 2024-09-12T00:41:30.190 INFO:teuthology.orchestra.run.smithi138.stderr: 20300K .......... .......... .......... .......... .......... 21% 253M 1s 2024-09-12T00:41:30.190 INFO:teuthology.orchestra.run.smithi138.stderr: 20350K .......... .......... .......... .......... .......... 21% 107M 1s 2024-09-12T00:41:30.190 INFO:teuthology.orchestra.run.smithi138.stderr: 20400K .......... .......... .......... .......... .......... 22% 243M 1s 2024-09-12T00:41:30.191 INFO:teuthology.orchestra.run.smithi138.stderr: 20450K .......... .......... .......... .......... .......... 22% 307M 1s 2024-09-12T00:41:30.191 INFO:teuthology.orchestra.run.smithi138.stderr: 20500K .......... .......... .......... .......... .......... 22% 194M 1s 2024-09-12T00:41:30.191 INFO:teuthology.orchestra.run.smithi138.stderr: 20550K .......... .......... .......... .......... .......... 22% 325M 1s 2024-09-12T00:41:30.191 INFO:teuthology.orchestra.run.smithi138.stderr: 20600K .......... .......... .......... .......... .......... 22% 232M 1s 2024-09-12T00:41:30.191 INFO:teuthology.orchestra.run.smithi138.stderr: 20650K .......... .......... .......... .......... .......... 22% 305M 1s 2024-09-12T00:41:30.191 INFO:teuthology.orchestra.run.smithi138.stderr: 20700K .......... .......... .......... .......... .......... 22% 125M 1s 2024-09-12T00:41:30.191 INFO:teuthology.orchestra.run.smithi138.stderr: 20750K .......... .......... .......... .......... .......... 22% 166M 1s 2024-09-12T00:41:30.191 INFO:teuthology.orchestra.run.smithi138.stderr: 20800K .......... .......... .......... .......... .......... 22% 70.1M 1s 2024-09-12T00:41:30.191 INFO:teuthology.orchestra.run.smithi138.stderr: 20850K .......... .......... .......... .......... .......... 22% 303M 1s 2024-09-12T00:41:30.191 INFO:teuthology.orchestra.run.smithi138.stderr: 20900K .......... .......... .......... .......... .......... 22% 257M 1s 2024-09-12T00:41:30.191 INFO:teuthology.orchestra.run.smithi138.stderr: 20950K .......... .......... .......... .......... .......... 22% 284M 1s 2024-09-12T00:41:30.191 INFO:teuthology.orchestra.run.smithi138.stderr: 21000K .......... .......... .......... .......... .......... 22% 311M 1s 2024-09-12T00:41:30.191 INFO:teuthology.orchestra.run.smithi138.stderr: 21050K .......... .......... .......... .......... .......... 22% 292M 1s 2024-09-12T00:41:30.192 INFO:teuthology.orchestra.run.smithi138.stderr: 21100K .......... .......... .......... .......... .......... 22% 256M 1s 2024-09-12T00:41:30.192 INFO:teuthology.orchestra.run.smithi138.stderr: 21150K .......... .......... .......... .......... .......... 22% 334M 1s 2024-09-12T00:41:30.192 INFO:teuthology.orchestra.run.smithi138.stderr: 21200K .......... .......... .......... .......... .......... 22% 294M 1s 2024-09-12T00:41:30.192 INFO:teuthology.orchestra.run.smithi138.stderr: 21250K .......... .......... .......... .......... .......... 22% 250M 1s 2024-09-12T00:41:30.192 INFO:teuthology.orchestra.run.smithi138.stderr: 21300K .......... .......... .......... .......... .......... 22% 296M 1s 2024-09-12T00:41:30.192 INFO:teuthology.orchestra.run.smithi138.stderr: 21350K .......... .......... .......... .......... .......... 23% 305M 1s 2024-09-12T00:41:30.192 INFO:teuthology.orchestra.run.smithi138.stderr: 21400K .......... .......... .......... .......... .......... 23% 327M 1s 2024-09-12T00:41:30.192 INFO:teuthology.orchestra.run.smithi138.stderr: 21450K .......... .......... .......... .......... .......... 23% 301M 1s 2024-09-12T00:41:30.192 INFO:teuthology.orchestra.run.smithi138.stderr: 21500K .......... .......... .......... .......... .......... 23% 250M 1s 2024-09-12T00:41:30.192 INFO:teuthology.orchestra.run.smithi138.stderr: 21550K .......... .......... .......... .......... .......... 23% 270M 1s 2024-09-12T00:41:30.192 INFO:teuthology.orchestra.run.smithi138.stderr: 21600K .......... .......... .......... .......... .......... 23% 301M 1s 2024-09-12T00:41:30.192 INFO:teuthology.orchestra.run.smithi138.stderr: 21650K .......... .......... .......... .......... .......... 23% 321M 1s 2024-09-12T00:41:30.193 INFO:teuthology.orchestra.run.smithi138.stderr: 21700K .......... .......... .......... .......... .......... 23% 298M 1s 2024-09-12T00:41:30.193 INFO:teuthology.orchestra.run.smithi138.stderr: 21750K .......... .......... .......... .......... .......... 23% 209M 1s 2024-09-12T00:41:30.193 INFO:teuthology.orchestra.run.smithi138.stderr: 21800K .......... .......... .......... .......... .......... 23% 300M 1s 2024-09-12T00:41:30.193 INFO:teuthology.orchestra.run.smithi138.stderr: 21850K .......... .......... .......... .......... .......... 23% 99.5M 1s 2024-09-12T00:41:30.193 INFO:teuthology.orchestra.run.smithi138.stderr: 21900K .......... .......... .......... .......... .......... 23% 161M 1s 2024-09-12T00:41:30.193 INFO:teuthology.orchestra.run.smithi138.stderr: 21950K .......... .......... .......... .......... .......... 23% 291M 1s 2024-09-12T00:41:30.193 INFO:teuthology.orchestra.run.smithi138.stderr: 22000K .......... .......... .......... .......... .......... 23% 302M 1s 2024-09-12T00:41:30.193 INFO:teuthology.orchestra.run.smithi138.stderr: 22050K .......... .......... .......... .......... .......... 23% 304M 1s 2024-09-12T00:41:30.193 INFO:teuthology.orchestra.run.smithi138.stderr: 22100K .......... .......... .......... .......... .......... 23% 252M 1s 2024-09-12T00:41:30.193 INFO:teuthology.orchestra.run.smithi138.stderr: 22150K .......... .......... .......... .......... .......... 23% 305M 1s 2024-09-12T00:41:30.193 INFO:teuthology.orchestra.run.smithi138.stderr: 22200K .......... .......... .......... .......... .......... 23% 306M 1s 2024-09-12T00:41:30.193 INFO:teuthology.orchestra.run.smithi138.stderr: 22250K .......... .......... .......... .......... .......... 24% 312M 1s 2024-09-12T00:41:30.193 INFO:teuthology.orchestra.run.smithi138.stderr: 22300K .......... .......... .......... .......... .......... 24% 262M 1s 2024-09-12T00:41:30.193 INFO:teuthology.orchestra.run.smithi138.stderr: 22350K .......... .......... .......... .......... .......... 24% 294M 1s 2024-09-12T00:41:30.194 INFO:teuthology.orchestra.run.smithi138.stderr: 22400K .......... .......... .......... .......... .......... 24% 294M 1s 2024-09-12T00:41:30.194 INFO:teuthology.orchestra.run.smithi138.stderr: 22450K .......... .......... .......... .......... .......... 24% 305M 1s 2024-09-12T00:41:30.194 INFO:teuthology.orchestra.run.smithi138.stderr: 22500K .......... .......... .......... .......... .......... 24% 282M 1s 2024-09-12T00:41:30.194 INFO:teuthology.orchestra.run.smithi138.stderr: 22550K .......... .......... .......... .......... .......... 24% 288M 1s 2024-09-12T00:41:30.194 INFO:teuthology.orchestra.run.smithi138.stderr: 22600K .......... .......... .......... .......... .......... 24% 330M 1s 2024-09-12T00:41:30.194 INFO:teuthology.orchestra.run.smithi138.stderr: 22650K .......... .......... .......... .......... .......... 24% 311M 1s 2024-09-12T00:41:30.194 INFO:teuthology.orchestra.run.smithi138.stderr: 22700K .......... .......... .......... .......... .......... 24% 251M 1s 2024-09-12T00:41:30.194 INFO:teuthology.orchestra.run.smithi138.stderr: 22750K .......... .......... .......... .......... .......... 24% 281M 1s 2024-09-12T00:41:30.194 INFO:teuthology.orchestra.run.smithi138.stderr: 22800K .......... .......... .......... .......... .......... 24% 309M 1s 2024-09-12T00:41:30.194 INFO:teuthology.orchestra.run.smithi138.stderr: 22850K .......... .......... .......... .......... .......... 24% 332M 1s 2024-09-12T00:41:30.194 INFO:teuthology.orchestra.run.smithi138.stderr: 22900K .......... .......... .......... .......... .......... 24% 103M 1s 2024-09-12T00:41:30.194 INFO:teuthology.orchestra.run.smithi138.stderr: 22950K .......... .......... .......... .......... .......... 24% 284M 1s 2024-09-12T00:41:30.194 INFO:teuthology.orchestra.run.smithi138.stderr: 23000K .......... .......... .......... .......... .......... 24% 317M 1s 2024-09-12T00:41:30.195 INFO:teuthology.orchestra.run.smithi138.stderr: 23050K .......... .......... .......... .......... .......... 24% 308M 1s 2024-09-12T00:41:30.195 INFO:teuthology.orchestra.run.smithi138.stderr: 23100K .......... .......... .......... .......... .......... 24% 250M 1s 2024-09-12T00:41:30.195 INFO:teuthology.orchestra.run.smithi138.stderr: 23150K .......... .......... .......... .......... .......... 24% 212M 1s 2024-09-12T00:41:30.195 INFO:teuthology.orchestra.run.smithi138.stderr: 23200K .......... .......... .......... .......... .......... 25% 297M 1s 2024-09-12T00:41:30.195 INFO:teuthology.orchestra.run.smithi138.stderr: 23250K .......... .......... .......... .......... .......... 25% 327M 1s 2024-09-12T00:41:30.195 INFO:teuthology.orchestra.run.smithi138.stderr: 23300K .......... .......... .......... .......... .......... 25% 279M 1s 2024-09-12T00:41:30.195 INFO:teuthology.orchestra.run.smithi138.stderr: 23350K .......... .......... .......... .......... .......... 25% 120M 1s 2024-09-12T00:41:30.195 INFO:teuthology.orchestra.run.smithi138.stderr: 23400K .......... .......... .......... .......... .......... 25% 294M 1s 2024-09-12T00:41:30.195 INFO:teuthology.orchestra.run.smithi138.stderr: 23450K .......... .......... .......... .......... .......... 25% 335M 1s 2024-09-12T00:41:30.195 INFO:teuthology.orchestra.run.smithi138.stderr: 23500K .......... .......... .......... .......... .......... 25% 208M 1s 2024-09-12T00:41:30.195 INFO:teuthology.orchestra.run.smithi138.stderr: 23550K .......... .......... .......... .......... .......... 25% 288M 1s 2024-09-12T00:41:30.195 INFO:teuthology.orchestra.run.smithi138.stderr: 23600K .......... .......... .......... .......... .......... 25% 241M 1s 2024-09-12T00:41:30.195 INFO:teuthology.orchestra.run.smithi138.stderr: 23650K .......... .......... .......... .......... .......... 25% 306M 1s 2024-09-12T00:41:30.195 INFO:teuthology.orchestra.run.smithi138.stderr: 23700K .......... .......... .......... .......... .......... 25% 290M 1s 2024-09-12T00:41:30.196 INFO:teuthology.orchestra.run.smithi138.stderr: 23750K .......... .......... .......... .......... .......... 25% 110M 1s 2024-09-12T00:41:30.196 INFO:teuthology.orchestra.run.smithi138.stderr: 23800K .......... .......... .......... .......... .......... 25% 59.2M 1s 2024-09-12T00:41:30.196 INFO:teuthology.orchestra.run.smithi138.stderr: 23850K .......... .......... .......... .......... .......... 25% 281M 1s 2024-09-12T00:41:30.196 INFO:teuthology.orchestra.run.smithi138.stderr: 23900K .......... .......... .......... .......... .......... 25% 156M 1s 2024-09-12T00:41:30.196 INFO:teuthology.orchestra.run.smithi138.stderr: 23950K .......... .......... .......... .......... .......... 25% 283M 1s 2024-09-12T00:41:30.196 INFO:teuthology.orchestra.run.smithi138.stderr: 24000K .......... .......... .......... .......... .......... 25% 295M 1s 2024-09-12T00:41:30.196 INFO:teuthology.orchestra.run.smithi138.stderr: 24050K .......... .......... .......... .......... .......... 25% 303M 1s 2024-09-12T00:41:30.196 INFO:teuthology.orchestra.run.smithi138.stderr: 24100K .......... .......... .......... .......... .......... 25% 292M 1s 2024-09-12T00:41:30.196 INFO:teuthology.orchestra.run.smithi138.stderr: 24150K .......... .......... .......... .......... .......... 26% 303M 1s 2024-09-12T00:41:30.196 INFO:teuthology.orchestra.run.smithi138.stderr: 24200K .......... .......... .......... .......... .......... 26% 283M 1s 2024-09-12T00:41:30.196 INFO:teuthology.orchestra.run.smithi138.stderr: 24250K .......... .......... .......... .......... .......... 26% 285M 1s 2024-09-12T00:41:30.196 INFO:teuthology.orchestra.run.smithi138.stderr: 24300K .......... .......... .......... .......... .......... 26% 237M 1s 2024-09-12T00:41:30.196 INFO:teuthology.orchestra.run.smithi138.stderr: 24350K .......... .......... .......... .......... .......... 26% 296M 1s 2024-09-12T00:41:30.197 INFO:teuthology.orchestra.run.smithi138.stderr: 24400K .......... .......... .......... .......... .......... 26% 298M 1s 2024-09-12T00:41:30.197 INFO:teuthology.orchestra.run.smithi138.stderr: 24450K .......... .......... .......... .......... .......... 26% 327M 1s 2024-09-12T00:41:30.197 INFO:teuthology.orchestra.run.smithi138.stderr: 24500K .......... .......... .......... .......... .......... 26% 280M 1s 2024-09-12T00:41:30.197 INFO:teuthology.orchestra.run.smithi138.stderr: 24550K .......... .......... .......... .......... .......... 26% 300M 1s 2024-09-12T00:41:30.197 INFO:teuthology.orchestra.run.smithi138.stderr: 24600K .......... .......... .......... .......... .......... 26% 326M 1s 2024-09-12T00:41:30.197 INFO:teuthology.orchestra.run.smithi138.stderr: 24650K .......... .......... .......... .......... .......... 26% 327M 1s 2024-09-12T00:41:30.197 INFO:teuthology.orchestra.run.smithi138.stderr: 24700K .......... .......... .......... .......... .......... 26% 190M 1s 2024-09-12T00:41:30.197 INFO:teuthology.orchestra.run.smithi138.stderr: 24750K .......... .......... .......... .......... .......... 26% 308M 1s 2024-09-12T00:41:30.197 INFO:teuthology.orchestra.run.smithi138.stderr: 24800K .......... .......... .......... .......... .......... 26% 165M 1s 2024-09-12T00:41:30.197 INFO:teuthology.orchestra.run.smithi138.stderr: 24850K .......... .......... .......... .......... .......... 26% 284M 1s 2024-09-12T00:41:30.197 INFO:teuthology.orchestra.run.smithi138.stderr: 24900K .......... .......... .......... .......... .......... 26% 97.9M 1s 2024-09-12T00:41:30.197 INFO:teuthology.orchestra.run.smithi138.stderr: 24950K .......... .......... .......... .......... .......... 26% 315M 1s 2024-09-12T00:41:30.197 INFO:teuthology.orchestra.run.smithi138.stderr: 25000K .......... .......... .......... .......... .......... 26% 276M 1s 2024-09-12T00:41:30.198 INFO:teuthology.orchestra.run.smithi138.stderr: 25050K .......... .......... .......... .......... .......... 27% 310M 1s 2024-09-12T00:41:30.198 INFO:teuthology.orchestra.run.smithi138.stderr: 25100K .......... .......... .......... .......... .......... 27% 238M 1s 2024-09-12T00:41:30.198 INFO:teuthology.orchestra.run.smithi138.stderr: 25150K .......... .......... .......... .......... .......... 27% 309M 1s 2024-09-12T00:41:30.198 INFO:teuthology.orchestra.run.smithi138.stderr: 25200K .......... .......... .......... .......... .......... 27% 329M 1s 2024-09-12T00:41:30.198 INFO:teuthology.orchestra.run.smithi138.stderr: 25250K .......... .......... .......... .......... .......... 27% 124M 1s 2024-09-12T00:41:30.198 INFO:teuthology.orchestra.run.smithi138.stderr: 25300K .......... .......... .......... .......... .......... 27% 221M 1s 2024-09-12T00:41:30.198 INFO:teuthology.orchestra.run.smithi138.stderr: 25350K .......... .......... .......... .......... .......... 27% 258M 1s 2024-09-12T00:41:30.198 INFO:teuthology.orchestra.run.smithi138.stderr: 25400K .......... .......... .......... .......... .......... 27% 276M 1s 2024-09-12T00:41:30.198 INFO:teuthology.orchestra.run.smithi138.stderr: 25450K .......... .......... .......... .......... .......... 27% 297M 1s 2024-09-12T00:41:30.198 INFO:teuthology.orchestra.run.smithi138.stderr: 25500K .......... .......... .......... .......... .......... 27% 215M 1s 2024-09-12T00:41:30.198 INFO:teuthology.orchestra.run.smithi138.stderr: 25550K .......... .......... .......... .......... .......... 27% 295M 1s 2024-09-12T00:41:30.198 INFO:teuthology.orchestra.run.smithi138.stderr: 25600K .......... .......... .......... .......... .......... 27% 325M 1s 2024-09-12T00:41:30.198 INFO:teuthology.orchestra.run.smithi138.stderr: 25650K .......... .......... .......... .......... .......... 27% 323M 1s 2024-09-12T00:41:30.199 INFO:teuthology.orchestra.run.smithi138.stderr: 25700K .......... .......... .......... .......... .......... 27% 291M 1s 2024-09-12T00:41:30.199 INFO:teuthology.orchestra.run.smithi138.stderr: 25750K .......... .......... .......... .......... .......... 27% 295M 1s 2024-09-12T00:41:30.199 INFO:teuthology.orchestra.run.smithi138.stderr: 25800K .......... .......... .......... .......... .......... 27% 312M 1s 2024-09-12T00:41:30.199 INFO:teuthology.orchestra.run.smithi138.stderr: 25850K .......... .......... .......... .......... .......... 27% 136M 1s 2024-09-12T00:41:30.199 INFO:teuthology.orchestra.run.smithi138.stderr: 25900K .......... .......... .......... .......... .......... 27% 257M 1s 2024-09-12T00:41:30.199 INFO:teuthology.orchestra.run.smithi138.stderr: 25950K .......... .......... .......... .......... .......... 27% 296M 1s 2024-09-12T00:41:30.199 INFO:teuthology.orchestra.run.smithi138.stderr: 26000K .......... .......... .......... .......... .......... 28% 307M 1s 2024-09-12T00:41:30.199 INFO:teuthology.orchestra.run.smithi138.stderr: 26050K .......... .......... .......... .......... .......... 28% 288M 1s 2024-09-12T00:41:30.199 INFO:teuthology.orchestra.run.smithi138.stderr: 26100K .......... .......... .......... .......... .......... 28% 261M 1s 2024-09-12T00:41:30.199 INFO:teuthology.orchestra.run.smithi138.stderr: 26150K .......... .......... .......... .......... .......... 28% 313M 1s 2024-09-12T00:41:30.199 INFO:teuthology.orchestra.run.smithi138.stderr: 26200K .......... .......... .......... .......... .......... 28% 289M 1s 2024-09-12T00:41:30.199 INFO:teuthology.orchestra.run.smithi138.stderr: 26250K .......... .......... .......... .......... .......... 28% 333M 0s 2024-09-12T00:41:30.200 INFO:teuthology.orchestra.run.smithi138.stderr: 26300K .......... .......... .......... .......... .......... 28% 243M 0s 2024-09-12T00:41:30.200 INFO:teuthology.orchestra.run.smithi138.stderr: 26350K .......... .......... .......... .......... .......... 28% 308M 0s 2024-09-12T00:41:30.200 INFO:teuthology.orchestra.run.smithi138.stderr: 26400K .......... .......... .......... .......... .......... 28% 317M 0s 2024-09-12T00:41:30.200 INFO:teuthology.orchestra.run.smithi138.stderr: 26450K .......... .......... .......... .......... .......... 28% 306M 0s 2024-09-12T00:41:30.200 INFO:teuthology.orchestra.run.smithi138.stderr: 26500K .......... .......... .......... .......... .......... 28% 264M 0s 2024-09-12T00:41:30.200 INFO:teuthology.orchestra.run.smithi138.stderr: 26550K .......... .......... .......... .......... .......... 28% 302M 0s 2024-09-12T00:41:30.200 INFO:teuthology.orchestra.run.smithi138.stderr: 26600K .......... .......... .......... .......... .......... 28% 322M 0s 2024-09-12T00:41:30.200 INFO:teuthology.orchestra.run.smithi138.stderr: 26650K .......... .......... .......... .......... .......... 28% 289M 0s 2024-09-12T00:41:30.200 INFO:teuthology.orchestra.run.smithi138.stderr: 26700K .......... .......... .......... .......... .......... 28% 204M 0s 2024-09-12T00:41:30.200 INFO:teuthology.orchestra.run.smithi138.stderr: 26750K .......... .......... .......... .......... .......... 28% 291M 0s 2024-09-12T00:41:30.200 INFO:teuthology.orchestra.run.smithi138.stderr: 26800K .......... .......... .......... .......... .......... 28% 48.5M 0s 2024-09-12T00:41:30.200 INFO:teuthology.orchestra.run.smithi138.stderr: 26850K .......... .......... .......... .......... .......... 28% 77.3M 0s 2024-09-12T00:41:30.200 INFO:teuthology.orchestra.run.smithi138.stderr: 26900K .......... .......... .......... .......... .......... 29% 234M 0s 2024-09-12T00:41:30.201 INFO:teuthology.orchestra.run.smithi138.stderr: 26950K .......... .......... .......... .......... .......... 29% 289M 0s 2024-09-12T00:41:30.201 INFO:teuthology.orchestra.run.smithi138.stderr: 27000K .......... .......... .......... .......... .......... 29% 278M 0s 2024-09-12T00:41:30.201 INFO:teuthology.orchestra.run.smithi138.stderr: 27050K .......... .......... .......... .......... .......... 29% 232M 0s 2024-09-12T00:41:30.201 INFO:teuthology.orchestra.run.smithi138.stderr: 27100K .......... .......... .......... .......... .......... 29% 215M 0s 2024-09-12T00:41:30.201 INFO:teuthology.orchestra.run.smithi138.stderr: 27150K .......... .......... .......... .......... .......... 29% 275M 0s 2024-09-12T00:41:30.201 INFO:teuthology.orchestra.run.smithi138.stderr: 27200K .......... .......... .......... .......... .......... 29% 295M 0s 2024-09-12T00:41:30.201 INFO:teuthology.orchestra.run.smithi138.stderr: 27250K .......... .......... .......... .......... .......... 29% 292M 0s 2024-09-12T00:41:30.201 INFO:teuthology.orchestra.run.smithi138.stderr: 27300K .......... .......... .......... .......... .......... 29% 208M 0s 2024-09-12T00:41:30.201 INFO:teuthology.orchestra.run.smithi138.stderr: 27350K .......... .......... .......... .......... .......... 29% 229M 0s 2024-09-12T00:41:30.201 INFO:teuthology.orchestra.run.smithi138.stderr: 27400K .......... .......... .......... .......... .......... 29% 270M 0s 2024-09-12T00:41:30.201 INFO:teuthology.orchestra.run.smithi138.stderr: 27450K .......... .......... .......... .......... .......... 29% 255M 0s 2024-09-12T00:41:30.201 INFO:teuthology.orchestra.run.smithi138.stderr: 27500K .......... .......... .......... .......... .......... 29% 195M 0s 2024-09-12T00:41:30.201 INFO:teuthology.orchestra.run.smithi138.stderr: 27550K .......... .......... .......... .......... .......... 29% 213M 0s 2024-09-12T00:41:30.202 INFO:teuthology.orchestra.run.smithi138.stderr: 27600K .......... .......... .......... .......... .......... 29% 211M 0s 2024-09-12T00:41:30.202 INFO:teuthology.orchestra.run.smithi138.stderr: 27650K .......... .......... .......... .......... .......... 29% 272M 0s 2024-09-12T00:41:30.202 INFO:teuthology.orchestra.run.smithi138.stderr: 27700K .......... .......... .......... .......... .......... 29% 265M 0s 2024-09-12T00:41:30.202 INFO:teuthology.orchestra.run.smithi138.stderr: 27750K .......... .......... .......... .......... .......... 29% 241M 0s 2024-09-12T00:41:30.202 INFO:teuthology.orchestra.run.smithi138.stderr: 27800K .......... .......... .......... .......... .......... 29% 274M 0s 2024-09-12T00:41:30.202 INFO:teuthology.orchestra.run.smithi138.stderr: 27850K .......... .......... .......... .......... .......... 30% 307M 0s 2024-09-12T00:41:30.202 INFO:teuthology.orchestra.run.smithi138.stderr: 27900K .......... .......... .......... .......... .......... 30% 248M 0s 2024-09-12T00:41:30.202 INFO:teuthology.orchestra.run.smithi138.stderr: 27950K .......... .......... .......... .......... .......... 30% 274M 0s 2024-09-12T00:41:30.202 INFO:teuthology.orchestra.run.smithi138.stderr: 28000K .......... .......... .......... .......... .......... 30% 243M 0s 2024-09-12T00:41:30.202 INFO:teuthology.orchestra.run.smithi138.stderr: 28050K .......... .......... .......... .......... .......... 30% 277M 0s 2024-09-12T00:41:30.202 INFO:teuthology.orchestra.run.smithi138.stderr: 28100K .......... .......... .......... .......... .......... 30% 278M 0s 2024-09-12T00:41:30.202 INFO:teuthology.orchestra.run.smithi138.stderr: 28150K .......... .......... .......... .......... .......... 30% 308M 0s 2024-09-12T00:41:30.202 INFO:teuthology.orchestra.run.smithi138.stderr: 28200K .......... .......... .......... .......... .......... 30% 290M 0s 2024-09-12T00:41:30.203 INFO:teuthology.orchestra.run.smithi138.stderr: 28250K .......... .......... .......... .......... .......... 30% 295M 0s 2024-09-12T00:41:30.203 INFO:teuthology.orchestra.run.smithi138.stderr: 28300K .......... .......... .......... .......... .......... 30% 207M 0s 2024-09-12T00:41:30.203 INFO:teuthology.orchestra.run.smithi138.stderr: 28350K .......... .......... .......... .......... .......... 30% 259M 0s 2024-09-12T00:41:30.203 INFO:teuthology.orchestra.run.smithi138.stderr: 28400K .......... .......... .......... .......... .......... 30% 317M 0s 2024-09-12T00:41:30.203 INFO:teuthology.orchestra.run.smithi138.stderr: 28450K .......... .......... .......... .......... .......... 30% 153M 0s 2024-09-12T00:41:30.203 INFO:teuthology.orchestra.run.smithi138.stderr: 28500K .......... .......... .......... .......... .......... 30% 269M 0s 2024-09-12T00:41:30.203 INFO:teuthology.orchestra.run.smithi138.stderr: 28550K .......... .......... .......... .......... .......... 30% 292M 0s 2024-09-12T00:41:30.203 INFO:teuthology.orchestra.run.smithi138.stderr: 28600K .......... .......... .......... .......... .......... 30% 247M 0s 2024-09-12T00:41:30.203 INFO:teuthology.orchestra.run.smithi138.stderr: 28650K .......... .......... .......... .......... .......... 30% 316M 0s 2024-09-12T00:41:30.203 INFO:teuthology.orchestra.run.smithi138.stderr: 28700K .......... .......... .......... .......... .......... 30% 81.2M 0s 2024-09-12T00:41:30.203 INFO:teuthology.orchestra.run.smithi138.stderr: 28750K .......... .......... .......... .......... .......... 31% 210M 0s 2024-09-12T00:41:30.203 INFO:teuthology.orchestra.run.smithi138.stderr: 28800K .......... .......... .......... .......... .......... 31% 275M 0s 2024-09-12T00:41:30.203 INFO:teuthology.orchestra.run.smithi138.stderr: 28850K .......... .......... .......... .......... .......... 31% 298M 0s 2024-09-12T00:41:30.204 INFO:teuthology.orchestra.run.smithi138.stderr: 28900K .......... .......... .......... .......... .......... 31% 270M 0s 2024-09-12T00:41:30.204 INFO:teuthology.orchestra.run.smithi138.stderr: 28950K .......... .......... .......... .......... .......... 31% 281M 0s 2024-09-12T00:41:30.204 INFO:teuthology.orchestra.run.smithi138.stderr: 29000K .......... .......... .......... .......... .......... 31% 300M 0s 2024-09-12T00:41:30.204 INFO:teuthology.orchestra.run.smithi138.stderr: 29050K .......... .......... .......... .......... .......... 31% 313M 0s 2024-09-12T00:41:30.204 INFO:teuthology.orchestra.run.smithi138.stderr: 29100K .......... .......... .......... .......... .......... 31% 248M 0s 2024-09-12T00:41:30.204 INFO:teuthology.orchestra.run.smithi138.stderr: 29150K .......... .......... .......... .......... .......... 31% 300M 0s 2024-09-12T00:41:30.204 INFO:teuthology.orchestra.run.smithi138.stderr: 29200K .......... .......... .......... .......... .......... 31% 318M 0s 2024-09-12T00:41:30.204 INFO:teuthology.orchestra.run.smithi138.stderr: 29250K .......... .......... .......... .......... .......... 31% 325M 0s 2024-09-12T00:41:30.204 INFO:teuthology.orchestra.run.smithi138.stderr: 29300K .......... .......... .......... .......... .......... 31% 279M 0s 2024-09-12T00:41:30.204 INFO:teuthology.orchestra.run.smithi138.stderr: 29350K .......... .......... .......... .......... .......... 31% 289M 0s 2024-09-12T00:41:30.204 INFO:teuthology.orchestra.run.smithi138.stderr: 29400K .......... .......... .......... .......... .......... 31% 294M 0s 2024-09-12T00:41:30.204 INFO:teuthology.orchestra.run.smithi138.stderr: 29450K .......... .......... .......... .......... .......... 31% 293M 0s 2024-09-12T00:41:30.204 INFO:teuthology.orchestra.run.smithi138.stderr: 29500K .......... .......... .......... .......... .......... 31% 266M 0s 2024-09-12T00:41:30.205 INFO:teuthology.orchestra.run.smithi138.stderr: 29550K .......... .......... .......... .......... .......... 31% 311M 0s 2024-09-12T00:41:30.205 INFO:teuthology.orchestra.run.smithi138.stderr: 29600K .......... .......... .......... .......... .......... 31% 310M 0s 2024-09-12T00:41:30.205 INFO:teuthology.orchestra.run.smithi138.stderr: 29650K .......... .......... .......... .......... .......... 31% 296M 0s 2024-09-12T00:41:30.205 INFO:teuthology.orchestra.run.smithi138.stderr: 29700K .......... .......... .......... .......... .......... 32% 287M 0s 2024-09-12T00:41:30.205 INFO:teuthology.orchestra.run.smithi138.stderr: 29750K .......... .......... .......... .......... .......... 32% 313M 0s 2024-09-12T00:41:30.205 INFO:teuthology.orchestra.run.smithi138.stderr: 29800K .......... .......... .......... .......... .......... 32% 202M 0s 2024-09-12T00:41:30.205 INFO:teuthology.orchestra.run.smithi138.stderr: 29850K .......... .......... .......... .......... .......... 32% 75.4M 0s 2024-09-12T00:41:30.205 INFO:teuthology.orchestra.run.smithi138.stderr: 29900K .......... .......... .......... .......... .......... 32% 94.6M 0s 2024-09-12T00:41:30.205 INFO:teuthology.orchestra.run.smithi138.stderr: 29950K .......... .......... .......... .......... .......... 32% 270M 0s 2024-09-12T00:41:30.205 INFO:teuthology.orchestra.run.smithi138.stderr: 30000K .......... .......... .......... .......... .......... 32% 324M 0s 2024-09-12T00:41:30.205 INFO:teuthology.orchestra.run.smithi138.stderr: 30050K .......... .......... .......... .......... .......... 32% 95.6M 0s 2024-09-12T00:41:30.205 INFO:teuthology.orchestra.run.smithi138.stderr: 30100K .......... .......... .......... .......... .......... 32% 242M 0s 2024-09-12T00:41:30.206 INFO:teuthology.orchestra.run.smithi138.stderr: 30150K .......... .......... .......... .......... .......... 32% 296M 0s 2024-09-12T00:41:30.206 INFO:teuthology.orchestra.run.smithi138.stderr: 30200K .......... .......... .......... .......... .......... 32% 301M 0s 2024-09-12T00:41:30.206 INFO:teuthology.orchestra.run.smithi138.stderr: 30250K .......... .......... .......... .......... .......... 32% 301M 0s 2024-09-12T00:41:30.206 INFO:teuthology.orchestra.run.smithi138.stderr: 30300K .......... .......... .......... .......... .......... 32% 245M 0s 2024-09-12T00:41:30.206 INFO:teuthology.orchestra.run.smithi138.stderr: 30350K .......... .......... .......... .......... .......... 32% 306M 0s 2024-09-12T00:41:30.206 INFO:teuthology.orchestra.run.smithi138.stderr: 30400K .......... .......... .......... .......... .......... 32% 317M 0s 2024-09-12T00:41:30.206 INFO:teuthology.orchestra.run.smithi138.stderr: 30450K .......... .......... .......... .......... .......... 32% 305M 0s 2024-09-12T00:41:30.206 INFO:teuthology.orchestra.run.smithi138.stderr: 30500K .......... .......... .......... .......... .......... 32% 288M 0s 2024-09-12T00:41:30.206 INFO:teuthology.orchestra.run.smithi138.stderr: 30550K .......... .......... .......... .......... .......... 32% 301M 0s 2024-09-12T00:41:30.206 INFO:teuthology.orchestra.run.smithi138.stderr: 30600K .......... .......... .......... .......... .......... 32% 301M 0s 2024-09-12T00:41:30.206 INFO:teuthology.orchestra.run.smithi138.stderr: 30650K .......... .......... .......... .......... .......... 33% 146M 0s 2024-09-12T00:41:30.206 INFO:teuthology.orchestra.run.smithi138.stderr: 30700K .......... .......... .......... .......... .......... 33% 273M 0s 2024-09-12T00:41:30.206 INFO:teuthology.orchestra.run.smithi138.stderr: 30750K .......... .......... .......... .......... .......... 33% 253M 0s 2024-09-12T00:41:30.207 INFO:teuthology.orchestra.run.smithi138.stderr: 30800K .......... .......... .......... .......... .......... 33% 304M 0s 2024-09-12T00:41:30.207 INFO:teuthology.orchestra.run.smithi138.stderr: 30850K .......... .......... .......... .......... .......... 33% 296M 0s 2024-09-12T00:41:30.207 INFO:teuthology.orchestra.run.smithi138.stderr: 30900K .......... .......... .......... .......... .......... 33% 293M 0s 2024-09-12T00:41:30.207 INFO:teuthology.orchestra.run.smithi138.stderr: 30950K .......... .......... .......... .......... .......... 33% 281M 0s 2024-09-12T00:41:30.207 INFO:teuthology.orchestra.run.smithi138.stderr: 31000K .......... .......... .......... .......... .......... 33% 301M 0s 2024-09-12T00:41:30.207 INFO:teuthology.orchestra.run.smithi138.stderr: 31050K .......... .......... .......... .......... .......... 33% 313M 0s 2024-09-12T00:41:30.207 INFO:teuthology.orchestra.run.smithi138.stderr: 31100K .......... .......... .......... .......... .......... 33% 204M 0s 2024-09-12T00:41:30.207 INFO:teuthology.orchestra.run.smithi138.stderr: 31150K .......... .......... .......... .......... .......... 33% 255M 0s 2024-09-12T00:41:30.207 INFO:teuthology.orchestra.run.smithi138.stderr: 31200K .......... .......... .......... .......... .......... 33% 307M 0s 2024-09-12T00:41:30.207 INFO:teuthology.orchestra.run.smithi138.stderr: 31250K .......... .......... .......... .......... .......... 33% 323M 0s 2024-09-12T00:41:30.207 INFO:teuthology.orchestra.run.smithi138.stderr: 31300K .......... .......... .......... .......... .......... 33% 280M 0s 2024-09-12T00:41:30.207 INFO:teuthology.orchestra.run.smithi138.stderr: 31350K .......... .......... .......... .......... .......... 33% 161M 0s 2024-09-12T00:41:30.207 INFO:teuthology.orchestra.run.smithi138.stderr: 31400K .......... .......... .......... .......... .......... 33% 304M 0s 2024-09-12T00:41:30.208 INFO:teuthology.orchestra.run.smithi138.stderr: 31450K .......... .......... .......... .......... .......... 33% 326M 0s 2024-09-12T00:41:30.208 INFO:teuthology.orchestra.run.smithi138.stderr: 31500K .......... .......... .......... .......... .......... 33% 157M 0s 2024-09-12T00:41:30.208 INFO:teuthology.orchestra.run.smithi138.stderr: 31550K .......... .......... .......... .......... .......... 34% 246M 0s 2024-09-12T00:41:30.208 INFO:teuthology.orchestra.run.smithi138.stderr: 31600K .......... .......... .......... .......... .......... 34% 73.9M 0s 2024-09-12T00:41:30.208 INFO:teuthology.orchestra.run.smithi138.stderr: 31650K .......... .......... .......... .......... .......... 34% 277M 0s 2024-09-12T00:41:30.208 INFO:teuthology.orchestra.run.smithi138.stderr: 31700K .......... .......... .......... .......... .......... 34% 317M 0s 2024-09-12T00:41:30.208 INFO:teuthology.orchestra.run.smithi138.stderr: 31750K .......... .......... .......... .......... .......... 34% 272M 0s 2024-09-12T00:41:30.208 INFO:teuthology.orchestra.run.smithi138.stderr: 31800K .......... .......... .......... .......... .......... 34% 317M 0s 2024-09-12T00:41:30.208 INFO:teuthology.orchestra.run.smithi138.stderr: 31850K .......... .......... .......... .......... .......... 34% 324M 0s 2024-09-12T00:41:30.208 INFO:teuthology.orchestra.run.smithi138.stderr: 31900K .......... .......... .......... .......... .......... 34% 306M 0s 2024-09-12T00:41:30.208 INFO:teuthology.orchestra.run.smithi138.stderr: 31950K .......... .......... .......... .......... .......... 34% 251M 0s 2024-09-12T00:41:30.208 INFO:teuthology.orchestra.run.smithi138.stderr: 32000K .......... .......... .......... .......... .......... 34% 320M 0s 2024-09-12T00:41:30.208 INFO:teuthology.orchestra.run.smithi138.stderr: 32050K .......... .......... .......... .......... .......... 34% 313M 0s 2024-09-12T00:41:30.209 INFO:teuthology.orchestra.run.smithi138.stderr: 32100K .......... .......... .......... .......... .......... 34% 285M 0s 2024-09-12T00:41:30.209 INFO:teuthology.orchestra.run.smithi138.stderr: 32150K .......... .......... .......... .......... .......... 34% 294M 0s 2024-09-12T00:41:30.209 INFO:teuthology.orchestra.run.smithi138.stderr: 32200K .......... .......... .......... .......... .......... 34% 319M 0s 2024-09-12T00:41:30.209 INFO:teuthology.orchestra.run.smithi138.stderr: 32250K .......... .......... .......... .......... .......... 34% 312M 0s 2024-09-12T00:41:30.209 INFO:teuthology.orchestra.run.smithi138.stderr: 32300K .......... .......... .......... .......... .......... 34% 296M 0s 2024-09-12T00:41:30.209 INFO:teuthology.orchestra.run.smithi138.stderr: 32350K .......... .......... .......... .......... .......... 34% 250M 0s 2024-09-12T00:41:30.209 INFO:teuthology.orchestra.run.smithi138.stderr: 32400K .......... .......... .......... .......... .......... 34% 303M 0s 2024-09-12T00:41:30.209 INFO:teuthology.orchestra.run.smithi138.stderr: 32450K .......... .......... .......... .......... .......... 34% 326M 0s 2024-09-12T00:41:30.209 INFO:teuthology.orchestra.run.smithi138.stderr: 32500K .......... .......... .......... .......... .......... 35% 310M 0s 2024-09-12T00:41:30.209 INFO:teuthology.orchestra.run.smithi138.stderr: 32550K .......... .......... .......... .......... .......... 35% 252M 0s 2024-09-12T00:41:30.209 INFO:teuthology.orchestra.run.smithi138.stderr: 32600K .......... .......... .......... .......... .......... 35% 315M 0s 2024-09-12T00:41:30.209 INFO:teuthology.orchestra.run.smithi138.stderr: 32650K .......... .......... .......... .......... .......... 35% 82.4M 0s 2024-09-12T00:41:30.209 INFO:teuthology.orchestra.run.smithi138.stderr: 32700K .......... .......... .......... .......... .......... 35% 274M 0s 2024-09-12T00:41:30.210 INFO:teuthology.orchestra.run.smithi138.stderr: 32750K .......... .......... .......... .......... .......... 35% 273M 0s 2024-09-12T00:41:30.210 INFO:teuthology.orchestra.run.smithi138.stderr: 32800K .......... .......... .......... .......... .......... 35% 322M 0s 2024-09-12T00:41:30.210 INFO:teuthology.orchestra.run.smithi138.stderr: 32850K .......... .......... .......... .......... .......... 35% 266M 0s 2024-09-12T00:41:30.210 INFO:teuthology.orchestra.run.smithi138.stderr: 32900K .......... .......... .......... .......... .......... 35% 131M 0s 2024-09-12T00:41:30.210 INFO:teuthology.orchestra.run.smithi138.stderr: 32950K .......... .......... .......... .......... .......... 35% 136M 0s 2024-09-12T00:41:30.210 INFO:teuthology.orchestra.run.smithi138.stderr: 33000K .......... .......... .......... .......... .......... 35% 86.7M 0s 2024-09-12T00:41:30.210 INFO:teuthology.orchestra.run.smithi138.stderr: 33050K .......... .......... .......... .......... .......... 35% 150M 0s 2024-09-12T00:41:30.210 INFO:teuthology.orchestra.run.smithi138.stderr: 33100K .......... .......... .......... .......... .......... 35% 309M 0s 2024-09-12T00:41:30.210 INFO:teuthology.orchestra.run.smithi138.stderr: 33150K .......... .......... .......... .......... .......... 35% 273M 0s 2024-09-12T00:41:30.210 INFO:teuthology.orchestra.run.smithi138.stderr: 33200K .......... .......... .......... .......... .......... 35% 301M 0s 2024-09-12T00:41:30.210 INFO:teuthology.orchestra.run.smithi138.stderr: 33250K .......... .......... .......... .......... .......... 35% 300M 0s 2024-09-12T00:41:30.210 INFO:teuthology.orchestra.run.smithi138.stderr: 33300K .......... .......... .......... .......... .......... 35% 329M 0s 2024-09-12T00:41:30.210 INFO:teuthology.orchestra.run.smithi138.stderr: 33350K .......... .......... .......... .......... .......... 35% 273M 0s 2024-09-12T00:41:30.210 INFO:teuthology.orchestra.run.smithi138.stderr: 33400K .......... .......... .......... .......... .......... 36% 165M 0s 2024-09-12T00:41:30.211 INFO:teuthology.orchestra.run.smithi138.stderr: 33450K .......... .......... .......... .......... .......... 36% 287M 0s 2024-09-12T00:41:30.211 INFO:teuthology.orchestra.run.smithi138.stderr: 33500K .......... .......... .......... .......... .......... 36% 300M 0s 2024-09-12T00:41:30.211 INFO:teuthology.orchestra.run.smithi138.stderr: 33550K .......... .......... .......... .......... .......... 36% 265M 0s 2024-09-12T00:41:30.211 INFO:teuthology.orchestra.run.smithi138.stderr: 33600K .......... .......... .......... .......... .......... 36% 311M 0s 2024-09-12T00:41:30.211 INFO:teuthology.orchestra.run.smithi138.stderr: 33650K .......... .......... .......... .......... .......... 36% 328M 0s 2024-09-12T00:41:30.211 INFO:teuthology.orchestra.run.smithi138.stderr: 33700K .......... .......... .......... .......... .......... 36% 310M 0s 2024-09-12T00:41:30.211 INFO:teuthology.orchestra.run.smithi138.stderr: 33750K .......... .......... .......... .......... .......... 36% 282M 0s 2024-09-12T00:41:30.211 INFO:teuthology.orchestra.run.smithi138.stderr: 33800K .......... .......... .......... .......... .......... 36% 325M 0s 2024-09-12T00:41:30.211 INFO:teuthology.orchestra.run.smithi138.stderr: 33850K .......... .......... .......... .......... .......... 36% 328M 0s 2024-09-12T00:41:30.211 INFO:teuthology.orchestra.run.smithi138.stderr: 33900K .......... .......... .......... .......... .......... 36% 302M 0s 2024-09-12T00:41:30.211 INFO:teuthology.orchestra.run.smithi138.stderr: 33950K .......... .......... .......... .......... .......... 36% 260M 0s 2024-09-12T00:41:30.211 INFO:teuthology.orchestra.run.smithi138.stderr: 34000K .......... .......... .......... .......... .......... 36% 326M 0s 2024-09-12T00:41:30.211 INFO:teuthology.orchestra.run.smithi138.stderr: 34050K .......... .......... .......... .......... .......... 36% 337M 0s 2024-09-12T00:41:30.212 INFO:teuthology.orchestra.run.smithi138.stderr: 34100K .......... .......... .......... .......... .......... 36% 314M 0s 2024-09-12T00:41:30.212 INFO:teuthology.orchestra.run.smithi138.stderr: 34150K .......... .......... .......... .......... .......... 36% 148M 0s 2024-09-12T00:41:30.212 INFO:teuthology.orchestra.run.smithi138.stderr: 34200K .......... .......... .......... .......... .......... 36% 299M 0s 2024-09-12T00:41:30.212 INFO:teuthology.orchestra.run.smithi138.stderr: 34250K .......... .......... .......... .......... .......... 36% 316M 0s 2024-09-12T00:41:30.212 INFO:teuthology.orchestra.run.smithi138.stderr: 34300K .......... .......... .......... .......... .......... 36% 230M 0s 2024-09-12T00:41:30.212 INFO:teuthology.orchestra.run.smithi138.stderr: 34350K .......... .......... .......... .......... .......... 37% 259M 0s 2024-09-12T00:41:30.212 INFO:teuthology.orchestra.run.smithi138.stderr: 34400K .......... .......... .......... .......... .......... 37% 101M 0s 2024-09-12T00:41:30.212 INFO:teuthology.orchestra.run.smithi138.stderr: 34450K .......... .......... .......... .......... .......... 37% 287M 0s 2024-09-12T00:41:30.212 INFO:teuthology.orchestra.run.smithi138.stderr: 34500K .......... .......... .......... .......... .......... 37% 310M 0s 2024-09-12T00:41:30.212 INFO:teuthology.orchestra.run.smithi138.stderr: 34550K .......... .......... .......... .......... .......... 37% 87.2M 0s 2024-09-12T00:41:30.212 INFO:teuthology.orchestra.run.smithi138.stderr: 34600K .......... .......... .......... .......... .......... 37% 270M 0s 2024-09-12T00:41:30.212 INFO:teuthology.orchestra.run.smithi138.stderr: 34650K .......... .......... .......... .......... .......... 37% 311M 0s 2024-09-12T00:41:30.212 INFO:teuthology.orchestra.run.smithi138.stderr: 34700K .......... .......... .......... .......... .......... 37% 298M 0s 2024-09-12T00:41:30.213 INFO:teuthology.orchestra.run.smithi138.stderr: 34750K .......... .......... .......... .......... .......... 37% 274M 0s 2024-09-12T00:41:30.213 INFO:teuthology.orchestra.run.smithi138.stderr: 34800K .......... .......... .......... .......... .......... 37% 292M 0s 2024-09-12T00:41:30.213 INFO:teuthology.orchestra.run.smithi138.stderr: 34850K .......... .......... .......... .......... .......... 37% 308M 0s 2024-09-12T00:41:30.213 INFO:teuthology.orchestra.run.smithi138.stderr: 34900K .......... .......... .......... .......... .......... 37% 304M 0s 2024-09-12T00:41:30.213 INFO:teuthology.orchestra.run.smithi138.stderr: 34950K .......... .......... .......... .......... .......... 37% 307M 0s 2024-09-12T00:41:30.213 INFO:teuthology.orchestra.run.smithi138.stderr: 35000K .......... .......... .......... .......... .......... 37% 312M 0s 2024-09-12T00:41:30.213 INFO:teuthology.orchestra.run.smithi138.stderr: 35050K .......... .......... .......... .......... .......... 37% 299M 0s 2024-09-12T00:41:30.213 INFO:teuthology.orchestra.run.smithi138.stderr: 35100K .......... .......... .......... .......... .......... 37% 321M 0s 2024-09-12T00:41:30.213 INFO:teuthology.orchestra.run.smithi138.stderr: 35150K .......... .......... .......... .......... .......... 37% 141M 0s 2024-09-12T00:41:30.213 INFO:teuthology.orchestra.run.smithi138.stderr: 35200K .......... .......... .......... .......... .......... 37% 188M 0s 2024-09-12T00:41:30.213 INFO:teuthology.orchestra.run.smithi138.stderr: 35250K .......... .......... .......... .......... .......... 37% 296M 0s 2024-09-12T00:41:30.213 INFO:teuthology.orchestra.run.smithi138.stderr: 35300K .......... .......... .......... .......... .......... 38% 325M 0s 2024-09-12T00:41:30.214 INFO:teuthology.orchestra.run.smithi138.stderr: 35350K .......... .......... .......... .......... .......... 38% 293M 0s 2024-09-12T00:41:30.214 INFO:teuthology.orchestra.run.smithi138.stderr: 35400K .......... .......... .......... .......... .......... 38% 303M 0s 2024-09-12T00:41:30.214 INFO:teuthology.orchestra.run.smithi138.stderr: 35450K .......... .......... .......... .......... .......... 38% 305M 0s 2024-09-12T00:41:30.214 INFO:teuthology.orchestra.run.smithi138.stderr: 35500K .......... .......... .......... .......... .......... 38% 334M 0s 2024-09-12T00:41:30.214 INFO:teuthology.orchestra.run.smithi138.stderr: 35550K .......... .......... .......... .......... .......... 38% 110M 0s 2024-09-12T00:41:30.214 INFO:teuthology.orchestra.run.smithi138.stderr: 35600K .......... .......... .......... .......... .......... 38% 279M 0s 2024-09-12T00:41:30.214 INFO:teuthology.orchestra.run.smithi138.stderr: 35650K .......... .......... .......... .......... .......... 38% 296M 0s 2024-09-12T00:41:30.214 INFO:teuthology.orchestra.run.smithi138.stderr: 35700K .......... .......... .......... .......... .......... 38% 304M 0s 2024-09-12T00:41:30.214 INFO:teuthology.orchestra.run.smithi138.stderr: 35750K .......... .......... .......... .......... .......... 38% 297M 0s 2024-09-12T00:41:30.214 INFO:teuthology.orchestra.run.smithi138.stderr: 35800K .......... .......... .......... .......... .......... 38% 232M 0s 2024-09-12T00:41:30.214 INFO:teuthology.orchestra.run.smithi138.stderr: 35850K .......... .......... .......... .......... .......... 38% 288M 0s 2024-09-12T00:41:30.214 INFO:teuthology.orchestra.run.smithi138.stderr: 35900K .......... .......... .......... .......... .......... 38% 306M 0s 2024-09-12T00:41:30.214 INFO:teuthology.orchestra.run.smithi138.stderr: 35950K .......... .......... .......... .......... .......... 38% 274M 0s 2024-09-12T00:41:30.215 INFO:teuthology.orchestra.run.smithi138.stderr: 36000K .......... .......... .......... .......... .......... 38% 111M 0s 2024-09-12T00:41:30.215 INFO:teuthology.orchestra.run.smithi138.stderr: 36050K .......... .......... .......... .......... .......... 38% 84.4M 0s 2024-09-12T00:41:30.215 INFO:teuthology.orchestra.run.smithi138.stderr: 36100K .......... .......... .......... .......... .......... 38% 300M 0s 2024-09-12T00:41:30.215 INFO:teuthology.orchestra.run.smithi138.stderr: 36150K .......... .......... .......... .......... .......... 38% 284M 0s 2024-09-12T00:41:30.215 INFO:teuthology.orchestra.run.smithi138.stderr: 36200K .......... .......... .......... .......... .......... 39% 145M 0s 2024-09-12T00:41:30.215 INFO:teuthology.orchestra.run.smithi138.stderr: 36250K .......... .......... .......... .......... .......... 39% 125M 0s 2024-09-12T00:41:30.215 INFO:teuthology.orchestra.run.smithi138.stderr: 36300K .......... .......... .......... .......... .......... 39% 230M 0s 2024-09-12T00:41:30.215 INFO:teuthology.orchestra.run.smithi138.stderr: 36350K .......... .......... .......... .......... .......... 39% 248M 0s 2024-09-12T00:41:30.215 INFO:teuthology.orchestra.run.smithi138.stderr: 36400K .......... .......... .......... .......... .......... 39% 296M 0s 2024-09-12T00:41:30.215 INFO:teuthology.orchestra.run.smithi138.stderr: 36450K .......... .......... .......... .......... .......... 39% 283M 0s 2024-09-12T00:41:30.215 INFO:teuthology.orchestra.run.smithi138.stderr: 36500K .......... .......... .......... .......... .......... 39% 325M 0s 2024-09-12T00:41:30.215 INFO:teuthology.orchestra.run.smithi138.stderr: 36550K .......... .......... .......... .......... .......... 39% 253M 0s 2024-09-12T00:41:30.215 INFO:teuthology.orchestra.run.smithi138.stderr: 36600K .......... .......... .......... .......... .......... 39% 318M 0s 2024-09-12T00:41:30.216 INFO:teuthology.orchestra.run.smithi138.stderr: 36650K .......... .......... .......... .......... .......... 39% 299M 0s 2024-09-12T00:41:30.216 INFO:teuthology.orchestra.run.smithi138.stderr: 36700K .......... .......... .......... .......... .......... 39% 304M 0s 2024-09-12T00:41:30.216 INFO:teuthology.orchestra.run.smithi138.stderr: 36750K .......... .......... .......... .......... .......... 39% 282M 0s 2024-09-12T00:41:30.216 INFO:teuthology.orchestra.run.smithi138.stderr: 36800K .......... .......... .......... .......... .......... 39% 302M 0s 2024-09-12T00:41:30.216 INFO:teuthology.orchestra.run.smithi138.stderr: 36850K .......... .......... .......... .......... .......... 39% 305M 0s 2024-09-12T00:41:30.216 INFO:teuthology.orchestra.run.smithi138.stderr: 36900K .......... .......... .......... .......... .......... 39% 298M 0s 2024-09-12T00:41:30.216 INFO:teuthology.orchestra.run.smithi138.stderr: 36950K .......... .......... .......... .......... .......... 39% 232M 0s 2024-09-12T00:41:30.216 INFO:teuthology.orchestra.run.smithi138.stderr: 37000K .......... .......... .......... .......... .......... 39% 293M 0s 2024-09-12T00:41:30.216 INFO:teuthology.orchestra.run.smithi138.stderr: 37050K .......... .......... .......... .......... .......... 39% 305M 0s 2024-09-12T00:41:30.216 INFO:teuthology.orchestra.run.smithi138.stderr: 37100K .......... .......... .......... .......... .......... 39% 301M 0s 2024-09-12T00:41:30.216 INFO:teuthology.orchestra.run.smithi138.stderr: 37150K .......... .......... .......... .......... .......... 40% 247M 0s 2024-09-12T00:41:30.216 INFO:teuthology.orchestra.run.smithi138.stderr: 37200K .......... .......... .......... .......... .......... 40% 315M 0s 2024-09-12T00:41:30.217 INFO:teuthology.orchestra.run.smithi138.stderr: 37250K .......... .......... .......... .......... .......... 40% 331M 0s 2024-09-12T00:41:30.217 INFO:teuthology.orchestra.run.smithi138.stderr: 37300K .......... .......... .......... .......... .......... 40% 337M 0s 2024-09-12T00:41:30.217 INFO:teuthology.orchestra.run.smithi138.stderr: 37350K .......... .......... .......... .......... .......... 40% 108M 0s 2024-09-12T00:41:30.217 INFO:teuthology.orchestra.run.smithi138.stderr: 37400K .......... .......... .......... .......... .......... 40% 273M 0s 2024-09-12T00:41:30.217 INFO:teuthology.orchestra.run.smithi138.stderr: 37450K .......... .......... .......... .......... .......... 40% 347M 0s 2024-09-12T00:41:30.217 INFO:teuthology.orchestra.run.smithi138.stderr: 37500K .......... .......... .......... .......... .......... 40% 328M 0s 2024-09-12T00:41:30.217 INFO:teuthology.orchestra.run.smithi138.stderr: 37550K .......... .......... .......... .......... .......... 40% 272M 0s 2024-09-12T00:41:30.217 INFO:teuthology.orchestra.run.smithi138.stderr: 37600K .......... .......... .......... .......... .......... 40% 146M 0s 2024-09-12T00:41:30.217 INFO:teuthology.orchestra.run.smithi138.stderr: 37650K .......... .......... .......... .......... .......... 40% 198M 0s 2024-09-12T00:41:30.217 INFO:teuthology.orchestra.run.smithi138.stderr: 37700K .......... .......... .......... .......... .......... 40% 274M 0s 2024-09-12T00:41:30.217 INFO:teuthology.orchestra.run.smithi138.stderr: 37750K .......... .......... .......... .......... .......... 40% 232M 0s 2024-09-12T00:41:30.217 INFO:teuthology.orchestra.run.smithi138.stderr: 37800K .......... .......... .......... .......... .......... 40% 319M 0s 2024-09-12T00:41:30.217 INFO:teuthology.orchestra.run.smithi138.stderr: 37850K .......... .......... .......... .......... .......... 40% 320M 0s 2024-09-12T00:41:30.218 INFO:teuthology.orchestra.run.smithi138.stderr: 37900K .......... .......... .......... .......... .......... 40% 234M 0s 2024-09-12T00:41:30.218 INFO:teuthology.orchestra.run.smithi138.stderr: 37950K .......... .......... .......... .......... .......... 40% 246M 0s 2024-09-12T00:41:30.218 INFO:teuthology.orchestra.run.smithi138.stderr: 38000K .......... .......... .......... .......... .......... 40% 304M 0s 2024-09-12T00:41:30.218 INFO:teuthology.orchestra.run.smithi138.stderr: 38050K .......... .......... .......... .......... .......... 41% 318M 0s 2024-09-12T00:41:30.218 INFO:teuthology.orchestra.run.smithi138.stderr: 38100K .......... .......... .......... .......... .......... 41% 122M 0s 2024-09-12T00:41:30.218 INFO:teuthology.orchestra.run.smithi138.stderr: 38150K .......... .......... .......... .......... .......... 41% 239M 0s 2024-09-12T00:41:30.218 INFO:teuthology.orchestra.run.smithi138.stderr: 38200K .......... .......... .......... .......... .......... 41% 322M 0s 2024-09-12T00:41:30.218 INFO:teuthology.orchestra.run.smithi138.stderr: 38250K .......... .......... .......... .......... .......... 41% 332M 0s 2024-09-12T00:41:30.218 INFO:teuthology.orchestra.run.smithi138.stderr: 38300K .......... .......... .......... .......... .......... 41% 139M 0s 2024-09-12T00:41:30.218 INFO:teuthology.orchestra.run.smithi138.stderr: 38350K .......... .......... .......... .......... .......... 41% 241M 0s 2024-09-12T00:41:30.218 INFO:teuthology.orchestra.run.smithi138.stderr: 38400K .......... .......... .......... .......... .......... 41% 338M 0s 2024-09-12T00:41:30.218 INFO:teuthology.orchestra.run.smithi138.stderr: 38450K .......... .......... .......... .......... .......... 41% 344M 0s 2024-09-12T00:41:30.218 INFO:teuthology.orchestra.run.smithi138.stderr: 38500K .......... .......... .......... .......... .......... 41% 203M 0s 2024-09-12T00:41:30.218 INFO:teuthology.orchestra.run.smithi138.stderr: 38550K .......... .......... .......... .......... .......... 41% 253M 0s 2024-09-12T00:41:30.219 INFO:teuthology.orchestra.run.smithi138.stderr: 38600K .......... .......... .......... .......... .......... 41% 316M 0s 2024-09-12T00:41:30.219 INFO:teuthology.orchestra.run.smithi138.stderr: 38650K .......... .......... .......... .......... .......... 41% 313M 0s 2024-09-12T00:41:30.219 INFO:teuthology.orchestra.run.smithi138.stderr: 38700K .......... .......... .......... .......... .......... 41% 339M 0s 2024-09-12T00:41:30.219 INFO:teuthology.orchestra.run.smithi138.stderr: 38750K .......... .......... .......... .......... .......... 41% 134M 0s 2024-09-12T00:41:30.219 INFO:teuthology.orchestra.run.smithi138.stderr: 38800K .......... .......... .......... .......... .......... 41% 291M 0s 2024-09-12T00:41:30.219 INFO:teuthology.orchestra.run.smithi138.stderr: 38850K .......... .......... .......... .......... .......... 41% 321M 0s 2024-09-12T00:41:30.219 INFO:teuthology.orchestra.run.smithi138.stderr: 38900K .......... .......... .......... .......... .......... 41% 284M 0s 2024-09-12T00:41:30.219 INFO:teuthology.orchestra.run.smithi138.stderr: 38950K .......... .......... .......... .......... .......... 41% 283M 0s 2024-09-12T00:41:30.219 INFO:teuthology.orchestra.run.smithi138.stderr: 39000K .......... .......... .......... .......... .......... 42% 337M 0s 2024-09-12T00:41:30.219 INFO:teuthology.orchestra.run.smithi138.stderr: 39050K .......... .......... .......... .......... .......... 42% 89.1M 0s 2024-09-12T00:41:30.219 INFO:teuthology.orchestra.run.smithi138.stderr: 39100K .......... .......... .......... .......... .......... 42% 290M 0s 2024-09-12T00:41:30.219 INFO:teuthology.orchestra.run.smithi138.stderr: 39150K .......... .......... .......... .......... .......... 42% 254M 0s 2024-09-12T00:41:30.219 INFO:teuthology.orchestra.run.smithi138.stderr: 39200K .......... .......... .......... .......... .......... 42% 150M 0s 2024-09-12T00:41:30.220 INFO:teuthology.orchestra.run.smithi138.stderr: 39250K .......... .......... .......... .......... .......... 42% 141M 0s 2024-09-12T00:41:30.220 INFO:teuthology.orchestra.run.smithi138.stderr: 39300K .......... .......... .......... .......... .......... 42% 176M 0s 2024-09-12T00:41:30.220 INFO:teuthology.orchestra.run.smithi138.stderr: 39350K .......... .......... .......... .......... .......... 42% 327M 0s 2024-09-12T00:41:30.220 INFO:teuthology.orchestra.run.smithi138.stderr: 39400K .......... .......... .......... .......... .......... 42% 175M 0s 2024-09-12T00:41:30.220 INFO:teuthology.orchestra.run.smithi138.stderr: 39450K .......... .......... .......... .......... .......... 42% 276M 0s 2024-09-12T00:41:30.220 INFO:teuthology.orchestra.run.smithi138.stderr: 39500K .......... .......... .......... .......... .......... 42% 322M 0s 2024-09-12T00:41:30.220 INFO:teuthology.orchestra.run.smithi138.stderr: 39550K .......... .......... .......... .......... .......... 42% 327M 0s 2024-09-12T00:41:30.220 INFO:teuthology.orchestra.run.smithi138.stderr: 39600K .......... .......... .......... .......... .......... 42% 336M 0s 2024-09-12T00:41:30.220 INFO:teuthology.orchestra.run.smithi138.stderr: 39650K .......... .......... .......... .......... .......... 42% 122M 0s 2024-09-12T00:41:30.220 INFO:teuthology.orchestra.run.smithi138.stderr: 39700K .......... .......... .......... .......... .......... 42% 297M 0s 2024-09-12T00:41:30.220 INFO:teuthology.orchestra.run.smithi138.stderr: 39750K .......... .......... .......... .......... .......... 42% 298M 0s 2024-09-12T00:41:30.220 INFO:teuthology.orchestra.run.smithi138.stderr: 39800K .......... .......... .......... .......... .......... 42% 344M 0s 2024-09-12T00:41:30.220 INFO:teuthology.orchestra.run.smithi138.stderr: 39850K .......... .......... .......... .......... .......... 42% 285M 0s 2024-09-12T00:41:30.221 INFO:teuthology.orchestra.run.smithi138.stderr: 39900K .......... .......... .......... .......... .......... 43% 302M 0s 2024-09-12T00:41:30.221 INFO:teuthology.orchestra.run.smithi138.stderr: 39950K .......... .......... .......... .......... .......... 43% 306M 0s 2024-09-12T00:41:30.221 INFO:teuthology.orchestra.run.smithi138.stderr: 40000K .......... .......... .......... .......... .......... 43% 341M 0s 2024-09-12T00:41:30.221 INFO:teuthology.orchestra.run.smithi138.stderr: 40050K .......... .......... .......... .......... .......... 43% 273M 0s 2024-09-12T00:41:30.221 INFO:teuthology.orchestra.run.smithi138.stderr: 40100K .......... .......... .......... .......... .......... 43% 297M 0s 2024-09-12T00:41:30.221 INFO:teuthology.orchestra.run.smithi138.stderr: 40150K .......... .......... .......... .......... .......... 43% 299M 0s 2024-09-12T00:41:30.221 INFO:teuthology.orchestra.run.smithi138.stderr: 40200K .......... .......... .......... .......... .......... 43% 338M 0s 2024-09-12T00:41:30.221 INFO:teuthology.orchestra.run.smithi138.stderr: 40250K .......... .......... .......... .......... .......... 43% 110M 0s 2024-09-12T00:41:30.221 INFO:teuthology.orchestra.run.smithi138.stderr: 40300K .......... .......... .......... .......... .......... 43% 295M 0s 2024-09-12T00:41:30.221 INFO:teuthology.orchestra.run.smithi138.stderr: 40350K .......... .......... .......... .......... .......... 43% 331M 0s 2024-09-12T00:41:30.221 INFO:teuthology.orchestra.run.smithi138.stderr: 40400K .......... .......... .......... .......... .......... 43% 302M 0s 2024-09-12T00:41:30.221 INFO:teuthology.orchestra.run.smithi138.stderr: 40450K .......... .......... .......... .......... .......... 43% 265M 0s 2024-09-12T00:41:30.221 INFO:teuthology.orchestra.run.smithi138.stderr: 40500K .......... .......... .......... .......... .......... 43% 242M 0s 2024-09-12T00:41:30.221 INFO:teuthology.orchestra.run.smithi138.stderr: 40550K .......... .......... .......... .......... .......... 43% 297M 0s 2024-09-12T00:41:30.222 INFO:teuthology.orchestra.run.smithi138.stderr: 40600K .......... .......... .......... .......... .......... 43% 292M 0s 2024-09-12T00:41:30.222 INFO:teuthology.orchestra.run.smithi138.stderr: 40650K .......... .......... .......... .......... .......... 43% 294M 0s 2024-09-12T00:41:30.222 INFO:teuthology.orchestra.run.smithi138.stderr: 40700K .......... .......... .......... .......... .......... 43% 208M 0s 2024-09-12T00:41:30.222 INFO:teuthology.orchestra.run.smithi138.stderr: 40750K .......... .......... .......... .......... .......... 43% 321M 0s 2024-09-12T00:41:30.222 INFO:teuthology.orchestra.run.smithi138.stderr: 40800K .......... .......... .......... .......... .......... 43% 302M 0s 2024-09-12T00:41:30.222 INFO:teuthology.orchestra.run.smithi138.stderr: 40850K .......... .......... .......... .......... .......... 44% 105M 0s 2024-09-12T00:41:30.222 INFO:teuthology.orchestra.run.smithi138.stderr: 40900K .......... .......... .......... .......... .......... 44% 294M 0s 2024-09-12T00:41:30.222 INFO:teuthology.orchestra.run.smithi138.stderr: 40950K .......... .......... .......... .......... .......... 44% 371M 0s 2024-09-12T00:41:30.222 INFO:teuthology.orchestra.run.smithi138.stderr: 41000K .......... .......... .......... .......... .......... 44% 318M 0s 2024-09-12T00:41:30.222 INFO:teuthology.orchestra.run.smithi138.stderr: 41050K .......... .......... .......... .......... .......... 44% 297M 0s 2024-09-12T00:41:30.222 INFO:teuthology.orchestra.run.smithi138.stderr: 41100K .......... .......... .......... .......... .......... 44% 268M 0s 2024-09-12T00:41:30.222 INFO:teuthology.orchestra.run.smithi138.stderr: 41150K .......... .......... .......... .......... .......... 44% 244M 0s 2024-09-12T00:41:30.222 INFO:teuthology.orchestra.run.smithi138.stderr: 41200K .......... .......... .......... .......... .......... 44% 156M 0s 2024-09-12T00:41:30.222 INFO:teuthology.orchestra.run.smithi138.stderr: 41250K .......... .......... .......... .......... .......... 44% 253M 0s 2024-09-12T00:41:30.223 INFO:teuthology.orchestra.run.smithi138.stderr: 41300K .......... .......... .......... .......... .......... 44% 249M 0s 2024-09-12T00:41:30.223 INFO:teuthology.orchestra.run.smithi138.stderr: 41350K .......... .......... .......... .......... .......... 44% 160M 0s 2024-09-12T00:41:30.223 INFO:teuthology.orchestra.run.smithi138.stderr: 41400K .......... .......... .......... .......... .......... 44% 299M 0s 2024-09-12T00:41:30.223 INFO:teuthology.orchestra.run.smithi138.stderr: 41450K .......... .......... .......... .......... .......... 44% 340M 0s 2024-09-12T00:41:30.223 INFO:teuthology.orchestra.run.smithi138.stderr: 41500K .......... .......... .......... .......... .......... 44% 321M 0s 2024-09-12T00:41:30.223 INFO:teuthology.orchestra.run.smithi138.stderr: 41550K .......... .......... .......... .......... .......... 44% 187M 0s 2024-09-12T00:41:30.223 INFO:teuthology.orchestra.run.smithi138.stderr: 41600K .......... .......... .......... .......... .......... 44% 305M 0s 2024-09-12T00:41:30.223 INFO:teuthology.orchestra.run.smithi138.stderr: 41650K .......... .......... .......... .......... .......... 44% 98.8M 0s 2024-09-12T00:41:30.223 INFO:teuthology.orchestra.run.smithi138.stderr: 41700K .......... .......... .......... .......... .......... 44% 291M 0s 2024-09-12T00:41:30.223 INFO:teuthology.orchestra.run.smithi138.stderr: 41750K .......... .......... .......... .......... .......... 44% 275M 0s 2024-09-12T00:41:30.223 INFO:teuthology.orchestra.run.smithi138.stderr: 41800K .......... .......... .......... .......... .......... 45% 310M 0s 2024-09-12T00:41:30.223 INFO:teuthology.orchestra.run.smithi138.stderr: 41850K .......... .......... .......... .......... .......... 45% 328M 0s 2024-09-12T00:41:30.223 INFO:teuthology.orchestra.run.smithi138.stderr: 41900K .......... .......... .......... .......... .......... 45% 338M 0s 2024-09-12T00:41:30.224 INFO:teuthology.orchestra.run.smithi138.stderr: 41950K .......... .......... .......... .......... .......... 45% 288M 0s 2024-09-12T00:41:30.224 INFO:teuthology.orchestra.run.smithi138.stderr: 42000K .......... .......... .......... .......... .......... 45% 112M 0s 2024-09-12T00:41:30.224 INFO:teuthology.orchestra.run.smithi138.stderr: 42050K .......... .......... .......... .......... .......... 45% 310M 0s 2024-09-12T00:41:30.224 INFO:teuthology.orchestra.run.smithi138.stderr: 42100K .......... .......... .......... .......... .......... 45% 331M 0s 2024-09-12T00:41:30.224 INFO:teuthology.orchestra.run.smithi138.stderr: 42150K .......... .......... .......... .......... .......... 45% 308M 0s 2024-09-12T00:41:30.224 INFO:teuthology.orchestra.run.smithi138.stderr: 42200K .......... .......... .......... .......... .......... 45% 190M 0s 2024-09-12T00:41:30.224 INFO:teuthology.orchestra.run.smithi138.stderr: 42250K .......... .......... .......... .......... .......... 45% 168M 0s 2024-09-12T00:41:30.224 INFO:teuthology.orchestra.run.smithi138.stderr: 42300K .......... .......... .......... .......... .......... 45% 181M 0s 2024-09-12T00:41:30.224 INFO:teuthology.orchestra.run.smithi138.stderr: 42350K .......... .......... .......... .......... .......... 45% 234M 0s 2024-09-12T00:41:30.224 INFO:teuthology.orchestra.run.smithi138.stderr: 42400K .......... .......... .......... .......... .......... 45% 305M 0s 2024-09-12T00:41:30.224 INFO:teuthology.orchestra.run.smithi138.stderr: 42450K .......... .......... .......... .......... .......... 45% 164M 0s 2024-09-12T00:41:30.224 INFO:teuthology.orchestra.run.smithi138.stderr: 42500K .......... .......... .......... .......... .......... 45% 281M 0s 2024-09-12T00:41:30.224 INFO:teuthology.orchestra.run.smithi138.stderr: 42550K .......... .......... .......... .......... .......... 45% 285M 0s 2024-09-12T00:41:30.225 INFO:teuthology.orchestra.run.smithi138.stderr: 42600K .......... .......... .......... .......... .......... 45% 344M 0s 2024-09-12T00:41:30.225 INFO:teuthology.orchestra.run.smithi138.stderr: 42650K .......... .......... .......... .......... .......... 45% 258M 0s 2024-09-12T00:41:30.225 INFO:teuthology.orchestra.run.smithi138.stderr: 42700K .......... .......... .......... .......... .......... 46% 164M 0s 2024-09-12T00:41:30.225 INFO:teuthology.orchestra.run.smithi138.stderr: 42750K .......... .......... .......... .......... .......... 46% 262M 0s 2024-09-12T00:41:30.225 INFO:teuthology.orchestra.run.smithi138.stderr: 42800K .......... .......... .......... .......... .......... 46% 300M 0s 2024-09-12T00:41:30.225 INFO:teuthology.orchestra.run.smithi138.stderr: 42850K .......... .......... .......... .......... .......... 46% 329M 0s 2024-09-12T00:41:30.225 INFO:teuthology.orchestra.run.smithi138.stderr: 42900K .......... .......... .......... .......... .......... 46% 109M 0s 2024-09-12T00:41:30.225 INFO:teuthology.orchestra.run.smithi138.stderr: 42950K .......... .......... .......... .......... .......... 46% 288M 0s 2024-09-12T00:41:30.225 INFO:teuthology.orchestra.run.smithi138.stderr: 43000K .......... .......... .......... .......... .......... 46% 324M 0s 2024-09-12T00:41:30.225 INFO:teuthology.orchestra.run.smithi138.stderr: 43050K .......... .......... .......... .......... .......... 46% 353M 0s 2024-09-12T00:41:30.225 INFO:teuthology.orchestra.run.smithi138.stderr: 43100K .......... .......... .......... .......... .......... 46% 330M 0s 2024-09-12T00:41:30.225 INFO:teuthology.orchestra.run.smithi138.stderr: 43150K .......... .......... .......... .......... .......... 46% 269M 0s 2024-09-12T00:41:30.225 INFO:teuthology.orchestra.run.smithi138.stderr: 43200K .......... .......... .......... .......... .......... 46% 79.5M 0s 2024-09-12T00:41:30.225 INFO:teuthology.orchestra.run.smithi138.stderr: 43250K .......... .......... .......... .......... .......... 46% 319M 0s 2024-09-12T00:41:30.226 INFO:teuthology.orchestra.run.smithi138.stderr: 43300K .......... .......... .......... .......... .......... 46% 352M 0s 2024-09-12T00:41:30.226 INFO:teuthology.orchestra.run.smithi138.stderr: 43350K .......... .......... .......... .......... .......... 46% 270M 0s 2024-09-12T00:41:30.226 INFO:teuthology.orchestra.run.smithi138.stderr: 43400K .......... .......... .......... .......... .......... 46% 326M 0s 2024-09-12T00:41:30.226 INFO:teuthology.orchestra.run.smithi138.stderr: 43450K .......... .......... .......... .......... .......... 46% 307M 0s 2024-09-12T00:41:30.226 INFO:teuthology.orchestra.run.smithi138.stderr: 43500K .......... .......... .......... .......... .......... 46% 329M 0s 2024-09-12T00:41:30.226 INFO:teuthology.orchestra.run.smithi138.stderr: 43550K .......... .......... .......... .......... .......... 46% 294M 0s 2024-09-12T00:41:30.226 INFO:teuthology.orchestra.run.smithi138.stderr: 43600K .......... .......... .......... .......... .......... 46% 336M 0s 2024-09-12T00:41:30.226 INFO:teuthology.orchestra.run.smithi138.stderr: 43650K .......... .......... .......... .......... .......... 47% 343M 0s 2024-09-12T00:41:30.226 INFO:teuthology.orchestra.run.smithi138.stderr: 43700K .......... .......... .......... .......... .......... 47% 340M 0s 2024-09-12T00:41:30.226 INFO:teuthology.orchestra.run.smithi138.stderr: 43750K .......... .......... .......... .......... .......... 47% 290M 0s 2024-09-12T00:41:30.226 INFO:teuthology.orchestra.run.smithi138.stderr: 43800K .......... .......... .......... .......... .......... 47% 347M 0s 2024-09-12T00:41:30.226 INFO:teuthology.orchestra.run.smithi138.stderr: 43850K .......... .......... .......... .......... .......... 47% 216M 0s 2024-09-12T00:41:30.226 INFO:teuthology.orchestra.run.smithi138.stderr: 43900K .......... .......... .......... .......... .......... 47% 303M 0s 2024-09-12T00:41:30.226 INFO:teuthology.orchestra.run.smithi138.stderr: 43950K .......... .......... .......... .......... .......... 47% 270M 0s 2024-09-12T00:41:30.227 INFO:teuthology.orchestra.run.smithi138.stderr: 44000K .......... .......... .......... .......... .......... 47% 156M 0s 2024-09-12T00:41:30.227 INFO:teuthology.orchestra.run.smithi138.stderr: 44050K .......... .......... .......... .......... .......... 47% 304M 0s 2024-09-12T00:41:30.227 INFO:teuthology.orchestra.run.smithi138.stderr: 44100K .......... .......... .......... .......... .......... 47% 345M 0s 2024-09-12T00:41:30.227 INFO:teuthology.orchestra.run.smithi138.stderr: 44150K .......... .......... .......... .......... .......... 47% 287M 0s 2024-09-12T00:41:30.227 INFO:teuthology.orchestra.run.smithi138.stderr: 44200K .......... .......... .......... .......... .......... 47% 326M 0s 2024-09-12T00:41:30.227 INFO:teuthology.orchestra.run.smithi138.stderr: 44250K .......... .......... .......... .......... .......... 47% 353M 0s 2024-09-12T00:41:30.227 INFO:teuthology.orchestra.run.smithi138.stderr: 44300K .......... .......... .......... .......... .......... 47% 232M 0s 2024-09-12T00:41:30.227 INFO:teuthology.orchestra.run.smithi138.stderr: 44350K .......... .......... .......... .......... .......... 47% 119M 0s 2024-09-12T00:41:30.227 INFO:teuthology.orchestra.run.smithi138.stderr: 44400K .......... .......... .......... .......... .......... 47% 267M 0s 2024-09-12T00:41:30.227 INFO:teuthology.orchestra.run.smithi138.stderr: 44450K .......... .......... .......... .......... .......... 47% 88.8M 0s 2024-09-12T00:41:30.227 INFO:teuthology.orchestra.run.smithi138.stderr: 44500K .......... .......... .......... .......... .......... 47% 240M 0s 2024-09-12T00:41:30.227 INFO:teuthology.orchestra.run.smithi138.stderr: 44550K .......... .......... .......... .......... .......... 48% 274M 0s 2024-09-12T00:41:30.227 INFO:teuthology.orchestra.run.smithi138.stderr: 44600K .......... .......... .......... .......... .......... 48% 328M 0s 2024-09-12T00:41:30.228 INFO:teuthology.orchestra.run.smithi138.stderr: 44650K .......... .......... .......... .......... .......... 48% 352M 0s 2024-09-12T00:41:30.228 INFO:teuthology.orchestra.run.smithi138.stderr: 44700K .......... .......... .......... .......... .......... 48% 351M 0s 2024-09-12T00:41:30.228 INFO:teuthology.orchestra.run.smithi138.stderr: 44750K .......... .......... .......... .......... .......... 48% 78.3M 0s 2024-09-12T00:41:30.228 INFO:teuthology.orchestra.run.smithi138.stderr: 44800K .......... .......... .......... .......... .......... 48% 297M 0s 2024-09-12T00:41:30.228 INFO:teuthology.orchestra.run.smithi138.stderr: 44850K .......... .......... .......... .......... .......... 48% 354M 0s 2024-09-12T00:41:30.228 INFO:teuthology.orchestra.run.smithi138.stderr: 44900K .......... .......... .......... .......... .......... 48% 334M 0s 2024-09-12T00:41:30.228 INFO:teuthology.orchestra.run.smithi138.stderr: 44950K .......... .......... .......... .......... .......... 48% 278M 0s 2024-09-12T00:41:30.228 INFO:teuthology.orchestra.run.smithi138.stderr: 45000K .......... .......... .......... .......... .......... 48% 294M 0s 2024-09-12T00:41:30.228 INFO:teuthology.orchestra.run.smithi138.stderr: 45050K .......... .......... .......... .......... .......... 48% 305M 0s 2024-09-12T00:41:30.228 INFO:teuthology.orchestra.run.smithi138.stderr: 45100K .......... .......... .......... .......... .......... 48% 293M 0s 2024-09-12T00:41:30.228 INFO:teuthology.orchestra.run.smithi138.stderr: 45150K .......... .......... .......... .......... .......... 48% 250M 0s 2024-09-12T00:41:30.228 INFO:teuthology.orchestra.run.smithi138.stderr: 45200K .......... .......... .......... .......... .......... 48% 312M 0s 2024-09-12T00:41:30.228 INFO:teuthology.orchestra.run.smithi138.stderr: 45250K .......... .......... .......... .......... .......... 48% 347M 0s 2024-09-12T00:41:30.229 INFO:teuthology.orchestra.run.smithi138.stderr: 45300K .......... .......... .......... .......... .......... 48% 140M 0s 2024-09-12T00:41:30.229 INFO:teuthology.orchestra.run.smithi138.stderr: 45350K .......... .......... .......... .......... .......... 48% 279M 0s 2024-09-12T00:41:30.229 INFO:teuthology.orchestra.run.smithi138.stderr: 45400K .......... .......... .......... .......... .......... 48% 350M 0s 2024-09-12T00:41:30.229 INFO:teuthology.orchestra.run.smithi138.stderr: 45450K .......... .......... .......... .......... .......... 48% 251M 0s 2024-09-12T00:41:30.229 INFO:teuthology.orchestra.run.smithi138.stderr: 45500K .......... .......... .......... .......... .......... 49% 102M 0s 2024-09-12T00:41:30.229 INFO:teuthology.orchestra.run.smithi138.stderr: 45550K .......... .......... .......... .......... .......... 49% 260M 0s 2024-09-12T00:41:30.229 INFO:teuthology.orchestra.run.smithi138.stderr: 45600K .......... .......... .......... .......... .......... 49% 306M 0s 2024-09-12T00:41:30.229 INFO:teuthology.orchestra.run.smithi138.stderr: 45650K .......... .......... .......... .......... .......... 49% 330M 0s 2024-09-12T00:41:30.229 INFO:teuthology.orchestra.run.smithi138.stderr: 45700K .......... .......... .......... .......... .......... 49% 335M 0s 2024-09-12T00:41:30.229 INFO:teuthology.orchestra.run.smithi138.stderr: 45750K .......... .......... .......... .......... .......... 49% 290M 0s 2024-09-12T00:41:30.229 INFO:teuthology.orchestra.run.smithi138.stderr: 45800K .......... .......... .......... .......... .......... 49% 328M 0s 2024-09-12T00:41:30.229 INFO:teuthology.orchestra.run.smithi138.stderr: 45850K .......... .......... .......... .......... .......... 49% 342M 0s 2024-09-12T00:41:30.229 INFO:teuthology.orchestra.run.smithi138.stderr: 45900K .......... .......... .......... .......... .......... 49% 146M 0s 2024-09-12T00:41:30.229 INFO:teuthology.orchestra.run.smithi138.stderr: 45950K .......... .......... .......... .......... .......... 49% 129M 0s 2024-09-12T00:41:30.230 INFO:teuthology.orchestra.run.smithi138.stderr: 46000K .......... .......... .......... .......... .......... 49% 306M 0s 2024-09-12T00:41:30.230 INFO:teuthology.orchestra.run.smithi138.stderr: 46050K .......... .......... .......... .......... .......... 49% 111M 0s 2024-09-12T00:41:30.230 INFO:teuthology.orchestra.run.smithi138.stderr: 46100K .......... .......... .......... .......... .......... 49% 103M 0s 2024-09-12T00:41:30.230 INFO:teuthology.orchestra.run.smithi138.stderr: 46150K .......... .......... .......... .......... .......... 49% 266M 0s 2024-09-12T00:41:30.230 INFO:teuthology.orchestra.run.smithi138.stderr: 46200K .......... .......... .......... .......... .......... 49% 317M 0s 2024-09-12T00:41:30.230 INFO:teuthology.orchestra.run.smithi138.stderr: 46250K .......... .......... .......... .......... .......... 49% 354M 0s 2024-09-12T00:41:30.230 INFO:teuthology.orchestra.run.smithi138.stderr: 46300K .......... .......... .......... .......... .......... 49% 347M 0s 2024-09-12T00:41:30.230 INFO:teuthology.orchestra.run.smithi138.stderr: 46350K .......... .......... .......... .......... .......... 49% 259M 0s 2024-09-12T00:41:30.230 INFO:teuthology.orchestra.run.smithi138.stderr: 46400K .......... .......... .......... .......... .......... 49% 336M 0s 2024-09-12T00:41:30.230 INFO:teuthology.orchestra.run.smithi138.stderr: 46450K .......... .......... .......... .......... .......... 50% 335M 0s 2024-09-12T00:41:30.230 INFO:teuthology.orchestra.run.smithi138.stderr: 46500K .......... .......... .......... .......... .......... 50% 337M 0s 2024-09-12T00:41:30.230 INFO:teuthology.orchestra.run.smithi138.stderr: 46550K .......... .......... .......... .......... .......... 50% 291M 0s 2024-09-12T00:41:30.230 INFO:teuthology.orchestra.run.smithi138.stderr: 46600K .......... .......... .......... .......... .......... 50% 333M 0s 2024-09-12T00:41:30.231 INFO:teuthology.orchestra.run.smithi138.stderr: 46650K .......... .......... .......... .......... .......... 50% 354M 0s 2024-09-12T00:41:30.231 INFO:teuthology.orchestra.run.smithi138.stderr: 46700K .......... .......... .......... .......... .......... 50% 341M 0s 2024-09-12T00:41:30.231 INFO:teuthology.orchestra.run.smithi138.stderr: 46750K .......... .......... .......... .......... .......... 50% 216M 0s 2024-09-12T00:41:30.231 INFO:teuthology.orchestra.run.smithi138.stderr: 46800K .......... .......... .......... .......... .......... 50% 324M 0s 2024-09-12T00:41:30.231 INFO:teuthology.orchestra.run.smithi138.stderr: 46850K .......... .......... .......... .......... .......... 50% 343M 0s 2024-09-12T00:41:30.231 INFO:teuthology.orchestra.run.smithi138.stderr: 46900K .......... .......... .......... .......... .......... 50% 355M 0s 2024-09-12T00:41:30.231 INFO:teuthology.orchestra.run.smithi138.stderr: 46950K .......... .......... .......... .......... .......... 50% 214M 0s 2024-09-12T00:41:30.231 INFO:teuthology.orchestra.run.smithi138.stderr: 47000K .......... .......... .......... .......... .......... 50% 280M 0s 2024-09-12T00:41:30.231 INFO:teuthology.orchestra.run.smithi138.stderr: 47050K .......... .......... .......... .......... .......... 50% 329M 0s 2024-09-12T00:41:30.231 INFO:teuthology.orchestra.run.smithi138.stderr: 47100K .......... .......... .......... .......... .......... 50% 301M 0s 2024-09-12T00:41:30.231 INFO:teuthology.orchestra.run.smithi138.stderr: 47150K .......... .......... .......... .......... .......... 50% 296M 0s 2024-09-12T00:41:30.231 INFO:teuthology.orchestra.run.smithi138.stderr: 47200K .......... .......... .......... .......... .......... 50% 207M 0s 2024-09-12T00:41:30.231 INFO:teuthology.orchestra.run.smithi138.stderr: 47250K .......... .......... .......... .......... .......... 50% 304M 0s 2024-09-12T00:41:30.231 INFO:teuthology.orchestra.run.smithi138.stderr: 47300K .......... .......... .......... .......... .......... 50% 350M 0s 2024-09-12T00:41:30.232 INFO:teuthology.orchestra.run.smithi138.stderr: 47350K .......... .......... .......... .......... .......... 51% 191M 0s 2024-09-12T00:41:30.232 INFO:teuthology.orchestra.run.smithi138.stderr: 47400K .......... .......... .......... .......... .......... 51% 245M 0s 2024-09-12T00:41:30.232 INFO:teuthology.orchestra.run.smithi138.stderr: 47450K .......... .......... .......... .......... .......... 51% 88.8M 0s 2024-09-12T00:41:30.232 INFO:teuthology.orchestra.run.smithi138.stderr: 47500K .......... .......... .......... .......... .......... 51% 312M 0s 2024-09-12T00:41:30.232 INFO:teuthology.orchestra.run.smithi138.stderr: 47550K .......... .......... .......... .......... .......... 51% 295M 0s 2024-09-12T00:41:30.232 INFO:teuthology.orchestra.run.smithi138.stderr: 47600K .......... .......... .......... .......... .......... 51% 181M 0s 2024-09-12T00:41:30.232 INFO:teuthology.orchestra.run.smithi138.stderr: 47650K .......... .......... .......... .......... .......... 51% 85.6M 0s 2024-09-12T00:41:30.232 INFO:teuthology.orchestra.run.smithi138.stderr: 47700K .......... .......... .......... .......... .......... 51% 235M 0s 2024-09-12T00:41:30.232 INFO:teuthology.orchestra.run.smithi138.stderr: 47750K .......... .......... .......... .......... .......... 51% 313M 0s 2024-09-12T00:41:30.232 INFO:teuthology.orchestra.run.smithi138.stderr: 47800K .......... .......... .......... .......... .......... 51% 161M 0s 2024-09-12T00:41:30.232 INFO:teuthology.orchestra.run.smithi138.stderr: 47850K .......... .......... .......... .......... .......... 51% 313M 0s 2024-09-12T00:41:30.232 INFO:teuthology.orchestra.run.smithi138.stderr: 47900K .......... .......... .......... .......... .......... 51% 283M 0s 2024-09-12T00:41:30.232 INFO:teuthology.orchestra.run.smithi138.stderr: 47950K .......... .......... .......... .......... .......... 51% 222M 0s 2024-09-12T00:41:30.233 INFO:teuthology.orchestra.run.smithi138.stderr: 48000K .......... .......... .......... .......... .......... 51% 339M 0s 2024-09-12T00:41:30.233 INFO:teuthology.orchestra.run.smithi138.stderr: 48050K .......... .......... .......... .......... .......... 51% 314M 0s 2024-09-12T00:41:30.233 INFO:teuthology.orchestra.run.smithi138.stderr: 48100K .......... .......... .......... .......... .......... 51% 325M 0s 2024-09-12T00:41:30.233 INFO:teuthology.orchestra.run.smithi138.stderr: 48150K .......... .......... .......... .......... .......... 51% 300M 0s 2024-09-12T00:41:30.233 INFO:teuthology.orchestra.run.smithi138.stderr: 48200K .......... .......... .......... .......... .......... 51% 325M 0s 2024-09-12T00:41:30.233 INFO:teuthology.orchestra.run.smithi138.stderr: 48250K .......... .......... .......... .......... .......... 51% 145M 0s 2024-09-12T00:41:30.233 INFO:teuthology.orchestra.run.smithi138.stderr: 48300K .......... .......... .......... .......... .......... 52% 310M 0s 2024-09-12T00:41:30.233 INFO:teuthology.orchestra.run.smithi138.stderr: 48350K .......... .......... .......... .......... .......... 52% 224M 0s 2024-09-12T00:41:30.233 INFO:teuthology.orchestra.run.smithi138.stderr: 48400K .......... .......... .......... .......... .......... 52% 316M 0s 2024-09-12T00:41:30.233 INFO:teuthology.orchestra.run.smithi138.stderr: 48450K .......... .......... .......... .......... .......... 52% 348M 0s 2024-09-12T00:41:30.233 INFO:teuthology.orchestra.run.smithi138.stderr: 48500K .......... .......... .......... .......... .......... 52% 158M 0s 2024-09-12T00:41:30.233 INFO:teuthology.orchestra.run.smithi138.stderr: 48550K .......... .......... .......... .......... .......... 52% 120M 0s 2024-09-12T00:41:30.233 INFO:teuthology.orchestra.run.smithi138.stderr: 48600K .......... .......... .......... .......... .......... 52% 293M 0s 2024-09-12T00:41:30.233 INFO:teuthology.orchestra.run.smithi138.stderr: 48650K .......... .......... .......... .......... .......... 52% 327M 0s 2024-09-12T00:41:30.234 INFO:teuthology.orchestra.run.smithi138.stderr: 48700K .......... .......... .......... .......... .......... 52% 305M 0s 2024-09-12T00:41:30.234 INFO:teuthology.orchestra.run.smithi138.stderr: 48750K .......... .......... .......... .......... .......... 52% 276M 0s 2024-09-12T00:41:30.234 INFO:teuthology.orchestra.run.smithi138.stderr: 48800K .......... .......... .......... .......... .......... 52% 341M 0s 2024-09-12T00:41:30.234 INFO:teuthology.orchestra.run.smithi138.stderr: 48850K .......... .......... .......... .......... .......... 52% 354M 0s 2024-09-12T00:41:30.234 INFO:teuthology.orchestra.run.smithi138.stderr: 48900K .......... .......... .......... .......... .......... 52% 335M 0s 2024-09-12T00:41:30.234 INFO:teuthology.orchestra.run.smithi138.stderr: 48950K .......... .......... .......... .......... .......... 52% 309M 0s 2024-09-12T00:41:30.234 INFO:teuthology.orchestra.run.smithi138.stderr: 49000K .......... .......... .......... .......... .......... 52% 240M 0s 2024-09-12T00:41:30.234 INFO:teuthology.orchestra.run.smithi138.stderr: 49050K .......... .......... .......... .......... .......... 52% 166M 0s 2024-09-12T00:41:30.234 INFO:teuthology.orchestra.run.smithi138.stderr: 49100K .......... .......... .......... .......... .......... 52% 88.2M 0s 2024-09-12T00:41:30.234 INFO:teuthology.orchestra.run.smithi138.stderr: 49150K .......... .......... .......... .......... .......... 52% 201M 0s 2024-09-12T00:41:30.234 INFO:teuthology.orchestra.run.smithi138.stderr: 49200K .......... .......... .......... .......... .......... 53% 251M 0s 2024-09-12T00:41:30.234 INFO:teuthology.orchestra.run.smithi138.stderr: 49250K .......... .......... .......... .......... .......... 53% 192M 0s 2024-09-12T00:41:30.234 INFO:teuthology.orchestra.run.smithi138.stderr: 49300K .......... .......... .......... .......... .......... 53% 316M 0s 2024-09-12T00:41:30.234 INFO:teuthology.orchestra.run.smithi138.stderr: 49350K .......... .......... .......... .......... .......... 53% 297M 0s 2024-09-12T00:41:30.235 INFO:teuthology.orchestra.run.smithi138.stderr: 49400K .......... .......... .......... .......... .......... 53% 355M 0s 2024-09-12T00:41:30.235 INFO:teuthology.orchestra.run.smithi138.stderr: 49450K .......... .......... .......... .......... .......... 53% 259M 0s 2024-09-12T00:41:30.235 INFO:teuthology.orchestra.run.smithi138.stderr: 49500K .......... .......... .......... .......... .......... 53% 311M 0s 2024-09-12T00:41:30.235 INFO:teuthology.orchestra.run.smithi138.stderr: 49550K .......... .......... .......... .......... .......... 53% 282M 0s 2024-09-12T00:41:30.235 INFO:teuthology.orchestra.run.smithi138.stderr: 49600K .......... .......... .......... .......... .......... 53% 354M 0s 2024-09-12T00:41:30.235 INFO:teuthology.orchestra.run.smithi138.stderr: 49650K .......... .......... .......... .......... .......... 53% 352M 0s 2024-09-12T00:41:30.235 INFO:teuthology.orchestra.run.smithi138.stderr: 49700K .......... .......... .......... .......... .......... 53% 337M 0s 2024-09-12T00:41:30.235 INFO:teuthology.orchestra.run.smithi138.stderr: 49750K .......... .......... .......... .......... .......... 53% 300M 0s 2024-09-12T00:41:30.235 INFO:teuthology.orchestra.run.smithi138.stderr: 49800K .......... .......... .......... .......... .......... 53% 348M 0s 2024-09-12T00:41:30.235 INFO:teuthology.orchestra.run.smithi138.stderr: 49850K .......... .......... .......... .......... .......... 53% 359M 0s 2024-09-12T00:41:30.235 INFO:teuthology.orchestra.run.smithi138.stderr: 49900K .......... .......... .......... .......... .......... 53% 332M 0s 2024-09-12T00:41:30.235 INFO:teuthology.orchestra.run.smithi138.stderr: 49950K .......... .......... .......... .......... .......... 53% 291M 0s 2024-09-12T00:41:30.235 INFO:teuthology.orchestra.run.smithi138.stderr: 50000K .......... .......... .......... .......... .......... 53% 345M 0s 2024-09-12T00:41:30.236 INFO:teuthology.orchestra.run.smithi138.stderr: 50050K .......... .......... .......... .......... .......... 53% 305M 0s 2024-09-12T00:41:30.236 INFO:teuthology.orchestra.run.smithi138.stderr: 50100K .......... .......... .......... .......... .......... 53% 343M 0s 2024-09-12T00:41:30.236 INFO:teuthology.orchestra.run.smithi138.stderr: 50150K .......... .......... .......... .......... .......... 54% 83.0M 0s 2024-09-12T00:41:30.236 INFO:teuthology.orchestra.run.smithi138.stderr: 50200K .......... .......... .......... .......... .......... 54% 300M 0s 2024-09-12T00:41:30.236 INFO:teuthology.orchestra.run.smithi138.stderr: 50250K .......... .......... .......... .......... .......... 54% 338M 0s 2024-09-12T00:41:30.236 INFO:teuthology.orchestra.run.smithi138.stderr: 50300K .......... .......... .......... .......... .......... 54% 338M 0s 2024-09-12T00:41:30.236 INFO:teuthology.orchestra.run.smithi138.stderr: 50350K .......... .......... .......... .......... .......... 54% 255M 0s 2024-09-12T00:41:30.236 INFO:teuthology.orchestra.run.smithi138.stderr: 50400K .......... .......... .......... .......... .......... 54% 359M 0s 2024-09-12T00:41:30.236 INFO:teuthology.orchestra.run.smithi138.stderr: 50450K .......... .......... .......... .......... .......... 54% 168M 0s 2024-09-12T00:41:30.236 INFO:teuthology.orchestra.run.smithi138.stderr: 50500K .......... .......... .......... .......... .......... 54% 256M 0s 2024-09-12T00:41:30.236 INFO:teuthology.orchestra.run.smithi138.stderr: 50550K .......... .......... .......... .......... .......... 54% 303M 0s 2024-09-12T00:41:30.236 INFO:teuthology.orchestra.run.smithi138.stderr: 50600K .......... .......... .......... .......... .......... 54% 320M 0s 2024-09-12T00:41:30.236 INFO:teuthology.orchestra.run.smithi138.stderr: 50650K .......... .......... .......... .......... .......... 54% 76.1M 0s 2024-09-12T00:41:30.237 INFO:teuthology.orchestra.run.smithi138.stderr: 50700K .......... .......... .......... .......... .......... 54% 200M 0s 2024-09-12T00:41:30.237 INFO:teuthology.orchestra.run.smithi138.stderr: 50750K .......... .......... .......... .......... .......... 54% 248M 0s 2024-09-12T00:41:30.237 INFO:teuthology.orchestra.run.smithi138.stderr: 50800K .......... .......... .......... .......... .......... 54% 344M 0s 2024-09-12T00:41:30.237 INFO:teuthology.orchestra.run.smithi138.stderr: 50850K .......... .......... .......... .......... .......... 54% 73.5M 0s 2024-09-12T00:41:30.237 INFO:teuthology.orchestra.run.smithi138.stderr: 50900K .......... .......... .......... .......... .......... 54% 311M 0s 2024-09-12T00:41:30.237 INFO:teuthology.orchestra.run.smithi138.stderr: 50950K .......... .......... .......... .......... .......... 54% 267M 0s 2024-09-12T00:41:30.237 INFO:teuthology.orchestra.run.smithi138.stderr: 51000K .......... .......... .......... .......... .......... 54% 343M 0s 2024-09-12T00:41:30.237 INFO:teuthology.orchestra.run.smithi138.stderr: 51050K .......... .......... .......... .......... .......... 55% 312M 0s 2024-09-12T00:41:30.237 INFO:teuthology.orchestra.run.smithi138.stderr: 51100K .......... .......... .......... .......... .......... 55% 308M 0s 2024-09-12T00:41:30.237 INFO:teuthology.orchestra.run.smithi138.stderr: 51150K .......... .......... .......... .......... .......... 55% 295M 0s 2024-09-12T00:41:30.237 INFO:teuthology.orchestra.run.smithi138.stderr: 51200K .......... .......... .......... .......... .......... 55% 333M 0s 2024-09-12T00:41:30.237 INFO:teuthology.orchestra.run.smithi138.stderr: 51250K .......... .......... .......... .......... .......... 55% 354M 0s 2024-09-12T00:41:30.237 INFO:teuthology.orchestra.run.smithi138.stderr: 51300K .......... .......... .......... .......... .......... 55% 322M 0s 2024-09-12T00:41:30.237 INFO:teuthology.orchestra.run.smithi138.stderr: 51350K .......... .......... .......... .......... .......... 55% 349M 0s 2024-09-12T00:41:30.238 INFO:teuthology.orchestra.run.smithi138.stderr: 51400K .......... .......... .......... .......... .......... 55% 357M 0s 2024-09-12T00:41:30.238 INFO:teuthology.orchestra.run.smithi138.stderr: 51450K .......... .......... .......... .......... .......... 55% 362M 0s 2024-09-12T00:41:30.238 INFO:teuthology.orchestra.run.smithi138.stderr: 51500K .......... .......... .......... .......... .......... 55% 160M 0s 2024-09-12T00:41:30.238 INFO:teuthology.orchestra.run.smithi138.stderr: 51550K .......... .......... .......... .......... .......... 55% 147M 0s 2024-09-12T00:41:30.238 INFO:teuthology.orchestra.run.smithi138.stderr: 51600K .......... .......... .......... .......... .......... 55% 183M 0s 2024-09-12T00:41:30.238 INFO:teuthology.orchestra.run.smithi138.stderr: 51650K .......... .......... .......... .......... .......... 55% 306M 0s 2024-09-12T00:41:30.238 INFO:teuthology.orchestra.run.smithi138.stderr: 51700K .......... .......... .......... .......... .......... 55% 273M 0s 2024-09-12T00:41:30.238 INFO:teuthology.orchestra.run.smithi138.stderr: 51750K .......... .......... .......... .......... .......... 55% 326M 0s 2024-09-12T00:41:30.238 INFO:teuthology.orchestra.run.smithi138.stderr: 51800K .......... .......... .......... .......... .......... 55% 192M 0s 2024-09-12T00:41:30.238 INFO:teuthology.orchestra.run.smithi138.stderr: 51850K .......... .......... .......... .......... .......... 55% 231M 0s 2024-09-12T00:41:30.238 INFO:teuthology.orchestra.run.smithi138.stderr: 51900K .......... .......... .......... .......... .......... 55% 229M 0s 2024-09-12T00:41:30.238 INFO:teuthology.orchestra.run.smithi138.stderr: 51950K .......... .......... .......... .......... .......... 55% 236M 0s 2024-09-12T00:41:30.238 INFO:teuthology.orchestra.run.smithi138.stderr: 52000K .......... .......... .......... .......... .......... 56% 285M 0s 2024-09-12T00:41:30.239 INFO:teuthology.orchestra.run.smithi138.stderr: 52050K .......... .......... .......... .......... .......... 56% 337M 0s 2024-09-12T00:41:30.239 INFO:teuthology.orchestra.run.smithi138.stderr: 52100K .......... .......... .......... .......... .......... 56% 168M 0s 2024-09-12T00:41:30.239 INFO:teuthology.orchestra.run.smithi138.stderr: 52150K .......... .......... .......... .......... .......... 56% 210M 0s 2024-09-12T00:41:30.239 INFO:teuthology.orchestra.run.smithi138.stderr: 52200K .......... .......... .......... .......... .......... 56% 219M 0s 2024-09-12T00:41:30.239 INFO:teuthology.orchestra.run.smithi138.stderr: 52250K .......... .......... .......... .......... .......... 56% 172M 0s 2024-09-12T00:41:30.239 INFO:teuthology.orchestra.run.smithi138.stderr: 52300K .......... .......... .......... .......... .......... 56% 161M 0s 2024-09-12T00:41:30.239 INFO:teuthology.orchestra.run.smithi138.stderr: 52350K .......... .......... .......... .......... .......... 56% 333M 0s 2024-09-12T00:41:30.239 INFO:teuthology.orchestra.run.smithi138.stderr: 52400K .......... .......... .......... .......... .......... 56% 223M 0s 2024-09-12T00:41:30.239 INFO:teuthology.orchestra.run.smithi138.stderr: 52450K .......... .......... .......... .......... .......... 56% 319M 0s 2024-09-12T00:41:30.239 INFO:teuthology.orchestra.run.smithi138.stderr: 52500K .......... .......... .......... .......... .......... 56% 278M 0s 2024-09-12T00:41:30.239 INFO:teuthology.orchestra.run.smithi138.stderr: 52550K .......... .......... .......... .......... .......... 56% 321M 0s 2024-09-12T00:41:30.239 INFO:teuthology.orchestra.run.smithi138.stderr: 52600K .......... .......... .......... .......... .......... 56% 354M 0s 2024-09-12T00:41:30.239 INFO:teuthology.orchestra.run.smithi138.stderr: 52650K .......... .......... .......... .......... .......... 56% 324M 0s 2024-09-12T00:41:30.239 INFO:teuthology.orchestra.run.smithi138.stderr: 52700K .......... .......... .......... .......... .......... 56% 278M 0s 2024-09-12T00:41:30.240 INFO:teuthology.orchestra.run.smithi138.stderr: 52750K .......... .......... .......... .......... .......... 56% 297M 0s 2024-09-12T00:41:30.240 INFO:teuthology.orchestra.run.smithi138.stderr: 52800K .......... .......... .......... .......... .......... 56% 286M 0s 2024-09-12T00:41:30.240 INFO:teuthology.orchestra.run.smithi138.stderr: 52850K .......... .......... .......... .......... .......... 56% 319M 0s 2024-09-12T00:41:30.240 INFO:teuthology.orchestra.run.smithi138.stderr: 52900K .......... .......... .......... .......... .......... 56% 291M 0s 2024-09-12T00:41:30.240 INFO:teuthology.orchestra.run.smithi138.stderr: 52950K .......... .......... .......... .......... .......... 57% 294M 0s 2024-09-12T00:41:30.240 INFO:teuthology.orchestra.run.smithi138.stderr: 53000K .......... .......... .......... .......... .......... 57% 332M 0s 2024-09-12T00:41:30.240 INFO:teuthology.orchestra.run.smithi138.stderr: 53050K .......... .......... .......... .......... .......... 57% 335M 0s 2024-09-12T00:41:30.240 INFO:teuthology.orchestra.run.smithi138.stderr: 53100K .......... .......... .......... .......... .......... 57% 124M 0s 2024-09-12T00:41:30.240 INFO:teuthology.orchestra.run.smithi138.stderr: 53150K .......... .......... .......... .......... .......... 57% 317M 0s 2024-09-12T00:41:30.240 INFO:teuthology.orchestra.run.smithi138.stderr: 53200K .......... .......... .......... .......... .......... 57% 239M 0s 2024-09-12T00:41:30.240 INFO:teuthology.orchestra.run.smithi138.stderr: 53250K .......... .......... .......... .......... .......... 57% 326M 0s 2024-09-12T00:41:30.240 INFO:teuthology.orchestra.run.smithi138.stderr: 53300K .......... .......... .......... .......... .......... 57% 290M 0s 2024-09-12T00:41:30.240 INFO:teuthology.orchestra.run.smithi138.stderr: 53350K .......... .......... .......... .......... .......... 57% 267M 0s 2024-09-12T00:41:30.241 INFO:teuthology.orchestra.run.smithi138.stderr: 53400K .......... .......... .......... .......... .......... 57% 174M 0s 2024-09-12T00:41:30.241 INFO:teuthology.orchestra.run.smithi138.stderr: 53450K .......... .......... .......... .......... .......... 57% 327M 0s 2024-09-12T00:41:30.241 INFO:teuthology.orchestra.run.smithi138.stderr: 53500K .......... .......... .......... .......... .......... 57% 263M 0s 2024-09-12T00:41:30.241 INFO:teuthology.orchestra.run.smithi138.stderr: 53550K .......... .......... .......... .......... .......... 57% 369M 0s 2024-09-12T00:41:30.241 INFO:teuthology.orchestra.run.smithi138.stderr: 53600K .......... .......... .......... .......... .......... 57% 326M 0s 2024-09-12T00:41:30.241 INFO:teuthology.orchestra.run.smithi138.stderr: 53650K .......... .......... .......... .......... .......... 57% 98.3M 0s 2024-09-12T00:41:30.241 INFO:teuthology.orchestra.run.smithi138.stderr: 53700K .......... .......... .......... .......... .......... 57% 135M 0s 2024-09-12T00:41:30.241 INFO:teuthology.orchestra.run.smithi138.stderr: 53750K .......... .......... .......... .......... .......... 57% 282M 0s 2024-09-12T00:41:30.241 INFO:teuthology.orchestra.run.smithi138.stderr: 53800K .......... .......... .......... .......... .......... 57% 271M 0s 2024-09-12T00:41:30.241 INFO:teuthology.orchestra.run.smithi138.stderr: 53850K .......... .......... .......... .......... .......... 58% 363M 0s 2024-09-12T00:41:30.241 INFO:teuthology.orchestra.run.smithi138.stderr: 53900K .......... .......... .......... .......... .......... 58% 50.1M 0s 2024-09-12T00:41:30.241 INFO:teuthology.orchestra.run.smithi138.stderr: 53950K .......... .......... .......... .......... .......... 58% 335M 0s 2024-09-12T00:41:30.241 INFO:teuthology.orchestra.run.smithi138.stderr: 54000K .......... .......... .......... .......... .......... 58% 273M 0s 2024-09-12T00:41:30.241 INFO:teuthology.orchestra.run.smithi138.stderr: 54050K .......... .......... .......... .......... .......... 58% 347M 0s 2024-09-12T00:41:30.242 INFO:teuthology.orchestra.run.smithi138.stderr: 54100K .......... .......... .......... .......... .......... 58% 321M 0s 2024-09-12T00:41:30.242 INFO:teuthology.orchestra.run.smithi138.stderr: 54150K .......... .......... .......... .......... .......... 58% 334M 0s 2024-09-12T00:41:30.242 INFO:teuthology.orchestra.run.smithi138.stderr: 54200K .......... .......... .......... .......... .......... 58% 276M 0s 2024-09-12T00:41:30.242 INFO:teuthology.orchestra.run.smithi138.stderr: 54250K .......... .......... .......... .......... .......... 58% 363M 0s 2024-09-12T00:41:30.242 INFO:teuthology.orchestra.run.smithi138.stderr: 54300K .......... .......... .......... .......... .......... 58% 340M 0s 2024-09-12T00:41:30.242 INFO:teuthology.orchestra.run.smithi138.stderr: 54350K .......... .......... .......... .......... .......... 58% 317M 0s 2024-09-12T00:41:30.242 INFO:teuthology.orchestra.run.smithi138.stderr: 54400K .......... .......... .......... .......... .......... 58% 291M 0s 2024-09-12T00:41:30.242 INFO:teuthology.orchestra.run.smithi138.stderr: 54450K .......... .......... .......... .......... .......... 58% 340M 0s 2024-09-12T00:41:30.242 INFO:teuthology.orchestra.run.smithi138.stderr: 54500K .......... .......... .......... .......... .......... 58% 313M 0s 2024-09-12T00:41:30.242 INFO:teuthology.orchestra.run.smithi138.stderr: 54550K .......... .......... .......... .......... .......... 58% 364M 0s 2024-09-12T00:41:30.242 INFO:teuthology.orchestra.run.smithi138.stderr: 54600K .......... .......... .......... .......... .......... 58% 174M 0s 2024-09-12T00:41:30.242 INFO:teuthology.orchestra.run.smithi138.stderr: 54650K .......... .......... .......... .......... .......... 58% 310M 0s 2024-09-12T00:41:30.242 INFO:teuthology.orchestra.run.smithi138.stderr: 54700K .......... .......... .......... .......... .......... 58% 223M 0s 2024-09-12T00:41:30.243 INFO:teuthology.orchestra.run.smithi138.stderr: 54750K .......... .......... .......... .......... .......... 58% 315M 0s 2024-09-12T00:41:30.243 INFO:teuthology.orchestra.run.smithi138.stderr: 54800K .......... .......... .......... .......... .......... 59% 114M 0s 2024-09-12T00:41:30.243 INFO:teuthology.orchestra.run.smithi138.stderr: 54850K .......... .......... .......... .......... .......... 59% 350M 0s 2024-09-12T00:41:30.243 INFO:teuthology.orchestra.run.smithi138.stderr: 54900K .......... .......... .......... .......... .......... 59% 160M 0s 2024-09-12T00:41:30.243 INFO:teuthology.orchestra.run.smithi138.stderr: 54950K .......... .......... .......... .......... .......... 59% 230M 0s 2024-09-12T00:41:30.243 INFO:teuthology.orchestra.run.smithi138.stderr: 55000K .......... .......... .......... .......... .......... 59% 292M 0s 2024-09-12T00:41:30.243 INFO:teuthology.orchestra.run.smithi138.stderr: 55050K .......... .......... .......... .......... .......... 59% 311M 0s 2024-09-12T00:41:30.243 INFO:teuthology.orchestra.run.smithi138.stderr: 55100K .......... .......... .......... .......... .......... 59% 327M 0s 2024-09-12T00:41:30.243 INFO:teuthology.orchestra.run.smithi138.stderr: 55150K .......... .......... .......... .......... .......... 59% 336M 0s 2024-09-12T00:41:30.243 INFO:teuthology.orchestra.run.smithi138.stderr: 55200K .......... .......... .......... .......... .......... 59% 228M 0s 2024-09-12T00:41:30.243 INFO:teuthology.orchestra.run.smithi138.stderr: 55250K .......... .......... .......... .......... .......... 59% 327M 0s 2024-09-12T00:41:30.243 INFO:teuthology.orchestra.run.smithi138.stderr: 55300K .......... .......... .......... .......... .......... 59% 97.0M 0s 2024-09-12T00:41:30.243 INFO:teuthology.orchestra.run.smithi138.stderr: 55350K .......... .......... .......... .......... .......... 59% 195M 0s 2024-09-12T00:41:30.243 INFO:teuthology.orchestra.run.smithi138.stderr: 55400K .......... .......... .......... .......... .......... 59% 153M 0s 2024-09-12T00:41:30.244 INFO:teuthology.orchestra.run.smithi138.stderr: 55450K .......... .......... .......... .......... .......... 59% 346M 0s 2024-09-12T00:41:30.244 INFO:teuthology.orchestra.run.smithi138.stderr: 55500K .......... .......... .......... .......... .......... 59% 356M 0s 2024-09-12T00:41:30.244 INFO:teuthology.orchestra.run.smithi138.stderr: 55550K .......... .......... .......... .......... .......... 59% 340M 0s 2024-09-12T00:41:30.244 INFO:teuthology.orchestra.run.smithi138.stderr: 55600K .......... .......... .......... .......... .......... 59% 315M 0s 2024-09-12T00:41:30.244 INFO:teuthology.orchestra.run.smithi138.stderr: 55650K .......... .......... .......... .......... .......... 59% 301M 0s 2024-09-12T00:41:30.244 INFO:teuthology.orchestra.run.smithi138.stderr: 55700K .......... .......... .......... .......... .......... 60% 319M 0s 2024-09-12T00:41:30.244 INFO:teuthology.orchestra.run.smithi138.stderr: 55750K .......... .......... .......... .......... .......... 60% 313M 0s 2024-09-12T00:41:30.244 INFO:teuthology.orchestra.run.smithi138.stderr: 55800K .......... .......... .......... .......... .......... 60% 246M 0s 2024-09-12T00:41:30.244 INFO:teuthology.orchestra.run.smithi138.stderr: 55850K .......... .......... .......... .......... .......... 60% 353M 0s 2024-09-12T00:41:30.244 INFO:teuthology.orchestra.run.smithi138.stderr: 55900K .......... .......... .......... .......... .......... 60% 300M 0s 2024-09-12T00:41:30.244 INFO:teuthology.orchestra.run.smithi138.stderr: 55950K .......... .......... .......... .......... .......... 60% 307M 0s 2024-09-12T00:41:30.244 INFO:teuthology.orchestra.run.smithi138.stderr: 56000K .......... .......... .......... .......... .......... 60% 299M 0s 2024-09-12T00:41:30.244 INFO:teuthology.orchestra.run.smithi138.stderr: 56050K .......... .......... .......... .......... .......... 60% 309M 0s 2024-09-12T00:41:30.245 INFO:teuthology.orchestra.run.smithi138.stderr: 56100K .......... .......... .......... .......... .......... 60% 340M 0s 2024-09-12T00:41:30.245 INFO:teuthology.orchestra.run.smithi138.stderr: 56150K .......... .......... .......... .......... .......... 60% 361M 0s 2024-09-12T00:41:30.245 INFO:teuthology.orchestra.run.smithi138.stderr: 56200K .......... .......... .......... .......... .......... 60% 197M 0s 2024-09-12T00:41:30.245 INFO:teuthology.orchestra.run.smithi138.stderr: 56250K .......... .......... .......... .......... .......... 60% 215M 0s 2024-09-12T00:41:30.245 INFO:teuthology.orchestra.run.smithi138.stderr: 56300K .......... .......... .......... .......... .......... 60% 337M 0s 2024-09-12T00:41:30.245 INFO:teuthology.orchestra.run.smithi138.stderr: 56350K .......... .......... .......... .......... .......... 60% 348M 0s 2024-09-12T00:41:30.245 INFO:teuthology.orchestra.run.smithi138.stderr: 56400K .......... .......... .......... .......... .......... 60% 309M 0s 2024-09-12T00:41:30.245 INFO:teuthology.orchestra.run.smithi138.stderr: 56450K .......... .......... .......... .......... .......... 60% 85.8M 0s 2024-09-12T00:41:30.245 INFO:teuthology.orchestra.run.smithi138.stderr: 56500K .......... .......... .......... .......... .......... 60% 353M 0s 2024-09-12T00:41:30.245 INFO:teuthology.orchestra.run.smithi138.stderr: 56550K .......... .......... .......... .......... .......... 60% 301M 0s 2024-09-12T00:41:30.245 INFO:teuthology.orchestra.run.smithi138.stderr: 56600K .......... .......... .......... .......... .......... 60% 292M 0s 2024-09-12T00:41:30.245 INFO:teuthology.orchestra.run.smithi138.stderr: 56650K .......... .......... .......... .......... .......... 61% 374M 0s 2024-09-12T00:41:30.245 INFO:teuthology.orchestra.run.smithi138.stderr: 56700K .......... .......... .......... .......... .......... 61% 145M 0s 2024-09-12T00:41:30.246 INFO:teuthology.orchestra.run.smithi138.stderr: 56750K .......... .......... .......... .......... .......... 61% 259M 0s 2024-09-12T00:41:30.246 INFO:teuthology.orchestra.run.smithi138.stderr: 56800K .......... .......... .......... .......... .......... 61% 44.6M 0s 2024-09-12T00:41:30.246 INFO:teuthology.orchestra.run.smithi138.stderr: 56850K .......... .......... .......... .......... .......... 61% 168M 0s 2024-09-12T00:41:30.246 INFO:teuthology.orchestra.run.smithi138.stderr: 56900K .......... .......... .......... .......... .......... 61% 363M 0s 2024-09-12T00:41:30.246 INFO:teuthology.orchestra.run.smithi138.stderr: 56950K .......... .......... .......... .......... .......... 61% 188M 0s 2024-09-12T00:41:30.246 INFO:teuthology.orchestra.run.smithi138.stderr: 57000K .......... .......... .......... .......... .......... 61% 260M 0s 2024-09-12T00:41:30.246 INFO:teuthology.orchestra.run.smithi138.stderr: 57050K .......... .......... .......... .......... .......... 61% 363M 0s 2024-09-12T00:41:30.246 INFO:teuthology.orchestra.run.smithi138.stderr: 57100K .......... .......... .......... .......... .......... 61% 349M 0s 2024-09-12T00:41:30.246 INFO:teuthology.orchestra.run.smithi138.stderr: 57150K .......... .......... .......... .......... .......... 61% 353M 0s 2024-09-12T00:41:30.246 INFO:teuthology.orchestra.run.smithi138.stderr: 57200K .......... .......... .......... .......... .......... 61% 306M 0s 2024-09-12T00:41:30.246 INFO:teuthology.orchestra.run.smithi138.stderr: 57250K .......... .......... .......... .......... .......... 61% 324M 0s 2024-09-12T00:41:30.246 INFO:teuthology.orchestra.run.smithi138.stderr: 57300K .......... .......... .......... .......... .......... 61% 316M 0s 2024-09-12T00:41:30.246 INFO:teuthology.orchestra.run.smithi138.stderr: 57350K .......... .......... .......... .......... .......... 61% 331M 0s 2024-09-12T00:41:30.246 INFO:teuthology.orchestra.run.smithi138.stderr: 57400K .......... .......... .......... .......... .......... 61% 295M 0s 2024-09-12T00:41:30.247 INFO:teuthology.orchestra.run.smithi138.stderr: 57450K .......... .......... .......... .......... .......... 61% 245M 0s 2024-09-12T00:41:30.247 INFO:teuthology.orchestra.run.smithi138.stderr: 57500K .......... .......... .......... .......... .......... 61% 233M 0s 2024-09-12T00:41:30.247 INFO:teuthology.orchestra.run.smithi138.stderr: 57550K .......... .......... .......... .......... .......... 62% 368M 0s 2024-09-12T00:41:30.247 INFO:teuthology.orchestra.run.smithi138.stderr: 57600K .......... .......... .......... .......... .......... 62% 321M 0s 2024-09-12T00:41:30.247 INFO:teuthology.orchestra.run.smithi138.stderr: 57650K .......... .......... .......... .......... .......... 62% 335M 0s 2024-09-12T00:41:30.247 INFO:teuthology.orchestra.run.smithi138.stderr: 57700K .......... .......... .......... .......... .......... 62% 351M 0s 2024-09-12T00:41:30.247 INFO:teuthology.orchestra.run.smithi138.stderr: 57750K .......... .......... .......... .......... .......... 62% 303M 0s 2024-09-12T00:41:30.247 INFO:teuthology.orchestra.run.smithi138.stderr: 57800K .......... .......... .......... .......... .......... 62% 94.4M 0s 2024-09-12T00:41:30.247 INFO:teuthology.orchestra.run.smithi138.stderr: 57850K .......... .......... .......... .......... .......... 62% 277M 0s 2024-09-12T00:41:30.247 INFO:teuthology.orchestra.run.smithi138.stderr: 57900K .......... .......... .......... .......... .......... 62% 343M 0s 2024-09-12T00:41:30.247 INFO:teuthology.orchestra.run.smithi138.stderr: 57950K .......... .......... .......... .......... .......... 62% 339M 0s 2024-09-12T00:41:30.247 INFO:teuthology.orchestra.run.smithi138.stderr: 58000K .......... .......... .......... .......... .......... 62% 81.2M 0s 2024-09-12T00:41:30.247 INFO:teuthology.orchestra.run.smithi138.stderr: 58050K .......... .......... .......... .......... .......... 62% 323M 0s 2024-09-12T00:41:30.248 INFO:teuthology.orchestra.run.smithi138.stderr: 58100K .......... .......... .......... .......... .......... 62% 319M 0s 2024-09-12T00:41:30.248 INFO:teuthology.orchestra.run.smithi138.stderr: 58150K .......... .......... .......... .......... .......... 62% 341M 0s 2024-09-12T00:41:30.248 INFO:teuthology.orchestra.run.smithi138.stderr: 58200K .......... .......... .......... .......... .......... 62% 286M 0s 2024-09-12T00:41:30.248 INFO:teuthology.orchestra.run.smithi138.stderr: 58250K .......... .......... .......... .......... .......... 62% 342M 0s 2024-09-12T00:41:30.248 INFO:teuthology.orchestra.run.smithi138.stderr: 58300K .......... .......... .......... .......... .......... 62% 376M 0s 2024-09-12T00:41:30.248 INFO:teuthology.orchestra.run.smithi138.stderr: 58350K .......... .......... .......... .......... .......... 62% 344M 0s 2024-09-12T00:41:30.248 INFO:teuthology.orchestra.run.smithi138.stderr: 58400K .......... .......... .......... .......... .......... 62% 173M 0s 2024-09-12T00:41:30.248 INFO:teuthology.orchestra.run.smithi138.stderr: 58450K .......... .......... .......... .......... .......... 62% 243M 0s 2024-09-12T00:41:30.248 INFO:teuthology.orchestra.run.smithi138.stderr: 58500K .......... .......... .......... .......... .......... 63% 338M 0s 2024-09-12T00:41:30.248 INFO:teuthology.orchestra.run.smithi138.stderr: 58550K .......... .......... .......... .......... .......... 63% 93.8M 0s 2024-09-12T00:41:30.248 INFO:teuthology.orchestra.run.smithi138.stderr: 58600K .......... .......... .......... .......... .......... 63% 231M 0s 2024-09-12T00:41:30.248 INFO:teuthology.orchestra.run.smithi138.stderr: 58650K .......... .......... .......... .......... .......... 63% 302M 0s 2024-09-12T00:41:30.248 INFO:teuthology.orchestra.run.smithi138.stderr: 58700K .......... .......... .......... .......... .......... 63% 320M 0s 2024-09-12T00:41:30.248 INFO:teuthology.orchestra.run.smithi138.stderr: 58750K .......... .......... .......... .......... .......... 63% 349M 0s 2024-09-12T00:41:30.249 INFO:teuthology.orchestra.run.smithi138.stderr: 58800K .......... .......... .......... .......... .......... 63% 285M 0s 2024-09-12T00:41:30.249 INFO:teuthology.orchestra.run.smithi138.stderr: 58850K .......... .......... .......... .......... .......... 63% 338M 0s 2024-09-12T00:41:30.249 INFO:teuthology.orchestra.run.smithi138.stderr: 58900K .......... .......... .......... .......... .......... 63% 356M 0s 2024-09-12T00:41:30.249 INFO:teuthology.orchestra.run.smithi138.stderr: 58950K .......... .......... .......... .......... .......... 63% 372M 0s 2024-09-12T00:41:30.249 INFO:teuthology.orchestra.run.smithi138.stderr: 59000K .......... .......... .......... .......... .......... 63% 299M 0s 2024-09-12T00:41:30.249 INFO:teuthology.orchestra.run.smithi138.stderr: 59050K .......... .......... .......... .......... .......... 63% 381M 0s 2024-09-12T00:41:30.249 INFO:teuthology.orchestra.run.smithi138.stderr: 59100K .......... .......... .......... .......... .......... 63% 238M 0s 2024-09-12T00:41:30.249 INFO:teuthology.orchestra.run.smithi138.stderr: 59150K .......... .......... .......... .......... .......... 63% 336M 0s 2024-09-12T00:41:30.249 INFO:teuthology.orchestra.run.smithi138.stderr: 59200K .......... .......... .......... .......... .......... 63% 296M 0s 2024-09-12T00:41:30.249 INFO:teuthology.orchestra.run.smithi138.stderr: 59250K .......... .......... .......... .......... .......... 63% 362M 0s 2024-09-12T00:41:30.249 INFO:teuthology.orchestra.run.smithi138.stderr: 59300K .......... .......... .......... .......... .......... 63% 336M 0s 2024-09-12T00:41:30.249 INFO:teuthology.orchestra.run.smithi138.stderr: 59350K .......... .......... .......... .......... .......... 63% 366M 0s 2024-09-12T00:41:30.249 INFO:teuthology.orchestra.run.smithi138.stderr: 59400K .......... .......... .......... .......... .......... 63% 106M 0s 2024-09-12T00:41:30.250 INFO:teuthology.orchestra.run.smithi138.stderr: 59450K .......... .......... .......... .......... .......... 64% 321M 0s 2024-09-12T00:41:30.250 INFO:teuthology.orchestra.run.smithi138.stderr: 59500K .......... .......... .......... .......... .......... 64% 353M 0s 2024-09-12T00:41:30.250 INFO:teuthology.orchestra.run.smithi138.stderr: 59550K .......... .......... .......... .......... .......... 64% 339M 0s 2024-09-12T00:41:30.250 INFO:teuthology.orchestra.run.smithi138.stderr: 59600K .......... .......... .......... .......... .......... 64% 136M 0s 2024-09-12T00:41:30.250 INFO:teuthology.orchestra.run.smithi138.stderr: 59650K .......... .......... .......... .......... .......... 64% 322M 0s 2024-09-12T00:41:30.250 INFO:teuthology.orchestra.run.smithi138.stderr: 59700K .......... .......... .......... .......... .......... 64% 302M 0s 2024-09-12T00:41:30.250 INFO:teuthology.orchestra.run.smithi138.stderr: 59750K .......... .......... .......... .......... .......... 64% 278M 0s 2024-09-12T00:41:30.250 INFO:teuthology.orchestra.run.smithi138.stderr: 59800K .......... .......... .......... .......... .......... 64% 47.6M 0s 2024-09-12T00:41:30.250 INFO:teuthology.orchestra.run.smithi138.stderr: 59850K .......... .......... .......... .......... .......... 64% 186M 0s 2024-09-12T00:41:30.250 INFO:teuthology.orchestra.run.smithi138.stderr: 59900K .......... .......... .......... .......... .......... 64% 153M 0s 2024-09-12T00:41:30.250 INFO:teuthology.orchestra.run.smithi138.stderr: 59950K .......... .......... .......... .......... .......... 64% 198M 0s 2024-09-12T00:41:30.250 INFO:teuthology.orchestra.run.smithi138.stderr: 60000K .......... .......... .......... .......... .......... 64% 309M 0s 2024-09-12T00:41:30.250 INFO:teuthology.orchestra.run.smithi138.stderr: 60050K .......... .......... .......... .......... .......... 64% 347M 0s 2024-09-12T00:41:30.250 INFO:teuthology.orchestra.run.smithi138.stderr: 60100K .......... .......... .......... .......... .......... 64% 284M 0s 2024-09-12T00:41:30.251 INFO:teuthology.orchestra.run.smithi138.stderr: 60150K .......... .......... .......... .......... .......... 64% 325M 0s 2024-09-12T00:41:30.251 INFO:teuthology.orchestra.run.smithi138.stderr: 60200K .......... .......... .......... .......... .......... 64% 330M 0s 2024-09-12T00:41:30.251 INFO:teuthology.orchestra.run.smithi138.stderr: 60250K .......... .......... .......... .......... .......... 64% 119M 0s 2024-09-12T00:41:30.251 INFO:teuthology.orchestra.run.smithi138.stderr: 60300K .......... .......... .......... .......... .......... 64% 255M 0s 2024-09-12T00:41:30.251 INFO:teuthology.orchestra.run.smithi138.stderr: 60350K .......... .......... .......... .......... .......... 65% 297M 0s 2024-09-12T00:41:30.251 INFO:teuthology.orchestra.run.smithi138.stderr: 60400K .......... .......... .......... .......... .......... 65% 337M 0s 2024-09-12T00:41:30.251 INFO:teuthology.orchestra.run.smithi138.stderr: 60450K .......... .......... .......... .......... .......... 65% 335M 0s 2024-09-12T00:41:30.251 INFO:teuthology.orchestra.run.smithi138.stderr: 60500K .......... .......... .......... .......... .......... 65% 303M 0s 2024-09-12T00:41:30.251 INFO:teuthology.orchestra.run.smithi138.stderr: 60550K .......... .......... .......... .......... .......... 65% 333M 0s 2024-09-12T00:41:30.251 INFO:teuthology.orchestra.run.smithi138.stderr: 60600K .......... .......... .......... .......... .......... 65% 332M 0s 2024-09-12T00:41:30.251 INFO:teuthology.orchestra.run.smithi138.stderr: 60650K .......... .......... .......... .......... .......... 65% 360M 0s 2024-09-12T00:41:30.251 INFO:teuthology.orchestra.run.smithi138.stderr: 60700K .......... .......... .......... .......... .......... 65% 279M 0s 2024-09-12T00:41:30.251 INFO:teuthology.orchestra.run.smithi138.stderr: 60750K .......... .......... .......... .......... .......... 65% 351M 0s 2024-09-12T00:41:30.252 INFO:teuthology.orchestra.run.smithi138.stderr: 60800K .......... .......... .......... .......... .......... 65% 200M 0s 2024-09-12T00:41:30.252 INFO:teuthology.orchestra.run.smithi138.stderr: 60850K .......... .......... .......... .......... .......... 65% 303M 0s 2024-09-12T00:41:30.252 INFO:teuthology.orchestra.run.smithi138.stderr: 60900K .......... .......... .......... .......... .......... 65% 148M 0s 2024-09-12T00:41:30.252 INFO:teuthology.orchestra.run.smithi138.stderr: 60950K .......... .......... .......... .......... .......... 65% 285M 0s 2024-09-12T00:41:30.252 INFO:teuthology.orchestra.run.smithi138.stderr: 61000K .......... .......... .......... .......... .......... 65% 186M 0s 2024-09-12T00:41:30.252 INFO:teuthology.orchestra.run.smithi138.stderr: 61050K .......... .......... .......... .......... .......... 65% 336M 0s 2024-09-12T00:41:30.252 INFO:teuthology.orchestra.run.smithi138.stderr: 61100K .......... .......... .......... .......... .......... 65% 141M 0s 2024-09-12T00:41:30.252 INFO:teuthology.orchestra.run.smithi138.stderr: 61150K .......... .......... .......... .......... .......... 65% 337M 0s 2024-09-12T00:41:30.252 INFO:teuthology.orchestra.run.smithi138.stderr: 61200K .......... .......... .......... .......... .......... 65% 333M 0s 2024-09-12T00:41:30.252 INFO:teuthology.orchestra.run.smithi138.stderr: 61250K .......... .......... .......... .......... .......... 65% 314M 0s 2024-09-12T00:41:30.252 INFO:teuthology.orchestra.run.smithi138.stderr: 61300K .......... .......... .......... .......... .......... 66% 294M 0s 2024-09-12T00:41:30.252 INFO:teuthology.orchestra.run.smithi138.stderr: 61350K .......... .......... .......... .......... .......... 66% 343M 0s 2024-09-12T00:41:30.252 INFO:teuthology.orchestra.run.smithi138.stderr: 61400K .......... .......... .......... .......... .......... 66% 367M 0s 2024-09-12T00:41:30.252 INFO:teuthology.orchestra.run.smithi138.stderr: 61450K .......... .......... .......... .......... .......... 66% 238M 0s 2024-09-12T00:41:30.253 INFO:teuthology.orchestra.run.smithi138.stderr: 61500K .......... .......... .......... .......... .......... 66% 104M 0s 2024-09-12T00:41:30.253 INFO:teuthology.orchestra.run.smithi138.stderr: 61550K .......... .......... .......... .......... .......... 66% 252M 0s 2024-09-12T00:41:30.253 INFO:teuthology.orchestra.run.smithi138.stderr: 61600K .......... .......... .......... .......... .......... 66% 243M 0s 2024-09-12T00:41:30.253 INFO:teuthology.orchestra.run.smithi138.stderr: 61650K .......... .......... .......... .......... .......... 66% 337M 0s 2024-09-12T00:41:30.253 INFO:teuthology.orchestra.run.smithi138.stderr: 61700K .......... .......... .......... .......... .......... 66% 307M 0s 2024-09-12T00:41:30.253 INFO:teuthology.orchestra.run.smithi138.stderr: 61750K .......... .......... .......... .......... .......... 66% 348M 0s 2024-09-12T00:41:30.253 INFO:teuthology.orchestra.run.smithi138.stderr: 61800K .......... .......... .......... .......... .......... 66% 315M 0s 2024-09-12T00:41:30.253 INFO:teuthology.orchestra.run.smithi138.stderr: 61850K .......... .......... .......... .......... .......... 66% 320M 0s 2024-09-12T00:41:30.253 INFO:teuthology.orchestra.run.smithi138.stderr: 61900K .......... .......... .......... .......... .......... 66% 342M 0s 2024-09-12T00:41:30.253 INFO:teuthology.orchestra.run.smithi138.stderr: 61950K .......... .......... .......... .......... .......... 66% 92.7M 0s 2024-09-12T00:41:30.253 INFO:teuthology.orchestra.run.smithi138.stderr: 62000K .......... .......... .......... .......... .......... 66% 282M 0s 2024-09-12T00:41:30.253 INFO:teuthology.orchestra.run.smithi138.stderr: 62050K .......... .......... .......... .......... .......... 66% 296M 0s 2024-09-12T00:41:30.253 INFO:teuthology.orchestra.run.smithi138.stderr: 62100K .......... .......... .......... .......... .......... 66% 312M 0s 2024-09-12T00:41:30.254 INFO:teuthology.orchestra.run.smithi138.stderr: 62150K .......... .......... .......... .......... .......... 66% 268M 0s 2024-09-12T00:41:30.254 INFO:teuthology.orchestra.run.smithi138.stderr: 62200K .......... .......... .......... .......... .......... 67% 363M 0s 2024-09-12T00:41:30.254 INFO:teuthology.orchestra.run.smithi138.stderr: 62250K .......... .......... .......... .......... .......... 67% 379M 0s 2024-09-12T00:41:30.254 INFO:teuthology.orchestra.run.smithi138.stderr: 62300K .......... .......... .......... .......... .......... 67% 372M 0s 2024-09-12T00:41:30.254 INFO:teuthology.orchestra.run.smithi138.stderr: 62350K .......... .......... .......... .......... .......... 67% 172M 0s 2024-09-12T00:41:30.254 INFO:teuthology.orchestra.run.smithi138.stderr: 62400K .......... .......... .......... .......... .......... 67% 315M 0s 2024-09-12T00:41:30.254 INFO:teuthology.orchestra.run.smithi138.stderr: 62450K .......... .......... .......... .......... .......... 67% 345M 0s 2024-09-12T00:41:30.254 INFO:teuthology.orchestra.run.smithi138.stderr: 62500K .......... .......... .......... .......... .......... 67% 371M 0s 2024-09-12T00:41:30.254 INFO:teuthology.orchestra.run.smithi138.stderr: 62550K .......... .......... .......... .......... .......... 67% 332M 0s 2024-09-12T00:41:30.254 INFO:teuthology.orchestra.run.smithi138.stderr: 62600K .......... .......... .......... .......... .......... 67% 192M 0s 2024-09-12T00:41:30.254 INFO:teuthology.orchestra.run.smithi138.stderr: 62650K .......... .......... .......... .......... .......... 67% 332M 0s 2024-09-12T00:41:30.254 INFO:teuthology.orchestra.run.smithi138.stderr: 62700K .......... .......... .......... .......... .......... 67% 336M 0s 2024-09-12T00:41:30.254 INFO:teuthology.orchestra.run.smithi138.stderr: 62750K .......... .......... .......... .......... .......... 67% 42.5M 0s 2024-09-12T00:41:30.254 INFO:teuthology.orchestra.run.smithi138.stderr: 62800K .......... .......... .......... .......... .......... 67% 316M 0s 2024-09-12T00:41:30.255 INFO:teuthology.orchestra.run.smithi138.stderr: 62850K .......... .......... .......... .......... .......... 67% 364M 0s 2024-09-12T00:41:30.255 INFO:teuthology.orchestra.run.smithi138.stderr: 62900K .......... .......... .......... .......... .......... 67% 351M 0s 2024-09-12T00:41:30.255 INFO:teuthology.orchestra.run.smithi138.stderr: 62950K .......... .......... .......... .......... .......... 67% 306M 0s 2024-09-12T00:41:30.255 INFO:teuthology.orchestra.run.smithi138.stderr: 63000K .......... .......... .......... .......... .......... 67% 124M 0s 2024-09-12T00:41:30.255 INFO:teuthology.orchestra.run.smithi138.stderr: 63050K .......... .......... .......... .......... .......... 67% 328M 0s 2024-09-12T00:41:30.255 INFO:teuthology.orchestra.run.smithi138.stderr: 63100K .......... .......... .......... .......... .......... 67% 257M 0s 2024-09-12T00:41:30.255 INFO:teuthology.orchestra.run.smithi138.stderr: 63150K .......... .......... .......... .......... .......... 68% 75.3M 0s 2024-09-12T00:41:30.255 INFO:teuthology.orchestra.run.smithi138.stderr: 63200K .......... .......... .......... .......... .......... 68% 319M 0s 2024-09-12T00:41:30.255 INFO:teuthology.orchestra.run.smithi138.stderr: 63250K .......... .......... .......... .......... .......... 68% 349M 0s 2024-09-12T00:41:30.255 INFO:teuthology.orchestra.run.smithi138.stderr: 63300K .......... .......... .......... .......... .......... 68% 323M 0s 2024-09-12T00:41:30.255 INFO:teuthology.orchestra.run.smithi138.stderr: 63350K .......... .......... .......... .......... .......... 68% 287M 0s 2024-09-12T00:41:30.255 INFO:teuthology.orchestra.run.smithi138.stderr: 63400K .......... .......... .......... .......... .......... 68% 333M 0s 2024-09-12T00:41:30.255 INFO:teuthology.orchestra.run.smithi138.stderr: 63450K .......... .......... .......... .......... .......... 68% 342M 0s 2024-09-12T00:41:30.256 INFO:teuthology.orchestra.run.smithi138.stderr: 63500K .......... .......... .......... .......... .......... 68% 332M 0s 2024-09-12T00:41:30.256 INFO:teuthology.orchestra.run.smithi138.stderr: 63550K .......... .......... .......... .......... .......... 68% 298M 0s 2024-09-12T00:41:30.256 INFO:teuthology.orchestra.run.smithi138.stderr: 63600K .......... .......... .......... .......... .......... 68% 379M 0s 2024-09-12T00:41:30.256 INFO:teuthology.orchestra.run.smithi138.stderr: 63650K .......... .......... .......... .......... .......... 68% 360M 0s 2024-09-12T00:41:30.256 INFO:teuthology.orchestra.run.smithi138.stderr: 63700K .......... .......... .......... .......... .......... 68% 198M 0s 2024-09-12T00:41:30.256 INFO:teuthology.orchestra.run.smithi138.stderr: 63750K .......... .......... .......... .......... .......... 68% 305M 0s 2024-09-12T00:41:30.256 INFO:teuthology.orchestra.run.smithi138.stderr: 63800K .......... .......... .......... .......... .......... 68% 329M 0s 2024-09-12T00:41:30.256 INFO:teuthology.orchestra.run.smithi138.stderr: 63850K .......... .......... .......... .......... .......... 68% 349M 0s 2024-09-12T00:41:30.256 INFO:teuthology.orchestra.run.smithi138.stderr: 63900K .......... .......... .......... .......... .......... 68% 372M 0s 2024-09-12T00:41:30.256 INFO:teuthology.orchestra.run.smithi138.stderr: 63950K .......... .......... .......... .......... .......... 68% 294M 0s 2024-09-12T00:41:30.256 INFO:teuthology.orchestra.run.smithi138.stderr: 64000K .......... .......... .......... .......... .......... 68% 346M 0s 2024-09-12T00:41:30.256 INFO:teuthology.orchestra.run.smithi138.stderr: 64050K .......... .......... .......... .......... .......... 68% 161M 0s 2024-09-12T00:41:30.256 INFO:teuthology.orchestra.run.smithi138.stderr: 64100K .......... .......... .......... .......... .......... 69% 336M 0s 2024-09-12T00:41:30.256 INFO:teuthology.orchestra.run.smithi138.stderr: 64150K .......... .......... .......... .......... .......... 69% 80.9M 0s 2024-09-12T00:41:30.257 INFO:teuthology.orchestra.run.smithi138.stderr: 64200K .......... .......... .......... .......... .......... 69% 370M 0s 2024-09-12T00:41:30.257 INFO:teuthology.orchestra.run.smithi138.stderr: 64250K .......... .......... .......... .......... .......... 69% 346M 0s 2024-09-12T00:41:30.257 INFO:teuthology.orchestra.run.smithi138.stderr: 64300K .......... .......... .......... .......... .......... 69% 346M 0s 2024-09-12T00:41:30.257 INFO:teuthology.orchestra.run.smithi138.stderr: 64350K .......... .......... .......... .......... .......... 69% 288M 0s 2024-09-12T00:41:30.257 INFO:teuthology.orchestra.run.smithi138.stderr: 64400K .......... .......... .......... .......... .......... 69% 291M 0s 2024-09-12T00:41:30.257 INFO:teuthology.orchestra.run.smithi138.stderr: 64450K .......... .......... .......... .......... .......... 69% 350M 0s 2024-09-12T00:41:30.257 INFO:teuthology.orchestra.run.smithi138.stderr: 64500K .......... .......... .......... .......... .......... 69% 364M 0s 2024-09-12T00:41:30.257 INFO:teuthology.orchestra.run.smithi138.stderr: 64550K .......... .......... .......... .......... .......... 69% 304M 0s 2024-09-12T00:41:30.257 INFO:teuthology.orchestra.run.smithi138.stderr: 64600K .......... .......... .......... .......... .......... 69% 239M 0s 2024-09-12T00:41:30.257 INFO:teuthology.orchestra.run.smithi138.stderr: 64650K .......... .......... .......... .......... .......... 69% 317M 0s 2024-09-12T00:41:30.257 INFO:teuthology.orchestra.run.smithi138.stderr: 64700K .......... .......... .......... .......... .......... 69% 122M 0s 2024-09-12T00:41:30.257 INFO:teuthology.orchestra.run.smithi138.stderr: 64750K .......... .......... .......... .......... .......... 69% 267M 0s 2024-09-12T00:41:30.257 INFO:teuthology.orchestra.run.smithi138.stderr: 64800K .......... .......... .......... .......... .......... 69% 346M 0s 2024-09-12T00:41:30.258 INFO:teuthology.orchestra.run.smithi138.stderr: 64850K .......... .......... .......... .......... .......... 69% 370M 0s 2024-09-12T00:41:30.258 INFO:teuthology.orchestra.run.smithi138.stderr: 64900K .......... .......... .......... .......... .......... 69% 89.7M 0s 2024-09-12T00:41:30.258 INFO:teuthology.orchestra.run.smithi138.stderr: 64950K .......... .......... .......... .......... .......... 69% 309M 0s 2024-09-12T00:41:30.258 INFO:teuthology.orchestra.run.smithi138.stderr: 65000K .......... .......... .......... .......... .......... 70% 139M 0s 2024-09-12T00:41:30.258 INFO:teuthology.orchestra.run.smithi138.stderr: 65050K .......... .......... .......... .......... .......... 70% 289M 0s 2024-09-12T00:41:30.258 INFO:teuthology.orchestra.run.smithi138.stderr: 65100K .......... .......... .......... .......... .......... 70% 322M 0s 2024-09-12T00:41:30.258 INFO:teuthology.orchestra.run.smithi138.stderr: 65150K .......... .......... .......... .......... .......... 70% 306M 0s 2024-09-12T00:41:30.258 INFO:teuthology.orchestra.run.smithi138.stderr: 65200K .......... .......... .......... .......... .......... 70% 329M 0s 2024-09-12T00:41:30.258 INFO:teuthology.orchestra.run.smithi138.stderr: 65250K .......... .......... .......... .......... .......... 70% 317M 0s 2024-09-12T00:41:30.258 INFO:teuthology.orchestra.run.smithi138.stderr: 65300K .......... .......... .......... .......... .......... 70% 343M 0s 2024-09-12T00:41:30.258 INFO:teuthology.orchestra.run.smithi138.stderr: 65350K .......... .......... .......... .......... .......... 70% 307M 0s 2024-09-12T00:41:30.258 INFO:teuthology.orchestra.run.smithi138.stderr: 65400K .......... .......... .......... .......... .......... 70% 345M 0s 2024-09-12T00:41:30.258 INFO:teuthology.orchestra.run.smithi138.stderr: 65450K .......... .......... .......... .......... .......... 70% 352M 0s 2024-09-12T00:41:30.258 INFO:teuthology.orchestra.run.smithi138.stderr: 65500K .......... .......... .......... .......... .......... 70% 386M 0s 2024-09-12T00:41:30.259 INFO:teuthology.orchestra.run.smithi138.stderr: 65550K .......... .......... .......... .......... .......... 70% 119M 0s 2024-09-12T00:41:30.259 INFO:teuthology.orchestra.run.smithi138.stderr: 65600K .......... .......... .......... .......... .......... 70% 343M 0s 2024-09-12T00:41:30.259 INFO:teuthology.orchestra.run.smithi138.stderr: 65650K .......... .......... .......... .......... .......... 70% 337M 0s 2024-09-12T00:41:30.259 INFO:teuthology.orchestra.run.smithi138.stderr: 65700K .......... .......... .......... .......... .......... 70% 69.9M 0s 2024-09-12T00:41:30.259 INFO:teuthology.orchestra.run.smithi138.stderr: 65750K .......... .......... .......... .......... .......... 70% 249M 0s 2024-09-12T00:41:30.259 INFO:teuthology.orchestra.run.smithi138.stderr: 65800K .......... .......... .......... .......... .......... 70% 329M 0s 2024-09-12T00:41:30.259 INFO:teuthology.orchestra.run.smithi138.stderr: 65850K .......... .......... .......... .......... .......... 70% 333M 0s 2024-09-12T00:41:30.259 INFO:teuthology.orchestra.run.smithi138.stderr: 65900K .......... .......... .......... .......... .......... 70% 366M 0s 2024-09-12T00:41:30.259 INFO:teuthology.orchestra.run.smithi138.stderr: 65950K .......... .......... .......... .......... .......... 71% 323M 0s 2024-09-12T00:41:30.259 INFO:teuthology.orchestra.run.smithi138.stderr: 66000K .......... .......... .......... .......... .......... 71% 201M 0s 2024-09-12T00:41:30.259 INFO:teuthology.orchestra.run.smithi138.stderr: 66050K .......... .......... .......... .......... .......... 71% 212M 0s 2024-09-12T00:41:30.259 INFO:teuthology.orchestra.run.smithi138.stderr: 66100K .......... .......... .......... .......... .......... 71% 242M 0s 2024-09-12T00:41:30.259 INFO:teuthology.orchestra.run.smithi138.stderr: 66150K .......... .......... .......... .......... .......... 71% 72.3M 0s 2024-09-12T00:41:30.260 INFO:teuthology.orchestra.run.smithi138.stderr: 66200K .......... .......... .......... .......... .......... 71% 295M 0s 2024-09-12T00:41:30.260 INFO:teuthology.orchestra.run.smithi138.stderr: 66250K .......... .......... .......... .......... .......... 71% 232M 0s 2024-09-12T00:41:30.260 INFO:teuthology.orchestra.run.smithi138.stderr: 66300K .......... .......... .......... .......... .......... 71% 169M 0s 2024-09-12T00:41:30.260 INFO:teuthology.orchestra.run.smithi138.stderr: 66350K .......... .......... .......... .......... .......... 71% 299M 0s 2024-09-12T00:41:30.260 INFO:teuthology.orchestra.run.smithi138.stderr: 66400K .......... .......... .......... .......... .......... 71% 303M 0s 2024-09-12T00:41:30.260 INFO:teuthology.orchestra.run.smithi138.stderr: 66450K .......... .......... .......... .......... .......... 71% 346M 0s 2024-09-12T00:41:30.260 INFO:teuthology.orchestra.run.smithi138.stderr: 66500K .......... .......... .......... .......... .......... 71% 344M 0s 2024-09-12T00:41:30.260 INFO:teuthology.orchestra.run.smithi138.stderr: 66550K .......... .......... .......... .......... .......... 71% 315M 0s 2024-09-12T00:41:30.260 INFO:teuthology.orchestra.run.smithi138.stderr: 66600K .......... .......... .......... .......... .......... 71% 143M 0s 2024-09-12T00:41:30.260 INFO:teuthology.orchestra.run.smithi138.stderr: 66650K .......... .......... .......... .......... .......... 71% 330M 0s 2024-09-12T00:41:30.260 INFO:teuthology.orchestra.run.smithi138.stderr: 66700K .......... .......... .......... .......... .......... 71% 350M 0s 2024-09-12T00:41:30.260 INFO:teuthology.orchestra.run.smithi138.stderr: 66750K .......... .......... .......... .......... .......... 71% 313M 0s 2024-09-12T00:41:30.260 INFO:teuthology.orchestra.run.smithi138.stderr: 66800K .......... .......... .......... .......... .......... 71% 200M 0s 2024-09-12T00:41:30.260 INFO:teuthology.orchestra.run.smithi138.stderr: 66850K .......... .......... .......... .......... .......... 72% 314M 0s 2024-09-12T00:41:30.261 INFO:teuthology.orchestra.run.smithi138.stderr: 66900K .......... .......... .......... .......... .......... 72% 344M 0s 2024-09-12T00:41:30.261 INFO:teuthology.orchestra.run.smithi138.stderr: 66950K .......... .......... .......... .......... .......... 72% 333M 0s 2024-09-12T00:41:30.261 INFO:teuthology.orchestra.run.smithi138.stderr: 67000K .......... .......... .......... .......... .......... 72% 368M 0s 2024-09-12T00:41:30.261 INFO:teuthology.orchestra.run.smithi138.stderr: 67050K .......... .......... .......... .......... .......... 72% 347M 0s 2024-09-12T00:41:30.261 INFO:teuthology.orchestra.run.smithi138.stderr: 67100K .......... .......... .......... .......... .......... 72% 367M 0s 2024-09-12T00:41:30.261 INFO:teuthology.orchestra.run.smithi138.stderr: 67150K .......... .......... .......... .......... .......... 72% 106M 0s 2024-09-12T00:41:30.261 INFO:teuthology.orchestra.run.smithi138.stderr: 67200K .......... .......... .......... .......... .......... 72% 125M 0s 2024-09-12T00:41:30.261 INFO:teuthology.orchestra.run.smithi138.stderr: 67250K .......... .......... .......... .......... .......... 72% 337M 0s 2024-09-12T00:41:30.261 INFO:teuthology.orchestra.run.smithi138.stderr: 67300K .......... .......... .......... .......... .......... 72% 327M 0s 2024-09-12T00:41:30.261 INFO:teuthology.orchestra.run.smithi138.stderr: 67350K .......... .......... .......... .......... .......... 72% 325M 0s 2024-09-12T00:41:30.261 INFO:teuthology.orchestra.run.smithi138.stderr: 67400K .......... .......... .......... .......... .......... 72% 306M 0s 2024-09-12T00:41:30.261 INFO:teuthology.orchestra.run.smithi138.stderr: 67450K .......... .......... .......... .......... .......... 72% 345M 0s 2024-09-12T00:41:30.261 INFO:teuthology.orchestra.run.smithi138.stderr: 67500K .......... .......... .......... .......... .......... 72% 348M 0s 2024-09-12T00:41:30.262 INFO:teuthology.orchestra.run.smithi138.stderr: 67550K .......... .......... .......... .......... .......... 72% 308M 0s 2024-09-12T00:41:30.262 INFO:teuthology.orchestra.run.smithi138.stderr: 67600K .......... .......... .......... .......... .......... 72% 359M 0s 2024-09-12T00:41:30.262 INFO:teuthology.orchestra.run.smithi138.stderr: 67650K .......... .......... .......... .......... .......... 72% 365M 0s 2024-09-12T00:41:30.262 INFO:teuthology.orchestra.run.smithi138.stderr: 67700K .......... .......... .......... .......... .......... 72% 368M 0s 2024-09-12T00:41:30.262 INFO:teuthology.orchestra.run.smithi138.stderr: 67750K .......... .......... .......... .......... .......... 72% 153M 0s 2024-09-12T00:41:30.262 INFO:teuthology.orchestra.run.smithi138.stderr: 67800K .......... .......... .......... .......... .......... 73% 59.6M 0s 2024-09-12T00:41:30.262 INFO:teuthology.orchestra.run.smithi138.stderr: 67850K .......... .......... .......... .......... .......... 73% 298M 0s 2024-09-12T00:41:30.262 INFO:teuthology.orchestra.run.smithi138.stderr: 67900K .......... .......... .......... .......... .......... 73% 333M 0s 2024-09-12T00:41:30.262 INFO:teuthology.orchestra.run.smithi138.stderr: 67950K .......... .......... .......... .......... .......... 73% 269M 0s 2024-09-12T00:41:30.262 INFO:teuthology.orchestra.run.smithi138.stderr: 68000K .......... .......... .......... .......... .......... 73% 344M 0s 2024-09-12T00:41:30.262 INFO:teuthology.orchestra.run.smithi138.stderr: 68050K .......... .......... .......... .......... .......... 73% 370M 0s 2024-09-12T00:41:30.262 INFO:teuthology.orchestra.run.smithi138.stderr: 68100K .......... .......... .......... .......... .......... 73% 360M 0s 2024-09-12T00:41:30.262 INFO:teuthology.orchestra.run.smithi138.stderr: 68150K .......... .......... .......... .......... .......... 73% 309M 0s 2024-09-12T00:41:30.263 INFO:teuthology.orchestra.run.smithi138.stderr: 68200K .......... .......... .......... .......... .......... 73% 149M 0s 2024-09-12T00:41:30.263 INFO:teuthology.orchestra.run.smithi138.stderr: 68250K .......... .......... .......... .......... .......... 73% 308M 0s 2024-09-12T00:41:30.263 INFO:teuthology.orchestra.run.smithi138.stderr: 68300K .......... .......... .......... .......... .......... 73% 371M 0s 2024-09-12T00:41:30.263 INFO:teuthology.orchestra.run.smithi138.stderr: 68350K .......... .......... .......... .......... .......... 73% 291M 0s 2024-09-12T00:41:30.263 INFO:teuthology.orchestra.run.smithi138.stderr: 68400K .......... .......... .......... .......... .......... 73% 325M 0s 2024-09-12T00:41:30.263 INFO:teuthology.orchestra.run.smithi138.stderr: 68450K .......... .......... .......... .......... .......... 73% 74.3M 0s 2024-09-12T00:41:30.263 INFO:teuthology.orchestra.run.smithi138.stderr: 68500K .......... .......... .......... .......... .......... 73% 205M 0s 2024-09-12T00:41:30.263 INFO:teuthology.orchestra.run.smithi138.stderr: 68550K .......... .......... .......... .......... .......... 73% 206M 0s 2024-09-12T00:41:30.263 INFO:teuthology.orchestra.run.smithi138.stderr: 68600K .......... .......... .......... .......... .......... 73% 265M 0s 2024-09-12T00:41:30.263 INFO:teuthology.orchestra.run.smithi138.stderr: 68650K .......... .......... .......... .......... .......... 73% 380M 0s 2024-09-12T00:41:30.263 INFO:teuthology.orchestra.run.smithi138.stderr: 68700K .......... .......... .......... .......... .......... 74% 377M 0s 2024-09-12T00:41:30.263 INFO:teuthology.orchestra.run.smithi138.stderr: 68750K .......... .......... .......... .......... .......... 74% 200M 0s 2024-09-12T00:41:30.263 INFO:teuthology.orchestra.run.smithi138.stderr: 68800K .......... .......... .......... .......... .......... 74% 239M 0s 2024-09-12T00:41:30.263 INFO:teuthology.orchestra.run.smithi138.stderr: 68850K .......... .......... .......... .......... .......... 74% 254M 0s 2024-09-12T00:41:30.264 INFO:teuthology.orchestra.run.smithi138.stderr: 68900K .......... .......... .......... .......... .......... 74% 227M 0s 2024-09-12T00:41:30.264 INFO:teuthology.orchestra.run.smithi138.stderr: 68950K .......... .......... .......... .......... .......... 74% 210M 0s 2024-09-12T00:41:30.264 INFO:teuthology.orchestra.run.smithi138.stderr: 69000K .......... .......... .......... .......... .......... 74% 372M 0s 2024-09-12T00:41:30.264 INFO:teuthology.orchestra.run.smithi138.stderr: 69050K .......... .......... .......... .......... .......... 74% 380M 0s 2024-09-12T00:41:30.264 INFO:teuthology.orchestra.run.smithi138.stderr: 69100K .......... .......... .......... .......... .......... 74% 380M 0s 2024-09-12T00:41:30.264 INFO:teuthology.orchestra.run.smithi138.stderr: 69150K .......... .......... .......... .......... .......... 74% 200M 0s 2024-09-12T00:41:30.264 INFO:teuthology.orchestra.run.smithi138.stderr: 69200K .......... .......... .......... .......... .......... 74% 124M 0s 2024-09-12T00:41:30.264 INFO:teuthology.orchestra.run.smithi138.stderr: 69250K .......... .......... .......... .......... .......... 74% 195M 0s 2024-09-12T00:41:30.264 INFO:teuthology.orchestra.run.smithi138.stderr: 69300K .......... .......... .......... .......... .......... 74% 305M 0s 2024-09-12T00:41:30.264 INFO:teuthology.orchestra.run.smithi138.stderr: 69350K .......... .......... .......... .......... .......... 74% 203M 0s 2024-09-12T00:41:30.264 INFO:teuthology.orchestra.run.smithi138.stderr: 69400K .......... .......... .......... .......... .......... 74% 222M 0s 2024-09-12T00:41:30.264 INFO:teuthology.orchestra.run.smithi138.stderr: 69450K .......... .......... .......... .......... .......... 74% 227M 0s 2024-09-12T00:41:30.264 INFO:teuthology.orchestra.run.smithi138.stderr: 69500K .......... .......... .......... .......... .......... 74% 369M 0s 2024-09-12T00:41:30.265 INFO:teuthology.orchestra.run.smithi138.stderr: 69550K .......... .......... .......... .......... .......... 74% 358M 0s 2024-09-12T00:41:30.265 INFO:teuthology.orchestra.run.smithi138.stderr: 69600K .......... .......... .......... .......... .......... 74% 262M 0s 2024-09-12T00:41:30.265 INFO:teuthology.orchestra.run.smithi138.stderr: 69650K .......... .......... .......... .......... .......... 75% 85.8M 0s 2024-09-12T00:41:30.265 INFO:teuthology.orchestra.run.smithi138.stderr: 69700K .......... .......... .......... .......... .......... 75% 209M 0s 2024-09-12T00:41:30.265 INFO:teuthology.orchestra.run.smithi138.stderr: 69750K .......... .......... .......... .......... .......... 75% 198M 0s 2024-09-12T00:41:30.265 INFO:teuthology.orchestra.run.smithi138.stderr: 69800K .......... .......... .......... .......... .......... 75% 207M 0s 2024-09-12T00:41:30.265 INFO:teuthology.orchestra.run.smithi138.stderr: 69850K .......... .......... .......... .......... .......... 75% 292M 0s 2024-09-12T00:41:30.265 INFO:teuthology.orchestra.run.smithi138.stderr: 69900K .......... .......... .......... .......... .......... 75% 326M 0s 2024-09-12T00:41:30.265 INFO:teuthology.orchestra.run.smithi138.stderr: 69950K .......... .......... .......... .......... .......... 75% 271M 0s 2024-09-12T00:41:30.265 INFO:teuthology.orchestra.run.smithi138.stderr: 70000K .......... .......... .......... .......... .......... 75% 356M 0s 2024-09-12T00:41:30.265 INFO:teuthology.orchestra.run.smithi138.stderr: 70050K .......... .......... .......... .......... .......... 75% 341M 0s 2024-09-12T00:41:30.265 INFO:teuthology.orchestra.run.smithi138.stderr: 70100K .......... .......... .......... .......... .......... 75% 283M 0s 2024-09-12T00:41:30.265 INFO:teuthology.orchestra.run.smithi138.stderr: 70150K .......... .......... .......... .......... .......... 75% 243M 0s 2024-09-12T00:41:30.265 INFO:teuthology.orchestra.run.smithi138.stderr: 70200K .......... .......... .......... .......... .......... 75% 305M 0s 2024-09-12T00:41:30.266 INFO:teuthology.orchestra.run.smithi138.stderr: 70250K .......... .......... .......... .......... .......... 75% 223M 0s 2024-09-12T00:41:30.266 INFO:teuthology.orchestra.run.smithi138.stderr: 70300K .......... .......... .......... .......... .......... 75% 245M 0s 2024-09-12T00:41:30.266 INFO:teuthology.orchestra.run.smithi138.stderr: 70350K .......... .......... .......... .......... .......... 75% 320M 0s 2024-09-12T00:41:30.266 INFO:teuthology.orchestra.run.smithi138.stderr: 70400K .......... .......... .......... .......... .......... 75% 230M 0s 2024-09-12T00:41:30.266 INFO:teuthology.orchestra.run.smithi138.stderr: 70450K .......... .......... .......... .......... .......... 75% 272M 0s 2024-09-12T00:41:30.266 INFO:teuthology.orchestra.run.smithi138.stderr: 70500K .......... .......... .......... .......... .......... 75% 372M 0s 2024-09-12T00:41:30.266 INFO:teuthology.orchestra.run.smithi138.stderr: 70550K .......... .......... .......... .......... .......... 75% 341M 0s 2024-09-12T00:41:30.266 INFO:teuthology.orchestra.run.smithi138.stderr: 70600K .......... .......... .......... .......... .......... 76% 310M 0s 2024-09-12T00:41:30.266 INFO:teuthology.orchestra.run.smithi138.stderr: 70650K .......... .......... .......... .......... .......... 76% 244M 0s 2024-09-12T00:41:30.266 INFO:teuthology.orchestra.run.smithi138.stderr: 70700K .......... .......... .......... .......... .......... 76% 374M 0s 2024-09-12T00:41:30.266 INFO:teuthology.orchestra.run.smithi138.stderr: 70750K .......... .......... .......... .......... .......... 76% 386M 0s 2024-09-12T00:41:30.266 INFO:teuthology.orchestra.run.smithi138.stderr: 70800K .......... .......... .......... .......... .......... 76% 111M 0s 2024-09-12T00:41:30.266 INFO:teuthology.orchestra.run.smithi138.stderr: 70850K .......... .......... .......... .......... .......... 76% 233M 0s 2024-09-12T00:41:30.266 INFO:teuthology.orchestra.run.smithi138.stderr: 70900K .......... .......... .......... .......... .......... 76% 317M 0s 2024-09-12T00:41:30.267 INFO:teuthology.orchestra.run.smithi138.stderr: 70950K .......... .......... .......... .......... .......... 76% 111M 0s 2024-09-12T00:41:30.267 INFO:teuthology.orchestra.run.smithi138.stderr: 71000K .......... .......... .......... .......... .......... 76% 308M 0s 2024-09-12T00:41:30.267 INFO:teuthology.orchestra.run.smithi138.stderr: 71050K .......... .......... .......... .......... .......... 76% 220M 0s 2024-09-12T00:41:30.267 INFO:teuthology.orchestra.run.smithi138.stderr: 71100K .......... .......... .......... .......... .......... 76% 384M 0s 2024-09-12T00:41:30.267 INFO:teuthology.orchestra.run.smithi138.stderr: 71150K .......... .......... .......... .......... .......... 76% 349M 0s 2024-09-12T00:41:30.267 INFO:teuthology.orchestra.run.smithi138.stderr: 71200K .......... .......... .......... .......... .......... 76% 73.6M 0s 2024-09-12T00:41:30.267 INFO:teuthology.orchestra.run.smithi138.stderr: 71250K .......... .......... .......... .......... .......... 76% 241M 0s 2024-09-12T00:41:30.267 INFO:teuthology.orchestra.run.smithi138.stderr: 71300K .......... .......... .......... .......... .......... 76% 254M 0s 2024-09-12T00:41:30.267 INFO:teuthology.orchestra.run.smithi138.stderr: 71350K .......... .......... .......... .......... .......... 76% 296M 0s 2024-09-12T00:41:30.267 INFO:teuthology.orchestra.run.smithi138.stderr: 71400K .......... .......... .......... .......... .......... 76% 385M 0s 2024-09-12T00:41:30.267 INFO:teuthology.orchestra.run.smithi138.stderr: 71450K .......... .......... .......... .......... .......... 76% 327M 0s 2024-09-12T00:41:30.267 INFO:teuthology.orchestra.run.smithi138.stderr: 71500K .......... .......... .......... .......... .......... 77% 231M 0s 2024-09-12T00:41:30.267 INFO:teuthology.orchestra.run.smithi138.stderr: 71550K .......... .......... .......... .......... .......... 77% 258M 0s 2024-09-12T00:41:30.268 INFO:teuthology.orchestra.run.smithi138.stderr: 71600K .......... .......... .......... .......... .......... 77% 383M 0s 2024-09-12T00:41:30.268 INFO:teuthology.orchestra.run.smithi138.stderr: 71650K .......... .......... .......... .......... .......... 77% 132M 0s 2024-09-12T00:41:30.268 INFO:teuthology.orchestra.run.smithi138.stderr: 71700K .......... .......... .......... .......... .......... 77% 261M 0s 2024-09-12T00:41:30.268 INFO:teuthology.orchestra.run.smithi138.stderr: 71750K .......... .......... .......... .......... .......... 77% 275M 0s 2024-09-12T00:41:30.268 INFO:teuthology.orchestra.run.smithi138.stderr: 71800K .......... .......... .......... .......... .......... 77% 240M 0s 2024-09-12T00:41:30.268 INFO:teuthology.orchestra.run.smithi138.stderr: 71850K .......... .......... .......... .......... .......... 77% 286M 0s 2024-09-12T00:41:30.268 INFO:teuthology.orchestra.run.smithi138.stderr: 71900K .......... .......... .......... .......... .......... 77% 382M 0s 2024-09-12T00:41:30.268 INFO:teuthology.orchestra.run.smithi138.stderr: 71950K .......... .......... .......... .......... .......... 77% 323M 0s 2024-09-12T00:41:30.268 INFO:teuthology.orchestra.run.smithi138.stderr: 72000K .......... .......... .......... .......... .......... 77% 121M 0s 2024-09-12T00:41:30.268 INFO:teuthology.orchestra.run.smithi138.stderr: 72050K .......... .......... .......... .......... .......... 77% 232M 0s 2024-09-12T00:41:30.268 INFO:teuthology.orchestra.run.smithi138.stderr: 72100K .......... .......... .......... .......... .......... 77% 230M 0s 2024-09-12T00:41:30.268 INFO:teuthology.orchestra.run.smithi138.stderr: 72150K .......... .......... .......... .......... .......... 77% 221M 0s 2024-09-12T00:41:30.268 INFO:teuthology.orchestra.run.smithi138.stderr: 72200K .......... .......... .......... .......... .......... 77% 334M 0s 2024-09-12T00:41:30.269 INFO:teuthology.orchestra.run.smithi138.stderr: 72250K .......... .......... .......... .......... .......... 77% 361M 0s 2024-09-12T00:41:30.269 INFO:teuthology.orchestra.run.smithi138.stderr: 72300K .......... .......... .......... .......... .......... 77% 258M 0s 2024-09-12T00:41:30.269 INFO:teuthology.orchestra.run.smithi138.stderr: 72350K .......... .......... .......... .......... .......... 77% 237M 0s 2024-09-12T00:41:30.269 INFO:teuthology.orchestra.run.smithi138.stderr: 72400K .......... .......... .......... .......... .......... 77% 262M 0s 2024-09-12T00:41:30.269 INFO:teuthology.orchestra.run.smithi138.stderr: 72450K .......... .......... .......... .......... .......... 78% 362M 0s 2024-09-12T00:41:30.269 INFO:teuthology.orchestra.run.smithi138.stderr: 72500K .......... .......... .......... .......... .......... 78% 259M 0s 2024-09-12T00:41:30.269 INFO:teuthology.orchestra.run.smithi138.stderr: 72550K .......... .......... .......... .......... .......... 78% 218M 0s 2024-09-12T00:41:30.269 INFO:teuthology.orchestra.run.smithi138.stderr: 72600K .......... .......... .......... .......... .......... 78% 354M 0s 2024-09-12T00:41:30.269 INFO:teuthology.orchestra.run.smithi138.stderr: 72650K .......... .......... .......... .......... .......... 78% 194M 0s 2024-09-12T00:41:30.269 INFO:teuthology.orchestra.run.smithi138.stderr: 72700K .......... .......... .......... .......... .......... 78% 299M 0s 2024-09-12T00:41:30.269 INFO:teuthology.orchestra.run.smithi138.stderr: 72750K .......... .......... .......... .......... .......... 78% 124M 0s 2024-09-12T00:41:30.269 INFO:teuthology.orchestra.run.smithi138.stderr: 72800K .......... .......... .......... .......... .......... 78% 306M 0s 2024-09-12T00:41:30.269 INFO:teuthology.orchestra.run.smithi138.stderr: 72850K .......... .......... .......... .......... .......... 78% 231M 0s 2024-09-12T00:41:30.269 INFO:teuthology.orchestra.run.smithi138.stderr: 72900K .......... .......... .......... .......... .......... 78% 193M 0s 2024-09-12T00:41:30.270 INFO:teuthology.orchestra.run.smithi138.stderr: 72950K .......... .......... .......... .......... .......... 78% 223M 0s 2024-09-12T00:41:30.270 INFO:teuthology.orchestra.run.smithi138.stderr: 73000K .......... .......... .......... .......... .......... 78% 383M 0s 2024-09-12T00:41:30.270 INFO:teuthology.orchestra.run.smithi138.stderr: 73050K .......... .......... .......... .......... .......... 78% 179M 0s 2024-09-12T00:41:30.270 INFO:teuthology.orchestra.run.smithi138.stderr: 73100K .......... .......... .......... .......... .......... 78% 299M 0s 2024-09-12T00:41:30.270 INFO:teuthology.orchestra.run.smithi138.stderr: 73150K .......... .......... .......... .......... .......... 78% 205M 0s 2024-09-12T00:41:30.270 INFO:teuthology.orchestra.run.smithi138.stderr: 73200K .......... .......... .......... .......... .......... 78% 290M 0s 2024-09-12T00:41:30.270 INFO:teuthology.orchestra.run.smithi138.stderr: 73250K .......... .......... .......... .......... .......... 78% 239M 0s 2024-09-12T00:41:30.270 INFO:teuthology.orchestra.run.smithi138.stderr: 73300K .......... .......... .......... .......... .......... 78% 219M 0s 2024-09-12T00:41:30.270 INFO:teuthology.orchestra.run.smithi138.stderr: 73350K .......... .......... .......... .......... .......... 79% 263M 0s 2024-09-12T00:41:30.270 INFO:teuthology.orchestra.run.smithi138.stderr: 73400K .......... .......... .......... .......... .......... 79% 238M 0s 2024-09-12T00:41:30.270 INFO:teuthology.orchestra.run.smithi138.stderr: 73450K .......... .......... .......... .......... .......... 79% 267M 0s 2024-09-12T00:41:30.270 INFO:teuthology.orchestra.run.smithi138.stderr: 73500K .......... .......... .......... .......... .......... 79% 242M 0s 2024-09-12T00:41:30.270 INFO:teuthology.orchestra.run.smithi138.stderr: 73550K .......... .......... .......... .......... .......... 79% 275M 0s 2024-09-12T00:41:30.270 INFO:teuthology.orchestra.run.smithi138.stderr: 73600K .......... .......... .......... .......... .......... 79% 381M 0s 2024-09-12T00:41:30.271 INFO:teuthology.orchestra.run.smithi138.stderr: 73650K .......... .......... .......... .......... .......... 79% 190M 0s 2024-09-12T00:41:30.271 INFO:teuthology.orchestra.run.smithi138.stderr: 73700K .......... .......... .......... .......... .......... 79% 185M 0s 2024-09-12T00:41:30.271 INFO:teuthology.orchestra.run.smithi138.stderr: 73750K .......... .......... .......... .......... .......... 79% 233M 0s 2024-09-12T00:41:30.271 INFO:teuthology.orchestra.run.smithi138.stderr: 73800K .......... .......... .......... .......... .......... 79% 317M 0s 2024-09-12T00:41:30.271 INFO:teuthology.orchestra.run.smithi138.stderr: 73850K .......... .......... .......... .......... .......... 79% 214M 0s 2024-09-12T00:41:30.271 INFO:teuthology.orchestra.run.smithi138.stderr: 73900K .......... .......... .......... .......... .......... 79% 288M 0s 2024-09-12T00:41:30.271 INFO:teuthology.orchestra.run.smithi138.stderr: 73950K .......... .......... .......... .......... .......... 79% 284M 0s 2024-09-12T00:41:30.271 INFO:teuthology.orchestra.run.smithi138.stderr: 74000K .......... .......... .......... .......... .......... 79% 304M 0s 2024-09-12T00:41:30.271 INFO:teuthology.orchestra.run.smithi138.stderr: 74050K .......... .......... .......... .......... .......... 79% 318M 0s 2024-09-12T00:41:30.271 INFO:teuthology.orchestra.run.smithi138.stderr: 74100K .......... .......... .......... .......... .......... 79% 72.5M 0s 2024-09-12T00:41:30.271 INFO:teuthology.orchestra.run.smithi138.stderr: 74150K .......... .......... .......... .......... .......... 79% 274M 0s 2024-09-12T00:41:30.271 INFO:teuthology.orchestra.run.smithi138.stderr: 74200K .......... .......... .......... .......... .......... 79% 320M 0s 2024-09-12T00:41:30.271 INFO:teuthology.orchestra.run.smithi138.stderr: 74250K .......... .......... .......... .......... .......... 79% 325M 0s 2024-09-12T00:41:30.272 INFO:teuthology.orchestra.run.smithi138.stderr: 74300K .......... .......... .......... .......... .......... 80% 296M 0s 2024-09-12T00:41:30.272 INFO:teuthology.orchestra.run.smithi138.stderr: 74350K .......... .......... .......... .......... .......... 80% 83.0M 0s 2024-09-12T00:41:30.272 INFO:teuthology.orchestra.run.smithi138.stderr: 74400K .......... .......... .......... .......... .......... 80% 243M 0s 2024-09-12T00:41:30.272 INFO:teuthology.orchestra.run.smithi138.stderr: 74450K .......... .......... .......... .......... .......... 80% 248M 0s 2024-09-12T00:41:30.272 INFO:teuthology.orchestra.run.smithi138.stderr: 74500K .......... .......... .......... .......... .......... 80% 299M 0s 2024-09-12T00:41:30.272 INFO:teuthology.orchestra.run.smithi138.stderr: 74550K .......... .......... .......... .......... .......... 80% 252M 0s 2024-09-12T00:41:30.272 INFO:teuthology.orchestra.run.smithi138.stderr: 74600K .......... .......... .......... .......... .......... 80% 221M 0s 2024-09-12T00:41:30.272 INFO:teuthology.orchestra.run.smithi138.stderr: 74650K .......... .......... .......... .......... .......... 80% 388M 0s 2024-09-12T00:41:30.272 INFO:teuthology.orchestra.run.smithi138.stderr: 74700K .......... .......... .......... .......... .......... 80% 243M 0s 2024-09-12T00:41:30.272 INFO:teuthology.orchestra.run.smithi138.stderr: 74750K .......... .......... .......... .......... .......... 80% 255M 0s 2024-09-12T00:41:30.272 INFO:teuthology.orchestra.run.smithi138.stderr: 74800K .......... .......... .......... .......... .......... 80% 394M 0s 2024-09-12T00:41:30.272 INFO:teuthology.orchestra.run.smithi138.stderr: 74850K .......... .......... .......... .......... .......... 80% 390M 0s 2024-09-12T00:41:30.272 INFO:teuthology.orchestra.run.smithi138.stderr: 74900K .......... .......... .......... .......... .......... 80% 390M 0s 2024-09-12T00:41:30.273 INFO:teuthology.orchestra.run.smithi138.stderr: 74950K .......... .......... .......... .......... .......... 80% 127M 0s 2024-09-12T00:41:30.273 INFO:teuthology.orchestra.run.smithi138.stderr: 75000K .......... .......... .......... .......... .......... 80% 241M 0s 2024-09-12T00:41:30.273 INFO:teuthology.orchestra.run.smithi138.stderr: 75050K .......... .......... .......... .......... .......... 80% 236M 0s 2024-09-12T00:41:30.273 INFO:teuthology.orchestra.run.smithi138.stderr: 75100K .......... .......... .......... .......... .......... 80% 377M 0s 2024-09-12T00:41:30.273 INFO:teuthology.orchestra.run.smithi138.stderr: 75150K .......... .......... .......... .......... .......... 80% 328M 0s 2024-09-12T00:41:30.273 INFO:teuthology.orchestra.run.smithi138.stderr: 75200K .......... .......... .......... .......... .......... 81% 229M 0s 2024-09-12T00:41:30.273 INFO:teuthology.orchestra.run.smithi138.stderr: 75250K .......... .......... .......... .......... .......... 81% 227M 0s 2024-09-12T00:41:30.273 INFO:teuthology.orchestra.run.smithi138.stderr: 75300K .......... .......... .......... .......... .......... 81% 372M 0s 2024-09-12T00:41:30.273 INFO:teuthology.orchestra.run.smithi138.stderr: 75350K .......... .......... .......... .......... .......... 81% 225M 0s 2024-09-12T00:41:30.273 INFO:teuthology.orchestra.run.smithi138.stderr: 75400K .......... .......... .......... .......... .......... 81% 325M 0s 2024-09-12T00:41:30.273 INFO:teuthology.orchestra.run.smithi138.stderr: 75450K .......... .......... .......... .......... .......... 81% 395M 0s 2024-09-12T00:41:30.273 INFO:teuthology.orchestra.run.smithi138.stderr: 75500K .......... .......... .......... .......... .......... 81% 372M 0s 2024-09-12T00:41:30.273 INFO:teuthology.orchestra.run.smithi138.stderr: 75550K .......... .......... .......... .......... .......... 81% 212M 0s 2024-09-12T00:41:30.274 INFO:teuthology.orchestra.run.smithi138.stderr: 75600K .......... .......... .......... .......... .......... 81% 276M 0s 2024-09-12T00:41:30.274 INFO:teuthology.orchestra.run.smithi138.stderr: 75650K .......... .......... .......... .......... .......... 81% 367M 0s 2024-09-12T00:41:30.274 INFO:teuthology.orchestra.run.smithi138.stderr: 75700K .......... .......... .......... .......... .......... 81% 152M 0s 2024-09-12T00:41:30.274 INFO:teuthology.orchestra.run.smithi138.stderr: 75750K .......... .......... .......... .......... .......... 81% 242M 0s 2024-09-12T00:41:30.274 INFO:teuthology.orchestra.run.smithi138.stderr: 75800K .......... .......... .......... .......... .......... 81% 408M 0s 2024-09-12T00:41:30.274 INFO:teuthology.orchestra.run.smithi138.stderr: 75850K .......... .......... .......... .......... .......... 81% 15.7M 0s 2024-09-12T00:41:30.274 INFO:teuthology.orchestra.run.smithi138.stderr: 75900K .......... .......... .......... .......... .......... 81% 252M 0s 2024-09-12T00:41:30.274 INFO:teuthology.orchestra.run.smithi138.stderr: 75950K .......... .......... .......... .......... .......... 81% 200M 0s 2024-09-12T00:41:30.274 INFO:teuthology.orchestra.run.smithi138.stderr: 76000K .......... .......... .......... .......... .......... 81% 236M 0s 2024-09-12T00:41:30.274 INFO:teuthology.orchestra.run.smithi138.stderr: 76050K .......... .......... .......... .......... .......... 81% 276M 0s 2024-09-12T00:41:30.274 INFO:teuthology.orchestra.run.smithi138.stderr: 76100K .......... .......... .......... .......... .......... 81% 308M 0s 2024-09-12T00:41:30.274 INFO:teuthology.orchestra.run.smithi138.stderr: 76150K .......... .......... .......... .......... .......... 82% 230M 0s 2024-09-12T00:41:30.274 INFO:teuthology.orchestra.run.smithi138.stderr: 76200K .......... .......... .......... .......... .......... 82% 254M 0s 2024-09-12T00:41:30.275 INFO:teuthology.orchestra.run.smithi138.stderr: 76250K .......... .......... .......... .......... .......... 82% 257M 0s 2024-09-12T00:41:30.275 INFO:teuthology.orchestra.run.smithi138.stderr: 76300K .......... .......... .......... .......... .......... 82% 258M 0s 2024-09-12T00:41:30.275 INFO:teuthology.orchestra.run.smithi138.stderr: 76350K .......... .......... .......... .......... .......... 82% 301M 0s 2024-09-12T00:41:30.275 INFO:teuthology.orchestra.run.smithi138.stderr: 76400K .......... .......... .......... .......... .......... 82% 302M 0s 2024-09-12T00:41:30.275 INFO:teuthology.orchestra.run.smithi138.stderr: 76450K .......... .......... .......... .......... .......... 82% 235M 0s 2024-09-12T00:41:30.275 INFO:teuthology.orchestra.run.smithi138.stderr: 76500K .......... .......... .......... .......... .......... 82% 304M 0s 2024-09-12T00:41:30.275 INFO:teuthology.orchestra.run.smithi138.stderr: 76550K .......... .......... .......... .......... .......... 82% 215M 0s 2024-09-12T00:41:30.275 INFO:teuthology.orchestra.run.smithi138.stderr: 76600K .......... .......... .......... .......... .......... 82% 354M 0s 2024-09-12T00:41:30.275 INFO:teuthology.orchestra.run.smithi138.stderr: 76650K .......... .......... .......... .......... .......... 82% 335M 0s 2024-09-12T00:41:30.275 INFO:teuthology.orchestra.run.smithi138.stderr: 76700K .......... .......... .......... .......... .......... 82% 318M 0s 2024-09-12T00:41:30.275 INFO:teuthology.orchestra.run.smithi138.stderr: 76750K .......... .......... .......... .......... .......... 82% 238M 0s 2024-09-12T00:41:30.275 INFO:teuthology.orchestra.run.smithi138.stderr: 76800K .......... .......... .......... .......... .......... 82% 298M 0s 2024-09-12T00:41:30.276 INFO:teuthology.orchestra.run.smithi138.stderr: 76850K .......... .......... .......... .......... .......... 82% 278M 0s 2024-09-12T00:41:30.276 INFO:teuthology.orchestra.run.smithi138.stderr: 76900K .......... .......... .......... .......... .......... 82% 339M 0s 2024-09-12T00:41:30.276 INFO:teuthology.orchestra.run.smithi138.stderr: 76950K .......... .......... .......... .......... .......... 82% 271M 0s 2024-09-12T00:41:30.276 INFO:teuthology.orchestra.run.smithi138.stderr: 77000K .......... .......... .......... .......... .......... 82% 293M 0s 2024-09-12T00:41:30.276 INFO:teuthology.orchestra.run.smithi138.stderr: 77050K .......... .......... .......... .......... .......... 82% 256M 0s 2024-09-12T00:41:30.276 INFO:teuthology.orchestra.run.smithi138.stderr: 77100K .......... .......... .......... .......... .......... 83% 232M 0s 2024-09-12T00:41:30.276 INFO:teuthology.orchestra.run.smithi138.stderr: 77150K .......... .......... .......... .......... .......... 83% 263M 0s 2024-09-12T00:41:30.276 INFO:teuthology.orchestra.run.smithi138.stderr: 77200K .......... .......... .......... .......... .......... 83% 303M 0s 2024-09-12T00:41:30.276 INFO:teuthology.orchestra.run.smithi138.stderr: 77250K .......... .......... .......... .......... .......... 83% 253M 0s 2024-09-12T00:41:30.276 INFO:teuthology.orchestra.run.smithi138.stderr: 77300K .......... .......... .......... .......... .......... 83% 372M 0s 2024-09-12T00:41:30.276 INFO:teuthology.orchestra.run.smithi138.stderr: 77350K .......... .......... .......... .......... .......... 83% 347M 0s 2024-09-12T00:41:30.276 INFO:teuthology.orchestra.run.smithi138.stderr: 77400K .......... .......... .......... .......... .......... 83% 391M 0s 2024-09-12T00:41:30.277 INFO:teuthology.orchestra.run.smithi138.stderr: 77450K .......... .......... .......... .......... .......... 83% 390M 0s 2024-09-12T00:41:30.277 INFO:teuthology.orchestra.run.smithi138.stderr: 77500K .......... .......... .......... .......... .......... 83% 271M 0s 2024-09-12T00:41:30.277 INFO:teuthology.orchestra.run.smithi138.stderr: 77550K .......... .......... .......... .......... .......... 83% 205M 0s 2024-09-12T00:41:30.277 INFO:teuthology.orchestra.run.smithi138.stderr: 77600K .......... .......... .......... .......... .......... 83% 257M 0s 2024-09-12T00:41:30.277 INFO:teuthology.orchestra.run.smithi138.stderr: 77650K .......... .......... .......... .......... .......... 83% 306M 0s 2024-09-12T00:41:30.277 INFO:teuthology.orchestra.run.smithi138.stderr: 77700K .......... .......... .......... .......... .......... 83% 349M 0s 2024-09-12T00:41:30.277 INFO:teuthology.orchestra.run.smithi138.stderr: 77750K .......... .......... .......... .......... .......... 83% 325M 0s 2024-09-12T00:41:30.277 INFO:teuthology.orchestra.run.smithi138.stderr: 77800K .......... .......... .......... .......... .......... 83% 274M 0s 2024-09-12T00:41:30.277 INFO:teuthology.orchestra.run.smithi138.stderr: 77850K .......... .......... .......... .......... .......... 83% 268M 0s 2024-09-12T00:41:30.277 INFO:teuthology.orchestra.run.smithi138.stderr: 77900K .......... .......... .......... .......... .......... 83% 307M 0s 2024-09-12T00:41:30.277 INFO:teuthology.orchestra.run.smithi138.stderr: 77950K .......... .......... .......... .......... .......... 83% 200M 0s 2024-09-12T00:41:30.277 INFO:teuthology.orchestra.run.smithi138.stderr: 78000K .......... .......... .......... .......... .......... 84% 391M 0s 2024-09-12T00:41:30.277 INFO:teuthology.orchestra.run.smithi138.stderr: 78050K .......... .......... .......... .......... .......... 84% 398M 0s 2024-09-12T00:41:30.278 INFO:teuthology.orchestra.run.smithi138.stderr: 78100K .......... .......... .......... .......... .......... 84% 247M 0s 2024-09-12T00:41:30.278 INFO:teuthology.orchestra.run.smithi138.stderr: 78150K .......... .......... .......... .......... .......... 84% 306M 0s 2024-09-12T00:41:30.278 INFO:teuthology.orchestra.run.smithi138.stderr: 78200K .......... .......... .......... .......... .......... 84% 315M 0s 2024-09-12T00:41:30.278 INFO:teuthology.orchestra.run.smithi138.stderr: 78250K .......... .......... .......... .......... .......... 84% 275M 0s 2024-09-12T00:41:30.278 INFO:teuthology.orchestra.run.smithi138.stderr: 78300K .......... .......... .......... .......... .......... 84% 256M 0s 2024-09-12T00:41:30.278 INFO:teuthology.orchestra.run.smithi138.stderr: 78350K .......... .......... .......... .......... .......... 84% 280M 0s 2024-09-12T00:41:30.278 INFO:teuthology.orchestra.run.smithi138.stderr: 78400K .......... .......... .......... .......... .......... 84% 401M 0s 2024-09-12T00:41:30.278 INFO:teuthology.orchestra.run.smithi138.stderr: 78450K .......... .......... .......... .......... .......... 84% 407M 0s 2024-09-12T00:41:30.278 INFO:teuthology.orchestra.run.smithi138.stderr: 78500K .......... .......... .......... .......... .......... 84% 402M 0s 2024-09-12T00:41:30.278 INFO:teuthology.orchestra.run.smithi138.stderr: 78550K .......... .......... .......... .......... .......... 84% 368M 0s 2024-09-12T00:41:30.278 INFO:teuthology.orchestra.run.smithi138.stderr: 78600K .......... .......... .......... .......... .......... 84% 396M 0s 2024-09-12T00:41:30.278 INFO:teuthology.orchestra.run.smithi138.stderr: 78650K .......... .......... .......... .......... .......... 84% 396M 0s 2024-09-12T00:41:30.278 INFO:teuthology.orchestra.run.smithi138.stderr: 78700K .......... .......... .......... .......... .......... 84% 407M 0s 2024-09-12T00:41:30.279 INFO:teuthology.orchestra.run.smithi138.stderr: 78750K .......... .......... .......... .......... .......... 84% 13.1M 0s 2024-09-12T00:41:30.279 INFO:teuthology.orchestra.run.smithi138.stderr: 78800K .......... .......... .......... .......... .......... 84% 238M 0s 2024-09-12T00:41:30.279 INFO:teuthology.orchestra.run.smithi138.stderr: 78850K .......... .......... .......... .......... .......... 84% 265M 0s 2024-09-12T00:41:30.279 INFO:teuthology.orchestra.run.smithi138.stderr: 78900K .......... .......... .......... .......... .......... 84% 334M 0s 2024-09-12T00:41:30.279 INFO:teuthology.orchestra.run.smithi138.stderr: 78950K .......... .......... .......... .......... .......... 85% 250M 0s 2024-09-12T00:41:30.279 INFO:teuthology.orchestra.run.smithi138.stderr: 79000K .......... .......... .......... .......... .......... 85% 248M 0s 2024-09-12T00:41:30.279 INFO:teuthology.orchestra.run.smithi138.stderr: 79050K .......... .......... .......... .......... .......... 85% 294M 0s 2024-09-12T00:41:30.279 INFO:teuthology.orchestra.run.smithi138.stderr: 79100K .......... .......... .......... .......... .......... 85% 283M 0s 2024-09-12T00:41:30.279 INFO:teuthology.orchestra.run.smithi138.stderr: 79150K .......... .......... .......... .......... .......... 85% 254M 0s 2024-09-12T00:41:30.279 INFO:teuthology.orchestra.run.smithi138.stderr: 79200K .......... .......... .......... .......... .......... 85% 266M 0s 2024-09-12T00:41:30.279 INFO:teuthology.orchestra.run.smithi138.stderr: 79250K .......... .......... .......... .......... .......... 85% 310M 0s 2024-09-12T00:41:30.279 INFO:teuthology.orchestra.run.smithi138.stderr: 79300K .......... .......... .......... .......... .......... 85% 201M 0s 2024-09-12T00:41:30.279 INFO:teuthology.orchestra.run.smithi138.stderr: 79350K .......... .......... .......... .......... .......... 85% 239M 0s 2024-09-12T00:41:30.280 INFO:teuthology.orchestra.run.smithi138.stderr: 79400K .......... .......... .......... .......... .......... 85% 236M 0s 2024-09-12T00:41:30.280 INFO:teuthology.orchestra.run.smithi138.stderr: 79450K .......... .......... .......... .......... .......... 85% 297M 0s 2024-09-12T00:41:30.280 INFO:teuthology.orchestra.run.smithi138.stderr: 79500K .......... .......... .......... .......... .......... 85% 258M 0s 2024-09-12T00:41:30.280 INFO:teuthology.orchestra.run.smithi138.stderr: 79550K .......... .......... .......... .......... .......... 85% 242M 0s 2024-09-12T00:41:30.280 INFO:teuthology.orchestra.run.smithi138.stderr: 79600K .......... .......... .......... .......... .......... 85% 281M 0s 2024-09-12T00:41:30.280 INFO:teuthology.orchestra.run.smithi138.stderr: 79650K .......... .......... .......... .......... .......... 85% 236M 0s 2024-09-12T00:41:30.280 INFO:teuthology.orchestra.run.smithi138.stderr: 79700K .......... .......... .......... .......... .......... 85% 270M 0s 2024-09-12T00:41:30.280 INFO:teuthology.orchestra.run.smithi138.stderr: 79750K .......... .......... .......... .......... .......... 85% 303M 0s 2024-09-12T00:41:30.280 INFO:teuthology.orchestra.run.smithi138.stderr: 79800K .......... .......... .......... .......... .......... 85% 292M 0s 2024-09-12T00:41:30.280 INFO:teuthology.orchestra.run.smithi138.stderr: 79850K .......... .......... .......... .......... .......... 86% 259M 0s 2024-09-12T00:41:30.280 INFO:teuthology.orchestra.run.smithi138.stderr: 79900K .......... .......... .......... .......... .......... 86% 341M 0s 2024-09-12T00:41:30.280 INFO:teuthology.orchestra.run.smithi138.stderr: 79950K .......... .......... .......... .......... .......... 86% 397M 0s 2024-09-12T00:41:30.281 INFO:teuthology.orchestra.run.smithi138.stderr: 80000K .......... .......... .......... .......... .......... 86% 315M 0s 2024-09-12T00:41:30.281 INFO:teuthology.orchestra.run.smithi138.stderr: 80050K .......... .......... .......... .......... .......... 86% 247M 0s 2024-09-12T00:41:30.281 INFO:teuthology.orchestra.run.smithi138.stderr: 80100K .......... .......... .......... .......... .......... 86% 256M 0s 2024-09-12T00:41:30.281 INFO:teuthology.orchestra.run.smithi138.stderr: 80150K .......... .......... .......... .......... .......... 86% 338M 0s 2024-09-12T00:41:30.281 INFO:teuthology.orchestra.run.smithi138.stderr: 80200K .......... .......... .......... .......... .......... 86% 307M 0s 2024-09-12T00:41:30.281 INFO:teuthology.orchestra.run.smithi138.stderr: 80250K .......... .......... .......... .......... .......... 86% 194M 0s 2024-09-12T00:41:30.281 INFO:teuthology.orchestra.run.smithi138.stderr: 80300K .......... .......... .......... .......... .......... 86% 283M 0s 2024-09-12T00:41:30.281 INFO:teuthology.orchestra.run.smithi138.stderr: 80350K .......... .......... .......... .......... .......... 86% 339M 0s 2024-09-12T00:41:30.281 INFO:teuthology.orchestra.run.smithi138.stderr: 80400K .......... .......... .......... .......... .......... 86% 239M 0s 2024-09-12T00:41:30.281 INFO:teuthology.orchestra.run.smithi138.stderr: 80450K .......... .......... .......... .......... .......... 86% 208M 0s 2024-09-12T00:41:30.281 INFO:teuthology.orchestra.run.smithi138.stderr: 80500K .......... .......... .......... .......... .......... 86% 304M 0s 2024-09-12T00:41:30.281 INFO:teuthology.orchestra.run.smithi138.stderr: 80550K .......... .......... .......... .......... .......... 86% 261M 0s 2024-09-12T00:41:30.281 INFO:teuthology.orchestra.run.smithi138.stderr: 80600K .......... .......... .......... .......... .......... 86% 266M 0s 2024-09-12T00:41:30.282 INFO:teuthology.orchestra.run.smithi138.stderr: 80650K .......... .......... .......... .......... .......... 86% 265M 0s 2024-09-12T00:41:30.282 INFO:teuthology.orchestra.run.smithi138.stderr: 80700K .......... .......... .......... .......... .......... 86% 275M 0s 2024-09-12T00:41:30.282 INFO:teuthology.orchestra.run.smithi138.stderr: 80750K .......... .......... .......... .......... .......... 86% 286M 0s 2024-09-12T00:41:30.282 INFO:teuthology.orchestra.run.smithi138.stderr: 80800K .......... .......... .......... .......... .......... 87% 345M 0s 2024-09-12T00:41:30.282 INFO:teuthology.orchestra.run.smithi138.stderr: 80850K .......... .......... .......... .......... .......... 87% 287M 0s 2024-09-12T00:41:30.282 INFO:teuthology.orchestra.run.smithi138.stderr: 80900K .......... .......... .......... .......... .......... 87% 258M 0s 2024-09-12T00:41:30.282 INFO:teuthology.orchestra.run.smithi138.stderr: 80950K .......... .......... .......... .......... .......... 87% 251M 0s 2024-09-12T00:41:30.282 INFO:teuthology.orchestra.run.smithi138.stderr: 81000K .......... .......... .......... .......... .......... 87% 340M 0s 2024-09-12T00:41:30.282 INFO:teuthology.orchestra.run.smithi138.stderr: 81050K .......... .......... .......... .......... .......... 87% 333M 0s 2024-09-12T00:41:30.282 INFO:teuthology.orchestra.run.smithi138.stderr: 81100K .......... .......... .......... .......... .......... 87% 400M 0s 2024-09-12T00:41:30.282 INFO:teuthology.orchestra.run.smithi138.stderr: 81150K .......... .......... .......... .......... .......... 87% 383M 0s 2024-09-12T00:41:30.282 INFO:teuthology.orchestra.run.smithi138.stderr: 81200K .......... .......... .......... .......... .......... 87% 403M 0s 2024-09-12T00:41:30.282 INFO:teuthology.orchestra.run.smithi138.stderr: 81250K .......... .......... .......... .......... .......... 87% 347M 0s 2024-09-12T00:41:30.282 INFO:teuthology.orchestra.run.smithi138.stderr: 81300K .......... .......... .......... .......... .......... 87% 399M 0s 2024-09-12T00:41:30.283 INFO:teuthology.orchestra.run.smithi138.stderr: 81350K .......... .......... .......... .......... .......... 87% 412M 0s 2024-09-12T00:41:30.283 INFO:teuthology.orchestra.run.smithi138.stderr: 81400K .......... .......... .......... .......... .......... 87% 395M 0s 2024-09-12T00:41:30.283 INFO:teuthology.orchestra.run.smithi138.stderr: 81450K .......... .......... .......... .......... .......... 87% 336M 0s 2024-09-12T00:41:30.283 INFO:teuthology.orchestra.run.smithi138.stderr: 81500K .......... .......... .......... .......... .......... 87% 13.7M 0s 2024-09-12T00:41:30.283 INFO:teuthology.orchestra.run.smithi138.stderr: 81550K .......... .......... .......... .......... .......... 87% 273M 0s 2024-09-12T00:41:30.283 INFO:teuthology.orchestra.run.smithi138.stderr: 81600K .......... .......... .......... .......... .......... 87% 242M 0s 2024-09-12T00:41:30.283 INFO:teuthology.orchestra.run.smithi138.stderr: 81650K .......... .......... .......... .......... .......... 87% 215M 0s 2024-09-12T00:41:30.283 INFO:teuthology.orchestra.run.smithi138.stderr: 81700K .......... .......... .......... .......... .......... 87% 229M 0s 2024-09-12T00:41:30.283 INFO:teuthology.orchestra.run.smithi138.stderr: 81750K .......... .......... .......... .......... .......... 88% 263M 0s 2024-09-12T00:41:30.283 INFO:teuthology.orchestra.run.smithi138.stderr: 81800K .......... .......... .......... .......... .......... 88% 291M 0s 2024-09-12T00:41:30.283 INFO:teuthology.orchestra.run.smithi138.stderr: 81850K .......... .......... .......... .......... .......... 88% 231M 0s 2024-09-12T00:41:30.283 INFO:teuthology.orchestra.run.smithi138.stderr: 81900K .......... .......... .......... .......... .......... 88% 268M 0s 2024-09-12T00:41:30.283 INFO:teuthology.orchestra.run.smithi138.stderr: 81950K .......... .......... .......... .......... .......... 88% 309M 0s 2024-09-12T00:41:30.284 INFO:teuthology.orchestra.run.smithi138.stderr: 82000K .......... .......... .......... .......... .......... 88% 219M 0s 2024-09-12T00:41:30.284 INFO:teuthology.orchestra.run.smithi138.stderr: 82050K .......... .......... .......... .......... .......... 88% 240M 0s 2024-09-12T00:41:30.284 INFO:teuthology.orchestra.run.smithi138.stderr: 82100K .......... .......... .......... .......... .......... 88% 291M 0s 2024-09-12T00:41:30.284 INFO:teuthology.orchestra.run.smithi138.stderr: 82150K .......... .......... .......... .......... .......... 88% 360M 0s 2024-09-12T00:41:30.284 INFO:teuthology.orchestra.run.smithi138.stderr: 82200K .......... .......... .......... .......... .......... 88% 413M 0s 2024-09-12T00:41:30.284 INFO:teuthology.orchestra.run.smithi138.stderr: 82250K .......... .......... .......... .......... .......... 88% 312M 0s 2024-09-12T00:41:30.284 INFO:teuthology.orchestra.run.smithi138.stderr: 82300K .......... .......... .......... .......... .......... 88% 254M 0s 2024-09-12T00:41:30.284 INFO:teuthology.orchestra.run.smithi138.stderr: 82350K .......... .......... .......... .......... .......... 88% 285M 0s 2024-09-12T00:41:30.284 INFO:teuthology.orchestra.run.smithi138.stderr: 82400K .......... .......... .......... .......... .......... 88% 270M 0s 2024-09-12T00:41:30.284 INFO:teuthology.orchestra.run.smithi138.stderr: 82450K .......... .......... .......... .......... .......... 88% 294M 0s 2024-09-12T00:41:30.284 INFO:teuthology.orchestra.run.smithi138.stderr: 82500K .......... .......... .......... .......... .......... 88% 413M 0s 2024-09-12T00:41:30.284 INFO:teuthology.orchestra.run.smithi138.stderr: 82550K .......... .......... .......... .......... .......... 88% 258M 0s 2024-09-12T00:41:30.284 INFO:teuthology.orchestra.run.smithi138.stderr: 82600K .......... .......... .......... .......... .......... 88% 269M 0s 2024-09-12T00:41:30.284 INFO:teuthology.orchestra.run.smithi138.stderr: 82650K .......... .......... .......... .......... .......... 89% 395M 0s 2024-09-12T00:41:30.285 INFO:teuthology.orchestra.run.smithi138.stderr: 82700K .......... .......... .......... .......... .......... 89% 366M 0s 2024-09-12T00:41:30.285 INFO:teuthology.orchestra.run.smithi138.stderr: 82750K .......... .......... .......... .......... .......... 89% 374M 0s 2024-09-12T00:41:30.285 INFO:teuthology.orchestra.run.smithi138.stderr: 82800K .......... .......... .......... .......... .......... 89% 416M 0s 2024-09-12T00:41:30.285 INFO:teuthology.orchestra.run.smithi138.stderr: 82850K .......... .......... .......... .......... .......... 89% 406M 0s 2024-09-12T00:41:30.285 INFO:teuthology.orchestra.run.smithi138.stderr: 82900K .......... .......... .......... .......... .......... 89% 402M 0s 2024-09-12T00:41:30.285 INFO:teuthology.orchestra.run.smithi138.stderr: 82950K .......... .......... .......... .......... .......... 89% 373M 0s 2024-09-12T00:41:30.285 INFO:teuthology.orchestra.run.smithi138.stderr: 83000K .......... .......... .......... .......... .......... 89% 252M 0s 2024-09-12T00:41:30.285 INFO:teuthology.orchestra.run.smithi138.stderr: 83050K .......... .......... .......... .......... .......... 89% 250M 0s 2024-09-12T00:41:30.285 INFO:teuthology.orchestra.run.smithi138.stderr: 83100K .......... .......... .......... .......... .......... 89% 361M 0s 2024-09-12T00:41:30.285 INFO:teuthology.orchestra.run.smithi138.stderr: 83150K .......... .......... .......... .......... .......... 89% 236M 0s 2024-09-12T00:41:30.285 INFO:teuthology.orchestra.run.smithi138.stderr: 83200K .......... .......... .......... .......... .......... 89% 282M 0s 2024-09-12T00:41:30.285 INFO:teuthology.orchestra.run.smithi138.stderr: 83250K .......... .......... .......... .......... .......... 89% 272M 0s 2024-09-12T00:41:30.285 INFO:teuthology.orchestra.run.smithi138.stderr: 83300K .......... .......... .......... .......... .......... 89% 251M 0s 2024-09-12T00:41:30.286 INFO:teuthology.orchestra.run.smithi138.stderr: 83350K .......... .......... .......... .......... .......... 89% 261M 0s 2024-09-12T00:41:30.286 INFO:teuthology.orchestra.run.smithi138.stderr: 83400K .......... .......... .......... .......... .......... 89% 260M 0s 2024-09-12T00:41:30.286 INFO:teuthology.orchestra.run.smithi138.stderr: 83450K .......... .......... .......... .......... .......... 89% 271M 0s 2024-09-12T00:41:30.286 INFO:teuthology.orchestra.run.smithi138.stderr: 83500K .......... .......... .......... .......... .......... 89% 329M 0s 2024-09-12T00:41:30.286 INFO:teuthology.orchestra.run.smithi138.stderr: 83550K .......... .......... .......... .......... .......... 89% 243M 0s 2024-09-12T00:41:30.286 INFO:teuthology.orchestra.run.smithi138.stderr: 83600K .......... .......... .......... .......... .......... 90% 286M 0s 2024-09-12T00:41:30.286 INFO:teuthology.orchestra.run.smithi138.stderr: 83650K .......... .......... .......... .......... .......... 90% 381M 0s 2024-09-12T00:41:30.286 INFO:teuthology.orchestra.run.smithi138.stderr: 83700K .......... .......... .......... .......... .......... 90% 414M 0s 2024-09-12T00:41:30.286 INFO:teuthology.orchestra.run.smithi138.stderr: 83750K .......... .......... .......... .......... .......... 90% 377M 0s 2024-09-12T00:41:30.286 INFO:teuthology.orchestra.run.smithi138.stderr: 83800K .......... .......... .......... .......... .......... 90% 408M 0s 2024-09-12T00:41:30.286 INFO:teuthology.orchestra.run.smithi138.stderr: 83850K .......... .......... .......... .......... .......... 90% 408M 0s 2024-09-12T00:41:30.286 INFO:teuthology.orchestra.run.smithi138.stderr: 83900K .......... .......... .......... .......... .......... 90% 411M 0s 2024-09-12T00:41:30.286 INFO:teuthology.orchestra.run.smithi138.stderr: 83950K .......... .......... .......... .......... .......... 90% 331M 0s 2024-09-12T00:41:30.287 INFO:teuthology.orchestra.run.smithi138.stderr: 84000K .......... .......... .......... .......... .......... 90% 414M 0s 2024-09-12T00:41:30.287 INFO:teuthology.orchestra.run.smithi138.stderr: 84050K .......... .......... .......... .......... .......... 90% 414M 0s 2024-09-12T00:41:30.287 INFO:teuthology.orchestra.run.smithi138.stderr: 84100K .......... .......... .......... .......... .......... 90% 326M 0s 2024-09-12T00:41:30.287 INFO:teuthology.orchestra.run.smithi138.stderr: 84150K .......... .......... .......... .......... .......... 90% 13.6M 0s 2024-09-12T00:41:30.287 INFO:teuthology.orchestra.run.smithi138.stderr: 84200K .......... .......... .......... .......... .......... 90% 291M 0s 2024-09-12T00:41:30.287 INFO:teuthology.orchestra.run.smithi138.stderr: 84250K .......... .......... .......... .......... .......... 90% 289M 0s 2024-09-12T00:41:30.287 INFO:teuthology.orchestra.run.smithi138.stderr: 84300K .......... .......... .......... .......... .......... 90% 215M 0s 2024-09-12T00:41:30.287 INFO:teuthology.orchestra.run.smithi138.stderr: 84350K .......... .......... .......... .......... .......... 90% 202M 0s 2024-09-12T00:41:30.287 INFO:teuthology.orchestra.run.smithi138.stderr: 84400K .......... .......... .......... .......... .......... 90% 287M 0s 2024-09-12T00:41:30.287 INFO:teuthology.orchestra.run.smithi138.stderr: 84450K .......... .......... .......... .......... .......... 90% 293M 0s 2024-09-12T00:41:30.287 INFO:teuthology.orchestra.run.smithi138.stderr: 84500K .......... .......... .......... .......... .......... 91% 285M 0s 2024-09-12T00:41:30.287 INFO:teuthology.orchestra.run.smithi138.stderr: 84550K .......... .......... .......... .......... .......... 91% 301M 0s 2024-09-12T00:41:30.287 INFO:teuthology.orchestra.run.smithi138.stderr: 84600K .......... .......... .......... .......... .......... 91% 394M 0s 2024-09-12T00:41:30.288 INFO:teuthology.orchestra.run.smithi138.stderr: 84650K .......... .......... .......... .......... .......... 91% 268M 0s 2024-09-12T00:41:30.288 INFO:teuthology.orchestra.run.smithi138.stderr: 84700K .......... .......... .......... .......... .......... 91% 263M 0s 2024-09-12T00:41:30.288 INFO:teuthology.orchestra.run.smithi138.stderr: 84750K .......... .......... .......... .......... .......... 91% 243M 0s 2024-09-12T00:41:30.288 INFO:teuthology.orchestra.run.smithi138.stderr: 84800K .......... .......... .......... .......... .......... 91% 399M 0s 2024-09-12T00:41:30.288 INFO:teuthology.orchestra.run.smithi138.stderr: 84850K .......... .......... .......... .......... .......... 91% 303M 0s 2024-09-12T00:41:30.288 INFO:teuthology.orchestra.run.smithi138.stderr: 84900K .......... .......... .......... .......... .......... 91% 367M 0s 2024-09-12T00:41:30.288 INFO:teuthology.orchestra.run.smithi138.stderr: 84950K .......... .......... .......... .......... .......... 91% 241M 0s 2024-09-12T00:41:30.288 INFO:teuthology.orchestra.run.smithi138.stderr: 85000K .......... .......... .......... .......... .......... 91% 302M 0s 2024-09-12T00:41:30.288 INFO:teuthology.orchestra.run.smithi138.stderr: 85050K .......... .......... .......... .......... .......... 91% 270M 0s 2024-09-12T00:41:30.288 INFO:teuthology.orchestra.run.smithi138.stderr: 85100K .......... .......... .......... .......... .......... 91% 291M 0s 2024-09-12T00:41:30.288 INFO:teuthology.orchestra.run.smithi138.stderr: 85150K .......... .......... .......... .......... .......... 91% 252M 0s 2024-09-12T00:41:30.288 INFO:teuthology.orchestra.run.smithi138.stderr: 85200K .......... .......... .......... .......... .......... 91% 339M 0s 2024-09-12T00:41:30.288 INFO:teuthology.orchestra.run.smithi138.stderr: 85250K .......... .......... .......... .......... .......... 91% 278M 0s 2024-09-12T00:41:30.289 INFO:teuthology.orchestra.run.smithi138.stderr: 85300K .......... .......... .......... .......... .......... 91% 312M 0s 2024-09-12T00:41:30.289 INFO:teuthology.orchestra.run.smithi138.stderr: 85350K .......... .......... .......... .......... .......... 91% 330M 0s 2024-09-12T00:41:30.289 INFO:teuthology.orchestra.run.smithi138.stderr: 85400K .......... .......... .......... .......... .......... 91% 341M 0s 2024-09-12T00:41:30.289 INFO:teuthology.orchestra.run.smithi138.stderr: 85450K .......... .......... .......... .......... .......... 92% 402M 0s 2024-09-12T00:41:30.289 INFO:teuthology.orchestra.run.smithi138.stderr: 85500K .......... .......... .......... .......... .......... 92% 405M 0s 2024-09-12T00:41:30.289 INFO:teuthology.orchestra.run.smithi138.stderr: 85550K .......... .......... .......... .......... .......... 92% 335M 0s 2024-09-12T00:41:30.289 INFO:teuthology.orchestra.run.smithi138.stderr: 85600K .......... .......... .......... .......... .......... 92% 401M 0s 2024-09-12T00:41:30.289 INFO:teuthology.orchestra.run.smithi138.stderr: 85650K .......... .......... .......... .......... .......... 92% 284M 0s 2024-09-12T00:41:30.289 INFO:teuthology.orchestra.run.smithi138.stderr: 85700K .......... .......... .......... .......... .......... 92% 252M 0s 2024-09-12T00:41:30.289 INFO:teuthology.orchestra.run.smithi138.stderr: 85750K .......... .......... .......... .......... .......... 92% 239M 0s 2024-09-12T00:41:30.289 INFO:teuthology.orchestra.run.smithi138.stderr: 85800K .......... .......... .......... .......... .......... 92% 251M 0s 2024-09-12T00:41:30.289 INFO:teuthology.orchestra.run.smithi138.stderr: 85850K .......... .......... .......... .......... .......... 92% 252M 0s 2024-09-12T00:41:30.289 INFO:teuthology.orchestra.run.smithi138.stderr: 85900K .......... .......... .......... .......... .......... 92% 315M 0s 2024-09-12T00:41:30.289 INFO:teuthology.orchestra.run.smithi138.stderr: 85950K .......... .......... .......... .......... .......... 92% 246M 0s 2024-09-12T00:41:30.290 INFO:teuthology.orchestra.run.smithi138.stderr: 86000K .......... .......... .......... .......... .......... 92% 334M 0s 2024-09-12T00:41:30.290 INFO:teuthology.orchestra.run.smithi138.stderr: 86050K .......... .......... .......... .......... .......... 92% 277M 0s 2024-09-12T00:41:30.290 INFO:teuthology.orchestra.run.smithi138.stderr: 86100K .......... .......... .......... .......... .......... 92% 265M 0s 2024-09-12T00:41:30.290 INFO:teuthology.orchestra.run.smithi138.stderr: 86150K .......... .......... .......... .......... .......... 92% 341M 0s 2024-09-12T00:41:30.290 INFO:teuthology.orchestra.run.smithi138.stderr: 86200K .......... .......... .......... .......... .......... 92% 316M 0s 2024-09-12T00:41:30.290 INFO:teuthology.orchestra.run.smithi138.stderr: 86250K .......... .......... .......... .......... .......... 92% 262M 0s 2024-09-12T00:41:30.290 INFO:teuthology.orchestra.run.smithi138.stderr: 86300K .......... .......... .......... .......... .......... 92% 321M 0s 2024-09-12T00:41:30.290 INFO:teuthology.orchestra.run.smithi138.stderr: 86350K .......... .......... .......... .......... .......... 93% 238M 0s 2024-09-12T00:41:30.290 INFO:teuthology.orchestra.run.smithi138.stderr: 86400K .......... .......... .......... .......... .......... 93% 388M 0s 2024-09-12T00:41:30.290 INFO:teuthology.orchestra.run.smithi138.stderr: 86450K .......... .......... .......... .......... .......... 93% 382M 0s 2024-09-12T00:41:30.290 INFO:teuthology.orchestra.run.smithi138.stderr: 86500K .......... .......... .......... .......... .......... 93% 402M 0s 2024-09-12T00:41:30.290 INFO:teuthology.orchestra.run.smithi138.stderr: 86550K .......... .......... .......... .......... .......... 93% 348M 0s 2024-09-12T00:41:30.290 INFO:teuthology.orchestra.run.smithi138.stderr: 86600K .......... .......... .......... .......... .......... 93% 399M 0s 2024-09-12T00:41:30.291 INFO:teuthology.orchestra.run.smithi138.stderr: 86650K .......... .......... .......... .......... .......... 93% 406M 0s 2024-09-12T00:41:30.291 INFO:teuthology.orchestra.run.smithi138.stderr: 86700K .......... .......... .......... .......... .......... 93% 394M 0s 2024-09-12T00:41:30.291 INFO:teuthology.orchestra.run.smithi138.stderr: 86750K .......... .......... .......... .......... .......... 93% 110M 0s 2024-09-12T00:41:30.291 INFO:teuthology.orchestra.run.smithi138.stderr: 86800K .......... .......... .......... .......... .......... 93% 181M 0s 2024-09-12T00:41:30.291 INFO:teuthology.orchestra.run.smithi138.stderr: 86850K .......... .......... .......... .......... .......... 93% 214M 0s 2024-09-12T00:41:30.291 INFO:teuthology.orchestra.run.smithi138.stderr: 86900K .......... .......... .......... .......... .......... 93% 307M 0s 2024-09-12T00:41:30.291 INFO:teuthology.orchestra.run.smithi138.stderr: 86950K .......... .......... .......... .......... .......... 93% 348M 0s 2024-09-12T00:41:30.291 INFO:teuthology.orchestra.run.smithi138.stderr: 87000K .......... .......... .......... .......... .......... 93% 398M 0s 2024-09-12T00:41:30.291 INFO:teuthology.orchestra.run.smithi138.stderr: 87050K .......... .......... .......... .......... .......... 93% 404M 0s 2024-09-12T00:41:30.291 INFO:teuthology.orchestra.run.smithi138.stderr: 87100K .......... .......... .......... .......... .......... 93% 402M 0s 2024-09-12T00:41:30.291 INFO:teuthology.orchestra.run.smithi138.stderr: 87150K .......... .......... .......... .......... .......... 93% 22.9M 0s 2024-09-12T00:41:30.291 INFO:teuthology.orchestra.run.smithi138.stderr: 87200K .......... .......... .......... .......... .......... 93% 97.4M 0s 2024-09-12T00:41:30.292 INFO:teuthology.orchestra.run.smithi138.stderr: 87250K .......... .......... .......... .......... .......... 93% 212M 0s 2024-09-12T00:41:30.292 INFO:teuthology.orchestra.run.smithi138.stderr: 87300K .......... .......... .......... .......... .......... 94% 280M 0s 2024-09-12T00:41:30.292 INFO:teuthology.orchestra.run.smithi138.stderr: 87350K .......... .......... .......... .......... .......... 94% 256M 0s 2024-09-12T00:41:30.292 INFO:teuthology.orchestra.run.smithi138.stderr: 87400K .......... .......... .......... .......... .......... 94% 390M 0s 2024-09-12T00:41:30.292 INFO:teuthology.orchestra.run.smithi138.stderr: 87450K .......... .......... .......... .......... .......... 94% 394M 0s 2024-09-12T00:41:30.292 INFO:teuthology.orchestra.run.smithi138.stderr: 87500K .......... .......... .......... .......... .......... 94% 288M 0s 2024-09-12T00:41:30.292 INFO:teuthology.orchestra.run.smithi138.stderr: 87550K .......... .......... .......... .......... .......... 94% 203M 0s 2024-09-12T00:41:30.292 INFO:teuthology.orchestra.run.smithi138.stderr: 87600K .......... .......... .......... .......... .......... 94% 272M 0s 2024-09-12T00:41:30.292 INFO:teuthology.orchestra.run.smithi138.stderr: 87650K .......... .......... .......... .......... .......... 94% 397M 0s 2024-09-12T00:41:30.292 INFO:teuthology.orchestra.run.smithi138.stderr: 87700K .......... .......... .......... .......... .......... 94% 363M 0s 2024-09-12T00:41:30.292 INFO:teuthology.orchestra.run.smithi138.stderr: 87750K .......... .......... .......... .......... .......... 94% 240M 0s 2024-09-12T00:41:30.292 INFO:teuthology.orchestra.run.smithi138.stderr: 87800K .......... .......... .......... .......... .......... 94% 289M 0s 2024-09-12T00:41:30.292 INFO:teuthology.orchestra.run.smithi138.stderr: 87850K .......... .......... .......... .......... .......... 94% 292M 0s 2024-09-12T00:41:30.293 INFO:teuthology.orchestra.run.smithi138.stderr: 87900K .......... .......... .......... .......... .......... 94% 268M 0s 2024-09-12T00:41:30.293 INFO:teuthology.orchestra.run.smithi138.stderr: 87950K .......... .......... .......... .......... .......... 94% 200M 0s 2024-09-12T00:41:30.293 INFO:teuthology.orchestra.run.smithi138.stderr: 88000K .......... .......... .......... .......... .......... 94% 388M 0s 2024-09-12T00:41:30.293 INFO:teuthology.orchestra.run.smithi138.stderr: 88050K .......... .......... .......... .......... .......... 94% 402M 0s 2024-09-12T00:41:30.293 INFO:teuthology.orchestra.run.smithi138.stderr: 88100K .......... .......... .......... .......... .......... 94% 316M 0s 2024-09-12T00:41:30.293 INFO:teuthology.orchestra.run.smithi138.stderr: 88150K .......... .......... .......... .......... .......... 94% 209M 0s 2024-09-12T00:41:30.293 INFO:teuthology.orchestra.run.smithi138.stderr: 88200K .......... .......... .......... .......... .......... 94% 257M 0s 2024-09-12T00:41:30.293 INFO:teuthology.orchestra.run.smithi138.stderr: 88250K .......... .......... .......... .......... .......... 95% 285M 0s 2024-09-12T00:41:30.293 INFO:teuthology.orchestra.run.smithi138.stderr: 88300K .......... .......... .......... .......... .......... 95% 319M 0s 2024-09-12T00:41:30.293 INFO:teuthology.orchestra.run.smithi138.stderr: 88350K .......... .......... .......... .......... .......... 95% 332M 0s 2024-09-12T00:41:30.293 INFO:teuthology.orchestra.run.smithi138.stderr: 88400K .......... .......... .......... .......... .......... 95% 408M 0s 2024-09-12T00:41:30.293 INFO:teuthology.orchestra.run.smithi138.stderr: 88450K .......... .......... .......... .......... .......... 95% 399M 0s 2024-09-12T00:41:30.293 INFO:teuthology.orchestra.run.smithi138.stderr: 88500K .......... .......... .......... .......... .......... 95% 140M 0s 2024-09-12T00:41:30.294 INFO:teuthology.orchestra.run.smithi138.stderr: 88550K .......... .......... .......... .......... .......... 95% 146M 0s 2024-09-12T00:41:30.294 INFO:teuthology.orchestra.run.smithi138.stderr: 88600K .......... .......... .......... .......... .......... 95% 238M 0s 2024-09-12T00:41:30.294 INFO:teuthology.orchestra.run.smithi138.stderr: 88650K .......... .......... .......... .......... .......... 95% 269M 0s 2024-09-12T00:41:30.294 INFO:teuthology.orchestra.run.smithi138.stderr: 88700K .......... .......... .......... .......... .......... 95% 265M 0s 2024-09-12T00:41:30.294 INFO:teuthology.orchestra.run.smithi138.stderr: 88750K .......... .......... .......... .......... .......... 95% 239M 0s 2024-09-12T00:41:30.294 INFO:teuthology.orchestra.run.smithi138.stderr: 88800K .......... .......... .......... .......... .......... 95% 294M 0s 2024-09-12T00:41:30.294 INFO:teuthology.orchestra.run.smithi138.stderr: 88850K .......... .......... .......... .......... .......... 95% 289M 0s 2024-09-12T00:41:30.294 INFO:teuthology.orchestra.run.smithi138.stderr: 88900K .......... .......... .......... .......... .......... 95% 284M 0s 2024-09-12T00:41:30.294 INFO:teuthology.orchestra.run.smithi138.stderr: 88950K .......... .......... .......... .......... .......... 95% 306M 0s 2024-09-12T00:41:30.294 INFO:teuthology.orchestra.run.smithi138.stderr: 89000K .......... .......... .......... .......... .......... 95% 298M 0s 2024-09-12T00:41:30.294 INFO:teuthology.orchestra.run.smithi138.stderr: 89050K .......... .......... .......... .......... .......... 95% 322M 0s 2024-09-12T00:41:30.294 INFO:teuthology.orchestra.run.smithi138.stderr: 89100K .......... .......... .......... .......... .......... 95% 347M 0s 2024-09-12T00:41:30.294 INFO:teuthology.orchestra.run.smithi138.stderr: 89150K .......... .......... .......... .......... .......... 96% 220M 0s 2024-09-12T00:41:30.295 INFO:teuthology.orchestra.run.smithi138.stderr: 89200K .......... .......... .......... .......... .......... 96% 307M 0s 2024-09-12T00:41:30.295 INFO:teuthology.orchestra.run.smithi138.stderr: 89250K .......... .......... .......... .......... .......... 96% 373M 0s 2024-09-12T00:41:30.295 INFO:teuthology.orchestra.run.smithi138.stderr: 89300K .......... .......... .......... .......... .......... 96% 352M 0s 2024-09-12T00:41:30.295 INFO:teuthology.orchestra.run.smithi138.stderr: 89350K .......... .......... .......... .......... .......... 96% 337M 0s 2024-09-12T00:41:30.295 INFO:teuthology.orchestra.run.smithi138.stderr: 89400K .......... .......... .......... .......... .......... 96% 395M 0s 2024-09-12T00:41:30.295 INFO:teuthology.orchestra.run.smithi138.stderr: 89450K .......... .......... .......... .......... .......... 96% 372M 0s 2024-09-12T00:41:30.295 INFO:teuthology.orchestra.run.smithi138.stderr: 89500K .......... .......... .......... .......... .......... 96% 104M 0s 2024-09-12T00:41:30.295 INFO:teuthology.orchestra.run.smithi138.stderr: 89550K .......... .......... .......... .......... .......... 96% 213M 0s 2024-09-12T00:41:30.295 INFO:teuthology.orchestra.run.smithi138.stderr: 89600K .......... .......... .......... .......... .......... 96% 240M 0s 2024-09-12T00:41:30.295 INFO:teuthology.orchestra.run.smithi138.stderr: 89650K .......... .......... .......... .......... .......... 96% 242M 0s 2024-09-12T00:41:30.295 INFO:teuthology.orchestra.run.smithi138.stderr: 89700K .......... .......... .......... .......... .......... 96% 267M 0s 2024-09-12T00:41:30.295 INFO:teuthology.orchestra.run.smithi138.stderr: 89750K .......... .......... .......... .......... .......... 96% 290M 0s 2024-09-12T00:41:30.295 INFO:teuthology.orchestra.run.smithi138.stderr: 89800K .......... .......... .......... .......... .......... 96% 378M 0s 2024-09-12T00:41:30.296 INFO:teuthology.orchestra.run.smithi138.stderr: 89850K .......... .......... .......... .......... .......... 96% 351M 0s 2024-09-12T00:41:30.296 INFO:teuthology.orchestra.run.smithi138.stderr: 89900K .......... .......... .......... .......... .......... 96% 381M 0s 2024-09-12T00:41:30.296 INFO:teuthology.orchestra.run.smithi138.stderr: 89950K .......... .......... .......... .......... .......... 96% 331M 0s 2024-09-12T00:41:30.296 INFO:teuthology.orchestra.run.smithi138.stderr: 90000K .......... .......... .......... .......... .......... 96% 28.9M 0s 2024-09-12T00:41:30.296 INFO:teuthology.orchestra.run.smithi138.stderr: 90050K .......... .......... .......... .......... .......... 96% 201M 0s 2024-09-12T00:41:30.296 INFO:teuthology.orchestra.run.smithi138.stderr: 90100K .......... .......... .......... .......... .......... 97% 293M 0s 2024-09-12T00:41:30.296 INFO:teuthology.orchestra.run.smithi138.stderr: 90150K .......... .......... .......... .......... .......... 97% 246M 0s 2024-09-12T00:41:30.296 INFO:teuthology.orchestra.run.smithi138.stderr: 90200K .......... .......... .......... .......... .......... 97% 289M 0s 2024-09-12T00:41:30.296 INFO:teuthology.orchestra.run.smithi138.stderr: 90250K .......... .......... .......... .......... .......... 97% 364M 0s 2024-09-12T00:41:30.296 INFO:teuthology.orchestra.run.smithi138.stderr: 90300K .......... .......... .......... .......... .......... 97% 243M 0s 2024-09-12T00:41:30.296 INFO:teuthology.orchestra.run.smithi138.stderr: 90350K .......... .......... .......... .......... .......... 97% 303M 0s 2024-09-12T00:41:30.296 INFO:teuthology.orchestra.run.smithi138.stderr: 90400K .......... .......... .......... .......... .......... 97% 192M 0s 2024-09-12T00:41:30.296 INFO:teuthology.orchestra.run.smithi138.stderr: 90450K .......... .......... .......... .......... .......... 97% 269M 0s 2024-09-12T00:41:30.297 INFO:teuthology.orchestra.run.smithi138.stderr: 90500K .......... .......... .......... .......... .......... 97% 350M 0s 2024-09-12T00:41:30.297 INFO:teuthology.orchestra.run.smithi138.stderr: 90550K .......... .......... .......... .......... .......... 97% 260M 0s 2024-09-12T00:41:30.297 INFO:teuthology.orchestra.run.smithi138.stderr: 90600K .......... .......... .......... .......... .......... 97% 304M 0s 2024-09-12T00:41:30.297 INFO:teuthology.orchestra.run.smithi138.stderr: 90650K .......... .......... .......... .......... .......... 97% 180M 0s 2024-09-12T00:41:30.297 INFO:teuthology.orchestra.run.smithi138.stderr: 90700K .......... .......... .......... .......... .......... 97% 218M 0s 2024-09-12T00:41:30.297 INFO:teuthology.orchestra.run.smithi138.stderr: 90750K .......... .......... .......... .......... .......... 97% 242M 0s 2024-09-12T00:41:30.297 INFO:teuthology.orchestra.run.smithi138.stderr: 90800K .......... .......... .......... .......... .......... 97% 391M 0s 2024-09-12T00:41:30.297 INFO:teuthology.orchestra.run.smithi138.stderr: 90850K .......... .......... .......... .......... .......... 97% 370M 0s 2024-09-12T00:41:30.297 INFO:teuthology.orchestra.run.smithi138.stderr: 90900K .......... .......... .......... .......... .......... 97% 196M 0s 2024-09-12T00:41:30.297 INFO:teuthology.orchestra.run.smithi138.stderr: 90950K .......... .......... .......... .......... .......... 97% 218M 0s 2024-09-12T00:41:30.297 INFO:teuthology.orchestra.run.smithi138.stderr: 91000K .......... .......... .......... .......... .......... 98% 207M 0s 2024-09-12T00:41:30.297 INFO:teuthology.orchestra.run.smithi138.stderr: 91050K .......... .......... .......... .......... .......... 98% 246M 0s 2024-09-12T00:41:30.297 INFO:teuthology.orchestra.run.smithi138.stderr: 91100K .......... .......... .......... .......... .......... 98% 358M 0s 2024-09-12T00:41:30.298 INFO:teuthology.orchestra.run.smithi138.stderr: 91150K .......... .......... .......... .......... .......... 98% 285M 0s 2024-09-12T00:41:30.298 INFO:teuthology.orchestra.run.smithi138.stderr: 91200K .......... .......... .......... .......... .......... 98% 280M 0s 2024-09-12T00:41:30.298 INFO:teuthology.orchestra.run.smithi138.stderr: 91250K .......... .......... .......... .......... .......... 98% 381M 0s 2024-09-12T00:41:30.298 INFO:teuthology.orchestra.run.smithi138.stderr: 91300K .......... .......... .......... .......... .......... 98% 370M 0s 2024-09-12T00:41:30.298 INFO:teuthology.orchestra.run.smithi138.stderr: 91350K .......... .......... .......... .......... .......... 98% 244M 0s 2024-09-12T00:41:30.298 INFO:teuthology.orchestra.run.smithi138.stderr: 91400K .......... .......... .......... .......... .......... 98% 234M 0s 2024-09-12T00:41:30.298 INFO:teuthology.orchestra.run.smithi138.stderr: 91450K .......... .......... .......... .......... .......... 98% 286M 0s 2024-09-12T00:41:30.298 INFO:teuthology.orchestra.run.smithi138.stderr: 91500K .......... .......... .......... .......... .......... 98% 293M 0s 2024-09-12T00:41:30.298 INFO:teuthology.orchestra.run.smithi138.stderr: 91550K .......... .......... .......... .......... .......... 98% 251M 0s 2024-09-12T00:41:30.298 INFO:teuthology.orchestra.run.smithi138.stderr: 91600K .......... .......... .......... .......... .......... 98% 250M 0s 2024-09-12T00:41:30.298 INFO:teuthology.orchestra.run.smithi138.stderr: 91650K .......... .......... .......... .......... .......... 98% 372M 0s 2024-09-12T00:41:30.298 INFO:teuthology.orchestra.run.smithi138.stderr: 91700K .......... .......... .......... .......... .......... 98% 250M 0s 2024-09-12T00:41:30.298 INFO:teuthology.orchestra.run.smithi138.stderr: 91750K .......... .......... .......... .......... .......... 98% 248M 0s 2024-09-12T00:41:30.299 INFO:teuthology.orchestra.run.smithi138.stderr: 91800K .......... .......... .......... .......... .......... 98% 250M 0s 2024-09-12T00:41:30.299 INFO:teuthology.orchestra.run.smithi138.stderr: 91850K .......... .......... .......... .......... .......... 98% 307M 0s 2024-09-12T00:41:30.299 INFO:teuthology.orchestra.run.smithi138.stderr: 91900K .......... .......... .......... .......... .......... 98% 305M 0s 2024-09-12T00:41:30.299 INFO:teuthology.orchestra.run.smithi138.stderr: 91950K .......... .......... .......... .......... .......... 99% 237M 0s 2024-09-12T00:41:30.301 INFO:teuthology.orchestra.run.smithi138.stderr: 92000K .......... .......... .......... .......... .......... 99% 256M 0s 2024-09-12T00:41:30.301 INFO:teuthology.orchestra.run.smithi138.stderr: 92050K .......... .......... .......... .......... .......... 99% 363M 0s 2024-09-12T00:41:30.301 INFO:teuthology.orchestra.run.smithi138.stderr: 92100K .......... .......... .......... .......... .......... 99% 229M 0s 2024-09-12T00:41:30.301 INFO:teuthology.orchestra.run.smithi138.stderr: 92150K .......... .......... .......... .......... .......... 99% 331M 0s 2024-09-12T00:41:30.301 INFO:teuthology.orchestra.run.smithi138.stderr: 92200K .......... .......... .......... .......... .......... 99% 361M 0s 2024-09-12T00:41:30.301 INFO:teuthology.orchestra.run.smithi138.stderr: 92250K .......... .......... .......... .......... .......... 99% 393M 0s 2024-09-12T00:41:30.301 INFO:teuthology.orchestra.run.smithi138.stderr: 92300K .......... .......... .......... .......... .......... 99% 70.3M 0s 2024-09-12T00:41:30.301 INFO:teuthology.orchestra.run.smithi138.stderr: 92350K .......... .......... .......... .......... .......... 99% 148M 0s 2024-09-12T00:41:30.301 INFO:teuthology.orchestra.run.smithi138.stderr: 92400K .......... .......... .......... .......... .......... 99% 321M 0s 2024-09-12T00:41:30.301 INFO:teuthology.orchestra.run.smithi138.stderr: 92450K .......... .......... .......... .......... .......... 99% 243M 0s 2024-09-12T00:41:30.301 INFO:teuthology.orchestra.run.smithi138.stderr: 92500K .......... .......... .......... .......... .......... 99% 239M 0s 2024-09-12T00:41:30.301 INFO:teuthology.orchestra.run.smithi138.stderr: 92550K .......... .......... .......... .......... .......... 99% 259M 0s 2024-09-12T00:41:30.301 INFO:teuthology.orchestra.run.smithi138.stderr: 92600K .......... .......... .......... .......... .......... 99% 395M 0s 2024-09-12T00:41:30.302 INFO:teuthology.orchestra.run.smithi138.stderr: 92650K .......... .......... .......... .......... .......... 99% 380M 0s 2024-09-12T00:41:30.302 INFO:teuthology.orchestra.run.smithi138.stderr: 92700K .......... .......... .......... .......... .......... 99% 408M 0s 2024-09-12T00:41:30.302 INFO:teuthology.orchestra.run.smithi138.stderr: 92750K .......... .......... .......... .......... .......... 99% 311M 0s 2024-09-12T00:41:30.302 INFO:teuthology.orchestra.run.smithi138.stderr: 92800K .......... .......... .......... .......... .......... 99% 30.0M 0s 2024-09-12T00:41:30.302 INFO:teuthology.orchestra.run.smithi138.stderr: 92850K .......... .......... .......... .......... .......... 99% 323M 0s 2024-09-12T00:41:30.302 INFO:teuthology.orchestra.run.smithi138.stderr: 92900K 100% 134G=0.5s 2024-09-12T00:41:30.302 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-12T00:41:30.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12 00:41:29 (189 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-12T00:41:30.302 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-12T00:41:30.329 INFO:teuthology.orchestra.run.smithi138.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T00:41:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T00:41:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T00:41:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T00:41:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T00:41:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T00:41:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T00:41:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T00:41:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T00:41:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T00:41:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T00:41:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T00:41:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T00:41:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T00:41:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T00:41:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T00:41:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T00:41:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T00:41:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T00:41:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T00:41:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T00:41:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T00:41:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T00:41:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T00:41:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T00:41:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T00:41:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T00:41:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T00:41:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T00:41:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T00:41:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T00:41:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T00:41:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T00:41:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T00:41:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T00:41:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T00:41:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T00:41:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T00:41:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T00:41:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T00:41:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T00:41:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T00:41:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T00:41:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T00:41:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T00:41:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T00:41:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T00:41:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T00:41:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T00:41:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:41:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T00:41:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T00:41:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T00:41:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T00:41:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T00:41:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T00:41:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T00:41:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T00:41:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T00:41:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T00:41:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T00:41:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T00:41:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T00:41:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T00:41:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T00:41:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T00:41:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T00:41:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T00:41:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T00:41:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T00:41:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T00:41:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T00:41:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T00:41:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T00:41:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T00:41:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T00:41:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T00:41:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T00:41:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T00:41:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T00:41:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T00:41:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T00:41:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T00:41:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T00:41:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T00:41:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T00:41:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T00:41:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T00:41:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T00:41:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T00:41:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T00:41:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T00:41:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T00:41:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T00:41:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T00:41:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T00:41:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T00:41:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T00:41:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T00:41:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T00:41:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T00:41:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T00:41:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T00:41:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T00:41:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T00:41:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T00:41:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T00:41:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T00:41:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T00:41:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T00:41:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T00:41:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T00:41:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T00:41:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T00:41:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T00:41:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T00:41:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T00:41:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T00:41:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T00:41:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T00:41:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T00:41:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T00:41:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T00:41:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T00:41:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T00:41:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T00:41:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T00:41:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T00:41:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T00:41:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T00:41:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T00:41:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T00:41:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T00:41:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T00:41:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T00:41:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T00:41:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T00:41:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T00:41:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T00:41:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T00:41:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T00:41:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T00:41:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T00:41:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T00:41:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T00:41:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T00:41:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T00:41:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T00:41:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T00:41:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T00:41:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T00:41:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T00:41:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T00:41:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T00:41:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T00:41:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T00:41:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T00:41:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T00:41:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T00:41:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T00:41:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T00:41:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T00:41:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T00:41:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T00:41:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T00:41:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T00:41:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T00:41:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T00:41:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T00:41:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T00:41:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T00:41:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T00:41:30.343 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T00:41:30.343 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T00:41:30.343 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T00:41:30.343 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T00:41:30.343 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T00:41:30.343 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T00:41:30.343 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T00:41:30.343 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T00:41:30.343 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T00:41:30.343 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T00:41:30.343 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T00:41:30.343 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T00:41:30.343 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T00:41:30.344 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T00:41:30.344 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T00:41:30.344 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T00:41:30.344 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T00:41:30.344 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T00:41:30.344 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T00:41:30.344 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T00:41:30.344 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T00:41:30.344 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T00:41:30.344 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T00:41:30.344 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T00:41:30.344 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T00:41:30.344 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T00:41:30.345 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T00:41:30.345 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T00:41:30.345 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T00:41:30.345 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T00:41:30.345 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T00:41:30.345 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T00:41:30.345 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T00:41:30.345 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T00:41:30.345 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T00:41:30.345 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T00:41:30.345 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T00:41:30.345 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T00:41:30.345 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T00:41:30.346 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T00:41:30.346 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T00:41:30.346 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T00:41:30.346 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T00:41:30.346 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T00:41:30.346 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T00:41:30.346 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T00:41:30.346 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T00:41:30.346 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T00:41:30.346 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T00:41:30.346 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T00:41:30.346 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T00:41:30.346 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T00:41:30.346 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T00:41:30.347 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T00:41:30.347 INFO:teuthology.orchestra.run.smithi138.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T00:41:30.351 INFO:teuthology.orchestra.run.smithi138.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-12T00:41:30.771 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:41:30.771 INFO:teuthology.orchestra.run.smithi138.stdout:Welcome to Gradle 6.0.1! 2024-09-12T00:41:30.771 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:41:30.771 INFO:teuthology.orchestra.run.smithi138.stdout:Here are the highlights of this release: 2024-09-12T00:41:30.771 INFO:teuthology.orchestra.run.smithi138.stdout: - Substantial improvements in dependency management, including 2024-09-12T00:41:30.771 INFO:teuthology.orchestra.run.smithi138.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T00:41:30.771 INFO:teuthology.orchestra.run.smithi138.stdout: - Advanced control of transitive versions 2024-09-12T00:41:30.772 INFO:teuthology.orchestra.run.smithi138.stdout: - Support for optional features and dependencies 2024-09-12T00:41:30.772 INFO:teuthology.orchestra.run.smithi138.stdout: - Rules to tweak published metadata 2024-09-12T00:41:30.772 INFO:teuthology.orchestra.run.smithi138.stdout: - Support for Java 13 2024-09-12T00:41:30.772 INFO:teuthology.orchestra.run.smithi138.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T00:41:30.772 INFO:teuthology.orchestra.run.smithi138.stdout: - New Zinc compiler for Scala 2024-09-12T00:41:30.772 INFO:teuthology.orchestra.run.smithi138.stdout: - VS2019 support 2024-09-12T00:41:30.772 INFO:teuthology.orchestra.run.smithi138.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T00:41:30.772 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:41:30.772 INFO:teuthology.orchestra.run.smithi138.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T00:41:30.772 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:41:30.772 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:41:30.772 INFO:teuthology.orchestra.run.smithi138.stdout:------------------------------------------------------------ 2024-09-12T00:41:30.773 INFO:teuthology.orchestra.run.smithi138.stdout:Gradle 6.0.1 2024-09-12T00:41:30.773 INFO:teuthology.orchestra.run.smithi138.stdout:------------------------------------------------------------ 2024-09-12T00:41:30.773 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:41:30.773 INFO:teuthology.orchestra.run.smithi138.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T00:41:30.774 INFO:teuthology.orchestra.run.smithi138.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T00:41:30.774 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:41:30.774 INFO:teuthology.orchestra.run.smithi138.stdout:Kotlin: 1.3.50 2024-09-12T00:41:30.774 INFO:teuthology.orchestra.run.smithi138.stdout:Groovy: 2.5.8 2024-09-12T00:41:30.774 INFO:teuthology.orchestra.run.smithi138.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T00:41:30.774 INFO:teuthology.orchestra.run.smithi138.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-12T00:41:30.774 INFO:teuthology.orchestra.run.smithi138.stdout:OS: Linux 5.15.0-119-generic amd64 2024-09-12T00:41:30.774 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:41:30.779 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T00:41:30.779 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:41:30.779 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi138.front.sepia.ceph.com 2024-09-12T00:41:30.779 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:41:30.779 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi178.front.sepia.ceph.com 2024-09-12T00:41:30.779 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T00:41:31.056 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T00:41:31.056 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T00:41:31.057 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'KFNWXWWDHZTAZZNNNEZW', 'access_secret': '2pG6dBkMKimZwzopq6XwJELTi5Ic++068AijNvoiiyaZRYIF8vT61A==', 'region': 'mexico', 'endpoint': 'smithi138.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi138.front.sepia.ceph.com'} 2024-09-12T00:41:31.057 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T00:41:31.057 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'KFNWXWWDHZTAZZNNNEZW', '--secret', '2pG6dBkMKimZwzopq6XwJELTi5Ic++068AijNvoiiyaZRYIF8vT61A==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T00:41:31.057 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key KFNWXWWDHZTAZZNNNEZW --secret 2pG6dBkMKimZwzopq6XwJELTi5Ic++068AijNvoiiyaZRYIF8vT61A== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T00:41:31.105 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:31.105 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:31.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.158+0000 7f1d7f73a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.158+0000 7f1d7f73a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:31.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.158+0000 7f1d7f73a9c0 20 realm 2024-09-12T00:41:31.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.158+0000 7f1d7f73a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.158+0000 7f1d7f73a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:31.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.158+0000 7f1d7f73a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:31.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.158+0000 7f1d7f73a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.158+0000 7f1d7f73a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:31.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.158+0000 7f1d7f73a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.162+0000 7f1d7f73a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:31.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.162+0000 7f1d7f73a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.162+0000 7f1d7f73a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:31.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.162+0000 7f1d7f73a9c0 20 searching for the correct realm 2024-09-12T00:41:31.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.166+0000 7f1d7da41640 0 -- 172.21.15.138:0/3655825615 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f1d78066410 msgr2=0x7f1d78089a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:31.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.382+0000 7f1d7da41640 0 -- 172.21.15.138:0/3655825615 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55bce2d89a60 msgr2=0x55bce2d8bf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:31.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.390+0000 7f1d7f73a9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:41:31.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.390+0000 7f1d7f73a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:31.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.390+0000 7f1d7f73a9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:41:31.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.390+0000 7f1d7f73a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:31.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.390+0000 7f1d7f73a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:31.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.390+0000 7f1d7f73a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:31.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.390+0000 7f1d7f73a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.390+0000 7f1d7f73a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:31.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.390+0000 7f1d7f73a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.390+0000 7f1d7f73a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:31.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.390+0000 7f1d7f73a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.394+0000 7f1d7f73a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:31.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.394+0000 7f1d7f73a9c0 20 zone default found 2024-09-12T00:41:31.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.394+0000 7f1d7f73a9c0 4 Realm: () 2024-09-12T00:41:31.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.394+0000 7f1d7f73a9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:41:31.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.394+0000 7f1d7f73a9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:41:31.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.394+0000 7f1d7f73a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:31.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.394+0000 7f1d7f73a9c0 20 zonegroup default 2024-09-12T00:41:31.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.394+0000 7f1d7f73a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.394+0000 7f1d7f73a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:31.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.394+0000 7f1d7f73a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.394+0000 7f1d7f73a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:31.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.394+0000 7f1d7f73a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.394+0000 7f1d7f73a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:31.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.394+0000 7f1d7f73a9c0 20 started sync module instance, tier type = 2024-09-12T00:41:31.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.394+0000 7f1d7f73a9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:41:31.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.422+0000 7f1d7f73a9c0 20 add_watcher() i=0 2024-09-12T00:41:31.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.422+0000 7f1d7f73a9c0 20 add_watcher() i=1 2024-09-12T00:41:31.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.422+0000 7f1d7f73a9c0 20 add_watcher() i=2 2024-09-12T00:41:31.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.422+0000 7f1d7f73a9c0 20 add_watcher() i=3 2024-09-12T00:41:31.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.422+0000 7f1d7f73a9c0 20 add_watcher() i=4 2024-09-12T00:41:31.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.422+0000 7f1d7f73a9c0 20 add_watcher() i=5 2024-09-12T00:41:31.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.422+0000 7f1d7f73a9c0 20 add_watcher() i=6 2024-09-12T00:41:31.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.426+0000 7f1d7f73a9c0 20 add_watcher() i=7 2024-09-12T00:41:31.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.426+0000 7f1d7f73a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:31.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1c337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:31.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1d7f73a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:31.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1d7f73a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:31.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1d7f73a9c0 5 note: GC not initialized 2024-09-12T00:41:31.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1c327e4640 20 reqs_thread_entry: start 2024-09-12T00:41:31.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1d7f73a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:31.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1d7f73a9c0 20 Filter name: none 2024-09-12T00:41:31.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1ba3fff640 20 reqs_thread_entry: start 2024-09-12T00:41:31.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1d7f73a9c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T00:41:31.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1d7f73a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1d7f73a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:31.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1d7f73a9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T00:41:31.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1d7f73a9c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:41:31.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1d7f73a9c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T00:41:31.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1d7f73a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1d7f73a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:31.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1d7f73a9c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T00:41:31.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1d7f73a9c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:41:31.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1d7f73a9c0 10 cache get: name=default.rgw.meta+users.keys+KFNWXWWDHZTAZZNNNEZW : miss 2024-09-12T00:41:31.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.430+0000 7f1d7f73a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.434+0000 7f1d7f73a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:31.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.434+0000 7f1d7f73a9c0 10 cache put: name=default.rgw.meta+users.keys+KFNWXWWDHZTAZZNNNEZW info.flags=0x0 2024-09-12T00:41:31.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.434+0000 7f1d7f73a9c0 10 adding default.rgw.meta+users.keys+KFNWXWWDHZTAZZNNNEZW to cache LRU end 2024-09-12T00:41:31.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.434+0000 7f1d7f73a9c0 10 cache get: name=default.rgw.meta+users.keys+KFNWXWWDHZTAZZNNNEZW : hit (negative entry) 2024-09-12T00:41:31.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.434+0000 7f1d7f73a9c0 10 cache get: name=default.rgw.meta+users.keys+KFNWXWWDHZTAZZNNNEZW : hit (negative entry) 2024-09-12T00:41:31.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.434+0000 7f1d7f73a9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:41:31.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.434+0000 7f1d7f73a9c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:41:31.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.434+0000 7f1d7f73a9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T00:41:31.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.434+0000 7f1c60ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333584 cookie 94269748087936 notifier 8850 bl.length()=670 2024-09-12T00:41:31.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.434+0000 7f1c60ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:41:31.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.434+0000 7f1c60ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:41:31.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.438+0000 7f1d7f73a9c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:41:31.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.438+0000 7f1d7f73a9c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:41:31.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.438+0000 7f1d7f73a9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T00:41:31.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.442+0000 7f1c4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333488 cookie 94269748082656 notifier 8850 bl.length()=200 2024-09-12T00:41:31.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.442+0000 7f1c4ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:41:31.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.442+0000 7f1c4ffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:41:31.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.446+0000 7f1d7f73a9c0 10 cache put: name=default.rgw.meta+users.keys+KFNWXWWDHZTAZZNNNEZW info.flags=0x7 2024-09-12T00:41:31.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.446+0000 7f1d7f73a9c0 10 moving default.rgw.meta+users.keys+KFNWXWWDHZTAZZNNNEZW to cache LRU end 2024-09-12T00:41:31.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.446+0000 7f1d7f73a9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:KFNWXWWDHZTAZZNNNEZW, ofs0, ns] 2024-09-12T00:41:31.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.446+0000 7f1c4ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333582 cookie 94269748066864 notifier 8850 bl.length()=189 2024-09-12T00:41:31.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.446+0000 7f1c4ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KFNWXWWDHZTAZZNNNEZW info.flags=0x7 2024-09-12T00:41:31.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.446+0000 7f1c4ffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KFNWXWWDHZTAZZNNNEZW to cache LRU end 2024-09-12T00:41:31.442 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T00:41:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "tester.client.0", 2024-09-12T00:41:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T00:41:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T00:41:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-12T00:41:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-12T00:41:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-12T00:41:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-12T00:41:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-12T00:41:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "tester.client.0", 2024-09-12T00:41:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "KFNWXWWDHZTAZZNNNEZW", 2024-09-12T00:41:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "2pG6dBkMKimZwzopq6XwJELTi5Ic++068AijNvoiiyaZRYIF8vT61A==", 2024-09-12T00:41:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-12T00:41:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:41:31.436032Z" 2024-09-12T00:41:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-12T00:41:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-12T00:41:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-12T00:41:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-12T00:41:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-12T00:41:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-12T00:41:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-12T00:41:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-12T00:41:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-12T00:41:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:41:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:41:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:41:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:41:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:41:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:41:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-12T00:41:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:41:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:41:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:41:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:41:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:41:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:41:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-12T00:41:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "rgw", 2024-09-12T00:41:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-12T00:41:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "", 2024-09-12T00:41:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-12T00:41:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:41:31.435978Z", 2024-09-12T00:41:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-12T00:41:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-12T00:41:31.445 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T00:41:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:41:31.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.446+0000 7f1c337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:31.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.450+0000 7f1d7f73a9c0 20 remove_watcher() i=0 2024-09-12T00:41:31.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.450+0000 7f1d7f73a9c0 2 removed watcher, disabling cache 2024-09-12T00:41:31.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.454+0000 7f1d7f73a9c0 20 remove_watcher() i=1 2024-09-12T00:41:31.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.458+0000 7f1d7f73a9c0 20 remove_watcher() i=2 2024-09-12T00:41:31.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.458+0000 7f1d7f73a9c0 20 remove_watcher() i=3 2024-09-12T00:41:31.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.462+0000 7f1d7f73a9c0 20 remove_watcher() i=4 2024-09-12T00:41:31.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.466+0000 7f1d7f73a9c0 20 remove_watcher() i=5 2024-09-12T00:41:31.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.474+0000 7f1d7f73a9c0 20 remove_watcher() i=6 2024-09-12T00:41:31.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.478+0000 7f1d7f73a9c0 20 remove_watcher() i=7 2024-09-12T00:41:31.492 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:41:31.492 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T00:41:31.544 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T00:41:31.544 DEBUG:teuthology.orchestra.run.smithi138:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T00:41:31.593 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-12T00:41:31.668 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:31.668 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:31.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.718+0000 7ff9d9c4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.722+0000 7ff9d9c4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:31.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.722+0000 7ff9d9c4c9c0 20 realm 2024-09-12T00:41:31.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.722+0000 7ff9d9c4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.722+0000 7ff9d9c4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:31.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.722+0000 7ff9d9c4c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:31.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.722+0000 7ff9d9c4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.722+0000 7ff9d9c4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:31.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.722+0000 7ff9d9c4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.722+0000 7ff9d9c4c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:31.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.722+0000 7ff9d9c4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.722+0000 7ff9d9c4c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:31.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.722+0000 7ff9d9c4c9c0 20 searching for the correct realm 2024-09-12T00:41:31.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.730+0000 7ff9d7f53640 0 -- 172.21.15.138:0/1282792657 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7ff9d0034420 msgr2=0x7ff9d0034880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:31.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.946+0000 7ff9d7f53640 0 -- 172.21.15.138:0/1282792657 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55833db48c10 msgr2=0x55833db4b0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:31.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.954+0000 7ff9d9c4c9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:41:31.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.954+0000 7ff9d9c4c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:31.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.954+0000 7ff9d9c4c9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:41:31.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.954+0000 7ff9d9c4c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:31.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.954+0000 7ff9d9c4c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:31.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.954+0000 7ff9d9c4c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:31.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.954+0000 7ff9d9c4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.954+0000 7ff9d9c4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:31.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.954+0000 7ff9d9c4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.958+0000 7ff9d9c4c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:31.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.958+0000 7ff9d9c4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.958+0000 7ff9d9c4c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:31.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.958+0000 7ff9d9c4c9c0 20 zone default found 2024-09-12T00:41:31.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.958+0000 7ff9d9c4c9c0 4 Realm: () 2024-09-12T00:41:31.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.958+0000 7ff9d9c4c9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:41:31.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.958+0000 7ff9d9c4c9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:41:31.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.958+0000 7ff9d9c4c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:31.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.958+0000 7ff9d9c4c9c0 20 zonegroup default 2024-09-12T00:41:31.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.958+0000 7ff9d9c4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.958+0000 7ff9d9c4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:31.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.958+0000 7ff9d9c4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.958+0000 7ff9d9c4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:31.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.958+0000 7ff9d9c4c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:31.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.962+0000 7ff9d9c4c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:31.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.962+0000 7ff9d9c4c9c0 20 started sync module instance, tier type = 2024-09-12T00:41:31.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.962+0000 7ff9d9c4c9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:41:31.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.982+0000 7ff9d9c4c9c0 20 add_watcher() i=0 2024-09-12T00:41:31.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.982+0000 7ff9d9c4c9c0 20 add_watcher() i=1 2024-09-12T00:41:31.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.982+0000 7ff9d9c4c9c0 20 add_watcher() i=2 2024-09-12T00:41:31.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.982+0000 7ff9d9c4c9c0 20 add_watcher() i=3 2024-09-12T00:41:31.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.982+0000 7ff9d9c4c9c0 20 add_watcher() i=4 2024-09-12T00:41:31.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.982+0000 7ff9d9c4c9c0 20 add_watcher() i=5 2024-09-12T00:41:31.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.982+0000 7ff9d9c4c9c0 20 add_watcher() i=6 2024-09-12T00:41:31.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.986+0000 7ff9d9c4c9c0 20 add_watcher() i=7 2024-09-12T00:41:31.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.986+0000 7ff9d9c4c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:31.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.990+0000 7ff88dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:31.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.990+0000 7ff9d9c4c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:31.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:31.990+0000 7ff9d9c4c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:32.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.082+0000 7ff88cfe1640 20 reqs_thread_entry: start 2024-09-12T00:41:32.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.082+0000 7ff9d9c4c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:32.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.082+0000 7ff9d9c4c9c0 20 Filter name: none 2024-09-12T00:41:32.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.082+0000 7ff8067fc640 20 reqs_thread_entry: start 2024-09-12T00:41:32.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.082+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:41:32.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.086+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.090+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.090+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:41:32.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.090+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17149201718960481642', time=2024-09-12T02:32:40.917806+0000, chain.objs.size()=4 2024-09-12T00:41:32.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.090+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.11__multipart_foo.2~yFIawm4Cml9QlqvSLxUhOYK--iD7TE8.1 2024-09-12T00:41:32.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.090+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.11__multipart_foo.2~yFIawm4Cml9QlqvSLxUhOYK--iD7TE8.2 2024-09-12T00:41:32.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.090+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.11__multipart_foo.2~yFIawm4Cml9QlqvSLxUhOYK--iD7TE8.3 2024-09-12T00:41:32.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.090+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.11__multipart_foo.2~yFIawm4Cml9QlqvSLxUhOYK--iD7TE8.4 2024-09-12T00:41:32.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.090+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6778104730770828000', time=2024-09-12T02:32:41.088268+0000, chain.objs.size()=4 2024-09-12T00:41:32.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.090+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.9__multipart_foo.2~ZQqvXKRGG2dbphRp-UPAHwpkHuK3IyX.1 2024-09-12T00:41:32.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.090+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.9__multipart_foo.2~ZQqvXKRGG2dbphRp-UPAHwpkHuK3IyX.2 2024-09-12T00:41:32.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.090+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.9__multipart_foo.2~ZQqvXKRGG2dbphRp-UPAHwpkHuK3IyX.3 2024-09-12T00:41:32.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.090+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.9__multipart_foo.2~ZQqvXKRGG2dbphRp-UPAHwpkHuK3IyX.4 2024-09-12T00:41:32.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.090+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_VFal-R_a25MO2z2Wg2JoaTKr_a-qd1k', time=2024-09-12T02:32:41.140994+0000, chain.objs.size()=1 2024-09-12T00:41:32.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.090+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.lAgEwnqy6Mu8-sAcT0XZAmeS3sBCsQN_0 2024-09-12T00:41:32.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.090+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_Q2AzhjWyRNThhLx540lV7GMqfWkuR8a', time=2024-09-12T02:32:41.339983+0000, chain.objs.size()=2 2024-09-12T00:41:32.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.090+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.ooyVsjR6SK5e434lfX5NZCQGdTOUy_v_0 2024-09-12T00:41:32.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.094+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.ooyVsjR6SK5e434lfX5NZCQGdTOUy_v_1 2024-09-12T00:41:32.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.094+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17154708064742342378', time=2024-09-12T02:34:01.432822+0000, chain.objs.size()=1 2024-09-12T00:41:32.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.094+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.ODt5-R9TuFVOg5zWab8C8mj1fuXNyIw_0 2024-09-12T00:41:32.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.098+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15101400389568381991', time=2024-09-12T02:35:49.650125+0000, chain.objs.size()=1 2024-09-12T00:41:32.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.098+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.MUBQPcHSNuEY6c04HjjnPd1cscIGGMD_0 2024-09-12T00:41:32.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.102+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5815039784992614431', time=2024-09-12T02:36:22.076255+0000, chain.objs.size()=1 2024-09-12T00:41:32.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.102+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.C_zKgptn5zQriycsX84ScdaFVLE-lR-_0 2024-09-12T00:41:32.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.102+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12114366805989351461', time=2024-09-12T02:36:22.101853+0000, chain.objs.size()=1 2024-09-12T00:41:32.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.102+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.MyNX6t7jllKW6kOyyzqW6vbIcJ5jhTt_0 2024-09-12T00:41:32.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.102+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13232543452474274317', time=2024-09-12T02:37:34.501601+0000, chain.objs.size()=1 2024-09-12T00:41:32.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.102+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.ijGSdiKPYTcDgyvr7NjRZYkPaXXSsO6_0 2024-09-12T00:41:32.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.102+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17305564390221158331', time=2024-09-12T02:38:12.675658+0000, chain.objs.size()=1 2024-09-12T00:41:32.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.102+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.1WUA_8ab0pB9V8KtsGTvsNV_ew0wY3O_0 2024-09-12T00:41:32.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.102+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13339246895904146973', time=2024-09-12T02:38:14.527430+0000, chain.objs.size()=1 2024-09-12T00:41:32.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.102+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.IKJKA9H5EXiW23W8ezft5fuoNKsPBQS_0 2024-09-12T00:41:32.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.102+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15151030793648089052', time=2024-09-12T02:38:14.541891+0000, chain.objs.size()=1 2024-09-12T00:41:32.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.102+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.CeI6djdhEZ6jqMcdXD-iy0wvAypLaG8_0 2024-09-12T00:41:32.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.102+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7169682652065397318', time=2024-09-12T02:38:47.678596+0000, chain.objs.size()=1 2024-09-12T00:41:32.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.102+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.r6aKwW08nAa7BJsCZ0HtxRcC19JO9BR_0 2024-09-12T00:41:32.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.102+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14515712283893246402', time=2024-09-12T02:41:08.670948+0000, chain.objs.size()=1 2024-09-12T00:41:32.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.102+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.18__shadow:euU-tQH5TI1NJ0YoVw6kTKKS6EFTS4z_.azZxTVH_vbXcAg46fXbFfdrWp591DSs_0 2024-09-12T00:41:32.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.114+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:41:32.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:41:32.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3194749336537918555', time=2024-09-12T02:32:41.389897+0000, chain.objs.size()=3 2024-09-12T00:41:32.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-LUKEWARM.2~Ig4ng87RG8L0NSDx3lH7mxAfoUO2r8C.1 2024-09-12T00:41:32.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-LUKEWARM.2~Ig4ng87RG8L0NSDx3lH7mxAfoUO2r8C.2 2024-09-12T00:41:32.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-LUKEWARM.2~Ig4ng87RG8L0NSDx3lH7mxAfoUO2r8C.3 2024-09-12T00:41:32.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1448584078237280024', time=2024-09-12T02:34:01.433148+0000, chain.objs.size()=1 2024-09-12T00:41:32.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.vfjffQ-VTcy1XEIBun1flgrQ6Gst1Ax_0 2024-09-12T00:41:32.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11554215474317580312', time=2024-09-12T02:34:01.454673+0000, chain.objs.size()=1 2024-09-12T00:41:32.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.jSF8OxzSlQfAcDv-EaQOtZC4B7gJUub_0 2024-09-12T00:41:32.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8056630829420146004', time=2024-09-12T02:34:38.364959+0000, chain.objs.size()=1 2024-09-12T00:41:32.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.RCIxQKw8XZNPejNZMs7O-SsgnhGoK5c_0 2024-09-12T00:41:32.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10892152307454494812', time=2024-09-12T02:34:38.367416+0000, chain.objs.size()=1 2024-09-12T00:41:32.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.5fq-zyqv4Y8GgLgU_btKZfJz3SbQsrP_0 2024-09-12T00:41:32.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1335760934978630331', time=2024-09-12T02:35:10.769853+0000, chain.objs.size()=1 2024-09-12T00:41:32.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.mrXDremARqX_ghJajfMuEAZ8J-4zE4K_0 2024-09-12T00:41:32.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10191934974638222391', time=2024-09-12T02:36:26.448651+0000, chain.objs.size()=1 2024-09-12T00:41:32.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.EDClHghmyhRvPrhGe9rAhE8nlk8eqr5_0 2024-09-12T00:41:32.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3779590659161864037', time=2024-09-12T02:37:01.587561+0000, chain.objs.size()=1 2024-09-12T00:41:32.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.4fGU0afLQu5hw7vSdWO6GVuPK2mQXbs_0 2024-09-12T00:41:32.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3328604747044453212', time=2024-09-12T02:37:34.511913+0000, chain.objs.size()=1 2024-09-12T00:41:32.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.mM_6pKQT-SFqPmmTkmmuFx0WQMjhlMw_0 2024-09-12T00:41:32.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1435581916483759468', time=2024-09-12T02:37:34.528916+0000, chain.objs.size()=1 2024-09-12T00:41:32.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.122+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.bCWUGt78lnfBW2s-M-n3kDkAn04Fr6k_0 2024-09-12T00:41:32.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.130+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11030241195126837174', time=2024-09-12T02:37:37.227698+0000, chain.objs.size()=1 2024-09-12T00:41:32.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.130+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.GAwCOLPhh9OmoLTXHMp-6CeleHFMxqg_0 2024-09-12T00:41:32.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.130+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17677886514625160546', time=2024-09-12T02:38:10.166470+0000, chain.objs.size()=1 2024-09-12T00:41:32.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.130+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.N6xcu6bFzdan8eItwclpg-3VtwXfhYy_0 2024-09-12T00:41:32.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.130+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3145737528553716762', time=2024-09-12T02:38:14.531063+0000, chain.objs.size()=1 2024-09-12T00:41:32.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.130+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.jlj2tpi36w65hKYwOWDNbZ4DUGQSA___0 2024-09-12T00:41:32.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.138+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.142+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:41:32.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.142+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T00:41:32.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12031010731933369408', time=2024-09-12T02:32:41.188971+0000, chain.objs.size()=1 2024-09-12T00:41:32.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.SNS6g_WYMoNKmqZnx_HExn_xLNeV6gg_0 2024-09-12T00:41:32.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8643553911065858245', time=2024-09-12T02:32:41.471005+0000, chain.objs.size()=3 2024-09-12T00:41:32.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-STANDARD.2~W4ExblD_SyqQ0ZCGNNWLsaqXTJMYRE1.1 2024-09-12T00:41:32.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-STANDARD.2~W4ExblD_SyqQ0ZCGNNWLsaqXTJMYRE1.2 2024-09-12T00:41:32.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-STANDARD.2~W4ExblD_SyqQ0ZCGNNWLsaqXTJMYRE1.3 2024-09-12T00:41:32.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8059738039235791564', time=2024-09-12T02:34:01.438071+0000, chain.objs.size()=1 2024-09-12T00:41:32.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.8vhrOEBarBq2ApF53oEb-GeQ32sKqWK_0 2024-09-12T00:41:32.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9416543117139811950', time=2024-09-12T02:34:36.518681+0000, chain.objs.size()=1 2024-09-12T00:41:32.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.TdE775VG-EDWfGU06XSx4jTmFITN-Hd_0 2024-09-12T00:41:32.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16978259044348365865', time=2024-09-12T02:35:12.857994+0000, chain.objs.size()=1 2024-09-12T00:41:32.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.ku1bWlJ8eS2nb_5uAojgC57ChKD5HLr_0 2024-09-12T00:41:32.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16225086467793316544', time=2024-09-12T02:35:51.190772+0000, chain.objs.size()=1 2024-09-12T00:41:32.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.MVcAtvisR80PVlM2PPkI6NHFsyyTAJa_0 2024-09-12T00:41:32.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12880825282795273963', time=2024-09-12T02:36:59.006743+0000, chain.objs.size()=1 2024-09-12T00:41:32.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.0xzjJ92ju3SjEwju_Mobrx8qKuB8FSa_0 2024-09-12T00:41:32.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9152896539519284451', time=2024-09-12T02:37:34.521248+0000, chain.objs.size()=1 2024-09-12T00:41:32.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.w69uPOYhNqlM3_Y7ARPQGyD1lkRVlxL_0 2024-09-12T00:41:32.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12215578019157824144', time=2024-09-12T02:38:14.539990+0000, chain.objs.size()=1 2024-09-12T00:41:32.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.UiFZr5UMTGAH2z_OyZ0TLx-qLRNYRAW_0 2024-09-12T00:41:32.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13976138535640947886', time=2024-09-12T02:38:14.547770+0000, chain.objs.size()=1 2024-09-12T00:41:32.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.146+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.nWSh-fFVwDaofmENc7y4LiERJmj1yJl_0 2024-09-12T00:41:32.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.158+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.162+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:41:32.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T00:41:32.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2901422447214724617', time=2024-09-12T02:32:40.861915+0000, chain.objs.size()=1 2024-09-12T00:41:32.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.DGp0Cwqlu4h-ZRI0vGD8IPUKT_nbNTY_0 2024-09-12T00:41:32.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7316250971046919796', time=2024-09-12T02:33:59.854075+0000, chain.objs.size()=1 2024-09-12T00:41:32.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.fKb73Th9cGstDG9lZHJ10RdzElde0Xr_0 2024-09-12T00:41:32.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4193564589949590916', time=2024-09-12T02:33:59.872753+0000, chain.objs.size()=1 2024-09-12T00:41:32.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.wl4QTUpVZNdto6yO6DaxYLHFnNTuq_3_0 2024-09-12T00:41:32.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9079754447920991427', time=2024-09-12T02:34:01.439485+0000, chain.objs.size()=1 2024-09-12T00:41:32.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.YP5wh3dQcs6pb0AsQGbH4V88fejgogw_0 2024-09-12T00:41:32.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9437419209564769748', time=2024-09-12T02:34:34.494044+0000, chain.objs.size()=1 2024-09-12T00:41:32.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.4Y1AYQvgXDArm7JVRHuUO7cSOXOF88Z_0 2024-09-12T00:41:32.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6461222181709789277', time=2024-09-12T02:34:36.508485+0000, chain.objs.size()=1 2024-09-12T00:41:32.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.mUxSJI8zyLFiRj0y-wrn6l7ih2OKtC7_0 2024-09-12T00:41:32.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5830395663077769213', time=2024-09-12T02:34:38.363852+0000, chain.objs.size()=1 2024-09-12T00:41:32.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.QJ5fPaobI9pDxoOHYKXfhBK7KOijLNS_0 2024-09-12T00:41:32.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1496227879040309562', time=2024-09-12T02:34:38.365821+0000, chain.objs.size()=1 2024-09-12T00:41:32.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.xKE0sjaewFnEwFnpVzeUfZ76h5GMhuz_0 2024-09-12T00:41:32.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14687463616980993371', time=2024-09-12T02:34:38.392307+0000, chain.objs.size()=1 2024-09-12T00:41:32.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.S1X60gBVtwKyPrOOtZC9fAU7BjYpV2w_0 2024-09-12T00:41:32.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11278767604311931170', time=2024-09-12T02:34:38.393832+0000, chain.objs.size()=1 2024-09-12T00:41:32.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.Hmhd9jrEqjEyxBiqnCIMIfMwagxsp4j_0 2024-09-12T00:41:32.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17379425020438555596', time=2024-09-12T02:35:10.782212+0000, chain.objs.size()=1 2024-09-12T00:41:32.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.eu0FtiwcFq0_GTFvk3Zb4P2YvxTNHpN_0 2024-09-12T00:41:32.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.538213903720381726', time=2024-09-12T02:35:16.178343+0000, chain.objs.size()=1 2024-09-12T00:41:32.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.166+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_._1ak0RLk8xG0Pu1WZIjKPXLkDThEaOM_0 2024-09-12T00:41:32.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.170+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16838332858368357611', time=2024-09-12T02:35:47.337995+0000, chain.objs.size()=1 2024-09-12T00:41:32.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.174+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.cKvDad21hRmDXfgTaSbPP0MUmgecAEK_0 2024-09-12T00:41:32.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.174+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12653824271387120933', time=2024-09-12T02:35:47.357134+0000, chain.objs.size()=1 2024-09-12T00:41:32.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.174+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.whG4hTiGriXfz3z-QM6pasQgi-Mojo5_0 2024-09-12T00:41:32.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.174+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10967147752073857162', time=2024-09-12T02:35:49.641204+0000, chain.objs.size()=1 2024-09-12T00:41:32.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.174+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.Asov3zCZoOQRNn_sX06-37eFNWGEVaa_0 2024-09-12T00:41:32.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.174+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12773191574381618084', time=2024-09-12T02:36:26.437346+0000, chain.objs.size()=1 2024-09-12T00:41:32.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.174+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.wAwsKkfabGEYxmEOdO4Pff4hJymwkEN_0 2024-09-12T00:41:32.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.174+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14638253553902471071', time=2024-09-12T02:37:01.574045+0000, chain.objs.size()=1 2024-09-12T00:41:32.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.174+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.8hbio_LCY0BU833TKqGQcA8vXb4CSML_0 2024-09-12T00:41:32.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.174+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16274697701136496480', time=2024-09-12T02:37:34.506946+0000, chain.objs.size()=1 2024-09-12T00:41:32.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.178+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.iIYxhOUxj4Aeq-P-3f5-9GYan-iV2R8_0 2024-09-12T00:41:32.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.178+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6791440145939646002', time=2024-09-12T02:37:37.201619+0000, chain.objs.size()=1 2024-09-12T00:41:32.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.178+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.wYjvJ2F9U9AEQ4F6-l3MW0zcz2Dg66N_0 2024-09-12T00:41:32.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.178+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16072696942955982217', time=2024-09-12T02:37:37.229295+0000, chain.objs.size()=1 2024-09-12T00:41:32.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.178+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.p-aI-gVPDB9IBmERHDwVlfZV4LdnIEx_0 2024-09-12T00:41:32.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.178+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14033300537344862653', time=2024-09-12T02:38:10.160050+0000, chain.objs.size()=1 2024-09-12T00:41:32.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.178+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.ScI-5dvUpisS5UfKEQnSk-td_Ry0xjk_0 2024-09-12T00:41:32.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.178+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14749699412778008355', time=2024-09-12T02:38:10.180232+0000, chain.objs.size()=1 2024-09-12T00:41:32.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.178+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.CO2vSclD8zETAQSN4aZ7C5FyQ7Sq14y_0 2024-09-12T00:41:32.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.178+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9661135419312315477', time=2024-09-12T02:38:12.668960+0000, chain.objs.size()=1 2024-09-12T00:41:32.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.178+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.LqoadRYYIEcTZlAFtSLrf_Mnz_etjxB_0 2024-09-12T00:41:32.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.178+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18435071968509449988', time=2024-09-12T02:38:14.542863+0000, chain.objs.size()=1 2024-09-12T00:41:32.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.178+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.Eb01DzS8nuxdGiDys9DzzlGHv9mbFI6_0 2024-09-12T00:41:32.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.182+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15888223310373783264', time=2024-09-12T02:38:16.306268+0000, chain.objs.size()=1 2024-09-12T00:41:32.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.182+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.aIeDrXFs8TXIgaxEtSw9VkhuMrXDd4t_0 2024-09-12T00:41:32.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.182+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6122691490188400661', time=2024-09-12T02:38:47.656883+0000, chain.objs.size()=1 2024-09-12T00:41:32.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.182+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.9uHHxNUKmSP4NVimhzka_QOS1eYhJ3Z_0 2024-09-12T00:41:32.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.186+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10110647308593690796', time=2024-09-12T02:38:47.659316+0000, chain.objs.size()=1 2024-09-12T00:41:32.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.186+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.2QJ7xX9adRnsTzOSnQxf5_xVqsJFq6n_0 2024-09-12T00:41:32.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.194+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.194+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:41:32.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:41:32.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5225341561526337632', time=2024-09-12T02:33:59.857801+0000, chain.objs.size()=1 2024-09-12T00:41:32.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.xoma_yxHJ43FgTYAtNOGJd8tsR2KZbF_0 2024-09-12T00:41:32.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7781661751083028183', time=2024-09-12T02:34:38.365754+0000, chain.objs.size()=1 2024-09-12T00:41:32.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.x3VmNMTFLK9ktL_pnbVhIwcTKJiK_Eb_0 2024-09-12T00:41:32.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15048978743857197425', time=2024-09-12T02:35:14.424379+0000, chain.objs.size()=1 2024-09-12T00:41:32.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.Y0afgTehg1czBtJ43bt1Wc24ceNsmBI_0 2024-09-12T00:41:32.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5942196110785621304', time=2024-09-12T02:35:14.442031+0000, chain.objs.size()=1 2024-09-12T00:41:32.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.MS0LTCoSxHhh-Jv5t0uhCpGZvHbSkEN_0 2024-09-12T00:41:32.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7461050838437799109', time=2024-09-12T02:35:49.654213+0000, chain.objs.size()=1 2024-09-12T00:41:32.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.MPXi5aUO1zxsrpgrcOArbRzvRIpqQNa_0 2024-09-12T00:41:32.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5178558042962312147', time=2024-09-12T02:36:59.004756+0000, chain.objs.size()=1 2024-09-12T00:41:32.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.gvL7m-UxE7xjMKDK2XlYUDya3R_T2gc_0 2024-09-12T00:41:32.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18239585850523573051', time=2024-09-12T02:37:01.586588+0000, chain.objs.size()=1 2024-09-12T00:41:32.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.w3TdJ9VxogWyo4sdPEjTsPO6TS-tZiy_0 2024-09-12T00:41:32.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15274349441641346515', time=2024-09-12T02:37:34.522516+0000, chain.objs.size()=1 2024-09-12T00:41:32.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.QoOyJAyqL-wlOIFT64MiQwYxxYNLkg2_0 2024-09-12T00:41:32.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4938688467951336950', time=2024-09-12T02:38:12.665338+0000, chain.objs.size()=1 2024-09-12T00:41:32.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.riOyV22S0UC6UxwEULAwNz4nScMWjdD_0 2024-09-12T00:41:32.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4071531848047670259', time=2024-09-12T02:38:14.534161+0000, chain.objs.size()=1 2024-09-12T00:41:32.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.iHTxRwQ9EgrG46wioX0ZixCfdp_Fn7q_0 2024-09-12T00:41:32.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9034076469032755731', time=2024-09-12T02:38:14.548306+0000, chain.objs.size()=1 2024-09-12T00:41:32.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.JNwh-mHiZP966M5N4BtxPKbK-UN_7WW_0 2024-09-12T00:41:32.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15195728494414491608', time=2024-09-12T02:38:47.659566+0000, chain.objs.size()=1 2024-09-12T00:41:32.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.198+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.p4Iz3ltQOttP-sBTHQ0uluIxJcf94I2_0 2024-09-12T00:41:32.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.206+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7215315885634194306', time=2024-09-12T02:41:03.291242+0000, chain.objs.size()=1 2024-09-12T00:41:32.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.206+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.18__shadow:dbj.feTrbH0Xq9N18t600vLId-mVDOs_.MF8xMgTduX9X8D84x25hvstGmmNz7V2_0 2024-09-12T00:41:32.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.206+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.739265685745648971', time=2024-09-12T02:41:08.666639+0000, chain.objs.size()=1 2024-09-12T00:41:32.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.206+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.18__shadow:4L3nL3WTNjnihxL3UDYUZyaS0V3Q-vV_.WN_rFpQkCLUXmlO2LMX4YMLrqg17mRx_0 2024-09-12T00:41:32.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.210+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.214+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:41:32.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.214+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:41:32.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3059281410891117616', time=2024-09-12T02:32:41.219847+0000, chain.objs.size()=1 2024-09-12T00:41:32.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.SNS6g_WYMoNKmqZnx_HExn_xLNeV6gg_0 2024-09-12T00:41:32.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4732516424218184280', time=2024-09-12T02:32:41.251581+0000, chain.objs.size()=1 2024-09-12T00:41:32.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.b5LaxNOZE5VW8zuIdU0s0JqxCyNtiAL_0 2024-09-12T00:41:32.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6820297438831168845', time=2024-09-12T02:32:41.542233+0000, chain.objs.size()=2 2024-09-12T00:41:32.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.13__shadow_.ODf01ypyHwh9vZzUF7yGHwhLWZPNQgZ_0 2024-09-12T00:41:32.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.13__shadow_.ODf01ypyHwh9vZzUF7yGHwhLWZPNQgZ_1 2024-09-12T00:41:32.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13278403260225882329', time=2024-09-12T02:33:59.864708+0000, chain.objs.size()=1 2024-09-12T00:41:32.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.GqnZIOxbJWkxlorkfdjvdDOZiiltu82_0 2024-09-12T00:41:32.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5515958900135302991', time=2024-09-12T02:34:36.496423+0000, chain.objs.size()=1 2024-09-12T00:41:32.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.3il76Qag8usR_GvdxNe2F_4SPEvz44L_0 2024-09-12T00:41:32.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10146620230419125280', time=2024-09-12T02:35:10.782862+0000, chain.objs.size()=1 2024-09-12T00:41:32.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.lzWVGndwCZvaLs-CegAZcFHYcunaMcG_0 2024-09-12T00:41:32.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11785536251607226234', time=2024-09-12T02:35:14.437962+0000, chain.objs.size()=1 2024-09-12T00:41:32.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.vpN8ebUDiB-pooN7tNYrYUKofQxzeFc_0 2024-09-12T00:41:32.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7656357719593367307', time=2024-09-12T02:35:47.329834+0000, chain.objs.size()=1 2024-09-12T00:41:32.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.-SSp8vFxihjAq0RqVTGRtneEqpZ-F9Y_0 2024-09-12T00:41:32.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3901828702107091494', time=2024-09-12T02:35:49.637973+0000, chain.objs.size()=1 2024-09-12T00:41:32.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.ZHCyBsccrlSLVaJasNlwmPru_boGdS-_0 2024-09-12T00:41:32.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12439104885937929316', time=2024-09-12T02:35:49.658375+0000, chain.objs.size()=1 2024-09-12T00:41:32.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.g6Eno0itV9BNhvrlKapxBWX15eoTXyB_0 2024-09-12T00:41:32.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14138514212465378407', time=2024-09-12T02:35:49.663919+0000, chain.objs.size()=1 2024-09-12T00:41:32.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.218+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.2X4uWbYYN_B3XHps4i5gWUyJHrB6gJr_0 2024-09-12T00:41:32.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.222+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15004360073254965722', time=2024-09-12T02:36:26.428137+0000, chain.objs.size()=1 2024-09-12T00:41:32.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.222+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.aWN6HDRx8eKwUchCcG0QZv3sZ8ke62B_0 2024-09-12T00:41:32.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.222+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4004678773803887410', time=2024-09-12T02:36:59.018877+0000, chain.objs.size()=1 2024-09-12T00:41:32.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.222+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.EUOZQkx0TVj96e_z6zIpGr69172Spey_0 2024-09-12T00:41:32.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.222+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11345643624598054324', time=2024-09-12T02:37:37.208754+0000, chain.objs.size()=1 2024-09-12T00:41:32.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.222+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.XsZo68HO18O7e07c4i2xUF-wJ2Z-lTJ_0 2024-09-12T00:41:32.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.222+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13817261641717245685', time=2024-09-12T02:37:37.224289+0000, chain.objs.size()=1 2024-09-12T00:41:32.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.222+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.oAslovpTbExExeMHJhjEdW2h08lxkEU_0 2024-09-12T00:41:32.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.222+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10673990362813918061', time=2024-09-12T02:38:10.158369+0000, chain.objs.size()=1 2024-09-12T00:41:32.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.222+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.-APuJnPPETpUakFDhrbD2SUhASbwuEs_0 2024-09-12T00:41:32.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.226+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3599433779518005611', time=2024-09-12T02:38:10.183691+0000, chain.objs.size()=1 2024-09-12T00:41:32.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.226+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.Wn-Jh8V5hkZRxmbLwKJRhfcJXebHBVa_0 2024-09-12T00:41:32.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.226+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5581595013789792599', time=2024-09-12T02:38:12.681824+0000, chain.objs.size()=1 2024-09-12T00:41:32.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.226+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.Ln4qkXLlQrivAcXbySkZYF4lDM5RJfU_0 2024-09-12T00:41:32.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.226+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1866355305226238101', time=2024-09-12T02:38:47.670667+0000, chain.objs.size()=1 2024-09-12T00:41:32.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.226+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.2P_YFqNLPb0kjPrx8vcFRbaASejjaNc_0 2024-09-12T00:41:32.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.226+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16134561380089644917', time=2024-09-12T02:40:55.193961+0000, chain.objs.size()=1 2024-09-12T00:41:32.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.226+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.17__shadow_.ADUchlxS13WUZ98Vpkf7agjUIR7s961_0 2024-09-12T00:41:32.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.230+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.234+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:41:32.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.234+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:41:32.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.712897401714332966', time=2024-09-12T02:33:59.855262+0000, chain.objs.size()=1 2024-09-12T00:41:32.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.zLGN7hmqgL4RB_ZjiOMkklhyvztAG9i_0 2024-09-12T00:41:32.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8538334626674159255', time=2024-09-12T02:34:01.438297+0000, chain.objs.size()=1 2024-09-12T00:41:32.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.fMHA8MEIkwlxaADb3yQSGsI8m1SN5d-_0 2024-09-12T00:41:32.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14961944806837660963', time=2024-09-12T02:34:01.444857+0000, chain.objs.size()=1 2024-09-12T00:41:32.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.47hwLB1GF17gXOToVOHV14O410nNjTi_0 2024-09-12T00:41:32.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3489640707858712912', time=2024-09-12T02:34:36.495372+0000, chain.objs.size()=1 2024-09-12T00:41:32.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.TT6PeX6H6_TmBnTXxw5udzx4QWtqJEj_0 2024-09-12T00:41:32.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4504003149433412366', time=2024-09-12T02:34:38.368160+0000, chain.objs.size()=1 2024-09-12T00:41:32.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.uaMj8bkHCKjHPVdBaLMZEgO8lWCjsIG_0 2024-09-12T00:41:32.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10582874413983074855', time=2024-09-12T02:35:12.128614+0000, chain.objs.size()=1 2024-09-12T00:41:32.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.qmhR0yZUkDHDl8bJw9aYQRo2tebQslY_0 2024-09-12T00:41:32.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11749842665903232531', time=2024-09-12T02:35:12.850443+0000, chain.objs.size()=1 2024-09-12T00:41:32.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.p4TA4mg_MQX6CY6nnNX7WO7lLB37Ovw_0 2024-09-12T00:41:32.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4507647577962397212', time=2024-09-12T02:35:47.340604+0000, chain.objs.size()=1 2024-09-12T00:41:32.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.M1vwbJrdlzF0qiqpLM5CLJXPrTiAzIg_0 2024-09-12T00:41:32.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11774273522270744260', time=2024-09-12T02:35:47.356178+0000, chain.objs.size()=1 2024-09-12T00:41:32.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.kcAyf4Mo9UUf8iaRsus4_qB2bm2irU4_0 2024-09-12T00:41:32.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11812684357478090547', time=2024-09-12T02:36:22.079145+0000, chain.objs.size()=1 2024-09-12T00:41:32.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.qah4JYRKsG6EbBkz1Nk_EP_ja9AxZ2a_0 2024-09-12T00:41:32.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14011197925806112117', time=2024-09-12T02:36:22.082284+0000, chain.objs.size()=1 2024-09-12T00:41:32.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.ldlrJkKUpOmsh1jEWurGh86AmLg4Cz0_0 2024-09-12T00:41:32.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9093850690287850952', time=2024-09-12T02:37:01.578861+0000, chain.objs.size()=1 2024-09-12T00:41:32.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.238+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.ayh3QvgOhBhVbizRgaPAxO5lHzXXLdx_0 2024-09-12T00:41:32.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.242+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3711224305773781648', time=2024-09-12T02:37:34.502313+0000, chain.objs.size()=1 2024-09-12T00:41:32.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.242+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.jvEZYneS2zoRmESpkAWRVwNM3JciVDV_0 2024-09-12T00:41:32.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.242+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2921732890167812250', time=2024-09-12T02:37:34.510439+0000, chain.objs.size()=1 2024-09-12T00:41:32.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.242+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.YDkVzckytFpUppiIBbgwIae6D91zTRV_0 2024-09-12T00:41:32.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.242+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.880778644777959784', time=2024-09-12T02:37:37.197984+0000, chain.objs.size()=1 2024-09-12T00:41:32.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.242+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.mgh8z6NCKXD8Ol9fwj5kTloQIK9i_ae_0 2024-09-12T00:41:32.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.242+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16682836662738008233', time=2024-09-12T02:38:12.690050+0000, chain.objs.size()=1 2024-09-12T00:41:32.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.242+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.y8GQWMc74hcz32UDHTc60vhm1BfRelS_0 2024-09-12T00:41:32.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.246+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.250+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:41:32.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:41:32.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8483166802481019742', time=2024-09-12T02:32:40.830268+0000, chain.objs.size()=1 2024-09-12T00:41:32.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.xSkpAdpSRGCPchNhieV-_LpG0YObQ6d_0 2024-09-12T00:41:32.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1601412358892183587', time=2024-09-12T02:34:34.462986+0000, chain.objs.size()=1 2024-09-12T00:41:32.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.S5WmY-EILywo_XFwMwGAXEgm04wIcMm_0 2024-09-12T00:41:32.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4468797911774965834', time=2024-09-12T02:34:36.493935+0000, chain.objs.size()=1 2024-09-12T00:41:32.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.rS5ZJkIQjsBX8dHd-KPsMR_ZoADkBmc_0 2024-09-12T00:41:32.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17905986706960262032', time=2024-09-12T02:35:10.787050+0000, chain.objs.size()=1 2024-09-12T00:41:32.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.F7NDMkTPVp0aLrpfZX4yR1eiedOe4HD_0 2024-09-12T00:41:32.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4614816807798074628', time=2024-09-12T02:35:47.334020+0000, chain.objs.size()=1 2024-09-12T00:41:32.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.Tfzam3VQVt9uX6AlI0qdxkjnUoSob93_0 2024-09-12T00:41:32.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.257907550164567406', time=2024-09-12T02:35:49.657087+0000, chain.objs.size()=1 2024-09-12T00:41:32.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.3ocFafxSJYsGZl0Ths25qiyUiEKI3Yf_0 2024-09-12T00:41:32.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1497365478750362188', time=2024-09-12T02:36:24.822785+0000, chain.objs.size()=1 2024-09-12T00:41:32.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.k2bnDpcLRfuHwk9x1A_QQDDADIgIyXJ_0 2024-09-12T00:41:32.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14307160257750402057', time=2024-09-12T02:36:58.289166+0000, chain.objs.size()=1 2024-09-12T00:41:32.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.zdfST27FzUdI5v80O1widZjAfkK7QHr_0 2024-09-12T00:41:32.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.679547930867448126', time=2024-09-12T02:37:01.560418+0000, chain.objs.size()=1 2024-09-12T00:41:32.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.iqEiJ3BvNAt9lLpmVuGVX2COBGbuN-t_0 2024-09-12T00:41:32.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15748326779227530487', time=2024-09-12T02:37:01.561416+0000, chain.objs.size()=1 2024-09-12T00:41:32.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.M_dUrn0kfpsGC0Ys2UHArMXVdEMxk2o_0 2024-09-12T00:41:32.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2748237187559485252', time=2024-09-12T02:37:01.583061+0000, chain.objs.size()=1 2024-09-12T00:41:32.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.4axn49R5T8Mxe1Nyx_T-m1ZgsYcdaO4_0 2024-09-12T00:41:32.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4784627577871355941', time=2024-09-12T02:37:03.354288+0000, chain.objs.size()=1 2024-09-12T00:41:32.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.254+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.HlP6hs1MBGnixpo75mTvTQbKHmSIU32_0 2024-09-12T00:41:32.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.262+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1058951103005600935', time=2024-09-12T02:37:34.510929+0000, chain.objs.size()=1 2024-09-12T00:41:32.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.262+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.KcufBpytHhElg7TU53BcsIIegwHap2a_0 2024-09-12T00:41:32.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.262+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14946501476091558662', time=2024-09-12T02:37:34.524652+0000, chain.objs.size()=1 2024-09-12T00:41:32.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.262+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.t_JGlaRol-ilK_pqlbDL8CVfwUzLLyZ_0 2024-09-12T00:41:32.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.266+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.270+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:41:32.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.270+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:41:32.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13600555981558945854', time=2024-09-12T02:32:40.805999+0000, chain.objs.size()=1 2024-09-12T00:41:32.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.V3knmeUrwBVxzXN8vDUDubjxwNlas-p_0 2024-09-12T00:41:32.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10485210167183011260', time=2024-09-12T02:33:59.860135+0000, chain.objs.size()=1 2024-09-12T00:41:32.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.OBl0_tjDVDJbDc6FuWSeyy1W1bNjt0r_0 2024-09-12T00:41:32.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8436206409337183818', time=2024-09-12T02:34:34.477290+0000, chain.objs.size()=1 2024-09-12T00:41:32.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.QQ8evbbJ-hYioeGg0iYw1RSPn6aXN4I_0 2024-09-12T00:41:32.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17935350764861200168', time=2024-09-12T02:34:34.486175+0000, chain.objs.size()=1 2024-09-12T00:41:32.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.itjgWIAi7COeob6E_jBIL3q1i30JZgm_0 2024-09-12T00:41:32.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10835398191249137406', time=2024-09-12T02:34:38.371673+0000, chain.objs.size()=1 2024-09-12T00:41:32.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.gpuYiR6-ybx0JHD5TAPD26R7LpDx7y0_0 2024-09-12T00:41:32.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12518377541569791104', time=2024-09-12T02:35:10.775949+0000, chain.objs.size()=1 2024-09-12T00:41:32.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.5RW1FNsRBHOS_m3YOwZPxVH8yvJcA81_0 2024-09-12T00:41:32.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14468442577669146270', time=2024-09-12T02:35:12.851607+0000, chain.objs.size()=1 2024-09-12T00:41:32.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.mIhCeyJE4f1a9B3ww-C2_QPft5OfnyG_0 2024-09-12T00:41:32.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16805023745497486000', time=2024-09-12T02:35:48.938850+0000, chain.objs.size()=1 2024-09-12T00:41:32.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.b768uz5wiXlDSm-lp8cS_fQT6MUfXTr_0 2024-09-12T00:41:32.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2579228959880544987', time=2024-09-12T02:35:49.638358+0000, chain.objs.size()=1 2024-09-12T00:41:32.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.6CdKZJ51iSesRo2s0sNMY8QB42JM05V_0 2024-09-12T00:41:32.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7868245402355046446', time=2024-09-12T02:36:24.818584+0000, chain.objs.size()=1 2024-09-12T00:41:32.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.JfZ6dwT-eFY98OjKk1a0N_KFAsksqiu_0 2024-09-12T00:41:32.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2999400589861019122', time=2024-09-12T02:36:24.830211+0000, chain.objs.size()=1 2024-09-12T00:41:32.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.xUqhM8JB2x78SbR8CgE_BqtE0oM4OPS_0 2024-09-12T00:41:32.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14631510063174559347', time=2024-09-12T02:36:26.438020+0000, chain.objs.size()=1 2024-09-12T00:41:32.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.274+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.NOMIM7y1JI7qKJC2BZHpQYNhDUvnOXQ_0 2024-09-12T00:41:32.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.278+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12202375493464538235', time=2024-09-12T02:37:34.502758+0000, chain.objs.size()=1 2024-09-12T00:41:32.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.278+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.Vm33ktzUT9BzUMbYuL452LwHGmE2y8s_0 2024-09-12T00:41:32.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.278+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1102836374285576831', time=2024-09-12T02:37:36.283309+0000, chain.objs.size()=1 2024-09-12T00:41:32.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.278+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.kGXhIrd4Ue4Sdz1MUR1d4kqXk4jJOlU_0 2024-09-12T00:41:32.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.278+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13582602753215730384', time=2024-09-12T02:38:12.694666+0000, chain.objs.size()=1 2024-09-12T00:41:32.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.278+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.OVm5ak0JdrJdBROSwDC4_NBTsdauxco_0 2024-09-12T00:41:32.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.278+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6466436076584942761', time=2024-09-12T02:38:14.538723+0000, chain.objs.size()=1 2024-09-12T00:41:32.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.278+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.R87feEiL3WAOWdvopYyJp_OjaKP8kMm_0 2024-09-12T00:41:32.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.282+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.286+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:41:32.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.286+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.286+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:41:32.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13532773913651647958', time=2024-09-12T02:32:40.852079+0000, chain.objs.size()=1 2024-09-12T00:41:32.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.cmVeQo4vVY6HX5GLa1x8cMsz6oqa_oy_0 2024-09-12T00:41:32.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14117658751077289386', time=2024-09-12T02:32:41.229545+0000, chain.objs.size()=1 2024-09-12T00:41:32.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.sdXlQdmJ6nd-geqI4iqus6ByaUH1SLr_0 2024-09-12T00:41:32.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6188920870170586014', time=2024-09-12T02:32:41.684794+0000, chain.objs.size()=1 2024-09-12T00:41:32.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.7__shadow_.ek7FdOdF-5b2klEnCX9x0JGeh6Cdffz_0 2024-09-12T00:41:32.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13260711140020262576', time=2024-09-12T02:34:01.430610+0000, chain.objs.size()=1 2024-09-12T00:41:32.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.D8z4d2PnaSgfI7hgCs4VnZ1TEcivbJk_0 2024-09-12T00:41:32.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8655240408814264774', time=2024-09-12T02:34:35.812809+0000, chain.objs.size()=1 2024-09-12T00:41:32.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.imlnCBGc4srRw_x_nFQ60hpDMGEv0C9_0 2024-09-12T00:41:32.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1533115767056316903', time=2024-09-12T02:34:38.384120+0000, chain.objs.size()=1 2024-09-12T00:41:32.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.VhZNkhkaVnP8TI2MU6r_1rcdGzLK4tu_0 2024-09-12T00:41:32.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.384110707881459811', time=2024-09-12T02:35:10.782500+0000, chain.objs.size()=1 2024-09-12T00:41:32.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.D7gaqDyJnqF2zuAe43Pf2t9XAFi9kcM_0 2024-09-12T00:41:32.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6481419313948974818', time=2024-09-12T02:35:12.853087+0000, chain.objs.size()=1 2024-09-12T00:41:32.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.Ds_yxWEK-oxxgRB4Rkb1ZX3SP61f5rK_0 2024-09-12T00:41:32.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10499314499184094042', time=2024-09-12T02:35:47.336936+0000, chain.objs.size()=1 2024-09-12T00:41:32.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.1rOlXiGl17fYChtKjDZO45689QUx3Dv_0 2024-09-12T00:41:32.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8434537689815078426', time=2024-09-12T02:35:49.641414+0000, chain.objs.size()=1 2024-09-12T00:41:32.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.QsxAGAD8hZYm2PS7AJzN5_T60lcga0V_0 2024-09-12T00:41:32.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13048675904649958260', time=2024-09-12T02:35:49.644683+0000, chain.objs.size()=1 2024-09-12T00:41:32.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.AxC7yQqr8nijM7vFVsfbAz-yttPuN7N_0 2024-09-12T00:41:32.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18134986023375060982', time=2024-09-12T02:35:49.648047+0000, chain.objs.size()=1 2024-09-12T00:41:32.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.290+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.er8eh8Wj7bVespavpUWUJMSi6_l8eEb_0 2024-09-12T00:41:32.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.294+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8042232423002030308', time=2024-09-12T02:35:49.663008+0000, chain.objs.size()=1 2024-09-12T00:41:32.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.294+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.wREQ35ye1e5tuDSmgOAHmC7lsJbnKrJ_0 2024-09-12T00:41:32.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.294+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12704908758761157395', time=2024-09-12T02:36:26.434948+0000, chain.objs.size()=1 2024-09-12T00:41:32.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.294+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.gnSHszge-Nyh8KIZoQr25Ox1Za7kqiq_0 2024-09-12T00:41:32.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.294+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6673336195986728251', time=2024-09-12T02:36:59.005546+0000, chain.objs.size()=1 2024-09-12T00:41:32.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.294+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.Lf1-4zTamOFq2sxe3RCQ7qCpLfzExIL_0 2024-09-12T00:41:32.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.294+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10528513914667785221', time=2024-09-12T02:37:01.561243+0000, chain.objs.size()=1 2024-09-12T00:41:32.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.294+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.Zgk5Lh_j0tYcpaYQrdigAIk9yKBVVsX_0 2024-09-12T00:41:32.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.294+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12746797945549938967', time=2024-09-12T02:37:01.563740+0000, chain.objs.size()=1 2024-09-12T00:41:32.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.294+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.SyneTDCsnCqDdOCEMFL4OhuJqdbtlfK_0 2024-09-12T00:41:32.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.294+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3767444267748929393', time=2024-09-12T02:37:34.517282+0000, chain.objs.size()=1 2024-09-12T00:41:32.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.294+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.SodkvRmjEQ_FyTzNz5llqriRsq9JcIM_0 2024-09-12T00:41:32.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.294+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9609903875402241675', time=2024-09-12T02:38:12.675403+0000, chain.objs.size()=1 2024-09-12T00:41:32.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.294+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.6DOnXHJaHl2J90i8gKooJ2GfGhbxXjM_0 2024-09-12T00:41:32.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.294+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16548032718461319876', time=2024-09-12T02:38:14.555696+0000, chain.objs.size()=1 2024-09-12T00:41:32.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.294+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.cfqzqy4nBorumdsgiCpw3UT8jOBdkwn_0 2024-09-12T00:41:32.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.302+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.302+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:41:32.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T00:41:32.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7657259465771134690', time=2024-09-12T02:34:36.502299+0000, chain.objs.size()=1 2024-09-12T00:41:32.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.l193Whr9kJ2HPvE8YCZ-dwdYNkBbKiH_0 2024-09-12T00:41:32.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17233338413726163713', time=2024-09-12T02:34:38.371367+0000, chain.objs.size()=1 2024-09-12T00:41:32.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.3mSJ3dkBEUBc2ZC3PCz5hXRDNmvdFMZ_0 2024-09-12T00:41:32.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7218310755406125724', time=2024-09-12T02:35:14.434848+0000, chain.objs.size()=1 2024-09-12T00:41:32.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.UVnuf6mOM517lgtsp0jReOHilvvgSWa_0 2024-09-12T00:41:32.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11488455355396915866', time=2024-09-12T02:35:47.348320+0000, chain.objs.size()=1 2024-09-12T00:41:32.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.ntSE-hNE2o2yznMExBRKGaRstb_EG2g_0 2024-09-12T00:41:32.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3088575028629696899', time=2024-09-12T02:35:49.647954+0000, chain.objs.size()=1 2024-09-12T00:41:32.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.fDmSFLOkVJPeWzRhmpodyFuOjdy-2JX_0 2024-09-12T00:41:32.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13728765997776788478', time=2024-09-12T02:36:24.817978+0000, chain.objs.size()=1 2024-09-12T00:41:32.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.zuCJ5DH8YP9RP5dZrpxriMeOupvmKSM_0 2024-09-12T00:41:32.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4833921414942549771', time=2024-09-12T02:36:26.416751+0000, chain.objs.size()=1 2024-09-12T00:41:32.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.TNFKuG5yyyw1RBbHPmIbcCgmueKgI-m_0 2024-09-12T00:41:32.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2706756659369424121', time=2024-09-12T02:37:01.579536+0000, chain.objs.size()=1 2024-09-12T00:41:32.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.VR8-h7MeosXcbB5KDFBuW_1p8U7rbs8_0 2024-09-12T00:41:32.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.698120148298768569', time=2024-09-12T02:37:34.526481+0000, chain.objs.size()=1 2024-09-12T00:41:32.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.5CZ-wU42vRaQOuBwps_LBJT2QiniKp1_0 2024-09-12T00:41:32.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8360142050662291206', time=2024-09-12T02:38:11.977152+0000, chain.objs.size()=1 2024-09-12T00:41:32.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.306+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.UW2zA2O5iwWCB8FVQXwfj2G6gSL6DTU_0 2024-09-12T00:41:32.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.310+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:41:32.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:41:32.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16353324678544606605', time=2024-09-12T02:32:41.161486+0000, chain.objs.size()=1 2024-09-12T00:41:32.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.b5LaxNOZE5VW8zuIdU0s0JqxCyNtiAL_0 2024-09-12T00:41:32.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17439981507388714639', time=2024-09-12T02:32:41.707195+0000, chain.objs.size()=1 2024-09-12T00:41:32.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.7__shadow_.RAIvjX3-wXg0EqhW2LTlBC2Y6zoLcNY_0 2024-09-12T00:41:32.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13902784687612969538', time=2024-09-12T02:32:41.806321+0000, chain.objs.size()=1 2024-09-12T00:41:32.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.8__shadow_.RsfktUS5Wm8jzYoCh8NO2D_P3Wez469_0 2024-09-12T00:41:32.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10088897580771912191', time=2024-09-12T02:33:59.855760+0000, chain.objs.size()=1 2024-09-12T00:41:32.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.XHd6NvKjyvbBECKIrp-fAYt_4Cxzhq9_0 2024-09-12T00:41:32.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3633955635287263965', time=2024-09-12T02:34:01.429369+0000, chain.objs.size()=1 2024-09-12T00:41:32.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.ZCui4xnNIhRz_VEb8lXjWOJwpCPwWOI_0 2024-09-12T00:41:32.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11445608858003629183', time=2024-09-12T02:34:01.437570+0000, chain.objs.size()=1 2024-09-12T00:41:32.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.VWHitxoJlQzeBDlgJYh66LkSregyKT2_0 2024-09-12T00:41:32.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10905949881900852456', time=2024-09-12T02:34:36.505380+0000, chain.objs.size()=1 2024-09-12T00:41:32.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.H77thW8yMLct46VX7kuCprfFqvS2Lv-_0 2024-09-12T00:41:32.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2309533352376147776', time=2024-09-12T02:35:10.780228+0000, chain.objs.size()=1 2024-09-12T00:41:32.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.mEMUvovtkEFLAXdcfUsKwcIi5gOA1sE_0 2024-09-12T00:41:32.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10312584629610806633', time=2024-09-12T02:35:10.794938+0000, chain.objs.size()=1 2024-09-12T00:41:32.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.WzpNdDWGx9iicA3M4T1ujJpVHOmMdyk_0 2024-09-12T00:41:32.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10856533736088824852', time=2024-09-12T02:35:10.796544+0000, chain.objs.size()=1 2024-09-12T00:41:32.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.IVsj7dDjEgOIlUxQKI9o3aBZS8FYR5s_0 2024-09-12T00:41:32.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13754467412049899422', time=2024-09-12T02:35:14.424249+0000, chain.objs.size()=1 2024-09-12T00:41:32.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.VT4GkdLfHGwNf3F0tG72tFOQ5cOdYJ-_0 2024-09-12T00:41:32.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4274687334401816664', time=2024-09-12T02:35:47.337072+0000, chain.objs.size()=1 2024-09-12T00:41:32.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.314+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.PpIJaYzeoH5fcytGAISJjgBXggdSF89_0 2024-09-12T00:41:32.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.318+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2005276802446763964', time=2024-09-12T02:35:47.354837+0000, chain.objs.size()=1 2024-09-12T00:41:32.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.318+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_._uva6IWTL1tS7ROv-I7cJk_p4LyI6hg_0 2024-09-12T00:41:32.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.322+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6664328896181147599', time=2024-09-12T02:36:26.430406+0000, chain.objs.size()=1 2024-09-12T00:41:32.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.322+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.Ndz9JIbraONrOZRKLc6RVri-LCNnWN3_0 2024-09-12T00:41:32.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.322+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16310446868447214729', time=2024-09-12T02:36:59.017123+0000, chain.objs.size()=1 2024-09-12T00:41:32.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.322+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.yRpxNchYIaRA-V9V0X6ae7ztY_ADQkt_0 2024-09-12T00:41:32.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.322+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7492795153628486904', time=2024-09-12T02:37:00.636038+0000, chain.objs.size()=1 2024-09-12T00:41:32.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.322+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.ZyVwetajNR3I7N_algsnQItygHiIY3C_0 2024-09-12T00:41:32.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.322+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11192401230693279700', time=2024-09-12T02:37:37.228613+0000, chain.objs.size()=1 2024-09-12T00:41:32.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.322+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.LP2_xowiK5jUBUG_KlfO1E2PG5R_o1a_0 2024-09-12T00:41:32.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.326+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.326+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:41:32.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T00:41:32.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_zYK2a5BsKIbFhiiNGI1J2Zwxku8ltaE', time=2024-09-12T02:32:41.299751+0000, chain.objs.size()=1 2024-09-12T00:41:32.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.W25CuMnbK_25MEa76LGyraJ0WI5LHwh_0 2024-09-12T00:41:32.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12241926498939962583', time=2024-09-12T02:32:41.369533+0000, chain.objs.size()=3 2024-09-12T00:41:32.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-LUKEWARM.2~Ig4ng87RG8L0NSDx3lH7mxAfoUO2r8C.1 2024-09-12T00:41:32.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-LUKEWARM.2~Ig4ng87RG8L0NSDx3lH7mxAfoUO2r8C.2 2024-09-12T00:41:32.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-LUKEWARM.2~Ig4ng87RG8L0NSDx3lH7mxAfoUO2r8C.3 2024-09-12T00:41:32.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17068232136388064307', time=2024-09-12T02:33:59.858129+0000, chain.objs.size()=1 2024-09-12T00:41:32.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.xn4DXbHnOsAKkibfOIkM3BFsn3Q_1jN_0 2024-09-12T00:41:32.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6637861696131465961', time=2024-09-12T02:34:38.366875+0000, chain.objs.size()=1 2024-09-12T00:41:32.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.BfDnlsCNYJJy4-evpmqsui5Vz8IswDW_0 2024-09-12T00:41:32.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6219618433510401701', time=2024-09-12T02:35:10.769375+0000, chain.objs.size()=1 2024-09-12T00:41:32.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.HH-FBnVxwrK1ZVOq6EaFSGTeSxe9IvK_0 2024-09-12T00:41:32.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5071256767618797474', time=2024-09-12T02:35:14.420615+0000, chain.objs.size()=1 2024-09-12T00:41:32.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.vTbi3QR-51ZsE4k7R00QqYGpS8nDqA7_0 2024-09-12T00:41:32.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18213648093088090386', time=2024-09-12T02:35:14.439927+0000, chain.objs.size()=1 2024-09-12T00:41:32.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.QYScynEmqrpTi-zSGG3HD_5Ki3FWw1a_0 2024-09-12T00:41:32.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9740339309832171752', time=2024-09-12T02:36:24.810662+0000, chain.objs.size()=1 2024-09-12T00:41:32.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.UXthFKmWm5SQbeqrXUJlN0OOV49tJGV_0 2024-09-12T00:41:32.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12194468224996068621', time=2024-09-12T02:36:24.828228+0000, chain.objs.size()=1 2024-09-12T00:41:32.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.AWHKIG3Qu0yTt_vLZv3kMRRETptqx4E_0 2024-09-12T00:41:32.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4614376170770091758', time=2024-09-12T02:36:59.026584+0000, chain.objs.size()=1 2024-09-12T00:41:32.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.330+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.qkQrDrpxi4G4OsZ1LRWdDGRv6fjgwrD_0 2024-09-12T00:41:32.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.334+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10560937741951844888', time=2024-09-12T02:37:34.516939+0000, chain.objs.size()=1 2024-09-12T00:41:32.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.334+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.ZtMcwklMMgt0R0mdNpNJsjOtHfnvOIM_0 2024-09-12T00:41:32.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.334+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6888980630141102754', time=2024-09-12T02:37:37.209207+0000, chain.objs.size()=1 2024-09-12T00:41:32.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.334+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.Jq7mZrGRlOeX917ervZRlSUhcKaqk8E_0 2024-09-12T00:41:32.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.334+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17240864799366771988', time=2024-09-12T02:38:10.156308+0000, chain.objs.size()=1 2024-09-12T00:41:32.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.334+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.2gGEbScWyfCc_jfdN-lWIX1Ybx7I_un_0 2024-09-12T00:41:32.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.334+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12893784254019666977', time=2024-09-12T02:38:10.172131+0000, chain.objs.size()=1 2024-09-12T00:41:32.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.334+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.9BOC7ar6AkwaponKL4A3eZtu2FsLOaT_0 2024-09-12T00:41:32.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.334+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6194081189204421248', time=2024-09-12T02:38:10.183409+0000, chain.objs.size()=1 2024-09-12T00:41:32.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.334+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.A08RpyKFEix9UfV-XvQIkMpH7ci-FEL_0 2024-09-12T00:41:32.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.334+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7753671923819558290', time=2024-09-12T02:38:12.672206+0000, chain.objs.size()=1 2024-09-12T00:41:32.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.334+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.GFWLuaiHq4YJdGn2AcH8oAYORFRhQZ8_0 2024-09-12T00:41:32.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.334+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4552404042931195660', time=2024-09-12T02:38:14.551036+0000, chain.objs.size()=1 2024-09-12T00:41:32.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.334+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.d1KU_VP4yBDMKLTFiMRWMqy7lXRv5Y9_0 2024-09-12T00:41:32.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.334+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8710514635212349078', time=2024-09-12T02:38:14.553653+0000, chain.objs.size()=1 2024-09-12T00:41:32.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.334+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.MWSTtRoKGao0xkh7aEsNoxNU9ZvYWKY_0 2024-09-12T00:41:32.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.338+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3913819962382302324', time=2024-09-12T02:38:47.649528+0000, chain.objs.size()=1 2024-09-12T00:41:32.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.338+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.UQHAxfTvYZvgq7ZTdpcovT8gaeqaRk7_0 2024-09-12T00:41:32.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.338+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4547654858564103176', time=2024-09-12T02:38:47.659195+0000, chain.objs.size()=1 2024-09-12T00:41:32.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.338+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.vizNwzpNj4-JkBhVU5sgZNnqvGxXLc9_0 2024-09-12T00:41:32.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.338+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3800552093254807249', time=2024-09-12T02:40:55.195518+0000, chain.objs.size()=1 2024-09-12T00:41:32.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.338+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.17__shadow_.b1aFCAI6wrkSN1uMwFXYOWyI6i4SjT4_0 2024-09-12T00:41:32.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.338+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9585729239461294635', time=2024-09-12T02:41:08.674165+0000, chain.objs.size()=1 2024-09-12T00:41:32.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.338+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.18__shadow:z4iM39iQdMiaSr0IYH77QsMj.i86PtZ_.sC3GZHHSsQnkJIfpUdD7wbqVJa0TqBR_0 2024-09-12T00:41:32.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.346+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.346+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:41:32.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T00:41:32.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5646217842240486457', time=2024-09-12T02:32:40.822659+0000, chain.objs.size()=1 2024-09-12T00:41:32.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.drgdmevXATq9FQwMt-i3-9G8fAUHW_b_0 2024-09-12T00:41:32.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11450409698346634935', time=2024-09-12T02:32:41.695306+0000, chain.objs.size()=1 2024-09-12T00:41:32.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.7__shadow_.4PnT9sqHONWktmgGIQVCSi3Fdazy_4c_0 2024-09-12T00:41:32.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11083655623854992699', time=2024-09-12T02:32:41.771208+0000, chain.objs.size()=1 2024-09-12T00:41:32.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.8__shadow_.N0cxNrp5vTChb9EpN7q6Mx4ag7NhoCm_0 2024-09-12T00:41:32.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12640134750573573243', time=2024-09-12T02:33:59.849305+0000, chain.objs.size()=1 2024-09-12T00:41:32.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.s_GxMxeT7HYJM1Rlmo_vs5tTygyWgU6_0 2024-09-12T00:41:32.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8089445160334113256', time=2024-09-12T02:34:34.469390+0000, chain.objs.size()=1 2024-09-12T00:41:32.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.Gm9m6iq-byTC7INivCNA0fUBrNih-QV_0 2024-09-12T00:41:32.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9136073325914504805', time=2024-09-12T02:34:36.495265+0000, chain.objs.size()=1 2024-09-12T00:41:32.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.E5UYng8qk9G14bVqcp7aosclgUP1TwC_0 2024-09-12T00:41:32.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14487224352489671359', time=2024-09-12T02:34:38.356145+0000, chain.objs.size()=1 2024-09-12T00:41:32.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.MsN5-95PhpdHWFK8CFMC9dT4XHH-8dl_0 2024-09-12T00:41:32.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12410683728913439855', time=2024-09-12T02:34:38.362789+0000, chain.objs.size()=1 2024-09-12T00:41:32.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.Mjyu-ceIOJraOYk1CAH2BFAqaW2g2Pk_0 2024-09-12T00:41:32.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5440414189325060025', time=2024-09-12T02:35:12.848146+0000, chain.objs.size()=1 2024-09-12T00:41:32.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.oYDK5r2jx5B0HIoU5dY4p2KJpeRHn4w_0 2024-09-12T00:41:32.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13893500403198944140', time=2024-09-12T02:35:12.849812+0000, chain.objs.size()=1 2024-09-12T00:41:32.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.eeTEfbFXqCDKnNQGY6Qck8EWgBbdnDP_0 2024-09-12T00:41:32.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6902615973813222160', time=2024-09-12T02:35:14.417123+0000, chain.objs.size()=1 2024-09-12T00:41:32.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_._XlNPnteuiGBo1L5Gf8xq4aAi5JeCBO_0 2024-09-12T00:41:32.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5720323742779638564', time=2024-09-12T02:35:14.427017+0000, chain.objs.size()=1 2024-09-12T00:41:32.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.350+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.MyI4Wr78L4UA2TH8CJzUXW0bLL8tv7m_0 2024-09-12T00:41:32.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3334502738926462529', time=2024-09-12T02:36:22.075826+0000, chain.objs.size()=1 2024-09-12T00:41:32.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.U9KWnDUH9kAPEDs4jW80zaxObobQx4C_0 2024-09-12T00:41:32.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4742874422351269201', time=2024-09-12T02:36:24.846063+0000, chain.objs.size()=1 2024-09-12T00:41:32.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.yB6_ey0UfJP629PtkxHsKeqJBfTgvtA_0 2024-09-12T00:41:32.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18416706664894293354', time=2024-09-12T02:36:26.415938+0000, chain.objs.size()=1 2024-09-12T00:41:32.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.mK034__L32uBOwEWVLprqWnIYpK2e0V_0 2024-09-12T00:41:32.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9048851555620346245', time=2024-09-12T02:37:01.567675+0000, chain.objs.size()=1 2024-09-12T00:41:32.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.egF-jl80t8ZNa_cT5yLdKXWpRjL7bnN_0 2024-09-12T00:41:32.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10104000848378763777', time=2024-09-12T02:37:34.509575+0000, chain.objs.size()=1 2024-09-12T00:41:32.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.YXmTvkWOnQEEzJnpzV-eMMg-5idsrA9_0 2024-09-12T00:41:32.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12203238210969072796', time=2024-09-12T02:37:37.198977+0000, chain.objs.size()=1 2024-09-12T00:41:32.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.WO47fzFXt_8NAKTGcXBGHYHUFvn9DMT_0 2024-09-12T00:41:32.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8218395407073152680', time=2024-09-12T02:38:12.667322+0000, chain.objs.size()=1 2024-09-12T00:41:32.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.mtQhUFKWwSzoU55ENZb71mm2Gv3J35V_0 2024-09-12T00:41:32.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14144624577109703059', time=2024-09-12T02:38:14.538102+0000, chain.objs.size()=1 2024-09-12T00:41:32.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_._O1Qr32sWufjtfbq7nn7di3uO_sM1nw_0 2024-09-12T00:41:32.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5384736404641814349', time=2024-09-12T02:38:14.559983+0000, chain.objs.size()=1 2024-09-12T00:41:32.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.354+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.c-zFv1LmFG2yJT0DScI4lVwtTEwEn64_0 2024-09-12T00:41:32.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.358+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.362+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:41:32.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.362+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T00:41:32.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.158487940789121681', time=2024-09-12T02:34:34.483177+0000, chain.objs.size()=1 2024-09-12T00:41:32.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.x5pvKLgAewDvrxhdH8C3R7H0F00sf5o_0 2024-09-12T00:41:32.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11613300747362313179', time=2024-09-12T02:35:10.785695+0000, chain.objs.size()=1 2024-09-12T00:41:32.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.iVIscY8z93I1i498YBI-ACMZd3UTIIR_0 2024-09-12T00:41:32.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8684294498647300537', time=2024-09-12T02:35:10.798287+0000, chain.objs.size()=1 2024-09-12T00:41:32.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.iQTQ4K1IJugvwpX-9npc4Gkvtdv4V3F_0 2024-09-12T00:41:32.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8284528372874983339', time=2024-09-12T02:35:14.419599+0000, chain.objs.size()=1 2024-09-12T00:41:32.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.XMxOhbrlzjKPwMLGq-VDnJBNKM5bCsR_0 2024-09-12T00:41:32.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17679324687088633670', time=2024-09-12T02:35:47.336966+0000, chain.objs.size()=1 2024-09-12T00:41:32.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.2udP-uDC23M9pDFBKW_feoBaczRDjOV_0 2024-09-12T00:41:32.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11953798607281279668', time=2024-09-12T02:35:49.667514+0000, chain.objs.size()=1 2024-09-12T00:41:32.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.-dvxgO06_BzrfkaWriuD1A4ZSKD0Lfw_0 2024-09-12T00:41:32.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.417537656249687985', time=2024-09-12T02:38:10.171647+0000, chain.objs.size()=1 2024-09-12T00:41:32.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.eILTiVKIyyPmkKc8w_rPlS3P9T88guD_0 2024-09-12T00:41:32.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3774125143806116190', time=2024-09-12T02:38:12.662999+0000, chain.objs.size()=1 2024-09-12T00:41:32.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.dPSSzduvqHxpU4jt9jkITsS1s5V3zB1_0 2024-09-12T00:41:32.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10279540836125935878', time=2024-09-12T02:38:12.668195+0000, chain.objs.size()=1 2024-09-12T00:41:32.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.MXSNnfRKos2YTap4FTviI-8jxTp_MDz_0 2024-09-12T00:41:32.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5874884500097596636', time=2024-09-12T02:38:14.534020+0000, chain.objs.size()=1 2024-09-12T00:41:32.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.knNIzwq85KfXCqs6KRTa4QACnrB2Akj_0 2024-09-12T00:41:32.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4347733239454819818', time=2024-09-12T02:40:55.197915+0000, chain.objs.size()=1 2024-09-12T00:41:32.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.366+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.17__shadow_.B13wqUCGnEiHAI_UQ6C0bMzJzTY_lLt_0 2024-09-12T00:41:32.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.370+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:41:32.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:41:32.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1392201350760281244', time=2024-09-12T02:32:41.318654+0000, chain.objs.size()=3 2024-09-12T00:41:32.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-FROZEN.2~s95WScGF9RVMJsX2bESYT3P5Lp48vCx.1 2024-09-12T00:41:32.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-FROZEN.2~s95WScGF9RVMJsX2bESYT3P5Lp48vCx.2 2024-09-12T00:41:32.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-FROZEN.2~s95WScGF9RVMJsX2bESYT3P5Lp48vCx.3 2024-09-12T00:41:32.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6583575158879278100', time=2024-09-12T02:32:41.349528+0000, chain.objs.size()=3 2024-09-12T00:41:32.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-STANDARD.2~MKryYOMaRoz-AMDa2zkBMNRN7R5s3NY.1 2024-09-12T00:41:32.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-STANDARD.2~MKryYOMaRoz-AMDa2zkBMNRN7R5s3NY.2 2024-09-12T00:41:32.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-STANDARD.2~MKryYOMaRoz-AMDa2zkBMNRN7R5s3NY.3 2024-09-12T00:41:32.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3576042661264886492', time=2024-09-12T02:34:01.435294+0000, chain.objs.size()=1 2024-09-12T00:41:32.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.9yi_Z88g3a03vCQruGVLKpiRXPBIJuX_0 2024-09-12T00:41:32.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8511482444218234695', time=2024-09-12T02:34:34.476759+0000, chain.objs.size()=1 2024-09-12T00:41:32.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.xG6MaDZZFiyJzI5hm2jTreenX5Syejp_0 2024-09-12T00:41:32.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7974379833327356345', time=2024-09-12T02:34:34.489322+0000, chain.objs.size()=1 2024-09-12T00:41:32.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.JpPGRv2lENvZicWyyB_Qc_xZaEziWTy_0 2024-09-12T00:41:32.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5906943540069690199', time=2024-09-12T02:34:36.506455+0000, chain.objs.size()=1 2024-09-12T00:41:32.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.bS9YLcE3Y9sltNHKOqyRxoU17cnaKg2_0 2024-09-12T00:41:32.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1706683608499844271', time=2024-09-12T02:35:12.840569+0000, chain.objs.size()=1 2024-09-12T00:41:32.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.3iXDk53ORRAgwqQsPOt896aDBvsFMk8_0 2024-09-12T00:41:32.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5387857624750398475', time=2024-09-12T02:35:14.426460+0000, chain.objs.size()=1 2024-09-12T00:41:32.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.374+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.uFPqHz2RCIrLQ4jZGqPDtAPxW3hTpQy_0 2024-09-12T00:41:32.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.378+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8653535527532031315', time=2024-09-12T02:35:14.428642+0000, chain.objs.size()=1 2024-09-12T00:41:32.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.378+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.9ZitSWYjPCKsQ-_D4cFt8LB1f1I6OOO_0 2024-09-12T00:41:32.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.378+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9619030294910449784', time=2024-09-12T02:35:14.429417+0000, chain.objs.size()=1 2024-09-12T00:41:32.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.378+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.BtYUhOzN9hzZtQr0AT-QHItmX4KFN0H_0 2024-09-12T00:41:32.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.378+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4844548082562325422', time=2024-09-12T02:36:22.089110+0000, chain.objs.size()=1 2024-09-12T00:41:32.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.378+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.lLpGULJ6dprQjC5mC-EVw67F8TyQwlU_0 2024-09-12T00:41:32.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.378+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14521291988290581618', time=2024-09-12T02:36:22.108937+0000, chain.objs.size()=1 2024-09-12T00:41:32.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.378+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.odfEC5btL0wLOGipskH6e0C1wMNdvXl_0 2024-09-12T00:41:32.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.378+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9467338690540404057', time=2024-09-12T02:36:24.813069+0000, chain.objs.size()=1 2024-09-12T00:41:32.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.378+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.BEMxw8qdiHeSqhFA1e4FwxIqvLQabd4_0 2024-09-12T00:41:32.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.378+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17712299285961408312', time=2024-09-12T02:36:24.838823+0000, chain.objs.size()=1 2024-09-12T00:41:32.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.378+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.wK0a_PUnDU7U8pjP97-UMXj1i77LZel_0 2024-09-12T00:41:32.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.382+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17652285957710841553', time=2024-09-12T02:37:01.570116+0000, chain.objs.size()=1 2024-09-12T00:41:32.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.382+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.H4yZr9zuB7Thek-J8FvkIvqOJ_GQyc6_0 2024-09-12T00:41:32.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.382+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3766887554026460967', time=2024-09-12T02:37:34.511195+0000, chain.objs.size()=1 2024-09-12T00:41:32.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.382+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_._CX0JNHO8NhDAYX3DwZ9dJYbQlnKNdv_0 2024-09-12T00:41:32.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.382+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17923702722403405510', time=2024-09-12T02:37:34.518993+0000, chain.objs.size()=1 2024-09-12T00:41:32.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.382+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.eXOscU801CNBlDi3LQNo37nh3iHuy5u_0 2024-09-12T00:41:32.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.382+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11480766670262071663', time=2024-09-12T02:37:34.530394+0000, chain.objs.size()=1 2024-09-12T00:41:32.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.382+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.7TkR8b06v-5J3XHG2pS1JVPv_XK2XtF_0 2024-09-12T00:41:32.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.382+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1277522691947606054', time=2024-09-12T02:38:14.532488+0000, chain.objs.size()=1 2024-09-12T00:41:32.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.382+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.a9EwCbSsJCLYNQFL1fyC9IK55VNE9Aw_0 2024-09-12T00:41:32.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.386+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:41:32.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T00:41:32.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1496737970527943358', time=2024-09-12T02:34:01.431500+0000, chain.objs.size()=1 2024-09-12T00:41:32.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.1LHr216ApOX3YM8lk6-694Qd5KO21fw_0 2024-09-12T00:41:32.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18202428824865776226', time=2024-09-12T02:34:38.366734+0000, chain.objs.size()=1 2024-09-12T00:41:32.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.b9WXdFlsiDuS7oVVRhBYWKww3iUq_u9_0 2024-09-12T00:41:32.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13279556689161757212', time=2024-09-12T02:36:26.441434+0000, chain.objs.size()=1 2024-09-12T00:41:32.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.uYb7WoZFp4PdzWd30UOXhLAisITVhag_0 2024-09-12T00:41:32.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13560874594888501711', time=2024-09-12T02:37:34.515520+0000, chain.objs.size()=1 2024-09-12T00:41:32.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.34__shadow_.4Bk7Qjcj0VnF1Sb1U7lZIEtrgYN_N1Q_0 2024-09-12T00:41:32.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12360932779190787739', time=2024-09-12T02:38:10.162879+0000, chain.objs.size()=1 2024-09-12T00:41:32.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.dA-Lw6FuCBW6CFD8xEaxC1AuS8ZFiXX_0 2024-09-12T00:41:32.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9829078523274008219', time=2024-09-12T02:38:14.529851+0000, chain.objs.size()=1 2024-09-12T00:41:32.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.vCRaN0WGFAFHltZdqfY10ut6v1vxrxe_0 2024-09-12T00:41:32.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12222546600145733869', time=2024-09-12T02:38:47.673279+0000, chain.objs.size()=1 2024-09-12T00:41:32.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.390+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.HMN8UlmQ_BpfS1XSyayZm7vyYqenEtd_0 2024-09-12T00:41:32.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.394+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.398+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:41:32.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.398+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.398+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:41:32.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5580825776979977128', time=2024-09-12T02:34:34.466851+0000, chain.objs.size()=1 2024-09-12T00:41:32.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.dW64T4f6vGzs1LQlNM5S60kq6_uucwQ_0 2024-09-12T00:41:32.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.729824215035949432', time=2024-09-12T02:34:38.364156+0000, chain.objs.size()=1 2024-09-12T00:41:32.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.JtKdqSYzbT_-fVxvqzbRHCZSVydDJpG_0 2024-09-12T00:41:32.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10884427827782100005', time=2024-09-12T02:34:38.389254+0000, chain.objs.size()=1 2024-09-12T00:41:32.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.hMY1szvO51zS5MwPbfsmoh4Pk_ZNGvm_0 2024-09-12T00:41:32.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6816875441956604380', time=2024-09-12T02:35:10.772885+0000, chain.objs.size()=1 2024-09-12T00:41:32.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.YAUQsJF83ThO7PTG-e40Izn9WPvw2w0_0 2024-09-12T00:41:32.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4794014325974495328', time=2024-09-12T02:35:12.861079+0000, chain.objs.size()=1 2024-09-12T00:41:32.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.dOuSHMu044EDTA81NcyG0UDoSL4Pzql_0 2024-09-12T00:41:32.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11682602405917758788', time=2024-09-12T02:35:49.643694+0000, chain.objs.size()=1 2024-09-12T00:41:32.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.-BC-kRgwDGfmgw66I3Z73V52MrJRukb_0 2024-09-12T00:41:32.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16164717135507636451', time=2024-09-12T02:37:39.001233+0000, chain.objs.size()=1 2024-09-12T00:41:32.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.s3PSwb8nOJSO3JcFDhOLjZc3ZpbCssZ_0 2024-09-12T00:41:32.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16761753763162351364', time=2024-09-12T02:38:12.682211+0000, chain.objs.size()=1 2024-09-12T00:41:32.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.XxUiMTXmvsXG5YiYmxHb8rfCF3xJt9N_0 2024-09-12T00:41:32.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12412647160660246314', time=2024-09-12T02:38:47.659475+0000, chain.objs.size()=1 2024-09-12T00:41:32.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.402+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.eOEKSffE_R70x-pYb6XxdsT77J1Nj-P_0 2024-09-12T00:41:32.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.406+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.406+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:41:32.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T00:41:32.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_xeXAa97skI_H1JWkxSdlo-QZ0-nN6Co', time=2024-09-12T02:32:41.151229+0000, chain.objs.size()=1 2024-09-12T00:41:32.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.ET0K8HLEHTplKnc6cjd8wmxhUkxJt9l_0 2024-09-12T00:41:32.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_q54lexO-AZwGVeNSfwLBHH8XMQ0jExo', time=2024-09-12T02:32:41.200358+0000, chain.objs.size()=1 2024-09-12T00:41:32.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.f8k-Iqvl21J17MPZqy4uIjveTj0B7HE_0 2024-09-12T00:41:32.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_V6bXtOoL2-_lUtdwjJgazuBudTWahv4', time=2024-09-12T02:32:41.240596+0000, chain.objs.size()=1 2024-09-12T00:41:32.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.M_Z-JknBCiXZj_8Eyq7XCy3KzdcAhJf_0 2024-09-12T00:41:32.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12217671696807105053', time=2024-09-12T02:32:41.410000+0000, chain.objs.size()=3 2024-09-12T00:41:32.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-FROZEN.2~s95WScGF9RVMJsX2bESYT3P5Lp48vCx.1 2024-09-12T00:41:32.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-FROZEN.2~s95WScGF9RVMJsX2bESYT3P5Lp48vCx.2 2024-09-12T00:41:32.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-FROZEN.2~s95WScGF9RVMJsX2bESYT3P5Lp48vCx.3 2024-09-12T00:41:32.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5418112830914368439', time=2024-09-12T02:34:34.471328+0000, chain.objs.size()=1 2024-09-12T00:41:32.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.Lb9-bvteMDmtjvOzb8bCRnLs5J5ddnp_0 2024-09-12T00:41:32.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12954668054398904080', time=2024-09-12T02:34:36.504660+0000, chain.objs.size()=1 2024-09-12T00:41:32.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.xcrVFmKeyL1aoBVjADfTqo4sIeVVb95_0 2024-09-12T00:41:32.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16998318526103498206', time=2024-09-12T02:35:10.775156+0000, chain.objs.size()=1 2024-09-12T00:41:32.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.VhVBjEs5vqI-iWPh6LMVhEq3eIxnSLT_0 2024-09-12T00:41:32.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3569867381976885362', time=2024-09-12T02:35:14.417539+0000, chain.objs.size()=1 2024-09-12T00:41:32.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.Bw2SW1xCafz65etlkCr_Ptg0jtGK6gG_0 2024-09-12T00:41:32.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7090832605195215465', time=2024-09-12T02:35:47.329789+0000, chain.objs.size()=1 2024-09-12T00:41:32.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.TbPhzchd5GSk98_YufsckhEa6G4WH4u_0 2024-09-12T00:41:32.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3281219698571022450', time=2024-09-12T02:35:47.339017+0000, chain.objs.size()=1 2024-09-12T00:41:32.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.410+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.zHZ506I2lN0CFhk4Gj1EKsqQeX8T5F7_0 2024-09-12T00:41:32.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13059587339419803523', time=2024-09-12T02:35:49.643895+0000, chain.objs.size()=1 2024-09-12T00:41:32.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.GQkCO4qGCEPj_iWmwyHaG9MGCZlAaLx_0 2024-09-12T00:41:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6206602463328968355', time=2024-09-12T02:36:23.890513+0000, chain.objs.size()=1 2024-09-12T00:41:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.2NbPvi9GaPKh3U8VxPWiWXk3m_tzRv9_0 2024-09-12T00:41:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3686833356407188018', time=2024-09-12T02:36:24.818572+0000, chain.objs.size()=1 2024-09-12T00:41:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.Pa3wvBooVcvW56yUOwGOh1Ktrp4m6IW_0 2024-09-12T00:41:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11290248740887001409', time=2024-09-12T02:36:59.012534+0000, chain.objs.size()=1 2024-09-12T00:41:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.Bpt3QGkAouL-o_erh9aZUdQzz9qkqGv_0 2024-09-12T00:41:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17219206894369362757', time=2024-09-12T02:36:59.023615+0000, chain.objs.size()=1 2024-09-12T00:41:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.HFL5r1MJjQSSdX-KsLci_zKj_9cZWVE_0 2024-09-12T00:41:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8853842116162554877', time=2024-09-12T02:37:01.563586+0000, chain.objs.size()=1 2024-09-12T00:41:32.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.DHArhuOXUPP8XVkAqgXl-kxAYa6qzNE_0 2024-09-12T00:41:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2509623352700983570', time=2024-09-12T02:38:47.655233+0000, chain.objs.size()=1 2024-09-12T00:41:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.ap9_O5qqQwbDnTrGH14Q0ZBOtKSZ_Q6_0 2024-09-12T00:41:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11694040562418762685', time=2024-09-12T02:38:47.657700+0000, chain.objs.size()=1 2024-09-12T00:41:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.DTImhU_YCUy3UAVLNcloIy6d07nI1MA_0 2024-09-12T00:41:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3384878274123400136', time=2024-09-12T02:38:47.665365+0000, chain.objs.size()=1 2024-09-12T00:41:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.vc75Mkk5tkFCKte7EpZzh10VJt_DQ7H_0 2024-09-12T00:41:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.90377154987466269', time=2024-09-12T02:38:47.682397+0000, chain.objs.size()=1 2024-09-12T00:41:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.z5MZ4yxdVcHhKo97JfH8lchQT5FrKul_0 2024-09-12T00:41:32.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10964394572740425435', time=2024-09-12T02:40:55.195270+0000, chain.objs.size()=1 2024-09-12T00:41:32.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.414+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.17__shadow_.RKQAf59eNXVN8FZAEgavJGBw5iZfCVU_0 2024-09-12T00:41:32.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.418+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.682709824634628878', time=2024-09-12T02:40:55.197012+0000, chain.objs.size()=1 2024-09-12T00:41:32.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.418+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.17__shadow_.cFtj_TL2wBs23ek8gDNzDV-jUnePRPo_0 2024-09-12T00:41:32.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.422+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:41:32.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:41:32.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1281051011569598549', time=2024-09-12T02:32:41.552951+0000, chain.objs.size()=2 2024-09-12T00:41:32.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.13__shadow_.J3UEipnnch0EZvB6LKuRptCylFBVX-w_0 2024-09-12T00:41:32.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.13__shadow_.J3UEipnnch0EZvB6LKuRptCylFBVX-w_1 2024-09-12T00:41:32.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12212613199359748361', time=2024-09-12T02:34:01.434732+0000, chain.objs.size()=1 2024-09-12T00:41:32.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.baHXmz_izSNVxc1PzmRk5Q3Rnd3XWYa_0 2024-09-12T00:41:32.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16650103436473666238', time=2024-09-12T02:34:34.479525+0000, chain.objs.size()=1 2024-09-12T00:41:32.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.QONorFcyaaadJubJPvdPw3ibX7vAo4M_0 2024-09-12T00:41:32.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2160620660837462075', time=2024-09-12T02:34:36.508113+0000, chain.objs.size()=1 2024-09-12T00:41:32.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.tkNsBKEMklZADX3HVcYWBH0Js5kEAPU_0 2024-09-12T00:41:32.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.130195408304281461', time=2024-09-12T02:34:36.518025+0000, chain.objs.size()=1 2024-09-12T00:41:32.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.2gkc8WCiR4qiFy-VPhwGY86Xy8hQWGj_0 2024-09-12T00:41:32.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6681308842958988997', time=2024-09-12T02:34:38.367224+0000, chain.objs.size()=1 2024-09-12T00:41:32.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.4NALm_tyJer94Q2peZUTjUUOTg6d5cA_0 2024-09-12T00:41:32.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8578572858064599457', time=2024-09-12T02:35:14.430982+0000, chain.objs.size()=1 2024-09-12T00:41:32.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.VReCMmytiNmT6Mc6PyDcoXxzBdMC9C4_0 2024-09-12T00:41:32.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15238484841886261804', time=2024-09-12T02:35:47.334964+0000, chain.objs.size()=1 2024-09-12T00:41:32.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.YWf_MaOEWoPsLIO6pWlzOoj_B0TWuAW_0 2024-09-12T00:41:32.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.719604509489553158', time=2024-09-12T02:36:24.830927+0000, chain.objs.size()=1 2024-09-12T00:41:32.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.VAlJNUrLsnsvmvSCXzSRBOkhFERzuFE_0 2024-09-12T00:41:32.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1139049259959146794', time=2024-09-12T02:36:26.415644+0000, chain.objs.size()=1 2024-09-12T00:41:32.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.426+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.RJ6drMb0I93i1diZzRMnYO8QrD65goa_0 2024-09-12T00:41:32.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.430+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17960764549366104039', time=2024-09-12T02:36:26.436778+0000, chain.objs.size()=1 2024-09-12T00:41:32.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.430+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.KYPFDFQ1fo9kUwlbZetaEJFT6n6BElV_0 2024-09-12T00:41:32.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.434+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8594101547658707602', time=2024-09-12T02:36:59.023736+0000, chain.objs.size()=1 2024-09-12T00:41:32.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.434+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.kW0b6PaeQsmTqaV864D5XH9XNo0RWdc_0 2024-09-12T00:41:32.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.434+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18434213938998404326', time=2024-09-12T02:37:01.561426+0000, chain.objs.size()=1 2024-09-12T00:41:32.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.434+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.MIFyjWZfpjdFLmBoVHrntWtPak2YJeL_0 2024-09-12T00:41:32.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.434+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2019981210499445342', time=2024-09-12T02:38:10.166698+0000, chain.objs.size()=1 2024-09-12T00:41:32.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.434+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.PacXg36uAPPVmoO841dXySRWjbGhqJS_0 2024-09-12T00:41:32.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.434+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14691764620151028402', time=2024-09-12T02:38:12.667872+0000, chain.objs.size()=1 2024-09-12T00:41:32.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.434+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.p5_L9a-WiAAsE2oebfmCpHRDVp5PC8I_0 2024-09-12T00:41:32.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.434+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6271564059976139769', time=2024-09-12T02:38:47.660347+0000, chain.objs.size()=1 2024-09-12T00:41:32.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.434+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.RFlPnzWEHmMM-EWMqUEoFQf8eqqIwnQ_0 2024-09-12T00:41:32.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.438+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:41:32.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:41:32.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14043497490123959392', time=2024-09-12T02:32:41.380680+0000, chain.objs.size()=3 2024-09-12T00:41:32.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-STANDARD.2~MKryYOMaRoz-AMDa2zkBMNRN7R5s3NY.1 2024-09-12T00:41:32.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-STANDARD.2~MKryYOMaRoz-AMDa2zkBMNRN7R5s3NY.2 2024-09-12T00:41:32.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__multipart_foo-STANDARD.2~MKryYOMaRoz-AMDa2zkBMNRN7R5s3NY.3 2024-09-12T00:41:32.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13766511971138853259', time=2024-09-12T02:32:41.795769+0000, chain.objs.size()=1 2024-09-12T00:41:32.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.8__shadow_.IPdJgDre9SGSog7U4Ta0NAO5aIaBX9G_0 2024-09-12T00:41:32.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16542709730563137186', time=2024-09-12T02:33:59.853993+0000, chain.objs.size()=1 2024-09-12T00:41:32.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.V-JILJ259pxccvQ0jOkUJCVF3nWFE77_0 2024-09-12T00:41:32.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4285070434667696702', time=2024-09-12T02:34:38.371349+0000, chain.objs.size()=1 2024-09-12T00:41:32.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.B3-3ySuRtdnKEI89FttzRh4hQVX0zqT_0 2024-09-12T00:41:32.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16686906491779261914', time=2024-09-12T02:35:12.851947+0000, chain.objs.size()=1 2024-09-12T00:41:32.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.JRLXnRjpnkfe_12yPMQ0Zy_inv6vmS9_0 2024-09-12T00:41:32.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16269151549286222130', time=2024-09-12T02:35:14.421600+0000, chain.objs.size()=1 2024-09-12T00:41:32.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.DBek2G6FhuSBFQI3jd9ySy-eFCAvSxj_0 2024-09-12T00:41:32.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9000226338520226671', time=2024-09-12T02:36:24.825018+0000, chain.objs.size()=1 2024-09-12T00:41:32.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.aHW7V3AOJ9Sy8jvq_goPelGS-2tsAgb_0 2024-09-12T00:41:32.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11935380266847435293', time=2024-09-12T02:36:24.831265+0000, chain.objs.size()=1 2024-09-12T00:41:32.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.GB2CdweV6uDVHdL_j_nK9YqS2Saj6nZ_0 2024-09-12T00:41:32.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3639720003248569457', time=2024-09-12T02:36:59.017616+0000, chain.objs.size()=1 2024-09-12T00:41:32.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.gGkIQ6LMSzIEZ9OxcAMN8TJ7k4p8fuN_0 2024-09-12T00:41:32.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6547976292977764868', time=2024-09-12T02:36:59.030334+0000, chain.objs.size()=1 2024-09-12T00:41:32.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.442+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.b9uhIJqIQQuvpbgvUIIBV3cFE9RYWNW_0 2024-09-12T00:41:32.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.446+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9020160498591423291', time=2024-09-12T02:38:47.664304+0000, chain.objs.size()=1 2024-09-12T00:41:32.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.446+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.rkY4vQByyI8VU9ruDEbtkbmV-JwqbvH_0 2024-09-12T00:41:32.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.450+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2177291625250109027', time=2024-09-12T02:40:55.196606+0000, chain.objs.size()=1 2024-09-12T00:41:32.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.450+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.17__shadow_.yBKqZp1vXJBsmGeAKjtexdpxNJMYPlX_0 2024-09-12T00:41:32.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.450+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11727937615816172989', time=2024-09-12T02:40:55.205375+0000, chain.objs.size()=1 2024-09-12T00:41:32.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.450+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.17__shadow_.EPlMbyRLcbjgkbMquY5nmur7H00Igjg_0 2024-09-12T00:41:32.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.450+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.454+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:41:32.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.454+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:41:32.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_5PF4kfC0mTkThDf_GQHScQN2llaE6bm', time=2024-09-12T02:32:41.400299+0000, chain.objs.size()=1 2024-09-12T00:41:32.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.542c5jMYltjz17DB1KBAUoaEDL5z4dk_0 2024-09-12T00:41:32.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10166595564516507269', time=2024-09-12T02:33:59.875289+0000, chain.objs.size()=1 2024-09-12T00:41:32.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.aPW6V7i2rQIGmK3GRCR5eCHayPsoArG_0 2024-09-12T00:41:32.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13695769180864327098', time=2024-09-12T02:34:34.472622+0000, chain.objs.size()=1 2024-09-12T00:41:32.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.lOxkh6IR1eqwbUWm37UzwVF0U249DcP_0 2024-09-12T00:41:32.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9692412174261841141', time=2024-09-12T02:34:34.497051+0000, chain.objs.size()=1 2024-09-12T00:41:32.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.tTMrfqaq0wuJNcu9nLW-qJRjNsyFgI4_0 2024-09-12T00:41:32.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2494265123102832753', time=2024-09-12T02:34:36.519808+0000, chain.objs.size()=1 2024-09-12T00:41:32.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.e2Gp-Daex0E-EsTcwY_hBsIOYWkBqPm_0 2024-09-12T00:41:32.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1470946803620899732', time=2024-09-12T02:35:12.849352+0000, chain.objs.size()=1 2024-09-12T00:41:32.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.V1IovelZplky0-p-bQDN6DYzn9W4VtU_0 2024-09-12T00:41:32.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16192740032130582091', time=2024-09-12T02:35:12.853854+0000, chain.objs.size()=1 2024-09-12T00:41:32.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.9fPsN9jULiQGAnjCBT5WcNg-wo67_Os_0 2024-09-12T00:41:32.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14227347658227109320', time=2024-09-12T02:35:49.661167+0000, chain.objs.size()=1 2024-09-12T00:41:32.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.ag-O6eeM0ZadYSBW5JByzQ8B7Zj7-MH_0 2024-09-12T00:41:32.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11518215305006398164', time=2024-09-12T02:36:22.088186+0000, chain.objs.size()=1 2024-09-12T00:41:32.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.hYpnF4KRs_dg1MOxYmFbVbIHTug-hN-_0 2024-09-12T00:41:32.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17098767288563603704', time=2024-09-12T02:36:22.090795+0000, chain.objs.size()=1 2024-09-12T00:41:32.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.xnfwhYB8q9v3EmjtoWsCv_nkydJeWrC_0 2024-09-12T00:41:32.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11483765379764813045', time=2024-09-12T02:36:24.832362+0000, chain.objs.size()=1 2024-09-12T00:41:32.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.cjjr-JnLUf5nxQeG6Ap2pdIC6Iwkr_Z_0 2024-09-12T00:41:32.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4674927374869153227', time=2024-09-12T02:36:24.845265+0000, chain.objs.size()=1 2024-09-12T00:41:32.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.458+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.HqzGCle-k302aG-8MZIaABtQVoywQ81_0 2024-09-12T00:41:32.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.462+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2976759453928637070', time=2024-09-12T02:36:26.438524+0000, chain.objs.size()=1 2024-09-12T00:41:32.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.462+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.ujv2AfBG0IjjS-9U7HIxLDEBjPR0UGR_0 2024-09-12T00:41:32.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.462+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16505764714740095945', time=2024-09-12T02:36:59.008395+0000, chain.objs.size()=1 2024-09-12T00:41:32.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.462+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.drF2jlsNuRum0OOSgOBosOgyFlcEEtu_0 2024-09-12T00:41:32.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.462+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15328784420567347095', time=2024-09-12T02:38:10.163433+0000, chain.objs.size()=1 2024-09-12T00:41:32.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.462+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.bRw8n5AfMaPysKDpUgLkUxJjj4iuwqj_0 2024-09-12T00:41:32.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.462+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11425655458475890942', time=2024-09-12T02:40:55.195958+0000, chain.objs.size()=1 2024-09-12T00:41:32.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.462+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.17__shadow_.TsZ9U5-5tAjBggIVA2Zwut_K8LMM5N-_0 2024-09-12T00:41:32.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.466+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:41:32.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:41:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13416551238520672633', time=2024-09-12T02:33:59.853819+0000, chain.objs.size()=1 2024-09-12T00:41:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.tzwfDIHV7G2L8GRCwrWZiQmgtnOKcvt_0 2024-09-12T00:41:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.704749147187512245', time=2024-09-12T02:33:59.854601+0000, chain.objs.size()=1 2024-09-12T00:41:32.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.U9mu6VycOiX6E7RDebCFZCtbIoLGuEl_0 2024-09-12T00:41:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2846083729230519464', time=2024-09-12T02:33:59.860536+0000, chain.objs.size()=1 2024-09-12T00:41:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.9AFbmGSl4KqRr5qVo-jKeSIihrKtk0L_0 2024-09-12T00:41:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2143670929390994387', time=2024-09-12T02:34:01.435719+0000, chain.objs.size()=1 2024-09-12T00:41:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.PC42RhVKF3MDuUjEPpPaB-KURVhtL06_0 2024-09-12T00:41:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14116035633727320255', time=2024-09-12T02:34:34.466311+0000, chain.objs.size()=1 2024-09-12T00:41:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.6nQ5TwfXvwicP_D2HTwKzLkMNPxgW6S_0 2024-09-12T00:41:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15647272803894726011', time=2024-09-12T02:34:34.481916+0000, chain.objs.size()=1 2024-09-12T00:41:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.Z0AYy-4ajn9VVrfQYX4erPBvfgHuu5Q_0 2024-09-12T00:41:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6303644798292810444', time=2024-09-12T02:35:12.841544+0000, chain.objs.size()=1 2024-09-12T00:41:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.yqjiprsi9vLr0VCvkUvijmq14UQm_ve_0 2024-09-12T00:41:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14102509267113188787', time=2024-09-12T02:36:24.817827+0000, chain.objs.size()=1 2024-09-12T00:41:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.AW-v4oCDt_-L14kr1zmnRRLx0wM084o_0 2024-09-12T00:41:32.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15544868935547087141', time=2024-09-12T02:36:26.412900+0000, chain.objs.size()=1 2024-09-12T00:41:32.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.5GL79_WhP_4-n4QwIF10pQmDbFfwi_p_0 2024-09-12T00:41:32.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13485667617179517955', time=2024-09-12T02:36:26.422360+0000, chain.objs.size()=1 2024-09-12T00:41:32.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.6ReHPBoGyUsLat3BQ8aIxM2MG-ERjea_0 2024-09-12T00:41:32.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9905690370009423169', time=2024-09-12T02:37:01.577138+0000, chain.objs.size()=1 2024-09-12T00:41:32.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.6cvpaH7VBXN5nwN8DZ9iwuwhT-4CDyI_0 2024-09-12T00:41:32.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6232157538331193261', time=2024-09-12T02:38:10.154916+0000, chain.objs.size()=1 2024-09-12T00:41:32.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.470+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.uXypqwJ1_C2PeoQuOdDbxQ2-SFSATZo_0 2024-09-12T00:41:32.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.474+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4212187804074168750', time=2024-09-12T02:38:10.167575+0000, chain.objs.size()=1 2024-09-12T00:41:32.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.474+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.h2BBatV9l3Tfl-2rDTdGaD8wZA5I8aP_0 2024-09-12T00:41:32.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.474+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18026705610232453712', time=2024-09-12T02:38:12.681989+0000, chain.objs.size()=1 2024-09-12T00:41:32.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.474+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.BgxgPuBkG_Ln7gjrCi2B3ojBjI-pW9M_0 2024-09-12T00:41:32.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.474+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14528458686932799664', time=2024-09-12T02:38:47.656528+0000, chain.objs.size()=1 2024-09-12T00:41:32.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.474+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.Mu3LbTgup2syeDNq3G4gefTDpEWFgJe_0 2024-09-12T00:41:32.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.478+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.482+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:41:32.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.482+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.482+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:41:32.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4753532720505200283', time=2024-09-12T02:33:58.938752+0000, chain.objs.size()=1 2024-09-12T00:41:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.toEZ9G1RDo6i1qWdqM0i4jTo6t0RJZh_0 2024-09-12T00:41:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1637796484104375317', time=2024-09-12T02:33:59.861927+0000, chain.objs.size()=1 2024-09-12T00:41:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.9oLmRxRy555Nt9IAIZLPrewL2tLGu1__0 2024-09-12T00:41:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15939935709700323720', time=2024-09-12T02:34:34.471222+0000, chain.objs.size()=1 2024-09-12T00:41:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.SRAnDNaWddIVNr2A1POaazZUpNKCOv1_0 2024-09-12T00:41:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4111138924759922437', time=2024-09-12T02:34:34.473599+0000, chain.objs.size()=1 2024-09-12T00:41:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.U91_X4NZTY0nxCaTwhEtJRDU6NFY2L1_0 2024-09-12T00:41:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17847155837556693810', time=2024-09-12T02:34:34.477006+0000, chain.objs.size()=1 2024-09-12T00:41:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.vE78Jf8VEMV9yo7M0FgxTx2d31hCFpn_0 2024-09-12T00:41:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4530279498970335441', time=2024-09-12T02:34:34.487430+0000, chain.objs.size()=1 2024-09-12T00:41:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.nC_Mm7TB4gcigURtdPOxuaylL-4ige-_0 2024-09-12T00:41:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7631130084722730382', time=2024-09-12T02:35:47.341142+0000, chain.objs.size()=1 2024-09-12T00:41:32.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.WGF1YqZABnFgETRl-Hu_dmCV-1eM6_I_0 2024-09-12T00:41:32.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18050650126467341825', time=2024-09-12T02:36:22.097656+0000, chain.objs.size()=1 2024-09-12T00:41:32.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.rCVinLqiUr2nSLaGCpwyVbzurCq6Qfx_0 2024-09-12T00:41:32.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1401048824992147824', time=2024-09-12T02:36:26.446973+0000, chain.objs.size()=1 2024-09-12T00:41:32.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.MikcRNphFcg3HystOIIIgw9WJoXmMGN_0 2024-09-12T00:41:32.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14310524154000193801', time=2024-09-12T02:36:59.019800+0000, chain.objs.size()=1 2024-09-12T00:41:32.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.WORm6vPkp1hUr-C3thX9if9IdL2DYKk_0 2024-09-12T00:41:32.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6634570067566918573', time=2024-09-12T02:37:01.571552+0000, chain.objs.size()=1 2024-09-12T00:41:32.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.scozzwEilxE2_eYVtds2UNjgkcAAV8x_0 2024-09-12T00:41:32.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11183235142556686969', time=2024-09-12T02:37:37.201722+0000, chain.objs.size()=1 2024-09-12T00:41:32.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.486+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.7NuM8QzQlPiYduRKf_9ZMVhFgWEwQR6_0 2024-09-12T00:41:32.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.490+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17470048500170482324', time=2024-09-12T02:37:37.215987+0000, chain.objs.size()=1 2024-09-12T00:41:32.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.490+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.CYAkzsp0wF6UAlJFc5hivQcjBfMBknd_0 2024-09-12T00:41:32.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.490+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8047641716795918615', time=2024-09-12T02:38:10.153514+0000, chain.objs.size()=1 2024-09-12T00:41:32.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.490+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.B7ssHiiu9f_opsPqk_pnPOUAasaYURu_0 2024-09-12T00:41:32.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.490+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3308604918556921111', time=2024-09-12T02:38:12.679786+0000, chain.objs.size()=1 2024-09-12T00:41:32.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.490+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.2DtjYsCrd2IQpOt7mPSpaZu-zDybBBW_0 2024-09-12T00:41:32.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.490+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5970152089146951011', time=2024-09-12T02:38:47.680003+0000, chain.objs.size()=1 2024-09-12T00:41:32.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.490+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.7-ij9SB9eTC0qBTM7dShxu0AixQJNag_0 2024-09-12T00:41:32.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.490+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4273769449758144986', time=2024-09-12T02:40:55.196457+0000, chain.objs.size()=1 2024-09-12T00:41:32.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.490+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.17__shadow_.zzvK66gK6P7JsQTeCc2ox8nksOfGelr_0 2024-09-12T00:41:32.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.494+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:41:32.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:41:32.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_4K9WJMLCDvk8izrQN0TMbf3w-iLmsud', time=2024-09-12T02:32:41.180199+0000, chain.objs.size()=1 2024-09-12T00:41:32.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.kWTyJg1I8yjrk3yJ66Q5u2qQ4H8iJLV_0 2024-09-12T00:41:32.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17977401134443998914', time=2024-09-12T02:34:03.125765+0000, chain.objs.size()=1 2024-09-12T00:41:32.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.21__shadow_.F7CLeE7Wth4vHR7sS3eF9g15BkhiTKi_0 2024-09-12T00:41:32.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15086712981129269755', time=2024-09-12T02:34:36.499436+0000, chain.objs.size()=1 2024-09-12T00:41:32.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.-TVAYwIVd_RU1QRRID48hJEX4jHolDi_0 2024-09-12T00:41:32.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7498532619851600859', time=2024-09-12T02:34:36.502359+0000, chain.objs.size()=1 2024-09-12T00:41:32.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.LxXJVpqbQgOh-43VDrTpeHkjQ7BpliC_0 2024-09-12T00:41:32.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9863191316714444162', time=2024-09-12T02:34:38.381616+0000, chain.objs.size()=1 2024-09-12T00:41:32.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.23__shadow_.c141yNjXLFq7SowFREY-2dYWneS6UIz_0 2024-09-12T00:41:32.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13268273756141013414', time=2024-09-12T02:35:14.413899+0000, chain.objs.size()=1 2024-09-12T00:41:32.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.Th-DbnNJ58Ja2m4pQmdycgXXrvzILD-_0 2024-09-12T00:41:32.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3305414263316173330', time=2024-09-12T02:35:47.331506+0000, chain.objs.size()=1 2024-09-12T00:41:32.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.Tnl3-XCF1YKjcv8_k9NmYehUdXoWZzF_0 2024-09-12T00:41:32.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16508546730709610556', time=2024-09-12T02:35:49.646111+0000, chain.objs.size()=1 2024-09-12T00:41:32.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.eGDOGH3HQvB-HmRv-9Br0Vj4igKYCh__0 2024-09-12T00:41:32.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12582504890125933378', time=2024-09-12T02:36:59.010141+0000, chain.objs.size()=1 2024-09-12T00:41:32.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.D7shaIkBjnBs8lZhuxrkF6pJDAwbObR_0 2024-09-12T00:41:32.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1526856453928072624', time=2024-09-12T02:36:59.023816+0000, chain.objs.size()=1 2024-09-12T00:41:32.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.ZtYu-x5EjKWeNDT0oIsSmJ5333UM-wa_0 2024-09-12T00:41:32.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14086357671390132591', time=2024-09-12T02:37:01.568554+0000, chain.objs.size()=1 2024-09-12T00:41:32.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.wxdSSWgeWJPLQdnjodAyH2xAeT8GO3w_0 2024-09-12T00:41:32.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5745872534195537992', time=2024-09-12T02:38:12.660739+0000, chain.objs.size()=1 2024-09-12T00:41:32.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.498+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.ku1MO_CVXjpTD-XDemdUz_QXsps4aEi_0 2024-09-12T00:41:32.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.502+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12066115077873033547', time=2024-09-12T02:38:14.559830+0000, chain.objs.size()=1 2024-09-12T00:41:32.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.502+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.HCh0fFIe2AOKFv_yDHpcKJga2x0a0Ac_0 2024-09-12T00:41:32.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.506+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:41:32.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T00:41:32.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_CzQ04H9_f6niPO6X3H_C32RpOrJAWFp', time=2024-09-12T02:32:41.170522+0000, chain.objs.size()=1 2024-09-12T00:41:32.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.6TJtgI9R_Q5-QRDvIcUrrXF9I0WxUJP_0 2024-09-12T00:41:32.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5233255729913762735', time=2024-09-12T02:34:01.451929+0000, chain.objs.size()=1 2024-09-12T00:41:32.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.rd2et4KuBWrxRJC9W_CfCsoNUs4Llnd_0 2024-09-12T00:41:32.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4620972686566983356', time=2024-09-12T02:35:47.348394+0000, chain.objs.size()=1 2024-09-12T00:41:32.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.jrTV54BqsLKvQpH2YKp2pluz1MZXAjW_0 2024-09-12T00:41:32.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3599981523131081856', time=2024-09-12T02:37:37.193207+0000, chain.objs.size()=1 2024-09-12T00:41:32.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.-MyEhqpAZQx7Z-mzpsmN0ID0NdF3mUS_0 2024-09-12T00:41:32.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12853776393592838703', time=2024-09-12T02:37:37.214994+0000, chain.objs.size()=1 2024-09-12T00:41:32.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.UcsAGgJNbOibmhgwplaNEd3CkJ0nwR5_0 2024-09-12T00:41:32.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6861391264467124201', time=2024-09-12T02:37:37.223031+0000, chain.objs.size()=1 2024-09-12T00:41:32.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.-r1jJsPLlHupbLwRkzOQM_FcVbrZ8Zm_0 2024-09-12T00:41:32.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12939575210759251356', time=2024-09-12T02:38:14.558673+0000, chain.objs.size()=1 2024-09-12T00:41:32.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.510+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.khd7XFlLZpYZVNElFVTsACX6h2ejf4R_0 2024-09-12T00:41:32.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.514+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:41:32.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:41:32.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_QoPw2wiT9PXG55UeqbmwOfZVClFeK45', time=2024-09-12T02:32:41.328519+0000, chain.objs.size()=2 2024-09-12T00:41:32.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.v7P0CO71zBfeh2Cr6KjWAVr58W8bo7q_0 2024-09-12T00:41:32.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.v7P0CO71zBfeh2Cr6KjWAVr58W8bo7q_1 2024-09-12T00:41:32.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6820006632909808591', time=2024-09-12T02:33:59.858963+0000, chain.objs.size()=1 2024-09-12T00:41:32.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.WTpYCZFHHoFeTZQMMS0_h-7xWRf0jU9_0 2024-09-12T00:41:32.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.282169754731503233', time=2024-09-12T02:34:01.434380+0000, chain.objs.size()=1 2024-09-12T00:41:32.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.glqDYCybmwgEdFqLgtkBm7EGZuq_kU-_0 2024-09-12T00:41:32.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.609194044334992065', time=2024-09-12T02:34:01.450818+0000, chain.objs.size()=1 2024-09-12T00:41:32.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.BcplVwSfPaMPFsj8_f6FzGL4UTCuLqr_0 2024-09-12T00:41:32.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12129565261553782272', time=2024-09-12T02:34:36.504553+0000, chain.objs.size()=1 2024-09-12T00:41:32.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.SWdnIWzRcm_TBKAa0uEfkQJhG4wJpph_0 2024-09-12T00:41:32.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14320982588581965079', time=2024-09-12T02:35:10.771219+0000, chain.objs.size()=1 2024-09-12T00:41:32.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.oPDS4SytWeLpHvUq_V4mP3muFJzE5-r_0 2024-09-12T00:41:32.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15765632652149140501', time=2024-09-12T02:35:10.775022+0000, chain.objs.size()=1 2024-09-12T00:41:32.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.weAEfBEiIsTFGhO_zzDtvPM2toJElVz_0 2024-09-12T00:41:32.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2197921154558022471', time=2024-09-12T02:36:22.094822+0000, chain.objs.size()=1 2024-09-12T00:41:32.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.wCldSBMkIxeo7dtMtXBq58ZH1LUi7OP_0 2024-09-12T00:41:32.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10952418572603433623', time=2024-09-12T02:36:22.096165+0000, chain.objs.size()=1 2024-09-12T00:41:32.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.5QapyZDdjzeLSATXDCuOs6SRFaAwxlm_0 2024-09-12T00:41:32.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9252268618267220734', time=2024-09-12T02:36:22.098481+0000, chain.objs.size()=1 2024-09-12T00:41:32.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.PqwRUqsDoXUD12xwPunYsh71N1-X4mI_0 2024-09-12T00:41:32.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13455943142130035570', time=2024-09-12T02:36:24.822226+0000, chain.objs.size()=1 2024-09-12T00:41:32.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.518+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.YKnX_2No-eqZkmFbWm9ICZl0_qP8gFx_0 2024-09-12T00:41:32.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.522+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16947707878261931641', time=2024-09-12T02:36:26.442969+0000, chain.objs.size()=1 2024-09-12T00:41:32.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.522+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.PtlawfhkLlRNvg0T2xdjK4K3gPPFR0h_0 2024-09-12T00:41:32.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.522+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4030021916281406652', time=2024-09-12T02:36:59.010821+0000, chain.objs.size()=1 2024-09-12T00:41:32.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.522+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.boPQnjFn9Sf45taUVvmLksmjTYnauYY_0 2024-09-12T00:41:32.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.522+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4849526010087686460', time=2024-09-12T02:36:59.026234+0000, chain.objs.size()=1 2024-09-12T00:41:32.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.522+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.K__wFrsDWHGzRhvVIQBKMmbUm5avu7r_0 2024-09-12T00:41:32.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.522+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18253262894359472005', time=2024-09-12T02:37:37.220657+0000, chain.objs.size()=1 2024-09-12T00:41:32.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.522+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.NBz7v6wD34M1DJ6rwRNClf33i4P5nnx_0 2024-09-12T00:41:32.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.522+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1604955719607348894', time=2024-09-12T02:38:10.173224+0000, chain.objs.size()=1 2024-09-12T00:41:32.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.522+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.wiku_2BujjnoS3ncBUMvXJ8GuinJ0m5_0 2024-09-12T00:41:32.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.526+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.530+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:41:32.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.530+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.530+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:41:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_aaDFG4IxUv_59ReHUiw4iXA-7mlGtCj', time=2024-09-12T02:32:41.310196+0000, chain.objs.size()=2 2024-09-12T00:41:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.Q2qO5BvG8SCMMbsZm7WnSzG0OcMF5k1_0 2024-09-12T00:41:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.Q2qO5BvG8SCMMbsZm7WnSzG0OcMF5k1_1 2024-09-12T00:41:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='_mCWUOIBGVAZUdelX1Tlu4a9LDc9z9f2', time=2024-09-12T02:32:41.359966+0000, chain.objs.size()=2 2024-09-12T00:41:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.bbXKoND8zH8DdLCPzbiYsw8VveFP7LQ_0 2024-09-12T00:41:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.16__shadow_.bbXKoND8zH8DdLCPzbiYsw8VveFP7LQ_1 2024-09-12T00:41:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3320846641809965331', time=2024-09-12T02:32:41.718779+0000, chain.objs.size()=1 2024-09-12T00:41:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.7__shadow_.Q90C93uXvrPKrjpC492tpVYUQ9s4hpa_0 2024-09-12T00:41:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13896770170208879988', time=2024-09-12T02:33:59.855299+0000, chain.objs.size()=1 2024-09-12T00:41:32.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.PHFn_tO2WYucszI5qeMzvf_CiTopAth_0 2024-09-12T00:41:32.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15834229698625902768', time=2024-09-12T02:34:01.433228+0000, chain.objs.size()=1 2024-09-12T00:41:32.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.LZcJ_2e2H_tP752UJS0X9sUTkT2w8Oz_0 2024-09-12T00:41:32.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13409443733580957885', time=2024-09-12T02:34:36.519503+0000, chain.objs.size()=1 2024-09-12T00:41:32.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.Q828U5WQdTXlsYGI7SPuF39trJCF9_M_0 2024-09-12T00:41:32.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16984819565890164730', time=2024-09-12T02:35:12.852736+0000, chain.objs.size()=1 2024-09-12T00:41:32.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.tc2yNyGvMxwgVK5b-OIBAaJPVH7_ijX_0 2024-09-12T00:41:32.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3623011457577995005', time=2024-09-12T02:36:22.084760+0000, chain.objs.size()=1 2024-09-12T00:41:32.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.QGh_vYlYGwPcoe9zcpsWN3sVkiaXiyI_0 2024-09-12T00:41:32.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2596925549034607433', time=2024-09-12T02:36:22.086508+0000, chain.objs.size()=1 2024-09-12T00:41:32.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.9K4AVzga6gF37jz5LCa8oy2dy2Rf8R1_0 2024-09-12T00:41:32.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17684969334047168059', time=2024-09-12T02:36:26.420566+0000, chain.objs.size()=1 2024-09-12T00:41:32.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.534+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.vcYCX1HyTlRVXxWmDK6r3fTRFMqzDIX_0 2024-09-12T00:41:32.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.538+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13631542405184711377', time=2024-09-12T02:36:59.004597+0000, chain.objs.size()=1 2024-09-12T00:41:32.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.538+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.5zvE_mLoPTXh8vBS-XX0eXfqZPvk6gg_0 2024-09-12T00:41:32.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.538+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.589647355623046588', time=2024-09-12T02:38:12.667318+0000, chain.objs.size()=1 2024-09-12T00:41:32.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.538+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.FHxJFl0ToHODzX6npWKRVzXas2scJ6E_0 2024-09-12T00:41:32.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.538+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4354117382489396081', time=2024-09-12T02:38:12.682662+0000, chain.objs.size()=1 2024-09-12T00:41:32.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.538+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.FKrCA0ULnMQ60gvoObwo229uagydj01_0 2024-09-12T00:41:32.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.538+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4936373724457923768', time=2024-09-12T02:38:12.690751+0000, chain.objs.size()=1 2024-09-12T00:41:32.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.538+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.37__shadow_.fM4wUdXD-pe-musV9fnx_OVPVkJH1d3_0 2024-09-12T00:41:32.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.538+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3804086309913043682', time=2024-09-12T02:38:14.558092+0000, chain.objs.size()=1 2024-09-12T00:41:32.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.538+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.38__shadow_.XrwVxYvufZI0_-38OWgsqlO6sesuJf-_0 2024-09-12T00:41:32.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.538+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5107254815199548864', time=2024-09-12T02:40:55.199761+0000, chain.objs.size()=1 2024-09-12T00:41:32.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.538+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.17__shadow_.rOXADwS_DY-FshtHCvOopk2a2b2AHRx_0 2024-09-12T00:41:32.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.546+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.546+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:41:32.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:41:32.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4059405578713980225', time=2024-09-12T02:32:41.460485+0000, chain.objs.size()=3 2024-09-12T00:41:32.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-FROZEN.2~cI7O_oAoqVL3kGmKWzTvMdFZt7nhQEr.1 2024-09-12T00:41:32.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-FROZEN.2~cI7O_oAoqVL3kGmKWzTvMdFZt7nhQEr.2 2024-09-12T00:41:32.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-FROZEN.2~cI7O_oAoqVL3kGmKWzTvMdFZt7nhQEr.3 2024-09-12T00:41:32.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5825443069615252216', time=2024-09-12T02:32:41.529763+0000, chain.objs.size()=2 2024-09-12T00:41:32.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.13__shadow_.qYfFtfFttpTmcG5utQyqwPbrYM5XwQe_0 2024-09-12T00:41:32.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.13__shadow_.qYfFtfFttpTmcG5utQyqwPbrYM5XwQe_1 2024-09-12T00:41:32.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17796443771858750673', time=2024-09-12T02:34:36.497717+0000, chain.objs.size()=1 2024-09-12T00:41:32.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_.cmMkFCd1lAE8JDJz-VWwkZICenKv407_0 2024-09-12T00:41:32.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11024834931456088050', time=2024-09-12T02:35:10.775888+0000, chain.objs.size()=1 2024-09-12T00:41:32.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.bSsUTCYPwrsp2jX_7Ij7hpmWMfzs7ZQ_0 2024-09-12T00:41:32.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7578213745102160030', time=2024-09-12T02:35:10.792624+0000, chain.objs.size()=1 2024-09-12T00:41:32.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.B2D7p_SLY9wveHvZmLevADGnuix7GLv_0 2024-09-12T00:41:32.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17952393328457250140', time=2024-09-12T02:35:12.868679+0000, chain.objs.size()=1 2024-09-12T00:41:32.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.AFFbRAi5rg62kz7ZOsnS_TgWuLVgNkd_0 2024-09-12T00:41:32.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12871304320208806176', time=2024-09-12T02:35:14.423486+0000, chain.objs.size()=1 2024-09-12T00:41:32.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.aAsvSoVwzCa-Dlmq-9Fd4pu2cbyFvpS_0 2024-09-12T00:41:32.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9116292256855618455', time=2024-09-12T02:36:22.079167+0000, chain.objs.size()=1 2024-09-12T00:41:32.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.4fsBSep0TxpTjPxj9HUH0x2gL8S-AyK_0 2024-09-12T00:41:32.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10499363234559374424', time=2024-09-12T02:36:22.102725+0000, chain.objs.size()=1 2024-09-12T00:41:32.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.550+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.UDvwQhpB44NpLKTg555o1OKjFFDpgSW_0 2024-09-12T00:41:32.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.554+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4691770830813186045', time=2024-09-12T02:36:24.825544+0000, chain.objs.size()=1 2024-09-12T00:41:32.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.554+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.--rJfqpNyIICySZ06xlFu3eO3XK4hhY_0 2024-09-12T00:41:32.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.554+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6387353584265711382', time=2024-09-12T02:36:59.016072+0000, chain.objs.size()=1 2024-09-12T00:41:32.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.554+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.32__shadow_.jleGLRmafu-Wy-r5w5e_xNGr9eK05vt_0 2024-09-12T00:41:32.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.554+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7343114292587694067', time=2024-09-12T02:37:37.196089+0000, chain.objs.size()=1 2024-09-12T00:41:32.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.554+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_._PqVYQtdMuUcQFjLyfcHRfa9tfvQK5p_0 2024-09-12T00:41:32.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.554+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3579911112746144198', time=2024-09-12T02:37:37.201713+0000, chain.objs.size()=1 2024-09-12T00:41:32.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.554+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.akcFmEe-ulzzd3w1sSSUL-oaCgn4UPp_0 2024-09-12T00:41:32.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.554+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7639452632533817036', time=2024-09-12T02:40:55.195373+0000, chain.objs.size()=1 2024-09-12T00:41:32.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.554+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.17__shadow_.0OZE1pPgPoQwdBYv-EVX5B_zqzxBh7y_0 2024-09-12T00:41:32.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.558+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.558+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:41:32.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:41:32.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3733127249162896797', time=2024-09-12T02:32:40.815054+0000, chain.objs.size()=1 2024-09-12T00:41:32.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.O3H0DPqSQCI_fR8UVBjHv4HZcN9ciP4_0 2024-09-12T00:41:32.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12838419454642460139', time=2024-09-12T02:32:40.837024+0000, chain.objs.size()=1 2024-09-12T00:41:32.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.smYEdzrKQw_sPiDZSGlIu9iY1QKrTQ7_0 2024-09-12T00:41:32.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17925227288810102824', time=2024-09-12T02:32:40.871035+0000, chain.objs.size()=1 2024-09-12T00:41:32.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.S5YSG15_AKqu1-vYbfcD5Z2U-HXa816_0 2024-09-12T00:41:32.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7564356551748226200', time=2024-09-12T02:32:40.961668+0000, chain.objs.size()=4 2024-09-12T00:41:32.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.12__multipart_foo.2~JCUEe7dAbd0crx3qhgtQDmXcAmc0eTr.1 2024-09-12T00:41:32.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.12__multipart_foo.2~JCUEe7dAbd0crx3qhgtQDmXcAmc0eTr.2 2024-09-12T00:41:32.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.12__multipart_foo.2~JCUEe7dAbd0crx3qhgtQDmXcAmc0eTr.3 2024-09-12T00:41:32.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.12__multipart_foo.2~JCUEe7dAbd0crx3qhgtQDmXcAmc0eTr.4 2024-09-12T00:41:32.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18421359531718568335', time=2024-09-12T02:33:59.881117+0000, chain.objs.size()=1 2024-09-12T00:41:32.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.HfIeL-HDr-x1ta8tUpaYonSHN-J0VpX_0 2024-09-12T00:41:32.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17057222350392438938', time=2024-09-12T02:34:01.438519+0000, chain.objs.size()=1 2024-09-12T00:41:32.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.kKtKNjDCG8mMrbEtKHL71-SENQo0D99_0 2024-09-12T00:41:32.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6376174261699323475', time=2024-09-12T02:35:12.867694+0000, chain.objs.size()=1 2024-09-12T00:41:32.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.JtbI60BQYKpz6xQjyokI1Pa7wVgb1qo_0 2024-09-12T00:41:32.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7400809202971555755', time=2024-09-12T02:35:47.340922+0000, chain.objs.size()=1 2024-09-12T00:41:32.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.zE0hFmSTBJ_lyzI-iJdivioYvNPPRyD_0 2024-09-12T00:41:32.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8892337088290149251', time=2024-09-12T02:36:22.095318+0000, chain.objs.size()=1 2024-09-12T00:41:32.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.562+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.MWyKPlbYtj62k7OQxfv30_W2Kckyn75_0 2024-09-12T00:41:32.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.566+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.65157723568559804', time=2024-09-12T02:36:24.839835+0000, chain.objs.size()=1 2024-09-12T00:41:32.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.566+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.30__shadow_.dgUWd1QdJa4ZFg8BzDxOO0scZ-K6Nf4_0 2024-09-12T00:41:32.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.566+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17058237310646604834', time=2024-09-12T02:36:26.433814+0000, chain.objs.size()=1 2024-09-12T00:41:32.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.566+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.PhQRR3Svn_oo4UcUs7ZolFA9kN6e0fc_0 2024-09-12T00:41:32.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.566+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16003694744748739258', time=2024-09-12T02:37:01.570895+0000, chain.objs.size()=1 2024-09-12T00:41:32.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.566+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.0q27t3LWHvdWPbm2Grs4jSHFZm2SveR_0 2024-09-12T00:41:32.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.570+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11025965345629608132', time=2024-09-12T02:38:10.181047+0000, chain.objs.size()=1 2024-09-12T00:41:32.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.570+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.uwPX_c1cZq6OwMjztgdxGfIvhUmGKNK_0 2024-09-12T00:41:32.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.570+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14737704299886984843', time=2024-09-12T02:40:55.192674+0000, chain.objs.size()=1 2024-09-12T00:41:32.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.570+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.17__shadow_.6_faF-IAE69DMXmpCVPW6leA_Et2Fdo_0 2024-09-12T00:41:32.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.574+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.574+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:41:32.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:41:32.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17586532457386590059', time=2024-09-12T02:32:40.844853+0000, chain.objs.size()=1 2024-09-12T00:41:32.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.4__shadow_.hO0c6PAwCtjp3wG-taqv6YrctbmzeV8_0 2024-09-12T00:41:32.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6955837973615786167', time=2024-09-12T02:32:41.210111+0000, chain.objs.size()=1 2024-09-12T00:41:32.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.15__shadow_.sdXlQdmJ6nd-geqI4iqus6ByaUH1SLr_0 2024-09-12T00:41:32.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3726023757901528706', time=2024-09-12T02:32:41.784307+0000, chain.objs.size()=1 2024-09-12T00:41:32.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.8__shadow_.PQEsvf1gFDOzTkV7csQXDK6W4FpohX1_0 2024-09-12T00:41:32.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18055202625562944945', time=2024-09-12T02:33:59.864441+0000, chain.objs.size()=1 2024-09-12T00:41:32.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.19__shadow_.mdVd5liV2f1PK2VAuP5ejx0JhLNN_IO_0 2024-09-12T00:41:32.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11609770449892420277', time=2024-09-12T02:34:01.451713+0000, chain.objs.size()=1 2024-09-12T00:41:32.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.20__shadow_.k1A9Ms8nJAAY353qz-kT-MswagliTS4_0 2024-09-12T00:41:32.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16916881589449962228', time=2024-09-12T02:35:12.855520+0000, chain.objs.size()=1 2024-09-12T00:41:32.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.zCr2WpLX0kS4o2dQyO8vha6FkdqMTrU_0 2024-09-12T00:41:32.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.797139948924860666', time=2024-09-12T02:35:12.868714+0000, chain.objs.size()=1 2024-09-12T00:41:32.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.OtCENN8TzKWmRyqoEr4p5cKJsvSM0as_0 2024-09-12T00:41:32.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11766321272257786108', time=2024-09-12T02:35:14.422032+0000, chain.objs.size()=1 2024-09-12T00:41:32.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.ulP-zNPA9X2tLQ7xqUxGsgT3-T9_8t1_0 2024-09-12T00:41:32.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11844355651210874983', time=2024-09-12T02:35:49.657076+0000, chain.objs.size()=1 2024-09-12T00:41:32.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.28__shadow_.CgN98gE9yJcbmHE4tWjZEYKAl8TvYeD_0 2024-09-12T00:41:32.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3675823039978967564', time=2024-09-12T02:36:22.076777+0000, chain.objs.size()=1 2024-09-12T00:41:32.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.29__shadow_.Dd9EAzaRHC5xixWU2nmw-A4JR4EsL4I_0 2024-09-12T00:41:32.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17811743299532001929', time=2024-09-12T02:37:01.560292+0000, chain.objs.size()=1 2024-09-12T00:41:32.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.33__shadow_.npI3mX70ZPTjJHz2K3ZqnRl71Iuih6C_0 2024-09-12T00:41:32.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3119221863713795014', time=2024-09-12T02:37:37.223840+0000, chain.objs.size()=1 2024-09-12T00:41:32.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.578+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.YFo8V_oOgFLY_Zx92bTr3_WCt0O6S87_0 2024-09-12T00:41:32.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.582+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3060406943796108029', time=2024-09-12T02:38:47.657282+0000, chain.objs.size()=1 2024-09-12T00:41:32.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.582+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.OLalpM2nRbImvMd_sgxK2BNbVR-S9Qb_0 2024-09-12T00:41:32.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.586+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.586+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:41:32.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:41:32.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3154619321990305929', time=2024-09-12T02:32:41.023004+0000, chain.objs.size()=4 2024-09-12T00:41:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.10__multipart_foo.2~DP7wHxdWehZxYn5FlhD_5VWRl7LChVj.1 2024-09-12T00:41:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.10__multipart_foo.2~DP7wHxdWehZxYn5FlhD_5VWRl7LChVj.2 2024-09-12T00:41:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.10__multipart_foo.2~DP7wHxdWehZxYn5FlhD_5VWRl7LChVj.3 2024-09-12T00:41:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.10__multipart_foo.2~DP7wHxdWehZxYn5FlhD_5VWRl7LChVj.4 2024-09-12T00:41:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.881200093889395099', time=2024-09-12T02:32:41.482436+0000, chain.objs.size()=3 2024-09-12T00:41:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-LUKEWARM.2~KhrfDCMUS2zNsIcxDTxHzN7B5I9UL8U.1 2024-09-12T00:41:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-LUKEWARM.2~KhrfDCMUS2zNsIcxDTxHzN7B5I9UL8U.2 2024-09-12T00:41:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.14__multipart_foo-LUKEWARM.2~KhrfDCMUS2zNsIcxDTxHzN7B5I9UL8U.3 2024-09-12T00:41:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9848891383929600781', time=2024-09-12T02:34:36.500352+0000, chain.objs.size()=1 2024-09-12T00:41:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.22__shadow_._mlYdMVpa8gf55vMxT3YL7P-2ENKG0y_0 2024-09-12T00:41:32.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14742306337523037767', time=2024-09-12T02:34:39.660128+0000, chain.objs.size()=1 2024-09-12T00:41:32.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.yu5J_eIPmIQh8bM_1YC4s5sjdZUm8je_0 2024-09-12T00:41:32.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11547925666682903433', time=2024-09-12T02:35:10.776586+0000, chain.objs.size()=1 2024-09-12T00:41:32.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.24__shadow_.xppyBSVh-M5jVnR9aqrTjaOkUie8h_x_0 2024-09-12T00:41:32.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2929312694882172094', time=2024-09-12T02:35:12.838174+0000, chain.objs.size()=1 2024-09-12T00:41:32.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.5HGuUtvZ3CD7XWzcTRo3Swu7f3X_0vK_0 2024-09-12T00:41:32.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8293001849165424092', time=2024-09-12T02:35:12.841641+0000, chain.objs.size()=1 2024-09-12T00:41:32.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.590+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.25__shadow_.uOh5R9NrZd3_ucxsP73s-rp8ev9qZr1_0 2024-09-12T00:41:32.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.594+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11204973866586144402', time=2024-09-12T02:35:14.445482+0000, chain.objs.size()=1 2024-09-12T00:41:32.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.594+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.26__shadow_.68rifDeaSL-fSHdqeYhRnlzJnsM7O5n_0 2024-09-12T00:41:32.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.594+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18348277469200454826', time=2024-09-12T02:35:47.357037+0000, chain.objs.size()=1 2024-09-12T00:41:32.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.594+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.27__shadow_.YdMKU2nfD3OosA4ivktzMK48Ue9UDQN_0 2024-09-12T00:41:32.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.594+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4526935894452324094', time=2024-09-12T02:36:26.424425+0000, chain.objs.size()=1 2024-09-12T00:41:32.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.594+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.HicB7-mdf7TczrznlvC99cc0AyXSSsH_0 2024-09-12T00:41:32.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.594+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7422167885993329425', time=2024-09-12T02:36:26.444586+0000, chain.objs.size()=1 2024-09-12T00:41:32.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.594+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.31__shadow_.Ek4nIEe56XsQzQjxJYWwLWisX17iWaY_0 2024-09-12T00:41:32.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.598+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15758587961597692809', time=2024-09-12T02:37:37.199774+0000, chain.objs.size()=1 2024-09-12T00:41:32.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.598+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.35__shadow_.Ag3G-6QbWBiTTTDiC8HTzIZO2OPaJ_Q_0 2024-09-12T00:41:32.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.598+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6693421024689707351', time=2024-09-12T02:38:10.166667+0000, chain.objs.size()=1 2024-09-12T00:41:32.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.598+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.La_cc4PeONs48QG383G2qG1tKuk7jPY_0 2024-09-12T00:41:32.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.598+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4372640123657763051', time=2024-09-12T02:38:10.173605+0000, chain.objs.size()=1 2024-09-12T00:41:32.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.598+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.36__shadow_.yc2K7dKNX2IFg0EQfSbTBoZmuVovdkL_0 2024-09-12T00:41:32.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.598+0000 7ff9d9c4c9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13603242347858283845', time=2024-09-12T02:38:47.678634+0000, chain.objs.size()=1 2024-09-12T00:41:32.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.598+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.39__shadow_.pXNaIwEm1n1wU65oOujY8iDjRDa3gc__0 2024-09-12T00:41:32.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.598+0000 7ff9d9c4c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:41:32.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.602+0000 7ff88dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:32.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.606+0000 7ff9d9c4c9c0 20 remove_watcher() i=0 2024-09-12T00:41:32.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.606+0000 7ff9d9c4c9c0 2 removed watcher, disabling cache 2024-09-12T00:41:32.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.606+0000 7ff9d9c4c9c0 20 remove_watcher() i=1 2024-09-12T00:41:32.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.606+0000 7ff9d9c4c9c0 20 remove_watcher() i=2 2024-09-12T00:41:32.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.610+0000 7ff9d9c4c9c0 20 remove_watcher() i=3 2024-09-12T00:41:32.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.610+0000 7ff9d9c4c9c0 20 remove_watcher() i=4 2024-09-12T00:41:32.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.610+0000 7ff9d9c4c9c0 20 remove_watcher() i=5 2024-09-12T00:41:32.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.614+0000 7ff9d9c4c9c0 20 remove_watcher() i=6 2024-09-12T00:41:32.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.614+0000 7ff9d9c4c9c0 20 remove_watcher() i=7 2024-09-12T00:41:32.620 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-12T00:41:32.688 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:32.688 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:32.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.730+0000 7f11ee50f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:32.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.734+0000 7f11ee50f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:32.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.734+0000 7f11ee50f9c0 20 realm 2024-09-12T00:41:32.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.734+0000 7f11ee50f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:32.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.734+0000 7f11ee50f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:32.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.734+0000 7f11ee50f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:41:32.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.734+0000 7f11ee50f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:32.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.734+0000 7f11ee50f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:32.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.734+0000 7f11ee50f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:32.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.734+0000 7f11ee50f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:32.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.734+0000 7f11ee50f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:32.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.734+0000 7f11ee50f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:41:32.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.734+0000 7f11ee50f9c0 20 searching for the correct realm 2024-09-12T00:41:32.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.742+0000 7f11ec816640 0 -- 172.21.15.138:0/860770055 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f11dc065850 msgr2=0x7f11dc05c0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:32.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.746+0000 7f11ec816640 0 -- 172.21.15.138:0/860770055 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55af814c4b90 msgr2=0x55af814c7050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:41:32.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:41:32.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:41:32.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:41:32.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:41:32.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:41:32.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:41:32.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:32.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:32.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:32.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:41:32.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:32.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:41:32.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 zone default found 2024-09-12T00:41:32.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 4 Realm: () 2024-09-12T00:41:32.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:41:32.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:41:32.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:41:32.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 zonegroup default 2024-09-12T00:41:32.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:32.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:32.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:32.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:32.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:41:32.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:41:32.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 started sync module instance, tier type = 2024-09-12T00:41:32.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.754+0000 7f11ee50f9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:41:32.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.778+0000 7f11ee50f9c0 20 add_watcher() i=0 2024-09-12T00:41:32.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.778+0000 7f11ee50f9c0 20 add_watcher() i=1 2024-09-12T00:41:32.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.778+0000 7f11ee50f9c0 20 add_watcher() i=2 2024-09-12T00:41:32.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.778+0000 7f11ee50f9c0 20 add_watcher() i=3 2024-09-12T00:41:32.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.778+0000 7f11ee50f9c0 20 add_watcher() i=4 2024-09-12T00:41:32.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.778+0000 7f11ee50f9c0 20 add_watcher() i=5 2024-09-12T00:41:32.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.778+0000 7f11ee50f9c0 20 add_watcher() i=6 2024-09-12T00:41:32.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.778+0000 7f11ee50f9c0 20 add_watcher() i=7 2024-09-12T00:41:32.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.778+0000 7f11ee50f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:41:32.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.782+0000 7f10a37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:32.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.782+0000 7f11ee50f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:41:32.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.782+0000 7f11ee50f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:41:32.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.846+0000 7f10a27dc640 20 reqs_thread_entry: start 2024-09-12T00:41:32.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.846+0000 7f11ee50f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:41:32.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.846+0000 7f11ee50f9c0 20 Filter name: none 2024-09-12T00:41:32.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.846+0000 7f109b7fe640 20 reqs_thread_entry: start 2024-09-12T00:41:32.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.846+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:41:32.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.850+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.850+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.850+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.854+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:41:32.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.858+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.858+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.858+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.858+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:41:32.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.862+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.862+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.862+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.866+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:41:32.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.866+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.870+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.870+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.870+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:41:32.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.874+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.878+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.878+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.882+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:41:32.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.882+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.882+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.882+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.886+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:41:32.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.886+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.890+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.890+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.890+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:41:32.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.894+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.894+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.894+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.898+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:41:32.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.898+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.898+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.902+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.902+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:41:32.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.906+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.906+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.906+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.910+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:41:32.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.914+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.914+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.918+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.918+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:41:32.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.922+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.926+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.926+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.926+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:41:32.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.930+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.930+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.930+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.934+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:41:32.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.934+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.938+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.938+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.938+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:41:32.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.942+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.942+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.946+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.946+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:41:32.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.950+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.950+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.954+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.954+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:41:32.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.958+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.962+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.962+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.966+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:41:32.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.970+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.970+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.974+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.974+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:41:32.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.978+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.978+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.982+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.982+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:41:32.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.986+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.990+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.990+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.990+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:41:32.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.994+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.998+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:32.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:32.998+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:32.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.002+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:41:32.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.002+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.006+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:33.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.006+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.010+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:41:33.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.010+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.014+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:33.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.014+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.018+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:41:33.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.022+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.022+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:33.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.022+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.026+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:41:33.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.030+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.030+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:33.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.030+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.034+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:41:33.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.038+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.038+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:33.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.038+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.042+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:41:33.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.046+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.046+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:33.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.050+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.050+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:41:33.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.054+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.058+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:33.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.058+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.058+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:41:33.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.062+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.066+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:33.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.066+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.070+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:41:33.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.074+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.078+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:33.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.078+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.082+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:41:33.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.082+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.086+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:33.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.086+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.090+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:41:33.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.094+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.094+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:41:33.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.098+0000 7f11ee50f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:41:33.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.102+0000 7f10a37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:41:33.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.106+0000 7f11ee50f9c0 20 remove_watcher() i=0 2024-09-12T00:41:33.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.106+0000 7f11ee50f9c0 2 removed watcher, disabling cache 2024-09-12T00:41:33.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.110+0000 7f11ee50f9c0 20 remove_watcher() i=1 2024-09-12T00:41:33.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.110+0000 7f11ee50f9c0 20 remove_watcher() i=2 2024-09-12T00:41:33.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.114+0000 7f11ee50f9c0 20 remove_watcher() i=3 2024-09-12T00:41:33.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.114+0000 7f11ee50f9c0 20 remove_watcher() i=4 2024-09-12T00:41:33.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.118+0000 7f11ee50f9c0 20 remove_watcher() i=5 2024-09-12T00:41:33.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.122+0000 7f11ee50f9c0 20 remove_watcher() i=6 2024-09-12T00:41:33.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:41:33.122+0000 7f11ee50f9c0 20 remove_watcher() i=7 2024-09-12T00:41:33.145 DEBUG:teuthology.orchestra.run.smithi138:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T00:41:33.726 INFO:teuthology.orchestra.run.smithi138.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T00:41:38.325 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :clean UP-TO-DATE 2024-09-12T00:41:56.229 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :compileJava 2024-09-12T00:41:56.323 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :processResources 2024-09-12T00:41:56.323 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :classes 2024-09-12T00:41:57.123 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:41:57.124 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :compileTestJava 2024-09-12T00:41:57.124 INFO:teuthology.orchestra.run.smithi138.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:41:57.125 INFO:teuthology.orchestra.run.smithi138.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:41:57.224 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:41:57.224 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:41:57.225 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :testClasses 2024-09-12T00:42:03.524 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:03.524 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :test 2024-09-12T00:42:03.524 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:03.524 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T00:42:04.323 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:04.324 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T00:42:04.623 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:04.624 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T00:42:04.723 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:04.724 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T00:42:05.023 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:05.024 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T00:42:05.723 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:05.723 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T00:42:06.024 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:06.024 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:42:06.024 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:06.024 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:42:06.124 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:06.124 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T00:42:06.124 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:06.124 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T00:42:06.423 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:06.423 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T00:42:07.124 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:07.124 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T00:42:07.623 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:07.624 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:42:07.923 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:07.923 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T00:42:07.924 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12 00:42:07,832 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:42:14.824 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:14.824 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:42:15.323 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:15.324 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T00:42:15.324 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:15.324 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T00:42:15.624 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:15.624 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T00:42:15.724 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:15.724 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T00:42:16.123 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:16.124 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T00:42:16.624 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:16.624 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T00:42:16.924 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:16.924 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:42:16.924 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:16.924 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:42:17.023 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:17.024 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T00:42:19.524 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:19.524 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T00:42:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:19.823 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:42:20.523 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:20.523 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:42:20.923 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:20.924 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T00:42:21.423 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:21.424 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T00:42:21.723 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:21.724 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:42:33.924 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:33.924 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:42:34.123 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:34.124 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T00:42:35.524 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:35.524 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T00:42:35.723 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:35.723 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T00:42:37.323 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:37.324 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T00:42:37.623 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:37.623 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T00:42:38.124 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:38.124 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T00:42:38.323 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:38.323 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T00:42:38.424 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:38.424 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T00:42:38.623 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:38.623 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T00:42:38.723 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:38.724 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T00:42:39.023 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:39.024 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T00:42:39.024 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:39.024 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T00:42:39.323 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:39.324 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T00:42:39.324 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:39.324 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T00:42:39.623 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:39.624 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T00:42:39.723 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:39.724 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T00:42:40.024 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:40.024 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T00:42:40.024 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:40.024 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T00:42:40.323 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:40.323 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T00:42:40.423 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:40.424 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T00:42:40.623 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:40.624 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T00:42:41.723 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:41.724 INFO:teuthology.orchestra.run.smithi138.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T00:42:42.023 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:42.024 INFO:teuthology.orchestra.run.smithi138.stdout:---------------------------------------------------------------------- 2024-09-12T00:42:42.024 INFO:teuthology.orchestra.run.smithi138.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T00:42:42.024 INFO:teuthology.orchestra.run.smithi138.stdout:---------------------------------------------------------------------- 2024-09-12T00:42:42.056 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:42.056 INFO:teuthology.orchestra.run.smithi138.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:42:42.057 INFO:teuthology.orchestra.run.smithi138.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:42:42.057 INFO:teuthology.orchestra.run.smithi138.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:42:42.057 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:42.057 INFO:teuthology.orchestra.run.smithi138.stdout:BUILD SUCCESSFUL in 1m 8s 2024-09-12T00:42:42.057 INFO:teuthology.orchestra.run.smithi138.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T00:42:42.381 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-12T00:42:42.413 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:42.414 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:42.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.456+0000 7fbe6f4599c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.460+0000 7fbe6f4599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:42.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.460+0000 7fbe6f4599c0 20 realm 2024-09-12T00:42:42.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.460+0000 7fbe6f4599c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.460+0000 7fbe6f4599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:42.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.460+0000 7fbe6f4599c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:42.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.460+0000 7fbe6f4599c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.460+0000 7fbe6f4599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:42.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.460+0000 7fbe6f4599c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.460+0000 7fbe6f4599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:42.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.460+0000 7fbe6f4599c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.460+0000 7fbe6f4599c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:42.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.460+0000 7fbe6f4599c0 20 searching for the correct realm 2024-09-12T00:42:42.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.464+0000 7fbe6d760640 0 -- 172.21.15.138:0/3800137674 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fbe64031420 msgr2=0x7fbe640318a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:42.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.680+0000 7fbe6d760640 0 -- 172.21.15.138:0/3800137674 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5646e1f34260 msgr2=0x5646e1f36720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:42.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.688+0000 7fbe6f4599c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:42:42.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.688+0000 7fbe6f4599c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:42.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.688+0000 7fbe6f4599c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:42:42.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.688+0000 7fbe6f4599c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:42.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.688+0000 7fbe6f4599c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:42.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.688+0000 7fbe6f4599c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:42.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.688+0000 7fbe6f4599c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.688+0000 7fbe6f4599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:42.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.688+0000 7fbe6f4599c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.688+0000 7fbe6f4599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:42.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.688+0000 7fbe6f4599c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.692+0000 7fbe6f4599c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:42.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.692+0000 7fbe6f4599c0 20 zone default found 2024-09-12T00:42:42.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.692+0000 7fbe6f4599c0 4 Realm: () 2024-09-12T00:42:42.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.692+0000 7fbe6f4599c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:42:42.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.692+0000 7fbe6f4599c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:42:42.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.692+0000 7fbe6f4599c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:42.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.692+0000 7fbe6f4599c0 20 zonegroup default 2024-09-12T00:42:42.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.692+0000 7fbe6f4599c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.692+0000 7fbe6f4599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:42.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.692+0000 7fbe6f4599c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.692+0000 7fbe6f4599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:42.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.692+0000 7fbe6f4599c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:42.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.692+0000 7fbe6f4599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:42.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.692+0000 7fbe6f4599c0 20 started sync module instance, tier type = 2024-09-12T00:42:42.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.692+0000 7fbe6f4599c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:42:42.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.716+0000 7fbe6f4599c0 20 add_watcher() i=0 2024-09-12T00:42:42.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.716+0000 7fbe6f4599c0 20 add_watcher() i=1 2024-09-12T00:42:42.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.716+0000 7fbe6f4599c0 20 add_watcher() i=2 2024-09-12T00:42:42.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.716+0000 7fbe6f4599c0 20 add_watcher() i=3 2024-09-12T00:42:42.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.716+0000 7fbe6f4599c0 20 add_watcher() i=4 2024-09-12T00:42:42.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.716+0000 7fbe6f4599c0 20 add_watcher() i=5 2024-09-12T00:42:42.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.716+0000 7fbe6f4599c0 20 add_watcher() i=6 2024-09-12T00:42:42.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.720+0000 7fbe6f4599c0 20 add_watcher() i=7 2024-09-12T00:42:42.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.720+0000 7fbe6f4599c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:42.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.724+0000 7fbd237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:42.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.724+0000 7fbe6f4599c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:42.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.724+0000 7fbe6f4599c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:42.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.820+0000 7fbd227e4640 20 reqs_thread_entry: start 2024-09-12T00:42:42.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.824+0000 7fbe6f4599c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:42.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.824+0000 7fbe6f4599c0 20 Filter name: none 2024-09-12T00:42:42.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.824+0000 7fbd207e0640 20 reqs_thread_entry: start 2024-09-12T00:42:42.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.824+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:42:42.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.824+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:42.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.828+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:42.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.828+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:42:42.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.828+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13584201842183147704', time=2024-09-12T02:42:13.137749+0000, chain.objs.size()=5 2024-09-12T00:42:42.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.828+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~6aKrRDZ7k2wimbmBeqgGsft6Zrnd93q.1 2024-09-12T00:42:42.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.828+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~6aKrRDZ7k2wimbmBeqgGsft6Zrnd93q.2 2024-09-12T00:42:42.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.828+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~6aKrRDZ7k2wimbmBeqgGsft6Zrnd93q.3 2024-09-12T00:42:42.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.828+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~6aKrRDZ7k2wimbmBeqgGsft6Zrnd93q.4 2024-09-12T00:42:42.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.828+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~6aKrRDZ7k2wimbmBeqgGsft6Zrnd93q.5 2024-09-12T00:42:42.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.828+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5890250140719810756', time=2024-09-12T02:42:14.927304+0000, chain.objs.size()=4 2024-09-12T00:42:42.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.828+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.46__shadow_.3OshGMPxmd6aGNAAz5vnmdnAY4YdcZC_0 2024-09-12T00:42:42.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.828+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.46__shadow_.3OshGMPxmd6aGNAAz5vnmdnAY4YdcZC_1 2024-09-12T00:42:42.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.828+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.46__shadow_.3OshGMPxmd6aGNAAz5vnmdnAY4YdcZC_2 2024-09-12T00:42:42.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.828+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.46__shadow_.3OshGMPxmd6aGNAAz5vnmdnAY4YdcZC_3 2024-09-12T00:42:42.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.836+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:42.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.844+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:42:42.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.848+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:42.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.848+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:42.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.848+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:42:42.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.848+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6666704353807384803', time=2024-09-12T02:42:07.408913+0000, chain.objs.size()=5 2024-09-12T00:42:42.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.848+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.44__multipart_key1.2~KoC8jt8xR0fNJ6BDyifLW2CvhwUXeD9.1 2024-09-12T00:42:42.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.848+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.44__multipart_key1.2~KoC8jt8xR0fNJ6BDyifLW2CvhwUXeD9.2 2024-09-12T00:42:42.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.848+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.44__multipart_key1.2~KoC8jt8xR0fNJ6BDyifLW2CvhwUXeD9.3 2024-09-12T00:42:42.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.848+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.44__multipart_key1.2~KoC8jt8xR0fNJ6BDyifLW2CvhwUXeD9.4 2024-09-12T00:42:42.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.848+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.44__multipart_key1.2~KoC8jt8xR0fNJ6BDyifLW2CvhwUXeD9.5 2024-09-12T00:42:42.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.848+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16887620742568295725', time=2024-09-12T02:42:34.892664+0000, chain.objs.size()=1 2024-09-12T00:42:42.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.848+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.56__shadow_.y0zyJoe9614LBWI2Awj-3Y-UwTmxAPP_0 2024-09-12T00:42:42.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.856+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:42.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.860+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:42:42.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.864+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:42.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.868+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:42.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.868+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:42:42.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.868+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18435111334340253931', time=2024-09-12T02:42:05.779752+0000, chain.objs.size()=5 2024-09-12T00:42:42.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.868+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.42__multipart_key1.2~tZbHRG9hwDgz6T7RKzBcUoZ4G8C8J8s.1 2024-09-12T00:42:42.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.868+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.42__multipart_key1.2~tZbHRG9hwDgz6T7RKzBcUoZ4G8C8J8s.2 2024-09-12T00:42:42.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.868+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.42__multipart_key1.2~tZbHRG9hwDgz6T7RKzBcUoZ4G8C8J8s.3 2024-09-12T00:42:42.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.868+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.42__multipart_key1.2~tZbHRG9hwDgz6T7RKzBcUoZ4G8C8J8s.4 2024-09-12T00:42:42.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.868+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.42__multipart_key1.2~tZbHRG9hwDgz6T7RKzBcUoZ4G8C8J8s.5 2024-09-12T00:42:42.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.868+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14220618613734761733', time=2024-09-12T02:42:20.620703+0000, chain.objs.size()=5 2024-09-12T00:42:42.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.868+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.53__multipart_file2.mpg.2~mJbvMc41cUPPyryAzBkxEI7EY13l9jb.1 2024-09-12T00:42:42.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.868+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.53__multipart_file2.mpg.2~mJbvMc41cUPPyryAzBkxEI7EY13l9jb.2 2024-09-12T00:42:42.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.868+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.53__multipart_file2.mpg.2~mJbvMc41cUPPyryAzBkxEI7EY13l9jb.3 2024-09-12T00:42:42.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.868+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.53__multipart_file2.mpg.2~mJbvMc41cUPPyryAzBkxEI7EY13l9jb.4 2024-09-12T00:42:42.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.868+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.53__multipart_file2.mpg.2~mJbvMc41cUPPyryAzBkxEI7EY13l9jb.5 2024-09-12T00:42:42.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.868+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1324950039737476363', time=2024-09-12T02:42:39.760833+0000, chain.objs.size()=1 2024-09-12T00:42:42.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.868+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.63__shadow_.qc4nHZ1qRjMZptprLKg8mqpOa-RcQn1_0 2024-09-12T00:42:42.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.880+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:42.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.888+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:42:42.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.892+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:42.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.892+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:42.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.892+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:42:42.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.892+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3732001385542836622', time=2024-09-12T02:42:11.536243+0000, chain.objs.size()=5 2024-09-12T00:42:42.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.892+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~CieSWz1bpcmU7nocMGCJfxA_y1rqmv1.1 2024-09-12T00:42:42.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.892+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~CieSWz1bpcmU7nocMGCJfxA_y1rqmv1.2 2024-09-12T00:42:42.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.892+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~CieSWz1bpcmU7nocMGCJfxA_y1rqmv1.3 2024-09-12T00:42:42.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.892+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~CieSWz1bpcmU7nocMGCJfxA_y1rqmv1.4 2024-09-12T00:42:42.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.892+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~CieSWz1bpcmU7nocMGCJfxA_y1rqmv1.5 2024-09-12T00:42:42.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.892+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5761061993880571186', time=2024-09-12T02:42:41.728622+0000, chain.objs.size()=11 2024-09-12T00:42:42.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.892+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.66__multipart_key1.2~94wfl_TzEFDA7TzbyFEJjFAz32DSdDb.1 2024-09-12T00:42:42.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.892+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.66__multipart_key1.2~94wfl_TzEFDA7TzbyFEJjFAz32DSdDb.2 2024-09-12T00:42:42.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.892+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.66__multipart_key1.2~94wfl_TzEFDA7TzbyFEJjFAz32DSdDb.3 2024-09-12T00:42:42.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.892+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.66__multipart_key1.2~94wfl_TzEFDA7TzbyFEJjFAz32DSdDb.4 2024-09-12T00:42:42.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.892+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.66__multipart_key1.2~94wfl_TzEFDA7TzbyFEJjFAz32DSdDb.5 2024-09-12T00:42:42.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.892+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.66__multipart_key1.2~94wfl_TzEFDA7TzbyFEJjFAz32DSdDb.6 2024-09-12T00:42:42.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.892+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.66__multipart_key1.2~94wfl_TzEFDA7TzbyFEJjFAz32DSdDb.7 2024-09-12T00:42:42.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.904+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.66__multipart_key1.2~94wfl_TzEFDA7TzbyFEJjFAz32DSdDb.8 2024-09-12T00:42:42.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.904+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.66__multipart_key1.2~94wfl_TzEFDA7TzbyFEJjFAz32DSdDb.9 2024-09-12T00:42:42.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.904+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.66__multipart_key1.2~94wfl_TzEFDA7TzbyFEJjFAz32DSdDb.10 2024-09-12T00:42:42.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.904+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.66__multipart_key1.2~94wfl_TzEFDA7TzbyFEJjFAz32DSdDb.11 2024-09-12T00:42:42.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.912+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:42.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.916+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:42:42.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.920+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:42.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.920+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:42.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.920+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:42.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.924+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:42:42.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.924+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:42.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.924+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:42.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.928+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:42.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.928+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:42:42.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.932+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:42.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.932+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:42.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.932+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:42:42.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.932+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='2~YT8_hxfTX52YkdZ2W0tH7SHS66aazDq', time=2024-09-12T02:42:21.606224+0000, chain.objs.size()=3 2024-09-12T00:42:42.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.932+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.54__multipart_key1.2~YT8_hxfTX52YkdZ2W0tH7SHS66aazDq.7 2024-09-12T00:42:42.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.932+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.54__multipart_key1.2~YT8_hxfTX52YkdZ2W0tH7SHS66aazDq.10 2024-09-12T00:42:42.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.932+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.54__multipart_key1.2~YT8_hxfTX52YkdZ2W0tH7SHS66aazDq.13 2024-09-12T00:42:42.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.940+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:42.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.944+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:42:42.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.944+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:42.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.948+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:42.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.948+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:42.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.948+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:42:42.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.952+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:42.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.952+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:42.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.952+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:42.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.956+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:42:42.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.956+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:42.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.956+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:42.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.956+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:42.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.960+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:42:42.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.960+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:42.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.964+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:42.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.964+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:42:42.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.964+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15522211274598719254', time=2024-09-12T02:42:37.428786+0000, chain.objs.size()=5 2024-09-12T00:42:42.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.964+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.57__multipart_key1.2~31Ybfx-CPYImsRNzzl1TVOxJxG3CqeT.1 2024-09-12T00:42:42.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.964+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.57__multipart_key1.2~31Ybfx-CPYImsRNzzl1TVOxJxG3CqeT.2 2024-09-12T00:42:42.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.964+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.57__multipart_key1.2~31Ybfx-CPYImsRNzzl1TVOxJxG3CqeT.3 2024-09-12T00:42:42.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.964+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.57__multipart_key1.2~31Ybfx-CPYImsRNzzl1TVOxJxG3CqeT.4 2024-09-12T00:42:42.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.964+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.57__multipart_key1.2~31Ybfx-CPYImsRNzzl1TVOxJxG3CqeT.5 2024-09-12T00:42:42.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.968+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:42.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.976+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:42:42.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.976+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:42.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.980+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:42.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.980+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:42:42.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.980+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5825418603142591187', time=2024-09-12T02:42:14.757710+0000, chain.objs.size()=5 2024-09-12T00:42:42.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.980+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~svUhsNpyo_jWLnZvfJPSI0RfeZiVXIE.1 2024-09-12T00:42:42.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.980+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__shadow_key1.2~svUhsNpyo_jWLnZvfJPSI0RfeZiVXIE.1_1 2024-09-12T00:42:42.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.980+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~svUhsNpyo_jWLnZvfJPSI0RfeZiVXIE.2 2024-09-12T00:42:42.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.980+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__shadow_key1.2~svUhsNpyo_jWLnZvfJPSI0RfeZiVXIE.2_1 2024-09-12T00:42:42.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.980+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~svUhsNpyo_jWLnZvfJPSI0RfeZiVXIE.3 2024-09-12T00:42:42.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.980+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10039205234189121992', time=2024-09-12T02:42:33.766262+0000, chain.objs.size()=11 2024-09-12T00:42:42.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.980+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~QClYPKUVxXyAYYSZbS0UqUT9oMyQXZv.1 2024-09-12T00:42:42.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.980+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__shadow_key1.2~QClYPKUVxXyAYYSZbS0UqUT9oMyQXZv.1_1 2024-09-12T00:42:42.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.980+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~QClYPKUVxXyAYYSZbS0UqUT9oMyQXZv.2 2024-09-12T00:42:42.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.980+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__shadow_key1.2~QClYPKUVxXyAYYSZbS0UqUT9oMyQXZv.2_1 2024-09-12T00:42:42.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.980+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~QClYPKUVxXyAYYSZbS0UqUT9oMyQXZv.3 2024-09-12T00:42:42.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.980+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__shadow_key1.2~QClYPKUVxXyAYYSZbS0UqUT9oMyQXZv.3_1 2024-09-12T00:42:42.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.980+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~QClYPKUVxXyAYYSZbS0UqUT9oMyQXZv.4 2024-09-12T00:42:42.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.984+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__shadow_key1.2~QClYPKUVxXyAYYSZbS0UqUT9oMyQXZv.4_1 2024-09-12T00:42:42.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.988+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~QClYPKUVxXyAYYSZbS0UqUT9oMyQXZv.5 2024-09-12T00:42:42.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.988+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__shadow_key1.2~QClYPKUVxXyAYYSZbS0UqUT9oMyQXZv.5_1 2024-09-12T00:42:42.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.988+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~QClYPKUVxXyAYYSZbS0UqUT9oMyQXZv.6 2024-09-12T00:42:42.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:42.996+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:43.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.004+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:42:43.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.004+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.004+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.004+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:42:43.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.004+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10222021604164132308', time=2024-09-12T02:42:15.111268+0000, chain.objs.size()=5 2024-09-12T00:42:43.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.004+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~aLcr3x36jQCVbhDSrFUBD1gMq7c7rU2.1 2024-09-12T00:42:43.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.004+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__shadow_key1.2~aLcr3x36jQCVbhDSrFUBD1gMq7c7rU2.1_1 2024-09-12T00:42:43.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.004+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~aLcr3x36jQCVbhDSrFUBD1gMq7c7rU2.2 2024-09-12T00:42:43.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.004+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__shadow_key1.2~aLcr3x36jQCVbhDSrFUBD1gMq7c7rU2.2_1 2024-09-12T00:42:43.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.004+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~aLcr3x36jQCVbhDSrFUBD1gMq7c7rU2.3 2024-09-12T00:42:43.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.004+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12565091438169113523', time=2024-09-12T02:42:16.675410+0000, chain.objs.size()=5 2024-09-12T00:42:43.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.004+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.51__multipart_key1.2~CmS-HdvvRzwY7znMhTz21eQ1GvYMVYG.1 2024-09-12T00:42:43.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.004+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.51__multipart_key1.2~CmS-HdvvRzwY7znMhTz21eQ1GvYMVYG.2 2024-09-12T00:42:43.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.004+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.51__multipart_key1.2~CmS-HdvvRzwY7znMhTz21eQ1GvYMVYG.3 2024-09-12T00:42:43.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.008+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.51__multipart_key1.2~CmS-HdvvRzwY7znMhTz21eQ1GvYMVYG.4 2024-09-12T00:42:43.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.008+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.51__multipart_key1.2~CmS-HdvvRzwY7znMhTz21eQ1GvYMVYG.5 2024-09-12T00:42:43.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.016+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:43.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.020+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:42:43.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.024+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.024+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.024+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:42:43.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.024+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3210942997499848115', time=2024-09-12T02:42:14.032156+0000, chain.objs.size()=5 2024-09-12T00:42:43.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.024+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~XmidK3zUcVXkw2JiWJyw4wCivoNIjiA.1 2024-09-12T00:42:43.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.024+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__shadow_key1.2~XmidK3zUcVXkw2JiWJyw4wCivoNIjiA.1_1 2024-09-12T00:42:43.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.024+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~XmidK3zUcVXkw2JiWJyw4wCivoNIjiA.2 2024-09-12T00:42:43.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.024+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__shadow_key1.2~XmidK3zUcVXkw2JiWJyw4wCivoNIjiA.2_1 2024-09-12T00:42:43.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.024+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~XmidK3zUcVXkw2JiWJyw4wCivoNIjiA.3 2024-09-12T00:42:43.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.028+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:43.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.032+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:42:43.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.036+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.036+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.036+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:42:43.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.036+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6682156916657934551', time=2024-09-12T02:42:20.635436+0000, chain.objs.size()=1 2024-09-12T00:42:43.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.036+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.53__shadow_.2D_8TSegZyy1jMqlKAKdW-0zGmGtc-b_0 2024-09-12T00:42:43.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.036+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2053719829903435118', time=2024-09-12T02:42:28.904418+0000, chain.objs.size()=11 2024-09-12T00:42:43.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.036+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~h2c-Tr57Y83y0_7xzlGjujqBelOPgah.1 2024-09-12T00:42:43.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.036+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~h2c-Tr57Y83y0_7xzlGjujqBelOPgah.2 2024-09-12T00:42:43.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.036+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~h2c-Tr57Y83y0_7xzlGjujqBelOPgah.3 2024-09-12T00:42:43.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.036+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~h2c-Tr57Y83y0_7xzlGjujqBelOPgah.4 2024-09-12T00:42:43.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.036+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~h2c-Tr57Y83y0_7xzlGjujqBelOPgah.5 2024-09-12T00:42:43.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.036+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~h2c-Tr57Y83y0_7xzlGjujqBelOPgah.6 2024-09-12T00:42:43.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.036+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~h2c-Tr57Y83y0_7xzlGjujqBelOPgah.7 2024-09-12T00:42:43.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.036+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~h2c-Tr57Y83y0_7xzlGjujqBelOPgah.8 2024-09-12T00:42:43.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.036+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~h2c-Tr57Y83y0_7xzlGjujqBelOPgah.9 2024-09-12T00:42:43.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.036+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~h2c-Tr57Y83y0_7xzlGjujqBelOPgah.10 2024-09-12T00:42:43.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.036+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~h2c-Tr57Y83y0_7xzlGjujqBelOPgah.11 2024-09-12T00:42:43.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.048+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:43.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.052+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:42:43.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:42:43.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='2~7sTsMHG6yg5HWQmO78e9RQVFbXhAqmn', time=2024-09-12T02:42:04.306698+0000, chain.objs.size()=5 2024-09-12T00:42:43.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.40__multipart_key1.2~7sTsMHG6yg5HWQmO78e9RQVFbXhAqmn.1 2024-09-12T00:42:43.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.40__multipart_key1.2~7sTsMHG6yg5HWQmO78e9RQVFbXhAqmn.2 2024-09-12T00:42:43.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.40__multipart_key1.2~7sTsMHG6yg5HWQmO78e9RQVFbXhAqmn.3 2024-09-12T00:42:43.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.40__multipart_key1.2~7sTsMHG6yg5HWQmO78e9RQVFbXhAqmn.4 2024-09-12T00:42:43.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.40__multipart_key1.2~7sTsMHG6yg5HWQmO78e9RQVFbXhAqmn.5 2024-09-12T00:42:43.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14863031356876519591', time=2024-09-12T02:42:20.606354+0000, chain.objs.size()=1 2024-09-12T00:42:43.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.53__shadow_.ihywZvQZrT5VGFbDZlO8C7bbwn5867R_0 2024-09-12T00:42:43.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2676466487603078411', time=2024-09-12T02:42:31.335386+0000, chain.objs.size()=10 2024-09-12T00:42:43.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~maZ5skdaLQ8LxXml1G-chNnHPRlGxI7.1 2024-09-12T00:42:43.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~maZ5skdaLQ8LxXml1G-chNnHPRlGxI7.2 2024-09-12T00:42:43.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~maZ5skdaLQ8LxXml1G-chNnHPRlGxI7.3 2024-09-12T00:42:43.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~maZ5skdaLQ8LxXml1G-chNnHPRlGxI7.4 2024-09-12T00:42:43.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~maZ5skdaLQ8LxXml1G-chNnHPRlGxI7.5 2024-09-12T00:42:43.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.056+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~maZ5skdaLQ8LxXml1G-chNnHPRlGxI7.6 2024-09-12T00:42:43.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.064+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~maZ5skdaLQ8LxXml1G-chNnHPRlGxI7.7 2024-09-12T00:42:43.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.064+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~maZ5skdaLQ8LxXml1G-chNnHPRlGxI7.8 2024-09-12T00:42:43.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.064+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~maZ5skdaLQ8LxXml1G-chNnHPRlGxI7.9 2024-09-12T00:42:43.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.064+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~maZ5skdaLQ8LxXml1G-chNnHPRlGxI7.10 2024-09-12T00:42:43.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.064+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6555708310376749705', time=2024-09-12T02:42:38.781944+0000, chain.objs.size()=1 2024-09-12T00:42:43.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.064+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.60__shadow_.oy1JQyxjLEUJiZ-_rqff6WCux2yNaii_0 2024-09-12T00:42:43.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.064+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11699333824615658143', time=2024-09-12T02:42:39.107249+0000, chain.objs.size()=1 2024-09-12T00:42:43.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.064+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.61__shadow_.wu9O4YqvYcfgIIURyAczyahZbl4s2Cw_0 2024-09-12T00:42:43.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.072+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:43.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.076+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:42:43.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.080+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.080+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.080+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:42:43.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.080+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.709048217607139576', time=2024-09-12T02:42:19.554239+0000, chain.objs.size()=5 2024-09-12T00:42:43.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.080+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.52__multipart_key1.2~1W7Vetue1p0yQZStRn5KLb-DDtW_HWU.1 2024-09-12T00:42:43.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.080+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.52__multipart_key1.2~1W7Vetue1p0yQZStRn5KLb-DDtW_HWU.2 2024-09-12T00:42:43.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.080+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.52__multipart_key1.2~1W7Vetue1p0yQZStRn5KLb-DDtW_HWU.3 2024-09-12T00:42:43.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.080+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.52__multipart_key1.2~1W7Vetue1p0yQZStRn5KLb-DDtW_HWU.4 2024-09-12T00:42:43.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.080+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.52__multipart_key1.2~1W7Vetue1p0yQZStRn5KLb-DDtW_HWU.5 2024-09-12T00:42:43.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.080+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12331881706595888441', time=2024-09-12T02:42:20.591116+0000, chain.objs.size()=5 2024-09-12T00:42:43.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.080+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.53__multipart_file.mpg.2~I1dPcSd5blBiO-xvElRKAoid6DJAKV7.1 2024-09-12T00:42:43.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.080+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.53__multipart_file.mpg.2~I1dPcSd5blBiO-xvElRKAoid6DJAKV7.2 2024-09-12T00:42:43.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.080+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.53__multipart_file.mpg.2~I1dPcSd5blBiO-xvElRKAoid6DJAKV7.3 2024-09-12T00:42:43.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.080+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.53__multipart_file.mpg.2~I1dPcSd5blBiO-xvElRKAoid6DJAKV7.4 2024-09-12T00:42:43.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.080+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.53__multipart_file.mpg.2~I1dPcSd5blBiO-xvElRKAoid6DJAKV7.5 2024-09-12T00:42:43.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.088+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:43.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.092+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:42:43.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.092+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.096+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.096+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:42:43.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.096+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17226882995151552380', time=2024-09-12T02:42:39.428270+0000, chain.objs.size()=1 2024-09-12T00:42:43.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.096+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.62__shadow_.CNbL_dvUEYeP-zX_6aOzAqwkOab-m3A_0 2024-09-12T00:42:43.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.096+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:43.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.100+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:42:43.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.100+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.104+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.104+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:42:43.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.104+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14943415202257846205', time=2024-09-12T02:42:33.931990+0000, chain.objs.size()=11 2024-09-12T00:42:43.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.104+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~qjeD2BZv2H3ihKrgvDemVHCOvMCR9DT.1 2024-09-12T00:42:43.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.104+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__shadow_key1.2~qjeD2BZv2H3ihKrgvDemVHCOvMCR9DT.1_1 2024-09-12T00:42:43.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.104+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~qjeD2BZv2H3ihKrgvDemVHCOvMCR9DT.2 2024-09-12T00:42:43.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.104+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__shadow_key1.2~qjeD2BZv2H3ihKrgvDemVHCOvMCR9DT.2_1 2024-09-12T00:42:43.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.104+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~qjeD2BZv2H3ihKrgvDemVHCOvMCR9DT.3 2024-09-12T00:42:43.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.104+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__shadow_key1.2~qjeD2BZv2H3ihKrgvDemVHCOvMCR9DT.3_1 2024-09-12T00:42:43.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.104+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~qjeD2BZv2H3ihKrgvDemVHCOvMCR9DT.4 2024-09-12T00:42:43.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.104+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__shadow_key1.2~qjeD2BZv2H3ihKrgvDemVHCOvMCR9DT.4_1 2024-09-12T00:42:43.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.104+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~qjeD2BZv2H3ihKrgvDemVHCOvMCR9DT.5 2024-09-12T00:42:43.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.104+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__shadow_key1.2~qjeD2BZv2H3ihKrgvDemVHCOvMCR9DT.5_1 2024-09-12T00:42:43.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.104+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~qjeD2BZv2H3ihKrgvDemVHCOvMCR9DT.6 2024-09-12T00:42:43.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.108+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:43.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.116+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:42:43.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.116+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.116+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.116+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.120+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:42:43.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.120+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.120+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.124+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:42:43.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.124+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6130559218878529639', time=2024-09-12T02:42:07.215475+0000, chain.objs.size()=5 2024-09-12T00:42:43.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.124+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.44__multipart_key1.2~KoC8jt8xR0fNJ6BDyifLW2CvhwUXeD9.1 2024-09-12T00:42:43.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.124+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.44__multipart_key1.2~KoC8jt8xR0fNJ6BDyifLW2CvhwUXeD9.2 2024-09-12T00:42:43.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.124+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.44__multipart_key1.2~KoC8jt8xR0fNJ6BDyifLW2CvhwUXeD9.3 2024-09-12T00:42:43.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.124+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.44__multipart_key1.2~KoC8jt8xR0fNJ6BDyifLW2CvhwUXeD9.4 2024-09-12T00:42:43.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.124+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.44__multipart_key1.2~KoC8jt8xR0fNJ6BDyifLW2CvhwUXeD9.5 2024-09-12T00:42:43.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.124+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12391906697921415443', time=2024-09-12T02:42:40.089468+0000, chain.objs.size()=1 2024-09-12T00:42:43.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.124+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.64__shadow_.Ic_N_ypEsKl0uRPVG6D1_DRA4NmJ5SE_0 2024-09-12T00:42:43.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.128+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:43.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.132+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:42:43.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.132+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.132+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.132+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:42:43.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.132+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18324904954743743240', time=2024-09-12T02:42:10.564527+0000, chain.objs.size()=5 2024-09-12T00:42:43.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.132+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~Mc7im-MbO9lKDxoVeTIaeN9V2gSqNau.1 2024-09-12T00:42:43.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.132+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~Mc7im-MbO9lKDxoVeTIaeN9V2gSqNau.2 2024-09-12T00:42:43.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.132+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~Mc7im-MbO9lKDxoVeTIaeN9V2gSqNau.3 2024-09-12T00:42:43.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.132+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~Mc7im-MbO9lKDxoVeTIaeN9V2gSqNau.4 2024-09-12T00:42:43.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.132+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.47__multipart_key1.2~Mc7im-MbO9lKDxoVeTIaeN9V2gSqNau.5 2024-09-12T00:42:43.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.140+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:43.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:42:43.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:42:43.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1507693444089595098', time=2024-09-12T02:42:30.086893+0000, chain.objs.size()=11 2024-09-12T00:42:43.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~tLO3az3vtcO7Bh65lbydVfDw9U9DFtE.1 2024-09-12T00:42:43.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~tLO3az3vtcO7Bh65lbydVfDw9U9DFtE.2 2024-09-12T00:42:43.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~tLO3az3vtcO7Bh65lbydVfDw9U9DFtE.3 2024-09-12T00:42:43.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~tLO3az3vtcO7Bh65lbydVfDw9U9DFtE.4 2024-09-12T00:42:43.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~tLO3az3vtcO7Bh65lbydVfDw9U9DFtE.5 2024-09-12T00:42:43.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~tLO3az3vtcO7Bh65lbydVfDw9U9DFtE.6 2024-09-12T00:42:43.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~tLO3az3vtcO7Bh65lbydVfDw9U9DFtE.7 2024-09-12T00:42:43.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~tLO3az3vtcO7Bh65lbydVfDw9U9DFtE.8 2024-09-12T00:42:43.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~tLO3az3vtcO7Bh65lbydVfDw9U9DFtE.9 2024-09-12T00:42:43.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~tLO3az3vtcO7Bh65lbydVfDw9U9DFtE.10 2024-09-12T00:42:43.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~tLO3az3vtcO7Bh65lbydVfDw9U9DFtE.11 2024-09-12T00:42:43.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx', time=2024-09-12T02:42:38.215053+0000, chain.objs.size()=61 2024-09-12T00:42:43.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.144+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.1 2024-09-12T00:42:43.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.152+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.2 2024-09-12T00:42:43.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.152+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.3 2024-09-12T00:42:43.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.152+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.4 2024-09-12T00:42:43.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.152+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.5 2024-09-12T00:42:43.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.156+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.6 2024-09-12T00:42:43.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.156+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.7 2024-09-12T00:42:43.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.156+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.8 2024-09-12T00:42:43.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.156+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.9 2024-09-12T00:42:43.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.156+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.10 2024-09-12T00:42:43.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.156+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.11 2024-09-12T00:42:43.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.156+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.12 2024-09-12T00:42:43.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.156+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.13 2024-09-12T00:42:43.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.156+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.14 2024-09-12T00:42:43.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.156+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.15 2024-09-12T00:42:43.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.160+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.16 2024-09-12T00:42:43.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.160+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.17 2024-09-12T00:42:43.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.164+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.18 2024-09-12T00:42:43.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.164+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.19 2024-09-12T00:42:43.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.164+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.20 2024-09-12T00:42:43.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.164+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.21 2024-09-12T00:42:43.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.164+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.22 2024-09-12T00:42:43.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.164+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.23 2024-09-12T00:42:43.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.164+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.24 2024-09-12T00:42:43.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.164+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.25 2024-09-12T00:42:43.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.164+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.26 2024-09-12T00:42:43.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.164+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.27 2024-09-12T00:42:43.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.164+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.28 2024-09-12T00:42:43.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.172+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.29 2024-09-12T00:42:43.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.172+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.30 2024-09-12T00:42:43.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.172+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.31 2024-09-12T00:42:43.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.172+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.32 2024-09-12T00:42:43.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.172+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.33 2024-09-12T00:42:43.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.172+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.34 2024-09-12T00:42:43.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.172+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.35 2024-09-12T00:42:43.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.172+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.36 2024-09-12T00:42:43.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.172+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.37 2024-09-12T00:42:43.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.172+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.38 2024-09-12T00:42:43.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.172+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.39 2024-09-12T00:42:43.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.176+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.40 2024-09-12T00:42:43.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.176+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.41 2024-09-12T00:42:43.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.176+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.42 2024-09-12T00:42:43.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.180+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.43 2024-09-12T00:42:43.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.180+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.44 2024-09-12T00:42:43.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.180+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.45 2024-09-12T00:42:43.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.180+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.46 2024-09-12T00:42:43.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.180+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.47 2024-09-12T00:42:43.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.180+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.48 2024-09-12T00:42:43.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.180+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.49 2024-09-12T00:42:43.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.180+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.50 2024-09-12T00:42:43.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.180+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.51 2024-09-12T00:42:43.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.180+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.52 2024-09-12T00:42:43.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.180+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.53 2024-09-12T00:42:43.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.184+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.54 2024-09-12T00:42:43.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.184+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.55 2024-09-12T00:42:43.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.184+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.56 2024-09-12T00:42:43.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.184+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.57 2024-09-12T00:42:43.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.184+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.58 2024-09-12T00:42:43.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.184+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.59 2024-09-12T00:42:43.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.184+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.60 2024-09-12T00:42:43.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.184+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.58__multipart_key1.2~Sxxn4Tob5sSDRr_Cy7mVK8pZpAdDMTx.61 2024-09-12T00:42:43.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.392+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:43.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.400+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:42:43.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.404+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.404+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.404+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.408+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:42:43.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.412+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.412+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.412+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.416+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:42:43.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.420+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.420+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.424+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.424+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:42:43.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.428+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.432+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.432+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.436+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:42:43.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.440+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.444+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.444+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:42:43.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.444+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18258191032086830238', time=2024-09-12T02:42:20.649760+0000, chain.objs.size()=1 2024-09-12T00:42:43.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.444+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.53__shadow_.3F30kVd_HXXizIpZ-uvujOOLBT9FrT1_0 2024-09-12T00:42:43.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.448+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:43.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.456+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:42:43.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.456+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.460+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.460+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:42:43.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.460+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2746125155223849358', time=2024-09-12T02:42:38.453022+0000, chain.objs.size()=1 2024-09-12T00:42:43.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.460+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.59__shadow_.cQXZN_AR055LghCzA1u1Nr-1S4c2ljI_0 2024-09-12T00:42:43.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.464+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:43.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.472+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:42:43.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.476+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.476+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.476+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:42:43.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.476+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2384189599298941970', time=2024-09-12T02:42:32.553018+0000, chain.objs.size()=11 2024-09-12T00:42:43.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.476+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~hn1QZW-DqYEs5NGILlWdmSYPXsFXV-e.1 2024-09-12T00:42:43.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.476+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__shadow_key1.2~hn1QZW-DqYEs5NGILlWdmSYPXsFXV-e.1_1 2024-09-12T00:42:43.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.476+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~hn1QZW-DqYEs5NGILlWdmSYPXsFXV-e.2 2024-09-12T00:42:43.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.476+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__shadow_key1.2~hn1QZW-DqYEs5NGILlWdmSYPXsFXV-e.2_1 2024-09-12T00:42:43.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.476+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~hn1QZW-DqYEs5NGILlWdmSYPXsFXV-e.3 2024-09-12T00:42:43.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.476+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__shadow_key1.2~hn1QZW-DqYEs5NGILlWdmSYPXsFXV-e.3_1 2024-09-12T00:42:43.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.476+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~hn1QZW-DqYEs5NGILlWdmSYPXsFXV-e.4 2024-09-12T00:42:43.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.476+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__shadow_key1.2~hn1QZW-DqYEs5NGILlWdmSYPXsFXV-e.4_1 2024-09-12T00:42:43.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.476+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~hn1QZW-DqYEs5NGILlWdmSYPXsFXV-e.5 2024-09-12T00:42:43.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.476+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__shadow_key1.2~hn1QZW-DqYEs5NGILlWdmSYPXsFXV-e.5_1 2024-09-12T00:42:43.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.476+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.55__multipart_key1.2~hn1QZW-DqYEs5NGILlWdmSYPXsFXV-e.6 2024-09-12T00:42:43.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.496+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:43.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.504+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:42:43.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.504+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.508+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.508+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:42:43.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.508+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13712534759851932324', time=2024-09-12T02:42:35.537058+0000, chain.objs.size()=5 2024-09-12T00:42:43.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.508+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.56__multipart_key1.2~6_JS-bOZMps5WBkPVT86teW5ZGPzPh0.1 2024-09-12T00:42:43.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.508+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.56__multipart_key1.2~6_JS-bOZMps5WBkPVT86teW5ZGPzPh0.2 2024-09-12T00:42:43.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.508+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.56__multipart_key1.2~6_JS-bOZMps5WBkPVT86teW5ZGPzPh0.3 2024-09-12T00:42:43.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.508+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.56__multipart_key1.2~6_JS-bOZMps5WBkPVT86teW5ZGPzPh0.4 2024-09-12T00:42:43.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.508+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.56__multipart_key1.2~6_JS-bOZMps5WBkPVT86teW5ZGPzPh0.5 2024-09-12T00:42:43.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.516+0000 7fbe6f4599c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:43.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.524+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:42:43.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.528+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.528+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.528+0000 7fbe6f4599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.532+0000 7fbd237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:43.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.540+0000 7fbe6f4599c0 20 remove_watcher() i=0 2024-09-12T00:42:43.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.540+0000 7fbe6f4599c0 2 removed watcher, disabling cache 2024-09-12T00:42:43.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.540+0000 7fbe6f4599c0 20 remove_watcher() i=1 2024-09-12T00:42:43.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.544+0000 7fbe6f4599c0 20 remove_watcher() i=2 2024-09-12T00:42:43.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.544+0000 7fbe6f4599c0 20 remove_watcher() i=3 2024-09-12T00:42:43.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.548+0000 7fbe6f4599c0 20 remove_watcher() i=4 2024-09-12T00:42:43.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.552+0000 7fbe6f4599c0 20 remove_watcher() i=5 2024-09-12T00:42:43.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.552+0000 7fbe6f4599c0 20 remove_watcher() i=6 2024-09-12T00:42:43.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.556+0000 7fbe6f4599c0 20 remove_watcher() i=7 2024-09-12T00:42:43.578 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-12T00:42:43.651 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:43.651 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:43.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.696+0000 7f2eb77e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:43.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.700+0000 7f2eb77e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:43.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.700+0000 7f2eb77e29c0 20 realm 2024-09-12T00:42:43.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.700+0000 7f2eb77e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:43.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.700+0000 7f2eb77e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:43.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.700+0000 7f2eb77e29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:43.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.700+0000 7f2eb77e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:43.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.700+0000 7f2eb77e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:43.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.700+0000 7f2eb77e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:43.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.704+0000 7f2eb77e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:43.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.704+0000 7f2eb77e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:43.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.704+0000 7f2eb77e29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:43.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.704+0000 7f2eb77e29c0 20 searching for the correct realm 2024-09-12T00:42:43.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.708+0000 7f2eb5ae9640 0 -- 172.21.15.138:0/2369111387 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55f095c625c0 msgr2=0x55f095c64a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:43.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.716+0000 7f2eb4ae7640 0 -- 172.21.15.138:0/2369111387 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55f095c5d800 msgr2=0x55f095c5fc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:43.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:42:43.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:43.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:42:43.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:43.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:43.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:43.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:43.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:43.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:43.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:43.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:43.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:43.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 20 zone default found 2024-09-12T00:42:43.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 4 Realm: () 2024-09-12T00:42:43.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:42:43.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:42:43.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:43.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 20 zonegroup default 2024-09-12T00:42:43.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:43.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:43.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.724+0000 7f2eb77e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:43.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.728+0000 7f2eb77e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:43.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.728+0000 7f2eb77e29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:43.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.728+0000 7f2eb77e29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:43.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.728+0000 7f2eb77e29c0 20 started sync module instance, tier type = 2024-09-12T00:42:43.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.728+0000 7f2eb77e29c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:42:43.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.744+0000 7f2eb77e29c0 20 add_watcher() i=0 2024-09-12T00:42:43.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.744+0000 7f2eb77e29c0 20 add_watcher() i=1 2024-09-12T00:42:43.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.744+0000 7f2eb77e29c0 20 add_watcher() i=2 2024-09-12T00:42:43.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.744+0000 7f2eb77e29c0 20 add_watcher() i=3 2024-09-12T00:42:43.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.744+0000 7f2eb77e29c0 20 add_watcher() i=4 2024-09-12T00:42:43.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.744+0000 7f2eb77e29c0 20 add_watcher() i=5 2024-09-12T00:42:43.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.744+0000 7f2eb77e29c0 20 add_watcher() i=6 2024-09-12T00:42:43.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.748+0000 7f2eb77e29c0 20 add_watcher() i=7 2024-09-12T00:42:43.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.748+0000 7f2eb77e29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:43.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.752+0000 7f2d6bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:43.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.752+0000 7f2eb77e29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:43.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.752+0000 7f2eb77e29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:43.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.828+0000 7f2d6afe5640 20 reqs_thread_entry: start 2024-09-12T00:42:43.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.828+0000 7f2eb77e29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:43.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.828+0000 7f2eb77e29c0 20 Filter name: none 2024-09-12T00:42:43.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.828+0000 7f2d68fe1640 20 reqs_thread_entry: start 2024-09-12T00:42:43.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.828+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:42:43.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.832+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.836+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.836+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.836+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:42:43.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.840+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.840+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.840+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.844+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:42:43.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.844+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.848+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.848+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.852+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:42:43.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.856+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.856+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.856+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.860+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:42:43.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.864+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.864+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.864+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.868+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:42:43.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.868+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.872+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.872+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.872+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:42:43.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.876+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.880+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.880+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.880+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:42:43.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.884+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.884+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.888+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.888+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:42:43.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.892+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.892+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.892+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.896+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:42:43.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.900+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.900+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.900+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.900 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.904+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:42:43.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.904+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.904+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.908+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.908+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:42:43.909 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.912+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.912+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.911 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.912+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.916+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:42:43.916 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.920+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.920+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.920+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.924+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:42:43.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.924+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.928+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.928+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.928+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:42:43.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.932+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.936+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.936+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.940+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:42:43.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.940+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.944+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.944+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.948+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:42:43.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.948+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.948+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.948+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.952+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:42:43.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.956+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.956+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.956+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.960+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:42:43.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.964+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.968+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.968+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.972+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:42:43.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.976+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.980+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.980+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.980+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:42:43.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.984+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.988+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.988+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.992+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:42:43.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.996+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.996+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:43.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:43.996+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:43.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.000+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:42:44.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.004+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.008+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.008+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.012+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:42:44.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.012+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.016+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.016+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.017 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.020+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:42:44.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.024+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.024+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.028+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.032+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:42:44.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.032+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.036+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.036+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.040+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:42:44.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.044+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.044+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.044+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.048+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:42:44.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.052+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.052+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.056+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.056+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:42:44.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.060+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.060+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.064+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.064+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:42:44.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.068+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.072+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.072+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.076+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:42:44.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.080+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.080+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.080+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.084+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:42:44.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.092+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.092+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.092+0000 7f2eb77e29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.096+0000 7f2d6bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:44.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.104+0000 7f2eb77e29c0 20 remove_watcher() i=0 2024-09-12T00:42:44.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.104+0000 7f2eb77e29c0 2 removed watcher, disabling cache 2024-09-12T00:42:44.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.104+0000 7f2eb77e29c0 20 remove_watcher() i=1 2024-09-12T00:42:44.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.108+0000 7f2eb77e29c0 20 remove_watcher() i=2 2024-09-12T00:42:44.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.112+0000 7f2eb77e29c0 20 remove_watcher() i=3 2024-09-12T00:42:44.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.112+0000 7f2eb77e29c0 20 remove_watcher() i=4 2024-09-12T00:42:44.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.116+0000 7f2eb77e29c0 20 remove_watcher() i=5 2024-09-12T00:42:44.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.116+0000 7f2eb77e29c0 20 remove_watcher() i=6 2024-09-12T00:42:44.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.120+0000 7f2eb77e29c0 20 remove_watcher() i=7 2024-09-12T00:42:44.139 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-12T00:42:44.214 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:44.215 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:44.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.264+0000 7f775b4b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.264+0000 7f775b4b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:44.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.264+0000 7f775b4b89c0 20 realm 2024-09-12T00:42:44.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.264+0000 7f775b4b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.264+0000 7f775b4b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:44.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.264+0000 7f775b4b89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:44.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.264+0000 7f775b4b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.264+0000 7f775b4b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:44.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.264+0000 7f775b4b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.264+0000 7f775b4b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:44.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.264+0000 7f775b4b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.268+0000 7f775b4b89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:44.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.268+0000 7f775b4b89c0 20 searching for the correct realm 2024-09-12T00:42:44.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.272+0000 7f77587bd640 0 -- 172.21.15.138:0/2812468990 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f77480f1040 msgr2=0x7f77480f1930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:44.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.276+0000 7f77587bd640 0 -- 172.21.15.138:0/2812468990 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55dad5dd80f0 msgr2=0x55dad5dda4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:44.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:42:44.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:44.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:42:44.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:44.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:44.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:44.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:44.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:44.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:44.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 zone default found 2024-09-12T00:42:44.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 4 Realm: () 2024-09-12T00:42:44.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:42:44.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:42:44.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:44.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 zonegroup default 2024-09-12T00:42:44.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:44.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:44.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.288+0000 7f775b4b89c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.292+0000 7f775b4b89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:44.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.292+0000 7f775b4b89c0 20 started sync module instance, tier type = 2024-09-12T00:42:44.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.292+0000 7f775b4b89c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:42:44.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.308+0000 7f775b4b89c0 20 add_watcher() i=0 2024-09-12T00:42:44.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.308+0000 7f775b4b89c0 20 add_watcher() i=1 2024-09-12T00:42:44.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.308+0000 7f775b4b89c0 20 add_watcher() i=2 2024-09-12T00:42:44.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.308+0000 7f775b4b89c0 20 add_watcher() i=3 2024-09-12T00:42:44.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.308+0000 7f775b4b89c0 20 add_watcher() i=4 2024-09-12T00:42:44.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.308+0000 7f775b4b89c0 20 add_watcher() i=5 2024-09-12T00:42:44.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.308+0000 7f775b4b89c0 20 add_watcher() i=6 2024-09-12T00:42:44.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.312+0000 7f775b4b89c0 20 add_watcher() i=7 2024-09-12T00:42:44.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.312+0000 7f775b4b89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:44.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.316+0000 7f760f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:44.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.316+0000 7f775b4b89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:44.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.316+0000 7f775b4b89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:44.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.388+0000 7f760e7e4640 20 reqs_thread_entry: start 2024-09-12T00:42:44.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.388+0000 7f775b4b89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:44.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.388+0000 7f775b4b89c0 20 Filter name: none 2024-09-12T00:42:44.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.388+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:42:44.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.388+0000 7f7607fff640 20 reqs_thread_entry: start 2024-09-12T00:42:44.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.392+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.392+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.396+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.396+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:42:44.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.400+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.400+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.400+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.400+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:42:44.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.404+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.404+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.408+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.408+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:42:44.409 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.412+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.412+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.412+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.416+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:42:44.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.420+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.420+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.420+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.424+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:42:44.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.424+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.428+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.428+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.428+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:42:44.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.432+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.432+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.432+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.436+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:42:44.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.436+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.436 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.440+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.440+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.444+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:42:44.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.444+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.448+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.448+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.452+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:42:44.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.456+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.456+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.456+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.460+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:42:44.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.464+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.464+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.464+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.464+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:42:44.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.468+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.468+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.472+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.472+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:42:44.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.476+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.476+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.480+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.480+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:42:44.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.484+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.484+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.484 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.488+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.488+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:42:44.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.492+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.492+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.492+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.496+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:42:44.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.496+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.500+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.500+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.500+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:42:44.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.504+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.508+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.508+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.512+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:42:44.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.512+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.516+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.516+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.516+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:42:44.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.520+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.524+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.524+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.528+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:42:44.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.532+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.532+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.532+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.532+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:42:44.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.536+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.536+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.540+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.540+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:42:44.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.544+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.548+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.548+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.552+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:42:44.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.556+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.556+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.556+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.560+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:42:44.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.564+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.564+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.563 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.568+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.568+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:42:44.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.572+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.576+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.576+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.580+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:42:44.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.584+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.584+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.584+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.588+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:42:44.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.592+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.592+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.596+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.596+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:42:44.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.600+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.604+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.604+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.604+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:42:44.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.608+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.612+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.612+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.616+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:42:44.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.620+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.620+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.620+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.624+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:42:44.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.628+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.628+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.628+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.632+0000 7f775b4b89c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:42:44.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.636+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.636+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.640+0000 7f775b4b89c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.644+0000 7f760f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:44.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.648+0000 7f775b4b89c0 20 remove_watcher() i=0 2024-09-12T00:42:44.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.648+0000 7f775b4b89c0 2 removed watcher, disabling cache 2024-09-12T00:42:44.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.648+0000 7f775b4b89c0 20 remove_watcher() i=1 2024-09-12T00:42:44.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.652+0000 7f775b4b89c0 20 remove_watcher() i=2 2024-09-12T00:42:44.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.656+0000 7f775b4b89c0 20 remove_watcher() i=3 2024-09-12T00:42:44.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.656+0000 7f775b4b89c0 20 remove_watcher() i=4 2024-09-12T00:42:44.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.660+0000 7f775b4b89c0 20 remove_watcher() i=5 2024-09-12T00:42:44.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.664+0000 7f775b4b89c0 20 remove_watcher() i=6 2024-09-12T00:42:44.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.664+0000 7f775b4b89c0 20 remove_watcher() i=7 2024-09-12T00:42:44.681 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-12T00:42:44.754 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:44.754 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:44.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.800+0000 7f031f6ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.804+0000 7f031f6ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:44.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.804+0000 7f031f6ea9c0 20 realm 2024-09-12T00:42:44.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.804+0000 7f031f6ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.804+0000 7f031f6ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:44.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.804+0000 7f031f6ea9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:44.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.804+0000 7f031f6ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.804+0000 7f031f6ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:44.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.804+0000 7f031f6ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.804+0000 7f031f6ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:44.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.804+0000 7f031f6ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.804+0000 7f031f6ea9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:44.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.804+0000 7f031f6ea9c0 20 searching for the correct realm 2024-09-12T00:42:44.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.812+0000 7f031d9f1640 0 -- 172.21.15.138:0/3703985269 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x563cf5d0fd70 msgr2=0x563cf5d12230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:44.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.816+0000 7f031c9ef640 0 -- 172.21.15.138:0/3703985269 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x563cf5d0b030 msgr2=0x563cf5d0d440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:44.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.824+0000 7f031f6ea9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:42:44.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.824+0000 7f031f6ea9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:44.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.824+0000 7f031f6ea9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:42:44.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.824+0000 7f031f6ea9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:44.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.824+0000 7f031f6ea9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:44.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.824+0000 7f031f6ea9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:44.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.824+0000 7f031f6ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.824+0000 7f031f6ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:44.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.824+0000 7f031f6ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.824+0000 7f031f6ea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:44.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.824+0000 7f031f6ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.828+0000 7f031f6ea9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:44.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.828+0000 7f031f6ea9c0 20 zone default found 2024-09-12T00:42:44.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.828+0000 7f031f6ea9c0 4 Realm: () 2024-09-12T00:42:44.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.828+0000 7f031f6ea9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:42:44.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.828+0000 7f031f6ea9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:42:44.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.828+0000 7f031f6ea9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:44.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.828+0000 7f031f6ea9c0 20 zonegroup default 2024-09-12T00:42:44.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.828+0000 7f031f6ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.828+0000 7f031f6ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:44.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.828+0000 7f031f6ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.828+0000 7f031f6ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:44.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.828+0000 7f031f6ea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:44.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.828+0000 7f031f6ea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:44.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.828+0000 7f031f6ea9c0 20 started sync module instance, tier type = 2024-09-12T00:42:44.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.828+0000 7f031f6ea9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:42:44.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.844+0000 7f031f6ea9c0 20 add_watcher() i=0 2024-09-12T00:42:44.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.844+0000 7f031f6ea9c0 20 add_watcher() i=1 2024-09-12T00:42:44.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.844+0000 7f031f6ea9c0 20 add_watcher() i=2 2024-09-12T00:42:44.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.844+0000 7f031f6ea9c0 20 add_watcher() i=3 2024-09-12T00:42:44.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.844+0000 7f031f6ea9c0 20 add_watcher() i=4 2024-09-12T00:42:44.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.844+0000 7f031f6ea9c0 20 add_watcher() i=5 2024-09-12T00:42:44.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.844+0000 7f031f6ea9c0 20 add_watcher() i=6 2024-09-12T00:42:44.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.848+0000 7f031f6ea9c0 20 add_watcher() i=7 2024-09-12T00:42:44.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.848+0000 7f031f6ea9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:44.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.852+0000 7f01d3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:44.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.852+0000 7f031f6ea9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:44.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.852+0000 7f031f6ea9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:44.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.924+0000 7f031f6ea9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:44.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.924+0000 7f01d2fe5640 20 reqs_thread_entry: start 2024-09-12T00:42:44.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.924+0000 7f031f6ea9c0 20 Filter name: none 2024-09-12T00:42:44.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.924+0000 7f01d0fe1640 20 reqs_thread_entry: start 2024-09-12T00:42:44.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.924+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:42:44.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.928+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.928+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.928+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.928+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:42:44.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.932+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.932+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.936+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.936+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:42:44.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.940+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.940+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.940+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.940+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:42:44.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.944+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.948+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.948+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.948+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:42:44.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.952+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.952+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.952+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.956+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:42:44.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.960+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.960+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.960+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.964+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:42:44.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.964+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.964+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.964+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.968+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:42:44.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.972+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.972+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.972+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.976+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:42:44.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.976+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.976+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.980+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.980+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:42:44.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.984+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.984+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.984+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.988+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:42:44.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.992+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.992+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.996+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:44.996+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:42:44.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.000+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:44.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.000+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:44.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.004+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.004+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:42:45.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.008+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.008+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.008+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.012+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:42:45.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.016+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.016+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.016+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.020+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:42:45.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.024+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.024+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.028+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.028+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:42:45.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.032+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.036+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.036+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.040+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:42:45.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.040+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.044+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.044+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.048+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:42:45.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.052+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.052+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.052+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.056+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:42:45.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.060+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.060+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.060+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.064+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:42:45.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.068+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.068+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.068+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.072+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:42:45.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.080+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.080+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.080+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.084+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:42:45.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.088+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.088+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.088+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.092+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:42:45.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.096+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.096+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.096+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.100+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:42:45.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.104+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.104+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.104+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.108+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:42:45.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.112+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.112+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.116+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.116+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:42:45.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.120+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.120+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.124+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.124+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:42:45.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.128+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.128+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.128+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.132+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:42:45.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.132+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.136+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.136+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.140+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:42:45.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.140+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.144+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.144+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.148+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:42:45.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.152+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.152+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.152+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.156+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:42:45.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.160+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.160+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.164+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.164+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:42:45.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.168+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.168+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:45.167 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.172+0000 7f031f6ea9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:45.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.176+0000 7f01d3fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:45.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.180+0000 7f031f6ea9c0 20 remove_watcher() i=0 2024-09-12T00:42:45.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.180+0000 7f031f6ea9c0 2 removed watcher, disabling cache 2024-09-12T00:42:45.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.180+0000 7f031f6ea9c0 20 remove_watcher() i=1 2024-09-12T00:42:45.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.184+0000 7f031f6ea9c0 20 remove_watcher() i=2 2024-09-12T00:42:45.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.184+0000 7f031f6ea9c0 20 remove_watcher() i=3 2024-09-12T00:42:45.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.188+0000 7f031f6ea9c0 20 remove_watcher() i=4 2024-09-12T00:42:45.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.192+0000 7f031f6ea9c0 20 remove_watcher() i=5 2024-09-12T00:42:45.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.196+0000 7f031f6ea9c0 20 remove_watcher() i=6 2024-09-12T00:42:45.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:45.196+0000 7f031f6ea9c0 20 remove_watcher() i=7 2024-09-12T00:42:45.214 DEBUG:teuthology.orchestra.run.smithi138:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T00:42:45.901 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :clean 2024-09-12T00:42:46.697 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :compileJava 2024-09-12T00:42:46.698 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :processResources 2024-09-12T00:42:46.698 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :classes 2024-09-12T00:42:47.198 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:47.198 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :compileTestJava 2024-09-12T00:42:47.198 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:47.198 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:42:47.198 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :testClasses 2024-09-12T00:42:47.198 INFO:teuthology.orchestra.run.smithi138.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:42:47.199 INFO:teuthology.orchestra.run.smithi138.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:42:49.197 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:49.198 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :test 2024-09-12T00:42:49.198 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:49.198 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T00:42:49.199 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12 00:42:48,481 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:42:49.199 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:49.200 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T00:42:49.200 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:49.200 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T00:42:49.200 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:49.200 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T00:42:49.200 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:49.200 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T00:42:49.398 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:49.398 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T00:42:49.398 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:49.398 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T00:42:49.697 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:49.698 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T00:42:49.798 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:49.798 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T00:42:49.897 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:49.898 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T00:42:50.001 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:50.002 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T00:42:50.297 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:50.298 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T00:42:50.397 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:50.398 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T00:42:50.497 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:50.497 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T00:42:50.597 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:50.597 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T00:42:51.097 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:51.098 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T00:42:51.098 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:51.098 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T00:42:51.397 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:51.397 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T00:42:51.497 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:51.497 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T00:42:51.599 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:51.599 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------- 2024-09-12T00:42:51.599 INFO:teuthology.orchestra.run.smithi138.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T00:42:51.599 INFO:teuthology.orchestra.run.smithi138.stdout:-------------------------------------------------------------------- 2024-09-12T00:42:51.599 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:51.599 INFO:teuthology.orchestra.run.smithi138.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:42:51.599 INFO:teuthology.orchestra.run.smithi138.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:42:51.599 INFO:teuthology.orchestra.run.smithi138.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:42:51.599 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:51.599 INFO:teuthology.orchestra.run.smithi138.stdout:BUILD SUCCESSFUL in 6s 2024-09-12T00:42:51.600 INFO:teuthology.orchestra.run.smithi138.stdout:5 actionable tasks: 5 executed 2024-09-12T00:42:51.607 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-12T00:42:51.637 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:51.637 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:51.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.684+0000 7f089f0f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:51.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.684+0000 7f089f0f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:51.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.684+0000 7f089f0f29c0 20 realm 2024-09-12T00:42:51.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.684+0000 7f089f0f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:51.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.688+0000 7f089f0f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:51.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.688+0000 7f089f0f29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:51.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.688+0000 7f089f0f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:51.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.688+0000 7f089f0f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:51.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.688+0000 7f089f0f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:51.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.688+0000 7f089f0f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:51.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.688+0000 7f089f0f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:51.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.688+0000 7f089f0f29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:51.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.688+0000 7f089f0f29c0 20 searching for the correct realm 2024-09-12T00:42:51.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.696+0000 7f089c3f7640 0 -- 172.21.15.138:0/805392230 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f088c111950 msgr2=0x7f088c0ff890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:51.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.704+0000 7f089c3f7640 0 -- 172.21.15.138:0/805392230 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x5635c9c5b300 msgr2=0x5635c9c5d6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:51.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:42:51.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:51.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:42:51.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:51.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:51.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:51.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:51.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:51.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:51.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:51.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:51.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:51.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 zone default found 2024-09-12T00:42:51.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 4 Realm: () 2024-09-12T00:42:51.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:42:51.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:42:51.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:51.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 zonegroup default 2024-09-12T00:42:51.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:51.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:51.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:51.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:51.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.708+0000 7f089f0f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:51.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.712+0000 7f089f0f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:51.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.712+0000 7f089f0f29c0 20 started sync module instance, tier type = 2024-09-12T00:42:51.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.712+0000 7f089f0f29c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:42:51.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.728+0000 7f089f0f29c0 20 add_watcher() i=0 2024-09-12T00:42:51.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.728+0000 7f089f0f29c0 20 add_watcher() i=1 2024-09-12T00:42:51.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.728+0000 7f089f0f29c0 20 add_watcher() i=2 2024-09-12T00:42:51.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.728+0000 7f089f0f29c0 20 add_watcher() i=3 2024-09-12T00:42:51.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.728+0000 7f089f0f29c0 20 add_watcher() i=4 2024-09-12T00:42:51.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.728+0000 7f089f0f29c0 20 add_watcher() i=5 2024-09-12T00:42:51.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.728+0000 7f089f0f29c0 20 add_watcher() i=6 2024-09-12T00:42:51.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.732+0000 7f089f0f29c0 20 add_watcher() i=7 2024-09-12T00:42:51.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.732+0000 7f089f0f29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:51.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.736+0000 7f07537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:51.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.736+0000 7f089f0f29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:51.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.736+0000 7f089f0f29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:51.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.812+0000 7f07527e4640 20 reqs_thread_entry: start 2024-09-12T00:42:51.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.812+0000 7f089f0f29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:51.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.812+0000 7f089f0f29c0 20 Filter name: none 2024-09-12T00:42:51.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.812+0000 7f074b7fe640 20 reqs_thread_entry: start 2024-09-12T00:42:51.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.812+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:42:51.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.816+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.816+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.816+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.816+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:42:51.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.820+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.820+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.820+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.824+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:42:51.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.824+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.828+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.828+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.828+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:42:51.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.832+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.832+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.832+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.836+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:42:51.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.840+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.840+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.840+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:42:51.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.840+0000 7f089f0f29c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2633155646924308191', time=2024-09-12T02:42:50.659297+0000, chain.objs.size()=1 2024-09-12T00:42:51.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.840+0000 7f089f0f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.72__shadow_.OF5NAC4ucrRDC3GlHcBBRhb7qyVhjLg_0 2024-09-12T00:42:51.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.844+0000 7f089f0f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:51.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.848+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:42:51.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.852+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.852+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.856+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.856+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:42:51.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.860+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.864+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.864+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.868+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:42:51.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.868+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.868+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.872+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.872+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:42:51.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.876+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.876+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.876+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.877 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.880+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:42:51.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.884+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.884+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.884+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.888+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:42:51.888 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.892+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.892+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.892+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.896+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:42:51.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.900+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.900+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.900+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.904+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:42:51.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.908+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.908+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.912+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.912+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:42:51.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.916+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.916+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.920+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.920+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:42:51.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.924+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.928+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.928+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.932+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:42:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.936+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.936+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.936+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.940+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:42:51.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.944+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.944+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.948+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:42:51.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.948+0000 7f089f0f29c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6196320458794430551', time=2024-09-12T02:42:50.102247+0000, chain.objs.size()=1 2024-09-12T00:42:51.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.948+0000 7f089f0f29c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.71__shadow_.spOUPdiktb9gCTyxof08FAp4IxVoNbR_0 2024-09-12T00:42:51.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.948+0000 7f089f0f29c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:42:51.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.956+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:42:51.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.960+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.960+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.960+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.964+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:42:51.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.968+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.968+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.972+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.972+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:42:51.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.976+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.980+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.980+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.984+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:42:51.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.988+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.988+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.988+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.992+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:42:51.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.996+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.996+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:51.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:51.996+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:51.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.000+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:42:51.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.000+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.004+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.004+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.008+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:42:52.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.012+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.012+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.016+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.016+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:42:52.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.020+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.024+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.024+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.028+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:42:52.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.032+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.032+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.032+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.036+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:42:52.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.040+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.044+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.044+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.044+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:42:52.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.048+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.052+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.052+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.052+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:42:52.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.056+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.060+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.060+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.064+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:42:52.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.064+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.068+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.068+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.072+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:42:52.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.076+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.076+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.076+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.080+0000 7f089f0f29c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:42:52.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.084+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.084+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.084 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.088+0000 7f089f0f29c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.092+0000 7f07537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:52.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.096+0000 7f089f0f29c0 20 remove_watcher() i=0 2024-09-12T00:42:52.094 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.096+0000 7f089f0f29c0 2 removed watcher, disabling cache 2024-09-12T00:42:52.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.100+0000 7f089f0f29c0 20 remove_watcher() i=1 2024-09-12T00:42:52.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.100+0000 7f089f0f29c0 20 remove_watcher() i=2 2024-09-12T00:42:52.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.104+0000 7f089f0f29c0 20 remove_watcher() i=3 2024-09-12T00:42:52.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.104+0000 7f089f0f29c0 20 remove_watcher() i=4 2024-09-12T00:42:52.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.108+0000 7f089f0f29c0 20 remove_watcher() i=5 2024-09-12T00:42:52.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.112+0000 7f089f0f29c0 20 remove_watcher() i=6 2024-09-12T00:42:52.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.116+0000 7f089f0f29c0 20 remove_watcher() i=7 2024-09-12T00:42:52.132 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-12T00:42:52.211 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:52.211 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:52.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.260+0000 7fab290159c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.260+0000 7fab290159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.260+0000 7fab290159c0 20 realm 2024-09-12T00:42:52.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.260+0000 7fab290159c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:52.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.260+0000 7fab290159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:52.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.260+0000 7fab290159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:52.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.260+0000 7fab290159c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:52.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.260+0000 7fab290159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:52.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.260+0000 7fab290159c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:52.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.264+0000 7fab290159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:52.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.264+0000 7fab290159c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:52.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.264+0000 7fab290159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:52.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.264+0000 7fab290159c0 20 searching for the correct realm 2024-09-12T00:42:52.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.268+0000 7fab2731c640 0 -- 172.21.15.138:0/1337106217 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fab1806a6d0 msgr2=0x7fab1805fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:52.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.484+0000 7fab2731c640 0 -- 172.21.15.138:0/1337106217 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x559d45ab9e60 msgr2=0x559d45abc320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:52.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.492+0000 7fab290159c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:42:52.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.492+0000 7fab290159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:52.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.492+0000 7fab290159c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:42:52.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.492+0000 7fab290159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:52.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.492+0000 7fab290159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:52.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.492+0000 7fab290159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:52.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.492+0000 7fab290159c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:52.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.496+0000 7fab290159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:52.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.496+0000 7fab290159c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:52.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.496+0000 7fab290159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:52.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.496+0000 7fab290159c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:52.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.496+0000 7fab290159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:52.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.496+0000 7fab290159c0 20 zone default found 2024-09-12T00:42:52.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.496+0000 7fab290159c0 4 Realm: () 2024-09-12T00:42:52.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.496+0000 7fab290159c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:42:52.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.496+0000 7fab290159c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:42:52.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.496+0000 7fab290159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:52.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.496+0000 7fab290159c0 20 zonegroup default 2024-09-12T00:42:52.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.496+0000 7fab290159c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:52.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.496+0000 7fab290159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:52.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.496+0000 7fab290159c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:52.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.500+0000 7fab290159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:52.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.500+0000 7fab290159c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:52.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.500+0000 7fab290159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:52.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.500+0000 7fab290159c0 20 started sync module instance, tier type = 2024-09-12T00:42:52.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.500+0000 7fab290159c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:42:52.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.524+0000 7fab290159c0 20 add_watcher() i=0 2024-09-12T00:42:52.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.524+0000 7fab290159c0 20 add_watcher() i=1 2024-09-12T00:42:52.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.524+0000 7fab290159c0 20 add_watcher() i=2 2024-09-12T00:42:52.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.524+0000 7fab290159c0 20 add_watcher() i=3 2024-09-12T00:42:52.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.524+0000 7fab290159c0 20 add_watcher() i=4 2024-09-12T00:42:52.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.524+0000 7fab290159c0 20 add_watcher() i=5 2024-09-12T00:42:52.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.524+0000 7fab290159c0 20 add_watcher() i=6 2024-09-12T00:42:52.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.528+0000 7fab290159c0 20 add_watcher() i=7 2024-09-12T00:42:52.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.528+0000 7fab290159c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:52.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.528+0000 7fa9dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:52.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.532+0000 7fab290159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:52.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.532+0000 7fab290159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.620+0000 7fa957fff640 20 reqs_thread_entry: start 2024-09-12T00:42:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.620+0000 7fab290159c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.620+0000 7fab290159c0 20 Filter name: none 2024-09-12T00:42:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.620+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:42:52.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.620+0000 7fa955ffb640 20 reqs_thread_entry: start 2024-09-12T00:42:52.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.624+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.624+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.624+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.628+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:42:52.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.632+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.632+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.632+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.636+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:42:52.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.636+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.636+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.636+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.640+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:42:52.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.644+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.644+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.644+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.648+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:42:52.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.648+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.648+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.652+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.652+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:42:52.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.656+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.656+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.660+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.660+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:42:52.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.664+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.668+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.668+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.676+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:42:52.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.676+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.680+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.680+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.680+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:42:52.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.684+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.688+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.688+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.692+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:42:52.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.696+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.696+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.696+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.700+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:42:52.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.704+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.704+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.704+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.708+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:42:52.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.712+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.716+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.716+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.720+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:42:52.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.720+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.724+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.724+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.728+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:42:52.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.732+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.732+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.732+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.736+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:42:52.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.740+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.744+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.744+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.748+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:42:52.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.752+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.752+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.752+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.756+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:42:52.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.760+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.760+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.760+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.764+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:42:52.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.768+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.768+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.768+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.772+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:42:52.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.776+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.776+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.780+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.780+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:42:52.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.784+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.784+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.788+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.788+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:42:52.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.792+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.796+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.796+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.796+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:42:52.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.800+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.804+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.804+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.808+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:42:52.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.812+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.812+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.812+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.816+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:42:52.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.820+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.824+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.824+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.828+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:42:52.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.828+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.832+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.832+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.836+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:42:52.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.840+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.840+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.840+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.844+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:42:52.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.848+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.848+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.848+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.852+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:42:52.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.856+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.856+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.860+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.860+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:42:52.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.864+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.864+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.868+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.868+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:42:52.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.872+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.876+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.876+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.876+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:42:52.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.880+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.884+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.884+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.888+0000 7fab290159c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:42:52.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.892+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.892+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:52.892 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.896+0000 7fab290159c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:52.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.900+0000 7fa9dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:52.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.904+0000 7fab290159c0 20 remove_watcher() i=0 2024-09-12T00:42:52.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.904+0000 7fab290159c0 2 removed watcher, disabling cache 2024-09-12T00:42:52.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.904+0000 7fab290159c0 20 remove_watcher() i=1 2024-09-12T00:42:52.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.908+0000 7fab290159c0 20 remove_watcher() i=2 2024-09-12T00:42:52.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.912+0000 7fab290159c0 20 remove_watcher() i=3 2024-09-12T00:42:52.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.912+0000 7fab290159c0 20 remove_watcher() i=4 2024-09-12T00:42:52.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.916+0000 7fab290159c0 20 remove_watcher() i=5 2024-09-12T00:42:52.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.916+0000 7fab290159c0 20 remove_watcher() i=6 2024-09-12T00:42:52.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:52.920+0000 7fab290159c0 20 remove_watcher() i=7 2024-09-12T00:42:52.936 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-12T00:42:53.012 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:53.012 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:53.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.060+0000 7f22985f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.060+0000 7f22985f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.060+0000 7f22985f79c0 20 realm 2024-09-12T00:42:53.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.060+0000 7f22985f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.060+0000 7f22985f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.060+0000 7f22985f79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:53.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.060+0000 7f22985f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.064+0000 7f22985f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.064+0000 7f22985f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.064+0000 7f22985f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:53.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.064+0000 7f22985f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.064+0000 7f22985f79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:53.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.064+0000 7f22985f79c0 20 searching for the correct realm 2024-09-12T00:42:53.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.068+0000 7f22968fe640 0 -- 172.21.15.138:0/2296160407 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f229008f4e0 msgr2=0x7f229008fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:53.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.284+0000 7f22968fe640 0 -- 172.21.15.138:0/2296160407 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x560fe3094590 msgr2=0x560fe3096a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:53.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.292+0000 7f22985f79c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:42:53.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.292+0000 7f22985f79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:53.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.292+0000 7f22985f79c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:42:53.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.292+0000 7f22985f79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:53.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.292+0000 7f22985f79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:53.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.292+0000 7f22985f79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:53.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.292+0000 7f22985f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.292+0000 7f22985f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:53.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:53.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 20 zone default found 2024-09-12T00:42:53.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 4 Realm: () 2024-09-12T00:42:53.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:42:53.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:42:53.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:53.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 20 zonegroup default 2024-09-12T00:42:53.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 20 started sync module instance, tier type = 2024-09-12T00:42:53.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.296+0000 7f22985f79c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:42:53.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.320+0000 7f22985f79c0 20 add_watcher() i=0 2024-09-12T00:42:53.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.320+0000 7f22985f79c0 20 add_watcher() i=1 2024-09-12T00:42:53.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.320+0000 7f22985f79c0 20 add_watcher() i=2 2024-09-12T00:42:53.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.320+0000 7f22985f79c0 20 add_watcher() i=3 2024-09-12T00:42:53.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.320+0000 7f22985f79c0 20 add_watcher() i=4 2024-09-12T00:42:53.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.320+0000 7f22985f79c0 20 add_watcher() i=5 2024-09-12T00:42:53.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.320+0000 7f22985f79c0 20 add_watcher() i=6 2024-09-12T00:42:53.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.320+0000 7f22985f79c0 20 add_watcher() i=7 2024-09-12T00:42:53.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.320+0000 7f22985f79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:53.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.324+0000 7f214cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:53.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.328+0000 7f22985f79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:53.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.328+0000 7f22985f79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:53.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.428+0000 7f20c77fe640 20 reqs_thread_entry: start 2024-09-12T00:42:53.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.428+0000 7f22985f79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:53.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.428+0000 7f22985f79c0 20 Filter name: none 2024-09-12T00:42:53.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.428+0000 7f20c57fa640 20 reqs_thread_entry: start 2024-09-12T00:42:53.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.428+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:42:53.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.432+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.432+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.432+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.436+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:42:53.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.440+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.440+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.440+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.444+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:42:53.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.448+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.448+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.448+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.452+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:42:53.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.452+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.452+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.456+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.456+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:42:53.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.460+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.460+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.460+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.464+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:42:53.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.464+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.468+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.468+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.472+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:42:53.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.472+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.476+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.476+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.476+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:42:53.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.480+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.484+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.484+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.488+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:42:53.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.492+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.492+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.492+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.496+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:42:53.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.500+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.500+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.504+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.504+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:42:53.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.508+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.508+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.508+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.512+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:42:53.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.516+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.516+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.520+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.520+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:42:53.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.524+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.528+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.528+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.528+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:42:53.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.532+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.536+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.536+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.536+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:42:53.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.540+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.544+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.544+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.548+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:42:53.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.548+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.552+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.552+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.556+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:42:53.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.560+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.560+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.560+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.564+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:42:53.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.568+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.572+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.572+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.576+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:42:53.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.580+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.578 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.580+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.580+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.584+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:42:53.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.588+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.588+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.592+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.592+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:42:53.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.596+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.600+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.600+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.604+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:42:53.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.608+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.608+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.608+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.612+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:42:53.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.616+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.620+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.620+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.624+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:42:53.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.628+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.628+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.632+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.632+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:42:53.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.636+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.636+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.636+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.640+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:42:53.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.644+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.644+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.644+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.648+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:42:53.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.652+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.652+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.652+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.656+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:42:53.656 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.660+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.660+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.660+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.664+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:42:53.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.664+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.668+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.668+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.676+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:42:53.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.680+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.680+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.680+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.684+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:42:53.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.688+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.688+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.688+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.692+0000 7f22985f79c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:42:53.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.696+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.696+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:53.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.696+0000 7f22985f79c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:53.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.700+0000 7f214cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:53.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.708+0000 7f22985f79c0 20 remove_watcher() i=0 2024-09-12T00:42:53.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.708+0000 7f22985f79c0 2 removed watcher, disabling cache 2024-09-12T00:42:53.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.708+0000 7f22985f79c0 20 remove_watcher() i=1 2024-09-12T00:42:53.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.712+0000 7f22985f79c0 20 remove_watcher() i=2 2024-09-12T00:42:53.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.716+0000 7f22985f79c0 20 remove_watcher() i=3 2024-09-12T00:42:53.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.716+0000 7f22985f79c0 20 remove_watcher() i=4 2024-09-12T00:42:53.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.720+0000 7f22985f79c0 20 remove_watcher() i=5 2024-09-12T00:42:53.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.720+0000 7f22985f79c0 20 remove_watcher() i=6 2024-09-12T00:42:53.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.724+0000 7f22985f79c0 20 remove_watcher() i=7 2024-09-12T00:42:53.744 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-12T00:42:53.819 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:53.819 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:53.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.868+0000 7f4727f2f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.868+0000 7f4727f2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.868+0000 7f4727f2f9c0 20 realm 2024-09-12T00:42:53.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.868+0000 7f4727f2f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.868+0000 7f4727f2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.868+0000 7f4727f2f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.868+0000 7f4727f2f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.868+0000 7f4727f2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.868+0000 7f4727f2f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.872+0000 7f4727f2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:53.868 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.872+0000 7f4727f2f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.872+0000 7f4727f2f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:53.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.872+0000 7f4727f2f9c0 20 searching for the correct realm 2024-09-12T00:42:53.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:53.876+0000 7f4726236640 0 -- 172.21.15.138:0/422772151 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f47200cf420 msgr2=0x7f47200cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:54.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.092+0000 7f4726236640 0 -- 172.21.15.138:0/422772151 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x557274549a40 msgr2=0x55727454bf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:54.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.100+0000 7f4727f2f9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:42:54.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.100+0000 7f4727f2f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:54.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.100+0000 7f4727f2f9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:42:54.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.100+0000 7f4727f2f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:54.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.100+0000 7f4727f2f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:54.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.100+0000 7f4727f2f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:54.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.100+0000 7f4727f2f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:54.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.100+0000 7f4727f2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:54.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.100+0000 7f4727f2f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:54.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.104+0000 7f4727f2f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:54.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.104+0000 7f4727f2f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:54.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.104+0000 7f4727f2f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:54.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.104+0000 7f4727f2f9c0 20 zone default found 2024-09-12T00:42:54.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.104+0000 7f4727f2f9c0 4 Realm: () 2024-09-12T00:42:54.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.104+0000 7f4727f2f9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:42:54.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.104+0000 7f4727f2f9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:42:54.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.104+0000 7f4727f2f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:54.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.104+0000 7f4727f2f9c0 20 zonegroup default 2024-09-12T00:42:54.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.104+0000 7f4727f2f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:54.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.104+0000 7f4727f2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:54.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.104+0000 7f4727f2f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:54.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.104+0000 7f4727f2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:54.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.104+0000 7f4727f2f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:42:54.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.104+0000 7f4727f2f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:54.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.104+0000 7f4727f2f9c0 20 started sync module instance, tier type = 2024-09-12T00:42:54.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.104+0000 7f4727f2f9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:42:54.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.128+0000 7f4727f2f9c0 20 add_watcher() i=0 2024-09-12T00:42:54.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.128+0000 7f4727f2f9c0 20 add_watcher() i=1 2024-09-12T00:42:54.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.128+0000 7f4727f2f9c0 20 add_watcher() i=2 2024-09-12T00:42:54.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.128+0000 7f4727f2f9c0 20 add_watcher() i=3 2024-09-12T00:42:54.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.128+0000 7f4727f2f9c0 20 add_watcher() i=4 2024-09-12T00:42:54.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.128+0000 7f4727f2f9c0 20 add_watcher() i=5 2024-09-12T00:42:54.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.128+0000 7f4727f2f9c0 20 add_watcher() i=6 2024-09-12T00:42:54.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.132+0000 7f4727f2f9c0 20 add_watcher() i=7 2024-09-12T00:42:54.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.132+0000 7f4727f2f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:54.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.136+0000 7f45dbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:54.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.136+0000 7f4727f2f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:54.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.136+0000 7f4727f2f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:54.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.232+0000 7f45dafe5640 20 reqs_thread_entry: start 2024-09-12T00:42:54.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.232+0000 7f4727f2f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:42:54.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.232+0000 7f4727f2f9c0 20 Filter name: none 2024-09-12T00:42:54.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.232+0000 7f45d8fe1640 20 reqs_thread_entry: start 2024-09-12T00:42:54.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.232+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:42:54.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.236+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.236+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.236+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.240+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:42:54.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.240+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.244+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.244+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.244+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:42:54.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.248+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.248+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.248+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.252+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:42:54.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.256+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.256+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.256+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.260+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:42:54.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.264+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.264+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.264+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.268+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:42:54.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.268+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.272+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.272+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.272+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:42:54.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.276+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.276+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.280+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.280+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:42:54.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.284+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.284+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.288+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.288+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:42:54.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.292+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.292+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.292+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.296+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:42:54.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.300+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.300+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.300+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.304+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:42:54.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.308+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.308+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.308+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.312+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:42:54.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.316+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.316+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.314 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.316+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.320+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:42:54.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.324+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.324+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.324+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.328+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:42:54.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.332+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.332+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.332+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.336+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:42:54.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.340+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.340+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.340+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.344+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:42:54.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.348+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.348+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.352+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.352+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:42:54.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.356+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.356+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.356+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.360+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:42:54.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.364+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.364+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.364+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.368+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:42:54.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.372+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.372+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.372+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.376+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:42:54.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.380+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.380+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.380+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.384+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:42:54.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.388+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.388+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.392+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.392+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:42:54.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.396+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.400+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.400+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.404+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:42:54.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.404+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.408+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.408+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.412+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:42:54.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.416+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.416+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.416+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.420+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:42:54.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.424+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.424+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.428+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.428+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:42:54.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.432+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.436+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.436+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.436+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:42:54.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.440+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.444+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.444+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.448+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:42:54.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.448+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.452+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.452+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.456+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:42:54.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.460+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.460+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.460+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.464+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:42:54.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.468+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.468+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.468+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.472+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:42:54.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.476+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.480+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.480+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.484+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:42:54.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.488+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.488+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:42:54.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.492+0000 7f4727f2f9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:42:54.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.496+0000 7f45dbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:54.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.500+0000 7f4727f2f9c0 20 remove_watcher() i=0 2024-09-12T00:42:54.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.500+0000 7f4727f2f9c0 2 removed watcher, disabling cache 2024-09-12T00:42:54.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.504+0000 7f4727f2f9c0 20 remove_watcher() i=1 2024-09-12T00:42:54.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.504+0000 7f4727f2f9c0 20 remove_watcher() i=2 2024-09-12T00:42:54.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.508+0000 7f4727f2f9c0 20 remove_watcher() i=3 2024-09-12T00:42:54.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.508+0000 7f4727f2f9c0 20 remove_watcher() i=4 2024-09-12T00:42:54.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.512+0000 7f4727f2f9c0 20 remove_watcher() i=5 2024-09-12T00:42:54.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.516+0000 7f4727f2f9c0 20 remove_watcher() i=6 2024-09-12T00:42:54.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:42:54.516+0000 7f4727f2f9c0 20 remove_watcher() i=7 2024-09-12T00:42:54.535 DEBUG:teuthology.orchestra.run.smithi138:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T00:42:55.259 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :clean 2024-09-12T00:42:56.055 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :compileJava 2024-09-12T00:42:56.055 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :processResources 2024-09-12T00:42:56.056 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :classes 2024-09-12T00:42:56.655 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:56.656 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :compileTestJava 2024-09-12T00:42:56.656 INFO:teuthology.orchestra.run.smithi138.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:42:56.656 INFO:teuthology.orchestra.run.smithi138.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:42:56.657 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:56.657 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:42:56.657 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :testClasses 2024-09-12T00:42:58.656 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:58.656 INFO:teuthology.orchestra.run.smithi138.stdout:> Task :test 2024-09-12T00:42:58.656 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:58.656 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests STANDARD_OUT 2024-09-12T00:42:58.656 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12 00:42:58,137 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:42:58.656 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:58.657 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T00:42:58.657 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:58.657 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T00:42:58.956 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:58.956 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T00:42:59.055 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:59.055 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T00:42:59.355 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:59.355 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T00:42:59.455 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:59.455 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T00:42:59.655 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:42:59.655 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T00:43:00.655 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:00.656 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T00:43:00.955 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:00.956 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T00:43:01.055 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:01.055 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T00:43:01.256 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:01.256 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T00:43:01.455 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:01.456 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T00:43:01.756 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:01.756 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T00:43:01.756 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:01.756 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T00:43:01.855 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:01.856 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T00:43:01.856 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:01.856 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T00:43:02.155 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:02.156 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T00:43:02.555 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:02.555 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T00:43:02.855 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:02.856 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T00:43:02.955 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:02.956 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T00:43:03.255 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:03.255 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T00:43:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:03.355 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T00:43:03.555 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:03.556 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T00:43:03.656 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:03.796 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T00:43:03.956 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:03.956 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T00:43:03.956 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:03.957 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T00:43:04.356 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:04.356 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T00:43:04.356 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:04.356 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T00:43:04.655 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:04.655 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T00:43:04.755 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:04.756 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T00:43:05.055 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:05.055 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T00:43:05.156 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:05.157 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T00:43:05.455 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:05.455 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T00:43:06.055 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:06.055 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T00:43:06.456 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:06.456 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T00:43:12.755 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:12.755 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T00:43:13.255 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:13.256 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T00:43:13.256 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:13.256 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T00:43:13.555 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:13.555 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T00:43:13.556 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:13.556 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T00:43:14.055 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:14.055 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T00:43:14.455 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:14.455 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T00:43:14.755 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:14.755 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T00:43:14.855 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:14.856 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T00:43:14.955 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:14.955 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T00:43:15.755 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:15.755 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T00:43:16.055 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:16.055 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:43:16.555 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:16.555 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:43:16.855 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:16.855 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T00:43:17.655 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:17.656 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T00:43:17.855 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:17.855 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T00:43:22.756 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:22.756 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T00:43:23.055 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:23.055 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T00:43:24.255 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:24.256 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T00:43:24.555 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:24.555 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T00:43:25.255 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:25.255 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T00:43:25.555 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:25.556 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T00:43:26.155 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:26.155 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T00:43:26.555 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:26.555 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T00:43:26.555 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:26.555 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T00:43:26.655 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:26.655 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T00:43:26.655 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:26.655 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T00:43:26.955 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:26.955 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T00:43:27.055 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:27.055 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T00:43:27.355 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:27.356 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T00:43:27.356 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:27.356 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T00:43:27.655 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:27.655 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T00:43:27.755 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:27.755 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T00:43:27.955 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:27.955 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T00:43:28.055 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:28.055 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T00:43:28.355 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:28.355 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T00:43:28.356 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:28.356 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T00:43:28.655 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:28.656 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T00:43:28.755 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:28.755 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T00:43:29.055 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:29.055 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T00:43:29.255 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:29.255 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T00:43:29.555 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:29.555 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T00:43:29.655 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:29.655 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T00:43:30.055 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:30.055 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T00:43:30.155 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:30.155 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T00:43:30.455 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:30.456 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T00:43:30.655 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:30.655 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T00:43:30.955 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:30.955 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T00:43:31.055 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:31.055 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T00:43:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:31.455 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T00:43:31.555 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:31.555 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T00:43:31.855 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:31.855 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T00:43:32.055 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:32.055 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T00:43:32.355 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:32.355 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T00:43:32.455 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:32.455 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T00:43:32.756 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:32.756 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T00:43:32.955 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:32.955 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T00:43:33.256 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:33.256 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T00:43:33.355 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:33.355 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T00:43:33.756 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:33.756 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T00:43:33.855 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:33.855 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T00:43:34.156 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:34.156 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T00:43:34.255 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:34.255 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T00:43:34.555 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:34.555 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T00:43:34.655 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:34.655 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T00:43:35.055 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:35.055 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T00:43:35.155 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:35.155 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T00:43:35.455 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:35.455 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T00:43:35.555 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:35.556 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T00:43:35.955 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:35.955 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T00:43:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:36.055 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T00:43:36.355 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:36.355 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T00:43:36.555 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:36.555 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T00:43:36.855 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:36.855 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T00:43:36.955 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:36.956 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T00:43:37.255 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:37.255 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T00:43:37.356 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:37.356 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T00:43:37.655 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:37.655 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T00:43:37.855 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:37.855 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T00:43:38.155 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:38.155 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T00:43:38.255 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:38.255 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T00:43:38.555 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:38.555 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T00:43:38.655 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:38.655 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T00:43:38.855 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:38.855 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T00:43:38.955 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:38.955 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T00:43:39.255 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:39.255 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T00:43:39.256 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:39.256 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T00:43:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:39.555 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T00:43:39.655 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:39.655 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T00:43:39.857 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:39.913 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T00:43:40.155 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:40.155 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T00:43:40.355 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:40.356 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T00:43:40.455 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:40.455 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T00:43:40.555 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:40.555 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T00:43:40.655 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:40.655 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T00:43:40.855 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:40.855 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T00:43:40.955 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:40.955 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T00:43:41.255 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:41.255 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T00:43:41.355 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:41.355 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T00:43:41.655 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:41.655 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T00:43:41.656 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:41.656 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T00:43:41.955 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:41.956 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T00:43:42.555 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:42.555 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T00:43:42.855 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:42.855 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T00:43:43.455 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:43.455 INFO:teuthology.orchestra.run.smithi138.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T00:43:43.755 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:43.755 INFO:teuthology.orchestra.run.smithi138.stdout:---------------------------------------------------------------------- 2024-09-12T00:43:43.756 INFO:teuthology.orchestra.run.smithi138.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T00:43:43.756 INFO:teuthology.orchestra.run.smithi138.stdout:---------------------------------------------------------------------- 2024-09-12T00:43:43.756 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:43.756 INFO:teuthology.orchestra.run.smithi138.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:43:43.756 INFO:teuthology.orchestra.run.smithi138.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:43:43.756 INFO:teuthology.orchestra.run.smithi138.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:43:43.756 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:43.756 INFO:teuthology.orchestra.run.smithi138.stdout:BUILD SUCCESSFUL in 49s 2024-09-12T00:43:43.756 INFO:teuthology.orchestra.run.smithi138.stdout:5 actionable tasks: 5 executed 2024-09-12T00:43:43.771 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-12T00:43:43.796 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:43.796 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:43.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.839+0000 7f0d2954e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:43.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.843+0000 7f0d2954e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:43.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.843+0000 7f0d2954e9c0 20 realm 2024-09-12T00:43:43.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.843+0000 7f0d2954e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:43.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.843+0000 7f0d2954e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:43.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.843+0000 7f0d2954e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:43.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.843+0000 7f0d2954e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:43.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.843+0000 7f0d2954e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:43.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.843+0000 7f0d2954e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:43.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.843+0000 7f0d2954e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:43.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.843+0000 7f0d2954e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:43.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.843+0000 7f0d2954e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:43.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.843+0000 7f0d2954e9c0 20 searching for the correct realm 2024-09-12T00:43:43.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.851+0000 7f0d27054640 0 -- 172.21.15.138:0/4251699204 >> [v2:172.21.15.138:6816/3496313381,v1:172.21.15.138:6817/3496313381] conn(0x7f0d2000e070 msgr2=0x7f0d20088e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:43.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.859+0000 7f0d27054640 0 -- 172.21.15.138:0/4251699204 >> [v2:172.21.15.178:6811/2062234204,v1:172.21.15.178:6813/2062234204] conn(0x7f0d180c6940 msgr2=0x7f0d180d3420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:43.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:43.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:43.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:43.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:43.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:43.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:43.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:43.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:43.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:43.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:43.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:43.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:43.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 20 zone default found 2024-09-12T00:43:43.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 4 Realm: () 2024-09-12T00:43:43.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:43.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:43.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:43.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 20 zonegroup default 2024-09-12T00:43:43.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.863+0000 7f0d2954e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:43.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.867+0000 7f0d2954e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:43.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.867+0000 7f0d2954e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:43.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.867+0000 7f0d2954e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:43.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.867+0000 7f0d2954e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:43.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.867+0000 7f0d2954e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:43.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.867+0000 7f0d2954e9c0 20 started sync module instance, tier type = 2024-09-12T00:43:43.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.867+0000 7f0d2954e9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:43.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.883+0000 7f0d2954e9c0 20 add_watcher() i=0 2024-09-12T00:43:43.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.883+0000 7f0d2954e9c0 20 add_watcher() i=1 2024-09-12T00:43:43.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.883+0000 7f0d2954e9c0 20 add_watcher() i=2 2024-09-12T00:43:43.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.883+0000 7f0d2954e9c0 20 add_watcher() i=3 2024-09-12T00:43:43.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.883+0000 7f0d2954e9c0 20 add_watcher() i=4 2024-09-12T00:43:43.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.883+0000 7f0d2954e9c0 20 add_watcher() i=5 2024-09-12T00:43:43.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.883+0000 7f0d2954e9c0 20 add_watcher() i=6 2024-09-12T00:43:43.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.887+0000 7f0d2954e9c0 20 add_watcher() i=7 2024-09-12T00:43:43.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.887+0000 7f0d2954e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:43.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.891+0000 7f0bddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:43.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.891+0000 7f0d2954e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:43.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.891+0000 7f0d2954e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:43.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.963+0000 7f0bdcfe1640 20 reqs_thread_entry: start 2024-09-12T00:43:43.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.967+0000 7f0d2954e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:43.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.967+0000 7f0d2954e9c0 20 Filter name: none 2024-09-12T00:43:43.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.967+0000 7f0b567fc640 20 reqs_thread_entry: start 2024-09-12T00:43:43.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.967+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:43:43.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.967+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:43.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.971+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:43.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.971+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:43.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.971+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16426035302941851069', time=2024-09-12T02:43:32.575883+0000, chain.objs.size()=1 2024-09-12T00:43:43.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.971+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.120__shadow_.24xfug_Ug4WLvegTFFYjaHEgEeP53di_0 2024-09-12T00:43:43.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.975+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:43.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.979+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:43:43.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.979+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:43.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.983+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:43.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.983+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:43:43.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.983+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11355086993698137509', time=2024-09-12T02:43:12.839299+0000, chain.objs.size()=4 2024-09-12T00:43:43.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.983+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.93__shadow_.5y_PqAGW1zP5RlFSW5g2qZppS-uLkim_0 2024-09-12T00:43:43.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.983+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.93__shadow_.5y_PqAGW1zP5RlFSW5g2qZppS-uLkim_1 2024-09-12T00:43:43.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.983+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.93__shadow_.5y_PqAGW1zP5RlFSW5g2qZppS-uLkim_2 2024-09-12T00:43:43.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.983+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.93__shadow_.5y_PqAGW1zP5RlFSW5g2qZppS-uLkim_3 2024-09-12T00:43:43.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.983+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7892787724733571140', time=2024-09-12T02:43:16.590355+0000, chain.objs.size()=5 2024-09-12T00:43:43.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.983+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.100__multipart_file.mpg.2~gc3HlnUsbOeS0rw66GLVKwoPRU3b-oA.1 2024-09-12T00:43:43.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.983+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.100__multipart_file.mpg.2~gc3HlnUsbOeS0rw66GLVKwoPRU3b-oA.2 2024-09-12T00:43:43.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.983+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.100__multipart_file.mpg.2~gc3HlnUsbOeS0rw66GLVKwoPRU3b-oA.3 2024-09-12T00:43:43.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.983+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.100__multipart_file.mpg.2~gc3HlnUsbOeS0rw66GLVKwoPRU3b-oA.4 2024-09-12T00:43:43.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.983+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.100__multipart_file.mpg.2~gc3HlnUsbOeS0rw66GLVKwoPRU3b-oA.5 2024-09-12T00:43:43.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.983+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4599514473341697688', time=2024-09-12T02:43:30.739259+0000, chain.objs.size()=1 2024-09-12T00:43:43.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.987+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.116__shadow_._IWrUeezrhz2hYRFSYaOaPwn26TtmHD_0 2024-09-12T00:43:43.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:43.995+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.003+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:43:44.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.003+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.007+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.007+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:43:44.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.007+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4414949735200280663', time=2024-09-12T02:43:03.378834+0000, chain.objs.size()=1 2024-09-12T00:43:44.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.007+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.85__shadow_.OTRIoXwh-FdjETjLE_GfrO2hEt7UI77_0 2024-09-12T00:43:44.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.007+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15078573847036872925', time=2024-09-12T02:43:28.868344+0000, chain.objs.size()=1 2024-09-12T00:43:44.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.007+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.112__shadow_.tWnCZi8Qey2ZvedV3HRXsI9I-fHtkPU_0 2024-09-12T00:43:44.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.007+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6587839897209146514', time=2024-09-12T02:43:30.694270+0000, chain.objs.size()=1 2024-09-12T00:43:44.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.007+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.116__shadow_.VPn2tgmqSg-neBi5BbeNGrtq-kp8XcS_0 2024-09-12T00:43:44.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.007+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8252316377183124851', time=2024-09-12T02:43:35.683131+0000, chain.objs.size()=1 2024-09-12T00:43:44.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.007+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.127__shadow_.6eF9S4AR2VNV1WO77Ohx7Kp40Ji3g2v_0 2024-09-12T00:43:44.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.007+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4817000399872156405', time=2024-09-12T02:43:37.477954+0000, chain.objs.size()=1 2024-09-12T00:43:44.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.007+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.131__shadow_.JnLUjkmWKLaQKa3E4BrW12kY7gt4aDf_0 2024-09-12T00:43:44.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.015+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.019+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:43:44.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.019+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.023+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.023+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:43:44.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.023+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12602259085364150886', time=2024-09-12T02:43:05.037181+0000, chain.objs.size()=1 2024-09-12T00:43:44.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.023+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.90__shadow_.nPe4rPIPncivVkp7PxJ_L0upruDqadN_0 2024-09-12T00:43:44.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.023+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18407568500706107788', time=2024-09-12T02:43:32.533328+0000, chain.objs.size()=1 2024-09-12T00:43:44.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.023+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.120__shadow_.S3E4iU9iuJUiLawziTmJ760NjPa1AHF_0 2024-09-12T00:43:44.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.023+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15517950657322220147', time=2024-09-12T02:43:32.548150+0000, chain.objs.size()=1 2024-09-12T00:43:44.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.023+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.120__shadow_.RHDso-BKVSjZCyHiwH8f8uWvIQRXXdk_0 2024-09-12T00:43:44.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.023+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9755051723766541914', time=2024-09-12T02:43:33.044814+0000, chain.objs.size()=1 2024-09-12T00:43:44.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.023+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.121__shadow_._Zid2wwdFrlT23M4ZS8eK5osfX2Hlp__0 2024-09-12T00:43:44.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.023+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12694475265249647259', time=2024-09-12T02:43:33.921984+0000, chain.objs.size()=1 2024-09-12T00:43:44.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.023+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.123__shadow_.JMDKJk2ROf_FmtKAIOHQomQWmk6RYOE_0 2024-09-12T00:43:44.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.023+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4266443954194929855', time=2024-09-12T02:43:34.793477+0000, chain.objs.size()=1 2024-09-12T00:43:44.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.023+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.125__shadow_.TPZpOzZ336VdJ78TaM3LnH8F6Sb2JD__0 2024-09-12T00:43:44.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.027+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.031+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:43:44.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:43:44.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15373319622121971594', time=2024-09-12T02:43:16.619992+0000, chain.objs.size()=5 2024-09-12T00:43:44.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.100__multipart_file2.mpg.2~AfA-c24yXr7flLBag0gq0WK371Adi6o.1 2024-09-12T00:43:44.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.100__multipart_file2.mpg.2~AfA-c24yXr7flLBag0gq0WK371Adi6o.2 2024-09-12T00:43:44.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.100__multipart_file2.mpg.2~AfA-c24yXr7flLBag0gq0WK371Adi6o.3 2024-09-12T00:43:44.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.100__multipart_file2.mpg.2~AfA-c24yXr7flLBag0gq0WK371Adi6o.4 2024-09-12T00:43:44.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.100__multipart_file2.mpg.2~AfA-c24yXr7flLBag0gq0WK371Adi6o.5 2024-09-12T00:43:44.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5247397192197661081', time=2024-09-12T02:43:32.077474+0000, chain.objs.size()=1 2024-09-12T00:43:44.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.119__shadow_.pe35Es9whu6-qA5zHbxpwmyZQeUyEiD_0 2024-09-12T00:43:44.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6615657662441321141', time=2024-09-12T02:43:34.780002+0000, chain.objs.size()=1 2024-09-12T00:43:44.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.125__shadow_.LXt2lUGWoZoqjT2xUMVCyuo0PPka0Xb_0 2024-09-12T00:43:44.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6574441521622047458', time=2024-09-12T02:43:42.596837+0000, chain.objs.size()=5 2024-09-12T00:43:44.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.143__multipart_key1.2~jOs4x3ERxad80uAc6aXNqoIywrAqG9H.1 2024-09-12T00:43:44.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.143__multipart_key1.2~jOs4x3ERxad80uAc6aXNqoIywrAqG9H.2 2024-09-12T00:43:44.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.143__multipart_key1.2~jOs4x3ERxad80uAc6aXNqoIywrAqG9H.3 2024-09-12T00:43:44.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.143__multipart_key1.2~jOs4x3ERxad80uAc6aXNqoIywrAqG9H.4 2024-09-12T00:43:44.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.035+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.143__multipart_key1.2~jOs4x3ERxad80uAc6aXNqoIywrAqG9H.5 2024-09-12T00:43:44.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.047+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7467608437231481441', time=2024-09-12T02:43:43.517312+0000, chain.objs.size()=1 2024-09-12T00:43:44.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.047+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.144__shadow_.kyalG7N0v1DWMPDAJpekzO0589Tx1zF_0 2024-09-12T00:43:44.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.055+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.059+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:43:44.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.063+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.063+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.063+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:43:44.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.063+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12000108494620362391', time=2024-09-12T02:43:06.258653+0000, chain.objs.size()=5 2024-09-12T00:43:44.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.063+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.91__multipart_key1.2~tOGewG73k7VyWKPTZ7yNbz7fJWbZIob.1 2024-09-12T00:43:44.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.063+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.91__multipart_key1.2~tOGewG73k7VyWKPTZ7yNbz7fJWbZIob.2 2024-09-12T00:43:44.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.063+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.91__multipart_key1.2~tOGewG73k7VyWKPTZ7yNbz7fJWbZIob.3 2024-09-12T00:43:44.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.063+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.91__multipart_key1.2~tOGewG73k7VyWKPTZ7yNbz7fJWbZIob.4 2024-09-12T00:43:44.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.063+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.91__multipart_key1.2~tOGewG73k7VyWKPTZ7yNbz7fJWbZIob.5 2024-09-12T00:43:44.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.063+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_', time=2024-09-12T02:43:26.348847+0000, chain.objs.size()=78 2024-09-12T00:43:44.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.063+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.1 2024-09-12T00:43:44.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.063+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.2 2024-09-12T00:43:44.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.063+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.3 2024-09-12T00:43:44.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.063+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.4 2024-09-12T00:43:44.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.063+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.5 2024-09-12T00:43:44.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.063+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.6 2024-09-12T00:43:44.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.063+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.7 2024-09-12T00:43:44.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.067+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.8 2024-09-12T00:43:44.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.071+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.9 2024-09-12T00:43:44.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.071+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.10 2024-09-12T00:43:44.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.075+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.11 2024-09-12T00:43:44.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.075+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.12 2024-09-12T00:43:44.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.075+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.13 2024-09-12T00:43:44.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.075+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.14 2024-09-12T00:43:44.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.075+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.15 2024-09-12T00:43:44.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.075+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.16 2024-09-12T00:43:44.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.075+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.17 2024-09-12T00:43:44.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.075+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.18 2024-09-12T00:43:44.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.079+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.19 2024-09-12T00:43:44.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.079+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.20 2024-09-12T00:43:44.079 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.079+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.21 2024-09-12T00:43:44.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.083+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.22 2024-09-12T00:43:44.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.083+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.23 2024-09-12T00:43:44.080 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.083+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.24 2024-09-12T00:43:44.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.083+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.25 2024-09-12T00:43:44.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.083+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.26 2024-09-12T00:43:44.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.087+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.27 2024-09-12T00:43:44.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.091+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.28 2024-09-12T00:43:44.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.091+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.29 2024-09-12T00:43:44.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.091+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.30 2024-09-12T00:43:44.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.095+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.31 2024-09-12T00:43:44.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.095+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.32 2024-09-12T00:43:44.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.095+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.33 2024-09-12T00:43:44.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.095+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.34 2024-09-12T00:43:44.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.095+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.35 2024-09-12T00:43:44.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.095+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.36 2024-09-12T00:43:44.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.095+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.37 2024-09-12T00:43:44.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.099+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.38 2024-09-12T00:43:44.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.099+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.39 2024-09-12T00:43:44.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.099+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.40 2024-09-12T00:43:44.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.099+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.41 2024-09-12T00:43:44.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.099+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.42 2024-09-12T00:43:44.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.099+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.43 2024-09-12T00:43:44.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.099+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.44 2024-09-12T00:43:44.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.099+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.45 2024-09-12T00:43:44.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.099+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.46 2024-09-12T00:43:44.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.099+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.47 2024-09-12T00:43:44.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.099+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.48 2024-09-12T00:43:44.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.107+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.49 2024-09-12T00:43:44.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.107+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.50 2024-09-12T00:43:44.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.107+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.51 2024-09-12T00:43:44.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.107+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.52 2024-09-12T00:43:44.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.107+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.53 2024-09-12T00:43:44.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.107+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.54 2024-09-12T00:43:44.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.107+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.55 2024-09-12T00:43:44.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.107+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.56 2024-09-12T00:43:44.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.107+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.57 2024-09-12T00:43:44.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.107+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.58 2024-09-12T00:43:44.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.107+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.59 2024-09-12T00:43:44.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.115+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.60 2024-09-12T00:43:44.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.115+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.61 2024-09-12T00:43:44.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.115+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.62 2024-09-12T00:43:44.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.115+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.63 2024-09-12T00:43:44.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.115+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.64 2024-09-12T00:43:44.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.115+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.65 2024-09-12T00:43:44.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.115+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.66 2024-09-12T00:43:44.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.115+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.67 2024-09-12T00:43:44.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.115+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.68 2024-09-12T00:43:44.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.115+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.69 2024-09-12T00:43:44.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.115+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.70 2024-09-12T00:43:44.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.119+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.71 2024-09-12T00:43:44.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.119+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.72 2024-09-12T00:43:44.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.123+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.73 2024-09-12T00:43:44.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.123+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.74 2024-09-12T00:43:44.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.123+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.75 2024-09-12T00:43:44.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.123+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.78 2024-09-12T00:43:44.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.123+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.80 2024-09-12T00:43:44.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.123+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.105__multipart_key1.2~3CRkLD5voqxHZkpHULCeBLJXpKGa-6_.81 2024-09-12T00:43:44.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.127+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.131+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:43:44.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.135+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.135+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.135+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:43:44.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.135+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16860670305524145056', time=2024-09-12T02:43:06.074674+0000, chain.objs.size()=5 2024-09-12T00:43:44.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.135+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.91__multipart_key1.2~tOGewG73k7VyWKPTZ7yNbz7fJWbZIob.1 2024-09-12T00:43:44.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.135+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.91__multipart_key1.2~tOGewG73k7VyWKPTZ7yNbz7fJWbZIob.2 2024-09-12T00:43:44.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.135+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.91__multipart_key1.2~tOGewG73k7VyWKPTZ7yNbz7fJWbZIob.3 2024-09-12T00:43:44.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.135+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.91__multipart_key1.2~tOGewG73k7VyWKPTZ7yNbz7fJWbZIob.4 2024-09-12T00:43:44.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.135+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.91__multipart_key1.2~tOGewG73k7VyWKPTZ7yNbz7fJWbZIob.5 2024-09-12T00:43:44.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.135+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16279228720932551888', time=2024-09-12T02:43:30.724928+0000, chain.objs.size()=1 2024-09-12T00:43:44.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.135+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.116__shadow_.5L93OEButQEqKHncBsbDpDY0R4KFAfc_0 2024-09-12T00:43:44.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.135+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16704772456441552923', time=2024-09-12T02:43:33.465911+0000, chain.objs.size()=1 2024-09-12T00:43:44.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.135+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.122__shadow_.tpmDYlkfytqM3d_2aCZ-H8nfh8zI-cs_0 2024-09-12T00:43:44.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.139+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.143+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:43:44.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.143+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.143+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.147+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:44.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.147+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16957396071003692250', time=2024-09-12T02:43:35.697767+0000, chain.objs.size()=1 2024-09-12T00:43:44.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.147+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.127__shadow_.gyN0jymgUN60mqx8woUWMFMitgAx_DZ_0 2024-09-12T00:43:44.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.147+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:43:44.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:43:44.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17476591618368610077', time=2024-09-12T02:43:21.346068+0000, chain.objs.size()=5 2024-09-12T00:43:44.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~x8hG_bGOmpCtgtJzWYM2eRdtc8JzUKh.1 2024-09-12T00:43:44.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~x8hG_bGOmpCtgtJzWYM2eRdtc8JzUKh.2 2024-09-12T00:43:44.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~x8hG_bGOmpCtgtJzWYM2eRdtc8JzUKh.3 2024-09-12T00:43:44.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~x8hG_bGOmpCtgtJzWYM2eRdtc8JzUKh.4 2024-09-12T00:43:44.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~x8hG_bGOmpCtgtJzWYM2eRdtc8JzUKh.5 2024-09-12T00:43:44.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14071070111736905904', time=2024-09-12T02:43:29.304704+0000, chain.objs.size()=1 2024-09-12T00:43:44.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.113__shadow_.OHeqEjl7I20YXO6n0suKBZICLHt9K4R_0 2024-09-12T00:43:44.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18116764477735245880', time=2024-09-12T02:43:29.341673+0000, chain.objs.size()=1 2024-09-12T00:43:44.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.113__shadow_.gR_AF84PkPCvNZ-Yg-Ud3pm8LbcZp2v_0 2024-09-12T00:43:44.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17769793274055370061', time=2024-09-12T02:43:31.621492+0000, chain.objs.size()=1 2024-09-12T00:43:44.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.118__shadow_.ogyhEq1IGsEYQ_LDzapGI1sdHsOTWdr_0 2024-09-12T00:43:44.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4686540230532008674', time=2024-09-12T02:43:37.881390+0000, chain.objs.size()=1 2024-09-12T00:43:44.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.132__shadow_.WhAZYzfCfqjjrJWCYEVLfoBKqxpOyHF_0 2024-09-12T00:43:44.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.477484603113752061', time=2024-09-12T02:43:43.505501+0000, chain.objs.size()=5 2024-09-12T00:43:44.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.144__multipart_key1/data/file.mpg.2~UlxolDpb51hzDo-PaJTJArhxQwvcV44.1 2024-09-12T00:43:44.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.144__multipart_key1/data/file.mpg.2~UlxolDpb51hzDo-PaJTJArhxQwvcV44.2 2024-09-12T00:43:44.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.151+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.144__multipart_key1/data/file.mpg.2~UlxolDpb51hzDo-PaJTJArhxQwvcV44.3 2024-09-12T00:43:44.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.155+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.144__multipart_key1/data/file.mpg.2~UlxolDpb51hzDo-PaJTJArhxQwvcV44.4 2024-09-12T00:43:44.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.155+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.144__multipart_key1/data/file.mpg.2~UlxolDpb51hzDo-PaJTJArhxQwvcV44.5 2024-09-12T00:43:44.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.159+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.163+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:43:44.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.163+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.163 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.167+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.167+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:44.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.167+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12278495186783620104', time=2024-09-12T02:43:30.204912+0000, chain.objs.size()=1 2024-09-12T00:43:44.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.167+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.115__shadow_.N9fvcRLCncjkfWP6_bx-kzDH8qGGKzV_0 2024-09-12T00:43:44.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.167+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:43:44.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.170 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:43:44.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7386932183893456635', time=2024-09-12T02:43:15.784757+0000, chain.objs.size()=5 2024-09-12T00:43:44.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.99__multipart_key1.2~2iwHkn4UWKSvtyynRB7swfzF7td637E.1 2024-09-12T00:43:44.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.99__multipart_key1.2~2iwHkn4UWKSvtyynRB7swfzF7td637E.2 2024-09-12T00:43:44.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.99__multipart_key1.2~2iwHkn4UWKSvtyynRB7swfzF7td637E.3 2024-09-12T00:43:44.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.99__multipart_key1.2~2iwHkn4UWKSvtyynRB7swfzF7td637E.4 2024-09-12T00:43:44.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.99__multipart_key1.2~2iwHkn4UWKSvtyynRB7swfzF7td637E.5 2024-09-12T00:43:44.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17489771303247077878', time=2024-09-12T02:43:33.906585+0000, chain.objs.size()=1 2024-09-12T00:43:44.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.123__shadow_.MS4an_2CHBZv4t3j2YucgVeIuyFWpCd_0 2024-09-12T00:43:44.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13877374581776341656', time=2024-09-12T02:43:34.329705+0000, chain.objs.size()=1 2024-09-12T00:43:44.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.124__shadow_.hTu9UjM65y_KViOW8wv3oZI109bXYnC_0 2024-09-12T00:43:44.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11425528566969107272', time=2024-09-12T02:43:35.213901+0000, chain.objs.size()=1 2024-09-12T00:43:44.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.126__shadow_.7sm9dM3zsDGcYoDcU-1qzvWhF53b50F_0 2024-09-12T00:43:44.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1299040494015461565', time=2024-09-12T02:43:36.630720+0000, chain.objs.size()=1 2024-09-12T00:43:44.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.129__shadow_.emKGbkuCT8Pk_s3Q7EboCLVehr6wHei_0 2024-09-12T00:43:44.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3081475127989086224', time=2024-09-12T02:43:37.449242+0000, chain.objs.size()=1 2024-09-12T00:43:44.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.171+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.131__shadow_.O5xQ29FL_Epdez_vKzO1Vj1Sj4-yP74_0 2024-09-12T00:43:44.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.179+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.183+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:43:44.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.183+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.183+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.183+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:43:44.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.183+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.677436673779458959', time=2024-09-12T02:43:10.423250+0000, chain.objs.size()=5 2024-09-12T00:43:44.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.183+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~BqvMiZyvC5m638pNn3wsc5Pzf-UQzcU.1 2024-09-12T00:43:44.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.183+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~BqvMiZyvC5m638pNn3wsc5Pzf-UQzcU.2 2024-09-12T00:43:44.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.183+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~BqvMiZyvC5m638pNn3wsc5Pzf-UQzcU.3 2024-09-12T00:43:44.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.183+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~BqvMiZyvC5m638pNn3wsc5Pzf-UQzcU.4 2024-09-12T00:43:44.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.183+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~BqvMiZyvC5m638pNn3wsc5Pzf-UQzcU.5 2024-09-12T00:43:44.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.183+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3102844477645609945', time=2024-09-12T02:43:31.650096+0000, chain.objs.size()=1 2024-09-12T00:43:44.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.183+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.118__shadow_.KDsllDnB88Kj4rm5msD9iTzxeJMRbqC_0 2024-09-12T00:43:44.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.187+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.191+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:43:44.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.191+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T00:43:44.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15462897047940673439', time=2024-09-12T02:43:29.750793+0000, chain.objs.size()=1 2024-09-12T00:43:44.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.114__shadow_.CCaFn9cVhUITzkE8XbI7UawQm_sZ9Le_0 2024-09-12T00:43:44.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7056320280032967525', time=2024-09-12T02:43:30.234324+0000, chain.objs.size()=1 2024-09-12T00:43:44.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.115__shadow_.O7hQN6R9Ezn7vU1N92MxOIHm68G1ILr_0 2024-09-12T00:43:44.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14413768775217750754', time=2024-09-12T02:43:31.198299+0000, chain.objs.size()=1 2024-09-12T00:43:44.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.117__shadow_.-dyvDSePhKEMD3UBgeitbTtyPuirb1c_0 2024-09-12T00:43:44.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2468346373193859591', time=2024-09-12T02:43:32.094741+0000, chain.objs.size()=1 2024-09-12T00:43:44.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.119__shadow_.sxB9CKE6n1PPp7i29ZFIbKckgL2DMSW_0 2024-09-12T00:43:44.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16417700087025592168', time=2024-09-12T02:43:36.138065+0000, chain.objs.size()=1 2024-09-12T00:43:44.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.128__shadow_.3vDja4xuJ2dVmy-fwBXGCkq_9pHB8Je_0 2024-09-12T00:43:44.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6736164268113713341', time=2024-09-12T02:43:37.464041+0000, chain.objs.size()=1 2024-09-12T00:43:44.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.131__shadow_.fMrMCVlsxLs1V-YwSNtABonSePcz9YF_0 2024-09-12T00:43:44.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16893980466375237731', time=2024-09-12T02:43:37.895498+0000, chain.objs.size()=1 2024-09-12T00:43:44.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.132__shadow_.EkEgCl_sFQ0zBAi8g48ii_ZL3DxQytg_0 2024-09-12T00:43:44.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12169710987214692240', time=2024-09-12T02:43:40.673252+0000, chain.objs.size()=1 2024-09-12T00:43:44.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.195+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.139__shadow_.MFC-TUIDrjbrVYBDEhOBRyd59jXlK97_0 2024-09-12T00:43:44.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.199+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.199+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:43:44.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T00:43:44.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4666240110613598612', time=2024-09-12T02:42:59.144296+0000, chain.objs.size()=1 2024-09-12T00:43:44.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.77__shadow_.7o5xta6-GpN5lSbozFGTuDJnkXKWj8Q_0 2024-09-12T00:43:44.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17506811822422696594', time=2024-09-12T02:43:03.006064+0000, chain.objs.size()=1 2024-09-12T00:43:44.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.84__shadow_.2heqiBdIj5eNcXe43-PiYghqlnRymIF_0 2024-09-12T00:43:44.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11135327091822898975', time=2024-09-12T02:43:13.026371+0000, chain.objs.size()=5 2024-09-12T00:43:44.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~zdxaykWPYWB1ZMnOUuMdE2nxGq-nMdT.1 2024-09-12T00:43:44.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__shadow_key1.2~zdxaykWPYWB1ZMnOUuMdE2nxGq-nMdT.1_1 2024-09-12T00:43:44.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~zdxaykWPYWB1ZMnOUuMdE2nxGq-nMdT.2 2024-09-12T00:43:44.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__shadow_key1.2~zdxaykWPYWB1ZMnOUuMdE2nxGq-nMdT.2_1 2024-09-12T00:43:44.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~zdxaykWPYWB1ZMnOUuMdE2nxGq-nMdT.3 2024-09-12T00:43:44.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9516646361809516113', time=2024-09-12T02:43:22.781578+0000, chain.objs.size()=5 2024-09-12T00:43:44.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~2jo-5nInDlTfn3zqDIlQaLb85CX2Ty-.1 2024-09-12T00:43:44.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__shadow_key1.2~2jo-5nInDlTfn3zqDIlQaLb85CX2Ty-.1_1 2024-09-12T00:43:44.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~2jo-5nInDlTfn3zqDIlQaLb85CX2Ty-.2 2024-09-12T00:43:44.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__shadow_key1.2~2jo-5nInDlTfn3zqDIlQaLb85CX2Ty-.2_1 2024-09-12T00:43:44.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.203+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~2jo-5nInDlTfn3zqDIlQaLb85CX2Ty-.3 2024-09-12T00:43:44.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.207+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1709835988840018233', time=2024-09-12T02:43:30.220074+0000, chain.objs.size()=1 2024-09-12T00:43:44.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.207+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.115__shadow_.eGsdKLqkBvmz1i--hEYJabUyoYbsS9w_0 2024-09-12T00:43:44.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.207+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18328333166484618687', time=2024-09-12T02:43:31.152460+0000, chain.objs.size()=1 2024-09-12T00:43:44.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.207+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.117__shadow_.yF3SFuWWDWv74hVej6rTfbQZLLUWMzq_0 2024-09-12T00:43:44.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.207+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16934657116425676048', time=2024-09-12T02:43:35.712465+0000, chain.objs.size()=1 2024-09-12T00:43:44.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.207+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.127__shadow_.Ty9DBpFj1Yrew4MwOVodfS5BSC_2OGW_0 2024-09-12T00:43:44.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.207+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1093018234143904739', time=2024-09-12T02:43:38.313486+0000, chain.objs.size()=1 2024-09-12T00:43:44.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.207+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.133__shadow_.vA5ijxp8qbpAoCdbiXE1A1ulAod39Wi_0 2024-09-12T00:43:44.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.215+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:43:44.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T00:43:44.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1581468462053933065', time=2024-09-12T02:43:09.513951+0000, chain.objs.size()=5 2024-09-12T00:43:44.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~TaQAv9o8lILNL9IGDZaZCG8y7UkF7kM.1 2024-09-12T00:43:44.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~TaQAv9o8lILNL9IGDZaZCG8y7UkF7kM.2 2024-09-12T00:43:44.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~TaQAv9o8lILNL9IGDZaZCG8y7UkF7kM.3 2024-09-12T00:43:44.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~TaQAv9o8lILNL9IGDZaZCG8y7UkF7kM.4 2024-09-12T00:43:44.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~TaQAv9o8lILNL9IGDZaZCG8y7UkF7kM.5 2024-09-12T00:43:44.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.252715377256512823', time=2024-09-12T02:43:20.746193+0000, chain.objs.size()=5 2024-09-12T00:43:44.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~-IuBAbN8akTcenDp5QfoHhgLPYFL7IX.1 2024-09-12T00:43:44.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~-IuBAbN8akTcenDp5QfoHhgLPYFL7IX.2 2024-09-12T00:43:44.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~-IuBAbN8akTcenDp5QfoHhgLPYFL7IX.3 2024-09-12T00:43:44.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~-IuBAbN8akTcenDp5QfoHhgLPYFL7IX.4 2024-09-12T00:43:44.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~-IuBAbN8akTcenDp5QfoHhgLPYFL7IX.5 2024-09-12T00:43:44.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12442458046832956513', time=2024-09-12T02:43:29.329530+0000, chain.objs.size()=1 2024-09-12T00:43:44.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.113__shadow_.r2n6_LtjJL-GPmzzZuZOQb38jCto1RS_0 2024-09-12T00:43:44.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.383474639722252129', time=2024-09-12T02:43:29.781611+0000, chain.objs.size()=1 2024-09-12T00:43:44.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.219+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.114__shadow_.iAfSJu0rbMJB-jZf4PudzlcONKnt3KN_0 2024-09-12T00:43:44.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.223+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16568032675798895963', time=2024-09-12T02:43:31.636566+0000, chain.objs.size()=1 2024-09-12T00:43:44.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.223+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.118__shadow_.ce7cyo5ZfpfjPL67bfTjN7lOwooH-6w_0 2024-09-12T00:43:44.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.223+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6873945571443639354', time=2024-09-12T02:43:33.014981+0000, chain.objs.size()=1 2024-09-12T00:43:44.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.223+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.121__shadow_.-JgQuVsgeKKqU_J8JHmgfByYshx98xn_0 2024-09-12T00:43:44.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.227+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15283047228649120830', time=2024-09-12T02:43:34.342226+0000, chain.objs.size()=1 2024-09-12T00:43:44.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.227+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.124__shadow_.kOdWxFxy9iLUinD9iRw-9QopMdHIoXS_0 2024-09-12T00:43:44.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.227+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5846975648633708014', time=2024-09-12T02:43:35.228700+0000, chain.objs.size()=1 2024-09-12T00:43:44.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.227+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.126__shadow_.h4uY5wId4SO9EfljzmMd5hdYNs3Lfdb_0 2024-09-12T00:43:44.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.227+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14203755231134008722', time=2024-09-12T02:43:37.049772+0000, chain.objs.size()=1 2024-09-12T00:43:44.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.227+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.130__shadow_.y2WJDBdke7MMIWh8eYTsrTgt90OsOnj_0 2024-09-12T00:43:44.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.227+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16530550434819980465', time=2024-09-12T02:43:39.680633+0000, chain.objs.size()=1 2024-09-12T00:43:44.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.227+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.137__shadow_.QYinpmeMCioN6RTRscYzmPUs8lsewI8_0 2024-09-12T00:43:44.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.227+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13759999691047230586', time=2024-09-12T02:43:41.041599+0000, chain.objs.size()=1 2024-09-12T00:43:44.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.227+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.140__shadow_.f4qtxmU10-WK64VO29Q4L1Kn7VVqQHJ_0 2024-09-12T00:43:44.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.231+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.235+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:43:44.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.235+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.239+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.239+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:43:44.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.239+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15889767893632202991', time=2024-09-12T02:43:01.511713+0000, chain.objs.size()=1 2024-09-12T00:43:44.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.239+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.81__shadow_.iMNf6sDB47TURYTcTO96kaWvKk9Szb__0 2024-09-12T00:43:44.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.239+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6891422799868912403', time=2024-09-12T02:43:11.933713+0000, chain.objs.size()=5 2024-09-12T00:43:44.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.239+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~BU493lIL-Qtq-lVRUO6wcsorth5GlvD.1 2024-09-12T00:43:44.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.239+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__shadow_key1.2~BU493lIL-Qtq-lVRUO6wcsorth5GlvD.1_1 2024-09-12T00:43:44.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.239+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~BU493lIL-Qtq-lVRUO6wcsorth5GlvD.2 2024-09-12T00:43:44.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.239+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__shadow_key1.2~BU493lIL-Qtq-lVRUO6wcsorth5GlvD.2_1 2024-09-12T00:43:44.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.239+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~BU493lIL-Qtq-lVRUO6wcsorth5GlvD.3 2024-09-12T00:43:44.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.239+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3144637784981666426', time=2024-09-12T02:43:30.709425+0000, chain.objs.size()=1 2024-09-12T00:43:44.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.239+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.116__shadow_.6KFDy7tyCa82qX36RP6DSWzIyJIFJdQ_0 2024-09-12T00:43:44.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.239+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4417914554998356446', time=2024-09-12T02:43:34.752464+0000, chain.objs.size()=1 2024-09-12T00:43:44.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.239+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.125__shadow_.Kgg-F6Yq5jz6BzxymgWdpEEuihqCi3g_0 2024-09-12T00:43:44.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.239+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8258348555630939873', time=2024-09-12T02:43:37.910103+0000, chain.objs.size()=1 2024-09-12T00:43:44.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.239+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.132__shadow_.g8SXaxLR4bxObgSQueE7sJGgIEl9AJo_0 2024-09-12T00:43:44.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.243+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:43:44.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T00:43:44.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12634752498105389112', time=2024-09-12T02:43:11.152035+0000, chain.objs.size()=5 2024-09-12T00:43:44.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~ajCcBnVsUmIAaKKbs9JkRMa7r4zJoA2.1 2024-09-12T00:43:44.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~ajCcBnVsUmIAaKKbs9JkRMa7r4zJoA2.2 2024-09-12T00:43:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~ajCcBnVsUmIAaKKbs9JkRMa7r4zJoA2.3 2024-09-12T00:43:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~ajCcBnVsUmIAaKKbs9JkRMa7r4zJoA2.4 2024-09-12T00:43:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~ajCcBnVsUmIAaKKbs9JkRMa7r4zJoA2.5 2024-09-12T00:43:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15047313548383318600', time=2024-09-12T02:43:24.354523+0000, chain.objs.size()=5 2024-09-12T00:43:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.103__multipart_key1.2~Usp3C9GHdJ7POhupFeqvC6rcsNdmNxy.1 2024-09-12T00:43:44.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.103__multipart_key1.2~Usp3C9GHdJ7POhupFeqvC6rcsNdmNxy.2 2024-09-12T00:43:44.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.103__multipart_key1.2~Usp3C9GHdJ7POhupFeqvC6rcsNdmNxy.3 2024-09-12T00:43:44.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.103__multipart_key1.2~Usp3C9GHdJ7POhupFeqvC6rcsNdmNxy.4 2024-09-12T00:43:44.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.103__multipart_key1.2~Usp3C9GHdJ7POhupFeqvC6rcsNdmNxy.5 2024-09-12T00:43:44.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3697117237857121744', time=2024-09-12T02:43:25.357301+0000, chain.objs.size()=5 2024-09-12T00:43:44.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.104__multipart_key1.2~T6Or7bBC8V-mWym-EQzdRVvp0w_qgvL.1 2024-09-12T00:43:44.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.247+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.104__multipart_key1.2~T6Or7bBC8V-mWym-EQzdRVvp0w_qgvL.2 2024-09-12T00:43:44.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.251+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.104__multipart_key1.2~T6Or7bBC8V-mWym-EQzdRVvp0w_qgvL.3 2024-09-12T00:43:44.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.251+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.104__multipart_key1.2~T6Or7bBC8V-mWym-EQzdRVvp0w_qgvL.4 2024-09-12T00:43:44.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.255+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.104__multipart_key1.2~T6Or7bBC8V-mWym-EQzdRVvp0w_qgvL.5 2024-09-12T00:43:44.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.255+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4553539037723198797', time=2024-09-12T02:43:32.109893+0000, chain.objs.size()=1 2024-09-12T00:43:44.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.255+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.119__shadow_.4KcXXuA8DYvuBQBN7f58uWH59dxPr8t_0 2024-09-12T00:43:44.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.255+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4379323703418036981', time=2024-09-12T02:43:33.029434+0000, chain.objs.size()=1 2024-09-12T00:43:44.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.255+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.121__shadow_.HxdPbJqDs52UOBJ18csrPAmbPzi-4KR_0 2024-09-12T00:43:44.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.255+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11120203536779251092', time=2024-09-12T02:43:36.167121+0000, chain.objs.size()=1 2024-09-12T00:43:44.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.255+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.128__shadow_.9d7HPrZ7CCnGz1uQVmB9hWYHGmWDfMF_0 2024-09-12T00:43:44.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.255+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5275270992159155837', time=2024-09-12T02:43:36.615768+0000, chain.objs.size()=1 2024-09-12T00:43:44.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.255+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.129__shadow_.3w6DF2QgoMsS2EyDJE_bNo8__J25BDO_0 2024-09-12T00:43:44.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.255+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9569160798867791162', time=2024-09-12T02:43:37.035451+0000, chain.objs.size()=1 2024-09-12T00:43:44.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.255+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.130__shadow_.Ab8sng4_67_P2IqoYQG7blXbevwaE9O_0 2024-09-12T00:43:44.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.259+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.263+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:43:44.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.263+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.263+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.267+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:44.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.267+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11801727157326074595', time=2024-09-12T02:43:38.328291+0000, chain.objs.size()=1 2024-09-12T00:43:44.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.267+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.133__shadow_.Hu2bgq-5OHL9cGIIof2gRfLQgANwZUG_0 2024-09-12T00:43:44.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.267+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.267+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:43:44.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.271+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.271+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.271+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:43:44.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.271+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7559028107051409243', time=2024-09-12T02:43:28.880922+0000, chain.objs.size()=1 2024-09-12T00:43:44.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.271+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.112__shadow_.DubXnjwgC8K17CIzMVJ6RZVrx22N2Lv_0 2024-09-12T00:43:44.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.271+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12366288482110871431', time=2024-09-12T02:43:33.478961+0000, chain.objs.size()=1 2024-09-12T00:43:44.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.271+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.122__shadow_.54jNhNc11B7JAkhj4dhMok-umygyY-W_0 2024-09-12T00:43:44.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.271+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10661314200219198329', time=2024-09-12T02:43:34.316573+0000, chain.objs.size()=1 2024-09-12T00:43:44.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.271+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.124__shadow_.64NrYZVWjdTFrvhl22GHs3JV5zkn3Ah_0 2024-09-12T00:43:44.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.271+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15395408272760260371', time=2024-09-12T02:43:35.669154+0000, chain.objs.size()=1 2024-09-12T00:43:44.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.271+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.127__shadow_.dcFhoRpqqAfxHDdoWMe0ki6ewji39KQ_0 2024-09-12T00:43:44.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.275+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.275+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:43:44.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.279+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.279+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.279+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:43:44.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.279+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.693792421633096406', time=2024-09-12T02:43:33.507380+0000, chain.objs.size()=1 2024-09-12T00:43:44.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.279+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.122__shadow_.D3sgjyNIF0vv_nXu91UkIJeESyu4Y16_0 2024-09-12T00:43:44.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.279+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15813376612373314765', time=2024-09-12T02:43:35.241828+0000, chain.objs.size()=1 2024-09-12T00:43:44.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.279+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.126__shadow_.PaF1wp5PUMWNNwVFjd-qjtzU4rPUs4a_0 2024-09-12T00:43:44.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.279+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.283+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:43:44.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.283+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.283+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.287+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:43:44.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.287+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13759574720035052351', time=2024-09-12T02:43:16.649733+0000, chain.objs.size()=1 2024-09-12T00:43:44.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.287+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.100__shadow_.JRdocp5TBvxD3fD98CCeNR4OrbtVULV_0 2024-09-12T00:43:44.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.287+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3380572269424826874', time=2024-09-12T02:43:22.007510+0000, chain.objs.size()=5 2024-09-12T00:43:44.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.287+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~VEgKG9DrU-5_3OfmyZhkOqLTsVz4Jrx.1 2024-09-12T00:43:44.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.287+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__shadow_key1.2~VEgKG9DrU-5_3OfmyZhkOqLTsVz4Jrx.1_1 2024-09-12T00:43:44.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.287+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~VEgKG9DrU-5_3OfmyZhkOqLTsVz4Jrx.2 2024-09-12T00:43:44.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.287+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__shadow_key1.2~VEgKG9DrU-5_3OfmyZhkOqLTsVz4Jrx.2_1 2024-09-12T00:43:44.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.287+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~VEgKG9DrU-5_3OfmyZhkOqLTsVz4Jrx.3 2024-09-12T00:43:44.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.287+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6476660364897305737', time=2024-09-12T02:43:31.167359+0000, chain.objs.size()=1 2024-09-12T00:43:44.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.287+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.117__shadow_.mgzX84L4yhrnRx2UGg3saDMU06QqKXf_0 2024-09-12T00:43:44.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.287+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11622717146004223943', time=2024-09-12T02:43:35.255432+0000, chain.objs.size()=1 2024-09-12T00:43:44.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.287+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.126__shadow_.oMTw4HJYJUN4BwyKWLP9aXLSTAMxNx4_0 2024-09-12T00:43:44.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.287+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4659656548539439510', time=2024-09-12T02:43:36.152347+0000, chain.objs.size()=1 2024-09-12T00:43:44.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.287+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.128__shadow_.xWM2L6LwCiMaa1u8v7k16HjY__uMW50_0 2024-09-12T00:43:44.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.287+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6668071446153347274', time=2024-09-12T02:43:40.025956+0000, chain.objs.size()=1 2024-09-12T00:43:44.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.287+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.138__shadow_.CQ2_u4QHeGg0Nr76oyc9daoQrc0ODab_0 2024-09-12T00:43:44.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.291+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:43:44.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T00:43:44.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~nphlT6PLHKIlAFMRzCjfdXlj3L8XY_i', time=2024-09-12T02:43:00.606568+0000, chain.objs.size()=5 2024-09-12T00:43:44.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.79__multipart_key1.2~nphlT6PLHKIlAFMRzCjfdXlj3L8XY_i.1 2024-09-12T00:43:44.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.79__multipart_key1.2~nphlT6PLHKIlAFMRzCjfdXlj3L8XY_i.2 2024-09-12T00:43:44.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.79__multipart_key1.2~nphlT6PLHKIlAFMRzCjfdXlj3L8XY_i.3 2024-09-12T00:43:44.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.79__multipart_key1.2~nphlT6PLHKIlAFMRzCjfdXlj3L8XY_i.4 2024-09-12T00:43:44.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.79__multipart_key1.2~nphlT6PLHKIlAFMRzCjfdXlj3L8XY_i.5 2024-09-12T00:43:44.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15039985681979620163', time=2024-09-12T02:43:14.553548+0000, chain.objs.size()=5 2024-09-12T00:43:44.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.98__multipart_key1.2~0sm32ywnx_Iwba2CfbQQ-5lsyM7ESan.1 2024-09-12T00:43:44.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.98__multipart_key1.2~0sm32ywnx_Iwba2CfbQQ-5lsyM7ESan.2 2024-09-12T00:43:44.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.98__multipart_key1.2~0sm32ywnx_Iwba2CfbQQ-5lsyM7ESan.3 2024-09-12T00:43:44.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.98__multipart_key1.2~0sm32ywnx_Iwba2CfbQQ-5lsyM7ESan.4 2024-09-12T00:43:44.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.98__multipart_key1.2~0sm32ywnx_Iwba2CfbQQ-5lsyM7ESan.5 2024-09-12T00:43:44.296 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14169127507887418374', time=2024-09-12T02:43:23.703069+0000, chain.objs.size()=1 2024-09-12T00:43:44.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.103__shadow_.wWPotIbFWrKvG8kiC3Nr5N5s4357owQ_0 2024-09-12T00:43:44.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16420564844040060416', time=2024-09-12T02:43:28.842652+0000, chain.objs.size()=1 2024-09-12T00:43:44.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.295+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.112__shadow_.jNeo7wsNZGQMqTI_ooMkEFUz9pBEgz0_0 2024-09-12T00:43:44.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.303+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8329231154627457693', time=2024-09-12T02:43:29.316946+0000, chain.objs.size()=1 2024-09-12T00:43:44.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.303+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.113__shadow_.WjeA2s9ckqjsvVmHRxSU_ZLQFfMVmMO_0 2024-09-12T00:43:44.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.303+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8175450156871517986', time=2024-09-12T02:43:31.665055+0000, chain.objs.size()=1 2024-09-12T00:43:44.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.303+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.118__shadow_.dqnYZGHjR-tbmasOzCJxCVFZou9xsnn_0 2024-09-12T00:43:44.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.303+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18027688574877353555', time=2024-09-12T02:43:34.766739+0000, chain.objs.size()=1 2024-09-12T00:43:44.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.303+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.125__shadow_.qOQiYXUxGCL6wLk3uW1yOt1gkJD_QFB_0 2024-09-12T00:43:44.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.303+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16054410405362457523', time=2024-09-12T02:43:38.341848+0000, chain.objs.size()=1 2024-09-12T00:43:44.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.303+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.133__shadow_.yk27Q1y2MApMz8zHek7RyDGco6kyS6h_0 2024-09-12T00:43:44.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.307+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.307+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:43:44.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.311+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.311+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.311+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:43:44.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.311+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~_pEc-dlaLYNyBtIG6XZ-9W_rxP67eoW', time=2024-09-12T02:43:17.742386+0000, chain.objs.size()=5 2024-09-12T00:43:44.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.311+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.101__multipart_key1.2~_pEc-dlaLYNyBtIG6XZ-9W_rxP67eoW.7 2024-09-12T00:43:44.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.311+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.101__multipart_key1.2~_pEc-dlaLYNyBtIG6XZ-9W_rxP67eoW.8 2024-09-12T00:43:44.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.311+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.101__multipart_key1.2~_pEc-dlaLYNyBtIG6XZ-9W_rxP67eoW.9 2024-09-12T00:43:44.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.311+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.101__multipart_key1.2~_pEc-dlaLYNyBtIG6XZ-9W_rxP67eoW.10 2024-09-12T00:43:44.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.311+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.101__multipart_key1.2~_pEc-dlaLYNyBtIG6XZ-9W_rxP67eoW.11 2024-09-12T00:43:44.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.311+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16515609608442411511', time=2024-09-12T02:43:33.493632+0000, chain.objs.size()=1 2024-09-12T00:43:44.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.311+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.122__shadow_.QqHtKNxXKB1xrLBqgXQi-nsjPIBlbBF_0 2024-09-12T00:43:44.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.315+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.315+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:43:44.316 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.319+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.319+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.319+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:43:44.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.319+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5793080458979105767', time=2024-09-12T02:43:16.635716+0000, chain.objs.size()=1 2024-09-12T00:43:44.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.319+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.100__shadow_.W1CLPpb8gbU8knbL97sDwOYzpFfiP2H_0 2024-09-12T00:43:44.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.319+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14969350262432743096', time=2024-09-12T02:43:29.797695+0000, chain.objs.size()=1 2024-09-12T00:43:44.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.319+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.114__shadow_.96jZgT5zgQT2PGDdd0Xr7j5vuW4X1sl_0 2024-09-12T00:43:44.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.319+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9657479203153344114', time=2024-09-12T02:43:33.893601+0000, chain.objs.size()=1 2024-09-12T00:43:44.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.319+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.123__shadow_.BIkwoY16kK9KUacsRztL-4qIa5vynP5_0 2024-09-12T00:43:44.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.319+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9369734923795598301', time=2024-09-12T02:43:36.181596+0000, chain.objs.size()=1 2024-09-12T00:43:44.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.319+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.128__shadow_.s6CzvP9G1IE9IV_mi8mjCwEQIj_7D6J_0 2024-09-12T00:43:44.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.319+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3675267279746700270', time=2024-09-12T02:43:36.602664+0000, chain.objs.size()=1 2024-09-12T00:43:44.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.319+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.129__shadow_.7eQ-ft4wV7r0LYWtSIptAcqcRTXPFQ0_0 2024-09-12T00:43:44.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.319+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10019066174657186477', time=2024-09-12T02:43:39.963637+0000, chain.objs.size()=1 2024-09-12T00:43:44.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.319+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.138__shadow_.lWEPUvNeQ4R8FQgMZPLs__zfkN-wYeq_0 2024-09-12T00:43:44.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.323+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.323+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:43:44.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.327+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.327+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.327+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:43:44.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.327+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6015247693829822190', time=2024-09-12T02:43:16.605302+0000, chain.objs.size()=1 2024-09-12T00:43:44.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.327+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.100__shadow_.wpdZHcw5t512wwkvRGA72mQCBfvYLTZ_0 2024-09-12T00:43:44.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.327+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4762061761222378764', time=2024-09-12T02:43:22.619326+0000, chain.objs.size()=5 2024-09-12T00:43:44.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.327+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~-wf0Az1m2g1dprdD2wYzT_NvzaDBtK6.1 2024-09-12T00:43:44.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.327+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__shadow_key1.2~-wf0Az1m2g1dprdD2wYzT_NvzaDBtK6.1_1 2024-09-12T00:43:44.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.327+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~-wf0Az1m2g1dprdD2wYzT_NvzaDBtK6.2 2024-09-12T00:43:44.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.327+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__shadow_key1.2~-wf0Az1m2g1dprdD2wYzT_NvzaDBtK6.2_1 2024-09-12T00:43:44.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.327+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~-wf0Az1m2g1dprdD2wYzT_NvzaDBtK6.3 2024-09-12T00:43:44.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.327+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15463791599991923272', time=2024-09-12T02:43:30.248275+0000, chain.objs.size()=1 2024-09-12T00:43:44.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.327+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.115__shadow_.Iey6e8UUed9MrPWvVFvEhlehwdxB_tY_0 2024-09-12T00:43:44.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.331+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.335+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:43:44.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.335+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.335+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.335+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:43:44.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.335+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17010054500114841402', time=2024-09-12T02:43:28.856124+0000, chain.objs.size()=1 2024-09-12T00:43:44.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.335+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.112__shadow_.Qyl0Tpp_KufP8OaljxYrK5bjF-Euj3t_0 2024-09-12T00:43:44.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.335+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10166687761005955465', time=2024-09-12T02:43:32.999954+0000, chain.objs.size()=1 2024-09-12T00:43:44.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.335+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.121__shadow_.IhPriSSmKgRmyA4YrwxptMg3OsTMHEz_0 2024-09-12T00:43:44.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.339+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.339+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:43:44.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.343+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.343+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.343+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.343+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:43:44.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.343+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.343+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.343+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:43:44.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.343+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14803147885830862095', time=2024-09-12T02:43:12.664507+0000, chain.objs.size()=5 2024-09-12T00:43:44.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.343+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~8m6pvr0ct2BHJCAWJuSfTzklI3_8Fl3.1 2024-09-12T00:43:44.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.343+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__shadow_key1.2~8m6pvr0ct2BHJCAWJuSfTzklI3_8Fl3.1_1 2024-09-12T00:43:44.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.343+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~8m6pvr0ct2BHJCAWJuSfTzklI3_8Fl3.2 2024-09-12T00:43:44.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.343+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__shadow_key1.2~8m6pvr0ct2BHJCAWJuSfTzklI3_8Fl3.2_1 2024-09-12T00:43:44.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.343+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.94__multipart_key1.2~8m6pvr0ct2BHJCAWJuSfTzklI3_8Fl3.3 2024-09-12T00:43:44.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.343+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4032295741301188372', time=2024-09-12T02:43:39.353984+0000, chain.objs.size()=1 2024-09-12T00:43:44.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.343+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.136__shadow_.P8tLsrpVZg9E-mySyN8ESzRqptSm-Eu_0 2024-09-12T00:43:44.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.347+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.351+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:43:44.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.351+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.351+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.355+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:43:44.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.355+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.235750005564245936', time=2024-09-12T02:43:19.194793+0000, chain.objs.size()=5 2024-09-12T00:43:44.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.355+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~im8l_87G2gQARnjPaCA2NXQU6_sXvhu.1 2024-09-12T00:43:44.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.355+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~im8l_87G2gQARnjPaCA2NXQU6_sXvhu.2 2024-09-12T00:43:44.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.355+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~im8l_87G2gQARnjPaCA2NXQU6_sXvhu.3 2024-09-12T00:43:44.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.355+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~im8l_87G2gQARnjPaCA2NXQU6_sXvhu.4 2024-09-12T00:43:44.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.355+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.102__multipart_key1.2~im8l_87G2gQARnjPaCA2NXQU6_sXvhu.5 2024-09-12T00:43:44.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.355+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3784099493130739502', time=2024-09-12T02:43:29.766282+0000, chain.objs.size()=1 2024-09-12T00:43:44.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.355+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.114__shadow_.jTe7AVHs7byCQpTcfx_BQf_NqZam7DH_0 2024-09-12T00:43:44.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.355+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16828165360705474220', time=2024-09-12T02:43:31.182475+0000, chain.objs.size()=1 2024-09-12T00:43:44.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.355+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.117__shadow_.0h4C0s78xtJjZA8kq1ANBJ1kZMoZD9Q_0 2024-09-12T00:43:44.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.355+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2970573933210975583', time=2024-09-12T02:43:36.587690+0000, chain.objs.size()=1 2024-09-12T00:43:44.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.355+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.129__shadow_.rsFCTP7nCEAoECQF9H0VjRbrhRdVy4x_0 2024-09-12T00:43:44.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.355+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4112706116903111348', time=2024-09-12T02:43:37.020012+0000, chain.objs.size()=1 2024-09-12T00:43:44.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.355+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.130__shadow_.C2_ZIj1EHdt0K112eTgltyDUF39t1O8_0 2024-09-12T00:43:44.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.359+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.363+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:43:44.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.363+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.363+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.363+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:43:44.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.363+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14527864286724864735', time=2024-09-12T02:43:02.623218+0000, chain.objs.size()=2 2024-09-12T00:43:44.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.363+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.83__shadow_.3P3ZTVb75vbVtjaiMsWVJUH5DctmSbe_0 2024-09-12T00:43:44.362 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.363+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.83__shadow_.3P3ZTVb75vbVtjaiMsWVJUH5DctmSbe_1 2024-09-12T00:43:44.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.367+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.367+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:43:44.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.371+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.371+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.371+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.371+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:43:44.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.371+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.371+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.375+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:43:44.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.375+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10888978331849782288', time=2024-09-12T02:43:26.761377+0000, chain.objs.size()=1 2024-09-12T00:43:44.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.375+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.106__shadow_.0M3CkNKoUuFwqNCnJG8tK7jl9ZLojSf_0 2024-09-12T00:43:44.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.375+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9649351725693406168', time=2024-09-12T02:43:32.124143+0000, chain.objs.size()=1 2024-09-12T00:43:44.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.375+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.119__shadow_.TOYvA-NB1RwEwlDgxkKhkARdXtmP-as_0 2024-09-12T00:43:44.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.375+0000 7f0d2954e9c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10752548158494934791', time=2024-09-12T02:43:32.561598+0000, chain.objs.size()=1 2024-09-12T00:43:44.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.375+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.120__shadow_.A7G5zLuLiTmyd01qwJglWa5hYN2qIrw_0 2024-09-12T00:43:44.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.375+0000 7f0d2954e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:43:44.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.379+0000 7f0bddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:44.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.379+0000 7f0d2954e9c0 20 remove_watcher() i=0 2024-09-12T00:43:44.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.379+0000 7f0d2954e9c0 2 removed watcher, disabling cache 2024-09-12T00:43:44.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.383+0000 7f0d2954e9c0 20 remove_watcher() i=1 2024-09-12T00:43:44.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.383+0000 7f0d2954e9c0 20 remove_watcher() i=2 2024-09-12T00:43:44.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.383+0000 7f0d2954e9c0 20 remove_watcher() i=3 2024-09-12T00:43:44.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.383+0000 7f0d2954e9c0 20 remove_watcher() i=4 2024-09-12T00:43:44.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.387+0000 7f0d2954e9c0 20 remove_watcher() i=5 2024-09-12T00:43:44.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.387+0000 7f0d2954e9c0 20 remove_watcher() i=6 2024-09-12T00:43:44.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.387+0000 7f0d2954e9c0 20 remove_watcher() i=7 2024-09-12T00:43:44.398 DEBUG:teuthology.orchestra.run.smithi138:> radosgw-admin gc process --include-all 2024-09-12T00:43:44.466 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:44.466 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:44.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.507+0000 7fea9c26e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:44.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.507+0000 7fea9c26e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:44.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.507+0000 7fea9c26e9c0 20 realm 2024-09-12T00:43:44.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.507+0000 7fea9c26e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:44.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.511+0000 7fea9c26e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:44.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.511+0000 7fea9c26e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:44.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.511+0000 7fea9c26e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:44.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.511+0000 7fea9c26e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:44.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.511+0000 7fea9c26e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:44.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.511+0000 7fea9c26e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:44.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.511+0000 7fea9c26e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:44.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.511+0000 7fea9c26e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:44.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.511+0000 7fea9c26e9c0 20 searching for the correct realm 2024-09-12T00:43:44.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.519+0000 7fea99573640 0 -- 172.21.15.138:0/2239370388 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7fea8c008030 msgr2=0x7fea8c046ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:44.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.527+0000 7fea99573640 0 -- 172.21.15.138:0/2239370388 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55c09469bfa0 msgr2=0x55c09469e390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:44.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:44.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:44.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:44.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:44.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:44.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:44.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:44.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:44.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:44.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:44.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:44.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:44.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 20 zone default found 2024-09-12T00:43:44.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 4 Realm: () 2024-09-12T00:43:44.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:44.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:44.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:44.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 20 zonegroup default 2024-09-12T00:43:44.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:44.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:44.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.531+0000 7fea9c26e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:44.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.535+0000 7fea9c26e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:44.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.535+0000 7fea9c26e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:44.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.535+0000 7fea9c26e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:44.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.535+0000 7fea9c26e9c0 20 started sync module instance, tier type = 2024-09-12T00:43:44.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.535+0000 7fea9c26e9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:44.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.551+0000 7fea9c26e9c0 20 add_watcher() i=0 2024-09-12T00:43:44.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.551+0000 7fea9c26e9c0 20 add_watcher() i=1 2024-09-12T00:43:44.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.551+0000 7fea9c26e9c0 20 add_watcher() i=2 2024-09-12T00:43:44.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.551+0000 7fea9c26e9c0 20 add_watcher() i=3 2024-09-12T00:43:44.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.551+0000 7fea9c26e9c0 20 add_watcher() i=4 2024-09-12T00:43:44.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.551+0000 7fea9c26e9c0 20 add_watcher() i=5 2024-09-12T00:43:44.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.551+0000 7fea9c26e9c0 20 add_watcher() i=6 2024-09-12T00:43:44.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.555+0000 7fea9c26e9c0 20 add_watcher() i=7 2024-09-12T00:43:44.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.555+0000 7fea9c26e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:44.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.555+0000 7fe94b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:44.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.559+0000 7fea9c26e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:44.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.559+0000 7fea9c26e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:44.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.627+0000 7fe94a7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.627+0000 7fea9c26e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.627+0000 7fea9c26e9c0 20 Filter name: none 2024-09-12T00:43:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.627+0000 7fe8bbfff640 20 reqs_thread_entry: start 2024-09-12T00:43:44.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.627+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:43:44.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.631+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.631+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.631+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.635+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:43:44.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.635+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.635+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.639+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.639+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:43:44.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.639+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.643+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.643+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.642 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.643+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:43:44.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.647+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.647+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.647+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.651+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:43:44.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.655+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.655+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.655+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.655+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:43:44.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.659+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.659+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.660 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.659+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.663+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:43:44.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.667+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.667+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.667+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.667+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:43:44.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.671+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.671+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.671+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.671+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:43:44.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.675+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.675+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.675+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.679+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:43:44.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.679+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.683+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.683+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.683+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:43:44.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.687+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.687+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.687+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.691+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:43:44.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.695+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.695+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.699+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.699+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:43:44.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.703+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.703+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.703+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.707+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:43:44.707 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.707+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.711+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.711+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.711+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:43:44.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.715+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.715+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.715+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.719+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:43:44.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.719+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.719+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.723+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.723+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:43:44.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.727+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.727+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.727+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.731+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:43:44.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.735+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.735+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.739+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.739+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:43:44.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.743+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.743+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.743+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.743+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:43:44.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.747+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.751+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.751+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.751+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:43:44.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.755+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.759+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.759+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.763+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:43:44.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.763+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.763+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.767+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.766 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.767+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:43:44.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.771+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.771+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.771+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.775+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:43:44.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.779+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.779+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.783+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.783 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.783+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:43:44.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.787+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.791+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.791+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.791+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:43:44.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.795+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.799+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.799+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.803+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:43:44.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.803+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.807+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.807+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.811+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:43:44.811 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.811+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.812 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.815+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.815+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.815+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:43:44.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.819+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.823+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.823+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.823+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:43:44.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.827+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.828 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.831+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.831+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.835+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:43:44.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.835+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.839+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.839+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.843+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:43:44.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.847+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.851+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:43:44.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.851+0000 7fea9c26e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:43:44.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.855+0000 7fe94b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:44.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.863+0000 7fea9c26e9c0 20 remove_watcher() i=0 2024-09-12T00:43:44.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.863+0000 7fea9c26e9c0 2 removed watcher, disabling cache 2024-09-12T00:43:44.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.863+0000 7fea9c26e9c0 20 remove_watcher() i=1 2024-09-12T00:43:44.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.867+0000 7fea9c26e9c0 20 remove_watcher() i=2 2024-09-12T00:43:44.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.871+0000 7fea9c26e9c0 20 remove_watcher() i=3 2024-09-12T00:43:44.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.871+0000 7fea9c26e9c0 20 remove_watcher() i=4 2024-09-12T00:43:44.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.875+0000 7fea9c26e9c0 20 remove_watcher() i=5 2024-09-12T00:43:44.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.875+0000 7fea9c26e9c0 20 remove_watcher() i=6 2024-09-12T00:43:44.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:44.879+0000 7fea9c26e9c0 20 remove_watcher() i=7 2024-09-12T00:43:44.897 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T00:43:44.914 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 main': 'RGW11111111111111111', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T00:43:44.914 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T00:43:44.915 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T00:43:44.915 DEBUG:teuthology.orchestra.run.smithi138:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:43:44.944 INFO:teuthology.orchestra.run.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T00:43:45.815 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T00:43:45.815 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW11111111111111111 --account-name Mr.RGW11111111111111111 --email RGW11111111111111111+test@test.test 2024-09-12T00:43:45.896 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:45.897 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:45.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.939+0000 7fa729f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.939+0000 7fa729f6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.939+0000 7fa729f6d9c0 20 realm 2024-09-12T00:43:45.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.939+0000 7fa729f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.943+0000 7fa729f6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.943+0000 7fa729f6d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:45.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.943+0000 7fa729f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.943+0000 7fa729f6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.943+0000 7fa729f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.943+0000 7fa729f6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:45.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.943+0000 7fa729f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.943+0000 7fa729f6d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:45.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.943+0000 7fa729f6d9c0 20 searching for the correct realm 2024-09-12T00:43:45.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.947+0000 7fa728274640 0 -- 172.21.15.138:0/2455144129 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55c7f1564220 msgr2=0x55c7f15666e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:45.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.955+0000 7fa727272640 0 -- 172.21.15.138:0/2455144129 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55c7f155f460 msgr2=0x55c7f1561870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:45.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:45.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:45.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:45.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:45.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:45.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:45.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:45.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:45.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 20 zone default found 2024-09-12T00:43:45.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 4 Realm: () 2024-09-12T00:43:45.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:45.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:45.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:45.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 20 zonegroup default 2024-09-12T00:43:45.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.963+0000 7fa729f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.967+0000 7fa729f6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.967+0000 7fa729f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.967+0000 7fa729f6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.967+0000 7fa729f6d9c0 20 started sync module instance, tier type = 2024-09-12T00:43:45.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.967+0000 7fa729f6d9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.991+0000 7fa729f6d9c0 20 add_watcher() i=0 2024-09-12T00:43:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.991+0000 7fa729f6d9c0 20 add_watcher() i=1 2024-09-12T00:43:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.991+0000 7fa729f6d9c0 20 add_watcher() i=2 2024-09-12T00:43:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.991+0000 7fa729f6d9c0 20 add_watcher() i=3 2024-09-12T00:43:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.991+0000 7fa729f6d9c0 20 add_watcher() i=4 2024-09-12T00:43:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.991+0000 7fa729f6d9c0 20 add_watcher() i=5 2024-09-12T00:43:45.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.991+0000 7fa729f6d9c0 20 add_watcher() i=6 2024-09-12T00:43:45.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.991+0000 7fa729f6d9c0 20 add_watcher() i=7 2024-09-12T00:43:45.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.991+0000 7fa729f6d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:45.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.995+0000 7fa5ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:45.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.995+0000 7fa729f6d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:45.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.995+0000 7fa729f6d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:45.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.995+0000 7fa729f6d9c0 5 note: GC not initialized 2024-09-12T00:43:45.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.999+0000 7fa5dcfe1640 20 reqs_thread_entry: start 2024-09-12T00:43:45.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.999+0000 7fa729f6d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:45.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.999+0000 7fa729f6d9c0 20 Filter name: none 2024-09-12T00:43:45.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.999+0000 7fa5567fc640 20 reqs_thread_entry: start 2024-09-12T00:43:45.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.999+0000 7fa729f6d9c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 : miss 2024-09-12T00:43:45.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.999+0000 7fa729f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.999+0000 7fa729f6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.999+0000 7fa729f6d9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x0 2024-09-12T00:43:45.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.999+0000 7fa729f6d9c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T00:43:45.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.999+0000 7fa729f6d9c0 20 failed to read name.$Mr.RGW11111111111111111 with: (2) No such file or directory 2024-09-12T00:43:45.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.999+0000 7fa729f6d9c0 10 cache get: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test : miss 2024-09-12T00:43:45.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.999+0000 7fa729f6d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:45.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.999+0000 7fa729f6d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:45.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.999+0000 7fa729f6d9c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x0 2024-09-12T00:43:45.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.999+0000 7fa729f6d9c0 10 adding default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T00:43:45.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:45.999+0000 7fa729f6d9c0 20 failed to read rgw11111111111111111+test@test.test with: (2) No such file or directory 2024-09-12T00:43:46.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.003+0000 7fa729f6d9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T00:43:46.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.003+0000 7fa729f6d9c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T00:43:46.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.003+0000 7fa729f6d9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW11111111111111111, ofs0, ns] 2024-09-12T00:43:46.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.003+0000 7fa606ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333696 cookie 94317235818864 notifier 8453 bl.length()=384 2024-09-12T00:43:46.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.003+0000 7fa606ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T00:43:46.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.003+0000 7fa606ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T00:43:46.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.007+0000 7fa729f6d9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T00:43:46.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.007+0000 7fa729f6d9c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T00:43:46.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.007+0000 7fa729f6d9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW11111111111111111, ofs0, ns] 2024-09-12T00:43:46.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.007+0000 7fa6067fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333697 cookie 94317235831504 notifier 8453 bl.length()=225 2024-09-12T00:43:46.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.007+0000 7fa6067fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 info.flags=0x17 2024-09-12T00:43:46.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.007+0000 7fa6067fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW11111111111111111 to cache LRU end 2024-09-12T00:43:46.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.007+0000 7fa729f6d9c0 10 cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T00:43:46.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.007+0000 7fa729f6d9c0 10 moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T00:43:46.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.007+0000 7fa729f6d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw11111111111111111+test@test.test, ofs0, ns] 2024-09-12T00:43:46.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.011+0000 7fa606ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333539 cookie 94317235827104 notifier 8453 bl.length()=234 2024-09-12T00:43:46.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.011+0000 7fa606ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw11111111111111111+test@test.test info.flags=0x17 2024-09-12T00:43:46.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.011+0000 7fa606ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw11111111111111111+test@test.test to cache LRU end 2024-09-12T00:43:46.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.011+0000 7fa5ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:46.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.015+0000 7fa729f6d9c0 20 remove_watcher() i=0 2024-09-12T00:43:46.014 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.015+0000 7fa729f6d9c0 2 removed watcher, disabling cache 2024-09-12T00:43:46.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.019+0000 7fa729f6d9c0 20 remove_watcher() i=1 2024-09-12T00:43:46.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.019+0000 7fa729f6d9c0 20 remove_watcher() i=2 2024-09-12T00:43:46.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.023+0000 7fa729f6d9c0 20 remove_watcher() i=3 2024-09-12T00:43:46.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.023+0000 7fa729f6d9c0 20 remove_watcher() i=4 2024-09-12T00:43:46.025 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.027+0000 7fa729f6d9c0 20 remove_watcher() i=5 2024-09-12T00:43:46.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.031+0000 7fa729f6d9c0 20 remove_watcher() i=6 2024-09-12T00:43:46.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.031+0000 7fa729f6d9c0 20 remove_watcher() i=7 2024-09-12T00:43:46.043 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T00:43:46.043 INFO:teuthology.orchestra.run.smithi138.stdout: "id": "RGW11111111111111111", 2024-09-12T00:43:46.043 INFO:teuthology.orchestra.run.smithi138.stdout: "tenant": "", 2024-09-12T00:43:46.043 INFO:teuthology.orchestra.run.smithi138.stdout: "name": "Mr.RGW11111111111111111", 2024-09-12T00:43:46.043 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "RGW11111111111111111+test@test.test", 2024-09-12T00:43:46.043 INFO:teuthology.orchestra.run.smithi138.stdout: "quota": { 2024-09-12T00:43:46.043 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:46.044 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:46.044 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:46.044 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:46.044 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:46.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:46.044 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-12T00:43:46.044 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:46.044 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:46.044 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:46.044 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:46.044 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:46.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:46.044 INFO:teuthology.orchestra.run.smithi138.stdout: "max_users": 1000, 2024-09-12T00:43:46.044 INFO:teuthology.orchestra.run.smithi138.stdout: "max_roles": 1000, 2024-09-12T00:43:46.045 INFO:teuthology.orchestra.run.smithi138.stdout: "max_groups": 1000, 2024-09-12T00:43:46.045 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-12T00:43:46.045 INFO:teuthology.orchestra.run.smithi138.stdout: "max_access_keys": 4 2024-09-12T00:43:46.045 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T00:43:46.046 DEBUG:tasks.s3tests:Creating user RGW11111111111111111 on client.0 2024-09-12T00:43:46.046 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.RGW11111111111111111 --email foo+test@test.test --access-key AYNUWVDKQTGUFDNPBSYE --secret LII+KC2WqyILwxzcITcpV2KLE0/p0+7eJA1icLB9YDT3IPmAgLanGQ== --cluster ceph --account-id RGW11111111111111111 --account-root 2024-09-12T00:43:46.137 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:46.137 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:46.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.179+0000 7f0a55ff19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.179+0000 7f0a55ff19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.179+0000 7f0a55ff19c0 20 realm 2024-09-12T00:43:46.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.179+0000 7f0a55ff19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.183+0000 7f0a55ff19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.183+0000 7f0a55ff19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:46.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.183+0000 7f0a55ff19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.183+0000 7f0a55ff19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.183+0000 7f0a55ff19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.183+0000 7f0a55ff19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:46.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.183+0000 7f0a55ff19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.183+0000 7f0a55ff19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:46.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.183+0000 7f0a55ff19c0 20 searching for the correct realm 2024-09-12T00:43:46.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.187+0000 7f0a532f6640 0 -- 172.21.15.138:0/630931766 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f0a44017070 msgr2=0x7f0a4408f370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:46.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.195+0000 7f0a532f6640 0 -- 172.21.15.138:0/630931766 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x56400fca2410 msgr2=0x56400fca4820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:46.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:46.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:46.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:46.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:46.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:46.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:46.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:46.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:46.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 20 zone default found 2024-09-12T00:43:46.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 4 Realm: () 2024-09-12T00:43:46.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:46.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:46.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:46.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 20 zonegroup default 2024-09-12T00:43:46.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.203+0000 7f0a55ff19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.207+0000 7f0a55ff19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.207+0000 7f0a55ff19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.207+0000 7f0a55ff19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.207+0000 7f0a55ff19c0 20 started sync module instance, tier type = 2024-09-12T00:43:46.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.207+0000 7f0a55ff19c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:46.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.223+0000 7f0a55ff19c0 20 add_watcher() i=0 2024-09-12T00:43:46.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.223+0000 7f0a55ff19c0 20 add_watcher() i=1 2024-09-12T00:43:46.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.223+0000 7f0a55ff19c0 20 add_watcher() i=2 2024-09-12T00:43:46.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.223+0000 7f0a55ff19c0 20 add_watcher() i=3 2024-09-12T00:43:46.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.223+0000 7f0a55ff19c0 20 add_watcher() i=4 2024-09-12T00:43:46.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.223+0000 7f0a55ff19c0 20 add_watcher() i=5 2024-09-12T00:43:46.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.223+0000 7f0a55ff19c0 20 add_watcher() i=6 2024-09-12T00:43:46.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.227+0000 7f0a55ff19c0 20 add_watcher() i=7 2024-09-12T00:43:46.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.227+0000 7f0a55ff19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:46.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0909fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:46.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:46.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:46.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 5 note: GC not initialized 2024-09-12T00:43:46.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0908fe1640 20 reqs_thread_entry: start 2024-09-12T00:43:46.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:46.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 20 Filter name: none 2024-09-12T00:43:46.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f08827fc640 20 reqs_thread_entry: start 2024-09-12T00:43:46.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T00:43:46.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T00:43:46.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:43:46.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T00:43:46.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T00:43:46.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:43:46.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 10 cache get: name=default.rgw.meta+users.keys+AYNUWVDKQTGUFDNPBSYE : miss 2024-09-12T00:43:46.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 10 cache put: name=default.rgw.meta+users.keys+AYNUWVDKQTGUFDNPBSYE info.flags=0x0 2024-09-12T00:43:46.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 10 adding default.rgw.meta+users.keys+AYNUWVDKQTGUFDNPBSYE to cache LRU end 2024-09-12T00:43:46.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 10 cache get: name=default.rgw.meta+accounts+account.RGW11111111111111111 : miss 2024-09-12T00:43:46.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.231+0000 7f0a55ff19c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.235+0000 7f0a55ff19c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:43:46.233 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.235+0000 7f0a55ff19c0 10 cache put: name=default.rgw.meta+accounts+account.RGW11111111111111111 info.flags=0x17 2024-09-12T00:43:46.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.235+0000 7f0a55ff19c0 10 adding default.rgw.meta+accounts+account.RGW11111111111111111 to cache LRU end 2024-09-12T00:43:46.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.235+0000 7f0a55ff19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:46.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.235+0000 7f0a55ff19c0 10 cache get: name=default.rgw.meta+users.keys+AYNUWVDKQTGUFDNPBSYE : hit (negative entry) 2024-09-12T00:43:46.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.235+0000 7f0a55ff19c0 10 cache get: name=default.rgw.meta+users.keys+AYNUWVDKQTGUFDNPBSYE : hit (negative entry) 2024-09-12T00:43:46.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.239+0000 7f0a55ff19c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:43:46.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.239+0000 7f0a55ff19c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:43:46.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.239+0000 7f0a55ff19c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T00:43:46.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.239+0000 7f0932ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333545 cookie 94833142809568 notifier 8471 bl.length()=673 2024-09-12T00:43:46.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.239+0000 7f0932ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:43:46.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.239+0000 7f0932ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:43:46.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.243+0000 7f0a55ff19c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T00:43:46.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.243+0000 7f0a55ff19c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:43:46.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.243+0000 7f0a55ff19c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T00:43:46.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.243+0000 7f09327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333698 cookie 94833142836784 notifier 8471 bl.length()=185 2024-09-12T00:43:46.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.243+0000 7f09327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T00:43:46.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.243+0000 7f09327fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:43:46.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.243+0000 7f0a55ff19c0 10 cache put: name=default.rgw.meta+users.keys+AYNUWVDKQTGUFDNPBSYE info.flags=0x7 2024-09-12T00:43:46.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.243+0000 7f0a55ff19c0 10 moving default.rgw.meta+users.keys+AYNUWVDKQTGUFDNPBSYE to cache LRU end 2024-09-12T00:43:46.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.243+0000 7f0a55ff19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:AYNUWVDKQTGUFDNPBSYE, ofs0, ns] 2024-09-12T00:43:46.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.247+0000 7f09327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333731 cookie 94833142846560 notifier 8471 bl.length()=186 2024-09-12T00:43:46.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.247+0000 7f09327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+AYNUWVDKQTGUFDNPBSYE info.flags=0x7 2024-09-12T00:43:46.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.247+0000 7f09327fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+AYNUWVDKQTGUFDNPBSYE to cache LRU end 2024-09-12T00:43:46.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.251+0000 7f0a55ff19c0 20 linked user foo.client.0 to account RGW11111111111111111 2024-09-12T00:43:46.249 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T00:43:46.249 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "foo.client.0", 2024-09-12T00:43:46.249 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr.RGW11111111111111111", 2024-09-12T00:43:46.249 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "foo+test@test.test", 2024-09-12T00:43:46.249 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-12T00:43:46.249 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-12T00:43:46.249 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-12T00:43:46.249 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-12T00:43:46.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-12T00:43:46.249 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "foo.client.0", 2024-09-12T00:43:46.250 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "AYNUWVDKQTGUFDNPBSYE", 2024-09-12T00:43:46.250 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "LII+KC2WqyILwxzcITcpV2KLE0/p0+7eJA1icLB9YDT3IPmAgLanGQ==", 2024-09-12T00:43:46.250 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-12T00:43:46.250 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:43:46.240143Z" 2024-09-12T00:43:46.250 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-12T00:43:46.250 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-12T00:43:46.250 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-12T00:43:46.250 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-12T00:43:46.251 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-12T00:43:46.251 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-12T00:43:46.251 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-12T00:43:46.251 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-12T00:43:46.251 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-12T00:43:46.251 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:46.251 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:46.251 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:46.251 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:46.251 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:46.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:46.252 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-12T00:43:46.252 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:46.252 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:46.252 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:46.252 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:46.252 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:46.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:46.252 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-12T00:43:46.252 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "root", 2024-09-12T00:43:46.252 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-12T00:43:46.252 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "RGW11111111111111111", 2024-09-12T00:43:46.253 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-12T00:43:46.253 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:43:46.240122Z", 2024-09-12T00:43:46.253 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-12T00:43:46.253 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-12T00:43:46.253 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T00:43:46.253 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:46.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.251+0000 7f0909fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:46.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.255+0000 7f0a55ff19c0 20 remove_watcher() i=0 2024-09-12T00:43:46.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.255+0000 7f0a55ff19c0 2 removed watcher, disabling cache 2024-09-12T00:43:46.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.255+0000 7f0a55ff19c0 20 remove_watcher() i=1 2024-09-12T00:43:46.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.259+0000 7f0a55ff19c0 20 remove_watcher() i=2 2024-09-12T00:43:46.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.259+0000 7f0a55ff19c0 20 remove_watcher() i=3 2024-09-12T00:43:46.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.263+0000 7f0a55ff19c0 20 remove_watcher() i=4 2024-09-12T00:43:46.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.263+0000 7f0a55ff19c0 20 remove_watcher() i=5 2024-09-12T00:43:46.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.267+0000 7f0a55ff19c0 20 remove_watcher() i=6 2024-09-12T00:43:46.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.271+0000 7f0a55ff19c0 20 remove_watcher() i=7 2024-09-12T00:43:46.283 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 3847649278 --totp-seed U3SDUIOWYE3H2WJIMUFBVOK37Q3NC7X2VIMBJQN2PYYCYTF7RUZ2PSPK3RMM2GXW --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:43:46.325 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:46.325 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:46.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.367+0000 7f60a69789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.367+0000 7f60a69789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.367+0000 7f60a69789c0 20 realm 2024-09-12T00:43:46.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.367+0000 7f60a69789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.367+0000 7f60a69789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.367+0000 7f60a69789c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:46.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.367+0000 7f60a69789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.367+0000 7f60a69789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.367+0000 7f60a69789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.371+0000 7f60a69789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:46.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.371+0000 7f60a69789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.371+0000 7f60a69789c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:46.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.371+0000 7f60a69789c0 20 searching for the correct realm 2024-09-12T00:43:46.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.375+0000 7f60a4c7f640 0 -- 172.21.15.138:0/2891946683 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f609c05f3d0 msgr2=0x7f609c092880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:46.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.591+0000 7f60a4c7f640 0 -- 172.21.15.138:0/2891946683 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x564cf4172c00 msgr2=0x564cf41750c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:46.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.599+0000 7f60a69789c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:46.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.599+0000 7f60a69789c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:46.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.599+0000 7f60a69789c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:46.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.599+0000 7f60a69789c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:46.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.599+0000 7f60a69789c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:46.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.599+0000 7f60a69789c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:46.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.599+0000 7f60a69789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.599+0000 7f60a69789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.599+0000 7f60a69789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.603+0000 7f60a69789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:46.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.603+0000 7f60a69789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.603+0000 7f60a69789c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:46.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.603+0000 7f60a69789c0 20 zone default found 2024-09-12T00:43:46.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.603+0000 7f60a69789c0 4 Realm: () 2024-09-12T00:43:46.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.603+0000 7f60a69789c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:46.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.603+0000 7f60a69789c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:46.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.603+0000 7f60a69789c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:46.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.603+0000 7f60a69789c0 20 zonegroup default 2024-09-12T00:43:46.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.603+0000 7f60a69789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.603+0000 7f60a69789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.603+0000 7f60a69789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.603+0000 7f60a69789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.603+0000 7f60a69789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.603+0000 7f60a69789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:46.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.603+0000 7f60a69789c0 20 started sync module instance, tier type = 2024-09-12T00:43:46.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.603+0000 7f60a69789c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:46.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.627+0000 7f60a69789c0 20 add_watcher() i=0 2024-09-12T00:43:46.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.627+0000 7f60a69789c0 20 add_watcher() i=1 2024-09-12T00:43:46.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.627+0000 7f60a69789c0 20 add_watcher() i=2 2024-09-12T00:43:46.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.627+0000 7f60a69789c0 20 add_watcher() i=3 2024-09-12T00:43:46.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.627+0000 7f60a69789c0 20 add_watcher() i=4 2024-09-12T00:43:46.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.627+0000 7f60a69789c0 20 add_watcher() i=5 2024-09-12T00:43:46.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.627+0000 7f60a69789c0 20 add_watcher() i=6 2024-09-12T00:43:46.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.631+0000 7f60a69789c0 20 add_watcher() i=7 2024-09-12T00:43:46.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.631+0000 7f60a69789c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:46.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.635+0000 7f5f5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:46.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.635+0000 7f60a69789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:46.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.635+0000 7f60a69789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:46.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.635+0000 7f60a69789c0 5 note: GC not initialized 2024-09-12T00:43:46.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.635+0000 7f5f59fdb640 20 reqs_thread_entry: start 2024-09-12T00:43:46.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.635+0000 7f60a69789c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:46.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.635+0000 7f60a69789c0 20 Filter name: none 2024-09-12T00:43:46.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.635+0000 7f5ecb7fe640 20 reqs_thread_entry: start 2024-09-12T00:43:46.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.635+0000 7f60a69789c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T00:43:46.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.635+0000 7f60a69789c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:46.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.635+0000 7f60a69789c0 20 rados_obj.operate() r=0 bl.length=488 2024-09-12T00:43:46.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.635+0000 7f60a69789c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T00:43:46.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.635+0000 7f60a69789c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:43:46.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:46.635+0000 7f60a69789c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:48.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.287+0000 7f60a69789c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:43:48.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.287+0000 7f60a69789c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:43:48.284 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.287+0000 7f60a69789c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T00:43:48.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.287+0000 7f5f7affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268138 cookie 94888512671968 notifier 9108 bl.length()=687 2024-09-12T00:43:48.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.287+0000 7f5f7affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:43:48.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.287+0000 7f5f7affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:43:48.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.291+0000 7f5f5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:48.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.295+0000 7f60a69789c0 20 remove_watcher() i=0 2024-09-12T00:43:48.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.295+0000 7f60a69789c0 2 removed watcher, disabling cache 2024-09-12T00:43:48.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.295+0000 7f60a69789c0 20 remove_watcher() i=1 2024-09-12T00:43:48.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.299+0000 7f60a69789c0 20 remove_watcher() i=2 2024-09-12T00:43:48.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.299+0000 7f60a69789c0 20 remove_watcher() i=3 2024-09-12T00:43:48.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.303+0000 7f60a69789c0 20 remove_watcher() i=4 2024-09-12T00:43:48.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.303+0000 7f60a69789c0 20 remove_watcher() i=5 2024-09-12T00:43:48.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.307+0000 7f60a69789c0 20 remove_watcher() i=6 2024-09-12T00:43:48.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.311+0000 7f60a69789c0 20 remove_watcher() i=7 2024-09-12T00:43:48.327 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T00:43:48.328 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key MSCNFTMIQMLHQLFLAQKQ --secret 3eA1y4PIaikjLbriRFZDp5nEr+WBCzT+JNGVyo/IEtv3L8gEUIL7ww== --cluster ceph 2024-09-12T00:43:48.412 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:48.413 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:48.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.455+0000 7fd1873f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.459+0000 7fd1873f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.459+0000 7fd1873f29c0 20 realm 2024-09-12T00:43:48.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.459+0000 7fd1873f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.459+0000 7fd1873f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.459+0000 7fd1873f29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:48.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.459+0000 7fd1873f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.459+0000 7fd1873f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.459+0000 7fd1873f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.459+0000 7fd1873f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:48.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.459+0000 7fd1873f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.459+0000 7fd1873f29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:48.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.459+0000 7fd1873f29c0 20 searching for the correct realm 2024-09-12T00:43:48.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.467+0000 7fd1856f9640 0 -- 172.21.15.138:0/3681552449 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fd174021030 msgr2=0x7fd174063a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:48.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.683+0000 7fd1856f9640 0 -- 172.21.15.138:0/3681552449 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x560f57f5acb0 msgr2=0x560f57f5d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:48.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.691+0000 7fd1873f29c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:48.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.691+0000 7fd1873f29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:48.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.691+0000 7fd1873f29c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:48.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.691+0000 7fd1873f29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:48.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.691+0000 7fd1873f29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:48.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.691+0000 7fd1873f29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:48.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.691+0000 7fd1873f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.691+0000 7fd1873f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.691+0000 7fd1873f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.695+0000 7fd1873f29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:48.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.695+0000 7fd1873f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.695+0000 7fd1873f29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:48.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.695+0000 7fd1873f29c0 20 zone default found 2024-09-12T00:43:48.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.695+0000 7fd1873f29c0 4 Realm: () 2024-09-12T00:43:48.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.695+0000 7fd1873f29c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:48.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.695+0000 7fd1873f29c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:48.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.695+0000 7fd1873f29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:48.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.695+0000 7fd1873f29c0 20 zonegroup default 2024-09-12T00:43:48.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.695+0000 7fd1873f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.695+0000 7fd1873f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.695+0000 7fd1873f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.695+0000 7fd1873f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.695+0000 7fd1873f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.695+0000 7fd1873f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.695+0000 7fd1873f29c0 20 started sync module instance, tier type = 2024-09-12T00:43:48.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.695+0000 7fd1873f29c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:48.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.719+0000 7fd1873f29c0 20 add_watcher() i=0 2024-09-12T00:43:48.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.719+0000 7fd1873f29c0 20 add_watcher() i=1 2024-09-12T00:43:48.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.719+0000 7fd1873f29c0 20 add_watcher() i=2 2024-09-12T00:43:48.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.719+0000 7fd1873f29c0 20 add_watcher() i=3 2024-09-12T00:43:48.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.719+0000 7fd1873f29c0 20 add_watcher() i=4 2024-09-12T00:43:48.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.719+0000 7fd1873f29c0 20 add_watcher() i=5 2024-09-12T00:43:48.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.719+0000 7fd1873f29c0 20 add_watcher() i=6 2024-09-12T00:43:48.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.723+0000 7fd1873f29c0 20 add_watcher() i=7 2024-09-12T00:43:48.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.723+0000 7fd1873f29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:48.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd039fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:48.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:48.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:48.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 5 note: GC not initialized 2024-09-12T00:43:48.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd038fe1640 20 reqs_thread_entry: start 2024-09-12T00:43:48.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:48.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 20 Filter name: none 2024-09-12T00:43:48.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fcfb27fc640 20 reqs_thread_entry: start 2024-09-12T00:43:48.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T00:43:48.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T00:43:48.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:43:48.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T00:43:48.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T00:43:48.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:43:48.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 10 cache get: name=default.rgw.meta+users.keys+MSCNFTMIQMLHQLFLAQKQ : miss 2024-09-12T00:43:48.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 10 cache put: name=default.rgw.meta+users.keys+MSCNFTMIQMLHQLFLAQKQ info.flags=0x0 2024-09-12T00:43:48.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 10 adding default.rgw.meta+users.keys+MSCNFTMIQMLHQLFLAQKQ to cache LRU end 2024-09-12T00:43:48.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 10 cache get: name=default.rgw.meta+users.keys+MSCNFTMIQMLHQLFLAQKQ : hit (negative entry) 2024-09-12T00:43:48.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.731+0000 7fd1873f29c0 10 cache get: name=default.rgw.meta+users.keys+MSCNFTMIQMLHQLFLAQKQ : hit (negative entry) 2024-09-12T00:43:48.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.735+0000 7fd1873f29c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:43:48.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.735+0000 7fd1873f29c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:43:48.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.735+0000 7fd1873f29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T00:43:48.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.735+0000 7fd062ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268291 cookie 94623900224608 notifier 8507 bl.length()=645 2024-09-12T00:43:48.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.735+0000 7fd062ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:43:48.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.735+0000 7fd062ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:43:48.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.739+0000 7fd1873f29c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T00:43:48.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.739+0000 7fd1873f29c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:43:48.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.739+0000 7fd1873f29c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T00:43:48.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.739+0000 7fd062ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268324 cookie 94623900239424 notifier 8507 bl.length()=185 2024-09-12T00:43:48.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.739+0000 7fd062ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T00:43:48.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.739+0000 7fd062ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:43:48.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.743+0000 7fd1873f29c0 10 cache put: name=default.rgw.meta+users.keys+MSCNFTMIQMLHQLFLAQKQ info.flags=0x7 2024-09-12T00:43:48.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.743+0000 7fd1873f29c0 10 moving default.rgw.meta+users.keys+MSCNFTMIQMLHQLFLAQKQ to cache LRU end 2024-09-12T00:43:48.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.743+0000 7fd1873f29c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:MSCNFTMIQMLHQLFLAQKQ, ofs0, ns] 2024-09-12T00:43:48.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.743+0000 7fd0627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268132 cookie 94623900234384 notifier 8507 bl.length()=186 2024-09-12T00:43:48.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.743+0000 7fd0627fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MSCNFTMIQMLHQLFLAQKQ info.flags=0x7 2024-09-12T00:43:48.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.743+0000 7fd0627fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MSCNFTMIQMLHQLFLAQKQ to cache LRU end 2024-09-12T00:43:48.742 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T00:43:48.742 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "bar.client.0", 2024-09-12T00:43:48.742 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T00:43:48.742 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "bar+test@test.test", 2024-09-12T00:43:48.742 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-12T00:43:48.742 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-12T00:43:48.742 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-12T00:43:48.743 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-12T00:43:48.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-12T00:43:48.743 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "bar.client.0", 2024-09-12T00:43:48.743 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "MSCNFTMIQMLHQLFLAQKQ", 2024-09-12T00:43:48.743 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "3eA1y4PIaikjLbriRFZDp5nEr+WBCzT+JNGVyo/IEtv3L8gEUIL7ww==", 2024-09-12T00:43:48.743 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-12T00:43:48.743 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:43:48.737389Z" 2024-09-12T00:43:48.743 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-12T00:43:48.743 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-12T00:43:48.743 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-12T00:43:48.743 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-12T00:43:48.743 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-12T00:43:48.744 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-12T00:43:48.744 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-12T00:43:48.744 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-12T00:43:48.744 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-12T00:43:48.744 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:48.744 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:48.744 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:48.744 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:48.744 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:48.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:48.744 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-12T00:43:48.745 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:48.745 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:48.745 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:48.745 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:48.745 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:48.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:48.745 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-12T00:43:48.745 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "rgw", 2024-09-12T00:43:48.745 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-12T00:43:48.745 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "", 2024-09-12T00:43:48.745 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-12T00:43:48.746 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:43:48.737357Z", 2024-09-12T00:43:48.746 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-12T00:43:48.746 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-12T00:43:48.746 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T00:43:48.746 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:48.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.743+0000 7fd039fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:48.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.747+0000 7fd1873f29c0 20 remove_watcher() i=0 2024-09-12T00:43:48.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.747+0000 7fd1873f29c0 2 removed watcher, disabling cache 2024-09-12T00:43:48.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.751+0000 7fd1873f29c0 20 remove_watcher() i=1 2024-09-12T00:43:48.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.755+0000 7fd1873f29c0 20 remove_watcher() i=2 2024-09-12T00:43:48.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.755+0000 7fd1873f29c0 20 remove_watcher() i=3 2024-09-12T00:43:48.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.759+0000 7fd1873f29c0 20 remove_watcher() i=4 2024-09-12T00:43:48.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.759+0000 7fd1873f29c0 20 remove_watcher() i=5 2024-09-12T00:43:48.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.763+0000 7fd1873f29c0 20 remove_watcher() i=6 2024-09-12T00:43:48.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.763+0000 7fd1873f29c0 20 remove_watcher() i=7 2024-09-12T00:43:48.780 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 6157534724 --totp-seed IEXJU3JXORMT25FHOQRM2PAFVXCCRBDYJ3M6TI56223KBJNUYZ4AA5DPDFXIZM2A --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:43:48.826 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:48.826 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:48.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.867+0000 7fc103fe29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.867+0000 7fc103fe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.867+0000 7fc103fe29c0 20 realm 2024-09-12T00:43:48.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.867+0000 7fc103fe29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.867+0000 7fc103fe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.867+0000 7fc103fe29c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:48.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.867+0000 7fc103fe29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.871+0000 7fc103fe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:48.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.871+0000 7fc103fe29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.871+0000 7fc103fe29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:48.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.871+0000 7fc103fe29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:48.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.871+0000 7fc103fe29c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:48.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.871+0000 7fc103fe29c0 20 searching for the correct realm 2024-09-12T00:43:48.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:48.875+0000 7fc1022e9640 0 -- 172.21.15.138:0/1555896607 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fc0fc018920 msgr2=0x7fc0fc040400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:49.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.091+0000 7fc1022e9640 0 -- 172.21.15.138:0/1555896607 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x564763c4a180 msgr2=0x564763c4c640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:49.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.099+0000 7fc103fe29c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:49.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.099+0000 7fc103fe29c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:49.099 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.099+0000 7fc103fe29c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:49.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.099+0000 7fc103fe29c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:49.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.099+0000 7fc103fe29c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:49.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.099+0000 7fc103fe29c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:49.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.099+0000 7fc103fe29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.103+0000 7fc103fe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.103+0000 7fc103fe29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.103+0000 7fc103fe29c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.101 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.103+0000 7fc103fe29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.103+0000 7fc103fe29c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.103+0000 7fc103fe29c0 20 zone default found 2024-09-12T00:43:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.103+0000 7fc103fe29c0 4 Realm: () 2024-09-12T00:43:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.103+0000 7fc103fe29c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.103+0000 7fc103fe29c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.103+0000 7fc103fe29c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.103+0000 7fc103fe29c0 20 zonegroup default 2024-09-12T00:43:49.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.103+0000 7fc103fe29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.103+0000 7fc103fe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.103+0000 7fc103fe29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.103+0000 7fc103fe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.103+0000 7fc103fe29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.107+0000 7fc103fe29c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.107+0000 7fc103fe29c0 20 started sync module instance, tier type = 2024-09-12T00:43:49.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.107+0000 7fc103fe29c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:49.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.127+0000 7fc103fe29c0 20 add_watcher() i=0 2024-09-12T00:43:49.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.127+0000 7fc103fe29c0 20 add_watcher() i=1 2024-09-12T00:43:49.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.127+0000 7fc103fe29c0 20 add_watcher() i=2 2024-09-12T00:43:49.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.127+0000 7fc103fe29c0 20 add_watcher() i=3 2024-09-12T00:43:49.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.127+0000 7fc103fe29c0 20 add_watcher() i=4 2024-09-12T00:43:49.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.127+0000 7fc103fe29c0 20 add_watcher() i=5 2024-09-12T00:43:49.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.127+0000 7fc103fe29c0 20 add_watcher() i=6 2024-09-12T00:43:49.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.135+0000 7fc103fe29c0 20 add_watcher() i=7 2024-09-12T00:43:49.128 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.135+0000 7fc103fe29c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:49.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.135+0000 7fbfb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:49.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.135+0000 7fc103fe29c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:49.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.135+0000 7fc103fe29c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:49.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.135+0000 7fc103fe29c0 5 note: GC not initialized 2024-09-12T00:43:49.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.135+0000 7fbfb27fc640 20 reqs_thread_entry: start 2024-09-12T00:43:49.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.135+0000 7fc103fe29c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:49.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.135+0000 7fc103fe29c0 20 Filter name: none 2024-09-12T00:43:49.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.135+0000 7fbf23fff640 20 reqs_thread_entry: start 2024-09-12T00:43:49.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.135+0000 7fc103fe29c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T00:43:49.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.135+0000 7fc103fe29c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.135+0000 7fc103fe29c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:43:49.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.135+0000 7fc103fe29c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T00:43:49.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.135+0000 7fc103fe29c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:43:49.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.135+0000 7fc103fe29c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:49.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.139+0000 7fc103fe29c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:43:49.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.139+0000 7fc103fe29c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:43:49.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.139+0000 7fc103fe29c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T00:43:49.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.139+0000 7fbfe57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1146756268292 cookie 94864616511856 notifier 8525 bl.length()=659 2024-09-12T00:43:49.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.139+0000 7fbfe57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:43:49.139 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.139+0000 7fbfe57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:43:49.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.143+0000 7fbfb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:49.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.147+0000 7fc103fe29c0 20 remove_watcher() i=0 2024-09-12T00:43:49.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.147+0000 7fc103fe29c0 2 removed watcher, disabling cache 2024-09-12T00:43:49.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.147+0000 7fc103fe29c0 20 remove_watcher() i=1 2024-09-12T00:43:49.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.151+0000 7fc103fe29c0 20 remove_watcher() i=2 2024-09-12T00:43:49.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.155+0000 7fc103fe29c0 20 remove_watcher() i=3 2024-09-12T00:43:49.154 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.155+0000 7fc103fe29c0 20 remove_watcher() i=4 2024-09-12T00:43:49.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.159+0000 7fc103fe29c0 20 remove_watcher() i=5 2024-09-12T00:43:49.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.159+0000 7fc103fe29c0 20 remove_watcher() i=6 2024-09-12T00:43:49.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.163+0000 7fc103fe29c0 20 remove_watcher() i=7 2024-09-12T00:43:49.177 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-12T00:43:49.214 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:49.215 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:49.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.275+0000 7f317d2c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.279+0000 7f317d2c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.279+0000 7f317d2c99c0 20 realm 2024-09-12T00:43:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.279+0000 7f317d2c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.279+0000 7f317d2c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.278 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.279+0000 7f317d2c99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:49.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.279+0000 7f317d2c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.279+0000 7f317d2c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.279+0000 7f317d2c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.279+0000 7f317d2c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.279+0000 7f317d2c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.279+0000 7f317d2c99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:49.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.279+0000 7f317d2c99c0 20 searching for the correct realm 2024-09-12T00:43:49.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.291+0000 7f317b5d0640 0 -- 172.21.15.138:0/676645066 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55f6c1317020 msgr2=0x55f6c13194e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:49.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.319+0000 7f3173fff640 0 -- 172.21.15.138:0/676645066 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55f6c1312260 msgr2=0x55f6c1314670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:49.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:49.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:49.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:49.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:49.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:49.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:49.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 zone default found 2024-09-12T00:43:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 4 Realm: () 2024-09-12T00:43:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 zonegroup default 2024-09-12T00:43:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.323+0000 7f317d2c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.327+0000 7f317d2c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.327+0000 7f317d2c99c0 20 started sync module instance, tier type = 2024-09-12T00:43:49.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.327+0000 7f317d2c99c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:49.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.343+0000 7f317d2c99c0 20 add_watcher() i=0 2024-09-12T00:43:49.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.343+0000 7f317d2c99c0 20 add_watcher() i=1 2024-09-12T00:43:49.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.343+0000 7f317d2c99c0 20 add_watcher() i=2 2024-09-12T00:43:49.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.343+0000 7f317d2c99c0 20 add_watcher() i=3 2024-09-12T00:43:49.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.343+0000 7f317d2c99c0 20 add_watcher() i=4 2024-09-12T00:43:49.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.343+0000 7f317d2c99c0 20 add_watcher() i=5 2024-09-12T00:43:49.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.343+0000 7f317d2c99c0 20 add_watcher() i=6 2024-09-12T00:43:49.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.347+0000 7f317d2c99c0 20 add_watcher() i=7 2024-09-12T00:43:49.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.347+0000 7f317d2c99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:49.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f30317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:49.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f317d2c99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:49.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f317d2c99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:49.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f317d2c99c0 5 note: GC not initialized 2024-09-12T00:43:49.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f2fabfff640 20 reqs_thread_entry: start 2024-09-12T00:43:49.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f317d2c99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:49.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f317d2c99c0 20 Filter name: none 2024-09-12T00:43:49.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f2fa9ffb640 20 reqs_thread_entry: start 2024-09-12T00:43:49.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f317d2c99c0 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-12T00:43:49.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f317d2c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f317d2c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f317d2c99c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-12T00:43:49.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f317d2c99c0 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T00:43:49.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f317d2c99c0 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-12T00:43:49.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f317d2c99c0 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-12T00:43:49.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f317d2c99c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f317d2c99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f317d2c99c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-12T00:43:49.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f317d2c99c0 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T00:43:49.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.351+0000 7f317d2c99c0 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-12T00:43:49.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.355+0000 7f317d2c99c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T00:43:49.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.355+0000 7f317d2c99c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T00:43:49.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.355+0000 7f317d2c99c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-12T00:43:49.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.355+0000 7f305e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235589 cookie 94518291560560 notifier 9165 bl.length()=389 2024-09-12T00:43:49.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.355+0000 7f305e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T00:43:49.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.355+0000 7f305e7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T00:43:49.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.359+0000 7f317d2c99c0 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T00:43:49.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.359+0000 7f317d2c99c0 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T00:43:49.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.359+0000 7f317d2c99c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-12T00:43:49.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.359+0000 7f305dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235590 cookie 94518291571008 notifier 9165 bl.length()=230 2024-09-12T00:43:49.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.359+0000 7f305dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T00:43:49.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.359+0000 7f305dffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T00:43:49.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.359+0000 7f317d2c99c0 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T00:43:49.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.359+0000 7f317d2c99c0 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T00:43:49.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.359+0000 7f317d2c99c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-12T00:43:49.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.359+0000 7f305dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235429 cookie 94518291567696 notifier 9165 bl.length()=234 2024-09-12T00:43:49.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.359+0000 7f305dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T00:43:49.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.359+0000 7f305dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T00:43:49.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.363+0000 7f30317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:49.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.367+0000 7f317d2c99c0 20 remove_watcher() i=0 2024-09-12T00:43:49.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.367+0000 7f317d2c99c0 2 removed watcher, disabling cache 2024-09-12T00:43:49.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.367+0000 7f317d2c99c0 20 remove_watcher() i=1 2024-09-12T00:43:49.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.371+0000 7f317d2c99c0 20 remove_watcher() i=2 2024-09-12T00:43:49.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.371+0000 7f317d2c99c0 20 remove_watcher() i=3 2024-09-12T00:43:49.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.375+0000 7f317d2c99c0 20 remove_watcher() i=4 2024-09-12T00:43:49.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.375+0000 7f317d2c99c0 20 remove_watcher() i=5 2024-09-12T00:43:49.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.379+0000 7f317d2c99c0 20 remove_watcher() i=6 2024-09-12T00:43:49.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.383+0000 7f317d2c99c0 20 remove_watcher() i=7 2024-09-12T00:43:49.393 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T00:43:49.393 INFO:teuthology.orchestra.run.smithi138.stdout: "id": "RGW33333333333333333", 2024-09-12T00:43:49.393 INFO:teuthology.orchestra.run.smithi138.stdout: "tenant": "testx", 2024-09-12T00:43:49.393 INFO:teuthology.orchestra.run.smithi138.stdout: "name": "Mr.RGW33333333333333333", 2024-09-12T00:43:49.393 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-12T00:43:49.393 INFO:teuthology.orchestra.run.smithi138.stdout: "quota": { 2024-09-12T00:43:49.393 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:49.393 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:49.393 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:49.393 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:49.394 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:49.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:49.394 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-12T00:43:49.394 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:49.394 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:49.394 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:49.394 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:49.394 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:49.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:49.394 INFO:teuthology.orchestra.run.smithi138.stdout: "max_users": 1000, 2024-09-12T00:43:49.394 INFO:teuthology.orchestra.run.smithi138.stdout: "max_roles": 1000, 2024-09-12T00:43:49.394 INFO:teuthology.orchestra.run.smithi138.stdout: "max_groups": 1000, 2024-09-12T00:43:49.394 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-12T00:43:49.395 INFO:teuthology.orchestra.run.smithi138.stdout: "max_access_keys": 4 2024-09-12T00:43:49.395 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T00:43:49.396 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-12T00:43:49.396 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key NTZJTVLVYYZZYWUQQMZZ --secret zOgc5hX6sGD7cTDRAqL9gtI65C30H7sBeOd+dMVssUgbFzSIFJocbA== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-12T00:43:49.488 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:49.488 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:49.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.531+0000 7f6ada7e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.531+0000 7f6ada7e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.531+0000 7f6ada7e39c0 20 realm 2024-09-12T00:43:49.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.531+0000 7f6ada7e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.531+0000 7f6ada7e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.531+0000 7f6ada7e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:49.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.531+0000 7f6ada7e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.531+0000 7f6ada7e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.531+0000 7f6ada7e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.535+0000 7f6ada7e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.535+0000 7f6ada7e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.535+0000 7f6ada7e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:49.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.535+0000 7f6ada7e39c0 20 searching for the correct realm 2024-09-12T00:43:49.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.535+0000 7f6ad82e9640 0 -- 172.21.15.138:0/882357505 >> [v2:172.21.15.138:6816/3496313381,v1:172.21.15.138:6817/3496313381] conn(0x7f6ad0010040 msgr2=0x7f6ad005f0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:49.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.543+0000 7f6ad8aea640 0 -- 172.21.15.138:0/882357505 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x564991a92b10 msgr2=0x564991a94fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:49.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:49.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:49.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:49.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:49.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:49.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:49.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:49.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 zone default found 2024-09-12T00:43:49.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 4 Realm: () 2024-09-12T00:43:49.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:49.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:49.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:49.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 zonegroup default 2024-09-12T00:43:49.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 started sync module instance, tier type = 2024-09-12T00:43:49.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.555+0000 7f6ada7e39c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:49.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.575+0000 7f6ada7e39c0 20 add_watcher() i=0 2024-09-12T00:43:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.575+0000 7f6ada7e39c0 20 add_watcher() i=1 2024-09-12T00:43:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.575+0000 7f6ada7e39c0 20 add_watcher() i=2 2024-09-12T00:43:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.575+0000 7f6ada7e39c0 20 add_watcher() i=3 2024-09-12T00:43:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.575+0000 7f6ada7e39c0 20 add_watcher() i=4 2024-09-12T00:43:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.575+0000 7f6ada7e39c0 20 add_watcher() i=5 2024-09-12T00:43:49.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.575+0000 7f6ada7e39c0 20 add_watcher() i=6 2024-09-12T00:43:49.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.575+0000 7f6ada7e39c0 20 add_watcher() i=7 2024-09-12T00:43:49.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.575+0000 7f6ada7e39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:49.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f698efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:49.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:49.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:49.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 5 note: GC not initialized 2024-09-12T00:43:49.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f698dfdb640 20 reqs_thread_entry: start 2024-09-12T00:43:49.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:49.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 20 Filter name: none 2024-09-12T00:43:49.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f68ff7fe640 20 reqs_thread_entry: start 2024-09-12T00:43:49.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T00:43:49.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T00:43:49.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:43:49.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T00:43:49.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T00:43:49.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:43:49.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 10 cache get: name=default.rgw.meta+users.keys+NTZJTVLVYYZZYWUQQMZZ : miss 2024-09-12T00:43:49.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 10 cache put: name=default.rgw.meta+users.keys+NTZJTVLVYYZZYWUQQMZZ info.flags=0x0 2024-09-12T00:43:49.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 10 adding default.rgw.meta+users.keys+NTZJTVLVYYZZYWUQQMZZ to cache LRU end 2024-09-12T00:43:49.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-12T00:43:49.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:43:49.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T00:43:49.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T00:43:49.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:49.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 10 cache get: name=default.rgw.meta+users.keys+NTZJTVLVYYZZYWUQQMZZ : hit (negative entry) 2024-09-12T00:43:49.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.583+0000 7f6ada7e39c0 10 cache get: name=default.rgw.meta+users.keys+NTZJTVLVYYZZYWUQQMZZ : hit (negative entry) 2024-09-12T00:43:49.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.587+0000 7f6ada7e39c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:43:49.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.587+0000 7f6ada7e39c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:43:49.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.587+0000 7f6ada7e39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T00:43:49.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.587+0000 7f69af7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235621 cookie 94873976462752 notifier 9183 bl.length()=732 2024-09-12T00:43:49.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.587+0000 7f69af7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:43:49.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.587+0000 7f69af7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:43:49.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.591+0000 7f6ada7e39c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T00:43:49.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.591+0000 7f6ada7e39c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:43:49.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.591+0000 7f6ada7e39c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T00:43:49.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.591+0000 7f69aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235622 cookie 94873976460208 notifier 9183 bl.length()=215 2024-09-12T00:43:49.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.591+0000 7f69aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T00:43:49.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.591+0000 7f69aeffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:43:49.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.595+0000 7f6ada7e39c0 10 cache put: name=default.rgw.meta+users.keys+NTZJTVLVYYZZYWUQQMZZ info.flags=0x7 2024-09-12T00:43:49.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.595+0000 7f6ada7e39c0 10 moving default.rgw.meta+users.keys+NTZJTVLVYYZZYWUQQMZZ to cache LRU end 2024-09-12T00:43:49.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.595+0000 7f6ada7e39c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NTZJTVLVYYZZYWUQQMZZ, ofs0, ns] 2024-09-12T00:43:49.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.595+0000 7f69af7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235623 cookie 94873976462752 notifier 9183 bl.length()=201 2024-09-12T00:43:49.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.595+0000 7f69af7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NTZJTVLVYYZZYWUQQMZZ info.flags=0x7 2024-09-12T00:43:49.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.595+0000 7f69af7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NTZJTVLVYYZZYWUQQMZZ to cache LRU end 2024-09-12T00:43:49.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.607+0000 7f6ada7e39c0 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-12T00:43:49.600 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T00:43:49.601 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T00:43:49.601 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-12T00:43:49.601 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T00:43:49.601 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-12T00:43:49.601 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-12T00:43:49.601 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-12T00:43:49.601 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-12T00:43:49.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-12T00:43:49.601 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T00:43:49.601 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "NTZJTVLVYYZZYWUQQMZZ", 2024-09-12T00:43:49.601 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "zOgc5hX6sGD7cTDRAqL9gtI65C30H7sBeOd+dMVssUgbFzSIFJocbA==", 2024-09-12T00:43:49.601 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:43:49.589186Z" 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:49.602 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:49.603 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:49.603 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:49.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:49.603 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-12T00:43:49.603 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:49.603 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:49.603 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:49.603 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:49.603 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:49.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:49.603 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-12T00:43:49.603 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "root", 2024-09-12T00:43:49.603 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-12T00:43:49.604 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "RGW33333333333333333", 2024-09-12T00:43:49.604 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-12T00:43:49.604 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:43:49.589169Z", 2024-09-12T00:43:49.604 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-12T00:43:49.604 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-12T00:43:49.604 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T00:43:49.604 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:49.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.607+0000 7f698efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:49.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.607+0000 7f6ada7e39c0 20 remove_watcher() i=0 2024-09-12T00:43:49.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.607+0000 7f6ada7e39c0 2 removed watcher, disabling cache 2024-09-12T00:43:49.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.607+0000 7f6ada7e39c0 20 remove_watcher() i=1 2024-09-12T00:43:49.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.611+0000 7f6ada7e39c0 20 remove_watcher() i=2 2024-09-12T00:43:49.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.615+0000 7f6ada7e39c0 20 remove_watcher() i=3 2024-09-12T00:43:49.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.615+0000 7f6ada7e39c0 20 remove_watcher() i=4 2024-09-12T00:43:49.616 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.619+0000 7f6ada7e39c0 20 remove_watcher() i=5 2024-09-12T00:43:49.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.619+0000 7f6ada7e39c0 20 remove_watcher() i=6 2024-09-12T00:43:49.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.623+0000 7f6ada7e39c0 20 remove_watcher() i=7 2024-09-12T00:43:49.638 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 0441380250 --totp-seed T2N2AJ5XBBZDPARXAOCTUK7VNGMLXSC2TIGCD3TXEOQGB7JYYX54BRMNWFY4KVY4 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:43:49.679 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:49.680 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:49.720 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.723+0000 7f608041e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.723+0000 7f608041e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.723+0000 7f608041e9c0 20 realm 2024-09-12T00:43:49.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.723+0000 7f608041e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.723+0000 7f608041e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.723+0000 7f608041e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:49.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.723+0000 7f608041e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.723+0000 7f608041e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.723+0000 7f608041e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.727+0000 7f608041e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.727+0000 7f608041e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.727+0000 7f608041e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:49.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.727+0000 7f608041e9c0 20 searching for the correct realm 2024-09-12T00:43:49.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.731+0000 7f607e725640 0 -- 172.21.15.138:0/2299929611 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x560c41794c10 msgr2=0x560c417970d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:49.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.739+0000 7f607d723640 0 -- 172.21.15.138:0/2299929611 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x560c4178ff10 msgr2=0x560c41792300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:49.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.743+0000 7f608041e9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:49.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.743+0000 7f608041e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:49.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.743+0000 7f608041e9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:49.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.743+0000 7f608041e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:49.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.743+0000 7f608041e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:49.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.743+0000 7f608041e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:49.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.743+0000 7f608041e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:49.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 20 zone default found 2024-09-12T00:43:49.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 4 Realm: () 2024-09-12T00:43:49.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:49.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:49.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:49.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 20 zonegroup default 2024-09-12T00:43:49.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 20 started sync module instance, tier type = 2024-09-12T00:43:49.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.747+0000 7f608041e9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:49.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.767+0000 7f608041e9c0 20 add_watcher() i=0 2024-09-12T00:43:49.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.767+0000 7f608041e9c0 20 add_watcher() i=1 2024-09-12T00:43:49.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.767+0000 7f608041e9c0 20 add_watcher() i=2 2024-09-12T00:43:49.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.767+0000 7f608041e9c0 20 add_watcher() i=3 2024-09-12T00:43:49.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.767+0000 7f608041e9c0 20 add_watcher() i=4 2024-09-12T00:43:49.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.767+0000 7f608041e9c0 20 add_watcher() i=5 2024-09-12T00:43:49.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.767+0000 7f608041e9c0 20 add_watcher() i=6 2024-09-12T00:43:49.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.767+0000 7f608041e9c0 20 add_watcher() i=7 2024-09-12T00:43:49.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.767+0000 7f608041e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:49.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.771+0000 7f5f2f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:49.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.771+0000 7f608041e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:49.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.771+0000 7f608041e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:49.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.771+0000 7f608041e9c0 5 note: GC not initialized 2024-09-12T00:43:49.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.771+0000 7f5f2e7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:49.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.771+0000 7f608041e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:49.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.771+0000 7f608041e9c0 20 Filter name: none 2024-09-12T00:43:49.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.775+0000 7f5e9ffff640 20 reqs_thread_entry: start 2024-09-12T00:43:49.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.775+0000 7f608041e9c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T00:43:49.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.775+0000 7f608041e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.775+0000 7f608041e9c0 20 rados_obj.operate() r=0 bl.length=532 2024-09-12T00:43:49.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.775+0000 7f608041e9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T00:43:49.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.775+0000 7f608041e9c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:43:49.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.775+0000 7f608041e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:49.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.779+0000 7f608041e9c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:43:49.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.779+0000 7f608041e9c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:43:49.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.779+0000 7f608041e9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T00:43:49.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.783+0000 7f5f617fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235624 cookie 94610638080688 notifier 8576 bl.length()=746 2024-09-12T00:43:49.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.783+0000 7f5f617fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:43:49.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.783+0000 7f5f617fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:43:49.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.783+0000 7f5f2f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:49.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.787+0000 7f608041e9c0 20 remove_watcher() i=0 2024-09-12T00:43:49.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.787+0000 7f608041e9c0 2 removed watcher, disabling cache 2024-09-12T00:43:49.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.791+0000 7f608041e9c0 20 remove_watcher() i=1 2024-09-12T00:43:49.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.791+0000 7f608041e9c0 20 remove_watcher() i=2 2024-09-12T00:43:49.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.795+0000 7f608041e9c0 20 remove_watcher() i=3 2024-09-12T00:43:49.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.795+0000 7f608041e9c0 20 remove_watcher() i=4 2024-09-12T00:43:49.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.799+0000 7f608041e9c0 20 remove_watcher() i=5 2024-09-12T00:43:49.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.799+0000 7f608041e9c0 20 remove_watcher() i=6 2024-09-12T00:43:49.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.803+0000 7f608041e9c0 20 remove_watcher() i=7 2024-09-12T00:43:49.817 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T00:43:49.817 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key NJGTOVKUYBZFPIARALZL --secret b+nQm9yAaiqXFZ2L9ljNw5yd5RPSQtoGCNndQ0kz6xbq8qAvrgzVpw== --cluster ceph 2024-09-12T00:43:49.903 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:49.904 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:49.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.943+0000 7f61c79399c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.947+0000 7f61c79399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.947+0000 7f61c79399c0 20 realm 2024-09-12T00:43:49.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.947+0000 7f61c79399c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.947+0000 7f61c79399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.947+0000 7f61c79399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:49.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.947+0000 7f61c79399c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.947+0000 7f61c79399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:49.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.947+0000 7f61c79399c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.951+0000 7f61c79399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:49.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.951+0000 7f61c79399c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.951+0000 7f61c79399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:49.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.951+0000 7f61c79399c0 20 searching for the correct realm 2024-09-12T00:43:49.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:49.955+0000 7f61c5c40640 0 -- 172.21.15.138:0/1387152736 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f61b801f070 msgr2=0x7f61b802c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:50.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.175+0000 7f61c5c40640 0 -- 172.21.15.138:0/1387152736 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x559329faf650 msgr2=0x559329fb1b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:50.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:50.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:50.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:50.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:50.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:50.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:50.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:50.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:50.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 20 zone default found 2024-09-12T00:43:50.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 4 Realm: () 2024-09-12T00:43:50.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:50.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:50.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:50.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 20 zonegroup default 2024-09-12T00:43:50.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.183+0000 7f61c79399c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.187+0000 7f61c79399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.187+0000 7f61c79399c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.187+0000 7f61c79399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.187+0000 7f61c79399c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.187+0000 7f61c79399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.187+0000 7f61c79399c0 20 started sync module instance, tier type = 2024-09-12T00:43:50.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.187+0000 7f61c79399c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:50.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.211+0000 7f61c79399c0 20 add_watcher() i=0 2024-09-12T00:43:50.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.211+0000 7f61c79399c0 20 add_watcher() i=1 2024-09-12T00:43:50.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.211+0000 7f61c79399c0 20 add_watcher() i=2 2024-09-12T00:43:50.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.211+0000 7f61c79399c0 20 add_watcher() i=3 2024-09-12T00:43:50.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.211+0000 7f61c79399c0 20 add_watcher() i=4 2024-09-12T00:43:50.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.211+0000 7f61c79399c0 20 add_watcher() i=5 2024-09-12T00:43:50.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.211+0000 7f61c79399c0 20 add_watcher() i=6 2024-09-12T00:43:50.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.215+0000 7f61c79399c0 20 add_watcher() i=7 2024-09-12T00:43:50.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.215+0000 7f61c79399c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:50.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f607b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:50.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f61c79399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:50.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f61c79399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:50.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f61c79399c0 5 note: GC not initialized 2024-09-12T00:43:50.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f607a7e4640 20 reqs_thread_entry: start 2024-09-12T00:43:50.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f61c79399c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:50.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f61c79399c0 20 Filter name: none 2024-09-12T00:43:50.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f5febfff640 20 reqs_thread_entry: start 2024-09-12T00:43:50.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f61c79399c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:43:50.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f61c79399c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f61c79399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f61c79399c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T00:43:50.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f61c79399c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:43:50.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f61c79399c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T00:43:50.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f61c79399c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f61c79399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f61c79399c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T00:43:50.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f61c79399c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:43:50.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f61c79399c0 10 cache get: name=default.rgw.meta+users.keys+NJGTOVKUYBZFPIARALZL : miss 2024-09-12T00:43:50.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.219+0000 7f61c79399c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.223+0000 7f61c79399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.223+0000 7f61c79399c0 10 cache put: name=default.rgw.meta+users.keys+NJGTOVKUYBZFPIARALZL info.flags=0x0 2024-09-12T00:43:50.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.223+0000 7f61c79399c0 10 adding default.rgw.meta+users.keys+NJGTOVKUYBZFPIARALZL to cache LRU end 2024-09-12T00:43:50.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.223+0000 7f61c79399c0 10 cache get: name=default.rgw.meta+users.keys+NJGTOVKUYBZFPIARALZL : hit (negative entry) 2024-09-12T00:43:50.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.223+0000 7f61c79399c0 10 cache get: name=default.rgw.meta+users.keys+NJGTOVKUYBZFPIARALZL : hit (negative entry) 2024-09-12T00:43:50.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.227+0000 7f61c79399c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:43:50.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.227+0000 7f61c79399c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:43:50.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.227+0000 7f61c79399c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:43:50.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.227+0000 7f60a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235625 cookie 94090552894896 notifier 9219 bl.length()=660 2024-09-12T00:43:50.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.227+0000 7f60a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:43:50.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.227+0000 7f60a8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:43:50.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.227+0000 7f61c79399c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T00:43:50.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.227+0000 7f61c79399c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:43:50.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.227+0000 7f61c79399c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T00:43:50.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.231+0000 7f6097fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235591 cookie 94090552873360 notifier 9219 bl.length()=191 2024-09-12T00:43:50.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.231+0000 7f6097fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T00:43:50.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.231+0000 7f6097fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:43:50.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.231+0000 7f61c79399c0 10 cache put: name=default.rgw.meta+users.keys+NJGTOVKUYBZFPIARALZL info.flags=0x7 2024-09-12T00:43:50.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.231+0000 7f61c79399c0 10 moving default.rgw.meta+users.keys+NJGTOVKUYBZFPIARALZL to cache LRU end 2024-09-12T00:43:50.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.231+0000 7f61c79399c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NJGTOVKUYBZFPIARALZL, ofs0, ns] 2024-09-12T00:43:50.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.231+0000 7f60a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235626 cookie 94090552879472 notifier 9219 bl.length()=189 2024-09-12T00:43:50.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.231+0000 7f60a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NJGTOVKUYBZFPIARALZL info.flags=0x7 2024-09-12T00:43:50.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.231+0000 7f60a8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NJGTOVKUYBZFPIARALZL to cache LRU end 2024-09-12T00:43:50.228 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T00:43:50.228 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "foobar.client.0", 2024-09-12T00:43:50.229 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T00:43:50.229 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "foobar+test@test.test", 2024-09-12T00:43:50.229 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-12T00:43:50.229 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-12T00:43:50.229 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-12T00:43:50.229 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-12T00:43:50.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-12T00:43:50.230 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "foobar.client.0", 2024-09-12T00:43:50.230 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "NJGTOVKUYBZFPIARALZL", 2024-09-12T00:43:50.230 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "b+nQm9yAaiqXFZ2L9ljNw5yd5RPSQtoGCNndQ0kz6xbq8qAvrgzVpw==", 2024-09-12T00:43:50.230 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-12T00:43:50.230 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:43:50.223931Z" 2024-09-12T00:43:50.231 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-12T00:43:50.231 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-12T00:43:50.231 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-12T00:43:50.231 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-12T00:43:50.231 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-12T00:43:50.231 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-12T00:43:50.232 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-12T00:43:50.232 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-12T00:43:50.232 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-12T00:43:50.232 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:50.232 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:50.232 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:50.233 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:50.233 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:50.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:50.233 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-12T00:43:50.233 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:50.233 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:50.233 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:50.233 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:50.233 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:50.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:50.233 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-12T00:43:50.233 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "rgw", 2024-09-12T00:43:50.234 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-12T00:43:50.234 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "", 2024-09-12T00:43:50.234 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-12T00:43:50.234 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:43:50.223897Z", 2024-09-12T00:43:50.234 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-12T00:43:50.234 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-12T00:43:50.234 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T00:43:50.234 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:50.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.235+0000 7f607b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:50.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.239+0000 7f61c79399c0 20 remove_watcher() i=0 2024-09-12T00:43:50.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.239+0000 7f61c79399c0 2 removed watcher, disabling cache 2024-09-12T00:43:50.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.243+0000 7f61c79399c0 20 remove_watcher() i=1 2024-09-12T00:43:50.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.243+0000 7f61c79399c0 20 remove_watcher() i=2 2024-09-12T00:43:50.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.247+0000 7f61c79399c0 20 remove_watcher() i=3 2024-09-12T00:43:50.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.251+0000 7f61c79399c0 20 remove_watcher() i=4 2024-09-12T00:43:50.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.251+0000 7f61c79399c0 20 remove_watcher() i=5 2024-09-12T00:43:50.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.255+0000 7f61c79399c0 20 remove_watcher() i=6 2024-09-12T00:43:50.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.259+0000 7f61c79399c0 20 remove_watcher() i=7 2024-09-12T00:43:50.270 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 4791406709 --totp-seed 277MRXO2QGS2QZLQ4QSNXYONXP44M6BFHQHBT37577JJHXGLYPWKUSWKYWZZA5IH --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:43:50.359 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:50.360 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:50.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.407+0000 7fea2c79a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.407+0000 7fea2c79a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.407+0000 7fea2c79a9c0 20 realm 2024-09-12T00:43:50.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.407+0000 7fea2c79a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.407+0000 7fea2c79a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.407+0000 7fea2c79a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:50.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.407+0000 7fea2c79a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.407+0000 7fea2c79a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.407+0000 7fea2c79a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.407+0000 7fea2c79a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:50.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.407+0000 7fea2c79a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.411+0000 7fea2c79a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:50.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.411+0000 7fea2c79a9c0 20 searching for the correct realm 2024-09-12T00:43:50.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.415+0000 7fea2aaa1640 0 -- 172.21.15.138:0/1098845229 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fea24025940 msgr2=0x7fea24008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:50.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.631+0000 7fea2aaa1640 0 -- 172.21.15.138:0/1098845229 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x562b67eea570 msgr2=0x562b67eeca30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:50.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.639+0000 7fea2c79a9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:50.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.639+0000 7fea2c79a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:50.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.639+0000 7fea2c79a9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:50.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.639+0000 7fea2c79a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:50.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.639+0000 7fea2c79a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:50.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.639+0000 7fea2c79a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:50.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.639+0000 7fea2c79a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.643+0000 7fea2c79a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.643+0000 7fea2c79a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.643+0000 7fea2c79a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:50.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.643+0000 7fea2c79a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.643+0000 7fea2c79a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:50.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.643+0000 7fea2c79a9c0 20 zone default found 2024-09-12T00:43:50.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.643+0000 7fea2c79a9c0 4 Realm: () 2024-09-12T00:43:50.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.643+0000 7fea2c79a9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:50.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.643+0000 7fea2c79a9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:50.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.643+0000 7fea2c79a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:50.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.643+0000 7fea2c79a9c0 20 zonegroup default 2024-09-12T00:43:50.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.643+0000 7fea2c79a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.643+0000 7fea2c79a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.643+0000 7fea2c79a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.643+0000 7fea2c79a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.643+0000 7fea2c79a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.647+0000 7fea2c79a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.647+0000 7fea2c79a9c0 20 started sync module instance, tier type = 2024-09-12T00:43:50.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.647+0000 7fea2c79a9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:50.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.667+0000 7fea2c79a9c0 20 add_watcher() i=0 2024-09-12T00:43:50.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.667+0000 7fea2c79a9c0 20 add_watcher() i=1 2024-09-12T00:43:50.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.667+0000 7fea2c79a9c0 20 add_watcher() i=2 2024-09-12T00:43:50.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.667+0000 7fea2c79a9c0 20 add_watcher() i=3 2024-09-12T00:43:50.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.667+0000 7fea2c79a9c0 20 add_watcher() i=4 2024-09-12T00:43:50.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.667+0000 7fea2c79a9c0 20 add_watcher() i=5 2024-09-12T00:43:50.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.667+0000 7fea2c79a9c0 20 add_watcher() i=6 2024-09-12T00:43:50.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.671+0000 7fea2c79a9c0 20 add_watcher() i=7 2024-09-12T00:43:50.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.671+0000 7fea2c79a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:50.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.675+0000 7fe8e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:50.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.675+0000 7fea2c79a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:50.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.675+0000 7fea2c79a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:50.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.675+0000 7fea2c79a9c0 5 note: GC not initialized 2024-09-12T00:43:50.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.675+0000 7fe85b7fe640 20 reqs_thread_entry: start 2024-09-12T00:43:50.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.675+0000 7fea2c79a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:50.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.675+0000 7fea2c79a9c0 20 Filter name: none 2024-09-12T00:43:50.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.675+0000 7fe8597fa640 20 reqs_thread_entry: start 2024-09-12T00:43:50.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.675+0000 7fea2c79a9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:43:50.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.675+0000 7fea2c79a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.679+0000 7fea2c79a9c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T00:43:50.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.679+0000 7fea2c79a9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T00:43:50.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.679+0000 7fea2c79a9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:43:50.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.679+0000 7fea2c79a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:50.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.683+0000 7fea2c79a9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:43:50.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.683+0000 7fea2c79a9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:43:50.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.683+0000 7fea2c79a9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:43:50.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.683+0000 7fe90dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235627 cookie 94744427305760 notifier 9234 bl.length()=674 2024-09-12T00:43:50.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.683+0000 7fe90dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:43:50.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.683+0000 7fe90dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:43:50.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.687+0000 7fe8e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:50.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.691+0000 7fea2c79a9c0 20 remove_watcher() i=0 2024-09-12T00:43:50.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.691+0000 7fea2c79a9c0 2 removed watcher, disabling cache 2024-09-12T00:43:50.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.695+0000 7fea2c79a9c0 20 remove_watcher() i=1 2024-09-12T00:43:50.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.695+0000 7fea2c79a9c0 20 remove_watcher() i=2 2024-09-12T00:43:50.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.699+0000 7fea2c79a9c0 20 remove_watcher() i=3 2024-09-12T00:43:50.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.699+0000 7fea2c79a9c0 20 remove_watcher() i=4 2024-09-12T00:43:50.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.703+0000 7fea2c79a9c0 20 remove_watcher() i=5 2024-09-12T00:43:50.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.703+0000 7fea2c79a9c0 20 remove_watcher() i=6 2024-09-12T00:43:50.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.707+0000 7fea2c79a9c0 20 remove_watcher() i=7 2024-09-12T00:43:50.718 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T00:43:50.755 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:50.755 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:50.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.799+0000 7fb6c3b5d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.803+0000 7fb6c3b5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.803+0000 7fb6c3b5d9c0 20 realm 2024-09-12T00:43:50.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.803+0000 7fb6c3b5d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.803+0000 7fb6c3b5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.803+0000 7fb6c3b5d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:50.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.803+0000 7fb6c3b5d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.803+0000 7fb6c3b5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:50.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.803+0000 7fb6c3b5d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.807+0000 7fb6c3b5d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:50.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.807+0000 7fb6c3b5d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:50.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.807+0000 7fb6c3b5d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:50.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.807+0000 7fb6c3b5d9c0 20 searching for the correct realm 2024-09-12T00:43:50.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:50.811+0000 7fb6c1e64640 0 -- 172.21.15.138:0/2894430485 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fb6bc0aa3d0 msgr2=0x7fb6bc0aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:43:51.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.027+0000 7fb6c1e64640 0 -- 172.21.15.138:0/2894430485 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55722382aae0 msgr2=0x55722382cfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:51.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:51.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:51.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:51.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:51.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:51.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:51.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:51.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:51.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 20 zone default found 2024-09-12T00:43:51.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 4 Realm: () 2024-09-12T00:43:51.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:51.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:51.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:51.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 20 zonegroup default 2024-09-12T00:43:51.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.039+0000 7fb6c3b5d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.043+0000 7fb6c3b5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.043+0000 7fb6c3b5d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.043+0000 7fb6c3b5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.043+0000 7fb6c3b5d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.043+0000 7fb6c3b5d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.043+0000 7fb6c3b5d9c0 20 started sync module instance, tier type = 2024-09-12T00:43:51.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.043+0000 7fb6c3b5d9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.067+0000 7fb6c3b5d9c0 20 add_watcher() i=0 2024-09-12T00:43:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.067+0000 7fb6c3b5d9c0 20 add_watcher() i=1 2024-09-12T00:43:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.067+0000 7fb6c3b5d9c0 20 add_watcher() i=2 2024-09-12T00:43:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.067+0000 7fb6c3b5d9c0 20 add_watcher() i=3 2024-09-12T00:43:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.067+0000 7fb6c3b5d9c0 20 add_watcher() i=4 2024-09-12T00:43:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.067+0000 7fb6c3b5d9c0 20 add_watcher() i=5 2024-09-12T00:43:51.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.067+0000 7fb6c3b5d9c0 20 add_watcher() i=6 2024-09-12T00:43:51.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.067+0000 7fb6c3b5d9c0 20 add_watcher() i=7 2024-09-12T00:43:51.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.067+0000 7fb6c3b5d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.071+0000 7fb5777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.071+0000 7fb6c3b5d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.071+0000 7fb6c3b5d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:51.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.071+0000 7fb6c3b5d9c0 5 note: GC not initialized 2024-09-12T00:43:51.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.075+0000 7fb5767e4640 20 reqs_thread_entry: start 2024-09-12T00:43:51.068 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.075+0000 7fb6c3b5d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:51.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.075+0000 7fb6c3b5d9c0 20 Filter name: none 2024-09-12T00:43:51.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.075+0000 7fb4e7fff640 20 reqs_thread_entry: start 2024-09-12T00:43:51.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.075+0000 7fb6c3b5d9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:43:51.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.075+0000 7fb6c3b5d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.075+0000 7fb6c3b5d9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:43:51.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.075+0000 7fb6c3b5d9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T00:43:51.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.075+0000 7fb6c3b5d9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:43:51.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.075+0000 7fb6c3b5d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:51.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.079+0000 7fb6c3b5d9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:43:51.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.079+0000 7fb6c3b5d9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:43:51.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.079+0000 7fb6c3b5d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:43:51.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.079+0000 7fb5a4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235628 cookie 93948710425952 notifier 9255 bl.length()=727 2024-09-12T00:43:51.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.079+0000 7fb5a4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:43:51.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.079+0000 7fb5a4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:43:51.076 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T00:43:51.076 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "foobar.client.0", 2024-09-12T00:43:51.076 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T00:43:51.076 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "foobar+test@test.test", 2024-09-12T00:43:51.076 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-12T00:43:51.077 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-12T00:43:51.077 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-12T00:43:51.077 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-12T00:43:51.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-12T00:43:51.077 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "foobar.client.0", 2024-09-12T00:43:51.077 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "NJGTOVKUYBZFPIARALZL", 2024-09-12T00:43:51.077 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "b+nQm9yAaiqXFZ2L9ljNw5yd5RPSQtoGCNndQ0kz6xbq8qAvrgzVpw==", 2024-09-12T00:43:51.077 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-12T00:43:51.077 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:43:50.223931Z" 2024-09-12T00:43:51.078 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-12T00:43:51.078 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-12T00:43:51.078 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-12T00:43:51.078 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [ 2024-09-12T00:43:51.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-12T00:43:51.078 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "oidc-provider", 2024-09-12T00:43:51.078 INFO:teuthology.orchestra.run.smithi138.stdout: "perm": "*" 2024-09-12T00:43:51.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:51.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-12T00:43:51.078 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "roles", 2024-09-12T00:43:51.078 INFO:teuthology.orchestra.run.smithi138.stdout: "perm": "*" 2024-09-12T00:43:51.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:51.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-12T00:43:51.078 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "user-policy", 2024-09-12T00:43:51.079 INFO:teuthology.orchestra.run.smithi138.stdout: "perm": "*" 2024-09-12T00:43:51.079 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-12T00:43:51.079 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-12T00:43:51.079 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-12T00:43:51.079 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-12T00:43:51.079 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-12T00:43:51.079 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-12T00:43:51.079 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-12T00:43:51.079 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:51.079 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:51.079 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:51.079 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:51.079 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:51.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:51.080 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-12T00:43:51.080 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:51.080 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:51.080 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:51.080 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:51.080 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:51.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:51.080 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-12T00:43:51.080 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "rgw", 2024-09-12T00:43:51.080 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [ 2024-09-12T00:43:51.080 INFO:teuthology.orchestra.run.smithi138.stdout: "4791406709" 2024-09-12T00:43:51.080 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-12T00:43:51.081 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "", 2024-09-12T00:43:51.081 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-12T00:43:51.081 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:43:50.223897Z", 2024-09-12T00:43:51.081 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-12T00:43:51.081 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-12T00:43:51.081 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T00:43:51.081 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:51.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.083+0000 7fb5777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:51.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.087+0000 7fb6c3b5d9c0 20 remove_watcher() i=0 2024-09-12T00:43:51.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.087+0000 7fb6c3b5d9c0 2 removed watcher, disabling cache 2024-09-12T00:43:51.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.087+0000 7fb6c3b5d9c0 20 remove_watcher() i=1 2024-09-12T00:43:51.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.091+0000 7fb6c3b5d9c0 20 remove_watcher() i=2 2024-09-12T00:43:51.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.091+0000 7fb6c3b5d9c0 20 remove_watcher() i=3 2024-09-12T00:43:51.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.095+0000 7fb6c3b5d9c0 20 remove_watcher() i=4 2024-09-12T00:43:51.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.099+0000 7fb6c3b5d9c0 20 remove_watcher() i=5 2024-09-12T00:43:51.095 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.099+0000 7fb6c3b5d9c0 20 remove_watcher() i=6 2024-09-12T00:43:51.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.103+0000 7fb6c3b5d9c0 20 remove_watcher() i=7 2024-09-12T00:43:51.113 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T00:43:51.195 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:51.195 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:51.235 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.239+0000 7fd541c499c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.243+0000 7fd541c499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.243+0000 7fd541c499c0 20 realm 2024-09-12T00:43:51.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.243+0000 7fd541c499c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.243+0000 7fd541c499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.243+0000 7fd541c499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:51.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.243+0000 7fd541c499c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.243+0000 7fd541c499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.243+0000 7fd541c499c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.243+0000 7fd541c499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:51.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.243+0000 7fd541c499c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.247+0000 7fd541c499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:51.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.247+0000 7fd541c499c0 20 searching for the correct realm 2024-09-12T00:43:51.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.251+0000 7fd53ff50640 0 -- 172.21.15.138:0/2323785491 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55e687124bd0 msgr2=0x55e687127090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:51.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.255+0000 7fd53f74f640 0 -- 172.21.15.138:0/2323785491 >> [v2:172.21.15.178:6811/2062234204,v1:172.21.15.178:6813/2062234204] conn(0x7fd53000f3d0 msgr2=0x7fd53000f810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:51.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.475+0000 7fd541c499c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:51.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.475+0000 7fd541c499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:51.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.475+0000 7fd541c499c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:51.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.475+0000 7fd541c499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:51.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.475+0000 7fd541c499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:51.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.475+0000 7fd541c499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:51.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.475+0000 7fd541c499c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.475+0000 7fd541c499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.475+0000 7fd541c499c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.479+0000 7fd541c499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:51.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.479+0000 7fd541c499c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.479+0000 7fd541c499c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:51.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.479+0000 7fd541c499c0 20 zone default found 2024-09-12T00:43:51.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.479+0000 7fd541c499c0 4 Realm: () 2024-09-12T00:43:51.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.479+0000 7fd541c499c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:51.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.479+0000 7fd541c499c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:51.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.479+0000 7fd541c499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:51.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.479+0000 7fd541c499c0 20 zonegroup default 2024-09-12T00:43:51.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.479+0000 7fd541c499c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.479+0000 7fd541c499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.479+0000 7fd541c499c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.479+0000 7fd541c499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.479+0000 7fd541c499c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.483+0000 7fd541c499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.483+0000 7fd541c499c0 20 started sync module instance, tier type = 2024-09-12T00:43:51.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.483+0000 7fd541c499c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:51.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.503+0000 7fd541c499c0 20 add_watcher() i=0 2024-09-12T00:43:51.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.503+0000 7fd541c499c0 20 add_watcher() i=1 2024-09-12T00:43:51.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.503+0000 7fd541c499c0 20 add_watcher() i=2 2024-09-12T00:43:51.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.503+0000 7fd541c499c0 20 add_watcher() i=3 2024-09-12T00:43:51.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.503+0000 7fd541c499c0 20 add_watcher() i=4 2024-09-12T00:43:51.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.503+0000 7fd541c499c0 20 add_watcher() i=5 2024-09-12T00:43:51.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.503+0000 7fd541c499c0 20 add_watcher() i=6 2024-09-12T00:43:51.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.507+0000 7fd541c499c0 20 add_watcher() i=7 2024-09-12T00:43:51.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.507+0000 7fd541c499c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:51.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.511+0000 7fd3f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:51.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.511+0000 7fd541c499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:51.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.511+0000 7fd541c499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:51.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.511+0000 7fd541c499c0 5 note: GC not initialized 2024-09-12T00:43:51.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.511+0000 7fd3f4fe1640 20 reqs_thread_entry: start 2024-09-12T00:43:51.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.511+0000 7fd541c499c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:51.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.511+0000 7fd541c499c0 20 Filter name: none 2024-09-12T00:43:51.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.511+0000 7fd36e7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:51.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.511+0000 7fd541c499c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T00:43:51.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.511+0000 7fd541c499c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.511+0000 7fd541c499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.511+0000 7fd541c499c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T00:43:51.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.511+0000 7fd541c499c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:43:51.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.511+0000 7fd541c499c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T00:43:51.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.511+0000 7fd541c499c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T00:43:51.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.511+0000 7fd541c499c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.515+0000 7fd541c499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.515+0000 7fd541c499c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T00:43:51.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.515+0000 7fd541c499c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:43:51.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.515+0000 7fd541c499c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T00:43:51.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.515+0000 7fd541c499c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:43:51.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.515+0000 7fd541c499c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:43:51.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.515+0000 7fd541c499c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T00:43:51.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.519+0000 7fd422ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235592 cookie 94448596963296 notifier 8645 bl.length()=384 2024-09-12T00:43:51.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.519+0000 7fd422ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:43:51.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.519+0000 7fd422ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:43:51.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.523+0000 7fd541c499c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T00:43:51.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.523+0000 7fd541c499c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:43:51.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.523+0000 7fd541c499c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T00:43:51.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.523+0000 7fd4227fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235593 cookie 94448596969920 notifier 8645 bl.length()=225 2024-09-12T00:43:51.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.523+0000 7fd4227fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T00:43:51.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.523+0000 7fd4227fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:43:51.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.527+0000 7fd541c499c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T00:43:51.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.527+0000 7fd541c499c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:43:51.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.527+0000 7fd541c499c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T00:43:51.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.527+0000 7fd422ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235430 cookie 94448596967712 notifier 8645 bl.length()=234 2024-09-12T00:43:51.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.527+0000 7fd422ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T00:43:51.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.527+0000 7fd422ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:43:51.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.531+0000 7fd3f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:51.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.535+0000 7fd541c499c0 20 remove_watcher() i=0 2024-09-12T00:43:51.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.535+0000 7fd541c499c0 2 removed watcher, disabling cache 2024-09-12T00:43:51.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.535+0000 7fd541c499c0 20 remove_watcher() i=1 2024-09-12T00:43:51.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.539+0000 7fd541c499c0 20 remove_watcher() i=2 2024-09-12T00:43:51.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.543+0000 7fd541c499c0 20 remove_watcher() i=3 2024-09-12T00:43:51.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.543+0000 7fd541c499c0 20 remove_watcher() i=4 2024-09-12T00:43:51.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.547+0000 7fd541c499c0 20 remove_watcher() i=5 2024-09-12T00:43:51.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.551+0000 7fd541c499c0 20 remove_watcher() i=6 2024-09-12T00:43:51.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.551+0000 7fd541c499c0 20 remove_watcher() i=7 2024-09-12T00:43:51.560 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T00:43:51.560 INFO:teuthology.orchestra.run.smithi138.stdout: "id": "RGW88888888888888888", 2024-09-12T00:43:51.560 INFO:teuthology.orchestra.run.smithi138.stdout: "tenant": "", 2024-09-12T00:43:51.560 INFO:teuthology.orchestra.run.smithi138.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T00:43:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T00:43:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "quota": { 2024-09-12T00:43:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-12T00:43:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: "max_users": 1000, 2024-09-12T00:43:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: "max_roles": 1000, 2024-09-12T00:43:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: "max_groups": 1000, 2024-09-12T00:43:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-12T00:43:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: "max_access_keys": 4 2024-09-12T00:43:51.562 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T00:43:51.563 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T00:43:51.563 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key NAXZLMGUEJQKAGRGGLJT --secret N485TE7LGk2A2hy+DbZTT+8Dxosctu+hoZhkKzZU9kLxH3I38WAXIg== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T00:43:51.650 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:51.651 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:51.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.695+0000 7ff10b6239c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.699+0000 7ff10b6239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.699+0000 7ff10b6239c0 20 realm 2024-09-12T00:43:51.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.699+0000 7ff10b6239c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.699+0000 7ff10b6239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.699+0000 7ff10b6239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:51.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.699+0000 7ff10b6239c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.699+0000 7ff10b6239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.699+0000 7ff10b6239c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.699+0000 7ff10b6239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:51.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.699+0000 7ff10b6239c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.699+0000 7ff10b6239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:51.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.699+0000 7ff10b6239c0 20 searching for the correct realm 2024-09-12T00:43:51.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.703+0000 7ff108928640 0 -- 172.21.15.138:0/2988261612 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7ff0fc022070 msgr2=0x7ff0fc075760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:51.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.915+0000 7ff108928640 0 -- 172.21.15.138:0/2988261612 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55de8cc1b330 msgr2=0x55de8cc1d740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:51.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.931+0000 7ff10b6239c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:51.927 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.931+0000 7ff10b6239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:51.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.931+0000 7ff10b6239c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:51.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.931+0000 7ff10b6239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:51.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.931+0000 7ff10b6239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:51.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.931+0000 7ff10b6239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:51.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.931+0000 7ff10b6239c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.935+0000 7ff10b6239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.935+0000 7ff10b6239c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.935+0000 7ff10b6239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:51.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.935+0000 7ff10b6239c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.935+0000 7ff10b6239c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:51.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.935+0000 7ff10b6239c0 20 zone default found 2024-09-12T00:43:51.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.935+0000 7ff10b6239c0 4 Realm: () 2024-09-12T00:43:51.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.935+0000 7ff10b6239c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:51.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.935+0000 7ff10b6239c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:51.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.935+0000 7ff10b6239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:51.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.935+0000 7ff10b6239c0 20 zonegroup default 2024-09-12T00:43:51.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.935+0000 7ff10b6239c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.935+0000 7ff10b6239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.935+0000 7ff10b6239c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.935+0000 7ff10b6239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.935+0000 7ff10b6239c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.939+0000 7ff10b6239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.939+0000 7ff10b6239c0 20 started sync module instance, tier type = 2024-09-12T00:43:51.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.939+0000 7ff10b6239c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:51.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.959+0000 7ff10b6239c0 20 add_watcher() i=0 2024-09-12T00:43:51.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.959+0000 7ff10b6239c0 20 add_watcher() i=1 2024-09-12T00:43:51.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.959+0000 7ff10b6239c0 20 add_watcher() i=2 2024-09-12T00:43:51.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.959+0000 7ff10b6239c0 20 add_watcher() i=3 2024-09-12T00:43:51.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.959+0000 7ff10b6239c0 20 add_watcher() i=4 2024-09-12T00:43:51.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.959+0000 7ff10b6239c0 20 add_watcher() i=5 2024-09-12T00:43:51.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.959+0000 7ff10b6239c0 20 add_watcher() i=6 2024-09-12T00:43:51.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.963+0000 7ff10b6239c0 20 add_watcher() i=7 2024-09-12T00:43:51.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.963+0000 7ff10b6239c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:51.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.967+0000 7fefbffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:51.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.967+0000 7ff10b6239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:51.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.967+0000 7ff10b6239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:51.963 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.967+0000 7ff10b6239c0 5 note: GC not initialized 2024-09-12T00:43:51.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.967+0000 7fefbefe5640 20 reqs_thread_entry: start 2024-09-12T00:43:51.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.967+0000 7ff10b6239c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:51.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.967+0000 7ff10b6239c0 20 Filter name: none 2024-09-12T00:43:51.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7fefbcfe1640 20 reqs_thread_entry: start 2024-09-12T00:43:51.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T00:43:51.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T00:43:51.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:43:51.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T00:43:51.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T00:43:51.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:43:51.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 10 cache get: name=default.rgw.meta+users.keys+NAXZLMGUEJQKAGRGGLJT : miss 2024-09-12T00:43:51.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:51.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 10 cache put: name=default.rgw.meta+users.keys+NAXZLMGUEJQKAGRGGLJT info.flags=0x0 2024-09-12T00:43:51.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 10 adding default.rgw.meta+users.keys+NAXZLMGUEJQKAGRGGLJT to cache LRU end 2024-09-12T00:43:51.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T00:43:51.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:51.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:43:51.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:43:51.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:43:51.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:51.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 10 cache get: name=default.rgw.meta+users.keys+NAXZLMGUEJQKAGRGGLJT : hit (negative entry) 2024-09-12T00:43:51.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.971+0000 7ff10b6239c0 10 cache get: name=default.rgw.meta+users.keys+NAXZLMGUEJQKAGRGGLJT : hit (negative entry) 2024-09-12T00:43:51.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.975+0000 7ff10b6239c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:43:51.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.975+0000 7ff10b6239c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:43:51.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.975+0000 7ff10b6239c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T00:43:51.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.975+0000 7fefecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235594 cookie 94414332637296 notifier 9294 bl.length()=681 2024-09-12T00:43:51.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.975+0000 7fefecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:43:51.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.975+0000 7fefecff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:43:51.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.979+0000 7ff10b6239c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T00:43:51.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.979+0000 7ff10b6239c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:43:51.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.979+0000 7ff10b6239c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T00:43:51.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.983+0000 7fefecff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235629 cookie 94414332648832 notifier 9294 bl.length()=189 2024-09-12T00:43:51.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.983+0000 7fefecff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T00:43:51.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.983+0000 7fefecff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:43:51.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.987+0000 7ff10b6239c0 10 cache put: name=default.rgw.meta+users.keys+NAXZLMGUEJQKAGRGGLJT info.flags=0x7 2024-09-12T00:43:51.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.987+0000 7ff10b6239c0 10 moving default.rgw.meta+users.keys+NAXZLMGUEJQKAGRGGLJT to cache LRU end 2024-09-12T00:43:51.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.987+0000 7ff10b6239c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:NAXZLMGUEJQKAGRGGLJT, ofs0, ns] 2024-09-12T00:43:51.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.987+0000 7fefdbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235595 cookie 94414332637296 notifier 9294 bl.length()=188 2024-09-12T00:43:51.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.987+0000 7fefdbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NAXZLMGUEJQKAGRGGLJT info.flags=0x7 2024-09-12T00:43:51.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.987+0000 7fefdbfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NAXZLMGUEJQKAGRGGLJT to cache LRU end 2024-09-12T00:43:51.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.987+0000 7ff10b6239c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T00:43:51.983 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T00:43:51.983 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "root1.client.0", 2024-09-12T00:43:51.983 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T00:43:51.983 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "root1+test@test.test", 2024-09-12T00:43:51.984 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-12T00:43:51.984 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-12T00:43:51.984 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-12T00:43:51.984 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-12T00:43:51.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-12T00:43:51.984 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "root1.client.0", 2024-09-12T00:43:51.984 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "NAXZLMGUEJQKAGRGGLJT", 2024-09-12T00:43:51.984 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "N485TE7LGk2A2hy+DbZTT+8Dxosctu+hoZhkKzZU9kLxH3I38WAXIg==", 2024-09-12T00:43:51.984 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-12T00:43:51.984 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:43:51.974956Z" 2024-09-12T00:43:51.984 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-12T00:43:51.984 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-12T00:43:51.984 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-12T00:43:51.985 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-12T00:43:51.985 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-12T00:43:51.985 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-12T00:43:51.985 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-12T00:43:51.985 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-12T00:43:51.985 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-12T00:43:51.985 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:51.985 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:51.985 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:51.985 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:51.985 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:51.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:51.986 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-12T00:43:51.986 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:51.986 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:51.986 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:51.986 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:51.986 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:51.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:51.986 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-12T00:43:51.986 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "root", 2024-09-12T00:43:51.986 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-12T00:43:51.986 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "RGW88888888888888888", 2024-09-12T00:43:51.986 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-12T00:43:51.986 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:43:51.974927Z", 2024-09-12T00:43:51.987 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-12T00:43:51.987 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-12T00:43:51.987 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T00:43:51.987 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:51.987 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.991+0000 7fefbffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:51.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.995+0000 7ff10b6239c0 20 remove_watcher() i=0 2024-09-12T00:43:51.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.995+0000 7ff10b6239c0 2 removed watcher, disabling cache 2024-09-12T00:43:51.990 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.995+0000 7ff10b6239c0 20 remove_watcher() i=1 2024-09-12T00:43:51.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.999+0000 7ff10b6239c0 20 remove_watcher() i=2 2024-09-12T00:43:51.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:51.999+0000 7ff10b6239c0 20 remove_watcher() i=3 2024-09-12T00:43:51.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.003+0000 7ff10b6239c0 20 remove_watcher() i=4 2024-09-12T00:43:51.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.003+0000 7ff10b6239c0 20 remove_watcher() i=5 2024-09-12T00:43:52.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.007+0000 7ff10b6239c0 20 remove_watcher() i=6 2024-09-12T00:43:52.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.011+0000 7ff10b6239c0 20 remove_watcher() i=7 2024-09-12T00:43:52.021 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 3759070489 --totp-seed MFOJDYXTH56RS3WZM44P7HTIKG6E6YTLRGQ7IPZ6CWKTGYXY2SSIKRH6NDAEJLPN --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:43:52.066 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:52.066 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:52.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.111+0000 7f55a87979c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.111+0000 7f55a87979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.111+0000 7f55a87979c0 20 realm 2024-09-12T00:43:52.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.111+0000 7f55a87979c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.111+0000 7f55a87979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.111+0000 7f55a87979c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:52.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.111+0000 7f55a87979c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.111+0000 7f55a87979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.111+0000 7f55a87979c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.115+0000 7f55a87979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:52.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.115+0000 7f55a87979c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.115+0000 7f55a87979c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:52.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.115+0000 7f55a87979c0 20 searching for the correct realm 2024-09-12T00:43:52.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.119+0000 7f55a6a9e640 0 -- 172.21.15.138:0/1891189809 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f55a00d7040 msgr2=0x7f55a0132630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:52.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.335+0000 7f55a6a9e640 0 -- 172.21.15.138:0/1891189809 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55e6de69ba80 msgr2=0x55e6de69df40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:52.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.343+0000 7f55a87979c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:52.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.343+0000 7f55a87979c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:52.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.343+0000 7f55a87979c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:52.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.343+0000 7f55a87979c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:52.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.343+0000 7f55a87979c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:52.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.343+0000 7f55a87979c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:52.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.343+0000 7f55a87979c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.347+0000 7f55a87979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.347+0000 7f55a87979c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.347+0000 7f55a87979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:52.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.347+0000 7f55a87979c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.347+0000 7f55a87979c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:52.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.347+0000 7f55a87979c0 20 zone default found 2024-09-12T00:43:52.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.347+0000 7f55a87979c0 4 Realm: () 2024-09-12T00:43:52.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.347+0000 7f55a87979c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:52.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.347+0000 7f55a87979c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:52.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.347+0000 7f55a87979c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:52.342 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.347+0000 7f55a87979c0 20 zonegroup default 2024-09-12T00:43:52.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.347+0000 7f55a87979c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.347+0000 7f55a87979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.347+0000 7f55a87979c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.351+0000 7f55a87979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.351+0000 7f55a87979c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.351+0000 7f55a87979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.351+0000 7f55a87979c0 20 started sync module instance, tier type = 2024-09-12T00:43:52.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.351+0000 7f55a87979c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:52.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.375+0000 7f55a87979c0 20 add_watcher() i=0 2024-09-12T00:43:52.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.375+0000 7f55a87979c0 20 add_watcher() i=1 2024-09-12T00:43:52.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.375+0000 7f55a87979c0 20 add_watcher() i=2 2024-09-12T00:43:52.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.375+0000 7f55a87979c0 20 add_watcher() i=3 2024-09-12T00:43:52.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.375+0000 7f55a87979c0 20 add_watcher() i=4 2024-09-12T00:43:52.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.375+0000 7f55a87979c0 20 add_watcher() i=5 2024-09-12T00:43:52.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.375+0000 7f55a87979c0 20 add_watcher() i=6 2024-09-12T00:43:52.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.375+0000 7f55a87979c0 20 add_watcher() i=7 2024-09-12T00:43:52.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.375+0000 7f55a87979c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:52.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.379+0000 7f545cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:52.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.379+0000 7f55a87979c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:52.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.379+0000 7f55a87979c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:52.376 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.379+0000 7f55a87979c0 5 note: GC not initialized 2024-09-12T00:43:52.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.383+0000 7f53d77fe640 20 reqs_thread_entry: start 2024-09-12T00:43:52.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.383+0000 7f55a87979c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:52.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.383+0000 7f55a87979c0 20 Filter name: none 2024-09-12T00:43:52.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.383+0000 7f53d57fa640 20 reqs_thread_entry: start 2024-09-12T00:43:52.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.383+0000 7f55a87979c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T00:43:52.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.383+0000 7f55a87979c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.383+0000 7f55a87979c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T00:43:52.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.383+0000 7f55a87979c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T00:43:52.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.383+0000 7f55a87979c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:43:52.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.383+0000 7f55a87979c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.391+0000 7f55a87979c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:43:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.391+0000 7f55a87979c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:43:52.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.391+0000 7f55a87979c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T00:43:52.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.391+0000 7f5489ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235596 cookie 94450062316096 notifier 8681 bl.length()=695 2024-09-12T00:43:52.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.391+0000 7f5489ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:43:52.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.391+0000 7f5489ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:43:52.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.395+0000 7f545cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:52.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.399+0000 7f55a87979c0 20 remove_watcher() i=0 2024-09-12T00:43:52.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.399+0000 7f55a87979c0 2 removed watcher, disabling cache 2024-09-12T00:43:52.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.399+0000 7f55a87979c0 20 remove_watcher() i=1 2024-09-12T00:43:52.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.403+0000 7f55a87979c0 20 remove_watcher() i=2 2024-09-12T00:43:52.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.403+0000 7f55a87979c0 20 remove_watcher() i=3 2024-09-12T00:43:52.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.407+0000 7f55a87979c0 20 remove_watcher() i=4 2024-09-12T00:43:52.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.411+0000 7f55a87979c0 20 remove_watcher() i=5 2024-09-12T00:43:52.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.411+0000 7f55a87979c0 20 remove_watcher() i=6 2024-09-12T00:43:52.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.415+0000 7f55a87979c0 20 remove_watcher() i=7 2024-09-12T00:43:52.428 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T00:43:52.464 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:52.464 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:52.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.511+0000 7fc9245ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.515+0000 7fc9245ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.515+0000 7fc9245ce9c0 20 realm 2024-09-12T00:43:52.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.515+0000 7fc9245ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.515+0000 7fc9245ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.515+0000 7fc9245ce9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:52.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.515+0000 7fc9245ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.515+0000 7fc9245ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.515+0000 7fc9245ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.515+0000 7fc9245ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:52.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.515+0000 7fc9245ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.515+0000 7fc9245ce9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:52.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.515+0000 7fc9245ce9c0 20 searching for the correct realm 2024-09-12T00:43:52.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.523+0000 7fc9228d5640 0 -- 172.21.15.138:0/2347504918 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fc91c047440 msgr2=0x7fc91c047880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:52.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.739+0000 7fc9228d5640 0 -- 172.21.15.138:0/2347504918 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x56009503f190 msgr2=0x560095041650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:52.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.747+0000 7fc9245ce9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:52.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.747+0000 7fc9245ce9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:52.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.747+0000 7fc9245ce9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:52.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.747+0000 7fc9245ce9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:52.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.747+0000 7fc9245ce9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:52.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.747+0000 7fc9245ce9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:52.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.747+0000 7fc9245ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.747+0000 7fc9245ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.751+0000 7fc9245ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.751+0000 7fc9245ce9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:52.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.751+0000 7fc9245ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.751+0000 7fc9245ce9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:52.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.751+0000 7fc9245ce9c0 20 zone default found 2024-09-12T00:43:52.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.751+0000 7fc9245ce9c0 4 Realm: () 2024-09-12T00:43:52.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.751+0000 7fc9245ce9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:52.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.751+0000 7fc9245ce9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:52.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.751+0000 7fc9245ce9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:52.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.751+0000 7fc9245ce9c0 20 zonegroup default 2024-09-12T00:43:52.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.751+0000 7fc9245ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.751+0000 7fc9245ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.751+0000 7fc9245ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.751+0000 7fc9245ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.751+0000 7fc9245ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.755+0000 7fc9245ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.755+0000 7fc9245ce9c0 20 started sync module instance, tier type = 2024-09-12T00:43:52.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.755+0000 7fc9245ce9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:52.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.775+0000 7fc9245ce9c0 20 add_watcher() i=0 2024-09-12T00:43:52.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.775+0000 7fc9245ce9c0 20 add_watcher() i=1 2024-09-12T00:43:52.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.775+0000 7fc9245ce9c0 20 add_watcher() i=2 2024-09-12T00:43:52.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.775+0000 7fc9245ce9c0 20 add_watcher() i=3 2024-09-12T00:43:52.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.775+0000 7fc9245ce9c0 20 add_watcher() i=4 2024-09-12T00:43:52.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.775+0000 7fc9245ce9c0 20 add_watcher() i=5 2024-09-12T00:43:52.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.775+0000 7fc9245ce9c0 20 add_watcher() i=6 2024-09-12T00:43:52.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.779+0000 7fc9245ce9c0 20 add_watcher() i=7 2024-09-12T00:43:52.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.779+0000 7fc9245ce9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:52.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc7d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:52.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc9245ce9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:52.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc9245ce9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:52.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc9245ce9c0 5 note: GC not initialized 2024-09-12T00:43:52.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc7537fe640 20 reqs_thread_entry: start 2024-09-12T00:43:52.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc9245ce9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:52.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc9245ce9c0 20 Filter name: none 2024-09-12T00:43:52.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc7517fa640 20 reqs_thread_entry: start 2024-09-12T00:43:52.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc9245ce9c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T00:43:52.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc9245ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc9245ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc9245ce9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T00:43:52.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc9245ce9c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:43:52.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc9245ce9c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T00:43:52.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc9245ce9c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T00:43:52.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc9245ce9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc9245ce9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc9245ce9c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T00:43:52.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc9245ce9c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:43:52.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.783+0000 7fc9245ce9c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T00:43:52.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.787+0000 7fc9245ce9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:43:52.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.787+0000 7fc9245ce9c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:43:52.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.787+0000 7fc9245ce9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T00:43:52.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.787+0000 7fc805ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235597 cookie 94560500060608 notifier 8699 bl.length()=384 2024-09-12T00:43:52.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.787+0000 7fc805ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:43:52.781 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.787+0000 7fc805ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:43:52.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.791+0000 7fc9245ce9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T00:43:52.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.791+0000 7fc9245ce9c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:43:52.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.791+0000 7fc9245ce9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T00:43:52.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.791+0000 7fc805ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235598 cookie 94560500075472 notifier 8699 bl.length()=225 2024-09-12T00:43:52.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.791+0000 7fc805ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T00:43:52.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.791+0000 7fc805ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:43:52.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.791+0000 7fc9245ce9c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T00:43:52.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.791+0000 7fc9245ce9c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:43:52.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.791+0000 7fc9245ce9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T00:43:52.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.795+0000 7fc8057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235431 cookie 94560500074144 notifier 8699 bl.length()=234 2024-09-12T00:43:52.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.795+0000 7fc8057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T00:43:52.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.795+0000 7fc8057fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:43:52.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.795+0000 7fc7d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:52.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.799+0000 7fc9245ce9c0 20 remove_watcher() i=0 2024-09-12T00:43:52.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.799+0000 7fc9245ce9c0 2 removed watcher, disabling cache 2024-09-12T00:43:52.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.803+0000 7fc9245ce9c0 20 remove_watcher() i=1 2024-09-12T00:43:52.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.803+0000 7fc9245ce9c0 20 remove_watcher() i=2 2024-09-12T00:43:52.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.807+0000 7fc9245ce9c0 20 remove_watcher() i=3 2024-09-12T00:43:52.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.807+0000 7fc9245ce9c0 20 remove_watcher() i=4 2024-09-12T00:43:52.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.811+0000 7fc9245ce9c0 20 remove_watcher() i=5 2024-09-12T00:43:52.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.811+0000 7fc9245ce9c0 20 remove_watcher() i=6 2024-09-12T00:43:52.813 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.815+0000 7fc9245ce9c0 20 remove_watcher() i=7 2024-09-12T00:43:52.824 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T00:43:52.824 INFO:teuthology.orchestra.run.smithi138.stdout: "id": "RGW99999999999999999", 2024-09-12T00:43:52.824 INFO:teuthology.orchestra.run.smithi138.stdout: "tenant": "", 2024-09-12T00:43:52.824 INFO:teuthology.orchestra.run.smithi138.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T00:43:52.824 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T00:43:52.824 INFO:teuthology.orchestra.run.smithi138.stdout: "quota": { 2024-09-12T00:43:52.824 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:52.824 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:52.824 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:52.824 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:52.825 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:52.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:52.825 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-12T00:43:52.825 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:52.825 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:52.825 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:52.825 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:52.825 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:52.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:52.825 INFO:teuthology.orchestra.run.smithi138.stdout: "max_users": 1000, 2024-09-12T00:43:52.825 INFO:teuthology.orchestra.run.smithi138.stdout: "max_roles": 1000, 2024-09-12T00:43:52.825 INFO:teuthology.orchestra.run.smithi138.stdout: "max_groups": 1000, 2024-09-12T00:43:52.825 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-12T00:43:52.826 INFO:teuthology.orchestra.run.smithi138.stdout: "max_access_keys": 4 2024-09-12T00:43:52.826 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T00:43:52.827 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T00:43:52.827 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key KHNMRETFUXMICTVJTBAC --secret JPF7a8Qvka/lt0e9t1m5JRlyVrdb1xwqzPAbTHq93TSjFquBju9NIg== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T00:43:52.918 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:52.918 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:52.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.963+0000 7fc851abe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.967+0000 7fc851abe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.967+0000 7fc851abe9c0 20 realm 2024-09-12T00:43:52.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.967+0000 7fc851abe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.967+0000 7fc851abe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.967+0000 7fc851abe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:52.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.967+0000 7fc851abe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.967+0000 7fc851abe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.967+0000 7fc851abe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.967+0000 7fc851abe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:52.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.967+0000 7fc851abe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.967+0000 7fc851abe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:52.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.967+0000 7fc851abe9c0 20 searching for the correct realm 2024-09-12T00:43:52.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.971+0000 7fc84edc3640 0 -- 172.21.15.138:0/3506420312 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7fc840040060 msgr2=0x7fc8400909f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:52.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.979+0000 7fc84edc3640 0 -- 172.21.15.138:0/3506420312 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x56529b375c20 msgr2=0x56529b378030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:52.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:52.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:52.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:52.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:52.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:52.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:52.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:52.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:52.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 20 zone default found 2024-09-12T00:43:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 4 Realm: () 2024-09-12T00:43:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 20 zonegroup default 2024-09-12T00:43:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.987+0000 7fc851abe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.991+0000 7fc851abe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.984 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.991+0000 7fc851abe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.991+0000 7fc851abe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.991+0000 7fc851abe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:52.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.991+0000 7fc851abe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:52.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.991+0000 7fc851abe9c0 20 started sync module instance, tier type = 2024-09-12T00:43:52.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:52.991+0000 7fc851abe9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:53.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.007+0000 7fc851abe9c0 20 add_watcher() i=0 2024-09-12T00:43:53.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.007+0000 7fc851abe9c0 20 add_watcher() i=1 2024-09-12T00:43:53.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.007+0000 7fc851abe9c0 20 add_watcher() i=2 2024-09-12T00:43:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.007+0000 7fc851abe9c0 20 add_watcher() i=3 2024-09-12T00:43:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.007+0000 7fc851abe9c0 20 add_watcher() i=4 2024-09-12T00:43:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.007+0000 7fc851abe9c0 20 add_watcher() i=5 2024-09-12T00:43:53.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.007+0000 7fc851abe9c0 20 add_watcher() i=6 2024-09-12T00:43:53.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.011+0000 7fc851abe9c0 20 add_watcher() i=7 2024-09-12T00:43:53.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.011+0000 7fc851abe9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:53.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc705fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:53.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:53.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:53.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 5 note: GC not initialized 2024-09-12T00:43:53.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc704fe1640 20 reqs_thread_entry: start 2024-09-12T00:43:53.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:53.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 20 Filter name: none 2024-09-12T00:43:53.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc67e7fc640 20 reqs_thread_entry: start 2024-09-12T00:43:53.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T00:43:53.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T00:43:53.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:43:53.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T00:43:53.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T00:43:53.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:43:53.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 10 cache get: name=default.rgw.meta+users.keys+KHNMRETFUXMICTVJTBAC : miss 2024-09-12T00:43:53.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 10 cache put: name=default.rgw.meta+users.keys+KHNMRETFUXMICTVJTBAC info.flags=0x0 2024-09-12T00:43:53.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 10 adding default.rgw.meta+users.keys+KHNMRETFUXMICTVJTBAC to cache LRU end 2024-09-12T00:43:53.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T00:43:53.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.015+0000 7fc851abe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.019+0000 7fc851abe9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:43:53.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.019+0000 7fc851abe9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:43:53.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.019+0000 7fc851abe9c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:43:53.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.019+0000 7fc851abe9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:53.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.019+0000 7fc851abe9c0 10 cache get: name=default.rgw.meta+users.keys+KHNMRETFUXMICTVJTBAC : hit (negative entry) 2024-09-12T00:43:53.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.019+0000 7fc851abe9c0 10 cache get: name=default.rgw.meta+users.keys+KHNMRETFUXMICTVJTBAC : hit (negative entry) 2024-09-12T00:43:53.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.019+0000 7fc851abe9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:43:53.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.019+0000 7fc851abe9c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:43:53.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.019+0000 7fc851abe9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T00:43:53.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.019+0000 7fc732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235599 cookie 94912791436544 notifier 9345 bl.length()=681 2024-09-12T00:43:53.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.019+0000 7fc732ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:43:53.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.019+0000 7fc732ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:43:53.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.023+0000 7fc851abe9c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T00:43:53.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.023+0000 7fc851abe9c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:43:53.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.023+0000 7fc851abe9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T00:43:53.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.023+0000 7fc732ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235630 cookie 94912791443600 notifier 9345 bl.length()=189 2024-09-12T00:43:53.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.023+0000 7fc732ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T00:43:53.019 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.023+0000 7fc732ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:43:53.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.027+0000 7fc851abe9c0 10 cache put: name=default.rgw.meta+users.keys+KHNMRETFUXMICTVJTBAC info.flags=0x7 2024-09-12T00:43:53.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.027+0000 7fc851abe9c0 10 moving default.rgw.meta+users.keys+KHNMRETFUXMICTVJTBAC to cache LRU end 2024-09-12T00:43:53.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.027+0000 7fc851abe9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:KHNMRETFUXMICTVJTBAC, ofs0, ns] 2024-09-12T00:43:53.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.027+0000 7fc7327fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235435 cookie 94912791409344 notifier 9345 bl.length()=188 2024-09-12T00:43:53.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.027+0000 7fc7327fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+KHNMRETFUXMICTVJTBAC info.flags=0x7 2024-09-12T00:43:53.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.027+0000 7fc7327fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+KHNMRETFUXMICTVJTBAC to cache LRU end 2024-09-12T00:43:53.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.031+0000 7fc851abe9c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T00:43:53.024 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T00:43:53.024 INFO:teuthology.orchestra.run.smithi138.stdout: "user_id": "root2.client.0", 2024-09-12T00:43:53.024 INFO:teuthology.orchestra.run.smithi138.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T00:43:53.025 INFO:teuthology.orchestra.run.smithi138.stdout: "email": "root2+test@test.test", 2024-09-12T00:43:53.025 INFO:teuthology.orchestra.run.smithi138.stdout: "suspended": 0, 2024-09-12T00:43:53.025 INFO:teuthology.orchestra.run.smithi138.stdout: "max_buckets": 1000, 2024-09-12T00:43:53.025 INFO:teuthology.orchestra.run.smithi138.stdout: "subusers": [], 2024-09-12T00:43:53.025 INFO:teuthology.orchestra.run.smithi138.stdout: "keys": [ 2024-09-12T00:43:53.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-09-12T00:43:53.025 INFO:teuthology.orchestra.run.smithi138.stdout: "user": "root2.client.0", 2024-09-12T00:43:53.025 INFO:teuthology.orchestra.run.smithi138.stdout: "access_key": "KHNMRETFUXMICTVJTBAC", 2024-09-12T00:43:53.025 INFO:teuthology.orchestra.run.smithi138.stdout: "secret_key": "JPF7a8Qvka/lt0e9t1m5JRlyVrdb1xwqzPAbTHq93TSjFquBju9NIg==", 2024-09-12T00:43:53.025 INFO:teuthology.orchestra.run.smithi138.stdout: "active": true, 2024-09-12T00:43:53.025 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:43:53.019357Z" 2024-09-12T00:43:53.025 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-09-12T00:43:53.025 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-09-12T00:43:53.026 INFO:teuthology.orchestra.run.smithi138.stdout: "swift_keys": [], 2024-09-12T00:43:53.026 INFO:teuthology.orchestra.run.smithi138.stdout: "caps": [], 2024-09-12T00:43:53.026 INFO:teuthology.orchestra.run.smithi138.stdout: "op_mask": "read, write, delete", 2024-09-12T00:43:53.026 INFO:teuthology.orchestra.run.smithi138.stdout: "default_placement": "", 2024-09-12T00:43:53.026 INFO:teuthology.orchestra.run.smithi138.stdout: "default_storage_class": "", 2024-09-12T00:43:53.026 INFO:teuthology.orchestra.run.smithi138.stdout: "placement_tags": [], 2024-09-12T00:43:53.026 INFO:teuthology.orchestra.run.smithi138.stdout: "bucket_quota": { 2024-09-12T00:43:53.026 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:53.026 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:53.026 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:53.026 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:53.026 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:53.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:53.027 INFO:teuthology.orchestra.run.smithi138.stdout: "user_quota": { 2024-09-12T00:43:53.027 INFO:teuthology.orchestra.run.smithi138.stdout: "enabled": false, 2024-09-12T00:43:53.027 INFO:teuthology.orchestra.run.smithi138.stdout: "check_on_raw": false, 2024-09-12T00:43:53.027 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size": -1, 2024-09-12T00:43:53.027 INFO:teuthology.orchestra.run.smithi138.stdout: "max_size_kb": 0, 2024-09-12T00:43:53.027 INFO:teuthology.orchestra.run.smithi138.stdout: "max_objects": -1 2024-09-12T00:43:53.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-09-12T00:43:53.027 INFO:teuthology.orchestra.run.smithi138.stdout: "temp_url_keys": [], 2024-09-12T00:43:53.027 INFO:teuthology.orchestra.run.smithi138.stdout: "type": "root", 2024-09-12T00:43:53.027 INFO:teuthology.orchestra.run.smithi138.stdout: "mfa_ids": [], 2024-09-12T00:43:53.027 INFO:teuthology.orchestra.run.smithi138.stdout: "account_id": "RGW99999999999999999", 2024-09-12T00:43:53.027 INFO:teuthology.orchestra.run.smithi138.stdout: "path": "/", 2024-09-12T00:43:53.027 INFO:teuthology.orchestra.run.smithi138.stdout: "create_date": "2024-09-12T00:43:53.019342Z", 2024-09-12T00:43:53.027 INFO:teuthology.orchestra.run.smithi138.stdout: "tags": [], 2024-09-12T00:43:53.028 INFO:teuthology.orchestra.run.smithi138.stdout: "group_ids": [] 2024-09-12T00:43:53.028 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T00:43:53.028 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:43:53.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.031+0000 7fc705fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:53.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.035+0000 7fc851abe9c0 20 remove_watcher() i=0 2024-09-12T00:43:53.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.035+0000 7fc851abe9c0 2 removed watcher, disabling cache 2024-09-12T00:43:53.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.035+0000 7fc851abe9c0 20 remove_watcher() i=1 2024-09-12T00:43:53.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.039+0000 7fc851abe9c0 20 remove_watcher() i=2 2024-09-12T00:43:53.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.039+0000 7fc851abe9c0 20 remove_watcher() i=3 2024-09-12T00:43:53.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.043+0000 7fc851abe9c0 20 remove_watcher() i=4 2024-09-12T00:43:53.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.043+0000 7fc851abe9c0 20 remove_watcher() i=5 2024-09-12T00:43:53.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.047+0000 7fc851abe9c0 20 remove_watcher() i=6 2024-09-12T00:43:53.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.051+0000 7fc851abe9c0 20 remove_watcher() i=7 2024-09-12T00:43:53.059 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 1175155334 --totp-seed WOUNLP4V5IXNNNCUIHTQ4GAAQXCZLUTKUMQ4VJAMZZ5PVBK3NALKIVSCMWDFTVQB --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:43:53.100 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:53.100 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:53.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.147+0000 7fac8319b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.147+0000 7fac8319b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.147+0000 7fac8319b9c0 20 realm 2024-09-12T00:43:53.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.147+0000 7fac8319b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.147+0000 7fac8319b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.147+0000 7fac8319b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:43:53.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.147+0000 7fac8319b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.147+0000 7fac8319b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.147+0000 7fac8319b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.151+0000 7fac8319b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:53.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.151+0000 7fac8319b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.151+0000 7fac8319b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:43:53.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.151+0000 7fac8319b9c0 20 searching for the correct realm 2024-09-12T00:43:53.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.155+0000 7fac814a2640 0 -- 172.21.15.138:0/1384606573 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7fac78016910 msgr2=0x7fac780153f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:53.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.371+0000 7fac814a2640 0 -- 172.21.15.138:0/1384606573 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x562592c1a9f0 msgr2=0x562592c1ceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:43:53.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T00:43:53.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:43:53.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T00:43:53.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:43:53.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:43:53.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:43:53.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:43:53.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:43:53.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 20 zone default found 2024-09-12T00:43:53.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 4 Realm: () 2024-09-12T00:43:53.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T00:43:53.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T00:43:53.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:43:53.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 20 zonegroup default 2024-09-12T00:43:53.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.383+0000 7fac8319b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.387+0000 7fac8319b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.387+0000 7fac8319b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.387+0000 7fac8319b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:43:53.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.387+0000 7fac8319b9c0 20 started sync module instance, tier type = 2024-09-12T00:43:53.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.387+0000 7fac8319b9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T00:43:53.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.411+0000 7fac8319b9c0 20 add_watcher() i=0 2024-09-12T00:43:53.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.411+0000 7fac8319b9c0 20 add_watcher() i=1 2024-09-12T00:43:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.411+0000 7fac8319b9c0 20 add_watcher() i=2 2024-09-12T00:43:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.411+0000 7fac8319b9c0 20 add_watcher() i=3 2024-09-12T00:43:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.411+0000 7fac8319b9c0 20 add_watcher() i=4 2024-09-12T00:43:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.411+0000 7fac8319b9c0 20 add_watcher() i=5 2024-09-12T00:43:53.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.411+0000 7fac8319b9c0 20 add_watcher() i=6 2024-09-12T00:43:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.411+0000 7fac8319b9c0 20 add_watcher() i=7 2024-09-12T00:43:53.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.411+0000 7fac8319b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:43:53.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.415+0000 7fab36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:53.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.419+0000 7fac8319b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:43:53.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.419+0000 7fac8319b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:43:53.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.419+0000 7fac8319b9c0 5 note: GC not initialized 2024-09-12T00:43:53.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.419+0000 7fab35fe3640 20 reqs_thread_entry: start 2024-09-12T00:43:53.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.419+0000 7fac8319b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:43:53.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.419+0000 7fac8319b9c0 20 Filter name: none 2024-09-12T00:43:53.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.419+0000 7faaa77fe640 20 reqs_thread_entry: start 2024-09-12T00:43:53.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.419+0000 7fac8319b9c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T00:43:53.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.419+0000 7fac8319b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:43:53.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.419+0000 7fac8319b9c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T00:43:53.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.419+0000 7fac8319b9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T00:43:53.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.419+0000 7fac8319b9c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:43:53.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.419+0000 7fac8319b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:43:53.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.427+0000 7fac8319b9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:43:53.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.427+0000 7fac8319b9c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:43:53.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.427+0000 7fac8319b9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T00:43:53.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.427+0000 7fab57fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235600 cookie 94719375956336 notifier 8735 bl.length()=695 2024-09-12T00:43:53.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.427+0000 7fab57fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:43:53.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.427+0000 7fab57fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:43:53.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.427+0000 7fab36fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:43:53.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.431+0000 7fac8319b9c0 20 remove_watcher() i=0 2024-09-12T00:43:53.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.431+0000 7fac8319b9c0 2 removed watcher, disabling cache 2024-09-12T00:43:53.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.435+0000 7fac8319b9c0 20 remove_watcher() i=1 2024-09-12T00:43:53.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.439+0000 7fac8319b9c0 20 remove_watcher() i=2 2024-09-12T00:43:53.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.439+0000 7fac8319b9c0 20 remove_watcher() i=3 2024-09-12T00:43:53.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.443+0000 7fac8319b9c0 20 remove_watcher() i=4 2024-09-12T00:43:53.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.443+0000 7fac8319b9c0 20 remove_watcher() i=5 2024-09-12T00:43:53.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.447+0000 7fac8319b9c0 20 remove_watcher() i=6 2024-09-12T00:43:53.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T00:43:53.451+0000 7fac8319b9c0 20 remove_watcher() i=7 2024-09-12T00:43:53.461 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T00:43:53.461 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:43:53.462 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T00:43:53.509 INFO:tasks.s3tests:Configuring boto... 2024-09-12T00:43:53.509 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T00:43:53.510 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T00:43:53.556 DEBUG:teuthology.orchestra.run.smithi138:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T00:43:53.733 INFO:teuthology.orchestra.run.smithi138.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T00:43:53.926 INFO:teuthology.orchestra.run.smithi138.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T00:43:54.277 INFO:teuthology.orchestra.run.smithi138.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:45:51.128 INFO:teuthology.orchestra.run.smithi138.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T00:45:52.955 INFO:teuthology.orchestra.run.smithi138.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=bee78c2c6e7d6689ad347a735a9ef7ad8915b684236b005b763cc683e1c7b05b,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T00:45:52.956 INFO:teuthology.orchestra.run.smithi138.stdout:py run-test-pre: PYTHONHASHSEED='3385603165' 2024-09-12T00:45:52.956 INFO:teuthology.orchestra.run.smithi138.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T00:45:53.141 INFO:teuthology.orchestra.run.smithi138.stdout:============================= test session starts ============================== 2024-09-12T00:45:53.142 INFO:teuthology.orchestra.run.smithi138.stdout:platform linux -- Python 3.10.6, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T00:45:53.142 INFO:teuthology.orchestra.run.smithi138.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:45:53.142 INFO:teuthology.orchestra.run.smithi138.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:45:53.142 INFO:teuthology.orchestra.run.smithi138.stdout:configfile: pytest.ini 2024-09-12T00:45:54.951 INFO:teuthology.orchestra.run.smithi138.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T00:45:54.951 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T00:45:55.347 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T00:45:55.588 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T00:45:55.842 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T00:45:56.097 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T00:45:56.349 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T00:45:56.549 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T00:45:56.822 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T00:45:57.020 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T00:45:57.118 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T00:45:57.221 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T00:45:57.471 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T00:45:57.721 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T00:45:57.971 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T00:45:58.228 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T00:45:58.327 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T00:45:58.424 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T00:45:58.479 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T00:45:58.539 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T00:45:58.595 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T00:45:58.651 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T00:45:58.706 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T00:45:58.759 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T00:45:58.816 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T00:45:58.873 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T00:45:58.928 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T00:45:58.984 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T00:45:59.040 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T00:45:59.096 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T00:45:59.152 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T00:45:59.208 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T00:45:59.265 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T00:45:59.319 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T00:45:59.376 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T00:45:59.432 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T00:45:59.487 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T00:45:59.544 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T00:45:59.599 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T00:45:59.656 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T00:45:59.712 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:45:59.768 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T00:45:59.827 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T00:45:59.883 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:45:59.940 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:45:59.996 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T00:46:00.052 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T00:46:00.107 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T00:46:00.163 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T00:46:00.219 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T00:46:00.277 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T00:46:00.332 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T00:46:00.387 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T00:46:00.444 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T00:46:00.500 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T00:46:01.051 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T00:46:02.046 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T00:46:03.823 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T00:46:05.430 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T00:46:08.353 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T00:46:09.444 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T00:46:10.628 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T00:46:11.129 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T00:46:11.359 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T00:46:11.698 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T00:46:12.055 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T00:46:12.515 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T00:46:12.808 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T00:46:13.118 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T00:46:13.120 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T00:46:13.122 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T00:46:13.125 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T00:46:13.131 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T00:46:13.134 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T00:46:13.136 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T00:46:13.138 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T00:46:13.140 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:46:13.142 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:46:13.145 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:46:13.147 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:46:13.149 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T00:46:13.151 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:46:13.153 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:46:13.155 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:46:13.158 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:46:13.160 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:46:13.162 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:46:13.164 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:46:13.166 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T00:46:13.168 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T00:46:13.170 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T00:46:13.171 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T00:46:13.173 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T00:46:13.175 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T00:46:13.177 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T00:46:13.178 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T00:46:13.282 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T00:46:13.296 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T00:46:14.123 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T00:46:24.979 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T00:46:25.555 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T00:46:26.279 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T00:46:26.951 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T00:46:27.651 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T00:46:28.327 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T00:46:28.931 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T00:46:29.675 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T00:46:30.319 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T00:46:30.955 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T00:46:31.747 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T00:46:32.271 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T00:46:32.819 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T00:46:33.199 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T00:46:33.743 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T00:46:34.403 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T00:46:35.103 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T00:46:35.727 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T00:46:36.355 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T00:46:36.944 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T00:46:37.508 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T00:46:38.099 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T00:46:38.599 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T00:46:39.119 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T00:46:39.543 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T00:46:40.011 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T00:46:40.411 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T00:46:40.803 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T00:46:41.199 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T00:46:41.871 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T00:46:42.263 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:46:42.675 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T00:46:43.220 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T00:46:43.743 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T00:46:44.223 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:46:44.735 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T00:46:45.243 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:46:45.867 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T00:46:46.355 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T00:46:46.855 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T00:46:47.391 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T00:46:48.163 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T00:46:48.819 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T00:46:49.483 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T00:46:50.219 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:46:51.007 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:46:51.767 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:46:52.583 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:46:53.383 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:46:54.127 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:46:54.787 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T00:46:55.563 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T00:46:56.169 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T00:46:57.407 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T00:46:58.307 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T00:46:59.356 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T00:47:01.339 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T00:47:03.967 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T00:47:05.532 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T00:47:06.917 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T00:47:08.008 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T00:47:08.772 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T00:47:10.052 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T00:47:11.004 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T00:47:12.216 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T00:47:13.112 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T00:47:14.672 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T00:47:15.920 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T00:47:17.580 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T00:47:19.200 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T00:47:20.388 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T00:47:21.452 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T00:47:22.360 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T00:47:24.364 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T00:47:25.896 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T00:47:27.588 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T00:47:29.164 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T00:47:30.664 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T00:47:32.128 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T00:47:33.344 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T00:47:34.272 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T00:47:35.492 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T00:47:37.364 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T00:47:39.712 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T00:47:40.784 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T00:47:42.344 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T00:47:43.880 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T00:47:45.304 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T00:47:46.888 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T00:47:48.588 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T00:47:50.136 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T00:47:51.624 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T00:47:52.636 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T00:47:53.500 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T00:47:54.372 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T00:47:55.276 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T00:47:56.716 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T00:47:58.184 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T00:47:59.684 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T00:48:01.152 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T00:48:02.620 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T00:48:04.132 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T00:48:05.540 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T00:48:07.040 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T00:48:08.460 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T00:48:09.912 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T00:48:11.436 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T00:48:12.896 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T00:48:13.908 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T00:48:14.925 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T00:48:15.916 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T00:48:16.880 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T00:48:17.723 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T00:48:18.571 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T00:48:19.344 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T00:48:20.124 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T00:48:20.847 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T00:48:21.607 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T00:48:22.343 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T00:48:23.135 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T00:48:23.843 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T00:48:25.087 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T00:48:26.327 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T00:48:27.032 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T00:48:27.751 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T00:48:28.499 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T00:48:29.232 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T00:48:30.439 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T00:48:31.683 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T00:48:32.416 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T00:48:33.187 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T00:48:33.899 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T00:48:34.615 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T00:48:35.379 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T00:48:36.103 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T00:48:36.843 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T00:48:37.671 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T00:48:38.367 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T00:48:39.075 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T00:48:39.803 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T00:48:40.531 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T00:48:41.272 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T00:48:41.983 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T00:48:42.756 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T00:48:43.487 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T00:48:44.219 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T00:49:07.740 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T00:49:08.683 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T00:49:09.395 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T00:49:10.083 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T00:49:10.791 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T00:49:11.499 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T00:49:12.199 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T00:49:12.955 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T00:49:13.639 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T00:49:14.360 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T00:49:15.087 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T00:49:15.787 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T00:49:16.475 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T00:49:17.423 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T00:49:18.207 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T00:49:18.967 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T00:49:19.723 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T00:49:20.495 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T00:49:21.227 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T00:49:21.959 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:49:22.775 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:49:23.487 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:49:24.247 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:49:25.011 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T00:49:25.803 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T00:49:26.543 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T00:49:27.303 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T00:49:28.047 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T00:49:28.791 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T00:49:29.191 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T00:49:29.827 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T00:49:31.304 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T00:49:32.791 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T00:49:33.507 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T00:49:34.251 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T00:49:35.007 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T00:49:35.739 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T00:49:36.519 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T00:49:37.307 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T00:49:38.091 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T00:49:38.835 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T00:49:39.581 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T00:49:40.315 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T00:49:41.043 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T00:49:41.783 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T00:49:42.780 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T00:49:43.867 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T00:49:44.503 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T00:49:45.144 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T00:49:45.731 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T00:49:46.304 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T00:49:46.699 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T00:49:47.091 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T00:49:47.555 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T00:49:48.215 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T00:49:48.843 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T00:49:49.243 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T00:49:49.871 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T00:49:50.627 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T00:49:51.219 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T00:49:51.799 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T00:49:52.959 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T00:49:53.819 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T00:49:54.671 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T00:50:18.032 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T00:50:41.935 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T00:50:42.563 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T00:50:43.243 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T00:50:43.907 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T00:50:44.563 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T00:50:45.403 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T00:50:46.003 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T00:50:46.615 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T00:50:47.367 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T00:50:48.027 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T00:50:48.667 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T00:50:49.307 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T00:50:50.015 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T00:50:50.700 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T00:50:51.315 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T00:50:51.947 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T00:50:52.547 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T00:50:53.268 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T00:50:53.951 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T00:50:54.615 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T00:50:55.275 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T00:50:55.955 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T00:50:56.707 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T00:50:57.287 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T00:50:57.879 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T00:50:58.475 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T00:50:59.047 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T00:50:59.651 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T00:51:00.271 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T00:51:00.955 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T00:51:01.583 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T00:51:02.155 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T00:51:02.823 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T00:51:03.411 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T00:51:04.183 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T00:51:04.779 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T00:51:05.351 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T00:51:05.923 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T00:51:06.551 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T00:51:07.136 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T00:51:07.795 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T00:51:08.359 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T00:51:09.035 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T00:51:09.623 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T00:51:10.348 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T00:51:11.015 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T00:51:11.615 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T00:51:12.319 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T00:51:13.003 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T00:51:14.791 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T00:51:15.527 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T00:51:16.183 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T00:51:16.935 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T00:51:17.747 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T00:51:18.527 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T00:51:19.359 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T00:51:20.099 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T00:51:20.955 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T00:51:21.635 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T00:51:22.471 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T00:51:23.111 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T00:51:23.763 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T00:51:24.376 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T00:51:25.087 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T00:51:25.655 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T00:51:26.087 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T00:51:26.847 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T00:51:27.519 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T00:51:28.211 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T00:51:31.231 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T00:51:31.895 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T00:51:32.563 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T00:51:33.231 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T00:51:33.919 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T00:51:34.503 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T00:51:35.151 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T00:51:35.835 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T00:51:36.587 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T00:51:37.279 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T00:51:37.947 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T00:51:38.619 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T00:51:39.359 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T00:51:40.067 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T00:51:40.932 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T00:51:41.631 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T00:51:42.375 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T00:51:43.071 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T00:51:43.475 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T00:51:43.903 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T00:51:44.295 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T00:51:44.819 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T00:51:45.375 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T00:51:45.903 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T00:51:46.451 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T00:51:47.043 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T00:51:47.447 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T00:51:47.879 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T00:51:48.403 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T00:51:48.803 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T00:51:49.203 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T00:51:49.603 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T00:51:49.999 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T00:51:50.563 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T00:51:51.139 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T00:51:51.791 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T00:51:52.347 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T00:51:52.903 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T00:51:53.491 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T00:51:54.063 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T00:51:54.695 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T00:51:55.295 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T00:51:55.851 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T00:51:56.535 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T00:51:57.211 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T00:51:57.963 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T00:51:58.643 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T00:51:59.376 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T00:52:00.107 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T00:52:00.827 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T00:52:01.511 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T00:52:02.247 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T00:52:02.807 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T00:52:03.635 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T00:52:04.375 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T00:52:05.119 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T00:52:05.899 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T00:52:06.663 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T00:52:07.719 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T00:52:08.639 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T00:52:09.663 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T00:52:10.663 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T00:52:11.608 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T00:52:12.243 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T00:52:12.927 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T00:52:13.591 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T00:52:14.355 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T00:52:15.035 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T00:52:15.799 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T00:52:16.843 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T00:52:17.859 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T00:52:18.881 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T00:52:19.927 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T00:52:20.987 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T00:52:22.011 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T00:52:23.019 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T00:52:24.003 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T00:52:25.123 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T00:52:26.039 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T00:52:27.015 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T00:52:27.995 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T00:52:29.239 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T00:52:30.403 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T00:52:30.831 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T00:52:31.259 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T00:52:31.655 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T00:52:32.351 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T00:52:33.003 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T00:52:33.507 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T00:52:34.035 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T00:52:34.863 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T00:52:36.543 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T00:52:37.351 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T00:52:38.083 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T00:52:39.123 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T00:52:39.931 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T00:52:40.691 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T00:52:41.439 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T00:52:42.155 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T00:52:43.157 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T00:52:43.951 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T00:52:44.919 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T00:52:45.727 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T00:52:46.795 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T00:52:47.839 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T00:52:48.448 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T00:52:49.023 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T00:52:50.947 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T00:52:51.767 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T00:52:54.835 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T00:52:55.511 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T00:52:56.327 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T00:52:57.727 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T00:52:58.479 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T00:52:59.839 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T00:53:02.935 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T00:53:06.655 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T00:53:11.291 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T00:53:28.171 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T00:53:30.743 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T00:53:35.295 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T00:53:36.311 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T00:53:37.495 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T00:53:38.739 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T00:53:39.739 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T00:53:40.435 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T00:53:41.755 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T00:53:42.591 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T00:53:43.347 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T00:53:44.063 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T00:53:59.631 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T00:54:02.151 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T00:54:02.895 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T00:54:03.539 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T00:54:04.243 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T00:54:09.707 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T00:54:13.495 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T00:54:17.140 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T00:54:17.847 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T00:54:18.591 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T00:54:19.319 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T00:54:20.071 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T00:54:20.767 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T00:54:21.475 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T00:54:22.199 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T00:54:23.051 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T00:54:24.083 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T00:54:25.219 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T00:54:26.335 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T00:54:27.615 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T00:54:28.995 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T00:54:29.903 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T00:54:31.003 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T00:54:32.267 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T00:54:33.251 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T00:54:34.031 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T00:54:35.160 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T00:54:35.919 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T00:54:40.651 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T00:54:41.380 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T00:54:42.083 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T00:54:42.795 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T00:54:43.483 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T00:54:44.563 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T00:54:53.279 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T00:54:54.383 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T00:54:55.247 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T00:54:56.295 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T00:54:57.451 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T00:55:01.327 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T00:55:02.371 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T00:55:06.947 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T00:55:23.235 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T00:55:27.231 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T00:55:28.931 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T00:55:30.779 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T00:55:31.795 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T00:55:32.803 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T00:55:33.659 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T00:55:34.675 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T00:55:35.687 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T00:55:36.703 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T00:55:37.279 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T00:55:37.927 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T00:55:38.547 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T00:55:39.131 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T00:55:39.771 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T00:55:40.463 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T00:55:41.059 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T00:55:41.647 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T00:55:42.355 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T00:55:42.935 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T00:55:43.547 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T00:55:44.127 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T00:55:44.699 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T00:55:45.363 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T00:55:46.007 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T00:55:46.687 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T00:55:47.351 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T00:55:48.047 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T00:55:48.711 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T00:55:49.375 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T00:55:50.051 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T00:55:50.671 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T00:55:51.255 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T00:55:51.835 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T00:55:52.439 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T00:55:57.723 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T00:56:03.131 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T00:56:04.963 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T00:56:05.611 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T00:57:07.367 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T00:58:08.419 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T00:58:09.099 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T00:58:09.807 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T00:58:10.407 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T00:58:11.003 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T00:58:15.067 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T00:58:16.623 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T00:58:18.256 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T00:58:18.971 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T00:58:19.675 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T00:58:20.383 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T00:58:21.087 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T00:58:21.791 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T00:58:22.499 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T00:58:23.167 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T00:58:23.947 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T00:58:24.663 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T00:58:25.443 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T00:58:26.171 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T00:58:26.831 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T00:58:27.911 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T00:58:29.019 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T00:58:29.967 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T00:58:30.755 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T00:58:31.723 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T00:58:32.600 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T00:58:33.479 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T00:58:34.455 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T00:58:35.367 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T00:58:36.404 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T00:58:37.367 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T00:58:38.043 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T00:58:38.739 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T00:58:39.463 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T00:58:40.384 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T00:58:41.371 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T00:58:42.379 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T00:58:43.787 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T00:58:47.599 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T00:58:48.525 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T00:58:49.520 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T00:58:50.404 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T00:58:51.700 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T00:58:52.803 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T00:58:53.612 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T00:58:54.592 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T00:58:55.216 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T00:58:55.840 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T00:58:56.464 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T00:58:57.056 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T00:58:57.835 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T00:58:58.419 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T00:58:59.403 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T00:59:00.016 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T00:59:00.579 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T00:59:01.164 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T00:59:01.728 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T00:59:02.339 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T00:59:02.955 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T00:59:03.624 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T00:59:04.215 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T00:59:04.815 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T00:59:05.391 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T00:59:06.071 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T00:59:06.708 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T00:59:07.435 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T00:59:08.095 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T00:59:08.752 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T00:59:09.416 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T00:59:10.188 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T00:59:10.883 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T00:59:11.667 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T00:59:12.335 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T00:59:13.015 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T00:59:13.724 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T00:59:14.512 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T00:59:15.264 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T00:59:15.968 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T00:59:16.615 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T00:59:17.256 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T00:59:18.000 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T00:59:18.728 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T00:59:19.360 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T00:59:20.071 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T00:59:20.899 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T00:59:21.536 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T00:59:22.184 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T00:59:22.788 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T00:59:33.260 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T00:59:33.979 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T00:59:44.388 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T00:59:45.104 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T00:59:46.064 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T00:59:46.680 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T00:59:47.272 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T00:59:47.940 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T00:59:48.616 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T00:59:49.252 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T00:59:49.868 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T00:59:50.548 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T00:59:51.204 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T00:59:51.944 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T00:59:52.588 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T00:59:53.327 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T00:59:54.040 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T00:59:54.664 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T00:59:55.288 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T00:59:56.171 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T00:59:58.228 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T00:59:58.823 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T00:59:59.503 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:00:00.163 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:00:00.968 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T01:00:01.839 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T01:00:02.523 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T01:00:03.604 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T01:00:04.908 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T01:00:05.664 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T01:00:13.024 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T01:00:20.176 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T01:00:20.776 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T01:00:21.628 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T01:00:23.572 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T01:00:25.436 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T01:00:26.896 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T01:00:27.916 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T01:00:28.952 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T01:00:29.944 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T01:00:30.572 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T01:00:31.912 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T01:00:33.428 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T01:00:36.140 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T01:00:37.572 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T01:00:38.496 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T01:00:39.195 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T01:00:39.859 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T01:00:40.912 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T01:00:41.916 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T01:00:42.951 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T01:00:43.764 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T01:00:44.784 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T01:00:45.720 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T01:00:46.836 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T01:00:47.888 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T01:00:48.216 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T01:00:49.548 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T01:00:50.900 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T01:00:51.987 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T01:00:52.936 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T01:00:53.744 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T01:01:04.040 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T01:01:04.404 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T01:01:05.311 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T01:01:06.067 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T01:01:06.703 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T01:01:07.540 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T01:01:07.584 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T01:01:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.584 INFO:teuthology.orchestra.run.smithi138.stdout:=============================== warnings summary =============================== 2024-09-12T01:01:07.584 INFO:teuthology.orchestra.run.smithi138.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T01:01:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T01:01:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: import imp 2024-09-12T01:01:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.584 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py:120 2024-09-12T01:01:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:01:07.584 INFO:teuthology.orchestra.run.smithi138.stdout: if boto_type is 'S3Connection': 2024-09-12T01:01:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.585 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_headers.py:124 2024-09-12T01:01:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:01:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T01:01:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.585 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3.py:359 2024-09-12T01:01:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-12T01:01:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T01:01:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.585 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T01:01:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:01:07.585 INFO:teuthology.orchestra.run.smithi138.stdout: if k is 'BucketName': 2024-09-12T01:01:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.586 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T01:01:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T01:01:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: @pytest.mark.timeout(10) 2024-09-12T01:01:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.586 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T01:01:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T01:01:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T01:01:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.586 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T01:01:07.586 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:01:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:01:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.587 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T01:01:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:01:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:01:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.587 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T01:01:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:01:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T01:01:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.587 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T01:01:07.587 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:01:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:01:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.588 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T01:01:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:01:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:01:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.588 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T01:01:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:01:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:01:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.588 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T01:01:07.588 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:01:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T01:01:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.589 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T01:01:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:01:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:01:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.589 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T01:01:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:01:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:01:07.589 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.590 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T01:01:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:01:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:01:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.590 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T01:01:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T01:01:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:01:07.590 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.590 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-12T01:01:07.590 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-12T01:01:07.590 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-12T01:01:07.590 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-12T01:01:07.590 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-12T01:01:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi138.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:01:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: warnings.warn( 2024-09-12T01:01:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.591 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T01:01:07.591 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T01:01:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:6540: DeprecationWarning: ssl.wrap_socket() is deprecated, use SSLContext.wrap_socket() 2024-09-12T01:01:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: s = ssl.wrap_socket(s); 2024-09-12T01:01:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.591 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T01:01:07.591 INFO:teuthology.orchestra.run.smithi138.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-09-12T01:01:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: /usr/lib/python3.10/ssl.py:1434: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated 2024-09-12T01:01:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: context = SSLContext(ssl_version) 2024-09-12T01:01:07.591 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:01:07.591 INFO:teuthology.orchestra.run.smithi138.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T01:01:07.592 INFO:teuthology.orchestra.run.smithi138.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 666 warnings in 914.44s (0:15:14) = 2024-09-12T01:01:07.769 INFO:teuthology.orchestra.run.smithi138.stdout:___________________________________ summary ____________________________________ 2024-09-12T01:01:07.769 INFO:teuthology.orchestra.run.smithi138.stdout: py: commands succeeded 2024-09-12T01:01:07.769 INFO:teuthology.orchestra.run.smithi138.stdout: congratulations :) 2024-09-12T01:01:07.808 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T01:01:07.809 DEBUG:teuthology.orchestra.run.smithi138:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:01:07.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:01:07.909 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T01:01:07.909 DEBUG:teuthology.orchestra.run.smithi138:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T01:01:07.915 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T01:01:07.915 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:01:08.106 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T01:01:08.123 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:01:08.123 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T01:01:08.123 DEBUG:teuthology.orchestra.run.smithi138:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:01:08.129 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:01:08.130 INFO:teuthology.orchestra.run.smithi138.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T01:01:08.130 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:01:08.176 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T01:01:08.177 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T01:01:08.225 INFO:tasks.workunit:timeout=3h 2024-09-12T01:01:08.225 INFO:tasks.workunit:cleanup=True 2024-09-12T01:01:08.225 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:01:08.279 INFO:tasks.workunit.client.0.smithi138.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T01:01:52.772 INFO:tasks.workunit.client.0.smithi138.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T01:01:52.772 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T01:01:52.772 INFO:tasks.workunit.client.0.smithi138.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T01:01:52.772 INFO:tasks.workunit.client.0.smithi138.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T01:01:52.772 INFO:tasks.workunit.client.0.smithi138.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T01:01:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T01:01:52.773 INFO:tasks.workunit.client.0.smithi138.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T01:01:52.773 INFO:tasks.workunit.client.0.smithi138.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T01:01:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T01:01:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: git switch -c 2024-09-12T01:01:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T01:01:52.773 INFO:tasks.workunit.client.0.smithi138.stderr:Or undo this operation with: 2024-09-12T01:01:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T01:01:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: git switch - 2024-09-12T01:01:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T01:01:52.773 INFO:tasks.workunit.client.0.smithi138.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T01:01:52.773 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T01:01:52.773 INFO:tasks.workunit.client.0.smithi138.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T01:01:52.779 DEBUG:teuthology.orchestra.run.smithi138:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T01:01:52.826 INFO:tasks.workunit.client.0.smithi138.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T01:01:52.829 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:01:52.829 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T01:01:52.885 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T01:01:52.941 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T01:01:52.982 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:01:52.983 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:01:52.983 INFO:tasks.workunit.client.0.smithi138.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T01:01:53.028 INFO:tasks.workunit.client.0.smithi138.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:01:53.031 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-09-12T01:01:53.031 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T01:01:53.076 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T01:01:53.078 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T01:01:53.078 DEBUG:teuthology.orchestra.run.smithi138:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:01:53.129 INFO:tasks.workunit.client.0.smithi138.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:01:53.130 INFO:tasks.workunit.client.0.smithi138.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:01:53.130 INFO:tasks.workunit.client.0.smithi138.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:01:55.951 INFO:tasks.workunit.client.0.smithi138.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T01:01:55.952 INFO:tasks.workunit.client.0.smithi138.stderr:++ deactivate nondestructive 2024-09-12T01:01:55.952 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-12T01:01:55.952 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-12T01:01:55.952 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:01:55.952 INFO:tasks.workunit.client.0.smithi138.stderr:++ hash -r 2024-09-12T01:01:55.952 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-12T01:01:55.952 INFO:tasks.workunit.client.0.smithi138.stderr:++ unset VIRTUAL_ENV 2024-09-12T01:01:55.952 INFO:tasks.workunit.client.0.smithi138.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T01:01:55.952 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T01:01:55.952 INFO:tasks.workunit.client.0.smithi138.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:01:55.953 INFO:tasks.workunit.client.0.smithi138.stderr:++ export VIRTUAL_ENV 2024-09-12T01:01:55.953 INFO:tasks.workunit.client.0.smithi138.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T01:01:55.953 INFO:tasks.workunit.client.0.smithi138.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T01:01:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:++ export PATH 2024-09-12T01:01:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n '' ']' 2024-09-12T01:01:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -z '' ']' 2024-09-12T01:01:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T01:01:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:++ PS1='(rgw) ' 2024-09-12T01:01:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:++ export PS1 2024-09-12T01:01:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T01:01:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T01:01:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:01:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:++ hash -r 2024-09-12T01:01:55.954 INFO:tasks.workunit.client.0.smithi138.stderr:+ pip install pip --upgrade 2024-09-12T01:01:56.347 INFO:tasks.workunit.client.0.smithi138.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T01:01:56.554 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting pip 2024-09-12T01:01:56.560 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T01:01:56.593 INFO:tasks.workunit.client.0.smithi138.stdout:Installing collected packages: pip 2024-09-12T01:01:56.594 INFO:tasks.workunit.client.0.smithi138.stdout: Attempting uninstall: pip 2024-09-12T01:01:56.594 INFO:tasks.workunit.client.0.smithi138.stdout: Found existing installation: pip 22.0.2 2024-09-12T01:01:56.849 INFO:tasks.workunit.client.0.smithi138.stdout: Uninstalling pip-22.0.2: 2024-09-12T01:01:56.855 INFO:tasks.workunit.client.0.smithi138.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T01:01:57.612 INFO:tasks.workunit.client.0.smithi138.stdout:Successfully installed pip-24.2 2024-09-12T01:01:57.678 INFO:tasks.workunit.client.0.smithi138.stderr:+ pip install boto3 2024-09-12T01:01:58.708 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting boto3 2024-09-12T01:01:58.710 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T01:01:59.202 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T01:01:59.203 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T01:01:59.254 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T01:01:59.255 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T01:01:59.312 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T01:01:59.312 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T01:01:59.384 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:01:59.385 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T01:01:59.486 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:01:59.488 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T01:01:59.674 INFO:tasks.workunit.client.0.smithi138.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:01:59.675 INFO:tasks.workunit.client.0.smithi138.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T01:01:59.678 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T01:01:59.680 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T01:01:59.689 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T01:01:59.690 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T01:01:59.691 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T01:01:59.693 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T01:01:59.694 INFO:tasks.workunit.client.0.smithi138.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T01:01:59.762 INFO:tasks.workunit.client.0.smithi138.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T01:02:00.914 INFO:tasks.workunit.client.0.smithi138.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T01:02:01.126 INFO:tasks.workunit.client.0.smithi138.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T01:02:01.261 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T01:02:01.300 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:01.300 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:01.342 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.343+0000 7f1958b7d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.347+0000 7f1958b7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.347+0000 7f1958b7d9c0 20 realm 2024-09-12T01:02:01.344 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.347+0000 7f1958b7d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.347+0000 7f1958b7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.347+0000 7f1958b7d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:01.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.347+0000 7f1958b7d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.347+0000 7f1958b7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.345 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.347+0000 7f1958b7d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.347+0000 7f1958b7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:01.346 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.347+0000 7f1958b7d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.347+0000 7f1958b7d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:01.347 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.347+0000 7f1958b7d9c0 20 searching for the correct realm 2024-09-12T01:02:01.353 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.355+0000 7f1956e84640 0 -- 172.21.15.138:0/2688363115 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f195006bfb0 msgr2=0x7f19500968c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:01.359 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.359+0000 7f1956683640 0 -- 172.21.15.138:0/2688363115 >> [v2:172.21.15.178:6811/2062234204,v1:172.21.15.178:6813/2062234204] conn(0x7f19480f9a10 msgr2=0x7f194812b1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:02:01.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T01:02:01.365 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:01.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T01:02:01.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:01.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:01.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:01.366 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:01.368 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:01.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 zone default found 2024-09-12T01:02:01.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 4 Realm: () 2024-09-12T01:02:01.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T01:02:01.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T01:02:01.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:01.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 zonegroup default 2024-09-12T01:02:01.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.369 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.367+0000 7f1958b7d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.371+0000 7f1958b7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.371+0000 7f1958b7d9c0 20 started sync module instance, tier type = 2024-09-12T01:02:01.370 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.371+0000 7f1958b7d9c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T01:02:01.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.387+0000 7f1958b7d9c0 20 add_watcher() i=0 2024-09-12T01:02:01.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.387+0000 7f1958b7d9c0 20 add_watcher() i=1 2024-09-12T01:02:01.387 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.387+0000 7f1958b7d9c0 20 add_watcher() i=2 2024-09-12T01:02:01.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.387+0000 7f1958b7d9c0 20 add_watcher() i=3 2024-09-12T01:02:01.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.387+0000 7f1958b7d9c0 20 add_watcher() i=4 2024-09-12T01:02:01.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.387+0000 7f1958b7d9c0 20 add_watcher() i=5 2024-09-12T01:02:01.388 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.387+0000 7f1958b7d9c0 20 add_watcher() i=6 2024-09-12T01:02:01.389 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.391+0000 7f1958b7d9c0 20 add_watcher() i=7 2024-09-12T01:02:01.390 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.391+0000 7f1958b7d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:01.392 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f180cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:01.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f1958b7d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:01.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f1958b7d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:01.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f1958b7d9c0 5 note: GC not initialized 2024-09-12T01:02:01.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f17877fe640 20 reqs_thread_entry: start 2024-09-12T01:02:01.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f1958b7d9c0 20 init_complete bucket index max shards: 11 2024-09-12T01:02:01.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f1958b7d9c0 20 Filter name: none 2024-09-12T01:02:01.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f17857fa640 20 reqs_thread_entry: start 2024-09-12T01:02:01.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f1958b7d9c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T01:02:01.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f1958b7d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f1958b7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.394 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f1958b7d9c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T01:02:01.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f1958b7d9c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:02:01.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f1958b7d9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T01:02:01.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f1958b7d9c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f1958b7d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f1958b7d9c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T01:02:01.395 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f1958b7d9c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:02:01.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f1958b7d9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:02:01.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.395+0000 7f1958b7d9c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:02:01.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.399+0000 7f1958b7d9c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:02:01.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.399+0000 7f1958b7d9c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:02:01.396 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.399+0000 7f1958b7d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T01:02:01.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.399+0000 7f1839ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051237135 cookie 94103498457056 notifier 9378 bl.length()=613 2024-09-12T01:02:01.397 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.399+0000 7f1839ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:02:01.398 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.399+0000 7f1839ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:02:01.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.403+0000 7f1958b7d9c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:02:01.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.403+0000 7f1958b7d9c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:02:01.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.403+0000 7f1958b7d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T01:02:01.401 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.403+0000 7f18397fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051237136 cookie 94103498447840 notifier 9378 bl.length()=191 2024-09-12T01:02:01.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.403+0000 7f18397fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:02:01.402 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.403+0000 7f18397fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:02:01.403 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.403+0000 7f180cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:01.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.407+0000 7f1958b7d9c0 20 remove_watcher() i=0 2024-09-12T01:02:01.407 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.407+0000 7f1958b7d9c0 2 removed watcher, disabling cache 2024-09-12T01:02:01.409 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.411+0000 7f1958b7d9c0 20 remove_watcher() i=1 2024-09-12T01:02:01.410 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.411+0000 7f1958b7d9c0 20 remove_watcher() i=2 2024-09-12T01:02:01.412 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.415+0000 7f1958b7d9c0 20 remove_watcher() i=3 2024-09-12T01:02:01.414 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.415+0000 7f1958b7d9c0 20 remove_watcher() i=4 2024-09-12T01:02:01.417 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.419+0000 7f1958b7d9c0 20 remove_watcher() i=5 2024-09-12T01:02:01.419 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.419+0000 7f1958b7d9c0 20 remove_watcher() i=6 2024-09-12T01:02:01.424 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.423+0000 7f1958b7d9c0 20 remove_watcher() i=7 2024-09-12T01:02:01.563 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:01.563 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:01.608 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:01.609 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:01.658 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:01.658 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:01.685 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:01.685 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:01.691 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T01:02:01.691 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T01:02:01.694 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:01.694 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:01.715 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:01.715 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:01.733 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:01.733 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:01.760 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:02:01.793 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:01.793 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:01.835 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.835+0000 7fb8627559c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.839+0000 7fb8627559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.839+0000 7fb8627559c0 20 realm 2024-09-12T01:02:01.838 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.839+0000 7fb8627559c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.839+0000 7fb8627559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.839+0000 7fb8627559c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:01.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.839+0000 7fb8627559c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.839+0000 7fb8627559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.839 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.839+0000 7fb8627559c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.839+0000 7fb8627559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:01.840 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.839+0000 7fb8627559c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.843+0000 7fb8627559c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:01.841 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.843+0000 7fb8627559c0 20 searching for the correct realm 2024-09-12T01:02:01.844 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.847+0000 7fb85fa5a640 0 -- 172.21.15.138:0/416147929 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7fb85408a040 msgr2=0x7fb854069ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:01.851 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.851+0000 7fb85fa5a640 0 -- 172.21.15.138:0/416147929 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55da4b6e48a0 msgr2=0x55da4b6e6c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:01.858 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.859+0000 7fb8627559c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T01:02:01.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.859+0000 7fb8627559c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:01.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.859+0000 7fb8627559c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T01:02:01.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.859+0000 7fb8627559c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:01.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.859+0000 7fb8627559c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:01.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.859+0000 7fb8627559c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:01.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.859+0000 7fb8627559c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.859 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.859+0000 7fb8627559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.859+0000 7fb8627559c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.859+0000 7fb8627559c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:01.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.859+0000 7fb8627559c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.863+0000 7fb8627559c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:01.860 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.863+0000 7fb8627559c0 20 zone default found 2024-09-12T01:02:01.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.863+0000 7fb8627559c0 4 Realm: () 2024-09-12T01:02:01.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.863+0000 7fb8627559c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T01:02:01.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.863+0000 7fb8627559c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T01:02:01.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.863+0000 7fb8627559c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:01.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.863+0000 7fb8627559c0 20 zonegroup default 2024-09-12T01:02:01.861 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.863+0000 7fb8627559c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.863+0000 7fb8627559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.863+0000 7fb8627559c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.863+0000 7fb8627559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.863+0000 7fb8627559c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.863+0000 7fb8627559c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.862 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.863+0000 7fb8627559c0 20 started sync module instance, tier type = 2024-09-12T01:02:01.863 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.863+0000 7fb8627559c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T01:02:01.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.879+0000 7fb8627559c0 20 add_watcher() i=0 2024-09-12T01:02:01.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.879+0000 7fb8627559c0 20 add_watcher() i=1 2024-09-12T01:02:01.879 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.879+0000 7fb8627559c0 20 add_watcher() i=2 2024-09-12T01:02:01.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.879+0000 7fb8627559c0 20 add_watcher() i=3 2024-09-12T01:02:01.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.879+0000 7fb8627559c0 20 add_watcher() i=4 2024-09-12T01:02:01.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.879+0000 7fb8627559c0 20 add_watcher() i=5 2024-09-12T01:02:01.880 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.879+0000 7fb8627559c0 20 add_watcher() i=6 2024-09-12T01:02:01.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.883+0000 7fb8627559c0 20 add_watcher() i=7 2024-09-12T01:02:01.882 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.883+0000 7fb8627559c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:01.885 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.887+0000 7fb716fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:01.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.887+0000 7fb8627559c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:01.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.887+0000 7fb8627559c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:01.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.887+0000 7fb8627559c0 5 note: GC not initialized 2024-09-12T01:02:01.886 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.887+0000 7fb715fdb640 20 reqs_thread_entry: start 2024-09-12T01:02:01.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.887+0000 7fb8627559c0 20 init_complete bucket index max shards: 11 2024-09-12T01:02:01.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.887+0000 7fb8627559c0 20 Filter name: none 2024-09-12T01:02:01.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.887+0000 7fb6877fe640 20 reqs_thread_entry: start 2024-09-12T01:02:01.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.887+0000 7fb8627559c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.887+0000 7fb8627559c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:02:01.887 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.887+0000 7fb8627559c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.887+0000 7fb8627559c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:02:01.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.887+0000 7fb8627559c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:02:01.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.887+0000 7fb8627559c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T01:02:01.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.887+0000 7fb8627559c0 20 INFO: main: starting shard=0 2024-09-12T01:02:01.888 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.887+0000 7fb8627559c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.0 2024-09-12T01:02:01.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.891+0000 7fb8627559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:01.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.891+0000 7fb8627559c0 20 INFO: main: starting shard=1 2024-09-12T01:02:01.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.891+0000 7fb8627559c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.1 2024-09-12T01:02:01.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.891+0000 7fb8627559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:01.889 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.891+0000 7fb8627559c0 20 INFO: main: starting shard=2 2024-09-12T01:02:01.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.891+0000 7fb8627559c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.2 2024-09-12T01:02:01.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.891+0000 7fb8627559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:01.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.891+0000 7fb8627559c0 20 INFO: main: starting shard=3 2024-09-12T01:02:01.890 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.891+0000 7fb8627559c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.3 2024-09-12T01:02:01.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.895+0000 7fb8627559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:01.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.895+0000 7fb8627559c0 20 INFO: main: starting shard=4 2024-09-12T01:02:01.892 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.895+0000 7fb8627559c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.4 2024-09-12T01:02:01.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.895+0000 7fb8627559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:01.893 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.895+0000 7fb8627559c0 20 INFO: main: starting shard=5 2024-09-12T01:02:01.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.895+0000 7fb8627559c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.5 2024-09-12T01:02:01.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.895+0000 7fb8627559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:01.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.895+0000 7fb8627559c0 20 INFO: main: starting shard=6 2024-09-12T01:02:01.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.895+0000 7fb8627559c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.6 2024-09-12T01:02:01.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.895+0000 7fb8627559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:01.894 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.895+0000 7fb8627559c0 20 INFO: main: starting shard=7 2024-09-12T01:02:01.895 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.895+0000 7fb8627559c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.7 2024-09-12T01:02:01.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.895+0000 7fb8627559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:01.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.895+0000 7fb8627559c0 20 INFO: main: starting shard=8 2024-09-12T01:02:01.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.895+0000 7fb8627559c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.8 2024-09-12T01:02:01.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.899+0000 7fb8627559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:01.896 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.899+0000 7fb8627559c0 20 INFO: main: starting shard=9 2024-09-12T01:02:01.897 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.899+0000 7fb8627559c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.9 2024-09-12T01:02:01.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.899+0000 7fb8627559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:01.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.899+0000 7fb8627559c0 20 INFO: main: starting shard=10 2024-09-12T01:02:01.898 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.899+0000 7fb8627559c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.10 2024-09-12T01:02:01.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.899+0000 7fb8627559c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:01.899 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.899+0000 7fb8627559c0 20 INFO: main: done 2024-09-12T01:02:01.900 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.903+0000 7fb716fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:01.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.903+0000 7fb8627559c0 20 remove_watcher() i=0 2024-09-12T01:02:01.904 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.903+0000 7fb8627559c0 2 removed watcher, disabling cache 2024-09-12T01:02:01.905 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.907+0000 7fb8627559c0 20 remove_watcher() i=1 2024-09-12T01:02:01.907 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.907+0000 7fb8627559c0 20 remove_watcher() i=2 2024-09-12T01:02:01.909 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.911+0000 7fb8627559c0 20 remove_watcher() i=3 2024-09-12T01:02:01.911 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.911+0000 7fb8627559c0 20 remove_watcher() i=4 2024-09-12T01:02:01.913 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.915+0000 7fb8627559c0 20 remove_watcher() i=5 2024-09-12T01:02:01.915 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.915+0000 7fb8627559c0 20 remove_watcher() i=6 2024-09-12T01:02:01.918 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:01.919+0000 7fb8627559c0 20 remove_watcher() i=7 2024-09-12T01:02:01.929 INFO:tasks.workunit.client.0.smithi138.stderr:rados -p default.rgw.buckets.data ls | grep 76faa022-7f81-4f4f-aa73-466d4c57ef88 2024-09-12T01:02:01.949 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:01.949 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:02.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:02.099+0000 7fd7a1042640 0 -- 172.21.15.138:0/4042394108 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7fd7980b85e0 msgr2=0x7fd7980b8a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:02.113 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T01:02:02.113 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T01:02:02.114 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:02:03.534 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:03.534 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:03.554 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:02:03.996 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:02:04.026 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:04.026 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:04.068 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.071+0000 7f5b02b479c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.071+0000 7f5b02b479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.071+0000 7f5b02b479c0 20 realm 2024-09-12T01:02:04.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.071+0000 7f5b02b479c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.071 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.071+0000 7f5b02b479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.071+0000 7f5b02b479c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:04.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.071+0000 7f5b02b479c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.071+0000 7f5b02b479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.071+0000 7f5b02b479c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.072 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.075+0000 7f5b02b479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:04.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.075+0000 7f5b02b479c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.075+0000 7f5b02b479c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:04.073 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.075+0000 7f5b02b479c0 20 searching for the correct realm 2024-09-12T01:02:04.076 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.075+0000 7f5b0064d640 0 -- 172.21.15.138:0/3774718231 >> [v2:172.21.15.138:6816/3496313381,v1:172.21.15.138:6817/3496313381] conn(0x7f5af003e040 msgr2=0x7f5af003e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:04.081 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.083+0000 7f5b00e4e640 0 -- 172.21.15.138:0/3774718231 >> [v2:172.21.15.178:6809/1109288734,v1:172.21.15.178:6812/1109288734] conn(0x56003332a2d0 msgr2=0x56003332c790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:04.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T01:02:04.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:04.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T01:02:04.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:04.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:04.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:04.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.094 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:04.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:04.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 zone default found 2024-09-12T01:02:04.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 4 Realm: () 2024-09-12T01:02:04.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T01:02:04.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T01:02:04.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:04.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 zonegroup default 2024-09-12T01:02:04.095 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.096 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 started sync module instance, tier type = 2024-09-12T01:02:04.097 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.095+0000 7f5b02b479c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T01:02:04.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.115+0000 7f5b02b479c0 20 add_watcher() i=0 2024-09-12T01:02:04.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.115+0000 7f5b02b479c0 20 add_watcher() i=1 2024-09-12T01:02:04.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.115+0000 7f5b02b479c0 20 add_watcher() i=2 2024-09-12T01:02:04.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.115+0000 7f5b02b479c0 20 add_watcher() i=3 2024-09-12T01:02:04.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.115+0000 7f5b02b479c0 20 add_watcher() i=4 2024-09-12T01:02:04.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.115+0000 7f5b02b479c0 20 add_watcher() i=5 2024-09-12T01:02:04.115 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.115+0000 7f5b02b479c0 20 add_watcher() i=6 2024-09-12T01:02:04.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.119+0000 7f5b02b479c0 20 add_watcher() i=7 2024-09-12T01:02:04.117 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.119+0000 7f5b02b479c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:04.120 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f59b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:04.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f5b02b479c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:04.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f5b02b479c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:04.121 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f5b02b479c0 5 note: GC not initialized 2024-09-12T01:02:04.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f59b5fdb640 20 reqs_thread_entry: start 2024-09-12T01:02:04.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f5b02b479c0 20 init_complete bucket index max shards: 11 2024-09-12T01:02:04.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f5b02b479c0 20 Filter name: none 2024-09-12T01:02:04.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f59277fe640 20 reqs_thread_entry: start 2024-09-12T01:02:04.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f5b02b479c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f5b02b479c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:02:04.122 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f5b02b479c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f5b02b479c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:02:04.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f5b02b479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:02:04.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f5b02b479c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T01:02:04.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f5b02b479c0 20 INFO: main: starting shard=0 2024-09-12T01:02:04.123 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f5b02b479c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.0 2024-09-12T01:02:04.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f5b02b479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:04.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f5b02b479c0 20 INFO: main: starting shard=1 2024-09-12T01:02:04.124 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.123+0000 7f5b02b479c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.1 2024-09-12T01:02:04.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.127+0000 7f5b02b479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:04.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.127+0000 7f5b02b479c0 20 INFO: main: starting shard=2 2024-09-12T01:02:04.125 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.127+0000 7f5b02b479c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.2 2024-09-12T01:02:04.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.127+0000 7f5b02b479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:04.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.127+0000 7f5b02b479c0 20 INFO: main: starting shard=3 2024-09-12T01:02:04.126 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.127+0000 7f5b02b479c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.3 2024-09-12T01:02:04.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.127+0000 7f5b02b479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:04.127 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.127+0000 7f5b02b479c0 20 INFO: main: starting shard=4 2024-09-12T01:02:04.128 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.127+0000 7f5b02b479c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.4 2024-09-12T01:02:04.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.131+0000 7f5b02b479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:04.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.131+0000 7f5b02b479c0 20 INFO: main: starting shard=5 2024-09-12T01:02:04.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.131+0000 7f5b02b479c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.5 2024-09-12T01:02:04.129 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.131+0000 7f5b02b479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:04.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.131+0000 7f5b02b479c0 20 INFO: main: starting shard=6 2024-09-12T01:02:04.130 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.131+0000 7f5b02b479c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.6 2024-09-12T01:02:04.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.131+0000 7f5b02b479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:04.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.131+0000 7f5b02b479c0 20 INFO: main: starting shard=7 2024-09-12T01:02:04.131 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.131+0000 7f5b02b479c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.7 2024-09-12T01:02:04.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.131+0000 7f5b02b479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:04.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.131+0000 7f5b02b479c0 20 INFO: main: starting shard=8 2024-09-12T01:02:04.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.131+0000 7f5b02b479c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.8 2024-09-12T01:02:04.132 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.135+0000 7f5b02b479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:04.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.135+0000 7f5b02b479c0 20 INFO: main: starting shard=9 2024-09-12T01:02:04.133 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.135+0000 7f5b02b479c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.9 2024-09-12T01:02:04.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.135+0000 7f5b02b479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:04.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.135+0000 7f5b02b479c0 20 INFO: main: starting shard=10 2024-09-12T01:02:04.134 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.135+0000 7f5b02b479c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.10 2024-09-12T01:02:04.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.135+0000 7f5b02b479c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:02:04.135 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.135+0000 7f5b02b479c0 20 INFO: main: done 2024-09-12T01:02:04.136 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.135+0000 7f59b6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:04.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.139+0000 7f5b02b479c0 20 remove_watcher() i=0 2024-09-12T01:02:04.140 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.139+0000 7f5b02b479c0 2 removed watcher, disabling cache 2024-09-12T01:02:04.142 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.143+0000 7f5b02b479c0 20 remove_watcher() i=1 2024-09-12T01:02:04.144 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.147+0000 7f5b02b479c0 20 remove_watcher() i=2 2024-09-12T01:02:04.146 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.147+0000 7f5b02b479c0 20 remove_watcher() i=3 2024-09-12T01:02:04.148 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.151+0000 7f5b02b479c0 20 remove_watcher() i=4 2024-09-12T01:02:04.150 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.151+0000 7f5b02b479c0 20 remove_watcher() i=5 2024-09-12T01:02:04.153 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.155+0000 7f5b02b479c0 20 remove_watcher() i=6 2024-09-12T01:02:04.155 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.155+0000 7f5b02b479c0 20 remove_watcher() i=7 2024-09-12T01:02:04.171 INFO:tasks.workunit.client.0.smithi138.stderr:rados -p default.rgw.buckets.data ls | grep d3c27969-5814-4ce9-92f4-067606690b78 2024-09-12T01:02:04.195 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:04.195 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:04.356 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:04.351+0000 7f95f4d31640 0 -- 172.21.15.138:0/4118364191 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x7f95ec00a2c0 msgr2=0x7f95ec00a6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:04.377 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T01:02:04.377 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T01:02:04.379 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:04.379 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:04.388 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:04.388 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:04.417 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:04.417 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:04.420 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:02:05.860 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:05.861 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:05.938 INFO:tasks.workunit.client.0.smithi138.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T01:02:05.938 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:02:06.378 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:06.378 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:06.389 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:06.389 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:06.392 INFO:tasks.workunit.client.0.smithi138.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T01:02:06.392 INFO:tasks.workunit.client.0.smithi138.stderr: 2024-09-12T01:02:06.394 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:06.395 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:06.444 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:06.445 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:06.495 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:06.495 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:06.515 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T01:02:07.965 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:07.965 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:07.976 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:07.976 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:10.005 INFO:tasks.workunit.client.0.smithi138.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T01:02:10.436 INFO:tasks.workunit.client.0.smithi138.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T01:02:10.468 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:10.468 INFO:tasks.workunit.client.0.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:10.506 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.507+0000 7f44adb769c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:10.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.511+0000 7f44adb769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:10.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.511+0000 7f44adb769c0 20 realm 2024-09-12T01:02:10.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.511+0000 7f44adb769c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:10.509 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.511+0000 7f44adb769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:10.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.511+0000 7f44adb769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:10.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.511+0000 7f44adb769c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:10.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.511+0000 7f44adb769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:10.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.511+0000 7f44adb769c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:10.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.511+0000 7f44adb769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:10.510 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.511+0000 7f44adb769c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:10.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.511+0000 7f44adb769c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:10.512 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.511+0000 7f44adb769c0 20 searching for the correct realm 2024-09-12T01:02:10.515 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.515+0000 7f44ab67c640 0 -- 172.21.15.138:0/4086531299 >> [v2:172.21.15.138:6800/1437861584,v1:172.21.15.138:6801/1437861584] conn(0x5568e6d655a0 msgr2=0x5568e6d679d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:10.520 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.523+0000 7f44ab67c640 0 -- 172.21.15.138:0/4086531299 >> [v2:172.21.15.178:6811/2062234204,v1:172.21.15.178:6813/2062234204] conn(0x7f449c06bb80 msgr2=0x7f449c058410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:10.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T01:02:10.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:10.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T01:02:10.737 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:10.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:10.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:10.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:10.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:10.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:10.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:10.738 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:10.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:10.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 20 zone default found 2024-09-12T01:02:10.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 4 Realm: () 2024-09-12T01:02:10.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T01:02:10.739 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T01:02:10.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:10.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 20 zonegroup default 2024-09-12T01:02:10.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.739+0000 7f44adb769c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:10.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.743+0000 7f44adb769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:10.740 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.743+0000 7f44adb769c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:10.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.743+0000 7f44adb769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:10.741 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.743+0000 7f44adb769c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:10.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.743+0000 7f44adb769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:10.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.743+0000 7f44adb769c0 20 started sync module instance, tier type = 2024-09-12T01:02:10.742 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.743+0000 7f44adb769c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T01:02:10.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.763+0000 7f44adb769c0 20 add_watcher() i=0 2024-09-12T01:02:10.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.763+0000 7f44adb769c0 20 add_watcher() i=1 2024-09-12T01:02:10.763 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.763+0000 7f44adb769c0 20 add_watcher() i=2 2024-09-12T01:02:10.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.763+0000 7f44adb769c0 20 add_watcher() i=3 2024-09-12T01:02:10.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.763+0000 7f44adb769c0 20 add_watcher() i=4 2024-09-12T01:02:10.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.763+0000 7f44adb769c0 20 add_watcher() i=5 2024-09-12T01:02:10.764 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.763+0000 7f44adb769c0 20 add_watcher() i=6 2024-09-12T01:02:10.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.767+0000 7f44adb769c0 20 add_watcher() i=7 2024-09-12T01:02:10.766 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.767+0000 7f44adb769c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:10.770 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.771+0000 7f4361fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:10.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.771+0000 7f44adb769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:10.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.771+0000 7f44adb769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:10.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.771+0000 7f44adb769c0 5 note: GC not initialized 2024-09-12T01:02:10.771 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.771+0000 7f4360fe1640 20 reqs_thread_entry: start 2024-09-12T01:02:10.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.771+0000 7f44adb769c0 20 init_complete bucket index max shards: 11 2024-09-12T01:02:10.772 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.771+0000 7f44adb769c0 20 Filter name: none 2024-09-12T01:02:10.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.775+0000 7f42da7fc640 20 reqs_thread_entry: start 2024-09-12T01:02:10.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.775+0000 7f44adb769c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T01:02:10.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.775+0000 7f44adb769c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:10.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.775+0000 7f44adb769c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:02:10.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.775+0000 7f44adb769c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T01:02:10.773 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.775+0000 7f44adb769c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T01:02:10.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.775+0000 7f44adb769c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.782 : miss 2024-09-12T01:02:10.774 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.775+0000 7f44adb769c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:10.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.775+0000 7f44adb769c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:02:10.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.775+0000 7f44adb769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.782 info.flags=0x17 2024-09-12T01:02:10.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.775+0000 7f44adb769c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.782 to cache LRU end 2024-09-12T01:02:10.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.775+0000 7f44adb769c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:02:10.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.775+0000 7f44adb769c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T01:02:10.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.775+0000 7f44adb769c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:e2043445-c131-4520-984d-b4d52f038a6b.4538.782 2024-09-12T01:02:10.775 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.775+0000 7f44adb769c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.0 2024-09-12T01:02:10.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.775+0000 7f44adb769c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T01:02:10.776 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.775+0000 7f44adb769c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.1 2024-09-12T01:02:10.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.779+0000 7f44adb769c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T01:02:10.777 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.779+0000 7f44adb769c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.2 2024-09-12T01:02:10.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.779+0000 7f44adb769c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T01:02:10.778 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.779+0000 7f44adb769c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.3 2024-09-12T01:02:10.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.779+0000 7f44adb769c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T01:02:10.779 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.779+0000 7f44adb769c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.4 2024-09-12T01:02:10.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.783+0000 7f44adb769c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T01:02:10.780 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.783+0000 7f44adb769c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.5 2024-09-12T01:02:10.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.783+0000 7f44adb769c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T01:02:10.781 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.783+0000 7f44adb769c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.6 2024-09-12T01:02:10.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.783+0000 7f44adb769c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T01:02:10.782 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.783+0000 7f44adb769c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.7 2024-09-12T01:02:10.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.783+0000 7f44adb769c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T01:02:10.783 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.783+0000 7f44adb769c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.8 2024-09-12T01:02:10.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.787+0000 7f44adb769c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T01:02:10.784 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.787+0000 7f44adb769c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.9 2024-09-12T01:02:10.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.787+0000 7f44adb769c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T01:02:10.785 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.787+0000 7f44adb769c0 20 bucket index object: :.dir.e2043445-c131-4520-984d-b4d52f038a6b.4538.782.10 2024-09-12T01:02:10.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.787+0000 7f44adb769c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T01:02:10.787 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.787+0000 7f44adb769c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T01:02:10.788 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.791+0000 7f4361fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:10.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.795+0000 7f44adb769c0 20 remove_watcher() i=0 2024-09-12T01:02:10.793 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.795+0000 7f44adb769c0 2 removed watcher, disabling cache 2024-09-12T01:02:10.795 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.795+0000 7f44adb769c0 20 remove_watcher() i=1 2024-09-12T01:02:10.797 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.799+0000 7f44adb769c0 20 remove_watcher() i=2 2024-09-12T01:02:10.799 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.799+0000 7f44adb769c0 20 remove_watcher() i=3 2024-09-12T01:02:10.801 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.803+0000 7f44adb769c0 20 remove_watcher() i=4 2024-09-12T01:02:10.803 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.803+0000 7f44adb769c0 20 remove_watcher() i=5 2024-09-12T01:02:10.807 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.807+0000 7f44adb769c0 20 remove_watcher() i=6 2024-09-12T01:02:10.808 INFO:tasks.workunit.client.0.smithi138.stderr:2024-09-12T01:02:10.811+0000 7f44adb769c0 20 remove_watcher() i=7 2024-09-12T01:02:10.826 INFO:tasks.workunit.client.0.smithi138.stderr:Deleting bucket versioning-bucket 2024-09-12T01:02:10.827 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:10.827 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:10.832 INFO:tasks.workunit.client.0.smithi138.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1099: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-09-12T01:02:10.832 INFO:tasks.workunit.client.0.smithi138.stderr: warnings.warn( 2024-09-12T01:02:10.883 INFO:tasks.workunit.client.0.smithi138.stderr:Completed bucket versioning tests 2024-09-12T01:02:10.883 INFO:tasks.workunit.client.0.smithi138.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T01:02:10.883 INFO:tasks.workunit.client.0.smithi138.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T01:02:10.884 INFO:tasks.workunit.client.0.smithi138.stdout:connected to https://localhost:443 2024-09-12T01:02:10.952 INFO:tasks.workunit.client.0.smithi138.stderr:+ deactivate 2024-09-12T01:02:10.952 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T01:02:10.952 INFO:tasks.workunit.client.0.smithi138.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T01:02:10.952 INFO:tasks.workunit.client.0.smithi138.stderr:+ export PATH 2024-09-12T01:02:10.953 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T01:02:10.953 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n '' ']' 2024-09-12T01:02:10.953 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:02:10.953 INFO:tasks.workunit.client.0.smithi138.stderr:+ hash -r 2024-09-12T01:02:10.953 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' -n '' ']' 2024-09-12T01:02:10.953 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset VIRTUAL_ENV 2024-09-12T01:02:10.953 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T01:02:10.953 INFO:tasks.workunit.client.0.smithi138.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T01:02:10.953 INFO:tasks.workunit.client.0.smithi138.stderr:+ unset -f deactivate 2024-09-12T01:02:10.953 INFO:tasks.workunit.client.0.smithi138.stderr:+ echo OK. 2024-09-12T01:02:10.954 INFO:tasks.workunit.client.0.smithi138.stdout:OK. 2024-09-12T01:02:10.955 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T01:02:10.955 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:02:11.009 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T01:02:11.009 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T01:02:11.431 DEBUG:teuthology.parallel:result is None 2024-09-12T01:02:11.432 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:02:11.445 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:02:11.445 DEBUG:teuthology.orchestra.run.smithi138:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:02:11.493 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:02:11.493 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T01:02:11.503 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T01:02:11.549 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T01:02:11.549 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T01:02:11.549 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T01:02:11.599 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T01:02:11.599 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T01:02:11.631 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:11.631 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:11.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.671+0000 7f117c3a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:11.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.671+0000 7f117c3a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:11.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.671+0000 7f117c3a49c0 20 realm 2024-09-12T01:02:11.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.671+0000 7f117c3a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:11.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.671+0000 7f117c3a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:11.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.671+0000 7f117c3a49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:11.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.671+0000 7f117c3a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:11.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.671+0000 7f117c3a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:11.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.671+0000 7f117c3a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:11.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.675+0000 7f117c3a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:11.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.675+0000 7f117c3a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:11.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.675+0000 7f117c3a49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:11.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.675+0000 7f117c3a49c0 20 searching for the correct realm 2024-09-12T01:02:11.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.679+0000 7f117a6ab640 0 -- 172.21.15.138:0/3023657417 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f116c043580 msgr2=0x7f116c090950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:11.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.895+0000 7f117a6ab640 0 -- 172.21.15.138:0/3023657417 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x5579a0e6f840 msgr2=0x5579a0e71d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:11.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.903+0000 7f117c3a49c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T01:02:11.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.903+0000 7f117c3a49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:11.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.903+0000 7f117c3a49c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T01:02:11.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.903+0000 7f117c3a49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:11.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.903+0000 7f117c3a49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:11.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.903+0000 7f117c3a49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:11.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.903+0000 7f117c3a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:11.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.903+0000 7f117c3a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:11.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.903+0000 7f117c3a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:11.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.907+0000 7f117c3a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:11.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.907+0000 7f117c3a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:11.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.907+0000 7f117c3a49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:11.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.907+0000 7f117c3a49c0 20 zone default found 2024-09-12T01:02:11.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.907+0000 7f117c3a49c0 4 Realm: () 2024-09-12T01:02:11.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.907+0000 7f117c3a49c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T01:02:11.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.907+0000 7f117c3a49c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T01:02:11.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.907+0000 7f117c3a49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:11.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.907+0000 7f117c3a49c0 20 zonegroup default 2024-09-12T01:02:11.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.907+0000 7f117c3a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:11.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.907+0000 7f117c3a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:11.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.907+0000 7f117c3a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:11.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.907+0000 7f117c3a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:11.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.907+0000 7f117c3a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:11.907 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.907+0000 7f117c3a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:11.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.907+0000 7f117c3a49c0 20 started sync module instance, tier type = 2024-09-12T01:02:11.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.907+0000 7f117c3a49c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T01:02:11.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.931+0000 7f117c3a49c0 20 add_watcher() i=0 2024-09-12T01:02:11.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.931+0000 7f117c3a49c0 20 add_watcher() i=1 2024-09-12T01:02:11.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.931+0000 7f117c3a49c0 20 add_watcher() i=2 2024-09-12T01:02:11.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.931+0000 7f117c3a49c0 20 add_watcher() i=3 2024-09-12T01:02:11.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.931+0000 7f117c3a49c0 20 add_watcher() i=4 2024-09-12T01:02:11.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.931+0000 7f117c3a49c0 20 add_watcher() i=5 2024-09-12T01:02:11.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.931+0000 7f117c3a49c0 20 add_watcher() i=6 2024-09-12T01:02:11.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.935+0000 7f117c3a49c0 20 add_watcher() i=7 2024-09-12T01:02:11.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.935+0000 7f117c3a49c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:11.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.939+0000 7f102b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:11.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.939+0000 7f117c3a49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:11.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:11.939+0000 7f117c3a49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:12.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.035+0000 7f102a7fc640 20 reqs_thread_entry: start 2024-09-12T01:02:12.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.035+0000 7f117c3a49c0 20 init_complete bucket index max shards: 11 2024-09-12T01:02:12.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.035+0000 7f117c3a49c0 20 Filter name: none 2024-09-12T01:02:12.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.035+0000 7f0f9bfff640 20 reqs_thread_entry: start 2024-09-12T01:02:12.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.035+0000 7f117c3a49c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T01:02:12.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.035+0000 7f117c3a49c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:12.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.035+0000 7f117c3a49c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T01:02:12.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.035+0000 7f117c3a49c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T01:02:12.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.035+0000 7f117c3a49c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T01:02:12.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.035+0000 7f117c3a49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:02:12.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.035+0000 7f117c3a49c0 10 removing key index: KFNWXWWDHZTAZZNNNEZW 2024-09-12T01:02:12.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.039+0000 7f117c3a49c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:KFNWXWWDHZTAZZNNNEZW, ofs0, ns] 2024-09-12T01:02:12.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.039+0000 7f105d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235968 cookie 93980878912096 notifier 8867 bl.length()=170 2024-09-12T01:02:12.039 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.039+0000 7f117c3a49c0 10 removing email index: tester.client.0_test@test.test 2024-09-12T01:02:12.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.043+0000 7f117c3a49c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T01:02:12.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.043+0000 7f105d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051235585 cookie 93980878913152 notifier 8867 bl.length()=181 2024-09-12T01:02:12.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.043+0000 7f117c3a49c0 10 removing user buckets index 2024-09-12T01:02:12.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.047+0000 7f117c3a49c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T01:02:12.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.047+0000 7f105cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051237139 cookie 93980878928112 notifier 8867 bl.length()=172 2024-09-12T01:02:12.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.047+0000 7f117c3a49c0 10 removing user index: tester.client.0 2024-09-12T01:02:12.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.051+0000 7f117c3a49c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T01:02:12.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.051+0000 7f117c3a49c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T01:02:12.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.051+0000 7f105d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1151051237140 cookie 93980878923120 notifier 8867 bl.length()=164 2024-09-12T01:02:12.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.055+0000 7f102b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:12.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.059+0000 7f117c3a49c0 20 remove_watcher() i=0 2024-09-12T01:02:12.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.059+0000 7f117c3a49c0 2 removed watcher, disabling cache 2024-09-12T01:02:12.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.059+0000 7f117c3a49c0 20 remove_watcher() i=1 2024-09-12T01:02:12.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.063+0000 7f117c3a49c0 20 remove_watcher() i=2 2024-09-12T01:02:12.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.067+0000 7f117c3a49c0 20 remove_watcher() i=3 2024-09-12T01:02:12.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.067+0000 7f117c3a49c0 20 remove_watcher() i=4 2024-09-12T01:02:12.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.071+0000 7f117c3a49c0 20 remove_watcher() i=5 2024-09-12T01:02:12.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.071+0000 7f117c3a49c0 20 remove_watcher() i=6 2024-09-12T01:02:12.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:12.075+0000 7f117c3a49c0 20 remove_watcher() i=7 2024-09-12T01:02:12.090 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T01:02:12.127 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T01:02:12.164 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T01:02:12.209 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T01:02:12.445 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T01:02:12.446 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:02:12.447 INFO:tasks.rgw.client.0.smithi138.stdout:2024-09-12T01:02:12.451+0000 7f47a1746640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 39411) UID: 0 2024-09-12T01:02:12.447 INFO:tasks.rgw.client.0.smithi138.stdout:2024-09-12T01:02:12.451+0000 7f47a4f8ea40 -1 shutting down 2024-09-12T01:02:36.852 INFO:tasks.rgw.client.0:Stopped 2024-09-12T01:02:36.852 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T01:02:36.859 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T01:02:36.914 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T01:02:36.968 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T01:02:36.968 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T01:02:36.969 DEBUG:teuthology.orchestra.run.smithi138:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T01:02:37.047 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:37.047 INFO:teuthology.orchestra.run.smithi138.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:37.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.094+0000 7f2bdc2919c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.094+0000 7f2bdc2919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:37.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.094+0000 7f2bdc2919c0 20 realm 2024-09-12T01:02:37.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.094+0000 7f2bdc2919c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.094+0000 7f2bdc2919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:37.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.094+0000 7f2bdc2919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:37.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.094+0000 7f2bdc2919c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.094+0000 7f2bdc2919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:37.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.094+0000 7f2bdc2919c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.094+0000 7f2bdc2919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:37.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.094+0000 7f2bdc2919c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.098+0000 7f2bdc2919c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:37.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.098+0000 7f2bdc2919c0 20 searching for the correct realm 2024-09-12T01:02:37.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.102+0000 7f2bda598640 0 -- 172.21.15.138:0/2003776050 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f2bd40a9070 msgr2=0x7f2bd40b3400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:02:37.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.110+0000 7f2bda598640 0 -- 172.21.15.138:0/2003776050 >> [v2:172.21.15.178:6808/3653702099,v1:172.21.15.178:6810/3653702099] conn(0x55f000926fe0 msgr2=0x55f0009294a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:37.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 RGWRados::pool_iterate: got zonegroup_info.441b6e70-260d-4e17-95c7-b8ef7b61e770 2024-09-12T01:02:37.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:37.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 RGWRados::pool_iterate: got zone_info.e2043445-c131-4520-984d-b4d52f038a6b 2024-09-12T01:02:37.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:37.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:37.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:37.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:37.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:37.114 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:37.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 zone default found 2024-09-12T01:02:37.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 4 Realm: () 2024-09-12T01:02:37.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 4 ZoneGroup: default (441b6e70-260d-4e17-95c7-b8ef7b61e770) 2024-09-12T01:02:37.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 4 Zone: default (e2043445-c131-4520-984d-b4d52f038a6b) 2024-09-12T01:02:37.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:37.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 zonegroup default 2024-09-12T01:02:37.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.115 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:37.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:37.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 rados->read ofs=0 len=0 2024-09-12T01:02:37.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:37.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 started sync module instance, tier type = 2024-09-12T01:02:37.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.118+0000 7f2bdc2919c0 20 started zone id=e2043445-c131-4520-984d-b4d52f038a6b (name=default) with tier type = 2024-09-12T01:02:37.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.142+0000 7f2bdc2919c0 20 add_watcher() i=0 2024-09-12T01:02:37.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.142+0000 7f2bdc2919c0 20 add_watcher() i=1 2024-09-12T01:02:37.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.142+0000 7f2bdc2919c0 20 add_watcher() i=2 2024-09-12T01:02:37.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.142+0000 7f2bdc2919c0 20 add_watcher() i=3 2024-09-12T01:02:37.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.142+0000 7f2bdc2919c0 20 add_watcher() i=4 2024-09-12T01:02:37.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.142+0000 7f2bdc2919c0 20 add_watcher() i=5 2024-09-12T01:02:37.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.142+0000 7f2bdc2919c0 20 add_watcher() i=6 2024-09-12T01:02:37.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.146+0000 7f2bdc2919c0 20 add_watcher() i=7 2024-09-12T01:02:37.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.146+0000 7f2bdc2919c0 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:37.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.150+0000 7f2a8ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:37.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.150+0000 7f2bdc2919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:37.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.150+0000 7f2bdc2919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:37.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.226+0000 7f2a8efe5640 20 reqs_thread_entry: start 2024-09-12T01:02:37.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.226+0000 7f2bdc2919c0 20 init_complete bucket index max shards: 11 2024-09-12T01:02:37.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.226+0000 7f2bdc2919c0 20 Filter name: none 2024-09-12T01:02:37.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.226+0000 7f2a8cfe1640 20 reqs_thread_entry: start 2024-09-12T01:02:37.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.226+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:02:37.225 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/64007' 2024-09-12T01:02:37.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10659093485033119752', time=2024-09-12T02:48:31.311904+0000, chain.objs.size()=1 2024-09-12T01:02:37.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.244__shadow_.pwnIqPdAEBBJR22VIY5HaY-AgH8UeQz_0 2024-09-12T01:02:37.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18146952772080101270', time=2024-09-12T02:49:05.452298+0000, chain.objs.size()=1 2024-09-12T01:02:37.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.dFDPC7cqzPFG_ronAzdbjid21wiw4yK_0 2024-09-12T01:02:37.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3956484723254752976', time=2024-09-12T02:49:05.533168+0000, chain.objs.size()=1 2024-09-12T01:02:37.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.oQx3pXA7jhxiM3Wej2TbPhW-mIZX-rx_0 2024-09-12T01:02:37.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10761863107067928576', time=2024-09-12T02:49:05.565790+0000, chain.objs.size()=1 2024-09-12T01:02:37.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9-UHomuBSp29Bjyofo60NDf5FPc52_y_0 2024-09-12T01:02:37.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5935642605127819196', time=2024-09-12T02:49:05.574272+0000, chain.objs.size()=1 2024-09-12T01:02:37.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.WE72luM4UuC9PNxyt3w0otFhgNUwihC_0 2024-09-12T01:02:37.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18329011456650232802', time=2024-09-12T02:49:05.722852+0000, chain.objs.size()=1 2024-09-12T01:02:37.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9KsD-qu8LRXB5befrh9MZjPOaISP5aJ_0 2024-09-12T01:02:37.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5089133832710946846', time=2024-09-12T02:49:05.768603+0000, chain.objs.size()=1 2024-09-12T01:02:37.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.VOhbCfYu3X0-ksTIF6F2oIn-gBmSEsC_0 2024-09-12T01:02:37.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17536043239958155185', time=2024-09-12T02:49:05.783692+0000, chain.objs.size()=1 2024-09-12T01:02:37.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.713UJDPAX2RYXBAiiNtT_E9wyL_upqP_0 2024-09-12T01:02:37.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11165238238349275191', time=2024-09-12T02:49:05.797677+0000, chain.objs.size()=1 2024-09-12T01:02:37.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7ySTe4nJqZCB4chS2plmycBCen1xUVV_0 2024-09-12T01:02:37.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2527188257127251250', time=2024-09-12T02:49:05.801905+0000, chain.objs.size()=1 2024-09-12T01:02:37.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.YMzbycbec0BRBFQ_mLNnTuu6tnheCzX_0 2024-09-12T01:02:37.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8555930070704369048', time=2024-09-12T02:49:06.016917+0000, chain.objs.size()=1 2024-09-12T01:02:37.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.mT7Fn6JCZdIeD8jXQC0BGIbAvWZxU5Z_0 2024-09-12T01:02:37.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15672214576390045488', time=2024-09-12T02:49:06.037886+0000, chain.objs.size()=1 2024-09-12T01:02:37.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.230+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Z0dYyF0Y0w681LqYSeFSctTfTkbgTsd_0 2024-09-12T01:02:37.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.234+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6111236095701277339', time=2024-09-12T02:49:06.045725+0000, chain.objs.size()=1 2024-09-12T01:02:37.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ItAAhQO2XT1hIsg2-CP5rN6SABUHX6r_0 2024-09-12T01:02:37.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16612820676811846716', time=2024-09-12T02:49:06.309291+0000, chain.objs.size()=1 2024-09-12T01:02:37.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.L5hYox5rzZis2WhxUpwbVW_tDdgL-Um_0 2024-09-12T01:02:37.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14346940635601727688', time=2024-09-12T02:49:06.319813+0000, chain.objs.size()=1 2024-09-12T01:02:37.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.NKnIwYEJ1HQwLrEmE0nsnG11jChIWsE_0 2024-09-12T01:02:37.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2340239256607722915', time=2024-09-12T02:49:06.342224+0000, chain.objs.size()=1 2024-09-12T01:02:37.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.iTWFGQBAsegKGWYUHqhLUEfVN5TYFNK_0 2024-09-12T01:02:37.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4489269350689514424', time=2024-09-12T02:49:06.638167+0000, chain.objs.size()=1 2024-09-12T01:02:37.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7FwWwAvb9i1DAaXCyG78OsF8YQwA2gF_0 2024-09-12T01:02:37.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1034215514176291247', time=2024-09-12T02:49:06.777323+0000, chain.objs.size()=1 2024-09-12T01:02:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.3n9B85j85OKS3cXlONzqcU7J0fhy0n5_0 2024-09-12T01:02:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6733949449963878702', time=2024-09-12T02:49:06.825461+0000, chain.objs.size()=1 2024-09-12T01:02:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.oPjVkBDjg_T-tznDrvqew3zlZ6C4Zu0_0 2024-09-12T01:02:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5360317365969295479', time=2024-09-12T02:49:06.829504+0000, chain.objs.size()=1 2024-09-12T01:02:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.gRpntdlBkR-ulKDylTHwMNTqJPakAIS_0 2024-09-12T01:02:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17263083320094972746', time=2024-09-12T02:49:06.838776+0000, chain.objs.size()=1 2024-09-12T01:02:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.cWA-kOrKutAqFnuAmArUV4F3AtsFbcp_0 2024-09-12T01:02:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9748346293189175515', time=2024-09-12T02:49:06.846713+0000, chain.objs.size()=1 2024-09-12T01:02:37.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.tyTljI6z5zyWY0Gxg8Hln2sfDP1nBMk_0 2024-09-12T01:02:37.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9501444446621855519', time=2024-09-12T02:49:06.852535+0000, chain.objs.size()=1 2024-09-12T01:02:37.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.CYc2S_XSXA0LOA55E7p1VIyuTbK8UiK_0 2024-09-12T01:02:37.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4071241241843852134', time=2024-09-12T02:49:06.894025+0000, chain.objs.size()=1 2024-09-12T01:02:37.238 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.238+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.DIHfmVjvYdwz59woDh9Uwfd6u8B6RR5_0 2024-09-12T01:02:37.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2182700010651288909', time=2024-09-12T02:49:07.098015+0000, chain.objs.size()=1 2024-09-12T01:02:37.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Ed3u7SO2MQB15QwDQSuvdMl2n-7wVzL_0 2024-09-12T01:02:37.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2285398786646153263', time=2024-09-12T02:49:07.160217+0000, chain.objs.size()=1 2024-09-12T01:02:37.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.nTaOez_D66X5IkDuJeSDJ68dpBUqnz9_0 2024-09-12T01:02:37.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9963141212671800501', time=2024-09-12T02:49:07.221829+0000, chain.objs.size()=1 2024-09-12T01:02:37.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.3gegepi6nKKN90VGCAiwLLjREjI3KCB_0 2024-09-12T01:02:37.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17186823244671278267', time=2024-09-12T02:49:07.311895+0000, chain.objs.size()=1 2024-09-12T01:02:37.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7T-bm_oOW3pPkWdxrdc29TgTHbiFukY_0 2024-09-12T01:02:37.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9051196112862565232', time=2024-09-12T02:49:07.369678+0000, chain.objs.size()=1 2024-09-12T01:02:37.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ZteID39xAGyHAMdIcT07Dj1o3-9Z5D0_0 2024-09-12T01:02:37.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15029668022495044394', time=2024-09-12T02:49:21.608214+0000, chain.objs.size()=1 2024-09-12T01:02:37.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.281__shadow_.RaarVuejb60UqJiU17sDR4UVIX5TuU7_0 2024-09-12T01:02:37.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8633592403793943873', time=2024-09-12T02:49:23.871335+0000, chain.objs.size()=1 2024-09-12T01:02:37.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.284__shadow_.SQcQS2l6CYxScEUMMyL8IVIs7Z-IDRu_0 2024-09-12T01:02:37.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3686885115463106224', time=2024-09-12T02:49:26.161290+0000, chain.objs.size()=1 2024-09-12T01:02:37.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.287__shadow_.t-Z4xcdAySxRD43U-gM7TbQ5GnJKBTu_0 2024-09-12T01:02:37.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8856766036814503275', time=2024-09-12T02:49:26.164004+0000, chain.objs.size()=1 2024-09-12T01:02:37.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.287__shadow_.DYk1l_nxMRXxsrJE38t7MOX8Kia6JPz_0 2024-09-12T01:02:37.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7904709410289105676', time=2024-09-12T02:49:30.942347+0000, chain.objs.size()=1 2024-09-12T01:02:37.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.F1QRm44Nugo5fHLo1zV4fbxKWMhk799_0 2024-09-12T01:02:37.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3162098069628365305', time=2024-09-12T02:49:30.946636+0000, chain.objs.size()=1 2024-09-12T01:02:37.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.ZwBnfrBZBCOEQcibiXBQUtr4EB086dQ_0 2024-09-12T01:02:37.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4420285337516107469', time=2024-09-12T02:49:32.437859+0000, chain.objs.size()=1 2024-09-12T01:02:37.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.2bB0gccBPtmY6W2GW3uaNF30EgVkXkQ_0 2024-09-12T01:02:37.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13029555484040464630', time=2024-09-12T02:49:32.468730+0000, chain.objs.size()=1 2024-09-12T01:02:37.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.Q-Do5XTghPEN2iWSPsYHvIw8GoQ0FQH_0 2024-09-12T01:02:37.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13328378638778392922', time=2024-09-12T02:49:34.634262+0000, chain.objs.size()=1 2024-09-12T01:02:37.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.296__shadow_.4BJU0JsFSe73nQbZrf3urJ7ni4QvzIf_0 2024-09-12T01:02:37.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5472745669794639786', time=2024-09-12T02:49:37.747744+0000, chain.objs.size()=1 2024-09-12T01:02:37.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.300__shadow_.j1LaVHrf1i3NnYATMBQupKKiofkVfu9_0 2024-09-12T01:02:37.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14161416755037919143', time=2024-09-12T02:49:40.691756+0000, chain.objs.size()=1 2024-09-12T01:02:37.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.304__shadow_.AbuLmcMW2JIgilnQXycQ31azTeGdLqz_0 2024-09-12T01:02:37.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1812524976527817813', time=2024-09-12T02:50:15.784137+0000, chain.objs.size()=1 2024-09-12T01:02:37.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.BRf0QNY_5DE8XG4a-Yl9frG5Svkbe2g_0 2024-09-12T01:02:37.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15257470281354765313', time=2024-09-12T02:50:15.828672+0000, chain.objs.size()=1 2024-09-12T01:02:37.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.uL2alIV8mvBtRMe9OtM1zSLT8wys4a3_0 2024-09-12T01:02:37.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16248844398451328946', time=2024-09-12T02:50:15.909089+0000, chain.objs.size()=1 2024-09-12T01:02:37.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.FPwfpDo5AHPlODNLHMW7L-3KTuW_frA_0 2024-09-12T01:02:37.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16432223639032623245', time=2024-09-12T02:50:16.182226+0000, chain.objs.size()=1 2024-09-12T01:02:37.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.vSPlphLT4i8NESoITZAiK6fv4v4o5wL_0 2024-09-12T01:02:37.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15619785781649852885', time=2024-09-12T02:50:16.354613+0000, chain.objs.size()=1 2024-09-12T01:02:37.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.dhWU8b32KLCqtaA8Rkg60hrfT4CtCen_0 2024-09-12T01:02:37.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18299352353662040190', time=2024-09-12T02:50:16.383280+0000, chain.objs.size()=1 2024-09-12T01:02:37.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.IoW0teXyDFsv3rIY0IrZ4GaU7gR-3qn_0 2024-09-12T01:02:37.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.270+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1014441115253811915', time=2024-09-12T02:50:16.424054+0000, chain.objs.size()=1 2024-09-12T01:02:37.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.270+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6qxyJ0gWMiTYixbOBiSBkoWaeAzMcyv_0 2024-09-12T01:02:37.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.270+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18409007100522154253', time=2024-09-12T02:50:16.440668+0000, chain.objs.size()=1 2024-09-12T01:02:37.266 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.270+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.kfq-Duxs7LO6JPchjyETBb6MSAm18wm_0 2024-09-12T01:02:37.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15047347221190438446', time=2024-09-12T02:50:16.445709+0000, chain.objs.size()=1 2024-09-12T01:02:37.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.8fub4WG_CsnD1kD21g2jx4ejoXc0fIz_0 2024-09-12T01:02:37.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16778382969428672925', time=2024-09-12T02:50:16.470010+0000, chain.objs.size()=1 2024-09-12T01:02:37.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.zKv70yjDtwfYjrA0oevhFhw0o8pEVUn_0 2024-09-12T01:02:37.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3976155795192919407', time=2024-09-12T02:50:16.495631+0000, chain.objs.size()=1 2024-09-12T01:02:37.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.WWMtLsLbCRWyX8RkBau5b4kbDtrnAq-_0 2024-09-12T01:02:37.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9733191816286521691', time=2024-09-12T02:50:16.496502+0000, chain.objs.size()=1 2024-09-12T01:02:37.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Dh6fMR9RsN_9npJpSDa6xMVVjZXhnAc_0 2024-09-12T01:02:37.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14416148791987432871', time=2024-09-12T02:50:16.505329+0000, chain.objs.size()=1 2024-09-12T01:02:37.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.kSEsqLGEK-hPz-74hi4R1lnsO-lni9l_0 2024-09-12T01:02:37.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5899646464527470070', time=2024-09-12T02:50:16.514559+0000, chain.objs.size()=1 2024-09-12T01:02:37.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.OdWHRHHz9saZc8HM3nCa1xm2PaPizkL_0 2024-09-12T01:02:37.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17766407086750876177', time=2024-09-12T02:50:16.674562+0000, chain.objs.size()=1 2024-09-12T01:02:37.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.VS8em3QKCKMhVwjL5AUvnAMC5tZrWYq_0 2024-09-12T01:02:37.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9886586665543472497', time=2024-09-12T02:50:16.693267+0000, chain.objs.size()=1 2024-09-12T01:02:37.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.c_79Wjkt00JuqLcOJ1bgBwTT8JEBZcB_0 2024-09-12T01:02:37.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13636982038864999668', time=2024-09-12T02:50:16.716515+0000, chain.objs.size()=1 2024-09-12T01:02:37.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.WmO8l-trg3DMvo0ghOAEt3o4BzaEWdb_0 2024-09-12T01:02:37.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.282+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.747805008694979610', time=2024-09-12T02:50:16.755074+0000, chain.objs.size()=1 2024-09-12T01:02:37.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.282+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.z1SaK1cFP-lNeVQLmC_gkFnPc22gcFV_0 2024-09-12T01:02:37.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.282+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15646427803268928700', time=2024-09-12T02:50:16.768452+0000, chain.objs.size()=1 2024-09-12T01:02:37.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.282+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4LeMxupl7e61WCoxLGxEXbT8fhhOcTR_0 2024-09-12T01:02:37.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.286+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6410299416152366886', time=2024-09-12T02:50:16.785050+0000, chain.objs.size()=1 2024-09-12T01:02:37.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.286+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.sl5oY8QWIrgxQUPBJJuD1MJOhebQqfN_0 2024-09-12T01:02:37.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14509744998614120134', time=2024-09-12T02:50:16.786140+0000, chain.objs.size()=1 2024-09-12T01:02:37.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.YupOBHGd_Ovxu3CXkgno4KP37kmxxwY_0 2024-09-12T01:02:37.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13738980278737040474', time=2024-09-12T02:50:16.944090+0000, chain.objs.size()=1 2024-09-12T01:02:37.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.FOZC3QzuEhE0hBpTT02FLWhMO7X_7Dw_0 2024-09-12T01:02:37.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15572917965103045338', time=2024-09-12T02:50:16.960181+0000, chain.objs.size()=1 2024-09-12T01:02:37.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4YsTgQoLwxBoPgOtxINgKXgWjAEiYBY_0 2024-09-12T01:02:37.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8365976186618313762', time=2024-09-12T02:50:17.029521+0000, chain.objs.size()=1 2024-09-12T01:02:37.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-yTpwfwKXPBOUU25FIrSOdzJKaIZ5xf_0 2024-09-12T01:02:37.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4501155368410025083', time=2024-09-12T02:50:17.133970+0000, chain.objs.size()=1 2024-09-12T01:02:37.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.yP7O-m0MpGD2hIW7njwKlrJFa9-PEq7_0 2024-09-12T01:02:37.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10876054294015258225', time=2024-09-12T02:50:17.179092+0000, chain.objs.size()=1 2024-09-12T01:02:37.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Pa7SSEITVWDe88mBfkdAfCTJsuG6x0t_0 2024-09-12T01:02:37.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10078529983311802360', time=2024-09-12T02:50:17.213921+0000, chain.objs.size()=1 2024-09-12T01:02:37.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.fjPZxQzw2WTeYfTizSvqFsSUdwPoAVS_0 2024-09-12T01:02:37.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17366532980360781233', time=2024-09-12T02:50:17.222613+0000, chain.objs.size()=1 2024-09-12T01:02:37.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.wXUSFMMx22vg9vS6tfyS8hsHC3ulhJ9_0 2024-09-12T01:02:37.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18345314397467730979', time=2024-09-12T02:50:17.224963+0000, chain.objs.size()=1 2024-09-12T01:02:37.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.YFQEqLmzWZSJ1Aqu-R6VK7SFLUxpXP8_0 2024-09-12T01:02:37.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7433409602037878794', time=2024-09-12T02:50:17.229134+0000, chain.objs.size()=1 2024-09-12T01:02:37.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Q-nbVfR4yiCUL_neLXejBQ4G2G4u0Kb_0 2024-09-12T01:02:37.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6535080419611681900', time=2024-09-12T02:50:17.451715+0000, chain.objs.size()=1 2024-09-12T01:02:37.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.290+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.EA8mauLA74r4KQ3yNZZx_iVOUioHghQ_0 2024-09-12T01:02:37.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14349305196810666370', time=2024-09-12T02:50:17.496093+0000, chain.objs.size()=1 2024-09-12T01:02:37.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.d6TYTE0UlznZT1Ch6X9EOODAA5M12xN_0 2024-09-12T01:02:37.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18300813704097902543', time=2024-09-12T02:50:17.504515+0000, chain.objs.size()=1 2024-09-12T01:02:37.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.wWvYje-8cS7sDmlmf8EJ1y1PVpOCPo1_0 2024-09-12T01:02:37.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.30701976453246602', time=2024-09-12T02:50:17.513711+0000, chain.objs.size()=1 2024-09-12T01:02:37.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.2l6Qz2eutbbEJpIY4QgP9_L8R5NqQqt_0 2024-09-12T01:02:37.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16299207465260653241', time=2024-09-12T02:50:17.528564+0000, chain.objs.size()=1 2024-09-12T01:02:37.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.n1H4ldcQC34oZXaywqfbbXxKyRW57ir_0 2024-09-12T01:02:37.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5315838989424174619', time=2024-09-12T02:50:17.685780+0000, chain.objs.size()=1 2024-09-12T01:02:37.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xIihUIfXRjQc3fo93nLwT9skBUAc7QI_0 2024-09-12T01:02:37.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.298+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16029374922389870485', time=2024-09-12T02:50:17.693909+0000, chain.objs.size()=1 2024-09-12T01:02:37.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.298+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.C0k-iWc_3aBn-VxBm5WH0vCW9o3xGOZ_0 2024-09-12T01:02:37.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.298+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17699720755179783319', time=2024-09-12T02:50:17.701324+0000, chain.objs.size()=1 2024-09-12T01:02:37.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.298+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ebQBnJmFwCrUJU6c32S4Uma-548zTS-_0 2024-09-12T01:02:37.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.298+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1544377661015122660', time=2024-09-12T02:50:17.729211+0000, chain.objs.size()=1 2024-09-12T01:02:37.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.298+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.t7poJgxAB0dYhbMR9r8ZHnZu6xSDtAj_0 2024-09-12T01:02:37.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11556621845212838451', time=2024-09-12T02:50:17.766163+0000, chain.objs.size()=1 2024-09-12T01:02:37.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.qdw960Uk29vxVLafO7S11px-5WHxOxs_0 2024-09-12T01:02:37.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4123196542799130967', time=2024-09-12T02:50:39.436018+0000, chain.objs.size()=1 2024-09-12T01:02:37.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.H_8WOSt9QUplba9dFZGoi3mt1SQwJD-_0 2024-09-12T01:02:37.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9857215894556118283', time=2024-09-12T02:50:39.443564+0000, chain.objs.size()=1 2024-09-12T01:02:37.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.PgFaAGG8tvKSVyCh4jr3ARAU6PCcz2Q_0 2024-09-12T01:02:37.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5653745782671405898', time=2024-09-12T02:50:39.474312+0000, chain.objs.size()=1 2024-09-12T01:02:37.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.wQMFJXDcwEMCaXZwXHjoX1jkFNMLPC5_0 2024-09-12T01:02:37.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13185114820479133114', time=2024-09-12T02:50:39.600058+0000, chain.objs.size()=1 2024-09-12T01:02:37.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.qetDDLVcilm1fbKAwHZ85MaQthEUTj6_0 2024-09-12T01:02:37.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13720568129547002098', time=2024-09-12T02:50:39.753652+0000, chain.objs.size()=1 2024-09-12T01:02:37.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.a4-GPs_vBfAsGxJAxs37FvLYBm62tyc_0 2024-09-12T01:02:37.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11467599339953709971', time=2024-09-12T02:50:39.834309+0000, chain.objs.size()=1 2024-09-12T01:02:37.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.RBoP4Nym4pwNDAYyeHV_yukxnbItCeM_0 2024-09-12T01:02:37.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4622776494605101519', time=2024-09-12T02:50:39.843141+0000, chain.objs.size()=1 2024-09-12T01:02:37.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.SqkFqHGB1dHPyv-dKl7PRJsDaulcNIc_0 2024-09-12T01:02:37.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.306+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16741240087208876364', time=2024-09-12T02:50:39.857382+0000, chain.objs.size()=1 2024-09-12T01:02:37.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.306+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.OO-SjRuXSF9eGZ5Ds1c3FnRKXcELZ0G_0 2024-09-12T01:02:37.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.306+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16843656559236673891', time=2024-09-12T02:50:40.018218+0000, chain.objs.size()=1 2024-09-12T01:02:37.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.306+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.-LkVGHAfIpcMzHquIY2SRfGBmAleV-v_0 2024-09-12T01:02:37.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.306+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17004632707868316635', time=2024-09-12T02:50:40.087539+0000, chain.objs.size()=1 2024-09-12T01:02:37.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.306+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.EVgoUj-1xqFxiSZDCYMEqUBWYH8Pxrx_0 2024-09-12T01:02:37.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.306+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13625291327720704353', time=2024-09-12T02:50:40.112025+0000, chain.objs.size()=1 2024-09-12T01:02:37.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.306+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.klkmasBcuPzhYmOTPwXb1XfqpbxnzzS_0 2024-09-12T01:02:37.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.306+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11038936216154011219', time=2024-09-12T02:50:40.118643+0000, chain.objs.size()=1 2024-09-12T01:02:37.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.306+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.PHL9aSXWjmnYuqBn7-8SKr8jp7Y5qWM_0 2024-09-12T01:02:37.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.306+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14378965115849031122', time=2024-09-12T02:50:40.123308+0000, chain.objs.size()=1 2024-09-12T01:02:37.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.306+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.YIu37wKIgyvbj8F5hydXvFsMx3z8-oK_0 2024-09-12T01:02:37.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.306+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7500247471978454403', time=2024-09-12T02:50:40.263784+0000, chain.objs.size()=1 2024-09-12T01:02:37.304 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.306+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.arZ_y3smELujr9-W3r2MAnCbQe-jaqz_0 2024-09-12T01:02:37.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11067780675582810128', time=2024-09-12T02:50:40.273564+0000, chain.objs.size()=1 2024-09-12T01:02:37.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.hHoWtYdTdlhXi-l84tKOt8VFc0WyrS8_0 2024-09-12T01:02:37.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11613291227492805030', time=2024-09-12T02:50:40.274874+0000, chain.objs.size()=1 2024-09-12T01:02:37.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.os4K-YmsaXbFT0F2KjN8fnDurD3DnVt_0 2024-09-12T01:02:37.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5685392042991409713', time=2024-09-12T02:50:40.307225+0000, chain.objs.size()=1 2024-09-12T01:02:37.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.M2HNdMWzpRJUoe7J2cd0gj4Nqo05S4s_0 2024-09-12T01:02:37.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.314+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13428452441216886455', time=2024-09-12T02:50:40.565175+0000, chain.objs.size()=1 2024-09-12T01:02:37.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.314+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.sasDxUOc99Wl036c40U5MbCWb-ow74G_0 2024-09-12T01:02:37.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.314+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2572783683950573173', time=2024-09-12T02:50:40.574374+0000, chain.objs.size()=1 2024-09-12T01:02:37.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.314+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.LI_YEzA-tmg1e0BcPlgPAOL064hxAJk_0 2024-09-12T01:02:37.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.314+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.460306246621540734', time=2024-09-12T02:50:40.624391+0000, chain.objs.size()=1 2024-09-12T01:02:37.309 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.314+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.K3GV2-uYxp1Y6eN2M8tZ4EDriPaW1VE_0 2024-09-12T01:02:37.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/64007 2024-09-12T01:02:37.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-12T01:02:37.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.673466344876710933', time=2024-09-12T02:50:40.803475+0000, chain.objs.size()=1 2024-09-12T01:02:37.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.RnDve_WW4p-aFeGKUEaBd2EpdPbp-O7_0 2024-09-12T01:02:37.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1283560187606542704', time=2024-09-12T02:50:40.812267+0000, chain.objs.size()=1 2024-09-12T01:02:37.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.RLSdlCsy-nR4RNYBLeXjGco1sO70ZM2_0 2024-09-12T01:02:37.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6549922098040836297', time=2024-09-12T02:50:40.826809+0000, chain.objs.size()=1 2024-09-12T01:02:37.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.8ITmdKUWjaQ7DrhrToqzqksnmrWqb1s_0 2024-09-12T01:02:37.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11312610179917866576', time=2024-09-12T02:50:40.842090+0000, chain.objs.size()=1 2024-09-12T01:02:37.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.7uPeamWqHGE1I2RQs3i6aeOlxilZzTH_0 2024-09-12T01:02:37.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13257553221276437133', time=2024-09-12T02:50:41.038054+0000, chain.objs.size()=1 2024-09-12T01:02:37.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.5Wd7wdNdJ8XN7Dsnn4Gu79djjv1MGJh_0 2024-09-12T01:02:37.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2034901188942633378', time=2024-09-12T02:50:41.108157+0000, chain.objs.size()=1 2024-09-12T01:02:37.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.GPc5jq_dC-HEIUIJLchqrQa6HlWQUfo_0 2024-09-12T01:02:37.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12695759719630661031', time=2024-09-12T02:50:41.137304+0000, chain.objs.size()=1 2024-09-12T01:02:37.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.AsHqbblASkHby-38oOIEQ8W0hmmX0rQ_0 2024-09-12T01:02:37.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3359418996968899913', time=2024-09-12T02:50:41.163403+0000, chain.objs.size()=1 2024-09-12T01:02:37.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.0ABUylRp9w6l3ldPn6ntZWpK_wlCJgV_0 2024-09-12T01:02:37.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2555105739395443673', time=2024-09-12T02:50:41.293667+0000, chain.objs.size()=1 2024-09-12T01:02:37.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.tWrSIvvaUJcaQiGe37e7gPHYtYm5Cda_0 2024-09-12T01:02:37.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3266122982988052967', time=2024-09-12T02:50:41.353763+0000, chain.objs.size()=1 2024-09-12T01:02:37.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.322+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.WBEBn-s0F8Zd4VtllTWx36sC-7NN3mP_0 2024-09-12T01:02:37.318 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.322+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12348928054087736599', time=2024-09-12T02:50:41.393815+0000, chain.objs.size()=1 2024-09-12T01:02:37.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.322+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.m2TzCokxIOmoLcVxwKX11Dq8hrYxK4T_0 2024-09-12T01:02:37.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.322+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3233134272889784856', time=2024-09-12T02:50:41.402921+0000, chain.objs.size()=1 2024-09-12T01:02:37.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.322+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Zyodj3TE3DcQ9qtTGa04IBU9iDm52FH_0 2024-09-12T01:02:37.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5040650986300859360', time=2024-09-12T02:50:41.421102+0000, chain.objs.size()=1 2024-09-12T01:02:37.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.QHnv7yEg4iwRCZDHrE_Z2FXW8rTKKTs_0 2024-09-12T01:02:37.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14884933913715553200', time=2024-09-12T02:50:41.433305+0000, chain.objs.size()=1 2024-09-12T01:02:37.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.BJWQ6ODNetJTeXmOhpJwzgxVvew81m3_0 2024-09-12T01:02:37.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5977195755340699428', time=2024-09-12T02:50:41.434720+0000, chain.objs.size()=1 2024-09-12T01:02:37.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.YBsMlTt1-8jK5cHTZBfj61Hz1lZKTH-_0 2024-09-12T01:02:37.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14095896138252792781', time=2024-09-12T02:50:41.529468+0000, chain.objs.size()=1 2024-09-12T01:02:37.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.N6FJFYgrx1ldrHDHwmfHXhaJJkplAmh_0 2024-09-12T01:02:37.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10417355028425299586', time=2024-09-12T02:50:41.571791+0000, chain.objs.size()=1 2024-09-12T01:02:37.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.OhhuPBsEzTLtJ-5Sy8R_o57SVnNBXED_0 2024-09-12T01:02:37.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12790381291151208975', time=2024-09-12T02:50:41.582327+0000, chain.objs.size()=1 2024-09-12T01:02:37.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.D0VNYKECsXrhjrapyAiEU3bPLyoExON_0 2024-09-12T01:02:37.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5383171276246560771', time=2024-09-12T02:50:41.634553+0000, chain.objs.size()=1 2024-09-12T01:02:37.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.c2umNZiqs7rBG8a6qUY7KhpxAyP29iQ_0 2024-09-12T01:02:37.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10411183934615664547', time=2024-09-12T02:52:25.687262+0000, chain.objs.size()=1 2024-09-12T01:02:37.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.464__shadow_._Sj7FaENHZdE1K6Fk-Ex7r3D8lzjAy6_0 2024-09-12T01:02:37.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8324030761087652220', time=2024-09-12T02:52:36.203915+0000, chain.objs.size()=1 2024-09-12T01:02:37.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.483__shadow_.aPeZ7e-CiKJkS4368HkJCD2xQ-6hDVT_0 2024-09-12T01:02:37.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14872226895834307958', time=2024-09-12T02:52:54.144819+0000, chain.objs.size()=6 2024-09-12T01:02:37.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.1 2024-09-12T01:02:37.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.2 2024-09-12T01:02:37.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.3 2024-09-12T01:02:37.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.4 2024-09-12T01:02:37.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.5 2024-09-12T01:02:37.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.6 2024-09-12T01:02:37.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.334+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Sr9IGPWXXvLxzH8DjQ7g7Osh5ykGQLb', time=2024-09-12T02:53:15.207240+0000, chain.objs.size()=1 2024-09-12T01:02:37.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~Sr9IGPWXXvLxzH8DjQ7g7Osh5ykGQLb.2 2024-09-12T01:02:37.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.334+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~s8QvwfmMVUfSJHYHR7eKlW7mlrLx1Jn', time=2024-09-12T02:53:35.939801+0000, chain.objs.size()=10 2024-09-12T01:02:37.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.526__multipart_mymultipart.2~s8QvwfmMVUfSJHYHR7eKlW7mlrLx1Jn.1 2024-09-12T01:02:37.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.526__multipart_mymultipart.2~s8QvwfmMVUfSJHYHR7eKlW7mlrLx1Jn.2 2024-09-12T01:02:37.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.526__multipart_mymultipart.2~s8QvwfmMVUfSJHYHR7eKlW7mlrLx1Jn.3 2024-09-12T01:02:37.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.526__multipart_mymultipart.2~s8QvwfmMVUfSJHYHR7eKlW7mlrLx1Jn.4 2024-09-12T01:02:37.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.526__multipart_mymultipart.2~s8QvwfmMVUfSJHYHR7eKlW7mlrLx1Jn.5 2024-09-12T01:02:37.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.526__multipart_mymultipart.2~s8QvwfmMVUfSJHYHR7eKlW7mlrLx1Jn.6 2024-09-12T01:02:37.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.526__multipart_mymultipart.2~s8QvwfmMVUfSJHYHR7eKlW7mlrLx1Jn.7 2024-09-12T01:02:37.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.526__multipart_mymultipart.2~s8QvwfmMVUfSJHYHR7eKlW7mlrLx1Jn.8 2024-09-12T01:02:37.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.526__multipart_mymultipart.2~s8QvwfmMVUfSJHYHR7eKlW7mlrLx1Jn.9 2024-09-12T01:02:37.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.526__multipart_mymultipart.2~s8QvwfmMVUfSJHYHR7eKlW7mlrLx1Jn.10 2024-09-12T01:02:37.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.338+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10519354681352655272', time=2024-09-12T02:54:33.672279+0000, chain.objs.size()=1 2024-09-12T01:02:37.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.560__shadow_.Noq8towXVfNGb8XAbS6dbmncZru8uie_0 2024-09-12T01:02:37.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.338+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12270758975316250558', time=2024-09-12T02:54:47.642228+0000, chain.objs.size()=1 2024-09-12T01:02:37.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:QvKGa2H4IkODaDglTzuG4vg3AbRbt5T_.cCf4iGy1C2nx7y6f5WQixXBq1xtDy9D_0 2024-09-12T01:02:37.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15597125178625864388', time=2024-09-12T02:54:47.973212+0000, chain.objs.size()=1 2024-09-12T01:02:37.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:NHjQGygyNobx-.muuEuh6qylen3TUiF_.V--_efsQN2QdNKZMiJWRiXerd5z4R2P_0 2024-09-12T01:02:37.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10944907979681173516', time=2024-09-12T02:54:49.619076+0000, chain.objs.size()=1 2024-09-12T01:02:37.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:-jEGWGCB.uHAt586hzP9twE.Lsc-WGb_._7t5WB4-AGuaJx8fdKMTXXmhcJRSPvb_0 2024-09-12T01:02:37.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11271192163318491822', time=2024-09-12T02:54:53.786353+0000, chain.objs.size()=1 2024-09-12T01:02:37.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.570__shadow:VdGVPbqJC3DinMsL.de9YPA0sT9l5r8_.bIRl-4u2jxHywJl6Vv5fT8k5CFJ-AA5_0 2024-09-12T01:02:37.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3436436242397347650', time=2024-09-12T02:54:56.851378+0000, chain.objs.size()=1 2024-09-12T01:02:37.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.573__shadow_.iHuxUuMHIdUBZJUw8PSpyZ-fXMisMpK_0 2024-09-12T01:02:37.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~RXWDIkaxVUYcl0q9L2IVmwtwdO86_8R', time=2024-09-12T02:58:16.322684+0000, chain.objs.size()=6 2024-09-12T01:02:37.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.624__multipart_multipart_enc.2~RXWDIkaxVUYcl0q9L2IVmwtwdO86_8R.1 2024-09-12T01:02:37.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.624__multipart_multipart_enc.2~RXWDIkaxVUYcl0q9L2IVmwtwdO86_8R.2 2024-09-12T01:02:37.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.624__multipart_multipart_enc.2~RXWDIkaxVUYcl0q9L2IVmwtwdO86_8R.3 2024-09-12T01:02:37.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.624__multipart_multipart_enc.2~RXWDIkaxVUYcl0q9L2IVmwtwdO86_8R.4 2024-09-12T01:02:37.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.624__multipart_multipart_enc.2~RXWDIkaxVUYcl0q9L2IVmwtwdO86_8R.5 2024-09-12T01:02:37.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.624__multipart_multipart_enc.2~RXWDIkaxVUYcl0q9L2IVmwtwdO86_8R.6 2024-09-12T01:02:37.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2482768526672001367', time=2024-09-12T02:58:47.229135+0000, chain.objs.size()=6 2024-09-12T01:02:37.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.662__multipart_foo.2~PiXbNflrZ9umBbNUcXSmooeE64xBO5S.1 2024-09-12T01:02:37.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.662__multipart_foo.2~PiXbNflrZ9umBbNUcXSmooeE64xBO5S.2 2024-09-12T01:02:37.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.350+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.662__multipart_foo.2~PiXbNflrZ9umBbNUcXSmooeE64xBO5S.3 2024-09-12T01:02:37.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.350+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.662__multipart_foo.2~PiXbNflrZ9umBbNUcXSmooeE64xBO5S.4 2024-09-12T01:02:37.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.350+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.662__multipart_foo.2~PiXbNflrZ9umBbNUcXSmooeE64xBO5S.5 2024-09-12T01:02:37.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.350+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.662__multipart_foo.2~PiXbNflrZ9umBbNUcXSmooeE64xBO5S.6 2024-09-12T01:02:37.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.350+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16732266810252972591', time=2024-09-12T02:59:18.383148+0000, chain.objs.size()=1 2024-09-12T01:02:37.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.350+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.708__shadow:F4TVtdZ.JyJ2BmV6mCOHxnWH1JzTi.F_.RpFDDnJeEW2pktd7JDj_x4zEdAlz7PB_0 2024-09-12T01:02:37.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.350+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16555325071650027052', time=2024-09-12T02:59:21.031763+0000, chain.objs.size()=1 2024-09-12T01:02:37.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.350+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.712__shadow:e3xYo4OeFmfC0vJlcLYxvW7vc1tD3Cb_.HcYEdttdaYfrLtTyxZyedhPXzbC5Dgc_0 2024-09-12T01:02:37.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:37.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:02:37.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45025' 2024-09-12T01:02:37.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.205300278809226426', time=2024-09-12T02:46:04.114354+0000, chain.objs.size()=1 2024-09-12T01:02:37.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.160__shadow_.BV9LCR5aiON5L626PpoUzVrG9sAlXom_0 2024-09-12T01:02:37.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18232495250707424319', time=2024-09-12T02:46:05.010570+0000, chain.objs.size()=2 2024-09-12T01:02:37.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.160__shadow_.0VHF0D1mY-_FsoN9pq7VxnDOxG6zP2O_0 2024-09-12T01:02:37.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.160__shadow_.0VHF0D1mY-_FsoN9pq7VxnDOxG6zP2O_1 2024-09-12T01:02:37.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9023518203597409036', time=2024-09-12T02:48:19.743117+0000, chain.objs.size()=1 2024-09-12T01:02:37.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.231__shadow_.cUHODDyllacdYsq8b4UWfMyMfZ4Z4k3_0 2024-09-12T01:02:37.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8589784498365287755', time=2024-09-12T02:48:32.041934+0000, chain.objs.size()=1 2024-09-12T01:02:37.358 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.245__shadow_.lB7ck-rmU9TA2UzABtE1RaMVRsfKakX_0 2024-09-12T01:02:37.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6056747727766497920', time=2024-09-12T02:48:32.837391+0000, chain.objs.size()=1 2024-09-12T01:02:37.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.246__shadow_.E4LqJVoZxKRvwjoRslMxntCzylITO68_0 2024-09-12T01:02:37.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.783589762235704522', time=2024-09-12T02:48:40.184089+0000, chain.objs.size()=1 2024-09-12T01:02:37.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.256__shadow_.RUNgEJyakA5ZHV17tNgwBqCx-s_Cm-i_0 2024-09-12T01:02:37.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9917695350665028216', time=2024-09-12T02:48:40.186752+0000, chain.objs.size()=1 2024-09-12T01:02:37.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.256__shadow_.NB2xM5ZmZ8ZX87hv3dq0YQyg7a0JcQx_0 2024-09-12T01:02:37.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16571110795573388379', time=2024-09-12T02:49:05.418493+0000, chain.objs.size()=1 2024-09-12T01:02:37.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.aHIeFB8hm_M-l3Y6CgRy4-_rDEaz6Rb_0 2024-09-12T01:02:37.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8152837488205157708', time=2024-09-12T02:49:05.487382+0000, chain.objs.size()=1 2024-09-12T01:02:37.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.raox0CnwqoU-gqRYU12TAmGYycSZ_S-_0 2024-09-12T01:02:37.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4506532771822169534', time=2024-09-12T02:49:05.530481+0000, chain.objs.size()=1 2024-09-12T01:02:37.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.CGc9J1ImXfzabqte_dGLpGsYo3e8HXE_0 2024-09-12T01:02:37.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8061924518969648415', time=2024-09-12T02:49:05.764628+0000, chain.objs.size()=1 2024-09-12T01:02:37.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.QYBBtHf73s0lf9Ap0Ap5XYh19JEw2So_0 2024-09-12T01:02:37.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7290216380668510908', time=2024-09-12T02:49:05.850212+0000, chain.objs.size()=1 2024-09-12T01:02:37.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.s7WZd1DG6n6MhLd6eorVqH0623tF9bZ_0 2024-09-12T01:02:37.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6125732844755137717', time=2024-09-12T02:49:05.861759+0000, chain.objs.size()=1 2024-09-12T01:02:37.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.YuaKVhE5GAxuu2fjJLEbh2hi7ysyak-_0 2024-09-12T01:02:37.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9483589732714437777', time=2024-09-12T02:49:06.019627+0000, chain.objs.size()=1 2024-09-12T01:02:37.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.4FVokK5jxpg7TrO_I3LuPuXCDj4DB4r_0 2024-09-12T01:02:37.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15989013458833418525', time=2024-09-12T02:49:06.059645+0000, chain.objs.size()=1 2024-09-12T01:02:37.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.YgoKjmRTCoq1MDfaf12G6avECfMv6CN_0 2024-09-12T01:02:37.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4406666362092440829', time=2024-09-12T02:49:06.250713+0000, chain.objs.size()=1 2024-09-12T01:02:37.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.4fpJLcafFwDSBXJu-Ay2JMeXPiEOMox_0 2024-09-12T01:02:37.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4149980653785696333', time=2024-09-12T02:49:06.283122+0000, chain.objs.size()=1 2024-09-12T01:02:37.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.nwXraJKVpo1LTwtb4rpnqE-PwUe_cbW_0 2024-09-12T01:02:37.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18133794388258626776', time=2024-09-12T02:49:06.283959+0000, chain.objs.size()=1 2024-09-12T01:02:37.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.R2NOKNPH7st-vDDhm5aovckJNUsWk-y_0 2024-09-12T01:02:37.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12599031377150587043', time=2024-09-12T02:49:06.307252+0000, chain.objs.size()=1 2024-09-12T01:02:37.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0HxaxE-5JXHKxVRZP4cSKnRcVGFH0X2_0 2024-09-12T01:02:37.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1353860012962611749', time=2024-09-12T02:49:06.366660+0000, chain.objs.size()=1 2024-09-12T01:02:37.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.bfEI4NDEiu4AvvQsVRd5db8QfyfAunt_0 2024-09-12T01:02:37.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.318313808720553640', time=2024-09-12T02:49:06.482905+0000, chain.objs.size()=1 2024-09-12T01:02:37.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Z1VznPtNNEenOtdrlgmDZUIDnn9KgLE_0 2024-09-12T01:02:37.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12164627168589494225', time=2024-09-12T02:49:06.520320+0000, chain.objs.size()=1 2024-09-12T01:02:37.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.366+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.OU7bBnDtxQQWadYR-PEKqBmWyeMC5Ld_0 2024-09-12T01:02:37.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6807760754243371010', time=2024-09-12T02:49:06.558406+0000, chain.objs.size()=1 2024-09-12T01:02:37.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Gol3qPf1t6sIQlrwWS3kBuDITCyj3om_0 2024-09-12T01:02:37.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15028281823837551582', time=2024-09-12T02:49:06.562542+0000, chain.objs.size()=1 2024-09-12T01:02:37.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0MAwd4WXSUYRLiJDGIcnr6DJXpzdHRS_0 2024-09-12T01:02:37.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17745786265557299648', time=2024-09-12T02:49:06.604595+0000, chain.objs.size()=1 2024-09-12T01:02:37.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.HGZdxKfIxr5-KU0F6fwEc4Bp0fiHiId_0 2024-09-12T01:02:37.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16342311050670687625', time=2024-09-12T02:49:06.612924+0000, chain.objs.size()=1 2024-09-12T01:02:37.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_._0oy4uZFG5ZbYpt1Ghy5QWnLRSpFkL__0 2024-09-12T01:02:37.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18309343438457710537', time=2024-09-12T02:49:06.885751+0000, chain.objs.size()=1 2024-09-12T01:02:37.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.-oQ-RXd57f31PLBReb8WNTsdYdwfcyl_0 2024-09-12T01:02:37.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2205476991019826382', time=2024-09-12T02:49:06.907836+0000, chain.objs.size()=1 2024-09-12T01:02:37.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_._SA_ox885f5_Yy9cF3porl1GTsAnXdV_0 2024-09-12T01:02:37.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3377733129943245657', time=2024-09-12T02:49:07.112643+0000, chain.objs.size()=1 2024-09-12T01:02:37.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Dj2l1WOPnox1E3ExU-C2htMSW1Piqg0_0 2024-09-12T01:02:37.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7770097669450461272', time=2024-09-12T02:49:07.130511+0000, chain.objs.size()=1 2024-09-12T01:02:37.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.EinsaWF6_Gc6ITIOGlBahXOmVvSFuAV_0 2024-09-12T01:02:37.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5073053712245467849', time=2024-09-12T02:49:07.166393+0000, chain.objs.size()=1 2024-09-12T01:02:37.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.gy_BUck4PPrT5FWyI3LsQ2q1uegAkER_0 2024-09-12T01:02:37.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4427354269052685431', time=2024-09-12T02:49:07.183634+0000, chain.objs.size()=1 2024-09-12T01:02:37.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.zoCW581LNJlqT2ZZc7ZivijaGjGcEbw_0 2024-09-12T01:02:37.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15746979920630836182', time=2024-09-12T02:49:07.195428+0000, chain.objs.size()=1 2024-09-12T01:02:37.371 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.QenNMiFKbWxiRvCPerjBqo_8xu0LHDn_0 2024-09-12T01:02:37.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16554132388553371782', time=2024-09-12T02:49:07.211795+0000, chain.objs.size()=1 2024-09-12T01:02:37.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.bG7ecMMf1BgGGO3e1ZCJCsL1W-wn6qQ_0 2024-09-12T01:02:37.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.378+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8573686429091039390', time=2024-09-12T02:49:08.095658+0000, chain.objs.size()=1 2024-09-12T01:02:37.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.378+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.263__shadow_.LfB0kdE7I_gEko5CZbdMqVM8dOi28oi_0 2024-09-12T01:02:37.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.378+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4015397667978117599', time=2024-09-12T02:49:20.103893+0000, chain.objs.size()=1 2024-09-12T01:02:37.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.378+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.279__shadow_.RA1-FshHsFJyoRFm71bCVNceXgMyFD8_0 2024-09-12T01:02:37.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.378+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6721245964720895451', time=2024-09-12T02:49:24.662083+0000, chain.objs.size()=1 2024-09-12T01:02:37.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.378+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.285__shadow_.eCIsXUBPVYh8WPuC9dxBENiR44vF4Ji_0 2024-09-12T01:02:37.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.378+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16942710159372395755', time=2024-09-12T02:49:30.974666+0000, chain.objs.size()=1 2024-09-12T01:02:37.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.378+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.DuIVI3Q8HobrvvoqC0_hQNYOT4ccWgl_0 2024-09-12T01:02:37.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.382+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8934259093180870375', time=2024-09-12T02:49:32.421630+0000, chain.objs.size()=1 2024-09-12T01:02:37.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.382+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.uywidlYS0a5EC16oGMErOjV8dWUqdsF_0 2024-09-12T01:02:37.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.382+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1241749582154337308', time=2024-09-12T02:49:42.410280+0000, chain.objs.size()=1 2024-09-12T01:02:37.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.382+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.306__shadow_.6bxbyVoT8gv3IM-gWATycjrxWjrZ5dI_0 2024-09-12T01:02:37.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.382+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9013801640227180650', time=2024-09-12T02:49:43.531558+0000, chain.objs.size()=1 2024-09-12T01:02:37.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.382+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.307__shadow:JdYpp0P0hUoLHHMlskwht8Q5YA72uGz_.W-TA7nAItoUgiI_DI74zRc6pmOUYjJY_0 2024-09-12T01:02:37.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.382+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1617126753587981713', time=2024-09-12T02:49:54.046753+0000, chain.objs.size()=1 2024-09-12T01:02:37.378 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.382+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.322__shadow_.qsGOOz3idNH9TS6hUbZc1I_SSEj6qCP_0 2024-09-12T01:02:37.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.382+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17858512363270478271', time=2024-09-12T02:50:15.790910+0000, chain.objs.size()=1 2024-09-12T01:02:37.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.382+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.bZLHDxfeSzbBDfUChutCFKwc9c2Nkuf_0 2024-09-12T01:02:37.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.382+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2984016740582464015', time=2024-09-12T02:50:15.957731+0000, chain.objs.size()=1 2024-09-12T01:02:37.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.382+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.95cH8NW-kJorlMpV2HwnJYNZLX1cOiu_0 2024-09-12T01:02:37.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.382+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15749136185033319323', time=2024-09-12T02:50:16.141093+0000, chain.objs.size()=1 2024-09-12T01:02:37.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.382+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.pxDIM29nLNZ8xhee5lMmqo8be5OZqc-_0 2024-09-12T01:02:37.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1357056374112046345', time=2024-09-12T02:50:16.160125+0000, chain.objs.size()=1 2024-09-12T01:02:37.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.7MU7lIOO5iaPxHY1c4WAQ9XLbispv6S_0 2024-09-12T01:02:37.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12505703964565616784', time=2024-09-12T02:50:16.179073+0000, chain.objs.size()=1 2024-09-12T01:02:37.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.8EvtfAK68Duzf1OLA9KOvzk-9PTx_zs_0 2024-09-12T01:02:37.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3481942689686899971', time=2024-09-12T02:50:16.205789+0000, chain.objs.size()=1 2024-09-12T01:02:37.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Kp_0pVWBA_ALG0A77drZkmUyt47w7TL_0 2024-09-12T01:02:37.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15602080858046532346', time=2024-09-12T02:50:16.364608+0000, chain.objs.size()=1 2024-09-12T01:02:37.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.CLf_Dc_yB3PE1DGupIM9QsS45x60bPJ_0 2024-09-12T01:02:37.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17731393659537890699', time=2024-09-12T02:50:16.377858+0000, chain.objs.size()=1 2024-09-12T01:02:37.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Gf6NRQJaYzPPTnAVLtXYPMZ0FZ1ZxiP_0 2024-09-12T01:02:37.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10527898024422833927', time=2024-09-12T02:50:16.407823+0000, chain.objs.size()=1 2024-09-12T01:02:37.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.yMTb3oF0Pvn89YeAA2N_66KMf6bmI72_0 2024-09-12T01:02:37.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10049995498393407183', time=2024-09-12T02:50:16.439872+0000, chain.objs.size()=1 2024-09-12T01:02:37.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.gEo9m7FJKDtidBWDEtdGUdfCR8Ffe4K_0 2024-09-12T01:02:37.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15181834726980359541', time=2024-09-12T02:50:16.444519+0000, chain.objs.size()=1 2024-09-12T01:02:37.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.h5kRkFlGuTDinKQucijwciQ_3hnrL5r_0 2024-09-12T01:02:37.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15522157297174833099', time=2024-09-12T02:50:16.450379+0000, chain.objs.size()=1 2024-09-12T01:02:37.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.hxtbhWuzqtV1Q1BL9NJMgiaL8ggL9M1_0 2024-09-12T01:02:37.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15124192280032564643', time=2024-09-12T02:50:16.692795+0000, chain.objs.size()=1 2024-09-12T01:02:37.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.fQmI-w5rPXNbdVEFUDM6hR47f6rs0Yy_0 2024-09-12T01:02:37.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18191641060352018327', time=2024-09-12T02:50:16.728454+0000, chain.objs.size()=1 2024-09-12T01:02:37.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Dw6CZKgHNlPiO8O_LJ36qUBrn8X5zzZ_0 2024-09-12T01:02:37.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15760240385886360837', time=2024-09-12T02:50:16.752127+0000, chain.objs.size()=1 2024-09-12T01:02:37.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.zjlEbdTulMnhmJocPVUUC4zfIp5Ey-y_0 2024-09-12T01:02:37.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18408169081420329645', time=2024-09-12T02:50:16.795583+0000, chain.objs.size()=1 2024-09-12T01:02:37.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.fzlpXHNOibaMIHpJcJ6MwX_tHYdUDEG_0 2024-09-12T01:02:37.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16249859470375518398', time=2024-09-12T02:50:16.906293+0000, chain.objs.size()=1 2024-09-12T01:02:37.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.BZtsFH3J8U-SUvBIJGkrpFwcpVMlW6E_0 2024-09-12T01:02:37.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9991307003974888761', time=2024-09-12T02:50:16.913515+0000, chain.objs.size()=1 2024-09-12T01:02:37.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.qq4PMeFOzn4fn_qebDz4zZZqq8XrDM4_0 2024-09-12T01:02:37.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12050106363945117253', time=2024-09-12T02:50:16.914382+0000, chain.objs.size()=1 2024-09-12T01:02:37.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.JunzEI3tlM1sbcYxfX979SfUHyNECGm_0 2024-09-12T01:02:37.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15872775029639136798', time=2024-09-12T02:50:16.957484+0000, chain.objs.size()=1 2024-09-12T01:02:37.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.hVU3MJDjc5OzTgx5p_BeqHYRigDwhrC_0 2024-09-12T01:02:37.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12101237370473983407', time=2024-09-12T02:50:16.991221+0000, chain.objs.size()=1 2024-09-12T01:02:37.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6ghnD9Ioip-PCkOd2_881fvJDm74hCE_0 2024-09-12T01:02:37.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4833883021929451037', time=2024-09-12T02:50:16.998553+0000, chain.objs.size()=1 2024-09-12T01:02:37.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4wOHun2kFIWpB9t2X5xGW1eSD2pKvTt_0 2024-09-12T01:02:37.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3264354426169870799', time=2024-09-12T02:50:17.131981+0000, chain.objs.size()=1 2024-09-12T01:02:37.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.n4FEiH9upHXrhCi5N9XUZgF5Pgnl-QR_0 2024-09-12T01:02:37.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9736422088615609610', time=2024-09-12T02:50:17.165245+0000, chain.objs.size()=1 2024-09-12T01:02:37.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-cR7PR5w7OZO5YYqr-RMMGNrfHtv0TF_0 2024-09-12T01:02:37.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17935531990276928385', time=2024-09-12T02:50:17.185425+0000, chain.objs.size()=1 2024-09-12T01:02:37.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.2FQaBDhhks4iGU4uUAgQXNdcpXIO5ay_0 2024-09-12T01:02:37.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14627303036771864855', time=2024-09-12T02:50:17.205812+0000, chain.objs.size()=1 2024-09-12T01:02:37.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.1yP05BsbYcAZBrGcsvbeFiCl4QY1era_0 2024-09-12T01:02:37.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.398+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1811712821921449137', time=2024-09-12T02:50:17.219707+0000, chain.objs.size()=1 2024-09-12T01:02:37.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.398+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.w5MmvQZS3nr0BF8poEXzpz3SMKTX1hY_0 2024-09-12T01:02:37.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.398+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11829217596244168444', time=2024-09-12T02:50:17.235299+0000, chain.objs.size()=1 2024-09-12T01:02:37.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.398+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.bgCYpgfVCh0uQUV-z8MYMLyKOmtkJ66_0 2024-09-12T01:02:37.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.398+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18285734817063693866', time=2024-09-12T02:50:17.284886+0000, chain.objs.size()=1 2024-09-12T01:02:37.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.398+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Sk4v5P_d-dXdsdmBfAf_3muHiVdbwkv_0 2024-09-12T01:02:37.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.398+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13808275885636209529', time=2024-09-12T02:50:17.390540+0000, chain.objs.size()=1 2024-09-12T01:02:37.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.398+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.dZAAbl6SGbvt9ddxc-s2AtdArsWAhe7_0 2024-09-12T01:02:37.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14375027409625647813', time=2024-09-12T02:50:17.469150+0000, chain.objs.size()=1 2024-09-12T01:02:37.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.5MWO9Afm-DneVVMSTIfxpX5YnXZJqrz_0 2024-09-12T01:02:37.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1884064444372947879', time=2024-09-12T02:50:17.517192+0000, chain.objs.size()=1 2024-09-12T01:02:37.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.N3MwMbkx1Nqg5Br_Mv6kcz9jTMIa41U_0 2024-09-12T01:02:37.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13852877412742324934', time=2024-09-12T02:50:17.544729+0000, chain.objs.size()=1 2024-09-12T01:02:37.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.5BKHPjQT4h4YKOeWWlJTWCgGT9z6Fn1_0 2024-09-12T01:02:37.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13882547309067811130', time=2024-09-12T02:50:39.538005+0000, chain.objs.size()=1 2024-09-12T01:02:37.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.zmJBqTmkhiKY7D2Kp3FfmQlQ39_fLVU_0 2024-09-12T01:02:37.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8640287124786551161', time=2024-09-12T02:50:39.736871+0000, chain.objs.size()=1 2024-09-12T01:02:37.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.gak627dBSYRoGzqYroyjbDHx-BR2tny_0 2024-09-12T01:02:37.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10059079803270231509', time=2024-09-12T02:50:39.823592+0000, chain.objs.size()=1 2024-09-12T01:02:37.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.kKsozzIxa7K4bqaW-0b3dZW8ckP4_Jx_0 2024-09-12T01:02:37.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18235418765481787100', time=2024-09-12T02:50:39.828535+0000, chain.objs.size()=1 2024-09-12T01:02:37.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ncbBtxFqblw5W2Zl9rxcaMtIWvc3pMX_0 2024-09-12T01:02:37.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5421527174097318412', time=2024-09-12T02:50:40.087943+0000, chain.objs.size()=1 2024-09-12T01:02:37.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.IVciGwcbkliCoXAHa9Qcwj4gjR30nhc_0 2024-09-12T01:02:37.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2762016012179370947', time=2024-09-12T02:50:40.090565+0000, chain.objs.size()=1 2024-09-12T01:02:37.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.aa8XpR0kmx7bi77p0gZ7mnPvfqFxHLr_0 2024-09-12T01:02:37.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.406+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8731688409855117636', time=2024-09-12T02:50:40.281689+0000, chain.objs.size()=1 2024-09-12T01:02:37.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.406+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.r4EDoQ805iOhhflbqGI4BupjPl7-E8M_0 2024-09-12T01:02:37.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.406+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4796914817396518302', time=2024-09-12T02:50:40.285501+0000, chain.objs.size()=1 2024-09-12T01:02:37.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.406+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.f-mFz4bGtB8kOMhoC6SpreyuznSu2QZ_0 2024-09-12T01:02:37.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.406+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9634428347757017839', time=2024-09-12T02:50:40.814930+0000, chain.objs.size()=1 2024-09-12T01:02:37.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.406+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Xk0UbPwyoHMocjiw5pvi9jk69CX8ghf_0 2024-09-12T01:02:37.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.406+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6688456368717145853', time=2024-09-12T02:50:40.842657+0000, chain.objs.size()=1 2024-09-12T01:02:37.404 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.406+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.6rvyNJDr_7kw5f7gw9OLpKvXygs7fV0_0 2024-09-12T01:02:37.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.406+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8110951638632063292', time=2024-09-12T02:50:40.854437+0000, chain.objs.size()=1 2024-09-12T01:02:37.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.406+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.PXBDKu5oaOhD3C7opWXZeDZJFkbSNt3_0 2024-09-12T01:02:37.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16008794938064908204', time=2024-09-12T02:50:40.855306+0000, chain.objs.size()=1 2024-09-12T01:02:37.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.9LPZpcQ7z5tn3DQX5186qcDUpNOOe7E_0 2024-09-12T01:02:37.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2609462495617460534', time=2024-09-12T02:50:41.027462+0000, chain.objs.size()=1 2024-09-12T01:02:37.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.SRuiJy8vi4pR236o17T_2svvpY78XB6_0 2024-09-12T01:02:37.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8744790662309734810', time=2024-09-12T02:50:41.071469+0000, chain.objs.size()=1 2024-09-12T01:02:37.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.m8SWFiWhBRHGk_yIZ7E1qRm4Uzf-u8A_0 2024-09-12T01:02:37.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8991549968534486931', time=2024-09-12T02:50:41.072574+0000, chain.objs.size()=1 2024-09-12T01:02:37.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.csLZxDWJYXcdxFsispJ_3-1Jjm96AgT_0 2024-09-12T01:02:37.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3321462800492473250', time=2024-09-12T02:50:41.083749+0000, chain.objs.size()=1 2024-09-12T01:02:37.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.E5NYxSpwDNeh62FR5Q3cQbiNd79fO_A_0 2024-09-12T01:02:37.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7919797454265245945', time=2024-09-12T02:50:41.108862+0000, chain.objs.size()=1 2024-09-12T01:02:37.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.XZNEr8XK_7CXtEndgo4ank7usCmb6rx_0 2024-09-12T01:02:37.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10067656140537370056', time=2024-09-12T02:50:41.156267+0000, chain.objs.size()=1 2024-09-12T01:02:37.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.BsfTVrwwCNfCjXs6qi5VHDwrd_fJrlt_0 2024-09-12T01:02:37.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2061171027258166151', time=2024-09-12T02:50:41.281906+0000, chain.objs.size()=1 2024-09-12T01:02:37.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.T5D_V4tZWeAqyCjDeMNsKMxZVvVfyGQ_0 2024-09-12T01:02:37.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16014848447634722875', time=2024-09-12T02:50:41.336447+0000, chain.objs.size()=1 2024-09-12T01:02:37.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.LuVx_aEzPIX2WqXLLrmVx8PP5euN6Ej_0 2024-09-12T01:02:37.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1794430163479736053', time=2024-09-12T02:50:41.355007+0000, chain.objs.size()=1 2024-09-12T01:02:37.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.C6ZxuAL5NVRdbaUETmCYMMH0z2QN_Vs_0 2024-09-12T01:02:37.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.593993110555021686', time=2024-09-12T02:50:41.388008+0000, chain.objs.size()=1 2024-09-12T01:02:37.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.IUl9jv6XFh6rXlDSkcAmSm3JmpGfYN5_0 2024-09-12T01:02:37.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.19910503206206372', time=2024-09-12T02:50:41.389800+0000, chain.objs.size()=1 2024-09-12T01:02:37.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.YY9ogRfTF0NZN_I8EpZHdJIfpBqTwNp_0 2024-09-12T01:02:37.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9028259197397773778', time=2024-09-12T02:50:41.425525+0000, chain.objs.size()=1 2024-09-12T01:02:37.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.e6u4ftRDXAfHzmj0seIHRpJMsNX4E6o_0 2024-09-12T01:02:37.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10405302727597212684', time=2024-09-12T02:50:41.440473+0000, chain.objs.size()=1 2024-09-12T01:02:37.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.9XUVA3mwngsA-I71m7lbHh6W_xx_eX1_0 2024-09-12T01:02:37.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45025 2024-09-12T01:02:37.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T01:02:37.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16688209695986747635', time=2024-09-12T02:50:41.623282+0000, chain.objs.size()=1 2024-09-12T01:02:37.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.KfhhaUJom_OJ-dw8P8sLr_A1gbv0VcX_0 2024-09-12T01:02:37.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1403350558927816732', time=2024-09-12T02:50:41.626005+0000, chain.objs.size()=1 2024-09-12T01:02:37.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.6i8xSklWRuhvySpRpsPqCM82Rt50H_d_0 2024-09-12T01:02:37.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18039502601940161489', time=2024-09-12T02:50:54.241894+0000, chain.objs.size()=1 2024-09-12T01:02:37.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.343__shadow_.qv13REFCnZclHVIXAbRiXnOYURwJ2Qd_0 2024-09-12T01:02:37.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6214111821438467987', time=2024-09-12T02:52:19.581783+0000, chain.objs.size()=1 2024-09-12T01:02:37.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.458__shadow_.CS9Igc47Xgbuda6E2XTUfLOrHe-y0mj_0 2024-09-12T01:02:37.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.987344169286239421', time=2024-09-12T02:52:34.480955+0000, chain.objs.size()=1 2024-09-12T01:02:37.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.481__shadow_.3ORCg2a845SL8iO5x0dlx9e7IVoQx_M_0 2024-09-12T01:02:37.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13104483338230552452', time=2024-09-12T02:53:02.550677+0000, chain.objs.size()=1 2024-09-12T01:02:37.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.518__multipart_mymultipart.2~CFvHZY1P9oJ_AdrN7nAakX9s7Jurdzt.1 2024-09-12T01:02:37.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~k5Qi9knjEsZnaAQj7XeqToLp_SHpMDX', time=2024-09-12T02:53:12.346395+0000, chain.objs.size()=1 2024-09-12T01:02:37.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~k5Qi9knjEsZnaAQj7XeqToLp_SHpMDX.1 2024-09-12T01:02:37.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4120371370660512868', time=2024-09-12T02:53:31.956745+0000, chain.objs.size()=1 2024-09-12T01:02:37.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.525__multipart_mymultipart.2~ZIEBdWwkBtIAD7M4LcVQjejO94PQNoJ.1 2024-09-12T01:02:37.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9372120223416411604', time=2024-09-12T02:53:33.822007+0000, chain.objs.size()=3 2024-09-12T01:02:37.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.525__multipart_mymultipart.2~qHHy4nETHVgNLv1unwELm4epk5fyK1m.1 2024-09-12T01:02:37.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.525__multipart_mymultipart.2~qHHy4nETHVgNLv1unwELm4epk5fyK1m.2 2024-09-12T01:02:37.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.525__multipart_mymultipart.2~qHHy4nETHVgNLv1unwELm4epk5fyK1m.3 2024-09-12T01:02:37.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4514836574101818757', time=2024-09-12T02:53:38.347777+0000, chain.objs.size()=2 2024-09-12T01:02:37.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.528__multipart_mymultipart.2~EnJADQiuTobchtgbQCL2TH0NZEQlb-I.1 2024-09-12T01:02:37.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.528__multipart_mymultipart.2~EnJADQiuTobchtgbQCL2TH0NZEQlb-I.2 2024-09-12T01:02:37.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~lqEQyH5QijviC-2Ob-P2JuW19TqNl2_', time=2024-09-12T02:53:41.262229+0000, chain.objs.size()=1 2024-09-12T01:02:37.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.531__multipart_mymultipart2.2~lqEQyH5QijviC-2Ob-P2JuW19TqNl2_.1 2024-09-12T01:02:37.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15484713846496616946', time=2024-09-12T02:53:59.284842+0000, chain.objs.size()=4 2024-09-12T01:02:37.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.535__multipart_mymultipart.2~mURk63yg3ab9TGEqox_AnGR9nL4BI4n.1 2024-09-12T01:02:37.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.535__multipart_mymultipart.2~mURk63yg3ab9TGEqox_AnGR9nL4BI4n.2 2024-09-12T01:02:37.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.535__multipart_mymultipart.YRJpwrIl4vdNapZMgRcF_RN8uuO19Fh0.3 2024-09-12T01:02:37.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.535__multipart_mymultipart.2~mURk63yg3ab9TGEqox_AnGR9nL4BI4n.4 2024-09-12T01:02:37.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13579963485896344395', time=2024-09-12T02:54:25.739986+0000, chain.objs.size()=1 2024-09-12T01:02:37.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.553__shadow_.UxsCGXSuHGyM3Om0ZsyD7ypa5HK1xjx_0 2024-09-12T01:02:37.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9272395636764099472', time=2024-09-12T02:54:30.409534+0000, chain.objs.size()=1 2024-09-12T01:02:37.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.557__shadow_.ZjMzwVryEZ48GBpLtn8_7FB8sCJzMBz_0 2024-09-12T01:02:37.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16818350162639422738', time=2024-09-12T02:54:44.941233+0000, chain.objs.size()=1 2024-09-12T01:02:37.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:izkZQV6pUDZXrW8YG1oHrME8unLC4DS_.axfcXaSuAfK_qEBMsDpcdvmH0THL-Zk_0 2024-09-12T01:02:37.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10561911826682388382', time=2024-09-12T02:54:47.331008+0000, chain.objs.size()=1 2024-09-12T01:02:37.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:uyhExFerIb31t.s2GUOGPBX3UTxjLru_.WlBMPW1_j6N5eC4HIDq0APIn6KuwcS__0 2024-09-12T01:02:37.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7769160858885297305', time=2024-09-12T02:55:30.256778+0000, chain.objs.size()=1 2024-09-12T01:02:37.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.580__shadow:kWg-hmk70TbJD44PluHyH1SxVs0PnuO_.CNAJCxvAts5TEli1dvPXCAtS9wGGi3e_0 2024-09-12T01:02:37.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14784761349878726650', time=2024-09-12T02:55:36.044899+0000, chain.objs.size()=1 2024-09-12T01:02:37.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.587__shadow:TLkSnxhmg54iDS-iY-Ds-XpeSkzVA2Y_.Bp-JrWGETPzKOOK0Lbx-kfXx4vO7XxN_0 2024-09-12T01:02:37.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6741854729846928838', time=2024-09-12T02:58:07.883271+0000, chain.objs.size()=1 2024-09-12T01:02:37.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.618__shadow_.fQRadH38pUMudZgJh2bXkjjgai-mmjN_0 2024-09-12T01:02:37.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2655003311504245861', time=2024-09-12T02:59:45.713516+0000, chain.objs.size()=1 2024-09-12T01:02:37.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.719__shadow_.hIxt17oJGm8dC6IUn6CJ802VuWCJZhE_0 2024-09-12T01:02:37.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.438+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:37.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:02:37.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43678' 2024-09-12T01:02:37.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3672553004531475091', time=2024-09-12T02:48:18.973954+0000, chain.objs.size()=1 2024-09-12T01:02:37.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.230__shadow_.VdFCIOdHig_kDvIVRr7M1XZolVz0XbK_0 2024-09-12T01:02:37.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16366426391976626882', time=2024-09-12T02:48:27.403458+0000, chain.objs.size()=1 2024-09-12T01:02:37.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.240__shadow_.jQwC0s_98jk3KQMNRAt-HCdJx7f5Qbo_0 2024-09-12T01:02:37.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7908277731402036202', time=2024-09-12T02:49:05.447452+0000, chain.objs.size()=1 2024-09-12T01:02:37.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.JudxDOlLI-h-hCYN036I6ZO54oyBK-u_0 2024-09-12T01:02:37.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2925872268158736789', time=2024-09-12T02:49:05.455793+0000, chain.objs.size()=1 2024-09-12T01:02:37.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.kH9LV9NJCTbNFjyU2GTfPHycDZtn8K__0 2024-09-12T01:02:37.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6482730841868199561', time=2024-09-12T02:49:05.522298+0000, chain.objs.size()=1 2024-09-12T01:02:37.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.S3X7PNcNqp-OrNDEqEkys3pYHqLVHg4_0 2024-09-12T01:02:37.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10581978790329098975', time=2024-09-12T02:49:05.813619+0000, chain.objs.size()=1 2024-09-12T01:02:37.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.xGeqJngq7DhA7ZWvHhdyBowYGyOwjK8_0 2024-09-12T01:02:37.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17054382504383225490', time=2024-09-12T02:49:05.833550+0000, chain.objs.size()=1 2024-09-12T01:02:37.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.U8IcjXYbplniayQt-yjI4NX5TXaX243_0 2024-09-12T01:02:37.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5813689198335133718', time=2024-09-12T02:49:05.850322+0000, chain.objs.size()=1 2024-09-12T01:02:37.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.-9YnZww_gYIpzVtNPha-5AQ2OdR21C2_0 2024-09-12T01:02:37.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15967615079265771150', time=2024-09-12T02:49:05.859403+0000, chain.objs.size()=1 2024-09-12T01:02:37.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.8HiwNAEaPUOrFjneXg9kfoTfkfgmgbK_0 2024-09-12T01:02:37.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12528011733265143769', time=2024-09-12T02:49:05.955079+0000, chain.objs.size()=1 2024-09-12T01:02:37.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Wh7pySP-tmsV4021lPHHXxVqYDqsKud_0 2024-09-12T01:02:37.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13334418129465250409', time=2024-09-12T02:49:05.989395+0000, chain.objs.size()=1 2024-09-12T01:02:37.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.1_NfikjnywpZ9SZGQCco-k5tL16_SpF_0 2024-09-12T01:02:37.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10354597097958110382', time=2024-09-12T02:49:05.990657+0000, chain.objs.size()=1 2024-09-12T01:02:37.442 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.GGjl4ts-LUaB8M2mr9EzlkGHmJMt4j8_0 2024-09-12T01:02:37.443 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.446+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3329618466043357274', time=2024-09-12T02:49:06.041145+0000, chain.objs.size()=1 2024-09-12T01:02:37.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.446+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Xy4gsE_jo2Sx_eCBegGgSI-f5XJOJf0_0 2024-09-12T01:02:37.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4224303831978198427', time=2024-09-12T02:49:06.049101+0000, chain.objs.size()=1 2024-09-12T01:02:37.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.X1sFSM5ZS5OeefxQthyQdvAcX6M8app_0 2024-09-12T01:02:37.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1484899869985057294', time=2024-09-12T02:49:06.075403+0000, chain.objs.size()=1 2024-09-12T01:02:37.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.nDzo3_NYpxw5k5xof4iTHc8ic23tGaz_0 2024-09-12T01:02:37.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13508542800596287471', time=2024-09-12T02:49:06.100125+0000, chain.objs.size()=1 2024-09-12T01:02:37.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.8BDKZ7WNzYwqskgh9J2G6A2-1X0Cts3_0 2024-09-12T01:02:37.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9965237067886523946', time=2024-09-12T02:49:06.287510+0000, chain.objs.size()=1 2024-09-12T01:02:37.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.6QRjUrtiXkN9vvytYdeZth24xxW4ywX_0 2024-09-12T01:02:37.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8826174106874487011', time=2024-09-12T02:49:06.303411+0000, chain.objs.size()=1 2024-09-12T01:02:37.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.W7WINEqCe6M3z65TYlzt7U1G86PpIrq_0 2024-09-12T01:02:37.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12972426931803605791', time=2024-09-12T02:49:06.379970+0000, chain.objs.size()=1 2024-09-12T01:02:37.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.unWux7Xhlo5izQCUIE882X2ab-SG1Jv_0 2024-09-12T01:02:37.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13529335926488710455', time=2024-09-12T02:49:06.480267+0000, chain.objs.size()=1 2024-09-12T01:02:37.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.DNRljD-0mSYS5WokH4Texf1mfS_U8Gv_0 2024-09-12T01:02:37.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10515178845246523346', time=2024-09-12T02:49:06.609583+0000, chain.objs.size()=1 2024-09-12T01:02:37.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.V8VhGofhE5tjiPA_y8ujoSiPzcTXOCr_0 2024-09-12T01:02:37.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4177438190849349769', time=2024-09-12T02:49:06.745558+0000, chain.objs.size()=1 2024-09-12T01:02:37.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.rlXxz5IpIk0xMJZENw5O6E0Rs35WhJD_0 2024-09-12T01:02:37.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13616876317130096525', time=2024-09-12T02:49:06.779610+0000, chain.objs.size()=1 2024-09-12T01:02:37.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.aO0LTb2Lp9g01NMhvgB9gMsNsm24q7h_0 2024-09-12T01:02:37.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13645509741689379124', time=2024-09-12T02:49:06.799567+0000, chain.objs.size()=1 2024-09-12T01:02:37.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.1KGPWh5SjCeDdMLKvZUX1hjhbikNyu3_0 2024-09-12T01:02:37.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1461576836086300087', time=2024-09-12T02:49:06.874936+0000, chain.objs.size()=1 2024-09-12T01:02:37.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.stlnLQBiQ3jyaJc3R7NsdDYINVSHj0S_0 2024-09-12T01:02:37.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13258414081193079849', time=2024-09-12T02:49:07.140273+0000, chain.objs.size()=1 2024-09-12T01:02:37.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.PJNnHtO_4WWmOptDMHsvB5BuDJOPEQs_0 2024-09-12T01:02:37.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5211408005203795575', time=2024-09-12T02:49:07.142814+0000, chain.objs.size()=1 2024-09-12T01:02:37.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.B21wtr_1x-mTTv3ihOlBU8NVSzH8sj-_0 2024-09-12T01:02:37.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7590209867318396452', time=2024-09-12T02:49:07.319793+0000, chain.objs.size()=1 2024-09-12T01:02:37.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.faVS2if_JSY8SevyZIHzYOJeZm6TWHe_0 2024-09-12T01:02:37.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2606006001295619077', time=2024-09-12T02:49:07.367335+0000, chain.objs.size()=1 2024-09-12T01:02:37.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.T-XHcaIqcooGUZpg2I59mTMYQChpRn5_0 2024-09-12T01:02:37.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9610398938681705377', time=2024-09-12T02:49:07.375033+0000, chain.objs.size()=1 2024-09-12T01:02:37.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.86ezoU9bfT0zMrb6pYBjUU_bof-EB-p_0 2024-09-12T01:02:37.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18136874889611121569', time=2024-09-12T02:49:07.401899+0000, chain.objs.size()=1 2024-09-12T01:02:37.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.OWVyHGJpvWzvAOT2QYMlx7MRJ2tAUQ__0 2024-09-12T01:02:37.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6290814771585617362', time=2024-09-12T02:49:07.408832+0000, chain.objs.size()=1 2024-09-12T01:02:37.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.3ZlnupQBxKvEPUl5JIuKcpiggqPWRaV_0 2024-09-12T01:02:37.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16865896325186856178', time=2024-09-12T02:49:07.409620+0000, chain.objs.size()=1 2024-09-12T01:02:37.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.r8OY96xJzBRDnm74OleKc03CsfY2F9s_0 2024-09-12T01:02:37.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.458+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.175655718694101530', time=2024-09-12T02:49:11.857155+0000, chain.objs.size()=1 2024-09-12T01:02:37.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.458+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.268__shadow_.uMmFFZZTtj-ftR2q1q-3hmKU-60N-ed_0 2024-09-12T01:02:37.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.458+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8623186705380796916', time=2024-09-12T02:49:13.975203+0000, chain.objs.size()=1 2024-09-12T01:02:37.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.458+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.271__shadow_.HhJv-88gz5Syx-gpHnrTs5ugPCotYXW_0 2024-09-12T01:02:37.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.458+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5126177955679910843', time=2024-09-12T02:49:16.836668+0000, chain.objs.size()=1 2024-09-12T01:02:37.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.458+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.275__shadow_.UfYaeoitXpCdBkuNVFjNDnDt_0oXQCe_0 2024-09-12T01:02:37.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.458+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5692476135881169049', time=2024-09-12T02:49:19.349506+0000, chain.objs.size()=1 2024-09-12T01:02:37.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.458+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.278__shadow_.y2fxoNrGlqCdCu6awBtUNX85msmqj0v_0 2024-09-12T01:02:37.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.458+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7545323998267284324', time=2024-09-12T02:49:32.426053+0000, chain.objs.size()=1 2024-09-12T01:02:37.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.458+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.Hcehdt2rUY1roAs4vweDxrKxoOjI1JY_0 2024-09-12T01:02:37.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17122825529979998144', time=2024-09-12T02:49:32.465001+0000, chain.objs.size()=1 2024-09-12T01:02:37.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.mrPhMJuoROyVjefrr3RBGQZyb5FH7Pg_0 2024-09-12T01:02:37.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3670855635205826226', time=2024-09-12T02:49:39.199621+0000, chain.objs.size()=1 2024-09-12T01:02:37.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.302__shadow_.9qpS8EyDOCcTaUwQGWs6WhcEY9oXA1V_0 2024-09-12T01:02:37.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11639630183110434414', time=2024-09-12T02:49:41.406696+0000, chain.objs.size()=1 2024-09-12T01:02:37.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.305__shadow_.Ub9Ds1nNKbEx_6R2Wclr2OblVwJchRu_0 2024-09-12T01:02:37.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6365071841124174304', time=2024-09-12T02:50:15.832347+0000, chain.objs.size()=1 2024-09-12T01:02:37.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.mnapQ3hb9ElHt_LpFWzlsA7cx0m6lvc_0 2024-09-12T01:02:37.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9063206541726819540', time=2024-09-12T02:50:15.860338+0000, chain.objs.size()=1 2024-09-12T01:02:37.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.YI_ajkiYJ7SYgSJ-vTqph7EZ2WFad8C_0 2024-09-12T01:02:37.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1914329406631475822', time=2024-09-12T02:50:15.951717+0000, chain.objs.size()=1 2024-09-12T01:02:37.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.RZOWLZY42Uz016VhWBZI5UaLdAU7mE6_0 2024-09-12T01:02:37.459 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10265481511439347070', time=2024-09-12T02:50:15.968579+0000, chain.objs.size()=1 2024-09-12T01:02:37.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.v1pCy-BhMj_m-9QQeZaUC9jCjMsbT4D_0 2024-09-12T01:02:37.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7344959854477119909', time=2024-09-12T02:50:16.142935+0000, chain.objs.size()=1 2024-09-12T01:02:37.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.NV2FNEBRAVIC03fI4pV_d4mXAr3nHkA_0 2024-09-12T01:02:37.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.353842236607191666', time=2024-09-12T02:50:16.147044+0000, chain.objs.size()=1 2024-09-12T01:02:37.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.mwJ08wlIqzwS52AbXufyVxl7ZhfHnNM_0 2024-09-12T01:02:37.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3974723386620678941', time=2024-09-12T02:50:16.150349+0000, chain.objs.size()=1 2024-09-12T01:02:37.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.vsucp3e4HTPlkl7i5XP8mbXTVVMgW6-_0 2024-09-12T01:02:37.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10738131244917915141', time=2024-09-12T02:50:16.170626+0000, chain.objs.size()=1 2024-09-12T01:02:37.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.7CF54g8kbJAxOvGoO7lxA6k42NJwSob_0 2024-09-12T01:02:37.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7865193718311130460', time=2024-09-12T02:50:16.358532+0000, chain.objs.size()=1 2024-09-12T01:02:37.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.fh0_HMDN3FYaKTzw2e5u2CA4tRx--iw_0 2024-09-12T01:02:37.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2746521957472568786', time=2024-09-12T02:50:16.386275+0000, chain.objs.size()=1 2024-09-12T01:02:37.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Uua7KvI0noGjMbA5DEm71A_ddgEYPMZ_0 2024-09-12T01:02:37.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8190274867899593230', time=2024-09-12T02:50:16.473941+0000, chain.objs.size()=1 2024-09-12T01:02:37.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.7ZRHutRk140EoXERQRo48zczq4Y1g11_0 2024-09-12T01:02:37.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7819931886355694816', time=2024-09-12T02:50:16.500985+0000, chain.objs.size()=1 2024-09-12T01:02:37.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Pwfl2lO3jQ9BwdEU_PghKJMWaPlHTv__0 2024-09-12T01:02:37.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8101730424158858857', time=2024-09-12T02:50:16.519505+0000, chain.objs.size()=1 2024-09-12T01:02:37.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Qwe_CLHen8yEJhbnEbxBs80GRVixjG6_0 2024-09-12T01:02:37.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13035151539506248988', time=2024-09-12T02:50:16.639309+0000, chain.objs.size()=1 2024-09-12T01:02:37.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.YlX1SQX1PbYEErcYsJVg4MKht3cnb64_0 2024-09-12T01:02:37.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9791642073447268846', time=2024-09-12T02:50:16.670015+0000, chain.objs.size()=1 2024-09-12T01:02:37.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.WIA5d7SNPxJ8cRG74XoHtq0AjhynsoK_0 2024-09-12T01:02:37.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17166076648671153628', time=2024-09-12T02:50:16.716830+0000, chain.objs.size()=1 2024-09-12T01:02:37.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xjahDniSs3jImrr2c5jvBoE-8rQj0HM_0 2024-09-12T01:02:37.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1541650333292144147', time=2024-09-12T02:50:16.928160+0000, chain.objs.size()=1 2024-09-12T01:02:37.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.7F1OvGL6DErEBKX3de1ulhOOaRj_yIo_0 2024-09-12T01:02:37.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8892349586742785711', time=2024-09-12T02:50:16.934716+0000, chain.objs.size()=1 2024-09-12T01:02:37.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4Ily_sE2jIMG70T92ACFNF9AjkV5eSK_0 2024-09-12T01:02:37.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12525011490447078945', time=2024-09-12T02:50:16.981800+0000, chain.objs.size()=1 2024-09-12T01:02:37.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.GOdeDErTJEiVXuNLXOMtShp29RzRDLv_0 2024-09-12T01:02:37.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16419274286462759218', time=2024-09-12T02:50:16.991881+0000, chain.objs.size()=1 2024-09-12T01:02:37.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Pf3tu-YrUxFGiBUI2biXcY-ViO8eQZW_0 2024-09-12T01:02:37.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14661721290676752324', time=2024-09-12T02:50:17.034214+0000, chain.objs.size()=1 2024-09-12T01:02:37.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.C9xmuSkJtdL-e96vJkC2Gh610iIMQWb_0 2024-09-12T01:02:37.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6925338317475217601', time=2024-09-12T02:50:17.169957+0000, chain.objs.size()=1 2024-09-12T01:02:37.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.zmAm872vs1R7UXEqxtZgkKewMM7b544_0 2024-09-12T01:02:37.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12024908175600708670', time=2024-09-12T02:50:17.184817+0000, chain.objs.size()=1 2024-09-12T01:02:37.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.h3EK1k30cv9wLYy9v77NlM5QTpn1Ux2_0 2024-09-12T01:02:37.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17354139836850779177', time=2024-09-12T02:50:17.198325+0000, chain.objs.size()=1 2024-09-12T01:02:37.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.vdyXWaVTVjsDWoJML3NFvbwV1yKYN2n_0 2024-09-12T01:02:37.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8733859560730740973', time=2024-09-12T02:50:17.254265+0000, chain.objs.size()=1 2024-09-12T01:02:37.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.2jaZ1ewCAI6nbuOBSkWHsBHUePsF11B_0 2024-09-12T01:02:37.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12610509833645091938', time=2024-09-12T02:50:17.444347+0000, chain.objs.size()=1 2024-09-12T01:02:37.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.HAm6AO2TTwKLVESX8QEjNS-YT7UtI24_0 2024-09-12T01:02:37.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6135286378480976155', time=2024-09-12T02:50:17.447917+0000, chain.objs.size()=1 2024-09-12T01:02:37.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.KUL4KzTVAWXqrweUiDVnGWJ6BbSxCfU_0 2024-09-12T01:02:37.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11278442657428369122', time=2024-09-12T02:50:17.459195+0000, chain.objs.size()=1 2024-09-12T01:02:37.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.vabZDGzSlCYZO6t3qrQsI3muzB0rKrd_0 2024-09-12T01:02:37.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1692140439076175039', time=2024-09-12T02:50:17.515846+0000, chain.objs.size()=1 2024-09-12T01:02:37.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.9WomPIbBeRNt3vAyEZ4Cop4fMnvMXts_0 2024-09-12T01:02:37.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10727148835258081422', time=2024-09-12T02:50:17.665033+0000, chain.objs.size()=1 2024-09-12T01:02:37.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Q972AWpiNx82Ub_OixDq-b_yFXcXwzS_0 2024-09-12T01:02:37.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12657609350458275014', time=2024-09-12T02:50:17.677979+0000, chain.objs.size()=1 2024-09-12T01:02:37.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.LU6bj7HwnV9zht0-yHzAL-ELfWlj-dZ_0 2024-09-12T01:02:37.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9483077403531331955', time=2024-09-12T02:50:17.698799+0000, chain.objs.size()=1 2024-09-12T01:02:37.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.gqL14S_low1mchWGclIMakzoY0vu60p_0 2024-09-12T01:02:37.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16833686180640388176', time=2024-09-12T02:50:17.710462+0000, chain.objs.size()=1 2024-09-12T01:02:37.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Fub7J9wRy-9MHhYFuI2SypY42UE7HQ2_0 2024-09-12T01:02:37.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14256782156290406309', time=2024-09-12T02:50:17.712528+0000, chain.objs.size()=1 2024-09-12T01:02:37.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.t1ZqjZ1PVjEoD4Jll207BGIHYU0Jyyr_0 2024-09-12T01:02:37.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5481700963581733331', time=2024-09-12T02:50:17.730543+0000, chain.objs.size()=1 2024-09-12T01:02:37.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.y-blElpRukfDdirChiA-AwZfuuUHDZk_0 2024-09-12T01:02:37.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11567742966221932346', time=2024-09-12T02:50:17.763192+0000, chain.objs.size()=1 2024-09-12T01:02:37.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Fdl4kECrV1_bAxgIHkphsFGc0OYoCbH_0 2024-09-12T01:02:37.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10925368858760824411', time=2024-09-12T02:50:17.767588+0000, chain.objs.size()=1 2024-09-12T01:02:37.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.TOFTa4uRYja9ryQ3rQL5o06xH2c8cBe_0 2024-09-12T01:02:37.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18147890113077877128', time=2024-09-12T02:50:39.440668+0000, chain.objs.size()=1 2024-09-12T01:02:37.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.VW-OKTZynxgWocfUXMfqW6a01LoOOZt_0 2024-09-12T01:02:37.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2146434549871628600', time=2024-09-12T02:50:39.509157+0000, chain.objs.size()=1 2024-09-12T01:02:37.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.M-ffehAZMtbLc6AarpUbp5ML3dR_Cx8_0 2024-09-12T01:02:37.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15177075608276154673', time=2024-09-12T02:50:39.545626+0000, chain.objs.size()=1 2024-09-12T01:02:37.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.RjFnYgKY2ko8epAOTxUHT9XBvz2UrNv_0 2024-09-12T01:02:37.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5222534011776436851', time=2024-09-12T02:50:39.568804+0000, chain.objs.size()=1 2024-09-12T01:02:37.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.KSgfaUySjYTnVBBCXptQsilM-pXi1N3_0 2024-09-12T01:02:37.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6609083469911638478', time=2024-09-12T02:50:39.740152+0000, chain.objs.size()=1 2024-09-12T01:02:37.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.qBrtSJWGEyEu4CYwuU0_b2mpK2AL5wz_0 2024-09-12T01:02:37.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9038834355071683771', time=2024-09-12T02:50:39.844336+0000, chain.objs.size()=1 2024-09-12T01:02:37.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.U3aUT_kVT2918WlIVYkDSiTHsPTjbsk_0 2024-09-12T01:02:37.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15432117430756049075', time=2024-09-12T02:50:39.862120+0000, chain.objs.size()=1 2024-09-12T01:02:37.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.5SegTDZNz4iAjaasU8O3pb6_eXVvBYa_0 2024-09-12T01:02:37.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1553135378318038846', time=2024-09-12T02:50:39.985176+0000, chain.objs.size()=1 2024-09-12T01:02:37.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.jUgJw15TJGG1Fr878Cv_VnBTS0yUoJN_0 2024-09-12T01:02:37.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3080536062548429801', time=2024-09-12T02:50:40.098637+0000, chain.objs.size()=1 2024-09-12T01:02:37.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.0qEbXhsCJFbmqnZ3EmrdVNPh-Mevzqe_0 2024-09-12T01:02:37.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15545409379806123639', time=2024-09-12T02:50:40.764122+0000, chain.objs.size()=1 2024-09-12T01:02:37.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.cNgSvLm66M77iisjx0t9y6y6pBGsUkL_0 2024-09-12T01:02:37.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10087467085622575348', time=2024-09-12T02:50:40.785350+0000, chain.objs.size()=1 2024-09-12T01:02:37.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.f7P72rzh5wo6PinG416H0Dy3OYyojAe_0 2024-09-12T01:02:37.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16107900782591650652', time=2024-09-12T02:50:40.790741+0000, chain.objs.size()=1 2024-09-12T01:02:37.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.s-2ZnuTQoqTQ3YJYQ2jIkMxh1lOF_Pg_0 2024-09-12T01:02:37.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.67487989195247270', time=2024-09-12T02:50:40.845499+0000, chain.objs.size()=1 2024-09-12T01:02:37.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.AdHuWB70XTNxvdZAv7-ZIjxAwOJrFie_0 2024-09-12T01:02:37.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1059682565282431330', time=2024-09-12T02:50:40.881131+0000, chain.objs.size()=1 2024-09-12T01:02:37.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.oVXJ3BMXqLSlMwPvaheKN7VZ6fKGLOB_0 2024-09-12T01:02:37.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14776707231034263184', time=2024-09-12T02:50:41.143430+0000, chain.objs.size()=1 2024-09-12T01:02:37.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.cfjMmio57zeIjnpCWDB77r1ewdEmJlX_0 2024-09-12T01:02:37.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8302736988414570928', time=2024-09-12T02:50:41.169056+0000, chain.objs.size()=1 2024-09-12T01:02:37.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.x_U31o1vhDv9qtQNUb5Hbi8Tx6VYCtk_0 2024-09-12T01:02:37.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.752800290171501341', time=2024-09-12T02:50:41.350524+0000, chain.objs.size()=1 2024-09-12T01:02:37.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Gm6_ZndDH9hUUkTLgvfU173t4FoIhCB_0 2024-09-12T01:02:37.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12773145534119389411', time=2024-09-12T02:50:41.368955+0000, chain.objs.size()=1 2024-09-12T01:02:37.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.SXOO-uiXBTmaYDnvtcwdM8PLdg45Nfw_0 2024-09-12T01:02:37.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15371597880813664826', time=2024-09-12T02:50:41.426962+0000, chain.objs.size()=1 2024-09-12T01:02:37.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.dLEbQKovqgpRqwuiJKNc_oBfTaWbwpX_0 2024-09-12T01:02:37.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.688345282438724880', time=2024-09-12T02:50:41.561263+0000, chain.objs.size()=1 2024-09-12T01:02:37.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.V5e1CswvJmRIZhovx7TFnRPWrcHQ8q5_0 2024-09-12T01:02:37.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7848608948124165569', time=2024-09-12T02:50:41.606576+0000, chain.objs.size()=1 2024-09-12T01:02:37.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.xB237f8Lf6G4Slx5VW9cULv1p-Upeyf_0 2024-09-12T01:02:37.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.494+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13796276808459349779', time=2024-09-12T02:50:41.615907+0000, chain.objs.size()=1 2024-09-12T01:02:37.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.494+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.JumgkNg5d_s68QJ8Zpg_K5kWfHObV7N_0 2024-09-12T01:02:37.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/43678 2024-09-12T01:02:37.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T01:02:37.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16042167898271731152', time=2024-09-12T02:50:41.622230+0000, chain.objs.size()=1 2024-09-12T01:02:37.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ujhhi-Es1imHA5xePrv0CXpSoKC89g-_0 2024-09-12T01:02:37.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9778604703423821355', time=2024-09-12T02:50:41.644061+0000, chain.objs.size()=1 2024-09-12T01:02:37.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.1zGIx8DSCPZyIuCZY6iLZ_H6tTRBq_k_0 2024-09-12T01:02:37.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11020549100376753464', time=2024-09-12T02:50:48.320096+0000, chain.objs.size()=1 2024-09-12T01:02:37.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.334__shadow_.JSoxb07afQH-zvXd6bzkZqhEuGR98bX_0 2024-09-12T01:02:37.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14200973438504541223', time=2024-09-12T02:50:52.188540+0000, chain.objs.size()=1 2024-09-12T01:02:37.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.340__shadow_.n1qSqdOj2-BNni6UvZPVMxBMq-gYGgX_0 2024-09-12T01:02:37.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10936887883686386929', time=2024-09-12T02:50:54.904848+0000, chain.objs.size()=1 2024-09-12T01:02:37.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.344__shadow_.smTJZiU5Bjoj3tytQxorAkP-1FWQtBF_0 2024-09-12T01:02:37.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.913027298302567788', time=2024-09-12T02:52:01.156320+0000, chain.objs.size()=1 2024-09-12T01:02:37.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.436__shadow_.E0Gy45tbFqtPG63AUzQnsgSMsnuxATH_0 2024-09-12T01:02:37.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17222479865449974481', time=2024-09-12T02:52:20.609912+0000, chain.objs.size()=1 2024-09-12T01:02:37.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.459__shadow_.rEcxdWaCMEBEqvlSkm8-uP4Ic70LpBI_0 2024-09-12T01:02:37.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3497058236701341811', time=2024-09-12T02:52:26.634316+0000, chain.objs.size()=1 2024-09-12T01:02:37.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.465__shadow_.lsXRRyf_tMJ6uySBDfTYQZj1Y8l3Gk__0 2024-09-12T01:02:37.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.913804283294017683', time=2024-09-12T02:52:44.572191+0000, chain.objs.size()=1 2024-09-12T01:02:37.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.495__shadow_.YD_vnRnK5q-Hb-o3JmtFHQaSIzIajur_0 2024-09-12T01:02:37.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1867889470959960325', time=2024-09-12T02:52:47.308915+0000, chain.objs.size()=1 2024-09-12T01:02:37.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.499__shadow_.FqOjqzlyy10O9k6HdxBF-C91KupjCsy_0 2024-09-12T01:02:37.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16555586796120252780', time=2024-09-12T02:53:02.380201+0000, chain.objs.size()=1 2024-09-12T01:02:37.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.517__shadow_.sq65Sl-a3RYnYgjk7Xr9LdW-Y2Ym5ek_0 2024-09-12T01:02:37.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9988897772609027226', time=2024-09-12T02:54:47.145549+0000, chain.objs.size()=1 2024-09-12T01:02:37.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:wpvsoqT2SKSaTBtmaojLaC3rQ9ccCac_.CK4jtNo9hdAnyyEhBptQn5pgtuAJ_wC_0 2024-09-12T01:02:37.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3788042548777751234', time=2024-09-12T02:54:55.722691+0000, chain.objs.size()=1 2024-09-12T01:02:37.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.572__shadow_._axsQ6JahHI5HOPv8efGkbc_hzftWz3_0 2024-09-12T01:02:37.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8819792626740472468', time=2024-09-12T02:54:58.086341+0000, chain.objs.size()=1 2024-09-12T01:02:37.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.574__shadow_.losu3y9svZxsjKU09KeRknBVTfiDIFE_0 2024-09-12T01:02:37.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1815193939483484692', time=2024-09-12T02:54:58.501590+0000, chain.objs.size()=1 2024-09-12T01:02:37.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.574__shadow:6nuxdNb2Pmu0fxtkeL1pNL4lpfJJErE_.B9O4xo4_0-QRvIMKY2ajpmbB7zd7voz_0 2024-09-12T01:02:37.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13180284394022386381', time=2024-09-12T02:55:00.626336+0000, chain.objs.size()=1 2024-09-12T01:02:37.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.574__shadow:DXTlJPFKf3V.qR-wKtikSnC7TccpM5._.HP3yTFBOPYhcOgYEbVp-3tYe30tE9_J_0 2024-09-12T01:02:37.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10633979154433883560', time=2024-09-12T02:55:10.777453+0000, chain.objs.size()=1 2024-09-12T01:02:37.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:a0u2OLJu.xeRZSBHlAAyDzKc8eggG1h_.cnPUZ0H01phguhOvUpvFj4lyk3WVKEx_0 2024-09-12T01:02:37.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.750200831068012613', time=2024-09-12T02:55:28.610938+0000, chain.objs.size()=1 2024-09-12T01:02:37.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.579__shadow:d8npcRzs7DGOBdF8c-iPrMmZ4L-UCz5_.euKVgjrWLI-OSgFfSXjqXQlw_DFGMUa_0 2024-09-12T01:02:37.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16345064036729078582', time=2024-09-12T02:55:36.034323+0000, chain.objs.size()=1 2024-09-12T01:02:37.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.587__shadow:kI4ZqKcT7oAZqBMHIC2kSPFjbmPI6WL_.h8tjOfcUaFTlTPztPTjL6DAZkSdmBje_0 2024-09-12T01:02:37.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3485487278772324394', time=2024-09-12T02:58:40.033430+0000, chain.objs.size()=1 2024-09-12T01:02:37.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.654__shadow_.9a_1ehvmObDrpmyxEc5zvT5KbTEDlxI_0 2024-09-12T01:02:37.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3014194400505076149', time=2024-09-12T02:58:50.061393+0000, chain.objs.size()=1 2024-09-12T01:02:37.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.665__shadow_.nYtz2u_UhaBA1vh61DTEqArp9RlrT2W_0 2024-09-12T01:02:37.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7191021855110561825', time=2024-09-12T02:58:59.050967+0000, chain.objs.size()=1 2024-09-12T01:02:37.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.679__shadow_.8GWjL6dfdbTU67-Vd6DS7c57wkRZ_0H_0 2024-09-12T01:02:37.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10318674369660763867', time=2024-09-12T02:59:08.250427+0000, chain.objs.size()=1 2024-09-12T01:02:37.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.694__shadow:HAkcdaW1yLNsY0pzdEeFBPoVimjO9EJ_._ZhyIebzBUsgUxFmnJr5-pGp6vjnP2G_0 2024-09-12T01:02:37.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.510+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8738225289564412618', time=2024-09-12T02:59:09.639934+0000, chain.objs.size()=1 2024-09-12T01:02:37.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.510+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.696__shadow:zhKBRAZngIdzk5ve84UkRRM-O82uniw_.8ou4XZM6lgnCbA_I4E_0EwpkuQTbd1B_0 2024-09-12T01:02:37.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.510+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1717413253061358984', time=2024-09-12T02:59:09.814872+0000, chain.objs.size()=1 2024-09-12T01:02:37.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.510+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.696__shadow:srO-0FcveeT5Gy2HGEaZPH2pglhKFic_.DfCz4_w_5i5orpeaR34zxBxYYRmjeM9_0 2024-09-12T01:02:37.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.510+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17390547389145412684', time=2024-09-12T02:59:33.574000+0000, chain.objs.size()=1 2024-09-12T01:02:37.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.510+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.716__shadow:e5M6blpUrFu2W1SmZFS-hUyx7okjbju_.glhA5SIwGfRBBnucZofsv56Dqa53_b2_0 2024-09-12T01:02:37.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:37.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:02:37.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49581' 2024-09-12T01:02:37.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2074401620782389576', time=2024-09-12T02:48:22.787733+0000, chain.objs.size()=1 2024-09-12T01:02:37.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.235__shadow_.y-1bQfmPXb6NiliWg2yY6SMISx0n1FH_0 2024-09-12T01:02:37.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17998746827235532387', time=2024-09-12T02:48:22.792468+0000, chain.objs.size()=1 2024-09-12T01:02:37.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.235__shadow_.MYts4HTFW1HEyK9ev4qetJyj1m_Twpe_0 2024-09-12T01:02:37.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2749938969998565032', time=2024-09-12T02:48:25.956173+0000, chain.objs.size()=1 2024-09-12T01:02:37.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.238__shadow_.q4iGVvdOIt9kyre_0XUddZniedPqbGr_0 2024-09-12T01:02:37.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16773533155337853314', time=2024-09-12T02:48:38.021608+0000, chain.objs.size()=1 2024-09-12T01:02:37.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.253__shadow_.keiKFkyFyH2KMaIN8saOUS1NMMlmhWf_0 2024-09-12T01:02:37.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7631167449083112129', time=2024-09-12T02:48:39.461214+0000, chain.objs.size()=1 2024-09-12T01:02:37.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.255__shadow_.Ub2qq5beBtRkTbwl64HvbEaAczEcGGe_0 2024-09-12T01:02:37.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12725512704896174250', time=2024-09-12T02:48:40.185431+0000, chain.objs.size()=1 2024-09-12T01:02:37.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.256__shadow_.eBFvPOZ0hWKyZaJLlErPSeHJwYgUFOB_0 2024-09-12T01:02:37.516 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2228727750790837874', time=2024-09-12T02:48:41.632517+0000, chain.objs.size()=1 2024-09-12T01:02:37.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.258__shadow_.9AbEQcQ8d158hwB0PEojauF8M1vRI4X_0 2024-09-12T01:02:37.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7277977567278580503', time=2024-09-12T02:49:05.511569+0000, chain.objs.size()=1 2024-09-12T01:02:37.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.8M-vI7zHZKYzPArmu55GnYR9OqIrdZ6_0 2024-09-12T01:02:37.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.912501442014108519', time=2024-09-12T02:49:05.577412+0000, chain.objs.size()=1 2024-09-12T01:02:37.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Ui7aqz4LuTB1LsRPF5jV83m7SFlLdqL_0 2024-09-12T01:02:37.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16343124334862294579', time=2024-09-12T02:49:05.744470+0000, chain.objs.size()=1 2024-09-12T01:02:37.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.MFM4uA3i9cwtwlKJreqMFcwpEppb-Un_0 2024-09-12T01:02:37.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7216919488647563832', time=2024-09-12T02:49:05.760147+0000, chain.objs.size()=1 2024-09-12T01:02:37.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.UsCAoe6xJ12qq_cJiqaGd4kfbFglCrR_0 2024-09-12T01:02:37.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12032645896760896675', time=2024-09-12T02:49:05.767594+0000, chain.objs.size()=1 2024-09-12T01:02:37.517 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.D7KZ7mVKPD6nHU6QGE9lWBYOeOQZgjq_0 2024-09-12T01:02:37.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7670767832036452306', time=2024-09-12T02:49:05.788439+0000, chain.objs.size()=1 2024-09-12T01:02:37.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.p1akdEGnGZo-FBMGXgZrXPp4Uu6fIxw_0 2024-09-12T01:02:37.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4787867342152462926', time=2024-09-12T02:49:05.801134+0000, chain.objs.size()=1 2024-09-12T01:02:37.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.rlNZfHFINYvhNCFIAItWP9OXnIkdJOL_0 2024-09-12T01:02:37.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13657744775478512249', time=2024-09-12T02:49:05.842444+0000, chain.objs.size()=1 2024-09-12T01:02:37.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.a-I_ie5S3a2zEv1D4scqJAbvuzTa--F_0 2024-09-12T01:02:37.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10476839289874229841', time=2024-09-12T02:49:06.012393+0000, chain.objs.size()=1 2024-09-12T01:02:37.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.56GWSrSIa7C4mONZIzYBqvgsVE4ac2j_0 2024-09-12T01:02:37.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15969723606880684554', time=2024-09-12T02:49:06.021863+0000, chain.objs.size()=1 2024-09-12T01:02:37.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.X2IuJ09BgDbIzCHQzaQYTHxWRJew1Gq_0 2024-09-12T01:02:37.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13789935048493713924', time=2024-09-12T02:49:06.110143+0000, chain.objs.size()=1 2024-09-12T01:02:37.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.IhI_-fqai9nkf4cL0b_bWHuLYyKG1r7_0 2024-09-12T01:02:37.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15120209822047241267', time=2024-09-12T02:49:06.226947+0000, chain.objs.size()=1 2024-09-12T01:02:37.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.jxHTeigyhdx42s7gr_AW0bQB2_RbHkp_0 2024-09-12T01:02:37.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7552647580407595832', time=2024-09-12T02:49:06.273967+0000, chain.objs.size()=1 2024-09-12T01:02:37.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.hIWBBlUh3TVwVM5EtT64Erj3pLtEEhF_0 2024-09-12T01:02:37.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15086442093274611076', time=2024-09-12T02:49:06.295894+0000, chain.objs.size()=1 2024-09-12T01:02:37.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.6o5oo3fLVR2DjgkRge978jxpDANAj9d_0 2024-09-12T01:02:37.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1287659295668972587', time=2024-09-12T02:49:06.335269+0000, chain.objs.size()=1 2024-09-12T01:02:37.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.522+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.vfjNi3Lr3I3cAOrfS6Ys5FFJetGjaFU_0 2024-09-12T01:02:37.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8822401348013414985', time=2024-09-12T02:49:06.566308+0000, chain.objs.size()=1 2024-09-12T01:02:37.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.TJGvJHyJkli8ij061mP0WvHr5XNMhaq_0 2024-09-12T01:02:37.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17874347211266685167', time=2024-09-12T02:49:06.581861+0000, chain.objs.size()=1 2024-09-12T01:02:37.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.PNw7wKUem97VKo5L0GwWBapOrC7Iljs_0 2024-09-12T01:02:37.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7217908597291276514', time=2024-09-12T02:49:06.596774+0000, chain.objs.size()=1 2024-09-12T01:02:37.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.huzqTo1IO0JQxseW_4OBMGiYhtDxbS1_0 2024-09-12T01:02:37.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6009981009098516254', time=2024-09-12T02:49:06.629765+0000, chain.objs.size()=1 2024-09-12T01:02:37.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.dxH-AdQ_sowxH0g_okBdcKagNnveb_p_0 2024-09-12T01:02:37.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.530+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16381912498784252490', time=2024-09-12T02:49:06.803605+0000, chain.objs.size()=1 2024-09-12T01:02:37.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.530+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.jQJiPumihlAe2z4FF5bIcJ-vM1FzOGa_0 2024-09-12T01:02:37.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.530+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16889081532506539845', time=2024-09-12T02:49:06.837891+0000, chain.objs.size()=1 2024-09-12T01:02:37.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.530+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.s0z9nUYJdBe1uz-c-jikZ6pyKAlM9hz_0 2024-09-12T01:02:37.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.530+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12706450412828942424', time=2024-09-12T02:49:06.846185+0000, chain.objs.size()=1 2024-09-12T01:02:37.525 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.530+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.C9Chls5kUmDcKnZD9bwdVPZ-69jf-Ei_0 2024-09-12T01:02:37.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.530+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11075556289388508124', time=2024-09-12T02:49:06.887141+0000, chain.objs.size()=1 2024-09-12T01:02:37.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.530+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.J5ObCN7SYuqBrNqe33HiQZMZWu1rOVC_0 2024-09-12T01:02:37.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.530+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15856443314463068874', time=2024-09-12T02:49:07.159832+0000, chain.objs.size()=1 2024-09-12T01:02:37.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.530+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.K2z07Bl1mw010gVaC4jW5yS5ySreuRl_0 2024-09-12T01:02:37.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.530+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13892240801840672937', time=2024-09-12T02:49:07.163646+0000, chain.objs.size()=1 2024-09-12T01:02:37.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.530+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.SVu_N8XOGwXp79K8Xjwf16tKXAfUGzx_0 2024-09-12T01:02:37.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.530+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9210971445813320389', time=2024-09-12T02:49:07.217794+0000, chain.objs.size()=1 2024-09-12T01:02:37.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.530+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.qawb_FsMgbuq4VUgq48YA-OwcqztwZa_0 2024-09-12T01:02:37.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.530+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4926303744790611107', time=2024-09-12T02:49:07.370968+0000, chain.objs.size()=1 2024-09-12T01:02:37.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.530+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.xStaM1zp8FVqfyK3bOPqYvTAZcXWQcG_0 2024-09-12T01:02:37.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17512996686005236269', time=2024-09-12T02:49:07.403982+0000, chain.objs.size()=1 2024-09-12T01:02:37.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.63yLCDxWdhNknL4Xuu-VZ-f-vXS-U2D_0 2024-09-12T01:02:37.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16262712655727596632', time=2024-09-12T02:49:07.426248+0000, chain.objs.size()=1 2024-09-12T01:02:37.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.VYERNrodlkr00rSpzALn2tj8EQErE-l_0 2024-09-12T01:02:37.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15019568933459091318', time=2024-09-12T02:49:13.974811+0000, chain.objs.size()=1 2024-09-12T01:02:37.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.271__shadow_.0GRjhxmBqewCd62zwvvTW8ZMX68B0Gy_0 2024-09-12T01:02:37.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13115886460409166107', time=2024-09-12T02:49:23.870885+0000, chain.objs.size()=1 2024-09-12T01:02:37.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.284__shadow_.apYp2cCysuX23Ea_D1_tAujF9s-HTfc_0 2024-09-12T01:02:37.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9886469742733791653', time=2024-09-12T02:49:30.928400+0000, chain.objs.size()=1 2024-09-12T01:02:37.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.E9XoTwAui78xDetl4puNfL68asK_izW_0 2024-09-12T01:02:37.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9574479575517568713', time=2024-09-12T02:49:30.934090+0000, chain.objs.size()=1 2024-09-12T01:02:37.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.4C0oNWWCqmqiA842-5DLXFdKrByLbFE_0 2024-09-12T01:02:37.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3468968065331705040', time=2024-09-12T02:50:15.830912+0000, chain.objs.size()=1 2024-09-12T01:02:37.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.GCp-4fKdtSfQkm19POptxUhkUnfReg2_0 2024-09-12T01:02:37.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11158552738723596279', time=2024-09-12T02:50:15.927956+0000, chain.objs.size()=1 2024-09-12T01:02:37.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.x9AXuL6g_1v6dkHBptrA3DbZV_1Xvv-_0 2024-09-12T01:02:37.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8201612605131914394', time=2024-09-12T02:50:16.080414+0000, chain.objs.size()=1 2024-09-12T01:02:37.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.5FVUtl78LnCs8TIL6C6Fi_yc0qm36s1_0 2024-09-12T01:02:37.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11216687880257855220', time=2024-09-12T02:50:16.141461+0000, chain.objs.size()=1 2024-09-12T01:02:37.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.NCaF73W-ynLIDfCzIwjV_ot1fJ_ArQy_0 2024-09-12T01:02:37.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11476627640166220510', time=2024-09-12T02:50:16.153275+0000, chain.objs.size()=1 2024-09-12T01:02:37.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.62y2hU2kRmy5TjoLCUZvMH39fUf8rKW_0 2024-09-12T01:02:37.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15373539440268340674', time=2024-09-12T02:50:16.154450+0000, chain.objs.size()=1 2024-09-12T01:02:37.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.LvYywFuOOSzUkMWxOEjn0KCw7Ydg2cM_0 2024-09-12T01:02:37.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13934955283791111898', time=2024-09-12T02:50:16.184936+0000, chain.objs.size()=1 2024-09-12T01:02:37.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_._x8PYy55xuHAnhYqgdN56qMM0hHjwue_0 2024-09-12T01:02:37.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15803961725571739719', time=2024-09-12T02:50:16.365390+0000, chain.objs.size()=1 2024-09-12T01:02:37.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.qVRVmLXxglIoo5hNWOcuSGcj3BRjeas_0 2024-09-12T01:02:37.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15317967613257462824', time=2024-09-12T02:50:16.738964+0000, chain.objs.size()=1 2024-09-12T01:02:37.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.J2EAokim9sPX2xanchvKfGtXi2il5t4_0 2024-09-12T01:02:37.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17978647167894424869', time=2024-09-12T02:50:16.777719+0000, chain.objs.size()=1 2024-09-12T01:02:37.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6Uybsav8a7IZcickwpm1uqr1KvS3_wf_0 2024-09-12T01:02:37.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9686930638552713914', time=2024-09-12T02:50:16.887787+0000, chain.objs.size()=1 2024-09-12T01:02:37.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.bVKi11H-ZvruXDyqjzWtFkj3Rbga67T_0 2024-09-12T01:02:37.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13163412494434853578', time=2024-09-12T02:50:16.930334+0000, chain.objs.size()=1 2024-09-12T01:02:37.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.FBoiMVPmDfF1JbrEtsKDMCp1aP3qF9u_0 2024-09-12T01:02:37.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16561093859167264818', time=2024-09-12T02:50:16.964782+0000, chain.objs.size()=1 2024-09-12T01:02:37.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4kj3oEGjGfj4Tnc2ErlhaOhh58gBFFV_0 2024-09-12T01:02:37.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4555522655974246650', time=2024-09-12T02:50:17.022152+0000, chain.objs.size()=1 2024-09-12T01:02:37.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.lV05hb-NpOrSqDeQgIH6efBXAo61Vcv_0 2024-09-12T01:02:37.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18009166538089135169', time=2024-09-12T02:50:17.181032+0000, chain.objs.size()=1 2024-09-12T01:02:37.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.LlPPSjbCp2LjfA_k1DPx1_4DUj2jWHo_0 2024-09-12T01:02:37.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16569615153850292522', time=2024-09-12T02:50:17.188574+0000, chain.objs.size()=1 2024-09-12T01:02:37.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.bkRvXj8YWCA6SWEZFwa-SOFsWkYd0z1_0 2024-09-12T01:02:37.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2591030711830763573', time=2024-09-12T02:50:17.210110+0000, chain.objs.size()=1 2024-09-12T01:02:37.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.vffPSg3z-lLiWBC_ZKfns6PyPMjqDV1_0 2024-09-12T01:02:37.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15383862629566582918', time=2024-09-12T02:50:17.218437+0000, chain.objs.size()=1 2024-09-12T01:02:37.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.sPEOMp3ygZCyfvuY8-QAOmTmqZMGNzf_0 2024-09-12T01:02:37.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3034235748766383358', time=2024-09-12T02:50:17.240729+0000, chain.objs.size()=1 2024-09-12T01:02:37.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4JUimE5kg2i9hoT0TjTfTRPb2-3EWvL_0 2024-09-12T01:02:37.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6779399263371484507', time=2024-09-12T02:50:17.256953+0000, chain.objs.size()=1 2024-09-12T01:02:37.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6lbrbqFQuJkR-umeQY4aAh-u_dXg7dX_0 2024-09-12T01:02:37.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1109336774404676702', time=2024-09-12T02:50:17.402700+0000, chain.objs.size()=1 2024-09-12T01:02:37.543 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.zgJADGROK0CTsD1A3YLfcUkyUPp-BZ0_0 2024-09-12T01:02:37.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5118417352902379317', time=2024-09-12T02:50:17.423785+0000, chain.objs.size()=1 2024-09-12T01:02:37.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ix9qKW990r3LmNds0PCt-FRT1pUdaN6_0 2024-09-12T01:02:37.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18422540283302706737', time=2024-09-12T02:50:17.471974+0000, chain.objs.size()=1 2024-09-12T01:02:37.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.LpKuyw4-l-wvYpuTg9s883NTCgyQJS0_0 2024-09-12T01:02:37.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9865508800418452178', time=2024-09-12T02:50:17.711307+0000, chain.objs.size()=1 2024-09-12T01:02:37.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.cembVrRQUIq7aiu38BG32r9Yl-2EYkt_0 2024-09-12T01:02:37.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4217420356433257898', time=2024-09-12T02:50:17.748208+0000, chain.objs.size()=1 2024-09-12T01:02:37.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-fQXS61iDDQRJGDw0mxEAkd_s5Tzyp__0 2024-09-12T01:02:37.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13428166211618991544', time=2024-09-12T02:50:17.749229+0000, chain.objs.size()=1 2024-09-12T01:02:37.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.9fg2GjnU6b7FzG2DcAqNw4QfhWxkuPJ_0 2024-09-12T01:02:37.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17873351922116685557', time=2024-09-12T02:50:39.483559+0000, chain.objs.size()=1 2024-09-12T01:02:37.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.G3zvBfW4xBzQlc2q0MPx7lFS0fGUWDi_0 2024-09-12T01:02:37.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18360901688054217394', time=2024-09-12T02:50:39.526302+0000, chain.objs.size()=1 2024-09-12T01:02:37.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.FzzKwjHAOpttNVzVA8mk8XLRyxKWNBZ_0 2024-09-12T01:02:37.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10661436816052563270', time=2024-09-12T02:50:39.565995+0000, chain.objs.size()=1 2024-09-12T01:02:37.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.QxQ1iBxTk2o9O2jvijHztBfrq61yRrB_0 2024-09-12T01:02:37.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2360309976232742611', time=2024-09-12T02:50:39.586541+0000, chain.objs.size()=1 2024-09-12T01:02:37.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.pwdEPeBO_AmZ_oSa6B3KNHK8whEjRlg_0 2024-09-12T01:02:37.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14233176414694497111', time=2024-09-12T02:50:39.599308+0000, chain.objs.size()=1 2024-09-12T01:02:37.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Rzkumn48SIRpy71hZ-SjbCKXenyiN2c_0 2024-09-12T01:02:37.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3969420928826843737', time=2024-09-12T02:50:39.602900+0000, chain.objs.size()=1 2024-09-12T01:02:37.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.FkpxyEPeMB4N-VNkEw9uKCTnP3N_yDC_0 2024-09-12T01:02:37.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18031518783670544237', time=2024-09-12T02:50:39.608094+0000, chain.objs.size()=1 2024-09-12T01:02:37.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.bN-60pjAcrcOlvs9gJ_kzWJg93Vl58H_0 2024-09-12T01:02:37.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17174599201789446790', time=2024-09-12T02:50:39.732472+0000, chain.objs.size()=1 2024-09-12T01:02:37.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.YeH-ZnYSB_DR-NftSj9XCsuAh70rF4e_0 2024-09-12T01:02:37.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.603200278227779854', time=2024-09-12T02:50:39.783235+0000, chain.objs.size()=1 2024-09-12T01:02:37.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.eEPGmAippIIaIajVyM6Ez-13lW_GocO_0 2024-09-12T01:02:37.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7262226016529927765', time=2024-09-12T02:50:40.071846+0000, chain.objs.size()=1 2024-09-12T01:02:37.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.15AKGiE65GKEJ7M39rqZaQ8B0NH-_7__0 2024-09-12T01:02:37.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16227552487661157211', time=2024-09-12T02:50:40.117834+0000, chain.objs.size()=1 2024-09-12T01:02:37.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.rFTlFSw5M2chpa6oMcWGUv8NO6wTnNi_0 2024-09-12T01:02:37.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8054072780567892475', time=2024-09-12T02:50:40.299851+0000, chain.objs.size()=1 2024-09-12T01:02:37.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.vMBji_yGrHexOubBBFZQ14QuN2txcqK_0 2024-09-12T01:02:37.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11183026141370082844', time=2024-09-12T02:50:40.334480+0000, chain.objs.size()=1 2024-09-12T01:02:37.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.dCaWQjo9cCPQRZV7auwBjTly_WkfFz1_0 2024-09-12T01:02:37.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.973720469361576181', time=2024-09-12T02:50:40.563668+0000, chain.objs.size()=1 2024-09-12T01:02:37.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.paPdwCAcOFSaaVq1In7LEtqLc97D8jn_0 2024-09-12T01:02:37.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5290380622809849662', time=2024-09-12T02:50:40.606139+0000, chain.objs.size()=1 2024-09-12T01:02:37.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.zGLC_ci7wbIO5XREUCAZ2QoWpX1vObg_0 2024-09-12T01:02:37.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4391480424308150555', time=2024-09-12T02:50:40.797595+0000, chain.objs.size()=1 2024-09-12T01:02:37.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.oJTrRA0Wb7mD6VFvnQ8rh0k4SzRBK2F_0 2024-09-12T01:02:37.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9242146563861423276', time=2024-09-12T02:50:40.834260+0000, chain.objs.size()=1 2024-09-12T01:02:37.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.oIKaAgsfHWW_UnBQU1NdwOPW9CuOsgW_0 2024-09-12T01:02:37.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10587366935538509332', time=2024-09-12T02:50:40.870433+0000, chain.objs.size()=1 2024-09-12T01:02:37.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.JSxCAswZbK7_IKWCrFbnSQTGTLHIZKu_0 2024-09-12T01:02:37.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8310351307756228194', time=2024-09-12T02:50:41.051331+0000, chain.objs.size()=1 2024-09-12T01:02:37.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_._JNnI-kT4-KH3ScMdKil7tUBycmL_Ui_0 2024-09-12T01:02:37.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15580035170302306287', time=2024-09-12T02:50:41.104949+0000, chain.objs.size()=1 2024-09-12T01:02:37.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ZO0LgiLvN726qUsNEql5Yg7JyJv0EqU_0 2024-09-12T01:02:37.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.356622562493849766', time=2024-09-12T02:50:41.151902+0000, chain.objs.size()=1 2024-09-12T01:02:37.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.rB0-5Yj4mZYdXlbErOikXjl63Bk1-v3_0 2024-09-12T01:02:37.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10336766938570872242', time=2024-09-12T02:50:41.266077+0000, chain.objs.size()=1 2024-09-12T01:02:37.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.xx7n-1CFE-gObK15J0CPpV_wVI0Gg6m_0 2024-09-12T01:02:37.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10909128408059024887', time=2024-09-12T02:50:41.296565+0000, chain.objs.size()=1 2024-09-12T01:02:37.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.QkTBzdYV934ojF41JV2hIzlyPnl7sgN_0 2024-09-12T01:02:37.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.566+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11038245010920672762', time=2024-09-12T02:50:41.377505+0000, chain.objs.size()=1 2024-09-12T01:02:37.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.566+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.sfM597ayV1QUztrNQtzHmJLl1FjcVAd_0 2024-09-12T01:02:37.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.566+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3265260153813494850', time=2024-09-12T02:50:41.552170+0000, chain.objs.size()=1 2024-09-12T01:02:37.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.566+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.PcVC0HDANMyGXdZmhLHuxrTBYH8hcAg_0 2024-09-12T01:02:37.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.566+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13365558206748428082', time=2024-09-12T02:50:41.641562+0000, chain.objs.size()=1 2024-09-12T01:02:37.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.566+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.8R12HtzwBoHTR7Ly7siPhH2trej25Da_0 2024-09-12T01:02:37.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.566+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16033547657505331473', time=2024-09-12T02:52:07.361465+0000, chain.objs.size()=1 2024-09-12T01:02:37.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.566+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.444__shadow_.RvDsO8DJKl84opowCufOOWRnmjXXsG2_0 2024-09-12T01:02:37.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.566+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7938382408521736325', time=2024-09-12T02:52:45.384218+0000, chain.objs.size()=1 2024-09-12T01:02:37.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.566+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.496__shadow_.HoCP76AKFS1VWiYyGseyKMzbcaWvBKe_0 2024-09-12T01:02:37.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.566+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3260007917465236698', time=2024-09-12T02:52:46.448963+0000, chain.objs.size()=1 2024-09-12T01:02:37.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.566+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.498__shadow_.9zoRtlZIT-cQSE27KNsr9z9cMPSOzQ8_0 2024-09-12T01:02:37.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~a_LzvR5Yq3HZz4OpKlpw-uRZeRJtQxL', time=2024-09-12T02:53:18.186620+0000, chain.objs.size()=1 2024-09-12T01:02:37.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~a_LzvR5Yq3HZz4OpKlpw-uRZeRJtQxL.3 2024-09-12T01:02:37.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8268664215792577093', time=2024-09-12T02:53:29.013753+0000, chain.objs.size()=2 2024-09-12T01:02:37.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.523__multipart_mymultipart.2~c175BilVauMxSW4cnwvfSjeIKfvZSzk.1 2024-09-12T01:02:37.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.523__multipart_mymultipart.2~c175BilVauMxSW4cnwvfSjeIKfvZSzk.2 2024-09-12T01:02:37.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.815211126582939902', time=2024-09-12T02:53:37.151711+0000, chain.objs.size()=4 2024-09-12T01:02:37.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.527__multipart_mymultipart.2~tcHNRzz8f4vuU_Zaz0Sp3-Ie_U8cQ5a.1 2024-09-12T01:02:37.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.527__multipart_mymultipart.2~tcHNRzz8f4vuU_Zaz0Sp3-Ie_U8cQ5a.2 2024-09-12T01:02:37.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.527__multipart_mymultipart.2~tcHNRzz8f4vuU_Zaz0Sp3-Ie_U8cQ5a.3 2024-09-12T01:02:37.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.527__multipart_mymultipart.2~tcHNRzz8f4vuU_Zaz0Sp3-Ie_U8cQ5a.4 2024-09-12T01:02:37.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3639603602281515498', time=2024-09-12T02:54:22.704850+0000, chain.objs.size()=1 2024-09-12T01:02:37.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.550__shadow_.W8wq9p5lgK1-TiZZumtsmHyX3dcJhoF_0 2024-09-12T01:02:37.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12070701932680866955', time=2024-09-12T02:54:29.261144+0000, chain.objs.size()=1 2024-09-12T01:02:37.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.556__shadow_.4fVmfGjGNBFtcnFqtghC6cxh_ytI4QU_0 2024-09-12T01:02:37.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.574+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49581 2024-09-12T01:02:37.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T01:02:37.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11915133639017809008', time=2024-09-12T02:54:45.798732+0000, chain.objs.size()=1 2024-09-12T01:02:37.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:BE3luS7EQVtfReP4yQicmjICGEWvGuK_.MRi1IVJ1tK63flwOtg5-N-4agkpD92__0 2024-09-12T01:02:37.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8825419251875205281', time=2024-09-12T02:55:00.395768+0000, chain.objs.size()=1 2024-09-12T01:02:37.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.574__shadow:PmhABCIcjFDBgSD9OSmlGSQRibricrQ_.70-AOnRpvDsC0uiX7qlq6SPdC9ybljX_0 2024-09-12T01:02:37.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14425754713986822244', time=2024-09-12T02:55:28.526064+0000, chain.objs.size()=1 2024-09-12T01:02:37.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.579__shadow:NQ-BYa2-M3hIHZ01pMUWCvnXdnF48CN_.cKTl-1InItx3kW9cnaKiVUcXdimSGUW_0 2024-09-12T01:02:37.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12427687257393755646', time=2024-09-12T02:55:57.372580+0000, chain.objs.size()=6 2024-09-12T01:02:37.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.613__multipart_multipart_enc.2~eCrj9yXE4BeNTgzB24yg4iRVUypH7CW.1 2024-09-12T01:02:37.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.613__multipart_multipart_enc.2~eCrj9yXE4BeNTgzB24yg4iRVUypH7CW.2 2024-09-12T01:02:37.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.613__multipart_multipart_enc.2~eCrj9yXE4BeNTgzB24yg4iRVUypH7CW.3 2024-09-12T01:02:37.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.613__multipart_multipart_enc.2~eCrj9yXE4BeNTgzB24yg4iRVUypH7CW.4 2024-09-12T01:02:37.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.613__multipart_multipart_enc.2~eCrj9yXE4BeNTgzB24yg4iRVUypH7CW.5 2024-09-12T01:02:37.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.613__multipart_multipart_enc.2~eCrj9yXE4BeNTgzB24yg4iRVUypH7CW.6 2024-09-12T01:02:37.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1953510301141311079', time=2024-09-12T02:58:35.017740+0000, chain.objs.size()=2 2024-09-12T01:02:37.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.648__shadow_.DtMkCZKXrsKTCLuwd5aACMhRVKOmPzf_0 2024-09-12T01:02:37.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.648__shadow_.DtMkCZKXrsKTCLuwd5aACMhRVKOmPzf_1 2024-09-12T01:02:37.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17247260199598722877', time=2024-09-12T02:58:51.340285+0000, chain.objs.size()=1 2024-09-12T01:02:37.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.666__shadow_.P_64aH_DL2SfDUzR_GVMSo4qGaBCP8-_0 2024-09-12T01:02:37.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.582+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8120975537234655479', time=2024-09-12T02:59:16.271103+0000, chain.objs.size()=1 2024-09-12T01:02:37.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.582+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.705__shadow:FTiIHuxuJEchak1qVLrFiIcagcELa3U_.VAGShTwHg28nEWj_KrCwWcuWsKG1odE_0 2024-09-12T01:02:37.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.582+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7515194264112281791', time=2024-09-12T02:59:22.332057+0000, chain.objs.size()=1 2024-09-12T01:02:37.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.582+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.714__shadow:dJJzLOyzpQ9g-gzMxZy1EF1.4Zro5lr_.JjC6PYx9_r1AWHUQ4mic00x0xsQrxTL_0 2024-09-12T01:02:37.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.582+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4078707138839183952', time=2024-09-12T03:00:04.531414+0000, chain.objs.size()=3 2024-09-12T01:02:37.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.582+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.743__multipart_mymultipart3.2~KNTlzIXjV-3JyWbjaUf5XF26xzPUuk7.1 2024-09-12T01:02:37.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.586+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.743__multipart_mymultipart3.2~KNTlzIXjV-3JyWbjaUf5XF26xzPUuk7.2 2024-09-12T01:02:37.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.586+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.743__multipart_mymultipart3.2~KNTlzIXjV-3JyWbjaUf5XF26xzPUuk7.3 2024-09-12T01:02:37.584 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:37.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:02:37.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/41847' 2024-09-12T01:02:37.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='_NoRc2p7bqu2V3fuGCX0xJgIqv9mpBy_', time=2024-09-12T02:46:05.331353+0000, chain.objs.size()=2 2024-09-12T01:02:37.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.160__shadow_.F85gqVaDzBfoAMoxqjNEIt8ypa7CbdR_0 2024-09-12T01:02:37.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.160__shadow_.F85gqVaDzBfoAMoxqjNEIt8ypa7CbdR_1 2024-09-12T01:02:37.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14633604825311569021', time=2024-09-12T02:48:25.956687+0000, chain.objs.size()=1 2024-09-12T01:02:37.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.238__shadow_.atW6zDrmQMuq_f2strp6kKGSp33YYzv_0 2024-09-12T01:02:37.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1921282106853518806', time=2024-09-12T02:48:28.876927+0000, chain.objs.size()=1 2024-09-12T01:02:37.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.242__shadow_.U7heRYIiUJKxswtshxW23gTtHDV4vyj_0 2024-09-12T01:02:37.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10989134450128139764', time=2024-09-12T02:48:38.728377+0000, chain.objs.size()=1 2024-09-12T01:02:37.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.254__shadow_.9GyyfZX2ZimN3UhVT3-b6vMbsA6poPG_0 2024-09-12T01:02:37.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12680574617224046974', time=2024-09-12T02:48:39.455509+0000, chain.objs.size()=1 2024-09-12T01:02:37.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.255__shadow_.tph3QBIfrZInW_v4EQUgvuf_RHSAjUc_0 2024-09-12T01:02:37.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1847688299272422691', time=2024-09-12T02:48:39.457746+0000, chain.objs.size()=1 2024-09-12T01:02:37.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.255__shadow_.j4gPwywwBW7o1u5waRvXjlMkmas3sVU_0 2024-09-12T01:02:37.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16237975464862949006', time=2024-09-12T02:49:05.578218+0000, chain.objs.size()=1 2024-09-12T01:02:37.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7eyoQW3mH2jdJGGqw5IH-ATlzXuIkrI_0 2024-09-12T01:02:37.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9967415904666268570', time=2024-09-12T02:49:05.797195+0000, chain.objs.size()=1 2024-09-12T01:02:37.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Zrj24gAfGcswJ4j0ANp-xMqJX0LaJWv_0 2024-09-12T01:02:37.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14624812685723891698', time=2024-09-12T02:49:05.816243+0000, chain.objs.size()=1 2024-09-12T01:02:37.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.K7OTQWERVFI_F51vZLnqKugLrgT0nYf_0 2024-09-12T01:02:37.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13724228681509404874', time=2024-09-12T02:49:05.822429+0000, chain.objs.size()=1 2024-09-12T01:02:37.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0tFIIfyfUeo3vy5T3QCQi98LfsMxHXw_0 2024-09-12T01:02:37.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9581658686712388293', time=2024-09-12T02:49:05.865928+0000, chain.objs.size()=1 2024-09-12T01:02:37.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.UvVBS0q4Cf_ShDh24Fj9FhHbfmbRVWa_0 2024-09-12T01:02:37.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3480854969969885982', time=2024-09-12T02:49:05.961576+0000, chain.objs.size()=1 2024-09-12T01:02:37.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.BrKA4OtKmIGQCOqae1U025RcTNQ2jQ9_0 2024-09-12T01:02:37.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5658236693601517431', time=2024-09-12T02:49:06.031188+0000, chain.objs.size()=1 2024-09-12T01:02:37.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.o8fN8dRuKRK-nNthccUstbMolqelmQm_0 2024-09-12T01:02:37.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1794409815912943878', time=2024-09-12T02:49:06.054230+0000, chain.objs.size()=1 2024-09-12T01:02:37.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.AmmCNsgAv3inLg6ZzcdYyWJzVo3K9EP_0 2024-09-12T01:02:37.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5641098214045217861', time=2024-09-12T02:49:06.085258+0000, chain.objs.size()=1 2024-09-12T01:02:37.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.4kgLVSpwxPOxM5KrxwmK4eYN8lyS4wa_0 2024-09-12T01:02:37.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13489142687380277862', time=2024-09-12T02:49:06.095401+0000, chain.objs.size()=1 2024-09-12T01:02:37.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.NMOcOSfl8kre5ruDtsBRJ2ydBZE-UHx_0 2024-09-12T01:02:37.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17459486717129410421', time=2024-09-12T02:49:06.256359+0000, chain.objs.size()=1 2024-09-12T01:02:37.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Vr27_0lnk7bLXWphaso2EIQbn9ZvMuM_0 2024-09-12T01:02:37.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7608411258666460149', time=2024-09-12T02:49:06.265418+0000, chain.objs.size()=1 2024-09-12T01:02:37.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.HynPYdjRFfOS8m3qzyNcZYdQGYRaFQI_0 2024-09-12T01:02:37.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2390371398398318408', time=2024-09-12T02:49:06.553467+0000, chain.objs.size()=1 2024-09-12T01:02:37.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.YugMbH5kackM2Kgxj-nhgxiDFnkdfGs_0 2024-09-12T01:02:37.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13800354074294672199', time=2024-09-12T02:49:06.594493+0000, chain.objs.size()=1 2024-09-12T01:02:37.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.aq8b0lGh8T52RwHdJD3iRWQw_VFaLLz_0 2024-09-12T01:02:37.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1405360022346816440', time=2024-09-12T02:49:06.613257+0000, chain.objs.size()=1 2024-09-12T01:02:37.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.C45OWWVscwAY2Ev4kjtvoWtym48wuQa_0 2024-09-12T01:02:37.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3382687263163587455', time=2024-09-12T02:49:06.848021+0000, chain.objs.size()=1 2024-09-12T01:02:37.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.iJzlpKlXCERWofu7bWHP_L6RdRq0st2_0 2024-09-12T01:02:37.599 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.602+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15308953656200477872', time=2024-09-12T02:49:06.864860+0000, chain.objs.size()=1 2024-09-12T01:02:37.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.602+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.DWrXBtOgrDsUoHvluRcNK7Qq5tpc9Se_0 2024-09-12T01:02:37.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.602+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8654673384942121495', time=2024-09-12T02:49:06.893168+0000, chain.objs.size()=1 2024-09-12T01:02:37.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.602+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.bcdbYSPlGL5s2GRdzJ88fpYcvAs3PGb_0 2024-09-12T01:02:37.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.602+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15634574318032797344', time=2024-09-12T02:49:07.063988+0000, chain.objs.size()=1 2024-09-12T01:02:37.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.602+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.30V7pUncvhSyLvC5csKLL_7EtB60LUp_0 2024-09-12T01:02:37.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.602+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.987185610737775813', time=2024-09-12T02:49:07.072804+0000, chain.objs.size()=1 2024-09-12T01:02:37.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.602+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.xzXpx8Jm5kOeX-3Iqvp6a_YAoXOdwra_0 2024-09-12T01:02:37.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.602+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8315052310803157170', time=2024-09-12T02:49:07.208248+0000, chain.objs.size()=1 2024-09-12T01:02:37.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.602+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ELXVpAca5xwZ69WMkCpUBSM16RQAv8S_0 2024-09-12T01:02:37.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17215344533199389759', time=2024-09-12T02:49:07.361614+0000, chain.objs.size()=1 2024-09-12T01:02:37.601 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ui2jnpg20Avk10nKKoCMOE50tvGJ_q8_0 2024-09-12T01:02:37.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14209384471924310095', time=2024-09-12T02:49:07.389894+0000, chain.objs.size()=1 2024-09-12T01:02:37.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.V8wcZ96oPp1L6uG66PLw_PcfQg2-rmR_0 2024-09-12T01:02:37.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4206289071304503148', time=2024-09-12T02:49:07.397832+0000, chain.objs.size()=1 2024-09-12T01:02:37.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.E9M76gz2zH6Vhl_QUJPIi1QUHfr2h5F_0 2024-09-12T01:02:37.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13735855218897646384', time=2024-09-12T02:49:07.412506+0000, chain.objs.size()=1 2024-09-12T01:02:37.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.vgrDoniFx_j6IjO5i9lrSSuuqBUUY4X_0 2024-09-12T01:02:37.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2364413407213567577', time=2024-09-12T02:49:17.867153+0000, chain.objs.size()=1 2024-09-12T01:02:37.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.276__shadow_.i35JyK62iMbCXFWdM-gy6sefAkvU4hM_0 2024-09-12T01:02:37.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15927752254577053943', time=2024-09-12T02:49:24.659043+0000, chain.objs.size()=1 2024-09-12T01:02:37.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.285__shadow_.Bu5Ui6247iQVT0creEOnvpgZNmsi8Ew_0 2024-09-12T01:02:37.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.956852121739792640', time=2024-09-12T02:49:27.700814+0000, chain.objs.size()=1 2024-09-12T01:02:37.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.289__shadow_.o3z_AVrTVfTbuT7j6xXl63hkz_eIsAF_0 2024-09-12T01:02:37.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.488220110351486658', time=2024-09-12T02:49:28.409772+0000, chain.objs.size()=1 2024-09-12T01:02:37.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.290__shadow_.ULGqjFbwZfEjJ62kz610N06qN1qrRqE_0 2024-09-12T01:02:37.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2782686270980892795', time=2024-09-12T02:49:30.927231+0000, chain.objs.size()=1 2024-09-12T01:02:37.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.q_ZcnSjS8WO-n13LLTD735M-YJAPZRZ_0 2024-09-12T01:02:37.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5508117091775641723', time=2024-09-12T02:49:32.430599+0000, chain.objs.size()=1 2024-09-12T01:02:37.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.oIOzqeilSXUbSuGHXLSKxk58FrgU93Y_0 2024-09-12T01:02:37.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15898513728815112728', time=2024-09-12T02:49:39.969307+0000, chain.objs.size()=1 2024-09-12T01:02:37.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.303__shadow_.Aj-O80jAuPZe5Z8FE0Vp41PgIfYpnph_0 2024-09-12T01:02:37.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15429209738765007192', time=2024-09-12T02:49:54.047425+0000, chain.objs.size()=1 2024-09-12T01:02:37.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.322__shadow_.hfWi6e3SWJiN3wWTv5fLGdUZDKaRWae_0 2024-09-12T01:02:37.606 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12729585246230500070', time=2024-09-12T02:50:15.791003+0000, chain.objs.size()=1 2024-09-12T01:02:37.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.lUM-iiGZZ20grr4TgDbJMdlLSDDU12c_0 2024-09-12T01:02:37.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2718280939228595130', time=2024-09-12T02:50:15.816390+0000, chain.objs.size()=1 2024-09-12T01:02:37.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Gy77X2DWOg7ufGPrkULSLM6A8VjwXLB_0 2024-09-12T01:02:37.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7895262472043252799', time=2024-09-12T02:50:15.883702+0000, chain.objs.size()=1 2024-09-12T01:02:37.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.2bsSG1m688hFn4QDbZIdOcI-Kp7AaNN_0 2024-09-12T01:02:37.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14756312502983396207', time=2024-09-12T02:50:15.898817+0000, chain.objs.size()=1 2024-09-12T01:02:37.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.S8QG3fLDujWg_5ys2GUoSiaTag5Pw8y_0 2024-09-12T01:02:37.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4583561012452953437', time=2024-09-12T02:50:15.926354+0000, chain.objs.size()=1 2024-09-12T01:02:37.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.eS4OiIzSGkovEi2WyoCA45Wy6WZIqq2_0 2024-09-12T01:02:37.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12040004966346194008', time=2024-09-12T02:50:15.928293+0000, chain.objs.size()=1 2024-09-12T01:02:37.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.D1gRf9-25q0h0glJIYvEBc2s2woB_QZ_0 2024-09-12T01:02:37.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5127380506541147648', time=2024-09-12T02:50:15.963215+0000, chain.objs.size()=1 2024-09-12T01:02:37.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.CaaNs-lyckR6bby6m5IQPd8mpKiIdxd_0 2024-09-12T01:02:37.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5632820972051188148', time=2024-09-12T02:50:15.969417+0000, chain.objs.size()=1 2024-09-12T01:02:37.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6G0r-fxlTU8nSCXxuR3TshWbjzkWS0-_0 2024-09-12T01:02:37.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8314370717781846341', time=2024-09-12T02:50:15.970119+0000, chain.objs.size()=1 2024-09-12T01:02:37.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.07Spu0Wq5l8Kp2Rl_KIVOMpUgnxOYH2_0 2024-09-12T01:02:37.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1335029605846811216', time=2024-09-12T02:50:16.157989+0000, chain.objs.size()=1 2024-09-12T01:02:37.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.32lo4SEV-S6Eg2TbVgzt9zCD3eLMQIH_0 2024-09-12T01:02:37.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11867599807417976694', time=2024-09-12T02:50:16.163105+0000, chain.objs.size()=1 2024-09-12T01:02:37.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.nbZMJE4PmIa6CSDXBkvsuyc5_rTUTSl_0 2024-09-12T01:02:37.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12680813807972019373', time=2024-09-12T02:50:16.210468+0000, chain.objs.size()=1 2024-09-12T01:02:37.613 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.MEU82AFZae6I0WHQGImzJ3f5coMOcq9_0 2024-09-12T01:02:37.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1571206130771045194', time=2024-09-12T02:50:16.215851+0000, chain.objs.size()=1 2024-09-12T01:02:37.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xPozHzq2JxMU7duI7gwq8gGwb3AarX9_0 2024-09-12T01:02:37.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2757117069720688055', time=2024-09-12T02:50:16.422638+0000, chain.objs.size()=1 2024-09-12T01:02:37.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.sIbXXPHg97Y4QR-nykqG9BT4ML_IoJL_0 2024-09-12T01:02:37.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12408414939782220420', time=2024-09-12T02:50:16.428292+0000, chain.objs.size()=1 2024-09-12T01:02:37.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.CaRx62krIFziB71V8MKuaa_vvrUIhST_0 2024-09-12T01:02:37.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7385782626900898511', time=2024-09-12T02:50:16.473962+0000, chain.objs.size()=1 2024-09-12T01:02:37.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.iaavzFRueAPq9ZKkMfsHssz8V7enyYy_0 2024-09-12T01:02:37.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4929998190752663582', time=2024-09-12T02:50:16.481240+0000, chain.objs.size()=1 2024-09-12T01:02:37.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.cTL-4SsIcmS8wLyOl4-wyXmvHntOPKa_0 2024-09-12T01:02:37.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4788487782950874127', time=2024-09-12T02:50:16.482014+0000, chain.objs.size()=1 2024-09-12T01:02:37.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.FJz2DR79u8laQM3uu3ZVe_d3hUG0MyO_0 2024-09-12T01:02:37.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.851200354379330821', time=2024-09-12T02:50:16.514671+0000, chain.objs.size()=1 2024-09-12T01:02:37.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.FTb_F2kQJznBNVgfRLF_evMce2QBg4I_0 2024-09-12T01:02:37.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4106473372650471585', time=2024-09-12T02:50:16.699256+0000, chain.objs.size()=1 2024-09-12T01:02:37.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.datVoxfIQ5QvyWtTWwB03OUjmKbC1jF_0 2024-09-12T01:02:37.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4819160985045550982', time=2024-09-12T02:50:16.705386+0000, chain.objs.size()=1 2024-09-12T01:02:37.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.uRf7EERNat00e3Vfhb77fEemgznpZsS_0 2024-09-12T01:02:37.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6391006534076493732', time=2024-09-12T02:50:16.770658+0000, chain.objs.size()=1 2024-09-12T01:02:37.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.CEYptZlPVhXHv2Vc5Q7yDXdZdjLgItA_0 2024-09-12T01:02:37.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4155153898624774980', time=2024-09-12T02:50:16.920880+0000, chain.objs.size()=1 2024-09-12T01:02:37.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.v3mIMfIKaMUeilKgoQGAxn2LtEgb290_0 2024-09-12T01:02:37.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3758437960088558027', time=2024-09-12T02:50:16.983640+0000, chain.objs.size()=1 2024-09-12T01:02:37.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.wjy9n-raqyL-l_8j3NQ5VElN-FsvUKe_0 2024-09-12T01:02:37.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14974923088386144159', time=2024-09-12T02:50:17.143024+0000, chain.objs.size()=1 2024-09-12T01:02:37.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.d3MtK09m5cVmPxOcyymlAN82RvSAp8m_0 2024-09-12T01:02:37.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16016697651684900199', time=2024-09-12T02:50:17.184736+0000, chain.objs.size()=1 2024-09-12T01:02:37.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.w6zVrglDivAdW2coAL1_e992YCpLhoN_0 2024-09-12T01:02:37.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15948485473796856845', time=2024-09-12T02:50:17.239711+0000, chain.objs.size()=1 2024-09-12T01:02:37.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.s61QkBhucskpWGZid8DnGlbShcpCrPJ_0 2024-09-12T01:02:37.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2942386475775800200', time=2024-09-12T02:50:17.241236+0000, chain.objs.size()=1 2024-09-12T01:02:37.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Q31AbQ-ehF1bjyzwOVp-RkZkQQ-GYe2_0 2024-09-12T01:02:37.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5877280809953232470', time=2024-09-12T02:50:17.249811+0000, chain.objs.size()=1 2024-09-12T01:02:37.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.0UY59ZJC6STm5lRvIdxvSoO98-7GKcN_0 2024-09-12T01:02:37.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8549788964591076507', time=2024-09-12T02:50:17.285787+0000, chain.objs.size()=1 2024-09-12T01:02:37.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.eM-JTB7NpgaFPLgGedKxFjsW-S7LoSv_0 2024-09-12T01:02:37.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13160338942393824693', time=2024-09-12T02:50:17.395241+0000, chain.objs.size()=1 2024-09-12T01:02:37.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.uIBZHupR9hfOOf-XNU-R17C70BQDD6C_0 2024-09-12T01:02:37.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4678597262016008388', time=2024-09-12T02:50:17.396761+0000, chain.objs.size()=1 2024-09-12T01:02:37.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.qNvYbfzALg15ubPzYLjb_udPD574-wo_0 2024-09-12T01:02:37.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11331644958209277760', time=2024-09-12T02:50:17.464408+0000, chain.objs.size()=1 2024-09-12T01:02:37.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.v5VkOStOvYAYB514eZW6eckq1Rgfd-E_0 2024-09-12T01:02:37.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12672231741173672222', time=2024-09-12T02:50:17.500600+0000, chain.objs.size()=1 2024-09-12T01:02:37.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.bJk8nAo-uTBxJ7mqZMNeXgyS7sG6YED_0 2024-09-12T01:02:37.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11329520161130932428', time=2024-09-12T02:50:17.521541+0000, chain.objs.size()=1 2024-09-12T01:02:37.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.9Q8gjJqV2R_hPCOQNFWQvp31mNepANA_0 2024-09-12T01:02:37.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7193955630642089040', time=2024-09-12T02:50:17.704568+0000, chain.objs.size()=1 2024-09-12T01:02:37.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.AyIQJsN_RL02rBEakcQoXIGS4GVnhyU_0 2024-09-12T01:02:37.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9207601491464750732', time=2024-09-12T02:50:17.708632+0000, chain.objs.size()=1 2024-09-12T01:02:37.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Jbj5UCHeFw4ugj5aSB3d11tWjbd7Z9b_0 2024-09-12T01:02:37.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10836864167400975521', time=2024-09-12T02:50:39.460653+0000, chain.objs.size()=1 2024-09-12T01:02:37.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.NPlhV3urx996rbEuQ5nYI4-Xv1G5-aa_0 2024-09-12T01:02:37.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11744296043750375780', time=2024-09-12T02:50:39.503846+0000, chain.objs.size()=1 2024-09-12T01:02:37.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.xkA_YvCYfdsRgU1tvpCj0OlOj-MbbnR_0 2024-09-12T01:02:37.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7303192628534065113', time=2024-09-12T02:50:39.537618+0000, chain.objs.size()=1 2024-09-12T01:02:37.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.bXYfieqJl4ZRW7flTQf7xcwHPDrX6lh_0 2024-09-12T01:02:37.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16933870519222198525', time=2024-09-12T02:50:39.592036+0000, chain.objs.size()=1 2024-09-12T01:02:37.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.IwR1Bq-xF3FZmajOvY38VTBIllkIr5__0 2024-09-12T01:02:37.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5116979925621580190', time=2024-09-12T02:50:39.598618+0000, chain.objs.size()=1 2024-09-12T01:02:37.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.91gPYoWwanw1BSEvJ7PnLhA-7RtjQx5_0 2024-09-12T01:02:37.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3371548693713312935', time=2024-09-12T02:50:39.610899+0000, chain.objs.size()=1 2024-09-12T01:02:37.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.jRGgTK_RQ31AQcc9G3mczcuu-D7bE-V_0 2024-09-12T01:02:37.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4733101682516673982', time=2024-09-12T02:50:39.708534+0000, chain.objs.size()=1 2024-09-12T01:02:37.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.UNPZg8WmCY4lipYiwSLqRvZ88hkKBHd_0 2024-09-12T01:02:37.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12958288439512817138', time=2024-09-12T02:50:39.789892+0000, chain.objs.size()=1 2024-09-12T01:02:37.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.PtgJLuVC7c21-b_VwQb7brlbUqasteH_0 2024-09-12T01:02:37.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17125499580364221374', time=2024-09-12T02:50:39.807045+0000, chain.objs.size()=1 2024-09-12T01:02:37.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.q7oYjOB6voeHqSDoDwSqCmAEsYxvdH9_0 2024-09-12T01:02:37.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.147154764847779495', time=2024-09-12T02:50:40.063193+0000, chain.objs.size()=1 2024-09-12T01:02:37.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.XqZvhB68S0i75ZqUG5rV5ZxypwaQ7Z9_0 2024-09-12T01:02:37.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1941311441997291933', time=2024-09-12T02:50:40.069589+0000, chain.objs.size()=1 2024-09-12T01:02:37.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.L2HnbLmcJW3pXLsmgJ1GgxGGO4DNmTk_0 2024-09-12T01:02:37.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16963910928095841717', time=2024-09-12T02:50:40.070725+0000, chain.objs.size()=1 2024-09-12T01:02:37.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.x9ufCb-qF4RKg_aWH9Z6PCymVESVT-X_0 2024-09-12T01:02:37.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3535472282421865333', time=2024-09-12T02:50:40.122561+0000, chain.objs.size()=1 2024-09-12T01:02:37.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.oT8xyk9XD9HWrJJg6F_wy8KteBqp5pF_0 2024-09-12T01:02:37.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5145803807701038453', time=2024-09-12T02:50:40.137329+0000, chain.objs.size()=1 2024-09-12T01:02:37.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.QJp0m9PcMu_OdwhF3n0rk_WqaILRwIK_0 2024-09-12T01:02:37.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3873378631136519647', time=2024-09-12T02:50:40.138232+0000, chain.objs.size()=1 2024-09-12T01:02:37.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.KSNBGx8KubWKPILYRz9kcB1qdfKxmrp_0 2024-09-12T01:02:37.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15661843152084128411', time=2024-09-12T02:50:40.262993+0000, chain.objs.size()=1 2024-09-12T01:02:37.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.GBeQitpoQJ6n2D8yCRrf6CxqkqeUGPw_0 2024-09-12T01:02:37.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12614468001252774625', time=2024-09-12T02:50:40.289361+0000, chain.objs.size()=1 2024-09-12T01:02:37.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.7CcADl1c8dHnIgKSeD-5ByCt42GFGtX_0 2024-09-12T01:02:37.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.69318514286501206', time=2024-09-12T02:50:40.593843+0000, chain.objs.size()=1 2024-09-12T01:02:37.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.9nrQyQITmPG4Ap5xoE5ij0lk4-5ZvRM_0 2024-09-12T01:02:37.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15637435016271409422', time=2024-09-12T02:50:40.778431+0000, chain.objs.size()=1 2024-09-12T01:02:37.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.yYWPLmVRRI_xlBykHL4nTRPmVhILzdY_0 2024-09-12T01:02:37.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1953237723203795889', time=2024-09-12T02:50:41.092643+0000, chain.objs.size()=1 2024-09-12T01:02:37.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.l_znL01UzMaF6j7sM0gPaG8bIMLjOXs_0 2024-09-12T01:02:37.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13197414171906850395', time=2024-09-12T02:50:41.096683+0000, chain.objs.size()=1 2024-09-12T01:02:37.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.sTXDqDhRHFwcPzwQE9xqtgndrPjdHvb_0 2024-09-12T01:02:37.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.642+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10436530274721358306', time=2024-09-12T02:50:41.154032+0000, chain.objs.size()=1 2024-09-12T01:02:37.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.642+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.55lxc_hHTuo3IlWDPLhZd4qvy61_6IG_0 2024-09-12T01:02:37.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.642+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6285747048476314582', time=2024-09-12T02:50:41.176687+0000, chain.objs.size()=1 2024-09-12T01:02:37.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.642+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.4QFpwhRiAlk2dRj2MxYTopwFkABAIKO_0 2024-09-12T01:02:37.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.642+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5944940755952252809', time=2024-09-12T02:50:41.341630+0000, chain.objs.size()=1 2024-09-12T01:02:37.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.642+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.6i9TgVeS359ZZAQjZzkdE9BRN6zyfKA_0 2024-09-12T01:02:37.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/41847 2024-09-12T01:02:37.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T01:02:37.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16160979041598876751', time=2024-09-12T02:50:41.430059+0000, chain.objs.size()=1 2024-09-12T01:02:37.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.QBlSFxARBitZeddpj1j657cH2Tes7z2_0 2024-09-12T01:02:37.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3225759597418712378', time=2024-09-12T02:50:41.538651+0000, chain.objs.size()=1 2024-09-12T01:02:37.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.0mxCg_jmv_kwL3DPpi9KNrDcoKxVWWf_0 2024-09-12T01:02:37.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.394582149873491716', time=2024-09-12T02:51:14.410119+0000, chain.objs.size()=1 2024-09-12T01:02:37.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.374__shadow_.buc3jBfypxztmEaNKY2yjkhhQXXo_It_0 2024-09-12T01:02:37.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14811613534482134857', time=2024-09-12T02:51:39.711649+0000, chain.objs.size()=1 2024-09-12T01:02:37.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.407__shadow_.iXti6Tr-mx8gHiliKXAKZ2PITtNH19__0 2024-09-12T01:02:37.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13568981226561542386', time=2024-09-12T02:51:56.828077+0000, chain.objs.size()=1 2024-09-12T01:02:37.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.430__shadow_.ZW9-kKtX1mn3lTHZS1oFV1v9HAVH6kk_0 2024-09-12T01:02:37.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14342104069441185828', time=2024-09-12T02:52:25.685994+0000, chain.objs.size()=1 2024-09-12T01:02:37.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.464__shadow_.62qvmVVZwsKAUkxn0X4xHF2YEmNFX7g_0 2024-09-12T01:02:37.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17766976810031088877', time=2024-09-12T02:52:43.471478+0000, chain.objs.size()=1 2024-09-12T01:02:37.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.493__shadow_.LoNPioY0CCloVl3VoxK-xzc2rukDCrp_0 2024-09-12T01:02:37.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15509987553841972533', time=2024-09-12T02:53:10.402112+0000, chain.objs.size()=3 2024-09-12T01:02:37.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.521__multipart_mymultipart.2~tsMQV_4-Dv4USnxuQ1Bl6fk_hQi9Vqq.1 2024-09-12T01:02:37.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.521__multipart_mymultipart.2~tsMQV_4-Dv4USnxuQ1Bl6fk_hQi9Vqq.2 2024-09-12T01:02:37.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.521__multipart_mymultipart.2~tsMQV_4-Dv4USnxuQ1Bl6fk_hQi9Vqq.3 2024-09-12T01:02:37.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1835125078021527135', time=2024-09-12T02:54:26.974406+0000, chain.objs.size()=1 2024-09-12T01:02:37.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.554__shadow_.QYcxG4EBzt-dsuuixyv_R9R_EjRd-a7_0 2024-09-12T01:02:37.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10875466407176197245', time=2024-09-12T02:54:28.643650+0000, chain.objs.size()=1 2024-09-12T01:02:37.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.555__shadow_.DQ5IimK28NKBPF4wSSiXonRhAnSwJl4_0 2024-09-12T01:02:37.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.654+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5780429261077152160', time=2024-09-12T02:54:29.547710+0000, chain.objs.size()=1 2024-09-12T01:02:37.652 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.556__shadow_.KzSOii5rGxBlp3Ax9kt93XYGOhoUOi0_0 2024-09-12T01:02:37.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4018350154681108609', time=2024-09-12T02:54:50.965472+0000, chain.objs.size()=1 2024-09-12T01:02:37.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:bOQ3Y6z..vzL1etd5rBR1Vf9cZkAWku_.XQCtDRmngz_236d9Y1n8hD2Z6TzHGEu_0 2024-09-12T01:02:37.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7087353388171080815', time=2024-09-12T02:55:05.388916+0000, chain.objs.size()=1 2024-09-12T01:02:37.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.576__shadow:LfySCI8vokR0qoa9wlXNk0odBFI5X.r_.izlJBK2rW1m_f4BlEk6O640tpSb8B9m_0 2024-09-12T01:02:37.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13756485877790798106', time=2024-09-12T02:55:11.978182+0000, chain.objs.size()=1 2024-09-12T01:02:37.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:XfkqK14tHN1RhVDb8-mr-h7KqaMD2Cd_.6oWHebi5jGPChE1RhdMYJ3cx5w8690w_0 2024-09-12T01:02:37.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10171544947465847031', time=2024-09-12T02:55:13.411428+0000, chain.objs.size()=1 2024-09-12T01:02:37.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:38.jW98zNtNoKz1CKN7382C8HiDDt9k_.7I7YooV7FT9gSJm8FBCn_T83PC8D_jD_0 2024-09-12T01:02:37.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2220541122578422496', time=2024-09-12T02:55:14.400809+0000, chain.objs.size()=1 2024-09-12T01:02:37.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:-bsrQKaFRoAfJkoX47W.ftdv9PRjp14_.7IQgJwjniDIT75MJ-VGnIBOCSymffWw_0 2024-09-12T01:02:37.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1079579373878248921', time=2024-09-12T02:55:22.330612+0000, chain.objs.size()=1 2024-09-12T01:02:37.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:B8QuG.OShFS52BFcky.blFg9FWs7ZVd_.kepWpvLSDxY0qXJjG1vcVS-RfS6RNV2_0 2024-09-12T01:02:37.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12470897281516259328', time=2024-09-12T02:55:35.302503+0000, chain.objs.size()=1 2024-09-12T01:02:37.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.586__shadow:GEfgduut.KIAE7lyY-bUOc1Gb8dlyRo_.AzLi0RRYdMghkNrvBRwl1kS_EKtKqW4_0 2024-09-12T01:02:37.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1605492878190692302', time=2024-09-12T02:58:23.601083+0000, chain.objs.size()=1 2024-09-12T01:02:37.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.633__shadow_.KkpPmQWc0PrtiG3nnkDKmPzSIH-AnW3_0 2024-09-12T01:02:37.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1812880806615394454', time=2024-09-12T02:58:27.385166+0000, chain.objs.size()=1 2024-09-12T01:02:37.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.638__shadow_.SZbL4l7UEM7eOMuDJaE2Nb8fztjpZFs_0 2024-09-12T01:02:37.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13218890703310983346', time=2024-09-12T02:58:48.173285+0000, chain.objs.size()=1 2024-09-12T01:02:37.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.663__shadow_.zCc_I3eHoTRb9AirPeXi9moJas4pyuh_0 2024-09-12T01:02:37.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.662+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8380476760370497739', time=2024-09-12T02:58:49.139991+0000, chain.objs.size()=1 2024-09-12T01:02:37.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.662+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.664__shadow_.LJjR0EQHGhyi7uUYvFgNMtkKmvUy6jv_0 2024-09-12T01:02:37.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.662+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10879292402573499141', time=2024-09-12T02:59:14.792710+0000, chain.objs.size()=1 2024-09-12T01:02:37.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.662+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.703__shadow:YHVLq7YFRNQNMS-Cfb4NA8GHgxtDqRs_.qrBMynIuLRXcUBGZSv0U3wPk24mbVze_0 2024-09-12T01:02:37.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.662+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7853472244222845920', time=2024-09-12T02:59:44.751632+0000, chain.objs.size()=1 2024-09-12T01:02:37.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.662+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.718__shadow_.L7nNMOUDkre8-o1ujq6uwVBzb008mGF_0 2024-09-12T01:02:37.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.666+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:37.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.670+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:02:37.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.670+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.670+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46977' 2024-09-12T01:02:37.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='_OrqX_XEpTtkX3vQtc5Y1XP6Fu9UhGmL', time=2024-09-12T02:46:08.269014+0000, chain.objs.size()=2 2024-09-12T01:02:37.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__shadow_.KXsKIlOcEtJ4O2vzzHYjRFyvctAgxSE_0 2024-09-12T01:02:37.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__shadow_.KXsKIlOcEtJ4O2vzzHYjRFyvctAgxSE_1 2024-09-12T01:02:37.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~cERaw4iZN3TnOb8yhEXBHsRP87v9aSw', time=2024-09-12T02:46:51.331800+0000, chain.objs.size()=1 2024-09-12T01:02:37.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.201__multipart_mymultipart.2~cERaw4iZN3TnOb8yhEXBHsRP87v9aSw.1 2024-09-12T01:02:37.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10366909147556006252', time=2024-09-12T02:48:24.701117+0000, chain.objs.size()=1 2024-09-12T01:02:37.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.237__shadow_.IvhgBxArKGLj-NkN0aSphU9JbLtRbdY_0 2024-09-12T01:02:37.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4383947484496176530', time=2024-09-12T02:48:34.997292+0000, chain.objs.size()=1 2024-09-12T01:02:37.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.249__shadow_.QiB9ZySFB3L_0AmkIX2r28ImKmAk1IO_0 2024-09-12T01:02:37.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1065475239447224621', time=2024-09-12T02:48:35.762571+0000, chain.objs.size()=1 2024-09-12T01:02:37.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.250__shadow_.KXqALXV_JkrawL2TEn6q85hGMhj6lhU_0 2024-09-12T01:02:37.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4027307752736205029', time=2024-09-12T02:48:38.018127+0000, chain.objs.size()=1 2024-09-12T01:02:37.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.253__shadow_.ylOZ2zOvvRKdUFaKuEIwwUu_lcbc71k_0 2024-09-12T01:02:37.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13076541784629765546', time=2024-09-12T02:48:42.382251+0000, chain.objs.size()=1 2024-09-12T01:02:37.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.259__shadow_.ES9Sd7jA4pUqeP_vNhylzL5oIpVaa2a_0 2024-09-12T01:02:37.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17832329917485863527', time=2024-09-12T02:49:05.479726+0000, chain.objs.size()=1 2024-09-12T01:02:37.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.GIGq1YBJvK4RniDnSAYziAa0B11BfMv_0 2024-09-12T01:02:37.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18243399409745734818', time=2024-09-12T02:49:05.482282+0000, chain.objs.size()=1 2024-09-12T01:02:37.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.V5lrISZBvauJ-btMQ8ndxIDRWf93Q1C_0 2024-09-12T01:02:37.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11338824481724184316', time=2024-09-12T02:49:05.484650+0000, chain.objs.size()=1 2024-09-12T01:02:37.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.n4GBSFHE1cmLSv-bsqhDw45CqT0F39w_0 2024-09-12T01:02:37.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12851427575709737770', time=2024-09-12T02:49:05.538770+0000, chain.objs.size()=1 2024-09-12T01:02:37.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.RDY08KGV0hoT5rKNPBUaJg13f2Z8PGt_0 2024-09-12T01:02:37.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14562285723225440356', time=2024-09-12T02:49:05.546068+0000, chain.objs.size()=1 2024-09-12T01:02:37.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.SIx39juZQf5eHE8nJZT3wd6j-9LT-cI_0 2024-09-12T01:02:37.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3318118478709310601', time=2024-09-12T02:49:05.583370+0000, chain.objs.size()=1 2024-09-12T01:02:37.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.2ukEiMorjog7S1gvbbTf-bgGgibr9mh_0 2024-09-12T01:02:37.672 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6269830185290290357', time=2024-09-12T02:49:05.709285+0000, chain.objs.size()=1 2024-09-12T01:02:37.673 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.EWK_IRtm73FMlIZNrb4FR14f6ZdNcSU_0 2024-09-12T01:02:37.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4861893632702305064', time=2024-09-12T02:49:05.826895+0000, chain.objs.size()=1 2024-09-12T01:02:37.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ekUHgBvP3VzTU-QICFR1vMWr2-Pap_p_0 2024-09-12T01:02:37.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17064748044537901347', time=2024-09-12T02:49:06.024677+0000, chain.objs.size()=1 2024-09-12T01:02:37.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ehSvs9kqekVInj4TCZDqr2kz6-O9ZGE_0 2024-09-12T01:02:37.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10175693832441277001', time=2024-09-12T02:49:06.035742+0000, chain.objs.size()=1 2024-09-12T01:02:37.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.kLKOcfLrrp41EadCAcCFeidGMGRN8o7_0 2024-09-12T01:02:37.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16568036970799801963', time=2024-09-12T02:49:06.043443+0000, chain.objs.size()=1 2024-09-12T01:02:37.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.k6ZW9kCQcb2gq48_y-OBQMIO-oqs15v_0 2024-09-12T01:02:37.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11484338569110756887', time=2024-09-12T02:49:06.065594+0000, chain.objs.size()=1 2024-09-12T01:02:37.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.AGNbrXiUDHmoDn9BFmOeB9T30YZMK5a_0 2024-09-12T01:02:37.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17082944649107455307', time=2024-09-12T02:49:06.097078+0000, chain.objs.size()=1 2024-09-12T01:02:37.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Lb9JlR_QGU0YPpmA9KI7ooDxp8lOM-h_0 2024-09-12T01:02:37.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9636090566795252000', time=2024-09-12T02:49:06.230916+0000, chain.objs.size()=1 2024-09-12T01:02:37.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.WuDATEuZYGLyyWL4ppcMLCg9T_kDBS6_0 2024-09-12T01:02:37.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8399541753993282633', time=2024-09-12T02:49:06.340327+0000, chain.objs.size()=1 2024-09-12T01:02:37.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.678+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.RSHCKcVd-Zk5RxpqJp8uuZpujvdqi6j_0 2024-09-12T01:02:37.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12611159847672241402', time=2024-09-12T02:49:06.541762+0000, chain.objs.size()=1 2024-09-12T01:02:37.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.q5y8_1TD7C2PWgQZJMDhZDVGx7BustX_0 2024-09-12T01:02:37.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14786852749030010120', time=2024-09-12T02:49:06.570993+0000, chain.objs.size()=1 2024-09-12T01:02:37.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.IWin4_ffOzOyue52o3y-YnvESC743hv_0 2024-09-12T01:02:37.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12356198275136791963', time=2024-09-12T02:49:06.597189+0000, chain.objs.size()=1 2024-09-12T01:02:37.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.sJjBu97__mh8WyCQIIoiOPCWKWrzWR5_0 2024-09-12T01:02:37.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6218469744108009783', time=2024-09-12T02:49:06.794104+0000, chain.objs.size()=1 2024-09-12T01:02:37.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.1Ldp5EXptsjF94vsZZ6A72NDYwySnj5_0 2024-09-12T01:02:37.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13652044250558190800', time=2024-09-12T02:49:06.847650+0000, chain.objs.size()=1 2024-09-12T01:02:37.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.bvhvRyXr3Y9_U__YCrft1POOSfRmxAG_0 2024-09-12T01:02:37.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14624144091522806072', time=2024-09-12T02:49:06.869444+0000, chain.objs.size()=1 2024-09-12T01:02:37.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9GpvS-8Os_H6Rmop1oHBwbkwai4dWDl_0 2024-09-12T01:02:37.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.523221109979333819', time=2024-09-12T02:49:06.893731+0000, chain.objs.size()=1 2024-09-12T01:02:37.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.n3Tu_ou99auuadI-y3mezcRSQ_MVx5P_0 2024-09-12T01:02:37.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14837699065718806164', time=2024-09-12T02:49:06.894880+0000, chain.objs.size()=1 2024-09-12T01:02:37.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.a57vwaGWynFy0F_Qw1PGe79oYsWXkOq_0 2024-09-12T01:02:37.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14562811038343785469', time=2024-09-12T02:49:07.196960+0000, chain.objs.size()=1 2024-09-12T01:02:37.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ti3dtw9FmCdGZPo3n9BswNyI0cKemz3_0 2024-09-12T01:02:37.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15593543835070186870', time=2024-09-12T02:49:07.201172+0000, chain.objs.size()=1 2024-09-12T01:02:37.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.QjUmgIsi0L2bR76k22BB4GQ0eRMGePU_0 2024-09-12T01:02:37.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4762947948759364162', time=2024-09-12T02:49:07.313421+0000, chain.objs.size()=1 2024-09-12T01:02:37.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.OZijcq8i-pqwqBnSdn8UFl7RoNZiNUO_0 2024-09-12T01:02:37.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7691176265435227135', time=2024-09-12T02:49:11.856871+0000, chain.objs.size()=1 2024-09-12T01:02:37.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.268__shadow_.qqfchy-3zXDDds5TMU7YDfxx3SGLae0_0 2024-09-12T01:02:37.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5219917312539294633', time=2024-09-12T02:49:16.837188+0000, chain.objs.size()=1 2024-09-12T01:02:37.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.275__shadow_.OPuwzNDsF2lX7CVA0etbquDGxqhCAgW_0 2024-09-12T01:02:37.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1139950881581887903', time=2024-09-12T02:49:32.417993+0000, chain.objs.size()=1 2024-09-12T01:02:37.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.2BugIa263TAmv3U5iaGztzBB7xe1tXt_0 2024-09-12T01:02:37.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9382883708290047885', time=2024-09-12T02:49:32.431470+0000, chain.objs.size()=1 2024-09-12T01:02:37.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.xucGzEg_8KyvhH2TpPTr5LqySUgfMDn_0 2024-09-12T01:02:37.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17544173711033707807', time=2024-09-12T02:49:32.466962+0000, chain.objs.size()=1 2024-09-12T01:02:37.684 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.KrObj9DOx2FImNTWltrswJmEGj3iOos_0 2024-09-12T01:02:37.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14568481268475216447', time=2024-09-12T02:49:52.289390+0000, chain.objs.size()=1 2024-09-12T01:02:37.685 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.319__shadow:hNq5RngGjWwOpbTWZqkuCcDKncbyrk5_.KweF7cxeCDVFJSBHErk0bOigUWO7SL3_0 2024-09-12T01:02:37.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11625082214023252727', time=2024-09-12T02:49:52.292346+0000, chain.objs.size()=1 2024-09-12T01:02:37.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.319__shadow:5KCIYHDyBwHiCDgJ-nnXc3r0IfeCrky_.29c4fTPleyBWPCJmSfv2_JjKEVGT81m_0 2024-09-12T01:02:37.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13637865314391370798', time=2024-09-12T02:49:53.187414+0000, chain.objs.size()=1 2024-09-12T01:02:37.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.321__shadow_.IJ0iym9BbM4NnGzaz8vQe4GPRX-bWTy_0 2024-09-12T01:02:37.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7502746599860778971', time=2024-09-12T02:50:15.855258+0000, chain.objs.size()=1 2024-09-12T01:02:37.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.XrfJw9DQkSL4k7ack5mN1sDJtPY13WN_0 2024-09-12T01:02:37.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3485860263093519599', time=2024-09-12T02:50:15.882730+0000, chain.objs.size()=1 2024-09-12T01:02:37.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.u7Y7ioayTs5cGysN6_QECeIuifzI1BG_0 2024-09-12T01:02:37.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2509468827158370696', time=2024-09-12T02:50:15.907276+0000, chain.objs.size()=1 2024-09-12T01:02:37.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.jGGZJ6cmCTSKLdo0dlYaUQlAnV-Gxcu_0 2024-09-12T01:02:37.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17014214936495208059', time=2024-09-12T02:50:15.909545+0000, chain.objs.size()=1 2024-09-12T01:02:37.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.cAE4ig05OJhA00UGMhDxWAf0SWJUBw__0 2024-09-12T01:02:37.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1971221317203399973', time=2024-09-12T02:50:15.942815+0000, chain.objs.size()=1 2024-09-12T01:02:37.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.wuU_HbBaoaQd-HrjwHbvlE-37HCckR2_0 2024-09-12T01:02:37.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11527930659333871511', time=2024-09-12T02:50:16.187261+0000, chain.objs.size()=1 2024-09-12T01:02:37.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xEeloRjIm3CsuPcrc6t7NS-BC5Sc3cC_0 2024-09-12T01:02:37.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13231441389601734741', time=2024-09-12T02:50:16.211651+0000, chain.objs.size()=1 2024-09-12T01:02:37.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.LSw7675iCZOY3PcaGWsWq-Aa8XNfkgi_0 2024-09-12T01:02:37.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4713010072007264308', time=2024-09-12T02:50:16.222871+0000, chain.objs.size()=1 2024-09-12T01:02:37.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.AR3-jUPo0YgIfx9_-yr0vTQ4iUqAP3y_0 2024-09-12T01:02:37.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5395150486896729818', time=2024-09-12T02:50:16.228415+0000, chain.objs.size()=1 2024-09-12T01:02:37.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ydAIAUyEIsfkgjxk-DUzPQdX-3W3ug9_0 2024-09-12T01:02:37.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17001523359142219887', time=2024-09-12T02:50:16.355037+0000, chain.objs.size()=1 2024-09-12T01:02:37.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.gaQlrU10-LE-wTBe_xd2avfMLEuB07d_0 2024-09-12T01:02:37.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14367281248788679518', time=2024-09-12T02:50:16.360748+0000, chain.objs.size()=1 2024-09-12T01:02:37.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ACvGE0mO6TB5XBsvcuKXJy89lqV7qTM_0 2024-09-12T01:02:37.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6195794664783484419', time=2024-09-12T02:50:16.422891+0000, chain.objs.size()=1 2024-09-12T01:02:37.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.FVJZgRKnQzbc2uIa7p-NZYkMIArxwvx_0 2024-09-12T01:02:37.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2829406464051543410', time=2024-09-12T02:50:16.484100+0000, chain.objs.size()=1 2024-09-12T01:02:37.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.apPwAufixCg1q8qiymDRmkEB6Rf5Lj9_0 2024-09-12T01:02:37.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10447309324678277931', time=2024-09-12T02:50:16.502243+0000, chain.objs.size()=1 2024-09-12T01:02:37.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.IkRqNOfThYAJtNTStkHcMNC-aTUzLNO_0 2024-09-12T01:02:37.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9941436238759445610', time=2024-09-12T02:50:16.691831+0000, chain.objs.size()=1 2024-09-12T01:02:37.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.U8JjzS27sFPCTvUW4o6YA0QJAmR2s0C_0 2024-09-12T01:02:37.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4807702644187789338', time=2024-09-12T02:50:16.712377+0000, chain.objs.size()=1 2024-09-12T01:02:37.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.DCF7L5_W_C7Z218hChYbh2rDX7dev2k_0 2024-09-12T01:02:37.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3300072355938999710', time=2024-09-12T02:50:16.734331+0000, chain.objs.size()=1 2024-09-12T01:02:37.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xrLUw-yItyRLHLI31jO5WbNvmOmZlgY_0 2024-09-12T01:02:37.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10620544258454063980', time=2024-09-12T02:50:16.739126+0000, chain.objs.size()=1 2024-09-12T01:02:37.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-vZZHlvAhJzI7-FbZA3rOMrzlLFPU7W_0 2024-09-12T01:02:37.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10366515573000467683', time=2024-09-12T02:50:16.915851+0000, chain.objs.size()=1 2024-09-12T01:02:37.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.yjUmgrrXH4vT10GRmWZpUGwxt_W3icB_0 2024-09-12T01:02:37.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13066595885391143578', time=2024-09-12T02:50:16.938245+0000, chain.objs.size()=1 2024-09-12T01:02:37.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.0po_LK7uIX_gNBgSeEjJGGHgClI5133_0 2024-09-12T01:02:37.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18427107761213969532', time=2024-09-12T02:50:16.975818+0000, chain.objs.size()=1 2024-09-12T01:02:37.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.HCzWSOJQr-YtTLpqcaQEtTdKHfEpcsN_0 2024-09-12T01:02:37.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17739517533492068511', time=2024-09-12T02:50:16.980402+0000, chain.objs.size()=1 2024-09-12T01:02:37.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.K-Ci6VGT5_IVOe7avaYBthI7qL_ZiRW_0 2024-09-12T01:02:37.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.702+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14702621130449287737', time=2024-09-12T02:50:17.015312+0000, chain.objs.size()=1 2024-09-12T01:02:37.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.702+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.__qD0E4ZuK-cXERIYkj93f1Fh3m6eYp_0 2024-09-12T01:02:37.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.702+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8197758185418616590', time=2024-09-12T02:50:17.127440+0000, chain.objs.size()=1 2024-09-12T01:02:37.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.702+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.uzbmMk658SHLXclkRrby8MeIG0A-NNY_0 2024-09-12T01:02:37.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.702+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2570547796673794151', time=2024-09-12T02:50:17.253816+0000, chain.objs.size()=1 2024-09-12T01:02:37.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.702+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Wz8CvYKYmsFuP6GOzwjR7NWJFbkqMpK_0 2024-09-12T01:02:37.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7258343327120666669', time=2024-09-12T02:50:17.415206+0000, chain.objs.size()=1 2024-09-12T01:02:37.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.RFynLNCoV1AtcrxU78DTyJ9uGspstwQ_0 2024-09-12T01:02:37.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18065739398813741210', time=2024-09-12T02:50:17.543965+0000, chain.objs.size()=1 2024-09-12T01:02:37.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.UGbPoVQe8hpZLxRfD-vTtqXSgA2vba-_0 2024-09-12T01:02:37.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3796378181309098017', time=2024-09-12T02:50:17.642630+0000, chain.objs.size()=1 2024-09-12T01:02:37.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ITpgj_ULdab5xeUFyAK8Z8n33nBiXa1_0 2024-09-12T01:02:37.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15178850835230743859', time=2024-09-12T02:50:17.710189+0000, chain.objs.size()=1 2024-09-12T01:02:37.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.bir2FNEtrQq6jt19PIhv1xcpYctFhXK_0 2024-09-12T01:02:37.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4296642827127016723', time=2024-09-12T02:50:17.726315+0000, chain.objs.size()=1 2024-09-12T01:02:37.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.CmbfUoUdlVyW8tZcuvs57aVUFOedfMq_0 2024-09-12T01:02:37.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4445130476786026046', time=2024-09-12T02:50:17.755565+0000, chain.objs.size()=1 2024-09-12T01:02:37.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.7JjfZmtwiRpNQwHeIXDkoreNetzWCWK_0 2024-09-12T01:02:37.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14389892107112174723', time=2024-09-12T02:50:17.767753+0000, chain.objs.size()=1 2024-09-12T01:02:37.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.g-mqJAO7agHnMU-d-aW3-kEgSd70WVl_0 2024-09-12T01:02:37.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11863178905002649767', time=2024-09-12T02:50:39.578313+0000, chain.objs.size()=1 2024-09-12T01:02:37.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.wHik5ZvyTXd50iIwoADYoe-Bs0ZiTX4_0 2024-09-12T01:02:37.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2618512103329465739', time=2024-09-12T02:50:39.586738+0000, chain.objs.size()=1 2024-09-12T01:02:37.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Uhk4Wbe-qyXDu1oljMyyTZ8nfYydW6Y_0 2024-09-12T01:02:37.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18088698762100767873', time=2024-09-12T02:50:39.723796+0000, chain.objs.size()=1 2024-09-12T01:02:37.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ElzXW24oj2AItNn1he6SKTFtHZm4wK__0 2024-09-12T01:02:37.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7040260762686834610', time=2024-09-12T02:50:39.738928+0000, chain.objs.size()=1 2024-09-12T01:02:37.705 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.HQM6ol1kMKw4fsQ3Gyl5pcxt-73FzxM_0 2024-09-12T01:02:37.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1662379821594068664', time=2024-09-12T02:50:39.804353+0000, chain.objs.size()=1 2024-09-12T01:02:37.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.kO_5deTIaUIa80H0qVZcnBPuLOWOY87_0 2024-09-12T01:02:37.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17970744351194394324', time=2024-09-12T02:50:39.807515+0000, chain.objs.size()=1 2024-09-12T01:02:37.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.D3i4XQf40BWX1hMruDydgpmQ6My__jZ_0 2024-09-12T01:02:37.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1606158981291235642', time=2024-09-12T02:50:40.045213+0000, chain.objs.size()=1 2024-09-12T01:02:37.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.UBySY2rNG3BJZ1HmdJBHErwQF5WDK9t_0 2024-09-12T01:02:37.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1795869710343482291', time=2024-09-12T02:50:40.047612+0000, chain.objs.size()=1 2024-09-12T01:02:37.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.zdwhEKDjlWSRU65dBQWI3pK4-b-ZVtj_0 2024-09-12T01:02:37.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11002853668725451991', time=2024-09-12T02:50:40.084361+0000, chain.objs.size()=1 2024-09-12T01:02:37.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.HnUaiu_RskLtT00p2fmXZQn_CEDHLyV_0 2024-09-12T01:02:37.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12829127527274322514', time=2024-09-12T02:50:40.086578+0000, chain.objs.size()=1 2024-09-12T01:02:37.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.VB6DIHFPuvpUGDj4sjyFTxO9n4LEY-p_0 2024-09-12T01:02:37.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4616559489383281793', time=2024-09-12T02:50:40.087394+0000, chain.objs.size()=1 2024-09-12T01:02:37.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.QGu1vrUoG2Kww-FsqTiO5MUJtbkL7mk_0 2024-09-12T01:02:37.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9307260804840793930', time=2024-09-12T02:50:40.109958+0000, chain.objs.size()=1 2024-09-12T01:02:37.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.710+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.m_lcWcJ_I9qdP8w4QeQh7-ff2qOdmak_0 2024-09-12T01:02:37.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2855646769940863333', time=2024-09-12T02:50:40.283175+0000, chain.objs.size()=1 2024-09-12T01:02:37.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.5LPA8TnuaDTDe20K1SZu7YZHWL5T2Yo_0 2024-09-12T01:02:37.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4445133223439122239', time=2024-09-12T02:50:40.303671+0000, chain.objs.size()=1 2024-09-12T01:02:37.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Kr1DyRllLygUjZPv6k2sVnl-kk2dIpf_0 2024-09-12T01:02:37.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11926084929248578304', time=2024-09-12T02:50:40.310959+0000, chain.objs.size()=1 2024-09-12T01:02:37.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.OB30NiOu66bXZTehd9rmBhjcz6qjXso_0 2024-09-12T01:02:37.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.390353339226185186', time=2024-09-12T02:50:40.322159+0000, chain.objs.size()=1 2024-09-12T01:02:37.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Z-oIOsOV2YG8mQoCpe3PcCeUlbB4iOC_0 2024-09-12T01:02:37.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4416518973911384477', time=2024-09-12T02:50:40.624790+0000, chain.objs.size()=1 2024-09-12T01:02:37.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.JGYsTwDpG8M7B1EMrD703Qex2cnEr4a_0 2024-09-12T01:02:37.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15599653903359432202', time=2024-09-12T02:50:40.635973+0000, chain.objs.size()=1 2024-09-12T01:02:37.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.x5mbS7v6yMoEOJF-RXr1F9h2Aat2-nd_0 2024-09-12T01:02:37.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6143394968674429966', time=2024-09-12T02:50:40.730153+0000, chain.objs.size()=1 2024-09-12T01:02:37.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.bFEEfMkfMZTRHYv0ZIbNh1LXvguUgxi_0 2024-09-12T01:02:37.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8777854582168867887', time=2024-09-12T02:50:40.738207+0000, chain.objs.size()=1 2024-09-12T01:02:37.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.IU-T4CDxy5RJg36AbG6F86Yk3_T7s2D_0 2024-09-12T01:02:37.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4900230381291523304', time=2024-09-12T02:50:41.018670+0000, chain.objs.size()=1 2024-09-12T01:02:37.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.EsZe8Giglq9-oVNUXrJFBDco2us3Ref_0 2024-09-12T01:02:37.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10421212789649302258', time=2024-09-12T02:50:41.141758+0000, chain.objs.size()=1 2024-09-12T01:02:37.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.7K0EzCO_-C10KFjk81VoE23U1S4RGG8_0 2024-09-12T01:02:37.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9321303673231394593', time=2024-09-12T02:50:41.270858+0000, chain.objs.size()=1 2024-09-12T01:02:37.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.3wWghmxUKeSEoLzgklOPRQgRKjIMfF6_0 2024-09-12T01:02:37.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7546941265826036289', time=2024-09-12T02:50:41.329470+0000, chain.objs.size()=1 2024-09-12T01:02:37.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.rswmCUgZsgCzidcM7aZujJiZL_JF2ax_0 2024-09-12T01:02:37.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10558846192475529708', time=2024-09-12T02:50:41.421685+0000, chain.objs.size()=1 2024-09-12T01:02:37.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.oCafB2rkfAE3V3vNjIZQCORfDL6qKIZ_0 2024-09-12T01:02:37.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18251934491381687588', time=2024-09-12T02:50:41.594061+0000, chain.objs.size()=1 2024-09-12T01:02:37.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.zNR8WJJHyVfoABNIhKD_cVCkLnSa9_k_0 2024-09-12T01:02:37.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10522735508496018468', time=2024-09-12T02:50:41.633468+0000, chain.objs.size()=1 2024-09-12T01:02:37.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.l0pdyz5EwBs85vRmI_0JvA9Ch3GBf20_0 2024-09-12T01:02:37.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46977 2024-09-12T01:02:37.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T01:02:37.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4036717341654162524', time=2024-09-12T02:50:41.647449+0000, chain.objs.size()=1 2024-09-12T01:02:37.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.OuYKhQEBmEEatSsyLsAxqqUmc2JHUT9_0 2024-09-12T01:02:37.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6274885160836904129', time=2024-09-12T02:52:06.314083+0000, chain.objs.size()=1 2024-09-12T01:02:37.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.443__shadow_.Z8cvOrr1yRgCz-oGSf6W4chEXr5q185_0 2024-09-12T01:02:37.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4935157143976210708', time=2024-09-12T02:52:25.686796+0000, chain.objs.size()=1 2024-09-12T01:02:37.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.464__shadow_.rZ4u0teSkKGH8PjIwoTpBWIrzZJ_pSt_0 2024-09-12T01:02:37.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6881860519373728896', time=2024-09-12T02:52:36.200914+0000, chain.objs.size()=1 2024-09-12T01:02:37.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.483__shadow_.ZNKdZfxpyFvj9_T3xNnrk8jq2kYzioH_0 2024-09-12T01:02:37.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17571391179021703567', time=2024-09-12T02:52:39.548448+0000, chain.objs.size()=1 2024-09-12T01:02:37.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.487__shadow_.pDJaF91IamkIVaHLjLxZNY9Jrj1dUeU_0 2024-09-12T01:02:37.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13458427383539219942', time=2024-09-12T02:52:57.377841+0000, chain.objs.size()=1 2024-09-12T01:02:37.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.513__multipart_mymultipart.2~hObXawlwwUPm4C-KptMK94AKGXxZJ0v.1 2024-09-12T01:02:37.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8130861693010674987', time=2024-09-12T02:54:46.627140+0000, chain.objs.size()=1 2024-09-12T01:02:37.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:osD8PBTUQYGTT9Gaar4AheLd-SNTpBi_.pyibNQlIpCcjQxQ5BjJHRytklrCEihL_0 2024-09-12T01:02:37.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7509052784333910428', time=2024-09-12T02:54:54.679464+0000, chain.objs.size()=1 2024-09-12T01:02:37.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.571__shadow_.06kZqLp4I8LeTjKrqvlqDmFQZou61Qn_0 2024-09-12T01:02:37.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4544582305110784936', time=2024-09-12T02:55:05.725560+0000, chain.objs.size()=1 2024-09-12T01:02:37.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.576__shadow:izcUr7mSDn.FwVHaLjYtfong12LfLwD_.izg5Ozj6NyBXdao3vrMCPVr6UQcm-Qd_0 2024-09-12T01:02:37.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16300635441391958715', time=2024-09-12T02:55:07.521958+0000, chain.objs.size()=1 2024-09-12T01:02:37.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:p35lAL2gRN1BtofcEyIRH0sUd5BZGs3_.23-vinyE1QgtIM3ep9_lhG_LiNcM3eB_0 2024-09-12T01:02:37.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17445483034179558843', time=2024-09-12T02:55:17.053366+0000, chain.objs.size()=1 2024-09-12T01:02:37.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:VEh7mny9YUHBVyl9CB7jl3uuNhWYBuz_.8KFAAc-bph9Ke6CjGlGg9nK-DnbEc9Q_0 2024-09-12T01:02:37.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2446919305167660589', time=2024-09-12T02:55:26.452688+0000, chain.objs.size()=4 2024-09-12T01:02:37.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.578__multipart_testobj.2~_KGp4iJHdgHBGsqxIVDEDAOn2X6nyj5.1 2024-09-12T01:02:37.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.578__multipart_testobj.2~_KGp4iJHdgHBGsqxIVDEDAOn2X6nyj5.2 2024-09-12T01:02:37.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.578__multipart_testobj.2~_KGp4iJHdgHBGsqxIVDEDAOn2X6nyj5.3 2024-09-12T01:02:37.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.578__multipart_testobj.2~_KGp4iJHdgHBGsqxIVDEDAOn2X6nyj5.4 2024-09-12T01:02:37.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15085323634236112845', time=2024-09-12T02:55:30.272011+0000, chain.objs.size()=1 2024-09-12T01:02:37.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.580__shadow:5seQflgHyeDERrTCRLXmTbaq2uEzkX-_.8J21rmYJmkrwmm13k_lnWBqcPPmmFdf_0 2024-09-12T01:02:37.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8913687947967772642', time=2024-09-12T02:55:30.439314+0000, chain.objs.size()=1 2024-09-12T01:02:37.729 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.580__shadow:5seQflgHyeDERrTCRLXmTbaq2uEzkX-_.8J21rmYJmkrwmm13k_lnWBqcPPmmFdf_0 2024-09-12T01:02:37.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8661793220829437369', time=2024-09-12T02:55:30.445258+0000, chain.objs.size()=1 2024-09-12T01:02:37.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.580__shadow:kWg-hmk70TbJD44PluHyH1SxVs0PnuO_.CNAJCxvAts5TEli1dvPXCAtS9wGGi3e_0 2024-09-12T01:02:37.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1481233549836454566', time=2024-09-12T02:58:41.994939+0000, chain.objs.size()=2 2024-09-12T01:02:37.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.656__shadow_.xmFuszLfDa-DRrwva-AFRW9uZPYLAM9_0 2024-09-12T01:02:37.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.656__shadow_.xmFuszLfDa-DRrwva-AFRW9uZPYLAM9_1 2024-09-12T01:02:37.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7489076297028785178', time=2024-09-12T02:58:49.140484+0000, chain.objs.size()=1 2024-09-12T01:02:37.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.664__shadow_.Sf1qogLGumbcxbZVR_chQXg-lEVIVIJ_0 2024-09-12T01:02:37.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.273850529103617370', time=2024-09-12T02:59:12.537023+0000, chain.objs.size()=1 2024-09-12T01:02:37.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.700__shadow:wWZjpmmkQ0kDoJq4JZJjs0AXmDq8XnN_.5UCiBLudcJzUZSh5Gl8fHht9IHcV3Vs_0 2024-09-12T01:02:37.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5661634705043505533', time=2024-09-12T02:59:57.884824+0000, chain.objs.size()=10 2024-09-12T01:02:37.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.735__multipart_foo.2~UdEw-TZ9N26rpuOG72hYtIQGHP0lnoi.1 2024-09-12T01:02:37.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.735__multipart_foo.2~UdEw-TZ9N26rpuOG72hYtIQGHP0lnoi.2 2024-09-12T01:02:37.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.735__multipart_foo.2~UdEw-TZ9N26rpuOG72hYtIQGHP0lnoi.3 2024-09-12T01:02:37.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.735__multipart_foo.2~UdEw-TZ9N26rpuOG72hYtIQGHP0lnoi.4 2024-09-12T01:02:37.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.735__multipart_foo.2~UdEw-TZ9N26rpuOG72hYtIQGHP0lnoi.5 2024-09-12T01:02:37.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.735__multipart_foo.2~UdEw-TZ9N26rpuOG72hYtIQGHP0lnoi.6 2024-09-12T01:02:37.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.735__multipart_foo.2~UdEw-TZ9N26rpuOG72hYtIQGHP0lnoi.7 2024-09-12T01:02:37.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.742+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.735__multipart_foo.2~UdEw-TZ9N26rpuOG72hYtIQGHP0lnoi.8 2024-09-12T01:02:37.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.742+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.735__multipart_foo.2~UdEw-TZ9N26rpuOG72hYtIQGHP0lnoi.9 2024-09-12T01:02:37.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.742+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.735__multipart_foo.2~UdEw-TZ9N26rpuOG72hYtIQGHP0lnoi.10 2024-09-12T01:02:37.741 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:37.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:02:37.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50253' 2024-09-12T01:02:37.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13974536328502872810', time=2024-09-12T02:45:56.025532+0000, chain.objs.size()=1 2024-09-12T01:02:37.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.148__shadow_.2X4u1M1jnJG69lxZoCrqqocI5I-G5qn_0 2024-09-12T01:02:37.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='_Uo8uRl_mIMx1GKean578IYaG3umqsVW', time=2024-09-12T02:46:05.153571+0000, chain.objs.size()=2 2024-09-12T01:02:37.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.160__shadow_.fdg7YcM_Zhz50BSIxyksq4r5Ucr_g10_0 2024-09-12T01:02:37.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.160__shadow_.fdg7YcM_Zhz50BSIxyksq4r5Ucr_g10_1 2024-09-12T01:02:37.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15590332690527617016', time=2024-09-12T02:48:21.964062+0000, chain.objs.size()=1 2024-09-12T01:02:37.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.234__shadow_.JusBaYeBjAfGC5-s-7v7Ief71i6hcec_0 2024-09-12T01:02:37.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17995880813933282328', time=2024-09-12T02:48:32.840480+0000, chain.objs.size()=1 2024-09-12T01:02:37.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.246__shadow_.PDbXvgrNvGQeo9yBOwcFyc25eRuU5hs_0 2024-09-12T01:02:37.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7923776497724832245', time=2024-09-12T02:48:34.260456+0000, chain.objs.size()=1 2024-09-12T01:02:37.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.248__shadow_.Qh6ojgyVmV2bbmxvAhiv_LnpGl6bRni_0 2024-09-12T01:02:37.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12085555304250004743', time=2024-09-12T02:48:37.227839+0000, chain.objs.size()=1 2024-09-12T01:02:37.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.252__shadow_.mNul1_vwsndwZcP2Kp-wm8AAxnAlLOD_0 2024-09-12T01:02:37.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10689922279978117816', time=2024-09-12T02:49:05.453853+0000, chain.objs.size()=1 2024-09-12T01:02:37.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.FBqKnOxXINNttxbE4GTgB33iqtAvSkI_0 2024-09-12T01:02:37.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15086542261285740808', time=2024-09-12T02:49:05.477726+0000, chain.objs.size()=1 2024-09-12T01:02:37.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.67BTuR4Lm2fiXgyLTIoxiWKfHpiX7qv_0 2024-09-12T01:02:37.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17868832711425604390', time=2024-09-12T02:49:05.563331+0000, chain.objs.size()=1 2024-09-12T01:02:37.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.C1c9BlNVwcve_hV1XH8jT6fol6P_-8S_0 2024-09-12T01:02:37.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17558204967889359099', time=2024-09-12T02:49:05.578176+0000, chain.objs.size()=1 2024-09-12T01:02:37.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.iq-88XRymfjL-TfXn6vlyDa3yALwKRr_0 2024-09-12T01:02:37.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7437765018574391939', time=2024-09-12T02:49:05.579775+0000, chain.objs.size()=1 2024-09-12T01:02:37.749 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.HJKv0u8Cu3sbTrb3GpE9TqUM2uMsKek_0 2024-09-12T01:02:37.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.754+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9992687455921169345', time=2024-09-12T02:49:05.698071+0000, chain.objs.size()=1 2024-09-12T01:02:37.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.754+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.wjtTBRqcccBDhQer6lPHoYQH64ZyD53_0 2024-09-12T01:02:37.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14009111994190981985', time=2024-09-12T02:49:05.957054+0000, chain.objs.size()=1 2024-09-12T01:02:37.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.kNkZuKM-GnRT-HrTXlh9MM4Qjb8BDFQ_0 2024-09-12T01:02:37.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16407148255501602661', time=2024-09-12T02:49:06.081689+0000, chain.objs.size()=1 2024-09-12T01:02:37.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.R9bN1ViRSq3H6ZBYv23QnDq23jKLiZ__0 2024-09-12T01:02:37.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11621802523413723566', time=2024-09-12T02:49:06.325222+0000, chain.objs.size()=1 2024-09-12T01:02:37.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.X51dn6mvewiOHtjcOOyJgU5Rshrbu6A_0 2024-09-12T01:02:37.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12980731719785946135', time=2024-09-12T02:49:06.378334+0000, chain.objs.size()=1 2024-09-12T01:02:37.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.S4qOXZOqx0HdNMuVvIZZNG4DIqAw5Rt_0 2024-09-12T01:02:37.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13052059929421495973', time=2024-09-12T02:49:06.524688+0000, chain.objs.size()=1 2024-09-12T01:02:37.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.J9kgc3EUiNtp2O8oldWJdlcDhhY21b4_0 2024-09-12T01:02:37.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5564677134070060613', time=2024-09-12T02:49:06.542270+0000, chain.objs.size()=1 2024-09-12T01:02:37.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.6_MCVFjhuihECV9GC2eTpNCBa9gLrnQ_0 2024-09-12T01:02:37.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4357016198861048909', time=2024-09-12T02:49:06.544723+0000, chain.objs.size()=1 2024-09-12T01:02:37.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.tyG5ZOGp9-jUfBrZg3pLOefyoI-Cip0_0 2024-09-12T01:02:37.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1330977723466843256', time=2024-09-12T02:49:06.571738+0000, chain.objs.size()=1 2024-09-12T01:02:37.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.sPKPXpz4Zl-5KHwfdIc9wfRlzIDNHBs_0 2024-09-12T01:02:37.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15075147589521426514', time=2024-09-12T02:49:06.616676+0000, chain.objs.size()=1 2024-09-12T01:02:37.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.naj6inotm7fm6JMZnqsvBgdGIw2Ozjh_0 2024-09-12T01:02:37.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16230541922109442086', time=2024-09-12T02:49:06.628925+0000, chain.objs.size()=1 2024-09-12T01:02:37.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.gj8Iy91CVbMaPenFJ5W0-Skc6UVCT6L_0 2024-09-12T01:02:37.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.879246596479701024', time=2024-09-12T02:49:06.784590+0000, chain.objs.size()=1 2024-09-12T01:02:37.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.dumIWNT0_F6phvkIeRn3P6_h5fHJzwV_0 2024-09-12T01:02:37.756 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3994667146018900471', time=2024-09-12T02:49:06.808612+0000, chain.objs.size()=1 2024-09-12T01:02:37.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.yrMJgcDia31UkY37TIr2wgrMFqcyz4D_0 2024-09-12T01:02:37.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1734665923806729570', time=2024-09-12T02:49:06.845459+0000, chain.objs.size()=1 2024-09-12T01:02:37.757 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.8cOLqh8oYkhC5cFKp70ljsAVCy_H4MT_0 2024-09-12T01:02:37.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.811101225183250047', time=2024-09-12T02:49:06.848697+0000, chain.objs.size()=1 2024-09-12T01:02:37.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.xs2I1QSX4c604S3v0Enk9DE44I7yMYT_0 2024-09-12T01:02:37.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13127895626543137245', time=2024-09-12T02:49:06.877471+0000, chain.objs.size()=1 2024-09-12T01:02:37.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.MqSYIuLZKpirQ1UBsY3aiCpRECSJvyN_0 2024-09-12T01:02:37.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.789629751142667105', time=2024-09-12T02:49:06.884970+0000, chain.objs.size()=1 2024-09-12T01:02:37.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.HkAv9lRniNLBGECXrg3QT6WIquCbHLu_0 2024-09-12T01:02:37.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15638612207299796750', time=2024-09-12T02:49:06.908316+0000, chain.objs.size()=1 2024-09-12T01:02:37.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.EhV-uqdqjLJeZAtgzAWcV9oemlUs7fg_0 2024-09-12T01:02:37.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13758987305646107837', time=2024-09-12T02:49:07.063781+0000, chain.objs.size()=1 2024-09-12T01:02:37.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.r1-2YL7Hn4P3EU5ex2zr4_fJx2hM4-O_0 2024-09-12T01:02:37.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9055729567924151148', time=2024-09-12T02:49:07.113627+0000, chain.objs.size()=1 2024-09-12T01:02:37.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.wvXdASrJQQ5eemZuzlnX0im4iqpgCmh_0 2024-09-12T01:02:37.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9956547520838004598', time=2024-09-12T02:49:07.149662+0000, chain.objs.size()=1 2024-09-12T01:02:37.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.YMskknGTbfzKAlAEpcPauNewbHKS0Nu_0 2024-09-12T01:02:37.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2860708166513831575', time=2024-09-12T02:49:07.173973+0000, chain.objs.size()=1 2024-09-12T01:02:37.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.42sj0NZBwvOB5-92qOUovD0Mknzal-n_0 2024-09-12T01:02:37.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13323770691221093342', time=2024-09-12T02:49:07.340296+0000, chain.objs.size()=1 2024-09-12T01:02:37.760 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.762+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.AZH5FQp75A_0d7bxlpEyV8r3COB6jdA_0 2024-09-12T01:02:37.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12630938548038128093', time=2024-09-12T02:49:16.839464+0000, chain.objs.size()=1 2024-09-12T01:02:37.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.275__shadow_.i943SC0YmQiVlC-n62SjqwuaK8gIDxa_0 2024-09-12T01:02:37.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8583943230560260786', time=2024-09-12T02:49:25.454842+0000, chain.objs.size()=1 2024-09-12T01:02:37.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.286__shadow_.U4dIIuhW9EGbERtaw-3L3o4eAEJnZqG_0 2024-09-12T01:02:37.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5387158196737825481', time=2024-09-12T02:49:32.461183+0000, chain.objs.size()=1 2024-09-12T01:02:37.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.6liLh7QL7CfScmLjaiAZvEks7Y9crTF_0 2024-09-12T01:02:37.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17403041815219296385', time=2024-09-12T02:49:33.152141+0000, chain.objs.size()=1 2024-09-12T01:02:37.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.294__shadow_.rHrMupZML_mT5Pm7ntjyY-pHWGP-jts_0 2024-09-12T01:02:37.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7858240603621483241', time=2024-09-12T02:49:33.867338+0000, chain.objs.size()=1 2024-09-12T01:02:37.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.295__shadow_.BstVVpt7bUk40oQ-7DJaduTPFnxl_bg_0 2024-09-12T01:02:37.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11863760503960367557', time=2024-09-12T02:49:35.394303+0000, chain.objs.size()=1 2024-09-12T01:02:37.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.297__shadow_.i1F5NJVXsYUwpvzmKr0pT0ldbNK5Bhe_0 2024-09-12T01:02:37.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1023382095950386215', time=2024-09-12T02:49:39.968231+0000, chain.objs.size()=1 2024-09-12T01:02:37.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.303__shadow_.aPJiT41Bz4zvtfNWknugAgE1pz2rcYo_0 2024-09-12T01:02:37.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2220693814155648508', time=2024-09-12T02:50:15.789952+0000, chain.objs.size()=1 2024-09-12T01:02:37.764 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.F1lyaUKGWpNPTU7f5HII8YIBUMdgCTz_0 2024-09-12T01:02:37.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.770+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3398420182198309965', time=2024-09-12T02:50:15.939050+0000, chain.objs.size()=1 2024-09-12T01:02:37.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.770+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.sjADI1TtZrVMlhWKn2HLTvp_3A3LuEH_0 2024-09-12T01:02:37.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.770+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17660567681538316677', time=2024-09-12T02:50:16.082642+0000, chain.objs.size()=1 2024-09-12T01:02:37.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.770+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.0fyeM5jRhouUqn5iKjWvAAP1D8OBRTq_0 2024-09-12T01:02:37.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.770+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4138446211954381728', time=2024-09-12T02:50:16.090998+0000, chain.objs.size()=1 2024-09-12T01:02:37.765 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.770+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xegv3T6sJDhxc2Bj3zGS1M4kXmMNQoV_0 2024-09-12T01:02:37.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17208403105207207766', time=2024-09-12T02:50:16.121496+0000, chain.objs.size()=1 2024-09-12T01:02:37.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.IzgaTE5D8ub24wXt4MeqfJ6w86fjJDC_0 2024-09-12T01:02:37.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18282158043388980332', time=2024-09-12T02:50:16.144095+0000, chain.objs.size()=1 2024-09-12T01:02:37.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.MmMtFzxqwSD4YX9woeFRhGz72_Qw_rf_0 2024-09-12T01:02:37.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2705323396092003361', time=2024-09-12T02:50:16.206105+0000, chain.objs.size()=1 2024-09-12T01:02:37.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6ovTwmwwpwoXjvp-3thXPqCD3oGP7qV_0 2024-09-12T01:02:37.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18304117070899926029', time=2024-09-12T02:50:16.378202+0000, chain.objs.size()=1 2024-09-12T01:02:37.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.XDJgPDls_FRr-XGkMApEeWECLn2Lb9F_0 2024-09-12T01:02:37.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7003123932123314603', time=2024-09-12T02:50:16.433778+0000, chain.objs.size()=1 2024-09-12T01:02:37.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.LWiaQXdrLJoYWbLvxFw_kHJFNzN1XAz_0 2024-09-12T01:02:37.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5586992189238624627', time=2024-09-12T02:50:16.443676+0000, chain.objs.size()=1 2024-09-12T01:02:37.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.B6D25ahgN4RhEy9u6u0X3uEevJuais1_0 2024-09-12T01:02:37.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17335312135585549424', time=2024-09-12T02:50:16.494880+0000, chain.objs.size()=1 2024-09-12T01:02:37.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_._yKp0uOALLrQQqlhxlpWKK5TpMAwJTx_0 2024-09-12T01:02:37.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2169957614847597751', time=2024-09-12T02:50:16.650547+0000, chain.objs.size()=1 2024-09-12T01:02:37.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4uX3sd2rIqQHH5lVWmoQ99kdsLHWgEm_0 2024-09-12T01:02:37.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4938153983006057527', time=2024-09-12T02:50:16.669451+0000, chain.objs.size()=1 2024-09-12T01:02:37.770 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.g8MuMiBZ8OYixR6U-hjrflAW97PEazt_0 2024-09-12T01:02:37.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3848068824308549130', time=2024-09-12T02:50:16.719238+0000, chain.objs.size()=1 2024-09-12T01:02:37.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.YyUcvZZjiwN_est7OOZ-5zpSQPqpkVN_0 2024-09-12T01:02:37.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13904038583062553926', time=2024-09-12T02:50:16.788453+0000, chain.objs.size()=1 2024-09-12T01:02:37.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.774+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.0a4U4Dwu_Ma4_EfCKiFkZTF7STiYFiE_0 2024-09-12T01:02:37.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3248858483810170451', time=2024-09-12T02:50:16.923764+0000, chain.objs.size()=1 2024-09-12T01:02:37.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.V2sTOl-jZ0lgADJtpqtpo5yWTXvEDmT_0 2024-09-12T01:02:37.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4157555233631454028', time=2024-09-12T02:50:16.990651+0000, chain.objs.size()=1 2024-09-12T01:02:37.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.0XrWnLEVnywsMUvfhCYVzuUaSqOM95j_0 2024-09-12T01:02:37.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12407462632853787605', time=2024-09-12T02:50:16.991814+0000, chain.objs.size()=1 2024-09-12T01:02:37.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.g3u7OUAAf5kuZ9j6X05kN5ipSOo2Rml_0 2024-09-12T01:02:37.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17117665943243800577', time=2024-09-12T02:50:17.026963+0000, chain.objs.size()=1 2024-09-12T01:02:37.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.3JSQbPX4Heg4P5gKC9nDHLrefL1uru0_0 2024-09-12T01:02:37.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3522150587633441548', time=2024-09-12T02:50:17.163246+0000, chain.objs.size()=1 2024-09-12T01:02:37.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Qn2Rvq8WSaHh5LtDtBudCvfeUv3W9nx_0 2024-09-12T01:02:37.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14417385799493454867', time=2024-09-12T02:50:17.172561+0000, chain.objs.size()=1 2024-09-12T01:02:37.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.W0T2AXi7Py7Kb0y5qWnO_p02FI-Yjvv_0 2024-09-12T01:02:37.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5060902950669111350', time=2024-09-12T02:50:17.207979+0000, chain.objs.size()=1 2024-09-12T01:02:37.775 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.MghAAe_Ied7_RXe27_euzDPXTpWqHw2_0 2024-09-12T01:02:37.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.643822340964203364', time=2024-09-12T02:50:17.471738+0000, chain.objs.size()=1 2024-09-12T01:02:37.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Nq7ic7gPHh-w5hVjsJzyru3iJCYMQDn_0 2024-09-12T01:02:37.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10788179988528401573', time=2024-09-12T02:50:17.543958+0000, chain.objs.size()=1 2024-09-12T01:02:37.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.778+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.9g3xCpmVGZQUkKjqRqvcHqfAlDBIDNV_0 2024-09-12T01:02:37.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4001278011413819015', time=2024-09-12T02:50:17.644553+0000, chain.objs.size()=1 2024-09-12T01:02:37.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.yL-ogNgmMg8Jc67X3dx9SMoYt1SAqPr_0 2024-09-12T01:02:37.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9523997090503053994', time=2024-09-12T02:50:17.676023+0000, chain.objs.size()=1 2024-09-12T01:02:37.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.0hrsIz2_2MoQiya19v20mcOvUaCaV9-_0 2024-09-12T01:02:37.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9735746510743067634', time=2024-09-12T02:50:17.739407+0000, chain.objs.size()=1 2024-09-12T01:02:37.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.BpiOkxJZJo7iwqvd6brOsgYq1-_ulFI_0 2024-09-12T01:02:37.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4654062893979161606', time=2024-09-12T02:50:17.751000+0000, chain.objs.size()=1 2024-09-12T01:02:37.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.SL3wQ0QRwuAqCrC0-XlX7rvoCpHOY7A_0 2024-09-12T01:02:37.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13191011772970906373', time=2024-09-12T02:50:39.553922+0000, chain.objs.size()=1 2024-09-12T01:02:37.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.9uQTBJ_KJwR3vsC0YqWNFxc9mnjuJAb_0 2024-09-12T01:02:37.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13394904317988080497', time=2024-09-12T02:50:39.577090+0000, chain.objs.size()=1 2024-09-12T01:02:37.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.7DZK_jmkRwszVWgURlzP8s8apiesfnI_0 2024-09-12T01:02:37.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8161390325374839076', time=2024-09-12T02:50:39.600265+0000, chain.objs.size()=1 2024-09-12T01:02:37.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.3uh9vcSqAj2o083RWW6wYMlbN42UJj9_0 2024-09-12T01:02:37.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1759951753792159148', time=2024-09-12T02:50:39.616739+0000, chain.objs.size()=1 2024-09-12T01:02:37.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.rofhKvpRBuVGOWWyoYFVHg_D1_xh0FW_0 2024-09-12T01:02:37.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5472928903123291558', time=2024-09-12T02:50:39.617599+0000, chain.objs.size()=1 2024-09-12T01:02:37.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.bV5u9EMD6q-sZS8H8z6SN_NX1O_K_wR_0 2024-09-12T01:02:37.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1936704334112686282', time=2024-09-12T02:50:39.765120+0000, chain.objs.size()=1 2024-09-12T01:02:37.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.yRUGsYfo5F32suFb9Dhobfc3S4PNlaT_0 2024-09-12T01:02:37.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7918792269433142105', time=2024-09-12T02:50:39.782695+0000, chain.objs.size()=1 2024-09-12T01:02:37.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.hCOoMAgiuj1xQoylqYTMXhps5rX-vDO_0 2024-09-12T01:02:37.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11633750329017267941', time=2024-09-12T02:50:39.824320+0000, chain.objs.size()=1 2024-09-12T01:02:37.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.vGy3FFLvMmQlTIWt3WjrXXeANUBrO_t_0 2024-09-12T01:02:37.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12887242134409249869', time=2024-09-12T02:50:39.827065+0000, chain.objs.size()=1 2024-09-12T01:02:37.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.IOa2hCjh65fbej5YZFaPI0WKm5113H2_0 2024-09-12T01:02:37.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.58786422586692481', time=2024-09-12T02:50:39.976214+0000, chain.objs.size()=1 2024-09-12T01:02:37.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.5xGoAC8Ws8hW8VORmO-M6_GxCVs6C8U_0 2024-09-12T01:02:37.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5238434835281577619', time=2024-09-12T02:50:40.116720+0000, chain.objs.size()=1 2024-09-12T01:02:37.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.pt0eGwMFxU9F7-tI7BpSpHrV2roILvn_0 2024-09-12T01:02:37.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7809286436696957227', time=2024-09-12T02:50:40.142723+0000, chain.objs.size()=1 2024-09-12T01:02:37.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.RmDVM1Sm4clNuww4WlLcTWFwsGMuTkk_0 2024-09-12T01:02:37.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3009478611917511462', time=2024-09-12T02:50:40.250968+0000, chain.objs.size()=1 2024-09-12T01:02:37.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.1Der3r1N7FHhtTg2JKOPeePBXMT0VeY_0 2024-09-12T01:02:37.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11426792703848352017', time=2024-09-12T02:50:40.323966+0000, chain.objs.size()=1 2024-09-12T01:02:37.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.tgctnR7dMDXSyIIRdoCggCc5bUhuNxQ_0 2024-09-12T01:02:37.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5456475074628964695', time=2024-09-12T02:50:40.326741+0000, chain.objs.size()=1 2024-09-12T01:02:37.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.qj17OKUSqTW8YVGsROYqZNGxnz5NpIo_0 2024-09-12T01:02:37.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8134580021325248469', time=2024-09-12T02:50:40.336120+0000, chain.objs.size()=1 2024-09-12T01:02:37.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.786+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Ku_3UlDvs3EpKF1bTWCbw1X8z7fOMRJ_0 2024-09-12T01:02:37.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5438585322104155805', time=2024-09-12T02:50:40.364431+0000, chain.objs.size()=1 2024-09-12T01:02:37.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.QPDMIRbtG9XnUQBoefZvP4v6Z_BANhJ_0 2024-09-12T01:02:37.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7024976263221753448', time=2024-09-12T02:50:40.561394+0000, chain.objs.size()=1 2024-09-12T01:02:37.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_._9a2TzcKQEutmrsErQ3hTmGCshEg9So_0 2024-09-12T01:02:37.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15787314437351587092', time=2024-09-12T02:50:40.573490+0000, chain.objs.size()=1 2024-09-12T01:02:37.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.5YiiXQ-ySmb05BKnZZtZaMIBBf-RCoi_0 2024-09-12T01:02:37.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11005896805717565037', time=2024-09-12T02:50:40.593772+0000, chain.objs.size()=1 2024-09-12T01:02:37.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.rXHeP-4dzl2QdyPKWSJMBtae3VxjidE_0 2024-09-12T01:02:37.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18212562555231536645', time=2024-09-12T02:50:40.834670+0000, chain.objs.size()=1 2024-09-12T01:02:37.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.t9Y8WcCGrNxGBcfURqJXmd4Dil5RjCx_0 2024-09-12T01:02:37.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16135728948168502352', time=2024-09-12T02:50:40.842054+0000, chain.objs.size()=1 2024-09-12T01:02:37.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.aGgDoffJyrG-8hTyA4SZhQx_GEDVVN1_0 2024-09-12T01:02:37.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5421869743369597778', time=2024-09-12T02:50:40.896734+0000, chain.objs.size()=1 2024-09-12T01:02:37.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.woQ0WBOMYDpaQ442PHvxY9TXU_LG-Bi_0 2024-09-12T01:02:37.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6581575264722296960', time=2024-09-12T02:50:41.009220+0000, chain.objs.size()=1 2024-09-12T01:02:37.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.6UhynAfWuPA3kydwFHZcNrOZpKv79xF_0 2024-09-12T01:02:37.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3803610425960142529', time=2024-09-12T02:50:41.123437+0000, chain.objs.size()=1 2024-09-12T01:02:37.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.f4dORpyIB57j6q2zivJQ4Ky-vH6RJl5_0 2024-09-12T01:02:37.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2894832932269309799', time=2024-09-12T02:50:41.266841+0000, chain.objs.size()=1 2024-09-12T01:02:37.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.k2mdGKLOJW7PII-sVXHrXVk0jJIb9g7_0 2024-09-12T01:02:37.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11732693143899620441', time=2024-09-12T02:50:41.332612+0000, chain.objs.size()=1 2024-09-12T01:02:37.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.602zQ5z4joHjjd_BvnHBzeXwafM2XIz_0 2024-09-12T01:02:37.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.798+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2090691947182210025', time=2024-09-12T02:50:41.338597+0000, chain.objs.size()=1 2024-09-12T01:02:37.794 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.798+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.x2jc4Nmi5tzsUDengvkAdUXsRVcmA77_0 2024-09-12T01:02:37.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.798+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4064498960158695449', time=2024-09-12T02:50:41.407034+0000, chain.objs.size()=1 2024-09-12T01:02:37.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.798+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.rQsIWy8XBxFrS2Bhbay_vyhynBRpK0S_0 2024-09-12T01:02:37.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.798+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4228295973043047574', time=2024-09-12T02:50:41.418575+0000, chain.objs.size()=1 2024-09-12T01:02:37.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.798+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.-1y0k43esAZZuN-_LHUgfAVDn8i6Fqt_0 2024-09-12T01:02:37.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.798+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6779989402938503878', time=2024-09-12T02:50:41.424542+0000, chain.objs.size()=1 2024-09-12T01:02:37.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.798+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.yluO5rhLKt6jdLLMd2FJXuC2Bof9jTG_0 2024-09-12T01:02:37.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.802+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50253 2024-09-12T01:02:37.802 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T01:02:37.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4259453116512342044', time=2024-09-12T02:50:41.523301+0000, chain.objs.size()=1 2024-09-12T01:02:37.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.kqbxt1-e8riRvkOt5nHvY73rn2ZzDSG_0 2024-09-12T01:02:37.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17466914837444273516', time=2024-09-12T02:50:41.610051+0000, chain.objs.size()=1 2024-09-12T01:02:37.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.G0KUJN-r7auHTXdLekEUkAvG8zENIhn_0 2024-09-12T01:02:37.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9855515241702259975', time=2024-09-12T02:50:49.634899+0000, chain.objs.size()=1 2024-09-12T01:02:37.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.336__shadow_.9FnnjvNocE1w-mm7dH-joG9QDjthFZ7_0 2024-09-12T01:02:37.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14560642206768651372', time=2024-09-12T02:51:00.604781+0000, chain.objs.size()=1 2024-09-12T01:02:37.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.353__shadow_.fkW1YAhosQThUt_37_-hnkc5vdDo12P_0 2024-09-12T01:02:37.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2917670160763056187', time=2024-09-12T02:51:15.152699+0000, chain.objs.size()=1 2024-09-12T01:02:37.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.375__shadow_._cGlXFFW9wOQPtDHbaAClo0gQQxjR___0 2024-09-12T01:02:37.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12526543523712851340', time=2024-09-12T02:52:23.661516+0000, chain.objs.size()=1 2024-09-12T01:02:37.803 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.462__shadow_.D0FDkvWwFKbX7LgrgldK4XriNZUYQep_0 2024-09-12T01:02:37.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6758130470423672511', time=2024-09-12T02:52:36.211260+0000, chain.objs.size()=1 2024-09-12T01:02:37.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.483__shadow_.xKRxpcY7DJ03h1OIHuJYYx0pCQksE4H_0 2024-09-12T01:02:37.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10182390539871820120', time=2024-09-12T02:52:36.998408+0000, chain.objs.size()=1 2024-09-12T01:02:37.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.484__shadow_.JCQjJRk29jy9hDRR8km1t-dE1Biw-fh_0 2024-09-12T01:02:37.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11799211691260303603', time=2024-09-12T02:52:37.000448+0000, chain.objs.size()=1 2024-09-12T01:02:37.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.484__shadow_.PBru2YAN1lhka_n5zjl7ynXA1nX3BjU_0 2024-09-12T01:02:37.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6056162364240486021', time=2024-09-12T02:53:25.529186+0000, chain.objs.size()=6 2024-09-12T01:02:37.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~zOO2vmQ-oaXLpPpzLLtbnZimy2lgCU7.1 2024-09-12T01:02:37.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.HVMycwkpWYcF_ahc_WweJKp1FjLsMDNy.2 2024-09-12T01:02:37.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.OPuIMfZHK631fY2-lymB2c1s8xeBGZob.3 2024-09-12T01:02:37.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.810+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~zOO2vmQ-oaXLpPpzLLtbnZimy2lgCU7.4 2024-09-12T01:02:37.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.810+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~zOO2vmQ-oaXLpPpzLLtbnZimy2lgCU7.5 2024-09-12T01:02:37.807 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.810+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~zOO2vmQ-oaXLpPpzLLtbnZimy2lgCU7.6 2024-09-12T01:02:37.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.814+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1894193922687811358', time=2024-09-12T02:53:32.463757+0000, chain.objs.size()=2 2024-09-12T01:02:37.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.814+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.525__multipart_mymultipart.2~Oqs5CXTFNSqfa1N9NM1U4mSLxjykJWh.1 2024-09-12T01:02:37.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.814+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.525__multipart_mymultipart.2~Oqs5CXTFNSqfa1N9NM1U4mSLxjykJWh.2 2024-09-12T01:02:37.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.814+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~i59GPhuBHzHu9trOqMbIpIm5MMX8hSR', time=2024-09-12T02:53:41.243879+0000, chain.objs.size()=2 2024-09-12T01:02:37.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.814+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.531__multipart_mymultipart.2~i59GPhuBHzHu9trOqMbIpIm5MMX8hSR.1 2024-09-12T01:02:37.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.814+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.531__multipart_mymultipart.2~i59GPhuBHzHu9trOqMbIpIm5MMX8hSR.2 2024-09-12T01:02:37.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.814+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6641582393139039102', time=2024-09-12T02:54:41.003728+0000, chain.objs.size()=1 2024-09-12T01:02:37.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.814+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.564__shadow_.jqheVdLPdpKTkIjTjsNd9qLcem9wedK_0 2024-09-12T01:02:37.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.814+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5592406314908532184', time=2024-09-12T02:55:06.233069+0000, chain.objs.size()=1 2024-09-12T01:02:37.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.814+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.576__shadow:dE52zzFSF-Zc7TIIjQ10d6dnGNR1TTz_.TT8gwzofLZZBLhwiAXAZ6aXXkK9uuhO_0 2024-09-12T01:02:37.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.814+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.586934362465608656', time=2024-09-12T02:55:30.436919+0000, chain.objs.size()=1 2024-09-12T01:02:37.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.814+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.580__shadow:5seQflgHyeDERrTCRLXmTbaq2uEzkX-_.8J21rmYJmkrwmm13k_lnWBqcPPmmFdf_0 2024-09-12T01:02:37.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.814+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3794062527275492763', time=2024-09-12T02:58:51.169257+0000, chain.objs.size()=1 2024-09-12T01:02:37.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.814+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.666__shadow_.P_64aH_DL2SfDUzR_GVMSo4qGaBCP8-_0 2024-09-12T01:02:37.815 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.818+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:37.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:02:37.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49632' 2024-09-12T01:02:37.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12309836087571676878', time=2024-09-12T02:46:07.877729+0000, chain.objs.size()=3 2024-09-12T01:02:37.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__multipart_foo-FROZEN.2~t2IeS4K7eCcBsGp6hKDVACnHKzcPGlx.1 2024-09-12T01:02:37.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__multipart_foo-FROZEN.2~t2IeS4K7eCcBsGp6hKDVACnHKzcPGlx.2 2024-09-12T01:02:37.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__multipart_foo-FROZEN.2~t2IeS4K7eCcBsGp6hKDVACnHKzcPGlx.3 2024-09-12T01:02:37.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.937419793869487578', time=2024-09-12T02:48:28.132161+0000, chain.objs.size()=1 2024-09-12T01:02:37.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.241__shadow_.R-P_iR37xN1Z9LWbFppa47H4OqJk8X3_0 2024-09-12T01:02:37.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7112033403983667769', time=2024-09-12T02:48:31.311713+0000, chain.objs.size()=1 2024-09-12T01:02:37.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.244__shadow_.x1uGOSYI2QhSXeSBAI8mvlqqtzr4OiF_0 2024-09-12T01:02:37.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8229094192053140977', time=2024-09-12T02:48:32.041197+0000, chain.objs.size()=1 2024-09-12T01:02:37.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.245__shadow_.frdYLkAOb4c20kXdQS5URtUsw7EJY4X_0 2024-09-12T01:02:37.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16641874586254844427', time=2024-09-12T02:48:33.553680+0000, chain.objs.size()=1 2024-09-12T01:02:37.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.247__shadow_.GB7NlYbv5TkUgPjft600ssop5JYDFMv_0 2024-09-12T01:02:37.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10636215370278248697', time=2024-09-12T02:48:39.457188+0000, chain.objs.size()=1 2024-09-12T01:02:37.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.255__shadow_.NdVSXzIktmZEJJpNNZ7M9CLVlNLk7la_0 2024-09-12T01:02:37.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15816233898233723832', time=2024-09-12T02:49:05.407845+0000, chain.objs.size()=1 2024-09-12T01:02:37.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.a6gnpWHlQRO1p4tNEiFbzrT0KBqQfyn_0 2024-09-12T01:02:37.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.244705043798785574', time=2024-09-12T02:49:05.452293+0000, chain.objs.size()=1 2024-09-12T01:02:37.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.K5iuwru1zBMzSDWEapjtyxirWSJ7hWS_0 2024-09-12T01:02:37.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13513811252720449420', time=2024-09-12T02:49:05.456882+0000, chain.objs.size()=1 2024-09-12T01:02:37.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0ogkmqC1KHU1vGe2G0ga049nmMUqCkm_0 2024-09-12T01:02:37.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16798873289167221097', time=2024-09-12T02:49:05.471603+0000, chain.objs.size()=1 2024-09-12T01:02:37.822 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.826+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.4-pmZ3SP2M7YNH37gPN9i6pvglJBnvg_0 2024-09-12T01:02:37.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13084333399461338845', time=2024-09-12T02:49:05.509644+0000, chain.objs.size()=1 2024-09-12T01:02:37.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Bq3hrH0_FP-dt6cyzHa6-7qiqQ2x0-A_0 2024-09-12T01:02:37.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2540946860882871497', time=2024-09-12T02:49:05.526131+0000, chain.objs.size()=1 2024-09-12T01:02:37.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.rvvkqHdJz8LoEQkuxZHyFukGEbxXgfU_0 2024-09-12T01:02:37.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10099312167689434115', time=2024-09-12T02:49:05.585104+0000, chain.objs.size()=1 2024-09-12T01:02:37.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.23MMFxmvXeeFQEtG4I1AC4AOnptExqF_0 2024-09-12T01:02:37.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15141339207855629509', time=2024-09-12T02:49:05.750566+0000, chain.objs.size()=1 2024-09-12T01:02:37.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.H2KicFzkOV47UMZl5EEUGaWounfnqJ7_0 2024-09-12T01:02:37.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15778706377207756829', time=2024-09-12T02:49:05.763504+0000, chain.objs.size()=1 2024-09-12T01:02:37.825 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.6r3Ncp4xm9obP5U_-d1BqGweOec7PhW_0 2024-09-12T01:02:37.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12229644905193507965', time=2024-09-12T02:49:05.770573+0000, chain.objs.size()=1 2024-09-12T01:02:37.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.sqjYME1_XD1KS9Vn2I-UrorvHyOrU59_0 2024-09-12T01:02:37.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.784154194074801030', time=2024-09-12T02:49:05.778476+0000, chain.objs.size()=1 2024-09-12T01:02:37.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.32hX4joMgPovxcOvR77z_ht7C8eCvgr_0 2024-09-12T01:02:37.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8663919469618088929', time=2024-09-12T02:49:05.793298+0000, chain.objs.size()=1 2024-09-12T01:02:37.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.InwxkrsaNgRDK_So5u_2Q_a1GO1p5Em_0 2024-09-12T01:02:37.826 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17466647121447783918', time=2024-09-12T02:49:05.821576+0000, chain.objs.size()=1 2024-09-12T01:02:37.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.cTo-63YMOVewvQLmpCWjewCqO_Z7Dr4_0 2024-09-12T01:02:37.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1636335855228681978', time=2024-09-12T02:49:05.857826+0000, chain.objs.size()=1 2024-09-12T01:02:37.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.JWIKejxe4csdxlUiMPsBYBsKxymPf_4_0 2024-09-12T01:02:37.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15736559423792067602', time=2024-09-12T02:49:05.997821+0000, chain.objs.size()=1 2024-09-12T01:02:37.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.830+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.U9aGIrTmpbqLZKIUhkQyJt_LpKCsZWX_0 2024-09-12T01:02:37.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10700169866522912195', time=2024-09-12T02:49:06.005579+0000, chain.objs.size()=1 2024-09-12T01:02:37.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.tlIhDs6AD7GnEzLeYQVdRlMYlGeyPEU_0 2024-09-12T01:02:37.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15922086463329059316', time=2024-09-12T02:49:06.044920+0000, chain.objs.size()=1 2024-09-12T01:02:37.829 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.MO5G6SxKck2X2i3owH-cuDGFRMoF95V_0 2024-09-12T01:02:37.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13573826627538931082', time=2024-09-12T02:49:06.218123+0000, chain.objs.size()=1 2024-09-12T01:02:37.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.G7Zifl-Y8slWQmrxYT1jBwo28fpflXB_0 2024-09-12T01:02:37.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8980572521748200095', time=2024-09-12T02:49:06.221713+0000, chain.objs.size()=1 2024-09-12T01:02:37.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.mh0uHz7kA3KjyvqtSA2BVeomHV-T7Mk_0 2024-09-12T01:02:37.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12836173031728458699', time=2024-09-12T02:49:06.223821+0000, chain.objs.size()=1 2024-09-12T01:02:37.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.sAhrVB2pb3Bdn-5NAw2wxkEp8S6-_EZ_0 2024-09-12T01:02:37.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13642698859018758481', time=2024-09-12T02:49:06.278113+0000, chain.objs.size()=1 2024-09-12T01:02:37.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.-tDAxNBMmucqwRs7vKS2nCB5kw2srqE_0 2024-09-12T01:02:37.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8747421891534942026', time=2024-09-12T02:49:06.279031+0000, chain.objs.size()=1 2024-09-12T01:02:37.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Utho-LcsxSgERVOled6-QBdhr2jOP5d_0 2024-09-12T01:02:37.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5447304328563906213', time=2024-09-12T02:49:06.280015+0000, chain.objs.size()=1 2024-09-12T01:02:37.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Wr0jydWvACCvXSqZ7Zap9nF3YQDnf9X_0 2024-09-12T01:02:37.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12767596599108544779', time=2024-09-12T02:49:06.323269+0000, chain.objs.size()=1 2024-09-12T01:02:37.833 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.HDGsMasurb3n-TR7jtQBC6COvBV81HS_0 2024-09-12T01:02:37.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9177541323439422681', time=2024-09-12T02:49:06.331826+0000, chain.objs.size()=1 2024-09-12T01:02:37.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.WTHlHeSdgSS32VUJJUuXRmix5fBim6O_0 2024-09-12T01:02:37.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5205845693412629206', time=2024-09-12T02:49:06.364522+0000, chain.objs.size()=1 2024-09-12T01:02:37.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ZQTUySGu-eZzSDs2dFogxiI9mn9Jaz-_0 2024-09-12T01:02:37.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.838+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11295554396309011130', time=2024-09-12T02:49:06.369323+0000, chain.objs.size()=1 2024-09-12T01:02:37.835 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.838+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.WJaCTY9V6IXolXFV3N_v6IJIznZSP4X_0 2024-09-12T01:02:37.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.838+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6219684958779434735', time=2024-09-12T02:49:06.375948+0000, chain.objs.size()=1 2024-09-12T01:02:37.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.838+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.AtU03lj4WoUxcfp2nfKvDc-55C03Efw_0 2024-09-12T01:02:37.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.838+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15049031892345908722', time=2024-09-12T02:49:06.486191+0000, chain.objs.size()=1 2024-09-12T01:02:37.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.838+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.IjvelfWhgGjzUm7ciIa5SuPnLQauHmy_0 2024-09-12T01:02:37.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.838+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10071335349983708496', time=2024-09-12T02:49:06.508290+0000, chain.objs.size()=1 2024-09-12T01:02:37.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.838+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.BxPKHCs_ASWGW6H5nOL-SUMaJmrwRjv_0 2024-09-12T01:02:37.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.838+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4183655363576204829', time=2024-09-12T02:49:06.549481+0000, chain.objs.size()=1 2024-09-12T01:02:37.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.838+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ojmaE5DdICNHJ-IHy9KSINd2vmfbh1Y_0 2024-09-12T01:02:37.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.842+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4502709265377892665', time=2024-09-12T02:49:06.641185+0000, chain.objs.size()=1 2024-09-12T01:02:37.838 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.842+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7vzoudPjtAludeXYOv1RZkgWF2nmx9t_0 2024-09-12T01:02:37.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.842+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8227197027875329998', time=2024-09-12T02:49:06.739987+0000, chain.objs.size()=1 2024-09-12T01:02:37.839 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.842+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.AMqVS6ooD3kNhBTAhjkvGNXlXIHLGN0_0 2024-09-12T01:02:37.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.842+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10196032650317850123', time=2024-09-12T02:49:06.748534+0000, chain.objs.size()=1 2024-09-12T01:02:37.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.842+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.3VKpu-rS9IWra1mPP-5uGvjyDwuk9t__0 2024-09-12T01:02:37.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.842+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6991035737972656259', time=2024-09-12T02:49:06.858719+0000, chain.objs.size()=1 2024-09-12T01:02:37.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.842+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.IGI8yc6ojn3w4w3rx4pF7BKMRRwd_Kc_0 2024-09-12T01:02:37.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.842+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14227371302207096850', time=2024-09-12T02:49:07.182022+0000, chain.objs.size()=1 2024-09-12T01:02:37.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.842+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.JM-cuLhzK5r-aM1npshyykAXkn6WtRT_0 2024-09-12T01:02:37.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.842+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3849904606480895204', time=2024-09-12T02:49:07.197452+0000, chain.objs.size()=1 2024-09-12T01:02:37.841 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.842+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.bCKNY6amlY5Jqe47kTTDidpq_fICAly_0 2024-09-12T01:02:37.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.842+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2989573093059873309', time=2024-09-12T02:49:07.323980+0000, chain.objs.size()=1 2024-09-12T01:02:37.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.842+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.gG9su7GHI_vC3Og5UJ9OaGZhiJ0YsHd_0 2024-09-12T01:02:37.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.846+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12755834462099182684', time=2024-09-12T02:49:07.341774+0000, chain.objs.size()=1 2024-09-12T01:02:37.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.846+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.AJrr7RnHH_r-wmM10YZxujUmEZgRjr2_0 2024-09-12T01:02:37.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.846+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13414055291086518958', time=2024-09-12T02:49:07.363402+0000, chain.objs.size()=1 2024-09-12T01:02:37.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.846+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.uEsazJWVDDDQjCgauxma2kQ9u92psnB_0 2024-09-12T01:02:37.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.846+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2095221221060397144', time=2024-09-12T02:49:07.382804+0000, chain.objs.size()=1 2024-09-12T01:02:37.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.846+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.AExiiiVC40ss_TOU2Hv_4gq5vtaLaUm_0 2024-09-12T01:02:37.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.846+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2472591378142082194', time=2024-09-12T02:49:07.422369+0000, chain.objs.size()=1 2024-09-12T01:02:37.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.846+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.FT8rFPfNrD7miUCDdlfi_8ZKFWva8IC_0 2024-09-12T01:02:37.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.846+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9676374567862830185', time=2024-09-12T02:49:09.043902+0000, chain.objs.size()=1 2024-09-12T01:02:37.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.846+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.264__shadow_.2iwoVOrNVHD2C9pEAXBw8mJCPcmqdnu_0 2024-09-12T01:02:37.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.846+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10643874591706860934', time=2024-09-12T02:49:09.736236+0000, chain.objs.size()=1 2024-09-12T01:02:37.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.846+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.265__shadow_.KLFyZSNQnetcQbKVQLw_haPmG_XFcxY_0 2024-09-12T01:02:37.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2044258327309526801', time=2024-09-12T02:49:11.146705+0000, chain.objs.size()=1 2024-09-12T01:02:37.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.267__shadow_.OUmCaejnU1NfUHNNl2pQAlrsbVdcohC_0 2024-09-12T01:02:37.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5245792186866495746', time=2024-09-12T02:49:24.662566+0000, chain.objs.size()=1 2024-09-12T01:02:37.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.285__shadow_.FWO3aKYbLTxyzlpJoLh-CnFu_KpU2U5_0 2024-09-12T01:02:37.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12923037015562127935', time=2024-09-12T02:49:30.978706+0000, chain.objs.size()=1 2024-09-12T01:02:37.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.xNVrkUn_8ion48ls0lAps-d5xQIkQDc_0 2024-09-12T01:02:37.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17748845766502864554', time=2024-09-12T02:49:32.433331+0000, chain.objs.size()=1 2024-09-12T01:02:37.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.6JohAq9_-ifBJTyLJnWIpiaTa_DF12a_0 2024-09-12T01:02:37.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6645656143516119961', time=2024-09-12T02:49:32.437717+0000, chain.objs.size()=1 2024-09-12T01:02:37.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.evxj0u9hPZELuOfgUbfaQtA92nq9lPH_0 2024-09-12T01:02:37.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3768672955838179661', time=2024-09-12T02:50:15.800051+0000, chain.objs.size()=1 2024-09-12T01:02:37.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.1u69UrOMKmOUMipHGlO3kUoUPIrCmGc_0 2024-09-12T01:02:37.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16081731546082322311', time=2024-09-12T02:50:15.836873+0000, chain.objs.size()=1 2024-09-12T01:02:37.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.JiQ8i5BzWZfBWn9RxZI5nhS1d37-AwN_0 2024-09-12T01:02:37.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8803792184984301130', time=2024-09-12T02:50:15.937800+0000, chain.objs.size()=1 2024-09-12T01:02:37.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-tJm2h3xya21zqSRvgPYjZvFMmrIoOu_0 2024-09-12T01:02:37.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.854+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9487802076328253897', time=2024-09-12T02:50:16.130695+0000, chain.objs.size()=1 2024-09-12T01:02:37.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.854+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-DCQEFmhw0BGRd7PO0v9litQJScyMYW_0 2024-09-12T01:02:37.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.854+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14640750611594358947', time=2024-09-12T02:50:16.141429+0000, chain.objs.size()=1 2024-09-12T01:02:37.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.854+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.pPYMI2F1Fds-UIw7Yi5JAi5bO-vkoG5_0 2024-09-12T01:02:37.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.854+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5266916229693756924', time=2024-09-12T02:50:16.143979+0000, chain.objs.size()=1 2024-09-12T01:02:37.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.854+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.FWAuImJXtAsvwl1vS04dnXuJbG7hAs5_0 2024-09-12T01:02:37.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8572926162390616100', time=2024-09-12T02:50:16.170622+0000, chain.objs.size()=1 2024-09-12T01:02:37.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ZHy6HgeZ0OxIEArBKHuwuees_h8N5t__0 2024-09-12T01:02:37.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11011922812249078137', time=2024-09-12T02:50:16.183081+0000, chain.objs.size()=1 2024-09-12T01:02:37.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.7_7TJbmYJ2ZghZXqRO03MRqEQboLsqF_0 2024-09-12T01:02:37.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.879447456492087826', time=2024-09-12T02:50:16.185812+0000, chain.objs.size()=1 2024-09-12T01:02:37.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.MQerpNcJIdv1Wp5FOqzOfpL8kqwSf_c_0 2024-09-12T01:02:37.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1366418174702423231', time=2024-09-12T02:50:16.223541+0000, chain.objs.size()=1 2024-09-12T01:02:37.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.QO-8oufPV1hhcDU-T7u_--WyzSmR7ak_0 2024-09-12T01:02:37.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1163487323338178791', time=2024-09-12T02:50:16.227362+0000, chain.objs.size()=1 2024-09-12T01:02:37.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.PYoQIqyByd_v_cdZsnNPJ2qz5D6h0-C_0 2024-09-12T01:02:37.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5715731933688243279', time=2024-09-12T02:50:16.368016+0000, chain.objs.size()=1 2024-09-12T01:02:37.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.yXQnkVzMSt_szWtALfoGnWDkoy9MPmc_0 2024-09-12T01:02:37.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13161142809795928436', time=2024-09-12T02:50:16.408922+0000, chain.objs.size()=1 2024-09-12T01:02:37.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.skXgdkYdskDBFj9w_2K-xBi-soOuet0_0 2024-09-12T01:02:37.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1631301600913939203', time=2024-09-12T02:50:16.505343+0000, chain.objs.size()=1 2024-09-12T01:02:37.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.jUcP9NhMOmVxXYhOu0OqXLDwsJunrI7_0 2024-09-12T01:02:37.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16381181921277608731', time=2024-09-12T02:50:16.656558+0000, chain.objs.size()=1 2024-09-12T01:02:37.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.aZYzLnXT-i1uy8wXnxWq7n9QzTYGhtW_0 2024-09-12T01:02:37.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4678594599115446668', time=2024-09-12T02:50:16.686675+0000, chain.objs.size()=1 2024-09-12T01:02:37.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.c8vCObDATn1Ii6mxGpDo6lvHyRnipyV_0 2024-09-12T01:02:37.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11258163239414325980', time=2024-09-12T02:50:16.701406+0000, chain.objs.size()=1 2024-09-12T01:02:37.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.8w40EPH-MsuqXaoDxpP40RtCC5XB4J8_0 2024-09-12T01:02:37.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14064855095100505656', time=2024-09-12T02:50:16.702258+0000, chain.objs.size()=1 2024-09-12T01:02:37.857 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.THWw55ygUBUOY3kK-PI_N1sgb1vZqnB_0 2024-09-12T01:02:37.858 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11785339699480748150', time=2024-09-12T02:50:16.745177+0000, chain.objs.size()=1 2024-09-12T01:02:37.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.khtMyR5i4d7_CB1U2gYTze4TjBDGSyz_0 2024-09-12T01:02:37.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11186397770769022647', time=2024-09-12T02:50:16.790990+0000, chain.objs.size()=1 2024-09-12T01:02:37.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.nhrO13uMdQ16BJReD9I_1wGrmQ2M-eT_0 2024-09-12T01:02:37.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16714657652284869940', time=2024-09-12T02:50:16.795754+0000, chain.objs.size()=1 2024-09-12T01:02:37.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.kAVEJyzobzwJHagg0tjTTeDWE1G7GcW_0 2024-09-12T01:02:37.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1268596365794123026', time=2024-09-12T02:50:16.799593+0000, chain.objs.size()=1 2024-09-12T01:02:37.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.nIv3bq17H7lfi3vRrDbh1ynMiSB5kJt_0 2024-09-12T01:02:37.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5363149208244320596', time=2024-09-12T02:50:16.914243+0000, chain.objs.size()=1 2024-09-12T01:02:37.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.XgKFg-vplsdpe34pcfJZWD4fQQDoI9o_0 2024-09-12T01:02:37.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10354180384085190738', time=2024-09-12T02:50:16.915418+0000, chain.objs.size()=1 2024-09-12T01:02:37.859 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.8vu0PaSyKPl35yHMDTYEnb19MdZLgAO_0 2024-09-12T01:02:37.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4429288765378371362', time=2024-09-12T02:50:16.937755+0000, chain.objs.size()=1 2024-09-12T01:02:37.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.JH36Icfogav8fgn0vACi7phyjeJ2Eh3_0 2024-09-12T01:02:37.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10970848382837197471', time=2024-09-12T02:50:17.011229+0000, chain.objs.size()=1 2024-09-12T01:02:37.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.yYzqK_DVZe5i615sqH0BEIaupdIxKA9_0 2024-09-12T01:02:37.860 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1357990682839199373', time=2024-09-12T02:50:17.141758+0000, chain.objs.size()=1 2024-09-12T01:02:37.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.1McfN4h_A-w2kPgnyhTWnVlX8HmnX8n_0 2024-09-12T01:02:37.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5824823034694426632', time=2024-09-12T02:50:17.143816+0000, chain.objs.size()=1 2024-09-12T01:02:37.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.862+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.c0MfqKb6sKsphqlxB0ijBoPzfKNqR-F_0 2024-09-12T01:02:37.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.866+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9897865614950875980', time=2024-09-12T02:50:17.252931+0000, chain.objs.size()=1 2024-09-12T01:02:37.861 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.866+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.LEIHv2sQ8rTlMGg7pXzTGmeQF91ZPav_0 2024-09-12T01:02:37.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.866+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15303642204674745504', time=2024-09-12T02:50:17.256629+0000, chain.objs.size()=1 2024-09-12T01:02:37.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.866+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.78kYVjaqsdX7GAkjUPdrHS0JQEG5n1O_0 2024-09-12T01:02:37.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.866+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13960196020562012576', time=2024-09-12T02:50:17.272832+0000, chain.objs.size()=1 2024-09-12T01:02:37.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.866+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.nS94C4BhfldTToo21F4dEIxvngtjM-G_0 2024-09-12T01:02:37.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1744310331161753962', time=2024-09-12T02:50:17.273577+0000, chain.objs.size()=1 2024-09-12T01:02:37.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.uvww4822kEn01j0GBAccv347Kk7P5fq_0 2024-09-12T01:02:37.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6403587403486112042', time=2024-09-12T02:50:17.419548+0000, chain.objs.size()=1 2024-09-12T01:02:37.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.7olVX430iFybPsyLeenT4ejmknYtA3E_0 2024-09-12T01:02:37.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4359778623183930801', time=2024-09-12T02:50:17.426044+0000, chain.objs.size()=1 2024-09-12T01:02:37.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_._uLcT44DZRFAUGuUk06U1aNPIiDxj_c_0 2024-09-12T01:02:37.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2653934116126156256', time=2024-09-12T02:50:17.430080+0000, chain.objs.size()=1 2024-09-12T01:02:37.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.jzEbBaBrk3Yvr2MPAZ-_RFuuSbZuMUF_0 2024-09-12T01:02:37.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.889908764429465218', time=2024-09-12T02:50:17.458062+0000, chain.objs.size()=1 2024-09-12T01:02:37.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.5FfyEB9yc-i0BY4YIvRgaYsHYrPvWxh_0 2024-09-12T01:02:37.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.912019669614948434', time=2024-09-12T02:50:17.475031+0000, chain.objs.size()=1 2024-09-12T01:02:37.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.MSMTacFnE1ySbVVwwWYPYv8Ix-lmdjN_0 2024-09-12T01:02:37.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15719229932660475494', time=2024-09-12T02:50:17.501944+0000, chain.objs.size()=1 2024-09-12T01:02:37.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.hWgEzZTYf4jL8XZRXCthnG0zdJo6wZd_0 2024-09-12T01:02:37.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7215590789314700095', time=2024-09-12T02:50:17.670313+0000, chain.objs.size()=1 2024-09-12T01:02:37.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.UzqzB9_2XcDE-Uq2INPFfJg1L9suNrZ_0 2024-09-12T01:02:37.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6201515427748091746', time=2024-09-12T02:50:17.722434+0000, chain.objs.size()=1 2024-09-12T01:02:37.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.870+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.uleJEB1WcjO4vc8y-ZyJUO7dMaDfq5u_0 2024-09-12T01:02:37.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.874+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8357230899048019540', time=2024-09-12T02:50:39.489527+0000, chain.objs.size()=1 2024-09-12T01:02:37.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.874+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Z58uRF6sc29n83DQIp-bQXF_bJsGZdW_0 2024-09-12T01:02:37.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.874+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13414278199486056711', time=2024-09-12T02:50:39.523053+0000, chain.objs.size()=1 2024-09-12T01:02:37.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.874+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.t9izIXbybc47w_sPqYZKdRS7Tj4CTUZ_0 2024-09-12T01:02:37.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.874+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13135778881661541413', time=2024-09-12T02:50:39.595374+0000, chain.objs.size()=1 2024-09-12T01:02:37.870 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.874+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.lbX2MxICMyXlqiWP9z84wu9Id-so2CA_0 2024-09-12T01:02:37.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.878+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16859361403997957526', time=2024-09-12T02:50:39.596735+0000, chain.objs.size()=1 2024-09-12T01:02:37.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.878+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.HIO9u208OYQKeCqq7ViNUeykBZEHif-_0 2024-09-12T01:02:37.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.878+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6874225854612779908', time=2024-09-12T02:50:39.716905+0000, chain.objs.size()=1 2024-09-12T01:02:37.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.878+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.xMFfqs5jpRxPk5dPwqcsVYrmA7EaHNU_0 2024-09-12T01:02:37.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49632 2024-09-12T01:02:37.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=50, truncated=0, next_marker='' 2024-09-12T01:02:37.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7111257778360004623', time=2024-09-12T02:50:39.718098+0000, chain.objs.size()=1 2024-09-12T01:02:37.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.YKePS0blHSYF_wPxpX9PaY07PtGyxt1_0 2024-09-12T01:02:37.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6144246607224127500', time=2024-09-12T02:50:39.719465+0000, chain.objs.size()=1 2024-09-12T01:02:37.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.XwMjDiwHhyiWUafmidbxX5xw9lQZx7r_0 2024-09-12T01:02:37.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.879136169858890505', time=2024-09-12T02:50:39.800076+0000, chain.objs.size()=1 2024-09-12T01:02:37.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.nhPKwibElL3k6_EQoMzvrwHARPa-ixp_0 2024-09-12T01:02:37.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7927621498501143191', time=2024-09-12T02:50:39.838524+0000, chain.objs.size()=1 2024-09-12T01:02:37.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.1-5BKiGFaOnIc0lG10J1NIGi9GM7TJ0_0 2024-09-12T01:02:37.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2434223175113728863', time=2024-09-12T02:50:39.997705+0000, chain.objs.size()=1 2024-09-12T01:02:37.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.4436AO8y7Nl0Su5crEPk3_2VPl_g2yO_0 2024-09-12T01:02:37.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2297715268684984125', time=2024-09-12T02:50:40.073920+0000, chain.objs.size()=1 2024-09-12T01:02:37.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.oOPcqpJklliFYuJ3NpO6h8bmVWNY6d7_0 2024-09-12T01:02:37.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11133532273221677070', time=2024-09-12T02:50:40.076428+0000, chain.objs.size()=1 2024-09-12T01:02:37.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.b6EI3mJU0qfpj6t9amIXtrPIU0wJa1b_0 2024-09-12T01:02:37.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9687618689107886914', time=2024-09-12T02:50:40.148677+0000, chain.objs.size()=1 2024-09-12T01:02:37.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.qol23_Jm_XpwX0l-pTTPLZk3wpcywTh_0 2024-09-12T01:02:37.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11002807501760713397', time=2024-09-12T02:50:40.316015+0000, chain.objs.size()=1 2024-09-12T01:02:37.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.lZpaPn0gpm62kfSNGNRumQVZVs7irfC_0 2024-09-12T01:02:37.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7088352888569485564', time=2024-09-12T02:50:40.338150+0000, chain.objs.size()=1 2024-09-12T01:02:37.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.koke3h7TqtgEdeGusbYjB6bGf-46upo_0 2024-09-12T01:02:37.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15855040558577083432', time=2024-09-12T02:50:40.626101+0000, chain.objs.size()=1 2024-09-12T01:02:37.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.4jjJchW8rfzD-2X5A_Sz99bDzq8zVjT_0 2024-09-12T01:02:37.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6011489883719403497', time=2024-09-12T02:50:40.756613+0000, chain.objs.size()=1 2024-09-12T01:02:37.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.O2Xysp4C02WymOTxOl_mxO6V0GocB0c_0 2024-09-12T01:02:37.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11402840909734411881', time=2024-09-12T02:50:40.760750+0000, chain.objs.size()=1 2024-09-12T01:02:37.882 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Is5iTOf6wLoOgBYapFMt47lc-isr8q3_0 2024-09-12T01:02:37.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10482315819759801125', time=2024-09-12T02:50:40.767235+0000, chain.objs.size()=1 2024-09-12T01:02:37.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.OhBksP4u8HHnW9rGzaU6efLwcWSRmFN_0 2024-09-12T01:02:37.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5013631706834670064', time=2024-09-12T02:50:40.786580+0000, chain.objs.size()=1 2024-09-12T01:02:37.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.0Db6AOsEydBBtNF5q7gBShdtNiuikA8_0 2024-09-12T01:02:37.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18048262151060964084', time=2024-09-12T02:50:40.795063+0000, chain.objs.size()=1 2024-09-12T01:02:37.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.OrpBABD_VNOi7suA7sS5vuXCD3sBrDD_0 2024-09-12T01:02:37.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3243659561308175283', time=2024-09-12T02:50:40.824904+0000, chain.objs.size()=1 2024-09-12T01:02:37.884 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.NRldyWDq69urhksiv8MXaXRG9TKjp7Y_0 2024-09-12T01:02:37.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7997990393914282075', time=2024-09-12T02:50:40.859527+0000, chain.objs.size()=1 2024-09-12T01:02:37.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.H2xropdEPIwdYWz4TX7TPx_zdYxFtlL_0 2024-09-12T01:02:37.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8189681749749445548', time=2024-09-12T02:50:40.881234+0000, chain.objs.size()=1 2024-09-12T01:02:37.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.tfAHeju5VWsRr3wK_42flWS47B9KLjy_0 2024-09-12T01:02:37.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7855269463729574279', time=2024-09-12T02:50:40.902564+0000, chain.objs.size()=1 2024-09-12T01:02:37.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.UJwLUY3xRGbtpCzaVXL5uP7M8GZmyFZ_0 2024-09-12T01:02:37.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11113840769964183991', time=2024-09-12T02:50:41.010263+0000, chain.objs.size()=1 2024-09-12T01:02:37.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Wi9Tme6SuUyBixDPCLf-ET5ugsaFM1h_0 2024-09-12T01:02:37.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3409567217095370211', time=2024-09-12T02:50:41.040099+0000, chain.objs.size()=1 2024-09-12T01:02:37.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.mDNTdDE9BqqvY-9kgDHejLD0Kbw2raY_0 2024-09-12T01:02:37.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4041210984204833467', time=2024-09-12T02:50:41.040937+0000, chain.objs.size()=1 2024-09-12T01:02:37.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.886+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.TnV-Amt_jAjZ1tai-p9L_CYwNMlJ1C3_0 2024-09-12T01:02:37.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.890+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17076386506996158366', time=2024-09-12T02:50:41.072944+0000, chain.objs.size()=1 2024-09-12T01:02:37.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.890+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.AQOaT1KmELn6jWxM3WJKAJgitqaEW2V_0 2024-09-12T01:02:37.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17035684771992928556', time=2024-09-12T02:50:41.164165+0000, chain.objs.size()=1 2024-09-12T01:02:37.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.q-UfcehdGzXF_0mzXcjZJPAfXvZQDby_0 2024-09-12T01:02:37.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18035998785298354530', time=2024-09-12T02:50:41.300593+0000, chain.objs.size()=1 2024-09-12T01:02:37.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_._qM4bmEIB8qzBsyytTcwrkIM5Uf6hLF_0 2024-09-12T01:02:37.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15262676133840722312', time=2024-09-12T02:50:41.306931+0000, chain.objs.size()=1 2024-09-12T01:02:37.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.IZ5CGyRSP-WnQRHI-v8uMJcOigqeYwk_0 2024-09-12T01:02:37.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17239487577261172716', time=2024-09-12T02:50:41.324794+0000, chain.objs.size()=1 2024-09-12T01:02:37.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.E_bfC9FswDaEqStGwNp_DHFOP2DW9UD_0 2024-09-12T01:02:37.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18094145085244950453', time=2024-09-12T02:50:41.329345+0000, chain.objs.size()=1 2024-09-12T01:02:37.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.J8aZK0Iol2YdQxrbqJNk5-SySKFPkdl_0 2024-09-12T01:02:37.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7270315281366805029', time=2024-09-12T02:50:41.362128+0000, chain.objs.size()=1 2024-09-12T01:02:37.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.QuxICasMWjtZrlL_c7grAtVEMeeGLdH_0 2024-09-12T01:02:37.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2502140166179487843', time=2024-09-12T02:50:41.378995+0000, chain.objs.size()=1 2024-09-12T01:02:37.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.tT07TSr2BBTu-GWVtQdGhfFoKTpAGeU_0 2024-09-12T01:02:37.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8825647035100771344', time=2024-09-12T02:50:41.392745+0000, chain.objs.size()=1 2024-09-12T01:02:37.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.TJytFx7UjxLqAOx-iua3bxIkiRcslK-_0 2024-09-12T01:02:37.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.30699581990241507', time=2024-09-12T02:50:41.400584+0000, chain.objs.size()=1 2024-09-12T01:02:37.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.QN_b4g9l5Q_yJKTgOD5j9nUibxzDHQ__0 2024-09-12T01:02:37.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4459064469051160062', time=2024-09-12T02:50:41.435549+0000, chain.objs.size()=1 2024-09-12T01:02:37.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.TTPvOsHOKg8iEMADVU6VbbDjwuimhix_0 2024-09-12T01:02:37.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.898+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16959454718625567017', time=2024-09-12T02:50:41.546772+0000, chain.objs.size()=1 2024-09-12T01:02:37.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.898+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.X1huArKGe9Bx-lv7jFVxyR9tr9A2mui_0 2024-09-12T01:02:37.893 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.898+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2305045881741778755', time=2024-09-12T02:50:41.602263+0000, chain.objs.size()=1 2024-09-12T01:02:37.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.898+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.AKNH_brCJt0QTXe2j02Zgxlgsb_-E7Q_0 2024-09-12T01:02:37.894 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.898+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2238835350371086189', time=2024-09-12T02:50:41.606797+0000, chain.objs.size()=1 2024-09-12T01:02:37.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.898+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.S1mMO1iw8ILCSirom5Z2BWp3UFh7NsQ_0 2024-09-12T01:02:37.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.898+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16394850435241725175', time=2024-09-12T02:50:41.650564+0000, chain.objs.size()=1 2024-09-12T01:02:37.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.898+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.J0S9-wsL3XqCG44mlCzb2ptJzvqU2Nc_0 2024-09-12T01:02:37.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.898+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6736941066272623825', time=2024-09-12T02:52:19.582206+0000, chain.objs.size()=1 2024-09-12T01:02:37.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.898+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.458__shadow_._9zNmkiczVglbgjanKhDykPmFsgoGU2_0 2024-09-12T01:02:37.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.898+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16457261926640801901', time=2024-09-12T02:52:37.490995+0000, chain.objs.size()=1 2024-09-12T01:02:37.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.898+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.485__shadow_.qpAPuP__wzTN6Q1FMiDGK72VYpESF44_0 2024-09-12T01:02:37.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.898+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5037998849011241736', time=2024-09-12T02:52:57.208127+0000, chain.objs.size()=1 2024-09-12T01:02:37.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.898+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.512__shadow_.XrWx6u7l1ZdhdPAyNXdp20ss4JLJZQT_0 2024-09-12T01:02:37.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.898+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13229643646104895850', time=2024-09-12T02:53:02.020315+0000, chain.objs.size()=1 2024-09-12T01:02:37.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.898+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.518__multipart_mymultipart.2~qjTpajfSjBicW1HVsQQIoUuVPypw0lu.1 2024-09-12T01:02:37.896 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.902+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4572601967598048358', time=2024-09-12T02:54:41.732796+0000, chain.objs.size()=1 2024-09-12T01:02:37.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.902+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.565__shadow_.gxGSUIFG2AlOT64IyjLK5ifUaMivPG2_0 2024-09-12T01:02:37.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.902+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4196916335641819586', time=2024-09-12T02:54:50.355387+0000, chain.objs.size()=1 2024-09-12T01:02:37.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.902+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:ruXgyBtzfpoWhaDKiWM7X-gSQD6iIiy_.duglFQAg7ecDLQxBOnzrj5xHSXp0fSI_0 2024-09-12T01:02:37.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.902+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3047729054611024085', time=2024-09-12T02:54:53.856111+0000, chain.objs.size()=1 2024-09-12T01:02:37.897 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.902+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.570__shadow:kJk0cswE03FEqGYgrn48hURnj1LKILb_.A1vYxXNE4e4CD2afFOhUZo9wS1cvCsq_0 2024-09-12T01:02:37.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.902+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8496420468750093393', time=2024-09-12T02:54:58.979862+0000, chain.objs.size()=1 2024-09-12T01:02:37.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.902+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.574__shadow:D5k9vFsvpu7HqxiXexnyrXo6tMeetDt_.2e7u1mp8LsiYm3f6Ez2Hc43QgD-6pgv_0 2024-09-12T01:02:37.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.902+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10432574516609167079', time=2024-09-12T02:55:13.790718+0000, chain.objs.size()=1 2024-09-12T01:02:37.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.902+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:WZhTfWtd0BgKpQchLi5p8MjKtjSEvdM_.IBksahagdY6ew8_HUYqbIqyqQgqQ4BY_0 2024-09-12T01:02:37.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.902+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3137245233716806370', time=2024-09-12T02:55:32.183516+0000, chain.objs.size()=1 2024-09-12T01:02:37.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.902+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.583__shadow:sayNKEjFHq6LQcXBd3AiLrNZxFvCM3h_.h619lWSYJIsfPcPA_UHLSc8i7IPdOls_0 2024-09-12T01:02:37.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.902+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14720883858705306826', time=2024-09-12T02:57:06.777811+0000, chain.objs.size()=1 2024-09-12T01:02:37.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.902+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.617__shadow_.t2zfTskQrd-fEB4Ph1bMn2gD4N-iEec_0 2024-09-12T01:02:37.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.902+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12369905955214170221', time=2024-09-12T02:58:26.584664+0000, chain.objs.size()=1 2024-09-12T01:02:37.899 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.902+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.637__shadow_.-A2o1uVXYLYFTQzxjirOqUBo-WOrE-D_0 2024-09-12T01:02:37.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.910+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:37.908 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:02:37.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:37.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:37.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46993' 2024-09-12T01:02:37.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2644430344280814734', time=2024-09-12T02:46:03.732741+0000, chain.objs.size()=3 2024-09-12T01:02:37.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.159__multipart_mymultipart-LUKEWARM.2~19ibeK8QSRz0frnIzfHyZfCUHyykKwk.1 2024-09-12T01:02:37.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.159__multipart_mymultipart-LUKEWARM.2~19ibeK8QSRz0frnIzfHyZfCUHyykKwk.2 2024-09-12T01:02:37.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.159__multipart_mymultipart-LUKEWARM.2~19ibeK8QSRz0frnIzfHyZfCUHyykKwk.3 2024-09-12T01:02:37.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3894753491279205766', time=2024-09-12T02:48:22.791238+0000, chain.objs.size()=1 2024-09-12T01:02:37.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.235__shadow_.rzM45S-H2wjvGmlbf7EJMdIJbYU1ROQ_0 2024-09-12T01:02:37.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16240976120001100806', time=2024-09-12T02:48:35.760776+0000, chain.objs.size()=1 2024-09-12T01:02:37.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.250__shadow_.OmCZRUPvtEJk1z9vdfUznnhFbWnUBLY_0 2024-09-12T01:02:37.912 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16950110639208928287', time=2024-09-12T02:48:37.229715+0000, chain.objs.size()=1 2024-09-12T01:02:37.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.252__shadow_.ZMRQHo4LFPpdahHfI3dBVN5lQYjNdGs_0 2024-09-12T01:02:37.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4118191462278042197', time=2024-09-12T02:48:41.631580+0000, chain.objs.size()=1 2024-09-12T01:02:37.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.258__shadow_._F7DlSOqzcW2RYor1L1V_CWPXbz0aDn_0 2024-09-12T01:02:37.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6220806091455996951', time=2024-09-12T02:49:05.403398+0000, chain.objs.size()=1 2024-09-12T01:02:37.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.d4pWuPvD5bLX-BEwHtpg4efjKicsEI6_0 2024-09-12T01:02:37.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15281299186902766171', time=2024-09-12T02:49:05.466863+0000, chain.objs.size()=1 2024-09-12T01:02:37.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Nd46b0_aBZ2cWOWwQooylnP9fflfiyA_0 2024-09-12T01:02:37.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6389472503635316853', time=2024-09-12T02:49:05.540011+0000, chain.objs.size()=1 2024-09-12T01:02:37.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.FuAKLgdEkoU_v-Bd9SUYqAiDhXI6wKp_0 2024-09-12T01:02:37.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5150465889449757257', time=2024-09-12T02:49:05.561261+0000, chain.objs.size()=1 2024-09-12T01:02:37.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.rJVCkCPOSwU4pYx2UIQZCBBdwN3QG0f_0 2024-09-12T01:02:37.913 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8548408806852357984', time=2024-09-12T02:49:05.708013+0000, chain.objs.size()=1 2024-09-12T01:02:37.914 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.914+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.pfof-F2Ou3S0fxytagBT89FAL4XQkVj_0 2024-09-12T01:02:37.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.918+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14054346984538255582', time=2024-09-12T02:49:05.743270+0000, chain.objs.size()=1 2024-09-12T01:02:37.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.918+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.rhz38uQVNLuqFLUAVSyCqktEe1jrHib_0 2024-09-12T01:02:37.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.918+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3783465931104560471', time=2024-09-12T02:49:05.818611+0000, chain.objs.size()=1 2024-09-12T01:02:37.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.918+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.DQ3xp2x4b5W5wxonhhQtC93VLV6yKp2_0 2024-09-12T01:02:37.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.918+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6983598205163307665', time=2024-09-12T02:49:05.822423+0000, chain.objs.size()=1 2024-09-12T01:02:37.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.918+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.G5W68iJqJLWc-o51MC3TdBrjFI533pi_0 2024-09-12T01:02:37.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.918+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1535934468776070113', time=2024-09-12T02:49:05.850349+0000, chain.objs.size()=1 2024-09-12T01:02:37.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.918+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.CSEqBy1JG5g1kNGEy_e2o61z8oK0qfR_0 2024-09-12T01:02:37.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4904935554784332006', time=2024-09-12T02:49:05.857614+0000, chain.objs.size()=1 2024-09-12T01:02:37.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.S-n5SIZ2dQHvqAOf1dUu2xaEyYmJS-L_0 2024-09-12T01:02:37.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1234257846433554994', time=2024-09-12T02:49:05.989498+0000, chain.objs.size()=1 2024-09-12T01:02:37.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.JhkbUkdUfZogTyOcAbVDXFanCzUq5io_0 2024-09-12T01:02:37.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14760355788919050808', time=2024-09-12T02:49:06.007931+0000, chain.objs.size()=1 2024-09-12T01:02:37.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Jf_-YNko72bxlqfNRHFJ7GaDjMdWHC9_0 2024-09-12T01:02:37.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.49610142412949812', time=2024-09-12T02:49:06.008985+0000, chain.objs.size()=1 2024-09-12T01:02:37.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.VMqGrehZQrEwVrSz3V2-ZcPj9RxfGtm_0 2024-09-12T01:02:37.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4161050490336472135', time=2024-09-12T02:49:06.040063+0000, chain.objs.size()=1 2024-09-12T01:02:37.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ErwOqF8C6sC0JUXJya0tmYbzWh1xsIh_0 2024-09-12T01:02:37.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10407617758855686568', time=2024-09-12T02:49:06.056172+0000, chain.objs.size()=1 2024-09-12T01:02:37.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Wx2uBdYiG_LCYUwrdRjUz1vDCD-AXzM_0 2024-09-12T01:02:37.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6322770495310900289', time=2024-09-12T02:49:06.070652+0000, chain.objs.size()=1 2024-09-12T01:02:37.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.yLegarNqx9B2TM7dWn9h84DgcBqbdsU_0 2024-09-12T01:02:37.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.341462083327429807', time=2024-09-12T02:49:06.077406+0000, chain.objs.size()=1 2024-09-12T01:02:37.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.AKpDOSudjDQxxoVgFWKo2DdHzhVItPA_0 2024-09-12T01:02:37.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.408754194711341235', time=2024-09-12T02:49:06.088550+0000, chain.objs.size()=1 2024-09-12T01:02:37.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.NzyMxprXRbJiGj1LaguxZO2izX6G9s-_0 2024-09-12T01:02:37.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8815478588242687727', time=2024-09-12T02:49:06.327612+0000, chain.objs.size()=1 2024-09-12T01:02:37.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.1sUc4bohHfyBTbMxN9XyYY5niwg3eju_0 2024-09-12T01:02:37.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9328353386786418658', time=2024-09-12T02:49:06.360167+0000, chain.objs.size()=1 2024-09-12T01:02:37.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.8-DuDFmOoq9KKr57tSO9NuFORl62Xtt_0 2024-09-12T01:02:37.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3851380824062393676', time=2024-09-12T02:49:06.378468+0000, chain.objs.size()=1 2024-09-12T01:02:37.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ZACiPoaPMihIsVsFwBZh5dkq7EMD3Ka_0 2024-09-12T01:02:37.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12898166170711770142', time=2024-09-12T02:49:06.486764+0000, chain.objs.size()=1 2024-09-12T01:02:37.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.VSq0EXisAy4fb6s7HnuEN4MipPLisaR_0 2024-09-12T01:02:37.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3715273907508268522', time=2024-09-12T02:49:06.511218+0000, chain.objs.size()=1 2024-09-12T01:02:37.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.JX-Q6Dd287n-_q9JGY6kEcK_BeQYmzT_0 2024-09-12T01:02:37.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5639598854998854667', time=2024-09-12T02:49:06.553891+0000, chain.objs.size()=1 2024-09-12T01:02:37.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.n4p1D9UdmCSolUvLVzTHuCaUC5nOPuQ_0 2024-09-12T01:02:37.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3206366792146744328', time=2024-09-12T02:49:06.577473+0000, chain.objs.size()=1 2024-09-12T01:02:37.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.5-8Xkpjufc1u24lr7s7jLDbpmiuUklo_0 2024-09-12T01:02:37.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13267478792275771003', time=2024-09-12T02:49:06.807505+0000, chain.objs.size()=1 2024-09-12T01:02:37.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.k51osYI6-lQE3sBDFN4Bzn4B1J3RvuF_0 2024-09-12T01:02:37.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14180425694603879831', time=2024-09-12T02:49:06.814820+0000, chain.objs.size()=1 2024-09-12T01:02:37.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ulUTFOFwluXw2NZpa83i1y3l5T_Uu7o_0 2024-09-12T01:02:37.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4880863307369983100', time=2024-09-12T02:49:06.889711+0000, chain.objs.size()=1 2024-09-12T01:02:37.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.926+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_._bSN2iRxldLmjVEWLkmzKXzdEkljDHs_0 2024-09-12T01:02:37.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.930+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18247307699507912933', time=2024-09-12T02:49:06.910918+0000, chain.objs.size()=1 2024-09-12T01:02:37.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.930+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0hl_o5e3JUvZv8WWtTxnr9guzImmco0_0 2024-09-12T01:02:37.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.930+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5081066249038643070', time=2024-09-12T02:49:07.061376+0000, chain.objs.size()=1 2024-09-12T01:02:37.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.930+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.zwenN3ZexsYcrXQpzuwxPU9iAlWwgiq_0 2024-09-12T01:02:37.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.930+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16424733713654706004', time=2024-09-12T02:49:07.097685+0000, chain.objs.size()=1 2024-09-12T01:02:37.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.930+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.5_kOtN2xKM2U8qN4dlQdUlxtxD6nXPM_0 2024-09-12T01:02:37.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.618964250119035938', time=2024-09-12T02:49:07.114157+0000, chain.objs.size()=1 2024-09-12T01:02:37.928 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Nu40Uivkj0jCm5kpbto7bbIeNjEdV7T_0 2024-09-12T01:02:37.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.569434194440496661', time=2024-09-12T02:49:07.394048+0000, chain.objs.size()=1 2024-09-12T01:02:37.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.15ZUwIS91zT6nEDsb3QnMOCxwo_Q93l_0 2024-09-12T01:02:37.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1055980938078880829', time=2024-09-12T02:49:11.147462+0000, chain.objs.size()=1 2024-09-12T01:02:37.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.267__shadow_.ELxO3_nxZaPa3icJMAu-xrRJ8VXLVPE_0 2024-09-12T01:02:37.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11032394725761226840', time=2024-09-12T02:49:17.863872+0000, chain.objs.size()=1 2024-09-12T01:02:37.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.276__shadow_.oS2bBrn7VSxYQ73QiJ5w0qw64UwR3wb_0 2024-09-12T01:02:37.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1180613824136934721', time=2024-09-12T02:49:18.582974+0000, chain.objs.size()=1 2024-09-12T01:02:37.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.277__shadow_.QHkVVxNO13sr5UwkmdrpZucwBl9DKcd_0 2024-09-12T01:02:37.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9846024384924659601', time=2024-09-12T02:49:20.879451+0000, chain.objs.size()=1 2024-09-12T01:02:37.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.280__shadow_.13QKsZH-CmWoJxt15AOk9GpkvUZFjzF_0 2024-09-12T01:02:37.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15558811000266423984', time=2024-09-12T02:49:27.700621+0000, chain.objs.size()=1 2024-09-12T01:02:37.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.289__shadow_.zMOfWYdLTRKJcOHoTlwEnGtChpic52B_0 2024-09-12T01:02:37.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12745818017470679666', time=2024-09-12T02:49:28.407285+0000, chain.objs.size()=1 2024-09-12T01:02:37.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.290__shadow_.liAGaMA9_5CeILnccspwIcbwOSytDBM_0 2024-09-12T01:02:37.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10990480840569735315', time=2024-09-12T02:49:30.930567+0000, chain.objs.size()=1 2024-09-12T01:02:37.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.7nxiX9RUoWDPSCHvABGAcrefHM5D37T_0 2024-09-12T01:02:37.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3974878453333405971', time=2024-09-12T02:49:30.941408+0000, chain.objs.size()=1 2024-09-12T01:02:37.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.IzZ6ktPav31EMcfqlZagQJ3DtqXniiv_0 2024-09-12T01:02:37.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8492292635721604182', time=2024-09-12T02:49:32.474105+0000, chain.objs.size()=1 2024-09-12T01:02:37.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.BtB1-KlY907dhkivBmhWW9bG14BsvBf_0 2024-09-12T01:02:37.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12769951859493021518', time=2024-09-12T02:49:35.393444+0000, chain.objs.size()=1 2024-09-12T01:02:37.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.297__shadow_.3ApXUeeh3h6g38JCedIUlpj09MqL4hb_0 2024-09-12T01:02:37.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6269239169543069356', time=2024-09-12T02:49:39.203081+0000, chain.objs.size()=1 2024-09-12T01:02:37.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.302__shadow_.vB404K6OMccYCOepwlVtfvaI-kbF1yg_0 2024-09-12T01:02:37.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.938+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7434037722297909923', time=2024-09-12T02:49:52.298946+0000, chain.objs.size()=1 2024-09-12T01:02:37.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.938+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.319__shadow:K5lgTcdzs9wlv3BqSbGIkgwHQ-9oX74_.1fdz6xpp9XmCwbRkCumdKj2II4_Lptp_0 2024-09-12T01:02:37.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.938+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14562467472631279105', time=2024-09-12T02:50:15.850110+0000, chain.objs.size()=1 2024-09-12T01:02:37.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.938+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.l3gnmNDtaNly1I-yAY9vWr8eo0CwM63_0 2024-09-12T01:02:37.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.938+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11455943927274377423', time=2024-09-12T02:50:15.885695+0000, chain.objs.size()=1 2024-09-12T01:02:37.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.938+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.wzACTDbb0FucrHR0S5ZSXrWwR1eRbmw_0 2024-09-12T01:02:37.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.938+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3107334211745456428', time=2024-09-12T02:50:15.893074+0000, chain.objs.size()=1 2024-09-12T01:02:37.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.938+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xXV1aewoKEEW3rLlpUDpgkTIYJC6izW_0 2024-09-12T01:02:37.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.938+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15957725526144034996', time=2024-09-12T02:50:15.925234+0000, chain.objs.size()=1 2024-09-12T01:02:37.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.938+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.mxw7LDVsT0GFhwzuDQX2AmmwqUcW_BJ_0 2024-09-12T01:02:37.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.938+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3755514896289273570', time=2024-09-12T02:50:15.940992+0000, chain.objs.size()=1 2024-09-12T01:02:37.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.938+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.o7w0nUzwf9pPgOQaPbocVluyG-Vr6od_0 2024-09-12T01:02:37.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.938+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13129202706988940631', time=2024-09-12T02:50:15.966993+0000, chain.objs.size()=1 2024-09-12T01:02:37.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.938+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.A83JKz5PrYIAx9gfhSq6UZ9pA0WJF1n_0 2024-09-12T01:02:37.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.942+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6604494216345782263', time=2024-09-12T02:50:15.968518+0000, chain.objs.size()=1 2024-09-12T01:02:37.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.942+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.RQNcBXvq0P7zsezAvgIrom71l-Z3Kp0_0 2024-09-12T01:02:37.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.942+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4461076030578119157', time=2024-09-12T02:50:16.089442+0000, chain.objs.size()=1 2024-09-12T01:02:37.937 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.942+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.1Svu381V-CPrGFVdSnPARe8sTPbO6MT_0 2024-09-12T01:02:37.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.942+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15789592793597341448', time=2024-09-12T02:50:16.106566+0000, chain.objs.size()=1 2024-09-12T01:02:37.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.942+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.esktJLzGWgurWC6qK3GpdufkSatDtRM_0 2024-09-12T01:02:37.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.942+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13194671951268230327', time=2024-09-12T02:50:16.199630+0000, chain.objs.size()=1 2024-09-12T01:02:37.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.942+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.VW_KVVha9s-VFzVcszmdrg_rnXkxD0W_0 2024-09-12T01:02:37.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.942+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.758806374341311960', time=2024-09-12T02:50:16.205898+0000, chain.objs.size()=1 2024-09-12T01:02:37.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.942+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.G8rO3aWff8fkp9wlR0blwuyUHD8AEVn_0 2024-09-12T01:02:37.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.946+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12448700235792588570', time=2024-09-12T02:50:16.220999+0000, chain.objs.size()=1 2024-09-12T01:02:37.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.946+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.GMASPEVg417qf1_vjMh6Vc8_cs4oV54_0 2024-09-12T01:02:37.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.946+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2734771951693265688', time=2024-09-12T02:50:16.233235+0000, chain.objs.size()=1 2024-09-12T01:02:37.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.946+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ggEfJeSdTRJq6w1vgWPtZ-vxTTGSVxM_0 2024-09-12T01:02:37.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.946+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.484054494200027365', time=2024-09-12T02:50:16.391715+0000, chain.objs.size()=1 2024-09-12T01:02:37.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.946+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.i2_6UmGqqveZgdjsoTNsa-RUnlzEKP6_0 2024-09-12T01:02:37.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.946+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16216897432232893353', time=2024-09-12T02:50:16.455040+0000, chain.objs.size()=1 2024-09-12T01:02:37.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.946+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.2Za9tTZDCEuct1DQJP9VdfHv3Odj89K_0 2024-09-12T01:02:37.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.946+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5066094859434627020', time=2024-09-12T02:50:16.455787+0000, chain.objs.size()=1 2024-09-12T01:02:37.941 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.946+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.zjxtVnFmv2JLNmbhKOSvW0QwDhpyQ9b_0 2024-09-12T01:02:37.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.946+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.927901386808558861', time=2024-09-12T02:50:16.478313+0000, chain.objs.size()=1 2024-09-12T01:02:37.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.946+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.FUIh_GQe_r9S57Xm4N_wS_jA2WzmYkD_0 2024-09-12T01:02:37.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.946+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17533913125668688225', time=2024-09-12T02:50:16.633478+0000, chain.objs.size()=1 2024-09-12T01:02:37.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.946+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Tk6kfw4e-Sz4Ke-LJWjU__qt7eroFOe_0 2024-09-12T01:02:37.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.950+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8056495745199150945', time=2024-09-12T02:50:16.702791+0000, chain.objs.size()=1 2024-09-12T01:02:37.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.950+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.KYdyPnF34bheZvarJJ-Qnmz0AU58z7X_0 2024-09-12T01:02:37.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.950+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6004240905744846015', time=2024-09-12T02:50:16.756167+0000, chain.objs.size()=1 2024-09-12T01:02:37.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.950+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.eBuV_kkM29LgWLJbvwkv50CWsFXox1q_0 2024-09-12T01:02:37.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.950+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2424149095868051425', time=2024-09-12T02:50:16.769897+0000, chain.objs.size()=1 2024-09-12T01:02:37.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.950+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.D9kGCQg_Bzn1mkcPhk7n1CcS5vXJe1r_0 2024-09-12T01:02:37.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.950+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17563357628936595741', time=2024-09-12T02:50:16.919791+0000, chain.objs.size()=1 2024-09-12T01:02:37.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.950+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Jf1Kcael1BqgxbRF22rWxb23GhlX2zL_0 2024-09-12T01:02:37.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.950+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7528031098395910883', time=2024-09-12T02:50:16.961109+0000, chain.objs.size()=1 2024-09-12T01:02:37.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.950+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.52tEQJc02kQXnxmNOvHR13AvMLUvWYS_0 2024-09-12T01:02:37.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.950+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10077069193373575046', time=2024-09-12T02:50:16.984649+0000, chain.objs.size()=1 2024-09-12T01:02:37.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.950+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.SYSD4ddzSLnasycBA6fKOEvHPaG97Jb_0 2024-09-12T01:02:37.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.954+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10894560385612613086', time=2024-09-12T02:50:17.006244+0000, chain.objs.size()=1 2024-09-12T01:02:37.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.954+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.tmqAy3fH9clC1bT8lg1Jb50w71MJVJE_0 2024-09-12T01:02:37.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.954+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.989991227737268894', time=2024-09-12T02:50:17.034999+0000, chain.objs.size()=1 2024-09-12T01:02:37.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.954+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.rkpzz1xCt-Rrs9NxXVUHAFDrusJJTWM_0 2024-09-12T01:02:37.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.954+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15655359515353547852', time=2024-09-12T02:50:17.157172+0000, chain.objs.size()=1 2024-09-12T01:02:37.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.954+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.pvFTIQ_RiHFrTTKB-QDoiPr6IfDjVEF_0 2024-09-12T01:02:37.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.954+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7683862108674403844', time=2024-09-12T02:50:17.227937+0000, chain.objs.size()=1 2024-09-12T01:02:37.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.954+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.kNtpQq-ZHp4u7JkNbaTQWEQoW749cTr_0 2024-09-12T01:02:37.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.954+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.965374556745560887', time=2024-09-12T02:50:17.278378+0000, chain.objs.size()=1 2024-09-12T01:02:37.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.954+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-Kt4RyhTBlAGvYQ9Y4tZYfUqj5oDw13_0 2024-09-12T01:02:37.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.954+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13816362446769999660', time=2024-09-12T02:50:17.400153+0000, chain.objs.size()=1 2024-09-12T01:02:37.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.954+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.wDxeiS9e6_VIwIlllMf1nnY4fZupLjy_0 2024-09-12T01:02:37.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.954+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14515268979669700906', time=2024-09-12T02:50:17.428509+0000, chain.objs.size()=1 2024-09-12T01:02:37.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.954+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.HWt2VtfHvjCXVhIu5QUxXwj7EexnR3A_0 2024-09-12T01:02:37.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.954+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6572204801115075866', time=2024-09-12T02:50:17.444214+0000, chain.objs.size()=1 2024-09-12T01:02:37.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.954+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.3OE5gDYggVkRZc8aeriIYe7aJoSEbys_0 2024-09-12T01:02:37.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12104595880792639027', time=2024-09-12T02:50:17.447140+0000, chain.objs.size()=1 2024-09-12T01:02:37.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.CMJGgbSWyzrm4K7Gelws8ic87fEB_3K_0 2024-09-12T01:02:37.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5621108405794782652', time=2024-09-12T02:50:17.672935+0000, chain.objs.size()=1 2024-09-12T01:02:37.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.HB7QAKsaIPBrL6Tf0Ag2d1NQ-1HEH9S_0 2024-09-12T01:02:37.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1524057114072403662', time=2024-09-12T02:50:17.736756+0000, chain.objs.size()=1 2024-09-12T01:02:37.953 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.i0SaaTFdeyeAFyzIgdiPYj1HmSxIco0_0 2024-09-12T01:02:37.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2808398869436362963', time=2024-09-12T02:50:17.751242+0000, chain.objs.size()=1 2024-09-12T01:02:37.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-0pjwcKfabA_kgJrQ-1ZAFlxNmCkj1Z_0 2024-09-12T01:02:37.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15310099205957190698', time=2024-09-12T02:50:17.763155+0000, chain.objs.size()=1 2024-09-12T01:02:37.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Yzb83B4xZkCSFb_XutZjxZPsEGVrQKS_0 2024-09-12T01:02:37.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18435429961129982800', time=2024-09-12T02:50:39.440642+0000, chain.objs.size()=1 2024-09-12T01:02:37.954 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.vhszbyeb_zH-PPDa4w6_B2mru0YWPry_0 2024-09-12T01:02:37.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13961406332489886523', time=2024-09-12T02:50:39.444931+0000, chain.objs.size()=1 2024-09-12T01:02:37.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ggHcR7jQuirga1HG2uUshYLQihKrHxJ_0 2024-09-12T01:02:37.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14904694336705084408', time=2024-09-12T02:50:39.521285+0000, chain.objs.size()=1 2024-09-12T01:02:37.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ts2MrMcCihF-GBZc5cqdnCsniNzxofb_0 2024-09-12T01:02:37.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15604055697315745141', time=2024-09-12T02:50:39.583253+0000, chain.objs.size()=1 2024-09-12T01:02:37.955 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.OwLD6B0Pu9lf0RhlA_vEkxEgfqvsn9e_0 2024-09-12T01:02:37.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10258319691918175046', time=2024-09-12T02:50:39.760218+0000, chain.objs.size()=1 2024-09-12T01:02:37.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.jK5Vxi9AKRcyWD0w16Aigzl1rQUQZmw_0 2024-09-12T01:02:37.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3698010771993173661', time=2024-09-12T02:50:39.767877+0000, chain.objs.size()=1 2024-09-12T01:02:37.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.jxkn6ir_RjDzloPNB6RpjsW6ovSSP_w_0 2024-09-12T01:02:37.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14118833852587752751', time=2024-09-12T02:50:39.769773+0000, chain.objs.size()=1 2024-09-12T01:02:37.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.sP75GIj8m8e-KufJHJyo1xKUbgQvePh_0 2024-09-12T01:02:37.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15270988755904732006', time=2024-09-12T02:50:39.793017+0000, chain.objs.size()=1 2024-09-12T01:02:37.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.giYa-SfsOlQOlNrarbymW_fPVDSp9O1_0 2024-09-12T01:02:37.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.310401783538580631', time=2024-09-12T02:50:40.016962+0000, chain.objs.size()=1 2024-09-12T01:02:37.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.9weSyq4-65IzYLwRcVHtoc9Z9NbDg4y_0 2024-09-12T01:02:37.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6445885708438727803', time=2024-09-12T02:50:40.065764+0000, chain.objs.size()=1 2024-09-12T01:02:37.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.R2NaiIP4YPQwl5uEuoOQ6L5qR1Z1a7o_0 2024-09-12T01:02:37.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17662902358130951411', time=2024-09-12T02:50:40.112813+0000, chain.objs.size()=1 2024-09-12T01:02:37.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.J3MHTa_QNjyp5OOcP08_SyiUftWnPtS_0 2024-09-12T01:02:37.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12753826115380418536', time=2024-09-12T02:50:40.145664+0000, chain.objs.size()=1 2024-09-12T01:02:37.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.3v6SuJznGJ98g78j6Ezvso-2KUm_ZnT_0 2024-09-12T01:02:37.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.966+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8581041328230456997', time=2024-09-12T02:50:40.146324+0000, chain.objs.size()=1 2024-09-12T01:02:37.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.966+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.qIamlWdUUdKQ2M7UDqHaoTHUyljxu-n_0 2024-09-12T01:02:37.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46993 2024-09-12T01:02:37.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=52, truncated=0, next_marker='' 2024-09-12T01:02:37.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8160157080289627542', time=2024-09-12T02:50:40.271144+0000, chain.objs.size()=1 2024-09-12T01:02:37.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.JOmCVjTMAVKZL3oswZlbl6-rT4ZiEh7_0 2024-09-12T01:02:37.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6802166762525521985', time=2024-09-12T02:50:40.323736+0000, chain.objs.size()=1 2024-09-12T01:02:37.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.krG1vTUBTrLJ-RT4J-rOiB-WZ1tUeWL_0 2024-09-12T01:02:37.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4684378049765777518', time=2024-09-12T02:50:40.800565+0000, chain.objs.size()=1 2024-09-12T01:02:37.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.GOt8PgAzyjNwHDMOnycUUJC5bRvE06S_0 2024-09-12T01:02:37.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18198629778451659027', time=2024-09-12T02:50:40.803859+0000, chain.objs.size()=1 2024-09-12T01:02:37.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.kTJwKGDZwlU_eolvZ_Iw--ESmRPSHY0_0 2024-09-12T01:02:37.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4431429595695098792', time=2024-09-12T02:50:40.806403+0000, chain.objs.size()=1 2024-09-12T01:02:37.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.cAk6xbvc7MuomKm2t1P6dkiBHAbz8Zt_0 2024-09-12T01:02:37.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5389787321412571951', time=2024-09-12T02:50:40.858822+0000, chain.objs.size()=1 2024-09-12T01:02:37.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.TAVEXe70VY9PT7gqJ9kf8I6M5BruvGp_0 2024-09-12T01:02:37.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1485958622068460766', time=2024-09-12T02:50:40.860713+0000, chain.objs.size()=1 2024-09-12T01:02:37.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.JpNydkwxBsblknjbCh7KtK__1WntiJe_0 2024-09-12T01:02:37.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7514179035420559270', time=2024-09-12T02:50:40.881261+0000, chain.objs.size()=1 2024-09-12T01:02:37.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ZRMEWCvRnjbG1AaBywdwSIB_PRIOVHe_0 2024-09-12T01:02:37.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5691515419340962286', time=2024-09-12T02:50:40.894246+0000, chain.objs.size()=1 2024-09-12T01:02:37.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.-vnOG_gSf18hyMcnmUDM8M2KEiMgu81_0 2024-09-12T01:02:37.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12779562944083499903', time=2024-09-12T02:50:40.898362+0000, chain.objs.size()=1 2024-09-12T01:02:37.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.88B5ksFCxooX0RHWJIf6kmjZdL40p5W_0 2024-09-12T01:02:37.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5422937036062302831', time=2024-09-12T02:50:41.059082+0000, chain.objs.size()=1 2024-09-12T01:02:37.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.BDZXyvGWoM5BC9ADvWjgvCT7LsDkigq_0 2024-09-12T01:02:37.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13361015654874940064', time=2024-09-12T02:50:41.063994+0000, chain.objs.size()=1 2024-09-12T01:02:37.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ZcGnE13DSX7Bz3EwJ6zpQ8glSp-g-AX_0 2024-09-12T01:02:37.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.974+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12782895003639075922', time=2024-09-12T02:50:41.090497+0000, chain.objs.size()=1 2024-09-12T01:02:37.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.974+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.1ecjwfYCfv6RPEgilYUex7f6qnPAaSM_0 2024-09-12T01:02:37.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.974+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3755874338472628963', time=2024-09-12T02:50:41.100947+0000, chain.objs.size()=1 2024-09-12T01:02:37.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.974+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.l5iv18mEeTrwSy7JekX6rvV_bEnLmnL_0 2024-09-12T01:02:37.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.974+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11615467951132103902', time=2024-09-12T02:50:41.152080+0000, chain.objs.size()=1 2024-09-12T01:02:37.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.974+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.F_phwNVAmP4Uq4MKNTuwSNZSNeLT1f9_0 2024-09-12T01:02:37.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.992223492180800511', time=2024-09-12T02:50:41.314766+0000, chain.objs.size()=1 2024-09-12T01:02:37.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.MfRM0R8ie7ohqPkg-ocLtk2LBBShC0Y_0 2024-09-12T01:02:37.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3477434010338057122', time=2024-09-12T02:50:41.365513+0000, chain.objs.size()=1 2024-09-12T01:02:37.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Ccp4lg0jtQXrCHetEK03wflj2CYWcyx_0 2024-09-12T01:02:37.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3545955986641483868', time=2024-09-12T02:50:41.373785+0000, chain.objs.size()=1 2024-09-12T01:02:37.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.wfx4o_ptr4jlZC913vQ-haseknzCvk__0 2024-09-12T01:02:37.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8689889325742825779', time=2024-09-12T02:50:41.407576+0000, chain.objs.size()=1 2024-09-12T01:02:37.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.jNpv_nd7bcHXCif3zJRm2hSHB8W87rG_0 2024-09-12T01:02:37.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4325637497770018429', time=2024-09-12T02:50:41.562891+0000, chain.objs.size()=1 2024-09-12T01:02:37.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.5VbA9UebymLzPEWtBfJSlinTAlBy5BY_0 2024-09-12T01:02:37.973 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4265681522814066747', time=2024-09-12T02:50:41.576096+0000, chain.objs.size()=1 2024-09-12T01:02:37.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.XMcSUHEAcYzXp_PyDzzwK1VWSGM99c-_0 2024-09-12T01:02:37.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10973206765687332872', time=2024-09-12T02:50:41.578517+0000, chain.objs.size()=1 2024-09-12T01:02:37.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.yabr05BWUTMvauiTQU_aADjL3mLkyfY_0 2024-09-12T01:02:37.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10698809044878272484', time=2024-09-12T02:50:41.585539+0000, chain.objs.size()=1 2024-09-12T01:02:37.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.lGzMxhU47tfyqwHmWrnV-Db0UUWBqyZ_0 2024-09-12T01:02:37.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.982+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11582330210944915756', time=2024-09-12T02:50:41.587216+0000, chain.objs.size()=1 2024-09-12T01:02:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.982+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.GU_63nRv8wAgXtueA33JR2RXvWQkClx_0 2024-09-12T01:02:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.982+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7175183873911177196', time=2024-09-12T02:50:41.633659+0000, chain.objs.size()=1 2024-09-12T01:02:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.982+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Ul8GKq1ZjjsGYeELVWmzk_tMMZZCnV1_0 2024-09-12T01:02:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.982+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11936403741940897334', time=2024-09-12T02:50:43.556849+0000, chain.objs.size()=1 2024-09-12T01:02:37.978 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.982+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.327__shadow_.NDIz1lfwZQu_-kAjLZZbNirE-blc9of_0 2024-09-12T01:02:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.982+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.56326654092670497', time=2024-09-12T02:50:45.655161+0000, chain.objs.size()=1 2024-09-12T01:02:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.982+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.330__shadow_.mZXrLdFHpaUterMVjQbAgQp2fbm_Z18_0 2024-09-12T01:02:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.982+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1333250545603913425', time=2024-09-12T02:51:09.972853+0000, chain.objs.size()=1 2024-09-12T01:02:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.982+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.369__shadow_.BABKi7CrksvTh9MLpafRpazXx3fSUDd_0 2024-09-12T01:02:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.982+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18385480837918010585', time=2024-09-12T02:52:10.308692+0000, chain.objs.size()=1 2024-09-12T01:02:37.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.982+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.447__shadow_.rlS8cB-XdigBWjSjBsDgtTmPfGucYKx_0 2024-09-12T01:02:37.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.986+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11256978094044260740', time=2024-09-12T02:52:25.460716+0000, chain.objs.size()=1 2024-09-12T01:02:37.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.986+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.464__shadow_.EceyZcF2xdV-Q072n3TE9ZAO3lGfchm_0 2024-09-12T01:02:37.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.986+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11082308309988202358', time=2024-09-12T02:52:36.205283+0000, chain.objs.size()=1 2024-09-12T01:02:37.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.986+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.483__shadow_.Lh7HPwtRwzaWhLw8rfUdmaytQEINK-J_0 2024-09-12T01:02:37.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.986+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5631423683701356044', time=2024-09-12T02:52:54.149598+0000, chain.objs.size()=6 2024-09-12T01:02:37.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.986+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.1 2024-09-12T01:02:37.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.986+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.2 2024-09-12T01:02:37.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.986+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.3 2024-09-12T01:02:37.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.986+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.4 2024-09-12T01:02:37.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.986+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.5 2024-09-12T01:02:37.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.986+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.6 2024-09-12T01:02:37.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.986+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2963541998812201905', time=2024-09-12T02:53:02.377735+0000, chain.objs.size()=1 2024-09-12T01:02:37.983 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.986+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.517__shadow_.aGh4GLYNlr4VaRhgvYe5p5jon5GHzcZ_0 2024-09-12T01:02:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.990+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~p1HksPRfLt-jYuPLkbuaoZ9cJ70LRd3', time=2024-09-12T02:53:25.496172+0000, chain.objs.size()=1 2024-09-12T01:02:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.990+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~p1HksPRfLt-jYuPLkbuaoZ9cJ70LRd3.1 2024-09-12T01:02:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.990+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~p1HksPRfLt-jYuPLkbuaoZ9cJ70LRd3', time=2024-09-12T02:53:25.499772+0000, chain.objs.size()=1 2024-09-12T01:02:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.990+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~p1HksPRfLt-jYuPLkbuaoZ9cJ70LRd3.2 2024-09-12T01:02:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.990+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~p1HksPRfLt-jYuPLkbuaoZ9cJ70LRd3', time=2024-09-12T02:53:25.502903+0000, chain.objs.size()=1 2024-09-12T01:02:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.990+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~p1HksPRfLt-jYuPLkbuaoZ9cJ70LRd3.3 2024-09-12T01:02:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.990+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~p1HksPRfLt-jYuPLkbuaoZ9cJ70LRd3', time=2024-09-12T02:53:25.506281+0000, chain.objs.size()=1 2024-09-12T01:02:37.985 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.990+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~p1HksPRfLt-jYuPLkbuaoZ9cJ70LRd3.4 2024-09-12T01:02:37.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.990+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~p1HksPRfLt-jYuPLkbuaoZ9cJ70LRd3', time=2024-09-12T02:53:25.509661+0000, chain.objs.size()=1 2024-09-12T01:02:37.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.990+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~p1HksPRfLt-jYuPLkbuaoZ9cJ70LRd3.5 2024-09-12T01:02:37.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.990+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~p1HksPRfLt-jYuPLkbuaoZ9cJ70LRd3', time=2024-09-12T02:53:25.512951+0000, chain.objs.size()=1 2024-09-12T01:02:37.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.990+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~p1HksPRfLt-jYuPLkbuaoZ9cJ70LRd3.6 2024-09-12T01:02:37.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.990+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13237195129583298336', time=2024-09-12T02:54:23.702374+0000, chain.objs.size()=1 2024-09-12T01:02:37.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.990+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.551__shadow_.cSV6AxjFMzqEfGsO7HnhzaVE7aBIUrf_0 2024-09-12T01:02:37.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9992324869797167566', time=2024-09-12T02:54:49.851518+0000, chain.objs.size()=1 2024-09-12T01:02:37.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:r4t8IIghQ-Smk4LTamkGOLbF9-HiIvZ_.F1YJV7z6-ImMoUf00AxcPWprSQOD0iX_0 2024-09-12T01:02:37.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7144620694707225696', time=2024-09-12T02:55:06.005486+0000, chain.objs.size()=1 2024-09-12T01:02:37.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.576__shadow:zSC7SGAFbuqE36Rwch8vxGN0HUZ9S2p_.M9IflUr85uiixyGv9b1JZiDEoUxClXp_0 2024-09-12T01:02:37.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1130284449462234349', time=2024-09-12T02:55:11.403066+0000, chain.objs.size()=1 2024-09-12T01:02:37.989 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:isIOqQp8dr55-HKeK9pJmVg.osFaCkh_.7Ou_lkh3Qwzp3WFUtXNQuw4gKXLw5pe_0 2024-09-12T01:02:37.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6383583226310145810', time=2024-09-12T02:55:15.257922+0000, chain.objs.size()=1 2024-09-12T01:02:37.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:7jguykUjHF.Y2Lhieb7a5VlW9uc5NxZ_.5aUFPj2Gp3FUH6KUSpiibvg-eNbNEAG_0 2024-09-12T01:02:37.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9197682309279264537', time=2024-09-12T02:55:18.460347+0000, chain.objs.size()=1 2024-09-12T01:02:37.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:I4RfNQwpWbqFmhJBNNP-nqkNAAeune7_.fj5wKZR4UUpzpBJb_48rlbaoCFi4V9-_0 2024-09-12T01:02:37.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9796711024926830742', time=2024-09-12T02:55:46.303827+0000, chain.objs.size()=1 2024-09-12T01:02:37.991 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.603__shadow_.DnIeJssmULn95qc6_lMbouChdIdBB4R_0 2024-09-12T01:02:37.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8794078918027268099', time=2024-09-12T02:55:46.995328+0000, chain.objs.size()=1 2024-09-12T01:02:37.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.604__shadow_.KoR6ORitvVh1E0T7RACBL37ruTodu2T_0 2024-09-12T01:02:37.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16859537080272531997', time=2024-09-12T02:55:47.667693+0000, chain.objs.size()=1 2024-09-12T01:02:37.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.605__shadow_.ndCmmz-J_5UDybgv3h8JABiNydXi-JY_0 2024-09-12T01:02:37.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16761983081850724516', time=2024-09-12T02:57:06.937189+0000, chain.objs.size()=1 2024-09-12T01:02:37.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.617__shadow_.Y2rPpwoJKimsUsne3hLgk8vroqRQTM0_0 2024-09-12T01:02:37.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2929033184813194620', time=2024-09-12T02:58:28.675606+0000, chain.objs.size()=1 2024-09-12T01:02:37.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.994+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.641__shadow_.VqPKLz0UJ0qmQWFX5_XGcd0ax1VGB9o_0 2024-09-12T01:02:37.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.998+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3065303577691820752', time=2024-09-12T02:58:37.012432+0000, chain.objs.size()=1 2024-09-12T01:02:37.993 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.998+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.650__shadow_.hX7mA0rehaVZkFmiC8rZrPwNgMwdLc1_0 2024-09-12T01:02:37.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.998+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6689011211966719716', time=2024-09-12T02:58:49.140652+0000, chain.objs.size()=1 2024-09-12T01:02:37.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:37.998+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.664__shadow_.I7k_DFuk-xhw-LhHI_HaHpbwYbUGAjv_0 2024-09-12T01:02:37.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.002+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:38.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:02:38.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.002 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52994' 2024-09-12T01:02:38.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='_F90JUSWLPzc9BpdJy5Lmv78FR3iO9gJ', time=2024-09-12T02:46:04.644508+0000, chain.objs.size()=2 2024-09-12T01:02:38.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.160__shadow_.oP-WxS5e0B1uxIO_8qOuDdCXwHJqtxw_0 2024-09-12T01:02:38.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.160__shadow_.oP-WxS5e0B1uxIO_8qOuDdCXwHJqtxw_1 2024-09-12T01:02:38.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14043795146571764716', time=2024-09-12T02:48:21.233156+0000, chain.objs.size()=1 2024-09-12T01:02:38.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.233__shadow_.L7d3KdTTmp1CxjajhlgLjoZnbF83QBZ_0 2024-09-12T01:02:38.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6082344842237590754', time=2024-09-12T02:48:23.495595+0000, chain.objs.size()=1 2024-09-12T01:02:38.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.236__shadow_.X7tdlmekUYZjbXzQv0dhwiYpakrIVVE_0 2024-09-12T01:02:38.003 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2599815171956820968', time=2024-09-12T02:48:24.703715+0000, chain.objs.size()=1 2024-09-12T01:02:38.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.237__shadow_.zAk30w6zisjX80ncZpEP2znodbPan03_0 2024-09-12T01:02:38.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5758361507765754720', time=2024-09-12T02:48:32.836901+0000, chain.objs.size()=1 2024-09-12T01:02:38.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.246__shadow_.wAHLJ6u-aBofmC6MqhGJguxg4nEQDyh_0 2024-09-12T01:02:38.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.340266340042629012', time=2024-09-12T02:48:34.996764+0000, chain.objs.size()=1 2024-09-12T01:02:38.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.249__shadow_.6hFbE7NrFn8BoO-otbjb-hyOJfpCkwh_0 2024-09-12T01:02:38.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6095733809625222023', time=2024-09-12T02:48:43.870575+0000, chain.objs.size()=1 2024-09-12T01:02:38.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.261__shadow_.NNKKNEeTRnGyNr-S-c00d6cdbF_obyr_0 2024-09-12T01:02:38.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5522212110067259844', time=2024-09-12T02:49:05.499050+0000, chain.objs.size()=1 2024-09-12T01:02:38.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.CYgc9vTS0xZGjs-mphwEj1w_5SFuAB1_0 2024-09-12T01:02:38.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.875099345752115787', time=2024-09-12T02:49:05.499771+0000, chain.objs.size()=1 2024-09-12T01:02:38.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.wd81_MT6ukFABOg6BZWy1Ql3BqbKm7c_0 2024-09-12T01:02:38.004 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14937766256003388104', time=2024-09-12T02:49:05.565075+0000, chain.objs.size()=1 2024-09-12T01:02:38.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.m2XGQwWvvfYL2OIVcbiphHFgB7odl0V_0 2024-09-12T01:02:38.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10230435392826982379', time=2024-09-12T02:49:05.574970+0000, chain.objs.size()=1 2024-09-12T01:02:38.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.006+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.4SuKWLuFR0KJsq1kQDzrpi3xNW9LPgj_0 2024-09-12T01:02:38.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.010+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5366601446220264207', time=2024-09-12T02:49:05.582367+0000, chain.objs.size()=1 2024-09-12T01:02:38.005 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.010+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.OgEteRI6hoclKzDwIwhbUPilOqhd7Rz_0 2024-09-12T01:02:38.006 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.010+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.739124713078394980', time=2024-09-12T02:49:05.723833+0000, chain.objs.size()=1 2024-09-12T01:02:38.007 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.010+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.pACSgBK4Kh-kdHgHnW6xMz7hgclT64N_0 2024-09-12T01:02:38.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.010+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15781181055797423992', time=2024-09-12T02:49:05.762503+0000, chain.objs.size()=1 2024-09-12T01:02:38.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.qjEtqGdTWTsKR5RkyIvvJA96W3LH578_0 2024-09-12T01:02:38.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16424927566373114667', time=2024-09-12T02:49:05.790826+0000, chain.objs.size()=1 2024-09-12T01:02:38.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.kBRCtzdeiMixQ-YGUGLGHRkL6RdhaAu_0 2024-09-12T01:02:38.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7166046046880562751', time=2024-09-12T02:49:05.834053+0000, chain.objs.size()=1 2024-09-12T01:02:38.008 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.kP4UEJQAob2MMZokP25nb9FgII5lYwo_0 2024-09-12T01:02:38.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15133584588014376847', time=2024-09-12T02:49:05.838694+0000, chain.objs.size()=1 2024-09-12T01:02:38.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.iG3PPXtd0IkyWdmN9OuyuDtXq67v79P_0 2024-09-12T01:02:38.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2710932055237946376', time=2024-09-12T02:49:05.959445+0000, chain.objs.size()=1 2024-09-12T01:02:38.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.t6fRyEXUEWrNEw68vyoSNWRcfed7-1b_0 2024-09-12T01:02:38.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1683460697514724089', time=2024-09-12T02:49:05.965720+0000, chain.objs.size()=1 2024-09-12T01:02:38.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7lDFd7iSl7dolxPOJIq1NJ-tGB_P0PQ_0 2024-09-12T01:02:38.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4349815226111617789', time=2024-09-12T02:49:06.005700+0000, chain.objs.size()=1 2024-09-12T01:02:38.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.kOyYJLGmDAprAI9tMH-bNc_eJAJ7Yqp_0 2024-09-12T01:02:38.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8179945343475031442', time=2024-09-12T02:49:06.024016+0000, chain.objs.size()=1 2024-09-12T01:02:38.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.iDbaguaQhPxOWvaMFRvTPOdi6T8ULFb_0 2024-09-12T01:02:38.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4785120744907919644', time=2024-09-12T02:49:06.106466+0000, chain.objs.size()=1 2024-09-12T01:02:38.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.HCTL75nMD0UTuO1Ov0bFG_swnqYocXw_0 2024-09-12T01:02:38.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11501839634791058236', time=2024-09-12T02:49:06.256037+0000, chain.objs.size()=1 2024-09-12T01:02:38.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.GLxZkzO7cC1n6IhaRlbg1zORtgi11MY_0 2024-09-12T01:02:38.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3153828741173488091', time=2024-09-12T02:49:06.281113+0000, chain.objs.size()=1 2024-09-12T01:02:38.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.SdMVWqWQQWPa8ruUn2tk_NB_D7LBSZX_0 2024-09-12T01:02:38.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.912686517898165771', time=2024-09-12T02:49:06.282187+0000, chain.objs.size()=1 2024-09-12T01:02:38.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.TSIFtpQtHq00ZRpgbgGMCj59eazLsBm_0 2024-09-12T01:02:38.012 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.018+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17791629702912954441', time=2024-09-12T02:49:06.288268+0000, chain.objs.size()=1 2024-09-12T01:02:38.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.018+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.fHDa718uIc2fX6IHPRYnuVd02khbXjH_0 2024-09-12T01:02:38.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.018+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4273686678648185007', time=2024-09-12T02:49:06.291627+0000, chain.objs.size()=1 2024-09-12T01:02:38.013 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.018+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.DDdfsdQo95esdcf5A7JIqDoCH62Mh3i_0 2024-09-12T01:02:38.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.018+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6319949637500692267', time=2024-09-12T02:49:06.333531+0000, chain.objs.size()=1 2024-09-12T01:02:38.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.018+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.4cSBu1cv5igYNwSfCEDfhNzJr2qZceX_0 2024-09-12T01:02:38.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.018+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14344929370429847913', time=2024-09-12T02:49:06.335315+0000, chain.objs.size()=1 2024-09-12T01:02:38.015 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.018+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.2pE263YjzABNpPmZ-FWSwbZE0NwC4dm_0 2024-09-12T01:02:38.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.018+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16047703804397327433', time=2024-09-12T02:49:06.519240+0000, chain.objs.size()=1 2024-09-12T01:02:38.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.018+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.OaaVVc3WjQQaT5tyfF58Nw6u1VUAQVH_0 2024-09-12T01:02:38.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.018+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3000366030902222485', time=2024-09-12T02:49:06.542164+0000, chain.objs.size()=1 2024-09-12T01:02:38.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.018+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.K6EAlhZOWnYhgo4NGvrIon9bBR_YFkJ_0 2024-09-12T01:02:38.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.018+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2102407419006728430', time=2024-09-12T02:49:06.607028+0000, chain.objs.size()=1 2024-09-12T01:02:38.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.018+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Cvl8UvYXWsQkKwrO8AmA4iMfspzIjE3_0 2024-09-12T01:02:38.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.018+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14772987169686824131', time=2024-09-12T02:49:06.618086+0000, chain.objs.size()=1 2024-09-12T01:02:38.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.018+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.moExhn4TxBlFuKX7WyOR-JJrOyUTaRb_0 2024-09-12T01:02:38.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.022+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4296947864533879008', time=2024-09-12T02:49:06.618840+0000, chain.objs.size()=1 2024-09-12T01:02:38.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.022+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ricyDkzO9lJaq2FaO9kS-Tya2C-cfLO_0 2024-09-12T01:02:38.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.022+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10093009219499485329', time=2024-09-12T02:49:06.835535+0000, chain.objs.size()=1 2024-09-12T01:02:38.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.022+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.PvNOLOkURNNAjCHp_4UCGmnMhQs9IVb_0 2024-09-12T01:02:38.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.022+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9001788649394885913', time=2024-09-12T02:49:07.062498+0000, chain.objs.size()=1 2024-09-12T01:02:38.018 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.022+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.htB3TE7I888uaTdjAOZ5ZOGg-ty7mZM_0 2024-09-12T01:02:38.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.022+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10963133427329311719', time=2024-09-12T02:49:07.112845+0000, chain.objs.size()=1 2024-09-12T01:02:38.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.022+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.MEUY4LATzXJ_7xp-HkvBJ9dtMD0r22n_0 2024-09-12T01:02:38.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.022+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6365481380198080475', time=2024-09-12T02:49:07.147782+0000, chain.objs.size()=1 2024-09-12T01:02:38.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.022+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.pjq9k72IMfmIo1SSVN4iU5TRyFueBP4_0 2024-09-12T01:02:38.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11820500788824898714', time=2024-09-12T02:49:07.168662+0000, chain.objs.size()=1 2024-09-12T01:02:38.020 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.h3Hg7wf0WyhKfUHzwtYmhsF1CvO5tYh_0 2024-09-12T01:02:38.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5519329833744079216', time=2024-09-12T02:49:07.169753+0000, chain.objs.size()=1 2024-09-12T01:02:38.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.VlfpW04382OjG7tCLScQi_qbSBkCTXt_0 2024-09-12T01:02:38.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.523984967300514525', time=2024-09-12T02:49:07.180694+0000, chain.objs.size()=1 2024-09-12T01:02:38.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.NHmE9r0jAzqDxfPyadWGSNurn25ZZmh_0 2024-09-12T01:02:38.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14937267621430671063', time=2024-09-12T02:49:07.334404+0000, chain.objs.size()=1 2024-09-12T01:02:38.021 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.yRtGYrn9K0FbdHyAhcUYDnRWgPqiKks_0 2024-09-12T01:02:38.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14408217050603800869', time=2024-09-12T02:49:07.347466+0000, chain.objs.size()=1 2024-09-12T01:02:38.022 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.NIOFy1DrAamzo62-Iyp6MgtVnh4jjb5_0 2024-09-12T01:02:38.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5148852586176841530', time=2024-09-12T02:49:07.392190+0000, chain.objs.size()=1 2024-09-12T01:02:38.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.LYwgwZXSHTcPFTZNJmyzQLq4VoqysV1_0 2024-09-12T01:02:38.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5771752313413773757', time=2024-09-12T02:49:07.435849+0000, chain.objs.size()=1 2024-09-12T01:02:38.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.s5LzEulN3aOu1QrBlAxMKtwPZvpe4ZQ_0 2024-09-12T01:02:38.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7378453927267007504', time=2024-09-12T02:49:07.442599+0000, chain.objs.size()=1 2024-09-12T01:02:38.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.US-4Ddz-LBqE7eMczcZRLwhJXmdqbOs_0 2024-09-12T01:02:38.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4327944417919281332', time=2024-09-12T02:49:09.043075+0000, chain.objs.size()=1 2024-09-12T01:02:38.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.264__shadow_.bT9H5z0PJjsaSMq_vjHaS0KkW3nwaBg_0 2024-09-12T01:02:38.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.030+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12145825978217356757', time=2024-09-12T02:49:13.296653+0000, chain.objs.size()=1 2024-09-12T01:02:38.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.030+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.270__shadow_.LtZAjNu2pAE-xF5oFu3duJ6AbO46876_0 2024-09-12T01:02:38.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.030+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9519646598185079578', time=2024-09-12T02:49:15.441355+0000, chain.objs.size()=1 2024-09-12T01:02:38.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.030+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.273__shadow_.4Zi5iN7ucGFJuRWbW1leogZfH-L3dKe_0 2024-09-12T01:02:38.026 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.030+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15315695688775582009', time=2024-09-12T02:49:20.104449+0000, chain.objs.size()=1 2024-09-12T01:02:38.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.030+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.279__shadow_.rDkdoz3M1JbY2VboiqOUQrFWiirOs_-_0 2024-09-12T01:02:38.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.030+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10123562232436292327', time=2024-09-12T02:49:21.611413+0000, chain.objs.size()=1 2024-09-12T01:02:38.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.030+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.281__shadow_.P-CfFDcrIg81p8RnXYlk7cTUibUvcCv_0 2024-09-12T01:02:38.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.030+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6894171877476478900', time=2024-09-12T02:49:26.919999+0000, chain.objs.size()=1 2024-09-12T01:02:38.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.030+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.288__shadow_.YQDQSgOh_3149IT3cCQFas_OJXhZBqO_0 2024-09-12T01:02:38.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.030+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7866941326262376807', time=2024-09-12T02:49:30.927885+0000, chain.objs.size()=1 2024-09-12T01:02:38.027 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.030+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.5w45vC_hoGbJ8I9mOjsa-qxkm1CRrA7_0 2024-09-12T01:02:38.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13041509156615229795', time=2024-09-12T02:49:32.460470+0000, chain.objs.size()=1 2024-09-12T01:02:38.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.uxGaOeGe2rhUcrzsOiaEYjW_KJmZb8o_0 2024-09-12T01:02:38.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13980358021841270684', time=2024-09-12T02:49:36.951760+0000, chain.objs.size()=1 2024-09-12T01:02:38.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.299__shadow_.iBzJllT4_n9SdTcMdgXf6hyLeyZq6aU_0 2024-09-12T01:02:38.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3556432548274578919', time=2024-09-12T02:50:15.814066+0000, chain.objs.size()=1 2024-09-12T01:02:38.029 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.uNdEXQ3uce3taqF8Z8LB7GrJOte7XDP_0 2024-09-12T01:02:38.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6338767876878926102', time=2024-09-12T02:50:15.897468+0000, chain.objs.size()=1 2024-09-12T01:02:38.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ZbHvCjv2_P3SQ_5trOQ18o90ALQQYO8_0 2024-09-12T01:02:38.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14621025141322200767', time=2024-09-12T02:50:16.183017+0000, chain.objs.size()=1 2024-09-12T01:02:38.030 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.rEcL_srK_gVOEHtl6gyQPg_olJ4tSZ0_0 2024-09-12T01:02:38.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14826696984954806159', time=2024-09-12T02:50:16.199410+0000, chain.objs.size()=1 2024-09-12T01:02:38.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6DwYUCNwAICZq9ptc4AKgdfL7Ps_Xh0_0 2024-09-12T01:02:38.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10049385213124638219', time=2024-09-12T02:50:16.237802+0000, chain.objs.size()=1 2024-09-12T01:02:38.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.CvBuH8-7gtHzLMgY4WByC5lGAh6O46a_0 2024-09-12T01:02:38.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16438065591890294721', time=2024-09-12T02:50:16.446744+0000, chain.objs.size()=1 2024-09-12T01:02:38.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.oXZobZ9YmbdkER0Y_UE7PxXufMKQM01_0 2024-09-12T01:02:38.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14113789880833443345', time=2024-09-12T02:50:16.635055+0000, chain.objs.size()=1 2024-09-12T01:02:38.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.WvUgti9u97ashZpEECfuUedi2ais5te_0 2024-09-12T01:02:38.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16410497020463219373', time=2024-09-12T02:50:16.679443+0000, chain.objs.size()=1 2024-09-12T01:02:38.031 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.jg0OOx6-CnoEg0b_xNNdoFks1kuwfaF_0 2024-09-12T01:02:38.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14861310324243379119', time=2024-09-12T02:50:16.684993+0000, chain.objs.size()=1 2024-09-12T01:02:38.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.034+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.nj8jnnSO1qoXWdD7RoJea2YEoBKgG6g_0 2024-09-12T01:02:38.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.038+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4214331653776516292', time=2024-09-12T02:50:16.697954+0000, chain.objs.size()=1 2024-09-12T01:02:38.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.038+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.LqMKJHMuGk2Hnx9LxYgjgB4RICuVNe2_0 2024-09-12T01:02:38.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.038+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14753458625206222857', time=2024-09-12T02:50:16.714792+0000, chain.objs.size()=1 2024-09-12T01:02:38.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.038+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.GdZeQ37JbOWGyqiZzpcrZLut83FuH_V_0 2024-09-12T01:02:38.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.038+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13556103729356835739', time=2024-09-12T02:50:16.892997+0000, chain.objs.size()=1 2024-09-12T01:02:38.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.038+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.70U4LIGdJCxUJZNcB6lGQwmED9_J7bQ_0 2024-09-12T01:02:38.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.038+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4419816001292070707', time=2024-09-12T02:50:16.896649+0000, chain.objs.size()=1 2024-09-12T01:02:38.035 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.038+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.yad5mUlA2TszfY3lV6csCBDY_OJIK3g_0 2024-09-12T01:02:38.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13170627767389801225', time=2024-09-12T02:50:16.897959+0000, chain.objs.size()=1 2024-09-12T01:02:38.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.aOb0kMMkV7dpZQpsYqF3kLRjUvFHWFy_0 2024-09-12T01:02:38.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17322950571069708733', time=2024-09-12T02:50:16.933326+0000, chain.objs.size()=1 2024-09-12T01:02:38.036 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.CwG8dwFBytWEc6jrnIzGiQ14OZCMnlw_0 2024-09-12T01:02:38.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8526839320891100122', time=2024-09-12T02:50:16.978059+0000, chain.objs.size()=1 2024-09-12T01:02:38.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.dVp85QEbfLNODzGe0ToalQDCsxg0Y7l_0 2024-09-12T01:02:38.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13099170714169572746', time=2024-09-12T02:50:17.004546+0000, chain.objs.size()=1 2024-09-12T01:02:38.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.7-UGSq3OLSBsuf5fhn3JkIiHhJmH-5O_0 2024-09-12T01:02:38.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.238862996451094166', time=2024-09-12T02:50:17.008183+0000, chain.objs.size()=1 2024-09-12T01:02:38.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.86A6vSTnkBcrzGd-_hcWpWVi7-oDeWm_0 2024-09-12T01:02:38.037 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15289051798831095278', time=2024-09-12T02:50:17.027692+0000, chain.objs.size()=1 2024-09-12T01:02:38.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.elOb91eA6nUyYzNXKB0iQuU5eO549mD_0 2024-09-12T01:02:38.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1162637703438907077', time=2024-09-12T02:50:17.149122+0000, chain.objs.size()=1 2024-09-12T01:02:38.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.7D8Xlb-tH-blBEFsT5S1UfxXxoOqxME_0 2024-09-12T01:02:38.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16373496302773411412', time=2024-09-12T02:50:17.268739+0000, chain.objs.size()=1 2024-09-12T01:02:38.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.QVayV3QO3O_2UKWK-RoQ2VgmhJjwx4T_0 2024-09-12T01:02:38.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4774935433728761812', time=2024-09-12T02:50:17.398523+0000, chain.objs.size()=1 2024-09-12T01:02:38.038 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.042+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.1vAKMo6AwgfRpDDQW6pCL4Pm2rkl9-T_0 2024-09-12T01:02:38.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8780386517415612936', time=2024-09-12T02:50:17.430157+0000, chain.objs.size()=1 2024-09-12T01:02:38.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.msAxVaWSTFBabrUu1Wyd-CxflBm8Vap_0 2024-09-12T01:02:38.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17759609792546614991', time=2024-09-12T02:50:17.432700+0000, chain.objs.size()=1 2024-09-12T01:02:38.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.HtVDNRPpkwkylpgogSkoNxZU6W7lAOw_0 2024-09-12T01:02:38.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15962981378883056000', time=2024-09-12T02:50:17.449413+0000, chain.objs.size()=1 2024-09-12T01:02:38.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.5NqargfpeU2BVegH8etrul0LFGhUGNp_0 2024-09-12T01:02:38.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13261725370124274452', time=2024-09-12T02:50:17.505376+0000, chain.objs.size()=1 2024-09-12T01:02:38.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.rHxYIIHOW059LNmniLR6gQ0DV20qLZU_0 2024-09-12T01:02:38.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9433562620876014414', time=2024-09-12T02:50:17.754686+0000, chain.objs.size()=1 2024-09-12T01:02:38.043 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.vdu00oNNSOaX8vUWFmJMHDnwUfCofWI_0 2024-09-12T01:02:38.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16329325542783196890', time=2024-09-12T02:50:39.492876+0000, chain.objs.size()=1 2024-09-12T01:02:38.044 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.BQeESCwmpBL4i6hGN0mry2viXICz8YO_0 2024-09-12T01:02:38.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5679995116652630233', time=2024-09-12T02:50:39.497844+0000, chain.objs.size()=1 2024-09-12T01:02:38.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.SVOUabonN8yOWjxULcKKG8XGtPdxRH1_0 2024-09-12T01:02:38.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15360564841683151179', time=2024-09-12T02:50:39.773562+0000, chain.objs.size()=1 2024-09-12T01:02:38.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.7p5YdDJpbc5HvzhawIAgWT5C1eQCNkO_0 2024-09-12T01:02:38.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15911299244280399673', time=2024-09-12T02:50:39.816826+0000, chain.objs.size()=1 2024-09-12T01:02:38.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.046+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.vvWqHkELLSIzP3uhSiAkM6SsBtwHuRN_0 2024-09-12T01:02:38.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.050+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15505536764662824399', time=2024-09-12T02:50:39.829281+0000, chain.objs.size()=1 2024-09-12T01:02:38.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.050+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.nFujCVdxKsf4EMTogzoLBoOX2nuLWez_0 2024-09-12T01:02:38.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.050+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3301119382669929802', time=2024-09-12T02:50:39.989432+0000, chain.objs.size()=1 2024-09-12T01:02:38.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.050+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.V8N-P91WtlugRhPwrFu3yV0LBnP_47D_0 2024-09-12T01:02:38.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.050+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2649591185157276853', time=2024-09-12T02:50:40.045662+0000, chain.objs.size()=1 2024-09-12T01:02:38.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.050+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Y2lwtvqQN5k7-PNDxR0GwT4afadR_R5_0 2024-09-12T01:02:38.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.050+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6386518120689425844', time=2024-09-12T02:50:40.055087+0000, chain.objs.size()=1 2024-09-12T01:02:38.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.050+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Pa0OE8K01WJyR8P5ISxNCzFXI4Cmf5d_0 2024-09-12T01:02:38.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.050+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15480109807390141826', time=2024-09-12T02:50:40.068992+0000, chain.objs.size()=1 2024-09-12T01:02:38.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.050+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.K1VzKZR09fbK--e61M1p8bxUu9AWf0S_0 2024-09-12T01:02:38.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.050+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14853828415484652927', time=2024-09-12T02:50:40.110801+0000, chain.objs.size()=1 2024-09-12T01:02:38.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.050+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.8hQxKVShh8VVrevNtS1yVgcdsOmWuqF_0 2024-09-12T01:02:38.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.054+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15094266571305616634', time=2024-09-12T02:50:40.280352+0000, chain.objs.size()=1 2024-09-12T01:02:38.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.054+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.tvHPpYLgCuwli5sBgQtufc6ikK9yexe_0 2024-09-12T01:02:38.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.054+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3211504759995881544', time=2024-09-12T02:50:40.313947+0000, chain.objs.size()=1 2024-09-12T01:02:38.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.054+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.zzGT8wBQol4yGr3Nkgst70vbjDPCMlu_0 2024-09-12T01:02:38.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.054+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12290548372381893642', time=2024-09-12T02:50:40.326765+0000, chain.objs.size()=1 2024-09-12T01:02:38.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.054+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.HIqf_Izi17NQVFfpTQoBgSMxGCAiFcJ_0 2024-09-12T01:02:38.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.054+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16468943854508244446', time=2024-09-12T02:50:40.342133+0000, chain.objs.size()=1 2024-09-12T01:02:38.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.054+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.cO6ZJVP0pfWoydgzKmlc4_56uPGQry6_0 2024-09-12T01:02:38.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.054+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7024322218336236897', time=2024-09-12T02:50:40.552773+0000, chain.objs.size()=1 2024-09-12T01:02:38.050 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.054+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.DX7izPrQTQEU7FL_mnkfNfwQnAEtRg__0 2024-09-12T01:02:38.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.054+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13644954705164764491', time=2024-09-12T02:50:40.562250+0000, chain.objs.size()=1 2024-09-12T01:02:38.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.054+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_._iHWtpNffgsYv6xhLHOElUpkrnTf50W_0 2024-09-12T01:02:38.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.054+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12686647862323024715', time=2024-09-12T02:50:40.591610+0000, chain.objs.size()=1 2024-09-12T01:02:38.051 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.054+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.SB1kQCJs2bKwazsGvEGArJ4dyRlZwfe_0 2024-09-12T01:02:38.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.058+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12455448053733913089', time=2024-09-12T02:50:40.738919+0000, chain.objs.size()=1 2024-09-12T01:02:38.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.058+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.E2ihVpzlY0pmNWNdTlVh7UqPxT_dbkC_0 2024-09-12T01:02:38.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/52994 2024-09-12T01:02:38.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-12T01:02:38.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5274827363663041938', time=2024-09-12T02:50:40.790533+0000, chain.objs.size()=1 2024-09-12T01:02:38.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.kX4BgEUNRb_ezZuI5PdVbusJ3pPzxf__0 2024-09-12T01:02:38.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4978045180470776576', time=2024-09-12T02:50:40.801886+0000, chain.objs.size()=1 2024-09-12T01:02:38.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.wt2FHS3cngPkUmNa6ORm-flwggi3LzL_0 2024-09-12T01:02:38.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12263414311163991949', time=2024-09-12T02:50:40.809554+0000, chain.objs.size()=1 2024-09-12T01:02:38.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.QtqQdCvpVhw9fiAu4YyGQKFW5cHGvWy_0 2024-09-12T01:02:38.059 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3709284616792000363', time=2024-09-12T02:50:40.841360+0000, chain.objs.size()=1 2024-09-12T01:02:38.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.OTeiha2RPIAU_PoxeFCBqOdn_sybiYi_0 2024-09-12T01:02:38.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2048226717019365768', time=2024-09-12T02:50:40.864580+0000, chain.objs.size()=1 2024-09-12T01:02:38.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.V7F_CJxd1rpaCsORzXctEfB3hQ94YWV_0 2024-09-12T01:02:38.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8750933679698447327', time=2024-09-12T02:50:40.885513+0000, chain.objs.size()=1 2024-09-12T01:02:38.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.RtHs81PBdskUu4p8GdzRPYENA8rfknP_0 2024-09-12T01:02:38.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4428543473198606841', time=2024-09-12T02:50:40.890371+0000, chain.objs.size()=1 2024-09-12T01:02:38.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ZXIChK57yt03YzgrGzfZaN55tTcf8OX_0 2024-09-12T01:02:38.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7094366991505970879', time=2024-09-12T02:50:41.037280+0000, chain.objs.size()=1 2024-09-12T01:02:38.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Bq_5L_ZaZGTsYf90rUbXa0L7j7en3KT_0 2024-09-12T01:02:38.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17955745486469565786', time=2024-09-12T02:50:41.051221+0000, chain.objs.size()=1 2024-09-12T01:02:38.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.BG9xDAAAEV4oWcgc1uoqwaLQ1_mNNoG_0 2024-09-12T01:02:38.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13212809697145368463', time=2024-09-12T02:50:41.068374+0000, chain.objs.size()=1 2024-09-12T01:02:38.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.MInDjP7bMCmVUjGAvmtydLbWvTP1OlP_0 2024-09-12T01:02:38.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5622806803773148504', time=2024-09-12T02:50:41.122969+0000, chain.objs.size()=1 2024-09-12T01:02:38.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Jp9wLX0MQ8B7SA3ywZZBVb4Ah7xgoNV_0 2024-09-12T01:02:38.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4628201703524847009', time=2024-09-12T02:50:41.172657+0000, chain.objs.size()=1 2024-09-12T01:02:38.061 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.XXilGNbE1hCfPXrkYMl93ThYCYpofPH_0 2024-09-12T01:02:38.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.066+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17384829647713942728', time=2024-09-12T02:50:41.270417+0000, chain.objs.size()=1 2024-09-12T01:02:38.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.066+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.d5WPw3TZgP1wbrrTD97TVZL-sApFM2y_0 2024-09-12T01:02:38.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.066+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14919312028689473646', time=2024-09-12T02:50:41.356827+0000, chain.objs.size()=1 2024-09-12T01:02:38.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.066+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.uZXMMdPPnJS_g_PW8S-_ptQ4MlI0AAH_0 2024-09-12T01:02:38.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.066+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4540139118083257228', time=2024-09-12T02:50:41.366382+0000, chain.objs.size()=1 2024-09-12T01:02:38.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.066+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.kyF2Cq4wejqV--wk7GcCUw2KZzkfgmO_0 2024-09-12T01:02:38.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.066+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7726937332045955457', time=2024-09-12T02:50:41.373746+0000, chain.objs.size()=1 2024-09-12T01:02:38.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.066+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.rB5sSD6ZShlOuFU86fc61MV8hXGg4QH_0 2024-09-12T01:02:38.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.066+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9877013026918393073', time=2024-09-12T02:50:41.395979+0000, chain.objs.size()=1 2024-09-12T01:02:38.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.066+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.5QMZm2krbtpZz5ED8zdxABuRCn-IXs2_0 2024-09-12T01:02:38.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.066+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17111088969701031279', time=2024-09-12T02:50:41.522418+0000, chain.objs.size()=1 2024-09-12T01:02:38.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.066+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.6AWlLN4X2wFC7DUdffvNBRgcm9jIGSg_0 2024-09-12T01:02:38.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.066+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6060742362079373000', time=2024-09-12T02:50:41.532938+0000, chain.objs.size()=1 2024-09-12T01:02:38.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.066+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.YJ-ZqZs8zWOEWZDN9BC6OEhHlsx0w-4_0 2024-09-12T01:02:38.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.070+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1429306076192045707', time=2024-09-12T02:50:41.550140+0000, chain.objs.size()=1 2024-09-12T01:02:38.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.070+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.C0brmyxuDERK-XRi8qZrQmEftDAR_pz_0 2024-09-12T01:02:38.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.070+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14988698092602723967', time=2024-09-12T02:50:41.554087+0000, chain.objs.size()=1 2024-09-12T01:02:38.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.070+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.hR8QnlYchIvxCVBJjwxzyIm2K9pRFpk_0 2024-09-12T01:02:38.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.070+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1540133328234541846', time=2024-09-12T02:50:41.569447+0000, chain.objs.size()=1 2024-09-12T01:02:38.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.070+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.aYNNQOJur4TC65tFsN6sYPTnjfcwOgw_0 2024-09-12T01:02:38.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.070+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8184174660932428074', time=2024-09-12T02:50:41.579587+0000, chain.objs.size()=1 2024-09-12T01:02:38.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.070+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Sqc0c4yOxBXmoajs77g9tdAI9IIplyB_0 2024-09-12T01:02:38.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.074+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2920576626531322601', time=2024-09-12T02:50:41.590379+0000, chain.objs.size()=1 2024-09-12T01:02:38.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.074+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.reXttzJuTOFkkpuR_iOcvch2IlN2g_1_0 2024-09-12T01:02:38.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.074+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.881104457104221197', time=2024-09-12T02:51:08.691864+0000, chain.objs.size()=1 2024-09-12T01:02:38.069 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.074+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.367__shadow_.UXt9slykrpl8qNO6gPxNtNVFX9eL4Oj_0 2024-09-12T01:02:38.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.074+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3916355432414793011', time=2024-09-12T02:51:16.593070+0000, chain.objs.size()=1 2024-09-12T01:02:38.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.074+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.377__shadow_.Bd8yOkQkDoncYd9zI_9gjqh_nXDs6UD_0 2024-09-12T01:02:38.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.074+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10083103396914317247', time=2024-09-12T02:51:18.180072+0000, chain.objs.size()=1 2024-09-12T01:02:38.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.074+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.379__shadow_.X8komd5Znz1e7f7WX2JQ_FftqVeWd7q_0 2024-09-12T01:02:38.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.074+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.238225961916682634', time=2024-09-12T02:51:41.275934+0000, chain.objs.size()=1 2024-09-12T01:02:38.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.074+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.409__shadow_.vYQyly_YbeZreF788HkJ7zK3xfIaD3z_0 2024-09-12T01:02:38.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.074+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1137270212601251721', time=2024-09-12T02:53:10.945913+0000, chain.objs.size()=3 2024-09-12T01:02:38.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.074+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.521__multipart_mymultipart.2~v2AinQF2R81zph6v5eNKk3hsHQnulBw.1 2024-09-12T01:02:38.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.074+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.521__multipart_mymultipart.2~v2AinQF2R81zph6v5eNKk3hsHQnulBw.2 2024-09-12T01:02:38.072 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.074+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.521__multipart_mymultipart.2~v2AinQF2R81zph6v5eNKk3hsHQnulBw.3 2024-09-12T01:02:38.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.078+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6607818334444683088', time=2024-09-12T02:55:10.962919+0000, chain.objs.size()=1 2024-09-12T01:02:38.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.078+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:yiLsIdcVBrF1Ia0Sm9fiDzP5FD7BSEs_.LuL-hpxmxkjGY4dmOaUn95B9TVbf7Xu_0 2024-09-12T01:02:38.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.078+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1799980556643388272', time=2024-09-12T02:55:12.980177+0000, chain.objs.size()=1 2024-09-12T01:02:38.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.078+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:aLMUObI.a-oQJ531YomsQdZIxfnwPmP_.5fL8i7gOsyKnjEUr_Q1EDMK7q-1lQZK_0 2024-09-12T01:02:38.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.078+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5626377693296620818', time=2024-09-12T02:55:30.252263+0000, chain.objs.size()=1 2024-09-12T01:02:38.073 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.078+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.580__shadow:8juGWe0B1jWWu.E0YOinGTS3brr-OEr_.EyzoynZFmObeaDXwIMD2h8fnGfkxGB4_0 2024-09-12T01:02:38.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.078+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5997814001681232810', time=2024-09-12T02:58:08.753056+0000, chain.objs.size()=1 2024-09-12T01:02:38.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.078+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.619__shadow_.CUkHAg0ag52ZySIHXpNduX9Gv-H5r2V_0 2024-09-12T01:02:38.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.078+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15619644048767438532', time=2024-09-12T02:59:05.598780+0000, chain.objs.size()=1 2024-09-12T01:02:38.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.078+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.690__shadow:ey6RfAMEBXcQx0Y1IViR2p1r.Wwxydd_.CW27RKmpj9NU8cBbBytVq5ruN17TLrt_0 2024-09-12T01:02:38.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.082+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2116363766751561370', time=2024-09-12T02:59:17.625278+0000, chain.objs.size()=1 2024-09-12T01:02:38.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.082+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.707__shadow:4koxVm5s-15jSX-zIvP6nV49AHRd9FQ_.0Xc2vB1gjeoZFWHfTHCh3Y2Pvg_Z2hk_0 2024-09-12T01:02:38.081 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.086+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:38.083 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.086+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:02:38.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44645' 2024-09-12T01:02:38.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5154596677438869796', time=2024-09-12T02:46:53.693483+0000, chain.objs.size()=1 2024-09-12T01:02:38.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.204__shadow_.tJ04tl1LByheQJ3I_aul8637cfmlLqK_0 2024-09-12T01:02:38.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9771899659396536496', time=2024-09-12T02:48:23.491102+0000, chain.objs.size()=1 2024-09-12T01:02:38.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.236__shadow_.3vZGeOKqJ8CgUleF6QdJg0KRQLy_KmE_0 2024-09-12T01:02:38.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12260306570915734498', time=2024-09-12T02:49:05.452590+0000, chain.objs.size()=1 2024-09-12T01:02:38.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.lybLtmdkIIlHUl-gWS7-IICISjohu3U_0 2024-09-12T01:02:38.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8608830563919096713', time=2024-09-12T02:49:05.521251+0000, chain.objs.size()=1 2024-09-12T01:02:38.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.mwKxcOLevfwUvauEC1xt5ui35CEoEbz_0 2024-09-12T01:02:38.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4170748475680298424', time=2024-09-12T02:49:05.562132+0000, chain.objs.size()=1 2024-09-12T01:02:38.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.wyPfGJxoF0uPYaOVGZkOWiy9ShqDCbf_0 2024-09-12T01:02:38.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14688284138249126935', time=2024-09-12T02:49:05.764714+0000, chain.objs.size()=1 2024-09-12T01:02:38.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Wl6nQmtprlS_je35Lr9gMStUFEcpWnR_0 2024-09-12T01:02:38.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6821260199791806864', time=2024-09-12T02:49:05.778196+0000, chain.objs.size()=1 2024-09-12T01:02:38.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.uXOuDrSYOlKyI9xd7y3OnKru58Jmvfh_0 2024-09-12T01:02:38.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12558661615652401497', time=2024-09-12T02:49:05.979442+0000, chain.objs.size()=1 2024-09-12T01:02:38.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.UfPznXTDdiXiMU8_d5CGy-_oiwWty1g_0 2024-09-12T01:02:38.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4759186105643094735', time=2024-09-12T02:49:05.992132+0000, chain.objs.size()=1 2024-09-12T01:02:38.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.QBuurd0pS6dmBRHS-LpgRwokiHiUGEG_0 2024-09-12T01:02:38.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2145678915329682431', time=2024-09-12T02:49:06.081482+0000, chain.objs.size()=1 2024-09-12T01:02:38.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.qwJD5UQSWrQtckG5miaOSF3EVnHGsCX_0 2024-09-12T01:02:38.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1519408578756542382', time=2024-09-12T02:49:06.082275+0000, chain.objs.size()=1 2024-09-12T01:02:38.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.hd9Ddynu1yJl3miFscT2MF61yGI5t8z_0 2024-09-12T01:02:38.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16350488204111104367', time=2024-09-12T02:49:06.220147+0000, chain.objs.size()=1 2024-09-12T01:02:38.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.6DzFhPRpHKz9qpuhZGZdWoa-sTSGvvd_0 2024-09-12T01:02:38.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8656322575095107305', time=2024-09-12T02:49:06.249585+0000, chain.objs.size()=1 2024-09-12T01:02:38.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.RD4hhxg9nZ032iV_c5xuUbnULJHXDRH_0 2024-09-12T01:02:38.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15417401503510920999', time=2024-09-12T02:49:06.312207+0000, chain.objs.size()=1 2024-09-12T01:02:38.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Q10j4ZEmcA5YaLnUCxpjAcUCQbvCuXb_0 2024-09-12T01:02:38.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.635307510257539190', time=2024-09-12T02:49:06.351981+0000, chain.objs.size()=1 2024-09-12T01:02:38.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.xqL8UheUJmvafDk_2EqsLr5Pw-6hNSg_0 2024-09-12T01:02:38.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10427702510248666166', time=2024-09-12T02:49:06.477205+0000, chain.objs.size()=1 2024-09-12T01:02:38.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0Rhrfi3Dmf1HL-xuPNUjlPBa5Gj8GWz_0 2024-09-12T01:02:38.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15652748461895113377', time=2024-09-12T02:49:06.504782+0000, chain.objs.size()=1 2024-09-12T01:02:38.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.SsPFKNkEXe-lYYMdXgTKtBSsOAqkNoW_0 2024-09-12T01:02:38.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11800764396365436576', time=2024-09-12T02:49:06.516149+0000, chain.objs.size()=1 2024-09-12T01:02:38.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.MUfTfwc78JKut49osk3byXiZhEQtuES_0 2024-09-12T01:02:38.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16006977078931326062', time=2024-09-12T02:49:06.577330+0000, chain.objs.size()=1 2024-09-12T01:02:38.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.mP3HAanE9dtwGJODjYeLimewJE7P6cg_0 2024-09-12T01:02:38.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10459636103981780928', time=2024-09-12T02:49:06.596490+0000, chain.objs.size()=1 2024-09-12T01:02:38.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.uUJTAl2zfCJW6BeDBzgTeB8ZvrZpkD5_0 2024-09-12T01:02:38.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9089283328341629425', time=2024-09-12T02:49:06.602088+0000, chain.objs.size()=1 2024-09-12T01:02:38.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.FQQrYGwqHnwSSUGQ6j6XfFyqWA05-gR_0 2024-09-12T01:02:38.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.098+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5114384475901437213', time=2024-09-12T02:49:06.779180+0000, chain.objs.size()=1 2024-09-12T01:02:38.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.098+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.T1IhWy9FBq8QXtWIjzb8r4BXHrTyZLK_0 2024-09-12T01:02:38.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.098+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5983248828967922140', time=2024-09-12T02:49:06.867460+0000, chain.objs.size()=1 2024-09-12T01:02:38.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.098+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.lCAoLg-yjV8JqneI41muMHgUrpZkhXK_0 2024-09-12T01:02:38.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15325447404580725552', time=2024-09-12T02:49:06.902693+0000, chain.objs.size()=1 2024-09-12T01:02:38.096 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.CAWYwj_l4i9E8CQvbH2XZQdzUsRqBnm_0 2024-09-12T01:02:38.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4339291580531090713', time=2024-09-12T02:49:06.904495+0000, chain.objs.size()=1 2024-09-12T01:02:38.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0RKLQ3RxxcqhBlu_PYxB0yWI0ewil4Z_0 2024-09-12T01:02:38.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10955979768309861095', time=2024-09-12T02:49:07.146924+0000, chain.objs.size()=1 2024-09-12T01:02:38.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.4quJ9fodeOUy8xDRQc8cy1dpJda8yss_0 2024-09-12T01:02:38.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2823860028731226070', time=2024-09-12T02:49:07.156287+0000, chain.objs.size()=1 2024-09-12T01:02:38.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.dvMKxC3abLI3D6c8DSZl4My1jlHXe4Z_0 2024-09-12T01:02:38.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3402544742436108804', time=2024-09-12T02:49:07.208705+0000, chain.objs.size()=1 2024-09-12T01:02:38.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ZleeGgFpX7tB8KgoN4gEAPu3XaCbim__0 2024-09-12T01:02:38.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11578731489815555756', time=2024-09-12T02:49:07.421068+0000, chain.objs.size()=1 2024-09-12T01:02:38.097 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ftvyrWOsPRL8gHPSOq-Yx3K8szkzLFb_0 2024-09-12T01:02:38.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.50513668868609538', time=2024-09-12T02:49:11.150019+0000, chain.objs.size()=1 2024-09-12T01:02:38.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.267__shadow_.gjGNTMxMK-tXUjBH8QPaCsytKB1E2xi_0 2024-09-12T01:02:38.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2397835081320683183', time=2024-09-12T02:49:17.866264+0000, chain.objs.size()=1 2024-09-12T01:02:38.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.276__shadow_.HCGDz3uZFqHekGN4MWzSMPKKDN2C12b_0 2024-09-12T01:02:38.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10130919556103721371', time=2024-09-12T02:49:23.872552+0000, chain.objs.size()=1 2024-09-12T01:02:38.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.284__shadow_.p3lI43GqrW0u78r8iF02ftFpFrWn9l8_0 2024-09-12T01:02:38.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6882104260675161202', time=2024-09-12T02:49:27.698134+0000, chain.objs.size()=1 2024-09-12T01:02:38.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.289__shadow_.LLN-INL23N4xpwVQmGiLc0LeNA97zlq_0 2024-09-12T01:02:38.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1210798285193481506', time=2024-09-12T02:49:32.418245+0000, chain.objs.size()=1 2024-09-12T01:02:38.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.102+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.6SaG0KyN1XvxApniS5LXKUpZcZpgqrQ_0 2024-09-12T01:02:38.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3598306127030068087', time=2024-09-12T02:49:32.444319+0000, chain.objs.size()=1 2024-09-12T01:02:38.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.106+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.AF22OC6soOD7TE2mZdQdSSRwoWlXneB_0 2024-09-12T01:02:38.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5540401451790281758', time=2024-09-12T02:49:33.155505+0000, chain.objs.size()=1 2024-09-12T01:02:38.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.106+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.294__shadow_.Q6MV7v9zz-7i79hKDUiqtvKxtbErdNt_0 2024-09-12T01:02:38.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11004076633725995014', time=2024-09-12T02:49:34.631969+0000, chain.objs.size()=1 2024-09-12T01:02:38.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.106+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.296__shadow_.tqamXJDE1TnJ6Z99N5zH-imBnYD4Oo5_0 2024-09-12T01:02:38.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3182762289658596511', time=2024-09-12T02:49:36.170798+0000, chain.objs.size()=1 2024-09-12T01:02:38.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.106+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.298__shadow_.OLujcKyf6ooinL80RlkFaRDufbP_nH__0 2024-09-12T01:02:38.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16409443516870923033', time=2024-09-12T02:49:37.750379+0000, chain.objs.size()=1 2024-09-12T01:02:38.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.300__shadow_.epkJQyLJHY7rxUNQ6Xt2XU0U_mWkizy_0 2024-09-12T01:02:38.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9594025188331770431', time=2024-09-12T02:49:39.967844+0000, chain.objs.size()=1 2024-09-12T01:02:38.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.303__shadow_.IPm7wNZtCGIhxOqbCRq2CRQTN0zycil_0 2024-09-12T01:02:38.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15469753325392376723', time=2024-09-12T02:49:40.692331+0000, chain.objs.size()=1 2024-09-12T01:02:38.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.304__shadow_.aydgebAO4fMIeNEOp8Fm0qNPuz4YQLI_0 2024-09-12T01:02:38.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5346457230539741039', time=2024-09-12T02:50:15.799347+0000, chain.objs.size()=1 2024-09-12T01:02:38.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.eVEthkdeYgQSrTmjWH6n_ZHyUxdyuAJ_0 2024-09-12T01:02:38.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14318303394934156914', time=2024-09-12T02:50:15.859137+0000, chain.objs.size()=1 2024-09-12T01:02:38.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.mG2c3Pmyow2htrzdG4AeENaDP9URzLt_0 2024-09-12T01:02:38.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12287396820976894538', time=2024-09-12T02:50:15.885016+0000, chain.objs.size()=1 2024-09-12T01:02:38.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.hsrFCff7CHsUrAfP2-zJ7m-sDmt2E1o_0 2024-09-12T01:02:38.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12395966347810521904', time=2024-09-12T02:50:15.887552+0000, chain.objs.size()=1 2024-09-12T01:02:38.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.u_QyYky5lafUCT13Wj_kV9aQ376BBkW_0 2024-09-12T01:02:38.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7099500647174198471', time=2024-09-12T02:50:15.905393+0000, chain.objs.size()=1 2024-09-12T01:02:38.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.5HC0Qdwz1gUIOmlXCR1Tch9mA8RboLa_0 2024-09-12T01:02:38.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6576818190438523348', time=2024-09-12T02:50:15.914861+0000, chain.objs.size()=1 2024-09-12T01:02:38.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.RDnoRM_Wa322-vwGPt6bjUPftHRAm6F_0 2024-09-12T01:02:38.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2957971097019223536', time=2024-09-12T02:50:15.926817+0000, chain.objs.size()=1 2024-09-12T01:02:38.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.110+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.2JMlUWYnF1CIBsp8LqSGbYaBymEyVd__0 2024-09-12T01:02:38.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16952423411296942421', time=2024-09-12T02:50:15.965423+0000, chain.objs.size()=1 2024-09-12T01:02:38.108 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.vuO4pjKc-vzIqZ1SqByonUGtVxecsjE_0 2024-09-12T01:02:38.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11549196074263470938', time=2024-09-12T02:50:16.111808+0000, chain.objs.size()=1 2024-09-12T01:02:38.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.5MLk9cjjsBzRoqO8TJ3DyIBFTyljymh_0 2024-09-12T01:02:38.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13234772594452130466', time=2024-09-12T02:50:16.123684+0000, chain.objs.size()=1 2024-09-12T01:02:38.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.h_sdDVehh8kK9k1oZ52qHYpY2bnkBjI_0 2024-09-12T01:02:38.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17869724375088761744', time=2024-09-12T02:50:16.163821+0000, chain.objs.size()=1 2024-09-12T01:02:38.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ea6lBLK4FI7NIvcpJzOOry8aTeqEKml_0 2024-09-12T01:02:38.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15224162113384109828', time=2024-09-12T02:50:16.194648+0000, chain.objs.size()=1 2024-09-12T01:02:38.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4h_zr8znd3YfGLKc2e-FAa1Uw_0v5rf_0 2024-09-12T01:02:38.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6154558253707418063', time=2024-09-12T02:50:16.498771+0000, chain.objs.size()=1 2024-09-12T01:02:38.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.o4nFdO7DaFZfCpTB-DkgGZBV9yJs4Q8_0 2024-09-12T01:02:38.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8222343419151193130', time=2024-09-12T02:50:16.664754+0000, chain.objs.size()=1 2024-09-12T01:02:38.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6DTmFCoioF0HZ2Enbq_DIkytV8PjxPv_0 2024-09-12T01:02:38.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11696889964804991983', time=2024-09-12T02:50:16.742492+0000, chain.objs.size()=1 2024-09-12T01:02:38.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.KcFmRBAIjDET4_gSRHI_IHrJZ6vBsKB_0 2024-09-12T01:02:38.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8654996673955333827', time=2024-09-12T02:50:16.751399+0000, chain.objs.size()=1 2024-09-12T01:02:38.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6amUchzkEHuxv2i_Av-xqbOn2LdrP-G_0 2024-09-12T01:02:38.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10921035881456561469', time=2024-09-12T02:50:16.775629+0000, chain.objs.size()=1 2024-09-12T01:02:38.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.3jxsIYv3KVysHO-iEQhOSdfHR3FA4Nu_0 2024-09-12T01:02:38.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13646090099391835080', time=2024-09-12T02:50:16.886044+0000, chain.objs.size()=1 2024-09-12T01:02:38.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.difcoOdQc5AeF_hzQH-ZQS0EDt81YKW_0 2024-09-12T01:02:38.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6208696510348327180', time=2024-09-12T02:50:16.919931+0000, chain.objs.size()=1 2024-09-12T01:02:38.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.C_WasP8NyIinxkjtlAheQoCwMM8SAF8_0 2024-09-12T01:02:38.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14740802698508254938', time=2024-09-12T02:50:17.037896+0000, chain.objs.size()=1 2024-09-12T01:02:38.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.hK7S8BxO28y_69UalIWIayGwW4HEbZd_0 2024-09-12T01:02:38.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3283268508493322024', time=2024-09-12T02:50:17.131478+0000, chain.objs.size()=1 2024-09-12T01:02:38.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.O--IZhLB32UTtJ4p9wOVSnAiV9FK7kp_0 2024-09-12T01:02:38.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.546605162955979374', time=2024-09-12T02:50:17.195501+0000, chain.objs.size()=1 2024-09-12T01:02:38.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.BscGm_9biH_9xwL2NZKY5i42rwlDfT0_0 2024-09-12T01:02:38.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9018694814499663590', time=2024-09-12T02:50:17.200703+0000, chain.objs.size()=1 2024-09-12T01:02:38.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.WuBboRRZJE9YX_lH3kT_hBWjnzNarfo_0 2024-09-12T01:02:38.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8950163700581809329', time=2024-09-12T02:50:17.213497+0000, chain.objs.size()=1 2024-09-12T01:02:38.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.t3ofSQhrH6NDI_nuyLAl9jHnwq_v4ro_0 2024-09-12T01:02:38.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3686656365862336311', time=2024-09-12T02:50:17.234891+0000, chain.objs.size()=1 2024-09-12T01:02:38.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.EcfauNYxGrRu7LGWtInBHCGXqV9S8cb_0 2024-09-12T01:02:38.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17793605834977423136', time=2024-09-12T02:50:17.249033+0000, chain.objs.size()=1 2024-09-12T01:02:38.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xrXbVYuhHchuXA18q9KrJmSrPzjIlB5_0 2024-09-12T01:02:38.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.122+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8182975863901983113', time=2024-09-12T02:50:17.258758+0000, chain.objs.size()=1 2024-09-12T01:02:38.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.122+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.9RC_YizcX_fmVY0_STnX86hbh6ssQp7_0 2024-09-12T01:02:38.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.122+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13436226029929640466', time=2024-09-12T02:50:17.272854+0000, chain.objs.size()=1 2024-09-12T01:02:38.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.122+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xEcZYRrD3ggtZj56U8kb7a1YC_iisBe_0 2024-09-12T01:02:38.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.122+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11752446840917732853', time=2024-09-12T02:50:17.387717+0000, chain.objs.size()=1 2024-09-12T01:02:38.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.122+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.5U9ogugRhqDH1BxxSTQ0CrJWWSSQmXx_0 2024-09-12T01:02:38.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.122+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16058089423681238840', time=2024-09-12T02:50:17.490724+0000, chain.objs.size()=1 2024-09-12T01:02:38.119 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.122+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.2urme2wsiI1CtDwHD8IPSTaTeO8A2kW_0 2024-09-12T01:02:38.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.122+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.390063400895007944', time=2024-09-12T02:50:17.493193+0000, chain.objs.size()=1 2024-09-12T01:02:38.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.bOQQxqDTp4TeO04mEenH0Ve0o8Wv5Kf_0 2024-09-12T01:02:38.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10196747372828666189', time=2024-09-12T02:50:17.699175+0000, chain.objs.size()=1 2024-09-12T01:02:38.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.GmY6nhmbSussGXcrLxxPz13pdzDKVaB_0 2024-09-12T01:02:38.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6792887215497495905', time=2024-09-12T02:50:17.754760+0000, chain.objs.size()=1 2024-09-12T01:02:38.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.egPtZPWCmUrH7WwQoshVPFMDaLCMg6D_0 2024-09-12T01:02:38.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9815827182747925167', time=2024-09-12T02:50:17.760225+0000, chain.objs.size()=1 2024-09-12T01:02:38.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.MCaRZrz01aynU07bnteT2PoKNMYGaz4_0 2024-09-12T01:02:38.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12321196075056174769', time=2024-09-12T02:50:39.541532+0000, chain.objs.size()=1 2024-09-12T01:02:38.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ewygu0aVBzLxtv54IHNOWcGnAt3B6i3_0 2024-09-12T01:02:38.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13946918918620478530', time=2024-09-12T02:50:39.562872+0000, chain.objs.size()=1 2024-09-12T01:02:38.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.7jEsnb24Yocw9C6rPaNzWVT3FVNKTY-_0 2024-09-12T01:02:38.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1320580142605408639', time=2024-09-12T02:50:39.716531+0000, chain.objs.size()=1 2024-09-12T01:02:38.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Mfu5YzqZZXVOYdTYhO0g4BxwqJN2XG1_0 2024-09-12T01:02:38.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10100765316821049655', time=2024-09-12T02:50:39.752767+0000, chain.objs.size()=1 2024-09-12T01:02:38.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.zvDmUaJoyotuoFm5XU6-0WR5sYe-NQI_0 2024-09-12T01:02:38.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16117683884115914790', time=2024-09-12T02:50:39.778834+0000, chain.objs.size()=1 2024-09-12T01:02:38.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.T0VYqynoNn83zhhGAzJPn0gkyLD8scy_0 2024-09-12T01:02:38.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7264723778601964225', time=2024-09-12T02:50:39.784306+0000, chain.objs.size()=1 2024-09-12T01:02:38.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.PEcWESbazGOyzM4U0E17feRKm6ZNsNK_0 2024-09-12T01:02:38.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6394282447232726066', time=2024-09-12T02:50:39.822112+0000, chain.objs.size()=1 2024-09-12T01:02:38.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.PilaotpBV4QMcWsxSBRPNkkG4-vKeA4_0 2024-09-12T01:02:38.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.130+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14376287077556449865', time=2024-09-12T02:50:39.841767+0000, chain.objs.size()=1 2024-09-12T01:02:38.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.130+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.dvsaFQQ9yrTwMmEdzeOXB9lJB4sP8Ei_0 2024-09-12T01:02:38.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.130+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9789577979764228465', time=2024-09-12T02:50:39.867320+0000, chain.objs.size()=1 2024-09-12T01:02:38.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.130+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.uRg0bjR6QfyD_-d3lhFG5K8PR9yivmF_0 2024-09-12T01:02:38.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.130+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11341078060109695152', time=2024-09-12T02:50:40.057283+0000, chain.objs.size()=1 2024-09-12T01:02:38.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.130+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.nE6wWIAYV5Vecw_R5gN4Fu_pd2hg0th_0 2024-09-12T01:02:38.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1626706918466937804', time=2024-09-12T02:50:40.092752+0000, chain.objs.size()=1 2024-09-12T01:02:38.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.8Ks5QwY7e-o0HGwOUsKLlFkBJH4zaiQ_0 2024-09-12T01:02:38.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2052814299829869549', time=2024-09-12T02:50:40.110431+0000, chain.objs.size()=1 2024-09-12T01:02:38.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.DEYwAplObSyTFPL9t120yn4hiDIhykt_0 2024-09-12T01:02:38.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2587693390899077704', time=2024-09-12T02:50:40.608091+0000, chain.objs.size()=1 2024-09-12T01:02:38.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.qgqkj8eGSwRMfJAT9wrIRjhvmWE61pI_0 2024-09-12T01:02:38.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2418182489199068305', time=2024-09-12T02:50:40.629919+0000, chain.objs.size()=1 2024-09-12T01:02:38.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.PDFZbDmx8FbiliQscGufldG6mCQFJU5_0 2024-09-12T01:02:38.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15645145919445940363', time=2024-09-12T02:50:40.735406+0000, chain.objs.size()=1 2024-09-12T01:02:38.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.K6OKLv_xOhV8Bc9N0wAb3QZMqcG1EUE_0 2024-09-12T01:02:38.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9960776127472751287', time=2024-09-12T02:50:40.747892+0000, chain.objs.size()=1 2024-09-12T01:02:38.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.hhi5DTZjTG1uRVXdrBlcRIkBfjkJibD_0 2024-09-12T01:02:38.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5308377537754780511', time=2024-09-12T02:50:40.796046+0000, chain.objs.size()=1 2024-09-12T01:02:38.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.-Cg8oDvCIdJ9WCPvruMcFbYhmVAggI-_0 2024-09-12T01:02:38.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17389265644909970598', time=2024-09-12T02:50:40.820883+0000, chain.objs.size()=1 2024-09-12T01:02:38.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.F1LzfsS6gCDV6PKRjqcmmO-ULLxXmAa_0 2024-09-12T01:02:38.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13154379411738834208', time=2024-09-12T02:50:40.859043+0000, chain.objs.size()=1 2024-09-12T01:02:38.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.p50lBESub_2PzkihiazlVqvC6RAVDfJ_0 2024-09-12T01:02:38.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17339214304971419683', time=2024-09-12T02:50:41.106849+0000, chain.objs.size()=1 2024-09-12T01:02:38.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.z8cxJmAaJMwEGkoeXYIvhexwPN3ssMN_0 2024-09-12T01:02:38.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6783401914303550636', time=2024-09-12T02:50:41.137330+0000, chain.objs.size()=1 2024-09-12T01:02:38.132 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.mJGnhFqUMR6eusJqXuC5RpbEZTsOWIx_0 2024-09-12T01:02:38.134 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.138+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11380729070386231610', time=2024-09-12T02:50:41.351463+0000, chain.objs.size()=1 2024-09-12T01:02:38.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.138+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.qR201--oy-ct2yvSQMZFJGmrrRTjSR-_0 2024-09-12T01:02:38.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.138+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14864713105283873334', time=2024-09-12T02:50:41.359379+0000, chain.objs.size()=1 2024-09-12T01:02:38.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.138+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.JL2nKBBHwLxhSTbjTe41eOifEJrqf-1_0 2024-09-12T01:02:38.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.138+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10941748418099484722', time=2024-09-12T02:50:41.530100+0000, chain.objs.size()=1 2024-09-12T01:02:38.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.138+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.PeWl8TJkBItX2lwS8AExyRyf5_t88z4_0 2024-09-12T01:02:38.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.138+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15685579231925048344', time=2024-09-12T02:50:41.570537+0000, chain.objs.size()=1 2024-09-12T01:02:38.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.138+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.hmtzbMTnL8OOxw11A_-LXzoesvmOgSX_0 2024-09-12T01:02:38.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.146+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44645 2024-09-12T01:02:38.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T01:02:38.144 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13401260494124274147', time=2024-09-12T02:50:41.574082+0000, chain.objs.size()=1 2024-09-12T01:02:38.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.XTPJ1U9cJcS3TPQAz4I14Kxor50pJet_0 2024-09-12T01:02:38.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12492732696753613086', time=2024-09-12T02:50:41.588708+0000, chain.objs.size()=1 2024-09-12T01:02:38.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.pdxXzlMSXHYr7D3qj8AxvTSp0HBfHIt_0 2024-09-12T01:02:38.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12131786605957493578', time=2024-09-12T02:50:41.603148+0000, chain.objs.size()=1 2024-09-12T01:02:38.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.5JttA4Bl3SmgwfqcX7aN7N3BXKMUX7e_0 2024-09-12T01:02:38.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12503465004215689519', time=2024-09-12T02:50:41.608035+0000, chain.objs.size()=1 2024-09-12T01:02:38.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.2dMQwLBdIvTv217LlbWwu4K1qZOafLD_0 2024-09-12T01:02:38.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5464346138387297182', time=2024-09-12T02:51:19.744296+0000, chain.objs.size()=1 2024-09-12T01:02:38.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.381__shadow_.qyXHS7a_X-qfhNjVpjdip2anOMyWnSO_0 2024-09-12T01:02:38.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4325167631113369776', time=2024-09-12T02:52:04.772146+0000, chain.objs.size()=1 2024-09-12T01:02:38.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.441__shadow_.poIF8ZYtvtK-nj9G5irKhq838Ta-CQq_0 2024-09-12T01:02:38.145 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1380972670043481585', time=2024-09-12T02:52:41.589239+0000, chain.objs.size()=1 2024-09-12T01:02:38.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.490__shadow_.w-FtwpAjN05BgYj2r4tgynOU_r9kRTr_0 2024-09-12T01:02:38.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1380972670043481585', time=2024-09-12T02:52:41.799648+0000, chain.objs.size()=1 2024-09-12T01:02:38.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.490__shadow_.w-FtwpAjN05BgYj2r4tgynOU_r9kRTr_0 2024-09-12T01:02:38.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4576344504685245315', time=2024-09-12T02:52:50.179622+0000, chain.objs.size()=1 2024-09-12T01:02:38.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.503__shadow:kkpnEcohSrS0OmtT6cE4b1ngYotif0k_.RijEw510gCv7_gxNQ272Sla30v4Z_0T_0 2024-09-12T01:02:38.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14854519756010536729', time=2024-09-12T02:54:58.200089+0000, chain.objs.size()=1 2024-09-12T01:02:38.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.574__shadow_.ysWRZVsKhgN9CGDzNyx8FP7ROCXc6OX_0 2024-09-12T01:02:38.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8182133399474220795', time=2024-09-12T02:55:01.869024+0000, chain.objs.size()=1 2024-09-12T01:02:38.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.575__shadow_.Uj8Zox_ANEs-kSx4LsNmxBDwu1iPcuB_0 2024-09-12T01:02:38.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18225137308559864811', time=2024-09-12T02:55:05.012383+0000, chain.objs.size()=1 2024-09-12T01:02:38.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.576__shadow:116ZwTxviEOvuYHb5pdCS8AMCPWT7DO_.xRJHYiXMtcZHFzywEyXhH8y9Ifv3ssL_0 2024-09-12T01:02:38.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16468937858686979670', time=2024-09-12T02:55:08.638404+0000, chain.objs.size()=1 2024-09-12T01:02:38.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.154+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:cnN44p68K.7yOAsp7Pll0bpSmVHVaQH_.ZHMnZWqCDV2huVjz5f3LmUvIOMjGeUr_0 2024-09-12T01:02:38.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.154+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11124874513474846222', time=2024-09-12T02:55:18.691847+0000, chain.objs.size()=1 2024-09-12T01:02:38.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.154+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:YzYe7.ZtvPTCz1rlxO7WMjF252x44gL_.Yv5uD4vCJqobO2mHSvyPLST2J133b_C_0 2024-09-12T01:02:38.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.154+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6348896676583646433', time=2024-09-12T02:55:41.986147+0000, chain.objs.size()=1 2024-09-12T01:02:38.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.154+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.596__shadow_.K4N62b8iMakeQFYqDfLa51wxz_UaOLq_0 2024-09-12T01:02:38.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.154+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15760172123289444520', time=2024-09-12T02:55:41.988152+0000, chain.objs.size()=1 2024-09-12T01:02:38.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.154+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.596__shadow_.ii0K8QcJv3LLTRPYQkBPQfVTwB0QBAY_0 2024-09-12T01:02:38.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.154+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11720471201273231998', time=2024-09-12T02:55:48.328758+0000, chain.objs.size()=1 2024-09-12T01:02:38.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.154+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.606__shadow_.D6Aw-8BfAo25ndtXu9IJlDkoGXFTwfn_0 2024-09-12T01:02:38.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.154+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12245802535392837091', time=2024-09-12T02:58:08.040945+0000, chain.objs.size()=1 2024-09-12T01:02:38.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.154+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.618__shadow_.ab7D_5-lK1u7-mtAihJpWFvsILxzpY__0 2024-09-12T01:02:38.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.154+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4352938406888132310', time=2024-09-12T02:58:25.056464+0000, chain.objs.size()=1 2024-09-12T01:02:38.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.154+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.635__shadow_.30Qypbrd97eMJIBDA2ngKMC4pRNnxd2_0 2024-09-12T01:02:38.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.154+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4048336510968349791', time=2024-09-12T02:59:19.699221+0000, chain.objs.size()=1 2024-09-12T01:02:38.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.154+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.710__shadow:z2E4G9MZBYpytlPs1.6guucSOKojz5N_.JywLv3jtDeb0Kz1CZ1MTCMAdmyiFR1-_0 2024-09-12T01:02:38.153 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.158+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:38.156 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.158+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:02:38.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.157 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54997' 2024-09-12T01:02:38.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8298459478899508523', time=2024-09-12T02:46:06.163994+0000, chain.objs.size()=3 2024-09-12T01:02:38.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__multipart_foo-STANDARD.2~_Y18EHqCxMNgMQwn8kAsZVhb4KmemzI.1 2024-09-12T01:02:38.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__multipart_foo-STANDARD.2~_Y18EHqCxMNgMQwn8kAsZVhb4KmemzI.2 2024-09-12T01:02:38.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__multipart_foo-STANDARD.2~_Y18EHqCxMNgMQwn8kAsZVhb4KmemzI.3 2024-09-12T01:02:38.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10026118568292775886', time=2024-09-12T02:46:09.221640+0000, chain.objs.size()=1 2024-09-12T01:02:38.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.162__shadow_.aJFqnHtUzf6LbsPVN1BGUh1TddS8Wwh_0 2024-09-12T01:02:38.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6392013670986509349', time=2024-09-12T02:46:11.050793+0000, chain.objs.size()=1 2024-09-12T01:02:38.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.166__shadow_.xjuiRJtIdShjfXvvfTOdzmt1sxLyD9y_0 2024-09-12T01:02:38.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~qC595x7jSSyFbg-FuFrX_uXa3ZYvIIC', time=2024-09-12T02:46:52.181100+0000, chain.objs.size()=1 2024-09-12T01:02:38.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.202__multipart_mymultipart.2~qC595x7jSSyFbg-FuFrX_uXa3ZYvIIC.1 2024-09-12T01:02:38.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9473909255941821603', time=2024-09-12T02:48:21.228803+0000, chain.objs.size()=1 2024-09-12T01:02:38.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.233__shadow_.BhVnUtWAB3ryag4fDErPkQB9lSPeAzT_0 2024-09-12T01:02:38.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12766659994703424300', time=2024-09-12T02:48:21.963189+0000, chain.objs.size()=1 2024-09-12T01:02:38.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.234__shadow_.11-1IL219X24F_S27Q4ckBi-zUMjBRY_0 2024-09-12T01:02:38.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7955350417344559496', time=2024-09-12T02:48:21.966924+0000, chain.objs.size()=1 2024-09-12T01:02:38.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.234__shadow_.GlWKLVQQyHEBLedrSc59iiNVDNNc_Yl_0 2024-09-12T01:02:38.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3770343477113165120', time=2024-09-12T02:48:43.132680+0000, chain.objs.size()=1 2024-09-12T01:02:38.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.260__shadow_.ZWiKKpQKScI6QaNPxQjdTh-jZKekic-_0 2024-09-12T01:02:38.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18008386454254531595', time=2024-09-12T02:49:05.451203+0000, chain.objs.size()=1 2024-09-12T01:02:38.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.QT3bxnNcJ4dtvOtQ-NfWf_9YB7966e7_0 2024-09-12T01:02:38.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16851001616381515399', time=2024-09-12T02:49:05.508906+0000, chain.objs.size()=1 2024-09-12T01:02:38.161 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.SXY44kMt95u001PZQSprmrcGzcq16Rb_0 2024-09-12T01:02:38.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.166+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12082203616540271498', time=2024-09-12T02:49:05.547830+0000, chain.objs.size()=1 2024-09-12T01:02:38.162 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.166+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.vz7agHdfdZZHfTKICFD9HoDocIbCBX5_0 2024-09-12T01:02:38.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.166+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5833750625725676477', time=2024-09-12T02:49:05.562376+0000, chain.objs.size()=1 2024-09-12T01:02:38.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.166+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.JDxdZBNdkQ4qxQCcXdGj0MB6Sqpjiqs_0 2024-09-12T01:02:38.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.166+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16867591020874441058', time=2024-09-12T02:49:05.742248+0000, chain.objs.size()=1 2024-09-12T01:02:38.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.166+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.w7BCIoGdkd5_DgmTk_MKL9B7jYpvIYw_0 2024-09-12T01:02:38.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.170+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8113342717176595618', time=2024-09-12T02:49:05.753249+0000, chain.objs.size()=1 2024-09-12T01:02:38.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.170+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.sshCMLwygKJaV7OF8g-PAyZTpyre4qD_0 2024-09-12T01:02:38.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.170+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6080741657986809563', time=2024-09-12T02:49:05.777922+0000, chain.objs.size()=1 2024-09-12T01:02:38.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.170+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.aWjRQwIhKtIKJEzktYz09SdlE-8Uy5u_0 2024-09-12T01:02:38.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.170+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15674763829080443529', time=2024-09-12T02:49:05.849182+0000, chain.objs.size()=1 2024-09-12T01:02:38.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.170+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.1oWG-736oQtgqmBoMhHugPKgGNFS-6F_0 2024-09-12T01:02:38.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.170+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6121570357511838445', time=2024-09-12T02:49:05.854061+0000, chain.objs.size()=1 2024-09-12T01:02:38.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.170+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.S_bo4-704gOPKH7nnGLE49AnqpQRChZ_0 2024-09-12T01:02:38.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.170+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8326173586432300487', time=2024-09-12T02:49:06.074698+0000, chain.objs.size()=1 2024-09-12T01:02:38.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.170+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.WXacZKvVUbFIfgB_wZRz-seWPwncKs4_0 2024-09-12T01:02:38.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.170+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17311155433420885387', time=2024-09-12T02:49:06.247596+0000, chain.objs.size()=1 2024-09-12T01:02:38.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.170+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ao41tYNQtf5efme4OPOHxI4o3BL_Q7p_0 2024-09-12T01:02:38.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.170+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3202864223202683756', time=2024-09-12T02:49:06.257032+0000, chain.objs.size()=1 2024-09-12T01:02:38.166 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.170+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.1n39YkIqi94VYfQFyREhKu7KR37I3XR_0 2024-09-12T01:02:38.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.174+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10584412805997688583', time=2024-09-12T02:49:06.344684+0000, chain.objs.size()=1 2024-09-12T01:02:38.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.174+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.vilWm8sQ-xaNdwh5kkc1bsZtE8rnfgn_0 2024-09-12T01:02:38.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.174+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9106339500648050058', time=2024-09-12T02:49:06.379709+0000, chain.objs.size()=1 2024-09-12T01:02:38.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.174+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ZIi1NXej7GNfa1_yH-E0pQjSDeHRql4_0 2024-09-12T01:02:38.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.174+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16328052573234588956', time=2024-09-12T02:49:06.380436+0000, chain.objs.size()=1 2024-09-12T01:02:38.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.174+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.830qmyOmf3DoyNchPoJXFvhf23sG34W_0 2024-09-12T01:02:38.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.174+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16956686826766531787', time=2024-09-12T02:49:06.525171+0000, chain.objs.size()=1 2024-09-12T01:02:38.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.174+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.YU7kBYHe1JCGPwGJQpswnQBgfIvE-5I_0 2024-09-12T01:02:38.171 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.174+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2328576544574350620', time=2024-09-12T02:49:06.540767+0000, chain.objs.size()=1 2024-09-12T01:02:38.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.174+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.OvFcODlxRpvgtUYHH0V3-hmnhMtai88_0 2024-09-12T01:02:38.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.174+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7508272719826810931', time=2024-09-12T02:49:06.570554+0000, chain.objs.size()=1 2024-09-12T01:02:38.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.174+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.6_a4sE5mlqKzTZw7BX6VwZUMiDUmBZc_0 2024-09-12T01:02:38.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7105972008792189682', time=2024-09-12T02:49:06.614230+0000, chain.objs.size()=1 2024-09-12T01:02:38.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.dQi8p28aF3zvohFtXZcSQ-xeYkcg5va_0 2024-09-12T01:02:38.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3063887631858052984', time=2024-09-12T02:49:06.615712+0000, chain.objs.size()=1 2024-09-12T01:02:38.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.FqSugxhyFHOKyC8VFJVzR3IgS2OKMfL_0 2024-09-12T01:02:38.173 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1773181314368647874', time=2024-09-12T02:49:06.622495+0000, chain.objs.size()=1 2024-09-12T01:02:38.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.vIulO-YuhRM615G08-GrymXADms13oB_0 2024-09-12T01:02:38.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12182587711319235807', time=2024-09-12T02:49:06.628873+0000, chain.objs.size()=1 2024-09-12T01:02:38.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.taxah-4HGfEq1IWLZALpC58wBvULGXm_0 2024-09-12T01:02:38.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.192653058078111775', time=2024-09-12T02:49:06.634733+0000, chain.objs.size()=1 2024-09-12T01:02:38.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.FsIHkhfLKwWL2ZipxLCg_naHwIW--XL_0 2024-09-12T01:02:38.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1737620841480233376', time=2024-09-12T02:49:06.806337+0000, chain.objs.size()=1 2024-09-12T01:02:38.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.8ZW5WAuffoblMmPiHOcbgAcrpjiHC8O_0 2024-09-12T01:02:38.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14854575092802209633', time=2024-09-12T02:49:06.826360+0000, chain.objs.size()=1 2024-09-12T01:02:38.174 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.lHIIeLAdoakUQsx9gana0hJhL9gtn37_0 2024-09-12T01:02:38.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3390739144312578895', time=2024-09-12T02:49:06.827095+0000, chain.objs.size()=1 2024-09-12T01:02:38.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.tud5R1V1jrJ4hqtuf1_VqLOyZ5SZGvs_0 2024-09-12T01:02:38.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6196147196310365252', time=2024-09-12T02:49:06.870483+0000, chain.objs.size()=1 2024-09-12T01:02:38.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.178+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.TUI3R_Ncrz1qNi4CJrf1_5O-zDazKff_0 2024-09-12T01:02:38.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.212230406654007927', time=2024-09-12T02:49:06.874265+0000, chain.objs.size()=1 2024-09-12T01:02:38.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.UEQUnYRmJlwI_qjgOBCcAnXNM0D-x___0 2024-09-12T01:02:38.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13481666299845233139', time=2024-09-12T02:49:06.880285+0000, chain.objs.size()=1 2024-09-12T01:02:38.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.XAML-5F5yZRBe2mdXvCbSJexKfFDD1I_0 2024-09-12T01:02:38.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4154624743775619903', time=2024-09-12T02:49:06.899693+0000, chain.objs.size()=1 2024-09-12T01:02:38.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.fFc7H4HqTttISsP1arg0Atl22Bq9y5L_0 2024-09-12T01:02:38.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16276293240285648185', time=2024-09-12T02:49:06.911299+0000, chain.objs.size()=1 2024-09-12T01:02:38.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0GKEqqbBpaMvm43_JpPnYnKhefWamkv_0 2024-09-12T01:02:38.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4193201769748022954', time=2024-09-12T02:49:07.061899+0000, chain.objs.size()=1 2024-09-12T01:02:38.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.eGR-daIdmcX_tntXX-_aB_3C6NFpOy8_0 2024-09-12T01:02:38.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16836407780979658538', time=2024-09-12T02:49:07.218824+0000, chain.objs.size()=1 2024-09-12T01:02:38.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.UcoAfLN3ZQ7sN3WJ4ZXjRTqTkee0FB8_0 2024-09-12T01:02:38.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2101920372346455777', time=2024-09-12T02:49:07.349458+0000, chain.objs.size()=1 2024-09-12T01:02:38.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.TN1rylQlAQ63UNWOuoZQARrRz9CE-Qi_0 2024-09-12T01:02:38.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13304195206675590394', time=2024-09-12T02:49:07.358851+0000, chain.objs.size()=1 2024-09-12T01:02:38.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.4Bk6uzkNN5xnfOlrItmo05e9Ain7ehH_0 2024-09-12T01:02:38.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6917496588573089900', time=2024-09-12T02:49:07.405634+0000, chain.objs.size()=1 2024-09-12T01:02:38.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Q8lF9gjJ_2hpZugC1LImPvWDLkUvDTa_0 2024-09-12T01:02:38.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5667902608173561812', time=2024-09-12T02:49:07.414343+0000, chain.objs.size()=1 2024-09-12T01:02:38.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.hqFIzDRJXbloTnIfp9PxK2qDlZd5ZAg_0 2024-09-12T01:02:38.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4916937898309380769', time=2024-09-12T02:49:10.445592+0000, chain.objs.size()=1 2024-09-12T01:02:38.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.266__shadow_.YfvL4y7UVvyh36fTriWoxhoI3j_Oqg__0 2024-09-12T01:02:38.181 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2251832970161131844', time=2024-09-12T02:49:20.108976+0000, chain.objs.size()=1 2024-09-12T01:02:38.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.279__shadow_.dQ7fFFG-JSoiXpcia_BBEuZpx5KSiy9_0 2024-09-12T01:02:38.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10034617421596069740', time=2024-09-12T02:49:22.396509+0000, chain.objs.size()=1 2024-09-12T01:02:38.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.282__shadow_.gSpyhLJUrprpg3u_BEzT5XpmHRY6DHO_0 2024-09-12T01:02:38.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7289075561855296041', time=2024-09-12T02:49:23.130557+0000, chain.objs.size()=1 2024-09-12T01:02:38.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.283__shadow_.3gv8XJbNafXs4alLMFJ0odC_hx7mIgr_0 2024-09-12T01:02:38.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3425135487270344405', time=2024-09-12T02:49:30.967365+0000, chain.objs.size()=1 2024-09-12T01:02:38.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.ud3M0qgO3Bun6e4bHmW2XjMdQgpjCWl_0 2024-09-12T01:02:38.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16688073598145521954', time=2024-09-12T02:50:15.875077+0000, chain.objs.size()=1 2024-09-12T01:02:38.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.V09IBLN5IcmvfZqBpBq-brrU6eNhyVj_0 2024-09-12T01:02:38.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17204057872117859553', time=2024-09-12T02:50:15.885972+0000, chain.objs.size()=1 2024-09-12T01:02:38.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.iF_HGMjR828mkjmxnypV-Bo6HOaW7ni_0 2024-09-12T01:02:38.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7440141298693302642', time=2024-09-12T02:50:15.892598+0000, chain.objs.size()=1 2024-09-12T01:02:38.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.2S5L-06ozN72d7rk_ypZlS_g7dOx_v0_0 2024-09-12T01:02:38.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.839239994488138208', time=2024-09-12T02:50:15.926012+0000, chain.objs.size()=1 2024-09-12T01:02:38.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.oB3LPr_QkcZAVTH2glRmt84ScUja27u_0 2024-09-12T01:02:38.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18033839248105181017', time=2024-09-12T02:50:16.083457+0000, chain.objs.size()=1 2024-09-12T01:02:38.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.dh6WYhGlNNZBWqRmV-B1K0B6i_NwAbc_0 2024-09-12T01:02:38.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11340188881104578725', time=2024-09-12T02:50:16.101894+0000, chain.objs.size()=1 2024-09-12T01:02:38.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.57BiwHi9t3FvAGoUi83yz2Wige3XwpD_0 2024-09-12T01:02:38.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15905266286289920212', time=2024-09-12T02:50:16.113797+0000, chain.objs.size()=1 2024-09-12T01:02:38.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.h5ysFAZTR5Qpz5x2eb44BLLSRlAEeg4_0 2024-09-12T01:02:38.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.190+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9930865809881549929', time=2024-09-12T02:50:16.135337+0000, chain.objs.size()=1 2024-09-12T01:02:38.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.190+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.YpYYXXeHqGZdVDcvU8eaLKdmUea_Vv-_0 2024-09-12T01:02:38.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.190+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11339344922016501119', time=2024-09-12T02:50:16.180839+0000, chain.objs.size()=1 2024-09-12T01:02:38.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.190+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.czX6zUxZ_xJuxDycwoK_DQro8ktl7Fx_0 2024-09-12T01:02:38.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.190+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7252313274698300117', time=2024-09-12T02:50:16.238718+0000, chain.objs.size()=1 2024-09-12T01:02:38.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.190+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.f4XwYgKWUD8IcW2Zpwn9ZEaaB93VocL_0 2024-09-12T01:02:38.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.190+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7797376667621453194', time=2024-09-12T02:50:16.511948+0000, chain.objs.size()=1 2024-09-12T01:02:38.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.190+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6AuDwpL02SFd5LrYaYT8UL_D2BGSIEG_0 2024-09-12T01:02:38.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.190+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4241725558254246885', time=2024-09-12T02:50:16.515297+0000, chain.objs.size()=1 2024-09-12T01:02:38.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.190+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.IE-mB3CuPzCDJlLLmhZIbB-kWUVv85S_0 2024-09-12T01:02:38.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.194+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13801417888036643392', time=2024-09-12T02:50:16.683006+0000, chain.objs.size()=1 2024-09-12T01:02:38.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.194+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.5OuVMVVajYSoKElyJWnVgFZDsszTl3Z_0 2024-09-12T01:02:38.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.194+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5531096452586886722', time=2024-09-12T02:50:16.692653+0000, chain.objs.size()=1 2024-09-12T01:02:38.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.194+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.OaLV8nk6Y_Vcj8kAS4h946FWFCXKzem_0 2024-09-12T01:02:38.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.194+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11208276672890549655', time=2024-09-12T02:50:16.760728+0000, chain.objs.size()=1 2024-09-12T01:02:38.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.194+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.WmbX73FUUup9XYIC2UXyaXPnlvT6wX8_0 2024-09-12T01:02:38.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.194+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4693354099144766114', time=2024-09-12T02:50:16.775127+0000, chain.objs.size()=1 2024-09-12T01:02:38.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.194+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.8tozs_NRy0x9aIAPdwBjt4N9FkMqKBJ_0 2024-09-12T01:02:38.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.194+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8010515355297090177', time=2024-09-12T02:50:16.791578+0000, chain.objs.size()=1 2024-09-12T01:02:38.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.194+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-ipvVENKbIfBOtC_MPPAnSSO8TGTI_d_0 2024-09-12T01:02:38.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.194+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.463592925197543957', time=2024-09-12T02:50:16.909936+0000, chain.objs.size()=1 2024-09-12T01:02:38.190 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.194+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.BQ3l-cpxo_ah48mvHjb_V46NwSX6tyB_0 2024-09-12T01:02:38.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12020451208062757255', time=2024-09-12T02:50:16.934245+0000, chain.objs.size()=1 2024-09-12T01:02:38.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.cNbOP_qPCG8Rxs11jTLdMyPOBZokl71_0 2024-09-12T01:02:38.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8581235120818836170', time=2024-09-12T02:50:16.958488+0000, chain.objs.size()=1 2024-09-12T01:02:38.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6GVhwgOkNMTHG75Z2ZbQLDV0boGzyFD_0 2024-09-12T01:02:38.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17651706615776099866', time=2024-09-12T02:50:17.281212+0000, chain.objs.size()=1 2024-09-12T01:02:38.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.hBDgVCP15GoxxML-g1rk3NsjNGsp-bw_0 2024-09-12T01:02:38.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12018072999488456564', time=2024-09-12T02:50:17.387461+0000, chain.objs.size()=1 2024-09-12T01:02:38.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.eu7o6fTl4CQ12KA_-vFMWDdUqsZzJhQ_0 2024-09-12T01:02:38.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8156681548376270240', time=2024-09-12T02:50:17.391963+0000, chain.objs.size()=1 2024-09-12T01:02:38.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.GmnCEudCX_iDjSDeAZgEb63x3AzE4AB_0 2024-09-12T01:02:38.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2424610134150337795', time=2024-09-12T02:50:17.397655+0000, chain.objs.size()=1 2024-09-12T01:02:38.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.admpR32GM196ZcGmac5aAc3N9_jGjU5_0 2024-09-12T01:02:38.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7603266844020963027', time=2024-09-12T02:50:17.420123+0000, chain.objs.size()=1 2024-09-12T01:02:38.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.jqt_67VRZ2a6Ak2HS21D1O81Rg9Yqvn_0 2024-09-12T01:02:38.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11380938071572835735', time=2024-09-12T02:50:17.448641+0000, chain.objs.size()=1 2024-09-12T01:02:38.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.5KrJT1WBJNb-b2RNOQ-f-1BYmTkAmfS_0 2024-09-12T01:02:38.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4537783484033701667', time=2024-09-12T02:50:17.503762+0000, chain.objs.size()=1 2024-09-12T01:02:38.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.DRX58Y_J2pljGCZIiHiu7Jr-evRmeam_0 2024-09-12T01:02:38.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1275951277818543351', time=2024-09-12T02:50:17.528241+0000, chain.objs.size()=1 2024-09-12T01:02:38.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.IRvPp5gIZufXY92e0F3Ur3CCRPgGScg_0 2024-09-12T01:02:38.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10066672995502432161', time=2024-09-12T02:50:17.677936+0000, chain.objs.size()=1 2024-09-12T01:02:38.196 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Xci-1W5O9kp1SfjwsYYmAt8qXRJns9T_0 2024-09-12T01:02:38.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13064403646061071781', time=2024-09-12T02:50:17.724335+0000, chain.objs.size()=1 2024-09-12T01:02:38.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.sOe18VBDR29rmO4sy_FKnqaq_Y6KWZR_0 2024-09-12T01:02:38.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17076350439726050231', time=2024-09-12T02:50:17.730199+0000, chain.objs.size()=1 2024-09-12T01:02:38.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.KZ3FXnVTgTnGttNLBlbyE_j2WYp7Bwh_0 2024-09-12T01:02:38.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9810995285253368129', time=2024-09-12T02:50:39.546321+0000, chain.objs.size()=1 2024-09-12T01:02:38.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.dONSAjTJ9IUOVKLgiIwDaW3G71CzOyg_0 2024-09-12T01:02:38.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1287978302566281637', time=2024-09-12T02:50:39.559355+0000, chain.objs.size()=1 2024-09-12T01:02:38.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.XcWe-XhuAk6QP3Kf0OnmGhcorbxv0uU_0 2024-09-12T01:02:38.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11559060100047322281', time=2024-09-12T02:50:39.709147+0000, chain.objs.size()=1 2024-09-12T01:02:38.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.bbsAHnMVl3UDSFYcJI4zPCrGKkDv1C3_0 2024-09-12T01:02:38.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3916828028544517427', time=2024-09-12T02:50:39.822146+0000, chain.objs.size()=1 2024-09-12T01:02:38.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.AMjIY10ZdnKxM0zIpffgGpnQz_dY22k_0 2024-09-12T01:02:38.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1811628511053664357', time=2024-09-12T02:50:39.832845+0000, chain.objs.size()=1 2024-09-12T01:02:38.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.CAEvUqoWJzESwV5aTW3oV5NRdGYe0nM_0 2024-09-12T01:02:38.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1332596910891000203', time=2024-09-12T02:50:40.058275+0000, chain.objs.size()=1 2024-09-12T01:02:38.200 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.JLBSR3kHbi05SR17Qj0U9_WG5elGnrA_0 2024-09-12T01:02:38.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4350702983471434330', time=2024-09-12T02:50:40.105535+0000, chain.objs.size()=1 2024-09-12T01:02:38.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Q9CKRckh77AICMUMZiqMyHlKPPaTJ-2_0 2024-09-12T01:02:38.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.206+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3455723637609580195', time=2024-09-12T02:50:40.108872+0000, chain.objs.size()=1 2024-09-12T01:02:38.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.206+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.R5kSI7QYUMVDQ8wqCKq4Mj6GE8s1axM_0 2024-09-12T01:02:38.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.206+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4955287027238710554', time=2024-09-12T02:50:40.130110+0000, chain.objs.size()=1 2024-09-12T01:02:38.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.206+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.cYHlKvxXl_eSPnCJVY1D4H8jGF4LtgR_0 2024-09-12T01:02:38.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.210+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9790683459309988764', time=2024-09-12T02:50:40.145202+0000, chain.objs.size()=1 2024-09-12T01:02:38.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.210+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Oqntxbripvnmaj7DlzFiuNHGQNJGpTr_0 2024-09-12T01:02:38.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.210+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5500865906170618557', time=2024-09-12T02:50:40.343728+0000, chain.objs.size()=1 2024-09-12T01:02:38.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.210+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Msnkat5svYyeaDR1VGB1TXKI7jkL4hd_0 2024-09-12T01:02:38.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.210+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6356162765841813419', time=2024-09-12T02:50:40.582748+0000, chain.objs.size()=1 2024-09-12T01:02:38.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.210+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.aym0t5KQyVlp6IIi_1toOstaDSAFNFj_0 2024-09-12T01:02:38.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.210+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17943795677248115568', time=2024-09-12T02:50:40.597708+0000, chain.objs.size()=1 2024-09-12T01:02:38.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.210+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.IeQladMG2mES29s7zwe38pXXuBwao40_0 2024-09-12T01:02:38.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.210+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.281443880250834738', time=2024-09-12T02:50:40.837400+0000, chain.objs.size()=1 2024-09-12T01:02:38.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.210+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.6WEj9E0Heapba0jhSjKA_0t8SrM8gOW_0 2024-09-12T01:02:38.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.210+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.30317453612117428', time=2024-09-12T02:50:40.877699+0000, chain.objs.size()=1 2024-09-12T01:02:38.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.210+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.sm5_Wtt5DDqpA4DrkmrkPymQ-cXq_15_0 2024-09-12T01:02:38.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.210+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4931693820602945517', time=2024-09-12T02:50:40.898065+0000, chain.objs.size()=1 2024-09-12T01:02:38.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.210+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.SEdoiDZBSK0FmuAhoNQ6arFWm0wxxLK_0 2024-09-12T01:02:38.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.214+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3072295948689732005', time=2024-09-12T02:50:41.015765+0000, chain.objs.size()=1 2024-09-12T01:02:38.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.214+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.cjrs6u7FuS8rP68hfwLg4emSXG6sbjb_0 2024-09-12T01:02:38.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.214+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13222177345379478868', time=2024-09-12T02:50:41.082609+0000, chain.objs.size()=1 2024-09-12T01:02:38.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.214+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.apGcp139zsrJdOLrkx3TQxKkjRi2bLs_0 2024-09-12T01:02:38.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.214+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16128236327677533402', time=2024-09-12T02:50:41.276061+0000, chain.objs.size()=1 2024-09-12T01:02:38.209 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.214+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.0-7imc-huHPs9i99XlrZ47wy-_l7HWh_0 2024-09-12T01:02:38.212 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/54997 2024-09-12T01:02:38.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-12T01:02:38.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4129255507020096258', time=2024-09-12T02:50:41.283183+0000, chain.objs.size()=1 2024-09-12T01:02:38.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.n5Wknf70FDTOhBJI_UN93BRREIMFLZk_0 2024-09-12T01:02:38.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12048084165848431255', time=2024-09-12T02:50:41.285313+0000, chain.objs.size()=1 2024-09-12T01:02:38.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.mU6P4I-chLzQXx1pWA26bHiZrnuZn76_0 2024-09-12T01:02:38.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16520151294873216970', time=2024-09-12T02:50:41.312495+0000, chain.objs.size()=1 2024-09-12T01:02:38.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.fbefNwWuyoONsINmHFcfRFW7xnvc2Fc_0 2024-09-12T01:02:38.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14220316200573453014', time=2024-09-12T02:50:41.320073+0000, chain.objs.size()=1 2024-09-12T01:02:38.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Aj6uF_ecQNKz-vNBEuj_cTUHqngAqTU_0 2024-09-12T01:02:38.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10253320413943310282', time=2024-09-12T02:50:41.376844+0000, chain.objs.size()=1 2024-09-12T01:02:38.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.dxdMtj-rKNOSFBqPYzGJwYcAmmvIEKv_0 2024-09-12T01:02:38.216 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1296048778921695604', time=2024-09-12T02:50:41.415585+0000, chain.objs.size()=1 2024-09-12T01:02:38.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.YI_QYpR0FaDqoznpWyrcU8MGIfX9HO0_0 2024-09-12T01:02:38.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5170609999902741422', time=2024-09-12T02:50:41.421622+0000, chain.objs.size()=1 2024-09-12T01:02:38.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.54zowq3JcXsleSjehi_c8UHpYcbe8uW_0 2024-09-12T01:02:38.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2417192530145193041', time=2024-09-12T02:50:41.441070+0000, chain.objs.size()=1 2024-09-12T01:02:38.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.2pxnTgtH8B8OQ9kEdALfhCRCZisCDpC_0 2024-09-12T01:02:38.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14881570880760926756', time=2024-09-12T02:50:41.561602+0000, chain.objs.size()=1 2024-09-12T01:02:38.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.54AMo6PTgznl2jA-9ebUmv_RtACZkO-_0 2024-09-12T01:02:38.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15257623222042043873', time=2024-09-12T02:50:41.590832+0000, chain.objs.size()=1 2024-09-12T01:02:38.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.fQxX_X_GP8c78oTZVcn4CfZYesKQcAM_0 2024-09-12T01:02:38.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14635312549884402252', time=2024-09-12T02:50:41.596026+0000, chain.objs.size()=1 2024-09-12T01:02:38.217 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.P3YJ5qVcGAAHCo4b61b63BN037M9hdb_0 2024-09-12T01:02:38.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10824893042090012019', time=2024-09-12T02:50:47.519682+0000, chain.objs.size()=1 2024-09-12T01:02:38.218 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.333__shadow_.I6Wx0NG5qs3uBHS5c3QWZfBJE1AtDV2_0 2024-09-12T01:02:38.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3368584543935361682', time=2024-09-12T02:51:10.662911+0000, chain.objs.size()=1 2024-09-12T01:02:38.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.370__shadow_.ny5H_fVNbTL5gsXaUZPkn87mWli2hu2_0 2024-09-12T01:02:38.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7573998330562679314', time=2024-09-12T02:51:17.399276+0000, chain.objs.size()=1 2024-09-12T01:02:38.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.378__shadow_.LmA9iDcD13TpoBooNa0voEzlyOy1txk_0 2024-09-12T01:02:38.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3309183300558960307', time=2024-09-12T02:51:26.502384+0000, chain.objs.size()=1 2024-09-12T01:02:38.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.390__shadow_.OjEZinYQIozTEoU7d7_f4Qwa5K36HHi_0 2024-09-12T01:02:38.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1412005977899137004', time=2024-09-12T02:51:42.131576+0000, chain.objs.size()=1 2024-09-12T01:02:38.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.410__shadow_.XscuuilaacIxHwyTZCSAVjxzpK-lp43_0 2024-09-12T01:02:38.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12802517752522048947', time=2024-09-12T02:52:04.026921+0000, chain.objs.size()=1 2024-09-12T01:02:38.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.440__shadow_.xVYMRvD-3EybTmWqlYZ9h_ZCr77cjyq_0 2024-09-12T01:02:38.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15982872073545067094', time=2024-09-12T02:52:17.508468+0000, chain.objs.size()=1 2024-09-12T01:02:38.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.456__shadow_.-YQ8GG453h6Am95CZOvR1mV1RzNrNcu_0 2024-09-12T01:02:38.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18395799987767900736', time=2024-09-12T02:52:26.635243+0000, chain.objs.size()=1 2024-09-12T01:02:38.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.465__shadow_.yvVS9hoSvbzX0DTY8dQCUWvZhnWRpFs_0 2024-09-12T01:02:38.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3381268181979158307', time=2024-09-12T02:52:40.337270+0000, chain.objs.size()=1 2024-09-12T01:02:38.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.488__shadow_.sA3zdOmbof18POld1Hakl_hXTBEGvLB_0 2024-09-12T01:02:38.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~il96NKDVxQt7cmYzon1LczVVwP7c9RH', time=2024-09-12T02:53:42.979977+0000, chain.objs.size()=1 2024-09-12T01:02:38.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.533__multipart_mymultipart.2~il96NKDVxQt7cmYzon1LczVVwP7c9RH.1 2024-09-12T01:02:38.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6306784675885330234', time=2024-09-12T02:54:01.801827+0000, chain.objs.size()=1 2024-09-12T01:02:38.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.536__multipart_mymultipart.2~rp05E4moAtAY5-SEmedGXhumQ2ge3Gw.1 2024-09-12T01:02:38.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17647008080207191387', time=2024-09-12T02:54:29.231023+0000, chain.objs.size()=1 2024-09-12T01:02:38.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.226+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.556__shadow_.X7QnmgGBA1oDm1Vb12Qeqa4XXovF03s_0 2024-09-12T01:02:38.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.230+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3872453878786382469', time=2024-09-12T02:54:40.286983+0000, chain.objs.size()=2 2024-09-12T01:02:38.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.230+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.563__shadow_.8Y4IZbwqRqvOd_Xud9CQhFvWtKcYj1R_0 2024-09-12T01:02:38.227 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.230+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.563__shadow_.8Y4IZbwqRqvOd_Xud9CQhFvWtKcYj1R_1 2024-09-12T01:02:38.228 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.234+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8657769919532998386', time=2024-09-12T02:54:45.981148+0000, chain.objs.size()=1 2024-09-12T01:02:38.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:3e5yTVsLve.3rpsAEQPZrPs6xXxn5GI_.C67ZlZRXd1mulTkysxnMn2tFlC1qWs3_0 2024-09-12T01:02:38.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.234+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4548431083340392709', time=2024-09-12T02:55:19.890491+0000, chain.objs.size()=1 2024-09-12T01:02:38.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:soBbnrFuY.Yg8NUk4Iw9XoYrOQ4CNQP_.F0wFLi9U9IM1We3xGYfk6creYQckYja_0 2024-09-12T01:02:38.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.234+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17070198624027998579', time=2024-09-12T02:56:04.613348+0000, chain.objs.size()=6 2024-09-12T01:02:38.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.615__multipart_multipart_enc.2~HlrvD1HPy4Z3x6dOJmzh35ds-tSR1fM.1 2024-09-12T01:02:38.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.615__multipart_multipart_enc.2~HlrvD1HPy4Z3x6dOJmzh35ds-tSR1fM.2 2024-09-12T01:02:38.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.615__multipart_multipart_enc.2~HlrvD1HPy4Z3x6dOJmzh35ds-tSR1fM.3 2024-09-12T01:02:38.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.615__multipart_multipart_enc.2~HlrvD1HPy4Z3x6dOJmzh35ds-tSR1fM.4 2024-09-12T01:02:38.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.615__multipart_multipart_enc.2~HlrvD1HPy4Z3x6dOJmzh35ds-tSR1fM.5 2024-09-12T01:02:38.229 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.615__multipart_multipart_enc.2~HlrvD1HPy4Z3x6dOJmzh35ds-tSR1fM.6 2024-09-12T01:02:38.236 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.242+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:38.239 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.242+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:02:38.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50218' 2024-09-12T01:02:38.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='_g3OnfKHNO7BhekCDjatT51PjoDNhszh', time=2024-09-12T02:46:05.359815+0000, chain.objs.size()=1 2024-09-12T01:02:38.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.160__shadow_.0K1TuJ5fb_6TPFouhzbbayD6EqJA48p_0 2024-09-12T01:02:38.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='_nmj4F1ejw9t3tnM55m6IRLqp_e22R4p', time=2024-09-12T02:46:09.356201+0000, chain.objs.size()=1 2024-09-12T01:02:38.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.163__shadow_.HSHEv-tU7yyG32YvGAXclmvgT5oveXu_0 2024-09-12T01:02:38.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18004906827057810422', time=2024-09-12T02:46:25.931518+0000, chain.objs.size()=1 2024-09-12T01:02:38.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.176__shadow_.15YxY6QV4So4pVvuVqNpmmUUMTFT9gN_0 2024-09-12T01:02:38.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.875092295508128588', time=2024-09-12T02:48:28.878146+0000, chain.objs.size()=1 2024-09-12T01:02:38.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.242__shadow_.Hh9JxrAHeL4EtMX4fchmDZUByIpcFmp_0 2024-09-12T01:02:38.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2319799982954959359', time=2024-09-12T02:49:05.422886+0000, chain.objs.size()=1 2024-09-12T01:02:38.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.a87NGvzSY97TsfA-PIey2SJ5oYfSJ9__0 2024-09-12T01:02:38.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6374044652072462970', time=2024-09-12T02:49:05.468605+0000, chain.objs.size()=1 2024-09-12T01:02:38.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Kb5j-bLf2XTQccttLsyUBfkKwWO3h8B_0 2024-09-12T01:02:38.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2535020648697409307', time=2024-09-12T02:49:05.547108+0000, chain.objs.size()=1 2024-09-12T01:02:38.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.eCTIxhDZCkhSQ9iZ1qWIYGEDal60NrU_0 2024-09-12T01:02:38.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2911921744435115579', time=2024-09-12T02:49:05.807495+0000, chain.objs.size()=1 2024-09-12T01:02:38.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.4TyQHTdydpcqP07y-CYBrv9fmIoIWbZ_0 2024-09-12T01:02:38.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7092405503247091191', time=2024-09-12T02:49:05.830561+0000, chain.objs.size()=1 2024-09-12T01:02:38.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.iPF2Fnf1nDlTzUHkkc8nvlE7cIGQT7j_0 2024-09-12T01:02:38.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16062264783042253394', time=2024-09-12T02:49:05.843786+0000, chain.objs.size()=1 2024-09-12T01:02:38.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.APe5QUeKjPGRDiv7f6JdOqdYYjb5kF7_0 2024-09-12T01:02:38.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2492950461980430277', time=2024-09-12T02:49:06.297268+0000, chain.objs.size()=1 2024-09-12T01:02:38.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.NLxj4-GRQzb6jzozkWytkqzZTzyiZTj_0 2024-09-12T01:02:38.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6671697011038352968', time=2024-09-12T02:49:06.330831+0000, chain.objs.size()=1 2024-09-12T01:02:38.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.q_mMPFsb35GSV14L9jpMmEImW6pBKtR_0 2024-09-12T01:02:38.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.305984048686421879', time=2024-09-12T02:49:06.339653+0000, chain.objs.size()=1 2024-09-12T01:02:38.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.JBdX4Tc7cP9aIXw5LOwyqDTYBvTHowB_0 2024-09-12T01:02:38.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13619702017553842868', time=2024-09-12T02:49:06.504489+0000, chain.objs.size()=1 2024-09-12T01:02:38.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.LTk-ZafJJdw-ElByV8bQfNSyr0bQB2j_0 2024-09-12T01:02:38.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5016459894063940981', time=2024-09-12T02:49:06.636223+0000, chain.objs.size()=1 2024-09-12T01:02:38.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.NG7IB3vsgrKmAxoc_xZZGFO2lEpxeJd_0 2024-09-12T01:02:38.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15714649735104046386', time=2024-09-12T02:49:06.808268+0000, chain.objs.size()=1 2024-09-12T01:02:38.246 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.qpgYlCEv-_qupBXolBx0zmgFwJPoNmV_0 2024-09-12T01:02:38.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16979939433387932859', time=2024-09-12T02:49:07.070674+0000, chain.objs.size()=1 2024-09-12T01:02:38.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.OAC5h4I3HT07toYI9-V6aMqpeWXQRvQ_0 2024-09-12T01:02:38.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12186782013781746274', time=2024-09-12T02:49:07.093250+0000, chain.objs.size()=1 2024-09-12T01:02:38.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.OgFg4VIhOW6Clncpu-Aa9N6TqO-e4dX_0 2024-09-12T01:02:38.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14289847085474752296', time=2024-09-12T02:49:07.095343+0000, chain.objs.size()=1 2024-09-12T01:02:38.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.wOfYAicvi5jQkkLnwvlc0Hc_ulaoRLb_0 2024-09-12T01:02:38.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12393692509905737466', time=2024-09-12T02:49:07.217799+0000, chain.objs.size()=1 2024-09-12T01:02:38.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ED5aFgLp7hJBSd27tb-hY10Qc2GxSzg_0 2024-09-12T01:02:38.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12227182967724028451', time=2024-09-12T02:49:07.369672+0000, chain.objs.size()=1 2024-09-12T01:02:38.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.So4Pls6gac0EBhLXXwzT2Ft0_6P2tFS_0 2024-09-12T01:02:38.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16635229871957785697', time=2024-09-12T02:49:09.738791+0000, chain.objs.size()=1 2024-09-12T01:02:38.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.265__shadow_.dm7nSqrAQXiam_01rUsDHPmCWvmwjha_0 2024-09-12T01:02:38.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14494371341372714965', time=2024-09-12T02:49:18.586787+0000, chain.objs.size()=1 2024-09-12T01:02:38.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.250+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.277__shadow_.THj6NFopYCvxSjNZW5dcBcc83xyH0ss_0 2024-09-12T01:02:38.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5181254588413797358', time=2024-09-12T02:49:22.394788+0000, chain.objs.size()=1 2024-09-12T01:02:38.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.282__shadow_.uI7I0BmTRmFbuGAOELOpA-v80ejMTQw_0 2024-09-12T01:02:38.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.258+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6726587900015558154', time=2024-09-12T02:49:25.451581+0000, chain.objs.size()=1 2024-09-12T01:02:38.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.258+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.286__shadow_.cVD4ZZ3xEZmMnSMNW2dN7qyyKX5C2rf_0 2024-09-12T01:02:38.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.258+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12433933573849258369', time=2024-09-12T02:49:30.931298+0000, chain.objs.size()=1 2024-09-12T01:02:38.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.258+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.dCfdlpt8q9qSYumoGXUadiMyfRttJNu_0 2024-09-12T01:02:38.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.258+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3368788234353345538', time=2024-09-12T02:49:36.168941+0000, chain.objs.size()=1 2024-09-12T01:02:38.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.258+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.298__shadow_.yhouq8Kg5-Lgglxlvry2Wp3Ewyn0chY_0 2024-09-12T01:02:38.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.258+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15295816478945976753', time=2024-09-12T02:49:36.947034+0000, chain.objs.size()=1 2024-09-12T01:02:38.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.258+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.299__shadow_.WFmZJ7AAeML_-a3Ajg5YyzV066rlzJL_0 2024-09-12T01:02:38.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.258+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15047509894349753196', time=2024-09-12T02:49:36.949112+0000, chain.objs.size()=1 2024-09-12T01:02:38.254 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.258+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.299__shadow_.ML9K6nEsEBkm13TzsXtuEAccu3xqlX-_0 2024-09-12T01:02:38.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17881564601657096278', time=2024-09-12T02:50:15.853890+0000, chain.objs.size()=1 2024-09-12T01:02:38.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.TDuxVhoiIv-Mcqujg6Se3lbqVLRmwcP_0 2024-09-12T01:02:38.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18365801369253072924', time=2024-09-12T02:50:15.952171+0000, chain.objs.size()=1 2024-09-12T01:02:38.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4y6mfnjyn4zG5v_wojXumLZXu-U-vJp_0 2024-09-12T01:02:38.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16572010235335669240', time=2024-09-12T02:50:16.139208+0000, chain.objs.size()=1 2024-09-12T01:02:38.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4qiXBKXlIEhGHryYViKN6MLQM2ahVLd_0 2024-09-12T01:02:38.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16037997619896788396', time=2024-09-12T02:50:16.184604+0000, chain.objs.size()=1 2024-09-12T01:02:38.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.r7kRdzFOgXNvLCT3O2P0lcrrtJk1jVN_0 2024-09-12T01:02:38.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1595630093662102793', time=2024-09-12T02:50:16.193047+0000, chain.objs.size()=1 2024-09-12T01:02:38.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.nWOaK_C8WIJIuM4H7mWVXV18Cyoa5Ce_0 2024-09-12T01:02:38.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17586803551401292226', time=2024-09-12T02:50:16.215210+0000, chain.objs.size()=1 2024-09-12T01:02:38.258 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xzSAHuE5Uu6fihLQT4U7ZXrmjBIxDq__0 2024-09-12T01:02:38.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1637157274152004896', time=2024-09-12T02:50:16.234399+0000, chain.objs.size()=1 2024-09-12T01:02:38.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.wjAaTRPGS-XjE8hkkVvTlfF8GTnJZ88_0 2024-09-12T01:02:38.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3136415306396688666', time=2024-09-12T02:50:16.391662+0000, chain.objs.size()=1 2024-09-12T01:02:38.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.rhIalzjovHhBFOBE3sbx4HK3SLVQZ7Q_0 2024-09-12T01:02:38.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2821552412791799589', time=2024-09-12T02:50:16.402677+0000, chain.objs.size()=1 2024-09-12T01:02:38.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.HkD90K7vFiNANNIJlPgppHQeShvQi3S_0 2024-09-12T01:02:38.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9593841699450564752', time=2024-09-12T02:50:16.418661+0000, chain.objs.size()=1 2024-09-12T01:02:38.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.abLsGF4ALhdQmKLrN5VU0eN-ip9ZGE9_0 2024-09-12T01:02:38.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3984180130353600216', time=2024-09-12T02:50:16.424078+0000, chain.objs.size()=1 2024-09-12T01:02:38.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.G8pwrWo5v578ew5Nu6UpLvlIaHhczm4_0 2024-09-12T01:02:38.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9419963350916504502', time=2024-09-12T02:50:16.430527+0000, chain.objs.size()=1 2024-09-12T01:02:38.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.edKojZ-yM1RZgLUiAItIE1t_YZ1v8At_0 2024-09-12T01:02:38.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5183158409843012637', time=2024-09-12T02:50:16.432172+0000, chain.objs.size()=1 2024-09-12T01:02:38.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.mAjGrMdQWt6fRYjMfZ2qz-ZboUoqq_C_0 2024-09-12T01:02:38.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12167475454275487963', time=2024-09-12T02:50:16.440026+0000, chain.objs.size()=1 2024-09-12T01:02:38.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.PtFxNw_26VxZJ_4kLifPGq_DVDZFsRG_0 2024-09-12T01:02:38.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15965873033340698073', time=2024-09-12T02:50:16.445529+0000, chain.objs.size()=1 2024-09-12T01:02:38.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.epjnwE3y9Ou5mra7nQuhr_6LQwikEHX_0 2024-09-12T01:02:38.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11194087385771562999', time=2024-09-12T02:50:16.476728+0000, chain.objs.size()=1 2024-09-12T01:02:38.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.zTyvUAEVtN6UeptA2YJodtTrgkWEk2M_0 2024-09-12T01:02:38.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9659391919529435719', time=2024-09-12T02:50:16.495596+0000, chain.objs.size()=1 2024-09-12T01:02:38.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.SFWy-9pajetZhmUahly7is-WynaPS2k_0 2024-09-12T01:02:38.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3411568200035097828', time=2024-09-12T02:50:16.679678+0000, chain.objs.size()=1 2024-09-12T01:02:38.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.44ayJalFqaOrUNQSrtVzKgDfAftIgOS_0 2024-09-12T01:02:38.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6538451202895426415', time=2024-09-12T02:50:16.699512+0000, chain.objs.size()=1 2024-09-12T01:02:38.264 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6eezby3h0PdfSw-v0WEoXFfldVgCOU0_0 2024-09-12T01:02:38.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15559506015165566063', time=2024-09-12T02:50:16.724310+0000, chain.objs.size()=1 2024-09-12T01:02:38.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.9RRtitRoqt7JZ_Q40GbfrCNpfauBJRR_0 2024-09-12T01:02:38.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18311773784048025968', time=2024-09-12T02:50:16.732756+0000, chain.objs.size()=1 2024-09-12T01:02:38.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.XGJlq81EFgPTSuFLlMdn7IZVc_25MDv_0 2024-09-12T01:02:38.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.270+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11036137344453441011', time=2024-09-12T02:50:16.757971+0000, chain.objs.size()=1 2024-09-12T01:02:38.265 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.270+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.EmkH0h5IZifkX0o2EVJe318mHbWP_i6_0 2024-09-12T01:02:38.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.270+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8641153349159342277', time=2024-09-12T02:50:16.774693+0000, chain.objs.size()=1 2024-09-12T01:02:38.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.270+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Ws4DGMdZURszxkBIeawCT4PY5HovwvA_0 2024-09-12T01:02:38.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.270+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6797730808279503175', time=2024-09-12T02:50:16.889057+0000, chain.objs.size()=1 2024-09-12T01:02:38.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.270+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.I9QB2eTK3K-AO3wjGzLDtdfIYxT3K5M_0 2024-09-12T01:02:38.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5722785199209016606', time=2024-09-12T02:50:16.897200+0000, chain.objs.size()=1 2024-09-12T01:02:38.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.5dRhg_L-AKhJtOyTtiyk3rndHxsDfP5_0 2024-09-12T01:02:38.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13368411416652977355', time=2024-09-12T02:50:16.972955+0000, chain.objs.size()=1 2024-09-12T01:02:38.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.YvXPdSSzO5N9nQh9JHnukP8hM3_xXx9_0 2024-09-12T01:02:38.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10129687139953684695', time=2024-09-12T02:50:17.031262+0000, chain.objs.size()=1 2024-09-12T01:02:38.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.M0Y43hKgV7c1a1bjkqaIbcq7PXVFToR_0 2024-09-12T01:02:38.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7679649412870496626', time=2024-09-12T02:50:17.037177+0000, chain.objs.size()=1 2024-09-12T01:02:38.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.vis54YAxbwnTMMEQ-GWzIkucS24NzsI_0 2024-09-12T01:02:38.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9570674788834740645', time=2024-09-12T02:50:17.168401+0000, chain.objs.size()=1 2024-09-12T01:02:38.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.PmmE9zsur8gI808HRdbMqx346NIGwlM_0 2024-09-12T01:02:38.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17474837748306025976', time=2024-09-12T02:50:17.185060+0000, chain.objs.size()=1 2024-09-12T01:02:38.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.DMhMZ_zhwMwaDb6DITgXZkdXRMuUkmb_0 2024-09-12T01:02:38.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10545796268164433979', time=2024-09-12T02:50:17.196794+0000, chain.objs.size()=1 2024-09-12T01:02:38.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.UVC5XXFm816Y1XjPShkuktQc2lIuMA5_0 2024-09-12T01:02:38.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11879443150009468531', time=2024-09-12T02:50:17.220310+0000, chain.objs.size()=1 2024-09-12T01:02:38.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.VxtUpqBKZRCkts16bdaD6okfn7nREIa_0 2024-09-12T01:02:38.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15695745451825162200', time=2024-09-12T02:50:17.270199+0000, chain.objs.size()=1 2024-09-12T01:02:38.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.gtGlvpexQAIiQMLCEv4Lj9zMbDaWb9F_0 2024-09-12T01:02:38.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15219164007944492402', time=2024-09-12T02:50:17.283647+0000, chain.objs.size()=1 2024-09-12T01:02:38.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.274+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xx86PjLVRSpw7kklroYA3cXHs9aCWSv_0 2024-09-12T01:02:38.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6263525192679910315', time=2024-09-12T02:50:17.423683+0000, chain.objs.size()=1 2024-09-12T01:02:38.273 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.gCT9WP85d5b0cUox9mVZ5cuUmjV2Tdn_0 2024-09-12T01:02:38.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10054953159956993260', time=2024-09-12T02:50:17.428758+0000, chain.objs.size()=1 2024-09-12T01:02:38.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.B7CuwadS2jloO-BxpbKEQWI0avxS48p_0 2024-09-12T01:02:38.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11691328194183939770', time=2024-09-12T02:50:17.438099+0000, chain.objs.size()=1 2024-09-12T01:02:38.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.VmuSjbWa7QIIBMuu-sgXhzL0G6jnKO1_0 2024-09-12T01:02:38.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6723806992156277291', time=2024-09-12T02:50:17.467271+0000, chain.objs.size()=1 2024-09-12T01:02:38.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.40dd-aPMvl2DIDbmTgxC4RVllwci6zO_0 2024-09-12T01:02:38.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7477745801168008336', time=2024-09-12T02:50:17.469751+0000, chain.objs.size()=1 2024-09-12T01:02:38.274 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.t7Kr79AUdazqHLRY6JevRdndFvEYqux_0 2024-09-12T01:02:38.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3646815415613233362', time=2024-09-12T02:50:17.474968+0000, chain.objs.size()=1 2024-09-12T01:02:38.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.e7Pm9VLjRt1kmh-r0TxtwlBFOIcW9-U_0 2024-09-12T01:02:38.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17421603859940954161', time=2024-09-12T02:50:17.479604+0000, chain.objs.size()=1 2024-09-12T01:02:38.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.jCqkRdm2_y0fLq1zCsKgNF3fxTIdTbx_0 2024-09-12T01:02:38.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17195947351321498495', time=2024-09-12T02:50:17.521245+0000, chain.objs.size()=1 2024-09-12T01:02:38.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.vwc8lNIZlZiVZMQ8inJkxbaRdqn2vG7_0 2024-09-12T01:02:38.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14430368771182910609', time=2024-09-12T02:50:17.532111+0000, chain.objs.size()=1 2024-09-12T01:02:38.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.eczC4XW7UxW6AqYsc0VKZKCO8UCbmJW_0 2024-09-12T01:02:38.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8538548227806733706', time=2024-09-12T02:50:17.540049+0000, chain.objs.size()=1 2024-09-12T01:02:38.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.utAJqpEZV5SBqBoURGupMqyeBVwa7O1_0 2024-09-12T01:02:38.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.282+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18330763836347502521', time=2024-09-12T02:50:17.679270+0000, chain.objs.size()=1 2024-09-12T01:02:38.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.282+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6yNKNTjK8dwdZQgwBKi48lZZMmUa0xz_0 2024-09-12T01:02:38.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.282+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10263681684867085575', time=2024-09-12T02:50:17.682596+0000, chain.objs.size()=1 2024-09-12T01:02:38.279 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.282+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.i-A1p3r_Ft8d--4pMG2-7UyNrYO6AGY_0 2024-09-12T01:02:38.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.282+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13946963919492471145', time=2024-09-12T02:50:17.721466+0000, chain.objs.size()=1 2024-09-12T01:02:38.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.282+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.zuA42yuES_zL8byKWrM4t7FfFKPjfbM_0 2024-09-12T01:02:38.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.282+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6465242147938024751', time=2024-09-12T02:50:17.731328+0000, chain.objs.size()=1 2024-09-12T01:02:38.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.282+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xQ9y3fit4QF_f-6HYMXkcHvOTBa3mlH_0 2024-09-12T01:02:38.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.282+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10765048979825167526', time=2024-09-12T02:50:39.479671+0000, chain.objs.size()=1 2024-09-12T01:02:38.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.282+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.wDSXVAqts_pWJNNYb97Nns_Vrg9pc7a_0 2024-09-12T01:02:38.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.282+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16738215388655652776', time=2024-09-12T02:50:39.575123+0000, chain.objs.size()=1 2024-09-12T01:02:38.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.282+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.6vLY-BN1CjHS6WYQXro5KMK51PmMYe4_0 2024-09-12T01:02:38.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.286+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1156544767908258973', time=2024-09-12T02:50:39.711597+0000, chain.objs.size()=1 2024-09-12T01:02:38.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.286+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.irDucikSgERg4tqoyUcPeY-hzzPyyzd_0 2024-09-12T01:02:38.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.286+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8310372196493134525', time=2024-09-12T02:50:39.717735+0000, chain.objs.size()=1 2024-09-12T01:02:38.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.286+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.v_6A0_Ogaei6wDIdMkeL3LLImmowMZz_0 2024-09-12T01:02:38.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.286+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8947785687430033055', time=2024-09-12T02:50:39.776526+0000, chain.objs.size()=1 2024-09-12T01:02:38.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.286+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.LWfQ3cfWNFhPEDtkdKuG2bHKNvs8_YC_0 2024-09-12T01:02:38.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.286+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2190583379587217086', time=2024-09-12T02:50:39.820592+0000, chain.objs.size()=1 2024-09-12T01:02:38.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.286+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.8RozoVn_58ZPQumucLVYhbuFZQeP4BN_0 2024-09-12T01:02:38.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.286+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6142887724772396848', time=2024-09-12T02:50:39.821324+0000, chain.objs.size()=1 2024-09-12T01:02:38.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.286+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Mlec8CmLwqezadA2ag4Et6zrXe-7hdt_0 2024-09-12T01:02:38.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.286+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.79344034251935408', time=2024-09-12T02:50:39.836841+0000, chain.objs.size()=1 2024-09-12T01:02:38.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.286+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.u-45WXontLL4cOMeX-yFMjoemGeudyy_0 2024-09-12T01:02:38.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1185784470500465238', time=2024-09-12T02:50:39.859933+0000, chain.objs.size()=1 2024-09-12T01:02:38.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.290+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.oK4NGTgytpV-h1Smq_MtNylRyrgpEaY_0 2024-09-12T01:02:38.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12206082936099332266', time=2024-09-12T02:50:39.986450+0000, chain.objs.size()=1 2024-09-12T01:02:38.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.290+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.qvaJLzMt3M1GUEhEwL78vo2nL0W4CSs_0 2024-09-12T01:02:38.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11931106440295649783', time=2024-09-12T02:50:40.083607+0000, chain.objs.size()=1 2024-09-12T01:02:38.287 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.290+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.bleZE_CCPbw57IRzP4rAchs_34H65j3_0 2024-09-12T01:02:38.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9991657634963868689', time=2024-09-12T02:50:40.259918+0000, chain.objs.size()=1 2024-09-12T01:02:38.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.290+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.6N6QZ-2rt1t2uPA6NThv9HJNtcpNSfk_0 2024-09-12T01:02:38.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17431479263182205498', time=2024-09-12T02:50:40.751386+0000, chain.objs.size()=1 2024-09-12T01:02:38.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.PmOR7QCKqx43Ny3RsAUzNG6VvT-mjsB_0 2024-09-12T01:02:38.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16579170976811613858', time=2024-09-12T02:50:40.798890+0000, chain.objs.size()=1 2024-09-12T01:02:38.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.c-Trb2HxrrUeD9_DCtdlf8SO812co8l_0 2024-09-12T01:02:38.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12688117347490603032', time=2024-09-12T02:50:40.854522+0000, chain.objs.size()=1 2024-09-12T01:02:38.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.lyuL27US03U6esVef8AI3IIAWneh-qB_0 2024-09-12T01:02:38.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11895256271743609232', time=2024-09-12T02:50:40.860242+0000, chain.objs.size()=1 2024-09-12T01:02:38.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.9Wc28XELg4hLmVhVpTVf7HZrK59Om-n_0 2024-09-12T01:02:38.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11032365302857520287', time=2024-09-12T02:50:40.868296+0000, chain.objs.size()=1 2024-09-12T01:02:38.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.KmQw9IifglJpXBF6szJfeVzU54Ow6cJ_0 2024-09-12T01:02:38.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14249019002282353425', time=2024-09-12T02:50:40.879394+0000, chain.objs.size()=1 2024-09-12T01:02:38.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.YU3IBXbCm3k62637rskATxSNarVT3pD_0 2024-09-12T01:02:38.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10973931888542826011', time=2024-09-12T02:50:40.887709+0000, chain.objs.size()=1 2024-09-12T01:02:38.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.d455hTSebTv4nAY2qk1NnRmtTvDW9zo_0 2024-09-12T01:02:38.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.298+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10258226934931108617', time=2024-09-12T02:50:40.892120+0000, chain.objs.size()=1 2024-09-12T01:02:38.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.298+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_._Rghp5fiQ4A6XIu9dWmO6Y2TApkww7a_0 2024-09-12T01:02:38.292 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.298+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4290450685665458637', time=2024-09-12T02:50:41.014061+0000, chain.objs.size()=1 2024-09-12T01:02:38.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.298+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.bwGFAC2daDR2i-AFXNA8Sl8C1bw9wX7_0 2024-09-12T01:02:38.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.298+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2978282398972492369', time=2024-09-12T02:50:41.045747+0000, chain.objs.size()=1 2024-09-12T01:02:38.293 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.298+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.v_21B0vP7HlyNz10Hc9XWaSijDAir8P_0 2024-09-12T01:02:38.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.298+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9677698454647178749', time=2024-09-12T02:50:41.088928+0000, chain.objs.size()=1 2024-09-12T01:02:38.294 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.298+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.5_wrWgZ3rlD4mLA7GIHWk_oQFD9GDG5_0 2024-09-12T01:02:38.297 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/50218 2024-09-12T01:02:38.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T01:02:38.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14138771736424718067', time=2024-09-12T02:50:41.101374+0000, chain.objs.size()=1 2024-09-12T01:02:38.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.LkD3nTGApz7zMKC1LWRzNcAOiD7aDt6_0 2024-09-12T01:02:38.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12762302072033882504', time=2024-09-12T02:50:41.108819+0000, chain.objs.size()=1 2024-09-12T01:02:38.300 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ORKO5qRTFaSG-UpvT8WJ_RvXvNe5fT2_0 2024-09-12T01:02:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11843969367419357543', time=2024-09-12T02:50:41.313446+0000, chain.objs.size()=1 2024-09-12T01:02:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.v-wVtOzwi5RcTJ8PNMvBgeDnZEbmXUV_0 2024-09-12T01:02:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12725278215026693468', time=2024-09-12T02:50:41.562603+0000, chain.objs.size()=1 2024-09-12T01:02:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ji83lDgkn_09N7JBSEVn0ZejU9Vb-Ls_0 2024-09-12T01:02:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5213113859303734243', time=2024-09-12T02:50:41.597287+0000, chain.objs.size()=1 2024-09-12T01:02:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.alcIduKZ2KhHPWV9KhE-McAeLk8ybws_0 2024-09-12T01:02:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11429264970795010461', time=2024-09-12T02:50:42.864375+0000, chain.objs.size()=1 2024-09-12T01:02:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.326__shadow_.5ZXwuXULYjC4o8WkiHjcX4iolVoPYwH_0 2024-09-12T01:02:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15896337984436020424', time=2024-09-12T02:51:17.969724+0000, chain.objs.size()=1 2024-09-12T01:02:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.379__shadow_._CBZ_lSwY6L7AQ6DCTa9teJvyQ0ce73_0 2024-09-12T01:02:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11850781024106648393', time=2024-09-12T02:51:22.095442+0000, chain.objs.size()=1 2024-09-12T01:02:38.301 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.384__shadow_.WD23I3PXmlKLL0yIcUTKB8POP2qUqFH_0 2024-09-12T01:02:38.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6018916801434012912', time=2024-09-12T02:52:38.736933+0000, chain.objs.size()=3 2024-09-12T01:02:38.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.486__shadow_.VRPSIR4SAzXCdEWz6BDQlp2bte-vC-c_0 2024-09-12T01:02:38.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.486__shadow_.VRPSIR4SAzXCdEWz6BDQlp2bte-vC-c_1 2024-09-12T01:02:38.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.486__shadow_.VRPSIR4SAzXCdEWz6BDQlp2bte-vC-c_2 2024-09-12T01:02:38.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14292283901483932616', time=2024-09-12T02:54:45.564018+0000, chain.objs.size()=1 2024-09-12T01:02:38.302 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:Iskz4N-csRI3YxzuUzMVlVQa6lyf8x1_.tQ24T6iHNjuuyhmcUsilGYr5x3Vn27L_0 2024-09-12T01:02:38.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.306+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3925889630046552637', time=2024-09-12T02:54:46.299698+0000, chain.objs.size()=1 2024-09-12T01:02:38.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.306+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:AC8SHWOCsN8EVl9gjld7JddTWs1XyKU_.F4C7ZJL3K6jg0sMWR5Wo5afAeTQb5cO_0 2024-09-12T01:02:38.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8110683978470585472', time=2024-09-12T02:55:21.336343+0000, chain.objs.size()=1 2024-09-12T01:02:38.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:XaWTmJT72y.c3OJDR5viFH3jzEvFwnu_.fIlwKUjJnIyMt1Btyws9YAaI_SWy5aB_0 2024-09-12T01:02:38.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12963839811936675925', time=2024-09-12T02:55:22.563273+0000, chain.objs.size()=1 2024-09-12T01:02:38.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:0quFeCHW1VnjSgazBxJvVCKZizcoye1_.GlusyBQUsN8IT22X6tFhNx9_Sa4XUyy_0 2024-09-12T01:02:38.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11103948629104401972', time=2024-09-12T02:55:30.255513+0000, chain.objs.size()=1 2024-09-12T01:02:38.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.580__shadow:8juGWe0B1jWWu.E0YOinGTS3brr-OEr_.EyzoynZFmObeaDXwIMD2h8fnGfkxGB4_0 2024-09-12T01:02:38.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4395054429854780172', time=2024-09-12T02:55:45.661716+0000, chain.objs.size()=1 2024-09-12T01:02:38.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.602__shadow_.-FpoZQIm8Zprals6TxU0ZZklbOc_VL9_0 2024-09-12T01:02:38.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10406514766115450843', time=2024-09-12T02:56:05.264867+0000, chain.objs.size()=1 2024-09-12T01:02:38.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.616__shadow_.gaJO94i0svk-Q7wCis3t-vkhAn0DEaX_0 2024-09-12T01:02:38.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12125065977519421298', time=2024-09-12T02:58:51.168489+0000, chain.objs.size()=1 2024-09-12T01:02:38.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.666__shadow_.4b3J6KTDMa_fObEntSjGFWWiqcjWHvV_0 2024-09-12T01:02:38.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3746355250654056645', time=2024-09-12T02:58:53.225095+0000, chain.objs.size()=1 2024-09-12T01:02:38.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.670__shadow_.eqa9nFsA0NcUfGJUMVnY-LHIYVvfrzp_0 2024-09-12T01:02:38.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14761109855785649481', time=2024-09-12T02:58:59.048449+0000, chain.objs.size()=1 2024-09-12T01:02:38.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.679__shadow_.1XHGcXZSGz10xf_mOEPhlC82RMAEiRx_0 2024-09-12T01:02:38.311 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.314+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:38.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:02:38.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46385' 2024-09-12T01:02:38.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5777472728483307698', time=2024-09-12T02:48:18.058122+0000, chain.objs.size()=1 2024-09-12T01:02:38.317 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.228__shadow_.aXIPtJy7972yw4RxbKyAyl86L8xdsLU_0 2024-09-12T01:02:38.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17864470349872626243', time=2024-09-12T02:48:26.647557+0000, chain.objs.size()=1 2024-09-12T01:02:38.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.239__shadow_.3j-hmhepHmt-DjlJJ1076T1jHJT7zrF_0 2024-09-12T01:02:38.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11064941622001263837', time=2024-09-12T02:48:30.089536+0000, chain.objs.size()=1 2024-09-12T01:02:38.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.243__shadow_.2tNpEwR4kwzXZwHzXQWO3bBbfpQBl34_0 2024-09-12T01:02:38.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5433320348930727716', time=2024-09-12T02:48:38.020414+0000, chain.objs.size()=1 2024-09-12T01:02:38.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.253__shadow_.fjZFviMRhYbBoswFOHwkCqFCfq_LFOJ_0 2024-09-12T01:02:38.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17725921901398342787', time=2024-09-12T02:48:40.183937+0000, chain.objs.size()=1 2024-09-12T01:02:38.320 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.256__shadow_.9JObGz5C4OS-6IENLw0BIv0m7uXoEkK_0 2024-09-12T01:02:38.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.234922595114659148', time=2024-09-12T02:48:40.896432+0000, chain.objs.size()=1 2024-09-12T01:02:38.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.257__shadow_.EnvP64lSNb5pnIfn4YSWNlMCKOcwMWS_0 2024-09-12T01:02:38.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13623064535108343786', time=2024-09-12T02:48:43.133630+0000, chain.objs.size()=1 2024-09-12T01:02:38.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.260__shadow_.MEVMpkCHA3UQMlKzg9HMLwrQI6CZNVA_0 2024-09-12T01:02:38.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.472619492377188925', time=2024-09-12T02:49:05.408845+0000, chain.objs.size()=1 2024-09-12T01:02:38.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Mwe-tb4MtoCY9MeZgfsHH2aWleCOggi_0 2024-09-12T01:02:38.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2455900648135265830', time=2024-09-12T02:49:06.225950+0000, chain.objs.size()=1 2024-09-12T01:02:38.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.uR39RulusK2_NFd0Hq6nTqtzgfxhwdp_0 2024-09-12T01:02:38.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5777497345281000437', time=2024-09-12T02:49:06.316328+0000, chain.objs.size()=1 2024-09-12T01:02:38.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Bkc1sE3iegnvyCKG2aFbdZ8Ld0VaBaq_0 2024-09-12T01:02:38.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.322+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17941945141747640578', time=2024-09-12T02:49:06.322373+0000, chain.objs.size()=1 2024-09-12T01:02:38.321 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.322+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7RHKvLzCcxL603MB_6_Vjn6NrgHimTu_0 2024-09-12T01:02:38.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.322+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7096500909018740102', time=2024-09-12T02:49:07.115517+0000, chain.objs.size()=1 2024-09-12T01:02:38.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.322+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.5UpsoqwxNiIWFIZFhVGQuwEP2aIKfsc_0 2024-09-12T01:02:38.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4552816541260742871', time=2024-09-12T02:49:07.145248+0000, chain.objs.size()=1 2024-09-12T01:02:38.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ra3qBcPBTZ4h6VuWTIJyXUR6rp7OgD5_0 2024-09-12T01:02:38.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8897048938361866330', time=2024-09-12T02:49:07.146662+0000, chain.objs.size()=1 2024-09-12T01:02:38.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9d_zpELTkWcrNJ48XJhBbbbtCvQhO6p_0 2024-09-12T01:02:38.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8029761123360524964', time=2024-09-12T02:49:07.214138+0000, chain.objs.size()=1 2024-09-12T01:02:38.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.YRPCGNWYm2UPlo6M1yKJpFB_BS5O3YH_0 2024-09-12T01:02:38.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4159855831539400105', time=2024-09-12T02:49:07.341749+0000, chain.objs.size()=1 2024-09-12T01:02:38.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.p2yGGnaor7sZVip-8JDPFvCxuDGR-GD_0 2024-09-12T01:02:38.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5409478332892461293', time=2024-09-12T02:49:07.356856+0000, chain.objs.size()=1 2024-09-12T01:02:38.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.M_ifWWe24dd5Q2gb7ROR7u9vgibGLbM_0 2024-09-12T01:02:38.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10171022780583166016', time=2024-09-12T02:49:07.409651+0000, chain.objs.size()=1 2024-09-12T01:02:38.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.iIpHp-2IX9F79lCEk6-zuJq0DnfeLph_0 2024-09-12T01:02:38.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8724922396142454848', time=2024-09-12T02:49:07.432473+0000, chain.objs.size()=1 2024-09-12T01:02:38.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.RQSv7M68WCGM1zl-T5zuuTq1FUKFoml_0 2024-09-12T01:02:38.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11788862521501580965', time=2024-09-12T02:49:07.435981+0000, chain.objs.size()=1 2024-09-12T01:02:38.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.dXWVPsnPN6ftP5MDxHBowQB22_2I9vC_0 2024-09-12T01:02:38.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10224442062662362127', time=2024-09-12T02:49:07.437448+0000, chain.objs.size()=1 2024-09-12T01:02:38.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.b2kzm25IWrXSOUIvmgZm2A5ZvpiEtrw_0 2024-09-12T01:02:38.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3955367413128997100', time=2024-09-12T02:49:13.294615+0000, chain.objs.size()=1 2024-09-12T01:02:38.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.270__shadow_.OzmtDKRXxcAg8M0znxCWDgzwvf2Fvoc_0 2024-09-12T01:02:38.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17738028323532846195', time=2024-09-12T02:49:16.123045+0000, chain.objs.size()=1 2024-09-12T01:02:38.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.326+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.274__shadow_.wGJhbhosvZTKG9zFct1kEOSkfGmUsU8_0 2024-09-12T01:02:38.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15103063349494272437', time=2024-09-12T02:49:20.876560+0000, chain.objs.size()=1 2024-09-12T01:02:38.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.280__shadow_.0Bv7eJOrekBCE2zu4vDU7iQxRMGAGDW_0 2024-09-12T01:02:38.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7180521488434928463', time=2024-09-12T02:49:23.134818+0000, chain.objs.size()=1 2024-09-12T01:02:38.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.283__shadow_.V19mUAeh7ZTAYMlCEFQgopF_S45_BcX_0 2024-09-12T01:02:38.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16802275365827566728', time=2024-09-12T02:49:32.449155+0000, chain.objs.size()=1 2024-09-12T01:02:38.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.VHj42n_z5vb4hBSUdh8efHSxbtLMdr__0 2024-09-12T01:02:38.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16990237271443310632', time=2024-09-12T02:50:15.782936+0000, chain.objs.size()=1 2024-09-12T01:02:38.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xdaDCJnpqBevGAQFvDcHPKqY2LfV_Pb_0 2024-09-12T01:02:38.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7253642105028691487', time=2024-09-12T02:50:15.792674+0000, chain.objs.size()=1 2024-09-12T01:02:38.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xHd0mbfEo_KiWfL8GycwskLfFODVPpW_0 2024-09-12T01:02:38.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17206635289276698689', time=2024-09-12T02:50:15.868163+0000, chain.objs.size()=1 2024-09-12T01:02:38.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.024tYYUx8XRqjVDXXMumVjypPO0sjuf_0 2024-09-12T01:02:38.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7636071788210450216', time=2024-09-12T02:50:15.940853+0000, chain.objs.size()=1 2024-09-12T01:02:38.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.61thBOPIdlpG5UsYw4aHF3sT7OB1m6U_0 2024-09-12T01:02:38.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17601665832949792705', time=2024-09-12T02:50:15.955566+0000, chain.objs.size()=1 2024-09-12T01:02:38.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.sKCiSIpmx7GSbC100wvNBQ5q-eb4jNj_0 2024-09-12T01:02:38.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12609417887647186445', time=2024-09-12T02:50:16.162554+0000, chain.objs.size()=1 2024-09-12T01:02:38.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.3aa5aqmBoJPTcEbe7GKydPIMVPhLaoC_0 2024-09-12T01:02:38.328 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17345902229125110032', time=2024-09-12T02:50:16.163939+0000, chain.objs.size()=1 2024-09-12T01:02:38.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.vK3mpfX_BNcuhNlda94vbI9uMcok5h__0 2024-09-12T01:02:38.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9469709107983061264', time=2024-09-12T02:50:16.172126+0000, chain.objs.size()=1 2024-09-12T01:02:38.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.SNNvNEIxYcTSnA_7ktTrsk7umw6-2Eo_0 2024-09-12T01:02:38.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.334+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9081459679245798725', time=2024-09-12T02:50:16.206267+0000, chain.objs.size()=1 2024-09-12T01:02:38.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.UidjQ34ksW8Jk1_vwZjHH0aLvRG0pkv_0 2024-09-12T01:02:38.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.334+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.223853870969101194', time=2024-09-12T02:50:16.418582+0000, chain.objs.size()=1 2024-09-12T01:02:38.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_._8A1wus3GkYT68R27yvNU57fkffmrHe_0 2024-09-12T01:02:38.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3274312579046094391', time=2024-09-12T02:50:16.433933+0000, chain.objs.size()=1 2024-09-12T01:02:38.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.uhOBM3Es1em7iCNkOWltOygxmob9rCF_0 2024-09-12T01:02:38.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4587256132730131348', time=2024-09-12T02:50:16.491787+0000, chain.objs.size()=1 2024-09-12T01:02:38.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.02bJHakZq5AUxncDy-KkqAJ7xUcUQ_9_0 2024-09-12T01:02:38.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9500540443421112033', time=2024-09-12T02:50:16.739977+0000, chain.objs.size()=1 2024-09-12T01:02:38.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.UUmyeAd9Iyua-8QQliVYBsWkirsxQAg_0 2024-09-12T01:02:38.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1597000321358726644', time=2024-09-12T02:50:16.752852+0000, chain.objs.size()=1 2024-09-12T01:02:38.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Ak0hb8FFH5roEe-EZ2DOC3g_akn2NvB_0 2024-09-12T01:02:38.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17585460309195360773', time=2024-09-12T02:50:16.781147+0000, chain.objs.size()=1 2024-09-12T01:02:38.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.bs62bb0tegxwZ6cbYkYrC_LFv4NQdxg_0 2024-09-12T01:02:38.334 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5128995802694483759', time=2024-09-12T02:50:16.786549+0000, chain.objs.size()=1 2024-09-12T01:02:38.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4p1VzljhTIYV1F7Xk_dOzMtnLneRzCY_0 2024-09-12T01:02:38.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9847411418959828630', time=2024-09-12T02:50:16.791764+0000, chain.objs.size()=1 2024-09-12T01:02:38.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.c9AzxroRqKZA5GpcylNljSO0GqQYK-T_0 2024-09-12T01:02:38.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14350776266833562195', time=2024-09-12T02:50:16.970981+0000, chain.objs.size()=1 2024-09-12T01:02:38.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.fZa2IEoq3qzwLjkd73BxpVs-vbI7izS_0 2024-09-12T01:02:38.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6076631870404626911', time=2024-09-12T02:50:16.997139+0000, chain.objs.size()=1 2024-09-12T01:02:38.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_._jKLCnvMONS-k24OHFGH195M-TFtkp-_0 2024-09-12T01:02:38.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3170074981536525709', time=2024-09-12T02:50:17.001006+0000, chain.objs.size()=1 2024-09-12T01:02:38.335 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ijx0sDnZJfapDwozGmVbNmZHBE6V5Wa_0 2024-09-12T01:02:38.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11737674262610654637', time=2024-09-12T02:50:17.017893+0000, chain.objs.size()=1 2024-09-12T01:02:38.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.pkf-s-lcZ-Ug1o49fQ2DjQfWUXoWIaH_0 2024-09-12T01:02:38.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18061500305934282522', time=2024-09-12T02:50:17.179646+0000, chain.objs.size()=1 2024-09-12T01:02:38.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.FgREVBq-KgfzCbADBMBxuNQrwRqVN93_0 2024-09-12T01:02:38.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7881126533130519569', time=2024-09-12T02:50:17.236649+0000, chain.objs.size()=1 2024-09-12T01:02:38.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.er-pdBuoQ3xFtNPrYaxNyLx0_D8GrOS_0 2024-09-12T01:02:38.339 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9953814444256313404', time=2024-09-12T02:50:17.261313+0000, chain.objs.size()=1 2024-09-12T01:02:38.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4dCTnN8kT62NOW_EnluqX1bxVJ-HKzW_0 2024-09-12T01:02:38.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14312248002006444962', time=2024-09-12T02:50:17.273846+0000, chain.objs.size()=1 2024-09-12T01:02:38.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.7amtGsUVTMLonC1U5Te4ob21OzPvRB9_0 2024-09-12T01:02:38.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2958109054595824709', time=2024-09-12T02:50:17.275651+0000, chain.objs.size()=1 2024-09-12T01:02:38.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.gqPmuEUl73PY-GgdI8PhXjMgZnwp1AS_0 2024-09-12T01:02:38.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10452997885873592523', time=2024-09-12T02:50:17.406495+0000, chain.objs.size()=1 2024-09-12T01:02:38.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ahsDgyorekmf-RL-C9jzVe3VZWWW4FR_0 2024-09-12T01:02:38.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17157397205612265645', time=2024-09-12T02:50:17.427869+0000, chain.objs.size()=1 2024-09-12T01:02:38.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.AdEc54_y36cPH1YVQGv8nAHWXo85po__0 2024-09-12T01:02:38.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16517756992930504691', time=2024-09-12T02:50:17.448021+0000, chain.objs.size()=1 2024-09-12T01:02:38.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.EAxJMKmT-kVcqWbQ40lsxCTfE7HGlCJ_0 2024-09-12T01:02:38.340 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7591378506999979934', time=2024-09-12T02:50:17.448856+0000, chain.objs.size()=1 2024-09-12T01:02:38.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.midoiYx-wBLVPbFhwIfsl6i5t_GU25J_0 2024-09-12T01:02:38.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2637813768682191663', time=2024-09-12T02:50:17.527712+0000, chain.objs.size()=1 2024-09-12T01:02:38.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Ox4fzFO5krvlk4RRuvPKn3H5vGrDURe_0 2024-09-12T01:02:38.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7450027385749307654', time=2024-09-12T02:50:17.531405+0000, chain.objs.size()=1 2024-09-12T01:02:38.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.R0XbOtcmZ1o_0NFtWCO877w9tTzFEcx_0 2024-09-12T01:02:38.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3569793858003859195', time=2024-09-12T02:50:17.692752+0000, chain.objs.size()=1 2024-09-12T01:02:38.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.X6ytohSyQXXr2ai0WVpc-Fit9v1T0ed_0 2024-09-12T01:02:38.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12546749447818874657', time=2024-09-12T02:50:17.720215+0000, chain.objs.size()=1 2024-09-12T01:02:38.343 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.P_kb76vFM2cDQ5kUgUeoffQL6dtRgcQ_0 2024-09-12T01:02:38.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8026520521554258115', time=2024-09-12T02:50:17.721346+0000, chain.objs.size()=1 2024-09-12T01:02:38.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Rn5fxvyr0cu1V1rb6Y_EOatd7FAvhfX_0 2024-09-12T01:02:38.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1217187912944214731', time=2024-09-12T02:50:17.739041+0000, chain.objs.size()=1 2024-09-12T01:02:38.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.IT5u9qtqckpeq-mHrsWy29YP1na4cfv_0 2024-09-12T01:02:38.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14781151882657099838', time=2024-09-12T02:50:39.553880+0000, chain.objs.size()=1 2024-09-12T01:02:38.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.nVdMyCd6I3FFEs2u_osFPWIYQDu6GrP_0 2024-09-12T01:02:38.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13875966832951802989', time=2024-09-12T02:50:39.566712+0000, chain.objs.size()=1 2024-09-12T01:02:38.344 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.CSgUtJkava7EotBW9yRLnfiAAxa8GXD_0 2024-09-12T01:02:38.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.350+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8473141632558159379', time=2024-09-12T02:50:39.574572+0000, chain.objs.size()=1 2024-09-12T01:02:38.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.350+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.0Q6ucmGb8hC6vKt_gB5YqDk7CwVSPqW_0 2024-09-12T01:02:38.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.350+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16678574574423698821', time=2024-09-12T02:50:39.596520+0000, chain.objs.size()=1 2024-09-12T01:02:38.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.350+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.yTt2reMjl7flfH6eNx9JD8UCcDOqago_0 2024-09-12T01:02:38.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.350+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6013151909482596888', time=2024-09-12T02:50:39.614446+0000, chain.objs.size()=1 2024-09-12T01:02:38.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.350+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.sqLQuCqj7x9KMrHuiOFi3vN3s64u-lL_0 2024-09-12T01:02:38.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.350+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1338889467326256922', time=2024-09-12T02:50:39.740942+0000, chain.objs.size()=1 2024-09-12T01:02:38.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.350+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.bAfBzXIdAIspQhQK94rM1kgHh94cDB4_0 2024-09-12T01:02:38.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.350+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10289382751245123133', time=2024-09-12T02:50:39.743175+0000, chain.objs.size()=1 2024-09-12T01:02:38.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.350+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.rk8Fc233hBcKnzpsajzf3jp2LaWnpU1_0 2024-09-12T01:02:38.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.350+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15665831556498206144', time=2024-09-12T02:50:39.747159+0000, chain.objs.size()=1 2024-09-12T01:02:38.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.350+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Ma_7OOmtMqlWW3JxEyAHwOYB2ZDFNqK_0 2024-09-12T01:02:38.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10369556858847190243', time=2024-09-12T02:50:39.808047+0000, chain.objs.size()=1 2024-09-12T01:02:38.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.jU2gco3APTxGos4Q0DJ_kUi7C4rqbHl_0 2024-09-12T01:02:38.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8679913760932946069', time=2024-09-12T02:50:40.014940+0000, chain.objs.size()=1 2024-09-12T01:02:38.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.dMxbyaon-PwNLpBs23u1zpKYq6CeYz1_0 2024-09-12T01:02:38.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15207693561626677197', time=2024-09-12T02:50:40.036089+0000, chain.objs.size()=1 2024-09-12T01:02:38.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.hBpkvwTxAZXgAbKSgMV8SS8H2E7r39a_0 2024-09-12T01:02:38.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6496804702985354726', time=2024-09-12T02:50:40.070817+0000, chain.objs.size()=1 2024-09-12T01:02:38.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.BZh2CdZvrpsHXVjGDqRFrEKH33a5PFd_0 2024-09-12T01:02:38.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4835931226256639671', time=2024-09-12T02:50:40.090710+0000, chain.objs.size()=1 2024-09-12T01:02:38.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.dF9GG3cmKRJ1PH_W2mWZVzlx_vZ5l7u_0 2024-09-12T01:02:38.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11579406741268045682', time=2024-09-12T02:50:40.346313+0000, chain.objs.size()=1 2024-09-12T01:02:38.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.y0ajvfc_yo4h-IrxcOxrvo3SE3gp8ut_0 2024-09-12T01:02:38.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2512783975147879340', time=2024-09-12T02:50:40.561907+0000, chain.objs.size()=1 2024-09-12T01:02:38.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.9jRlimjJRy__FQS9Vr48iTYdJNsEXFL_0 2024-09-12T01:02:38.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8892523622327014090', time=2024-09-12T02:50:40.579621+0000, chain.objs.size()=1 2024-09-12T01:02:38.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.FKrfgyF4D0t6rUSNxYbjlwV42NOTR-t_0 2024-09-12T01:02:38.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17888479574591180958', time=2024-09-12T02:50:40.749046+0000, chain.objs.size()=1 2024-09-12T01:02:38.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.zaUJtQX4HBRAPtIZ3NYucEsrPJ0ttvP_0 2024-09-12T01:02:38.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13417988502591454138', time=2024-09-12T02:50:40.777831+0000, chain.objs.size()=1 2024-09-12T01:02:38.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.em4r9VNVUKZowITOcdw8I31JVAiHvvV_0 2024-09-12T01:02:38.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9486729030481835257', time=2024-09-12T02:50:40.835828+0000, chain.objs.size()=1 2024-09-12T01:02:38.352 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.NhyCxyze66QuN_MQMkZea05ScBo_zrA_0 2024-09-12T01:02:38.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14415132047160407338', time=2024-09-12T02:50:40.892512+0000, chain.objs.size()=1 2024-09-12T01:02:38.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.wPNMdN42CBEOpgoWJFzeDhyce2a539q_0 2024-09-12T01:02:38.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7788457393859441012', time=2024-09-12T02:50:41.018509+0000, chain.objs.size()=1 2024-09-12T01:02:38.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.QQ9LYSlI8_jnemAGjNnslvzjUUufmpE_0 2024-09-12T01:02:38.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9216010847686665811', time=2024-09-12T02:50:41.047405+0000, chain.objs.size()=1 2024-09-12T01:02:38.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.YXbrGXAWan6LmB5RkNG2iL9FlO0O5oV_0 2024-09-12T01:02:38.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8269225342628476434', time=2024-09-12T02:50:41.348777+0000, chain.objs.size()=1 2024-09-12T01:02:38.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.9t0-4WiLAsDu9AlytDMQ4JhBTa3uFfi_0 2024-09-12T01:02:38.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16980950410028758440', time=2024-09-12T02:50:41.393974+0000, chain.objs.size()=1 2024-09-12T01:02:38.354 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.VPgHz99nLcOcTTZ7UwbrYgLWTlGf6vf_0 2024-09-12T01:02:38.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3292103181474971465', time=2024-09-12T02:50:41.410885+0000, chain.objs.size()=1 2024-09-12T01:02:38.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ZZBsi5SvhkqO0Om5L9q8tx0v6BKVH6l_0 2024-09-12T01:02:38.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11571899266516443331', time=2024-09-12T02:50:41.534045+0000, chain.objs.size()=1 2024-09-12T01:02:38.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.9AjyJpHnpksPim7Eswwk4doBSzlSz5S_0 2024-09-12T01:02:38.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2046218088978042277', time=2024-09-12T02:50:41.586423+0000, chain.objs.size()=1 2024-09-12T01:02:38.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.T3i177DUVTyGxxBsMsn9MbvsG17k_bi_0 2024-09-12T01:02:38.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16492211143590225873', time=2024-09-12T02:50:41.645646+0000, chain.objs.size()=1 2024-09-12T01:02:38.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.7md-SnDc7k9aylieImjSz1HuV-R-LQ4_0 2024-09-12T01:02:38.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13529653206795655293', time=2024-09-12T02:50:41.648338+0000, chain.objs.size()=1 2024-09-12T01:02:38.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.dWEzRJtNk9vaNfGoOj6ulcUs-OhcGrL_0 2024-09-12T01:02:38.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10454848595321604206', time=2024-09-12T02:50:48.956561+0000, chain.objs.size()=1 2024-09-12T01:02:38.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.335__shadow_.Z8w4x-Xnc8udmzRPpuGV7amY44CRr0x_0 2024-09-12T01:02:38.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13695419267140498472', time=2024-09-12T02:51:30.887216+0000, chain.objs.size()=1 2024-09-12T01:02:38.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.394__shadow:iids3XMDEspF-dwAAq68VVTlajW2F3W_.BMxkPFLX2LJ2RjYeGt4C6Di0MHYmRtY_0 2024-09-12T01:02:38.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11079889646800351247', time=2024-09-12T02:52:36.211427+0000, chain.objs.size()=1 2024-09-12T01:02:38.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.483__shadow_.My3iXQc_bS0I82L5MGmXU9g6RTfJX1t_0 2024-09-12T01:02:38.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1485537323282057161', time=2024-09-12T02:52:54.483089+0000, chain.objs.size()=6 2024-09-12T01:02:38.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.1 2024-09-12T01:02:38.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.2 2024-09-12T01:02:38.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.3 2024-09-12T01:02:38.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.4 2024-09-12T01:02:38.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.366+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.5 2024-09-12T01:02:38.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.366+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.6 2024-09-12T01:02:38.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.366+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1777860805903539149', time=2024-09-12T02:53:10.771720+0000, chain.objs.size()=1 2024-09-12T01:02:38.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.366+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.520__shadow:rUCkUg.1q3A26jBsVn4sYU2EFJc0CFu_.XauKB7nP5WMmtM3ewzf8NXIrvV6xuQt_0 2024-09-12T01:02:38.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.366+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18352880481801696606', time=2024-09-12T02:54:24.871361+0000, chain.objs.size()=2 2024-09-12T01:02:38.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.366+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.552__shadow_.eM3sZAU35UgbCScZT3_GVlknJcwPgxB_0 2024-09-12T01:02:38.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.366+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.552__shadow_.eM3sZAU35UgbCScZT3_GVlknJcwPgxB_1 2024-09-12T01:02:38.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~eukov97eFZ7Sv6NT2LuSPIYffRFvgpt', time=2024-09-12T02:54:34.448369+0000, chain.objs.size()=1 2024-09-12T01:02:38.364 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.561__multipart_mymultipart.2~eukov97eFZ7Sv6NT2LuSPIYffRFvgpt.1 2024-09-12T01:02:38.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13317103535544300762', time=2024-09-12T02:55:10.262945+0000, chain.objs.size()=1 2024-09-12T01:02:38.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:blPwAozMUEZJqwB1BoMShO29dNm-L.q_.5jhinbhWlxmyiQ8dTNhqHLxp2dpMWd__0 2024-09-12T01:02:38.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4383752403407508751', time=2024-09-12T02:55:16.580651+0000, chain.objs.size()=1 2024-09-12T01:02:38.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:Ac1Gh45-asSuCasSgy-TRQOrMaTeept_.X4xVTCLerLMw_28CWG2xmfpRwbO498k_0 2024-09-12T01:02:38.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46385 2024-09-12T01:02:38.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T01:02:38.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16924262277922319912', time=2024-09-12T02:55:22.049761+0000, chain.objs.size()=1 2024-09-12T01:02:38.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:wLUHnC0kNjYyle7VnBODfY9WlsQ4Anh_.mIqRX2OOBSuwVaZ-uasZyJdRHwUfuzg_0 2024-09-12T01:02:38.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13084280184400096699', time=2024-09-12T02:55:35.313453+0000, chain.objs.size()=1 2024-09-12T01:02:38.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.586__shadow:Yg.iD4MjMjGbdviNe3jHS6HI41uCgFL_.zSf34MrQR0h_8u4GyFx7Rc0kWhol1Gq_0 2024-09-12T01:02:38.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17151667558438284257', time=2024-09-12T02:58:09.452267+0000, chain.objs.size()=1 2024-09-12T01:02:38.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.620__shadow_.1OB75Ij_C_l3IH_CFTqxND2LoFoffLu_0 2024-09-12T01:02:38.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6608469929032182766', time=2024-09-12T02:58:33.120451+0000, chain.objs.size()=2 2024-09-12T01:02:38.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.646__shadow_.uM0NhWJHvAFGX9SJdmu8LG3xlIYGKDn_0 2024-09-12T01:02:38.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.646__shadow_.uM0NhWJHvAFGX9SJdmu8LG3xlIYGKDn_1 2024-09-12T01:02:38.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3567190808279613051', time=2024-09-12T02:58:48.170436+0000, chain.objs.size()=1 2024-09-12T01:02:38.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.663__shadow_.1KI2WNcnPsFCcfm-HNDe4rGIvQ68cBR_0 2024-09-12T01:02:38.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12211337929838155264', time=2024-09-12T02:59:16.908297+0000, chain.objs.size()=1 2024-09-12T01:02:38.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.706__shadow_.gY3fb-aF1n9QuWKveXBJx89lW7oS5EP_0 2024-09-12T01:02:38.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.908555736351554591', time=2024-09-12T02:59:20.551878+0000, chain.objs.size()=1 2024-09-12T01:02:38.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.711__multipart_file1.2~hs2IPLkwiRA_U5gOgn_c57KmZKMjosp.1 2024-09-12T01:02:38.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.382+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:38.379 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.382+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:02:38.380 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.381 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=98, truncated=0, next_marker='' 2024-09-12T01:02:38.383 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9792000937952985576', time=2024-09-12T02:46:03.718100+0000, chain.objs.size()=3 2024-09-12T01:02:38.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.159__multipart_mymultipart-FROZEN.2~u6rFl9wakmynvHvJVxzzUYSjKthLf0_.1 2024-09-12T01:02:38.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.159__multipart_mymultipart-FROZEN.2~u6rFl9wakmynvHvJVxzzUYSjKthLf0_.2 2024-09-12T01:02:38.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.159__multipart_mymultipart-FROZEN.2~u6rFl9wakmynvHvJVxzzUYSjKthLf0_.3 2024-09-12T01:02:38.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13200570187965274480', time=2024-09-12T02:49:05.417714+0000, chain.objs.size()=1 2024-09-12T01:02:38.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.R1JTzCfugnGB9dD931sdjq9Pixi7IQq_0 2024-09-12T01:02:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10325945773982568834', time=2024-09-12T02:49:05.516534+0000, chain.objs.size()=1 2024-09-12T01:02:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7i6maeZKinybEsKCj8fk0rKRYJUSTku_0 2024-09-12T01:02:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13639114137444868394', time=2024-09-12T02:49:05.538937+0000, chain.objs.size()=1 2024-09-12T01:02:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.I0IIIv9aOxVlB1vhUpAlw5I-qVNejVP_0 2024-09-12T01:02:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5303518860929574563', time=2024-09-12T02:49:05.541022+0000, chain.objs.size()=1 2024-09-12T01:02:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.R65fBeJ0Dbys7GQb7cMjFBI9e6uYf5H_0 2024-09-12T01:02:38.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8358250291743120428', time=2024-09-12T02:49:05.545954+0000, chain.objs.size()=1 2024-09-12T01:02:38.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.C84LBqVlvCmeeGjU3NED1GT7AxZGScz_0 2024-09-12T01:02:38.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13998311527212027785', time=2024-09-12T02:49:05.553816+0000, chain.objs.size()=1 2024-09-12T01:02:38.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.--hbmAJCf7nuoir6lVtDhnR2hr8OOE4_0 2024-09-12T01:02:38.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15555754400593954275', time=2024-09-12T02:49:05.736800+0000, chain.objs.size()=1 2024-09-12T01:02:38.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.hOW-Y-3lQ3nDJF2R82Ltbke_0-6EZiR_0 2024-09-12T01:02:38.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10977902850958224478', time=2024-09-12T02:49:05.777895+0000, chain.objs.size()=1 2024-09-12T01:02:38.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.pHk3EYDr8m2h-mLH6AhqYlTa8TRUx-V_0 2024-09-12T01:02:38.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.98240281584124468', time=2024-09-12T02:49:05.785787+0000, chain.objs.size()=1 2024-09-12T01:02:38.386 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.4l5PfeXvaqAytszGWPQJ6dgX68-eKqx_0 2024-09-12T01:02:38.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5884596555864390981', time=2024-09-12T02:49:05.800724+0000, chain.objs.size()=1 2024-09-12T01:02:38.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.rQVjainv0j-Uq3JGtAKMbftir9kYQIO_0 2024-09-12T01:02:38.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1074293355200381432', time=2024-09-12T02:49:06.082306+0000, chain.objs.size()=1 2024-09-12T01:02:38.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.RRHwRT6QXBKLCo6JiSZW7_x_g9kfU1e_0 2024-09-12T01:02:38.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15431052257646291133', time=2024-09-12T02:49:06.257871+0000, chain.objs.size()=1 2024-09-12T01:02:38.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.hphxqZXjUI2P0tbuNiYAM7pYdXA7rRZ_0 2024-09-12T01:02:38.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10105393130905039938', time=2024-09-12T02:49:06.298542+0000, chain.objs.size()=1 2024-09-12T01:02:38.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.pr7cR4q-6IyAp7HMwTQtrnq_yEIGiu2_0 2024-09-12T01:02:38.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9110092130987376115', time=2024-09-12T02:49:06.482381+0000, chain.objs.size()=1 2024-09-12T01:02:38.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Brk8quVadQeabjbn0fa9p0kKxB_ldRO_0 2024-09-12T01:02:38.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10670707481018715742', time=2024-09-12T02:49:06.498594+0000, chain.objs.size()=1 2024-09-12T01:02:38.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.v2TY9X8BjVMnZIwt1g28JGszDJIygoK_0 2024-09-12T01:02:38.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11245021331216326902', time=2024-09-12T02:49:06.548423+0000, chain.objs.size()=1 2024-09-12T01:02:38.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.dqiDZauU2zxd9g6OfYB60xT_iR3SUsB_0 2024-09-12T01:02:38.388 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13948520052008327106', time=2024-09-12T02:49:06.601201+0000, chain.objs.size()=1 2024-09-12T01:02:38.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.PzNVzPKTee_1_gj5D8ZneDSWRkVKFuA_0 2024-09-12T01:02:38.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16949965077333223041', time=2024-09-12T02:49:06.758712+0000, chain.objs.size()=1 2024-09-12T01:02:38.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.P-kbi-i2HKNo2rzmYecR8hTKcEN0_UT_0 2024-09-12T01:02:38.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10233599481339609291', time=2024-09-12T02:49:06.817435+0000, chain.objs.size()=1 2024-09-12T01:02:38.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.6u8BWhXDP5p63B2O4K8TcItf_TQ7b_H_0 2024-09-12T01:02:38.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17380549045798228003', time=2024-09-12T02:49:06.845204+0000, chain.objs.size()=1 2024-09-12T01:02:38.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.cmdQo_8cqBiE_BrXcng-18f5O2uqKYb_0 2024-09-12T01:02:38.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7940249993028307682', time=2024-09-12T02:49:06.869846+0000, chain.objs.size()=1 2024-09-12T01:02:38.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.SRORU7eOVVvJy-p7UcXRw1vGXghazNP_0 2024-09-12T01:02:38.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7108282057849612606', time=2024-09-12T02:49:07.126899+0000, chain.objs.size()=1 2024-09-12T01:02:38.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.1nYCUvahPQ-0Q8ZSCINEo8kQ_f5pRz2_0 2024-09-12T01:02:38.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11570491644394414585', time=2024-09-12T02:49:07.166871+0000, chain.objs.size()=1 2024-09-12T01:02:38.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.kPWZu0LZ0bpqC6go6E7tVomGKNQZZu5_0 2024-09-12T01:02:38.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17572684633577132668', time=2024-09-12T02:49:07.203842+0000, chain.objs.size()=1 2024-09-12T01:02:38.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.BvfVajqmN9F1YOWou5M0pmP251CxW5t_0 2024-09-12T01:02:38.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10441555004871592026', time=2024-09-12T02:49:07.210373+0000, chain.objs.size()=1 2024-09-12T01:02:38.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.AwRlgPDUBF5AeMCaQjQKpECt81Ppkg__0 2024-09-12T01:02:38.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13131345139341005999', time=2024-09-12T02:49:07.341455+0000, chain.objs.size()=1 2024-09-12T01:02:38.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ST6WiO3WTWyYlyOXGmgp69UY1nzctrE_0 2024-09-12T01:02:38.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17597891746933440725', time=2024-09-12T02:49:07.348263+0000, chain.objs.size()=1 2024-09-12T01:02:38.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0Rf1ERoe-IN3NCZMm_jh6WrilDeTAuZ_0 2024-09-12T01:02:38.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8725081695578574741', time=2024-09-12T02:49:07.385441+0000, chain.objs.size()=1 2024-09-12T01:02:38.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.1how4ffG7NYOLtdK6IhGVbBdbGTV-Ff_0 2024-09-12T01:02:38.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8419139690656038502', time=2024-09-12T02:49:07.442392+0000, chain.objs.size()=1 2024-09-12T01:02:38.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.xF1AX9feWvdczl_2AarOtlacJYO_GGo_0 2024-09-12T01:02:38.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3900347233887002243', time=2024-09-12T02:49:09.734691+0000, chain.objs.size()=1 2024-09-12T01:02:38.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.265__shadow_.q6bslo_f_ozigfOkZ7O8T8zgPuD7NMr_0 2024-09-12T01:02:38.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2865333113684717103', time=2024-09-12T02:49:14.702791+0000, chain.objs.size()=1 2024-09-12T01:02:38.394 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.272__shadow_.B88IqIAx6jBC-TUW1QEUWOKcTXukz4o_0 2024-09-12T01:02:38.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18400845787045078839', time=2024-09-12T02:49:15.437838+0000, chain.objs.size()=1 2024-09-12T01:02:38.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.273__shadow_.jyTfGVo9YcRlF-V-Z7z_SsVEu9pmZ6y_0 2024-09-12T01:02:38.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17550846409409169580', time=2024-09-12T02:49:21.607700+0000, chain.objs.size()=1 2024-09-12T01:02:38.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.281__shadow_.rQqOaoMrJ_6tq8ZhoPc7ZVZU9OXVKix_0 2024-09-12T01:02:38.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17338516534829196405', time=2024-09-12T02:49:30.951095+0000, chain.objs.size()=1 2024-09-12T01:02:38.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.0Qgo-T8oYC9XM55z7axE9owy4r979LR_0 2024-09-12T01:02:38.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10394242728746012075', time=2024-09-12T02:49:30.973833+0000, chain.objs.size()=1 2024-09-12T01:02:38.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.Gz0KFa46rmW3V77-q136Ov-E27WsjzY_0 2024-09-12T01:02:38.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8456205219909518003', time=2024-09-12T02:49:32.425229+0000, chain.objs.size()=1 2024-09-12T01:02:38.396 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.398+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.wZypK302C5uB18FhlL8pYwXEcVc9THW_0 2024-09-12T01:02:38.400 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16721319048365447574', time=2024-09-12T02:49:35.395515+0000, chain.objs.size()=1 2024-09-12T01:02:38.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.297__shadow_.NWWa0_o40pH7AttjTv99GllL1oi5Fg4_0 2024-09-12T01:02:38.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11842529184895477217', time=2024-09-12T02:49:36.165841+0000, chain.objs.size()=1 2024-09-12T01:02:38.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.298__shadow_.i3lKgiIDBufI1hjtq3XLp_PPvv7_Axw_0 2024-09-12T01:02:38.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10158578109947294678', time=2024-09-12T02:50:15.827953+0000, chain.objs.size()=1 2024-09-12T01:02:38.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.SogAx9P-NMxVVy8yeplP0UaUQaXFZmA_0 2024-09-12T01:02:38.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10260829061230159971', time=2024-09-12T02:50:16.197753+0000, chain.objs.size()=1 2024-09-12T01:02:38.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.0m5OUvKtkX0hxa7g6t5diqZqOQ6-FZA_0 2024-09-12T01:02:38.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18438273071339901614', time=2024-09-12T02:50:16.205563+0000, chain.objs.size()=1 2024-09-12T01:02:38.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.d42tGY9xhHKwIuisZvxwxfOzTfECiMQ_0 2024-09-12T01:02:38.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2987218668053072787', time=2024-09-12T02:50:16.474104+0000, chain.objs.size()=1 2024-09-12T01:02:38.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Mc1xcH5tqXpnfzsqqH8fkGSsnkqsbal_0 2024-09-12T01:02:38.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18423509649974754990', time=2024-09-12T02:50:16.641268+0000, chain.objs.size()=1 2024-09-12T01:02:38.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4Z5QxC9CBhN4sFx5ikzMZsoHEW5r-i1_0 2024-09-12T01:02:38.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4515377428533441778', time=2024-09-12T02:50:16.667495+0000, chain.objs.size()=1 2024-09-12T01:02:38.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.iTQLUkodMrYZClOFhdFG8JCtbkrl9DI_0 2024-09-12T01:02:38.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16034841593100845240', time=2024-09-12T02:50:16.753954+0000, chain.objs.size()=1 2024-09-12T01:02:38.402 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.uC1ewqpX5mRs5kN-rqNuieoUvqLM3TT_0 2024-09-12T01:02:38.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4247946334486862079', time=2024-09-12T02:50:16.756499+0000, chain.objs.size()=1 2024-09-12T01:02:38.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Lt2puuqgNCJWyih5fpZ17lG2uLXPTvv_0 2024-09-12T01:02:38.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10494206957121374930', time=2024-09-12T02:50:16.757405+0000, chain.objs.size()=1 2024-09-12T01:02:38.403 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.406+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.katvfNUYbNP6E072E89CAQP5Q7RlMOx_0 2024-09-12T01:02:38.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3695829946628009559', time=2024-09-12T02:50:16.796358+0000, chain.objs.size()=1 2024-09-12T01:02:38.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.wsXnCgKESHW9gM9bfQeRg1nWJkZ0pXd_0 2024-09-12T01:02:38.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4535811460137599561', time=2024-09-12T02:50:16.913323+0000, chain.objs.size()=1 2024-09-12T01:02:38.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.CoOSNvpRNtMRpfKmvosJDjHEh9Mkabf_0 2024-09-12T01:02:38.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2025885256185231666', time=2024-09-12T02:50:17.018974+0000, chain.objs.size()=1 2024-09-12T01:02:38.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.9bkyvak5NbtAnXeaEGiKKZ_3ZLeGftV_0 2024-09-12T01:02:38.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5553050573059297314', time=2024-09-12T02:50:17.142572+0000, chain.objs.size()=1 2024-09-12T01:02:38.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Ln3X2B2sC9W-qnyP6wIDcqUCRUZKagN_0 2024-09-12T01:02:38.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15805127528405224788', time=2024-09-12T02:50:17.190197+0000, chain.objs.size()=1 2024-09-12T01:02:38.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.QQaUj82z0Z_ug0RBoGOA-opb4u55h5__0 2024-09-12T01:02:38.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13211069367073140527', time=2024-09-12T02:50:17.285605+0000, chain.objs.size()=1 2024-09-12T01:02:38.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.CnArHC-NaiqN-2xj2CQrqCm6Dh_zFqk_0 2024-09-12T01:02:38.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4865933154069665556', time=2024-09-12T02:50:17.399160+0000, chain.objs.size()=1 2024-09-12T01:02:38.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.c1QQLqQQfsg1ZetL8KQZOCEVMeYeCej_0 2024-09-12T01:02:38.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5617556560305327542', time=2024-09-12T02:50:17.429792+0000, chain.objs.size()=1 2024-09-12T01:02:38.408 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.p8HwU_vvP0dDBXJfz5u6C38XUH6dSTe_0 2024-09-12T01:02:38.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.414+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6133469103467534035', time=2024-09-12T02:50:17.489151+0000, chain.objs.size()=1 2024-09-12T01:02:38.410 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.414+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.eljMg4VSAMcyethcM-4pi07VkrOkspT_0 2024-09-12T01:02:38.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.414+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14800817435519118865', time=2024-09-12T02:50:17.746462+0000, chain.objs.size()=1 2024-09-12T01:02:38.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.414+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.s_XnPQz9mbiyjhKe3p_oaZsHWyDDLT9_0 2024-09-12T01:02:38.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.414+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10707346435077195423', time=2024-09-12T02:50:17.749949+0000, chain.objs.size()=1 2024-09-12T01:02:38.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.414+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.XM6H_BQR9qHyRoAA2pRclKHQlxPWDAk_0 2024-09-12T01:02:38.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17882186582213332280', time=2024-09-12T02:50:39.504959+0000, chain.objs.size()=1 2024-09-12T01:02:38.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.OKQxQgqt3iT_iBvUyuIFUJvPbY1ceDl_0 2024-09-12T01:02:38.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3132373049113751052', time=2024-09-12T02:50:39.551889+0000, chain.objs.size()=1 2024-09-12T01:02:38.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.qa5dmme3DCZKNfwM46-1rJWneTQIDFV_0 2024-09-12T01:02:38.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4298106153263295836', time=2024-09-12T02:50:39.743741+0000, chain.objs.size()=1 2024-09-12T01:02:38.414 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.k7MvtmzzwrtZwnuaWtsWAB1jfT_LYWh_0 2024-09-12T01:02:38.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17798240637027887481', time=2024-09-12T02:50:39.767788+0000, chain.objs.size()=1 2024-09-12T01:02:38.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.7y2YsnzzC0Y0x3dqjM1KOc_muuetP5c_0 2024-09-12T01:02:38.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10682123151042476276', time=2024-09-12T02:50:39.775449+0000, chain.objs.size()=1 2024-09-12T01:02:38.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.sFE7jtVE3DV4EruAJfSmnlRC6AXh1jU_0 2024-09-12T01:02:38.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8873981564392055579', time=2024-09-12T02:50:39.991389+0000, chain.objs.size()=1 2024-09-12T01:02:38.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.-KmD-cPA-UDZdJF7rNa_Q8UsoCEWumt_0 2024-09-12T01:02:38.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11424237824706750310', time=2024-09-12T02:50:39.993231+0000, chain.objs.size()=1 2024-09-12T01:02:38.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.bbQ-QUhQQA71YCLKH55VsRHyVSwjelT_0 2024-09-12T01:02:38.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3011202528643777119', time=2024-09-12T02:50:40.017291+0000, chain.objs.size()=1 2024-09-12T01:02:38.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.6H9wkq74vKvJIS_eY3ZReIaCHHHxBNR_0 2024-09-12T01:02:38.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15500851169931645698', time=2024-09-12T02:50:40.330005+0000, chain.objs.size()=1 2024-09-12T01:02:38.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.euEwrb18VjMfKpko9WUhXxld4EA8d65_0 2024-09-12T01:02:38.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9262673393255172901', time=2024-09-12T02:50:40.805279+0000, chain.objs.size()=1 2024-09-12T01:02:38.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.y-ZwT9exFOvhnx_QZjjgzOr3QMJoWtC_0 2024-09-12T01:02:38.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.110502807674056899', time=2024-09-12T02:50:40.818180+0000, chain.objs.size()=1 2024-09-12T01:02:38.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.mlxM5JQwbT6Gvq--fPC3hCCGl4v38xg_0 2024-09-12T01:02:38.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12663817428520711619', time=2024-09-12T02:50:40.820889+0000, chain.objs.size()=1 2024-09-12T01:02:38.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.HrNASyeF-lv4QL3ipKRHyGcQknrypfu_0 2024-09-12T01:02:38.419 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1834437912236540771', time=2024-09-12T02:50:40.840689+0000, chain.objs.size()=1 2024-09-12T01:02:38.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.f8ZwXrESPAZnM2GhPSkXSWK0WOE-v_3_0 2024-09-12T01:02:38.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14421446982697884770', time=2024-09-12T02:50:41.013697+0000, chain.objs.size()=1 2024-09-12T01:02:38.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.WqtkQocLx5JcHek5qizNIpH-Vr5Tdgy_0 2024-09-12T01:02:38.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6515366026146860294', time=2024-09-12T02:50:41.016601+0000, chain.objs.size()=1 2024-09-12T01:02:38.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.u_476ClSLmyd3Vh1nSVLaRQysC8ZZTr_0 2024-09-12T01:02:38.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11856981265939932001', time=2024-09-12T02:50:41.074034+0000, chain.objs.size()=1 2024-09-12T01:02:38.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.lsQmLSspFhD2zREc23FKzMR97Qwht2g_0 2024-09-12T01:02:38.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2574824047753591098', time=2024-09-12T02:50:41.119273+0000, chain.objs.size()=1 2024-09-12T01:02:38.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.CehXvwBZUMtDyOSOyxY1M4M15nCzkZ8_0 2024-09-12T01:02:38.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8193203772900109847', time=2024-09-12T02:50:41.174436+0000, chain.objs.size()=1 2024-09-12T01:02:38.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.NkILJmcYyiCLfmNJGVMJKzkAUDyguoV_0 2024-09-12T01:02:38.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12080773800001077803', time=2024-09-12T02:50:41.318843+0000, chain.objs.size()=1 2024-09-12T01:02:38.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.9LnkvWpdxLOG99_Nclr_vokba1iwtyK_0 2024-09-12T01:02:38.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17010165590313275092', time=2024-09-12T02:50:41.329622+0000, chain.objs.size()=1 2024-09-12T01:02:38.423 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Gw8NSGClbq2W6pcoZwm66Rqm2Cjfq_Z_0 2024-09-12T01:02:38.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12959006578696853927', time=2024-09-12T02:50:41.332834+0000, chain.objs.size()=1 2024-09-12T01:02:38.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.3hx3jXD10L5uW2hkSP0Z-jPeaBlv-H6_0 2024-09-12T01:02:38.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13609096051838434137', time=2024-09-12T02:50:41.335351+0000, chain.objs.size()=1 2024-09-12T01:02:38.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.hyzHajjRfYzocKykGAPgGdhzOfiFKvx_0 2024-09-12T01:02:38.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13843129330507947867', time=2024-09-12T02:50:41.410147+0000, chain.objs.size()=1 2024-09-12T01:02:38.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_._DHH_vaDRaFE-yH6qdM4wXfKSOrq5ql_0 2024-09-12T01:02:38.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6187275096690820927', time=2024-09-12T02:50:41.561111+0000, chain.objs.size()=1 2024-09-12T01:02:38.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.lFYYI0ClSH3XBuhru7TYTXLu8iF0Hro_0 2024-09-12T01:02:38.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17627741790629427732', time=2024-09-12T02:50:41.639329+0000, chain.objs.size()=1 2024-09-12T01:02:38.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.EFvXZ-MtveZ-7_PIdDW7dBgcGy3xgYT_0 2024-09-12T01:02:38.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2855093354779090715', time=2024-09-12T02:50:51.597823+0000, chain.objs.size()=1 2024-09-12T01:02:38.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.339__shadow_._LAgIAgrIhx9cQAqGsjBfflp-jm2Ukf_0 2024-09-12T01:02:38.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4374583933692913643', time=2024-09-12T02:51:16.389209+0000, chain.objs.size()=1 2024-09-12T01:02:38.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.377__shadow_.D2SViKYrcIt_RivOckLhx4Gut2aesr__0 2024-09-12T01:02:38.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11452222072764043309', time=2024-09-12T02:52:13.247389+0000, chain.objs.size()=1 2024-09-12T01:02:38.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.451__shadow_.OzKQGJwiffHCyTnW5uL38SE2zih8uzj_0 2024-09-12T01:02:38.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1214403751621747573', time=2024-09-12T02:52:26.635423+0000, chain.objs.size()=1 2024-09-12T01:02:38.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.465__shadow_.KIpx2HaoFUhqAZLfmtnSe5x0eM-8JD9_0 2024-09-12T01:02:38.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11177882897112349413', time=2024-09-12T02:52:55.967345+0000, chain.objs.size()=1 2024-09-12T01:02:38.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.511__multipart_mymultipart.2~Gn6u-3j6rMZqmTRBMcC2PQ5lWip8aU7.1 2024-09-12T01:02:38.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8733788691068274714', time=2024-09-12T02:54:27.263145+0000, chain.objs.size()=1 2024-09-12T01:02:38.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.554__shadow_.UqhNCmVf2_jKlSg75dt1N2rCIZerei8_0 2024-09-12T01:02:38.431 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16480879045694111093', time=2024-09-12T02:54:48.683059+0000, chain.objs.size()=1 2024-09-12T01:02:38.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:pkqsTvHXK1UkZ1I-C3hLqanQEoh-4KK_.Hpc5UGwG-0umc1GTDgBplrBhfvI8SpA_0 2024-09-12T01:02:38.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5816067686084510105', time=2024-09-12T02:54:51.386932+0000, chain.objs.size()=1 2024-09-12T01:02:38.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:CaRu1MjBDrbebKTIEEkHyuHuJb2dPdm_.HR3ejGmIDZk5RlVojrJKA6u2pGqJaYE_0 2024-09-12T01:02:38.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3481974026013510147', time=2024-09-12T02:54:53.820195+0000, chain.objs.size()=1 2024-09-12T01:02:38.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.570__shadow:q0t4i14Y-fatBvw5pt4bAea9iEoTL6d_._o0FkOJhnPRmuf9CFkheZlf_BLF8SHA_0 2024-09-12T01:02:38.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11252358090419418018', time=2024-09-12T02:55:35.958806+0000, chain.objs.size()=1 2024-09-12T01:02:38.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.587__shadow:DzfLcLwOxuQkVehnHDttAhCw.EZqrP8_.NqgZJX5vwBorbWclxf9mJZZG-VojIi6_0 2024-09-12T01:02:38.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2323429325293261880', time=2024-09-12T02:58:25.821089+0000, chain.objs.size()=1 2024-09-12T01:02:38.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.636__shadow_.8UTu9WDZrlrU8EJZ_azGJRo-K5VPgUq_0 2024-09-12T01:02:38.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1379404011157500081', time=2024-09-12T02:59:10.385884+0000, chain.objs.size()=1 2024-09-12T01:02:38.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.697__shadow:deUuI7g1zriGD86kI4JCCUVc6FkQ4lD_.llKB6gvmcmeL4kfuMKXTufP7F9tXnup_0 2024-09-12T01:02:38.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.438+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14665995239636080461', time=2024-09-12T02:59:11.860303+0000, chain.objs.size()=1 2024-09-12T01:02:38.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.438+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.699__shadow:5.dy5BBpBkuLkntST4RSlagqg77QxxH_.8Z9ar9qpOkqLm4Jq9Vdq6CoZdSO6fFf_0 2024-09-12T01:02:38.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.438+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16829471657313595455', time=2024-09-12T03:00:00.576709+0000, chain.objs.size()=1 2024-09-12T01:02:38.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.438+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.739__shadow_.2Ja9rpFi4F5Z9iQW7lVRYauyvANEXww_0 2024-09-12T01:02:38.437 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:38.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:02:38.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.441 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46776' 2024-09-12T01:02:38.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11708710092916586890', time=2024-09-12T02:45:55.769840+0000, chain.objs.size()=1 2024-09-12T01:02:38.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.147__shadow_.Yz_qFVRu2EK7gJnN2F047Ix9h3njLKj_0 2024-09-12T01:02:38.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10107585252122586820', time=2024-09-12T02:46:12.441936+0000, chain.objs.size()=1 2024-09-12T01:02:38.444 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.170__shadow_.fSbb7GIi4RNoVGWPXno3WFHzMcthpmF_0 2024-09-12T01:02:38.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17587824797389267247', time=2024-09-12T02:48:19.742078+0000, chain.objs.size()=1 2024-09-12T01:02:38.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.231__shadow_.d1j2A7ih8IJOW7YM2sKjhdt_L8nY26m_0 2024-09-12T01:02:38.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16956195087817769329', time=2024-09-12T02:48:23.492035+0000, chain.objs.size()=1 2024-09-12T01:02:38.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.236__shadow_.amjq53ZMfpw5gkjVGTHLLzRJxV_PH0C_0 2024-09-12T01:02:38.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9241211417609110384', time=2024-09-12T02:48:28.131811+0000, chain.objs.size()=1 2024-09-12T01:02:38.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.241__shadow_.vpaAhr7DJ0YiB4BC2zLn0JtGuPmX-Ts_0 2024-09-12T01:02:38.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18110083758445592152', time=2024-09-12T02:48:38.727919+0000, chain.objs.size()=1 2024-09-12T01:02:38.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.254__shadow_.MK4Wz0-k_BSj9uaXbVwSprat5PXkZsV_0 2024-09-12T01:02:38.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9887145056463794716', time=2024-09-12T02:48:42.379383+0000, chain.objs.size()=1 2024-09-12T01:02:38.446 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.259__shadow_.dS3RG5IYWxM-50Ij5s6lqY01tTOcRNM_0 2024-09-12T01:02:38.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16892937685252703220', time=2024-09-12T02:48:43.133659+0000, chain.objs.size()=1 2024-09-12T01:02:38.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.260__shadow_.K2MwKTr8sDZIURhO6EZXRyl6Dd3jzlF_0 2024-09-12T01:02:38.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10664974479449026768', time=2024-09-12T02:49:05.409268+0000, chain.objs.size()=1 2024-09-12T01:02:38.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.UUoCuy9k7G-pAHH9JeXSYnyqW4U-NRS_0 2024-09-12T01:02:38.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15455917218345407706', time=2024-09-12T02:49:05.440446+0000, chain.objs.size()=1 2024-09-12T01:02:38.447 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.jmRf9LgN7xG70_m2ezjsuguyLgr38x__0 2024-09-12T01:02:38.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4341140894103807946', time=2024-09-12T02:49:05.448858+0000, chain.objs.size()=1 2024-09-12T01:02:38.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.pmFnBMk5E8B2qqOIUgoe3zYDi__rEKi_0 2024-09-12T01:02:38.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5664390639620018459', time=2024-09-12T02:49:05.475330+0000, chain.objs.size()=1 2024-09-12T01:02:38.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.446+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Yhst0HjmDmdXl3zedczob66YakFd6Ab_0 2024-09-12T01:02:38.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16331736266661856454', time=2024-09-12T02:49:05.518447+0000, chain.objs.size()=1 2024-09-12T01:02:38.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.dS1k_zQGMkont4Ezf_gmSfpgUKxtfiZ_0 2024-09-12T01:02:38.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7757953384735471021', time=2024-09-12T02:49:05.560871+0000, chain.objs.size()=1 2024-09-12T01:02:38.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Nl3FK6fldlaRRC6m1Qotf5NLopCc2it_0 2024-09-12T01:02:38.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8396941154567053362', time=2024-09-12T02:49:05.778139+0000, chain.objs.size()=1 2024-09-12T01:02:38.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.W_zC6qZUVa5ryk_KGpFfbD1h-ydMhds_0 2024-09-12T01:02:38.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11554450831777244106', time=2024-09-12T02:49:05.780331+0000, chain.objs.size()=1 2024-09-12T01:02:38.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Y4Sh_Uf_kQfP6hfPE8EZK96SdMEW6eJ_0 2024-09-12T01:02:38.451 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13286403204076401158', time=2024-09-12T02:49:05.968086+0000, chain.objs.size()=1 2024-09-12T01:02:38.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.P0PKwgD_u2VKoX41t5AagO0VbIRNijh_0 2024-09-12T01:02:38.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15501323254956262300', time=2024-09-12T02:49:05.997056+0000, chain.objs.size()=1 2024-09-12T01:02:38.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.hUnrXtgpvlQVhgq5ZegH6l0iKmlduHu_0 2024-09-12T01:02:38.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18236108441694819827', time=2024-09-12T02:49:06.051367+0000, chain.objs.size()=1 2024-09-12T01:02:38.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ARpAkbVHb6g99Nysfs9DqDooFJmaq7K_0 2024-09-12T01:02:38.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4620597277717776714', time=2024-09-12T02:49:06.068713+0000, chain.objs.size()=1 2024-09-12T01:02:38.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.tqY7PTk8irn-oHvj6cQlDlVIisMcF7f_0 2024-09-12T01:02:38.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17038932290898171324', time=2024-09-12T02:49:06.299788+0000, chain.objs.size()=1 2024-09-12T01:02:38.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7yQBy39Zr0Vgl7AxIFJFP5TWb9t8UP7_0 2024-09-12T01:02:38.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3072112442628522702', time=2024-09-12T02:49:06.340432+0000, chain.objs.size()=1 2024-09-12T01:02:38.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7-bq6FS2mTo6PcQ5uQsoMF7Y38GAZaF_0 2024-09-12T01:02:38.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5089385219113975026', time=2024-09-12T02:49:06.366739+0000, chain.objs.size()=1 2024-09-12T01:02:38.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.oCTgYl4EVEifZr2OCJGp3TBiXDjdUwe_0 2024-09-12T01:02:38.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12825828668075749875', time=2024-09-12T02:49:06.537308+0000, chain.objs.size()=1 2024-09-12T01:02:38.454 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.uMhQ6KBwoKf9f82jWH6mHyYuBWrEhgQ_0 2024-09-12T01:02:38.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13599368136780811193', time=2024-09-12T02:49:06.541906+0000, chain.objs.size()=1 2024-09-12T01:02:38.455 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.V5NtHmZi6jgD2fvW48L9X0BQnAJNIXg_0 2024-09-12T01:02:38.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9310137570677812160', time=2024-09-12T02:49:06.562183+0000, chain.objs.size()=1 2024-09-12T01:02:38.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.TogCWQbU4wtR8IwoE4YAGSq1F8B3F0I_0 2024-09-12T01:02:38.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7110543079471693540', time=2024-09-12T02:49:06.578919+0000, chain.objs.size()=1 2024-09-12T01:02:38.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.TzCXcjwyQhZw36vIs2tgZwmCeJh2dwR_0 2024-09-12T01:02:38.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.916308865827492871', time=2024-09-12T02:49:06.631095+0000, chain.objs.size()=1 2024-09-12T01:02:38.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.z4yJsrQozjM0OBfuSElJxpzVo2CFarH_0 2024-09-12T01:02:38.456 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5319761375379309420', time=2024-09-12T02:49:06.759763+0000, chain.objs.size()=1 2024-09-12T01:02:38.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.JfVmu7J-8eK7F6OB0cqgtaqo9vi5Atd_0 2024-09-12T01:02:38.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16314111006735357209', time=2024-09-12T02:49:06.802089+0000, chain.objs.size()=1 2024-09-12T01:02:38.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.arGXna2Y6PnUuQhuSsw1o7mpOMtBYax_0 2024-09-12T01:02:38.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12055013402480524761', time=2024-09-12T02:49:06.852289+0000, chain.objs.size()=1 2024-09-12T01:02:38.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.DJ6QAZv3cqNjnOAmc9TnIT_9LRFr8Mb_0 2024-09-12T01:02:38.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9383277899178216465', time=2024-09-12T02:49:06.855429+0000, chain.objs.size()=1 2024-09-12T01:02:38.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.uRRr28Iq4lU6mvsDcvJKp-J4r4BFZVR_0 2024-09-12T01:02:38.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3747084249747884255', time=2024-09-12T02:49:06.873821+0000, chain.objs.size()=1 2024-09-12T01:02:38.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.S7Pj8SSEtWPiMmboT0418oVOzI1zqjq_0 2024-09-12T01:02:38.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12120287484066129464', time=2024-09-12T02:49:06.883796+0000, chain.objs.size()=1 2024-09-12T01:02:38.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.GfbquqMy6Fv3fsMlV1xSTX8KLk-dkZX_0 2024-09-12T01:02:38.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9161120875692154056', time=2024-09-12T02:49:07.070689+0000, chain.objs.size()=1 2024-09-12T01:02:38.458 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.458+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.KLXflzdLWTiMUHLB2f1LYMZQ3knmpeT_0 2024-09-12T01:02:38.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14914340597352982933', time=2024-09-12T02:49:07.104423+0000, chain.objs.size()=1 2024-09-12T01:02:38.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.lhcGwC2Bw5HniXcKthw3TdZO5nDmZHe_0 2024-09-12T01:02:38.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14067699429385665874', time=2024-09-12T02:49:07.105915+0000, chain.objs.size()=1 2024-09-12T01:02:38.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.J9DNL2U7Fj1Q36yqdyTeWzqVbhwan13_0 2024-09-12T01:02:38.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5013533158038881894', time=2024-09-12T02:49:07.121480+0000, chain.objs.size()=1 2024-09-12T01:02:38.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.VvpsYEB56vVYSpa4-HWm23IP9uq3V_W_0 2024-09-12T01:02:38.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8631068646228923848', time=2024-09-12T02:49:07.138107+0000, chain.objs.size()=1 2024-09-12T01:02:38.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.fCRyMRwbg0ZlAtz44dlPkfjAQxyuxkG_0 2024-09-12T01:02:38.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3744135222668123028', time=2024-09-12T02:49:07.148760+0000, chain.objs.size()=1 2024-09-12T01:02:38.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.3WGM0OFV0bdzacC8YhlWDNoGLntrz62_0 2024-09-12T01:02:38.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1133362749626764817', time=2024-09-12T02:49:07.152332+0000, chain.objs.size()=1 2024-09-12T01:02:38.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.A9e-hOdMldqfCXqRPHWURySS8oIiDWc_0 2024-09-12T01:02:38.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10440433436252437851', time=2024-09-12T02:49:07.200695+0000, chain.objs.size()=1 2024-09-12T01:02:38.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.JN0Kbw-fskxN8eqR7569H6eJ5pkFMWE_0 2024-09-12T01:02:38.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3639673144788684997', time=2024-09-12T02:49:07.219523+0000, chain.objs.size()=1 2024-09-12T01:02:38.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.M3ZhouxK-IVnqzGSvH8WWBZcHt6lP0u_0 2024-09-12T01:02:38.461 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1741897509175135011', time=2024-09-12T02:49:07.224649+0000, chain.objs.size()=1 2024-09-12T01:02:38.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.U_RdsuwB-g8Ljuc6citwCwhqxErJ5pF_0 2024-09-12T01:02:38.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16843839616470305323', time=2024-09-12T02:49:07.339211+0000, chain.objs.size()=1 2024-09-12T01:02:38.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.SQr7q0AoQAErfPDaZvyHKdoU3usLM4k_0 2024-09-12T01:02:38.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17467582641365175632', time=2024-09-12T02:49:07.351463+0000, chain.objs.size()=1 2024-09-12T01:02:38.462 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.a2w1vGSjcmTyUGAGwm5h-WpJmzRxeWH_0 2024-09-12T01:02:38.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16223593656475817741', time=2024-09-12T02:49:07.400867+0000, chain.objs.size()=1 2024-09-12T01:02:38.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.iMXJLdECicK-_aV0TOMnTncC4vQLrX8_0 2024-09-12T01:02:38.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1747144778354828568', time=2024-09-12T02:49:07.414472+0000, chain.objs.size()=1 2024-09-12T01:02:38.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.bQtRI4auZwhdtfE3uuoqvgM1rdRJvrD_0 2024-09-12T01:02:38.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15373832739437726861', time=2024-09-12T02:49:07.418666+0000, chain.objs.size()=1 2024-09-12T01:02:38.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.cCN6ZlbBmmXLmtPH7qYbcQm93YynWU2_0 2024-09-12T01:02:38.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15571147872822056081', time=2024-09-12T02:49:07.439195+0000, chain.objs.size()=1 2024-09-12T01:02:38.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.RAKOyx9mMUD4Li-Qa-4Ga5MH77wl7oX_0 2024-09-12T01:02:38.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5305633184648210614', time=2024-09-12T02:49:16.122804+0000, chain.objs.size()=1 2024-09-12T01:02:38.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.274__shadow_.50K_C8EN7KlTjcHQqc-lBcaC9bTZYft_0 2024-09-12T01:02:38.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6968308577467127933', time=2024-09-12T02:49:16.124816+0000, chain.objs.size()=1 2024-09-12T01:02:38.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.274__shadow_.Tw02H6by9f5r3FdQZYyW4RT4zzQJeBr_0 2024-09-12T01:02:38.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7765596115508121477', time=2024-09-12T02:49:19.348373+0000, chain.objs.size()=1 2024-09-12T01:02:38.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.278__shadow_.GfVRO69B96E-xFh3A73X3FzuEmg5o2L_0 2024-09-12T01:02:38.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18101809529394681192', time=2024-09-12T02:49:29.446991+0000, chain.objs.size()=1 2024-09-12T01:02:38.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.291__shadow_.jqVwZnqCnu8wy-IR8AkUYJB7uef-Laa_0 2024-09-12T01:02:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14607575116201689802', time=2024-09-12T02:49:30.945857+0000, chain.objs.size()=1 2024-09-12T01:02:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.E3iIFXeZiIDf_bzb8QBpFyQv8qktD7s_0 2024-09-12T01:02:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7116322933058765615', time=2024-09-12T02:49:35.392512+0000, chain.objs.size()=1 2024-09-12T01:02:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.297__shadow_.1aOutDyTWp9wTHh-UxtQSA_iVWbnAf6_0 2024-09-12T01:02:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9449597051121838577', time=2024-09-12T02:50:15.789109+0000, chain.objs.size()=1 2024-09-12T01:02:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.RPj001_ORWvYEcglB9NllFFUB0DrpSu_0 2024-09-12T01:02:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11903397263423897907', time=2024-09-12T02:50:15.887039+0000, chain.objs.size()=1 2024-09-12T01:02:38.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ZWiSXM9lmvQxVRzTnWLGCfdEZSE9p13_0 2024-09-12T01:02:38.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5210505891803450729', time=2024-09-12T02:50:15.934428+0000, chain.objs.size()=1 2024-09-12T01:02:38.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.p8gDcT6Mq3zSNjQEie7CF86q3vEFySJ_0 2024-09-12T01:02:38.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3100721426485132902', time=2024-09-12T02:50:16.079295+0000, chain.objs.size()=1 2024-09-12T01:02:38.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.v0h-50BMZ4jV8anD-mTX0w8EzrjCvSM_0 2024-09-12T01:02:38.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1332434312894184502', time=2024-09-12T02:50:16.129466+0000, chain.objs.size()=1 2024-09-12T01:02:38.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.MgXM7BBYGioh81NkaXPhIQjgPjxIJC5_0 2024-09-12T01:02:38.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16154353246780808951', time=2024-09-12T02:50:16.132817+0000, chain.objs.size()=1 2024-09-12T01:02:38.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.dU5cL_tKfvDVV6wqh9ZHrijc0K52hMq_0 2024-09-12T01:02:38.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10260416157023043949', time=2024-09-12T02:50:16.225998+0000, chain.objs.size()=1 2024-09-12T01:02:38.469 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.3HIPnkJKb1_ryun8jYfmzIs46ut1sP-_0 2024-09-12T01:02:38.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4779418806932283315', time=2024-09-12T02:50:16.228017+0000, chain.objs.size()=1 2024-09-12T01:02:38.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.pd3mYCaV0W9fZzn6x_nFP08hN22Y83l_0 2024-09-12T01:02:38.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17723477356535032120', time=2024-09-12T02:50:16.411682+0000, chain.objs.size()=1 2024-09-12T01:02:38.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.dYjz7iD7S9dYmnoiSLKpoRvXn22Wqg3_0 2024-09-12T01:02:38.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10091096516008396442', time=2024-09-12T02:50:16.460304+0000, chain.objs.size()=1 2024-09-12T01:02:38.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.uZwl1MqPp3s43dkoZj6luIuwVlQ-HxW_0 2024-09-12T01:02:38.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14629625534889413820', time=2024-09-12T02:50:16.646624+0000, chain.objs.size()=1 2024-09-12T01:02:38.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.1QHCW6oI7RV7FgL0lhbmQIusQZZEWwl_0 2024-09-12T01:02:38.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15256067987181377266', time=2024-09-12T02:50:16.718153+0000, chain.objs.size()=1 2024-09-12T01:02:38.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.qKVP4485P7t4Dqshs88oZ6wiTKhig_C_0 2024-09-12T01:02:38.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8862726864559767372', time=2024-09-12T02:50:16.737546+0000, chain.objs.size()=1 2024-09-12T01:02:38.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.TLoPlhrbQnDGFAGBW9LYQ6yl2iIfFdE_0 2024-09-12T01:02:38.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7869308692106907107', time=2024-09-12T02:50:16.740940+0000, chain.objs.size()=1 2024-09-12T01:02:38.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.rxi7DV-KNmbhSWgczPIXLcnloH8emtc_0 2024-09-12T01:02:38.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13426022737729206471', time=2024-09-12T02:50:16.744975+0000, chain.objs.size()=1 2024-09-12T01:02:38.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.97mPnWRU0rwpt0XlX6ejRMF99-V5lDG_0 2024-09-12T01:02:38.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7608486779814890800', time=2024-09-12T02:50:16.774199+0000, chain.objs.size()=1 2024-09-12T01:02:38.474 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.BwZOrBByOq3aCUWKU9krD0qClfBSD0y_0 2024-09-12T01:02:38.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14936340105247467680', time=2024-09-12T02:50:16.911424+0000, chain.objs.size()=1 2024-09-12T01:02:38.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.LIhLbkwZL5p9a_de8AzbNhnzeiL4brF_0 2024-09-12T01:02:38.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2604541120369028798', time=2024-09-12T02:50:16.955088+0000, chain.objs.size()=1 2024-09-12T01:02:38.475 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.940uYV6JKg7Xh6313I8SslkGA-XEZW__0 2024-09-12T01:02:38.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8553508521275909105', time=2024-09-12T02:50:16.971121+0000, chain.objs.size()=1 2024-09-12T01:02:38.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.NXuNk52PKEYGUCYlir1CPO6ETQezGZo_0 2024-09-12T01:02:38.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14324065082814897062', time=2024-09-12T02:50:17.004904+0000, chain.objs.size()=1 2024-09-12T01:02:38.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_._nu_YtPXi1lOzkJlPAJmcnvtttKuNDN_0 2024-09-12T01:02:38.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17946792786863002659', time=2024-09-12T02:50:17.165745+0000, chain.objs.size()=1 2024-09-12T01:02:38.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6hNFVgVSJ_C_tjjy3RojOt90c_fA_g-_0 2024-09-12T01:02:38.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13411675398871863115', time=2024-09-12T02:50:17.456884+0000, chain.objs.size()=1 2024-09-12T01:02:38.476 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.In5jzL_ua1ebSaTnFYPYxs_Kgje69ew_0 2024-09-12T01:02:38.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15426345013963045739', time=2024-09-12T02:50:17.460537+0000, chain.objs.size()=1 2024-09-12T01:02:38.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.JQFNFyudLlFmpG0-I-4kjau_HGoyLwQ_0 2024-09-12T01:02:38.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8074942728994037434', time=2024-09-12T02:50:17.487349+0000, chain.objs.size()=1 2024-09-12T01:02:38.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.rjP9CBLKu2vS57IX6k6lSWj6G4cI543_0 2024-09-12T01:02:38.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4962069450002317909', time=2024-09-12T02:50:17.517621+0000, chain.objs.size()=1 2024-09-12T01:02:38.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.478+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.9enprCQOmE_tGk1p-ZLIRtA55k6xLMJ_0 2024-09-12T01:02:38.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.482+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14681342927154507501', time=2024-09-12T02:50:17.518499+0000, chain.objs.size()=1 2024-09-12T01:02:38.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.482+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.QKT6h3YSUZuWeSD2XZCiLW3kqYGsZgZ_0 2024-09-12T01:02:38.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.482+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16721611518599658903', time=2024-09-12T02:50:17.521894+0000, chain.objs.size()=1 2024-09-12T01:02:38.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.482+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.fahWe_L7kSZfhQMj6I_2K7pvjmLHPqq_0 2024-09-12T01:02:38.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16211862192215442651', time=2024-09-12T02:50:17.545706+0000, chain.objs.size()=1 2024-09-12T01:02:38.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.QZ4kS66345vFnyHBXtGYt546s7awdal_0 2024-09-12T01:02:38.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11932212237671477126', time=2024-09-12T02:50:17.752984+0000, chain.objs.size()=1 2024-09-12T01:02:38.480 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.MtM5UoTed8iLAOODK6xqvYAGYUTjC97_0 2024-09-12T01:02:38.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14534780099331643344', time=2024-09-12T02:50:17.755618+0000, chain.objs.size()=1 2024-09-12T01:02:38.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4SFNuvLvuqQzKn72EBl4yptvSJJakxZ_0 2024-09-12T01:02:38.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4594886210430112728', time=2024-09-12T02:50:17.759662+0000, chain.objs.size()=1 2024-09-12T01:02:38.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Gl0Ba4AmRwoFCZs1OjSywF-a1NBbB6i_0 2024-09-12T01:02:38.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15659552675345834129', time=2024-09-12T02:50:39.443944+0000, chain.objs.size()=1 2024-09-12T01:02:38.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.qTE5WqMMEDScpwE7g79qy7rIByAEJmC_0 2024-09-12T01:02:38.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15356198240964278810', time=2024-09-12T02:50:39.523555+0000, chain.objs.size()=1 2024-09-12T01:02:38.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.dC1WB1oUa_BNnscfid_W8tiSjZUor6p_0 2024-09-12T01:02:38.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2613640416946515517', time=2024-09-12T02:50:39.612888+0000, chain.objs.size()=1 2024-09-12T01:02:38.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.fsir1LQvdbfKTdgYMz0YOhK1jCLLKpV_0 2024-09-12T01:02:38.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14374283809676257062', time=2024-09-12T02:50:39.710672+0000, chain.objs.size()=1 2024-09-12T01:02:38.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.o173neE0AXiW68BoVTfa698ZeV6FhkH_0 2024-09-12T01:02:38.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12216121854320075929', time=2024-09-12T02:50:39.793024+0000, chain.objs.size()=1 2024-09-12T01:02:38.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.6oJdbkNyJID08I2o0KszoyOrubH-0iY_0 2024-09-12T01:02:38.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15408979391136331906', time=2024-09-12T02:50:39.816506+0000, chain.objs.size()=1 2024-09-12T01:02:38.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.NfPMKkYf4HEj9WqsSBiGLMjFklab88k_0 2024-09-12T01:02:38.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14984024541054085690', time=2024-09-12T02:50:39.989166+0000, chain.objs.size()=1 2024-09-12T01:02:38.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.C_Wr53sX3vvLxLCQFKf2ou_LTcjY0KE_0 2024-09-12T01:02:38.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9726393673819581570', time=2024-09-12T02:50:40.025340+0000, chain.objs.size()=1 2024-09-12T01:02:38.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.8nFimRi6KLUO2aiptTMvKMtTml2eJur_0 2024-09-12T01:02:38.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16885543705900041919', time=2024-09-12T02:50:40.062670+0000, chain.objs.size()=1 2024-09-12T01:02:38.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.i_O70uEyg5Q1HZJFyhu5cnOjc4bus3g_0 2024-09-12T01:02:38.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10548329562778965777', time=2024-09-12T02:50:40.075652+0000, chain.objs.size()=1 2024-09-12T01:02:38.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.J3vCy9l17T76Uip4N4WcR6uvQv9KmDZ_0 2024-09-12T01:02:38.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18256876699532013877', time=2024-09-12T02:50:40.318185+0000, chain.objs.size()=1 2024-09-12T01:02:38.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.JEKLFHVUCiDsikWTpd2AU3Pm-JCoNVw_0 2024-09-12T01:02:38.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15210134509426729089', time=2024-09-12T02:50:40.562632+0000, chain.objs.size()=1 2024-09-12T01:02:38.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.PrazCbZ6InvSL-olkrthQCTeYu1fW3C_0 2024-09-12T01:02:38.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3971916721640964796', time=2024-09-12T02:50:40.567632+0000, chain.objs.size()=1 2024-09-12T01:02:38.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.HrNE56TAdSwOWsk8qutn7ni-u3gC7Dc_0 2024-09-12T01:02:38.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46776 2024-09-12T01:02:38.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-12T01:02:38.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15009279285970441287', time=2024-09-12T02:50:40.600723+0000, chain.objs.size()=1 2024-09-12T01:02:38.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.p6FwYDjuVq32tnyXpMuZcKpZ23VKo02_0 2024-09-12T01:02:38.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9439106481343288607', time=2024-09-12T02:50:40.626877+0000, chain.objs.size()=1 2024-09-12T01:02:38.494 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ZWixNSonFXnkm4hX7CU-fj22OWZI2mG_0 2024-09-12T01:02:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6050288583278583826', time=2024-09-12T02:50:40.841728+0000, chain.objs.size()=1 2024-09-12T01:02:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.dAG6UwzMxrKf3XNzxtL9fXc0ijC6XGq_0 2024-09-12T01:02:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14982663463856892072', time=2024-09-12T02:50:41.049234+0000, chain.objs.size()=1 2024-09-12T01:02:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.2nKmsuQIZe-1acHmvHez0-oa1W9KqL6_0 2024-09-12T01:02:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17470206597006348537', time=2024-09-12T02:50:41.069156+0000, chain.objs.size()=1 2024-09-12T01:02:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.nVDZHoQn9TL6CBnaM1TuGUvJ5wFyuII_0 2024-09-12T01:02:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11098818235489362487', time=2024-09-12T02:50:41.083920+0000, chain.objs.size()=1 2024-09-12T01:02:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.YuHdn9tT6CG8drvisdr4W7fzngLgb7L_0 2024-09-12T01:02:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15551997629873771640', time=2024-09-12T02:50:41.266366+0000, chain.objs.size()=1 2024-09-12T01:02:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.hSrpNnsfvgF_U_9qkVYbw1JNGS_rovI_0 2024-09-12T01:02:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3386223262247199878', time=2024-09-12T02:50:41.282954+0000, chain.objs.size()=1 2024-09-12T01:02:38.495 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.r6N4VkvYGcz0KzVtkP0gq-eyR_aE8w9_0 2024-09-12T01:02:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5542704192903679929', time=2024-09-12T02:50:41.299841+0000, chain.objs.size()=1 2024-09-12T01:02:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.7sUOaM0NgARB89wvPhYugrMHZAuqd_t_0 2024-09-12T01:02:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1982849411529486714', time=2024-09-12T02:50:41.345255+0000, chain.objs.size()=1 2024-09-12T01:02:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.M1nywi1u4m5a6VxlmAMgqE_3DaSxnBk_0 2024-09-12T01:02:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11007111573708878959', time=2024-09-12T02:50:41.402276+0000, chain.objs.size()=1 2024-09-12T01:02:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.pqgjKNQQxJlkbU8VBgC2tanSnkC28E-_0 2024-09-12T01:02:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13992366045505017632', time=2024-09-12T02:50:41.410726+0000, chain.objs.size()=1 2024-09-12T01:02:38.496 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.498+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.0zw8veVeVESoL2b-NMzbfQVUVpPgU4Z_0 2024-09-12T01:02:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.502+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17455469731631803711', time=2024-09-12T02:50:41.526245+0000, chain.objs.size()=1 2024-09-12T01:02:38.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.502+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.mb8cd10vM_I39_kEh1uGP1SBfN0xc39_0 2024-09-12T01:02:38.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.502+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16458863085798655913', time=2024-09-12T02:50:41.639421+0000, chain.objs.size()=1 2024-09-12T01:02:38.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.502+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Ckks9Y4u0nQUEoapBIoeAheBpg41_X9_0 2024-09-12T01:02:38.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.502+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16826550923552319309', time=2024-09-12T02:50:41.648710+0000, chain.objs.size()=1 2024-09-12T01:02:38.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.502+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.JSXQVsF4WB1ITWZqN3FVjqKCWa8Kw-9_0 2024-09-12T01:02:38.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.502+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5175910808416245528', time=2024-09-12T02:51:11.968112+0000, chain.objs.size()=1 2024-09-12T01:02:38.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.502+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.372__shadow_.n6E8MNJQ_OmRjYbDEXlXyJqpuHi8Td9_0 2024-09-12T01:02:38.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9529941485574851735', time=2024-09-12T02:51:26.497615+0000, chain.objs.size()=1 2024-09-12T01:02:38.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.390__shadow_.1Oi4kV9KxCqbmSe4gHXpuYOUe_soDv-_0 2024-09-12T01:02:38.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9744904633800463382', time=2024-09-12T02:51:26.499842+0000, chain.objs.size()=1 2024-09-12T01:02:38.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.390__shadow_.xi8gmSqzaZfZW6lQmemK-uo8l6BdExt_0 2024-09-12T01:02:38.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2361878821951263526', time=2024-09-12T02:51:40.368952+0000, chain.objs.size()=1 2024-09-12T01:02:38.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.408__shadow_.E0bE2ZwBKhjiA8yfj9yeuZNHwaKRHdZ_0 2024-09-12T01:02:38.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17917669397190348586', time=2024-09-12T02:51:58.291709+0000, chain.objs.size()=1 2024-09-12T01:02:38.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.432__shadow_.qq9OHavAIHtfmGp1PrdCp0IGASMP_tQ_0 2024-09-12T01:02:38.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.52778749266546642', time=2024-09-12T02:52:01.887996+0000, chain.objs.size()=1 2024-09-12T01:02:38.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.437__shadow_.uOislxZC4W25uKPq9xJhMK7ET-NIxBr_0 2024-09-12T01:02:38.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6417044354295583932', time=2024-09-12T02:52:18.499938+0000, chain.objs.size()=1 2024-09-12T01:02:38.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.457__shadow_.68rBsz3TC52td2YKKBR4z7n4r-A6aUs_0 2024-09-12T01:02:38.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11052289962386712835', time=2024-09-12T02:52:21.664893+0000, chain.objs.size()=1 2024-09-12T01:02:38.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.460__shadow_.7xeZ8Vb0-PfMIwhl6WBI4f52GDFKn8D_0 2024-09-12T01:02:38.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13849448213151257913', time=2024-09-12T02:52:25.386906+0000, chain.objs.size()=1 2024-09-12T01:02:38.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.464__shadow_.cgak0EIQrMe1u8tFWVo6-X_6ohkZUJM_0 2024-09-12T01:02:38.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.510+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1219024472511741597', time=2024-09-12T02:52:26.322323+0000, chain.objs.size()=1 2024-09-12T01:02:38.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.510+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.465__shadow_.NPPhCYoB7HzKbyRv3JVaLoZfc2D59nc_0 2024-09-12T01:02:38.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.510+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1458470607678378354', time=2024-09-12T02:52:36.208748+0000, chain.objs.size()=1 2024-09-12T01:02:38.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.510+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.483__shadow_.Le4X63WR8mWGKPoF0RQfklavCngZYeY_0 2024-09-12T01:02:38.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.510+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1686292733064789976', time=2024-09-12T02:53:00.934774+0000, chain.objs.size()=1 2024-09-12T01:02:38.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.510+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.518__multipart_mymultipart.2~k3nH9AFP_HtEKhOQdQbm855E7jkaNKD.1 2024-09-12T01:02:38.506 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.510+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4869572563890091741', time=2024-09-12T02:54:31.911684+0000, chain.objs.size()=1 2024-09-12T01:02:38.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.510+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.558__shadow_.RUpGwb9MQDIOCi3_h32NCUb4yC_l7GS_0 2024-09-12T01:02:38.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1947623280839116139', time=2024-09-12T02:54:42.439673+0000, chain.objs.size()=1 2024-09-12T01:02:38.509 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.566__shadow_.1koeZURNjnrmsivyEBYkD7wRWS3fUqD_0 2024-09-12T01:02:38.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.754478871015686909', time=2024-09-12T02:54:50.043811+0000, chain.objs.size()=1 2024-09-12T01:02:38.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:T7.I2B1jBpIfgezW.5QO6MeavkTRwNl_.Xkh6X5LBnDWpilXqQrNvDyjBKKLqGml_0 2024-09-12T01:02:38.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1760060949895193292', time=2024-09-12T02:55:15.850024+0000, chain.objs.size()=1 2024-09-12T01:02:38.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:Q83OI98M11CfaLatSBUX-lP82feyQRl_.5eiqGwwEMxz64hYrwPkRE3kC2pxrPQR_0 2024-09-12T01:02:38.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6530517408501378151', time=2024-09-12T02:55:20.901971+0000, chain.objs.size()=1 2024-09-12T01:02:38.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:n9Ov6KxotiQUng-KpIn6m0tgZNR25aY_.T0JtXxmOnevg7YJD-kg8_5EULb_X8x3_0 2024-09-12T01:02:38.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6050341411789744432', time=2024-09-12T02:55:28.548955+0000, chain.objs.size()=1 2024-09-12T01:02:38.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.579__shadow:Lr624P9gf67HmjdyW-Yv5Pszf8jqz5p_.2AgC0rvKu-rYtb7WljxV0PoepvGH0OT_0 2024-09-12T01:02:38.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8589720060466695037', time=2024-09-12T02:55:28.583492+0000, chain.objs.size()=1 2024-09-12T01:02:38.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.579__shadow:QhcLL5wWoelbS6sgCBGe0zCtzVsd5hK_.NNixrnpnQ8cbqx5sxctZ2HbAeUI1PcZ_0 2024-09-12T01:02:38.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3708967156095017473', time=2024-09-12T02:58:14.712949+0000, chain.objs.size()=6 2024-09-12T01:02:38.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.623__multipart_multipart_enc.2~4sD9ULGRU5-bmPQnW07n_iZ9qDxp3pH.1 2024-09-12T01:02:38.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.623__multipart_multipart_enc.2~4sD9ULGRU5-bmPQnW07n_iZ9qDxp3pH.2 2024-09-12T01:02:38.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.623__multipart_multipart_enc.2~4sD9ULGRU5-bmPQnW07n_iZ9qDxp3pH.3 2024-09-12T01:02:38.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.623__multipart_multipart_enc.2~4sD9ULGRU5-bmPQnW07n_iZ9qDxp3pH.4 2024-09-12T01:02:38.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.623__multipart_multipart_enc.2~4sD9ULGRU5-bmPQnW07n_iZ9qDxp3pH.5 2024-09-12T01:02:38.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.623__multipart_multipart_enc.2~4sD9ULGRU5-bmPQnW07n_iZ9qDxp3pH.6 2024-09-12T01:02:38.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11268919923154027610', time=2024-09-12T02:58:20.732928+0000, chain.objs.size()=1 2024-09-12T01:02:38.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.629__shadow_.WcSfAZ5Wocx7Octnel_l-Rn5lO-qvMC_0 2024-09-12T01:02:38.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5739448670992583041', time=2024-09-12T02:59:14.035357+0000, chain.objs.size()=1 2024-09-12T01:02:38.515 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.702__multipart_file1.2~eJ8GXcQFLHl3kB2zcPjAGsaUw5hxTz-.1 2024-09-12T01:02:38.519 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.522+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:38.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:02:38.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47269' 2024-09-12T01:02:38.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15434270441707900', time=2024-09-12T02:46:49.777015+0000, chain.objs.size()=1 2024-09-12T01:02:38.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.199__shadow_.qQ96piNE7iRJ7ixzmqOOYuALtLbIdHG_0 2024-09-12T01:02:38.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10555843973957048124', time=2024-09-12T02:46:50.712075+0000, chain.objs.size()=1 2024-09-12T01:02:38.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.200__shadow_.TfFjLmytNtqy7jCdTk1VNkxfzH3ZMYj_0 2024-09-12T01:02:38.527 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12023126497554758672', time=2024-09-12T02:48:34.264126+0000, chain.objs.size()=1 2024-09-12T01:02:38.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.248__shadow_.jYpauYaVG2asojhvimqJUHYUPeJjPGf_0 2024-09-12T01:02:38.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6432256236032846899', time=2024-09-12T02:48:40.894968+0000, chain.objs.size()=1 2024-09-12T01:02:38.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.257__shadow_.WhKPUVzXUc4TnnylAi2FTGaL67v2hhz_0 2024-09-12T01:02:38.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4884110607230179662', time=2024-09-12T02:48:43.869991+0000, chain.objs.size()=1 2024-09-12T01:02:38.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.261__shadow_.uQDYE_0jAhLs940K6cd7gf9jYAvje0v_0 2024-09-12T01:02:38.528 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9995470962255998338', time=2024-09-12T02:49:05.434986+0000, chain.objs.size()=1 2024-09-12T01:02:38.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.qVGpR808A6iqk_FB7awEwHdlJpb-DSt_0 2024-09-12T01:02:38.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3177894026391368371', time=2024-09-12T02:49:05.479442+0000, chain.objs.size()=1 2024-09-12T01:02:38.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_._vpNVe1fNbfsd1gv2dhn7kQEru0w3si_0 2024-09-12T01:02:38.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14228402519039691956', time=2024-09-12T02:49:05.811688+0000, chain.objs.size()=1 2024-09-12T01:02:38.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.OUh4rL4dRnmukkIxHjOs5CJkV11GQ1M_0 2024-09-12T01:02:38.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15356210365751836448', time=2024-09-12T02:49:05.819361+0000, chain.objs.size()=1 2024-09-12T01:02:38.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.gflaUwWopIe4NJUZRgdWRo8o4Ip72I7_0 2024-09-12T01:02:38.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13115186081053875628', time=2024-09-12T02:49:05.839234+0000, chain.objs.size()=1 2024-09-12T01:02:38.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.VJvmChzt5VMxTsPxtSPToDnQiuBA_5w_0 2024-09-12T01:02:38.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.530+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5896517214914692177', time=2024-09-12T02:49:05.964211+0000, chain.objs.size()=1 2024-09-12T01:02:38.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.530+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.djt1h3I147NBZLVnm7Oo-yo7fHcnyKe_0 2024-09-12T01:02:38.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.530+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18228605036456575911', time=2024-09-12T02:49:05.970469+0000, chain.objs.size()=1 2024-09-12T01:02:38.531 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.530+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.WOmE6mo94CmLm5I2t9eJ6b_AUT4-er5_0 2024-09-12T01:02:38.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.530+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1021391620730391933', time=2024-09-12T02:49:05.972144+0000, chain.objs.size()=1 2024-09-12T01:02:38.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.530+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.LswJ5qpSgpZJdOcM4dAPDUiDMvvw-bd_0 2024-09-12T01:02:38.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14401665965178992486', time=2024-09-12T02:49:05.991076+0000, chain.objs.size()=1 2024-09-12T01:02:38.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.2T1_aSIazA25S1cYVXfDDTv9BVIJrfK_0 2024-09-12T01:02:38.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3575249486267521430', time=2024-09-12T02:49:06.026978+0000, chain.objs.size()=1 2024-09-12T01:02:38.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.n28gW7NBhfYYQ9z6fVk0JRvCe1i-iQW_0 2024-09-12T01:02:38.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10007205439459525793', time=2024-09-12T02:49:06.031980+0000, chain.objs.size()=1 2024-09-12T01:02:38.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7ILc_rKLRF3RAznjG_08BvalsBhmlFv_0 2024-09-12T01:02:38.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10151300681886719046', time=2024-09-12T02:49:06.071574+0000, chain.objs.size()=1 2024-09-12T01:02:38.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.G9qzgJ_IbE6otE2cMcUTrXMiGZ9BiSl_0 2024-09-12T01:02:38.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9860373138984801484', time=2024-09-12T02:49:06.230002+0000, chain.objs.size()=1 2024-09-12T01:02:38.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.8wsaOihDwvWpnT0Hmw80ygTEpTedHNS_0 2024-09-12T01:02:38.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18139346963282739243', time=2024-09-12T02:49:06.231985+0000, chain.objs.size()=1 2024-09-12T01:02:38.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.2MAxrj9cTYSx4sSJYIGMECLVDLqO0Gx_0 2024-09-12T01:02:38.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1703019362836679141', time=2024-09-12T02:49:06.234201+0000, chain.objs.size()=1 2024-09-12T01:02:38.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.SK5H0K1Tcq6W4s5XsXMFDEIYovbVnUZ_0 2024-09-12T01:02:38.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10176855209276328437', time=2024-09-12T02:49:06.271243+0000, chain.objs.size()=1 2024-09-12T01:02:38.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7Xc1Cbep3sJWyQFnw9P2wc_Sk3f-LfL_0 2024-09-12T01:02:38.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.443266438268571961', time=2024-09-12T02:49:06.354280+0000, chain.objs.size()=1 2024-09-12T01:02:38.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.PvVVHywNJXBasf7w7-5xtc3LJoYiBFO_0 2024-09-12T01:02:38.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11826899156902475649', time=2024-09-12T02:49:06.356556+0000, chain.objs.size()=1 2024-09-12T01:02:38.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.bdc-4EtLQof7tGLKeswdVBgT5NvU9Ce_0 2024-09-12T01:02:38.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.624408077867708938', time=2024-09-12T02:49:06.358611+0000, chain.objs.size()=1 2024-09-12T01:02:38.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.mYFLdhJucz0IMcJEwSetYJ2LRF9OZML_0 2024-09-12T01:02:38.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6764910453626782064', time=2024-09-12T02:49:06.371642+0000, chain.objs.size()=1 2024-09-12T01:02:38.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.OwBFIAz7us33wJZTT_9Tt8jZF63D3ut_0 2024-09-12T01:02:38.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12489465453056726319', time=2024-09-12T02:49:06.494983+0000, chain.objs.size()=1 2024-09-12T01:02:38.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.4N_V-igrxsLaW6lBOYh9DG2AL0Mf0Mt_0 2024-09-12T01:02:38.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9321171949848608479', time=2024-09-12T02:49:06.557422+0000, chain.objs.size()=1 2024-09-12T01:02:38.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.JXSPVYNx9NWUf-2yTgTPFufcMmdmkFe_0 2024-09-12T01:02:38.539 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15144434995116348756', time=2024-09-12T02:49:06.563633+0000, chain.objs.size()=1 2024-09-12T01:02:38.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.5DJhV2n-dtl8-L_Ik8cv2A7RfEIoZi0_0 2024-09-12T01:02:38.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3691273053746479601', time=2024-09-12T02:49:06.576139+0000, chain.objs.size()=1 2024-09-12T01:02:38.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.AV0mC5nYKVu-4UVjb_Fz4lEqoykZbQX_0 2024-09-12T01:02:38.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.805312023526689257', time=2024-09-12T02:49:06.580475+0000, chain.objs.size()=1 2024-09-12T01:02:38.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ziL_SvQetXlBEr0avzZUSuWu0tZaM-P_0 2024-09-12T01:02:38.540 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10036758307747808948', time=2024-09-12T02:49:06.595353+0000, chain.objs.size()=1 2024-09-12T01:02:38.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.u4cVOfV56ZexzomMQG39yu4iEskqJ4H_0 2024-09-12T01:02:38.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2734501942166292286', time=2024-09-12T02:49:06.628749+0000, chain.objs.size()=1 2024-09-12T01:02:38.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Asia2eLTuwmQiHrnWmXRU0Gw9eAV6_N_0 2024-09-12T01:02:38.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15973294090526571251', time=2024-09-12T02:49:06.631044+0000, chain.objs.size()=1 2024-09-12T01:02:38.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.N6ubfmKQXpisOF_e2Fgk29mlwwGvPv-_0 2024-09-12T01:02:38.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4097343618074059967', time=2024-09-12T02:49:06.752876+0000, chain.objs.size()=1 2024-09-12T01:02:38.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.F0Wt4e9Xs14s3iIkoQPCQeYCm46Boqr_0 2024-09-12T01:02:38.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.542+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3704135645150541975', time=2024-09-12T02:49:06.754206+0000, chain.objs.size()=1 2024-09-12T01:02:38.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.PqzZK29BxKH3cAnrTpPd9WpRk6xIuZb_0 2024-09-12T01:02:38.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.542+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7564436054362513519', time=2024-09-12T02:49:06.779616+0000, chain.objs.size()=1 2024-09-12T01:02:38.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.jS1aRXWkPTvznfS0gAk_pKpgNArVsdz_0 2024-09-12T01:02:38.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.542+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4008988403483242142', time=2024-09-12T02:49:06.788952+0000, chain.objs.size()=1 2024-09-12T01:02:38.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.l528lac35E8zaqE_WHTsCdvyuzRB4-K_0 2024-09-12T01:02:38.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.542+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.513329070052073091', time=2024-09-12T02:49:06.820130+0000, chain.objs.size()=1 2024-09-12T01:02:38.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.c2AoBq4BbhXkblzkc9Ks0NlEqsMiFXi_0 2024-09-12T01:02:38.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.542+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13503573452335219362', time=2024-09-12T02:49:06.834546+0000, chain.objs.size()=1 2024-09-12T01:02:38.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.DPjokS9LzIkt0KbfhohGEo0ut3k8RC2_0 2024-09-12T01:02:38.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9670747313510464643', time=2024-09-12T02:49:06.844353+0000, chain.objs.size()=1 2024-09-12T01:02:38.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.t5AlDtPJtdMzmX6gzETTEQqq8nsVa_M_0 2024-09-12T01:02:38.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7335724646890946920', time=2024-09-12T02:49:06.894624+0000, chain.objs.size()=1 2024-09-12T01:02:38.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.QraKEcRKqfshEkJXAZrO3x4P9J15Xmp_0 2024-09-12T01:02:38.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14521419116022415118', time=2024-09-12T02:49:06.911856+0000, chain.objs.size()=1 2024-09-12T01:02:38.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0uIm7V-MtRtVqY8BPu36xHA0L62Q5kB_0 2024-09-12T01:02:38.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16972454904678670813', time=2024-09-12T02:49:07.064960+0000, chain.objs.size()=1 2024-09-12T01:02:38.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.wOfoSl56CH6OUpsPyip7xvaKa3Qf5ff_0 2024-09-12T01:02:38.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17561223563246295261', time=2024-09-12T02:49:07.192587+0000, chain.objs.size()=1 2024-09-12T01:02:38.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_._fpAdsMXO8FQ9pvJVaPQokqxvhn-A-I_0 2024-09-12T01:02:38.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3348557034166973605', time=2024-09-12T02:49:07.314070+0000, chain.objs.size()=1 2024-09-12T01:02:38.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.EDhtaGeZAaZ_yar2UQozSVhq10B_xpA_0 2024-09-12T01:02:38.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3806214435617091164', time=2024-09-12T02:49:07.364196+0000, chain.objs.size()=1 2024-09-12T01:02:38.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Tlg-WkUYkcuWs8KHAtxDNR29KTc94Vc_0 2024-09-12T01:02:38.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13492107436310855502', time=2024-09-12T02:49:07.407740+0000, chain.objs.size()=1 2024-09-12T01:02:38.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Svr-Wne4nojTC_GMyj7uFg8NBswRCLZ_0 2024-09-12T01:02:38.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17491270138303330540', time=2024-09-12T02:49:07.425566+0000, chain.objs.size()=1 2024-09-12T01:02:38.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0lOpeL-aXE4haL8SRSF28ChZyKOq_eM_0 2024-09-12T01:02:38.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14778809636125385085', time=2024-09-12T02:49:20.108461+0000, chain.objs.size()=1 2024-09-12T01:02:38.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.279__shadow_.8avQqSWMzKHZSP_q-XG5GkthQ7n6VHv_0 2024-09-12T01:02:38.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15981452406093014277', time=2024-09-12T02:49:20.874476+0000, chain.objs.size()=1 2024-09-12T01:02:38.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.280__shadow_.q-Q3_Us-mU-6_IKAPmZeAs4G9MvXXwY_0 2024-09-12T01:02:38.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1047594708289344107', time=2024-09-12T02:49:23.869459+0000, chain.objs.size()=1 2024-09-12T01:02:38.550 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.284__shadow_.qS0py--TsT7liuzx9XMbAHN1oJ3MMle_0 2024-09-12T01:02:38.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2972177233426764430', time=2024-09-12T02:49:30.968331+0000, chain.objs.size()=1 2024-09-12T01:02:38.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.hyhd7aUvbTCNyRpx5k9M9rM14dTlS2j_0 2024-09-12T01:02:38.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15423580856607298276', time=2024-09-12T02:49:33.155805+0000, chain.objs.size()=1 2024-09-12T01:02:38.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.294__shadow_.1G3fKLDKGFEkQs_awh1iOQM-Zo0OKZf_0 2024-09-12T01:02:38.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8390184448121353876', time=2024-09-12T02:49:38.453569+0000, chain.objs.size()=1 2024-09-12T01:02:38.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.301__shadow_.s-qqOB2GnE-Zs4G7OZxWWris1b2WjQB_0 2024-09-12T01:02:38.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14195256495943239783', time=2024-09-12T02:49:39.206180+0000, chain.objs.size()=1 2024-09-12T01:02:38.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.302__shadow_.LFMuTsxmRyDNRVpeMECnHhKxUjQwm84_0 2024-09-12T01:02:38.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3480448634966655687', time=2024-09-12T02:50:15.832648+0000, chain.objs.size()=1 2024-09-12T01:02:38.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.qgjysXHKe2inzjqo40nZuFnrDfRLI-d_0 2024-09-12T01:02:38.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17856661559332446656', time=2024-09-12T02:50:15.876301+0000, chain.objs.size()=1 2024-09-12T01:02:38.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.1k16uqjFXTWmhtB5Yp0byv2XFkPaEQt_0 2024-09-12T01:02:38.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1520720186133300692', time=2024-09-12T02:50:15.941710+0000, chain.objs.size()=1 2024-09-12T01:02:38.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.2OxwWJA35TMUJNAiRloY8qlMJD4St7O_0 2024-09-12T01:02:38.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12062248844759743790', time=2024-09-12T02:50:15.943882+0000, chain.objs.size()=1 2024-09-12T01:02:38.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.2TVH3kKF-KqBMQPd_LmpVLRJUGBaiwI_0 2024-09-12T01:02:38.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8267786388474855224', time=2024-09-12T02:50:15.954254+0000, chain.objs.size()=1 2024-09-12T01:02:38.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xFANPjPAG3wese9VWtaSAGYRXRqDiZ-_0 2024-09-12T01:02:38.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10065948677959592091', time=2024-09-12T02:50:16.199505+0000, chain.objs.size()=1 2024-09-12T01:02:38.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.IMs9LwOVvgk_LNv3IPK0xNPtwHPV9S0_0 2024-09-12T01:02:38.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1040167541464682144', time=2024-09-12T02:50:16.391743+0000, chain.objs.size()=1 2024-09-12T01:02:38.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.rVbDkcoamHEV7_VxEGXvc5dKYr-HKnt_0 2024-09-12T01:02:38.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8194061652086123799', time=2024-09-12T02:50:16.394498+0000, chain.objs.size()=1 2024-09-12T01:02:38.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.UVdf_W_sQ70hS-8aKpf-gNNFU96BZAc_0 2024-09-12T01:02:38.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8748878880397367530', time=2024-09-12T02:50:16.417344+0000, chain.objs.size()=1 2024-09-12T01:02:38.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.tKoOwGlvc5WRCH08z9XjI6zrEIVQdMC_0 2024-09-12T01:02:38.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4680662925521879912', time=2024-09-12T02:50:16.456032+0000, chain.objs.size()=1 2024-09-12T01:02:38.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ImTHRy3WwJXV57vSk75Y2LMg5xPI0Fe_0 2024-09-12T01:02:38.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3921094970209867425', time=2024-09-12T02:50:16.456925+0000, chain.objs.size()=1 2024-09-12T01:02:38.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.3mrrXeSWnz_xOFjD-PPcXohQwE7TWvA_0 2024-09-12T01:02:38.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12995801305995692869', time=2024-09-12T02:50:16.458521+0000, chain.objs.size()=1 2024-09-12T01:02:38.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.LJ886AaIHRF-dcHetd5hQImEL1c45D6_0 2024-09-12T01:02:38.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14779075369978956564', time=2024-09-12T02:50:16.473567+0000, chain.objs.size()=1 2024-09-12T01:02:38.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.c_Uvl_0-WobTC2ae2s0AfixlYzVcUO4_0 2024-09-12T01:02:38.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13859189524316706671', time=2024-09-12T02:50:16.476814+0000, chain.objs.size()=1 2024-09-12T01:02:38.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.rRgnNfb2WhqXjLrYkW-3Q1PM9n2C8jr_0 2024-09-12T01:02:38.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15200648860337710434', time=2024-09-12T02:50:16.489783+0000, chain.objs.size()=1 2024-09-12T01:02:38.556 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.gvg3wQalEWopih9wgXnE6TwRdIOPFRd_0 2024-09-12T01:02:38.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3941399939184300361', time=2024-09-12T02:50:16.513452+0000, chain.objs.size()=1 2024-09-12T01:02:38.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.fv_HJL3YO-QZec46aEQnSNp4rdNnqEp_0 2024-09-12T01:02:38.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8898547653158110430', time=2024-09-12T02:50:16.641944+0000, chain.objs.size()=1 2024-09-12T01:02:38.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Kan5tm7EYI0ySDAPQJOkHpRi-wGnNJ__0 2024-09-12T01:02:38.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11693218059007711002', time=2024-09-12T02:50:16.763044+0000, chain.objs.size()=1 2024-09-12T01:02:38.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.cUyD1fNAgg8_Zbp-LvtrWBO6Dljq9O9_0 2024-09-12T01:02:38.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10630718494973368885', time=2024-09-12T02:50:16.778665+0000, chain.objs.size()=1 2024-09-12T01:02:38.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.U2OKxdegJIG4jUHqDL3mDlf_1jOPbuO_0 2024-09-12T01:02:38.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10049874003555278708', time=2024-09-12T02:50:16.796380+0000, chain.objs.size()=1 2024-09-12T01:02:38.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ePdwdrprpQmIAHArBRrZgb705XWGFKj_0 2024-09-12T01:02:38.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1649016070156756521', time=2024-09-12T02:50:16.932124+0000, chain.objs.size()=1 2024-09-12T01:02:38.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.79WtGq3gU4o3iGf7TYxMDxR5moEQMVg_0 2024-09-12T01:02:38.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13754219057917494072', time=2024-09-12T02:50:16.937110+0000, chain.objs.size()=1 2024-09-12T01:02:38.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.PHo5LgR_E9BtPY7bOCsQb9iDlWjAXRL_0 2024-09-12T01:02:38.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12331576675631527515', time=2024-09-12T02:50:16.939098+0000, chain.objs.size()=1 2024-09-12T01:02:38.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.uoywzfCuc0z09vbptkEY92S8c1oZ_Em_0 2024-09-12T01:02:38.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2440396459373809156', time=2024-09-12T02:50:16.966208+0000, chain.objs.size()=1 2024-09-12T01:02:38.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.H-5jZrYxlnavBYrtUsu8x3czPZ4NgkV_0 2024-09-12T01:02:38.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13615368617191973879', time=2024-09-12T02:50:16.966995+0000, chain.objs.size()=1 2024-09-12T01:02:38.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.pVNIi7U962P4jlBGeEuDg6DgCcs3imO_0 2024-09-12T01:02:38.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9702572840725783539', time=2024-09-12T02:50:16.992561+0000, chain.objs.size()=1 2024-09-12T01:02:38.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.PNaoKAeGcXGDAQ-J0-8dyhaJKYWDRPI_0 2024-09-12T01:02:38.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10311119368576636173', time=2024-09-12T02:50:17.162262+0000, chain.objs.size()=1 2024-09-12T01:02:38.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.P_h1Q93MIAd7_0T7dyKQJALXOj0qIIr_0 2024-09-12T01:02:38.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12919940047176142732', time=2024-09-12T02:50:17.192810+0000, chain.objs.size()=1 2024-09-12T01:02:38.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.mybOUk6DvZEELiNz_vzADTLklewlin7_0 2024-09-12T01:02:38.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3586820401246529787', time=2024-09-12T02:50:17.203320+0000, chain.objs.size()=1 2024-09-12T01:02:38.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.hDs9H2Pu00H1iRYvOqffBi8R553R8H9_0 2024-09-12T01:02:38.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6006276787714418529', time=2024-09-12T02:50:17.222126+0000, chain.objs.size()=1 2024-09-12T01:02:38.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.iyWkI8C-H3JK3LJ8zoITJdwzwQXJDYR_0 2024-09-12T01:02:38.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6211310237444825640', time=2024-09-12T02:50:17.440111+0000, chain.objs.size()=1 2024-09-12T01:02:38.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.yrIIYa0LH-W4MwrV_vqMWoZGa-TQvqO_0 2024-09-12T01:02:38.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11704942346321572166', time=2024-09-12T02:50:17.643637+0000, chain.objs.size()=1 2024-09-12T01:02:38.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.DoPN07z9c6pi_InB8n0EkifWfSbg6R8_0 2024-09-12T01:02:38.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1709848991955261148', time=2024-09-12T02:50:17.735388+0000, chain.objs.size()=1 2024-09-12T01:02:38.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6jAgxVzEo_OqfoSSorCDB7hjsWgO9Sl_0 2024-09-12T01:02:38.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16869418417057534973', time=2024-09-12T02:50:39.482021+0000, chain.objs.size()=1 2024-09-12T01:02:38.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.d-irzlWZF7jFFwfL3wZanu3BJ37vSh3_0 2024-09-12T01:02:38.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17118957323313775274', time=2024-09-12T02:50:39.488057+0000, chain.objs.size()=1 2024-09-12T01:02:38.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.sB9sYVBVx3LuoIOfqcG1A62nCWAIpr2_0 2024-09-12T01:02:38.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13416375673916138524', time=2024-09-12T02:50:39.603393+0000, chain.objs.size()=1 2024-09-12T01:02:38.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Jmxr5zM745lTQytbEnOnBd2COzcZOgN_0 2024-09-12T01:02:38.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.574+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12920647807490490172', time=2024-09-12T02:50:39.739571+0000, chain.objs.size()=1 2024-09-12T01:02:38.569 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.574+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.4SqX9csdwoof7dWnWibfTLuyb6F-G1t_0 2024-09-12T01:02:38.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.574+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5970062136795476200', time=2024-09-12T02:50:39.787354+0000, chain.objs.size()=1 2024-09-12T01:02:38.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.574+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.9s0IOyiLSiIxkvnNBSn6wrY9A-4iRXd_0 2024-09-12T01:02:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.574+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.641132862936708976', time=2024-09-12T02:50:39.806658+0000, chain.objs.size()=1 2024-09-12T01:02:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.574+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.84N22jZ7vzx9lsJK7UM7mp0HaaziBSP_0 2024-09-12T01:02:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.574+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8650243450139889250', time=2024-09-12T02:50:39.823826+0000, chain.objs.size()=1 2024-09-12T01:02:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.574+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.x0qRm5q7Nxo5x5uThvTYu8s1BK9Iw9W_0 2024-09-12T01:02:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.574+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7925880743223842367', time=2024-09-12T02:50:39.845403+0000, chain.objs.size()=1 2024-09-12T01:02:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.574+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.0gIa3NV0aiBKz8KIjhAIs8O-1KfrkKt_0 2024-09-12T01:02:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.574+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.369074899706355120', time=2024-09-12T02:50:39.869696+0000, chain.objs.size()=1 2024-09-12T01:02:38.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.574+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Tv48cIK9lD0nJ-SNUNrDCsPUSWcp0RM_0 2024-09-12T01:02:38.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5234373390082092450', time=2024-09-12T02:50:39.983280+0000, chain.objs.size()=1 2024-09-12T01:02:38.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.zs5QhVvmOaYGRZl1fVLuIIXGRV8kOQH_0 2024-09-12T01:02:38.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8037138034379585821', time=2024-09-12T02:50:40.063889+0000, chain.objs.size()=1 2024-09-12T01:02:38.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.4yxq9yYWsdA4pWY_5nZfCUfWMnKIIoX_0 2024-09-12T01:02:38.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8508677905263969020', time=2024-09-12T02:50:40.259594+0000, chain.objs.size()=1 2024-09-12T01:02:38.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Mcz5YLz3yNSADgX7xrkD9tCjwQKaMr__0 2024-09-12T01:02:38.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47269 2024-09-12T01:02:38.579 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=35, truncated=0, next_marker='' 2024-09-12T01:02:38.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4237133562330312189', time=2024-09-12T02:50:40.262121+0000, chain.objs.size()=1 2024-09-12T01:02:38.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.bsrM42Uh_1IbsiYOrCc5x33t_h0ZV-5_0 2024-09-12T01:02:38.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17560690630943843357', time=2024-09-12T02:50:40.304065+0000, chain.objs.size()=1 2024-09-12T01:02:38.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.UXaBIYd_I6eetvlLDFZ_LVerGTRp16L_0 2024-09-12T01:02:38.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10513848092903243347', time=2024-09-12T02:50:40.309489+0000, chain.objs.size()=1 2024-09-12T01:02:38.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.TuqaCbFNKrBmnb2_tcsA0l47lMHMenI_0 2024-09-12T01:02:38.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.499286798666598362', time=2024-09-12T02:50:40.312305+0000, chain.objs.size()=1 2024-09-12T01:02:38.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.2hIVQvjcxrxI2SbPVvXs5QYdt7YLPlg_0 2024-09-12T01:02:38.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7065247329894103214', time=2024-09-12T02:50:40.348660+0000, chain.objs.size()=1 2024-09-12T01:02:38.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.IwmLZKxTzPtYe2zapNrkGBREFV4UVVW_0 2024-09-12T01:02:38.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5741593897242720956', time=2024-09-12T02:50:40.614956+0000, chain.objs.size()=1 2024-09-12T01:02:38.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.bX9bAyD6_5rlgswibqMd5f5pYaSTdPc_0 2024-09-12T01:02:38.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3805949674581224894', time=2024-09-12T02:50:40.624315+0000, chain.objs.size()=1 2024-09-12T01:02:38.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.N6DoDZmVT4brDsS_GUjLSwiUCK4lKf__0 2024-09-12T01:02:38.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2615357921236411710', time=2024-09-12T02:50:40.631726+0000, chain.objs.size()=1 2024-09-12T01:02:38.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.W-VBJVZwKuPbQhYAdWx433gSXGbk0sI_0 2024-09-12T01:02:38.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8448820560708822722', time=2024-09-12T02:50:40.782803+0000, chain.objs.size()=1 2024-09-12T01:02:38.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Ftf9Pd5AVmuBjsthiDgbVbPm6qhoYJ4_0 2024-09-12T01:02:38.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11296383556971467113', time=2024-09-12T02:50:40.846872+0000, chain.objs.size()=1 2024-09-12T01:02:38.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.lT3HvQTCrzA_jvCCf_HsCSnyBqInos__0 2024-09-12T01:02:38.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10369737412095276671', time=2024-09-12T02:50:41.087048+0000, chain.objs.size()=1 2024-09-12T01:02:38.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.23h63YZXKsp5s8LNHFUokmuVpxXkMRo_0 2024-09-12T01:02:38.581 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15598560542158728182', time=2024-09-12T02:50:41.101797+0000, chain.objs.size()=1 2024-09-12T01:02:38.582 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.582+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.EpWMjFWuahTbNFoN9qHV4O_UpzRG860_0 2024-09-12T01:02:38.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.586+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15197160808496728948', time=2024-09-12T02:50:41.153463+0000, chain.objs.size()=1 2024-09-12T01:02:38.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.586+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.TpIPmT8Lq-dfBIjkIGUKN41r0vRb-n3_0 2024-09-12T01:02:38.585 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16024026974093922576', time=2024-09-12T02:50:41.348247+0000, chain.objs.size()=1 2024-09-12T01:02:38.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_._ayPhrtyW1ybV6mLVsyv08gakeA1ilW_0 2024-09-12T01:02:38.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10188148849734347699', time=2024-09-12T02:50:41.387978+0000, chain.objs.size()=1 2024-09-12T01:02:38.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.4BbmK1Y8Hwv-yQsFMiMIgk428AE8vRM_0 2024-09-12T01:02:38.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12651970302033421596', time=2024-09-12T02:50:41.413895+0000, chain.objs.size()=1 2024-09-12T01:02:38.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Dj4_cJ3-6CWO2qzR404V5rV3MEq2v8X_0 2024-09-12T01:02:38.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17001654781874959387', time=2024-09-12T02:50:41.537231+0000, chain.objs.size()=1 2024-09-12T01:02:38.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.2iQUOAWMWlFVex1czxESFocbUUWC52p_0 2024-09-12T01:02:38.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9364498518820696471', time=2024-09-12T02:50:41.541532+0000, chain.objs.size()=1 2024-09-12T01:02:38.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.tziANV0lyK6Nr0-2RNqF792GcUYEAZB_0 2024-09-12T01:02:38.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3305036163648882273', time=2024-09-12T02:50:41.553646+0000, chain.objs.size()=1 2024-09-12T01:02:38.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.NqWcWeePxCjg0tQqu_5bGneEGbvt8yp_0 2024-09-12T01:02:38.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13235715695046121270', time=2024-09-12T02:50:41.585096+0000, chain.objs.size()=1 2024-09-12T01:02:38.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.CWtku0m9RlPKyao-bbfEIWXcN--6n79_0 2024-09-12T01:02:38.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8706594139057612917', time=2024-09-12T02:50:41.629518+0000, chain.objs.size()=1 2024-09-12T01:02:38.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.7kBwioy5zCeJSiFNGgpczgjF9lLsLII_0 2024-09-12T01:02:38.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12714213483084494447', time=2024-09-12T02:50:46.257601+0000, chain.objs.size()=1 2024-09-12T01:02:38.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.331__shadow_.Of1sOlBKi9n1ebTBr3zQ9gP5eEpkszS_0 2024-09-12T01:02:38.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16232156726485174460', time=2024-09-12T02:50:56.283364+0000, chain.objs.size()=1 2024-09-12T01:02:38.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.346__shadow_.ca4CvdAHKUkE8r0_m0KYSyJ5ATB1oXh_0 2024-09-12T01:02:38.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2821563755889209141', time=2024-09-12T02:52:17.509560+0000, chain.objs.size()=1 2024-09-12T01:02:38.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.456__shadow_.1f__WRFWgtrJ0rS3dLLJjspxXd_ydL3_0 2024-09-12T01:02:38.589 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10003438341409647875', time=2024-09-12T02:52:36.206516+0000, chain.objs.size()=1 2024-09-12T01:02:38.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.483__shadow_._5ViUpX1wc57lK-CMK1_ajtjv4LK-c9_0 2024-09-12T01:02:38.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15307727618126786606', time=2024-09-12T02:52:50.182777+0000, chain.objs.size()=1 2024-09-12T01:02:38.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.503__shadow:kkpnEcohSrS0OmtT6cE4b1ngYotif0k_.RijEw510gCv7_gxNQ272Sla30v4Z_0T_0 2024-09-12T01:02:38.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10300323003323547203', time=2024-09-12T02:52:54.320464+0000, chain.objs.size()=6 2024-09-12T01:02:38.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.1 2024-09-12T01:02:38.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.2 2024-09-12T01:02:38.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.3 2024-09-12T01:02:38.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.4 2024-09-12T01:02:38.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.5 2024-09-12T01:02:38.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.6 2024-09-12T01:02:38.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.598+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13462063638681480670', time=2024-09-12T02:53:29.801724+0000, chain.objs.size()=3 2024-09-12T01:02:38.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.523__multipart_mymultipart.2~f4aTlAne0oDZJJ0t1xjzB4t77uAFAZP.1 2024-09-12T01:02:38.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.523__multipart_mymultipart.2~f4aTlAne0oDZJJ0t1xjzB4t77uAFAZP.2 2024-09-12T01:02:38.593 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.523__multipart_mymultipart.2~f4aTlAne0oDZJJ0t1xjzB4t77uAFAZP.3 2024-09-12T01:02:38.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.598+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2368891967868573907', time=2024-09-12T02:55:14.823229+0000, chain.objs.size()=1 2024-09-12T01:02:38.594 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:VtFik4m1Qpj-vVZ8HAn886L2JVMkYa0_.9yGShcCQZSnG-MV5Lr_gMKOJzMH4h5w_0 2024-09-12T01:02:38.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.598+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13360528745654696403', time=2024-09-12T02:58:22.145190+0000, chain.objs.size()=1 2024-09-12T01:02:38.595 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.631__shadow_.02a8TxhIN27J_YddAvnfazDUuzFODyY_0 2024-09-12T01:02:38.597 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.602+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17074891131563135487', time=2024-09-12T02:58:32.244433+0000, chain.objs.size()=2 2024-09-12T01:02:38.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.602+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.645__shadow_.F2yTSNcF2WnI_DtqwbgMLE-Pd3BLJjE_0 2024-09-12T01:02:38.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.602+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.645__shadow_.F2yTSNcF2WnI_DtqwbgMLE-Pd3BLJjE_1 2024-09-12T01:02:38.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.602+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7316022751878761774', time=2024-09-12T02:58:37.692706+0000, chain.objs.size()=1 2024-09-12T01:02:38.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.602+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.651__shadow_.wXkdqVUNH76IH0S7OtmggItHZBtPOfo_0 2024-09-12T01:02:38.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.602+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7003098011792846893', time=2024-09-12T02:59:32.905555+0000, chain.objs.size()=1 2024-09-12T01:02:38.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.602+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.715__shadow:KvLE7MiXIth24TiKLO4fnS9M9G4bTTQ_.wotHI53Bs1_GB-ncVDFMfqPuVAjlLQE_0 2024-09-12T01:02:38.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14096079618544013454', time=2024-09-12T02:59:44.039511+0000, chain.objs.size()=1 2024-09-12T01:02:38.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.717__shadow:PiYWR51haMAK74W06h3bP3F-D1gljhs_.T9NM5iMV6uaPqtFcsUL1rSedcSbpXP8_0 2024-09-12T01:02:38.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15804638205394488761', time=2024-09-12T03:00:05.309107+0000, chain.objs.size()=1 2024-09-12T01:02:38.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.744__shadow_.ch5RfGoHQs7LvzFKF-NRYs1hCz-Zj8a_0 2024-09-12T01:02:38.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:38.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:02:38.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45854' 2024-09-12T01:02:38.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12318981450181380900', time=2024-09-12T02:46:01.969999+0000, chain.objs.size()=1 2024-09-12T01:02:38.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.158__shadow_.Z95_I6DWo3q0Vx8ofKjC7_Jygw4A2ub_0 2024-09-12T01:02:38.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3718137833440061459', time=2024-09-12T02:46:04.520437+0000, chain.objs.size()=2 2024-09-12T01:02:38.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.160__shadow_.yRAJThRO5G-sVT8HtAXWBms42pPrtsW_0 2024-09-12T01:02:38.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.160__shadow_.yRAJThRO5G-sVT8HtAXWBms42pPrtsW_1 2024-09-12T01:02:38.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6735211437195169994', time=2024-09-12T02:48:22.791290+0000, chain.objs.size()=1 2024-09-12T01:02:38.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.235__shadow_.4_H8hqungS90H9L4cDcoryJsBxLWP5r_0 2024-09-12T01:02:38.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12605135243458524111', time=2024-09-12T02:48:23.493512+0000, chain.objs.size()=1 2024-09-12T01:02:38.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.236__shadow_.JBTirCzhDHHoMFPHebpkkL8T3GYG6pd_0 2024-09-12T01:02:38.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2906971962050691559', time=2024-09-12T02:48:25.951561+0000, chain.objs.size()=1 2024-09-12T01:02:38.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.238__shadow_.OoHA4A7pwOWi38k0j5uzHrDLIa-lViG_0 2024-09-12T01:02:38.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16305802958847329211', time=2024-09-12T02:48:40.893913+0000, chain.objs.size()=1 2024-09-12T01:02:38.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.257__shadow_.a7F1jPGwSOXOkAeIsOu_YsdZTb8piEe_0 2024-09-12T01:02:38.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5862009902018501539', time=2024-09-12T02:48:42.380101+0000, chain.objs.size()=1 2024-09-12T01:02:38.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.259__shadow_.FqC3jj4UJkkW-HFgx6_YowhxPGaSmRG_0 2024-09-12T01:02:38.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5996482635152806447', time=2024-09-12T02:49:05.399198+0000, chain.objs.size()=1 2024-09-12T01:02:38.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.i6S5uZw_bkEPydxbN3EvA7gT__08NIe_0 2024-09-12T01:02:38.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15220329460735403632', time=2024-09-12T02:49:05.700431+0000, chain.objs.size()=1 2024-09-12T01:02:38.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.IYMMR2CXY3cJbSvaSCjqYG05Ifpilap_0 2024-09-12T01:02:38.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11501109456719498735', time=2024-09-12T02:49:05.783300+0000, chain.objs.size()=1 2024-09-12T01:02:38.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.5ScKVvqV_KcF8EoXPObvb0YW1lX9czx_0 2024-09-12T01:02:38.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10029122657284152033', time=2024-09-12T02:49:05.798102+0000, chain.objs.size()=1 2024-09-12T01:02:38.612 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.78hwIzs3HzsYvIyLkr06JVUO8IUuucI_0 2024-09-12T01:02:38.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6371768638749719643', time=2024-09-12T02:49:05.800746+0000, chain.objs.size()=1 2024-09-12T01:02:38.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.1HggIO4ApCv92z1yDXrYxZJekNijmUd_0 2024-09-12T01:02:38.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6867100078739211036', time=2024-09-12T02:49:05.802032+0000, chain.objs.size()=1 2024-09-12T01:02:38.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.e02OzC-KbYDJk1INhu95MwLGf4mvoIJ_0 2024-09-12T01:02:38.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13562880783369327400', time=2024-09-12T02:49:05.805747+0000, chain.objs.size()=1 2024-09-12T01:02:38.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.E_vAvOwggie8ULjDqGoRNYiJd1pv6xB_0 2024-09-12T01:02:38.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10749382933954568242', time=2024-09-12T02:49:05.834412+0000, chain.objs.size()=1 2024-09-12T01:02:38.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.mmVia5xAE6EzDbu0rMshRny0LI6XA7a_0 2024-09-12T01:02:38.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5779319499415488579', time=2024-09-12T02:49:05.835977+0000, chain.objs.size()=1 2024-09-12T01:02:38.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.RHjADTGhtI9eyQQgOYqEUipRpvoMIdD_0 2024-09-12T01:02:38.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2950275129710343210', time=2024-09-12T02:49:05.956854+0000, chain.objs.size()=1 2024-09-12T01:02:38.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.dqs-7RwiwDWrqxg5ibfg9RKD78054fH_0 2024-09-12T01:02:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6121685959608740694', time=2024-09-12T02:49:05.963234+0000, chain.objs.size()=1 2024-09-12T01:02:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_._0B9agflfa61GTHNVn7Tv48waXQ-SE__0 2024-09-12T01:02:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10879560822950137323', time=2024-09-12T02:49:05.963945+0000, chain.objs.size()=1 2024-09-12T01:02:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.RtIXybYV8tDEklLD5U0E8K7R_dXRMte_0 2024-09-12T01:02:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11369585516587388871', time=2024-09-12T02:49:06.003634+0000, chain.objs.size()=1 2024-09-12T01:02:38.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9x3gWNtsk7a21rnTr-7YIrZDQ_H2GLJ_0 2024-09-12T01:02:38.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6061690502856943801', time=2024-09-12T02:49:06.004872+0000, chain.objs.size()=1 2024-09-12T01:02:38.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.yYmLYy7rDNYu_Qp5bS1W45DmEVq2Baw_0 2024-09-12T01:02:38.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3572107383864532332', time=2024-09-12T02:49:06.014781+0000, chain.objs.size()=1 2024-09-12T01:02:38.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.R4MPOcMK2acmzTEEiJtycuc4C9_1Uvx_0 2024-09-12T01:02:38.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4590430443344931346', time=2024-09-12T02:49:06.020536+0000, chain.objs.size()=1 2024-09-12T01:02:38.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.--Nq8BQnZIxgdS_f2stYCB3QdXsz_Tq_0 2024-09-12T01:02:38.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9583616504892993804', time=2024-09-12T02:49:06.060040+0000, chain.objs.size()=1 2024-09-12T01:02:38.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.5s1ZB2zwGGKWaRgFkgaB0uVVze7zX7f_0 2024-09-12T01:02:38.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17104522063640385645', time=2024-09-12T02:49:06.091297+0000, chain.objs.size()=1 2024-09-12T01:02:38.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.547l0sUnv-GVEGhJKueigx7-SKVUrd5_0 2024-09-12T01:02:38.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16183034919232769101', time=2024-09-12T02:49:06.262852+0000, chain.objs.size()=1 2024-09-12T01:02:38.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.90yBM93GYrMoiPksLJco7ShwSr_v9Xt_0 2024-09-12T01:02:38.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13593337803035885298', time=2024-09-12T02:49:06.294504+0000, chain.objs.size()=1 2024-09-12T01:02:38.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Cil1PfncdfjxGe4bGTRUm6lyGAjqfn1_0 2024-09-12T01:02:38.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13735368964665040888', time=2024-09-12T02:49:06.363666+0000, chain.objs.size()=1 2024-09-12T01:02:38.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.oIz6ZMQB5vtifd0PgY2aQ2alRU1kVLb_0 2024-09-12T01:02:38.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10243821355861463095', time=2024-09-12T02:49:06.380110+0000, chain.objs.size()=1 2024-09-12T01:02:38.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.4sSHHQuuS3k5l4efIpReFIAqEwh2w2q_0 2024-09-12T01:02:38.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16387441290240864788', time=2024-09-12T02:49:06.632573+0000, chain.objs.size()=1 2024-09-12T01:02:38.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7OYQWAVKG_RsCoaicck6323PtevBqPE_0 2024-09-12T01:02:38.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16956347143734861253', time=2024-09-12T02:49:06.638291+0000, chain.objs.size()=1 2024-09-12T01:02:38.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9a4O7C3s9Tby8MLVnTLhiRNPqNWOWIT_0 2024-09-12T01:02:38.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9660563943671733129', time=2024-09-12T02:49:06.775253+0000, chain.objs.size()=1 2024-09-12T01:02:38.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Me1TQQCzQq2foL3xw7b2b0ontk3Q2OA_0 2024-09-12T01:02:38.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3020294886647300195', time=2024-09-12T02:49:06.813139+0000, chain.objs.size()=1 2024-09-12T01:02:38.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7IM6lYjG-nfcN0Eptk7UVWfAo2NlD6J_0 2024-09-12T01:02:38.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15562361617385619978', time=2024-09-12T02:49:06.842023+0000, chain.objs.size()=1 2024-09-12T01:02:38.624 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.rgZUGNFkR4OWs22IOuxFxuPZBPpWNFg_0 2024-09-12T01:02:38.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10084769629630898065', time=2024-09-12T02:49:07.170132+0000, chain.objs.size()=1 2024-09-12T01:02:38.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.jL7v7P2ZlUTPQpnNc_iwAccuOKDJWJF_0 2024-09-12T01:02:38.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11430802817344492321', time=2024-09-12T02:49:07.181905+0000, chain.objs.size()=1 2024-09-12T01:02:38.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.BbqTLVHjzBI9okL06wMOOUlpkuF6Vkx_0 2024-09-12T01:02:38.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13263008033489927228', time=2024-09-12T02:49:07.186193+0000, chain.objs.size()=1 2024-09-12T01:02:38.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.HRWxo4dtUxO1VgGis376DnECB3Ikw3L_0 2024-09-12T01:02:38.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2012106994210447851', time=2024-09-12T02:49:07.310907+0000, chain.objs.size()=1 2024-09-12T01:02:38.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.nVld0HXyiJcdOCyZS2l761DJ073IWcF_0 2024-09-12T01:02:38.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4943124909679941785', time=2024-09-12T02:49:07.321179+0000, chain.objs.size()=1 2024-09-12T01:02:38.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ft8oYPFnI5cMShis2JbCKd__O6-IPPI_0 2024-09-12T01:02:38.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13197970449686726862', time=2024-09-12T02:49:07.374973+0000, chain.objs.size()=1 2024-09-12T01:02:38.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0_z7O3ffmlUBDX4PSt1i4s13CX3sqqK_0 2024-09-12T01:02:38.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7926580794011546731', time=2024-09-12T02:49:07.441071+0000, chain.objs.size()=1 2024-09-12T01:02:38.627 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.-n-kKJim3ytTugnVO5iZqk8SKmwUAKS_0 2024-09-12T01:02:38.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13801092659830522001', time=2024-09-12T02:49:22.395400+0000, chain.objs.size()=1 2024-09-12T01:02:38.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.282__shadow_.W4GDriXVW-tWY8-SPRjuVCNd1SzgPYi_0 2024-09-12T01:02:38.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4394013020985035128', time=2024-09-12T02:49:30.947206+0000, chain.objs.size()=1 2024-09-12T01:02:38.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.X2o3y4f0YMoCcyP9QMtkXr5Kyq3F3NT_0 2024-09-12T01:02:38.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18118734208100864182', time=2024-09-12T02:49:32.439969+0000, chain.objs.size()=1 2024-09-12T01:02:38.628 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.2gN79YdAyktEv5M0s7bD1ZCnzkHMbqn_0 2024-09-12T01:02:38.629 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15203437595836142482', time=2024-09-12T02:49:33.868948+0000, chain.objs.size()=1 2024-09-12T01:02:38.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.295__shadow_.qB-IwA7uPrEu5u_JGkFaZP-Kdoq9MLr_0 2024-09-12T01:02:38.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5119166736070506803', time=2024-09-12T02:49:38.453175+0000, chain.objs.size()=1 2024-09-12T01:02:38.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.301__shadow_.W3q8zmOu2_rlM49-2Zci6at0gqDxE3O_0 2024-09-12T01:02:38.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13232950603527676752', time=2024-09-12T02:50:16.082537+0000, chain.objs.size()=1 2024-09-12T01:02:38.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_._xhCB3mjN0n4PRc50a2MlK0ID5yPjBW_0 2024-09-12T01:02:38.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.169767682624192321', time=2024-09-12T02:50:16.177161+0000, chain.objs.size()=1 2024-09-12T01:02:38.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.97hJ00-pATU1SNGUSwDmZXN9VjluCok_0 2024-09-12T01:02:38.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8105896145537840347', time=2024-09-12T02:50:16.359068+0000, chain.objs.size()=1 2024-09-12T01:02:38.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.J7CbjCL_h1JqT15y_DPf1A0R_qd1YWn_0 2024-09-12T01:02:38.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10056187674214989323', time=2024-09-12T02:50:16.362240+0000, chain.objs.size()=1 2024-09-12T01:02:38.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.aSsn3sDwnFbBcDuUmPPA6O5rZPafUnx_0 2024-09-12T01:02:38.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4791672012870249726', time=2024-09-12T02:50:16.391506+0000, chain.objs.size()=1 2024-09-12T01:02:38.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4kHWiTMpB1xE_dfz-hIejUcgAjBEbE9_0 2024-09-12T01:02:38.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14620851286128010440', time=2024-09-12T02:50:16.400296+0000, chain.objs.size()=1 2024-09-12T01:02:38.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ZAg75hRa7tpjwrcyyM7x2LqFNOllvES_0 2024-09-12T01:02:38.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4380114159679828545', time=2024-09-12T02:50:16.416992+0000, chain.objs.size()=1 2024-09-12T01:02:38.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.mYQiFfGFQayLLKmiG5IL1lugb2fZWcD_0 2024-09-12T01:02:38.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14350421972208809449', time=2024-09-12T02:50:16.427447+0000, chain.objs.size()=1 2024-09-12T01:02:38.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Snjl-M_lBgAj75RSX0yLQOOfGzYPaZU_0 2024-09-12T01:02:38.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12815689145901267715', time=2024-09-12T02:50:16.457015+0000, chain.objs.size()=1 2024-09-12T01:02:38.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-s_KWmZkif_WRU4o_cxFjBdRE7LfrVp_0 2024-09-12T01:02:38.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11230852572054170473', time=2024-09-12T02:50:16.461152+0000, chain.objs.size()=1 2024-09-12T01:02:38.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.XY0vkLWyjeAUTvIBdZLM-FS4b9s0Lq8_0 2024-09-12T01:02:38.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16719428517816535912', time=2024-09-12T02:50:16.463341+0000, chain.objs.size()=1 2024-09-12T01:02:38.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.r0CL-JJzzbGt7lBrbcP9oNOcHFrI9iy_0 2024-09-12T01:02:38.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4011724877410649982', time=2024-09-12T02:50:16.881137+0000, chain.objs.size()=1 2024-09-12T01:02:38.635 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ZwYsplk8_H0nENFPstzGQr6ugYyMWSL_0 2024-09-12T01:02:38.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11931241530959146201', time=2024-09-12T02:50:16.972858+0000, chain.objs.size()=1 2024-09-12T01:02:38.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.642+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.IpfpbE3HoVf5n2vGJfVDqKbOglcZZT8_0 2024-09-12T01:02:38.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.642+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7504343519852738761', time=2024-09-12T02:50:17.176588+0000, chain.objs.size()=1 2024-09-12T01:02:38.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.642+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.0hQlOdrBlo5caHs9sA-osDBzx8RAew9_0 2024-09-12T01:02:38.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.642+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1882360815083478519', time=2024-09-12T02:50:17.200262+0000, chain.objs.size()=1 2024-09-12T01:02:38.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.642+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xlCgOogolLK2VSuBHbnMvWUByAYVuYV_0 2024-09-12T01:02:38.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.642+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1057894912890237892', time=2024-09-12T02:50:17.450643+0000, chain.objs.size()=1 2024-09-12T01:02:38.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.642+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.MMLbEo5ilbMHSXUN7TuCBwf7yDTX8Te_0 2024-09-12T01:02:38.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.642+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7720764505203454847', time=2024-09-12T02:50:17.451718+0000, chain.objs.size()=1 2024-09-12T01:02:38.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.642+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Ob36u_KXGsiCnKeJfuzYpVMbaX3pbY__0 2024-09-12T01:02:38.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.642+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3030375612406879668', time=2024-09-12T02:50:17.465473+0000, chain.objs.size()=1 2024-09-12T01:02:38.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.642+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.56e9Ch6P8KkOY4hqZPiSBqN9xoxSjx0_0 2024-09-12T01:02:38.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.642+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2358488395480875420', time=2024-09-12T02:50:17.493784+0000, chain.objs.size()=1 2024-09-12T01:02:38.639 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.642+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.rr-LZb_lFQqQCTKjXnLZtqJW77wmKkf_0 2024-09-12T01:02:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.646+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8389134810029872936', time=2024-09-12T02:50:17.531329+0000, chain.objs.size()=1 2024-09-12T01:02:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.21Uk5d2POtx3k5zXaAmrd20Jeixd6L9_0 2024-09-12T01:02:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.646+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1270843729313322880', time=2024-09-12T02:50:17.721077+0000, chain.objs.size()=1 2024-09-12T01:02:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.bBc7WANZFPiKCqQhtQmqmAiaR9aBhmF_0 2024-09-12T01:02:38.640 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.646+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16299229107770218575', time=2024-09-12T02:50:17.732365+0000, chain.objs.size()=1 2024-09-12T01:02:38.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.BTQO7xRlZ3_Gbbac9SdgceP3yvdgOaS_0 2024-09-12T01:02:38.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.646+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11006425904731708336', time=2024-09-12T02:50:17.733933+0000, chain.objs.size()=1 2024-09-12T01:02:38.641 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.wjxqD6w8vBwpOHU0A94MeKRYjq42e6J_0 2024-09-12T01:02:38.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.646+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3608800253069385031', time=2024-09-12T02:50:17.741819+0000, chain.objs.size()=1 2024-09-12T01:02:38.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.SKemPa09HTT8o-cfdThcq9dEczL-oXU_0 2024-09-12T01:02:38.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.646+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7612159656282393343', time=2024-09-12T02:50:39.426922+0000, chain.objs.size()=1 2024-09-12T01:02:38.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.-u6Rxe28x9uhAmGuBkA6bv85z7ZF9I__0 2024-09-12T01:02:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7522533192290830437', time=2024-09-12T02:50:39.478680+0000, chain.objs.size()=1 2024-09-12T01:02:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.JhrnhCGOID7Hy8FgJzDrateAplEpYBn_0 2024-09-12T01:02:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13354376706616597639', time=2024-09-12T02:50:39.517018+0000, chain.objs.size()=1 2024-09-12T01:02:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.IRviLAfaxO30nmAZHedcztgal6fakrK_0 2024-09-12T01:02:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5201961064810459051', time=2024-09-12T02:50:39.525352+0000, chain.objs.size()=1 2024-09-12T01:02:38.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.IXcizGS00op8FVnpSCEZLDG-u2r-RWQ_0 2024-09-12T01:02:38.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4230173382364191406', time=2024-09-12T02:50:39.558166+0000, chain.objs.size()=1 2024-09-12T01:02:38.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.DD_AcAy-3WDjcsS7B4pWp0mQ68p7w7H_0 2024-09-12T01:02:38.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15344338472141821976', time=2024-09-12T02:50:39.573990+0000, chain.objs.size()=1 2024-09-12T01:02:38.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.SsqkWhQfeTvxQjl8SjB08eW4aywCt8E_0 2024-09-12T01:02:38.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9827164273582593172', time=2024-09-12T02:50:39.748987+0000, chain.objs.size()=1 2024-09-12T01:02:38.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.A2966rBVketuXHY7mVnBjb-2Zu3-Gfj_0 2024-09-12T01:02:38.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8647826277317352521', time=2024-09-12T02:50:39.766043+0000, chain.objs.size()=1 2024-09-12T01:02:38.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.tyCDdogcMZkad38EKDvDMSnawg_Nl2o_0 2024-09-12T01:02:38.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18082411185719061661', time=2024-09-12T02:50:39.768767+0000, chain.objs.size()=1 2024-09-12T01:02:38.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.GJg2miYdKKYVoRZqSO5fmEky7-lAOho_0 2024-09-12T01:02:38.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6302189999880830194', time=2024-09-12T02:50:39.841891+0000, chain.objs.size()=1 2024-09-12T01:02:38.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.-ai5tt9v5pW9nnxtYbf9CxEcusgYZip_0 2024-09-12T01:02:38.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.654+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17103480822275675935', time=2024-09-12T02:50:39.871218+0000, chain.objs.size()=1 2024-09-12T01:02:38.649 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.654+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.RlwOyY3CZUNPR5Mxo13zbJR4ewXMjx-_0 2024-09-12T01:02:38.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2968065706369214848', time=2024-09-12T02:50:39.988682+0000, chain.objs.size()=1 2024-09-12T01:02:38.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.IVuCcf2sdHPuDBgFptgOYTog_CIcaWL_0 2024-09-12T01:02:38.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13213416647345933918', time=2024-09-12T02:50:40.036684+0000, chain.objs.size()=1 2024-09-12T01:02:38.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.tGJxUXlV7T-RFD96qE-A8hEGdsDv4FJ_0 2024-09-12T01:02:38.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16034797814156610382', time=2024-09-12T02:50:40.038626+0000, chain.objs.size()=1 2024-09-12T01:02:38.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.DEtne1tYcLDL9guIbKKzCuPzbDARMoJ_0 2024-09-12T01:02:38.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11003964577152357474', time=2024-09-12T02:50:40.140282+0000, chain.objs.size()=1 2024-09-12T01:02:38.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.b0bn3n6ZpjEDqkDA3iOdUdVnykqjKqV_0 2024-09-12T01:02:38.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6032056952976641436', time=2024-09-12T02:50:40.294356+0000, chain.objs.size()=1 2024-09-12T01:02:38.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.fVFWKkgRq7Fo9TTt6QyMbC6hPQNEgNJ_0 2024-09-12T01:02:38.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6075779868927352820', time=2024-09-12T02:50:40.321070+0000, chain.objs.size()=1 2024-09-12T01:02:38.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.lBToPEYA8JrQkUba_4Xy50GLRbhTEb0_0 2024-09-12T01:02:38.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17051384293100589204', time=2024-09-12T02:50:40.591892+0000, chain.objs.size()=1 2024-09-12T01:02:38.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.zmR_XgM9nQIpUavGjTCL1TpNgqAQeAB_0 2024-09-12T01:02:38.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10746201412033247070', time=2024-09-12T02:50:40.595929+0000, chain.objs.size()=1 2024-09-12T01:02:38.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.hRVt1KvKbQVaUwv0KdVHihFl85TV2h6_0 2024-09-12T01:02:38.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8943878948163198812', time=2024-09-12T02:50:40.603149+0000, chain.objs.size()=1 2024-09-12T01:02:38.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.1-A3UM10drVY9g8Es4ucU-6egrQ20Xa_0 2024-09-12T01:02:38.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18137525373940887046', time=2024-09-12T02:50:40.774061+0000, chain.objs.size()=1 2024-09-12T01:02:38.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.fDlCqLS-4NQAzy4xb2eRyM6n-DC2JfS_0 2024-09-12T01:02:38.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4738740037298897887', time=2024-09-12T02:50:40.874299+0000, chain.objs.size()=1 2024-09-12T01:02:38.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.fdwCUtomykV4BY6ywEiTp3FfMCQ9HkW_0 2024-09-12T01:02:38.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.662+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17881344579498167357', time=2024-09-12T02:50:41.054235+0000, chain.objs.size()=1 2024-09-12T01:02:38.657 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.662+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.D_OQJhXHZ42Ca-1IHIPILXI-SJqROG1_0 2024-09-12T01:02:38.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.662+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8702688595948530995', time=2024-09-12T02:50:41.072106+0000, chain.objs.size()=1 2024-09-12T01:02:38.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.662+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.8PwHtWPLj27mnH9fF0NLMqgSVNfASo0_0 2024-09-12T01:02:38.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.662+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17697622196261972741', time=2024-09-12T02:50:41.133709+0000, chain.objs.size()=1 2024-09-12T01:02:38.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.662+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ZgXwoaOjAhU2KouumNwA1nUlStjj4gr_0 2024-09-12T01:02:38.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.662+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16594713339541123060', time=2024-09-12T02:50:41.155121+0000, chain.objs.size()=1 2024-09-12T01:02:38.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.662+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.PridqR68OjDBmiTEZPLlkWy1tVfibcD_0 2024-09-12T01:02:38.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.662+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16566888150399882412', time=2024-09-12T02:50:41.272721+0000, chain.objs.size()=1 2024-09-12T01:02:38.658 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.662+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.FFHLVPFrRFjNtkBcLGEMh_gr-0sPtZw_0 2024-09-12T01:02:38.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.662+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6606733956238373967', time=2024-09-12T02:50:41.424933+0000, chain.objs.size()=1 2024-09-12T01:02:38.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.662+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.3k0cULULSd-tAjeTqtXbyS7A4mEgCxp_0 2024-09-12T01:02:38.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.662+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11480411183774567502', time=2024-09-12T02:50:41.433876+0000, chain.objs.size()=1 2024-09-12T01:02:38.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.662+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.aswVDknyfkgOgLTA4GUE-xoqu6MM3MC_0 2024-09-12T01:02:38.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.662+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18087284594397358383', time=2024-09-12T02:50:41.597516+0000, chain.objs.size()=1 2024-09-12T01:02:38.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.662+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.4XhPwHkMgGcJqF8MUKIElvtTDxMKGbr_0 2024-09-12T01:02:38.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.666+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45854 2024-09-12T01:02:38.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T01:02:38.665 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6843372505147602242', time=2024-09-12T02:50:44.844810+0000, chain.objs.size()=1 2024-09-12T01:02:38.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.329__shadow_.YxY2cWBmMURTGVWUcYM7BpwEcodNuNK_0 2024-09-12T01:02:38.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2201342419134915657', time=2024-09-12T02:52:21.659816+0000, chain.objs.size()=1 2024-09-12T01:02:38.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.460__shadow_.X_nxO7PPXE1Hx-lgkQCp0MwdfkuQVfJ_0 2024-09-12T01:02:38.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15817925160068084365', time=2024-09-12T02:52:40.336591+0000, chain.objs.size()=1 2024-09-12T01:02:38.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.488__shadow_.sA3zdOmbof18POld1Hakl_hXTBEGvLB_0 2024-09-12T01:02:38.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1677753815993044954', time=2024-09-12T02:52:42.801305+0000, chain.objs.size()=1 2024-09-12T01:02:38.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.491__shadow_.jF-xMXNsIWqottGGmS3vSM2KhVCVzjR_0 2024-09-12T01:02:38.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6682441769708039089', time=2024-09-12T02:52:50.178270+0000, chain.objs.size()=1 2024-09-12T01:02:38.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.503__shadow:kkpnEcohSrS0OmtT6cE4b1ngYotif0k_.RijEw510gCv7_gxNQ272Sla30v4Z_0T_0 2024-09-12T01:02:38.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11858959049432249053', time=2024-09-12T02:53:06.267346+0000, chain.objs.size()=6 2024-09-12T01:02:38.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.519__multipart_mymultipart.2~KVTAdP9gjt9n4B7nyTqAePHON-_2AGY.1 2024-09-12T01:02:38.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.519__multipart_mymultipart.2~KVTAdP9gjt9n4B7nyTqAePHON-_2AGY.2 2024-09-12T01:02:38.666 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.519__multipart_mymultipart.2~KVTAdP9gjt9n4B7nyTqAePHON-_2AGY.3 2024-09-12T01:02:38.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.519__multipart_mymultipart.2~KVTAdP9gjt9n4B7nyTqAePHON-_2AGY.4 2024-09-12T01:02:38.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.519__multipart_mymultipart.2~KVTAdP9gjt9n4B7nyTqAePHON-_2AGY.5 2024-09-12T01:02:38.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.519__multipart_mymultipart.2~KVTAdP9gjt9n4B7nyTqAePHON-_2AGY.6 2024-09-12T01:02:38.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14416815908708206833', time=2024-09-12T02:53:10.758753+0000, chain.objs.size()=3 2024-09-12T01:02:38.667 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.520__shadow:KJnpYtDfvQetubP-7XzEqH1cP4y4XRz_.5te-dYpyonGN1AZ3GvtF1ZgNDsb4TAr_0 2024-09-12T01:02:38.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.520__shadow:KJnpYtDfvQetubP-7XzEqH1cP4y4XRz_.5te-dYpyonGN1AZ3GvtF1ZgNDsb4TAr_1 2024-09-12T01:02:38.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.520__shadow:KJnpYtDfvQetubP-7XzEqH1cP4y4XRz_.5te-dYpyonGN1AZ3GvtF1ZgNDsb4TAr_2 2024-09-12T01:02:38.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2543597005292051931', time=2024-09-12T02:53:30.231717+0000, chain.objs.size()=3 2024-09-12T01:02:38.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.523__multipart_mymultipart.2~EFoOJM3uJu-ex0-EP9la5WGteKcmukc.1 2024-09-12T01:02:38.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.523__multipart_mymultipart.2~EFoOJM3uJu-ex0-EP9la5WGteKcmukc.2 2024-09-12T01:02:38.670 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.523__multipart_mymultipart.2~EFoOJM3uJu-ex0-EP9la5WGteKcmukc.3 2024-09-12T01:02:38.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6458298937520466768', time=2024-09-12T02:54:31.575903+0000, chain.objs.size()=2 2024-09-12T01:02:38.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.558__shadow_._i69Q_skATCjAdr0KG9t6nD_S_9Zy9R_0 2024-09-12T01:02:38.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.558__shadow_._i69Q_skATCjAdr0KG9t6nD_S_9Zy9R_1 2024-09-12T01:02:38.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16333602304968101651', time=2024-09-12T02:55:03.006911+0000, chain.objs.size()=1 2024-09-12T01:02:38.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.576__shadow:e7E1WPVwXMn4kld9ypOJrQIWUqHzfFb_.EJBrVlt1nTHtJ27cUMNEiHAmr-cIVx2_0 2024-09-12T01:02:38.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8462367768814833749', time=2024-09-12T02:55:28.517140+0000, chain.objs.size()=1 2024-09-12T01:02:38.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.579__shadow:vBKUy.9BKMROOEcZue703EICpHbH3n5_.fN0sz1rq7lfXzTIYAPs5AvqJLZhjWVC_0 2024-09-12T01:02:38.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6050807863920656009', time=2024-09-12T02:55:32.171414+0000, chain.objs.size()=1 2024-09-12T01:02:38.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.583__shadow:WIbkR8puO7P5r3w82lcIdI74NF91gYV_.eCg1NcMe6canxjXlhnUxn44K5cHcYCh_0 2024-09-12T01:02:38.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.674+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9460813924881147642', time=2024-09-12T02:58:48.170296+0000, chain.objs.size()=1 2024-09-12T01:02:38.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.663__shadow_.b3GGid-XYYU_9AcomeDDT8rU7ck3Lzv_0 2024-09-12T01:02:38.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.678+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16386254774765493728', time=2024-09-12T03:00:01.461855+0000, chain.objs.size()=1 2024-09-12T01:02:38.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.678+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.740__shadow_.lY6iXKHUva_b3dsPfK0yQMEtdbheXbA_0 2024-09-12T01:02:38.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.678+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ufP7f9XcJgm-0WC03xG9zdIG_gXs-AP', time=2024-09-12T03:00:03.276044+0000, chain.objs.size()=1 2024-09-12T01:02:38.676 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.678+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.742__multipart_mymultipart2.2~ufP7f9XcJgm-0WC03xG9zdIG_gXs-AP.1 2024-09-12T01:02:38.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:38.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:02:38.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44037' 2024-09-12T01:02:38.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='_WkM3S50w40BcPiShBufp0WRmPzd05UB', time=2024-09-12T02:46:04.179788+0000, chain.objs.size()=1 2024-09-12T01:02:38.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.160__shadow_.eHQaDxrr-donSg3S21qfZWDDcEoJMFb_0 2024-09-12T01:02:38.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1944366141131860737', time=2024-09-12T02:46:27.980679+0000, chain.objs.size()=1 2024-09-12T01:02:38.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.179__shadow_.xuLNDUtrHVuXWNwYzOWp0CTn3h6gi1N_0 2024-09-12T01:02:38.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8542393883570682817', time=2024-09-12T02:46:34.760369+0000, chain.objs.size()=1 2024-09-12T01:02:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.189__shadow_.EVtHPgfGZ4wNMkSTWR84CDuP1mS0a6M_0 2024-09-12T01:02:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8702488017258703536', time=2024-09-12T02:48:28.134360+0000, chain.objs.size()=1 2024-09-12T01:02:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.241__shadow_.YYB81VE0ZrQJqTBx_Lg4-SUBGZ_mMsg_0 2024-09-12T01:02:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13495477347709416099', time=2024-09-12T02:48:30.086084+0000, chain.objs.size()=1 2024-09-12T01:02:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.243__shadow_.HyVTtL_5LZrhguJM7POEczIMqc59z7N_0 2024-09-12T01:02:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14602050647663506199', time=2024-09-12T02:48:32.039701+0000, chain.objs.size()=1 2024-09-12T01:02:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.245__shadow_.V8NakUf2qt7dwmJRrenFeuBVa0SHCYP_0 2024-09-12T01:02:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8159824803987002599', time=2024-09-12T02:48:33.556730+0000, chain.objs.size()=1 2024-09-12T01:02:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.247__shadow_.sVgyU2zkkP6dLMYOta1YVn-y40_nnL-_0 2024-09-12T01:02:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10557172488604856097', time=2024-09-12T02:48:37.230285+0000, chain.objs.size()=1 2024-09-12T01:02:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.252__shadow_.7UJirSR2sdLZew0gbw-CEPox2BSpI8w_0 2024-09-12T01:02:38.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8262766097208057855', time=2024-09-12T02:49:05.400139+0000, chain.objs.size()=1 2024-09-12T01:02:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0ZnYuD6fkNEK2xI-lKzWnBaG9iDcv1t_0 2024-09-12T01:02:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7980933517227712858', time=2024-09-12T02:49:05.465542+0000, chain.objs.size()=1 2024-09-12T01:02:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.H6ZdnpwDTjj7vTa81NI2aN66Te4mr7T_0 2024-09-12T01:02:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15012215428047484514', time=2024-09-12T02:49:05.502416+0000, chain.objs.size()=1 2024-09-12T01:02:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.f-idNesBt5Eu7oXkRoV94Vqzq_72iyX_0 2024-09-12T01:02:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15364147057124012615', time=2024-09-12T02:49:05.583884+0000, chain.objs.size()=1 2024-09-12T01:02:38.690 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.KlsBZMITeLfdXKMg48UPGL8hVycrTCM_0 2024-09-12T01:02:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.812839326149990963', time=2024-09-12T02:49:05.735020+0000, chain.objs.size()=1 2024-09-12T01:02:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.3QjoiaGNd6_y2c8wL95TV5Ku6Q-X7LZ_0 2024-09-12T01:02:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12886916781648102204', time=2024-09-12T02:49:05.745148+0000, chain.objs.size()=1 2024-09-12T01:02:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Ik2TbV1r3lmMgcEBUbSguYhpoOUxp___0 2024-09-12T01:02:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.815213432998426424', time=2024-09-12T02:49:05.766310+0000, chain.objs.size()=1 2024-09-12T01:02:38.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.uURxkPbivTa6XlhmlayOlR4jMTfTUW5_0 2024-09-12T01:02:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.954400713465034185', time=2024-09-12T02:49:05.783026+0000, chain.objs.size()=1 2024-09-12T01:02:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.FoaOzJcge3EAVymmVfMgQ4iSk4JxnCB_0 2024-09-12T01:02:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3362772132093921674', time=2024-09-12T02:49:05.801855+0000, chain.objs.size()=1 2024-09-12T01:02:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.zS2DHRu9l1wMaC3bZ4ILEWk47vGdyGi_0 2024-09-12T01:02:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.572896538553555284', time=2024-09-12T02:49:05.823574+0000, chain.objs.size()=1 2024-09-12T01:02:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.-1ZnD-2DHgMEsgCGo4bUkI96p_OWG-R_0 2024-09-12T01:02:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18432158504037190441', time=2024-09-12T02:49:05.983406+0000, chain.objs.size()=1 2024-09-12T01:02:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.2XxWIygsZQlNWAyLLJzpbs0tKwkAHFk_0 2024-09-12T01:02:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1936884992588294907', time=2024-09-12T02:49:06.045690+0000, chain.objs.size()=1 2024-09-12T01:02:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.YY7b8LBz-PN6BWe9FSA4sDyz9W9Apnt_0 2024-09-12T01:02:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12747507557009676893', time=2024-09-12T02:49:06.082959+0000, chain.objs.size()=1 2024-09-12T01:02:38.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Wq4D_mM4WaYmdoELJNU4wivwt-TV3YA_0 2024-09-12T01:02:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11009957802089455529', time=2024-09-12T02:49:06.256560+0000, chain.objs.size()=1 2024-09-12T01:02:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.t1lkO1_-QWCICd9Zr7D9cYA9Pedtqeq_0 2024-09-12T01:02:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17950300086750561190', time=2024-09-12T02:49:06.259078+0000, chain.objs.size()=1 2024-09-12T01:02:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.hlmkfWTHAx9HsZatixdsyycrS3bYjkF_0 2024-09-12T01:02:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15461778097124571471', time=2024-09-12T02:49:06.274451+0000, chain.objs.size()=1 2024-09-12T01:02:38.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.afKGP_9QuzNz9lZQZrsbU2Hz1-y7ZcM_0 2024-09-12T01:02:38.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4827326215563435862', time=2024-09-12T02:49:06.305405+0000, chain.objs.size()=1 2024-09-12T01:02:38.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7owkUrHaAtvO8AE2L5BoxTAl07TkFTy_0 2024-09-12T01:02:38.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16057103890625797209', time=2024-09-12T02:49:06.336115+0000, chain.objs.size()=1 2024-09-12T01:02:38.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.qfUqTWcedGnKoVEjGfDY73Hyg6HwejD_0 2024-09-12T01:02:38.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8594704458410920964', time=2024-09-12T02:49:06.357648+0000, chain.objs.size()=1 2024-09-12T01:02:38.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.HR71OOxVQxuMqyMT5Ffw8uGFZ1cQyeM_0 2024-09-12T01:02:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1131392228980979811', time=2024-09-12T02:49:06.484207+0000, chain.objs.size()=1 2024-09-12T01:02:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.FJJNbszk8vR9r4hcUhotCKQ94WdW_vo_0 2024-09-12T01:02:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3260282060930582125', time=2024-09-12T02:49:06.508259+0000, chain.objs.size()=1 2024-09-12T01:02:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.po8dJZvFlOAr4bLEYo2kYtBFrcKaGU6_0 2024-09-12T01:02:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12414765987687315500', time=2024-09-12T02:49:06.576929+0000, chain.objs.size()=1 2024-09-12T01:02:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.G_9L3K2N5GwN7KRMpcDTK_jvzlVMwnf_0 2024-09-12T01:02:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8390814095254207088', time=2024-09-12T02:49:06.742746+0000, chain.objs.size()=1 2024-09-12T01:02:38.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.jshYaMyV-FGa32kM-QCI_af_ZNBDU1G_0 2024-09-12T01:02:38.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12803775356704915666', time=2024-09-12T02:49:06.775910+0000, chain.objs.size()=1 2024-09-12T01:02:38.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.xnqLDN0kcbIh7bpZUdMunGpbfOLaR-F_0 2024-09-12T01:02:38.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2021718536218539531', time=2024-09-12T02:49:06.887781+0000, chain.objs.size()=1 2024-09-12T01:02:38.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.mcGQDVdWKVmSx0epubrnF2rUpZayic-_0 2024-09-12T01:02:38.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7531666698550533446', time=2024-09-12T02:49:07.095410+0000, chain.objs.size()=1 2024-09-12T01:02:38.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.DnDQKl-_h06in38ba8CBopzTAeYWcWY_0 2024-09-12T01:02:38.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.702+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6890931471092736468', time=2024-09-12T02:49:07.122436+0000, chain.objs.size()=1 2024-09-12T01:02:38.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.702+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.trxhDwljx4kBP9l4eNxQy_OvfqRfmQG_0 2024-09-12T01:02:38.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.702+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9780195359156959744', time=2024-09-12T02:49:07.190996+0000, chain.objs.size()=1 2024-09-12T01:02:38.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.702+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.QbXMkG6QyWrs9fkasS-kGiQ6-ihdOQG_0 2024-09-12T01:02:38.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.702+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4765940256563255151', time=2024-09-12T02:49:07.367297+0000, chain.objs.size()=1 2024-09-12T01:02:38.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.702+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Oh1bBTXQpBR5MCufnZZKMsBTp9o95_3_0 2024-09-12T01:02:38.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3307898405940336864', time=2024-09-12T02:49:07.371557+0000, chain.objs.size()=1 2024-09-12T01:02:38.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.VlZyiMoz-CuobTIyqucBd375Y5bS3Le_0 2024-09-12T01:02:38.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4129007850825338133', time=2024-09-12T02:49:07.372457+0000, chain.objs.size()=1 2024-09-12T01:02:38.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9I1oF_jb0vawrPJx50zr6nuIQnq8s0Q_0 2024-09-12T01:02:38.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13387776471924074933', time=2024-09-12T02:49:07.384983+0000, chain.objs.size()=1 2024-09-12T01:02:38.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9dXG-QA_KsJuHaJr0FiNUhj_RbkdIys_0 2024-09-12T01:02:38.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17444164294953812926', time=2024-09-12T02:49:07.413856+0000, chain.objs.size()=1 2024-09-12T01:02:38.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.vmSiisupfUADdQ18rTFPq3yE_BGsthJ_0 2024-09-12T01:02:38.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2274370852124216397', time=2024-09-12T02:49:07.441497+0000, chain.objs.size()=1 2024-09-12T01:02:38.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0iHC7c3dh6I5GPJ4UY_kEIK09plAbrQ_0 2024-09-12T01:02:38.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9154822190290604475', time=2024-09-12T02:49:07.444052+0000, chain.objs.size()=1 2024-09-12T01:02:38.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.zEDqFv5_1DlXS8BB0zM8e1kDMfccg9T_0 2024-09-12T01:02:38.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11930032889786624688', time=2024-09-12T02:49:52.303945+0000, chain.objs.size()=1 2024-09-12T01:02:38.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.319__shadow:.mdPeBDYMrRF-d77so7OtTLcv6USwlJ_.ChvfxoZWG-FkH0OdXagv5bOUdSBMa25_0 2024-09-12T01:02:38.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.778227780024313064', time=2024-09-12T02:50:15.805858+0000, chain.objs.size()=1 2024-09-12T01:02:38.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.AwHipUbiGyhRTZSgGKvcgTsvQ3SL-2N_0 2024-09-12T01:02:38.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12010868867765842275', time=2024-09-12T02:50:15.867125+0000, chain.objs.size()=1 2024-09-12T01:02:38.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.SN_zoKAr38n4_Frgq-dRHiIyI3pqGaL_0 2024-09-12T01:02:38.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11655003814581834147', time=2024-09-12T02:50:15.869107+0000, chain.objs.size()=1 2024-09-12T01:02:38.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Y_i6pKebMxGekTRWtM90y2i1X5zonGu_0 2024-09-12T01:02:38.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.710+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1114613578158117174', time=2024-09-12T02:50:15.871502+0000, chain.objs.size()=1 2024-09-12T01:02:38.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Gxk9CnytHOKsW5pTtG1iFOxHlBKqpp-_0 2024-09-12T01:02:38.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8271455171806477543', time=2024-09-12T02:50:15.891547+0000, chain.objs.size()=1 2024-09-12T01:02:38.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.9LD21pY2OUkTrmM1nqINU6YwPZHE1qt_0 2024-09-12T01:02:38.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7613349115980868660', time=2024-09-12T02:50:15.954269+0000, chain.objs.size()=1 2024-09-12T01:02:38.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.JoD9w6g_JETQv_caOJSnxmPFNNf9aca_0 2024-09-12T01:02:38.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8758809562447779540', time=2024-09-12T02:50:15.967875+0000, chain.objs.size()=1 2024-09-12T01:02:38.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-7SZ66a5IR-K-aXoCqhPtoAwKTR8yiM_0 2024-09-12T01:02:38.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2252480512415276711', time=2024-09-12T02:50:16.077339+0000, chain.objs.size()=1 2024-09-12T01:02:38.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.SupTBVB2mpoZniKujqCKdlo67ury0xT_0 2024-09-12T01:02:38.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.134571103687572285', time=2024-09-12T02:50:16.101484+0000, chain.objs.size()=1 2024-09-12T01:02:38.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.BgU2bIM6rf2hlZjmHifIyug8roEwevR_0 2024-09-12T01:02:38.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9071789375182828412', time=2024-09-12T02:50:16.188545+0000, chain.objs.size()=1 2024-09-12T01:02:38.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.GH6m25L1cLTQGNYJk99hYT3QMVSNeXv_0 2024-09-12T01:02:38.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15962661830815615988', time=2024-09-12T02:50:16.189962+0000, chain.objs.size()=1 2024-09-12T01:02:38.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.BVAbiSqtPHv15pazZq1zaW1U4N6B3hi_0 2024-09-12T01:02:38.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5589256571698914506', time=2024-09-12T02:50:16.205829+0000, chain.objs.size()=1 2024-09-12T01:02:38.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xUtEzT6rEaSoazv4MLYKwClPvyVyD4i_0 2024-09-12T01:02:38.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1965045696462826816', time=2024-09-12T02:50:16.236392+0000, chain.objs.size()=1 2024-09-12T01:02:38.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.3J1_yHweJspxxLGyP5dwo5sT2lSOzkZ_0 2024-09-12T01:02:38.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5675980199197959762', time=2024-09-12T02:50:16.398409+0000, chain.objs.size()=1 2024-09-12T01:02:38.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.MzZpOPt_zKs6lIENaOqfXtVWNRX3KYK_0 2024-09-12T01:02:38.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16455626358083189470', time=2024-09-12T02:50:16.412786+0000, chain.objs.size()=1 2024-09-12T01:02:38.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.9nTSq_lXg6oSukJQaS52RILq6j4-luR_0 2024-09-12T01:02:38.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16007475326953961563', time=2024-09-12T02:50:16.485056+0000, chain.objs.size()=1 2024-09-12T01:02:38.712 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.yyPGTHBNk2S4xsHuXKQrR2eI7aBvLzQ_0 2024-09-12T01:02:38.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2680048977923997831', time=2024-09-12T02:50:16.506229+0000, chain.objs.size()=1 2024-09-12T01:02:38.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.bS5Zwp_EiOxLcC0ryR7i9ZSonE1pTdL_0 2024-09-12T01:02:38.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7926675868151618753', time=2024-09-12T02:50:16.519733+0000, chain.objs.size()=1 2024-09-12T01:02:38.714 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Kz9_55ZtrwFH77OlWJThBzrjlLKNPFT_0 2024-09-12T01:02:38.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6193227267861742175', time=2024-09-12T02:50:16.642930+0000, chain.objs.size()=1 2024-09-12T01:02:38.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Fx5LLtgj3W43HSDCVD3r97WJS-LMgWC_0 2024-09-12T01:02:38.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12885177720748658797', time=2024-09-12T02:50:16.682646+0000, chain.objs.size()=1 2024-09-12T01:02:38.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Zvj1HcbKGKLToKoFLpGbq02HAd-RVcQ_0 2024-09-12T01:02:38.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.446171729354107390', time=2024-09-12T02:50:16.709103+0000, chain.objs.size()=1 2024-09-12T01:02:38.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.fr0-RLjq4rE-vhcPFciy3hCNMxhKrfP_0 2024-09-12T01:02:38.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13854877996246968293', time=2024-09-12T02:50:16.721606+0000, chain.objs.size()=1 2024-09-12T01:02:38.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.oomMNqc5i5a_rd8feyxtRUaq_wb_qCP_0 2024-09-12T01:02:38.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3063589588860166120', time=2024-09-12T02:50:16.722693+0000, chain.objs.size()=1 2024-09-12T01:02:38.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.3D_n8oHc3K765IqQ6-4e2zvoS7fqUgb_0 2024-09-12T01:02:38.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18193442128179541656', time=2024-09-12T02:50:16.941522+0000, chain.objs.size()=1 2024-09-12T01:02:38.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.m6QonNzvkgDBBp2YF549C0Yo86X8YcK_0 2024-09-12T01:02:38.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16132195685000467051', time=2024-09-12T02:50:17.014440+0000, chain.objs.size()=1 2024-09-12T01:02:38.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.bxe_jzPszr_aOBuSxCF7Tw7Bj5fwazu_0 2024-09-12T01:02:38.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7048200134139576121', time=2024-09-12T02:50:17.022629+0000, chain.objs.size()=1 2024-09-12T01:02:38.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.7hsSf_L6BZ81fQQNLfbgG-TOXVmPve__0 2024-09-12T01:02:38.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17260796680939971169', time=2024-09-12T02:50:17.038573+0000, chain.objs.size()=1 2024-09-12T01:02:38.718 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.04siamjEl_i-9A6Zyv7ePdjdOBIZoc__0 2024-09-12T01:02:38.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2655388635363060810', time=2024-09-12T02:50:17.166847+0000, chain.objs.size()=1 2024-09-12T01:02:38.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.abH4ZE4jLO9oHA8-RJXhHk3BR6JOQoq_0 2024-09-12T01:02:38.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17906078746682177159', time=2024-09-12T02:50:17.185243+0000, chain.objs.size()=1 2024-09-12T01:02:38.719 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.722+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.y3OpreWo3XeJ2KfaZCxvmS1f64itLxV_0 2024-09-12T01:02:38.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18102875849269681036', time=2024-09-12T02:50:17.209855+0000, chain.objs.size()=1 2024-09-12T01:02:38.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.5oYVBwf4Jw7W03GDfM_l21yJ3YlD096_0 2024-09-12T01:02:38.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4503433226435657537', time=2024-09-12T02:50:17.231191+0000, chain.objs.size()=1 2024-09-12T01:02:38.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.H4OXERbBPPSUQKndui4W0ZTg4I4iDx0_0 2024-09-12T01:02:38.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10548592092561861380', time=2024-09-12T02:50:17.233226+0000, chain.objs.size()=1 2024-09-12T01:02:38.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.zg08YcTA3RRsqCJx3mHSNCmVWNyRfdj_0 2024-09-12T01:02:38.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13618008726331537444', time=2024-09-12T02:50:17.234321+0000, chain.objs.size()=1 2024-09-12T01:02:38.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.GZ5T8OC-l_6sf5nTNNYE3g-InWOymYh_0 2024-09-12T01:02:38.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4281490862799892909', time=2024-09-12T02:50:17.244461+0000, chain.objs.size()=1 2024-09-12T01:02:38.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.tvfdHlb9WXgzlgcTAAmgDzLpihB1Hxt_0 2024-09-12T01:02:38.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10851413644033475214', time=2024-09-12T02:50:17.250618+0000, chain.objs.size()=1 2024-09-12T01:02:38.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ma2sMOh85jONIvxeDroULpeYz9Caq73_0 2024-09-12T01:02:38.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4397069367252434577', time=2024-09-12T02:50:17.267307+0000, chain.objs.size()=1 2024-09-12T01:02:38.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.o7Vkyus6vXv7NM5ZYYENAwQCBNlG6ZB_0 2024-09-12T01:02:38.725 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2263016531893413973', time=2024-09-12T02:50:17.280124+0000, chain.objs.size()=1 2024-09-12T01:02:38.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4y_PXcmZvsa5Pe3HIFnBRW8D3AliL5Y_0 2024-09-12T01:02:38.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17963810628433837695', time=2024-09-12T02:50:17.464820+0000, chain.objs.size()=1 2024-09-12T01:02:38.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.YFlG9lACUbFRS5x1KrSoHvNPuo7G2S3_0 2024-09-12T01:02:38.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18333498276591981370', time=2024-09-12T02:50:17.510400+0000, chain.objs.size()=1 2024-09-12T01:02:38.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.suxfHWBJ367yWkRXFq7DUe5GZ7YCCtF_0 2024-09-12T01:02:38.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14667647919477302396', time=2024-09-12T02:50:17.520500+0000, chain.objs.size()=1 2024-09-12T01:02:38.726 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Crwi787k3bmg4FDnvqzjjZs3VQnchTH_0 2024-09-12T01:02:38.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4098748418380476665', time=2024-09-12T02:50:17.638376+0000, chain.objs.size()=1 2024-09-12T01:02:38.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.NvCIYToIOA2vnzFilY-iX5Y9qvE12_8_0 2024-09-12T01:02:38.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1100552782433718061', time=2024-09-12T02:50:17.643725+0000, chain.objs.size()=1 2024-09-12T01:02:38.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.XRVk2_dufA04SoRMIkBWdAh3c7bUbRL_0 2024-09-12T01:02:38.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11891283672932882385', time=2024-09-12T02:50:17.664796+0000, chain.objs.size()=1 2024-09-12T01:02:38.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.lUGdd76-nvOXAIVauIA5kNd-Fsn8Tuz_0 2024-09-12T01:02:38.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17439307668991539593', time=2024-09-12T02:50:39.431444+0000, chain.objs.size()=1 2024-09-12T01:02:38.728 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.730+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_._p9LPfKabh6zdr47KF_7-eeU6SN9dRt_0 2024-09-12T01:02:38.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14448377746490385506', time=2024-09-12T02:50:39.441815+0000, chain.objs.size()=1 2024-09-12T01:02:38.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.vopAIyVVabE32o6FPjT81oim7e4OOfa_0 2024-09-12T01:02:38.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15791506414071123766', time=2024-09-12T02:50:39.468228+0000, chain.objs.size()=1 2024-09-12T01:02:38.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.PuPpL9dAiUgi2Z4hNWx7Php3c3gFBMY_0 2024-09-12T01:02:38.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.765614545635367591', time=2024-09-12T02:50:39.503567+0000, chain.objs.size()=1 2024-09-12T01:02:38.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.UOA04F3NRmGHDIHdsd96w9-fEC01ebX_0 2024-09-12T01:02:38.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12808870174827450753', time=2024-09-12T02:50:39.518516+0000, chain.objs.size()=1 2024-09-12T01:02:38.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.sCpI4GI3lhuNv1r8gZ3JNAcW7MDnugd_0 2024-09-12T01:02:38.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1778668186616400806', time=2024-09-12T02:50:39.534936+0000, chain.objs.size()=1 2024-09-12T01:02:38.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Cnvnbnksml5zq1t0HoctBNM2usD1kFm_0 2024-09-12T01:02:38.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3285408945817466555', time=2024-09-12T02:50:39.556487+0000, chain.objs.size()=1 2024-09-12T01:02:38.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.24OwtQsl8lIiI9-TobrL7AlyYAQRf7S_0 2024-09-12T01:02:38.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16833610416824406336', time=2024-09-12T02:50:39.557962+0000, chain.objs.size()=1 2024-09-12T01:02:38.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.cWdIpIZ3GXjAbRW6pvY-thd3c9GuSc-_0 2024-09-12T01:02:38.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10977582018685530378', time=2024-09-12T02:50:39.588140+0000, chain.objs.size()=1 2024-09-12T01:02:38.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.67DkAgfz1RfXWgqOkAM-gbxiNGZOM93_0 2024-09-12T01:02:38.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.738+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9096404959539324007', time=2024-09-12T02:50:39.616555+0000, chain.objs.size()=1 2024-09-12T01:02:38.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.My5tKltpkaHOkxNk8NykIL6cbEZSGVJ_0 2024-09-12T01:02:38.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.738+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7835096467247980005', time=2024-09-12T02:50:39.751831+0000, chain.objs.size()=1 2024-09-12T01:02:38.733 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.1DIHtCdQPK2IWJykfGuA6IgFsw95pGR_0 2024-09-12T01:02:38.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.738+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3104680191097941523', time=2024-09-12T02:50:39.861818+0000, chain.objs.size()=1 2024-09-12T01:02:38.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.5T3y9vLiwCGYjAnCaP06uBHuOIEy_s-_0 2024-09-12T01:02:38.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.742+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18280047814953708152', time=2024-09-12T02:50:40.024394+0000, chain.objs.size()=1 2024-09-12T01:02:38.737 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.742+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.fPieIbgbSAxh9ButoNkzrslxcnRtOgV_0 2024-09-12T01:02:38.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44037 2024-09-12T01:02:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=47, truncated=0, next_marker='' 2024-09-12T01:02:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5001798274957768822', time=2024-09-12T02:50:40.036677+0000, chain.objs.size()=1 2024-09-12T01:02:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.RIExiuatYSsbMV918nwrKGzpdaGfkfM_0 2024-09-12T01:02:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4272821717005677061', time=2024-09-12T02:50:40.082692+0000, chain.objs.size()=1 2024-09-12T01:02:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.BdZs-x6jdylzX8_gPwJwrAWUPm65RND_0 2024-09-12T01:02:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5405513196645808621', time=2024-09-12T02:50:40.084977+0000, chain.objs.size()=1 2024-09-12T01:02:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.HKpjmpDc-5BR5QiV0M-r__AlvQBj_ku_0 2024-09-12T01:02:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12039567359441350321', time=2024-09-12T02:50:40.085760+0000, chain.objs.size()=1 2024-09-12T01:02:38.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.YWWhZcqbtlJD7R9pAFMFdScf_zm9qqU_0 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13416873193936103652', time=2024-09-12T02:50:40.102540+0000, chain.objs.size()=1 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.VRiu5iJc1IR7SpFuvMvKlGymsrdCayz_0 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2182688478573856299', time=2024-09-12T02:50:40.120441+0000, chain.objs.size()=1 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.HJq7CWw_R1oV8oOjPRPCuOy2rXOc5oq_0 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11279416188103795742', time=2024-09-12T02:50:40.138298+0000, chain.objs.size()=1 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.sM-nCnaxoMqcFASeROVRIPpcv31VDNl_0 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6725312523118942407', time=2024-09-12T02:50:40.145893+0000, chain.objs.size()=1 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.M7EPnl0VhQB-uikLwbmngGVocDTWIoU_0 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4381748980907283332', time=2024-09-12T02:50:40.152103+0000, chain.objs.size()=1 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.4WKube37oDCri0_T1ljUtf78aW8xCad_0 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13723414649987640276', time=2024-09-12T02:50:40.254965+0000, chain.objs.size()=1 2024-09-12T01:02:38.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.cgtJNzrjSjWRxkLNbzzD1DGNsIaeCqo_0 2024-09-12T01:02:38.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14478075304769189989', time=2024-09-12T02:50:40.285097+0000, chain.objs.size()=1 2024-09-12T01:02:38.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.0b3b_E8LB3OqnqPlIHHb3TT4CEC-iIC_0 2024-09-12T01:02:38.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18416305921982242671', time=2024-09-12T02:50:40.290072+0000, chain.objs.size()=1 2024-09-12T01:02:38.745 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.CiGdWCJjHZWqrfZZQRscbCBACYqCuZv_0 2024-09-12T01:02:38.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1701291348679565966', time=2024-09-12T02:50:40.352927+0000, chain.objs.size()=1 2024-09-12T01:02:38.746 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.nN-PCPpyCe_hb48GxIU4l1yUcayagdb_0 2024-09-12T01:02:38.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18265677553676529474', time=2024-09-12T02:50:40.539979+0000, chain.objs.size()=1 2024-09-12T01:02:38.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.1Qb9Qn4DyBWLw_JA5Eu1wm96kpg9K0j_0 2024-09-12T01:02:38.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.730701443201044914', time=2024-09-12T02:50:40.542135+0000, chain.objs.size()=1 2024-09-12T01:02:38.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.8MSounrJ4OIUSfCRxIScO5gnvi9OaAk_0 2024-09-12T01:02:38.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5040362332174953012', time=2024-09-12T02:50:40.627284+0000, chain.objs.size()=1 2024-09-12T01:02:38.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Qh3N3S-LuaUYBvBViq9OqrGuFI3XreY_0 2024-09-12T01:02:38.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17965737256317880640', time=2024-09-12T02:50:40.809902+0000, chain.objs.size()=1 2024-09-12T01:02:38.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.gsCHM7pWT-dU2UhnASPzH9X6NH2Ddce_0 2024-09-12T01:02:38.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7130210122699026949', time=2024-09-12T02:50:40.850722+0000, chain.objs.size()=1 2024-09-12T01:02:38.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.IlEnn9Fi-25LeuaEVzoB3cBu-ttqUK4_0 2024-09-12T01:02:38.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4414829159492329266', time=2024-09-12T02:50:41.125644+0000, chain.objs.size()=1 2024-09-12T01:02:38.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.sJK--waHwygpnfj5a9f915xWFfXki4t_0 2024-09-12T01:02:38.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.754+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8271145377686111863', time=2024-09-12T02:50:41.126602+0000, chain.objs.size()=1 2024-09-12T01:02:38.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.754+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.VdzOV12KZfxV6xqUjOmjknjHVtM4LM9_0 2024-09-12T01:02:38.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.754+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1214923942804011828', time=2024-09-12T02:50:41.162949+0000, chain.objs.size()=1 2024-09-12T01:02:38.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.754+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.fcIvV3XMN_2hb53hgygaJOO9w4tPXGW_0 2024-09-12T01:02:38.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.754+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8594159339043398285', time=2024-09-12T02:50:41.392925+0000, chain.objs.size()=1 2024-09-12T01:02:38.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.754+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.H1x-UsMOgHl1RsEESfZF59Tk2iJMM5j_0 2024-09-12T01:02:38.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.754+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16479472125804747284', time=2024-09-12T02:50:41.428312+0000, chain.objs.size()=1 2024-09-12T01:02:38.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.754+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.L_Ah09B7txYbmY7jNMBnNo156nTnSzj_0 2024-09-12T01:02:38.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.754+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16125765905433764085', time=2024-09-12T02:50:41.598930+0000, chain.objs.size()=1 2024-09-12T01:02:38.751 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.754+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.I-wJbAJW_cxUqW0bmcmGN1graP8XzR2_0 2024-09-12T01:02:38.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.754+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.700472717865160893', time=2024-09-12T02:50:41.599754+0000, chain.objs.size()=1 2024-09-12T01:02:38.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.754+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ZKjnxD4KI7zjRsMnkGfgPZGJDbuxcDV_0 2024-09-12T01:02:38.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.754+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8543972347943732719', time=2024-09-12T02:50:41.601649+0000, chain.objs.size()=1 2024-09-12T01:02:38.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.7-WCV_yZ_uf4mhqjcdyVoqSG6fHRQ5p_0 2024-09-12T01:02:38.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.758+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2342535160079678734', time=2024-09-12T02:50:44.913030+0000, chain.objs.size()=1 2024-09-12T01:02:38.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.329__shadow_.lRNdzqXy1BzPzSfFjINkMDIq5h9Qxet_0 2024-09-12T01:02:38.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.758+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11990271392049690309', time=2024-09-12T02:52:03.282701+0000, chain.objs.size()=1 2024-09-12T01:02:38.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.439__shadow_.05rF5CcLi_KmgY5wbSDvzHWZ7M8_23h_0 2024-09-12T01:02:38.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.758+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.894409532386639215', time=2024-09-12T02:52:24.745245+0000, chain.objs.size()=1 2024-09-12T01:02:38.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.463__shadow_.SJwHPQyxjzmcFJw8r2Ky58ld5-fFW4p_0 2024-09-12T01:02:38.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.758+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13203321254158260455', time=2024-09-12T02:52:34.478814+0000, chain.objs.size()=1 2024-09-12T01:02:38.753 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.481__shadow_.FmwyA9XzIpDfO-IhcBEfnEE-5ax4aBP_0 2024-09-12T01:02:38.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.758+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7251097458726765131', time=2024-09-12T02:52:37.003150+0000, chain.objs.size()=1 2024-09-12T01:02:38.755 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.484__shadow_.0dpB6ei7ATOVHV8McvGYHGo2Zd5wtZg_0 2024-09-12T01:02:38.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11949453754299511636', time=2024-09-12T02:52:41.052632+0000, chain.objs.size()=1 2024-09-12T01:02:38.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.489__shadow_.MwqvQSjTbNWiC6Bh5nyGSJmLLbBPylw_0 2024-09-12T01:02:38.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3756232000378092013', time=2024-09-12T02:52:47.310265+0000, chain.objs.size()=1 2024-09-12T01:02:38.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.499__shadow_.FqOjqzlyy10O9k6HdxBF-C91KupjCsy_0 2024-09-12T01:02:38.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3578213842205516171', time=2024-09-12T02:53:01.482373+0000, chain.objs.size()=1 2024-09-12T01:02:38.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.518__multipart_mymultipart.2~0_633wdMGFpDsnYgPilT4g0fQ3V3Prs.1 2024-09-12T01:02:38.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13099930845577450691', time=2024-09-12T02:53:09.622937+0000, chain.objs.size()=3 2024-09-12T01:02:38.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.521__multipart_mymultipart.2~KsGveiui_9yGA5C_z9L6HlXSQvlp-FY.1 2024-09-12T01:02:38.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.521__multipart_mymultipart.2~KsGveiui_9yGA5C_z9L6HlXSQvlp-FY.2 2024-09-12T01:02:38.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.521__multipart_mymultipart.2~KsGveiui_9yGA5C_z9L6HlXSQvlp-FY.3 2024-09-12T01:02:38.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18191616568109351862', time=2024-09-12T02:54:51.698506+0000, chain.objs.size()=1 2024-09-12T01:02:38.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:hMTdlRCV47cGBkKnzhAv1IemfPSOhKr_.VN2VdEgDFZC3XJ505AdYeLFsldnoDKx_0 2024-09-12T01:02:38.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2060738928692001215', time=2024-09-12T02:54:58.130516+0000, chain.objs.size()=1 2024-09-12T01:02:38.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.574__shadow_.sej0rgPbuhE7H4A9P8ue1wFj_szQE9l_0 2024-09-12T01:02:38.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12499411582077896758', time=2024-09-12T02:55:18.878335+0000, chain.objs.size()=1 2024-09-12T01:02:38.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:deMVaEmycRpdAUCSyGJbLe71f-6XwGC_.jLeM56MZI7tOu-aIiyX6Rw9zu0XF5X5_0 2024-09-12T01:02:38.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11878561276800893210', time=2024-09-12T02:55:20.422806+0000, chain.objs.size()=1 2024-09-12T01:02:38.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:QAG6yrzzvcEgZqsRwO3RTEjADRGfG1r_.mwRdTqKYnKe1AVNwVeZufocKjBOxMHy_0 2024-09-12T01:02:38.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.966+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3218863844613665242', time=2024-09-12T02:55:21.719135+0000, chain.objs.size()=1 2024-09-12T01:02:38.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.966+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:fC9zpy9pU2UMvmL4b2cKLY6fdLN.upP_.xsvWcCXG3mbkqS4Boht6PuTdYjUAHZl_0 2024-09-12T01:02:38.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.974+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15070527081233977337', time=2024-09-12T02:55:28.603619+0000, chain.objs.size()=1 2024-09-12T01:02:38.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.974+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.579__shadow:-Dv9K3v-ppbLDDVB-l3gCRbGMLut2aC_.MoUb1aGuOmsT8gdz2WJCAE6qjJ8QvC7_0 2024-09-12T01:02:38.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.974+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10545411290053208769', time=2024-09-12T02:58:28.504617+0000, chain.objs.size()=1 2024-09-12T01:02:38.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.974+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.640__shadow_.YW1wnZd5yJK41_jrzg0cq4KLv2sTbU3_0 2024-09-12T01:02:38.969 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.974+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11255176448539098748', time=2024-09-12T02:58:46.883410+0000, chain.objs.size()=6 2024-09-12T01:02:38.970 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.974+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.660__multipart_bar.2~8Snl4bwnpyz80fG2QYRGadHTI9jHWC6.1 2024-09-12T01:02:38.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.660__multipart_bar.2~8Snl4bwnpyz80fG2QYRGadHTI9jHWC6.2 2024-09-12T01:02:38.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.660__multipart_bar.2~8Snl4bwnpyz80fG2QYRGadHTI9jHWC6.3 2024-09-12T01:02:38.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.660__multipart_bar.2~8Snl4bwnpyz80fG2QYRGadHTI9jHWC6.4 2024-09-12T01:02:38.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.660__multipart_bar.2~8Snl4bwnpyz80fG2QYRGadHTI9jHWC6.5 2024-09-12T01:02:38.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.660__multipart_bar.2~8Snl4bwnpyz80fG2QYRGadHTI9jHWC6.6 2024-09-12T01:02:38.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6592416295837291071', time=2024-09-12T02:58:51.164916+0000, chain.objs.size()=1 2024-09-12T01:02:38.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.666__shadow_.jTtv_KgcbVeFEJPfeS24Vg7_9b_2amz_0 2024-09-12T01:02:38.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13564014133175966733', time=2024-09-12T02:58:54.210635+0000, chain.objs.size()=1 2024-09-12T01:02:38.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.672__shadow_.urfkN0-XPdX9qzBWwj95LppC5qBA5Wd_0 2024-09-12T01:02:38.974 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1567104752800636490', time=2024-09-12T02:59:06.353279+0000, chain.objs.size()=1 2024-09-12T01:02:38.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.691__shadow_.tken2GJgXQshxn0rvSrxDX2Lzz0iuR7_0 2024-09-12T01:02:38.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.982+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9020349938196401039', time=2024-09-12T02:59:55.825089+0000, chain.objs.size()=1 2024-09-12T01:02:38.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.982+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.734__shadow_.xGOkcsjkTPZkNUuhb6jcDJ3JPziaZ_f_0 2024-09-12T01:02:38.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.990+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:38.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.994+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:02:38.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.998+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:38.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:38.998+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:38.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44707' 2024-09-12T01:02:38.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2385222383806850960', time=2024-09-12T02:46:01.942154+0000, chain.objs.size()=2 2024-09-12T01:02:38.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.158__shadow_.ckOHsJ7iHWVVA7oXOwLGC9QXYzRiVWZ_0 2024-09-12T01:02:38.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.158__shadow_.ckOHsJ7iHWVVA7oXOwLGC9QXYzRiVWZ_1 2024-09-12T01:02:38.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6285971722121207895', time=2024-09-12T02:48:18.976328+0000, chain.objs.size()=1 2024-09-12T01:02:38.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.230__shadow_.RBHmKYg641T7HMEZPVULHq8U0PM7SNs_0 2024-09-12T01:02:38.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7585223040551141376', time=2024-09-12T02:48:21.228270+0000, chain.objs.size()=1 2024-09-12T01:02:38.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.233__shadow_.f5WE-XjtGb8B2nHC1j7iuH-QuYC-fsF_0 2024-09-12T01:02:38.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12232589321589779795', time=2024-09-12T02:48:30.085165+0000, chain.objs.size()=1 2024-09-12T01:02:38.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.243__shadow_.xG3JSU_jZWR9bVxN75Djw6uimNIfEnQ_0 2024-09-12T01:02:38.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4411457278835853268', time=2024-09-12T02:48:35.756952+0000, chain.objs.size()=1 2024-09-12T01:02:38.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.250__shadow_.IGVlAgayucgLHmYm40oYV92BrsK4yKe_0 2024-09-12T01:02:38.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6792142153100279855', time=2024-09-12T02:48:35.759025+0000, chain.objs.size()=1 2024-09-12T01:02:38.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.250__shadow_.vbnaRW_sdN7oh8YL_5t5k2LAnFijVGS_0 2024-09-12T01:02:38.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9227349630751707587', time=2024-09-12T02:49:05.409073+0000, chain.objs.size()=1 2024-09-12T01:02:38.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.UBOHHbfVMTQMx__lj5G8Sm7QPMopiqy_0 2024-09-12T01:02:38.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13747727125392663574', time=2024-09-12T02:49:05.441489+0000, chain.objs.size()=1 2024-09-12T01:02:38.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.hucH9YnYxcNgtPpkclpksH0grk2fntR_0 2024-09-12T01:02:38.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7441501959275408378', time=2024-09-12T02:49:05.465569+0000, chain.objs.size()=1 2024-09-12T01:02:38.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.-0r6TZK5PO_eOQenECV-1UEwIHbt352_0 2024-09-12T01:02:39.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15247274855448490657', time=2024-09-12T02:49:05.513772+0000, chain.objs.size()=1 2024-09-12T01:02:39.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Qr7P1iz8OzabvwcfRUxSEY250tN2Lcd_0 2024-09-12T01:02:39.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5566772104514597422', time=2024-09-12T02:49:05.535399+0000, chain.objs.size()=1 2024-09-12T01:02:39.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.002+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.B4uSwB8b-3vuKNSH8hXcVFxeFEFXVLA_0 2024-09-12T01:02:39.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14505499336530775719', time=2024-09-12T02:49:05.539353+0000, chain.objs.size()=1 2024-09-12T01:02:39.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.pdpPsbBHNkuFVJXQ6syRasZT4X7L5v4_0 2024-09-12T01:02:39.009 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14618013989201834703', time=2024-09-12T02:49:05.548398+0000, chain.objs.size()=1 2024-09-12T01:02:39.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.6IcNmC5J1XJfKwZUGM7DLT48H2fRORx_0 2024-09-12T01:02:39.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8161779091676880184', time=2024-09-12T02:49:05.556097+0000, chain.objs.size()=1 2024-09-12T01:02:39.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9bGVcj-EzxGxI5AUvOhxup4HnaK2E-q_0 2024-09-12T01:02:39.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3310377454693425882', time=2024-09-12T02:49:05.558378+0000, chain.objs.size()=1 2024-09-12T01:02:39.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.6Kp6cpApdjoAhul_2RuFZxhQiyd8xd-_0 2024-09-12T01:02:39.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10175832410645525897', time=2024-09-12T02:49:05.559903+0000, chain.objs.size()=1 2024-09-12T01:02:39.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.zl8k4uaqthmQxXI175zMxbtB1QPqvyF_0 2024-09-12T01:02:39.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13935859883996981318', time=2024-09-12T02:49:05.711547+0000, chain.objs.size()=1 2024-09-12T01:02:39.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.2_vyFyU4e6cPwE22UuaGKwJ7lnUBDbY_0 2024-09-12T01:02:39.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3990919852218200119', time=2024-09-12T02:49:05.828813+0000, chain.objs.size()=1 2024-09-12T01:02:39.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.LvroMgzSGormVAqlBDI4Px7-OGCeUpl_0 2024-09-12T01:02:39.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17312261722574316467', time=2024-09-12T02:49:06.003295+0000, chain.objs.size()=1 2024-09-12T01:02:39.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.j7L4JbqRSqHo7GqshHFjzLzFkTt1y7u_0 2024-09-12T01:02:39.010 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1554440483063425472', time=2024-09-12T02:49:06.023911+0000, chain.objs.size()=1 2024-09-12T01:02:39.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.f6fRvM90nSl2ma-YQxAsLiYd-eU37qX_0 2024-09-12T01:02:39.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2853975763330775496', time=2024-09-12T02:49:06.041913+0000, chain.objs.size()=1 2024-09-12T01:02:39.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9_txtvK4zvTnLF5tvkmMH_zhDbCVB05_0 2024-09-12T01:02:39.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13890950171248339531', time=2024-09-12T02:49:06.090841+0000, chain.objs.size()=1 2024-09-12T01:02:39.011 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.014+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.a9595HL_ZG4FvSP-QTzjx2gLsgJsCQj_0 2024-09-12T01:02:39.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.022+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15238353236616000605', time=2024-09-12T02:49:06.108508+0000, chain.objs.size()=1 2024-09-12T01:02:39.016 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.022+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.SOOx8NvYgxiyADhBMkbIg1N56X-Ubvh_0 2024-09-12T01:02:39.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9470982296576715404', time=2024-09-12T02:49:06.252004+0000, chain.objs.size()=1 2024-09-12T01:02:39.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.pD3V6IEwF10WWwGUn5dJ-HVlpvRpGCE_0 2024-09-12T01:02:39.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14549023535674569201', time=2024-09-12T02:49:06.321721+0000, chain.objs.size()=1 2024-09-12T01:02:39.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9uQ2CDO6RvfFfDVpNsKL0xJ8uGKmbUP_0 2024-09-12T01:02:39.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10704181399516851932', time=2024-09-12T02:49:06.584185+0000, chain.objs.size()=1 2024-09-12T01:02:39.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.QC49A6wec1LHrp9w3biSVErzA-hJwdV_0 2024-09-12T01:02:39.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17140392130931623694', time=2024-09-12T02:49:06.774974+0000, chain.objs.size()=1 2024-09-12T01:02:39.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.4OCewFrOIP8Eo9ZX5inG2fgTPXRb7p6_0 2024-09-12T01:02:39.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13422150440074637442', time=2024-09-12T02:49:06.798256+0000, chain.objs.size()=1 2024-09-12T01:02:39.023 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ypNEL3a6v5NIBc9bzSKtR1lqMLLkl05_0 2024-09-12T01:02:39.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2562902851828176652', time=2024-09-12T02:49:06.800727+0000, chain.objs.size()=1 2024-09-12T01:02:39.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.bJunmn-v4t7eMqI7SfKlQ06tN_TrmfQ_0 2024-09-12T01:02:39.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12291348266908176141', time=2024-09-12T02:49:06.819801+0000, chain.objs.size()=1 2024-09-12T01:02:39.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.FssMwoxFPUTZAQ6qPqFWs7nkISJ-ORA_0 2024-09-12T01:02:39.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4997344135677930814', time=2024-09-12T02:49:07.089205+0000, chain.objs.size()=1 2024-09-12T01:02:39.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9qKcAK3vvXti8heK47e8i22KFW1wurN_0 2024-09-12T01:02:39.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1251472379718380753', time=2024-09-12T02:49:07.099514+0000, chain.objs.size()=1 2024-09-12T01:02:39.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.bS1hzVJi6Q_FMwFUXE3qZSVV9uHi0Lk_0 2024-09-12T01:02:39.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8153320345092046558', time=2024-09-12T02:49:07.123074+0000, chain.objs.size()=1 2024-09-12T01:02:39.024 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.026+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7IuvPuYx5mGHUk3iymR0VXlTN8uXuat_0 2024-09-12T01:02:39.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.030+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5677832673891343811', time=2024-09-12T02:49:07.146052+0000, chain.objs.size()=1 2024-09-12T01:02:39.028 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.034+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.GGhXL8Up-vQ7qpHjc8DkJPRdevqRZ1x_0 2024-09-12T01:02:39.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4857236913262217401', time=2024-09-12T02:49:07.179716+0000, chain.objs.size()=1 2024-09-12T01:02:39.032 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.a2uusp7ez3yQ6jTqX8A2ecz-Brcnqhv_0 2024-09-12T01:02:39.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12993110588860437100', time=2024-09-12T02:49:07.349578+0000, chain.objs.size()=1 2024-09-12T01:02:39.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.kJTlAjd8FCnyhjyZfhJDIso38GPFBZd_0 2024-09-12T01:02:39.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13135638106564345904', time=2024-09-12T02:49:07.375888+0000, chain.objs.size()=1 2024-09-12T01:02:39.033 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.V0JR5hGI3OqlKXs8V0spmpMyM4M6M6r_0 2024-09-12T01:02:39.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4294286093557246032', time=2024-09-12T02:49:10.445960+0000, chain.objs.size()=1 2024-09-12T01:02:39.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.266__shadow_.KOnNP0dnzPf7GJfDBV9eBL-uUzDzbte_0 2024-09-12T01:02:39.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13566711683657663948', time=2024-09-12T02:49:16.836708+0000, chain.objs.size()=1 2024-09-12T01:02:39.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.275__shadow_._E3CYsQuNHz0i2mzaz0qZQwPcL7DPxs_0 2024-09-12T01:02:39.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5164280158564619717', time=2024-09-12T02:49:26.163794+0000, chain.objs.size()=1 2024-09-12T01:02:39.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.287__shadow_.d3aYhSd5H-pREs7oEibLOthN4agkAOW_0 2024-09-12T01:02:39.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14540143814575900373', time=2024-09-12T02:49:32.471002+0000, chain.objs.size()=1 2024-09-12T01:02:39.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.vtql5VUJ5r44jERE02Si524Ewu1dDSL_0 2024-09-12T01:02:39.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16189682139662856482', time=2024-09-12T02:49:54.046128+0000, chain.objs.size()=1 2024-09-12T01:02:39.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.322__shadow_.gNR8FGLJ6tZZYLwL12CxIFm-Lu1oIIU_0 2024-09-12T01:02:39.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.817512366593521426', time=2024-09-12T02:50:15.848817+0000, chain.objs.size()=1 2024-09-12T01:02:39.034 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.038+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.wlkJg0vrntCNe3JXO2blon_8iOCAL-y_0 2024-09-12T01:02:39.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.042+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1467953716274344304', time=2024-09-12T02:50:15.877889+0000, chain.objs.size()=1 2024-09-12T01:02:39.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.042+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.rT_RLlGDQU4Ep2VE0xlPm8O9EmwAGtF_0 2024-09-12T01:02:39.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.042+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18195571338371317903', time=2024-09-12T02:50:15.878907+0000, chain.objs.size()=1 2024-09-12T01:02:39.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.042+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.vgP0ttjpc9kY5hEBPmvhi5ogdcISN2h_0 2024-09-12T01:02:39.040 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.046+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17412523102734878191', time=2024-09-12T02:50:15.957665+0000, chain.objs.size()=1 2024-09-12T01:02:39.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.046+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xL6hGLMnLDMwjeg0lln-Pdl7rnqmjHo_0 2024-09-12T01:02:39.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.046+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2830091770101154282', time=2024-09-12T02:50:15.964457+0000, chain.objs.size()=1 2024-09-12T01:02:39.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.046+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ovdiwIPbyWU7tvdB9Jgw2NYKQfesful_0 2024-09-12T01:02:39.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.046+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2729510786038140768', time=2024-09-12T02:50:16.092787+0000, chain.objs.size()=1 2024-09-12T01:02:39.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.046+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Cb7ZCdhL8v5bnQAmyN3j2tPs_7dHsUb_0 2024-09-12T01:02:39.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.046+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4960767459132604939', time=2024-09-12T02:50:16.115161+0000, chain.objs.size()=1 2024-09-12T01:02:39.041 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.046+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4qjssv8ugyHP9BYt_9CNNHO7FCLGmqr_0 2024-09-12T01:02:39.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.046+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6617004128045432547', time=2024-09-12T02:50:16.150755+0000, chain.objs.size()=1 2024-09-12T01:02:39.042 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.046+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.swsbiK9ifr3wCGYZ5s3h-5FJxBhp-Zc_0 2024-09-12T01:02:39.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.050+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5435405962715790804', time=2024-09-12T02:50:16.230578+0000, chain.objs.size()=1 2024-09-12T01:02:39.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.050+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ThpKS1Bq8um-KavkqYfKvj_2e2XcGrG_0 2024-09-12T01:02:39.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.050+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12842168743471081328', time=2024-09-12T02:50:16.509895+0000, chain.objs.size()=1 2024-09-12T01:02:39.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.050+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.2A1D26Rf9WaHVlM0AjayP_bxGR5D4Yn_0 2024-09-12T01:02:39.045 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.050+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12849435930101979797', time=2024-09-12T02:50:16.513792+0000, chain.objs.size()=1 2024-09-12T01:02:39.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.050+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.O7dr4larImNpKRs7mIKpu3p0PkeeirM_0 2024-09-12T01:02:39.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.050+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2889154326886095315', time=2024-09-12T02:50:16.635225+0000, chain.objs.size()=1 2024-09-12T01:02:39.046 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.050+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.IEpovaYlFwEBpauguNNxoB_23jMGViH_0 2024-09-12T01:02:39.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.050+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16680426333999415215', time=2024-09-12T02:50:16.666564+0000, chain.objs.size()=1 2024-09-12T01:02:39.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.050+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.K8OyOVbn_Ro2n3zl6_1ePGBVxb86SKk_0 2024-09-12T01:02:39.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.050+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17528846856417175320', time=2024-09-12T02:50:16.796855+0000, chain.objs.size()=1 2024-09-12T01:02:39.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.050+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.VItEFi9gyWO-F_4msCJ3ypIuMyCyrv8_0 2024-09-12T01:02:39.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.050+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1289119673287129731', time=2024-09-12T02:50:16.883161+0000, chain.objs.size()=1 2024-09-12T01:02:39.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.050+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.burojLjdo-xwO0RTREoW-tMgl4ghIte_0 2024-09-12T01:02:39.047 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.050+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6243554602411029003', time=2024-09-12T02:50:16.894588+0000, chain.objs.size()=1 2024-09-12T01:02:39.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.050+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.LWhisIgFOpOiOTKPRFafY52HFFAK7Eg_0 2024-09-12T01:02:39.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.054+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1444848922109140028', time=2024-09-12T02:50:16.946201+0000, chain.objs.size()=1 2024-09-12T01:02:39.048 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.054+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.CkBiNOVNDUFQUmgHUojLWMpjICwLUXQ_0 2024-09-12T01:02:39.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.054+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12019238808764442992', time=2024-09-12T02:50:17.141471+0000, chain.objs.size()=1 2024-09-12T01:02:39.049 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.054+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.BI4tfWl9SnD18LXczoVmXpbUgjydaG4_0 2024-09-12T01:02:39.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.054+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15278160069525406743', time=2024-09-12T02:50:17.165659+0000, chain.objs.size()=1 2024-09-12T01:02:39.052 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.054+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ltfegxVhywVlbFa95M6y1ThMb8nBrYB_0 2024-09-12T01:02:39.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.058+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11767195639952278194', time=2024-09-12T02:50:17.206121+0000, chain.objs.size()=1 2024-09-12T01:02:39.053 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.058+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.DyeihsgC-fP7h6-8Evh_vuw2-EsQFvW_0 2024-09-12T01:02:39.054 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.058+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12983260824627094130', time=2024-09-12T02:50:17.455265+0000, chain.objs.size()=1 2024-09-12T01:02:39.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.058+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.RTnJG9fHDewAkAc8Dl2NSNLTaW2i2lT_0 2024-09-12T01:02:39.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.058+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1039103809327728165', time=2024-09-12T02:50:17.467678+0000, chain.objs.size()=1 2024-09-12T01:02:39.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.058+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.I0S2a4D6eRwp0I-2wYHxlDG0CtBPE_5_0 2024-09-12T01:02:39.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.058+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17640279106582341943', time=2024-09-12T02:50:17.536982+0000, chain.objs.size()=1 2024-09-12T01:02:39.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.058+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.PhKTDNURrg_yQJOVuSyv-9-H705vmRQ_0 2024-09-12T01:02:39.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.058+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1272561010263171961', time=2024-09-12T02:50:17.540149+0000, chain.objs.size()=1 2024-09-12T01:02:39.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.058+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.JZqFNmpf8-j-RorCPSZzsHw8C56F1SN_0 2024-09-12T01:02:39.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.058+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6559610415337623180', time=2024-09-12T02:50:17.684104+0000, chain.objs.size()=1 2024-09-12T01:02:39.055 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.058+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.7CfZq3ZrAuBcBuYlLOBiyPr4nWkYLCv_0 2024-09-12T01:02:39.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10928098076284201564', time=2024-09-12T02:50:17.717649+0000, chain.objs.size()=1 2024-09-12T01:02:39.056 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.06BX6oYYd5OXUJSQdA6FTdy-wNDI6wl_0 2024-09-12T01:02:39.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4285636088434550967', time=2024-09-12T02:50:39.442861+0000, chain.objs.size()=1 2024-09-12T01:02:39.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.aLo3pEaNa2Lm7eqZIW2YAWN_ULCAQ3n_0 2024-09-12T01:02:39.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14459913466084469646', time=2024-09-12T02:50:39.531468+0000, chain.objs.size()=1 2024-09-12T01:02:39.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Jta1nO8nNA2MsfhoJQVXhYhYIQHmpwa_0 2024-09-12T01:02:39.057 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9186883523793181842', time=2024-09-12T02:50:39.543003+0000, chain.objs.size()=1 2024-09-12T01:02:39.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.8Dro8PB6DUa2RQ15d7mHNGSCpY9XABH_0 2024-09-12T01:02:39.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11060527595882387416', time=2024-09-12T02:50:39.553855+0000, chain.objs.size()=1 2024-09-12T01:02:39.058 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.graX-OuoLyslmHBLeS9UnJ-DUnSDK24_0 2024-09-12T01:02:39.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.062+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10365841120418146273', time=2024-09-12T02:50:39.762253+0000, chain.objs.size()=1 2024-09-12T01:02:39.060 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.062+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.jTgbMJQMWaP7QRC8cf3LkTHwewJ9NRu_0 2024-09-12T01:02:39.062 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.066+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2996089674594903341', time=2024-09-12T02:50:39.808891+0000, chain.objs.size()=1 2024-09-12T01:02:39.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.066+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ggzipO_2kTOBwidNZnoc-HJGMIHAjXn_0 2024-09-12T01:02:39.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.066+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11118687377836844079', time=2024-09-12T02:50:39.852170+0000, chain.objs.size()=1 2024-09-12T01:02:39.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.066+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.79TFUk6kWe6A3b9wGzq8Ytt10rz47Ve_0 2024-09-12T01:02:39.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.066+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.648456183081965218', time=2024-09-12T02:50:39.857271+0000, chain.objs.size()=1 2024-09-12T01:02:39.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.066+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.2FE-S9FveojHx0Ed3uKGx_CQD42TJZx_0 2024-09-12T01:02:39.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.066+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5636101704198437014', time=2024-09-12T02:50:39.858530+0000, chain.objs.size()=1 2024-09-12T01:02:39.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.066+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.EqS627s0IgGWdoGUk7pqCK0KTtG74vi_0 2024-09-12T01:02:39.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.066+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11093359181962494523', time=2024-09-12T02:50:39.981837+0000, chain.objs.size()=1 2024-09-12T01:02:39.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.066+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.CHYn8Km4JUSKSIkDeBgw0YhSSLRn8Bt_0 2024-09-12T01:02:39.063 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.066+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7839212731691528905', time=2024-09-12T02:50:40.009548+0000, chain.objs.size()=1 2024-09-12T01:02:39.064 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.066+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.HDzS5Jq9NZm3vK0yF_gGINYofgou7kj_0 2024-09-12T01:02:39.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.070+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10862917054483243969', time=2024-09-12T02:50:40.084717+0000, chain.objs.size()=1 2024-09-12T01:02:39.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.070+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.EsU-ak0ggSRj88jfIo4SWYZYBByvgi1_0 2024-09-12T01:02:39.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.070+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9705366083827666434', time=2024-09-12T02:50:40.102670+0000, chain.objs.size()=1 2024-09-12T01:02:39.065 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.070+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.aZRi9C01TXJ0zs_hyw2Na2Se6gLvJ2r_0 2024-09-12T01:02:39.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.070+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12048920881417480892', time=2024-09-12T02:50:40.129242+0000, chain.objs.size()=1 2024-09-12T01:02:39.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.070+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Nrm0Y8CinKoTFtPv6fqLoLrTriFXQvn_0 2024-09-12T01:02:39.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.070+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.823192947677152670', time=2024-09-12T02:50:40.133537+0000, chain.objs.size()=1 2024-09-12T01:02:39.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.070+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.8WdVBXpcXtp-8wTnp65uqBi2OptUDnM_0 2024-09-12T01:02:39.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.070+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11785547478739594518', time=2024-09-12T02:50:40.309359+0000, chain.objs.size()=1 2024-09-12T01:02:39.066 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.070+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_._7NWK4wf-7VTFb1dNrz0bO250Eg4uS9_0 2024-09-12T01:02:39.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.070+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13834421841093110091', time=2024-09-12T02:50:40.532933+0000, chain.objs.size()=1 2024-09-12T01:02:39.067 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.070+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.lFMSX2i8w4u7zeGiLCUXrMecvDV858i_0 2024-09-12T01:02:39.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.074+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11887174042118232802', time=2024-09-12T02:50:40.542828+0000, chain.objs.size()=1 2024-09-12T01:02:39.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.074+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.xPHK8Z8OJO-C5JwKl5pT-1HhAxeJ9jG_0 2024-09-12T01:02:39.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.074+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16628490289680698433', time=2024-09-12T02:50:40.597677+0000, chain.objs.size()=1 2024-09-12T01:02:39.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.074+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.76r_R2Nb50bltUfTqA6Shn27NHbhMwX_0 2024-09-12T01:02:39.070 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.074+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5036625797351522190', time=2024-09-12T02:50:40.766302+0000, chain.objs.size()=1 2024-09-12T01:02:39.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.074+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.XUxaZ3tCqmO9yMJEItThbmOl3r-EgBg_0 2024-09-12T01:02:39.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.074+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16374290343213459033', time=2024-09-12T02:50:40.780622+0000, chain.objs.size()=1 2024-09-12T01:02:39.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.074+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.1u5WhAxTl6__7J173_zyH-5Kg1tL1Jd_0 2024-09-12T01:02:39.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.074+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1127677978769749770', time=2024-09-12T02:50:40.857404+0000, chain.objs.size()=1 2024-09-12T01:02:39.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.074+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.tucxuF5p-gIVYiDkEKzj7XIjHXCuOM7_0 2024-09-12T01:02:39.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.074+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13030245965566150426', time=2024-09-12T02:50:40.883052+0000, chain.objs.size()=1 2024-09-12T01:02:39.071 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.074+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.WCqoniHWngWf6PBUoi_oIWt79SlsOmF_0 2024-09-12T01:02:39.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.078+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13449852160824816502', time=2024-09-12T02:50:41.126330+0000, chain.objs.size()=1 2024-09-12T01:02:39.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.078+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.rqaS_JJAa8aq2GCtapifOjD73bmncBQ_0 2024-09-12T01:02:39.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.078+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7221091300337830030', time=2024-09-12T02:50:41.266394+0000, chain.objs.size()=1 2024-09-12T01:02:39.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.078+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.9NOpFbCStPs3D_gw4Jof4L86LvP9BFi_0 2024-09-12T01:02:39.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.078+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1270582926120791489', time=2024-09-12T02:50:41.370491+0000, chain.objs.size()=1 2024-09-12T01:02:39.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.078+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.w9xyi-Ya5Y0s0Fx7Y-7fzxqpSB7ftCj_0 2024-09-12T01:02:39.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.078+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8955740954681127672', time=2024-09-12T02:50:41.438511+0000, chain.objs.size()=1 2024-09-12T01:02:39.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.078+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.TU8814kEZNvwG9UT4syuVIdMFDkdv2G_0 2024-09-12T01:02:39.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.078+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16496920644296447370', time=2024-09-12T02:50:41.571765+0000, chain.objs.size()=1 2024-09-12T01:02:39.074 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.078+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.JTJ0XUywl06GdKmL37YITTDvvBUZTPv_0 2024-09-12T01:02:39.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.078+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1864990545065767588', time=2024-09-12T02:50:41.615507+0000, chain.objs.size()=1 2024-09-12T01:02:39.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.078+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.GQUqojIkzJ_PI3zVf12S-d5TWF9DhV-_0 2024-09-12T01:02:39.075 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.078+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4459148129226324389', time=2024-09-12T02:50:41.636183+0000, chain.objs.size()=1 2024-09-12T01:02:39.076 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.078+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.YEDG5O0aKK6hseqcYezl_BV9hv35kR3_0 2024-09-12T01:02:39.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.082+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11597452284213234263', time=2024-09-12T02:51:19.541203+0000, chain.objs.size()=1 2024-09-12T01:02:39.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.082+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.381__shadow_.3o3ocozverBB_Vu0Xythv_FNRKKZscq_0 2024-09-12T01:02:39.077 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.082+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13499371133253517846', time=2024-09-12T02:51:56.182584+0000, chain.objs.size()=1 2024-09-12T01:02:39.078 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.082+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.429__shadow_.UTaF-VNwuPPf0iBsRqn8t-m530tgdhI_0 2024-09-12T01:02:39.082 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.086+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44707 2024-09-12T01:02:39.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T01:02:39.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16665790426916183631', time=2024-09-12T02:52:16.458887+0000, chain.objs.size()=1 2024-09-12T01:02:39.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.455__shadow_.Vm0oYZi6Daw1yuAyywWJ6QFBLyuZ0YJ_0 2024-09-12T01:02:39.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17461808467916801742', time=2024-09-12T02:53:18.200024+0000, chain.objs.size()=6 2024-09-12T01:02:39.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~Sr9IGPWXXvLxzH8DjQ7g7Osh5ykGQLb.1 2024-09-12T01:02:39.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2SKLZlPS1p4iI-RHFnUvmtCpXIb-kA4U.2 2024-09-12T01:02:39.085 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~Sr9IGPWXXvLxzH8DjQ7g7Osh5ykGQLb.3 2024-09-12T01:02:39.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~Sr9IGPWXXvLxzH8DjQ7g7Osh5ykGQLb.4 2024-09-12T01:02:39.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~Sr9IGPWXXvLxzH8DjQ7g7Osh5ykGQLb.5 2024-09-12T01:02:39.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~Sr9IGPWXXvLxzH8DjQ7g7Osh5ykGQLb.6 2024-09-12T01:02:39.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15336102341896464495', time=2024-09-12T02:53:33.121460+0000, chain.objs.size()=2 2024-09-12T01:02:39.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.525__multipart_mymultipart.2~vcFyY6qGNg6FiKS1Ekg3MFPlXzZ6pLW.1 2024-09-12T01:02:39.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.525__multipart_mymultipart.2~vcFyY6qGNg6FiKS1Ekg3MFPlXzZ6pLW.2 2024-09-12T01:02:39.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14410470607514323981', time=2024-09-12T02:54:30.349385+0000, chain.objs.size()=1 2024-09-12T01:02:39.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.557__shadow_.k5hP48Y4PE6lSg-ikUYoqlO5AAX411A_0 2024-09-12T01:02:39.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8402923403629319328', time=2024-09-12T02:54:53.579992+0000, chain.objs.size()=1 2024-09-12T01:02:39.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.570__shadow:rPYlXmoovpm.AbXPsk1D.d2Fz8mTaD8_.l4hCdO1cfw95ksuDJ93IxbqxnA7kNvp_0 2024-09-12T01:02:39.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8790353560943695142', time=2024-09-12T02:55:01.782970+0000, chain.objs.size()=1 2024-09-12T01:02:39.086 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.575__shadow_.Uj8Zox_ANEs-kSx4LsNmxBDwu1iPcuB_0 2024-09-12T01:02:39.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3716475266506753912', time=2024-09-12T02:55:01.932858+0000, chain.objs.size()=1 2024-09-12T01:02:39.088 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.090+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.575__shadow:RTk0Z.tImu6TQ.KkNsjaEwDeDUCdJs9_.TzXW1vGjqofPUPsFdI-FlSP6o1L2_OX_0 2024-09-12T01:02:39.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.094+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12593130249917916346', time=2024-09-12T02:55:09.553791+0000, chain.objs.size()=1 2024-09-12T01:02:39.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:E1a.5X4szjkxAZbPfcyqQnEF1p6BgVg_.XSYJNPFajBYR9agfL1gVfO-WLzYEXgq_0 2024-09-12T01:02:39.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.094+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7315282817712644294', time=2024-09-12T02:55:28.573977+0000, chain.objs.size()=1 2024-09-12T01:02:39.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.579__shadow:m65l0i.Q76hLSGKl8BB4zaY34psjNyX_.x62oKewjVb2HqKbx8SgXoxBnXchMphk_0 2024-09-12T01:02:39.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.094+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9870129976578542238', time=2024-09-12T02:55:36.054501+0000, chain.objs.size()=1 2024-09-12T01:02:39.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.587__shadow:654-fFFO3NT6Ab89BdFcPmdLHoPgQ4P_.WHjbAMIrhAYaFV5mESN-_iKg3YySZz6_0 2024-09-12T01:02:39.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.094+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15386383999111099207', time=2024-09-12T02:55:36.161298+0000, chain.objs.size()=1 2024-09-12T01:02:39.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.587__shadow:wlcBxhkLn9JLMDdp6iO9xgrXOwp-Rp8_.d-8RDNxp1-T76JxUa4l0lo0E45hCdq2_0 2024-09-12T01:02:39.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.094+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9982476857924194244', time=2024-09-12T02:55:49.023886+0000, chain.objs.size()=1 2024-09-12T01:02:39.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.607__shadow_.tTEPtKJQe8qI2QO35zxlixY47mQOq7w_0 2024-09-12T01:02:39.091 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.094+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1653276118345652389', time=2024-09-12T02:58:47.042828+0000, chain.objs.size()=6 2024-09-12T01:02:39.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.661__multipart_baz.2~If26___BXRK7OOPHTdB7qHCBRSusNV0.1 2024-09-12T01:02:39.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.661__multipart_baz.2~If26___BXRK7OOPHTdB7qHCBRSusNV0.2 2024-09-12T01:02:39.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.661__multipart_baz.2~If26___BXRK7OOPHTdB7qHCBRSusNV0.3 2024-09-12T01:02:39.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.661__multipart_baz.2~If26___BXRK7OOPHTdB7qHCBRSusNV0.4 2024-09-12T01:02:39.092 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.094+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.661__multipart_baz.2~If26___BXRK7OOPHTdB7qHCBRSusNV0.5 2024-09-12T01:02:39.093 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.098+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.661__multipart_baz.2~If26___BXRK7OOPHTdB7qHCBRSusNV0.6 2024-09-12T01:02:39.098 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.102+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:39.100 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:02:39.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.102 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48048' 2024-09-12T01:02:39.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18174504644543654090', time=2024-09-12T02:46:00.962437+0000, chain.objs.size()=1 2024-09-12T01:02:39.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.157__shadow:YTa7wIBOt6zbjl7gH1lm.uQqZdDpu00_.oF9vbU3fO02LJkrPd-biL248ej0qBSi_0 2024-09-12T01:02:39.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.129612220196228451', time=2024-09-12T02:46:30.617118+0000, chain.objs.size()=1 2024-09-12T01:02:39.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.183__shadow_.iUo9B5FW52aowK-xPnIQFtEZl8-jTv3_0 2024-09-12T01:02:39.103 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8960405055080272296', time=2024-09-12T02:48:21.230035+0000, chain.objs.size()=1 2024-09-12T01:02:39.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.233__shadow_.z8qCvAwga3QRrkZNOq40VmOVVVLfwn3_0 2024-09-12T01:02:39.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12941013922245321377', time=2024-09-12T02:48:28.136609+0000, chain.objs.size()=1 2024-09-12T01:02:39.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.241__shadow_.WHLJFF4r18eP5B26pU8wjzNrhfrkbVd_0 2024-09-12T01:02:39.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15025585128061034661', time=2024-09-12T02:48:31.304610+0000, chain.objs.size()=1 2024-09-12T01:02:39.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.244__shadow_.uGuG1ZJJoWvI9BPn2tCC2e-r5NmsCb__0 2024-09-12T01:02:39.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15002326267918331259', time=2024-09-12T02:48:43.133491+0000, chain.objs.size()=1 2024-09-12T01:02:39.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.260__shadow_.t52ndXh-jDjKlAEJnPCW7raLH_Ft8Vp_0 2024-09-12T01:02:39.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5491786259222276788', time=2024-09-12T02:49:05.519973+0000, chain.objs.size()=1 2024-09-12T01:02:39.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.h3FjpxtYyFELlaRkYaRZHc1G_Aq7Fc8_0 2024-09-12T01:02:39.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4363051001554417497', time=2024-09-12T02:49:05.553104+0000, chain.objs.size()=1 2024-09-12T01:02:39.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.1Z521B9RWJAzJ5xdKh9Pa9jKG5q_QLP_0 2024-09-12T01:02:39.104 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15525665930660172943', time=2024-09-12T02:49:05.698989+0000, chain.objs.size()=1 2024-09-12T01:02:39.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Ie5aX1A8NrzY4VclPT8yGg6G3BZBny1_0 2024-09-12T01:02:39.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11328021669674752246', time=2024-09-12T02:49:05.737313+0000, chain.objs.size()=1 2024-09-12T01:02:39.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.hWKNfjJlltuXqv78zJ3eB_bTa0SZXiY_0 2024-09-12T01:02:39.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12435940054390145666', time=2024-09-12T02:49:05.755307+0000, chain.objs.size()=1 2024-09-12T01:02:39.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9qnhbqtVrepB7ETZr3FVLKS6na2f6aR_0 2024-09-12T01:02:39.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2552002272673104498', time=2024-09-12T02:49:05.770277+0000, chain.objs.size()=1 2024-09-12T01:02:39.105 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.106+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ez_pM-UbIFqQ0CGUmiWkT7Rh38fMTSS_0 2024-09-12T01:02:39.106 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.110+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7079038277154062900', time=2024-09-12T02:49:05.794503+0000, chain.objs.size()=1 2024-09-12T01:02:39.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.110+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.AtAt1_T4MWmjyFx_PyNRpE2qZeHtCQJ_0 2024-09-12T01:02:39.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.110+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1646329048869780365', time=2024-09-12T02:49:05.836200+0000, chain.objs.size()=1 2024-09-12T01:02:39.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.110+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.hJy-hhYEpb5bpANdPfszVkeGqJKDsqi_0 2024-09-12T01:02:39.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.110+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5088103550041048795', time=2024-09-12T02:49:06.033120+0000, chain.objs.size()=1 2024-09-12T01:02:39.107 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.110+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.EdM_yz1OJ5EnhZtCw-q8rAU7ukgy2gm_0 2024-09-12T01:02:39.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12667704924035986529', time=2024-09-12T02:49:06.034639+0000, chain.objs.size()=1 2024-09-12T01:02:39.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.kXU9vfPFevo-0ZInkVJmgeSGxzsAADb_0 2024-09-12T01:02:39.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13742777978668373642', time=2024-09-12T02:49:06.068569+0000, chain.objs.size()=1 2024-09-12T01:02:39.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.yyRTlY3uNGaPvM_ZjHVuir7qo5zq3IO_0 2024-09-12T01:02:39.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7214204047339592674', time=2024-09-12T02:49:06.073200+0000, chain.objs.size()=1 2024-09-12T01:02:39.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Ktmzc-30DlbwfG_uLG-UzvQrcPGoNl-_0 2024-09-12T01:02:39.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13035710042096594763', time=2024-09-12T02:49:06.104106+0000, chain.objs.size()=1 2024-09-12T01:02:39.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0u-l5LD_fbn2diUgxz8a6aizScd6mi__0 2024-09-12T01:02:39.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16471017500273282965', time=2024-09-12T02:49:06.113694+0000, chain.objs.size()=1 2024-09-12T01:02:39.109 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.n9-z_geZzlBVdX9539CcMMjDqoRkW1e_0 2024-09-12T01:02:39.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18351051238768229917', time=2024-09-12T02:49:06.226146+0000, chain.objs.size()=1 2024-09-12T01:02:39.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.araQKHfugvq0VfO3AWlCfomopCd3svB_0 2024-09-12T01:02:39.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.518553992342052730', time=2024-09-12T02:49:06.315772+0000, chain.objs.size()=1 2024-09-12T01:02:39.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.78Du53fubm60EMAzND5W_ghZLCKBDUA_0 2024-09-12T01:02:39.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14566142006969131364', time=2024-09-12T02:49:06.373612+0000, chain.objs.size()=1 2024-09-12T01:02:39.110 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.GFL-M7gwl_Iw2kGAA0zE4GU1aeT4Lcp_0 2024-09-12T01:02:39.111 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1742660649231164415', time=2024-09-12T02:49:06.519605+0000, chain.objs.size()=1 2024-09-12T01:02:39.112 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.114+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0D05pslYbu_mQu6tG6YZM1k5q9vDtKd_0 2024-09-12T01:02:39.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3401397996521643657', time=2024-09-12T02:49:06.538717+0000, chain.objs.size()=1 2024-09-12T01:02:39.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Sn-ov6l7IQ-nXcSMfpVSF8mBxT9ELWj_0 2024-09-12T01:02:39.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5544761051657677347', time=2024-09-12T02:49:06.557400+0000, chain.objs.size()=1 2024-09-12T01:02:39.113 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.4CtVO9cukLCPlsQ26BDhLFTO9YKEOqd_0 2024-09-12T01:02:39.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7204635365145558774', time=2024-09-12T02:49:06.590226+0000, chain.objs.size()=1 2024-09-12T01:02:39.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Q9OpJYxhluxSoquoEOrVD_2A8kYl73O_0 2024-09-12T01:02:39.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15774405112042666532', time=2024-09-12T02:49:06.609385+0000, chain.objs.size()=1 2024-09-12T01:02:39.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.269RoDE_g2nuYONnhYRhtkjzRA6uImn_0 2024-09-12T01:02:39.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7738788740649148762', time=2024-09-12T02:49:06.630755+0000, chain.objs.size()=1 2024-09-12T01:02:39.116 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Zi56EXxPnjeNsRUNl54CuPToMchMjxf_0 2024-09-12T01:02:39.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6177687482132793379', time=2024-09-12T02:49:06.632189+0000, chain.objs.size()=1 2024-09-12T01:02:39.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.2Oz119U1o36lg9FHsTC3zIkywpJ5ylE_0 2024-09-12T01:02:39.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.438126649339050601', time=2024-09-12T02:49:06.753144+0000, chain.objs.size()=1 2024-09-12T01:02:39.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.8vmySFg2oJR5R8YIycWHrOGOi8eNaEE_0 2024-09-12T01:02:39.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2992511305327353228', time=2024-09-12T02:49:06.765830+0000, chain.objs.size()=1 2024-09-12T01:02:39.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.6emWsUAafyldoDjk90jQLBJwx6D_siy_0 2024-09-12T01:02:39.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.465717011453239346', time=2024-09-12T02:49:06.824378+0000, chain.objs.size()=1 2024-09-12T01:02:39.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9l1B182ahb78yz09j-GUuD8jqUKvF44_0 2024-09-12T01:02:39.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5616655967335303420', time=2024-09-12T02:49:06.839492+0000, chain.objs.size()=1 2024-09-12T01:02:39.117 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.m_Prz_DjV75dNLqT80r4gRmT0Kgkk9L_0 2024-09-12T01:02:39.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17472225017649737708', time=2024-09-12T02:49:06.869051+0000, chain.objs.size()=1 2024-09-12T01:02:39.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.118+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.wKflV4r6KsAzI-H4mHCtYCmfmyVW7bM_0 2024-09-12T01:02:39.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.122+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6631492252737490483', time=2024-09-12T02:49:07.166090+0000, chain.objs.size()=1 2024-09-12T01:02:39.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.122+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.MWCgoChtQFiABUNzIZKcwRhVWM_0tJB_0 2024-09-12T01:02:39.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.122+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1127659677770889304', time=2024-09-12T02:49:07.178445+0000, chain.objs.size()=1 2024-09-12T01:02:39.118 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.122+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Oc4pjK_a_IJ6TA6Ut-nOuOb6aSOTVbj_0 2024-09-12T01:02:39.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4739361556142536494', time=2024-09-12T02:49:07.186452+0000, chain.objs.size()=1 2024-09-12T01:02:39.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7diIp83tNcbnGkxH36D97Hq0dt8Uw6p_0 2024-09-12T01:02:39.120 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7119891702999290818', time=2024-09-12T02:49:07.200642+0000, chain.objs.size()=1 2024-09-12T01:02:39.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.IGT54Pf3UpahYotjP0sfugE887SQ32s_0 2024-09-12T01:02:39.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7616625235297144482', time=2024-09-12T02:49:07.206863+0000, chain.objs.size()=1 2024-09-12T01:02:39.121 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.jnt5iTAhk2ud3xxWg6LTl-LgXtFdtVS_0 2024-09-12T01:02:39.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11453529067309828575', time=2024-09-12T02:49:07.218686+0000, chain.objs.size()=1 2024-09-12T01:02:39.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.zCPR51BImHMHj5BoLwZsohHdj-13aA6_0 2024-09-12T01:02:39.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13667344184109027673', time=2024-09-12T02:49:07.350420+0000, chain.objs.size()=1 2024-09-12T01:02:39.122 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.DTlGpd3F_PkXyOEK1Grat2T-7f_vLfi_0 2024-09-12T01:02:39.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3164112427200897400', time=2024-09-12T02:49:07.421988+0000, chain.objs.size()=1 2024-09-12T01:02:39.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.hVMDqZFTMB-Yw0rivTysapYsyquBS0s_0 2024-09-12T01:02:39.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4902813856549140353', time=2024-09-12T02:49:07.425508+0000, chain.objs.size()=1 2024-09-12T01:02:39.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.DgpnkJEyTn_WI8m8exUzT-vLC2zm-f4_0 2024-09-12T01:02:39.123 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9214794241434947315', time=2024-09-12T02:49:22.394442+0000, chain.objs.size()=1 2024-09-12T01:02:39.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.282__shadow_.zuR_7YJ8arbKjS6dotXaw2p9iCl8lJi_0 2024-09-12T01:02:39.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2240557866927039684', time=2024-09-12T02:49:26.923026+0000, chain.objs.size()=1 2024-09-12T01:02:39.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.288__shadow_.j8b2dbJl6tZIb7loL2UD2fR0LIvMAqq_0 2024-09-12T01:02:39.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8394341130670928689', time=2024-09-12T02:49:26.925065+0000, chain.objs.size()=1 2024-09-12T01:02:39.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.288__shadow_.HgBC7r0gxS166Zarzgtg3JD81YcXWyd_0 2024-09-12T01:02:39.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10089365576955666281', time=2024-09-12T02:49:30.935999+0000, chain.objs.size()=1 2024-09-12T01:02:39.124 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.126+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.vd_nIZFKWu81RYboIJBqiJs2sG57iaQ_0 2024-09-12T01:02:39.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.130+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12033065969324524811', time=2024-09-12T02:49:39.201066+0000, chain.objs.size()=1 2024-09-12T01:02:39.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.130+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.302__shadow_.jXMSjVk4taXqneYGWM7ADzMXhwudpeB_0 2024-09-12T01:02:39.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.130+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1786124127799632516', time=2024-09-12T02:50:15.792832+0000, chain.objs.size()=1 2024-09-12T01:02:39.125 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.130+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.FmIU6vT6NFiRxWV9UuTxmtjq7oVk9bx_0 2024-09-12T01:02:39.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.130+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10350028844799200860', time=2024-09-12T02:50:15.862394+0000, chain.objs.size()=1 2024-09-12T01:02:39.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.130+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.BHQ8NliaPZJgOn5whhCTXT8d6CQGkrc_0 2024-09-12T01:02:39.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.130+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11096358978100448317', time=2024-09-12T02:50:15.945060+0000, chain.objs.size()=1 2024-09-12T01:02:39.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.130+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.vKamBdyDr63Ytg1yNzVkFmPbeXzDWNb_0 2024-09-12T01:02:39.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.130+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6048190982145992092', time=2024-09-12T02:50:16.132611+0000, chain.objs.size()=1 2024-09-12T01:02:39.126 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.130+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.mH0-vC643fUmyN_5njfSQVcdZtUb5oS_0 2024-09-12T01:02:39.129 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4878648134882573716', time=2024-09-12T02:50:16.158499+0000, chain.objs.size()=1 2024-09-12T01:02:39.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.KKt1ihECHS4khClbuYfuk8kGL4D2u83_0 2024-09-12T01:02:39.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15916374713423853230', time=2024-09-12T02:50:16.208201+0000, chain.objs.size()=1 2024-09-12T01:02:39.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.qOojoqQSTujQOIcDJLwakl67Wb0LM3r_0 2024-09-12T01:02:39.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17197840319283424312', time=2024-09-12T02:50:16.428854+0000, chain.objs.size()=1 2024-09-12T01:02:39.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.5v7JX4cTuRPo6cfTuy2GQrEC_J-R4p2_0 2024-09-12T01:02:39.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11700140337738336788', time=2024-09-12T02:50:16.467869+0000, chain.objs.size()=1 2024-09-12T01:02:39.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.uCu9gp7CFaaim3mZziMezb3gqzrtIRb_0 2024-09-12T01:02:39.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5141608414308297862', time=2024-09-12T02:50:16.519384+0000, chain.objs.size()=1 2024-09-12T01:02:39.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.7KZpHZF5J7dTliZdlulBs1Ou6Ut8KDy_0 2024-09-12T01:02:39.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16454114053904078786', time=2024-09-12T02:50:16.721507+0000, chain.objs.size()=1 2024-09-12T01:02:39.130 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-NGnNngftbm9vTL3C8lyvrwevRvYjuc_0 2024-09-12T01:02:39.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2147416228163773902', time=2024-09-12T02:50:16.793968+0000, chain.objs.size()=1 2024-09-12T01:02:39.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.jXc-BrlrmWh6AiLlGIYpWXg2ilAERYU_0 2024-09-12T01:02:39.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1952182879571216877', time=2024-09-12T02:50:16.928008+0000, chain.objs.size()=1 2024-09-12T01:02:39.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-yAC0-VPwPz2Fs1M8hswWWTmL_dn7az_0 2024-09-12T01:02:39.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13394968816016702705', time=2024-09-12T02:50:16.935722+0000, chain.objs.size()=1 2024-09-12T01:02:39.131 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.134+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.e7QF0apYiApGzxxA9YX-34U8wz5EoE-_0 2024-09-12T01:02:39.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.138+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3929654110293378348', time=2024-09-12T02:50:16.974544+0000, chain.objs.size()=1 2024-09-12T01:02:39.133 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.138+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ecgfvtsVG5Z9JQtLI_lxaWZkFsXao5n_0 2024-09-12T01:02:39.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.138+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15813241553922325142', time=2024-09-12T02:50:17.467087+0000, chain.objs.size()=1 2024-09-12T01:02:39.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.138+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ySgBR4gNewZtES5pGT0uNjMvr3kf5zO_0 2024-09-12T01:02:39.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.138+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8786294357734699711', time=2024-09-12T02:50:17.485466+0000, chain.objs.size()=1 2024-09-12T01:02:39.135 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.138+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.upP3yprAKwtsKy0HSV0ZQoPj0ChV1Lw_0 2024-09-12T01:02:39.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7045381219817278064', time=2024-09-12T02:50:17.539569+0000, chain.objs.size()=1 2024-09-12T01:02:39.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4SBOlZvI1aTnDrOw_-FQd3wpyUsgAJd_0 2024-09-12T01:02:39.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12973570922474989739', time=2024-09-12T02:50:17.643633+0000, chain.objs.size()=1 2024-09-12T01:02:39.136 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.WojW67va9OiuPhWzSOuu-sM6RVoDnnm_0 2024-09-12T01:02:39.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15001332707506179508', time=2024-09-12T02:50:17.649565+0000, chain.objs.size()=1 2024-09-12T01:02:39.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.rvCcUYYZvCuPWuh6D_VmiLGcYRyY1NA_0 2024-09-12T01:02:39.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2342641057622017070', time=2024-09-12T02:50:17.655255+0000, chain.objs.size()=1 2024-09-12T01:02:39.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.c30vnpIX9UabKxwxUF9szk1Eo1RU7O8_0 2024-09-12T01:02:39.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14676233128068812286', time=2024-09-12T02:50:17.763162+0000, chain.objs.size()=1 2024-09-12T01:02:39.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.1Gf9F9LblpNBoe0AC7sNMV-AIglEiH__0 2024-09-12T01:02:39.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3782361686371560647', time=2024-09-12T02:50:39.479978+0000, chain.objs.size()=1 2024-09-12T01:02:39.137 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.q2_L0GzTVlF4U2EBweglJhQBW_3XddW_0 2024-09-12T01:02:39.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2595936047398311852', time=2024-09-12T02:50:39.504670+0000, chain.objs.size()=1 2024-09-12T01:02:39.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.e0lXBXxbWGt0ypfe3qEM_BVBbftHEL1_0 2024-09-12T01:02:39.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1284100749978104117', time=2024-09-12T02:50:39.521900+0000, chain.objs.size()=1 2024-09-12T01:02:39.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_._jknloaTx5Ke3QvTQEz7wwjOoNvsKDP_0 2024-09-12T01:02:39.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2210618575259726450', time=2024-09-12T02:50:39.546301+0000, chain.objs.size()=1 2024-09-12T01:02:39.138 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.uBINgDXkoe7UXuMzH7lLswFWR934uOI_0 2024-09-12T01:02:39.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15365652497891675511', time=2024-09-12T02:50:39.547839+0000, chain.objs.size()=1 2024-09-12T01:02:39.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.aZ8DUyuiN4IQJySl01t5Jx4G70vaahQ_0 2024-09-12T01:02:39.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3337392005363600866', time=2024-09-12T02:50:39.589576+0000, chain.objs.size()=1 2024-09-12T01:02:39.140 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.142+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.b38ln3bgacHyn3DII4bp1b4tXyNO2i6_0 2024-09-12T01:02:39.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13467206693959191043', time=2024-09-12T02:50:39.711599+0000, chain.objs.size()=1 2024-09-12T01:02:39.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.hTFoWBGat2P5_tIuwD2xFTErZD1wfb4_0 2024-09-12T01:02:39.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17241620839786303774', time=2024-09-12T02:50:39.773605+0000, chain.objs.size()=1 2024-09-12T01:02:39.141 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.UKJfT1id1su9QQYj7botOUg5zbXHAfk_0 2024-09-12T01:02:39.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15033546754060970611', time=2024-09-12T02:50:39.803793+0000, chain.objs.size()=1 2024-09-12T01:02:39.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.6c4hIvpRv5_7ER8jKA3pqqS2ZToYioH_0 2024-09-12T01:02:39.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9733253417337015996', time=2024-09-12T02:50:39.844364+0000, chain.objs.size()=1 2024-09-12T01:02:39.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.8hU6RRQHqxpLD2cQziKqhsI0ZGEm_Xm_0 2024-09-12T01:02:39.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8824538269879317955', time=2024-09-12T02:50:39.859827+0000, chain.objs.size()=1 2024-09-12T01:02:39.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.mZfbrI8xMv_1Ith_xHoGNjLoeotKoNB_0 2024-09-12T01:02:39.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15372072066093724462', time=2024-09-12T02:50:39.865871+0000, chain.objs.size()=1 2024-09-12T01:02:39.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.yFQ5i0cAzHauaH7RT-oQWWA6jRgE-jS_0 2024-09-12T01:02:39.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6226998213590050960', time=2024-09-12T02:50:39.989934+0000, chain.objs.size()=1 2024-09-12T01:02:39.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.jCqtQKUPeIEVrk_z4x_sfXdRtHl4VLD_0 2024-09-12T01:02:39.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11089952874726239676', time=2024-09-12T02:50:40.031880+0000, chain.objs.size()=1 2024-09-12T01:02:39.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.moUoJNVHjKu_tk4Sv8xt0x-k0u-dsPK_0 2024-09-12T01:02:39.142 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16371552479853258102', time=2024-09-12T02:50:40.038242+0000, chain.objs.size()=1 2024-09-12T01:02:39.143 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.146+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.KQySt0WA_4eEa1j3p6C_rjfP5bP884o_0 2024-09-12T01:02:39.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10761407731744353573', time=2024-09-12T02:50:40.053091+0000, chain.objs.size()=1 2024-09-12T01:02:39.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.wBenlKFIWXTZ4h76BrjT5MayRJzXcoB_0 2024-09-12T01:02:39.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5923869384868619168', time=2024-09-12T02:50:40.055577+0000, chain.objs.size()=1 2024-09-12T01:02:39.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_._mYAVJum3GwVdfvbpN975KFuLne_D9I_0 2024-09-12T01:02:39.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12701330812551196523', time=2024-09-12T02:50:40.103568+0000, chain.objs.size()=1 2024-09-12T01:02:39.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.JMvh4CRkV3Y9gmpacZXPfkhTcULWD-T_0 2024-09-12T01:02:39.146 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17421911905995967905', time=2024-09-12T02:50:40.144601+0000, chain.objs.size()=1 2024-09-12T01:02:39.147 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.agQcLifthf9T-txTJE1NlOXeJbCOvFJ_0 2024-09-12T01:02:39.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7896638528056106092', time=2024-09-12T02:50:40.268780+0000, chain.objs.size()=1 2024-09-12T01:02:39.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.YL-GdF8YDecSpqPKJ7PLD2vKebjCWKs_0 2024-09-12T01:02:39.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5802834895667340067', time=2024-09-12T02:50:40.572340+0000, chain.objs.size()=1 2024-09-12T01:02:39.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.EVW4dTW1SUL1sIFTCY_3p1lmg-TYPnI_0 2024-09-12T01:02:39.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.150+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3658002237251203145', time=2024-09-12T02:50:40.741299+0000, chain.objs.size()=1 2024-09-12T01:02:39.148 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.150+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.EZluuA3w9Ns1O-CX_VRv0lMVMN14TTt_0 2024-09-12T01:02:39.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.154+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7443835016652684744', time=2024-09-12T02:50:40.782518+0000, chain.objs.size()=1 2024-09-12T01:02:39.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.154+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.VpGwgRpPkBYbj1AQcsc0_S72Z313tmS_0 2024-09-12T01:02:39.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.154+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.31453041114228787', time=2024-09-12T02:50:40.824071+0000, chain.objs.size()=1 2024-09-12T01:02:39.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.154+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.EL31wPvdFkc9rOKX_ki2_Y8IRH8g442_0 2024-09-12T01:02:39.149 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.154+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14304279525480063942', time=2024-09-12T02:50:41.019277+0000, chain.objs.size()=1 2024-09-12T01:02:39.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.154+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.7WxG2mNyNr31FmT3tr9TxStIslKQHAZ_0 2024-09-12T01:02:39.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.154+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2707701490848796849', time=2024-09-12T02:50:41.057542+0000, chain.objs.size()=1 2024-09-12T01:02:39.150 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.154+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ptiT5eLfZoTPdirf16bx5BDNFm9kWc5_0 2024-09-12T01:02:39.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.154+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5958228387088507914', time=2024-09-12T02:50:41.094279+0000, chain.objs.size()=1 2024-09-12T01:02:39.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.154+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.N2hOF4FAyBhgon90hKjBE5PP3zg2Alu_0 2024-09-12T01:02:39.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.154+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10693728252081195940', time=2024-09-12T02:50:41.105969+0000, chain.objs.size()=1 2024-09-12T01:02:39.151 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.154+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_._-96NLfFOgCGwctp6IR3ec5_ri_ZTGY_0 2024-09-12T01:02:39.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.154+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1502509508993261417', time=2024-09-12T02:50:41.142279+0000, chain.objs.size()=1 2024-09-12T01:02:39.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.154+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_._KpufOQ3GYm7bV4qc-hln5vpT2eerEJ_0 2024-09-12T01:02:39.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.154+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.861007138538590643', time=2024-09-12T02:50:41.283104+0000, chain.objs.size()=1 2024-09-12T01:02:39.152 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.154+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ee_AUbmXhGx39HNTv3AFLJX4yov5CgP_0 2024-09-12T01:02:39.155 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.158+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/48048 2024-09-12T01:02:39.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T01:02:39.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16950411181897342443', time=2024-09-12T02:50:41.411228+0000, chain.objs.size()=1 2024-09-12T01:02:39.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.jIWcSkCVEemz5ZrOgUsEMkRpT0wHEre_0 2024-09-12T01:02:39.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6315433104742692797', time=2024-09-12T02:50:41.528838+0000, chain.objs.size()=1 2024-09-12T01:02:39.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.tRA86IFhGyWtdZ1k-kad2d5hJVdYMss_0 2024-09-12T01:02:39.158 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13360756342047723055', time=2024-09-12T02:50:41.530306+0000, chain.objs.size()=1 2024-09-12T01:02:39.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.58M8qWNhy8L63F3R1T49VyYUgj7C9dR_0 2024-09-12T01:02:39.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6342974192458970651', time=2024-09-12T02:52:22.668681+0000, chain.objs.size()=1 2024-09-12T01:02:39.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.461__shadow_.RxeFgAZqAgOKm35wG5xzlermt5HcDRH_0 2024-09-12T01:02:39.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9272342537667898594', time=2024-09-12T02:52:36.209045+0000, chain.objs.size()=1 2024-09-12T01:02:39.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.483__shadow_._6NT2sZIjQelskHAx-F-8pSDOUIiKqA_0 2024-09-12T01:02:39.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18408910284759231654', time=2024-09-12T02:52:39.548836+0000, chain.objs.size()=1 2024-09-12T01:02:39.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.487__shadow_.pDJaF91IamkIVaHLjLxZNY9Jrj1dUeU_0 2024-09-12T01:02:39.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10221294632310732330', time=2024-09-12T02:52:58.112230+0000, chain.objs.size()=1 2024-09-12T01:02:39.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.514__shadow_.xvTEaYJbNF7NXl0X1srSq7xzYm2hVLB_0 2024-09-12T01:02:39.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8103621639760415026', time=2024-09-12T02:54:34.286521+0000, chain.objs.size()=1 2024-09-12T01:02:39.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.561__multipart_mymultipart.2~ggVeqHaNL8ZiJVNQ7yqmcEhWtGXEjAX.1 2024-09-12T01:02:39.159 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5686494741524083377', time=2024-09-12T02:54:51.200095+0000, chain.objs.size()=1 2024-09-12T01:02:39.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:Eta.1bC1QbO5YT4824kjjn8rTBKjTz7_.qJXBvnUtM-g37XhCc_Z_O6eS07-0q0P_0 2024-09-12T01:02:39.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7454685595554709699', time=2024-09-12T02:55:14.634102+0000, chain.objs.size()=1 2024-09-12T01:02:39.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:a1aFiK14KcSsZRhQONA-220XmYR9qI7_.ENg9pYctRGHDOpQoraM2UevX-WullY2_0 2024-09-12T01:02:39.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14260008524463687480', time=2024-09-12T02:55:17.478195+0000, chain.objs.size()=1 2024-09-12T01:02:39.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:LSysnq5-cxB9fqOLt3kKPzbTKRk47L3_.ZX9SWiGVQ6inciXhDo_swZaJffg7CoS_0 2024-09-12T01:02:39.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14760219579407801571', time=2024-09-12T02:55:26.089131+0000, chain.objs.size()=4 2024-09-12T01:02:39.160 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.162+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.578__multipart_testobj.2~HS4-ehUdzZFy7qLUABZGJPHBbKoUPa4.1 2024-09-12T01:02:39.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.166+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.578__multipart_testobj.2~HS4-ehUdzZFy7qLUABZGJPHBbKoUPa4.2 2024-09-12T01:02:39.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.166+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.578__multipart_testobj.2~HS4-ehUdzZFy7qLUABZGJPHBbKoUPa4.3 2024-09-12T01:02:39.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.166+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.578__multipart_testobj.2~HS4-ehUdzZFy7qLUABZGJPHBbKoUPa4.4 2024-09-12T01:02:39.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.166+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12702702942933221732', time=2024-09-12T02:55:26.754980+0000, chain.objs.size()=4 2024-09-12T01:02:39.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.166+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.578__multipart_testobj.2~lCac1AQOdTAPx7bHgbVDnDYVLiUh5z6.1 2024-09-12T01:02:39.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.166+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.578__multipart_testobj.2~lCac1AQOdTAPx7bHgbVDnDYVLiUh5z6.2 2024-09-12T01:02:39.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.166+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.578__multipart_testobj.2~lCac1AQOdTAPx7bHgbVDnDYVLiUh5z6.3 2024-09-12T01:02:39.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.166+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.578__multipart_testobj.2~lCac1AQOdTAPx7bHgbVDnDYVLiUh5z6.4 2024-09-12T01:02:39.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.166+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14804457968482281969', time=2024-09-12T02:55:31.132482+0000, chain.objs.size()=1 2024-09-12T01:02:39.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.166+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.582__shadow:gFT4an-sRNB8JeNDlq6AfbdBJt993L._.hqDKyXUk2yXzv9sReHzc6Qkp8zkGVCC_0 2024-09-12T01:02:39.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.166+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2539174314008847655', time=2024-09-12T02:55:49.668257+0000, chain.objs.size()=1 2024-09-12T01:02:39.164 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.166+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.608__shadow_.agee7zstqg9FVG6Q4c5CBKvz9Zlx8WL_0 2024-09-12T01:02:39.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.166+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8509393222632393761', time=2024-09-12T02:58:38.377185+0000, chain.objs.size()=1 2024-09-12T01:02:39.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.166+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.652__shadow_.XhBbdsqSNRxXQL9keNeMMyGBcGN7lQb_0 2024-09-12T01:02:39.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.166+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6243104552888560634', time=2024-09-12T02:58:52.278243+0000, chain.objs.size()=1 2024-09-12T01:02:39.165 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.166+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.668__shadow_.ovrjp-Cy0RS_hN3cWcbmOfV_ftVIuhv_0 2024-09-12T01:02:39.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.170+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8726437949489734115', time=2024-09-12T02:58:54.040904+0000, chain.objs.size()=1 2024-09-12T01:02:39.168 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.170+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.671__shadow_.GNNv-KOtwgWZ9PyN3mF4lEZaZGgbsLK_0 2024-09-12T01:02:39.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.174+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~c6PA7ThFJ9PLAC4wz0YNWkzt0RgtVBs', time=2024-09-12T03:00:03.263048+0000, chain.objs.size()=1 2024-09-12T01:02:39.169 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.174+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.742__multipart_mymultipart.2~c6PA7ThFJ9PLAC4wz0YNWkzt0RgtVBs.1 2024-09-12T01:02:39.172 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.178+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:39.175 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.178+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:02:39.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.178+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.176 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.177 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45699' 2024-09-12T01:02:39.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16738482911377101604', time=2024-09-12T02:46:52.925983+0000, chain.objs.size()=1 2024-09-12T01:02:39.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.203__shadow_.Qs1_hix6Cqyo1p9yYJb7-WVKonqWfI3_0 2024-09-12T01:02:39.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8799778188807341802', time=2024-09-12T02:48:28.876764+0000, chain.objs.size()=1 2024-09-12T01:02:39.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.242__shadow_.OsC8P6APqvpZWgkrEXrLBCtR07INQZl_0 2024-09-12T01:02:39.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15908713892107386702', time=2024-09-12T02:48:37.231659+0000, chain.objs.size()=1 2024-09-12T01:02:39.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.252__shadow_.W5WweYS3dCgzXecKKHDrKCPYXB7wN-X_0 2024-09-12T01:02:39.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13538188960599249852', time=2024-09-12T02:48:43.869440+0000, chain.objs.size()=1 2024-09-12T01:02:39.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.261__shadow_.Bl11pCQtQU7MqSq2H1JJJ7Z1HTF5bGw_0 2024-09-12T01:02:39.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.453072958285292870', time=2024-09-12T02:49:05.491301+0000, chain.objs.size()=1 2024-09-12T01:02:39.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.6odulCVHYtbfB_7XWwQRCRzym-0TBb1_0 2024-09-12T01:02:39.178 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3330904153089647874', time=2024-09-12T02:49:05.513096+0000, chain.objs.size()=1 2024-09-12T01:02:39.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.WUypkz3uJWAzC_gZMgZqZ-ihpGz_PBu_0 2024-09-12T01:02:39.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14799296882790785014', time=2024-09-12T02:49:05.703216+0000, chain.objs.size()=1 2024-09-12T01:02:39.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Uih9v3YtE_vAERQcZEa7YvI4zegOXvd_0 2024-09-12T01:02:39.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15196801933253493147', time=2024-09-12T02:49:05.731153+0000, chain.objs.size()=1 2024-09-12T01:02:39.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.6cTKPhFO8Y7e5crIn7cFY3AOYdi5cLM_0 2024-09-12T01:02:39.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.334026515494138', time=2024-09-12T02:49:05.750203+0000, chain.objs.size()=1 2024-09-12T01:02:39.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.CGAY_pdciUnjUrvbuBHcrKLe5HVJMgA_0 2024-09-12T01:02:39.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17012376044742189235', time=2024-09-12T02:49:05.990614+0000, chain.objs.size()=1 2024-09-12T01:02:39.179 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.4thsVaGn26wVXEwu78u9xjvCas3w8ee_0 2024-09-12T01:02:39.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6181076237847829051', time=2024-09-12T02:49:06.037790+0000, chain.objs.size()=1 2024-09-12T01:02:39.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.kPZ3lu5gOVuQigJV2msXI07Du-X1GGa_0 2024-09-12T01:02:39.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13917571149510476399', time=2024-09-12T02:49:06.097980+0000, chain.objs.size()=1 2024-09-12T01:02:39.180 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.182+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Y80KjMLJBPvRKgoUDikk3WQ81WF-izY_0 2024-09-12T01:02:39.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3982188995850950057', time=2024-09-12T02:49:06.253255+0000, chain.objs.size()=1 2024-09-12T01:02:39.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.cJQI0VFrmpT4BOSx1ZJkVLM-Qq5Lrzk_0 2024-09-12T01:02:39.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3092756894917084043', time=2024-09-12T02:49:06.256083+0000, chain.objs.size()=1 2024-09-12T01:02:39.182 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.TzCvNtK5pIneZGW0H0EslYWlDnEsXKk_0 2024-09-12T01:02:39.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8043296859519132871', time=2024-09-12T02:49:06.273831+0000, chain.objs.size()=1 2024-09-12T01:02:39.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_._Qtm3aklhmmdZsVn45dPho1ZskMWDMt_0 2024-09-12T01:02:39.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14464120249819612949', time=2024-09-12T02:49:06.343239+0000, chain.objs.size()=1 2024-09-12T01:02:39.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0G2bkkhAcyIjPAf8GRIEJM22IyDSvot_0 2024-09-12T01:02:39.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16260730976669457838', time=2024-09-12T02:49:06.478067+0000, chain.objs.size()=1 2024-09-12T01:02:39.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.UJqH5KrHeS5hBaXiu-EP6QHEIn8GIe8_0 2024-09-12T01:02:39.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12448937581837671842', time=2024-09-12T02:49:06.479493+0000, chain.objs.size()=1 2024-09-12T01:02:39.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_._nJ80Jr3vw4tcItGZ7EVn5oUzctTbIC_0 2024-09-12T01:02:39.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3622298564737581701', time=2024-09-12T02:49:06.529573+0000, chain.objs.size()=1 2024-09-12T01:02:39.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ytQ2Sx9rxgwKjlyMytIPnCk4VrOZFqg_0 2024-09-12T01:02:39.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14983373899956787144', time=2024-09-12T02:49:06.544363+0000, chain.objs.size()=1 2024-09-12T01:02:39.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.IRYh0OAK0mCMRoKnXLLurHP0r6Idwi4_0 2024-09-12T01:02:39.183 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8104367702892825368', time=2024-09-12T02:49:06.749006+0000, chain.objs.size()=1 2024-09-12T01:02:39.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.BplF7p8-lMP_xrtfm8U1NMoSeKNW9N3_0 2024-09-12T01:02:39.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8119161343884346608', time=2024-09-12T02:49:06.780657+0000, chain.objs.size()=1 2024-09-12T01:02:39.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.q1qXKAMBUQOKNrSInuBZp5bp77d3tVO_0 2024-09-12T01:02:39.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14620547071213821654', time=2024-09-12T02:49:06.804386+0000, chain.objs.size()=1 2024-09-12T01:02:39.184 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.186+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.izS3Cvn2-6E1ozP8pfG20RU7btcjG5l_0 2024-09-12T01:02:39.186 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.190+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2608614217905955139', time=2024-09-12T02:49:06.824368+0000, chain.objs.size()=1 2024-09-12T01:02:39.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.190+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.kDCWv4_mRB_wNEMxZ_gOp6dWqLeE4_v_0 2024-09-12T01:02:39.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.190+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6224383880898424754', time=2024-09-12T02:49:06.827275+0000, chain.objs.size()=1 2024-09-12T01:02:39.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.190+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.bgRRUAiv5T0vCpr-4_aEtE83UtpTiwk_0 2024-09-12T01:02:39.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.190+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8448896137692265151', time=2024-09-12T02:49:06.870327+0000, chain.objs.size()=1 2024-09-12T01:02:39.187 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.190+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.1pnaKpCVUU9ZL7e-RYI5cl_8sDdEggH_0 2024-09-12T01:02:39.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.390325636470341486', time=2024-09-12T02:49:07.135992+0000, chain.objs.size()=1 2024-09-12T01:02:39.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.vodEkXXjEUNIXj_Wm3cA8xPI5uQCx2i_0 2024-09-12T01:02:39.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7728728892888973355', time=2024-09-12T02:49:07.141803+0000, chain.objs.size()=1 2024-09-12T01:02:39.188 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.hEcfb7XUd_59zZZFzWAzgUwRWOBZCSA_0 2024-09-12T01:02:39.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10667962603922035313', time=2024-09-12T02:49:07.336895+0000, chain.objs.size()=1 2024-09-12T01:02:39.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_._MPThz8qKBhile0Mg6oDLLdSeQuOvOX_0 2024-09-12T01:02:39.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18241697726091675876', time=2024-09-12T02:49:07.406853+0000, chain.objs.size()=1 2024-09-12T01:02:39.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.3MXe5OKNqwxp2XZqDjML_78jBfrzFJt_0 2024-09-12T01:02:39.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14345168050072712498', time=2024-09-12T02:49:30.965463+0000, chain.objs.size()=1 2024-09-12T01:02:39.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_._hFrY1Uop6VbYdoFtMo7uNHwwLIN3-F_0 2024-09-12T01:02:39.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15918219341150565211', time=2024-09-12T02:49:32.426722+0000, chain.objs.size()=1 2024-09-12T01:02:39.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.uvycztRJvdhW3eKfgREtVg-kd-vknlz_0 2024-09-12T01:02:39.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8799850362002566226', time=2024-09-12T02:49:33.868546+0000, chain.objs.size()=1 2024-09-12T01:02:39.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.295__shadow_.vG6b4RBLOoLjm_GVUIQs8CeDzIhd8Vh_0 2024-09-12T01:02:39.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13219405620232135033', time=2024-09-12T02:49:42.405864+0000, chain.objs.size()=1 2024-09-12T01:02:39.189 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.306__shadow_.3Qoio83TEFViEKTybNwulyvez56eqM1_0 2024-09-12T01:02:39.191 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14460451853038072170', time=2024-09-12T02:50:15.778225+0000, chain.objs.size()=1 2024-09-12T01:02:39.192 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.194+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.fvY968le4iTQUyhRl8ntL9_cgYXMhkv_0 2024-09-12T01:02:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4146239991466394845', time=2024-09-12T02:50:15.783237+0000, chain.objs.size()=1 2024-09-12T01:02:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.UFMg0mTLjKCsnkLINAtkX0SvpUDwUFQ_0 2024-09-12T01:02:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7486632456545623095', time=2024-09-12T02:50:15.860371+0000, chain.objs.size()=1 2024-09-12T01:02:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_._qSl1IWpzGVhPkH89ZXVHxAyWA9NwbA_0 2024-09-12T01:02:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11280507367444039514', time=2024-09-12T02:50:15.910370+0000, chain.objs.size()=1 2024-09-12T01:02:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.u3kd24n-jdwt7nUy_wAeHGkrnamTUVa_0 2024-09-12T01:02:39.193 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4752801402110900239', time=2024-09-12T02:50:16.138109+0000, chain.objs.size()=1 2024-09-12T01:02:39.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.z33sSnwYy7dJzrzIg1yhJLLZd2j0h5v_0 2024-09-12T01:02:39.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13319338138615808890', time=2024-09-12T02:50:16.211564+0000, chain.objs.size()=1 2024-09-12T01:02:39.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Aq32IEEiszP-PZ8P1FFJmwVHZU96yOd_0 2024-09-12T01:02:39.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13728418852181043769', time=2024-09-12T02:50:16.238933+0000, chain.objs.size()=1 2024-09-12T01:02:39.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.EFYJHVLfrdeYMk0PGNFwGfaRn3IlCHy_0 2024-09-12T01:02:39.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7479680447818725977', time=2024-09-12T02:50:16.369972+0000, chain.objs.size()=1 2024-09-12T01:02:39.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.v8Wijo5wiMM79OwoHwAVprKWM3YV4WX_0 2024-09-12T01:02:39.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16738519571357334767', time=2024-09-12T02:50:16.400249+0000, chain.objs.size()=1 2024-09-12T01:02:39.194 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.NcUoxlmG25sOLRWEiqdQSR2hm10BnWL_0 2024-09-12T01:02:39.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1079882259489657300', time=2024-09-12T02:50:16.409929+0000, chain.objs.size()=1 2024-09-12T01:02:39.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.q00JEi5-Yp7yitYq_5hjosE98ZDkjLa_0 2024-09-12T01:02:39.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12876343765032160658', time=2024-09-12T02:50:16.759862+0000, chain.objs.size()=1 2024-09-12T01:02:39.195 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.198+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.JXtWYEhQMGCxgfli2PNZyDmxmsJnEw4_0 2024-09-12T01:02:39.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12777570959170687162', time=2024-09-12T02:50:16.910955+0000, chain.objs.size()=1 2024-09-12T01:02:39.197 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.TRbS0aN0pl4zvDNq2a7BtaZdCjwIC87_0 2024-09-12T01:02:39.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10996452442324755307', time=2024-09-12T02:50:16.987349+0000, chain.objs.size()=1 2024-09-12T01:02:39.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.UYg9y8ENLDEUyIelVgUej_fgamI1224_0 2024-09-12T01:02:39.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4657383981954923248', time=2024-09-12T02:50:16.990496+0000, chain.objs.size()=1 2024-09-12T01:02:39.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Y0KtfzQHQwdaxr7vHSdQXE0aDdUCWiq_0 2024-09-12T01:02:39.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10033167669810170846', time=2024-09-12T02:50:17.133826+0000, chain.objs.size()=1 2024-09-12T01:02:39.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.9qG5twnN55XJcabHjdsRJ_G15_eci6f_0 2024-09-12T01:02:39.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7363300079581986409', time=2024-09-12T02:50:17.143326+0000, chain.objs.size()=1 2024-09-12T01:02:39.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.GmTnGLAQxzcsHSQTGgfrg8-beVP4O5u_0 2024-09-12T01:02:39.198 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5447492490406114426', time=2024-09-12T02:50:17.157716+0000, chain.objs.size()=1 2024-09-12T01:02:39.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.rLYH0mj2BIkoILrmw8SxwybYUgG0QvM_0 2024-09-12T01:02:39.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.766722806194214525', time=2024-09-12T02:50:17.191320+0000, chain.objs.size()=1 2024-09-12T01:02:39.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6fXHAJNezOlM8mrxT-1SEzMw8QJJkgV_0 2024-09-12T01:02:39.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9013504239331929233', time=2024-09-12T02:50:17.211106+0000, chain.objs.size()=1 2024-09-12T01:02:39.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.3v_rjy7vmGl9IYd9AY7V84GcGTwgMMh_0 2024-09-12T01:02:39.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6134405241865056213', time=2024-09-12T02:50:17.249343+0000, chain.objs.size()=1 2024-09-12T01:02:39.199 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.202+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.qCRva_pB6gpgNGrIpeGCARXmiuY2AYd_0 2024-09-12T01:02:39.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3008149536772085256', time=2024-09-12T02:50:17.478160+0000, chain.objs.size()=1 2024-09-12T01:02:39.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-DFdsj_1HgUZjmT1Zd0q1RaNm79XUhb_0 2024-09-12T01:02:39.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3028846770326780431', time=2024-09-12T02:50:17.496152+0000, chain.objs.size()=1 2024-09-12T01:02:39.201 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.9awJ-K--DQvsSJ_FpIZ_R-3RRjd_WIy_0 2024-09-12T01:02:39.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17722033972087959565', time=2024-09-12T02:50:17.539982+0000, chain.objs.size()=1 2024-09-12T01:02:39.202 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.a3jmRWWo_XvEplFC_IftKnxB0oP6SON_0 2024-09-12T01:02:39.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4337395140060932395', time=2024-09-12T02:50:17.651268+0000, chain.objs.size()=1 2024-09-12T01:02:39.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.OPz3lKy40KqyynZsXg0uZfac9CSBZdl_0 2024-09-12T01:02:39.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17093120680937138920', time=2024-09-12T02:50:17.672586+0000, chain.objs.size()=1 2024-09-12T01:02:39.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Ei2hvNso65KmcXTQP0Mr-YTUWDGo1uL_0 2024-09-12T01:02:39.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3932220293877347841', time=2024-09-12T02:50:17.683792+0000, chain.objs.size()=1 2024-09-12T01:02:39.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.s47bE29EhOZMtb8CWxB3LDkFhSm14l9_0 2024-09-12T01:02:39.203 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16102070537906432126', time=2024-09-12T02:50:17.695272+0000, chain.objs.size()=1 2024-09-12T01:02:39.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.dPrfRHsRvnFKNOA-e53VPKNfgkiMPCx_0 2024-09-12T01:02:39.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13741965467576929768', time=2024-09-12T02:50:17.739582+0000, chain.objs.size()=1 2024-09-12T01:02:39.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.p-kFiOc-UetEgcUFC0qfp6j3xnoyaH3_0 2024-09-12T01:02:39.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3986660394591945632', time=2024-09-12T02:50:17.742348+0000, chain.objs.size()=1 2024-09-12T01:02:39.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.VsY9DMqFWi1quxJ61Nx1qJufI2hw29L_0 2024-09-12T01:02:39.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.746053943267987127', time=2024-09-12T02:50:39.568021+0000, chain.objs.size()=1 2024-09-12T01:02:39.204 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.mIXsyWtfEgLUtImHnT1rtjF_1MbdptC_0 2024-09-12T01:02:39.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1267094758314768735', time=2024-09-12T02:50:39.578362+0000, chain.objs.size()=1 2024-09-12T01:02:39.205 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.206+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.equ0yf9nGTLDgSqOGt9S-Mu7ydJnTsR_0 2024-09-12T01:02:39.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.210+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1971060944017070386', time=2024-09-12T02:50:39.709399+0000, chain.objs.size()=1 2024-09-12T01:02:39.206 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.210+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.l5HmH_lPFLof9Qymzc_YYgNf9vSBlZX_0 2024-09-12T01:02:39.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.210+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9441910253639892561', time=2024-09-12T02:50:39.720280+0000, chain.objs.size()=1 2024-09-12T01:02:39.207 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.210+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.1EV9aNxYzPYzZDwbkH4llbUYFxkCMce_0 2024-09-12T01:02:39.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.210+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7653692153983417074', time=2024-09-12T02:50:39.755496+0000, chain.objs.size()=1 2024-09-12T01:02:39.208 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.210+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.198R2Z5xfXVWeZmK_VJqmOGbLR5q3u2_0 2024-09-12T01:02:39.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.214+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17934708002943063679', time=2024-09-12T02:50:39.797566+0000, chain.objs.size()=1 2024-09-12T01:02:39.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.214+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.1Z1RaEHFxPbyhANi5KGIt_64C_PYF7K_0 2024-09-12T01:02:39.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.214+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11836488079288279074', time=2024-09-12T02:50:39.834182+0000, chain.objs.size()=1 2024-09-12T01:02:39.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.214+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.0YnN_3h-Jx67OcbkdiEGiLnuioZPhdQ_0 2024-09-12T01:02:39.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.214+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10942374057996492636', time=2024-09-12T02:50:40.041276+0000, chain.objs.size()=1 2024-09-12T01:02:39.210 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.214+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.VY5llPjfPtDVc1liB1AVJKb6adIF50P_0 2024-09-12T01:02:39.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.214+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3246867402995048423', time=2024-09-12T02:50:40.066593+0000, chain.objs.size()=1 2024-09-12T01:02:39.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.214+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.816mi-eKy37OxarCDIw-228Ztj2-Efc_0 2024-09-12T01:02:39.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.214+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1242243335458524680', time=2024-09-12T02:50:40.294204+0000, chain.objs.size()=1 2024-09-12T01:02:39.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.214+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.vO8p2LL5DlBpYsbtw5vtxP0VORrRi9h_0 2024-09-12T01:02:39.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.214+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4258476063936172504', time=2024-09-12T02:50:40.296704+0000, chain.objs.size()=1 2024-09-12T01:02:39.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.214+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.NuUMhX70bXwKy8MQJB-Tkq9ETxxHB3r_0 2024-09-12T01:02:39.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.214+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11898424940874719199', time=2024-09-12T02:50:40.313520+0000, chain.objs.size()=1 2024-09-12T01:02:39.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.214+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.4y_9P4Bcq5LBA-ELDS7D4HE6qxJ7S3w_0 2024-09-12T01:02:39.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.214+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17564839372036742976', time=2024-09-12T02:50:40.336447+0000, chain.objs.size()=1 2024-09-12T01:02:39.211 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.214+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.XFFumdxL9M86Vaa3ogyRJ0dr38hYN27_0 2024-09-12T01:02:39.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12077115421309150269', time=2024-09-12T02:50:40.355621+0000, chain.objs.size()=1 2024-09-12T01:02:39.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.fkbGwoty-EwuDOo_Dlkj6Cep6PxIWf7_0 2024-09-12T01:02:39.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5850237205749412043', time=2024-09-12T02:50:40.615054+0000, chain.objs.size()=1 2024-09-12T01:02:39.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.g8p_q2A4lOTClR5jsNVpnqKlzp-i21N_0 2024-09-12T01:02:39.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12837408095746570730', time=2024-09-12T02:50:40.633069+0000, chain.objs.size()=1 2024-09-12T01:02:39.213 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.AJM0p2RgDWhj90gO38ZdFsM_WAMZI_N_0 2024-09-12T01:02:39.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16742184197128080078', time=2024-09-12T02:50:40.636636+0000, chain.objs.size()=1 2024-09-12T01:02:39.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.cf-L6Fy_0yu7IbhGGj2avtVcn2Aw8N5_0 2024-09-12T01:02:39.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1826540006870046237', time=2024-09-12T02:50:40.808640+0000, chain.objs.size()=1 2024-09-12T01:02:39.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.0seoPufxGld0fU3B5dwJWlPqjhB4ZDm_0 2024-09-12T01:02:39.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15736927475304739072', time=2024-09-12T02:50:40.890821+0000, chain.objs.size()=1 2024-09-12T01:02:39.214 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ltHwIoTNgkS-UBQpyF4_ip5nf5kZr-m_0 2024-09-12T01:02:39.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9028436499330191170', time=2024-09-12T02:50:41.102242+0000, chain.objs.size()=1 2024-09-12T01:02:39.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.h8R3-UrThFj1xg7snh7ITQWnM1LFzCW_0 2024-09-12T01:02:39.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1255220777334313947', time=2024-09-12T02:50:41.110079+0000, chain.objs.size()=1 2024-09-12T01:02:39.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.bvragOudXM8V1H7KSlBfaqLpGKGxUoE_0 2024-09-12T01:02:39.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5872456941962869199', time=2024-09-12T02:50:41.139754+0000, chain.objs.size()=1 2024-09-12T01:02:39.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.awdjBQIxQrmm1kGtkpA8OMY5Ta7l1Vb_0 2024-09-12T01:02:39.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15607058111256751142', time=2024-09-12T02:50:41.163277+0000, chain.objs.size()=1 2024-09-12T01:02:39.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.X6bFGUtjDL-X7f7z_ivhmG0vqCSt2PM_0 2024-09-12T01:02:39.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9529062623161911520', time=2024-09-12T02:50:41.287355+0000, chain.objs.size()=1 2024-09-12T01:02:39.215 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.218+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.rY_boA_MrEmKOGRknbacCSBbQ1AWffw_0 2024-09-12T01:02:39.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7951111350235106244', time=2024-09-12T02:50:41.317514+0000, chain.objs.size()=1 2024-09-12T01:02:39.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.QgsZeYmoFdu3oKjA19tG_FoqSLSYbOc_0 2024-09-12T01:02:39.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12762896238164251250', time=2024-09-12T02:50:41.337180+0000, chain.objs.size()=1 2024-09-12T01:02:39.219 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.hhWzO8wJqyOxbSYmvxT0Nn9hlGr493G_0 2024-09-12T01:02:39.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1819395710952570693', time=2024-09-12T02:50:41.340982+0000, chain.objs.size()=1 2024-09-12T01:02:39.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.3lR0bxOJzYl-T4nelYp92YOGmOyWW5L_0 2024-09-12T01:02:39.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14881455899291672230', time=2024-09-12T02:50:41.377168+0000, chain.objs.size()=1 2024-09-12T01:02:39.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.8LslmJLlJajtyauUQeSIuKRW_OV-5CQ_0 2024-09-12T01:02:39.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5906099935319187338', time=2024-09-12T02:50:41.400399+0000, chain.objs.size()=1 2024-09-12T01:02:39.220 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.95U8Eo1e7X-ZZL9I6e8pqKKPDdm6pF3_0 2024-09-12T01:02:39.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11224418175361476751', time=2024-09-12T02:50:41.429039+0000, chain.objs.size()=1 2024-09-12T01:02:39.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.DOzz5yLM--F4UlTeJcwjPXEqZPqTwhx_0 2024-09-12T01:02:39.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6118403002651022520', time=2024-09-12T02:50:41.535250+0000, chain.objs.size()=1 2024-09-12T01:02:39.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.giSkKo8wrcN8T9sP6cibxJ3E4S4WU1t_0 2024-09-12T01:02:39.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7044616247943362251', time=2024-09-12T02:50:41.550215+0000, chain.objs.size()=1 2024-09-12T01:02:39.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.MSpHkgFmGGK8HCEZwM5xivUeUE8O1Mw_0 2024-09-12T01:02:39.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16489007551806766026', time=2024-09-12T02:50:41.596567+0000, chain.objs.size()=1 2024-09-12T01:02:39.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.v2Nff9VqqhsPGesFu0e9GFxRftqJVVk_0 2024-09-12T01:02:39.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16292422270073944257', time=2024-09-12T02:50:41.634775+0000, chain.objs.size()=1 2024-09-12T01:02:39.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ssEeBOlSQiq8oGtI0NIUs-2hP3m3KtI_0 2024-09-12T01:02:39.221 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12887549196909039333', time=2024-09-12T02:51:15.842014+0000, chain.objs.size()=1 2024-09-12T01:02:39.222 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.222+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.376__shadow_.Y-TZ8SmkFcoDr0pK5yQmEuqrKdF62Ok_0 2024-09-12T01:02:39.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.226+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13662433013782748593', time=2024-09-12T02:52:00.268382+0000, chain.objs.size()=1 2024-09-12T01:02:39.223 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.226+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.435__shadow_.uQGnsnZ5VpcM1xWQFUR9a136SA66vXx_0 2024-09-12T01:02:39.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.230+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12405900695644207185', time=2024-09-12T02:52:15.453718+0000, chain.objs.size()=1 2024-09-12T01:02:39.224 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.230+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.454__shadow_.xhZxzodQmNbYbeDkKGBcoeGErRXUJEP_0 2024-09-12T01:02:39.226 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.230+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45699 2024-09-12T01:02:39.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T01:02:39.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1017259597928518919', time=2024-09-12T02:52:22.671685+0000, chain.objs.size()=1 2024-09-12T01:02:39.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.461__shadow_.lW-zlNCYgaEz1X09e53nDAF3xZH1_vU_0 2024-09-12T01:02:39.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8217023190791109351', time=2024-09-12T02:52:27.656190+0000, chain.objs.size()=1 2024-09-12T01:02:39.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.466__shadow_.zJbXic79cU4U6BrNC5hNQnGYNRRMglW_0 2024-09-12T01:02:39.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15781317359798693161', time=2024-09-12T02:52:45.382235+0000, chain.objs.size()=1 2024-09-12T01:02:39.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.496__shadow_.HoCP76AKFS1VWiYyGseyKMzbcaWvBKe_0 2024-09-12T01:02:39.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15391359650285980065', time=2024-09-12T02:52:46.265845+0000, chain.objs.size()=1 2024-09-12T01:02:39.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.497__shadow_.X_cd4Nyh-z8LpMjLBTlUKfXWk_gevhs_0 2024-09-12T01:02:39.230 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~BNVeEJgmQPK0hq9ArniDS0yM1DweZcx', time=2024-09-12T02:53:43.742954+0000, chain.objs.size()=1 2024-09-12T01:02:39.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.534__multipart_mymultipart.2~BNVeEJgmQPK0hq9ArniDS0yM1DweZcx.1 2024-09-12T01:02:39.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15236154906974644100', time=2024-09-12T02:54:23.393477+0000, chain.objs.size()=1 2024-09-12T01:02:39.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.551__shadow_.KippzG9CRIYSv_hFuQHLHqco3xM6UqO_0 2024-09-12T01:02:39.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.478441093373067320', time=2024-09-12T02:54:52.542019+0000, chain.objs.size()=1 2024-09-12T01:02:39.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:8dUxL-BttAdjAmcB7QEGUYvfa6zjU2B_.hS8yTmcEcjcAWJLbPt70wWa8Ln_5Fap_0 2024-09-12T01:02:39.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10141492839009735895', time=2024-09-12T02:54:59.779613+0000, chain.objs.size()=1 2024-09-12T01:02:39.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.574__shadow:arOMJQkhjpvAUc5mVbPpPG3HLAY6K2H_.IA-9GsTEmzCetN2xzqwCVygJZp3Rx_b_0 2024-09-12T01:02:39.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11110657978870111902', time=2024-09-12T02:55:19.318338+0000, chain.objs.size()=1 2024-09-12T01:02:39.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:LzOD275G-Og7gns75qd6W4sWaRuqG8A_.V2sNRiZ66bOVE8ZVS_Go8Lz1fauWuEU_0 2024-09-12T01:02:39.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14494984536504614550', time=2024-09-12T02:55:31.119789+0000, chain.objs.size()=1 2024-09-12T01:02:39.231 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.582__shadow:qaQ6.cor2oQHnagQF9LwyvrQaZYFNWW_.tYf7AEjeH2JCVbbqiwT0rwiKZDuzfAb_0 2024-09-12T01:02:39.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15471423758619843609', time=2024-09-12T02:55:34.353146+0000, chain.objs.size()=1 2024-09-12T01:02:39.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.585__shadow:jV8NsQo2agZpMIzJeZxNXDkCwJ1xMrr_.thNo7vI9IrlVmBHJ85hVYqS8WSjpi-c_0 2024-09-12T01:02:39.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13525667536149671035', time=2024-09-12T02:55:36.153590+0000, chain.objs.size()=1 2024-09-12T01:02:39.232 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.234+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.587__shadow:BCMCa9Kv1t9xrQMQptRUHZmmkkfp0VX_.lMlEMrd0JnVFttu2FV0yJgZEMxWsLt2_0 2024-09-12T01:02:39.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.238+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1840884809529354600', time=2024-09-12T02:58:21.448479+0000, chain.objs.size()=1 2024-09-12T01:02:39.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.238+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.630__shadow_.ntJv-GOhHuiwk8d5JBZeRE_IL9KjUqG_0 2024-09-12T01:02:39.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.238+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7357394545678386156', time=2024-09-12T02:58:34.100134+0000, chain.objs.size()=1 2024-09-12T01:02:39.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.238+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.647__shadow_.rkXXlZbVo2-Vh-R_AWBsvntjv1kizRV_0 2024-09-12T01:02:39.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.238+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17554832488080256714', time=2024-09-12T02:59:13.216093+0000, chain.objs.size()=1 2024-09-12T01:02:39.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.238+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.701__shadow:sU8e3Fv-6SaJPwy1zcYRs0mVIBEHl9l_.B_oRvMhfZHpRuxixPQ1w-wRLLCbbLBR_0 2024-09-12T01:02:39.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.238+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11231596788336191235', time=2024-09-12T02:59:44.748705+0000, chain.objs.size()=1 2024-09-12T01:02:39.234 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.238+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.718__shadow_.L7nNMOUDkre8-o1ujq6uwVBzb008mGF_0 2024-09-12T01:02:39.237 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.242+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:39.240 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:02:39.241 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.242 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47100' 2024-09-12T01:02:39.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1255089034624023756', time=2024-09-12T02:46:01.957356+0000, chain.objs.size()=2 2024-09-12T01:02:39.243 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.158__shadow_.lAyBwfstzUMpoGzjPFtQFVvR4IJTD8T_0 2024-09-12T01:02:39.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.158__shadow_.lAyBwfstzUMpoGzjPFtQFVvR4IJTD8T_1 2024-09-12T01:02:39.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='_RDDJ2e6gJWyiI0yD3WuFjtLYa4K8iEW', time=2024-09-12T02:46:06.296551+0000, chain.objs.size()=2 2024-09-12T01:02:39.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__shadow_.KtQ04kRu8WLZdqKDbLdz05o7kptfiX0_0 2024-09-12T01:02:39.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__shadow_.KtQ04kRu8WLZdqKDbLdz05o7kptfiX0_1 2024-09-12T01:02:39.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2409742767320764612', time=2024-09-12T02:46:07.016677+0000, chain.objs.size()=3 2024-09-12T01:02:39.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__multipart_foo-LUKEWARM.2~aS8UW1vfA9UneZA9w60hPKjGeMM4DyH.1 2024-09-12T01:02:39.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__multipart_foo-LUKEWARM.2~aS8UW1vfA9UneZA9w60hPKjGeMM4DyH.2 2024-09-12T01:02:39.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__multipart_foo-LUKEWARM.2~aS8UW1vfA9UneZA9w60hPKjGeMM4DyH.3 2024-09-12T01:02:39.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2752106343420891542', time=2024-09-12T02:46:10.403248+0000, chain.objs.size()=2 2024-09-12T01:02:39.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.164__multipart_foo.2~NunX0f9R_w2vSdh3Rk4kcX-xfr1Y89S.1 2024-09-12T01:02:39.244 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.164__multipart_foo.2~NunX0f9R_w2vSdh3Rk4kcX-xfr1Y89S.2 2024-09-12T01:02:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5996712007528707730', time=2024-09-12T02:46:10.784701+0000, chain.objs.size()=1 2024-09-12T01:02:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.166__shadow_.6zlF5AyVYewXAmfxpD1QKXAaD_bPiYE_0 2024-09-12T01:02:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11694382489588406604', time=2024-09-12T02:46:34.020290+0000, chain.objs.size()=1 2024-09-12T01:02:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.188__shadow_.31OY-1gqsFE3iQjBDCOR7x3VZYNwAny_0 2024-09-12T01:02:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13625184880418250049', time=2024-09-12T02:46:48.396347+0000, chain.objs.size()=1 2024-09-12T01:02:39.245 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.246+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.197__shadow_.-m7RGst7TdAqEb_6NjcxqPxy9jBbzug_0 2024-09-12T01:02:39.247 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.250+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11097645251414362586', time=2024-09-12T02:48:25.956275+0000, chain.objs.size()=1 2024-09-12T01:02:39.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.250+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.238__shadow_.VkT8zDKjunveiCWLqVbJo3eELwpgDN9_0 2024-09-12T01:02:39.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.250+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3118265491567004670', time=2024-09-12T02:48:43.867473+0000, chain.objs.size()=1 2024-09-12T01:02:39.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.250+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.261__shadow_.aAp8MwYXKzrn2Jqj_BjvEWHFz32pmnJ_0 2024-09-12T01:02:39.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.250+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18302085292803702392', time=2024-09-12T02:49:05.413255+0000, chain.objs.size()=1 2024-09-12T01:02:39.248 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.250+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.2KQdQTPTCGJRHaVlzLBP-3t0pnq5cxN_0 2024-09-12T01:02:39.249 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9468574523363661456', time=2024-09-12T02:49:05.498601+0000, chain.objs.size()=1 2024-09-12T01:02:39.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.SH5iq6mmzLhT5N6Rcb7d3me38OCPgle_0 2024-09-12T01:02:39.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5034778727916778342', time=2024-09-12T02:49:05.515594+0000, chain.objs.size()=1 2024-09-12T01:02:39.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.xb4w8O51u1Gf1LV0dfwhxgepfR48KMh_0 2024-09-12T01:02:39.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8455512146350768630', time=2024-09-12T02:49:05.530412+0000, chain.objs.size()=1 2024-09-12T01:02:39.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.VxPCEA_ScxQbfs-CVz_keCUtG63BCPB_0 2024-09-12T01:02:39.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15458818609570103681', time=2024-09-12T02:49:05.716653+0000, chain.objs.size()=1 2024-09-12T01:02:39.250 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Y2SlDeQl9Ku-RKUSF77uM46YXCZnzSy_0 2024-09-12T01:02:39.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13321177142038851270', time=2024-09-12T02:49:05.718530+0000, chain.objs.size()=1 2024-09-12T01:02:39.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.36prDnfWeBAw-x39HPtwD3mJ_cCr0vO_0 2024-09-12T01:02:39.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10321785077754647364', time=2024-09-12T02:49:05.723039+0000, chain.objs.size()=1 2024-09-12T01:02:39.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.dLMHPqIhnv1I5bDiZn9uB8U3D5o8Dc0_0 2024-09-12T01:02:39.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12283030956850677548', time=2024-09-12T02:49:05.735229+0000, chain.objs.size()=1 2024-09-12T01:02:39.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.IJIA1zLQ-21k9Zl6dJuotG4NgXJ_sFT_0 2024-09-12T01:02:39.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1739070724263659903', time=2024-09-12T02:49:05.763288+0000, chain.objs.size()=1 2024-09-12T01:02:39.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.XQLn030HFc7dlxoG9EQvKOtWTiOwUnP_0 2024-09-12T01:02:39.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10268006961234740865', time=2024-09-12T02:49:05.770277+0000, chain.objs.size()=1 2024-09-12T01:02:39.251 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.hSmXrYo94TK9cPHKAEVZbI3cV5yJm1__0 2024-09-12T01:02:39.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16539718376249447329', time=2024-09-12T02:49:05.786883+0000, chain.objs.size()=1 2024-09-12T01:02:39.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.SAc8l6-tYrd5bTMKIMZGAUZEwi4Txf__0 2024-09-12T01:02:39.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6027829274062090443', time=2024-09-12T02:49:05.836778+0000, chain.objs.size()=1 2024-09-12T01:02:39.252 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.254+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Aa_EoLUFsSD1oHBGQphftxzq0UrMSIR_0 2024-09-12T01:02:39.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9782056329362135861', time=2024-09-12T02:49:05.850376+0000, chain.objs.size()=1 2024-09-12T01:02:39.253 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.gazUHKpqt_KyPkbmtgRQkq7f3Is3kBU_0 2024-09-12T01:02:39.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11866227103653330534', time=2024-09-12T02:49:06.060719+0000, chain.objs.size()=1 2024-09-12T01:02:39.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.boqQSTI8U4DHJYtl22Gsj6-H1POChp3_0 2024-09-12T01:02:39.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3551527455374581829', time=2024-09-12T02:49:06.091590+0000, chain.objs.size()=1 2024-09-12T01:02:39.255 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.EjiJjTNg8LTdVVapfU2wKWjTeAe_mCM_0 2024-09-12T01:02:39.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2379109747107063840', time=2024-09-12T02:49:06.101018+0000, chain.objs.size()=1 2024-09-12T01:02:39.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.gMRDE7arh3efcvFWlv_Rn7ed0qsZ8Eg_0 2024-09-12T01:02:39.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8900161248491087765', time=2024-09-12T02:49:06.103767+0000, chain.objs.size()=1 2024-09-12T01:02:39.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.LaRihGcTXfSrXcJZQegHNL4nSOgGNpf_0 2024-09-12T01:02:39.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4161118093650732575', time=2024-09-12T02:49:06.221450+0000, chain.objs.size()=1 2024-09-12T01:02:39.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.epLGq5RjVXWNv5ECK80t0SsxJGugNz4_0 2024-09-12T01:02:39.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18446383882048807021', time=2024-09-12T02:49:06.235693+0000, chain.objs.size()=1 2024-09-12T01:02:39.256 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.mo9LhVvsC0S8GnuUwysYMPOutNPLHP4_0 2024-09-12T01:02:39.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4228253390256565037', time=2024-09-12T02:49:06.324208+0000, chain.objs.size()=1 2024-09-12T01:02:39.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.XijUZNcBLHZgyqC_L5QVwEqVqYHUZdG_0 2024-09-12T01:02:39.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4411766948416671', time=2024-09-12T02:49:06.530296+0000, chain.objs.size()=1 2024-09-12T01:02:39.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.MZIf1yQsye-wyl0LJKpBbarPkJB6baH_0 2024-09-12T01:02:39.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11985383459825813142', time=2024-09-12T02:49:06.594542+0000, chain.objs.size()=1 2024-09-12T01:02:39.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.mbXq25F9OB8Sq-5OXyokwcAlinVmXRx_0 2024-09-12T01:02:39.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.983525892005565607', time=2024-09-12T02:49:06.623997+0000, chain.objs.size()=1 2024-09-12T01:02:39.257 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.258+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.GUIr-6HN0WFcPbEElVxcARb6F5QcUx4_0 2024-09-12T01:02:39.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9931970516327147148', time=2024-09-12T02:49:06.744531+0000, chain.objs.size()=1 2024-09-12T01:02:39.259 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.yO_TQq0gUyP4xIbsxqT3OMN_R8xTrHg_0 2024-09-12T01:02:39.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6595747041122589854', time=2024-09-12T02:49:06.770850+0000, chain.objs.size()=1 2024-09-12T01:02:39.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.a40ervSeo2kfZk5ZuIlhR4Hzv97-UmP_0 2024-09-12T01:02:39.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.37670626161170823', time=2024-09-12T02:49:06.787981+0000, chain.objs.size()=1 2024-09-12T01:02:39.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.O0x2s8ze7z36284It3phUKtz-2y3RBA_0 2024-09-12T01:02:39.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17471138257865426210', time=2024-09-12T02:49:06.798551+0000, chain.objs.size()=1 2024-09-12T01:02:39.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.x7dK_kIk4WaUawEZQb0lBkrl5uUNtlA_0 2024-09-12T01:02:39.260 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9328444466575631294', time=2024-09-12T02:49:06.806599+0000, chain.objs.size()=1 2024-09-12T01:02:39.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.t2wg4AWo-J1JeVFTxANSD-wK6D5N4NX_0 2024-09-12T01:02:39.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.262+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14978449213262673688', time=2024-09-12T02:49:06.853949+0000, chain.objs.size()=1 2024-09-12T01:02:39.261 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.262+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.4AdPewHz0yx5wCQF9t_eizDgNtFti72_0 2024-09-12T01:02:39.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4273083183775831623', time=2024-09-12T02:49:06.855506+0000, chain.objs.size()=1 2024-09-12T01:02:39.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.zTkJT3Q1l-0fKbWmca09LijzvA151UO_0 2024-09-12T01:02:39.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1875669581631590097', time=2024-09-12T02:49:06.905128+0000, chain.objs.size()=1 2024-09-12T01:02:39.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.pxDu9Wh2CgC1zs2_XaZeM97kFs_lI4M_0 2024-09-12T01:02:39.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15284944878162034187', time=2024-09-12T02:49:07.089870+0000, chain.objs.size()=1 2024-09-12T01:02:39.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Sc5dYquTHfSUB5f8ylM0_VzkxnieMZD_0 2024-09-12T01:02:39.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.210702056351512427', time=2024-09-12T02:49:07.126854+0000, chain.objs.size()=1 2024-09-12T01:02:39.262 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.tdxj_VlDdXye7QjoiQ0xsZ2opoGh70l_0 2024-09-12T01:02:39.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1736650008065392530', time=2024-09-12T02:49:07.133685+0000, chain.objs.size()=1 2024-09-12T01:02:39.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.d9Aj3qeJH-gHuRqg5i6GHQVNffdyl3j_0 2024-09-12T01:02:39.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.266+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.297224935508211243', time=2024-09-12T02:49:07.171856+0000, chain.objs.size()=1 2024-09-12T01:02:39.263 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.266+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.8e_hJZ6D25SZX1bZRz1DI_hH0OTZx-0_0 2024-09-12T01:02:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bd9596640 0 -- 172.21.15.138:0/2003776050 >> [v2:172.21.15.138:6808/276276685,v1:172.21.15.138:6809/276276685] conn(0x7f2bcc023040 msgr2=0x7f2bcc07d1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7206460025413075567', time=2024-09-12T02:49:07.312276+0000, chain.objs.size()=1 2024-09-12T01:02:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.k57fkneuoEmGrRiP2cvLS-NqJ797FAd_0 2024-09-12T01:02:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17010715833616878629', time=2024-09-12T02:49:07.319712+0000, chain.objs.size()=1 2024-09-12T01:02:39.267 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.SjaW5L8kyPMeqWZpVuWPZxsBJagvD17_0 2024-09-12T01:02:39.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5892060700499353151', time=2024-09-12T02:49:25.453978+0000, chain.objs.size()=1 2024-09-12T01:02:39.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.286__shadow_.JFA8SF0WrICi7EQ_BSL_6sILK0-F9_L_0 2024-09-12T01:02:39.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16723482313619407495', time=2024-09-12T02:49:32.459775+0000, chain.objs.size()=1 2024-09-12T01:02:39.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.FyixngmJLe-J4cPLqHwQ7sKBRSjrwYK_0 2024-09-12T01:02:39.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17884809234321730214', time=2024-09-12T02:49:33.152503+0000, chain.objs.size()=1 2024-09-12T01:02:39.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.294__shadow_.smQx7x1z_dy91WVajSAo7oGvMdSjqty_0 2024-09-12T01:02:39.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9307397793894707606', time=2024-09-12T02:49:40.694870+0000, chain.objs.size()=1 2024-09-12T01:02:39.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.304__shadow_.aw61uM0eV1zU0xftUl9P4M-Kd9KlSd1_0 2024-09-12T01:02:39.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13100133681290254253', time=2024-09-12T02:50:15.790962+0000, chain.objs.size()=1 2024-09-12T01:02:39.268 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4nHIyVGkAT7exYzlwhLQYzQ_gmfkrb7_0 2024-09-12T01:02:39.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5446203985839229490', time=2024-09-12T02:50:15.818012+0000, chain.objs.size()=1 2024-09-12T01:02:39.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.NdlO_1IuaCQXjkq2i0Ru7g6Mo-7kfVX_0 2024-09-12T01:02:39.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12745376744782562708', time=2024-09-12T02:50:15.824654+0000, chain.objs.size()=1 2024-09-12T01:02:39.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.N5p8cZPGHL5soWCQK9wVy0yAfYOTGzz_0 2024-09-12T01:02:39.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13488271392758934019', time=2024-09-12T02:50:15.901752+0000, chain.objs.size()=1 2024-09-12T01:02:39.269 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.270+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.QP8GNcFpi3GFEHcopev2CaA-X-iqu3D_0 2024-09-12T01:02:39.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.274+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3799454525100715802', time=2024-09-12T02:50:16.144156+0000, chain.objs.size()=1 2024-09-12T01:02:39.270 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.274+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.8xZ876iAUtw0mhfRPh6WvjeJ4xemCDp_0 2024-09-12T01:02:39.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.274+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10853854411443489054', time=2024-09-12T02:50:16.162733+0000, chain.objs.size()=1 2024-09-12T01:02:39.271 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.274+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.pOr2FarDWgWRDYCiB9QNXbZu7uEILgG_0 2024-09-12T01:02:39.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13515958390246007311', time=2024-09-12T02:50:16.228618+0000, chain.objs.size()=1 2024-09-12T01:02:39.272 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.nyAmKODjOFyeZ_C6ih4rPPo9W54ymBL_0 2024-09-12T01:02:39.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11559169233872843288', time=2024-09-12T02:50:16.431509+0000, chain.objs.size()=1 2024-09-12T01:02:39.275 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Bty6jEiLui0FQ-VSJSVCcNXCXjQQaVU_0 2024-09-12T01:02:39.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8109643203113490869', time=2024-09-12T02:50:16.466086+0000, chain.objs.size()=1 2024-09-12T01:02:39.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.mS_1hZCdr9_T8nW9e0QNt9fTrCcb41G_0 2024-09-12T01:02:39.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1623274890617757376', time=2024-09-12T02:50:16.494555+0000, chain.objs.size()=1 2024-09-12T01:02:39.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.2oBuHxqyfOF3tVdEtl9ZhBoNXLOHcJX_0 2024-09-12T01:02:39.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15455222998021416431', time=2024-09-12T02:50:16.643506+0000, chain.objs.size()=1 2024-09-12T01:02:39.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.YBdAr5pxVxlfJxnUw6NUQbUVoWT1T01_0 2024-09-12T01:02:39.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1248808446208791606', time=2024-09-12T02:50:16.765701+0000, chain.objs.size()=1 2024-09-12T01:02:39.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.sulrKApi1JNdkio5HOFGvwR2fwDLxGY_0 2024-09-12T01:02:39.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1295767748422397406', time=2024-09-12T02:50:16.796996+0000, chain.objs.size()=1 2024-09-12T01:02:39.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.lhwJhAUsP0W0eAImZJpFN4OWCUI9I7b_0 2024-09-12T01:02:39.276 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12675822458568827085', time=2024-09-12T02:50:16.927159+0000, chain.objs.size()=1 2024-09-12T01:02:39.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.OGnGeCYOTOQnxf82ZjqKVxerBb_9yIT_0 2024-09-12T01:02:39.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11854707037190048311', time=2024-09-12T02:50:16.989544+0000, chain.objs.size()=1 2024-09-12T01:02:39.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.d_nWbaT6u2e0KWhis9lR9O0FA5WmaOU_0 2024-09-12T01:02:39.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4302257986756847775', time=2024-09-12T02:50:17.000715+0000, chain.objs.size()=1 2024-09-12T01:02:39.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.DEKhy6oVfvbE0UdtPHNMI1Rf6fqSz0H_0 2024-09-12T01:02:39.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16610513335752478219', time=2024-09-12T02:50:17.003852+0000, chain.objs.size()=1 2024-09-12T01:02:39.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.pZQriuIr6fjTtUkIgd2LD1A6uRlxl2S_0 2024-09-12T01:02:39.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1650659618826052300', time=2024-09-12T02:50:17.165949+0000, chain.objs.size()=1 2024-09-12T01:02:39.277 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.278+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.lFOWQMGcwUgbJCMlgA34A3E7l-Gr6_J_0 2024-09-12T01:02:39.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.282+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12770298762421215038', time=2024-09-12T02:50:17.201005+0000, chain.objs.size()=1 2024-09-12T01:02:39.280 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.282+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.PINgr5NncUxEgsnj0LJntBUUPXA2fHt_0 2024-09-12T01:02:39.281 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3663592732838314686', time=2024-09-12T02:50:17.247579+0000, chain.objs.size()=1 2024-09-12T01:02:39.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.VhejTvmWAma0gcZtBuG8OKITt_A_GzG_0 2024-09-12T01:02:39.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15570245355691609265', time=2024-09-12T02:50:17.453976+0000, chain.objs.size()=1 2024-09-12T01:02:39.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.OL6hDhdFbmwaUuqPgtRamzXeyZl5yuq_0 2024-09-12T01:02:39.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4500142059583707544', time=2024-09-12T02:50:17.484314+0000, chain.objs.size()=1 2024-09-12T01:02:39.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.v2rtz9d5gjHn43CMGSDMi1Wdq2av_OD_0 2024-09-12T01:02:39.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2459347676275093657', time=2024-09-12T02:50:17.488511+0000, chain.objs.size()=1 2024-09-12T01:02:39.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.45cABeJA4iIwUGFZ1ddQbkacHhXO-fK_0 2024-09-12T01:02:39.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17810460896013920772', time=2024-09-12T02:50:17.663080+0000, chain.objs.size()=1 2024-09-12T01:02:39.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.2AtxmNuuL9wuVlAE_Mi33EbCLELPpI__0 2024-09-12T01:02:39.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3744531058541638606', time=2024-09-12T02:50:17.673515+0000, chain.objs.size()=1 2024-09-12T01:02:39.282 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.tIvYsg83joBSCE5ERi-RePhXC2WNHxQ_0 2024-09-12T01:02:39.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9930343718161384769', time=2024-09-12T02:50:17.683188+0000, chain.objs.size()=1 2024-09-12T01:02:39.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-Ie_Iv_RFrgGQj1AyiqNPQyhDOFT--u_0 2024-09-12T01:02:39.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13486938686190224984', time=2024-09-12T02:50:17.707156+0000, chain.objs.size()=1 2024-09-12T01:02:39.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.FohCQjB7HZ31aR_App2_6Q13_7PvlDg_0 2024-09-12T01:02:39.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15548763556468865105', time=2024-09-12T02:50:17.717719+0000, chain.objs.size()=1 2024-09-12T01:02:39.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.jtQkC5CHNEN8HUxMqICsJTKiKFFhkjI_0 2024-09-12T01:02:39.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.977816435630843325', time=2024-09-12T02:50:39.514593+0000, chain.objs.size()=1 2024-09-12T01:02:39.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Izt_hPuMkdSCGbH6-l_QQr89wNkoAjn_0 2024-09-12T01:02:39.283 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.286+0000 7f2bd9596640 0 -- 172.21.15.138:0/2003776050 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x55f000922240 msgr2=0x55f000924630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:02:39.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2914933021110507917', time=2024-09-12T02:50:39.545816+0000, chain.objs.size()=1 2024-09-12T01:02:39.285 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.290+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.wMuPWuKQWYNdGEZpSvPpcoKqUuWKyvS_0 2024-09-12T01:02:39.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.290+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13068017803423671139', time=2024-09-12T02:50:39.549991+0000, chain.objs.size()=1 2024-09-12T01:02:39.286 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.290+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.bXo1xP8o9-X1I0Ap5lXL_Om31jXV7me_0 2024-09-12T01:02:39.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8255153979054364914', time=2024-09-12T02:50:39.568872+0000, chain.objs.size()=1 2024-09-12T01:02:39.288 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.d96QOqwn8tblieEjUOIUYhXO2txCfZ1_0 2024-09-12T01:02:39.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9065443949433919286', time=2024-09-12T02:50:39.717985+0000, chain.objs.size()=1 2024-09-12T01:02:39.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.fevNBE-aApN1vcnXNXQqDoX8yXHwzHt_0 2024-09-12T01:02:39.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12241058352554282838', time=2024-09-12T02:50:39.730062+0000, chain.objs.size()=1 2024-09-12T01:02:39.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.FqngmoGvo7UgN_4b4CIeAiZd6AAxKIM_0 2024-09-12T01:02:39.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5143019423038524183', time=2024-09-12T02:50:39.741933+0000, chain.objs.size()=1 2024-09-12T01:02:39.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.u6DaaIiC7Hl2fGmysqKqoQbjZkZfTdz_0 2024-09-12T01:02:39.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5745031091977991302', time=2024-09-12T02:50:39.785778+0000, chain.objs.size()=1 2024-09-12T01:02:39.289 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.uTnYf4xd03TTC3umN-fSL5NQTyQap1Q_0 2024-09-12T01:02:39.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9301353254434285116', time=2024-09-12T02:50:39.789178+0000, chain.objs.size()=1 2024-09-12T01:02:39.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.B5MO8OR10YAw95n7vs3lgNvVPh6-E29_0 2024-09-12T01:02:39.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14042001764648362674', time=2024-09-12T02:50:39.862321+0000, chain.objs.size()=1 2024-09-12T01:02:39.290 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.2lecg1SKhtSGsBuH7UqUi11LMZSaTxV_0 2024-09-12T01:02:39.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bda598640 0 -- 172.21.15.138:0/2003776050 >> [v2:172.21.15.178:6800/833505061,v1:172.21.15.178:6801/833505061] conn(0x7f2aa4081c30 msgr2=0x7f2aa4084060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:39.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7599870670839362693', time=2024-09-12T02:50:39.865096+0000, chain.objs.size()=1 2024-09-12T01:02:39.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.QmZM4TOWV41RFlqTb5UvW7UlyboMB5M_0 2024-09-12T01:02:39.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3094493213458448969', time=2024-09-12T02:50:39.870450+0000, chain.objs.size()=1 2024-09-12T01:02:39.291 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.294+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.liVMYgL_pN1rehQS7K36_HVysDQdpPM_0 2024-09-12T01:02:39.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.298+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9034156914399725111', time=2024-09-12T02:50:39.985243+0000, chain.objs.size()=1 2024-09-12T01:02:39.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.298+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.vA2komU3TN_T2q3uwFsc1DBJdWJyMoD_0 2024-09-12T01:02:39.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.298+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4209659087930585942', time=2024-09-12T02:50:40.030568+0000, chain.objs.size()=1 2024-09-12T01:02:39.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.298+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Y9HScjaOGgXJrJFtHaVl9pMoI_xgQBR_0 2024-09-12T01:02:39.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.298+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15909552078714246644', time=2024-09-12T02:50:40.285575+0000, chain.objs.size()=1 2024-09-12T01:02:39.295 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.298+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.RHY71tEeBb5C9roGa9_NXktTqXC0-_b_0 2024-09-12T01:02:39.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11788664290029765441', time=2024-09-12T02:50:40.556767+0000, chain.objs.size()=1 2024-09-12T01:02:39.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.pCV6_nvYgXohKjrcMrWopV7a4sznpNc_0 2024-09-12T01:02:39.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18085526869571477953', time=2024-09-12T02:50:40.609496+0000, chain.objs.size()=1 2024-09-12T01:02:39.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.RDI1fF990gRw2X67_DNfgFxqf1hUI88_0 2024-09-12T01:02:39.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11173420605920775011', time=2024-09-12T02:50:40.802335+0000, chain.objs.size()=1 2024-09-12T01:02:39.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.esqZ64zMuddzQT8ONFIC07GKYHcBrDq_0 2024-09-12T01:02:39.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2852222322768281995', time=2024-09-12T02:50:40.898226+0000, chain.objs.size()=1 2024-09-12T01:02:39.298 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.2nz-p41ev6tav3iwVTT6htRzWZ-PnTw_0 2024-09-12T01:02:39.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9682003428545551377', time=2024-09-12T02:50:41.067349+0000, chain.objs.size()=1 2024-09-12T01:02:39.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.43I7vi30QueAh4LMO0uqSg05OrSZDh8_0 2024-09-12T01:02:39.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.508172217083968999', time=2024-09-12T02:50:41.078761+0000, chain.objs.size()=1 2024-09-12T01:02:39.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.9TfQvYLMgBE2rNdmTs_Q3hQs-zN_TAi_0 2024-09-12T01:02:39.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.302+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6430758966504424474', time=2024-09-12T02:50:41.164629+0000, chain.objs.size()=1 2024-09-12T01:02:39.299 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.302+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.mHdEfW94YSb0fJAAFovxCHC3r6iCrju_0 2024-09-12T01:02:39.303 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.306+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47100 2024-09-12T01:02:39.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T01:02:39.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.881527248403422831', time=2024-09-12T02:50:41.172354+0000, chain.objs.size()=1 2024-09-12T01:02:39.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.i4F1oiMJ1GZyKUL8b-aoceD9M3FfkDA_0 2024-09-12T01:02:39.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7117668314175148256', time=2024-09-12T02:50:41.353911+0000, chain.objs.size()=1 2024-09-12T01:02:39.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Io1Bt4eWVMifHMuKLalrg37qQ40_GSS_0 2024-09-12T01:02:39.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17423751753386671508', time=2024-09-12T02:50:41.438947+0000, chain.objs.size()=1 2024-09-12T01:02:39.305 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.rQMIz7AXUSpD-Dwvazes84qe9Ao7N9F_0 2024-09-12T01:02:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10790201660487493392', time=2024-09-12T02:50:41.554541+0000, chain.objs.size()=1 2024-09-12T01:02:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ygAIEQypp1czIBtJl_s5HB8MSdMnhe3_0 2024-09-12T01:02:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12635301270371182344', time=2024-09-12T02:50:41.556916+0000, chain.objs.size()=1 2024-09-12T01:02:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.N5cS6cU4A3Q4_gUrdnRLF2JVpBlX9K__0 2024-09-12T01:02:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1398414273583739817', time=2024-09-12T02:50:41.620233+0000, chain.objs.size()=1 2024-09-12T01:02:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.e_zier45BqadiVl9LuX2AnX-YKGhU9k_0 2024-09-12T01:02:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7641679057923600140', time=2024-09-12T02:50:41.646785+0000, chain.objs.size()=1 2024-09-12T01:02:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.aiJ8brWPt4LcKUoJXCL8OiE-_9BDwhR_0 2024-09-12T01:02:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11894560842376862918', time=2024-09-12T02:52:27.338367+0000, chain.objs.size()=1 2024-09-12T01:02:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.466__shadow_.3vxY1nuRBag6BU5QukFewg-ZITm56mO_0 2024-09-12T01:02:39.306 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4058759176782575901', time=2024-09-12T02:52:27.418230+0000, chain.objs.size()=1 2024-09-12T01:02:39.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.466__shadow_.La7WCfOwt6S035RCyIqQFkee1YmcScg_0 2024-09-12T01:02:39.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6899716553993925233', time=2024-09-12T02:52:36.201451+0000, chain.objs.size()=1 2024-09-12T01:02:39.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.483__shadow_.VvmRN1-3c9kmagih7QZcrkwiHldN5X3_0 2024-09-12T01:02:39.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9938372543745495995', time=2024-09-12T02:52:45.164198+0000, chain.objs.size()=1 2024-09-12T01:02:39.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.496__shadow_.HoCP76AKFS1VWiYyGseyKMzbcaWvBKe_0 2024-09-12T01:02:39.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14395999662825890045', time=2024-09-12T02:52:59.304421+0000, chain.objs.size()=1 2024-09-12T01:02:39.307 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.515__shadow_.6lpSMAJ3bhgXs8C3XIKVzAem5P_aAUj_0 2024-09-12T01:02:39.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4814143930061919478', time=2024-09-12T02:52:59.478716+0000, chain.objs.size()=1 2024-09-12T01:02:39.308 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.310+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.516__multipart_mymultipartcopy.2~otC8gXop9aIw1TZJ7gH8M-n8wT6JRgv.1 2024-09-12T01:02:39.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.314+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.428515433751044583', time=2024-09-12T02:53:34.429184+0000, chain.objs.size()=3 2024-09-12T01:02:39.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.314+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.525__multipart_mymultipart.2~uPAxva_8XQm5YZvBeyu8WbE7Rk0k1PU.1 2024-09-12T01:02:39.310 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.314+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.525__multipart_mymultipart.2~uPAxva_8XQm5YZvBeyu8WbE7Rk0k1PU.2 2024-09-12T01:02:39.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.525__multipart_mymultipart.2~uPAxva_8XQm5YZvBeyu8WbE7Rk0k1PU.3 2024-09-12T01:02:39.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17689639980027693427', time=2024-09-12T02:54:30.652754+0000, chain.objs.size()=1 2024-09-12T01:02:39.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.557__shadow_.1vygKGZaOuiKylDhvFKK1cstzVRhbxj_0 2024-09-12T01:02:39.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11188028165998043801', time=2024-09-12T02:54:35.500888+0000, chain.objs.size()=1 2024-09-12T01:02:39.312 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.562__shadow_.befCW_OGIoPsbyzlTx0knBkj_WT3CE2_0 2024-09-12T01:02:39.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13768873098494550788', time=2024-09-12T02:54:49.334222+0000, chain.objs.size()=1 2024-09-12T01:02:39.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:N99VYeED7Z3MElH7GsPm3psSoal-Url_.QJ2PBF_8vfe5g-W_jqEfjiMHe9shXFK_0 2024-09-12T01:02:39.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13313518489697842272', time=2024-09-12T02:54:55.637211+0000, chain.objs.size()=1 2024-09-12T01:02:39.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.572__shadow:zhxn9Rqw.uRa9fkSGsO-qwHUpr65Xlc_.pZ1gfqotbagT__ohV0VbSTX-LKlzu8c_0 2024-09-12T01:02:39.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8914461823378566593', time=2024-09-12T02:55:00.106315+0000, chain.objs.size()=1 2024-09-12T01:02:39.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.574__shadow:2HdXl8IxzSpzwRLG6cB9TcTI8N4ofhR_.veonR5kV6X-R05LbqjdIgR48HbitOXR_0 2024-09-12T01:02:39.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14311115601394989049', time=2024-09-12T02:55:04.588092+0000, chain.objs.size()=1 2024-09-12T01:02:39.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.576__shadow:2S5V8h0bSqBl8E3lbIjwIx3W2h-rNft_.RKJSLexe8zMslVJ0k-C08aNpOyW72JY_0 2024-09-12T01:02:39.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1248549032449053306', time=2024-09-12T02:55:06.423922+0000, chain.objs.size()=1 2024-09-12T01:02:39.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.576__shadow:cIfJrrOI6wPJguwKl1vTxge1TkFNnD6_.nbGH5Gl9yawBir5Y0aygXDboiI-cbrz_0 2024-09-12T01:02:39.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14643711183636555502', time=2024-09-12T02:55:30.289141+0000, chain.objs.size()=1 2024-09-12T01:02:39.313 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.580__shadow:kWg-hmk70TbJD44PluHyH1SxVs0PnuO_.CNAJCxvAts5TEli1dvPXCAtS9wGGi3e_0 2024-09-12T01:02:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8321146558456565251', time=2024-09-12T02:58:22.812499+0000, chain.objs.size()=1 2024-09-12T01:02:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.632__shadow_.MODNBXzUmThTpxPDtm58NtGfEuuoL8l_0 2024-09-12T01:02:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14350143471465044885', time=2024-09-12T02:58:50.060866+0000, chain.objs.size()=1 2024-09-12T01:02:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.665__shadow_.gMtdYJnp0VY1HnsxuFGSK_PnAsejpAZ_0 2024-09-12T01:02:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7032429816384481422', time=2024-09-12T02:59:21.714702+0000, chain.objs.size()=1 2024-09-12T01:02:39.315 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.318+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.713__shadow:y6IR4U1PJSOh493FwVHoDO9CFMZMGs8_.-KGQYjf74axdt2HJUjmYrvA7wZc_k9S_0 2024-09-12T01:02:39.319 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.322+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:39.322 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:02:39.323 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.324 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.326+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51265' 2024-09-12T01:02:39.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='_P5-KtiA2CkVDdEfmyqEZcb6-4iv9VDO', time=2024-09-12T02:46:05.345750+0000, chain.objs.size()=2 2024-09-12T01:02:39.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.160__shadow_.vaK9NkvWU-k58uWsk9CHVIJANeNfMwM_0 2024-09-12T01:02:39.325 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.160__shadow_.vaK9NkvWU-k58uWsk9CHVIJANeNfMwM_1 2024-09-12T01:02:39.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='_gyXJFcphkeiXhhL-9NJ3h9U0l1xJuFq', time=2024-09-12T02:46:07.178227+0000, chain.objs.size()=2 2024-09-12T01:02:39.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__shadow_.EINjwU2TLQITQQ7Wj8gPpE_ixS8aFP6_0 2024-09-12T01:02:39.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__shadow_.EINjwU2TLQITQQ7Wj8gPpE_ixS8aFP6_1 2024-09-12T01:02:39.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='_3mS2EnVPWSeJuwmauQEodkWqKPQUaVa', time=2024-09-12T02:46:08.066676+0000, chain.objs.size()=2 2024-09-12T01:02:39.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__shadow_.WiAzTba74281i-BmCaeib5bCj7xLjBR_0 2024-09-12T01:02:39.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__shadow_.WiAzTba74281i-BmCaeib5bCj7xLjBR_1 2024-09-12T01:02:39.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='_1nePPe9VC1Bnt0rR3nDXYROdIJlYwKO', time=2024-09-12T02:46:08.254876+0000, chain.objs.size()=2 2024-09-12T01:02:39.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__shadow_.0lMmwQVwIO8nsO1d3vuMr4rndm7O0-o_0 2024-09-12T01:02:39.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__shadow_.0lMmwQVwIO8nsO1d3vuMr4rndm7O0-o_1 2024-09-12T01:02:39.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='_K5NKJtMChX8VkQKBcIRQTKGuKhomMGl', time=2024-09-12T02:46:08.282312+0000, chain.objs.size()=2 2024-09-12T01:02:39.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__shadow_.pIDd0z1QBzsjlgVq8lLkCCVsSckMGH6_0 2024-09-12T01:02:39.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.161__shadow_.pIDd0z1QBzsjlgVq8lLkCCVsSckMGH6_1 2024-09-12T01:02:39.326 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1191517495692659195', time=2024-09-12T02:48:21.963518+0000, chain.objs.size()=1 2024-09-12T01:02:39.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.234__shadow_.SG93dBZ0fWthQ0rJSBTH9SfHQHIY3CM_0 2024-09-12T01:02:39.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16262604140382206089', time=2024-09-12T02:48:34.262277+0000, chain.objs.size()=1 2024-09-12T01:02:39.327 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.330+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.248__shadow_.2S9o0f5BP0x3mq_LnP62oMNpQ6f4Ecv_0 2024-09-12T01:02:39.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9220740139757062156', time=2024-09-12T02:49:05.500393+0000, chain.objs.size()=1 2024-09-12T01:02:39.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.lFNwZXGyemk-QIcGWkeF_2wX-CSuwEJ_0 2024-09-12T01:02:39.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11190460470108755562', time=2024-09-12T02:49:05.563689+0000, chain.objs.size()=1 2024-09-12T01:02:39.329 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.HhnMVUGrw-S1BPp6nRTBqgYbEN-6HaB_0 2024-09-12T01:02:39.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10622131821786550049', time=2024-09-12T02:49:05.580687+0000, chain.objs.size()=1 2024-09-12T01:02:39.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ojUdKtaOCPvfMpubOHEn3se5n66T_i-_0 2024-09-12T01:02:39.330 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5719220245376796384', time=2024-09-12T02:49:05.583144+0000, chain.objs.size()=1 2024-09-12T01:02:39.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.aFR5mjndlZMrKOWSWXNHDH-89Gy4UMp_0 2024-09-12T01:02:39.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9644202635939422865', time=2024-09-12T02:49:05.699824+0000, chain.objs.size()=1 2024-09-12T01:02:39.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.lkvFfewVFg7cDl_bro1VwPkEh8PN5m3_0 2024-09-12T01:02:39.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12564202209771486677', time=2024-09-12T02:49:05.817072+0000, chain.objs.size()=1 2024-09-12T01:02:39.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.TZWNTNxyU4FblZ6es4DLkUZrwdtqM6F_0 2024-09-12T01:02:39.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17879470891795308574', time=2024-09-12T02:49:05.829732+0000, chain.objs.size()=1 2024-09-12T01:02:39.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.plq11hIWlcJBpqkaIElSSVT4YC8Ips8_0 2024-09-12T01:02:39.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17212398654355292630', time=2024-09-12T02:49:05.837085+0000, chain.objs.size()=1 2024-09-12T01:02:39.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.YEgyMXo2uOxVxqDdh985L7hoRCa4In0_0 2024-09-12T01:02:39.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1188352853124898603', time=2024-09-12T02:49:06.080434+0000, chain.objs.size()=1 2024-09-12T01:02:39.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_._0XFQenSnHqJ510B81pVD2Uhhs0rlHz_0 2024-09-12T01:02:39.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14642435010017271692', time=2024-09-12T02:49:06.103878+0000, chain.objs.size()=1 2024-09-12T01:02:39.331 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ux_P1XHvu_kR5SQtLIdQk2XkMc-eag3_0 2024-09-12T01:02:39.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.336424605614507079', time=2024-09-12T02:49:06.531309+0000, chain.objs.size()=1 2024-09-12T01:02:39.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.334+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.0jgDvi3GK8ZoHP8LC5BCFjwmbLpN4rv_0 2024-09-12T01:02:39.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.338+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5168927927222819276', time=2024-09-12T02:49:06.586053+0000, chain.objs.size()=1 2024-09-12T01:02:39.332 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ExtrcBm-VA1ZevemZqF6P4ZEbjDrSTo_0 2024-09-12T01:02:39.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.338+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11566355994464276454', time=2024-09-12T02:49:06.600713+0000, chain.objs.size()=1 2024-09-12T01:02:39.333 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.338+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.50M7St9_CXi-JRjLAMYUuwcyI8JdJRH_0 2024-09-12T01:02:39.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4440464138691409396', time=2024-09-12T02:49:06.609207+0000, chain.objs.size()=1 2024-09-12T01:02:39.336 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ywcQI0lPLGLd6MzaJFpl0fyiXlYNlxQ_0 2024-09-12T01:02:39.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9433681583811108802', time=2024-09-12T02:49:06.625560+0000, chain.objs.size()=1 2024-09-12T01:02:39.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.uJpr64eXRDnJFtFIjlTt0KqsDWAfHRq_0 2024-09-12T01:02:39.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7429590427102015626', time=2024-09-12T02:49:06.780853+0000, chain.objs.size()=1 2024-09-12T01:02:39.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.oGK7crbk46ayEkyUGNw2on6h6HL2q8e_0 2024-09-12T01:02:39.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16394209956116570225', time=2024-09-12T02:49:06.789056+0000, chain.objs.size()=1 2024-09-12T01:02:39.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.USYujSyl_UBJ3iA5E4GseAsBtAFwgW0_0 2024-09-12T01:02:39.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11744568890125447595', time=2024-09-12T02:49:06.842496+0000, chain.objs.size()=1 2024-09-12T01:02:39.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.8tlykoQrOl4ZLI-1sKiZLNiBtlQUu6u_0 2024-09-12T01:02:39.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.408098751803046587', time=2024-09-12T02:49:07.090638+0000, chain.objs.size()=1 2024-09-12T01:02:39.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ATs-XvO57j3NQ1IX-B9v_ekE2MtoB6N_0 2024-09-12T01:02:39.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14182309207121311089', time=2024-09-12T02:49:07.096883+0000, chain.objs.size()=1 2024-09-12T01:02:39.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Nwt9FSdd6Xorkle5S_Ensdei0dfGgZ__0 2024-09-12T01:02:39.337 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16514719117314501495', time=2024-09-12T02:49:07.118500+0000, chain.objs.size()=1 2024-09-12T01:02:39.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9FUdK0obTym8yUg1ejDHNrv86o2_3fK_0 2024-09-12T01:02:39.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5743140580756583717', time=2024-09-12T02:49:07.198732+0000, chain.objs.size()=1 2024-09-12T01:02:39.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.kz5wseV_XjyhbH_4pkZi0PYHFqyU68E_0 2024-09-12T01:02:39.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4620993064198781873', time=2024-09-12T02:49:07.321834+0000, chain.objs.size()=1 2024-09-12T01:02:39.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.6Kwa8HbsoxuazEAsw6_0D88omabi8H5_0 2024-09-12T01:02:39.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5319356599461408003', time=2024-09-12T02:49:08.095435+0000, chain.objs.size()=1 2024-09-12T01:02:39.338 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.342+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.263__shadow_.Ss2LQTFotDLoxJKeImYVrb7N6y6Jlsm_0 2024-09-12T01:02:39.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14645388394375452056', time=2024-09-12T02:49:14.702543+0000, chain.objs.size()=1 2024-09-12T01:02:39.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.272__shadow_.-TNepylwSA86eQeo2jCM47823pp86Vt_0 2024-09-12T01:02:39.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9706584951397361939', time=2024-09-12T02:49:38.455347+0000, chain.objs.size()=1 2024-09-12T01:02:39.341 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.301__shadow_.agAikOXuzt6HNIDVuDOLr1YIPP4kbP0_0 2024-09-12T01:02:39.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12273442700190014553', time=2024-09-12T02:50:15.788999+0000, chain.objs.size()=1 2024-09-12T01:02:39.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.PgEPO63bhC6QFRnk8edTeWcjbU4kF9e_0 2024-09-12T01:02:39.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18417396023277259037', time=2024-09-12T02:50:15.903480+0000, chain.objs.size()=1 2024-09-12T01:02:39.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.UlNzujDS8SVMqx54zuUKzktfwhUayeq_0 2024-09-12T01:02:39.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.595282139112017154', time=2024-09-12T02:50:15.905069+0000, chain.objs.size()=1 2024-09-12T01:02:39.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.sO3qjxOvmdTCOi9kI-9BifxmM1HI6lJ_0 2024-09-12T01:02:39.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17734625020649725095', time=2024-09-12T02:50:15.937063+0000, chain.objs.size()=1 2024-09-12T01:02:39.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.UKaU8PLV3BLu-JCH4MiYHhNJgph9W5D_0 2024-09-12T01:02:39.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9642168512772721358', time=2024-09-12T02:50:15.963334+0000, chain.objs.size()=1 2024-09-12T01:02:39.345 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.9hhtrau_yrwL6W8WLXjnSkO2LGuSuP6_0 2024-09-12T01:02:39.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1990201362150782352', time=2024-09-12T02:50:16.091561+0000, chain.objs.size()=1 2024-09-12T01:02:39.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Eq_l7WANaZucacOMefG4u58NHGnV9Ee_0 2024-09-12T01:02:39.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4158297416230562605', time=2024-09-12T02:50:16.114075+0000, chain.objs.size()=1 2024-09-12T01:02:39.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_._qZfr31bscInqNPjXMnNDJoOzTYNHb6_0 2024-09-12T01:02:39.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17392069554646603544', time=2024-09-12T02:50:16.116676+0000, chain.objs.size()=1 2024-09-12T01:02:39.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.GV-VXMFrcoPIZddgi_fJUzIQ05FHUEV_0 2024-09-12T01:02:39.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2712748754721283898', time=2024-09-12T02:50:16.151142+0000, chain.objs.size()=1 2024-09-12T01:02:39.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.346+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.XkN3b4y-GWbDsv5tPIi3wQ_vXLmptqL_0 2024-09-12T01:02:39.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.350+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4367267444746615200', time=2024-09-12T02:50:16.373996+0000, chain.objs.size()=1 2024-09-12T01:02:39.346 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.350+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.QQ0Ocz8slY5_OIdBOp2KgB6MOLBz8d5_0 2024-09-12T01:02:39.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.350+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10073819866272950852', time=2024-09-12T02:50:16.405845+0000, chain.objs.size()=1 2024-09-12T01:02:39.347 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.350+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.BHiOkW-iF6qu-dMzvflBqZxs3QgO6yC_0 2024-09-12T01:02:39.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13896372824642545951', time=2024-09-12T02:50:16.485573+0000, chain.objs.size()=1 2024-09-12T01:02:39.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-ZHTOSfk9sn-sfxWO9ROuq-xItagiGX_0 2024-09-12T01:02:39.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16061503318036594136', time=2024-09-12T02:50:16.683732+0000, chain.objs.size()=1 2024-09-12T01:02:39.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.LnXUSNCZage3mBvcoPlp9sJxaU6bsmO_0 2024-09-12T01:02:39.348 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4824317412808565380', time=2024-09-12T02:50:16.717188+0000, chain.objs.size()=1 2024-09-12T01:02:39.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.X3Dk_IJO2BxYGA9oCla2_5bKT2i2MrA_0 2024-09-12T01:02:39.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4747839320991381888', time=2024-09-12T02:50:16.718436+0000, chain.objs.size()=1 2024-09-12T01:02:39.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.czSdMMUehjcvOcXNNXoQobyovaNhRTN_0 2024-09-12T01:02:39.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15938438478826892643', time=2024-09-12T02:50:16.773186+0000, chain.objs.size()=1 2024-09-12T01:02:39.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_._aeb7EOwmFza0N21X5njQ8RyywT5xyW_0 2024-09-12T01:02:39.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3893359407000049538', time=2024-09-12T02:50:16.888972+0000, chain.objs.size()=1 2024-09-12T01:02:39.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.t4DYjjALuJje_PhxUSfIGV-YDRCq8U-_0 2024-09-12T01:02:39.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8286066253784489253', time=2024-09-12T02:50:16.894010+0000, chain.objs.size()=1 2024-09-12T01:02:39.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.GzXlsJbSLFAMc8EzrCob-fUSZa7w9cD_0 2024-09-12T01:02:39.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12299530421877131114', time=2024-09-12T02:50:16.947246+0000, chain.objs.size()=1 2024-09-12T01:02:39.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.LegzOrl-roB8F1S4Y_e7WG3Q77J_9Y7_0 2024-09-12T01:02:39.349 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3637746190484590002', time=2024-09-12T02:50:17.001416+0000, chain.objs.size()=1 2024-09-12T01:02:39.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.UqiBmCnb-L7bX3eyKsA_JlsxGMphpJE_0 2024-09-12T01:02:39.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7620338931453240843', time=2024-09-12T02:50:17.010795+0000, chain.objs.size()=1 2024-09-12T01:02:39.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.mDEop0v3DXdmeG1fXODlkTSaLltxYGh_0 2024-09-12T01:02:39.350 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.574039324477201905', time=2024-09-12T02:50:17.018949+0000, chain.objs.size()=1 2024-09-12T01:02:39.351 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.354+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-Ntz5oBzdyv5eeGpW2AZvT_CjqH4pOo_0 2024-09-12T01:02:39.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5909678366864250588', time=2024-09-12T02:50:17.136086+0000, chain.objs.size()=1 2024-09-12T01:02:39.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.dh58-vrH7sEFZkGwOaZITeWBPtxKp4o_0 2024-09-12T01:02:39.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18127277357896002067', time=2024-09-12T02:50:17.180242+0000, chain.objs.size()=1 2024-09-12T01:02:39.353 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.b3vLgs1Em8EqRHRKqXoHhQ7wc6NXDNO_0 2024-09-12T01:02:39.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.733747837951361967', time=2024-09-12T02:50:17.253943+0000, chain.objs.size()=1 2024-09-12T01:02:39.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.KwhE5ha67zQXMGvsyHZrAMmw5Fy4-fE_0 2024-09-12T01:02:39.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16976524604869880508', time=2024-09-12T02:50:17.259691+0000, chain.objs.size()=1 2024-09-12T01:02:39.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.9RlwgbGf9uFWBpG3fPNeJPlSJeb2mcr_0 2024-09-12T01:02:39.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13270624274844473123', time=2024-09-12T02:50:17.479411+0000, chain.objs.size()=1 2024-09-12T01:02:39.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.F3B8Kbz_K6f_rO7EZb4NHxNOhwRu_Tt_0 2024-09-12T01:02:39.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.745557930793340005', time=2024-09-12T02:50:17.481416+0000, chain.objs.size()=1 2024-09-12T01:02:39.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.KCcSc9-IndjeyH6BYWFeg9a_AMJBIMh_0 2024-09-12T01:02:39.355 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.839160266386320130', time=2024-09-12T02:50:17.535115+0000, chain.objs.size()=1 2024-09-12T01:02:39.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6FDt8ROUlss62o9FFGlkUANpzxDixvI_0 2024-09-12T01:02:39.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8839104988792954785', time=2024-09-12T02:50:17.644708+0000, chain.objs.size()=1 2024-09-12T01:02:39.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.gn9NNOAEATUnenaPEmh6nF1pu8CwoDu_0 2024-09-12T01:02:39.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5244956772682720627', time=2024-09-12T02:50:17.674629+0000, chain.objs.size()=1 2024-09-12T01:02:39.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.kIN-934A-3AUKLmtjEr1n7F4OtyB36u_0 2024-09-12T01:02:39.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17073483464343614034', time=2024-09-12T02:50:17.701826+0000, chain.objs.size()=1 2024-09-12T01:02:39.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.uOz1LvXbZLSWZfqAvyC4mGHbwlw6PQu_0 2024-09-12T01:02:39.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.496667279761378161', time=2024-09-12T02:50:17.766283+0000, chain.objs.size()=1 2024-09-12T01:02:39.356 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.DJ6TDjdeE1UCgyx3nn7NcThRuvkljH4_0 2024-09-12T01:02:39.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9707860667599032454', time=2024-09-12T02:50:39.513160+0000, chain.objs.size()=1 2024-09-12T01:02:39.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.358+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.pe9TlVbRg50CUG4Q5i1ifJ7dJtTue-b_0 2024-09-12T01:02:39.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.97302545446248452', time=2024-09-12T02:50:39.559737+0000, chain.objs.size()=1 2024-09-12T01:02:39.357 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.iKGgbUczmFxIdvL3jV9v8oIpscSPiNF_0 2024-09-12T01:02:39.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15030216277213228453', time=2024-09-12T02:50:39.577385+0000, chain.objs.size()=1 2024-09-12T01:02:39.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.bcazgVePepxFmZKkfGQC61Kp1sih02X_0 2024-09-12T01:02:39.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8904278578094861353', time=2024-09-12T02:50:39.586743+0000, chain.objs.size()=1 2024-09-12T01:02:39.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.6bjF3xkqTzIExVBwMpy93gzEVHbxtQ__0 2024-09-12T01:02:39.359 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9071451835356609972', time=2024-09-12T02:50:39.805186+0000, chain.objs.size()=1 2024-09-12T01:02:39.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.AHjgg6ajzioicDLix5FzsOZgOWgSpUU_0 2024-09-12T01:02:39.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11821394374500944697', time=2024-09-12T02:50:39.847330+0000, chain.objs.size()=1 2024-09-12T01:02:39.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.vfDlFjr6jzHe61paVulk7eJqo5o5VXp_0 2024-09-12T01:02:39.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14394881049167359198', time=2024-09-12T02:50:40.261853+0000, chain.objs.size()=1 2024-09-12T01:02:39.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.OjITQt70wscpn19fTvZdhFEgYrucdgs_0 2024-09-12T01:02:39.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11907049414364511741', time=2024-09-12T02:50:40.308023+0000, chain.objs.size()=1 2024-09-12T01:02:39.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.3ye3UK4COhAgyFUV90mbNewZuuYDGOZ_0 2024-09-12T01:02:39.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3473151490704421062', time=2024-09-12T02:50:40.594005+0000, chain.objs.size()=1 2024-09-12T01:02:39.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.rJF49H3wth73kjgipuogNPDwwZbZ16K_0 2024-09-12T01:02:39.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15220979573547573934', time=2024-09-12T02:50:40.736181+0000, chain.objs.size()=1 2024-09-12T01:02:39.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.DzaUi6FiP4scRCWzZQ8EakxbVIo-IBV_0 2024-09-12T01:02:39.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8738747331892067359', time=2024-09-12T02:50:40.820500+0000, chain.objs.size()=1 2024-09-12T01:02:39.360 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.z8iJ1JxKNtQ_87L5K6al1-3dz_h2sbo_0 2024-09-12T01:02:39.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14786841659337670828', time=2024-09-12T02:50:40.822100+0000, chain.objs.size()=1 2024-09-12T01:02:39.361 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.362+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.D-LNoiBBaGithZ3SDexnDm9-raeMl0N_0 2024-09-12T01:02:39.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.366+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12055781466755092894', time=2024-09-12T02:50:40.895150+0000, chain.objs.size()=1 2024-09-12T01:02:39.363 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.366+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.dchUYfP4xzbOXUaI2W7wZ_IeW1VC9JO_0 2024-09-12T01:02:39.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2817202298433921707', time=2024-09-12T02:50:41.036687+0000, chain.objs.size()=1 2024-09-12T01:02:39.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.RxWJc2OWXjEduGx1qxnbYvSpNRKWjxK_0 2024-09-12T01:02:39.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8610224749130774232', time=2024-09-12T02:50:41.081343+0000, chain.objs.size()=1 2024-09-12T01:02:39.365 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.tThYG1c8-GP5pHAFke0tzbbT9nGfeuh_0 2024-09-12T01:02:39.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4821204595869253843', time=2024-09-12T02:50:41.126228+0000, chain.objs.size()=1 2024-09-12T01:02:39.366 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.-doOWMLr9MCW6SICBbbCjHEcveFSbcz_0 2024-09-12T01:02:39.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14198021213796605479', time=2024-09-12T02:50:41.142229+0000, chain.objs.size()=1 2024-09-12T01:02:39.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_._XgYKZyMmzQ0qXQemE5N3URDMYGwZVA_0 2024-09-12T01:02:39.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3733256099190076797', time=2024-09-12T02:50:41.149359+0000, chain.objs.size()=1 2024-09-12T01:02:39.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.-Aag6Z0f1vQE-AsoeJmuroEHPo7md21_0 2024-09-12T01:02:39.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10056491813966662254', time=2024-09-12T02:50:41.167897+0000, chain.objs.size()=1 2024-09-12T01:02:39.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ixpFFn9Xh8PqZKJjNkk0NCwqva7rPK4_0 2024-09-12T01:02:39.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15470730066580980578', time=2024-09-12T02:50:41.296323+0000, chain.objs.size()=1 2024-09-12T01:02:39.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.aviTa04-aMEceDnj_nVG4vJ5xs2LWK__0 2024-09-12T01:02:39.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15198640232296386943', time=2024-09-12T02:50:41.425645+0000, chain.objs.size()=1 2024-09-12T01:02:39.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.lBQNOaNm0p7Zb90yTqTkdCIEfqNGW4s_0 2024-09-12T01:02:39.367 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10679602616875636204', time=2024-09-12T02:50:46.857271+0000, chain.objs.size()=1 2024-09-12T01:02:39.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.332__shadow_.ubrcsFtfrVNON0CoVYjDQnbQ-rbHJjG_0 2024-09-12T01:02:39.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10160101424361211087', time=2024-09-12T02:51:11.267204+0000, chain.objs.size()=1 2024-09-12T01:02:39.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.371__shadow_.GAOcnTrmKa1AEq0cWo_0OC_Oh5g-x0T_0 2024-09-12T01:02:39.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4255221681619481948', time=2024-09-12T02:51:57.618945+0000, chain.objs.size()=1 2024-09-12T01:02:39.368 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.370+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.431__shadow_.h5Ptya730F0rrb7W6APL7Z89TEPcpli_0 2024-09-12T01:02:39.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6602726531412800819', time=2024-09-12T02:51:59.548709+0000, chain.objs.size()=1 2024-09-12T01:02:39.369 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.434__shadow_.eNRNWSVkWZKYhrznf_PTQfYYpbKXpVE_0 2024-09-12T01:02:39.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14228680240240792081', time=2024-09-12T02:52:05.520607+0000, chain.objs.size()=1 2024-09-12T01:02:39.370 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.442__shadow_.2fbvzfZYG3TF9Cv2J4aqI9iT_Gikcj8_0 2024-09-12T01:02:39.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.374+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.365214265126746334', time=2024-09-12T02:53:27.820220+0000, chain.objs.size()=6 2024-09-12T01:02:39.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.374+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.NSK8iNxXnKNwVTsflz-DGK3RWIPzAzn8.1 2024-09-12T01:02:39.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.378+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.IJARdXRyVS7-Hsb_RNV1-3BsH9HEBkih.2 2024-09-12T01:02:39.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.378+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.-97z1sBdlcqL6g31pSme5iCbz5d52sC1.3 2024-09-12T01:02:39.372 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.378+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.G_IpdcGP7F5AMlWwETP8LKlvZ7dAfdN3.4 2024-09-12T01:02:39.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.378+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.0tpIF4sF4hlMZOgxRQ6JKMa6vxtL5Nxb.5 2024-09-12T01:02:39.373 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.378+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.VjTdeIFVvUR3TD82Uwv6uUpDv3D1fIbM.6 2024-09-12T01:02:39.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.378+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10860281586092142531', time=2024-09-12T02:54:48.997037+0000, chain.objs.size()=1 2024-09-12T01:02:39.374 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.378+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:QP1UXLC81cr1M4xFbs6YxhFtRjpUzh9_.RfiQjUNHh9B4XdO7CxUIQqPkNDPZ5WF_0 2024-09-12T01:02:39.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.378+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15374156874566134481', time=2024-09-12T02:55:03.586914+0000, chain.objs.size()=1 2024-09-12T01:02:39.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.378+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.576__shadow:7mAM3RpFsl2l0KnR5cvepD0nb2S4aB1_.G-nReGIJQ3HKG0MZesdjyNmiQBfAgSp_0 2024-09-12T01:02:39.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.378+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7504890460300645584', time=2024-09-12T02:55:18.181599+0000, chain.objs.size()=1 2024-09-12T01:02:39.375 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.378+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:Mucx-HnujIH2L9YLITmT54QQtTHH1.G_.WvFcP4IIcPyYvoYNcH7TNon9XdXj1pW_0 2024-09-12T01:02:39.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.382+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10788516609224442935', time=2024-09-12T02:55:28.593994+0000, chain.objs.size()=1 2024-09-12T01:02:39.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.382+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.579__shadow:wIAHZH7j.6H6T.wo89d8AdQY88GF-lw_.OqPO1dcPnccLBOAgl8PXjQYeit42u9h_0 2024-09-12T01:02:39.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.382+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10245436329889731256', time=2024-09-12T02:58:52.280336+0000, chain.objs.size()=1 2024-09-12T01:02:39.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.382+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.668__shadow_.Ws1u9bLn-1CjNO6DN1TrajsTVK8iAlJ_0 2024-09-12T01:02:39.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.382+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9181681573315547944', time=2024-09-12T02:58:52.455765+0000, chain.objs.size()=1 2024-09-12T01:02:39.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.382+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.668__shadow_.Ws1u9bLn-1CjNO6DN1TrajsTVK8iAlJ_0 2024-09-12T01:02:39.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.382+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16413900168726291051', time=2024-09-12T02:59:07.083616+0000, chain.objs.size()=1 2024-09-12T01:02:39.377 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.382+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.692__shadow:lbsqf9VKRMjLNOHLjo9bLRjupluWUxf_.mVVqyYDvvce0nNx5uINjYRCqmbTnbQO_0 2024-09-12T01:02:39.382 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.386+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/51265 2024-09-12T01:02:39.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:02:39.384 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17340942967673669664', time=2024-09-12T02:59:45.714392+0000, chain.objs.size()=1 2024-09-12T01:02:39.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.719__shadow_.hIxt17oJGm8dC6IUn6CJ802VuWCJZhE_0 2024-09-12T01:02:39.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2870040868473070311', time=2024-09-12T03:00:03.198107+0000, chain.objs.size()=1 2024-09-12T01:02:39.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.742__multipart_mymultipart3.2~UHCN8zjykHaTDE1E0co9fbTiXNHiCtj.1 2024-09-12T01:02:39.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.390+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13194229400817343834', time=2024-09-12T03:00:21.140464+0000, chain.objs.size()=1 2024-09-12T01:02:39.385 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.745__shadow_.I9n4WhTC51hf1ZXdm5EIGAj9KglhCF7_0 2024-09-12T01:02:39.387 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.390+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:39.389 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:02:39.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.390 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47709' 2024-09-12T01:02:39.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14933074016905807821', time=2024-09-12T02:46:26.607762+0000, chain.objs.size()=1 2024-09-12T01:02:39.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.177__shadow_.VuWNI0N1gIRtHyrTcQ6fdHtRyt70EI6_0 2024-09-12T01:02:39.391 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13448046514526310571', time=2024-09-12T02:46:29.960364+0000, chain.objs.size()=1 2024-09-12T01:02:39.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.182__shadow_.YwSp1sbyKaD1bFkSiQWInaSBI1xeV5l_0 2024-09-12T01:02:39.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6602429834897697986', time=2024-09-12T02:48:36.495523+0000, chain.objs.size()=1 2024-09-12T01:02:39.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.251__shadow_._KJfgfHQdU-HFZDvznh84IDGRXA8Pq0_0 2024-09-12T01:02:39.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15783294058803281448', time=2024-09-12T02:48:36.497617+0000, chain.objs.size()=1 2024-09-12T01:02:39.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.251__shadow_.E20pS59cup8eudCj-Mto6xOFO5128hE_0 2024-09-12T01:02:39.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15435296268301787191', time=2024-09-12T02:48:38.728590+0000, chain.objs.size()=1 2024-09-12T01:02:39.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.254__shadow_.nrcs9gtTQn_ORe8o8PegF7RC0m4b-7a_0 2024-09-12T01:02:39.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14806011620635114715', time=2024-09-12T02:49:05.436091+0000, chain.objs.size()=1 2024-09-12T01:02:39.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.tmMV9umLo-kG-Hcxr8uZmaZoFzypQao_0 2024-09-12T01:02:39.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14192448690640785095', time=2024-09-12T02:49:05.464399+0000, chain.objs.size()=1 2024-09-12T01:02:39.392 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Kd2KRMHThcRvgHvQxUhfrrlgAPDoJV5_0 2024-09-12T01:02:39.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3101415842231648594', time=2024-09-12T02:49:05.478284+0000, chain.objs.size()=1 2024-09-12T01:02:39.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.3e28o6odBoYTg6ZkeU1emlbVsdmvYcN_0 2024-09-12T01:02:39.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5572964443546213990', time=2024-09-12T02:49:05.538371+0000, chain.objs.size()=1 2024-09-12T01:02:39.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.V4LcNdwDoOA65PaVUX--kHZuQ8k-AmB_0 2024-09-12T01:02:39.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2776893538833604079', time=2024-09-12T02:49:05.546064+0000, chain.objs.size()=1 2024-09-12T01:02:39.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.hk30CJarLcmNeJsJEP_V4BJmARM7te8_0 2024-09-12T01:02:39.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14671415498567281786', time=2024-09-12T02:49:05.577478+0000, chain.objs.size()=1 2024-09-12T01:02:39.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.MNJ3s3pGWUjucQM0ePSTn3hGcYhCn71_0 2024-09-12T01:02:39.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6795793773608281798', time=2024-09-12T02:49:05.774352+0000, chain.objs.size()=1 2024-09-12T01:02:39.393 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.394+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.kFgPj_v9G2PX-Fl3EGPd_ts_lAYbp-y_0 2024-09-12T01:02:39.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.398+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9807483005312259091', time=2024-09-12T02:49:05.799698+0000, chain.objs.size()=1 2024-09-12T01:02:39.395 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.398+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.FeKTzfChyqT7iA2jFbHHOKlL9cak6p9_0 2024-09-12T01:02:39.397 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6595342059044644949', time=2024-09-12T02:49:05.853300+0000, chain.objs.size()=1 2024-09-12T01:02:39.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.vtg_3O2P0KUqESULtv3ADR_VCi4FZAN_0 2024-09-12T01:02:39.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13240880375653393353', time=2024-09-12T02:49:05.990067+0000, chain.objs.size()=1 2024-09-12T01:02:39.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.IN__WEOneVwmcWbh2dDwSN38d-Ur7si_0 2024-09-12T01:02:39.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9049301474145286981', time=2024-09-12T02:49:06.012386+0000, chain.objs.size()=1 2024-09-12T01:02:39.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Ns4Zt5igriFLC9--WeivMM_D1yeI0ub_0 2024-09-12T01:02:39.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5858297028355078677', time=2024-09-12T02:49:06.022847+0000, chain.objs.size()=1 2024-09-12T01:02:39.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.IXCsg2yUwOakmRHfJhv9f7svh9hAV06_0 2024-09-12T01:02:39.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17667105675800363572', time=2024-09-12T02:49:06.034645+0000, chain.objs.size()=1 2024-09-12T01:02:39.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.DGJGIkMMFvMhDyuiRSaQX5TFehT5UoX_0 2024-09-12T01:02:39.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7991816800414119744', time=2024-09-12T02:49:06.049911+0000, chain.objs.size()=1 2024-09-12T01:02:39.398 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Kr8afBe-_DmIHnc0UQh--MklmJZLbyq_0 2024-09-12T01:02:39.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2139808480173502816', time=2024-09-12T02:49:06.058152+0000, chain.objs.size()=1 2024-09-12T01:02:39.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.67y2lVkF45aqvXUP2cImrzb4KC6CzOB_0 2024-09-12T01:02:39.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6268540989228259555', time=2024-09-12T02:49:06.220111+0000, chain.objs.size()=1 2024-09-12T01:02:39.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.lhCfJtu83dZnPjb-y7eCdbaRmWNwJu__0 2024-09-12T01:02:39.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15135911705405400215', time=2024-09-12T02:49:06.301738+0000, chain.objs.size()=1 2024-09-12T01:02:39.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.09tJDipjIsdw9wsqvlAj_E-X1ArP0Tg_0 2024-09-12T01:02:39.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9565907320648791319', time=2024-09-12T02:49:06.306723+0000, chain.objs.size()=1 2024-09-12T01:02:39.399 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.402+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Y8g84YodVB0x7YkGzJMOHcZ7xZpBkrL_0 2024-09-12T01:02:39.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.406+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8829192489628878326', time=2024-09-12T02:49:06.345988+0000, chain.objs.size()=1 2024-09-12T01:02:39.401 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.406+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.lqH35RrxzLy9-xVhUNxWZ8EV8LmsPK5_0 2024-09-12T01:02:39.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5160966326992888762', time=2024-09-12T02:49:06.495866+0000, chain.objs.size()=1 2024-09-12T01:02:39.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.oTsSSriJE2rBB-pwozRyMuPksWtAU1p_0 2024-09-12T01:02:39.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15993919966936214142', time=2024-09-12T02:49:06.513076+0000, chain.objs.size()=1 2024-09-12T01:02:39.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.g_EPq_pgVsQPgryKGsvBpRcJy33-9q-_0 2024-09-12T01:02:39.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10064926411908885089', time=2024-09-12T02:49:06.523695+0000, chain.objs.size()=1 2024-09-12T01:02:39.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.SmBtTzVweaCYdr0ytWWv7K_ZDR2Kirf_0 2024-09-12T01:02:39.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14199713940226274958', time=2024-09-12T02:49:06.560871+0000, chain.objs.size()=1 2024-09-12T01:02:39.405 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.SiYPMuD1cWh1Oaz5hVVj_6MoQFGMGCP_0 2024-09-12T01:02:39.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1039803153587800298', time=2024-09-12T02:49:06.584716+0000, chain.objs.size()=1 2024-09-12T01:02:39.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.skhFpNSBDwseyXXRmdrZhQb5kh-DMIC_0 2024-09-12T01:02:39.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11645354100753207198', time=2024-09-12T02:49:06.588436+0000, chain.objs.size()=1 2024-09-12T01:02:39.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.FLJdm0j52PU21wLbfviO9SkyYpbYk6H_0 2024-09-12T01:02:39.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3364136993186913478', time=2024-09-12T02:49:06.596376+0000, chain.objs.size()=1 2024-09-12T01:02:39.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.GZuOsnUXRDrqH0zA8tf1l8MWHCv24ir_0 2024-09-12T01:02:39.406 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12632311668417862135', time=2024-09-12T02:49:06.806050+0000, chain.objs.size()=1 2024-09-12T01:02:39.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.jPb0A8oXfLmPx4DBHtpekF-OUtQld_W_0 2024-09-12T01:02:39.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1604414534460656111', time=2024-09-12T02:49:06.860098+0000, chain.objs.size()=1 2024-09-12T01:02:39.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.syzS7HVufZHAxx6ksyjb6H-VQipdXSH_0 2024-09-12T01:02:39.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12288215284939594128', time=2024-09-12T02:49:06.871474+0000, chain.objs.size()=1 2024-09-12T01:02:39.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.F4Vfc6C6HCWpdfsiydG2NbPn7DwEm23_0 2024-09-12T01:02:39.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5778865872157265512', time=2024-09-12T02:49:07.065019+0000, chain.objs.size()=1 2024-09-12T01:02:39.407 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.410+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Zpnb1uMuWFnXGjlN5YV46dyGt984apU_0 2024-09-12T01:02:39.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18044417169612157215', time=2024-09-12T02:49:07.138019+0000, chain.objs.size()=1 2024-09-12T01:02:39.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.98rfy-xiNMiGBp-K0oRC4ZvfJT77Vpl_0 2024-09-12T01:02:39.411 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4193665108003294487', time=2024-09-12T02:49:07.165001+0000, chain.objs.size()=1 2024-09-12T01:02:39.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.5bVFc5sYNEF-oZQIY-nnNUT38rwvLlx_0 2024-09-12T01:02:39.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9743250768538991391', time=2024-09-12T02:49:07.185691+0000, chain.objs.size()=1 2024-09-12T01:02:39.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.6x7JsJGoeOK3r4R7poJuRMYePzEgFjS_0 2024-09-12T01:02:39.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7528019353715933426', time=2024-09-12T02:49:07.223664+0000, chain.objs.size()=1 2024-09-12T01:02:39.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.gYnwjxZbwOXUJc-fNeU0sYoQyDkK-x1_0 2024-09-12T01:02:39.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3832694449801992659', time=2024-09-12T02:49:07.327987+0000, chain.objs.size()=1 2024-09-12T01:02:39.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.gVqNpo2DVQdtxeu1xxxPT01JR69Kno7_0 2024-09-12T01:02:39.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1162776502835685826', time=2024-09-12T02:49:07.348793+0000, chain.objs.size()=1 2024-09-12T01:02:39.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.rMLibdyelHFzTHnud4ACDy28ztNbojl_0 2024-09-12T01:02:39.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14093873104778430566', time=2024-09-12T02:49:07.385977+0000, chain.objs.size()=1 2024-09-12T01:02:39.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.gJt6p9jz5cR9B5ODYYCyBTmG9TD3GZz_0 2024-09-12T01:02:39.412 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1805743859444469076', time=2024-09-12T02:49:07.413597+0000, chain.objs.size()=1 2024-09-12T01:02:39.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.YqXN5C53CqnoPwkKt9oezKhpBBeWazc_0 2024-09-12T01:02:39.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6034901716761892254', time=2024-09-12T02:49:12.608365+0000, chain.objs.size()=1 2024-09-12T01:02:39.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.269__shadow_.jyLTdw3rBVpF1hqfLEFO8csnKYMLi5q_0 2024-09-12T01:02:39.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16419359151385660872', time=2024-09-12T02:49:13.295803+0000, chain.objs.size()=1 2024-09-12T01:02:39.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.270__shadow_.ZezQcC1J67AnPxlp2j9ECleEdTtf6os_0 2024-09-12T01:02:39.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1605614972181447164', time=2024-09-12T02:49:23.131836+0000, chain.objs.size()=1 2024-09-12T01:02:39.413 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.414+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.283__shadow_.Axp4QDZWiD6wmuzY-qOZXZ3ixoacKhE_0 2024-09-12T01:02:39.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11743419979530525824', time=2024-09-12T02:49:26.164713+0000, chain.objs.size()=1 2024-09-12T01:02:39.415 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.287__shadow_.vauHzv6gqEzqr1_SuwVqImFDLubSXaw_0 2024-09-12T01:02:39.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14652733103625203372', time=2024-09-12T02:49:26.923518+0000, chain.objs.size()=1 2024-09-12T01:02:39.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.288__shadow_.NRl1WWd2epWiEBX9jMZYHW3th1U2RGp_0 2024-09-12T01:02:39.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.418+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18441672379872163328', time=2024-09-12T02:49:30.927269+0000, chain.objs.size()=1 2024-09-12T01:02:39.416 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.418+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.s_mLyP9SKS3szzsO135LxrwSdvGd49S_0 2024-09-12T01:02:39.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2961329837120427627', time=2024-09-12T02:49:30.951917+0000, chain.objs.size()=1 2024-09-12T01:02:39.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.sWq93GiUI4KxzoPkNZktdM60QR-YqOy_0 2024-09-12T01:02:39.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4071595699678639308', time=2024-09-12T02:49:30.971745+0000, chain.objs.size()=1 2024-09-12T01:02:39.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.H-mltsHe3t4PcBthFJZ8AsvkpPtdjIe_0 2024-09-12T01:02:39.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5182448353850697746', time=2024-09-12T02:49:32.466255+0000, chain.objs.size()=1 2024-09-12T01:02:39.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.Q-jQDNkg-JRmloedsLX0a9BBlYPTCno_0 2024-09-12T01:02:39.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.873683137923292753', time=2024-09-12T02:49:34.637104+0000, chain.objs.size()=1 2024-09-12T01:02:39.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.296__shadow_.Os_DTRfW23_qfskcwnyqOB9Zl7PpGD-_0 2024-09-12T01:02:39.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12994207396799368185', time=2024-09-12T02:49:38.451840+0000, chain.objs.size()=1 2024-09-12T01:02:39.417 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.301__shadow_.S_tyyswusRMqv44qZLQu_-ti5mgv41V_0 2024-09-12T01:02:39.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13038631503860541282', time=2024-09-12T02:49:53.186842+0000, chain.objs.size()=1 2024-09-12T01:02:39.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.321__shadow_.rmcWZFrnIaHEWBXrWONyOJ8gz5mgsuM_0 2024-09-12T01:02:39.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7080312951818013710', time=2024-09-12T02:50:15.853355+0000, chain.objs.size()=1 2024-09-12T01:02:39.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Iyx-WMXOUkDOq37wWyxiZL2FU28YMbs_0 2024-09-12T01:02:39.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.422+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15460313110970458995', time=2024-09-12T02:50:15.881201+0000, chain.objs.size()=1 2024-09-12T01:02:39.418 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.422+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.B_rSPLOyLW8lV70MN8j2zUoJ_R98grz_0 2024-09-12T01:02:39.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14864606222038827071', time=2024-09-12T02:50:15.882530+0000, chain.objs.size()=1 2024-09-12T01:02:39.420 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ZrZiY2nd1DkAytb3YAIZKOfF9PkcQRv_0 2024-09-12T01:02:39.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2587230531536407190', time=2024-09-12T02:50:15.939508+0000, chain.objs.size()=1 2024-09-12T01:02:39.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.T0fo30RYBERyHIny_a7Z8FI9Lc02RZd_0 2024-09-12T01:02:39.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4471717112220918538', time=2024-09-12T02:50:15.964356+0000, chain.objs.size()=1 2024-09-12T01:02:39.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.rpmEa0hYl8b-QRIGIsSKvqsXqA5VrBg_0 2024-09-12T01:02:39.421 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14629271008334612150', time=2024-09-12T02:50:16.084267+0000, chain.objs.size()=1 2024-09-12T01:02:39.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.PxqXcJ53_MUUKWZjJ6LvmCnmjJ8UBTU_0 2024-09-12T01:02:39.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4603656911520767752', time=2024-09-12T02:50:16.091242+0000, chain.objs.size()=1 2024-09-12T01:02:39.422 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.WOMbXjIb9nQtT3PN-egU73ilhHEAdie_0 2024-09-12T01:02:39.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9959011934375489615', time=2024-09-12T02:50:16.175753+0000, chain.objs.size()=1 2024-09-12T01:02:39.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.0JzgCeY5-wYkWKvN44cToI0SdTwURE1_0 2024-09-12T01:02:39.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18364184576291921072', time=2024-09-12T02:50:16.356545+0000, chain.objs.size()=1 2024-09-12T01:02:39.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ONr1qwtHtsaOzLlAagpMsFR3Oz8Dtwr_0 2024-09-12T01:02:39.424 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4033023000919649052', time=2024-09-12T02:50:16.358302+0000, chain.objs.size()=1 2024-09-12T01:02:39.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.SRL1Wvdhw5Ae5PZYXou1WJBumTnXHer_0 2024-09-12T01:02:39.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1552825803242719372', time=2024-09-12T02:50:16.468493+0000, chain.objs.size()=1 2024-09-12T01:02:39.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xiRPDhkJMHQEQTSCtWYhRvaTc1WWvaK_0 2024-09-12T01:02:39.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5205739909687798073', time=2024-09-12T02:50:16.641092+0000, chain.objs.size()=1 2024-09-12T01:02:39.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ayDyqJR7y39c_h_4DXScNc2xNWycnOu_0 2024-09-12T01:02:39.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5345886959646912824', time=2024-09-12T02:50:16.645425+0000, chain.objs.size()=1 2024-09-12T01:02:39.425 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.426+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.eYSQJBs6YR2YuBVVxZEq2JVvKqFNAFW_0 2024-09-12T01:02:39.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2915525454208011092', time=2024-09-12T02:50:16.774953+0000, chain.objs.size()=1 2024-09-12T01:02:39.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.474eEGkGSQlSClYlJ618saIO0HIYwEA_0 2024-09-12T01:02:39.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10968512132126747494', time=2024-09-12T02:50:16.887674+0000, chain.objs.size()=1 2024-09-12T01:02:39.426 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.bP8hNykWO1Up0I4mu_sCOy29J91DRH__0 2024-09-12T01:02:39.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5968349363449077966', time=2024-09-12T02:50:16.975843+0000, chain.objs.size()=1 2024-09-12T01:02:39.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.j3eEiMGlskIZBfodt2f63AwjCRTnagy_0 2024-09-12T01:02:39.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.826964798145516271', time=2024-09-12T02:50:16.983017+0000, chain.objs.size()=1 2024-09-12T01:02:39.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.McXLv7Tt2V8WWDKFc0QVwrefUlyoDJR_0 2024-09-12T01:02:39.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12875084296818900735', time=2024-09-12T02:50:17.019854+0000, chain.objs.size()=1 2024-09-12T01:02:39.427 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.nxNSEN2djlyCYollf0ATmqFezYl-6C8_0 2024-09-12T01:02:39.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9176435626996116629', time=2024-09-12T02:50:17.038117+0000, chain.objs.size()=1 2024-09-12T01:02:39.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.VLy-pw55dnLC9RHnZGYBBD220ypZcDr_0 2024-09-12T01:02:39.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.430+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17297470037955707910', time=2024-09-12T02:50:17.187609+0000, chain.objs.size()=1 2024-09-12T01:02:39.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.430+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.zLrgA3_0e4n-SrJtPCUZX81NP4Tg183_0 2024-09-12T01:02:39.428 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6791593511832014256', time=2024-09-12T02:50:17.240796+0000, chain.objs.size()=1 2024-09-12T01:02:39.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.SjMLBfb65HS33p69VEBwNyDhIJ1lEV2_0 2024-09-12T01:02:39.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16695261355177165312', time=2024-09-12T02:50:17.478446+0000, chain.objs.size()=1 2024-09-12T01:02:39.429 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.DRhuY5LdyiJSTKf_PlJNL9qevx0Tm4m_0 2024-09-12T01:02:39.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18048658871704683104', time=2024-09-12T02:50:17.533555+0000, chain.objs.size()=1 2024-09-12T01:02:39.430 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.tD6fHmrM-tQe9LVty-LiBw-Oq4zoypm_0 2024-09-12T01:02:39.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4372257147016960037', time=2024-09-12T02:50:17.537926+0000, chain.objs.size()=1 2024-09-12T01:02:39.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.bg1djIjm5QbuAShnG8qPqm2bTDp00Sf_0 2024-09-12T01:02:39.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17251710917910339256', time=2024-09-12T02:50:17.656602+0000, chain.objs.size()=1 2024-09-12T01:02:39.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.t74Q4lBnO3ub4-lGNaezukBACf0jvCX_0 2024-09-12T01:02:39.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2637911232990251068', time=2024-09-12T02:50:17.717831+0000, chain.objs.size()=1 2024-09-12T01:02:39.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.V7slQx0aHiziIb6ytBCpMH1xCwowFy__0 2024-09-12T01:02:39.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7757629490127130943', time=2024-09-12T02:50:17.762871+0000, chain.objs.size()=1 2024-09-12T01:02:39.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.aP9XaPMhvrFAdnvXIZbtSWi7q3_Kt6-_0 2024-09-12T01:02:39.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2600751282436854063', time=2024-09-12T02:50:39.476544+0000, chain.objs.size()=1 2024-09-12T01:02:39.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.LN3c3Wkziw7LeZcPJpUEhMitIXqWgKQ_0 2024-09-12T01:02:39.432 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6303475998314686479', time=2024-09-12T02:50:39.530633+0000, chain.objs.size()=1 2024-09-12T01:02:39.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.434+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.n6murIwd1mq0d0d59YkyTwbm23eFAIL_0 2024-09-12T01:02:39.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.438+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16175538935756073947', time=2024-09-12T02:50:39.558192+0000, chain.objs.size()=1 2024-09-12T01:02:39.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.438+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.kOQxyRGMnikVOdhUUVKWjUrNJ2LyeHZ_0 2024-09-12T01:02:39.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.438+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13841069682150845196', time=2024-09-12T02:50:39.564698+0000, chain.objs.size()=1 2024-09-12T01:02:39.433 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.438+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.-lzr5QABxXGme4WTiwXVjs4i4Q4-_qP_0 2024-09-12T01:02:39.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.438+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18427470946490597698', time=2024-09-12T02:50:39.615359+0000, chain.objs.size()=1 2024-09-12T01:02:39.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.438+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.gfYrFtwz3EX_g46_kuOQ2HrQNm8VKeK_0 2024-09-12T01:02:39.434 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.438+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7678417177110498002', time=2024-09-12T02:50:39.746631+0000, chain.objs.size()=1 2024-09-12T01:02:39.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.438+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.bWpW2Li4clLrLBb2gsE9Ir8I-WCtE3n_0 2024-09-12T01:02:39.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.438+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9381578603544661259', time=2024-09-12T02:50:39.800165+0000, chain.objs.size()=1 2024-09-12T01:02:39.435 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.438+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.4vndAhnP-0gWWTDhGMu3Dy51M7pGBAT_0 2024-09-12T01:02:39.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6177802008331951869', time=2024-09-12T02:50:39.811581+0000, chain.objs.size()=1 2024-09-12T01:02:39.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.nSCUcZACfMGgQn0WrGOvmJFDLtzgznv_0 2024-09-12T01:02:39.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12883591173183886997', time=2024-09-12T02:50:39.978888+0000, chain.objs.size()=1 2024-09-12T01:02:39.438 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.DqG0qxeAg45LuzA9FRIG58PH6A8Mvqw_0 2024-09-12T01:02:39.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2688659058865754367', time=2024-09-12T02:50:40.008630+0000, chain.objs.size()=1 2024-09-12T01:02:39.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Iz0BJuc3qYrOp1oPVts4Ux1-BtsOAKx_0 2024-09-12T01:02:39.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1093631356260772116', time=2024-09-12T02:50:40.009665+0000, chain.objs.size()=1 2024-09-12T01:02:39.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.U2MX3dxlhCJ12WU6O2KZyLNKQ8OZ8GJ_0 2024-09-12T01:02:39.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12766161091693150634', time=2024-09-12T02:50:40.525449+0000, chain.objs.size()=1 2024-09-12T01:02:39.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.MYzAyAbmDpyADaDN9HDf-NeqzPrhzkn_0 2024-09-12T01:02:39.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13837177049814486710', time=2024-09-12T02:50:40.634609+0000, chain.objs.size()=1 2024-09-12T01:02:39.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.GmRrpONnyfs5BC863c9g5VIF5Ao07x7_0 2024-09-12T01:02:39.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12497944465603318100', time=2024-09-12T02:50:40.777377+0000, chain.objs.size()=1 2024-09-12T01:02:39.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.gu7BgWkuicYA2DL2ks4MJe_NJFxY2M6_0 2024-09-12T01:02:39.439 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15551824839839806001', time=2024-09-12T02:50:40.803903+0000, chain.objs.size()=1 2024-09-12T01:02:39.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.4gMPv7SsxrBtqpn_v2H3fgO_g6WjMAo_0 2024-09-12T01:02:39.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16053838064279192616', time=2024-09-12T02:50:41.010853+0000, chain.objs.size()=1 2024-09-12T01:02:39.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.oLXJUKhRK2Y3i82qn2ifnOnCytqGVuK_0 2024-09-12T01:02:39.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8607241853821368742', time=2024-09-12T02:50:41.020749+0000, chain.objs.size()=1 2024-09-12T01:02:39.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Zj-YqpR1HnK4sMA4GAFwn7gdZsJ7S5c_0 2024-09-12T01:02:39.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7734314030462471467', time=2024-09-12T02:50:41.064236+0000, chain.objs.size()=1 2024-09-12T01:02:39.440 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.442+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.XUqAlA0u8C8ntboBg96pAj2o5YxrXNp_0 2024-09-12T01:02:39.445 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47709 2024-09-12T01:02:39.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T01:02:39.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6927265933209452120', time=2024-09-12T02:50:41.090230+0000, chain.objs.size()=1 2024-09-12T01:02:39.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.hVEcMENewK5hbrIe-4KiGYbfuIwnvJv_0 2024-09-12T01:02:39.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11458085212861200889', time=2024-09-12T02:50:41.115245+0000, chain.objs.size()=1 2024-09-12T01:02:39.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.eVLDcuPjvVPPXrTqx7lFcOC9EPe_5fa_0 2024-09-12T01:02:39.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17808882689340908424', time=2024-09-12T02:50:41.120191+0000, chain.objs.size()=1 2024-09-12T01:02:39.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.gOHmUEXdBnGpK1TLgVgFJXpwk6h8M79_0 2024-09-12T01:02:39.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17499445116325788393', time=2024-09-12T02:50:41.170666+0000, chain.objs.size()=1 2024-09-12T01:02:39.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.SeYSaX8eJZrsHjc-lUECbeFoRnQAnDJ_0 2024-09-12T01:02:39.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16966719272420926914', time=2024-09-12T02:50:41.299514+0000, chain.objs.size()=1 2024-09-12T01:02:39.448 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.JGt4JlHPcAoyVcf_aTVSYMrUrgqsRmt_0 2024-09-12T01:02:39.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16070235067764015840', time=2024-09-12T02:50:41.332140+0000, chain.objs.size()=1 2024-09-12T01:02:39.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.hFtzSRSdm6n6ylJu1ac_XgnVHxW5bxr_0 2024-09-12T01:02:39.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.336395620800876132', time=2024-09-12T02:50:41.354181+0000, chain.objs.size()=1 2024-09-12T01:02:39.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_._kCm_2vNIjqjogK-lF3q1xUlGYbtkOX_0 2024-09-12T01:02:39.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5237984031986450247', time=2024-09-12T02:50:41.551393+0000, chain.objs.size()=1 2024-09-12T01:02:39.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.w2kkObQv1aTuvWd-vhn6jPRYU5ZKoxY_0 2024-09-12T01:02:39.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2664054626479111201', time=2024-09-12T02:50:41.579869+0000, chain.objs.size()=1 2024-09-12T01:02:39.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Na6jpMloHaUJIwEAs8b50IUYVpgA8d0_0 2024-09-12T01:02:39.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4516491635521043069', time=2024-09-12T02:50:41.617600+0000, chain.objs.size()=1 2024-09-12T01:02:39.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.J5lXTp6VlavROx2NwTxbpSnkvKKbD7e_0 2024-09-12T01:02:39.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8362593398807020171', time=2024-09-12T02:50:41.624527+0000, chain.objs.size()=1 2024-09-12T01:02:39.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.4Kz8h2kOK9A5QoX1ZqH0UJrAGiCezY0_0 2024-09-12T01:02:39.449 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2056860141291063220', time=2024-09-12T02:52:27.651472+0000, chain.objs.size()=1 2024-09-12T01:02:39.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.450+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.466__shadow_.cR8n2flNyCz8SKxo1oW4F2uxHUTPkRV_0 2024-09-12T01:02:39.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6094996033697043002', time=2024-09-12T02:52:44.571869+0000, chain.objs.size()=1 2024-09-12T01:02:39.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.495__shadow_.YD_vnRnK5q-Hb-o3JmtFHQaSIzIajur_0 2024-09-12T01:02:39.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~zOO2vmQ-oaXLpPpzLLtbnZimy2lgCU7', time=2024-09-12T02:53:21.649371+0000, chain.objs.size()=1 2024-09-12T01:02:39.450 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~zOO2vmQ-oaXLpPpzLLtbnZimy2lgCU7.2 2024-09-12T01:02:39.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~zOO2vmQ-oaXLpPpzLLtbnZimy2lgCU7', time=2024-09-12T02:53:21.652671+0000, chain.objs.size()=1 2024-09-12T01:02:39.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~zOO2vmQ-oaXLpPpzLLtbnZimy2lgCU7.3 2024-09-12T01:02:39.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16698836720091581678', time=2024-09-12T02:53:28.745610+0000, chain.objs.size()=1 2024-09-12T01:02:39.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.523__multipart_mymultipart.2~Zpk4cs6Xjdqo7WxPJ6s3URtAfy9H52_.1 2024-09-12T01:02:39.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15595331511084902097', time=2024-09-12T02:54:22.454250+0000, chain.objs.size()=1 2024-09-12T01:02:39.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.550__shadow_.yils6QZocFTyRuu_iupuZz6nHuxOMln_0 2024-09-12T01:02:39.452 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14783917584065689814', time=2024-09-12T02:54:45.279926+0000, chain.objs.size()=1 2024-09-12T01:02:39.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:imhhTzj5fmlw9v.VkuBIZZ4B.VS5z6G_.pdUSPgLbKn8lqXeEv8njt872iJYAYyg_0 2024-09-12T01:02:39.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5562878649685565437', time=2024-09-12T02:55:30.438822+0000, chain.objs.size()=1 2024-09-12T01:02:39.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.580__shadow:8juGWe0B1jWWu.E0YOinGTS3brr-OEr_.EyzoynZFmObeaDXwIMD2h8fnGfkxGB4_0 2024-09-12T01:02:39.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4517659800605026438', time=2024-09-12T02:55:34.325073+0000, chain.objs.size()=1 2024-09-12T01:02:39.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.585__shadow:x9zHjuSl9nz.IWoTduJz6l5WVbMSbUg_.v01SZgoux4cOX1bG23GlmA6S6kJ4J1h_0 2024-09-12T01:02:39.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12404484681090424921', time=2024-09-12T02:55:36.144736+0000, chain.objs.size()=1 2024-09-12T01:02:39.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.587__shadow:oJkSgpPpjf87zrZ36tb44-af-eLIzcp_.lRMnGc2fsqVxR--LVFvpoJ_SFTFOJCv_0 2024-09-12T01:02:39.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2720442789279756524', time=2024-09-12T02:59:07.622671+0000, chain.objs.size()=1 2024-09-12T01:02:39.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.454+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.693__shadow:4pfiLm7jC4gn4M7dH8u5hkTf1oYtRPR_.Djg8Y7awSPzaU06aCK2__MpGOy3owUS_0 2024-09-12T01:02:39.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.458+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12695982428312656655', time=2024-09-12T02:59:09.031794+0000, chain.objs.size()=1 2024-09-12T01:02:39.453 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.458+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.695__shadow_.d_dNU4G6bM-f5GdHf-vz43sKHuqHwym_0 2024-09-12T01:02:39.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.462+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2902452433529543348', time=2024-09-12T02:59:15.443138+0000, chain.objs.size()=1 2024-09-12T01:02:39.457 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.462+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.704__shadow:dHkliA6XAnF9sWFxLe-ehK3sgcirKge_.gtf1tFuWLLcCw4_5WH986tPPQavNW6V_0 2024-09-12T01:02:39.460 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.466+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:39.463 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.466+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:02:39.464 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.465 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49221' 2024-09-12T01:02:39.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8908423223904397101', time=2024-09-12T02:46:12.735099+0000, chain.objs.size()=1 2024-09-12T01:02:39.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.171__shadow_.n022BBDzyp_4yi9gTODEqBlj7TEbS-n_0 2024-09-12T01:02:39.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12726731918213425882', time=2024-09-12T02:46:27.300543+0000, chain.objs.size()=1 2024-09-12T01:02:39.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.178__shadow_.O6B0XQUpBeOZB1QyZNhA3dMxXuM__UB_0 2024-09-12T01:02:39.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8586432608790528734', time=2024-09-12T02:48:24.704184+0000, chain.objs.size()=1 2024-09-12T01:02:39.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.237__shadow_.Sa3L23nxFGEMGMbT00kdzoUW-YIszPg_0 2024-09-12T01:02:39.466 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8204913059923323612', time=2024-09-12T02:49:05.496523+0000, chain.objs.size()=1 2024-09-12T01:02:39.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.cD_ltlJO-27PV52oC9U-u1JkWJrmaYR_0 2024-09-12T01:02:39.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9665004830726275674', time=2024-09-12T02:49:05.497379+0000, chain.objs.size()=1 2024-09-12T01:02:39.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.VC5jMnmX7IMaGa5fqd9hHYey_26ii_q_0 2024-09-12T01:02:39.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5802454813857130891', time=2024-09-12T02:49:05.511392+0000, chain.objs.size()=1 2024-09-12T01:02:39.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.5qxdsmA9ozREF8SLmW871nnqfqzCZ-J_0 2024-09-12T01:02:39.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1385623823162395072', time=2024-09-12T02:49:05.531207+0000, chain.objs.size()=1 2024-09-12T01:02:39.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.DbrubDHpqpAozx1egcgh5SiHsVdvOs__0 2024-09-12T01:02:39.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3460120732834885164', time=2024-09-12T02:49:05.551020+0000, chain.objs.size()=1 2024-09-12T01:02:39.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.K6DesE7xqGGYbKn6GYeh8Sg_cb0Jysv_0 2024-09-12T01:02:39.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9813818537526581246', time=2024-09-12T02:49:05.740995+0000, chain.objs.size()=1 2024-09-12T01:02:39.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.t4ZhuXUQl8DCzc3wNUdou-4skEoGnLi_0 2024-09-12T01:02:39.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17435591468849898228', time=2024-09-12T02:49:05.811414+0000, chain.objs.size()=1 2024-09-12T01:02:39.467 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.r75RdcfJHbnH6naO8cNB0boPizLyP8j_0 2024-09-12T01:02:39.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1893397320279723308', time=2024-09-12T02:49:05.864856+0000, chain.objs.size()=1 2024-09-12T01:02:39.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.GN42_KMKU8bChCPVzEN-8Mw-ShUAdit_0 2024-09-12T01:02:39.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14069375087481734909', time=2024-09-12T02:49:05.988990+0000, chain.objs.size()=1 2024-09-12T01:02:39.468 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.470+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.1EKJw9yFSRW5IR_6OG-pl70XK3dDFXv_0 2024-09-12T01:02:39.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13116763589789240751', time=2024-09-12T02:49:06.001304+0000, chain.objs.size()=1 2024-09-12T01:02:39.470 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.wR431Y2UDyBSFrIhGqpDpkOhtXJtORE_0 2024-09-12T01:02:39.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14317370288807257566', time=2024-09-12T02:49:06.048070+0000, chain.objs.size()=1 2024-09-12T01:02:39.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.sjyl5Yo2o4UsQqqUkbuu5SNrPiippFA_0 2024-09-12T01:02:39.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3185146687329219554', time=2024-09-12T02:49:06.063201+0000, chain.objs.size()=1 2024-09-12T01:02:39.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.EyycbfZPknPMYHRE6IsDQhmpRaUZIhZ_0 2024-09-12T01:02:39.471 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.261299121252713767', time=2024-09-12T02:49:06.088013+0000, chain.objs.size()=1 2024-09-12T01:02:39.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.UMnzrny775Ifpsd193UQCs9y64fUnsR_0 2024-09-12T01:02:39.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3963122937067940475', time=2024-09-12T02:49:06.245351+0000, chain.objs.size()=1 2024-09-12T01:02:39.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.AWK7C_wFIu_UYuDNZBS1l6FCuXrq0dj_0 2024-09-12T01:02:39.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17691754434743857111', time=2024-09-12T02:49:06.274483+0000, chain.objs.size()=1 2024-09-12T01:02:39.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.frpbG-y0zNih2q-JsRsd8DUzEmzNntc_0 2024-09-12T01:02:39.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13121274792451115875', time=2024-09-12T02:49:06.312983+0000, chain.objs.size()=1 2024-09-12T01:02:39.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.45q05UC9y_5FuK_D2WEMPUlIlORCTev_0 2024-09-12T01:02:39.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10645734434474299226', time=2024-09-12T02:49:06.339041+0000, chain.objs.size()=1 2024-09-12T01:02:39.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.DQFIna2T0zsZElH1DupMLRuCmm_NoFd_0 2024-09-12T01:02:39.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13452023118425399069', time=2024-09-12T02:49:06.345010+0000, chain.objs.size()=1 2024-09-12T01:02:39.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.EJhZlO1SB_DP0Hpe9FGJayGqwogODpO_0 2024-09-12T01:02:39.472 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bd9596640 0 -- 172.21.15.138:0/2003776050 >> [v2:172.21.15.138:6824/4021037468,v1:172.21.15.138:6825/4021037468] conn(0x7f2bcc023040 msgr2=0x7f2aa4090f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:02:39.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1445380213721245840', time=2024-09-12T02:49:06.512408+0000, chain.objs.size()=1 2024-09-12T01:02:39.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ygTDRTlyH3Y04N34HvPX-FGHF6kcaab_0 2024-09-12T01:02:39.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8626721115314074119', time=2024-09-12T02:49:06.546494+0000, chain.objs.size()=1 2024-09-12T01:02:39.473 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.474+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Q6tc5FRfn4iEq6Q4Cc6ISTSpK_ZO9f1_0 2024-09-12T01:02:39.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4667633877062687796', time=2024-09-12T02:49:06.585966+0000, chain.objs.size()=1 2024-09-12T01:02:39.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.UMwQnSPGZUnIAy1IUcIbb-QKO_2Wriz_0 2024-09-12T01:02:39.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3810747877793674362', time=2024-09-12T02:49:06.751718+0000, chain.objs.size()=1 2024-09-12T01:02:39.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.PAIpdlv3uh0Hm7bcNiCS-7dOBqk5wZ1_0 2024-09-12T01:02:39.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6607689497302505806', time=2024-09-12T02:49:06.819451+0000, chain.objs.size()=1 2024-09-12T01:02:39.477 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.quvsUtOQR44TNzA-90JIX-LZRI4pYlN_0 2024-09-12T01:02:39.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12743167669048939391', time=2024-09-12T02:49:06.868197+0000, chain.objs.size()=1 2024-09-12T01:02:39.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.RhFndej6M99PEtZIIv_276uMLoSyX1f_0 2024-09-12T01:02:39.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15290690010961765352', time=2024-09-12T02:49:07.062720+0000, chain.objs.size()=1 2024-09-12T01:02:39.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Lc2IvqwifKj-YRylfBeHac3Ws4A8-yn_0 2024-09-12T01:02:39.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9142922042017113076', time=2024-09-12T02:49:07.066066+0000, chain.objs.size()=1 2024-09-12T01:02:39.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ceaW-vrfW1A9b1H8hwZ6Ik_ZRkOiTNu_0 2024-09-12T01:02:39.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1946032223523409845', time=2024-09-12T02:49:07.091396+0000, chain.objs.size()=1 2024-09-12T01:02:39.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7ttCTHPaiFfAbG9VtnalIYqSi0s6Cpy_0 2024-09-12T01:02:39.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4663232038008882150', time=2024-09-12T02:49:07.104281+0000, chain.objs.size()=1 2024-09-12T01:02:39.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9fsXEdUg_vQPAgZEBkG9cv9_tHOsiV7_0 2024-09-12T01:02:39.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3493500693893184892', time=2024-09-12T02:49:07.158469+0000, chain.objs.size()=1 2024-09-12T01:02:39.478 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.sqIzpLENSfrot6Bu2Rf3are9HQ9PZVt_0 2024-09-12T01:02:39.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14550711292788190438', time=2024-09-12T02:49:07.164510+0000, chain.objs.size()=1 2024-09-12T01:02:39.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.lApNJ-6o2BDDae4ZJPyO-UGHnhTjElv_0 2024-09-12T01:02:39.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11209743134377490148', time=2024-09-12T02:49:07.179830+0000, chain.objs.size()=1 2024-09-12T01:02:39.479 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.482+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.aznXIF4qc_AJUDonz-LFZcUpAmGe1YC_0 2024-09-12T01:02:39.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1788778378229695892', time=2024-09-12T02:49:07.200711+0000, chain.objs.size()=1 2024-09-12T01:02:39.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.XGm8hB_VH-IEYAXHXHagBg6oxFI6uo9_0 2024-09-12T01:02:39.481 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9563168553190899675', time=2024-09-12T02:49:07.201740+0000, chain.objs.size()=1 2024-09-12T01:02:39.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.pk5QXoRkDSoOFkHVcL1JFeARpQpTzRZ_0 2024-09-12T01:02:39.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15882202391270843321', time=2024-09-12T02:49:07.382223+0000, chain.objs.size()=1 2024-09-12T01:02:39.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.YLHq6UwcnZ_WYIbuGN620KjFtgux269_0 2024-09-12T01:02:39.482 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1853958770813020758', time=2024-09-12T02:49:07.393231+0000, chain.objs.size()=1 2024-09-12T01:02:39.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.K-R8aepqI6Sn-Xvo6BG6LmZEJCiNG26_0 2024-09-12T01:02:39.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.486+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7682894861585302702', time=2024-09-12T02:49:07.394971+0000, chain.objs.size()=1 2024-09-12T01:02:39.483 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.486+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.FBrz3x5Kl00v9cKg3g55zGvzH7dY3BQ_0 2024-09-12T01:02:39.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18404446060817249552', time=2024-09-12T02:49:07.420343+0000, chain.objs.size()=1 2024-09-12T01:02:39.485 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.MQe1fVdrygvc2wrbG97NIgecKX0BPA9_0 2024-09-12T01:02:39.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3752125367474074818', time=2024-09-12T02:49:07.426905+0000, chain.objs.size()=1 2024-09-12T01:02:39.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.g5M1LGEJ-QSlVa-psEZS4gRP2eB3pFf_0 2024-09-12T01:02:39.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2075626643088366573', time=2024-09-12T02:49:13.973853+0000, chain.objs.size()=1 2024-09-12T01:02:39.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.271__shadow_.9nsvgQCabA6L7PR_xalEyRpNea5XiVk_0 2024-09-12T01:02:39.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17543566685670626497', time=2024-09-12T02:49:30.970000+0000, chain.objs.size()=1 2024-09-12T01:02:39.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.pR1nw0XgcakBlfWL0ILLWgyNIa6uSxb_0 2024-09-12T01:02:39.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2411899474108341071', time=2024-09-12T02:49:36.168473+0000, chain.objs.size()=1 2024-09-12T01:02:39.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.298__shadow_.3o-yyfSYJwBN_1XH8YzWvtkSTIY8jBZ_0 2024-09-12T01:02:39.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17403597506731549183', time=2024-09-12T02:49:36.946963+0000, chain.objs.size()=1 2024-09-12T01:02:39.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.299__shadow_.AdBgnY4yHS_dgTc1TnGrgs4NFGb_xaW_0 2024-09-12T01:02:39.486 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11541524337202201811', time=2024-09-12T02:50:15.842762+0000, chain.objs.size()=1 2024-09-12T01:02:39.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.RITIt9EDEUFq-fWuHn2NYyGXPQXGBPd_0 2024-09-12T01:02:39.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14603456302675103191', time=2024-09-12T02:50:15.860335+0000, chain.objs.size()=1 2024-09-12T01:02:39.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.BhkfLe7AlxsPbkZAXEYAhKMC6oTrDMH_0 2024-09-12T01:02:39.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17407496048989154325', time=2024-09-12T02:50:15.902725+0000, chain.objs.size()=1 2024-09-12T01:02:39.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.9k72pVMAZmScURihQfKbHW4AlauJQH6_0 2024-09-12T01:02:39.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6002835347370752602', time=2024-09-12T02:50:15.909854+0000, chain.objs.size()=1 2024-09-12T01:02:39.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.LkXCuCRcVIEnA_izkm-nu5tN0WKGq89_0 2024-09-12T01:02:39.487 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5800702687564931432', time=2024-09-12T02:50:15.932158+0000, chain.objs.size()=1 2024-09-12T01:02:39.488 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.490+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.v-rQTGA2Q8L0hdlbq90_o42Asy3g2yQ_0 2024-09-12T01:02:39.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8769664144290648887', time=2024-09-12T02:50:15.946783+0000, chain.objs.size()=1 2024-09-12T01:02:39.489 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.5shlyVHfdETnNTOywXhwnC09Hgs6j_X_0 2024-09-12T01:02:39.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3723200121225717696', time=2024-09-12T02:50:15.959090+0000, chain.objs.size()=1 2024-09-12T01:02:39.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.41c9-KGOjuvtR0L2BCKbbfrfesLfKbW_0 2024-09-12T01:02:39.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6400715209677575055', time=2024-09-12T02:50:16.186494+0000, chain.objs.size()=1 2024-09-12T01:02:39.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.qePunsSGNSNYbsyk3ePXtrVDPmZIFKF_0 2024-09-12T01:02:39.490 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13490330426930890326', time=2024-09-12T02:50:16.196841+0000, chain.objs.size()=1 2024-09-12T01:02:39.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.CTQS2Dx1bS1o_ULxBuKgeljUpBV0JJx_0 2024-09-12T01:02:39.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11384544117826224112', time=2024-09-12T02:50:16.221221+0000, chain.objs.size()=1 2024-09-12T01:02:39.491 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.FsVX2mExK7C_64dWS9MAMGwZUT3QgGI_0 2024-09-12T01:02:39.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.832053888884343207', time=2024-09-12T02:50:16.240309+0000, chain.objs.size()=1 2024-09-12T01:02:39.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Ht2H79BECM9EHNCinq1CvkSnhPlIVCk_0 2024-09-12T01:02:39.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2543178515436257656', time=2024-09-12T02:50:16.484235+0000, chain.objs.size()=1 2024-09-12T01:02:39.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.SfzPxd9izCAJV2Mns9cYutv7Ou9pGYr_0 2024-09-12T01:02:39.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9663269753440172582', time=2024-09-12T02:50:16.673448+0000, chain.objs.size()=1 2024-09-12T01:02:39.492 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.EIS666YLUWogsdNwkYazKhCXlChjXKh_0 2024-09-12T01:02:39.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3858743125635855968', time=2024-09-12T02:50:16.759157+0000, chain.objs.size()=1 2024-09-12T01:02:39.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.FCoo95Yua6ezTZMRchXT2ga_5lWZZu0_0 2024-09-12T01:02:39.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16688572786773355869', time=2024-09-12T02:50:16.784939+0000, chain.objs.size()=1 2024-09-12T01:02:39.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.SaeJVbokb3S1nebWbUCnAGvpYYKS7tN_0 2024-09-12T01:02:39.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10527194155379307323', time=2024-09-12T02:50:17.035032+0000, chain.objs.size()=1 2024-09-12T01:02:39.493 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.494+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-CA8FRBQSnJFEM3sMyvSjUczs07aPbI_0 2024-09-12T01:02:39.497 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11119518265089664274', time=2024-09-12T02:50:17.203459+0000, chain.objs.size()=1 2024-09-12T01:02:39.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.voaF-8vPK44M_8I0qvAs73EESa3gOWl_0 2024-09-12T01:02:39.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5073015443787395389', time=2024-09-12T02:50:17.264590+0000, chain.objs.size()=1 2024-09-12T01:02:39.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.tdxPqXxYKvwyw0UXEke7gfTfRse8SyG_0 2024-09-12T01:02:39.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6836058485826807943', time=2024-09-12T02:50:17.482685+0000, chain.objs.size()=1 2024-09-12T01:02:39.498 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.w0Rf-rMUw5utMVBo2rprMJHscKRsa6I_0 2024-09-12T01:02:39.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5729954068974175829', time=2024-09-12T02:50:17.494036+0000, chain.objs.size()=1 2024-09-12T01:02:39.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Jyk4VnXeYk8iTXbxGCZdnx2NhJfRmuB_0 2024-09-12T01:02:39.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10142019932258439286', time=2024-09-12T02:50:17.507448+0000, chain.objs.size()=1 2024-09-12T01:02:39.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.CmN-kjaAXvo54N0ils7-Mcv14wTGMxa_0 2024-09-12T01:02:39.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1933838907078059892', time=2024-09-12T02:50:17.543702+0000, chain.objs.size()=1 2024-09-12T01:02:39.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Z-1bsIp4xFsQnx45QjnI5H9zK6YtM9p_0 2024-09-12T01:02:39.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7034819907078788562', time=2024-09-12T02:50:39.461372+0000, chain.objs.size()=1 2024-09-12T01:02:39.499 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.gla56Xm4uHjDq6sXo7BHEPK_MEexf4o_0 2024-09-12T01:02:39.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13661181124098604113', time=2024-09-12T02:50:39.491449+0000, chain.objs.size()=1 2024-09-12T01:02:39.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.4DycIlMR0gfV1D_tiQUryGSMOiarxxI_0 2024-09-12T01:02:39.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11389824426300387074', time=2024-09-12T02:50:39.526011+0000, chain.objs.size()=1 2024-09-12T01:02:39.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.502+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.5Frywab04ppHFL0NZ_c69EYG36ezFAx_0 2024-09-12T01:02:39.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17042906554021749246', time=2024-09-12T02:50:39.787134+0000, chain.objs.size()=1 2024-09-12T01:02:39.500 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.KN7ShaMCnqFxP0_Bql7G25R-q8pHsH4_0 2024-09-12T01:02:39.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18397524286749230221', time=2024-09-12T02:50:39.812732+0000, chain.objs.size()=1 2024-09-12T01:02:39.501 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ImvsPz6AaEB1BkOVfyyxccZMMp3Rs5N_0 2024-09-12T01:02:39.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5066836638303633627', time=2024-09-12T02:50:39.865021+0000, chain.objs.size()=1 2024-09-12T01:02:39.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.FgqYjOG36xqyUdxQbuNBaDaSmbcaoIH_0 2024-09-12T01:02:39.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10799583471487091332', time=2024-09-12T02:50:39.978363+0000, chain.objs.size()=1 2024-09-12T01:02:39.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.y5EurVhW7p_jK9ZCQsPyNcHLahMKXq__0 2024-09-12T01:02:39.502 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.346707058976639560', time=2024-09-12T02:50:40.031384+0000, chain.objs.size()=1 2024-09-12T01:02:39.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.wvrtJVcThRDv8aRVanvQb9NpGyXytbN_0 2024-09-12T01:02:39.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4243045704092806323', time=2024-09-12T02:50:40.125539+0000, chain.objs.size()=1 2024-09-12T01:02:39.503 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ate7PHXepWiQxFEeIcfrnm4G_0qI67W_0 2024-09-12T01:02:39.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16275447591114714068', time=2024-09-12T02:50:40.126619+0000, chain.objs.size()=1 2024-09-12T01:02:39.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.kmI0pbjSaANef1NY55sqa0pSm8FKoFQ_0 2024-09-12T01:02:39.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.506+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15794895841953801227', time=2024-09-12T02:50:40.141231+0000, chain.objs.size()=1 2024-09-12T01:02:39.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.506+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.RJh1o4L6R0oOQKXLtflPnoZIQ_ZSggL_0 2024-09-12T01:02:39.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.510+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6856007794366200025', time=2024-09-12T02:50:40.252996+0000, chain.objs.size()=1 2024-09-12T01:02:39.504 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.510+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.X6yLHEXosm_1RmJ8Zboy-pxJlXk3Bwx_0 2024-09-12T01:02:39.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.510+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13536368814377685265', time=2024-09-12T02:50:40.546370+0000, chain.objs.size()=1 2024-09-12T01:02:39.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.510+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ZK3q_HOPLQX3UTJV8v9NOKaDbGlQIzR_0 2024-09-12T01:02:39.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.510+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.418686223244537276', time=2024-09-12T02:50:40.566061+0000, chain.objs.size()=1 2024-09-12T01:02:39.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.510+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.SKd_r-AZ8P_NTCcT-2TsDWwWNQm9-gZ_0 2024-09-12T01:02:39.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.510+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15783945399985710866', time=2024-09-12T02:50:40.610215+0000, chain.objs.size()=1 2024-09-12T01:02:39.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.510+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Lfa4Sy5Pr8iV7qn1pjCW7tVKlqUJVtS_0 2024-09-12T01:02:39.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.510+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12982691837939536809', time=2024-09-12T02:50:40.744786+0000, chain.objs.size()=1 2024-09-12T01:02:39.505 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.510+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.N1c8_uunUUO7U0xV7UPgFSOa4LYe9Ng_0 2024-09-12T01:02:39.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.510+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5784391111648111742', time=2024-09-12T02:50:40.755803+0000, chain.objs.size()=1 2024-09-12T01:02:39.507 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.510+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.BJkaqJy-XIvx7V5SkLnbHRruHali8sB_0 2024-09-12T01:02:39.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.510+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14617227011890776999', time=2024-09-12T02:50:40.818409+0000, chain.objs.size()=1 2024-09-12T01:02:39.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.510+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.PPmhkvwem4P7GgfCe7AwvgxBAbh3How_0 2024-09-12T01:02:39.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10730750038897948284', time=2024-09-12T02:50:40.853562+0000, chain.objs.size()=1 2024-09-12T01:02:39.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.2ixnzi9CasRk2JHR-4qJDI5KwSZGLLh_0 2024-09-12T01:02:39.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17522632262838381119', time=2024-09-12T02:50:40.874572+0000, chain.objs.size()=1 2024-09-12T01:02:39.508 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.lkdJRWg1vmVOJiherUbDzrICuYbmDW6_0 2024-09-12T01:02:39.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9097930262538659894', time=2024-09-12T02:50:41.007504+0000, chain.objs.size()=1 2024-09-12T01:02:39.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Jk-AR3JhQ0GOKcxTgsGE5z1Mbv3no0a_0 2024-09-12T01:02:39.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3492002095061982060', time=2024-09-12T02:50:41.042252+0000, chain.objs.size()=1 2024-09-12T01:02:39.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.BF72h6gnCvaFUIAaN2XErwwzx_VQaop_0 2024-09-12T01:02:39.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6240959565010956196', time=2024-09-12T02:50:41.065142+0000, chain.objs.size()=1 2024-09-12T01:02:39.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.UbxKKAUr7IQQ0hCnWP1kqgqkJZLHLwV_0 2024-09-12T01:02:39.510 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1203646825214494754', time=2024-09-12T02:50:41.157008+0000, chain.objs.size()=1 2024-09-12T01:02:39.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.yXCF3IFNLixrIDe40KIPkyqu1aO_K0f_0 2024-09-12T01:02:39.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4687777961745683331', time=2024-09-12T02:50:41.173029+0000, chain.objs.size()=1 2024-09-12T01:02:39.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.9u0V9LvnhsjeRmrllCmguAbLRLyBL6q_0 2024-09-12T01:02:39.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11475491079846403942', time=2024-09-12T02:50:41.300977+0000, chain.objs.size()=1 2024-09-12T01:02:39.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.zIshzsyeiB6ZAQp6GePYdRXOqle5Gli_0 2024-09-12T01:02:39.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10284973209107175770', time=2024-09-12T02:50:41.304133+0000, chain.objs.size()=1 2024-09-12T01:02:39.511 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.VUlJ76t0HSbvqEFwEC8GGFNAf_ScWeA_0 2024-09-12T01:02:39.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9424654642966385012', time=2024-09-12T02:50:41.322893+0000, chain.objs.size()=1 2024-09-12T01:02:39.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.514+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.NlVkEmRJR2d7cCsMc96pqot0-XFfsNS_0 2024-09-12T01:02:39.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15447058791861230826', time=2024-09-12T02:50:41.349063+0000, chain.objs.size()=1 2024-09-12T01:02:39.512 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.4sBgJcpBv47PQZFYGyZ-6rfW1YW24Pi_0 2024-09-12T01:02:39.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4069543011370521616', time=2024-09-12T02:50:41.376920+0000, chain.objs.size()=1 2024-09-12T01:02:39.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.jWBQ3RdUC4O4p47G7vUaQrFuEAXbM3J_0 2024-09-12T01:02:39.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13360310082863554231', time=2024-09-12T02:50:41.598772+0000, chain.objs.size()=1 2024-09-12T01:02:39.513 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.RfRPSvQ5F8XpOUBlGxuqaAWN_y9kYbk_0 2024-09-12T01:02:39.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16309303537058469852', time=2024-09-12T02:50:41.635177+0000, chain.objs.size()=1 2024-09-12T01:02:39.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Oe-YVzdwYxRNSmBD3lhnVwmiDZUB76I_0 2024-09-12T01:02:39.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.518+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5872797340112207388', time=2024-09-12T02:51:21.251870+0000, chain.objs.size()=1 2024-09-12T01:02:39.514 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.518+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.383__shadow_.1hCySBLz-WZ11q1ZcxydGpCgc8omUc1_0 2024-09-12T01:02:39.518 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.522+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49221 2024-09-12T01:02:39.520 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T01:02:39.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16255311913896008834', time=2024-09-12T02:52:50.181744+0000, chain.objs.size()=1 2024-09-12T01:02:39.521 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.503__shadow:kkpnEcohSrS0OmtT6cE4b1ngYotif0k_.RijEw510gCv7_gxNQ272Sla30v4Z_0T_0 2024-09-12T01:02:39.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6481488259451018383', time=2024-09-12T02:53:02.380148+0000, chain.objs.size()=1 2024-09-12T01:02:39.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.517__shadow_.iE1ZWcATJ78CQQYZP4wL-Nbj2LjVx0p_0 2024-09-12T01:02:39.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16500813248715316773', time=2024-09-12T02:53:30.392405+0000, chain.objs.size()=2 2024-09-12T01:02:39.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.523__multipart_mymultipart.2~f6wqUEPzClVfsTdryNAWkHOIqS36b4y.1 2024-09-12T01:02:39.522 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.523__multipart_mymultipart.2~f6wqUEPzClVfsTdryNAWkHOIqS36b4y.2 2024-09-12T01:02:39.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15891039151622933078', time=2024-09-12T02:54:25.985085+0000, chain.objs.size()=1 2024-09-12T01:02:39.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.553__shadow_.Ex-rn1DZYIYd2idFb_tuCUtK6qHW9ou_0 2024-09-12T01:02:39.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16267029125195894169', time=2024-09-12T02:54:53.749277+0000, chain.objs.size()=1 2024-09-12T01:02:39.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.570__shadow:EpuG774.9-.8bqo5UMDb8RHQ7fKo4yh_.zghXy8q14KxsGdDTi7NDy54JaSDpbw-_0 2024-09-12T01:02:39.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4359905108813128854', time=2024-09-12T02:55:12.503595+0000, chain.objs.size()=1 2024-09-12T01:02:39.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:g70t.aRYz70k30OccVE13r0lYNNVSRQ_.-IrXohzM9PrXmxmKrlmhismDraiEnQt_0 2024-09-12T01:02:39.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5125523779796866659', time=2024-09-12T02:55:17.857090+0000, chain.objs.size()=1 2024-09-12T01:02:39.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:ooMG5fUq4KsE1duFAIQ2y0RDovBvKFv_.hRwJ8gxrqpYEhZAq80lP2B2izI6lhXm_0 2024-09-12T01:02:39.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12197966617051748108', time=2024-09-12T02:55:28.561898+0000, chain.objs.size()=1 2024-09-12T01:02:39.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.579__shadow:Re76hY3cUR0CoPYsvoIGcD8RultiTFY_.u9WPF7B6ASXJs8dDZ3N-_u_tkrTWkDq_0 2024-09-12T01:02:39.523 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16057520086951107680', time=2024-09-12T02:55:35.328447+0000, chain.objs.size()=1 2024-09-12T01:02:39.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.586__shadow:bN9MsEjZnTIjVjSIHkTR18gJVO.d9Ab_.oVZqoH7GiltXMKonRbx95QBu5l82TOk_0 2024-09-12T01:02:39.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4900051120838692776', time=2024-09-12T02:58:20.029320+0000, chain.objs.size()=1 2024-09-12T01:02:39.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.628__shadow_.bmklCsVcL2IeQQG26noZUtsTIVaOXUJ_0 2024-09-12T01:02:39.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1835411966902077923', time=2024-09-12T02:59:11.173607+0000, chain.objs.size()=1 2024-09-12T01:02:39.524 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.526+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.698__shadow:z9.dCVXfmW5GSbU.-OeUURcRnFMClyg_.jgfoABM39CiRWuBrs5obiAIRN8dcXtT_0 2024-09-12T01:02:39.526 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.530+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:39.529 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:02:39.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.530 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45438' 2024-09-12T01:02:39.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.782932393019503533', time=2024-09-12T02:48:28.879554+0000, chain.objs.size()=1 2024-09-12T01:02:39.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.242__shadow_.8B7KWkUPYZ3pb2HogtbiXCzL6QkmaVY_0 2024-09-12T01:02:39.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10086681467679304393', time=2024-09-12T02:48:36.494163+0000, chain.objs.size()=1 2024-09-12T01:02:39.532 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.251__shadow_.z62I8vl_cPHBkMcyBHNILrsLYLFf3YW_0 2024-09-12T01:02:39.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5484681103648057622', time=2024-09-12T02:49:05.403927+0000, chain.objs.size()=1 2024-09-12T01:02:39.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.8X_DoSaNcKNDub3zwOCG08ulQiLANVd_0 2024-09-12T01:02:39.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6390329802996208495', time=2024-09-12T02:49:05.422711+0000, chain.objs.size()=1 2024-09-12T01:02:39.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.VqeUvzcATJdzj9ET_huIfpFDtpDhoX6_0 2024-09-12T01:02:39.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.771974320982303663', time=2024-09-12T02:49:05.438054+0000, chain.objs.size()=1 2024-09-12T01:02:39.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.wbNI4q3sPLw7XfUjP91RkJg-3r6wVAk_0 2024-09-12T01:02:39.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.740519564015212929', time=2024-09-12T02:49:05.514910+0000, chain.objs.size()=1 2024-09-12T01:02:39.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.sxRikSb4gEYvUwxzTAPMF2NiriGUKgD_0 2024-09-12T01:02:39.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14678450514629188713', time=2024-09-12T02:49:05.519906+0000, chain.objs.size()=1 2024-09-12T01:02:39.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.w0iFi8EDCZJDfLIK2Dy28f2b2e0H6hR_0 2024-09-12T01:02:39.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15881384550083275101', time=2024-09-12T02:49:05.720206+0000, chain.objs.size()=1 2024-09-12T01:02:39.533 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.-6kAk2B6S5y6RmwTRdBSmzHEDUM6Do5_0 2024-09-12T01:02:39.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14190897551063482359', time=2024-09-12T02:49:05.756458+0000, chain.objs.size()=1 2024-09-12T01:02:39.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.471QjVdj93bOhRc311KD5n7SOlyNVcZ_0 2024-09-12T01:02:39.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3409007410972249465', time=2024-09-12T02:49:05.855509+0000, chain.objs.size()=1 2024-09-12T01:02:39.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7rFbzVhX8-QmjyqokGVWdrGbxfjLP8z_0 2024-09-12T01:02:39.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7586611620786636565', time=2024-09-12T02:49:05.963431+0000, chain.objs.size()=1 2024-09-12T01:02:39.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.mkXqlscJwrrPN3w8ZQW6qM0_3CXra94_0 2024-09-12T01:02:39.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11173597983015708258', time=2024-09-12T02:49:06.053365+0000, chain.objs.size()=1 2024-09-12T01:02:39.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.534+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9SjTJfQGKlikSogYTeltK5PV05wr743_0 2024-09-12T01:02:39.534 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14372793311216746140', time=2024-09-12T02:49:06.070797+0000, chain.objs.size()=1 2024-09-12T01:02:39.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.EtSGeqbwXxSDKa3c-vvUNciafdYTCX2_0 2024-09-12T01:02:39.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.346414470629903316', time=2024-09-12T02:49:06.218892+0000, chain.objs.size()=1 2024-09-12T01:02:39.535 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.OrJDumsdbNUuH8krfDFunUhKu9gxFTB_0 2024-09-12T01:02:39.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1686020447187336394', time=2024-09-12T02:49:06.284878+0000, chain.objs.size()=1 2024-09-12T01:02:39.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Xfr8sPPHC0aWqECzqIHlr8HxZr_v87b_0 2024-09-12T01:02:39.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11029495198566924069', time=2024-09-12T02:49:06.291463+0000, chain.objs.size()=1 2024-09-12T01:02:39.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.1dPCQQUXQnWDyDP2WkmpbZHAzRPClFV_0 2024-09-12T01:02:39.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4614567556010479924', time=2024-09-12T02:49:06.318542+0000, chain.objs.size()=1 2024-09-12T01:02:39.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7hmyjtQUnLM-_aOaEb0MFc_ORA5Oe1e_0 2024-09-12T01:02:39.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9272849264022322539', time=2024-09-12T02:49:06.376628+0000, chain.objs.size()=1 2024-09-12T01:02:39.536 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.MxOef1BE54eJ90HfSSbuQcLH2Za4L-5_0 2024-09-12T01:02:39.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12340366259693665768', time=2024-09-12T02:49:06.485963+0000, chain.objs.size()=1 2024-09-12T01:02:39.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.yPW0RNj3Y9HcYu851H_m-jhwBBs-m3x_0 2024-09-12T01:02:39.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12928609856548015363', time=2024-09-12T02:49:06.489239+0000, chain.objs.size()=1 2024-09-12T01:02:39.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.a0199HXJYShsTSSdchpatbGrdfxz2hg_0 2024-09-12T01:02:39.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15533176746922480162', time=2024-09-12T02:49:06.523737+0000, chain.objs.size()=1 2024-09-12T01:02:39.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.rwF-o7Yqstxq-fqnJZzQeuAur7Wq3xc_0 2024-09-12T01:02:39.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11995889916812731212', time=2024-09-12T02:49:06.592921+0000, chain.objs.size()=1 2024-09-12T01:02:39.537 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.peZ9y4MAYdRlrycBvivXU5Uvi2DmhWz_0 2024-09-12T01:02:39.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16346416442319442986', time=2024-09-12T02:49:06.597963+0000, chain.objs.size()=1 2024-09-12T01:02:39.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.538+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.z4k4mx6tESFmQDtLy4Srir33k15RDrQ_0 2024-09-12T01:02:39.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.542+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16974798622248195871', time=2024-09-12T02:49:06.782811+0000, chain.objs.size()=1 2024-09-12T01:02:39.538 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.542+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.jF0qAqjONsrAChJwFvNo_xmV-CpwChV_0 2024-09-12T01:02:39.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10040727496327816431', time=2024-09-12T02:49:06.827902+0000, chain.objs.size()=1 2024-09-12T01:02:39.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.WWuKYF8GH1WlMsBxA8_RNGvgOTG3Eqb_0 2024-09-12T01:02:39.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2332941255492824349', time=2024-09-12T02:49:06.858582+0000, chain.objs.size()=1 2024-09-12T01:02:39.541 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_._-A2mnaIPKmoS5NDLU_4_s6aHQZ1C3u_0 2024-09-12T01:02:39.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15537814323543529783', time=2024-09-12T02:49:06.860255+0000, chain.objs.size()=1 2024-09-12T01:02:39.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.NUAL18mxP06FWdMKXGY5EMHKg-1zdgO_0 2024-09-12T01:02:39.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8896707322579788096', time=2024-09-12T02:49:07.090112+0000, chain.objs.size()=1 2024-09-12T01:02:39.542 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.79_O7TWOG6jvY7cg8EuLAfvPu340yJm_0 2024-09-12T01:02:39.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16826713311094073810', time=2024-09-12T02:49:07.167784+0000, chain.objs.size()=1 2024-09-12T01:02:39.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.4M-5eM6E-ktNo0tAZFcX-bBI_CG4BKc_0 2024-09-12T01:02:39.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10750155748500138411', time=2024-09-12T02:49:07.174747+0000, chain.objs.size()=1 2024-09-12T01:02:39.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.-BIi-s5T0QuCUIvbvkd6s0g-IvBWTXH_0 2024-09-12T01:02:39.544 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3431129639927638156', time=2024-09-12T02:49:07.314077+0000, chain.objs.size()=1 2024-09-12T01:02:39.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.42I36TuAlMlC_10ZeD2DqpDO--K_zis_0 2024-09-12T01:02:39.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11090442382422031467', time=2024-09-12T02:49:07.349652+0000, chain.objs.size()=1 2024-09-12T01:02:39.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.G_fL1eyPqwRqCNw-N5E6r8GjF2I981d_0 2024-09-12T01:02:39.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.803675351153843984', time=2024-09-12T02:49:07.390129+0000, chain.objs.size()=1 2024-09-12T01:02:39.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.djhWq_zo7HMsleuvaUmDBLH6BbniUuz_0 2024-09-12T01:02:39.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5468777350952298962', time=2024-09-12T02:49:10.447756+0000, chain.objs.size()=1 2024-09-12T01:02:39.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.266__shadow_.Z7QWtQibh0pOX0CTc5spDOMV8KGRnsW_0 2024-09-12T01:02:39.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11004363544081533526', time=2024-09-12T02:49:23.137269+0000, chain.objs.size()=1 2024-09-12T01:02:39.545 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.546+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.283__shadow_.1i_m7_C03L6nGE6hEo3lfCyfBoEoEwo_0 2024-09-12T01:02:39.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3082620110805679458', time=2024-09-12T02:49:25.453273+0000, chain.objs.size()=1 2024-09-12T01:02:39.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.286__shadow_.nyIPXtIcL7uRzqr-pBPIvVpDExxRPXC_0 2024-09-12T01:02:39.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5767379137048514302', time=2024-09-12T02:49:33.868892+0000, chain.objs.size()=1 2024-09-12T01:02:39.546 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.295__shadow_.sORpTJ1anYwro4KFlUkBKtpc4Np9Vwt_0 2024-09-12T01:02:39.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10450858021932068943', time=2024-09-12T02:49:41.409927+0000, chain.objs.size()=1 2024-09-12T01:02:39.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.305__shadow_.3OPreuCI-AidJuoZODHNPZAyj5t8bPO_0 2024-09-12T01:02:39.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9242411531057333034', time=2024-09-12T02:49:52.293244+0000, chain.objs.size()=1 2024-09-12T01:02:39.547 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.319__shadow:UYDOUJMfFgw0vL1-hwzyvp21SEhTC1Z_.aktKSoTs474zQ3fvJ05YzV-EX5npcra_0 2024-09-12T01:02:39.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10348559022474051422', time=2024-09-12T02:50:15.799540+0000, chain.objs.size()=1 2024-09-12T01:02:39.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.BugLKmYaYhbhFh0_0Y5kDape3RccFXb_0 2024-09-12T01:02:39.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.550+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1707602837478816333', time=2024-09-12T02:50:15.820113+0000, chain.objs.size()=1 2024-09-12T01:02:39.548 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.550+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.PDUA2w09KlTbTZ9TBGc2yY8IuoKzBgl_0 2024-09-12T01:02:39.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.792610209039058440', time=2024-09-12T02:50:16.118540+0000, chain.objs.size()=1 2024-09-12T01:02:39.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.kCQN2Nj4PPR04HQyO6l37t3Hc3y7LQH_0 2024-09-12T01:02:39.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11178725161822569602', time=2024-09-12T02:50:16.156611+0000, chain.objs.size()=1 2024-09-12T01:02:39.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.5mOYwoBPLluXMFK5YRjcNI8URP9Kait_0 2024-09-12T01:02:39.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12396306125332212370', time=2024-09-12T02:50:16.165623+0000, chain.objs.size()=1 2024-09-12T01:02:39.549 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.3Qd0EmlSlHBLUcnvLPkTBJcASIxjnMd_0 2024-09-12T01:02:39.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4331564070735556723', time=2024-09-12T02:50:16.167654+0000, chain.objs.size()=1 2024-09-12T01:02:39.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.kGnARvU1-k8Jf_Am6tgYou8UbyBSTnM_0 2024-09-12T01:02:39.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17534636148268738330', time=2024-09-12T02:50:16.193279+0000, chain.objs.size()=1 2024-09-12T01:02:39.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.CFC9z1QcgiYGvdGqGljgTTrwawA301e_0 2024-09-12T01:02:39.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16456294679551700759', time=2024-09-12T02:50:16.202914+0000, chain.objs.size()=1 2024-09-12T01:02:39.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.qZPfd9jJwHTgmPaXwjgOgbF-8XncLiL_0 2024-09-12T01:02:39.551 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1292656308030876242', time=2024-09-12T02:50:16.221626+0000, chain.objs.size()=1 2024-09-12T01:02:39.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.BdAjZElZHO88Fi9gpI9-r8lHDo2n-7H_0 2024-09-12T01:02:39.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.554+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10732788607390587501', time=2024-09-12T02:50:16.234362+0000, chain.objs.size()=1 2024-09-12T01:02:39.552 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.554+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.JR41n_uue80KyEEivgl9x3uAAVPEkb-_0 2024-09-12T01:02:39.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9419939730559021955', time=2024-09-12T02:50:16.398635+0000, chain.objs.size()=1 2024-09-12T01:02:39.553 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.X1yAvDP5PBut2YUJNggrKrXX-yyLPX__0 2024-09-12T01:02:39.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2777715468862034811', time=2024-09-12T02:50:16.445716+0000, chain.objs.size()=1 2024-09-12T01:02:39.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.fAKsLRn5RfSUgwUPjczRIe_xOnw1JEa_0 2024-09-12T01:02:39.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8497133939268145360', time=2024-09-12T02:50:16.472597+0000, chain.objs.size()=1 2024-09-12T01:02:39.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.2dJgdHiNYhVn5arw09ZWxIT9ewAQk86_0 2024-09-12T01:02:39.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6123474172498552365', time=2024-09-12T02:50:16.492284+0000, chain.objs.size()=1 2024-09-12T01:02:39.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Yz8pv8TbmCzQHaYq__QM3_H24UoAjmd_0 2024-09-12T01:02:39.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17550137749292149139', time=2024-09-12T02:50:16.512518+0000, chain.objs.size()=1 2024-09-12T01:02:39.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.33iFLdlcZYCM10srmtc-uBNSn-JntqA_0 2024-09-12T01:02:39.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16197805654984441837', time=2024-09-12T02:50:16.516895+0000, chain.objs.size()=1 2024-09-12T01:02:39.554 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.0nVP6_ntLb9UcQhvCcJMGjACeQN5un__0 2024-09-12T01:02:39.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9588691413538829128', time=2024-09-12T02:50:16.653725+0000, chain.objs.size()=1 2024-09-12T01:02:39.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.hdyAsN0ziP7Yd0W_-RLZS-8zeK8FP9Y_0 2024-09-12T01:02:39.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.558+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13098057175054612338', time=2024-09-12T02:50:16.892004+0000, chain.objs.size()=1 2024-09-12T01:02:39.555 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.558+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.m4RgvvCX9dEv82YPaAlNNhOeMocMwBM_0 2024-09-12T01:02:39.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7287273628585090153', time=2024-09-12T02:50:16.893989+0000, chain.objs.size()=1 2024-09-12T01:02:39.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.fRMWR_TsZgbaqVW6okEMLJXiPW6e8v-_0 2024-09-12T01:02:39.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12584807951216882240', time=2024-09-12T02:50:16.946112+0000, chain.objs.size()=1 2024-09-12T01:02:39.557 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.llcImJ_G5ouOVtQ3kq01q1gSaVWfxo5_0 2024-09-12T01:02:39.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2198929558493288552', time=2024-09-12T02:50:16.957454+0000, chain.objs.size()=1 2024-09-12T01:02:39.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.v1ULbMLqWnpz08-oB2EXl5YpkqoJweE_0 2024-09-12T01:02:39.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8666027164002809763', time=2024-09-12T02:50:16.964356+0000, chain.objs.size()=1 2024-09-12T01:02:39.558 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.vHOUFkk3u2ybO9c4-HSnZDAE5MuZ3bG_0 2024-09-12T01:02:39.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16074860195324939420', time=2024-09-12T02:50:16.996782+0000, chain.objs.size()=1 2024-09-12T01:02:39.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.yz-h7BYGUQDYepAeXikM6PcQRziDqUk_0 2024-09-12T01:02:39.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.568203955855902521', time=2024-09-12T02:50:17.026926+0000, chain.objs.size()=1 2024-09-12T01:02:39.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.OhVtZNODSTkjnA6FVhHUl-qJXbVfDde_0 2024-09-12T01:02:39.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7785386448883962069', time=2024-09-12T02:50:17.133544+0000, chain.objs.size()=1 2024-09-12T01:02:39.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.I-UsEMNsRxWZOS0nDI8-I0djSuMZ3of_0 2024-09-12T01:02:39.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.562+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13233051194596412531', time=2024-09-12T02:50:17.201186+0000, chain.objs.size()=1 2024-09-12T01:02:39.559 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.562+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.YsaqX2AkKMI365xtJvY5lzzW2WudbN6_0 2024-09-12T01:02:39.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.566+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13202885285796279213', time=2024-09-12T02:50:17.251218+0000, chain.objs.size()=1 2024-09-12T01:02:39.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.566+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.K8MrBmqLAAHgekQIdJYaSRHQIdJMePM_0 2024-09-12T01:02:39.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.566+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15453482079534081179', time=2024-09-12T02:50:17.271792+0000, chain.objs.size()=1 2024-09-12T01:02:39.560 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.566+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.0Mx3qrQ0bick4wmtPtLyFQF_OswJgI2_0 2024-09-12T01:02:39.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.566+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16939784870762641990', time=2024-09-12T02:50:17.285323+0000, chain.objs.size()=1 2024-09-12T01:02:39.561 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.566+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.0yOkizJDlxp7Y_7I-Jy573ov08vKpJR_0 2024-09-12T01:02:39.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.566+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2649679335755871597', time=2024-09-12T02:50:17.428118+0000, chain.objs.size()=1 2024-09-12T01:02:39.562 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.566+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.PCc9TO8laEGvIgvc9YgDXXvdKRWiaPr_0 2024-09-12T01:02:39.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.566+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9200261072920887704', time=2024-09-12T02:50:17.482344+0000, chain.objs.size()=1 2024-09-12T01:02:39.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.566+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.rx97MuAg0dosVgetXhNJKwrJmtbIABl_0 2024-09-12T01:02:39.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.566+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2550775092129172236', time=2024-09-12T02:50:17.504462+0000, chain.objs.size()=1 2024-09-12T01:02:39.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.566+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.XiKYOpGF_5nTg5OPokMtEBQ2OdjEcaF_0 2024-09-12T01:02:39.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.566+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2550653805598570896', time=2024-09-12T02:50:17.508190+0000, chain.objs.size()=1 2024-09-12T01:02:39.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.566+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.SU0ZPoAp_j2pDBvisbpA64y3NqWWfND_0 2024-09-12T01:02:39.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.566+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.157736440185547537', time=2024-09-12T02:50:17.655539+0000, chain.objs.size()=1 2024-09-12T01:02:39.564 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.566+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.y7uwz1Dn9I8V72LOXlt4WdghGuraEMx_0 2024-09-12T01:02:39.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9550125754286307000', time=2024-09-12T02:50:17.691048+0000, chain.objs.size()=1 2024-09-12T01:02:39.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.AOTCtBNjo9sf9rkUCsUWEuSRC7azEKf_0 2024-09-12T01:02:39.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8035867779271567285', time=2024-09-12T02:50:17.693536+0000, chain.objs.size()=1 2024-09-12T01:02:39.565 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.lq_9Vg4R_XHV0nDUZyMF5aKGLb7GY_v_0 2024-09-12T01:02:39.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8277847247707743994', time=2024-09-12T02:50:17.713019+0000, chain.objs.size()=1 2024-09-12T01:02:39.566 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.OY5-a5UJqPDpcL6R4mk9qZ2nIQ7dcXY_0 2024-09-12T01:02:39.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16500140821225922542', time=2024-09-12T02:50:39.451363+0000, chain.objs.size()=1 2024-09-12T01:02:39.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Z7QrGjxSgqPIartoSNP4HsWBTMKP9um_0 2024-09-12T01:02:39.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8189674611457939776', time=2024-09-12T02:50:39.525986+0000, chain.objs.size()=1 2024-09-12T01:02:39.567 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.nxQL9hXyr8PzNF0hxzPmfYhGtyJ53TR_0 2024-09-12T01:02:39.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8825224757054161171', time=2024-09-12T02:50:39.598254+0000, chain.objs.size()=1 2024-09-12T01:02:39.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.CjXoskD2mIlQnfzIcWVA6zQRlI82YZb_0 2024-09-12T01:02:39.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.570+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5350355908089891526', time=2024-09-12T02:50:39.610101+0000, chain.objs.size()=1 2024-09-12T01:02:39.568 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.570+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.A_0KqRxcw4d-1N3WWIqu_sEeK97Yd3A_0 2024-09-12T01:02:39.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.574+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6927681528234652557', time=2024-09-12T02:50:39.766704+0000, chain.objs.size()=1 2024-09-12T01:02:39.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.574+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.oIzxPOX0gB-hVFwPnMZ9-A93fLDZA-T_0 2024-09-12T01:02:39.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.574+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9294270415684773526', time=2024-09-12T02:50:39.770801+0000, chain.objs.size()=1 2024-09-12T01:02:39.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.574+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.NlAo8229BvHThxT6eVTtOv_KWwl1lxR_0 2024-09-12T01:02:39.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.574+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9247993086600058736', time=2024-09-12T02:50:39.774932+0000, chain.objs.size()=1 2024-09-12T01:02:39.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.574+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.SDCZ5vmEpc0nv9U9tIckG2WJHsCOo78_0 2024-09-12T01:02:39.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.574+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2695931524052783116', time=2024-09-12T02:50:39.790347+0000, chain.objs.size()=1 2024-09-12T01:02:39.570 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.574+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.H7MgoWjOSZZXqPWwsc8PekgEj2Xd1-d_0 2024-09-12T01:02:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.574+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11904606782924104697', time=2024-09-12T02:50:39.813761+0000, chain.objs.size()=1 2024-09-12T01:02:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.574+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.dbQP6-E48rGSHRnWUgrfROwq6EFs54M_0 2024-09-12T01:02:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.574+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7949446015173714780', time=2024-09-12T02:50:40.017836+0000, chain.objs.size()=1 2024-09-12T01:02:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.574+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.GrP8RGpENtmgyEhyABxSwWUzHUmDR91_0 2024-09-12T01:02:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.574+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8890813748106227406', time=2024-09-12T02:50:40.040395+0000, chain.objs.size()=1 2024-09-12T01:02:39.571 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.574+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.IN1YAIMZ1HfFLQTb6EaOW9l1nvKEavV_0 2024-09-12T01:02:39.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.574+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3446965701261617803', time=2024-09-12T02:50:40.043875+0000, chain.objs.size()=1 2024-09-12T01:02:39.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.574+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.mQ5w-Uh2a5TfF-ChtmSTAxSsjd0orCS_0 2024-09-12T01:02:39.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16014755935462691282', time=2024-09-12T02:50:40.063899+0000, chain.objs.size()=1 2024-09-12T01:02:39.572 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.cBp_o2Qn9v9zEtx4tlvQA7UmqywIBAq_0 2024-09-12T01:02:39.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8956454481034191417', time=2024-09-12T02:50:40.070595+0000, chain.objs.size()=1 2024-09-12T01:02:39.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Vt30abnCjYDUdelNjazlqLr0TaYYF--_0 2024-09-12T01:02:39.573 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.898760754854767651', time=2024-09-12T02:50:40.084297+0000, chain.objs.size()=1 2024-09-12T01:02:39.574 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_._Zjssu4cWeXInQdH6Nrl8wttYlYEGsV_0 2024-09-12T01:02:39.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1553520730094342878', time=2024-09-12T02:50:40.633981+0000, chain.objs.size()=1 2024-09-12T01:02:39.575 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.yjGbu3J6C9Ayd-0nGhuTH_V-L8J4Gt-_0 2024-09-12T01:02:39.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5623816515536207268', time=2024-09-12T02:50:40.732312+0000, chain.objs.size()=1 2024-09-12T01:02:39.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.8eJegEfOSVuzZrPhzndKe5hMPdzdWFj_0 2024-09-12T01:02:39.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14273165967679963560', time=2024-09-12T02:50:40.824517+0000, chain.objs.size()=1 2024-09-12T01:02:39.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.-QP9IFJcjKC0lOUpS5PJ4LY1J73gnAi_0 2024-09-12T01:02:39.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.710553860239828248', time=2024-09-12T02:50:40.873456+0000, chain.objs.size()=1 2024-09-12T01:02:39.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.OLbPyv3F659p78Ke6T95siD5ixFwCt6_0 2024-09-12T01:02:39.576 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16521237711057455988', time=2024-09-12T02:50:40.880299+0000, chain.objs.size()=1 2024-09-12T01:02:39.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.H4PJ7dcyilXWkQtbq9dze1g65xFamqi_0 2024-09-12T01:02:39.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4559290789119342914', time=2024-09-12T02:50:40.884568+0000, chain.objs.size()=1 2024-09-12T01:02:39.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.U0SBfRRswfjBeLWneldm8p4pO72kaed_0 2024-09-12T01:02:39.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7345476223108577824', time=2024-09-12T02:50:41.024351+0000, chain.objs.size()=1 2024-09-12T01:02:39.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_._Mp3_sB2NVONXPiRvGduvY2sCH07n73_0 2024-09-12T01:02:39.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17424790937445947244', time=2024-09-12T02:50:41.055014+0000, chain.objs.size()=1 2024-09-12T01:02:39.577 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.578+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.kw4tj2ALqWpjI-LuG1BuieRHmRY6OGU_0 2024-09-12T01:02:39.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.582+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15933065905143266989', time=2024-09-12T02:50:41.083118+0000, chain.objs.size()=1 2024-09-12T01:02:39.580 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.582+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.T4bwZc2lYn94duFZgaacplTI_6xOANi_0 2024-09-12T01:02:39.583 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.586+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/45438 2024-09-12T01:02:39.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T01:02:39.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18004408117322577526', time=2024-09-12T02:50:41.114323+0000, chain.objs.size()=1 2024-09-12T01:02:39.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.OqFYTHy6QY7V1hsaPbwmQpcfhJnr2JD_0 2024-09-12T01:02:39.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16329593570167252173', time=2024-09-12T02:50:41.119119+0000, chain.objs.size()=1 2024-09-12T01:02:39.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.DFr_ohPh5smJECZi8GcKQYMSwiuerHo_0 2024-09-12T01:02:39.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15102733766157215556', time=2024-09-12T02:50:41.122597+0000, chain.objs.size()=1 2024-09-12T01:02:39.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.GXwqssN3IwGqkx6U5wgFxzcbvRFf5o__0 2024-09-12T01:02:39.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1306986249987049845', time=2024-09-12T02:50:41.138036+0000, chain.objs.size()=1 2024-09-12T01:02:39.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.y5r4b_ECOKZIEeFRUbmqjswKzkbT5kl_0 2024-09-12T01:02:39.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7756520488680627724', time=2024-09-12T02:50:41.141935+0000, chain.objs.size()=1 2024-09-12T01:02:39.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.68oMQ_pLKb9IceY09ZI7baQQBNnxLMQ_0 2024-09-12T01:02:39.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15798180276391831065', time=2024-09-12T02:50:41.298722+0000, chain.objs.size()=1 2024-09-12T01:02:39.586 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.uUM9amfon3BWSIVjseAfE2bIyYqCJw7_0 2024-09-12T01:02:39.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11042936751798147949', time=2024-09-12T02:50:41.371947+0000, chain.objs.size()=1 2024-09-12T01:02:39.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.R0rJ-H9eC5AUCJDWIo3jcYD2hWeFiyR_0 2024-09-12T01:02:39.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1075613838196511991', time=2024-09-12T02:50:41.403501+0000, chain.objs.size()=1 2024-09-12T01:02:39.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.AEF5PXRYalJXTejRenmMo1rSf9WjZTG_0 2024-09-12T01:02:39.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.809254991126182416', time=2024-09-12T02:50:41.571518+0000, chain.objs.size()=1 2024-09-12T01:02:39.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.S28yH1KSmgUbYotjFtJotwDylZ_HyJf_0 2024-09-12T01:02:39.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6466245964812323224', time=2024-09-12T02:50:41.620252+0000, chain.objs.size()=1 2024-09-12T01:02:39.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.NemdXAVfpCuea-g84DFkd9U_oWNzDY7_0 2024-09-12T01:02:39.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.727634705178953398', time=2024-09-12T02:50:41.644311+0000, chain.objs.size()=1 2024-09-12T01:02:39.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ofkZc1Sn2gsCBKxbddyHKV694TTyzeu_0 2024-09-12T01:02:39.587 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6284295310252479857', time=2024-09-12T02:50:44.219845+0000, chain.objs.size()=1 2024-09-12T01:02:39.588 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.590+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.328__shadow_.hWFoqJYt5H0hHHdZW0eQVEr7g-ujSb8_0 2024-09-12T01:02:39.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2277792307828666706', time=2024-09-12T02:51:20.614312+0000, chain.objs.size()=1 2024-09-12T01:02:39.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.382__shadow_.UsH2P0q8YuYifUAyWbWgUE5g1_Om8PY_0 2024-09-12T01:02:39.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14512148807541337844', time=2024-09-12T02:52:12.579444+0000, chain.objs.size()=1 2024-09-12T01:02:39.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.450__shadow_.GPYTXvz1o_lKYAeZMeXtWRl-xOE8Ug9_0 2024-09-12T01:02:39.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2115977448600053488', time=2024-09-12T02:52:36.997547+0000, chain.objs.size()=1 2024-09-12T01:02:39.590 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.484__shadow_.w7wl_gUMw__xhWOsE2cuykt_D68eAXd_0 2024-09-12T01:02:39.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13053095660300043285', time=2024-09-12T02:52:47.487496+0000, chain.objs.size()=1 2024-09-12T01:02:39.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.500__shadow_.k96CwR6jGUazAHdWQlY72e8QbvaoZ5h_0 2024-09-12T01:02:39.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6335352898035842041', time=2024-09-12T02:54:50.683176+0000, chain.objs.size()=1 2024-09-12T01:02:39.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:viGH2Koqbnt.iOSmNqtxlBrl4d8M6ze_.mecHq0nWbAu9d0CvLOi-oVHPPlSSbSL_0 2024-09-12T01:02:39.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12931243922621320992', time=2024-09-12T02:54:56.718252+0000, chain.objs.size()=1 2024-09-12T01:02:39.591 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.573__shadow_.8mYQlogK2sOOIFA_flHw_fG56FAYGi__0 2024-09-12T01:02:39.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.594+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3164379232657194926', time=2024-09-12T02:58:31.339778+0000, chain.objs.size()=1 2024-09-12T01:02:39.592 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.594+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.644__shadow_.hLccb3LXbVIvEDIVO5YBsaQcsxxiQkX_0 2024-09-12T01:02:39.596 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.598+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:39.598 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.602+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:02:39.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.600 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47257' 2024-09-12T01:02:39.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4444032902189433240', time=2024-09-12T02:46:03.747637+0000, chain.objs.size()=3 2024-09-12T01:02:39.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.159__multipart_mymultipart-STANDARD.2~ehRpmzgDpzf3HFBejTTWdOYXFHcZYaZ.1 2024-09-12T01:02:39.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.159__multipart_mymultipart-STANDARD.2~ehRpmzgDpzf3HFBejTTWdOYXFHcZYaZ.2 2024-09-12T01:02:39.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.159__multipart_mymultipart-STANDARD.2~ehRpmzgDpzf3HFBejTTWdOYXFHcZYaZ.3 2024-09-12T01:02:39.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='_314vqDAJx1xYGiewkAgV7cxTOGyD4MT', time=2024-09-12T02:46:09.371094+0000, chain.objs.size()=1 2024-09-12T01:02:39.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.163__shadow_.aUzRrVrOlmLYam8l7k5S6VntnTrkFaC_0 2024-09-12T01:02:39.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6311700721037637624', time=2024-09-12T02:46:29.333274+0000, chain.objs.size()=1 2024-09-12T01:02:39.602 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.181__shadow_.H27K0PXKnqqeGP5Ifchpi6wULvSymd2_0 2024-09-12T01:02:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12590338933123939792', time=2024-09-12T02:48:18.977916+0000, chain.objs.size()=1 2024-09-12T01:02:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.230__shadow_.exHmCs7JnpZihi8kCoqVB30Cypm-881_0 2024-09-12T01:02:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7251815911445851252', time=2024-09-12T02:48:33.556374+0000, chain.objs.size()=1 2024-09-12T01:02:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.247__shadow_.dpDLI5Wk20_DM01QFegxu-rDw7T_Ufc_0 2024-09-12T01:02:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3433952960920865769', time=2024-09-12T02:48:34.261898+0000, chain.objs.size()=1 2024-09-12T01:02:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.248__shadow_.eT7bDjXzieAQ6Khq-56DsCgKqfCBjQu_0 2024-09-12T01:02:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9865204742271796461', time=2024-09-12T02:48:38.728749+0000, chain.objs.size()=1 2024-09-12T01:02:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.254__shadow_.N70Pcsik2cl9vece1tyWov46Geq5BUC_0 2024-09-12T01:02:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13822469633113653872', time=2024-09-12T02:49:05.498036+0000, chain.objs.size()=1 2024-09-12T01:02:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.B0aGONvdO7q7lpVq9f8m8cRD8HARTPf_0 2024-09-12T01:02:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8130910415500952651', time=2024-09-12T02:49:05.577628+0000, chain.objs.size()=1 2024-09-12T01:02:39.603 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.WRpW7mzdMpXbe4dk_96jf1YlUPo8F_K_0 2024-09-12T01:02:39.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3918921351856223591', time=2024-09-12T02:49:05.718312+0000, chain.objs.size()=1 2024-09-12T01:02:39.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.s2IW-ZS7jsbEmRCButM9QPhWWvyv8mT_0 2024-09-12T01:02:39.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17291209571619720370', time=2024-09-12T02:49:05.719587+0000, chain.objs.size()=1 2024-09-12T01:02:39.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.y3c302axJ4DE9rOP96lW-janoeRw6S-_0 2024-09-12T01:02:39.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1136902427378653229', time=2024-09-12T02:49:05.844107+0000, chain.objs.size()=1 2024-09-12T01:02:39.604 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.606+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.-yRuZClc6URM4gamHfhIdDG5n0G3cAg_0 2024-09-12T01:02:39.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4309413391694166688', time=2024-09-12T02:49:05.863986+0000, chain.objs.size()=1 2024-09-12T01:02:39.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.bns8cfvQWzV8XTgYxxWYEO38z_DA7tQ_0 2024-09-12T01:02:39.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16946373032782771418', time=2024-09-12T02:49:05.865055+0000, chain.objs.size()=1 2024-09-12T01:02:39.605 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.IK0mi3YN9hsI5cDnbJwY2pK7GAgZDCC_0 2024-09-12T01:02:39.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4202874689466561827', time=2024-09-12T02:49:06.032027+0000, chain.objs.size()=1 2024-09-12T01:02:39.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.aHgx_x5kXGwoInt6SQRKvS6GQqP8SDs_0 2024-09-12T01:02:39.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8012522441433105220', time=2024-09-12T02:49:06.067308+0000, chain.objs.size()=1 2024-09-12T01:02:39.607 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.c80S7YbVsEARwUctL9BSevVJsPrtd9a_0 2024-09-12T01:02:39.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13630525600227656354', time=2024-09-12T02:49:06.074087+0000, chain.objs.size()=1 2024-09-12T01:02:39.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.szy8zHOzUq2tUP4GIHsLkLxTN9kYpoI_0 2024-09-12T01:02:39.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2563526539647272789', time=2024-09-12T02:49:06.312842+0000, chain.objs.size()=1 2024-09-12T01:02:39.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.jKJaNPJkM7_mOK0ZAYgLB-2qAo1Q4s-_0 2024-09-12T01:02:39.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17616294758509051586', time=2024-09-12T02:49:06.320601+0000, chain.objs.size()=1 2024-09-12T01:02:39.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.BbG84DEOtphmCPvqzi57NQwH4XVcwO8_0 2024-09-12T01:02:39.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3787525181558582674', time=2024-09-12T02:49:06.327783+0000, chain.objs.size()=1 2024-09-12T01:02:39.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.G0n43nFcJ4QHa6uv738z5vDKnXW6-u-_0 2024-09-12T01:02:39.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13642836689892849733', time=2024-09-12T02:49:06.328639+0000, chain.objs.size()=1 2024-09-12T01:02:39.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.At9KCpCedhX5sH-uToguf2_1Df_t-sy_0 2024-09-12T01:02:39.608 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.678756658555484422', time=2024-09-12T02:49:06.363169+0000, chain.objs.size()=1 2024-09-12T01:02:39.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.610+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.-SQahDoAFwaTNoawhTJo_jKUzLybEBZ_0 2024-09-12T01:02:39.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6636146914872144172', time=2024-09-12T02:49:06.543286+0000, chain.objs.size()=1 2024-09-12T01:02:39.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.8wnF6852MmFnol_yF_9bbaMHtppQlq6_0 2024-09-12T01:02:39.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1604743041899969233', time=2024-09-12T02:49:06.560736+0000, chain.objs.size()=1 2024-09-12T01:02:39.609 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.o7wb9HHC9SH49Gk_NF1UkFFfX24oyAg_0 2024-09-12T01:02:39.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16169415857909084341', time=2024-09-12T02:49:06.579725+0000, chain.objs.size()=1 2024-09-12T01:02:39.610 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.E0Tdx5hMatsGjX5HqGn5LAiGwIIGGbh_0 2024-09-12T01:02:39.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.614+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4370603114250452712', time=2024-09-12T02:49:06.755441+0000, chain.objs.size()=1 2024-09-12T01:02:39.611 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.614+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.AVCfacW6uURmtIvSQptdG-VRx6vs3g__0 2024-09-12T01:02:39.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.239394021773143806', time=2024-09-12T02:49:06.832695+0000, chain.objs.size()=1 2024-09-12T01:02:39.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.RVUaSKsXO6VlW8PCQVwjgZtN6UmRPf8_0 2024-09-12T01:02:39.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1116744841360309683', time=2024-09-12T02:49:06.838187+0000, chain.objs.size()=1 2024-09-12T01:02:39.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9wAtuEvovUlEoqI6YVNjdThqT5Pon8j_0 2024-09-12T01:02:39.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9217907736984418806', time=2024-09-12T02:49:06.866830+0000, chain.objs.size()=1 2024-09-12T01:02:39.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_._8PxlQKl7AJEEkZycqbHSSv0Q02ohj4_0 2024-09-12T01:02:39.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1476802199831423794', time=2024-09-12T02:49:07.132396+0000, chain.objs.size()=1 2024-09-12T01:02:39.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.pIKoUpN3NKXAqDCDZusZ9284SlMciS3_0 2024-09-12T01:02:39.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9826726741840265340', time=2024-09-12T02:49:07.211666+0000, chain.objs.size()=1 2024-09-12T01:02:39.614 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.can12dxfM8snClGafqnWABdL9ZcIvID_0 2024-09-12T01:02:39.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4641732386614872201', time=2024-09-12T02:49:07.222783+0000, chain.objs.size()=1 2024-09-12T01:02:39.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.JOHbwxTGgnY9HrHvn58oNivHhvTRgmo_0 2024-09-12T01:02:39.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16200506022986733388', time=2024-09-12T02:49:07.320657+0000, chain.objs.size()=1 2024-09-12T01:02:39.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Xw8inU6c1Rw0GL4o8wVgGNPkO7PmSAU_0 2024-09-12T01:02:39.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9370868417484767985', time=2024-09-12T02:49:07.321884+0000, chain.objs.size()=1 2024-09-12T01:02:39.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.5Rc8wuEmF6tymcpDDQsgFG4D0lyOFhf_0 2024-09-12T01:02:39.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11221386851769355658', time=2024-09-12T02:49:07.403898+0000, chain.objs.size()=1 2024-09-12T01:02:39.615 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.618+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7r2rq2FKOTVuWIPYUnRz-wgiyI3hUCW_0 2024-09-12T01:02:39.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17319541557982883106', time=2024-09-12T02:49:07.433100+0000, chain.objs.size()=1 2024-09-12T01:02:39.617 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ZH56lhX18wWj3q6OPAQaqkEimHCwb_X_0 2024-09-12T01:02:39.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12143191317286442453', time=2024-09-12T02:49:24.659259+0000, chain.objs.size()=1 2024-09-12T01:02:39.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.285__shadow_.dk7Hw9sJghAMWN2O-M9uwIPfIRRLbXb_0 2024-09-12T01:02:39.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13189154142128951477', time=2024-09-12T02:49:30.971479+0000, chain.objs.size()=1 2024-09-12T01:02:39.618 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.FZmo6Py8TdfJkgMUNhddabL9-L8XNU9_0 2024-09-12T01:02:39.619 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12539605413896454379', time=2024-09-12T02:49:40.695026+0000, chain.objs.size()=1 2024-09-12T01:02:39.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.304__shadow_.HQSjrH69yADK42lnud4jDbqWkhd0nQD_0 2024-09-12T01:02:39.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5455106953630285237', time=2024-09-12T02:49:47.868684+0000, chain.objs.size()=1 2024-09-12T01:02:39.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.313__shadow_.gl8Aluh5xkSz1_dMGZTKt3VDr9yXL8g_0 2024-09-12T01:02:39.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11090500998446896102', time=2024-09-12T02:49:49.513102+0000, chain.objs.size()=1 2024-09-12T01:02:39.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.315__shadow_.i9RNiZExjfD1syxIxMI7u_9ci6vnxPu_0 2024-09-12T01:02:39.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.622+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6745611189179545788', time=2024-09-12T02:50:15.826957+0000, chain.objs.size()=1 2024-09-12T01:02:39.620 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.622+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.7ZtzeK6RjQjocGxKNJLRk5NXK_1GoI0_0 2024-09-12T01:02:39.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14460899765797572998', time=2024-09-12T02:50:15.835330+0000, chain.objs.size()=1 2024-09-12T01:02:39.621 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.uUaF_iskD-KdbGqbFVcmw0EPf1ObfoV_0 2024-09-12T01:02:39.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4333127363017906180', time=2024-09-12T02:50:15.854245+0000, chain.objs.size()=1 2024-09-12T01:02:39.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.c8KghAN4eI7rw1hTXbT24XWBPGEPgZt_0 2024-09-12T01:02:39.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10096118727140598793', time=2024-09-12T02:50:15.858282+0000, chain.objs.size()=1 2024-09-12T01:02:39.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Fc-2RXICR3Xzw5lI8bq55py-MXJHf3L_0 2024-09-12T01:02:39.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.777399199186979391', time=2024-09-12T02:50:15.880837+0000, chain.objs.size()=1 2024-09-12T01:02:39.622 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.SApw3WkQGDXuPE6muO1a-bYGzuBsut1_0 2024-09-12T01:02:39.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17174212716132903574', time=2024-09-12T02:50:15.909853+0000, chain.objs.size()=1 2024-09-12T01:02:39.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.NVN0HXSEw5-Y_veoK85C0Eri7bKbliN_0 2024-09-12T01:02:39.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2561293489218592180', time=2024-09-12T02:50:15.910544+0000, chain.objs.size()=1 2024-09-12T01:02:39.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Wgqe9cClIkPO_U1uFi4Qi2Yfp8u_M9I_0 2024-09-12T01:02:39.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.626+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18236671177008558465', time=2024-09-12T02:50:15.935148+0000, chain.objs.size()=1 2024-09-12T01:02:39.623 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.626+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.bVY7_yYCd0Uj1ZMtJjAgcx77fgzzOUl_0 2024-09-12T01:02:39.625 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2321158573346628403', time=2024-09-12T02:50:15.954548+0000, chain.objs.size()=1 2024-09-12T01:02:39.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.vJTyaF6JzoKOtdsO4NIHm8O_ai8eqKO_0 2024-09-12T01:02:39.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1603412770596773900', time=2024-09-12T02:50:16.164068+0000, chain.objs.size()=1 2024-09-12T01:02:39.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Dx5E-6yd9k6ot3j7W1y-4tnKOrxEe0R_0 2024-09-12T01:02:39.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1061127757924885311', time=2024-09-12T02:50:16.224345+0000, chain.objs.size()=1 2024-09-12T01:02:39.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.KLHTvszh__MVYUl0r-40DzO7seeBRl6_0 2024-09-12T01:02:39.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.630+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16549668866844054617', time=2024-09-12T02:50:16.227074+0000, chain.objs.size()=1 2024-09-12T01:02:39.626 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.630+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.3y1paHR6y-dXBY6tXzJYXGNLI7CX68-_0 2024-09-12T01:02:39.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11467175395446765076', time=2024-09-12T02:50:16.463847+0000, chain.objs.size()=1 2024-09-12T01:02:39.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ojKM0xz9MXghbHxRJBF-BLT5OyUM3ke_0 2024-09-12T01:02:39.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9455403490764518792', time=2024-09-12T02:50:16.475642+0000, chain.objs.size()=1 2024-09-12T01:02:39.630 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.CyLQczj-1vCYZkvGJZLJA3t2QzR7IHt_0 2024-09-12T01:02:39.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10311552276750471890', time=2024-09-12T02:50:16.644085+0000, chain.objs.size()=1 2024-09-12T01:02:39.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-8DShR-bwFYQPTMxON-ALGnuuPr3Y2x_0 2024-09-12T01:02:39.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.634+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15403191142969972248', time=2024-09-12T02:50:16.655335+0000, chain.objs.size()=1 2024-09-12T01:02:39.631 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.634+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.gicfcl1FueiMGJoC3qk0Vs5-lar_2sM_0 2024-09-12T01:02:39.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17534400015561427809', time=2024-09-12T02:50:16.678028+0000, chain.objs.size()=1 2024-09-12T01:02:39.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.LOktHNlkJ-IBsptEHfOE41PpoVwIzLn_0 2024-09-12T01:02:39.632 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16123129077674875898', time=2024-09-12T02:50:16.701705+0000, chain.objs.size()=1 2024-09-12T01:02:39.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.hG1cPmYa9lvDxJK6b7Nu3lOXFP1WbDI_0 2024-09-12T01:02:39.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6063300943511755679', time=2024-09-12T02:50:16.719679+0000, chain.objs.size()=1 2024-09-12T01:02:39.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.bZEHMDfHP4o4iW_KpfnKjeYM6UDpzMW_0 2024-09-12T01:02:39.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1378213737556336271', time=2024-09-12T02:50:16.734263+0000, chain.objs.size()=1 2024-09-12T01:02:39.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.SlJ3TDxz15sChZQlvnsZtrZKwAuTjou_0 2024-09-12T01:02:39.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3283517661495895890', time=2024-09-12T02:50:16.738924+0000, chain.objs.size()=1 2024-09-12T01:02:39.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.1s93O3KKnkC2sxBo628_PtHRRVRQ41b_0 2024-09-12T01:02:39.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13410632984971906067', time=2024-09-12T02:50:16.906748+0000, chain.objs.size()=1 2024-09-12T01:02:39.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.mkzsL4Zp9Q5togXhnsk7RonlreqISyu_0 2024-09-12T01:02:39.633 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10011135393206256966', time=2024-09-12T02:50:17.033771+0000, chain.objs.size()=1 2024-09-12T01:02:39.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.b4RL8KGctfJsOoDdLDsCJ5AijXcLWQV_0 2024-09-12T01:02:39.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13785402203322273466', time=2024-09-12T02:50:17.160901+0000, chain.objs.size()=1 2024-09-12T01:02:39.634 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-EKEOTXI_D8ekl_3COCWm5wHospT1Sz_0 2024-09-12T01:02:39.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10799231159005256705', time=2024-09-12T02:50:17.169315+0000, chain.objs.size()=1 2024-09-12T01:02:39.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.3-Q0RxJbA18nKes2HsCz4YT3PoB1L-o_0 2024-09-12T01:02:39.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14291588085567104762', time=2024-09-12T02:50:17.233764+0000, chain.objs.size()=1 2024-09-12T01:02:39.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.0xuyvZVzG5QSp3tr8vwf9YmFUs-uUFV_0 2024-09-12T01:02:39.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18064740540517971908', time=2024-09-12T02:50:17.488414+0000, chain.objs.size()=1 2024-09-12T01:02:39.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.JVKgn15aFaxc22AILVCnGddszlhRbbn_0 2024-09-12T01:02:39.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10004932941595024027', time=2024-09-12T02:50:17.642626+0000, chain.objs.size()=1 2024-09-12T01:02:39.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.IcXiVcqrzo7RP7GbjVqfrcBdCW0dgMD_0 2024-09-12T01:02:39.636 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10789712788451835689', time=2024-09-12T02:50:17.684645+0000, chain.objs.size()=1 2024-09-12T01:02:39.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.5UU8izjlvLzrwjiEQcmWBO0TPDnaHXU_0 2024-09-12T01:02:39.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5465222307834669335', time=2024-09-12T02:50:17.695462+0000, chain.objs.size()=1 2024-09-12T01:02:39.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.mU8V1_t-m-Mf2XUb1uE80fMXoidGnhp_0 2024-09-12T01:02:39.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17290637473204006652', time=2024-09-12T02:50:17.697746+0000, chain.objs.size()=1 2024-09-12T01:02:39.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.638+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.IoseorUjTVyK-3HYO9qb0tMIr5xR72t_0 2024-09-12T01:02:39.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.642+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10339604701504663086', time=2024-09-12T02:50:17.700655+0000, chain.objs.size()=1 2024-09-12T01:02:39.637 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.642+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.yTcUj6wCNyRoeioRiTOcxcoryJAF2_8_0 2024-09-12T01:02:39.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.642+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16788755435272309707', time=2024-09-12T02:50:39.489673+0000, chain.objs.size()=1 2024-09-12T01:02:39.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.642+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.KbPYWAabexodOVr8D6LKEtyDduoICM4_0 2024-09-12T01:02:39.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.642+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16408090263017879694', time=2024-09-12T02:50:39.607988+0000, chain.objs.size()=1 2024-09-12T01:02:39.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.642+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.vxH5VI-2lIzBcoNfPeRCYwtUdIFxAc__0 2024-09-12T01:02:39.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.642+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2626502971843070190', time=2024-09-12T02:50:39.610274+0000, chain.objs.size()=1 2024-09-12T01:02:39.638 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.642+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.WdgCLUBngBuJf5ZJngyw3HOPB2svgVU_0 2024-09-12T01:02:39.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16941856506467273307', time=2024-09-12T02:50:39.722123+0000, chain.objs.size()=1 2024-09-12T01:02:39.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.KoCoL4YuXIVzbTW3jV9X7rths2sbpcw_0 2024-09-12T01:02:39.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14492821683570741605', time=2024-09-12T02:50:39.744091+0000, chain.objs.size()=1 2024-09-12T01:02:39.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.91Eh2D64JE8uk5MI6aDsYuWlCtBj2oQ_0 2024-09-12T01:02:39.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3435021842763906042', time=2024-09-12T02:50:39.825132+0000, chain.objs.size()=1 2024-09-12T01:02:39.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.EVfnwJg515NR59UOtlwzKGsXOT9S239_0 2024-09-12T01:02:39.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14856749703301062753', time=2024-09-12T02:50:39.840326+0000, chain.objs.size()=1 2024-09-12T01:02:39.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.JM614es50IRc7o8vQmRd1cH3OC3FWIX_0 2024-09-12T01:02:39.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2921981632997782787', time=2024-09-12T02:50:39.997882+0000, chain.objs.size()=1 2024-09-12T01:02:39.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Gauqcf4gIJWi3qMvCJCM8JqmtO1gSwn_0 2024-09-12T01:02:39.643 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9084998246739952936', time=2024-09-12T02:50:40.043784+0000, chain.objs.size()=1 2024-09-12T01:02:39.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.zrWT6Yu7gxWvzahKIc0xnkppb8hFWIn_0 2024-09-12T01:02:39.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1631140293564895755', time=2024-09-12T02:50:40.067736+0000, chain.objs.size()=1 2024-09-12T01:02:39.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.1eBm4dpJ4O_jtUU_Ayf3Cpke9FQq9Wq_0 2024-09-12T01:02:39.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15847017138251612407', time=2024-09-12T02:50:40.097553+0000, chain.objs.size()=1 2024-09-12T01:02:39.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.h_hr0lwLsGWvfsPh3oVgt6Dskbl0Pxx_0 2024-09-12T01:02:39.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8450927649498415810', time=2024-09-12T02:50:40.142460+0000, chain.objs.size()=1 2024-09-12T01:02:39.644 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.aTjaodM32_ZaxTWALivzNJO33gJWzSR_0 2024-09-12T01:02:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1062031679520611583', time=2024-09-12T02:50:40.150155+0000, chain.objs.size()=1 2024-09-12T01:02:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.perDOjDHKfTiYjWghPea8VZ1pnpXzKw_0 2024-09-12T01:02:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17672303792989688865', time=2024-09-12T02:50:40.601313+0000, chain.objs.size()=1 2024-09-12T01:02:39.645 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.646+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.f6rHYfcOTM93MMFgSGrRMV1ye3C_qlA_0 2024-09-12T01:02:39.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14553426141386036568', time=2024-09-12T02:50:40.817526+0000, chain.objs.size()=1 2024-09-12T01:02:39.646 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.h8EEQVc3mk_5gGPY064i7nOymZmLxZs_0 2024-09-12T01:02:39.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4747328679743632124', time=2024-09-12T02:50:40.832486+0000, chain.objs.size()=1 2024-09-12T01:02:39.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.2GgToy1eZYMc39yZlXX5PPo4iVbNFnl_0 2024-09-12T01:02:39.647 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15137253895336109698', time=2024-09-12T02:50:40.869194+0000, chain.objs.size()=1 2024-09-12T01:02:39.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.G5VLSOXkUudl_mZHAu_3-J1Y9ri8Yqk_0 2024-09-12T01:02:39.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9615058220089833469', time=2024-09-12T02:50:40.897901+0000, chain.objs.size()=1 2024-09-12T01:02:39.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.76seRDGKbUQECEqwae_n0g4yxGumbTV_0 2024-09-12T01:02:39.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.650+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6860587392770002746', time=2024-09-12T02:50:41.006728+0000, chain.objs.size()=1 2024-09-12T01:02:39.648 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.650+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.uIVungMyCBTOVQjtHSsvYb2933POkVL_0 2024-09-12T01:02:39.650 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.654+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16315689612843453815', time=2024-09-12T02:50:41.086956+0000, chain.objs.size()=1 2024-09-12T01:02:39.651 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.654+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.HIBA15hcw6j1jJ5erThdswdZ6SbcdM8_0 2024-09-12T01:02:39.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10173313766279084465', time=2024-09-12T02:50:41.311569+0000, chain.objs.size()=1 2024-09-12T01:02:39.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Lo8iiO4UyHC0WZKUOzOAMFuvByZs_0__0 2024-09-12T01:02:39.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16561336060710872323', time=2024-09-12T02:50:41.379023+0000, chain.objs.size()=1 2024-09-12T01:02:39.653 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.cU8OPLLMXcRASO1hNaL9QLRnHWSTodo_0 2024-09-12T01:02:39.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10044959317770758067', time=2024-09-12T02:50:41.434072+0000, chain.objs.size()=1 2024-09-12T01:02:39.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.yJ-mLznccofQey2rhgLOtQtllUN0zY1_0 2024-09-12T01:02:39.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12647765983628781531', time=2024-09-12T02:50:41.606462+0000, chain.objs.size()=1 2024-09-12T01:02:39.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.TUQLTGs1U8SF2SXJi2GbRJjhM3HU4QH_0 2024-09-12T01:02:39.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12454803054120304574', time=2024-09-12T02:50:47.023619+0000, chain.objs.size()=1 2024-09-12T01:02:39.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.332__shadow_.T472YUEEqOzQtvg2zv7dLtFlSKgTkO__0 2024-09-12T01:02:39.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14542111412473568846', time=2024-09-12T02:50:52.916528+0000, chain.objs.size()=1 2024-09-12T01:02:39.654 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.341__shadow_.JvRuuUqVxsERCRmJZl4-qkgA12wt8d__0 2024-09-12T01:02:39.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.658+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3693603497615721472', time=2024-09-12T02:52:36.198061+0000, chain.objs.size()=1 2024-09-12T01:02:39.655 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.658+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.483__shadow_.be_cGyEgRzZ1BVARqhgHseVkFq2E13o_0 2024-09-12T01:02:39.659 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.662+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/47257 2024-09-12T01:02:39.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T01:02:39.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10643632181855726294', time=2024-09-12T02:52:36.998033+0000, chain.objs.size()=1 2024-09-12T01:02:39.661 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.484__shadow_.DksVIKZUvP7saTTr884uR0RkxO87erK_0 2024-09-12T01:02:39.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.372837462235259496', time=2024-09-12T02:52:38.739549+0000, chain.objs.size()=3 2024-09-12T01:02:39.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.486__shadow_.VRPSIR4SAzXCdEWz6BDQlp2bte-vC-c_0 2024-09-12T01:02:39.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.486__shadow_.VRPSIR4SAzXCdEWz6BDQlp2bte-vC-c_1 2024-09-12T01:02:39.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.486__shadow_.VRPSIR4SAzXCdEWz6BDQlp2bte-vC-c_2 2024-09-12T01:02:39.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15121501749729848285', time=2024-09-12T02:52:47.488140+0000, chain.objs.size()=1 2024-09-12T01:02:39.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.500__shadow_.k96CwR6jGUazAHdWQlY72e8QbvaoZ5h_0 2024-09-12T01:02:39.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2874873395185260078', time=2024-09-12T02:52:54.146686+0000, chain.objs.size()=6 2024-09-12T01:02:39.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.1 2024-09-12T01:02:39.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.2 2024-09-12T01:02:39.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.3 2024-09-12T01:02:39.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.4 2024-09-12T01:02:39.662 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.5 2024-09-12T01:02:39.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.6 2024-09-12T01:02:39.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1063492065728753733', time=2024-09-12T02:53:02.376933+0000, chain.objs.size()=1 2024-09-12T01:02:39.663 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.666+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.517__shadow_.8xY8qLEI5Wid5Tn6p8wyu3n2EV_O_1X_0 2024-09-12T01:02:39.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.670+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15473391238404987167', time=2024-09-12T02:54:28.393164+0000, chain.objs.size()=2 2024-09-12T01:02:39.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.555__shadow_.wOVcTKuRf3yAfsCBRLnAQcrS5elYycA_0 2024-09-12T01:02:39.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.555__shadow_.wOVcTKuRf3yAfsCBRLnAQcrS5elYycA_1 2024-09-12T01:02:39.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.670+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3802122289751129907', time=2024-09-12T02:55:22.752765+0000, chain.objs.size()=1 2024-09-12T01:02:39.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:cpQJK7hQ8145ZnUWEDn8MOlhuJcUW9R_.qxOCTA0LMKi_OorPC5oaeTc_uCVZFfU_0 2024-09-12T01:02:39.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.670+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16417181487141163586', time=2024-09-12T02:58:27.559142+0000, chain.objs.size()=1 2024-09-12T01:02:39.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.639__shadow_.QKyt2_wB2C5svKAMH9t4XqhMefdzMHA_0 2024-09-12T01:02:39.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.670+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10658291745803948126', time=2024-09-12T02:58:36.048556+0000, chain.objs.size()=1 2024-09-12T01:02:39.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.649__shadow_.k_ZgqrFbtmzV2DE17y0CZnq43QoXWhh_0 2024-09-12T01:02:39.668 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.670+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8936306339722840165', time=2024-09-12T02:59:19.005202+0000, chain.objs.size()=1 2024-09-12T01:02:39.669 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.670+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.709__shadow_.UimcDdhYacMwVcHgYv6PHLZlY4ysUsC_0 2024-09-12T01:02:39.671 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.674+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:39.674 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.678+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:02:39.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.678+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.675 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.678+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44387' 2024-09-12T01:02:39.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='_nOo3MxTPMWQIg68kF09I68RYRl2iRK3', time=2024-09-12T02:46:10.552934+0000, chain.objs.size()=1 2024-09-12T01:02:39.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:e2043445-c131-4520-984d-b4d52f038a6b.4538.165__shadow_.hCNUQ9cIZdRUHvQuSiTMIecPI4Hs3XS_0 2024-09-12T01:02:39.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15718502484061991756', time=2024-09-12T02:48:25.959557+0000, chain.objs.size()=1 2024-09-12T01:02:39.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.238__shadow_.Ji71x16F2HBDZUOtM-S6oxwDhPbJMSW_0 2024-09-12T01:02:39.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15716648944208383019', time=2024-09-12T02:48:32.041688+0000, chain.objs.size()=1 2024-09-12T01:02:39.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.245__shadow_.4VFSaVjlw0fGnX5hn5eUc-6Q7UkxtMn_0 2024-09-12T01:02:39.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5754531135762546416', time=2024-09-12T02:48:33.551275+0000, chain.objs.size()=1 2024-09-12T01:02:39.677 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.247__shadow_.MEq1tzu-U2WTFbigFytzbvW5ZKCcqoO_0 2024-09-12T01:02:39.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6904423630172135293', time=2024-09-12T02:48:41.632624+0000, chain.objs.size()=1 2024-09-12T01:02:39.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.258__shadow_.Ec3iB49_Tdvn8sAr6yq9Zb9FP3YCMBI_0 2024-09-12T01:02:39.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10134610138712442093', time=2024-09-12T02:49:05.477297+0000, chain.objs.size()=1 2024-09-12T01:02:39.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.JfGRLZDMR_ptpiFT2IzW4Y42umrz_JW_0 2024-09-12T01:02:39.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3687915591408045045', time=2024-09-12T02:49:05.514323+0000, chain.objs.size()=1 2024-09-12T01:02:39.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.tU7mqldzj6yP8LSXDYt9idSTRCis9cD_0 2024-09-12T01:02:39.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8601837048303427205', time=2024-09-12T02:49:05.570599+0000, chain.objs.size()=1 2024-09-12T01:02:39.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.lOM-8BPcHCPMdRyGXkkmvsVwwSHNoGd_0 2024-09-12T01:02:39.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11723852719911741060', time=2024-09-12T02:49:05.729695+0000, chain.objs.size()=1 2024-09-12T01:02:39.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ujyWit26pHu8IDzFB1QfI441FYqiuyW_0 2024-09-12T01:02:39.678 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13188360413076469541', time=2024-09-12T02:49:05.801028+0000, chain.objs.size()=1 2024-09-12T01:02:39.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.hRrX_7nqYRTFIhs0-ydoFfeuL8XalOy_0 2024-09-12T01:02:39.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7356853147929148526', time=2024-09-12T02:49:05.805474+0000, chain.objs.size()=1 2024-09-12T01:02:39.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.KTcqPIaWWzcy-jSud3oEy_f0sC0mo1S_0 2024-09-12T01:02:39.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4811872205297580792', time=2024-09-12T02:49:05.812552+0000, chain.objs.size()=1 2024-09-12T01:02:39.679 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.gXwNvpiRilwyqh6kJKtDaHqhvwOxFSV_0 2024-09-12T01:02:39.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15014579929126393706', time=2024-09-12T02:49:05.861771+0000, chain.objs.size()=1 2024-09-12T01:02:39.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.SmuP7DMWtlOmj26Z5JjB7pVJ5X23V18_0 2024-09-12T01:02:39.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9590287678543150753', time=2024-09-12T02:49:05.962087+0000, chain.objs.size()=1 2024-09-12T01:02:39.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.C6SeVm06pZS8pfZJgBKHp_qFR215jTo_0 2024-09-12T01:02:39.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14878211816387154262', time=2024-09-12T02:49:05.992055+0000, chain.objs.size()=1 2024-09-12T01:02:39.680 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.682+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.aQEAYpbCnXn3M4IqJ1F4frYNB08CvmG_0 2024-09-12T01:02:39.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12927812824639836713', time=2024-09-12T02:49:06.013349+0000, chain.objs.size()=1 2024-09-12T01:02:39.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.I0LyIiNirotgj7I2JekaK3E_3whEOTg_0 2024-09-12T01:02:39.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4378596138854511975', time=2024-09-12T02:49:06.022331+0000, chain.objs.size()=1 2024-09-12T01:02:39.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.OjR56JgaW8jfKNQfVCogHvxaA6Kyymo_0 2024-09-12T01:02:39.681 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4593176946099454696', time=2024-09-12T02:49:06.086056+0000, chain.objs.size()=1 2024-09-12T01:02:39.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.UnGT5403v_UZJORY4-9_FznVM3D9XtP_0 2024-09-12T01:02:39.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2220828967096658063', time=2024-09-12T02:49:06.090018+0000, chain.objs.size()=1 2024-09-12T01:02:39.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.6fmTUdwdV7ZnWHw6OshYs612QzYPbDR_0 2024-09-12T01:02:39.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16084071683768609024', time=2024-09-12T02:49:06.106779+0000, chain.objs.size()=1 2024-09-12T01:02:39.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.fCzSJD4IWJ2uVs5suFRl1pXlcrBKvPl_0 2024-09-12T01:02:39.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.61489090561969195', time=2024-09-12T02:49:06.110235+0000, chain.objs.size()=1 2024-09-12T01:02:39.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.sywLsk3gxKRYDNuy2rTpbXbGR1QnCLG_0 2024-09-12T01:02:39.682 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15178822084494679095', time=2024-09-12T02:49:06.113686+0000, chain.objs.size()=1 2024-09-12T01:02:39.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.8mkmwVGB7dycNdVIXpmRthSRyGP3iGn_0 2024-09-12T01:02:39.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16065669855465747766', time=2024-09-12T02:49:06.275725+0000, chain.objs.size()=1 2024-09-12T01:02:39.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Mo2SQR3PULDIp1rLAyDb4m2wwT27N71_0 2024-09-12T01:02:39.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10684088442524658227', time=2024-09-12T02:49:06.293149+0000, chain.objs.size()=1 2024-09-12T01:02:39.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.oE8h-X94szks4sYHNpTtgQ96P8CwFIp_0 2024-09-12T01:02:39.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.135580864843141468', time=2024-09-12T02:49:06.374818+0000, chain.objs.size()=1 2024-09-12T01:02:39.683 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.686+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ljRHREChIdCtM1eAphU-hK-d6cwqz0p_0 2024-09-12T01:02:39.686 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16785361263561131569', time=2024-09-12T02:49:06.486439+0000, chain.objs.size()=1 2024-09-12T01:02:39.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.E1d-Xey_EOnfmbgSmD5Qw_i1sea_FRF_0 2024-09-12T01:02:39.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16051804490872590271', time=2024-09-12T02:49:06.562864+0000, chain.objs.size()=1 2024-09-12T01:02:39.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.boOIGYTp8_1fCwmdHHXIGFE7sBRoo_o_0 2024-09-12T01:02:39.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14536992273908420340', time=2024-09-12T02:49:06.571799+0000, chain.objs.size()=1 2024-09-12T01:02:39.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ZoHDDze7i3fX8DP1J9IhnL5TbIa3McX_0 2024-09-12T01:02:39.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7195932920209318708', time=2024-09-12T02:49:06.583732+0000, chain.objs.size()=1 2024-09-12T01:02:39.687 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.ORTd_NdqZBydCzYu26ZD6gfYrJ29zJf_0 2024-09-12T01:02:39.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3830575045097284810', time=2024-09-12T02:49:06.887140+0000, chain.objs.size()=1 2024-09-12T01:02:39.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Z6OTBilqGkkQLYrtAqFwy8jQypke4kb_0 2024-09-12T01:02:39.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5585824679142279423', time=2024-09-12T02:49:06.904178+0000, chain.objs.size()=1 2024-09-12T01:02:39.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.fG4nCp8C-1hpHfAuTci_2cCi-_pAjhj_0 2024-09-12T01:02:39.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5508627664303376991', time=2024-09-12T02:49:07.076981+0000, chain.objs.size()=1 2024-09-12T01:02:39.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.8T8AgmJwDVjhIaodqdH1BQxJ5-uD_c-_0 2024-09-12T01:02:39.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8650229467764439767', time=2024-09-12T02:49:07.193678+0000, chain.objs.size()=1 2024-09-12T01:02:39.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.pMvUnkatlne7T0H3wXbmCndy8hynu95_0 2024-09-12T01:02:39.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10762152671734026996', time=2024-09-12T02:49:07.215058+0000, chain.objs.size()=1 2024-09-12T01:02:39.688 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.i6dXIDn6ZbhzL3b7W9L43SRlQoUG8kk_0 2024-09-12T01:02:39.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12770545177360711329', time=2024-09-12T02:49:07.223563+0000, chain.objs.size()=1 2024-09-12T01:02:39.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.olfvVPIJWhgMMl-7Q6y9JE9LY0PSoHv_0 2024-09-12T01:02:39.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17609835165193542815', time=2024-09-12T02:49:07.383566+0000, chain.objs.size()=1 2024-09-12T01:02:39.689 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.690+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.tcjG95j1gkcthY7L6aaqhl4d9H6sbQr_0 2024-09-12T01:02:39.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8905283479456888591', time=2024-09-12T02:49:07.440290+0000, chain.objs.size()=1 2024-09-12T01:02:39.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.WkfRTDgwOstXii9xbBmipIiUnUAU4oh_0 2024-09-12T01:02:39.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4945129833283000657', time=2024-09-12T02:49:18.583364+0000, chain.objs.size()=1 2024-09-12T01:02:39.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.277__shadow_.PK1lYsuW9vE1ZWjtcfwJuQFaCoZeTcq_0 2024-09-12T01:02:39.691 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7098120912493069189', time=2024-09-12T02:49:30.971300+0000, chain.objs.size()=1 2024-09-12T01:02:39.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.VG44fkR3VpD36k9_EixxQdV-9seinsM_0 2024-09-12T01:02:39.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.694+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14670641724089009126', time=2024-09-12T02:49:32.440034+0000, chain.objs.size()=1 2024-09-12T01:02:39.692 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.694+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.rDfMQzT76EDu7Vha4USCQIe3yeXOYT3_0 2024-09-12T01:02:39.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17084692347253737486', time=2024-09-12T02:49:32.450187+0000, chain.objs.size()=1 2024-09-12T01:02:39.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.CwRt05vsPMQ0TSLi4TlT7O1sWsp9bAg_0 2024-09-12T01:02:39.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14565750255641460586', time=2024-09-12T02:49:37.747792+0000, chain.objs.size()=1 2024-09-12T01:02:39.693 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.300__shadow_.7Kfo7tFLU7pUZzLJ26AeXI69orCLgHq_0 2024-09-12T01:02:39.694 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3856901246709723827', time=2024-09-12T02:49:41.409290+0000, chain.objs.size()=1 2024-09-12T01:02:39.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.305__shadow_.hlDK5Mf2-UIvhV2KR8eL96YzD0GN-cy_0 2024-09-12T01:02:39.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4652679686789799823', time=2024-09-12T02:49:43.530151+0000, chain.objs.size()=1 2024-09-12T01:02:39.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.307__shadow:r6thQrVyla2D.WUMEHquwKd8easpYwj_.BB5pqFeu9RfZszghv0gGCVV236xjC2U_0 2024-09-12T01:02:39.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5636330290589172499', time=2024-09-12T02:50:15.842637+0000, chain.objs.size()=1 2024-09-12T01:02:39.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.tFL-w1cGmnyIlWCzmV5pGjXrybks1Dh_0 2024-09-12T01:02:39.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2340595632160431424', time=2024-09-12T02:50:15.845847+0000, chain.objs.size()=1 2024-09-12T01:02:39.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.0PmVDx2BmVUckzDGADlpXm1CE8k12p-_0 2024-09-12T01:02:39.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8844214987596192129', time=2024-09-12T02:50:15.917827+0000, chain.objs.size()=1 2024-09-12T01:02:39.695 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.7vCBcUTJsHo8XbUQTGB4f7Or7bqkhgw_0 2024-09-12T01:02:39.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7044019090344862476', time=2024-09-12T02:50:16.106000+0000, chain.objs.size()=1 2024-09-12T01:02:39.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.REG95gWBcXwK_PUt516QJRs1CKLZ8Z8_0 2024-09-12T01:02:39.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15033159806691830000', time=2024-09-12T02:50:16.143409+0000, chain.objs.size()=1 2024-09-12T01:02:39.696 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.698+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.TbZgfU1pvFzgZZ7IhZo6V7RRIeLzgq0_0 2024-09-12T01:02:39.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.702+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1059862137122827543', time=2024-09-12T02:50:16.424050+0000, chain.objs.size()=1 2024-09-12T01:02:39.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.702+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.qxADH4J63GqKzXWZkCOliZ9xdlNBGGD_0 2024-09-12T01:02:39.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.702+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.834024353695116435', time=2024-09-12T02:50:16.446613+0000, chain.objs.size()=1 2024-09-12T01:02:39.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.702+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.0omxqrQwPcy7Xwk550mzC4vPc0dEtX-_0 2024-09-12T01:02:39.697 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.702+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1949256978923834007', time=2024-09-12T02:50:16.682715+0000, chain.objs.size()=1 2024-09-12T01:02:39.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.702+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Co9J5ESA-D9k10BO8H5ilASDabJilTL_0 2024-09-12T01:02:39.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.702+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10515578475753356181', time=2024-09-12T02:50:16.734205+0000, chain.objs.size()=1 2024-09-12T01:02:39.698 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.702+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.gendlmBaSmh3_02EHCeOj8aCL7YM0xA_0 2024-09-12T01:02:39.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.702+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15911067870434076194', time=2024-09-12T02:50:16.752439+0000, chain.objs.size()=1 2024-09-12T01:02:39.699 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.702+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-gJsvj3jOOYhUUPZOJdev2WzdqR5ULh_0 2024-09-12T01:02:39.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10152944168278501688', time=2024-09-12T02:50:16.753352+0000, chain.objs.size()=1 2024-09-12T01:02:39.700 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.zSnMfAkAQw6bHj4PndBGDUOVI0Erqdi_0 2024-09-12T01:02:39.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13972122559468554086', time=2024-09-12T02:50:16.885683+0000, chain.objs.size()=1 2024-09-12T01:02:39.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.OfdhOEiU7PZNb6td24LiUawmbLpxp7l_0 2024-09-12T01:02:39.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15175758301433210907', time=2024-09-12T02:50:16.940282+0000, chain.objs.size()=1 2024-09-12T01:02:39.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6NdYdy0Rjw60YVe94g2tWnoy6als3l7_0 2024-09-12T01:02:39.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6188234155360677974', time=2024-09-12T02:50:16.949350+0000, chain.objs.size()=1 2024-09-12T01:02:39.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.WWRoL7n_Fk2UezbsSweizmE6-NYuM0R_0 2024-09-12T01:02:39.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3209929364400962173', time=2024-09-12T02:50:16.956790+0000, chain.objs.size()=1 2024-09-12T01:02:39.701 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Hd6IW6Ixns42He9OjggXcvc0lM9EioI_0 2024-09-12T01:02:39.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11776302759873915192', time=2024-09-12T02:50:17.015783+0000, chain.objs.size()=1 2024-09-12T01:02:39.702 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.aEwgV_3R23SlF0M4y-SuBX8CO6VNDmD_0 2024-09-12T01:02:39.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4674623011777433184', time=2024-09-12T02:50:17.130844+0000, chain.objs.size()=1 2024-09-12T01:02:39.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.YK-dqldry-1EsAttLZMqPLUWNkW8HhK_0 2024-09-12T01:02:39.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16630289341005313201', time=2024-09-12T02:50:17.222837+0000, chain.objs.size()=1 2024-09-12T01:02:39.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.12pWSw1_3yWMJfxpQ__MIl4FhYZ6bSC_0 2024-09-12T01:02:39.703 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4016802929997131692', time=2024-09-12T02:50:17.230371+0000, chain.objs.size()=1 2024-09-12T01:02:39.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_._mU8KqntfLLuf9ABvSuHwV9naz-OQ-b_0 2024-09-12T01:02:39.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9258993629753717587', time=2024-09-12T02:50:17.259899+0000, chain.objs.size()=1 2024-09-12T01:02:39.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.kgfsezVrdghfPCDcKnF6Muv9q9uYHr1_0 2024-09-12T01:02:39.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10506677367697675926', time=2024-09-12T02:50:17.391148+0000, chain.objs.size()=1 2024-09-12T01:02:39.704 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.706+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.svYzRZUqnn016QUGH_mxlTgp90oVulW_0 2024-09-12T01:02:39.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.710+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13334426762417071469', time=2024-09-12T02:50:17.392280+0000, chain.objs.size()=1 2024-09-12T01:02:39.706 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.710+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.h4NZE4zwg15ExZlHewrmfBvdtMDmYr6_0 2024-09-12T01:02:39.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.710+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14629344465735107468', time=2024-09-12T02:50:17.409601+0000, chain.objs.size()=1 2024-09-12T01:02:39.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.710+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.dAaj6gR8G7m4n-qS79BA-qACNrnxp2D_0 2024-09-12T01:02:39.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.710+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10949859570260978962', time=2024-09-12T02:50:17.432194+0000, chain.objs.size()=1 2024-09-12T01:02:39.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.710+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.V9a62YJJNaN8f26XUnHS6dBsx-7sA2A_0 2024-09-12T01:02:39.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.710+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8980294738269586833', time=2024-09-12T02:50:17.505384+0000, chain.objs.size()=1 2024-09-12T01:02:39.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.710+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.l0Jnv1MHcWSiuUfDQvCBjP3-zUceTBP_0 2024-09-12T01:02:39.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.710+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11293813621704206229', time=2024-09-12T02:50:17.537159+0000, chain.objs.size()=1 2024-09-12T01:02:39.708 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.710+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.KE7t9jnRpklUvIdMyXO4mXxxAHpt6eL_0 2024-09-12T01:02:39.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.710+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10215071528187642890', time=2024-09-12T02:50:17.651194+0000, chain.objs.size()=1 2024-09-12T01:02:39.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.710+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.JAjM_58aHEEeCiVJg-Mhdch3wfHmL-u_0 2024-09-12T01:02:39.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1294354663059233034', time=2024-09-12T02:50:17.677484+0000, chain.objs.size()=1 2024-09-12T01:02:39.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.XBnvnePFnTw8x9iNKn2szv3N8vxZHkZ_0 2024-09-12T01:02:39.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11403120376853380295', time=2024-09-12T02:50:39.504588+0000, chain.objs.size()=1 2024-09-12T01:02:39.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.LYXXwa2hUyZCqQKtBEyuQV2eBsiXSnj_0 2024-09-12T01:02:39.709 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8613606216229272422', time=2024-09-12T02:50:39.506209+0000, chain.objs.size()=1 2024-09-12T01:02:39.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.MnU5MFIf2BZXcSxuyHj0ijV8oLc4WnU_0 2024-09-12T01:02:39.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1477118726365709629', time=2024-09-12T02:50:39.536312+0000, chain.objs.size()=1 2024-09-12T01:02:39.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.bIeS2t8mXmQ5_dg-o7Jq0CHY09N8_FJ_0 2024-09-12T01:02:39.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13455861255790262227', time=2024-09-12T02:50:39.604650+0000, chain.objs.size()=1 2024-09-12T01:02:39.710 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.OUybOr9V1vrMwYyCxRcmIEXqIMNiek8_0 2024-09-12T01:02:39.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.714+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7912829833210038711', time=2024-09-12T02:50:39.607043+0000, chain.objs.size()=1 2024-09-12T01:02:39.711 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.714+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.cSI35u5XvNPTMX63j1alk1NZ7QcgMga_0 2024-09-12T01:02:39.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.968264828212911228', time=2024-09-12T02:50:39.788075+0000, chain.objs.size()=1 2024-09-12T01:02:39.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.9uA84gId7__pEKI30LJDx2EIz7Jj-vr_0 2024-09-12T01:02:39.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1518625565731320916', time=2024-09-12T02:50:39.792732+0000, chain.objs.size()=1 2024-09-12T01:02:39.713 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.YP4Vo2X3xNuQHGEA6FkJHK2sjqHpw4Z_0 2024-09-12T01:02:39.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12628957085877535052', time=2024-09-12T02:50:40.016327+0000, chain.objs.size()=1 2024-09-12T01:02:39.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.E-V9opDXUUTvnteQ1E_nQ2S5roFfpjo_0 2024-09-12T01:02:39.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14845999054037634053', time=2024-09-12T02:50:40.102758+0000, chain.objs.size()=1 2024-09-12T01:02:39.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.67hFUy0aVKSzoadr_mWqvJvA2vNBd3r_0 2024-09-12T01:02:39.715 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.653222111510089743', time=2024-09-12T02:50:40.119697+0000, chain.objs.size()=1 2024-09-12T01:02:39.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.uJV9Y76kfZHkCPpP6EkbqgiRAkp6NgL_0 2024-09-12T01:02:39.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14417600373443734527', time=2024-09-12T02:50:40.125330+0000, chain.objs.size()=1 2024-09-12T01:02:39.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Y7iVAyRbzS4LEe7lwHeANWMbgWSpgHu_0 2024-09-12T01:02:39.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4586237373547680901', time=2024-09-12T02:50:40.260872+0000, chain.objs.size()=1 2024-09-12T01:02:39.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.kBNvMbmcf6nhi4V5SzdSvo68QdS23Jr_0 2024-09-12T01:02:39.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5875137872938560647', time=2024-09-12T02:50:40.327887+0000, chain.objs.size()=1 2024-09-12T01:02:39.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Dbi9gPFehmTl-beLKp_nWg7QMQuMSAg_0 2024-09-12T01:02:39.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10017836850907802121', time=2024-09-12T02:50:40.346939+0000, chain.objs.size()=1 2024-09-12T01:02:39.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.TyJ8aKQkQiYyMcTTz0_8Usxiy1L0UC0_0 2024-09-12T01:02:39.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17729677662793312512', time=2024-09-12T02:50:40.353155+0000, chain.objs.size()=1 2024-09-12T01:02:39.716 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.718+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.uHLoQCTwJexf9Fp11fP3guHGVHKrfpn_0 2024-09-12T01:02:39.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.722+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9188442003527016126', time=2024-09-12T02:50:40.617844+0000, chain.objs.size()=1 2024-09-12T01:02:39.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.722+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.6j90PMsP4DBTMb51TDTSSjAv5cB6iOC_0 2024-09-12T01:02:39.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.722+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11252971362861317105', time=2024-09-12T02:50:40.736573+0000, chain.objs.size()=1 2024-09-12T01:02:39.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.722+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Z9pHCTThnJoF05Ti4SsNaLPkgkzYWQU_0 2024-09-12T01:02:39.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.722+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12135281817565002172', time=2024-09-12T02:50:40.776049+0000, chain.objs.size()=1 2024-09-12T01:02:39.717 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.722+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Vzf4Eq_hXU_Wb2jTFqrjvqhgt0_SGD3_0 2024-09-12T01:02:39.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9290958222655888210', time=2024-09-12T02:50:40.778738+0000, chain.objs.size()=1 2024-09-12T01:02:39.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.MnrlxKTA_N_Hu17NAW4eFJWL2zPEFgh_0 2024-09-12T01:02:39.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14977385667958259120', time=2024-09-12T02:50:40.794489+0000, chain.objs.size()=1 2024-09-12T01:02:39.721 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.23RWl6MSdXoDBrL90FytKrXPOVEHmyx_0 2024-09-12T01:02:39.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13565568249188880521', time=2024-09-12T02:50:40.829036+0000, chain.objs.size()=1 2024-09-12T01:02:39.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.eGnP23gqSxcLePPmMgCX6sBGl5Vn4QB_0 2024-09-12T01:02:39.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11702380850731091572', time=2024-09-12T02:50:40.848004+0000, chain.objs.size()=1 2024-09-12T01:02:39.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.hptRQJNzdA565QAnQ6gbgR9GW7pA9pu_0 2024-09-12T01:02:39.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7697066541348092017', time=2024-09-12T02:50:40.865048+0000, chain.objs.size()=1 2024-09-12T01:02:39.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.HNoExVslnLUCexWgKENBbgogHuo53c3_0 2024-09-12T01:02:39.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17282045476363564829', time=2024-09-12T02:50:40.865764+0000, chain.objs.size()=1 2024-09-12T01:02:39.722 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Olm2qS1OjNeGz6_iM15jvzIMqlzewjZ_0 2024-09-12T01:02:39.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16794627996453937792', time=2024-09-12T02:50:41.014196+0000, chain.objs.size()=1 2024-09-12T01:02:39.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.VqEo6Owp0RSfmnc3l9MeY7IUzSiikvF_0 2024-09-12T01:02:39.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9616074208996716352', time=2024-09-12T02:50:41.083008+0000, chain.objs.size()=1 2024-09-12T01:02:39.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.EO7IJZoupodOtxJ4gWppWdecA9LjaLS_0 2024-09-12T01:02:39.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12442149500410354026', time=2024-09-12T02:50:41.175786+0000, chain.objs.size()=1 2024-09-12T01:02:39.723 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.XMqlCIs725GkV1bIIfAXcVcKbq1CCp0_0 2024-09-12T01:02:39.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8431870492104783913', time=2024-09-12T02:50:41.177241+0000, chain.objs.size()=1 2024-09-12T01:02:39.724 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.726+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.dRfCPUwtxCO6_CYx9xqY9aVuADlAfdQ_0 2024-09-12T01:02:39.727 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.730+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/44387 2024-09-12T01:02:39.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=33, truncated=0, next_marker='' 2024-09-12T01:02:39.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5251943375494431928', time=2024-09-12T02:50:41.179597+0000, chain.objs.size()=1 2024-09-12T01:02:39.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.jKjFchHMcGTgB0SYqmRwEntrYYcsPK5_0 2024-09-12T01:02:39.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6442634893120289680', time=2024-09-12T02:50:41.269375+0000, chain.objs.size()=1 2024-09-12T01:02:39.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.O_p9SEi_TJMQrS3PonA-5HjcwstsFIM_0 2024-09-12T01:02:39.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17323875774394924235', time=2024-09-12T02:50:41.316105+0000, chain.objs.size()=1 2024-09-12T01:02:39.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.OHm0-BVmsleIO-sPX0ZEGgEbK3BR3VJ_0 2024-09-12T01:02:39.730 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12023349068796725304', time=2024-09-12T02:50:41.355886+0000, chain.objs.size()=1 2024-09-12T01:02:39.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.w55KVxRTS2sff6dE7eUH6yeyxtcUoZP_0 2024-09-12T01:02:39.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11880902387304885132', time=2024-09-12T02:50:41.407931+0000, chain.objs.size()=1 2024-09-12T01:02:39.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.YIa4qDDQamALR0fw1s2W-PF9ldDkwXr_0 2024-09-12T01:02:39.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12277567941185456993', time=2024-09-12T02:50:41.525680+0000, chain.objs.size()=1 2024-09-12T01:02:39.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.pNo5aG0szxRD9VN_C--tv8QFR-pnF9__0 2024-09-12T01:02:39.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9464557063268454633', time=2024-09-12T02:50:41.528914+0000, chain.objs.size()=1 2024-09-12T01:02:39.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ggSICx9TK6Adlj5O4kTKgfaWiTMTEke_0 2024-09-12T01:02:39.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13637081839653551937', time=2024-09-12T02:50:41.552146+0000, chain.objs.size()=1 2024-09-12T01:02:39.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.8weh1aLRXxvNCKSWKpDEkT81-JCx783_0 2024-09-12T01:02:39.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8427199135301608602', time=2024-09-12T02:50:41.616507+0000, chain.objs.size()=1 2024-09-12T01:02:39.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.JvkCiiutbK4oa4YTQnm-xgeHlQtXzwO_0 2024-09-12T01:02:39.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9601849934800332614', time=2024-09-12T02:50:41.630839+0000, chain.objs.size()=1 2024-09-12T01:02:39.731 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.3KAMa1DH7MazH7L4WKiKDlbVzdIbYjT_0 2024-09-12T01:02:39.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3182003320048446833', time=2024-09-12T02:50:41.649733+0000, chain.objs.size()=1 2024-09-12T01:02:39.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.nrrtKAFp2L5PaCcaHe1y4XN2ylxmc_X_0 2024-09-12T01:02:39.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.835106133425877426', time=2024-09-12T02:50:55.608610+0000, chain.objs.size()=1 2024-09-12T01:02:39.732 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.734+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.345__shadow_.9DcpyFx_H07mbpHlNSiQ1O95ZrHOIV-_0 2024-09-12T01:02:39.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12752088132526202535', time=2024-09-12T02:52:16.459096+0000, chain.objs.size()=1 2024-09-12T01:02:39.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.455__shadow_.G_9OGHi8RwMnwG61P4kQAIhTjQDfPHG_0 2024-09-12T01:02:39.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1212221536823790380', time=2024-09-12T02:52:18.500981+0000, chain.objs.size()=1 2024-09-12T01:02:39.734 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.457__shadow_.2kvsRtFliYR32uD7nKp2DpmzE3NpkO5_0 2024-09-12T01:02:39.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1462470103932279026', time=2024-09-12T02:52:24.745670+0000, chain.objs.size()=1 2024-09-12T01:02:39.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.463__shadow_.NNgYKTbjfJqd9HdD5gD3WQqGQr8bVkc_0 2024-09-12T01:02:39.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10967953554373885864', time=2024-09-12T02:52:27.651144+0000, chain.objs.size()=1 2024-09-12T01:02:39.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.466__shadow_.xP6k85S2RZ86zzcm5TkzJXAppLb4_bq_0 2024-09-12T01:02:39.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7314065906515861472', time=2024-09-12T02:52:42.627977+0000, chain.objs.size()=1 2024-09-12T01:02:39.735 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.491__shadow_.jF-xMXNsIWqottGGmS3vSM2KhVCVzjR_0 2024-09-12T01:02:39.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17119499238610622077', time=2024-09-12T02:52:50.531157+0000, chain.objs.size()=1 2024-09-12T01:02:39.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.503__shadow:kkpnEcohSrS0OmtT6cE4b1ngYotif0k_.RijEw510gCv7_gxNQ272Sla30v4Z_0T_0 2024-09-12T01:02:39.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5213628988827430777', time=2024-09-12T02:53:10.787451+0000, chain.objs.size()=1 2024-09-12T01:02:39.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.520__shadow:iCbDRk8D1Qhhucsi.UTlvwNUPjYizF4_.Zi-j4UvLYavd05gEEMz3RQkl3YdpkWl_0 2024-09-12T01:02:39.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14990127234826775420', time=2024-09-12T02:53:15.222667+0000, chain.objs.size()=6 2024-09-12T01:02:39.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.CS5_JsDf8P7Fg3qikV0CIM8dkN2ScQPc.1 2024-09-12T01:02:39.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~k5Qi9knjEsZnaAQj7XeqToLp_SHpMDX.2 2024-09-12T01:02:39.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~k5Qi9knjEsZnaAQj7XeqToLp_SHpMDX.3 2024-09-12T01:02:39.736 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.738+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~k5Qi9knjEsZnaAQj7XeqToLp_SHpMDX.4 2024-09-12T01:02:39.738 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.742+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~k5Qi9knjEsZnaAQj7XeqToLp_SHpMDX.5 2024-09-12T01:02:39.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~k5Qi9knjEsZnaAQj7XeqToLp_SHpMDX.6 2024-09-12T01:02:39.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2724929469633958841', time=2024-09-12T02:53:29.424684+0000, chain.objs.size()=2 2024-09-12T01:02:39.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.523__multipart_mymultipart.2~L-W7cl1RqkAThKiXBCkMCbney2kiUgf.1 2024-09-12T01:02:39.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.523__multipart_mymultipart.2~L-W7cl1RqkAThKiXBCkMCbney2kiUgf.2 2024-09-12T01:02:39.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16462805724830562957', time=2024-09-12T02:53:34.772889+0000, chain.objs.size()=1 2024-09-12T01:02:39.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.524__shadow_.oY_b6gkZUzYhx5ZuxUKjtjubNRI1doT_0 2024-09-12T01:02:39.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2685760154446582966', time=2024-09-12T02:53:38.041971+0000, chain.objs.size()=1 2024-09-12T01:02:39.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.528__shadow_.hh1c1QPyHBbrp21uPzvWhzMHKM4IpKj_0 2024-09-12T01:02:39.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3141250431584426563', time=2024-09-12T02:54:32.622774+0000, chain.objs.size()=1 2024-09-12T01:02:39.742 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.559__shadow_.82uGNo9EQ5113dv3qnD1Fnx3rmW5vPG_0 2024-09-12T01:02:39.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7992077197729065518', time=2024-09-12T02:54:46.906423+0000, chain.objs.size()=1 2024-09-12T01:02:39.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:B6Y0L7m-9MbxYX9p1bzU11H.lcqrw-s_.h5BfIKUHWpSnLDyxZurziX_Q0frmO9E_0 2024-09-12T01:02:39.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15827553461169694451', time=2024-09-12T02:54:48.263168+0000, chain.objs.size()=1 2024-09-12T01:02:39.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:6bI2.FZxYpnIsT8p.A561FSPYUDWbTc_.6Ohw3nudVVpkk9IqTCJk9kdbo36SkJf_0 2024-09-12T01:02:39.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.276479909330917747', time=2024-09-12T02:54:52.726720+0000, chain.objs.size()=1 2024-09-12T01:02:39.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:K0UYiPmVl5Hr1vqT3lyT1Wqle9Ute0V_.-SyzJuk0476zRLvoSTg5Po7ObC4JtsH_0 2024-09-12T01:02:39.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1642849924188182000', time=2024-09-12T02:55:00.812705+0000, chain.objs.size()=1 2024-09-12T01:02:39.743 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.574__shadow:BGw-it.DZpI9t72bzVL583W8VCpmbRx_.-jIFlIlyM2Iy2CLJ2RfI3eii3mXrvYM_0 2024-09-12T01:02:39.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12000042398851419957', time=2024-09-12T02:55:04.113496+0000, chain.objs.size()=1 2024-09-12T01:02:39.744 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.746+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.576__shadow:hIogKSd88TcMILcZIW3uUUOsJoMocZ._.OwlG_nslj1z0Rp7orJNO31res2UX3eI_0 2024-09-12T01:02:39.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.812481208974431877', time=2024-09-12T02:55:28.537115+0000, chain.objs.size()=1 2024-09-12T01:02:39.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.579__shadow:9iRXA6S-mgR-AGge83YDV5kcA60vqAt_.nS8pIdGz1cQGiqKB7xZwDXswWi1vMzb_0 2024-09-12T01:02:39.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9533523022405570023', time=2024-09-12T02:55:30.259879+0000, chain.objs.size()=1 2024-09-12T01:02:39.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.580__shadow:5seQflgHyeDERrTCRLXmTbaq2uEzkX-_.8J21rmYJmkrwmm13k_lnWBqcPPmmFdf_0 2024-09-12T01:02:39.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.750+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~RYagin4mZexkehnMtlv_RyWWjgef1rA', time=2024-09-12T02:58:17.930306+0000, chain.objs.size()=6 2024-09-12T01:02:39.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.625__multipart_multipart_enc.2~RYagin4mZexkehnMtlv_RyWWjgef1rA.1 2024-09-12T01:02:39.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.625__multipart_multipart_enc.2~RYagin4mZexkehnMtlv_RyWWjgef1rA.2 2024-09-12T01:02:39.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.750+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.625__multipart_multipart_enc.2~RYagin4mZexkehnMtlv_RyWWjgef1rA.3 2024-09-12T01:02:39.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.754+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.625__multipart_multipart_enc.2~RYagin4mZexkehnMtlv_RyWWjgef1rA.4 2024-09-12T01:02:39.748 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.754+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.625__multipart_multipart_enc.2~RYagin4mZexkehnMtlv_RyWWjgef1rA.5 2024-09-12T01:02:39.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.754+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.625__multipart_multipart_enc.2~RYagin4mZexkehnMtlv_RyWWjgef1rA.6 2024-09-12T01:02:39.750 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.754+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1073525602313378984', time=2024-09-12T02:58:24.300396+0000, chain.objs.size()=1 2024-09-12T01:02:39.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.754+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.634__shadow_.XW7N7FlgdSrJzTgYHhKzs6xCr8a0eri_0 2024-09-12T01:02:39.754 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.758+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:39.758 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.762+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:02:39.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.762+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.759 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.762+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49919' 2024-09-12T01:02:39.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17916087522586579320', time=2024-09-12T02:48:19.743442+0000, chain.objs.size()=1 2024-09-12T01:02:39.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.231__shadow_.FNLpEH0TC2S5X_PCueec16GiFCE3NF3_0 2024-09-12T01:02:39.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5656213486179601717', time=2024-09-12T02:48:24.701199+0000, chain.objs.size()=1 2024-09-12T01:02:39.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.237__shadow_.oXNKbloHBn9sTq6Stuj7atLKIcfsTBa_0 2024-09-12T01:02:39.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4678376451724430022', time=2024-09-12T02:48:24.704515+0000, chain.objs.size()=1 2024-09-12T01:02:39.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.237__shadow_.h2jtxqrFOBaRQwaXM28OxMKXDPS7RIl_0 2024-09-12T01:02:39.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5419406403582322455', time=2024-09-12T02:48:30.085776+0000, chain.objs.size()=1 2024-09-12T01:02:39.761 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.243__shadow_.nKTtTPEukb1B7hIcQI24TFMVBUEcIlN_0 2024-09-12T01:02:39.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17713589841391225863', time=2024-09-12T02:48:32.834814+0000, chain.objs.size()=1 2024-09-12T01:02:39.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.246__shadow_.OTXOD6YpROoHOMuTzAkxsInGYUJR7k0_0 2024-09-12T01:02:39.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3048955747672353516', time=2024-09-12T02:48:36.491832+0000, chain.objs.size()=1 2024-09-12T01:02:39.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.251__shadow_.g9wpO_pnvPH-NJAEZRPYqA2bsIWDxCl_0 2024-09-12T01:02:39.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7322372322303545190', time=2024-09-12T02:49:05.406150+0000, chain.objs.size()=1 2024-09-12T01:02:39.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.MQnw14iMjuml7MdHHt4iJGJTBn_Vxd6_0 2024-09-12T01:02:39.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4626481220651805699', time=2024-09-12T02:49:05.489938+0000, chain.objs.size()=1 2024-09-12T01:02:39.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.tE98KqNG7rWTceDfvvlK-V5_RIRk5u1_0 2024-09-12T01:02:39.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11749190420623112400', time=2024-09-12T02:49:05.528388+0000, chain.objs.size()=1 2024-09-12T01:02:39.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.f8mwxdp8FPWjPlbDzFkHnYuoD7IrONQ_0 2024-09-12T01:02:39.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1006368394760424563', time=2024-09-12T02:49:05.547940+0000, chain.objs.size()=1 2024-09-12T01:02:39.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.-lvcDGuaKlMd7LUn5rlgp8nElsB0qqz_0 2024-09-12T01:02:39.762 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16580231442600378824', time=2024-09-12T02:49:05.778507+0000, chain.objs.size()=1 2024-09-12T01:02:39.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.5jIcUr6wcaG6XIUx0Ia0QBYea4uPsi4_0 2024-09-12T01:02:39.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18388803216541544480', time=2024-09-12T02:49:05.825499+0000, chain.objs.size()=1 2024-09-12T01:02:39.763 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.766+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.2KE9qYIch4rG1Gu5g0OQbzWy_riah3o_0 2024-09-12T01:02:39.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15556200037002991729', time=2024-09-12T02:49:05.842925+0000, chain.objs.size()=1 2024-09-12T01:02:39.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.3N2ugjznqLwFmUbutNU5z1mPxd_lJAQ_0 2024-09-12T01:02:39.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2774874458907559031', time=2024-09-12T02:49:05.846850+0000, chain.objs.size()=1 2024-09-12T01:02:39.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.NH7aWnSHyv0-sRPh8lJMHa9iW0q2r4c_0 2024-09-12T01:02:39.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13389378092794526340', time=2024-09-12T02:49:05.856478+0000, chain.objs.size()=1 2024-09-12T01:02:39.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Ikm_zRA54BnLIjlQfmx6gzUSBkjIksp_0 2024-09-12T01:02:39.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10134289965722387064', time=2024-09-12T02:49:05.983793+0000, chain.objs.size()=1 2024-09-12T01:02:39.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.-XujPJqhzqdjFixve9itXQO7m6e5ysX_0 2024-09-12T01:02:39.767 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16019952070509098456', time=2024-09-12T02:49:06.004548+0000, chain.objs.size()=1 2024-09-12T01:02:39.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.bjtVYIqOr3S4KOnot96lyqlf2egY1iR_0 2024-09-12T01:02:39.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11452288759095627124', time=2024-09-12T02:49:06.023215+0000, chain.objs.size()=1 2024-09-12T01:02:39.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.DhAn7NhrWmLlFecx2RQ2OAbV0k_8mgG_0 2024-09-12T01:02:39.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3533607867625979410', time=2024-09-12T02:49:06.043841+0000, chain.objs.size()=1 2024-09-12T01:02:39.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.GtdaPnZV2y4eLHaGesjSAr85YpMLdUn_0 2024-09-12T01:02:39.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6442658356710239158', time=2024-09-12T02:49:06.273387+0000, chain.objs.size()=1 2024-09-12T01:02:39.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.B2tgrta5c743xq0geCx7BR8XXPHXkYg_0 2024-09-12T01:02:39.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4633168309427819831', time=2024-09-12T02:49:06.297002+0000, chain.objs.size()=1 2024-09-12T01:02:39.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.MzqotSRaOgokPa_nytxGYNMbbPY_T9c_0 2024-09-12T01:02:39.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10232307920879596542', time=2024-09-12T02:49:06.298408+0000, chain.objs.size()=1 2024-09-12T01:02:39.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.HJiA6k6us9ZkS5dqdwZVOPV0XN-FWbF_0 2024-09-12T01:02:39.768 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14964091858463200734', time=2024-09-12T02:49:06.347303+0000, chain.objs.size()=1 2024-09-12T01:02:39.769 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.770+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.jVZf8PhMnSoNoCrdGQIQsXqjWNdPW0Q_0 2024-09-12T01:02:39.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.774+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14475947316505171499', time=2024-09-12T02:49:06.362924+0000, chain.objs.size()=1 2024-09-12T01:02:39.771 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.774+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.QcAFM40O69gogs4hjvkBeSQCvsYVvvn_0 2024-09-12T01:02:39.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.774+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6209185721689039651', time=2024-09-12T02:49:06.497230+0000, chain.objs.size()=1 2024-09-12T01:02:39.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.774+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.biMjYU5Am2tv8KQrSbvR4QtCu5Yb-pg_0 2024-09-12T01:02:39.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.774+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3854045854944714306', time=2024-09-12T02:49:06.516601+0000, chain.objs.size()=1 2024-09-12T01:02:39.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.774+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.r0ngiDaJQrvdNUrbgYDLl1uW-HwThXU_0 2024-09-12T01:02:39.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.774+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4243662380322923415', time=2024-09-12T02:49:06.548341+0000, chain.objs.size()=1 2024-09-12T01:02:39.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.774+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.I11NlyadvTHIKXJhxEPYORh1L5hY3IP_0 2024-09-12T01:02:39.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.774+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3864057454812212162', time=2024-09-12T02:49:06.565155+0000, chain.objs.size()=1 2024-09-12T01:02:39.772 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.774+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.WT5otu9bQBXdOnKYGMAS1T9_pTrFcO5_0 2024-09-12T01:02:39.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.778+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10996120936974809797', time=2024-09-12T02:49:06.566576+0000, chain.objs.size()=1 2024-09-12T01:02:39.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.778+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.wWneLO5XC-rVHCkSSL5rc9ESd-kqaSd_0 2024-09-12T01:02:39.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.778+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10654865441043474943', time=2024-09-12T02:49:06.756680+0000, chain.objs.size()=1 2024-09-12T01:02:39.773 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.778+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9MrQjuIsaTf9ti6Vhsikpti4T3O0CiS_0 2024-09-12T01:02:39.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.778+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4302679536800787575', time=2024-09-12T02:49:06.888082+0000, chain.objs.size()=1 2024-09-12T01:02:39.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.778+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.UZz1yrEdF_QFIfIrb9qaHzZNb9tBCaZ_0 2024-09-12T01:02:39.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.778+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17211818552205390581', time=2024-09-12T02:49:06.888709+0000, chain.objs.size()=1 2024-09-12T01:02:39.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.778+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.uphESxWQttdXB9vENsKV7ce8Mf2JxL8_0 2024-09-12T01:02:39.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.778+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13727733264808873554', time=2024-09-12T02:49:07.089290+0000, chain.objs.size()=1 2024-09-12T01:02:39.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.778+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.YKs_ptl5ZGm2Z_JWC8oJbu5OcMrMHjy_0 2024-09-12T01:02:39.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.778+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11369650757651151011', time=2024-09-12T02:49:07.121750+0000, chain.objs.size()=1 2024-09-12T01:02:39.774 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.778+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.QaA7GSZV507cUx6QZ75MHp9Z1oq-z_3_0 2024-09-12T01:02:39.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12132750386980863578', time=2024-09-12T02:49:07.185059+0000, chain.objs.size()=1 2024-09-12T01:02:39.776 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.w-NtThbsssbz4a8LWC6Exs3ZoJltVjG_0 2024-09-12T01:02:39.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10593263879440297585', time=2024-09-12T02:49:07.202148+0000, chain.objs.size()=1 2024-09-12T01:02:39.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.vOhAhbs8VS7fPdKxc7N_4iPV2n_8Nba_0 2024-09-12T01:02:39.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11367017033030434215', time=2024-09-12T02:49:07.370473+0000, chain.objs.size()=1 2024-09-12T01:02:39.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.PcXA4ScTEih8ir7Fg8q4DOGUYdA4-Mo_0 2024-09-12T01:02:39.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8727603782388242332', time=2024-09-12T02:49:07.428401+0000, chain.objs.size()=1 2024-09-12T01:02:39.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.CkAhOx6sLuez86DW6M1h3tHRSb_lid-_0 2024-09-12T01:02:39.777 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18093648282490136627', time=2024-09-12T02:49:07.430587+0000, chain.objs.size()=1 2024-09-12T01:02:39.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.60rXlfXgr1M1atEfqNAvxFjopSgsfPd_0 2024-09-12T01:02:39.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9880610334992438193', time=2024-09-12T02:49:07.432408+0000, chain.objs.size()=1 2024-09-12T01:02:39.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.G0THlwT1r0mzw9546dr5rntO7YGVQcM_0 2024-09-12T01:02:39.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4925749880801243812', time=2024-09-12T02:49:07.433251+0000, chain.objs.size()=1 2024-09-12T01:02:39.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.6GXusY16L7VaPl_DzqmLnhdVjXYxIZ-_0 2024-09-12T01:02:39.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13414591365182133601', time=2024-09-12T02:49:09.042355+0000, chain.objs.size()=1 2024-09-12T01:02:39.778 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.264__shadow_.dV8Y2GyaUJTLU746fHd7YpBY1rewcHJ_0 2024-09-12T01:02:39.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17254145644401578807', time=2024-09-12T02:49:12.607930+0000, chain.objs.size()=1 2024-09-12T01:02:39.779 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.269__shadow_.UzPrwhWDY7f7DGmnHdmiB8qAwyTTnLP_0 2024-09-12T01:02:39.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12168853144536185989', time=2024-09-12T02:49:17.863893+0000, chain.objs.size()=1 2024-09-12T01:02:39.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.276__shadow_.J9qjA6D1osoEogkDIKU2qGAULRzpWd__0 2024-09-12T01:02:39.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1400038035183861654', time=2024-09-12T02:49:18.585313+0000, chain.objs.size()=1 2024-09-12T01:02:39.780 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.782+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.277__shadow_.uSR4OFBtmOkblFNkqoCd4vT8nB26qeA_0 2024-09-12T01:02:39.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.786+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8712398377512328807', time=2024-09-12T02:49:20.875489+0000, chain.objs.size()=1 2024-09-12T01:02:39.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.786+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.280__shadow_.uWPUSlO6BkICqwBP06oJGgqSQv78UXn_0 2024-09-12T01:02:39.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.786+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3501301259506646295', time=2024-09-12T02:49:28.408985+0000, chain.objs.size()=1 2024-09-12T01:02:39.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.786+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.290__shadow_.wgu3NQz0SVWkUzW2qT372VrHwuXbV-m_0 2024-09-12T01:02:39.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.786+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7444052139686002115', time=2024-09-12T02:49:34.630567+0000, chain.objs.size()=1 2024-09-12T01:02:39.782 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.786+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.296__shadow_.B8KslErUZp6ARpu4-DTNrz_uh7pPcjP_0 2024-09-12T01:02:39.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.185653950371262655', time=2024-09-12T02:49:37.747829+0000, chain.objs.size()=1 2024-09-12T01:02:39.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.300__shadow_.dsN6nSEWMEewXaNHPOx513DYkU5TR_p_0 2024-09-12T01:02:39.784 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1706851684770315575', time=2024-09-12T02:50:15.860896+0000, chain.objs.size()=1 2024-09-12T01:02:39.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.DH_kIGDcenP9s1sA78z6sutXqZYpdsd_0 2024-09-12T01:02:39.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6807753890831923222', time=2024-09-12T02:50:15.916202+0000, chain.objs.size()=1 2024-09-12T01:02:39.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.LEr8dSod4AymROQYfeLOQ2HFJy9kJ0R_0 2024-09-12T01:02:39.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9676325134549902578', time=2024-09-12T02:50:15.940898+0000, chain.objs.size()=1 2024-09-12T01:02:39.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.DemGQYXeGiAHmqoxhbYVZ4oQvqXGl2p_0 2024-09-12T01:02:39.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3849988908758694978', time=2024-09-12T02:50:15.961954+0000, chain.objs.size()=1 2024-09-12T01:02:39.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.mevdZeDAKxxRdhRtt3hFc3F6pa45xxs_0 2024-09-12T01:02:39.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7325004861504028736', time=2024-09-12T02:50:16.120394+0000, chain.objs.size()=1 2024-09-12T01:02:39.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.cuV5zgbwsArrIQi7mHz20u_lUvynfzX_0 2024-09-12T01:02:39.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3638230157629213053', time=2024-09-12T02:50:16.169761+0000, chain.objs.size()=1 2024-09-12T01:02:39.785 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.qijw1JN9jBmy14AFHjEQRFWiwkVBf_p_0 2024-09-12T01:02:39.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10802307558631886268', time=2024-09-12T02:50:16.212673+0000, chain.objs.size()=1 2024-09-12T01:02:39.786 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.LuTRwRFD0ihEX_L_HdqhPqRoLNHGE75_0 2024-09-12T01:02:39.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15088452553133820976', time=2024-09-12T02:50:16.500057+0000, chain.objs.size()=1 2024-09-12T01:02:39.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.fEkdblYCriQyHonK6eM9vo_DUwrfIU3_0 2024-09-12T01:02:39.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13647105233593537669', time=2024-09-12T02:50:16.506006+0000, chain.objs.size()=1 2024-09-12T01:02:39.787 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.vb6BbCckgw85oYxSBK7gX3L7xg4wW6v_0 2024-09-12T01:02:39.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12438184413556211773', time=2024-09-12T02:50:16.707101+0000, chain.objs.size()=1 2024-09-12T01:02:39.788 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.790+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.3B749P0Qb_l0hRVM_FcobAKBMXltHcs_0 2024-09-12T01:02:39.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4368241288957091152', time=2024-09-12T02:50:16.727024+0000, chain.objs.size()=1 2024-09-12T01:02:39.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.nEXyVfysOAdkQXPjejIk1qmlvYs_Ikr_0 2024-09-12T01:02:39.789 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15836936156939479027', time=2024-09-12T02:50:16.734192+0000, chain.objs.size()=1 2024-09-12T01:02:39.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.xy5BkajvGVxFNFZb7zIeJQhoKQ2K_SZ_0 2024-09-12T01:02:39.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6051847634247555414', time=2024-09-12T02:50:16.735160+0000, chain.objs.size()=1 2024-09-12T01:02:39.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.wbAn9POlcahs5p8FoWjuDsUqREUKbeX_0 2024-09-12T01:02:39.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18380546197559280668', time=2024-09-12T02:50:16.774098+0000, chain.objs.size()=1 2024-09-12T01:02:39.790 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.SLpjbvPt4TRBB-9TT37x413jSAFK-8N_0 2024-09-12T01:02:39.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2243407112545735913', time=2024-09-12T02:50:16.790075+0000, chain.objs.size()=1 2024-09-12T01:02:39.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.iLlcKnAjlnVl6u_P7MJ-pXBb-8fTBRq_0 2024-09-12T01:02:39.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.219382794353190375', time=2024-09-12T02:50:16.956689+0000, chain.objs.size()=1 2024-09-12T01:02:39.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.x-2hVT2V1oR4a5Vl8w-DsScqg1ogkGC_0 2024-09-12T01:02:39.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15245692740324653849', time=2024-09-12T02:50:16.976740+0000, chain.objs.size()=1 2024-09-12T01:02:39.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.QjKLL6T78syk5AM-8xmPLvjv41kbBN__0 2024-09-12T01:02:39.791 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15154652005549693321', time=2024-09-12T02:50:16.980614+0000, chain.objs.size()=1 2024-09-12T01:02:39.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ou65gJbLra5L4zcxEgHevVrrPt5PnRb_0 2024-09-12T01:02:39.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8252186245098157604', time=2024-09-12T02:50:17.150817+0000, chain.objs.size()=1 2024-09-12T01:02:39.792 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.794+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.BG65rsKhNCiuQD0Rwjj43ytMKIaIl6s_0 2024-09-12T01:02:39.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.798+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.114187645719082652', time=2024-09-12T02:50:17.230772+0000, chain.objs.size()=1 2024-09-12T01:02:39.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.798+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.G2kiK8Zo3f4LqY36G8l_6nVnZpIT9vI_0 2024-09-12T01:02:39.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.798+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9270496634325900725', time=2024-09-12T02:50:17.275712+0000, chain.objs.size()=1 2024-09-12T01:02:39.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.798+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.VcQG5FJGLSthPORhTmwZXrdFZGw5841_0 2024-09-12T01:02:39.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.798+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6725066797527108335', time=2024-09-12T02:50:17.404152+0000, chain.objs.size()=1 2024-09-12T01:02:39.793 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.798+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.AtB0HHopjxt8nOMr3TZ8CoeQKKW9tTl_0 2024-09-12T01:02:39.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.798+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4657353405843473434', time=2024-09-12T02:50:17.497496+0000, chain.objs.size()=1 2024-09-12T01:02:39.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.798+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.v7Ib9NW8zClnQzNz_g9byZdpceVHcoZ_0 2024-09-12T01:02:39.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.798+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4711605658250929150', time=2024-09-12T02:50:17.645809+0000, chain.objs.size()=1 2024-09-12T01:02:39.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.798+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.chSwKRl8ad4Td09PbMV615WRi5muvsE_0 2024-09-12T01:02:39.795 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.798+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6986371162975911522', time=2024-09-12T02:50:39.426509+0000, chain.objs.size()=1 2024-09-12T01:02:39.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.798+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.LoMCsve15UYL9edioLYowg2AeyQU_YG_0 2024-09-12T01:02:39.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.798+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13071816650120246209', time=2024-09-12T02:50:39.445309+0000, chain.objs.size()=1 2024-09-12T01:02:39.796 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.798+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.FsfdllaWxLRFaKCh1MvmH24PTLn8M2T_0 2024-09-12T01:02:39.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.802+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15362301252567035584', time=2024-09-12T02:50:39.470717+0000, chain.objs.size()=1 2024-09-12T01:02:39.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.802+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.4ZENNLdEJsmpQyYoKWrWNUwvY5-zOeF_0 2024-09-12T01:02:39.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.802+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7365393467318689357', time=2024-09-12T02:50:39.502621+0000, chain.objs.size()=1 2024-09-12T01:02:39.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.802+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.SXp1W3_0Dq2c8kZgS_jINVSG2577oX2_0 2024-09-12T01:02:39.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.802+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15202862967664895130', time=2024-09-12T02:50:39.507500+0000, chain.objs.size()=1 2024-09-12T01:02:39.797 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.802+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.VOwTeimpns6ucC9De-ojuHK2ZZQzZd5_0 2024-09-12T01:02:39.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.802+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12328670645805853060', time=2024-09-12T02:50:39.530555+0000, chain.objs.size()=1 2024-09-12T01:02:39.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.802+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ZLxRthX0MFis4ma9EDTqmky2lmONoqv_0 2024-09-12T01:02:39.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.802+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5017528376471896996', time=2024-09-12T02:50:39.586034+0000, chain.objs.size()=1 2024-09-12T01:02:39.798 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.802+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.XblXoRI-5xbjar65foZz65zi_2NfY7R_0 2024-09-12T01:02:39.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.802+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17175535617214544211', time=2024-09-12T02:50:39.762268+0000, chain.objs.size()=1 2024-09-12T01:02:39.799 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.802+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.IrEh1LUEFnjWam88ozsrc64moZZG9rp_0 2024-09-12T01:02:39.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.802+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11723320118324358918', time=2024-09-12T02:50:39.845590+0000, chain.objs.size()=1 2024-09-12T01:02:39.800 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.802+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.rB_IptF-mcYFDFMnzjKWM8oVBxKbXd2_0 2024-09-12T01:02:39.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9474649265270454938', time=2024-09-12T02:50:39.861569+0000, chain.objs.size()=1 2024-09-12T01:02:39.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.BqQ-OtsHOEsIU4PneQbIBpu4Fwqg_ly_0 2024-09-12T01:02:39.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17603127503363205749', time=2024-09-12T02:50:40.018064+0000, chain.objs.size()=1 2024-09-12T01:02:39.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.z8X3pk-RswJiH1vsIdt43k9nKeQmRct_0 2024-09-12T01:02:39.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.292612418069947679', time=2024-09-12T02:50:40.136585+0000, chain.objs.size()=1 2024-09-12T01:02:39.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.7FFD0THI4bdtJIqzFtIyK1FqNiTvwDp_0 2024-09-12T01:02:39.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14707376052937607443', time=2024-09-12T02:50:40.248133+0000, chain.objs.size()=1 2024-09-12T01:02:39.801 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.7RYXeQa43oa8am11bnBCSRet0TFWHy5_0 2024-09-12T01:02:39.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15936890392995234073', time=2024-09-12T02:50:40.252653+0000, chain.objs.size()=1 2024-09-12T01:02:39.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.J6wEeGdnam28dxgI1jV2XOjrZExRyfr_0 2024-09-12T01:02:39.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14504219527193224980', time=2024-09-12T02:50:40.255007+0000, chain.objs.size()=1 2024-09-12T01:02:39.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.SyhaRVNBHnW-6WNo32TBEcRmOQ7SlQ1_0 2024-09-12T01:02:39.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9889502468643708555', time=2024-09-12T02:50:40.289858+0000, chain.objs.size()=1 2024-09-12T01:02:39.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.snXMW8FzsyczkA3PWS4O3cFy1gYBH1z_0 2024-09-12T01:02:39.804 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.806+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16490922057050734980', time=2024-09-12T02:50:40.292831+0000, chain.objs.size()=1 2024-09-12T01:02:39.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.806+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.mzMwJqrtAhdgOLbyZrrmTHTondOWMLy_0 2024-09-12T01:02:39.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.810+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6107250440087779446', time=2024-09-12T02:50:40.312563+0000, chain.objs.size()=1 2024-09-12T01:02:39.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.810+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.qsQwWIVIHRAwyHNZvtouB9LEILDtX4j_0 2024-09-12T01:02:39.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.810+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5421230683742259067', time=2024-09-12T02:50:40.604344+0000, chain.objs.size()=1 2024-09-12T01:02:39.805 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.810+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.aYLYFNcidQLjEeqS6Nnc9mP_f2ohFBU_0 2024-09-12T01:02:39.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.810+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2372035180529297206', time=2024-09-12T02:50:40.613839+0000, chain.objs.size()=1 2024-09-12T01:02:39.806 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.810+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.k7lLIrjZ8FlOIwz_4QfYG3fJLIHAu3r_0 2024-09-12T01:02:39.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.814+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15958339133596021557', time=2024-09-12T02:50:40.617886+0000, chain.objs.size()=1 2024-09-12T01:02:39.808 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.814+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.n5yCFO65nxfgDwPtOVsb_eRXbBkXT3T_0 2024-09-12T01:02:39.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.814+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4624294760245452925', time=2024-09-12T02:50:40.629836+0000, chain.objs.size()=1 2024-09-12T01:02:39.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.814+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.nagyOxEl8T1A9jNcVgUQnDbbVz4Tu-h_0 2024-09-12T01:02:39.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.814+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6225499546038833632', time=2024-09-12T02:50:40.730631+0000, chain.objs.size()=1 2024-09-12T01:02:39.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.814+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.RkT_5WXBWraO8qyezG5753kKoFLS31f_0 2024-09-12T01:02:39.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.814+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7405002536911378725', time=2024-09-12T02:50:40.831304+0000, chain.objs.size()=1 2024-09-12T01:02:39.809 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.814+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.1ybjprrgHPyPTctuf2yUx5VQzdcvq5l_0 2024-09-12T01:02:39.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.814+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5115947735971279875', time=2024-09-12T02:50:40.838212+0000, chain.objs.size()=1 2024-09-12T01:02:39.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.814+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.vSiDiJrN1JxyP6bPpLTqvqd1evhX-pP_0 2024-09-12T01:02:39.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.814+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8977938393397381329', time=2024-09-12T02:50:40.864892+0000, chain.objs.size()=1 2024-09-12T01:02:39.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.814+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.t7-4miMqIycfmqy8Q5Jo_8t7ToHh9u__0 2024-09-12T01:02:39.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.814+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17830527260508004978', time=2024-09-12T02:50:40.875839+0000, chain.objs.size()=1 2024-09-12T01:02:39.810 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.814+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.VY5DizhqhyHrFWTGBUvUlg4Qb4QYgSo_0 2024-09-12T01:02:39.814 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.818+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/49919 2024-09-12T01:02:39.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T01:02:39.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16678363934694249057', time=2024-09-12T02:50:41.039014+0000, chain.objs.size()=1 2024-09-12T01:02:39.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.d4p3OcCVoG6obd2FApKWPvPKJKosew0_0 2024-09-12T01:02:39.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9950163055678343579', time=2024-09-12T02:50:41.084147+0000, chain.objs.size()=1 2024-09-12T01:02:39.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.9dFeoGOo9msPm6bRxwtXXhoP1IZ_YBA_0 2024-09-12T01:02:39.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12596296911136102758', time=2024-09-12T02:50:41.094873+0000, chain.objs.size()=1 2024-09-12T01:02:39.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.EM1hizLEqht_m-yGwvclOoA47dpYyWO_0 2024-09-12T01:02:39.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4921087481222457964', time=2024-09-12T02:50:41.143543+0000, chain.objs.size()=1 2024-09-12T01:02:39.817 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.M2dLR9LDjYABJe4fWXXrv-X-ISuUuDf_0 2024-09-12T01:02:39.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5506190386581599276', time=2024-09-12T02:50:41.277578+0000, chain.objs.size()=1 2024-09-12T01:02:39.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.F5mDalyyN-6G23k9C5o41N23MRvrkgG_0 2024-09-12T01:02:39.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1107368472126859645', time=2024-09-12T02:50:41.323654+0000, chain.objs.size()=1 2024-09-12T01:02:39.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.YRo0r7sozxruIwI1PQYpgwyXlfKYyDF_0 2024-09-12T01:02:39.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9919689635550826120', time=2024-09-12T02:50:41.365303+0000, chain.objs.size()=1 2024-09-12T01:02:39.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ceNs6pRupZITxN-_1el2v_NtWh7_MF7_0 2024-09-12T01:02:39.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13714310044789016935', time=2024-09-12T02:50:41.393830+0000, chain.objs.size()=1 2024-09-12T01:02:39.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.-pIutQdnaE2-tW22WEFlC41TANHQP-Q_0 2024-09-12T01:02:39.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6282843894153729888', time=2024-09-12T02:50:41.605385+0000, chain.objs.size()=1 2024-09-12T01:02:39.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.9ZuT6DoQnByNR9-dNJYCDq8hosmn9Zi_0 2024-09-12T01:02:39.818 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8312304543170867003', time=2024-09-12T02:50:41.615330+0000, chain.objs.size()=1 2024-09-12T01:02:39.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.1JZMmqapbrsIJVrMj8Q3v4fEJTq_Fis_0 2024-09-12T01:02:39.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7687568836191530220', time=2024-09-12T02:50:41.637053+0000, chain.objs.size()=1 2024-09-12T01:02:39.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.lPLY2XfBS2JAVcaUvRbYc-RzWSJT7KU_0 2024-09-12T01:02:39.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11539822361488081261', time=2024-09-12T02:50:47.683827+0000, chain.objs.size()=1 2024-09-12T01:02:39.819 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.822+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.333__shadow_.W4W3yjSmvqVXdBZaX7P_DBG0vn3_g_S_0 2024-09-12T01:02:39.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10882583444870422860', time=2024-09-12T02:52:20.609027+0000, chain.objs.size()=1 2024-09-12T01:02:39.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.459__shadow_.KhaMVxgGBerhpHsSdUHfwQOadnV6UdE_0 2024-09-12T01:02:39.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10827239244317578004', time=2024-09-12T02:52:26.401124+0000, chain.objs.size()=1 2024-09-12T01:02:39.820 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.465__shadow_.IAdtNSdrmADzyM1S7137IVMvGoor6wq_0 2024-09-12T01:02:39.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1916790994058381497', time=2024-09-12T02:52:36.205273+0000, chain.objs.size()=1 2024-09-12T01:02:39.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.483__shadow_.ermjyZtp902QLl4ktOyOWa6IQdpipkA_0 2024-09-12T01:02:39.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.477003541537241919', time=2024-09-12T02:52:54.483749+0000, chain.objs.size()=6 2024-09-12T01:02:39.821 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.1 2024-09-12T01:02:39.823 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.2 2024-09-12T01:02:39.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.3 2024-09-12T01:02:39.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.4 2024-09-12T01:02:39.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.5 2024-09-12T01:02:39.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.507__multipart_srcmultipart.2~ArEbyzFglyU0OqPUMlrvDtYFocWXJEV.6 2024-09-12T01:02:39.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~zUzehrjUfZ41PR4gXrD_8DNiyrPHXoG', time=2024-09-12T02:53:39.171344+0000, chain.objs.size()=2 2024-09-12T01:02:39.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.529__multipart_mymultipart.2~zUzehrjUfZ41PR4gXrD_8DNiyrPHXoG.1 2024-09-12T01:02:39.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.529__multipart_mymultipart.2~zUzehrjUfZ41PR4gXrD_8DNiyrPHXoG.2 2024-09-12T01:02:39.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8642019549909611604', time=2024-09-12T02:54:24.602150+0000, chain.objs.size()=2 2024-09-12T01:02:39.824 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.826+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.552__shadow_.shDDiARQ2wU4tz7JvfGBnzcoG6vGkg1_0 2024-09-12T01:02:39.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.830+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.552__shadow_.shDDiARQ2wU4tz7JvfGBnzcoG6vGkg1_1 2024-09-12T01:02:39.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.830+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4028167072895022944', time=2024-09-12T02:54:32.895965+0000, chain.objs.size()=1 2024-09-12T01:02:39.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.830+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.559__shadow_._aoTPYSJLzFQY3LFDEtx-ku4MQ0V0NT_0 2024-09-12T01:02:39.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.830+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13949851699859312812', time=2024-09-12T02:54:34.779918+0000, chain.objs.size()=1 2024-09-12T01:02:39.827 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.830+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.561__multipart_mymultipart.XsOx26Kbawz7fRfN9AV9AzDsslkpQLp_.1 2024-09-12T01:02:39.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16699374664660090884', time=2024-09-12T02:54:52.025507+0000, chain.objs.size()=1 2024-09-12T01:02:39.830 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:2EoKGg4jHJ0HMAcMnjNPBUb34fNjtfn_.vkD4SZbW83pfke2EaZ8mfY70-_eqdCg_0 2024-09-12T01:02:39.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12858651638384039546', time=2024-09-12T02:55:08.117164+0000, chain.objs.size()=1 2024-09-12T01:02:39.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:fFslph4HBcTJHHrgpc.5BqoiIYhDTW9_.dW6jLzJH1L_KSdwLFVEh-zJzBO4k-Ob_0 2024-09-12T01:02:39.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8055399478430334016', time=2024-09-12T02:55:09.934130+0000, chain.objs.size()=1 2024-09-12T01:02:39.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:9pNqV1Ah2CopQxojRTcygYYbMEBX0gD_.vwtp2v9JK1F_xqEMC2hMufHy2o8aL1f_0 2024-09-12T01:02:39.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17361625282542734654', time=2024-09-12T02:55:14.122244+0000, chain.objs.size()=1 2024-09-12T01:02:39.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:s6zGAStl2tHyeBzGCjnVmxTHILEyMGF_.amags6mgJLOUH9eibsJ5HYJ9orkPaMh_0 2024-09-12T01:02:39.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17383329397454891539', time=2024-09-12T02:55:36.021229+0000, chain.objs.size()=1 2024-09-12T01:02:39.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.587__shadow:i4HOVwLv2w.OD8GdIgm4JjHiINts31d_.x55fRxCqtx_Y7k5ZWQldvRGJC0OYV3V_0 2024-09-12T01:02:39.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16458314594855422024', time=2024-09-12T02:58:18.588306+0000, chain.objs.size()=1 2024-09-12T01:02:39.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.626__shadow_.ZO5JyJcO_9qQaefHDRNWJmOjZQ18aO9_0 2024-09-12T01:02:39.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6025987839668535267', time=2024-09-12T02:58:39.089218+0000, chain.objs.size()=1 2024-09-12T01:02:39.831 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.653__shadow_.WCOwjnKk7r01a1PLlbYC5raT6g_OHxu_0 2024-09-12T01:02:39.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.834+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17530524178826095430', time=2024-09-12T02:58:50.060366+0000, chain.objs.size()=1 2024-09-12T01:02:39.832 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.834+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.665__shadow_.o6H0dL8knj4XgNbUEBCLI1zl6aCp3Fp_0 2024-09-12T01:02:39.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.838+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10679819885938967573', time=2024-09-12T02:58:51.340447+0000, chain.objs.size()=1 2024-09-12T01:02:39.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.838+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.666__shadow_.4b3J6KTDMa_fObEntSjGFWWiqcjWHvV_0 2024-09-12T01:02:39.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.838+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10467534546223388712', time=2024-09-12T02:58:59.049241+0000, chain.objs.size()=1 2024-09-12T01:02:39.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.838+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.679__shadow_.BwxAVkY9kmIqkNPNwYAIXSopl3roQ3z_0 2024-09-12T01:02:39.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.838+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12913198018896056307', time=2024-09-12T03:02:06.473166+0000, chain.objs.size()=1 2024-09-12T01:02:39.834 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.838+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.782__shadow_.6woHuRq-aTNkgSztLnUjRVC4AIixiRw_0 2024-09-12T01:02:39.840 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.842+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:39.842 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.846+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:02:39.843 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.846+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.844 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.846+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46997' 2024-09-12T01:02:39.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15666010924326042516', time=2024-09-12T02:48:31.307925+0000, chain.objs.size()=1 2024-09-12T01:02:39.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.244__shadow_.686b8lQY3jAwVEVurFPWC_yR32wmorw_0 2024-09-12T01:02:39.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2083782783236850710', time=2024-09-12T02:48:34.996718+0000, chain.objs.size()=1 2024-09-12T01:02:39.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.249__shadow_.Svy0-VwJhSzhZn_UqkjQNLcuXAaos16_0 2024-09-12T01:02:39.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8015492909157372393', time=2024-09-12T02:48:38.020192+0000, chain.objs.size()=1 2024-09-12T01:02:39.845 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.253__shadow_.H8tui8eCCieIjowN54ZjArOBtUsAKHR_0 2024-09-12T01:02:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4957997250120580922', time=2024-09-12T02:49:05.418081+0000, chain.objs.size()=1 2024-09-12T01:02:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.M9LnQQ0DW9OltQSXHS3JnO5V0NFgNin_0 2024-09-12T01:02:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16952408346581247820', time=2024-09-12T02:49:05.500791+0000, chain.objs.size()=1 2024-09-12T01:02:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.YK6qwlpSz-ZTEEBul85u_iWssCCGxZk_0 2024-09-12T01:02:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7887425012372025662', time=2024-09-12T02:49:05.501599+0000, chain.objs.size()=1 2024-09-12T01:02:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.dPWt9MkeaMbPdIbY_WcdgvOxX6Vd6Kg_0 2024-09-12T01:02:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15459599024119777017', time=2024-09-12T02:49:05.536030+0000, chain.objs.size()=1 2024-09-12T01:02:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.HCeTpIBEdMXSC3i4RRRoy5RYT-mnD6C_0 2024-09-12T01:02:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14439597014425114519', time=2024-09-12T02:49:05.536739+0000, chain.objs.size()=1 2024-09-12T01:02:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.tcXoEQdNbn9DBZKa9p8MPW19zy9-B_b_0 2024-09-12T01:02:39.846 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15874743102134405384', time=2024-09-12T02:49:05.557226+0000, chain.objs.size()=1 2024-09-12T01:02:39.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.q7AdnBFzMw3J0gFBS6NlHNLK0Qbfkq9_0 2024-09-12T01:02:39.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6267332625083279673', time=2024-09-12T02:49:05.969440+0000, chain.objs.size()=1 2024-09-12T01:02:39.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.bcgnM_kI6A1jpTR_UsYV-PVtpAHGlYK_0 2024-09-12T01:02:39.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13589674639712931674', time=2024-09-12T02:49:06.098149+0000, chain.objs.size()=1 2024-09-12T01:02:39.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.E386nw_cn-eD69ohiuVr9jaPCFyJ_LW_0 2024-09-12T01:02:39.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11081817367762107963', time=2024-09-12T02:49:06.248371+0000, chain.objs.size()=1 2024-09-12T01:02:39.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.nWzWHUhbMbsLcpTticCw77XP09j7I1U_0 2024-09-12T01:02:39.847 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.217073941453519772', time=2024-09-12T02:49:06.313177+0000, chain.objs.size()=1 2024-09-12T01:02:39.848 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.850+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.7pZA-GVOSfvPMoAxbRsRsNuSny-Mf6v_0 2024-09-12T01:02:39.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4322343513397474100', time=2024-09-12T02:49:06.330265+0000, chain.objs.size()=1 2024-09-12T01:02:39.849 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.CRur08qL_HFc7mlNAHSv4lPIYB5THcz_0 2024-09-12T01:02:39.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5823535883052827086', time=2024-09-12T02:49:06.349332+0000, chain.objs.size()=1 2024-09-12T01:02:39.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.sQsop1YV_vpf8aLssDkrdhmzkLkJpNH_0 2024-09-12T01:02:39.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12902489471379008672', time=2024-09-12T02:49:06.355126+0000, chain.objs.size()=1 2024-09-12T01:02:39.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.EcZp8uVxiSCsrTx9otiEFz88sXtSie8_0 2024-09-12T01:02:39.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10826345398793960402', time=2024-09-12T02:49:06.531960+0000, chain.objs.size()=1 2024-09-12T01:02:39.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.QtXLXLMFKHAaD48PdtLHeYTWc6dRvEq_0 2024-09-12T01:02:39.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14656668857770674904', time=2024-09-12T02:49:06.606515+0000, chain.objs.size()=1 2024-09-12T01:02:39.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.1o_AHp1bum3BaLVl9MNc9tbqx8lnqU3_0 2024-09-12T01:02:39.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17799285269295812478', time=2024-09-12T02:49:06.612098+0000, chain.objs.size()=1 2024-09-12T01:02:39.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Z1g5_4yM-cFWH7BDq-1_XV1Mf943ys1_0 2024-09-12T01:02:39.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3551080416647748566', time=2024-09-12T02:49:06.618911+0000, chain.objs.size()=1 2024-09-12T01:02:39.850 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.XYibebs5r2Th5tOLtMsUbp8ZrMLPg4H_0 2024-09-12T01:02:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16519621379808901531', time=2024-09-12T02:49:06.755905+0000, chain.objs.size()=1 2024-09-12T01:02:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.22w5G4QXVK1wzuV6QUJ0xcjQupRpqb1_0 2024-09-12T01:02:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4088540912784153884', time=2024-09-12T02:49:06.795035+0000, chain.objs.size()=1 2024-09-12T01:02:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.xQSQ507Y14OiXy_WkkjPKAurPKIJUb9_0 2024-09-12T01:02:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15302629950271150388', time=2024-09-12T02:49:06.864960+0000, chain.objs.size()=1 2024-09-12T01:02:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.y00vBj7dksY6DwD4cOEWCAx-S0wgv5r_0 2024-09-12T01:02:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7451989803875883491', time=2024-09-12T02:49:07.059653+0000, chain.objs.size()=1 2024-09-12T01:02:39.851 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.854+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.YWMOgarkewzjfqn3rPM5oGldEz8nB4K_0 2024-09-12T01:02:39.852 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11352151373463721167', time=2024-09-12T02:49:07.120457+0000, chain.objs.size()=1 2024-09-12T01:02:39.853 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.fjnoHdXpBTXGSRyWCtTA_ef_vseEDUm_0 2024-09-12T01:02:39.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.215727806564478128', time=2024-09-12T02:49:07.157963+0000, chain.objs.size()=1 2024-09-12T01:02:39.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.w-Pf_0uOVX-oIn67XUQ3TysEkuZas0j_0 2024-09-12T01:02:39.854 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2502667961660856171', time=2024-09-12T02:49:07.177820+0000, chain.objs.size()=1 2024-09-12T01:02:39.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.T2LmL9DL-s-9C0n3wGnCo_ZyNOk4dfJ_0 2024-09-12T01:02:39.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1057288611234809243', time=2024-09-12T02:49:07.315171+0000, chain.objs.size()=1 2024-09-12T01:02:39.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.cr4klRdvDYSHiHt2F5dETc055IRBMtq_0 2024-09-12T01:02:39.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16180323412145627839', time=2024-09-12T02:49:07.366330+0000, chain.objs.size()=1 2024-09-12T01:02:39.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.LuFK_8p9BsYC2Tf-Da6W4iucMu3kTR-_0 2024-09-12T01:02:39.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7751442120411562617', time=2024-09-12T02:49:07.391210+0000, chain.objs.size()=1 2024-09-12T01:02:39.855 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.Va4ic2DPSBa9MZFTYHfIjAZILXpE2SQ_0 2024-09-12T01:02:39.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10895630626823440108', time=2024-09-12T02:49:07.401462+0000, chain.objs.size()=1 2024-09-12T01:02:39.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.UvEyqmnoyJAn1KmJIiuT-2Gjr9_k0cL_0 2024-09-12T01:02:39.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1709895700090113898', time=2024-09-12T02:49:07.427886+0000, chain.objs.size()=1 2024-09-12T01:02:39.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_._g-0iQHuB3Wkbjo6cbDpLXQafez3eIg_0 2024-09-12T01:02:39.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12495000691309681717', time=2024-09-12T02:49:11.858464+0000, chain.objs.size()=1 2024-09-12T01:02:39.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.268__shadow_.N9bsUC4HVbu4hchBYI6DSSIV-e9Auyn_0 2024-09-12T01:02:39.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16619962711411345251', time=2024-09-12T02:49:15.438696+0000, chain.objs.size()=1 2024-09-12T01:02:39.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.273__shadow_.C26XOFdymqtETJWYX44AsG1KdP9GuPu_0 2024-09-12T01:02:39.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9817635131166899908', time=2024-09-12T02:49:19.349217+0000, chain.objs.size()=1 2024-09-12T01:02:39.856 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.858+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.278__shadow_.NZZ2vZhh1wc5QcE43aipB8QiyqOd6mg_0 2024-09-12T01:02:39.862 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.866+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16585538025742584241', time=2024-09-12T02:49:19.352309+0000, chain.objs.size()=1 2024-09-12T01:02:39.863 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.866+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.278__shadow_.XXCqUYa3Qmo2K24xiNx6W-T3d-Z_n1Q_0 2024-09-12T01:02:39.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.866+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16823206034829037068', time=2024-09-12T02:49:28.413917+0000, chain.objs.size()=1 2024-09-12T01:02:39.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.866+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.290__shadow_.ECLvIKxkukeH5nvhUZ8P4Ycm13J89mc_0 2024-09-12T01:02:39.864 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.866+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3646774952409697936', time=2024-09-12T02:49:41.408260+0000, chain.objs.size()=1 2024-09-12T01:02:39.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.866+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.305__shadow_.PrC_-TJFJwCFkMbh1PURJ4U3yZl7js8_0 2024-09-12T01:02:39.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.866+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.222125276986865709', time=2024-09-12T02:50:15.905145+0000, chain.objs.size()=1 2024-09-12T01:02:39.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.866+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.aHDZQOMvycCeYnTPgZGK2MuhB-ptqaV_0 2024-09-12T01:02:39.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.866+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16762090287220855535', time=2024-09-12T02:50:15.953437+0000, chain.objs.size()=1 2024-09-12T01:02:39.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.866+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.2HkPahb34dAxpXymw_lWdMxk9uR2WYW_0 2024-09-12T01:02:39.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.866+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3131465972839859323', time=2024-09-12T02:50:16.077171+0000, chain.objs.size()=1 2024-09-12T01:02:39.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.870+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.HiFX_iWgOUbe8-GEmEjUYhVbbkIDvJB_0 2024-09-12T01:02:39.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.870+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8087288951766641893', time=2024-09-12T02:50:16.095795+0000, chain.objs.size()=1 2024-09-12T01:02:39.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.870+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.J1kfQ1YWQJV5VIlkSGMTc0oJauZ1mvz_0 2024-09-12T01:02:39.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.870+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11107149613822328683', time=2024-09-12T02:50:16.111509+0000, chain.objs.size()=1 2024-09-12T01:02:39.865 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.870+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.rYPpe9zsA0C8PnNr2HbWaQPeLaIqjc0_0 2024-09-12T01:02:39.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.870+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4068472478099632986', time=2024-09-12T02:50:16.418155+0000, chain.objs.size()=1 2024-09-12T01:02:39.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.870+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.hbYy0yPI9Pz_-Ei4OAatdm4zwdwpKUV_0 2024-09-12T01:02:39.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.870+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14111370566952971781', time=2024-09-12T02:50:16.434814+0000, chain.objs.size()=1 2024-09-12T01:02:39.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.870+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.TqV0e_tJtYkptwDJ65eBn5-k5bdL6S2_0 2024-09-12T01:02:39.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.870+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10376043744745939385', time=2024-09-12T02:50:16.446555+0000, chain.objs.size()=1 2024-09-12T01:02:39.866 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.870+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.etHolbY2aVF-sj9750aV2JsPutTg-Sf_0 2024-09-12T01:02:39.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.870+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17474454827500234740', time=2024-09-12T02:50:16.450096+0000, chain.objs.size()=1 2024-09-12T01:02:39.867 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.870+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.JWON7w6Uhg8yB12pvToOZExPHu1MtSK_0 2024-09-12T01:02:39.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10289879199662362214', time=2024-09-12T02:50:16.481696+0000, chain.objs.size()=1 2024-09-12T01:02:39.869 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Fse45kNIXyALLXRZ6vLQiO124HGFkC7_0 2024-09-12T01:02:39.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15307247965310573632', time=2024-09-12T02:50:16.515946+0000, chain.objs.size()=1 2024-09-12T01:02:39.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.dys_bX5EVnt06UG801W0Fp7kAkerWYc_0 2024-09-12T01:02:39.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3142883444616499924', time=2024-09-12T02:50:16.709532+0000, chain.objs.size()=1 2024-09-12T01:02:39.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.TGByIFz9pOIoJAQgoxbknq5SmDaaWx2_0 2024-09-12T01:02:39.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2220900747299299588', time=2024-09-12T02:50:16.746024+0000, chain.objs.size()=1 2024-09-12T01:02:39.871 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.TNta_lWiUYUGpPdspYnk4G_DTVW6A0A_0 2024-09-12T01:02:39.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1193422657162157146', time=2024-09-12T02:50:16.963131+0000, chain.objs.size()=1 2024-09-12T01:02:39.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.1yAU1bONf5v9HqzS8E0NlylCFnanVt7_0 2024-09-12T01:02:39.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16979406419480463741', time=2024-09-12T02:50:16.986670+0000, chain.objs.size()=1 2024-09-12T01:02:39.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.jI9p8mPuSqw9bK_aJHOdFhUeoqw7iFi_0 2024-09-12T01:02:39.872 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9946649186586899321', time=2024-09-12T02:50:17.012440+0000, chain.objs.size()=1 2024-09-12T01:02:39.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.zC-Cx7T2yAY7G7bn5PhPbxYYXOu1oOG_0 2024-09-12T01:02:39.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6692019291013937537', time=2024-09-12T02:50:17.020309+0000, chain.objs.size()=1 2024-09-12T01:02:39.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.htXppXShaWvCoTLyWguj8nhuHnCP31n_0 2024-09-12T01:02:39.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17191317205052016254', time=2024-09-12T02:50:17.186656+0000, chain.objs.size()=1 2024-09-12T01:02:39.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.6tiZUHxHBcOJXz51dOiKmSa8JuU9AZm_0 2024-09-12T01:02:39.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14275375112133601373', time=2024-09-12T02:50:17.218210+0000, chain.objs.size()=1 2024-09-12T01:02:39.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.VT24I0KkkpKEQUZ0WadEaovOMXhiD7a_0 2024-09-12T01:02:39.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11069140232349683022', time=2024-09-12T02:50:17.269484+0000, chain.objs.size()=1 2024-09-12T01:02:39.873 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.874+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.wkAxGMOTwpHrdFFdGEMWvCxEVHG36Au_0 2024-09-12T01:02:39.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.878+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14155075276394842631', time=2024-09-12T02:50:17.279269+0000, chain.objs.size()=1 2024-09-12T01:02:39.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.878+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Kz6ovzFAeB3pmhL9oei7oZ23nNgGMwF_0 2024-09-12T01:02:39.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.878+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2812728249677367130', time=2024-09-12T02:50:17.434610+0000, chain.objs.size()=1 2024-09-12T01:02:39.874 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.878+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.CZqtcEW5Z1vgDDrmWStnzV60Xa1NdXk_0 2024-09-12T01:02:39.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.878+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3899584785326118705', time=2024-09-12T02:50:17.518870+0000, chain.objs.size()=1 2024-09-12T01:02:39.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.878+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.cnRb99n9yYljAnOwXShOmbzS8RJCMMG_0 2024-09-12T01:02:39.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.878+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4475112168702300118', time=2024-09-12T02:50:17.521529+0000, chain.objs.size()=1 2024-09-12T01:02:39.875 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.878+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.-rFfOgi_TbO2KhBflcDRe0AGQojZ1Vu_0 2024-09-12T01:02:39.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.878+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13515801291997851743', time=2024-09-12T02:50:17.650869+0000, chain.objs.size()=1 2024-09-12T01:02:39.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.878+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.cuxotj4lp1DnW7yIWZWdd57pw3TdlBv_0 2024-09-12T01:02:39.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.878+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.403205633365575425', time=2024-09-12T02:50:17.720481+0000, chain.objs.size()=1 2024-09-12T01:02:39.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.878+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.c88EJslbm_U29CXsVZBmmk5R961J8fS_0 2024-09-12T01:02:39.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.878+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4828187303115143402', time=2024-09-12T02:50:17.730772+0000, chain.objs.size()=1 2024-09-12T01:02:39.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.878+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.277LPYbmrRtPcVYAVUTo_O0zkvvGTul_0 2024-09-12T01:02:39.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.878+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2683851477518843454', time=2024-09-12T02:50:17.733180+0000, chain.objs.size()=1 2024-09-12T01:02:39.876 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.878+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.WlEvkRkDSESWuw-nrEw18YocNPRYvzS_0 2024-09-12T01:02:39.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6892644562269201746', time=2024-09-12T02:50:17.747147+0000, chain.objs.size()=1 2024-09-12T01:02:39.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.S5mdjyHjBvvJeODkeVN6_WUrrgp7lj8_0 2024-09-12T01:02:39.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11257187773841008013', time=2024-09-12T02:50:17.760138+0000, chain.objs.size()=1 2024-09-12T01:02:39.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.d_DS4RQT72BkF2DR_5cobJOfvMKdnrt_0 2024-09-12T01:02:39.878 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10018667688768111897', time=2024-09-12T02:50:39.438959+0000, chain.objs.size()=1 2024-09-12T01:02:39.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.NCv4vASly3VvPn4rm3rYirFE6gVdRxx_0 2024-09-12T01:02:39.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4822563222768430588', time=2024-09-12T02:50:39.484734+0000, chain.objs.size()=1 2024-09-12T01:02:39.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.qEv3V-ixtNQP0Dy2TO-nxUVdvMbXUTb_0 2024-09-12T01:02:39.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11125076314092431438', time=2024-09-12T02:50:39.525888+0000, chain.objs.size()=1 2024-09-12T01:02:39.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Mrssvhv1wNJ-jpwL-_AzbzUIks_W-oA_0 2024-09-12T01:02:39.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2485132042048202632', time=2024-09-12T02:50:39.544594+0000, chain.objs.size()=1 2024-09-12T01:02:39.879 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.UHabFMdzKVN7hm5qugO6BqOE9PO67VO_0 2024-09-12T01:02:39.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.882+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1555226633586791965', time=2024-09-12T02:50:39.578241+0000, chain.objs.size()=1 2024-09-12T01:02:39.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.882+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Yny2Xm6o6M27H8veZ2iR-PuhT1SfX3C_0 2024-09-12T01:02:39.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.886+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17498726614214191853', time=2024-09-12T02:50:39.588914+0000, chain.objs.size()=1 2024-09-12T01:02:39.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.886+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.MbCikKxQRqZvcJzWZU5pEGclqILvbuw_0 2024-09-12T01:02:39.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.886+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17726533522412393517', time=2024-09-12T02:50:39.791140+0000, chain.objs.size()=1 2024-09-12T01:02:39.880 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.886+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.c3o0WBRflRbVYLR2fSrs3h7AoEMkV1d_0 2024-09-12T01:02:39.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.886+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5539278530245842193', time=2024-09-12T02:50:40.053285+0000, chain.objs.size()=1 2024-09-12T01:02:39.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.886+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.C2XdqaKm4krZFBRax7wKQHQNZuWbEaC_0 2024-09-12T01:02:39.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.886+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.880945518448177408', time=2024-09-12T02:50:40.331490+0000, chain.objs.size()=1 2024-09-12T01:02:39.881 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.886+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.lpGtezMHnYlEWCSirg9S1YLvvxzdrZd_0 2024-09-12T01:02:39.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.886+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17354283504631084877', time=2024-09-12T02:50:40.563874+0000, chain.objs.size()=1 2024-09-12T01:02:39.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.886+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.afjQ0ph_dNWKWecQtj5dTlNVhicVrXo_0 2024-09-12T01:02:39.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.886+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14906561472384061088', time=2024-09-12T02:50:40.577624+0000, chain.objs.size()=1 2024-09-12T01:02:39.883 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.886+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.xirvRYq_n88_XLd_60XC7oovsacmi4D_0 2024-09-12T01:02:39.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3513035283587578167', time=2024-09-12T02:50:40.622692+0000, chain.objs.size()=1 2024-09-12T01:02:39.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.duagTGs2oR3gHuZbCtZRUikdlRzr2Cu_0 2024-09-12T01:02:39.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7216701049196468772', time=2024-09-12T02:50:40.730088+0000, chain.objs.size()=1 2024-09-12T01:02:39.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Wa-9F3i0h98e1UQWCasbJOXcqqihOoG_0 2024-09-12T01:02:39.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10789246027080842074', time=2024-09-12T02:50:40.758218+0000, chain.objs.size()=1 2024-09-12T01:02:39.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.pbpUrPY-esWz15sN-TEUDIR27F0mUJJ_0 2024-09-12T01:02:39.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3498289441661139801', time=2024-09-12T02:50:40.783914+0000, chain.objs.size()=1 2024-09-12T01:02:39.885 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.r4KF21OVrIOBR7tvOHlTkBYOekPuSv__0 2024-09-12T01:02:39.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.690841760305490446', time=2024-09-12T02:50:40.819133+0000, chain.objs.size()=1 2024-09-12T01:02:39.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ozq7jW_3qgsSDvZ2NxBygEXNdcAKMKB_0 2024-09-12T01:02:39.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10451908315011188048', time=2024-09-12T02:50:40.897646+0000, chain.objs.size()=1 2024-09-12T01:02:39.886 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.qV_RvPfXUvH8eJDO0rwjVUpJ2FytVUC_0 2024-09-12T01:02:39.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15955103539760794298', time=2024-09-12T02:50:41.053922+0000, chain.objs.size()=1 2024-09-12T01:02:39.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.aBl4yrZyAnEVff-D25rZpgQr0RhJaWc_0 2024-09-12T01:02:39.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9279494931809582401', time=2024-09-12T02:50:41.057211+0000, chain.objs.size()=1 2024-09-12T01:02:39.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.DcL_h7ehDHbIthAEgBPnrAOpaHjsB5W_0 2024-09-12T01:02:39.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10295259044782538532', time=2024-09-12T02:50:41.111245+0000, chain.objs.size()=1 2024-09-12T01:02:39.887 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.890+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.w7LW8rsDWPosQL6RuKiqsZgx4o4hz5q_0 2024-09-12T01:02:39.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13315050737713643161', time=2024-09-12T02:50:41.154212+0000, chain.objs.size()=1 2024-09-12T01:02:39.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Y_E4uwzS_caLQb6d3tqmyOSPppyX6qW_0 2024-09-12T01:02:39.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17149507772135058196', time=2024-09-12T02:50:41.275303+0000, chain.objs.size()=1 2024-09-12T01:02:39.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.cLTo-mCC0eVcGkuCxLTtPEzb2qFV3s0_0 2024-09-12T01:02:39.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9028321955951029056', time=2024-09-12T02:50:41.303462+0000, chain.objs.size()=1 2024-09-12T01:02:39.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.rRGlKs9VnxO_llV_1JhNln58XRl_fIZ_0 2024-09-12T01:02:39.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17938386396339229979', time=2024-09-12T02:50:41.313831+0000, chain.objs.size()=1 2024-09-12T01:02:39.889 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.vw4enjme1IAK6wr9g5uGejFK-SBtUAU_0 2024-09-12T01:02:39.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13731062719446400084', time=2024-09-12T02:50:41.391965+0000, chain.objs.size()=1 2024-09-12T01:02:39.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.k8mWIkcz_eaC5VOjDX_DnWTJ2t16C9A_0 2024-09-12T01:02:39.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17223352686944140407', time=2024-09-12T02:50:41.425381+0000, chain.objs.size()=1 2024-09-12T01:02:39.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.31ME85os9gNjg5VHE9HzpETcEHSR_gO_0 2024-09-12T01:02:39.890 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7904696699233924369', time=2024-09-12T02:50:41.566246+0000, chain.objs.size()=1 2024-09-12T01:02:39.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.IGtJlbzcpKY7tJ0YAxOBg1_cIK0OK-i_0 2024-09-12T01:02:39.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1251472877938485849', time=2024-09-12T02:50:41.567803+0000, chain.objs.size()=1 2024-09-12T01:02:39.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.kSaFh-M9EdOda184dtf52f7Hp1jsL2E_0 2024-09-12T01:02:39.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15637350312411041743', time=2024-09-12T02:50:41.617699+0000, chain.objs.size()=1 2024-09-12T01:02:39.891 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.894+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.CeNppyAA3GM3-fjFSDTdDiOvNCQTgnR_0 2024-09-12T01:02:39.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.898+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15723497247990904314', time=2024-09-12T02:50:41.633100+0000, chain.objs.size()=1 2024-09-12T01:02:39.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.898+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.wOhdmEWnG6X9lvNpMQkx2S8IFnPbVHZ_0 2024-09-12T01:02:39.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.898+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11642051470543839091', time=2024-09-12T02:51:58.996830+0000, chain.objs.size()=1 2024-09-12T01:02:39.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.898+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.433__shadow_.T7gPE2pg6x-PgqQfx2Z62BSgCxDarTx_0 2024-09-12T01:02:39.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.898+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4481325441568315724', time=2024-09-12T02:52:46.448678+0000, chain.objs.size()=1 2024-09-12T01:02:39.895 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.898+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.498__shadow_.9zoRtlZIT-cQSE27KNsr9z9cMPSOzQ8_0 2024-09-12T01:02:39.898 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.902+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/46997 2024-09-12T01:02:39.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T01:02:39.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12512500367557189975', time=2024-09-12T02:52:50.362018+0000, chain.objs.size()=1 2024-09-12T01:02:39.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.503__shadow:kkpnEcohSrS0OmtT6cE4b1ngYotif0k_.RijEw510gCv7_gxNQ272Sla30v4Z_0T_0 2024-09-12T01:02:39.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13998252681404614679', time=2024-09-12T02:54:02.517690+0000, chain.objs.size()=1 2024-09-12T01:02:39.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.537__shadow_.EZHfg70D0okNsrJe7Hb3sY6ct96C4fJ_0 2024-09-12T01:02:39.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6780866699823613856', time=2024-09-12T02:54:48.496099+0000, chain.objs.size()=1 2024-09-12T01:02:39.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:VvNx9dmuPL1jFVZtWC8aG1Y-TWDC4oQ_.ACoWaAqy_P23o9XPqqs6gHmAEiokzAT_0 2024-09-12T01:02:39.901 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11987648613238782454', time=2024-09-12T02:54:52.307841+0000, chain.objs.size()=1 2024-09-12T01:02:39.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.569__shadow:g.jk.6xcmwz0G.uO5NuBneVdbSh.Sno_.i3gcgiJ5vWAjmGLA6H6m07zbYfQ7K4O_0 2024-09-12T01:02:39.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8619235109124500409', time=2024-09-12T02:54:59.402417+0000, chain.objs.size()=1 2024-09-12T01:02:39.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.574__shadow:0dI6K7lV9bhAQAof9JF1cFjiSSAVSbq_.9jRilS1-RdwprdbumKfksG5HAG1L8KS_0 2024-09-12T01:02:39.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13935751439519088918', time=2024-09-12T02:55:09.119561+0000, chain.objs.size()=1 2024-09-12T01:02:39.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:IddBAec6LCeURZfTV0VGof3l2ZET3XD_.CHJ8zHLveMrExF2vhXJflbvMa_rqkpu_0 2024-09-12T01:02:39.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7755226044127489790', time=2024-09-12T02:55:34.338482+0000, chain.objs.size()=1 2024-09-12T01:02:39.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.585__shadow:jD0fSfDZ4UGzTzZGWrd8Rk.lXBizUPp_.5K_xJHtOA4LdVLQz6Re6Ur7NpCPYO84_0 2024-09-12T01:02:39.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3766735541059378103', time=2024-09-12T02:56:02.776403+0000, chain.objs.size()=6 2024-09-12T01:02:39.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.614__multipart_multipart_enc.2~YTnEs_-ISwZbSYFMzdmxR6yFNZD_0Pv.1 2024-09-12T01:02:39.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.614__multipart_multipart_enc.2~YTnEs_-ISwZbSYFMzdmxR6yFNZD_0Pv.2 2024-09-12T01:02:39.902 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.614__multipart_multipart_enc.2~YTnEs_-ISwZbSYFMzdmxR6yFNZD_0Pv.3 2024-09-12T01:02:39.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.614__multipart_multipart_enc.2~YTnEs_-ISwZbSYFMzdmxR6yFNZD_0Pv.4 2024-09-12T01:02:39.903 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.906+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.614__multipart_multipart_enc.2~YTnEs_-ISwZbSYFMzdmxR6yFNZD_0Pv.5 2024-09-12T01:02:39.904 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.910+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.614__multipart_multipart_enc.2~YTnEs_-ISwZbSYFMzdmxR6yFNZD_0Pv.6 2024-09-12T01:02:39.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.910+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2955460432764448646', time=2024-09-12T02:58:19.329364+0000, chain.objs.size()=1 2024-09-12T01:02:39.905 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.910+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.627__shadow_.hWfvn8XkqlCK5_u_Xn6QAmQ41-TSRLt_0 2024-09-12T01:02:39.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.910+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15407245026820362404', time=2024-09-12T02:58:29.623821+0000, chain.objs.size()=1 2024-09-12T01:02:39.906 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.910+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.642__shadow_.9sbeJzfSO3Um4bSf_Sv6iFRYJ2FZ0eY_0 2024-09-12T01:02:39.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.914+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5242219066090052765', time=2024-09-12T02:58:30.409549+0000, chain.objs.size()=1 2024-09-12T01:02:39.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.914+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.643__shadow_.Lf-eDS8EWmr_0EDQ0V2IdJnGsYjyTZ5_0 2024-09-12T01:02:39.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.914+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10598501968055554567', time=2024-09-12T02:58:40.981935+0000, chain.objs.size()=1 2024-09-12T01:02:39.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.914+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.655__shadow_.WWx1eOUwkZCc7Lu8TxiCD7dydBIex1Y_0 2024-09-12T01:02:39.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.914+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10048204723535555083', time=2024-09-12T03:00:02.168347+0000, chain.objs.size()=1 2024-09-12T01:02:39.910 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.914+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.741__shadow_.6ArBgIYFMjVys1nsOrvsA5mljBX1Pi7_0 2024-09-12T01:02:39.915 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.918+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:39.917 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:02:39.918 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:39.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:39.919 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/66099' 2024-09-12T01:02:39.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11133931968153506689', time=2024-09-12T02:45:56.745991+0000, chain.objs.size()=1 2024-09-12T01:02:39.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.151__shadow_.RE-kL7fuj-X7R7DRXF1MRVQUDgWeANV_0 2024-09-12T01:02:39.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='_bi-ekHIYeJrmOXpkXmFOWhwJazWckAZ', time=2024-09-12T02:46:10.537477+0000, chain.objs.size()=1 2024-09-12T01:02:39.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:e2043445-c131-4520-984d-b4d52f038a6b.4538.165__shadow_.shHJ5UH8Dc56fZgZ-IbsBqWVqv_0tXr_0 2024-09-12T01:02:39.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13626086134818413695', time=2024-09-12T02:48:30.089104+0000, chain.objs.size()=1 2024-09-12T01:02:39.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.243__shadow_.LXpedKJw9oO4JNp6R25xsFOiC67PYh__0 2024-09-12T01:02:39.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16957696787639643099', time=2024-09-12T02:48:31.305621+0000, chain.objs.size()=1 2024-09-12T01:02:39.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.244__shadow_.QWb1nqVPQFDjoKPULWZe5N1yBR5dvcK_0 2024-09-12T01:02:39.920 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10228086147591274493', time=2024-09-12T02:48:34.996089+0000, chain.objs.size()=1 2024-09-12T01:02:39.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.249__shadow_.SvUB3jRl7cipFhMTdS_lVixLndhJQ7j_0 2024-09-12T01:02:39.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12066708900403329813', time=2024-09-12T02:49:05.413131+0000, chain.objs.size()=1 2024-09-12T01:02:39.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.vCrZ1TACSp5zhf-QkiIA6w7dl-WSHUU_0 2024-09-12T01:02:39.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6625918335853859296', time=2024-09-12T02:49:05.484658+0000, chain.objs.size()=1 2024-09-12T01:02:39.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_._slKH6hR7J5s_7H3XV873N_qPE9PDwc_0 2024-09-12T01:02:39.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7117096202874431820', time=2024-09-12T02:49:05.528130+0000, chain.objs.size()=1 2024-09-12T01:02:39.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.9NqnJvPi5cW_8MQyVCXQ5cUAEUlN5Xd_0 2024-09-12T01:02:39.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1798709878477780495', time=2024-09-12T02:49:05.567673+0000, chain.objs.size()=1 2024-09-12T01:02:39.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.-PKWhxQv0wjpT9qaJRDf-BAcnox4K6t_0 2024-09-12T01:02:39.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15966227471847981170', time=2024-09-12T02:49:05.570995+0000, chain.objs.size()=1 2024-09-12T01:02:39.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.--7Q546eA-puTD9i-QfpJ6oMw12ZVYW_0 2024-09-12T01:02:39.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9104222595633869501', time=2024-09-12T02:49:05.736085+0000, chain.objs.size()=1 2024-09-12T01:02:39.921 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.aH_St7DxNEkCSH_PsmPuY8PTWm8wJqP_0 2024-09-12T01:02:39.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16516131015109932164', time=2024-09-12T02:49:05.810265+0000, chain.objs.size()=1 2024-09-12T01:02:39.922 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.922+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.QQ7xXiIh29738Jgx_-eUS0z9LmpepWB_0 2024-09-12T01:02:39.923 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.926+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14325101750003625076', time=2024-09-12T02:49:05.820501+0000, chain.objs.size()=1 2024-09-12T01:02:39.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.926+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.zZbjPMKQJz6Pf79Z1FZTeXS9OqQXL3u_0 2024-09-12T01:02:39.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.926+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5139777820497029430', time=2024-09-12T02:49:05.854562+0000, chain.objs.size()=1 2024-09-12T01:02:39.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.926+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.dOeYNuoleRL60jDVcaFs_fyEI8BzKdL_0 2024-09-12T01:02:39.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.926+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1095133238620184391', time=2024-09-12T02:49:05.976306+0000, chain.objs.size()=1 2024-09-12T01:02:39.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.926+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.QQiE2ur2XxTT3Go4auEImRBKYuvKdLd_0 2024-09-12T01:02:39.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.926+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10043368406485065771', time=2024-09-12T02:49:05.993870+0000, chain.objs.size()=1 2024-09-12T01:02:39.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.926+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_._4zH7ZtiJh9EUUk-_DiHd8-ZobRpmdz_0 2024-09-12T01:02:39.924 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.930+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8303314698248968335', time=2024-09-12T02:49:06.018143+0000, chain.objs.size()=1 2024-09-12T01:02:39.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.930+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.AyhYxtCBfnftTM_BNZut1Dm4fOMLSyu_0 2024-09-12T01:02:39.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.930+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11805010258166323120', time=2024-09-12T02:49:06.056972+0000, chain.objs.size()=1 2024-09-12T01:02:39.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.930+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.gU0w5UdT1R9JRkWtoLrt7dL7mQFSZh6_0 2024-09-12T01:02:39.925 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.930+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4362524097285737164', time=2024-09-12T02:49:06.226993+0000, chain.objs.size()=1 2024-09-12T01:02:39.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.930+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.zJ0gi4OLtknubojNxVT0wYS74duukdM_0 2024-09-12T01:02:39.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.930+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9391958375184839147', time=2024-09-12T02:49:06.298300+0000, chain.objs.size()=1 2024-09-12T01:02:39.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.930+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.NIyNKBMmvoSdH6FK5i0Su5QhvkQhAk4_0 2024-09-12T01:02:39.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.930+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5615631519424136170', time=2024-09-12T02:49:06.352047+0000, chain.objs.size()=1 2024-09-12T01:02:39.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.930+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.32hOZO2nW3Yi8t32PgKTNMZqllAL7Ii_0 2024-09-12T01:02:39.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.930+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13348232860292710264', time=2024-09-12T02:49:06.375776+0000, chain.objs.size()=1 2024-09-12T01:02:39.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.930+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_._J8yNObONv_csr4OMQwcG_B0NiYvgb9_0 2024-09-12T01:02:39.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.930+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4928942973455005748', time=2024-09-12T02:49:06.546618+0000, chain.objs.size()=1 2024-09-12T01:02:39.926 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.930+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.lOP7jKqg2g_nzAre3wn1RmtcyZb4-vS_0 2024-09-12T01:02:39.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14745349749395208797', time=2024-09-12T02:49:06.811137+0000, chain.objs.size()=1 2024-09-12T01:02:39.929 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.IWjkpZ5J_LUo6GPwevnajfq5ApefX5v_0 2024-09-12T01:02:39.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3043045448465264862', time=2024-09-12T02:49:06.902672+0000, chain.objs.size()=1 2024-09-12T01:02:39.930 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.UIvgVAfiwduQHQYcLfvUtSTWroyvJgd_0 2024-09-12T01:02:39.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13830600123516710571', time=2024-09-12T02:49:07.062847+0000, chain.objs.size()=1 2024-09-12T01:02:39.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.5RrJhX3DTarPzslQpkfjfQh-Dy4x3Eg_0 2024-09-12T01:02:39.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5430784230353100223', time=2024-09-12T02:49:07.066153+0000, chain.objs.size()=1 2024-09-12T01:02:39.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.p1GDeAw3Nh6PrRcNWgq8-blelwLm0F2_0 2024-09-12T01:02:39.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6522696351438594222', time=2024-09-12T02:49:07.122590+0000, chain.objs.size()=1 2024-09-12T01:02:39.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.SFoHaWXzqVdUEgVyftzX1x1BXri9YWH_0 2024-09-12T01:02:39.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16568914641349990763', time=2024-09-12T02:49:07.130610+0000, chain.objs.size()=1 2024-09-12T01:02:39.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_._JQl5j1w8hHf3hgJhxrhQyI2jdndMwu_0 2024-09-12T01:02:39.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.934+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10680896889628721092', time=2024-09-12T02:49:07.133646+0000, chain.objs.size()=1 2024-09-12T01:02:39.931 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.934+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.hQ58dfpr-HsyjYjzxJvTGnl7PFX4ibX_0 2024-09-12T01:02:39.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.938+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11621419091502824516', time=2024-09-12T02:49:07.199629+0000, chain.objs.size()=1 2024-09-12T01:02:39.932 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.938+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.H_ZS2IdP1PhVm4Rn5x40vZGY5SJzi5v_0 2024-09-12T01:02:39.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.938+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9283132814757186503', time=2024-09-12T02:49:07.322043+0000, chain.objs.size()=1 2024-09-12T01:02:39.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.938+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.HUxqyY5smHZP4_Z9gM-GBpnRPRONTeq_0 2024-09-12T01:02:39.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.938+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11859765214659854312', time=2024-09-12T02:49:07.376422+0000, chain.objs.size()=1 2024-09-12T01:02:39.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.938+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.nCf9X5gB9tqZJB7ASjMguCsUIVD-WUK_0 2024-09-12T01:02:39.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.938+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2195123867712769771', time=2024-09-12T02:49:07.393467+0000, chain.objs.size()=1 2024-09-12T01:02:39.933 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.938+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.PBjK_Tu5ZsleFYGl8gBF6ZMZxDNRHlC_0 2024-09-12T01:02:39.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.938+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12576039736931751790', time=2024-09-12T02:49:07.417812+0000, chain.objs.size()=1 2024-09-12T01:02:39.934 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.938+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.2U5WePBylUBrR5VbBqJTMUbj9kBuKLD_0 2024-09-12T01:02:39.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.938+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7904709652956656865', time=2024-09-12T02:49:07.443162+0000, chain.objs.size()=1 2024-09-12T01:02:39.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.938+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.262__shadow_.OWdZQYNgfhAXE22d1oTMk81tepLWc17_0 2024-09-12T01:02:39.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.938+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.192058333597608443', time=2024-09-12T02:49:08.095658+0000, chain.objs.size()=1 2024-09-12T01:02:39.935 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.938+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.263__shadow_.KtP_01fWtRYtEB4pJz9OXdH5C5kDLTO_0 2024-09-12T01:02:39.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9138558714088931079', time=2024-09-12T02:49:12.610635+0000, chain.objs.size()=1 2024-09-12T01:02:39.936 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.269__shadow_.ONkq0P65rF_OjurhfedVlzZwZeyHeLt_0 2024-09-12T01:02:39.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16416940363642783487', time=2024-09-12T02:49:14.705449+0000, chain.objs.size()=1 2024-09-12T01:02:39.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.272__shadow_.GfJjDjqkzoy6-epY8RHukKLyZWTy1bT_0 2024-09-12T01:02:39.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15511201662550647384', time=2024-09-12T02:49:21.609620+0000, chain.objs.size()=1 2024-09-12T01:02:39.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.281__shadow_.ei21-vcfF7NZdGTTgCWHuLe8aUXJKu8_0 2024-09-12T01:02:39.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13039909305285168466', time=2024-09-12T02:49:27.698283+0000, chain.objs.size()=1 2024-09-12T01:02:39.938 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.289__shadow_.bFmZPrgYR4M1lpG-SHH7nNbXcmaWNEd_0 2024-09-12T01:02:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16306530173368280378', time=2024-09-12T02:49:30.948034+0000, chain.objs.size()=1 2024-09-12T01:02:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.292__shadow_.VC109TjmlFUU1DrCQpSeSIgTqZwFGkf_0 2024-09-12T01:02:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5446485347053597450', time=2024-09-12T02:49:32.423924+0000, chain.objs.size()=1 2024-09-12T01:02:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.293__shadow_.EaNYwgPLng-e8lMA1UrmZ-YnVnoDPuP_0 2024-09-12T01:02:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15677388650164298993', time=2024-09-12T02:49:39.963895+0000, chain.objs.size()=1 2024-09-12T01:02:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.303__shadow_.dvci-_bkIElk78cXX6Lz3bBEWdZ5Vwq_0 2024-09-12T01:02:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17704871427641600483', time=2024-09-12T02:49:42.404863+0000, chain.objs.size()=1 2024-09-12T01:02:39.939 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.306__shadow_.LjliukJrqBczotSbY5R_Jl8wwjR5ufP_0 2024-09-12T01:02:39.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2931694429652233417', time=2024-09-12T02:49:43.530009+0000, chain.objs.size()=1 2024-09-12T01:02:39.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.307__shadow:shXF7PIt0S.b6SNUVoTiA0dGpofe7fV_.NFyPaz7xkj2JjvCdH3LPejCqrPl2XOz_0 2024-09-12T01:02:39.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6189270253461802749', time=2024-09-12T02:49:53.185879+0000, chain.objs.size()=1 2024-09-12T01:02:39.940 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.942+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.321__shadow_.Dpdl5DcEsI51XTvarWJQ4ALaKThIYzN_0 2024-09-12T01:02:39.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.946+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15436884984842016521', time=2024-09-12T02:50:15.940473+0000, chain.objs.size()=1 2024-09-12T01:02:39.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.946+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.dgCncvsHPpc-45oqckr-mIONmNxjaM8_0 2024-09-12T01:02:39.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.946+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7980695194069923471', time=2024-09-12T02:50:16.112549+0000, chain.objs.size()=1 2024-09-12T01:02:39.942 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.946+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.PeJHuuWqA5SBvCIkkg_X02VsYuflTFz_0 2024-09-12T01:02:39.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.946+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6919710408135213894', time=2024-09-12T02:50:16.162040+0000, chain.objs.size()=1 2024-09-12T01:02:39.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.946+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ZKm0SQCpSnps3m1Upc2M8HgaVCs6VWI_0 2024-09-12T01:02:39.943 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.946+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13140614992551987237', time=2024-09-12T02:50:16.178558+0000, chain.objs.size()=1 2024-09-12T01:02:39.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.946+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.CZUV_8LHtCrhBS7x7sXpL_KHuG0B-HG_0 2024-09-12T01:02:39.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.946+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8897256898010750750', time=2024-09-12T02:50:16.190851+0000, chain.objs.size()=1 2024-09-12T01:02:39.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.946+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.uAF8g3sVIFBwmpTwazt5XSSeTwl4KsX_0 2024-09-12T01:02:39.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.946+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12198551800187721955', time=2024-09-12T02:50:16.220348+0000, chain.objs.size()=1 2024-09-12T01:02:39.944 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.946+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.NpKLfMYSSK1Ceqm_kXYPKFbC83p0MJC_0 2024-09-12T01:02:39.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.950+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8179819867171046299', time=2024-09-12T02:50:16.240246+0000, chain.objs.size()=1 2024-09-12T01:02:39.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.950+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.4MSuO-KVMbDWo_5T5cstDAodQBtLrZv_0 2024-09-12T01:02:39.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.950+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.18359539133376712112', time=2024-09-12T02:50:16.352030+0000, chain.objs.size()=1 2024-09-12T01:02:39.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.950+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.SO3McQCqrhGcuUxDgkv9gkPN4KcVqNO_0 2024-09-12T01:02:39.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.950+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2435977178321324244', time=2024-09-12T02:50:16.389836+0000, chain.objs.size()=1 2024-09-12T01:02:39.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.950+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ao9Y1S4FpQWHAMXB-btkO3T_Z8YmqAz_0 2024-09-12T01:02:39.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.950+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2231043984649565438', time=2024-09-12T02:50:16.461269+0000, chain.objs.size()=1 2024-09-12T01:02:39.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.950+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.3Y4pd7u0HAEvT57gIuNBeifQJ-G9EOj_0 2024-09-12T01:02:39.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.950+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9233782457621553360', time=2024-09-12T02:50:16.519880+0000, chain.objs.size()=1 2024-09-12T01:02:39.945 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.950+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.8AFl-PkoeSpzV25q6A0g9fu1M7TJdqu_0 2024-09-12T01:02:39.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.950+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.8025318647155647199', time=2024-09-12T02:50:16.706474+0000, chain.objs.size()=1 2024-09-12T01:02:39.946 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.950+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.yBUNJG2ayiiT7Xe3EGvx6W_tWC0nu6A_0 2024-09-12T01:02:39.947 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.950+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4350079993589985418', time=2024-09-12T02:50:16.708361+0000, chain.objs.size()=1 2024-09-12T01:02:39.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.950+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_._Z7BFvEybvK0gDRu73QDEc5ZfXTTu4R_0 2024-09-12T01:02:39.948 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3264871200678914331', time=2024-09-12T02:50:16.768981+0000, chain.objs.size()=1 2024-09-12T01:02:39.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.F2kyFVD4CnIHmjpQiNjFRBpyr1gTpvv_0 2024-09-12T01:02:39.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6263507533783668490', time=2024-09-12T02:50:16.771745+0000, chain.objs.size()=1 2024-09-12T01:02:39.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.tKzGEhXXbyhOwSL_vqMtUhMuNRJZ1Sc_0 2024-09-12T01:02:39.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.628214891790964638', time=2024-09-12T02:50:17.003979+0000, chain.objs.size()=1 2024-09-12T01:02:39.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.JJn06YgyKtpeEerllm0NBkyfhzqp8xI_0 2024-09-12T01:02:39.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2041364031426310732', time=2024-09-12T02:50:17.007996+0000, chain.objs.size()=1 2024-09-12T01:02:39.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.UzcSBMACCUN_VtMpb4cYs389V1tSnk1_0 2024-09-12T01:02:39.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12630714997535954893', time=2024-09-12T02:50:17.032263+0000, chain.objs.size()=1 2024-09-12T01:02:39.949 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.ukewW2sJZAx2q85JwQYvBwnwy5yfggp_0 2024-09-12T01:02:39.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.14610083643693497151', time=2024-09-12T02:50:17.166681+0000, chain.objs.size()=1 2024-09-12T01:02:39.950 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.Q4EB_IXv1U4khQq9qcnPaNUNxpQYaiK_0 2024-09-12T01:02:39.951 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15748162078827788105', time=2024-09-12T02:50:17.226085+0000, chain.objs.size()=1 2024-09-12T01:02:39.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.lfXNaVA9pQ9b5kx84XaoWvmejfvwTtt_0 2024-09-12T01:02:39.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2033264572404799883', time=2024-09-12T02:50:17.258749+0000, chain.objs.size()=1 2024-09-12T01:02:39.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.L6XfWD0l0PxBTRPIPq9Hf31kgV5U7W6_0 2024-09-12T01:02:39.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17870465468905123844', time=2024-09-12T02:50:17.280328+0000, chain.objs.size()=1 2024-09-12T01:02:39.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.954+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.0Kh_w_fXNw0J7pUyOOBMqVa3SSj-8ME_0 2024-09-12T01:02:39.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11003245091485536654', time=2024-09-12T02:50:17.396093+0000, chain.objs.size()=1 2024-09-12T01:02:39.952 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.qqvduSalB1qKqxCsos_7ZEpTqw8WY6a_0 2024-09-12T01:02:39.956 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2863582383267812094', time=2024-09-12T02:50:17.443820+0000, chain.objs.size()=1 2024-09-12T01:02:39.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.7SznNk1nZeG606WTzRy_LWUt2UuUFaw_0 2024-09-12T01:02:39.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6002523240392399041', time=2024-09-12T02:50:17.483759+0000, chain.objs.size()=1 2024-09-12T01:02:39.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.7LrBc2-bbNsiN6Hy_A4yIDFpvWO0AnP_0 2024-09-12T01:02:39.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9094070774724293010', time=2024-09-12T02:50:17.509345+0000, chain.objs.size()=1 2024-09-12T01:02:39.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.rbF4Uy-xdl1QcxGEV6hh3HdU2kX8ETR_0 2024-09-12T01:02:39.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1566111971931149178', time=2024-09-12T02:50:17.705049+0000, chain.objs.size()=1 2024-09-12T01:02:39.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.323__shadow_.PaGJnPIYlcLUyolEF1BPOUZPe4jT4M0_0 2024-09-12T01:02:39.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4300514482678950305', time=2024-09-12T02:50:39.581312+0000, chain.objs.size()=1 2024-09-12T01:02:39.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.vjXsjZg0ZYH4zyXDZe9UsKRcPR1TsSI_0 2024-09-12T01:02:39.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9125842163453191776', time=2024-09-12T02:50:39.743457+0000, chain.objs.size()=1 2024-09-12T01:02:39.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.kvrYYZJW2Jgo8rW_HOrqS7o7Qj2d0nJ_0 2024-09-12T01:02:39.957 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.315624867568172502', time=2024-09-12T02:50:39.783381+0000, chain.objs.size()=1 2024-09-12T01:02:39.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.5Mebhq_BxK08Nw9anfRARW7BklEUCuo_0 2024-09-12T01:02:39.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7559392121263212267', time=2024-09-12T02:50:39.808117+0000, chain.objs.size()=1 2024-09-12T01:02:39.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.958+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.z3BySR7Sc8HtMIz7N-JWbrLBFv74QKl_0 2024-09-12T01:02:39.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13154980117008082339', time=2024-09-12T02:50:39.843216+0000, chain.objs.size()=1 2024-09-12T01:02:39.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.XWEsH9Hm19ZhmnQV3vKfVToU2n0OiBq_0 2024-09-12T01:02:39.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12835168263511442741', time=2024-09-12T02:50:39.847924+0000, chain.objs.size()=1 2024-09-12T01:02:39.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.zby98M3Zpu4J38eQRGf9cjSIbsLnxHB_0 2024-09-12T01:02:39.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10732996249209404877', time=2024-09-12T02:50:39.863072+0000, chain.objs.size()=1 2024-09-12T01:02:39.958 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.XH-NneQerZcBoX7a-83jkxbZFrJGniF_0 2024-09-12T01:02:39.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.962+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.5899279501797545077', time=2024-09-12T02:50:40.014287+0000, chain.objs.size()=1 2024-09-12T01:02:39.959 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.962+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.g72KzhbJMIHq9Hv-nBHdYUM2Q2XHh0m_0 2024-09-12T01:02:39.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.966+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12014824789088067930', time=2024-09-12T02:50:40.023713+0000, chain.objs.size()=1 2024-09-12T01:02:39.960 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.966+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.uxpSjkvYCV-8mDZ7GWPRJydSZACsLkX_0 2024-09-12T01:02:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.966+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1610092444053707017', time=2024-09-12T02:50:40.053658+0000, chain.objs.size()=1 2024-09-12T01:02:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.966+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.tDQKVRNgqNqQSZszqPK4v2zKw3o7QI3_0 2024-09-12T01:02:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.966+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9218585608387444586', time=2024-09-12T02:50:40.096816+0000, chain.objs.size()=1 2024-09-12T01:02:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.966+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.tMPoqQrShzx1pK1Oavkwox1Rk1wMMiQ_0 2024-09-12T01:02:39.961 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.966+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.16131829433093192001', time=2024-09-12T02:50:40.111563+0000, chain.objs.size()=1 2024-09-12T01:02:39.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.966+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.pwom7wbgc6qJ18HgSMEjvqoCCrgE6XK_0 2024-09-12T01:02:39.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.966+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7454490445746027424', time=2024-09-12T02:50:40.116901+0000, chain.objs.size()=1 2024-09-12T01:02:39.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.966+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.SAP50gsCyaNhK6boAz92X7mxccSBWX7_0 2024-09-12T01:02:39.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.966+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17048826830515959344', time=2024-09-12T02:50:40.135782+0000, chain.objs.size()=1 2024-09-12T01:02:39.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.966+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.qS3-nI2APcFcXYEHap-YHUoNbKNUvxB_0 2024-09-12T01:02:39.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.966+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1729190291576347640', time=2024-09-12T02:50:40.324732+0000, chain.objs.size()=1 2024-09-12T01:02:39.962 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.966+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.4LrPKF-JyQH2J3PdqeNEXPcGNzRuKYP_0 2024-09-12T01:02:39.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.200262547691233438', time=2024-09-12T02:50:40.359757+0000, chain.objs.size()=1 2024-09-12T01:02:39.964 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.hMzCYXbZ_LxChF94QuMxN-kiUJ9XD-W_0 2024-09-12T01:02:39.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.6205440781548852593', time=2024-09-12T02:50:40.615224+0000, chain.objs.size()=1 2024-09-12T01:02:39.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.-LVWdpXmsshdyfVSLRpPYf7njDCnHrK_0 2024-09-12T01:02:39.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10643153108864635630', time=2024-09-12T02:50:40.766657+0000, chain.objs.size()=1 2024-09-12T01:02:39.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.n4ZjrgsZhVuxbuflRpayjqipDWmih0w_0 2024-09-12T01:02:39.965 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.27523873352663412', time=2024-09-12T02:50:41.065048+0000, chain.objs.size()=1 2024-09-12T01:02:39.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.MKIZPhJzxux-yhB6jX8ugtFPART-McT_0 2024-09-12T01:02:39.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9433296369474833762', time=2024-09-12T02:50:41.120296+0000, chain.objs.size()=1 2024-09-12T01:02:39.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.CAq5jjviEWgvUVCPthfUQCnj4lGMMxx_0 2024-09-12T01:02:39.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7596713615390702550', time=2024-09-12T02:50:41.133576+0000, chain.objs.size()=1 2024-09-12T01:02:39.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.NZQ_yGm6l7U6nJayL_kkd_VNisDIzzi_0 2024-09-12T01:02:39.966 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.904135102373784289', time=2024-09-12T02:50:41.152772+0000, chain.objs.size()=1 2024-09-12T01:02:39.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.j9xPeLQCOCX8LbvfEeS5CXO3Y69ezC8_0 2024-09-12T01:02:39.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.1291476675294457047', time=2024-09-12T02:50:41.160581+0000, chain.objs.size()=1 2024-09-12T01:02:39.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.68fo5H-ncDS3-CzPgFZhDXuO7LqwKT9_0 2024-09-12T01:02:39.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.3651585737827284725', time=2024-09-12T02:50:41.170051+0000, chain.objs.size()=1 2024-09-12T01:02:39.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.ShkbvyR41bt1Wt00kc5_YLgmcFDaclP_0 2024-09-12T01:02:39.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.7280402977912838134', time=2024-09-12T02:50:41.364542+0000, chain.objs.size()=1 2024-09-12T01:02:39.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.Kl4snrBwBNmLx8FpnOuldfh8gfTLa7A_0 2024-09-12T01:02:39.967 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.965243340172864875', time=2024-09-12T02:50:41.412511+0000, chain.objs.size()=1 2024-09-12T01:02:39.968 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.970+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.QDtqBQe6WQWNPgti5a_3kxN2rcufmx5_0 2024-09-12T01:02:39.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 0/66099 2024-09-12T01:02:39.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T01:02:39.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.11897546890216933412', time=2024-09-12T02:50:41.534710+0000, chain.objs.size()=1 2024-09-12T01:02:39.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.EsBgMfx07YdXjXY5cqR0JJV_H-bXYbN_0 2024-09-12T01:02:39.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12796268691560984096', time=2024-09-12T02:50:41.577718+0000, chain.objs.size()=1 2024-09-12T01:02:39.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.w4KUBg5z2H6hUZKEKobID7JYNWSyxp7_0 2024-09-12T01:02:39.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.13907549965348473610', time=2024-09-12T02:50:41.584975+0000, chain.objs.size()=1 2024-09-12T01:02:39.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.gvpYhPzTPOhdY2kBoNV1hKlMyTG5gH1_0 2024-09-12T01:02:39.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.349976583319024219', time=2024-09-12T02:50:41.629923+0000, chain.objs.size()=1 2024-09-12T01:02:39.975 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.324__shadow_.I54DYNTwzzy12neXMBhuYKBWdqNIYQT_0 2024-09-12T01:02:39.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.4973367316741228675', time=2024-09-12T02:50:50.352057+0000, chain.objs.size()=1 2024-09-12T01:02:39.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.337__shadow_.4CbhvouRRZffF-Xii_PgEXnrqYl3dBP_0 2024-09-12T01:02:39.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.12344188239265120554', time=2024-09-12T02:50:53.591375+0000, chain.objs.size()=1 2024-09-12T01:02:39.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.342__shadow_.rwPi0V1tpuRI8D-5fp_uask2xZsxzks_0 2024-09-12T01:02:39.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.2762993483518128822', time=2024-09-12T02:51:12.627673+0000, chain.objs.size()=1 2024-09-12T01:02:39.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.373__shadow_.pgOGWTqUBMP6mBgLNqjo7MC-L4LMPpD_0 2024-09-12T01:02:39.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.246969454176598148', time=2024-09-12T02:52:23.663300+0000, chain.objs.size()=1 2024-09-12T01:02:39.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.462__shadow_.K9wZFAVLOUvt0CmEJZlvv5tFuk0nLO4_0 2024-09-12T01:02:39.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17225626426063904007', time=2024-09-12T02:52:36.206846+0000, chain.objs.size()=1 2024-09-12T01:02:39.976 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.483__shadow_.QWvME1Gt1lEfjZpCfFQowIMZ13LPqdE_0 2024-09-12T01:02:39.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9070130828370368881', time=2024-09-12T02:52:46.265270+0000, chain.objs.size()=1 2024-09-12T01:02:39.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.497__shadow_.X_cd4Nyh-z8LpMjLBTlUKfXWk_gevhs_0 2024-09-12T01:02:39.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.9954215399770908934', time=2024-09-12T02:53:21.667605+0000, chain.objs.size()=6 2024-09-12T01:02:39.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~a_LzvR5Yq3HZz4OpKlpw-uRZeRJtQxL.1 2024-09-12T01:02:39.977 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.978+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~a_LzvR5Yq3HZz4OpKlpw-uRZeRJtQxL.2 2024-09-12T01:02:39.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.982+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.Ge1jtfvBzsgShZzkNp6BRpZVFrBySn7k.3 2024-09-12T01:02:39.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.982+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~a_LzvR5Yq3HZz4OpKlpw-uRZeRJtQxL.4 2024-09-12T01:02:39.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.982+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~a_LzvR5Yq3HZz4OpKlpw-uRZeRJtQxL.5 2024-09-12T01:02:39.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.982+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.522__multipart_mymultipart.2~a_LzvR5Yq3HZz4OpKlpw-uRZeRJtQxL.6 2024-09-12T01:02:39.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.982+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.10202328866093878754', time=2024-09-12T02:53:34.942729+0000, chain.objs.size()=2 2024-09-12T01:02:39.979 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.982+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.525__multipart_mymultipart.2~pJKkJ2Yn7Q0u_XyRq-JjC5FicCRVgQp.1 2024-09-12T01:02:39.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.982+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.525__multipart_mymultipart.2~pJKkJ2Yn7Q0u_XyRq-JjC5FicCRVgQp.2 2024-09-12T01:02:39.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.982+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~wk0VhGLzlEm9Vkc-TAJQa-HbRMhPFNU', time=2024-09-12T02:53:41.226689+0000, chain.objs.size()=1 2024-09-12T01:02:39.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.982+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.531__multipart_mymultipart.2~wk0VhGLzlEm9Vkc-TAJQa-HbRMhPFNU.1 2024-09-12T01:02:39.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.982+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='2~mURk63yg3ab9TGEqox_AnGR9nL4BI4n', time=2024-09-12T02:53:44.981295+0000, chain.objs.size()=1 2024-09-12T01:02:39.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.982+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.535__multipart_mymultipart.2~mURk63yg3ab9TGEqox_AnGR9nL4BI4n.3 2024-09-12T01:02:39.980 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.986+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15987624648815374865', time=2024-09-12T02:54:31.631008+0000, chain.objs.size()=1 2024-09-12T01:02:39.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.986+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.558__shadow_.68FjNN9p5fQjmLmxNrF7TinKvDvOc2H_0 2024-09-12T01:02:39.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.986+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.17088588675438375585', time=2024-09-12T02:55:10.541817+0000, chain.objs.size()=1 2024-09-12T01:02:39.981 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.986+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.577__shadow:zhjbbsQ.iRjaEYLuL6vdjx60Mv3.58t_.Hj6ikfAJu7rBwJcYXkkVCi-gMwsAqDL_0 2024-09-12T01:02:39.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.986+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.15795814201195073018', time=2024-09-12T02:55:36.064208+0000, chain.objs.size()=1 2024-09-12T01:02:39.982 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.986+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.587__shadow:NmyMYS1APCe19FIHCKoum0SqLaFTKdo_.zk19Am4JO2oNbu26w8JEt6wfthU_z5R_0 2024-09-12T01:02:39.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.990+0000 7f2bdc2919c0 20 garbage collection: RGWGC::process iterating over entry tag='e2043445-c131-4520-984d-b4d52f038a6b.4538.270958309853339352', time=2024-09-12T02:59:15.489398+0000, chain.objs.size()=1 2024-09-12T01:02:39.986 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.990+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:e2043445-c131-4520-984d-b4d52f038a6b.4538.704__shadow:e7gL74Rgrcc9bh-4ynXLaftfMDREQ-o_.yTDF7oS9t_-UKGRDiXD_KEKbY66LEH9_0 2024-09-12T01:02:39.988 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.994+0000 7f2bdc2919c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:39.992 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.998+0000 7f2a8ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:39.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.998+0000 7f2bdc2919c0 20 remove_watcher() i=0 2024-09-12T01:02:39.994 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.998+0000 7f2bdc2919c0 2 removed watcher, disabling cache 2024-09-12T01:02:39.995 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:39.998+0000 7f2bdc2919c0 20 remove_watcher() i=1 2024-09-12T01:02:39.996 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:40.002+0000 7f2bdc2919c0 20 remove_watcher() i=2 2024-09-12T01:02:39.997 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:40.002+0000 7f2bdc2919c0 20 remove_watcher() i=3 2024-09-12T01:02:39.998 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:40.002+0000 7f2bdc2919c0 20 remove_watcher() i=4 2024-09-12T01:02:39.999 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:40.002+0000 7f2bdc2919c0 20 remove_watcher() i=5 2024-09-12T01:02:40.000 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:40.006+0000 7f2bdc2919c0 20 remove_watcher() i=6 2024-09-12T01:02:40.001 INFO:teuthology.orchestra.run.smithi138.stderr:2024-09-12T01:02:40.006+0000 7f2bdc2919c0 20 remove_watcher() i=7 2024-09-12T01:02:40.013 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T01:02:40.024 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-12T01:02:40.059 DEBUG:teuthology.orchestra.run.smithi138:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T01:02:40.103 DEBUG:teuthology.orchestra.run.smithi138:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-12T01:02:40.148 DEBUG:teuthology.orchestra.run.smithi138:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T01:02:40.196 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm /usr/local/share/ca-certificates/root.crt 2024-09-12T01:02:40.251 DEBUG:teuthology.orchestra.run.smithi138:> sudo update-ca-certificates 2024-09-12T01:02:40.304 INFO:teuthology.orchestra.run.smithi138.stdout:Updating certificates in /etc/ssl/certs... 2024-09-12T01:02:40.629 INFO:teuthology.orchestra.run.smithi138.stdout:0 added, 0 removed; done. 2024-09-12T01:02:40.629 INFO:teuthology.orchestra.run.smithi138.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-09-12T01:02:40.631 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:02:40.869 INFO:teuthology.orchestra.run.smithi138.stdout:done. 2024-09-12T01:02:40.869 INFO:teuthology.orchestra.run.smithi138.stdout:done. 2024-09-12T01:02:40.872 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T01:02:40.884 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:02:40.884 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:02:41.259 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:02:41.273 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-12T01:02:41.277 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":1675,"stamp":"2024-09-12T01:02:40.813567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":519906609,"num_objects":3693,"num_object_clones":0,"num_object_copies":13728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3693,"num_whiteouts":0,"num_read":286616,"num_read_kb":2600254,"num_write":157585,"num_write_kb":2450810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13305,"ondisk_log_size":13305,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2550448,"kb_used_data":940296,"kb_used_omap":12,"kb_used_meta":1609715,"kb_avail":752424272,"statfs":{"total":773094113280,"available":770482454528,"internally_reserved":0,"allocated":962863104,"data_stored":946483121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1648348720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-202258165,"num_objects":-1242,"num_object_clones":0,"num_object_copies":-4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1242,"num_whiteouts":0,"num_read":1413,"num_read_kb":1383,"num_write":1330,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008912"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.173833+0000","last_change":"2024-09-12T00:43:48.284274+0000","last_active":"2024-09-12T00:58:48.173833+0000","last_peered":"2024-09-12T00:58:48.173833+0000","last_clean":"2024-09-12T00:58:48.173833+0000","last_became_active":"2024-09-12T00:43:48.282777+0000","last_became_peered":"2024-09-12T00:43:48.282777+0000","last_unstale":"2024-09-12T00:58:48.173833+0000","last_undegraded":"2024-09-12T00:58:48.173833+0000","last_fullsized":"2024-09-12T00:58:48.173833+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:26.885566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"268'1","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.190566+0000","last_change":"2024-09-12T00:32:28.070403+0000","last_active":"2024-09-12T00:59:58.190566+0000","last_peered":"2024-09-12T00:59:58.190566+0000","last_clean":"2024-09-12T00:59:58.190566+0000","last_became_active":"2024-09-12T00:32:28.069841+0000","last_became_peered":"2024-09-12T00:32:28.069841+0000","last_unstale":"2024-09-12T00:59:58.190566+0000","last_undegraded":"2024-09-12T00:59:58.190566+0000","last_fullsized":"2024-09-12T00:59:58.190566+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:32.102006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.181946+0000","last_change":"2024-09-12T00:32:25.027280+0000","last_active":"2024-09-12T00:59:57.181946+0000","last_peered":"2024-09-12T00:59:57.181946+0000","last_clean":"2024-09-12T00:59:57.181946+0000","last_became_active":"2024-09-12T00:32:25.026726+0000","last_became_peered":"2024-09-12T00:32:25.026726+0000","last_unstale":"2024-09-12T00:59:57.181946+0000","last_undegraded":"2024-09-12T00:59:57.181946+0000","last_fullsized":"2024-09-12T00:59:57.181946+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:47.659267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"268'31","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.187370+0000","last_change":"2024-09-12T00:30:51.544593+0000","last_active":"2024-09-12T01:00:03.187370+0000","last_peered":"2024-09-12T01:00:03.187370+0000","last_clean":"2024-09-12T01:00:03.187370+0000","last_became_active":"2024-09-12T00:30:51.543858+0000","last_became_peered":"2024-09-12T00:30:51.543858+0000","last_unstale":"2024-09-12T01:00:03.187370+0000","last_undegraded":"2024-09-12T01:00:03.187370+0000","last_fullsized":"2024-09-12T01:00:03.187370+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:38.568158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":120,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.161958+0000","last_change":"2024-09-12T00:43:48.286931+0000","last_active":"2024-09-12T00:58:48.161958+0000","last_peered":"2024-09-12T00:58:48.161958+0000","last_clean":"2024-09-12T00:58:48.161958+0000","last_became_active":"2024-09-12T00:43:48.286291+0000","last_became_peered":"2024-09-12T00:43:48.286291+0000","last_unstale":"2024-09-12T00:58:48.161958+0000","last_undegraded":"2024-09-12T00:58:48.161958+0000","last_fullsized":"2024-09-12T00:58:48.161958+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:17.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.190647+0000","last_change":"2024-09-12T00:32:28.070732+0000","last_active":"2024-09-12T00:59:58.190647+0000","last_peered":"2024-09-12T00:59:58.190647+0000","last_clean":"2024-09-12T00:59:58.190647+0000","last_became_active":"2024-09-12T00:32:28.070091+0000","last_became_peered":"2024-09-12T00:32:28.070091+0000","last_unstale":"2024-09-12T00:59:58.190647+0000","last_undegraded":"2024-09-12T00:59:58.190647+0000","last_fullsized":"2024-09-12T00:59:58.190647+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:33.762789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.206709+0000","last_change":"2024-09-12T00:32:25.024486+0000","last_active":"2024-09-12T00:59:57.206709+0000","last_peered":"2024-09-12T00:59:57.206709+0000","last_clean":"2024-09-12T00:59:57.206709+0000","last_became_active":"2024-09-12T00:32:25.023750+0000","last_became_peered":"2024-09-12T00:32:25.023750+0000","last_unstale":"2024-09-12T00:59:57.206709+0000","last_undegraded":"2024-09-12T00:59:57.206709+0000","last_fullsized":"2024-09-12T00:59:57.206709+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:12.053492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"268'20","reported_seq":97,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.273682+0000","last_change":"2024-09-12T00:30:51.555569+0000","last_active":"2024-09-12T01:00:03.273682+0000","last_peered":"2024-09-12T01:00:03.273682+0000","last_clean":"2024-09-12T01:00:03.273682+0000","last_became_active":"2024-09-12T00:30:51.554875+0000","last_became_peered":"2024-09-12T00:30:51.554875+0000","last_unstale":"2024-09-12T01:00:03.273682+0000","last_undegraded":"2024-09-12T01:00:03.273682+0000","last_fullsized":"2024-09-12T01:00:03.273682+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:03.959589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":61,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:18.166602+0000","last_change":"2024-09-12T00:43:48.271637+0000","last_active":"2024-09-12T00:58:18.166602+0000","last_peered":"2024-09-12T00:58:18.166602+0000","last_clean":"2024-09-12T00:58:18.166602+0000","last_became_active":"2024-09-12T00:43:48.270700+0000","last_became_peered":"2024-09-12T00:43:48.270700+0000","last_unstale":"2024-09-12T00:58:18.166602+0000","last_undegraded":"2024-09-12T00:58:18.166602+0000","last_fullsized":"2024-09-12T00:58:18.166602+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:41.349025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"268'2","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.201826+0000","last_change":"2024-09-12T00:32:28.078229+0000","last_active":"2024-09-12T00:59:37.201826+0000","last_peered":"2024-09-12T00:59:37.201826+0000","last_clean":"2024-09-12T00:59:37.201826+0000","last_became_active":"2024-09-12T00:32:28.065497+0000","last_became_peered":"2024-09-12T00:32:28.065497+0000","last_unstale":"2024-09-12T00:59:37.201826+0000","last_undegraded":"2024-09-12T00:59:37.201826+0000","last_fullsized":"2024-09-12T00:59:37.201826+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:04.479825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"268'3","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:37.191813+0000","last_change":"2024-09-12T00:32:25.002095+0000","last_active":"2024-09-12T01:00:37.191813+0000","last_peered":"2024-09-12T01:00:37.191813+0000","last_clean":"2024-09-12T01:00:37.191813+0000","last_became_active":"2024-09-12T00:32:25.001290+0000","last_became_peered":"2024-09-12T00:32:25.001290+0000","last_unstale":"2024-09-12T01:00:37.191813+0000","last_undegraded":"2024-09-12T01:00:37.191813+0000","last_fullsized":"2024-09-12T01:00:37.191813+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:20.950634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2088,"num_write":8,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"268'25","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:02.981579+0000","last_change":"2024-09-12T00:30:51.546159+0000","last_active":"2024-09-12T01:00:02.981579+0000","last_peered":"2024-09-12T01:00:02.981579+0000","last_clean":"2024-09-12T01:00:02.981579+0000","last_became_active":"2024-09-12T00:30:51.544751+0000","last_became_peered":"2024-09-12T00:30:51.544751+0000","last_unstale":"2024-09-12T01:00:02.981579+0000","last_undegraded":"2024-09-12T01:00:02.981579+0000","last_fullsized":"2024-09-12T01:00:02.981579+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:47.192663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":82,"num_write":61,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:27.183725+0000","last_change":"2024-09-12T00:43:48.280902+0000","last_active":"2024-09-12T00:58:27.183725+0000","last_peered":"2024-09-12T00:58:27.183725+0000","last_clean":"2024-09-12T00:58:27.183725+0000","last_became_active":"2024-09-12T00:43:48.280166+0000","last_became_peered":"2024-09-12T00:43:48.280166+0000","last_unstale":"2024-09-12T00:58:27.183725+0000","last_undegraded":"2024-09-12T00:58:27.183725+0000","last_fullsized":"2024-09-12T00:58:27.183725+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:30.937177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:37.186576+0000","last_change":"2024-09-12T00:32:28.078675+0000","last_active":"2024-09-12T00:58:37.186576+0000","last_peered":"2024-09-12T00:58:37.186576+0000","last_clean":"2024-09-12T00:58:37.186576+0000","last_became_active":"2024-09-12T00:32:28.073988+0000","last_became_peered":"2024-09-12T00:32:28.073988+0000","last_unstale":"2024-09-12T00:58:37.186576+0000","last_undegraded":"2024-09-12T00:58:37.186576+0000","last_fullsized":"2024-09-12T00:58:37.186576+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:09.276835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185184+0000","last_change":"2024-09-12T00:32:25.008128+0000","last_active":"2024-09-12T00:59:33.185184+0000","last_peered":"2024-09-12T00:59:33.185184+0000","last_clean":"2024-09-12T00:59:33.185184+0000","last_became_active":"2024-09-12T00:32:25.007732+0000","last_became_peered":"2024-09-12T00:32:25.007732+0000","last_unstale":"2024-09-12T00:59:33.185184+0000","last_undegraded":"2024-09-12T00:59:33.185184+0000","last_fullsized":"2024-09-12T00:59:33.185184+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:28.829369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"268'61","reported_seq":203,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.690930+0000","last_change":"2024-09-12T00:30:51.552185+0000","last_active":"2024-09-12T00:59:57.690930+0000","last_peered":"2024-09-12T00:59:57.690930+0000","last_clean":"2024-09-12T00:59:57.690930+0000","last_became_active":"2024-09-12T00:30:51.551417+0000","last_became_peered":"2024-09-12T00:30:51.551417+0000","last_unstale":"2024-09-12T00:59:57.690930+0000","last_undegraded":"2024-09-12T00:59:57.690930+0000","last_fullsized":"2024-09-12T00:59:57.690930+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:45.506758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":214,"num_write":108,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.182039+0000","last_change":"2024-09-12T00:43:48.284245+0000","last_active":"2024-09-12T00:59:57.182039+0000","last_peered":"2024-09-12T00:59:57.182039+0000","last_clean":"2024-09-12T00:59:57.182039+0000","last_became_active":"2024-09-12T00:43:48.283357+0000","last_became_peered":"2024-09-12T00:43:48.283357+0000","last_unstale":"2024-09-12T00:59:57.182039+0000","last_undegraded":"2024-09-12T00:59:57.182039+0000","last_fullsized":"2024-09-12T00:59:57.182039+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.113641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"268'5","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:38.003769+0000","last_change":"2024-09-12T00:32:28.054309+0000","last_active":"2024-09-12T01:01:38.003769+0000","last_peered":"2024-09-12T01:01:38.003769+0000","last_clean":"2024-09-12T01:01:38.003769+0000","last_became_active":"2024-09-12T00:32:28.053541+0000","last_became_peered":"2024-09-12T00:32:28.053541+0000","last_unstale":"2024-09-12T01:01:38.003769+0000","last_undegraded":"2024-09-12T01:01:38.003769+0000","last_fullsized":"2024-09-12T01:01:38.003769+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.456715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"268'2","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.192266+0000","last_change":"2024-09-12T00:32:25.015629+0000","last_active":"2024-09-12T00:59:02.192266+0000","last_peered":"2024-09-12T00:59:02.192266+0000","last_clean":"2024-09-12T00:59:02.192266+0000","last_became_active":"2024-09-12T00:32:25.014665+0000","last_became_peered":"2024-09-12T00:32:25.014665+0000","last_unstale":"2024-09-12T00:59:02.192266+0000","last_undegraded":"2024-09-12T00:59:02.192266+0000","last_fullsized":"2024-09-12T00:59:02.192266+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:46.651960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"268'40","reported_seq":154,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:23.156361+0000","last_change":"2024-09-12T00:30:51.549303+0000","last_active":"2024-09-12T00:58:23.156361+0000","last_peered":"2024-09-12T00:58:23.156361+0000","last_clean":"2024-09-12T00:58:23.156361+0000","last_became_active":"2024-09-12T00:30:51.547784+0000","last_became_peered":"2024-09-12T00:30:51.547784+0000","last_unstale":"2024-09-12T00:58:23.156361+0000","last_undegraded":"2024-09-12T00:58:23.156361+0000","last_fullsized":"2024-09-12T00:58:23.156361+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:29.971436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":150,"num_write":68,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.192933+0000","last_change":"2024-09-12T00:43:48.278102+0000","last_active":"2024-09-12T01:00:28.192933+0000","last_peered":"2024-09-12T01:00:28.192933+0000","last_clean":"2024-09-12T01:00:28.192933+0000","last_became_active":"2024-09-12T00:43:48.276078+0000","last_became_peered":"2024-09-12T00:43:48.276078+0000","last_unstale":"2024-09-12T01:00:28.192933+0000","last_undegraded":"2024-09-12T01:00:28.192933+0000","last_fullsized":"2024-09-12T01:00:28.192933+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:21.420479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"268'5","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.600193+0000","last_change":"2024-09-12T00:32:28.031279+0000","last_active":"2024-09-12T01:02:37.600193+0000","last_peered":"2024-09-12T01:02:37.600193+0000","last_clean":"2024-09-12T01:02:37.600193+0000","last_became_active":"2024-09-12T00:32:28.030520+0000","last_became_peered":"2024-09-12T00:32:28.030520+0000","last_unstale":"2024-09-12T01:02:37.600193+0000","last_undegraded":"2024-09-12T01:02:37.600193+0000","last_fullsized":"2024-09-12T01:02:37.600193+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:22.614081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"268'3","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:34.014371+0000","last_change":"2024-09-12T00:32:25.010515+0000","last_active":"2024-09-12T01:01:34.014371+0000","last_peered":"2024-09-12T01:01:34.014371+0000","last_clean":"2024-09-12T01:01:34.014371+0000","last_became_active":"2024-09-12T00:32:25.009898+0000","last_became_peered":"2024-09-12T00:32:25.009898+0000","last_unstale":"2024-09-12T01:01:34.014371+0000","last_undegraded":"2024-09-12T01:01:34.014371+0000","last_fullsized":"2024-09-12T01:01:34.014371+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:26.343687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"268'22","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:23.166566+0000","last_change":"2024-09-12T00:30:51.560284+0000","last_active":"2024-09-12T00:58:23.166566+0000","last_peered":"2024-09-12T00:58:23.166566+0000","last_clean":"2024-09-12T00:58:23.166566+0000","last_became_active":"2024-09-12T00:30:51.559544+0000","last_became_peered":"2024-09-12T00:30:51.559544+0000","last_unstale":"2024-09-12T00:58:23.166566+0000","last_undegraded":"2024-09-12T00:58:23.166566+0000","last_fullsized":"2024-09-12T00:58:23.166566+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:21.732816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":79,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.173552+0000","last_change":"2024-09-12T00:43:48.283455+0000","last_active":"2024-09-12T00:58:48.173552+0000","last_peered":"2024-09-12T00:58:48.173552+0000","last_clean":"2024-09-12T00:58:48.173552+0000","last_became_active":"2024-09-12T00:43:48.283057+0000","last_became_peered":"2024-09-12T00:43:48.283057+0000","last_unstale":"2024-09-12T00:58:48.173552+0000","last_undegraded":"2024-09-12T00:58:48.173552+0000","last_fullsized":"2024-09-12T00:58:48.173552+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:33.410879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.190602+0000","last_change":"2024-09-12T00:32:28.066260+0000","last_active":"2024-09-12T00:59:58.190602+0000","last_peered":"2024-09-12T00:59:58.190602+0000","last_clean":"2024-09-12T00:59:58.190602+0000","last_became_active":"2024-09-12T00:32:28.065376+0000","last_became_peered":"2024-09-12T00:32:28.065376+0000","last_unstale":"2024-09-12T00:59:58.190602+0000","last_undegraded":"2024-09-12T00:59:58.190602+0000","last_fullsized":"2024-09-12T00:59:58.190602+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:37.216971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"268'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.191528+0000","last_change":"2024-09-12T00:32:25.000290+0000","last_active":"2024-09-12T00:59:58.191528+0000","last_peered":"2024-09-12T00:59:58.191528+0000","last_clean":"2024-09-12T00:59:58.191528+0000","last_became_active":"2024-09-12T00:32:24.999604+0000","last_became_peered":"2024-09-12T00:32:24.999604+0000","last_unstale":"2024-09-12T00:59:58.191528+0000","last_undegraded":"2024-09-12T00:59:58.191528+0000","last_fullsized":"2024-09-12T00:59:58.191528+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:52.889640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"268'41","reported_seq":153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:04.255372+0000","last_change":"2024-09-12T00:30:51.557465+0000","last_active":"2024-09-12T01:00:04.255372+0000","last_peered":"2024-09-12T01:00:04.255372+0000","last_clean":"2024-09-12T01:00:04.255372+0000","last_became_active":"2024-09-12T00:30:51.556729+0000","last_became_peered":"2024-09-12T00:30:51.556729+0000","last_unstale":"2024-09-12T01:00:04.255372+0000","last_undegraded":"2024-09-12T01:00:04.255372+0000","last_fullsized":"2024-09-12T01:00:04.255372+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:59.334180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":144,"num_write":69,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.174016+0000","last_change":"2024-09-12T00:43:48.282559+0000","last_active":"2024-09-12T00:58:48.174016+0000","last_peered":"2024-09-12T00:58:48.174016+0000","last_clean":"2024-09-12T00:58:48.174016+0000","last_became_active":"2024-09-12T00:43:48.281781+0000","last_became_peered":"2024-09-12T00:43:48.281781+0000","last_unstale":"2024-09-12T00:58:48.174016+0000","last_undegraded":"2024-09-12T00:58:48.174016+0000","last_fullsized":"2024-09-12T00:58:48.174016+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:09.023666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"268'3","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.181867+0000","last_change":"2024-09-12T00:32:28.063332+0000","last_active":"2024-09-12T00:59:57.181867+0000","last_peered":"2024-09-12T00:59:57.181867+0000","last_clean":"2024-09-12T00:59:57.181867+0000","last_became_active":"2024-09-12T00:32:28.062540+0000","last_became_peered":"2024-09-12T00:32:28.062540+0000","last_unstale":"2024-09-12T00:59:57.181867+0000","last_undegraded":"2024-09-12T00:59:57.181867+0000","last_fullsized":"2024-09-12T00:59:57.181867+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:19.133641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.179111+0000","last_change":"2024-09-12T00:32:25.021694+0000","last_active":"2024-09-12T00:59:58.179111+0000","last_peered":"2024-09-12T00:59:58.179111+0000","last_clean":"2024-09-12T00:59:58.179111+0000","last_became_active":"2024-09-12T00:32:25.017715+0000","last_became_peered":"2024-09-12T00:32:25.017715+0000","last_unstale":"2024-09-12T00:59:58.179111+0000","last_undegraded":"2024-09-12T00:59:58.179111+0000","last_fullsized":"2024-09-12T00:59:58.179111+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:02.525100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'8","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:53.178004+0000","last_change":"2024-09-12T00:30:51.547647+0000","last_active":"2024-09-12T00:59:53.178004+0000","last_peered":"2024-09-12T00:59:53.178004+0000","last_clean":"2024-09-12T00:59:53.178004+0000","last_became_active":"2024-09-12T00:30:51.546981+0000","last_became_peered":"2024-09-12T00:30:51.546981+0000","last_unstale":"2024-09-12T00:59:53.178004+0000","last_undegraded":"2024-09-12T00:59:53.178004+0000","last_fullsized":"2024-09-12T00:59:53.178004+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:52.873539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.210443+0000","last_change":"2024-09-12T00:43:48.273242+0000","last_active":"2024-09-12T01:00:12.210443+0000","last_peered":"2024-09-12T01:00:12.210443+0000","last_clean":"2024-09-12T01:00:12.210443+0000","last_became_active":"2024-09-12T00:43:48.272523+0000","last_became_peered":"2024-09-12T00:43:48.272523+0000","last_unstale":"2024-09-12T01:00:12.210443+0000","last_undegraded":"2024-09-12T01:00:12.210443+0000","last_fullsized":"2024-09-12T01:00:12.210443+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:58.897794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"268'8","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168024+0000","last_change":"2024-09-12T00:32:28.069369+0000","last_active":"2024-09-12T00:59:02.168024+0000","last_peered":"2024-09-12T00:59:02.168024+0000","last_clean":"2024-09-12T00:59:02.168024+0000","last_became_active":"2024-09-12T00:32:28.062839+0000","last_became_peered":"2024-09-12T00:32:28.062839+0000","last_unstale":"2024-09-12T00:59:02.168024+0000","last_undegraded":"2024-09-12T00:59:02.168024+0000","last_fullsized":"2024-09-12T00:59:02.168024+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:52.354103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"268'3","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.234269+0000","last_change":"2024-09-12T00:32:25.005903+0000","last_active":"2024-09-12T01:00:29.234269+0000","last_peered":"2024-09-12T01:00:29.234269+0000","last_clean":"2024-09-12T01:00:29.234269+0000","last_became_active":"2024-09-12T00:32:25.005113+0000","last_became_peered":"2024-09-12T00:32:25.005113+0000","last_unstale":"2024-09-12T01:00:29.234269+0000","last_undegraded":"2024-09-12T01:00:29.234269+0000","last_fullsized":"2024-09-12T01:00:29.234269+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:34.390961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3076,"num_write":3,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'62","reported_seq":220,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:53.184530+0000","last_change":"2024-09-12T00:30:51.542763+0000","last_active":"2024-09-12T00:59:53.184530+0000","last_peered":"2024-09-12T00:59:53.184530+0000","last_clean":"2024-09-12T00:59:53.184530+0000","last_became_active":"2024-09-12T00:30:51.541882+0000","last_became_peered":"2024-09-12T00:30:51.541882+0000","last_unstale":"2024-09-12T00:59:53.184530+0000","last_undegraded":"2024-09-12T00:59:53.184530+0000","last_fullsized":"2024-09-12T00:59:53.184530+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.614120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":254,"num_write":98,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.181831+0000","last_change":"2024-09-12T00:43:48.278782+0000","last_active":"2024-09-12T01:00:08.181831+0000","last_peered":"2024-09-12T01:00:08.181831+0000","last_clean":"2024-09-12T01:00:08.181831+0000","last_became_active":"2024-09-12T00:43:48.277883+0000","last_became_peered":"2024-09-12T00:43:48.277883+0000","last_unstale":"2024-09-12T01:00:08.181831+0000","last_undegraded":"2024-09-12T01:00:08.181831+0000","last_fullsized":"2024-09-12T01:00:08.181831+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:35.841252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'5","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:17.180442+0000","last_change":"2024-09-12T00:32:28.052092+0000","last_active":"2024-09-12T00:58:17.180442+0000","last_peered":"2024-09-12T00:58:17.180442+0000","last_clean":"2024-09-12T00:58:17.180442+0000","last_became_active":"2024-09-12T00:32:28.051364+0000","last_became_peered":"2024-09-12T00:32:28.051364+0000","last_unstale":"2024-09-12T00:58:17.180442+0000","last_undegraded":"2024-09-12T00:58:17.180442+0000","last_fullsized":"2024-09-12T00:58:17.180442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:30.719026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5136,"num_write":10,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.178275+0000","last_change":"2024-09-12T00:32:25.009850+0000","last_active":"2024-09-12T00:59:03.178275+0000","last_peered":"2024-09-12T00:59:03.178275+0000","last_clean":"2024-09-12T00:59:03.178275+0000","last_became_active":"2024-09-12T00:32:25.009125+0000","last_became_peered":"2024-09-12T00:32:25.009125+0000","last_unstale":"2024-09-12T00:59:03.178275+0000","last_undegraded":"2024-09-12T00:59:03.178275+0000","last_fullsized":"2024-09-12T00:59:03.178275+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:33.665936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"268'31","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:53.184482+0000","last_change":"2024-09-12T00:30:51.555036+0000","last_active":"2024-09-12T00:59:53.184482+0000","last_peered":"2024-09-12T00:59:53.184482+0000","last_clean":"2024-09-12T00:59:53.184482+0000","last_became_active":"2024-09-12T00:30:51.553919+0000","last_became_peered":"2024-09-12T00:30:51.553919+0000","last_unstale":"2024-09-12T00:59:53.184482+0000","last_undegraded":"2024-09-12T00:59:53.184482+0000","last_fullsized":"2024-09-12T00:59:53.184482+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:07.977904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":104,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.195129+0000","last_change":"2024-09-12T00:43:48.289134+0000","last_active":"2024-09-12T01:00:08.195129+0000","last_peered":"2024-09-12T01:00:08.195129+0000","last_clean":"2024-09-12T01:00:08.195129+0000","last_became_active":"2024-09-12T00:43:48.288517+0000","last_became_peered":"2024-09-12T00:43:48.288517+0000","last_unstale":"2024-09-12T01:00:08.195129+0000","last_undegraded":"2024-09-12T01:00:08.195129+0000","last_fullsized":"2024-09-12T01:00:08.195129+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:05.171146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168160+0000","last_change":"2024-09-12T00:32:28.060574+0000","last_active":"2024-09-12T00:59:02.168160+0000","last_peered":"2024-09-12T00:59:02.168160+0000","last_clean":"2024-09-12T00:59:02.168160+0000","last_became_active":"2024-09-12T00:32:28.059869+0000","last_became_peered":"2024-09-12T00:32:28.059869+0000","last_unstale":"2024-09-12T00:59:02.168160+0000","last_undegraded":"2024-09-12T00:59:02.168160+0000","last_fullsized":"2024-09-12T00:59:02.168160+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:24.600878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168108+0000","last_change":"2024-09-12T00:32:25.027341+0000","last_active":"2024-09-12T00:59:02.168108+0000","last_peered":"2024-09-12T00:59:02.168108+0000","last_clean":"2024-09-12T00:59:02.168108+0000","last_became_active":"2024-09-12T00:32:25.026751+0000","last_became_peered":"2024-09-12T00:32:25.026751+0000","last_unstale":"2024-09-12T00:59:02.168108+0000","last_undegraded":"2024-09-12T00:59:02.168108+0000","last_fullsized":"2024-09-12T00:59:02.168108+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:19.648395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"268'24","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.286940+0000","last_change":"2024-09-12T00:30:51.548842+0000","last_active":"2024-09-12T01:00:03.286940+0000","last_peered":"2024-09-12T01:00:03.286940+0000","last_clean":"2024-09-12T01:00:03.286940+0000","last_became_active":"2024-09-12T00:30:51.548069+0000","last_became_peered":"2024-09-12T00:30:51.548069+0000","last_unstale":"2024-09-12T01:00:03.286940+0000","last_undegraded":"2024-09-12T01:00:03.286940+0000","last_fullsized":"2024-09-12T01:00:03.286940+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:24.452311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":85,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.194752+0000","last_change":"2024-09-12T00:43:48.276141+0000","last_active":"2024-09-12T01:00:08.194752+0000","last_peered":"2024-09-12T01:00:08.194752+0000","last_clean":"2024-09-12T01:00:08.194752+0000","last_became_active":"2024-09-12T00:43:48.274026+0000","last_became_peered":"2024-09-12T00:43:48.274026+0000","last_unstale":"2024-09-12T01:00:08.194752+0000","last_undegraded":"2024-09-12T01:00:08.194752+0000","last_fullsized":"2024-09-12T01:00:08.194752+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:53.384375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"268'1","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.178343+0000","last_change":"2024-09-12T00:32:28.063379+0000","last_active":"2024-09-12T00:59:03.178343+0000","last_peered":"2024-09-12T00:59:03.178343+0000","last_clean":"2024-09-12T00:59:03.178343+0000","last_became_active":"2024-09-12T00:32:28.062657+0000","last_became_peered":"2024-09-12T00:32:28.062657+0000","last_unstale":"2024-09-12T00:59:03.178343+0000","last_undegraded":"2024-09-12T00:59:03.178343+0000","last_fullsized":"2024-09-12T00:59:03.178343+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:10.594711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.192560+0000","last_change":"2024-09-12T00:32:24.997566+0000","last_active":"2024-09-12T00:59:02.192560+0000","last_peered":"2024-09-12T00:59:02.192560+0000","last_clean":"2024-09-12T00:59:02.192560+0000","last_became_active":"2024-09-12T00:32:24.996754+0000","last_became_peered":"2024-09-12T00:32:24.996754+0000","last_unstale":"2024-09-12T00:59:02.192560+0000","last_undegraded":"2024-09-12T00:59:02.192560+0000","last_fullsized":"2024-09-12T00:59:02.192560+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:55.566151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"268'26","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:59.211731+0000","last_change":"2024-09-12T00:30:51.551315+0000","last_active":"2024-09-12T00:58:59.211731+0000","last_peered":"2024-09-12T00:58:59.211731+0000","last_clean":"2024-09-12T00:58:59.211731+0000","last_became_active":"2024-09-12T00:30:51.545679+0000","last_became_peered":"2024-09-12T00:30:51.545679+0000","last_unstale":"2024-09-12T00:58:59.211731+0000","last_undegraded":"2024-09-12T00:58:59.211731+0000","last_fullsized":"2024-09-12T00:58:59.211731+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:48.283586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":84,"num_write":50,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:22.182350+0000","last_change":"2024-09-12T00:43:48.286291+0000","last_active":"2024-09-12T00:58:22.182350+0000","last_peered":"2024-09-12T00:58:22.182350+0000","last_clean":"2024-09-12T00:58:22.182350+0000","last_became_active":"2024-09-12T00:43:48.285657+0000","last_became_peered":"2024-09-12T00:43:48.285657+0000","last_unstale":"2024-09-12T00:58:22.182350+0000","last_undegraded":"2024-09-12T00:58:22.182350+0000","last_fullsized":"2024-09-12T00:58:22.182350+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:25.925943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"268'7","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:12.178896+0000","last_change":"2024-09-12T00:32:28.068135+0000","last_active":"2024-09-12T00:58:12.178896+0000","last_peered":"2024-09-12T00:58:12.178896+0000","last_clean":"2024-09-12T00:58:12.178896+0000","last_became_active":"2024-09-12T00:32:28.067168+0000","last_became_peered":"2024-09-12T00:32:28.067168+0000","last_unstale":"2024-09-12T00:58:12.178896+0000","last_undegraded":"2024-09-12T00:58:12.178896+0000","last_fullsized":"2024-09-12T00:58:12.178896+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:58.886483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"268'9","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:08.164412+0000","last_change":"2024-09-12T00:32:25.012858+0000","last_active":"2024-09-12T00:58:08.164412+0000","last_peered":"2024-09-12T00:58:08.164412+0000","last_clean":"2024-09-12T00:58:08.164412+0000","last_became_active":"2024-09-12T00:32:25.011944+0000","last_became_peered":"2024-09-12T00:32:25.011944+0000","last_unstale":"2024-09-12T00:58:08.164412+0000","last_undegraded":"2024-09-12T00:58:08.164412+0000","last_fullsized":"2024-09-12T00:58:08.164412+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:59.502458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":19,"num_write_kb":10558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"268'29","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:54.210368+0000","last_change":"2024-09-12T00:30:51.551466+0000","last_active":"2024-09-12T00:58:54.210368+0000","last_peered":"2024-09-12T00:58:54.210368+0000","last_clean":"2024-09-12T00:58:54.210368+0000","last_became_active":"2024-09-12T00:30:51.550694+0000","last_became_peered":"2024-09-12T00:30:51.550694+0000","last_unstale":"2024-09-12T00:58:54.210368+0000","last_undegraded":"2024-09-12T00:58:54.210368+0000","last_fullsized":"2024-09-12T00:58:54.210368+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:19.647721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:18.155457+0000","last_change":"2024-09-12T00:43:48.273326+0000","last_active":"2024-09-12T00:58:18.155457+0000","last_peered":"2024-09-12T00:58:18.155457+0000","last_clean":"2024-09-12T00:58:18.155457+0000","last_became_active":"2024-09-12T00:43:48.272356+0000","last_became_peered":"2024-09-12T00:43:48.272356+0000","last_unstale":"2024-09-12T00:58:18.155457+0000","last_undegraded":"2024-09-12T00:58:18.155457+0000","last_fullsized":"2024-09-12T00:58:18.155457+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:10.874661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"268'5","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:12.178797+0000","last_change":"2024-09-12T00:32:28.068097+0000","last_active":"2024-09-12T00:58:12.178797+0000","last_peered":"2024-09-12T00:58:12.178797+0000","last_clean":"2024-09-12T00:58:12.178797+0000","last_became_active":"2024-09-12T00:32:28.067388+0000","last_became_peered":"2024-09-12T00:32:28.067388+0000","last_unstale":"2024-09-12T00:58:12.178797+0000","last_undegraded":"2024-09-12T00:58:12.178797+0000","last_fullsized":"2024-09-12T00:58:12.178797+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:43.197946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:07.177487+0000","last_change":"2024-09-12T00:32:25.009043+0000","last_active":"2024-09-12T00:58:07.177487+0000","last_peered":"2024-09-12T00:58:07.177487+0000","last_clean":"2024-09-12T00:58:07.177487+0000","last_became_active":"2024-09-12T00:32:25.005882+0000","last_became_peered":"2024-09-12T00:32:25.005882+0000","last_unstale":"2024-09-12T00:58:07.177487+0000","last_undegraded":"2024-09-12T00:58:07.177487+0000","last_fullsized":"2024-09-12T00:58:07.177487+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:03.055383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"268'19","reported_seq":95,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:52.165743+0000","last_change":"2024-09-12T00:30:51.555200+0000","last_active":"2024-09-12T00:58:52.165743+0000","last_peered":"2024-09-12T00:58:52.165743+0000","last_clean":"2024-09-12T00:58:52.165743+0000","last_became_active":"2024-09-12T00:30:51.548932+0000","last_became_peered":"2024-09-12T00:30:51.548932+0000","last_unstale":"2024-09-12T00:58:52.165743+0000","last_undegraded":"2024-09-12T00:58:52.165743+0000","last_fullsized":"2024-09-12T00:58:52.165743+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:27.568202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.189591+0000","last_change":"2024-09-12T00:43:48.277526+0000","last_active":"2024-09-12T01:00:13.189591+0000","last_peered":"2024-09-12T01:00:13.189591+0000","last_clean":"2024-09-12T01:00:13.189591+0000","last_became_active":"2024-09-12T00:43:48.274983+0000","last_became_peered":"2024-09-12T00:43:48.274983+0000","last_unstale":"2024-09-12T01:00:13.189591+0000","last_undegraded":"2024-09-12T01:00:13.189591+0000","last_fullsized":"2024-09-12T01:00:13.189591+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:44.126353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"265'5","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:07.155894+0000","last_change":"2024-09-12T00:32:28.050796+0000","last_active":"2024-09-12T00:58:07.155894+0000","last_peered":"2024-09-12T00:58:07.155894+0000","last_clean":"2024-09-12T00:58:07.155894+0000","last_became_active":"2024-09-12T00:32:28.049947+0000","last_became_peered":"2024-09-12T00:32:28.049947+0000","last_unstale":"2024-09-12T00:58:07.155894+0000","last_undegraded":"2024-09-12T00:58:07.155894+0000","last_fullsized":"2024-09-12T00:58:07.155894+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:37.435116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:08.164500+0000","last_change":"2024-09-12T00:32:25.008845+0000","last_active":"2024-09-12T00:58:08.164500+0000","last_peered":"2024-09-12T00:58:08.164500+0000","last_clean":"2024-09-12T00:58:08.164500+0000","last_became_active":"2024-09-12T00:32:25.008089+0000","last_became_peered":"2024-09-12T00:32:25.008089+0000","last_unstale":"2024-09-12T00:58:08.164500+0000","last_undegraded":"2024-09-12T00:58:08.164500+0000","last_fullsized":"2024-09-12T00:58:08.164500+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:32.387676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"268'82","reported_seq":323,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:53.174675+0000","last_change":"2024-09-12T00:30:51.548938+0000","last_active":"2024-09-12T00:58:53.174675+0000","last_peered":"2024-09-12T00:58:53.174675+0000","last_clean":"2024-09-12T00:58:53.174675+0000","last_became_active":"2024-09-12T00:30:51.548232+0000","last_became_peered":"2024-09-12T00:30:51.548232+0000","last_unstale":"2024-09-12T00:58:53.174675+0000","last_undegraded":"2024-09-12T00:58:53.174675+0000","last_fullsized":"2024-09-12T00:58:53.174675+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:32.055820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":390,"num_write":93,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:18.155390+0000","last_change":"2024-09-12T00:43:48.272336+0000","last_active":"2024-09-12T00:58:18.155390+0000","last_peered":"2024-09-12T00:58:18.155390+0000","last_clean":"2024-09-12T00:58:18.155390+0000","last_became_active":"2024-09-12T00:43:48.271560+0000","last_became_peered":"2024-09-12T00:43:48.271560+0000","last_unstale":"2024-09-12T00:58:18.155390+0000","last_undegraded":"2024-09-12T00:58:18.155390+0000","last_fullsized":"2024-09-12T00:58:18.155390+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:33.055656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:09.196589+0000","last_change":"2024-09-12T00:32:28.058883+0000","last_active":"2024-09-12T00:58:09.196589+0000","last_peered":"2024-09-12T00:58:09.196589+0000","last_clean":"2024-09-12T00:58:09.196589+0000","last_became_active":"2024-09-12T00:32:28.058127+0000","last_became_peered":"2024-09-12T00:32:28.058127+0000","last_unstale":"2024-09-12T00:58:09.196589+0000","last_undegraded":"2024-09-12T00:58:09.196589+0000","last_fullsized":"2024-09-12T00:58:09.196589+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:36.704098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"268'3","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.197862+0000","last_change":"2024-09-12T00:32:25.013431+0000","last_active":"2024-09-12T01:00:28.197862+0000","last_peered":"2024-09-12T01:00:28.197862+0000","last_clean":"2024-09-12T01:00:28.197862+0000","last_became_active":"2024-09-12T00:32:25.013042+0000","last_became_peered":"2024-09-12T00:32:25.013042+0000","last_unstale":"2024-09-12T01:00:28.197862+0000","last_undegraded":"2024-09-12T01:00:28.197862+0000","last_fullsized":"2024-09-12T01:00:28.197862+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:01.167610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'29","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:52.165632+0000","last_change":"2024-09-12T00:30:51.548109+0000","last_active":"2024-09-12T00:58:52.165632+0000","last_peered":"2024-09-12T00:58:52.165632+0000","last_clean":"2024-09-12T00:58:52.165632+0000","last_became_active":"2024-09-12T00:30:51.545619+0000","last_became_peered":"2024-09-12T00:30:51.545619+0000","last_unstale":"2024-09-12T00:58:52.165632+0000","last_undegraded":"2024-09-12T00:58:52.165632+0000","last_fullsized":"2024-09-12T00:58:52.165632+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:38.398967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":120,"num_write":40,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:07.193629+0000","last_change":"2024-09-12T00:43:48.280018+0000","last_active":"2024-09-12T00:59:07.193629+0000","last_peered":"2024-09-12T00:59:07.193629+0000","last_clean":"2024-09-12T00:59:07.193629+0000","last_became_active":"2024-09-12T00:43:48.279197+0000","last_became_peered":"2024-09-12T00:43:48.279197+0000","last_unstale":"2024-09-12T00:59:07.193629+0000","last_undegraded":"2024-09-12T00:59:07.193629+0000","last_fullsized":"2024-09-12T00:59:07.193629+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:16.184230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174616+0000","last_change":"2024-09-12T00:32:28.058572+0000","last_active":"2024-09-12T00:59:27.174616+0000","last_peered":"2024-09-12T00:59:27.174616+0000","last_clean":"2024-09-12T00:59:27.174616+0000","last_became_active":"2024-09-12T00:32:28.057839+0000","last_became_peered":"2024-09-12T00:32:28.057839+0000","last_unstale":"2024-09-12T00:59:27.174616+0000","last_undegraded":"2024-09-12T00:59:27.174616+0000","last_fullsized":"2024-09-12T00:59:27.174616+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:41.184079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"268'7","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:28.183290+0000","last_change":"2024-09-12T00:32:25.022238+0000","last_active":"2024-09-12T00:59:28.183290+0000","last_peered":"2024-09-12T00:59:28.183290+0000","last_clean":"2024-09-12T00:59:28.183290+0000","last_became_active":"2024-09-12T00:32:25.021649+0000","last_became_peered":"2024-09-12T00:32:25.021649+0000","last_unstale":"2024-09-12T00:59:28.183290+0000","last_undegraded":"2024-09-12T00:59:28.183290+0000","last_fullsized":"2024-09-12T00:59:28.183290+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:11.939783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"268'68","reported_seq":236,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:17.186626+0000","last_change":"2024-09-12T00:30:51.562713+0000","last_active":"2024-09-12T01:00:17.186626+0000","last_peered":"2024-09-12T01:00:17.186626+0000","last_clean":"2024-09-12T01:00:17.186626+0000","last_became_active":"2024-09-12T00:30:51.562106+0000","last_became_peered":"2024-09-12T00:30:51.562106+0000","last_unstale":"2024-09-12T01:00:17.186626+0000","last_undegraded":"2024-09-12T01:00:17.186626+0000","last_fullsized":"2024-09-12T01:00:17.186626+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:57.176892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":360,"num_read_kb":258,"num_write":123,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185103+0000","last_change":"2024-09-12T00:43:48.287022+0000","last_active":"2024-09-12T00:59:33.185103+0000","last_peered":"2024-09-12T00:59:33.185103+0000","last_clean":"2024-09-12T00:59:33.185103+0000","last_became_active":"2024-09-12T00:43:48.286629+0000","last_became_peered":"2024-09-12T00:43:48.286629+0000","last_unstale":"2024-09-12T00:59:33.185103+0000","last_undegraded":"2024-09-12T00:59:33.185103+0000","last_fullsized":"2024-09-12T00:59:33.185103+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:40.640752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174553+0000","last_change":"2024-09-12T00:32:28.071698+0000","last_active":"2024-09-12T00:59:27.174553+0000","last_peered":"2024-09-12T00:59:27.174553+0000","last_clean":"2024-09-12T00:59:27.174553+0000","last_became_active":"2024-09-12T00:32:28.070913+0000","last_became_peered":"2024-09-12T00:32:28.070913+0000","last_unstale":"2024-09-12T00:59:27.174553+0000","last_undegraded":"2024-09-12T00:59:27.174553+0000","last_fullsized":"2024-09-12T00:59:27.174553+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:34.008495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"268'8","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:28.172420+0000","last_change":"2024-09-12T00:32:25.022141+0000","last_active":"2024-09-12T00:59:28.172420+0000","last_peered":"2024-09-12T00:59:28.172420+0000","last_clean":"2024-09-12T00:59:28.172420+0000","last_became_active":"2024-09-12T00:32:25.007681+0000","last_became_peered":"2024-09-12T00:32:25.007681+0000","last_unstale":"2024-09-12T00:59:28.172420+0000","last_undegraded":"2024-09-12T00:59:28.172420+0000","last_fullsized":"2024-09-12T00:59:28.172420+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:46.593006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5291296,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":4146,"num_write":18,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"268'39","reported_seq":150,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:09.229370+0000","last_change":"2024-09-12T00:30:51.565589+0000","last_active":"2024-09-12T01:00:09.229370+0000","last_peered":"2024-09-12T01:00:09.229370+0000","last_clean":"2024-09-12T01:00:09.229370+0000","last_became_active":"2024-09-12T00:30:51.559520+0000","last_became_peered":"2024-09-12T00:30:51.559520+0000","last_unstale":"2024-09-12T01:00:09.229370+0000","last_undegraded":"2024-09-12T01:00:09.229370+0000","last_fullsized":"2024-09-12T01:00:09.229370+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:38.099204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":143,"num_write":68,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:59.211561+0000","last_change":"2024-09-12T00:43:48.287080+0000","last_active":"2024-09-12T00:58:59.211561+0000","last_peered":"2024-09-12T00:58:59.211561+0000","last_clean":"2024-09-12T00:58:59.211561+0000","last_became_active":"2024-09-12T00:43:48.286079+0000","last_became_peered":"2024-09-12T00:43:48.286079+0000","last_unstale":"2024-09-12T00:58:59.211561+0000","last_undegraded":"2024-09-12T00:58:59.211561+0000","last_fullsized":"2024-09-12T00:58:59.211561+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:57.937242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.177100+0000","last_change":"2024-09-12T00:32:28.075197+0000","last_active":"2024-09-12T00:59:37.177100+0000","last_peered":"2024-09-12T00:59:37.177100+0000","last_clean":"2024-09-12T00:59:37.177100+0000","last_became_active":"2024-09-12T00:32:28.074621+0000","last_became_peered":"2024-09-12T00:32:28.074621+0000","last_unstale":"2024-09-12T00:59:37.177100+0000","last_undegraded":"2024-09-12T00:59:37.177100+0000","last_fullsized":"2024-09-12T00:59:37.177100+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:11.217357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174686+0000","last_change":"2024-09-12T00:32:25.009196+0000","last_active":"2024-09-12T00:59:27.174686+0000","last_peered":"2024-09-12T00:59:27.174686+0000","last_clean":"2024-09-12T00:59:27.174686+0000","last_became_active":"2024-09-12T00:32:25.008419+0000","last_became_peered":"2024-09-12T00:32:25.008419+0000","last_unstale":"2024-09-12T00:59:27.174686+0000","last_undegraded":"2024-09-12T00:59:27.174686+0000","last_fullsized":"2024-09-12T00:59:27.174686+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:01.482915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"268'30","reported_seq":120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.193309+0000","last_change":"2024-09-12T00:30:51.541334+0000","last_active":"2024-09-12T01:00:08.193309+0000","last_peered":"2024-09-12T01:00:08.193309+0000","last_clean":"2024-09-12T01:00:08.193309+0000","last_became_active":"2024-09-12T00:30:51.540434+0000","last_became_peered":"2024-09-12T00:30:51.540434+0000","last_unstale":"2024-09-12T01:00:08.193309+0000","last_undegraded":"2024-09-12T01:00:08.193309+0000","last_fullsized":"2024-09-12T01:00:08.193309+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:01.590635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":92,"num_write":60,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:58.176983+0000","last_change":"2024-09-12T00:43:48.279278+0000","last_active":"2024-09-12T00:58:58.176983+0000","last_peered":"2024-09-12T00:58:58.176983+0000","last_clean":"2024-09-12T00:58:58.176983+0000","last_became_active":"2024-09-12T00:43:48.278477+0000","last_became_peered":"2024-09-12T00:43:48.278477+0000","last_unstale":"2024-09-12T00:58:58.176983+0000","last_undegraded":"2024-09-12T00:58:58.176983+0000","last_fullsized":"2024-09-12T00:58:58.176983+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:23.351907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"268'10","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:32.200462+0000","last_change":"2024-09-12T00:32:28.075698+0000","last_active":"2024-09-12T00:59:32.200462+0000","last_peered":"2024-09-12T00:59:32.200462+0000","last_clean":"2024-09-12T00:59:32.200462+0000","last_became_active":"2024-09-12T00:32:28.066441+0000","last_became_peered":"2024-09-12T00:32:28.066441+0000","last_unstale":"2024-09-12T00:59:32.200462+0000","last_undegraded":"2024-09-12T00:59:32.200462+0000","last_fullsized":"2024-09-12T00:59:32.200462+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:29.911316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":37890,"num_write":20,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.177139+0000","last_change":"2024-09-12T00:32:25.011505+0000","last_active":"2024-09-12T00:59:37.177139+0000","last_peered":"2024-09-12T00:59:37.177139+0000","last_clean":"2024-09-12T00:59:37.177139+0000","last_became_active":"2024-09-12T00:32:25.010752+0000","last_became_peered":"2024-09-12T00:32:25.010752+0000","last_unstale":"2024-09-12T00:59:37.177139+0000","last_undegraded":"2024-09-12T00:59:37.177139+0000","last_fullsized":"2024-09-12T00:59:37.177139+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:38.026878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"268'114","reported_seq":464,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.181883+0000","last_change":"2024-09-12T00:30:51.550820+0000","last_active":"2024-09-12T01:00:08.181883+0000","last_peered":"2024-09-12T01:00:08.181883+0000","last_clean":"2024-09-12T01:00:08.181883+0000","last_became_active":"2024-09-12T00:30:51.550081+0000","last_became_peered":"2024-09-12T00:30:51.550081+0000","last_unstale":"2024-09-12T01:00:08.181883+0000","last_undegraded":"2024-09-12T01:00:08.181883+0000","last_fullsized":"2024-09-12T01:00:08.181883+0000","mapping_epoch":257,"log_start":"265'100","ondisk_log_start":"265'100","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:48.107776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":826,"num_read_kb":599,"num_write":142,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.201751+0000","last_change":"2024-09-12T00:43:48.273417+0000","last_active":"2024-09-12T00:59:37.201751+0000","last_peered":"2024-09-12T00:59:37.201751+0000","last_clean":"2024-09-12T00:59:37.201751+0000","last_became_active":"2024-09-12T00:43:48.272486+0000","last_became_peered":"2024-09-12T00:43:48.272486+0000","last_unstale":"2024-09-12T00:59:37.201751+0000","last_undegraded":"2024-09-12T00:59:37.201751+0000","last_fullsized":"2024-09-12T00:59:37.201751+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:26.875710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:29.201794+0000","last_change":"2024-09-12T00:32:28.051078+0000","last_active":"2024-09-12T00:58:29.201794+0000","last_peered":"2024-09-12T00:58:29.201794+0000","last_clean":"2024-09-12T00:58:29.201794+0000","last_became_active":"2024-09-12T00:32:28.049186+0000","last_became_peered":"2024-09-12T00:32:28.049186+0000","last_unstale":"2024-09-12T00:58:29.201794+0000","last_undegraded":"2024-09-12T00:58:29.201794+0000","last_fullsized":"2024-09-12T00:58:29.201794+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:54.432738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:27.160025+0000","last_change":"2024-09-12T00:32:25.000690+0000","last_active":"2024-09-12T00:58:27.160025+0000","last_peered":"2024-09-12T00:58:27.160025+0000","last_clean":"2024-09-12T00:58:27.160025+0000","last_became_active":"2024-09-12T00:32:24.999633+0000","last_became_peered":"2024-09-12T00:32:24.999633+0000","last_unstale":"2024-09-12T00:58:27.160025+0000","last_undegraded":"2024-09-12T00:58:27.160025+0000","last_fullsized":"2024-09-12T00:58:27.160025+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:09.259657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"268'69","reported_seq":237,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.181761+0000","last_change":"2024-09-12T00:30:51.548507+0000","last_active":"2024-09-12T01:00:08.181761+0000","last_peered":"2024-09-12T01:00:08.181761+0000","last_clean":"2024-09-12T01:00:08.181761+0000","last_became_active":"2024-09-12T00:30:51.546873+0000","last_became_peered":"2024-09-12T00:30:51.546873+0000","last_unstale":"2024-09-12T01:00:08.181761+0000","last_undegraded":"2024-09-12T01:00:08.181761+0000","last_fullsized":"2024-09-12T01:00:08.181761+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:28.201041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":256,"num_write":124,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:38.185725+0000","last_change":"2024-09-12T00:43:48.287793+0000","last_active":"2024-09-12T00:59:38.185725+0000","last_peered":"2024-09-12T00:59:38.185725+0000","last_clean":"2024-09-12T00:59:38.185725+0000","last_became_active":"2024-09-12T00:43:48.287144+0000","last_became_peered":"2024-09-12T00:43:48.287144+0000","last_unstale":"2024-09-12T00:59:38.185725+0000","last_undegraded":"2024-09-12T00:59:38.185725+0000","last_fullsized":"2024-09-12T00:59:38.185725+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:03.320468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:28.167607+0000","last_change":"2024-09-12T00:32:28.064542+0000","last_active":"2024-09-12T00:58:28.167607+0000","last_peered":"2024-09-12T00:58:28.167607+0000","last_clean":"2024-09-12T00:58:28.167607+0000","last_became_active":"2024-09-12T00:32:28.063712+0000","last_became_peered":"2024-09-12T00:32:28.063712+0000","last_unstale":"2024-09-12T00:58:28.167607+0000","last_undegraded":"2024-09-12T00:58:28.167607+0000","last_fullsized":"2024-09-12T00:58:28.167607+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:07.012225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"268'2","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:27.183761+0000","last_change":"2024-09-12T00:32:25.012329+0000","last_active":"2024-09-12T00:58:27.183761+0000","last_peered":"2024-09-12T00:58:27.183761+0000","last_clean":"2024-09-12T00:58:27.183761+0000","last_became_active":"2024-09-12T00:32:25.005902+0000","last_became_peered":"2024-09-12T00:32:25.005902+0000","last_unstale":"2024-09-12T00:58:27.183761+0000","last_undegraded":"2024-09-12T00:58:27.183761+0000","last_fullsized":"2024-09-12T00:58:27.183761+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:34.031714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"268'31","reported_seq":126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:13.179616+0000","last_change":"2024-09-12T00:30:51.545329+0000","last_active":"2024-09-12T00:59:13.179616+0000","last_peered":"2024-09-12T00:59:13.179616+0000","last_clean":"2024-09-12T00:59:13.179616+0000","last_became_active":"2024-09-12T00:30:51.541904+0000","last_became_peered":"2024-09-12T00:30:51.541904+0000","last_unstale":"2024-09-12T00:59:13.179616+0000","last_undegraded":"2024-09-12T00:59:13.179616+0000","last_fullsized":"2024-09-12T00:59:13.179616+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:26.384655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":109,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185912+0000","last_change":"2024-09-12T00:43:48.275537+0000","last_active":"2024-09-12T00:59:33.185912+0000","last_peered":"2024-09-12T00:59:33.185912+0000","last_clean":"2024-09-12T00:59:33.185912+0000","last_became_active":"2024-09-12T00:43:48.274756+0000","last_became_peered":"2024-09-12T00:43:48.274756+0000","last_unstale":"2024-09-12T00:59:33.185912+0000","last_undegraded":"2024-09-12T00:59:33.185912+0000","last_fullsized":"2024-09-12T00:59:33.185912+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:14.072781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"268'3","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:28.172269+0000","last_change":"2024-09-12T00:32:28.066799+0000","last_active":"2024-09-12T00:59:28.172269+0000","last_peered":"2024-09-12T00:59:28.172269+0000","last_clean":"2024-09-12T00:59:28.172269+0000","last_became_active":"2024-09-12T00:32:28.066029+0000","last_became_peered":"2024-09-12T00:32:28.066029+0000","last_unstale":"2024-09-12T00:59:28.172269+0000","last_undegraded":"2024-09-12T00:59:28.172269+0000","last_fullsized":"2024-09-12T00:59:28.172269+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:56.429963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"268'2","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:37.162238+0000","last_change":"2024-09-12T00:32:25.001979+0000","last_active":"2024-09-12T00:58:37.162238+0000","last_peered":"2024-09-12T00:58:37.162238+0000","last_clean":"2024-09-12T00:58:37.162238+0000","last_became_active":"2024-09-12T00:32:25.001194+0000","last_became_peered":"2024-09-12T00:32:25.001194+0000","last_unstale":"2024-09-12T00:58:37.162238+0000","last_undegraded":"2024-09-12T00:58:37.162238+0000","last_fullsized":"2024-09-12T00:58:37.162238+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:06.421742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"268'15","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.192385+0000","last_change":"2024-09-12T00:30:51.544531+0000","last_active":"2024-09-12T00:59:02.192385+0000","last_peered":"2024-09-12T00:59:02.192385+0000","last_clean":"2024-09-12T00:59:02.192385+0000","last_became_active":"2024-09-12T00:30:51.543711+0000","last_became_peered":"2024-09-12T00:30:51.543711+0000","last_unstale":"2024-09-12T00:59:02.192385+0000","last_undegraded":"2024-09-12T00:59:02.192385+0000","last_fullsized":"2024-09-12T00:59:02.192385+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:07.148537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":43,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.176965+0000","last_change":"2024-09-12T00:43:48.290387+0000","last_active":"2024-09-12T00:59:37.176965+0000","last_peered":"2024-09-12T00:59:37.176965+0000","last_clean":"2024-09-12T00:59:37.176965+0000","last_became_active":"2024-09-12T00:43:48.289475+0000","last_became_peered":"2024-09-12T00:43:48.289475+0000","last_unstale":"2024-09-12T00:59:37.176965+0000","last_undegraded":"2024-09-12T00:59:37.176965+0000","last_fullsized":"2024-09-12T00:59:37.176965+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:49.960814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.169772+0000","last_change":"2024-09-12T00:32:28.056626+0000","last_active":"2024-09-12T00:58:33.169772+0000","last_peered":"2024-09-12T00:58:33.169772+0000","last_clean":"2024-09-12T00:58:33.169772+0000","last_became_active":"2024-09-12T00:32:28.055934+0000","last_became_peered":"2024-09-12T00:32:28.055934+0000","last_unstale":"2024-09-12T00:58:33.169772+0000","last_undegraded":"2024-09-12T00:58:33.169772+0000","last_fullsized":"2024-09-12T00:58:33.169772+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:50.220908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"268'2","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:24.218059+0000","last_change":"2024-09-12T00:32:25.005226+0000","last_active":"2024-09-12T00:59:24.218059+0000","last_peered":"2024-09-12T00:59:24.218059+0000","last_clean":"2024-09-12T00:59:24.218059+0000","last_became_active":"2024-09-12T00:32:25.004503+0000","last_became_peered":"2024-09-12T00:32:25.004503+0000","last_unstale":"2024-09-12T00:59:24.218059+0000","last_undegraded":"2024-09-12T00:59:24.218059+0000","last_fullsized":"2024-09-12T00:59:24.218059+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:32.108404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"268'12","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.178118+0000","last_change":"2024-09-12T00:30:51.543743+0000","last_active":"2024-09-12T00:59:03.178118+0000","last_peered":"2024-09-12T00:59:03.178118+0000","last_clean":"2024-09-12T00:59:03.178118+0000","last_became_active":"2024-09-12T00:30:51.542992+0000","last_became_peered":"2024-09-12T00:30:51.542992+0000","last_unstale":"2024-09-12T00:59:03.178118+0000","last_undegraded":"2024-09-12T00:59:03.178118+0000","last_fullsized":"2024-09-12T00:59:03.178118+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:43.711804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.199729+0000","last_change":"2024-09-12T00:43:48.283532+0000","last_active":"2024-09-12T01:00:28.199729+0000","last_peered":"2024-09-12T01:00:28.199729+0000","last_clean":"2024-09-12T01:00:28.199729+0000","last_became_active":"2024-09-12T00:43:48.276293+0000","last_became_peered":"2024-09-12T00:43:48.276293+0000","last_unstale":"2024-09-12T01:00:28.199729+0000","last_undegraded":"2024-09-12T01:00:28.199729+0000","last_fullsized":"2024-09-12T01:00:28.199729+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:45.902022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"268'4","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:42.202970+0000","last_change":"2024-09-12T00:32:28.073623+0000","last_active":"2024-09-12T00:59:42.202970+0000","last_peered":"2024-09-12T00:59:42.202970+0000","last_clean":"2024-09-12T00:59:42.202970+0000","last_became_active":"2024-09-12T00:32:28.067824+0000","last_became_peered":"2024-09-12T00:32:28.067824+0000","last_unstale":"2024-09-12T00:59:42.202970+0000","last_undegraded":"2024-09-12T00:59:42.202970+0000","last_fullsized":"2024-09-12T00:59:42.202970+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:24.607971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":11264,"num_write":4,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"268'3","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:34.014457+0000","last_change":"2024-09-12T00:32:25.022973+0000","last_active":"2024-09-12T01:01:34.014457+0000","last_peered":"2024-09-12T01:01:34.014457+0000","last_clean":"2024-09-12T01:01:34.014457+0000","last_became_active":"2024-09-12T00:32:25.022210+0000","last_became_peered":"2024-09-12T00:32:25.022210+0000","last_unstale":"2024-09-12T01:01:34.014457+0000","last_undegraded":"2024-09-12T01:01:34.014457+0000","last_fullsized":"2024-09-12T01:01:34.014457+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:27.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.171708+0000","last_change":"2024-09-12T00:30:51.550674+0000","last_active":"2024-09-12T00:59:03.171708+0000","last_peered":"2024-09-12T00:59:03.171708+0000","last_clean":"2024-09-12T00:59:03.171708+0000","last_became_active":"2024-09-12T00:30:51.549942+0000","last_became_peered":"2024-09-12T00:30:51.549942+0000","last_unstale":"2024-09-12T00:59:03.171708+0000","last_undegraded":"2024-09-12T00:59:03.171708+0000","last_fullsized":"2024-09-12T00:59:03.171708+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:52.263117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":118,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.199785+0000","last_change":"2024-09-12T00:43:48.276759+0000","last_active":"2024-09-12T01:00:28.199785+0000","last_peered":"2024-09-12T01:00:28.199785+0000","last_clean":"2024-09-12T01:00:28.199785+0000","last_became_active":"2024-09-12T00:43:48.276176+0000","last_became_peered":"2024-09-12T00:43:48.276176+0000","last_unstale":"2024-09-12T01:00:28.199785+0000","last_undegraded":"2024-09-12T01:00:28.199785+0000","last_fullsized":"2024-09-12T01:00:28.199785+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:07.896702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.201670+0000","last_change":"2024-09-12T00:32:28.052395+0000","last_active":"2024-09-12T00:59:37.201670+0000","last_peered":"2024-09-12T00:59:37.201670+0000","last_clean":"2024-09-12T00:59:37.201670+0000","last_became_active":"2024-09-12T00:32:28.051244+0000","last_became_peered":"2024-09-12T00:32:28.051244+0000","last_unstale":"2024-09-12T00:59:37.201670+0000","last_undegraded":"2024-09-12T00:59:37.201670+0000","last_fullsized":"2024-09-12T00:59:37.201670+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:09.633243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"268'2","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.995791+0000","last_change":"2024-09-12T00:32:25.023656+0000","last_active":"2024-09-12T01:01:47.995791+0000","last_peered":"2024-09-12T01:01:47.995791+0000","last_clean":"2024-09-12T01:01:47.995791+0000","last_became_active":"2024-09-12T00:32:25.022757+0000","last_became_peered":"2024-09-12T00:32:25.022757+0000","last_unstale":"2024-09-12T01:01:47.995791+0000","last_undegraded":"2024-09-12T01:01:47.995791+0000","last_fullsized":"2024-09-12T01:01:47.995791+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:59.877231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'12","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:04.213055+0000","last_change":"2024-09-12T00:30:51.566131+0000","last_active":"2024-09-12T00:59:04.213055+0000","last_peered":"2024-09-12T00:59:04.213055+0000","last_clean":"2024-09-12T00:59:04.213055+0000","last_became_active":"2024-09-12T00:30:51.565544+0000","last_became_peered":"2024-09-12T00:30:51.565544+0000","last_unstale":"2024-09-12T00:59:04.213055+0000","last_undegraded":"2024-09-12T00:59:04.213055+0000","last_fullsized":"2024-09-12T00:59:04.213055+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:14.413107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.206539+0000","last_change":"2024-09-12T00:43:48.280037+0000","last_active":"2024-09-12T00:59:57.206539+0000","last_peered":"2024-09-12T00:59:57.206539+0000","last_clean":"2024-09-12T00:59:57.206539+0000","last_became_active":"2024-09-12T00:43:48.279243+0000","last_became_peered":"2024-09-12T00:43:48.279243+0000","last_unstale":"2024-09-12T00:59:57.206539+0000","last_undegraded":"2024-09-12T00:59:57.206539+0000","last_fullsized":"2024-09-12T00:59:57.206539+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:31.525488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"268'2","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:28.168408+0000","last_change":"2024-09-12T00:32:28.060782+0000","last_active":"2024-09-12T00:58:28.168408+0000","last_peered":"2024-09-12T00:58:28.168408+0000","last_clean":"2024-09-12T00:58:28.168408+0000","last_became_active":"2024-09-12T00:32:28.058384+0000","last_became_peered":"2024-09-12T00:32:28.058384+0000","last_unstale":"2024-09-12T00:58:28.168408+0000","last_undegraded":"2024-09-12T00:58:28.168408+0000","last_fullsized":"2024-09-12T00:58:28.168408+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:38.238661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"265'3","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:28.167835+0000","last_change":"2024-09-12T00:32:24.996244+0000","last_active":"2024-09-12T00:58:28.167835+0000","last_peered":"2024-09-12T00:58:28.167835+0000","last_clean":"2024-09-12T00:58:28.167835+0000","last_became_active":"2024-09-12T00:32:24.995532+0000","last_became_peered":"2024-09-12T00:32:24.995532+0000","last_unstale":"2024-09-12T00:58:28.167835+0000","last_undegraded":"2024-09-12T00:58:28.167835+0000","last_fullsized":"2024-09-12T00:58:28.167835+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:39.969617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"268'40","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.196522+0000","last_change":"2024-09-12T00:30:51.554468+0000","last_active":"2024-09-12T01:00:13.196522+0000","last_peered":"2024-09-12T01:00:13.196522+0000","last_clean":"2024-09-12T01:00:13.196522+0000","last_became_active":"2024-09-12T00:30:51.553501+0000","last_became_peered":"2024-09-12T00:30:51.553501+0000","last_unstale":"2024-09-12T01:00:13.196522+0000","last_undegraded":"2024-09-12T01:00:13.196522+0000","last_fullsized":"2024-09-12T01:00:13.196522+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:13.843806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":68,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.234081+0000","last_change":"2024-09-12T00:43:48.281674+0000","last_active":"2024-09-12T01:00:29.234081+0000","last_peered":"2024-09-12T01:00:29.234081+0000","last_clean":"2024-09-12T01:00:29.234081+0000","last_became_active":"2024-09-12T00:43:48.280566+0000","last_became_peered":"2024-09-12T00:43:48.280566+0000","last_unstale":"2024-09-12T01:00:29.234081+0000","last_undegraded":"2024-09-12T01:00:29.234081+0000","last_fullsized":"2024-09-12T01:00:29.234081+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:02.297251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"268'4","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000545+0000","last_change":"2024-09-12T00:32:28.061791+0000","last_active":"2024-09-12T01:00:39.000545+0000","last_peered":"2024-09-12T01:00:39.000545+0000","last_clean":"2024-09-12T01:00:39.000545+0000","last_became_active":"2024-09-12T00:32:28.061089+0000","last_became_peered":"2024-09-12T00:32:28.061089+0000","last_unstale":"2024-09-12T01:00:39.000545+0000","last_undegraded":"2024-09-12T01:00:39.000545+0000","last_fullsized":"2024-09-12T01:00:39.000545+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:12.218155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":326,"num_write":4,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"265'11","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:24.200843+0000","last_change":"2024-09-12T00:32:25.004508+0000","last_active":"2024-09-12T00:58:24.200843+0000","last_peered":"2024-09-12T00:58:24.200843+0000","last_clean":"2024-09-12T00:58:24.200843+0000","last_became_active":"2024-09-12T00:32:25.004199+0000","last_became_peered":"2024-09-12T00:32:25.004199+0000","last_unstale":"2024-09-12T00:58:24.200843+0000","last_undegraded":"2024-09-12T00:58:24.200843+0000","last_fullsized":"2024-09-12T00:58:24.200843+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:38.507054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11280,"num_write":21,"num_write_kb":11280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"268'12","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:02.183087+0000","last_change":"2024-09-12T00:30:51.554784+0000","last_active":"2024-09-12T01:00:02.183087+0000","last_peered":"2024-09-12T01:00:02.183087+0000","last_clean":"2024-09-12T01:00:02.183087+0000","last_became_active":"2024-09-12T00:30:51.548619+0000","last_became_peered":"2024-09-12T00:30:51.548619+0000","last_unstale":"2024-09-12T01:00:02.183087+0000","last_undegraded":"2024-09-12T01:00:02.183087+0000","last_fullsized":"2024-09-12T01:00:02.183087+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:18.858058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168084+0000","last_change":"2024-09-12T00:43:48.284636+0000","last_active":"2024-09-12T00:59:02.168084+0000","last_peered":"2024-09-12T00:59:02.168084+0000","last_clean":"2024-09-12T00:59:02.168084+0000","last_became_active":"2024-09-12T00:43:48.283630+0000","last_became_peered":"2024-09-12T00:43:48.283630+0000","last_unstale":"2024-09-12T00:59:02.168084+0000","last_undegraded":"2024-09-12T00:59:02.168084+0000","last_fullsized":"2024-09-12T00:59:02.168084+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:05.417886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'5","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179689+0000","last_change":"2024-09-12T00:32:28.054779+0000","last_active":"2024-09-12T00:59:33.179689+0000","last_peered":"2024-09-12T00:59:33.179689+0000","last_clean":"2024-09-12T00:59:33.179689+0000","last_became_active":"2024-09-12T00:32:28.054045+0000","last_became_peered":"2024-09-12T00:32:28.054045+0000","last_unstale":"2024-09-12T00:59:33.179689+0000","last_undegraded":"2024-09-12T00:59:33.179689+0000","last_fullsized":"2024-09-12T00:59:33.179689+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:05.598087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'3","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:38.202145+0000","last_change":"2024-09-12T00:32:24.998555+0000","last_active":"2024-09-12T01:00:38.202145+0000","last_peered":"2024-09-12T01:00:38.202145+0000","last_clean":"2024-09-12T01:00:38.202145+0000","last_became_active":"2024-09-12T00:32:24.997768+0000","last_became_peered":"2024-09-12T00:32:24.997768+0000","last_unstale":"2024-09-12T01:00:38.202145+0000","last_undegraded":"2024-09-12T01:00:38.202145+0000","last_fullsized":"2024-09-12T01:00:38.202145+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:01.938274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"268'27","reported_seq":114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.193807+0000","last_change":"2024-09-12T00:30:51.557180+0000","last_active":"2024-09-12T01:00:03.193807+0000","last_peered":"2024-09-12T01:00:03.193807+0000","last_clean":"2024-09-12T01:00:03.193807+0000","last_became_active":"2024-09-12T00:30:51.556456+0000","last_became_peered":"2024-09-12T00:30:51.556456+0000","last_unstale":"2024-09-12T01:00:03.193807+0000","last_undegraded":"2024-09-12T01:00:03.193807+0000","last_fullsized":"2024-09-12T01:00:03.193807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:08.813545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":57,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:58.170620+0000","last_change":"2024-09-12T00:43:48.266541+0000","last_active":"2024-09-12T00:58:58.170620+0000","last_peered":"2024-09-12T00:58:58.170620+0000","last_clean":"2024-09-12T00:58:58.170620+0000","last_became_active":"2024-09-12T00:43:48.265726+0000","last_became_peered":"2024-09-12T00:43:48.265726+0000","last_unstale":"2024-09-12T00:58:58.170620+0000","last_undegraded":"2024-09-12T00:58:58.170620+0000","last_fullsized":"2024-09-12T00:58:58.170620+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:07.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000271+0000","last_change":"2024-09-12T00:32:28.051868+0000","last_active":"2024-09-12T01:00:39.000271+0000","last_peered":"2024-09-12T01:00:39.000271+0000","last_clean":"2024-09-12T01:00:39.000271+0000","last_became_active":"2024-09-12T00:32:28.051145+0000","last_became_peered":"2024-09-12T00:32:28.051145+0000","last_unstale":"2024-09-12T01:00:39.000271+0000","last_undegraded":"2024-09-12T01:00:39.000271+0000","last_fullsized":"2024-09-12T01:00:39.000271+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:26.514177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219199+0000","last_change":"2024-09-12T00:32:25.007529+0000","last_active":"2024-09-12T00:59:29.219199+0000","last_peered":"2024-09-12T00:59:29.219199+0000","last_clean":"2024-09-12T00:59:29.219199+0000","last_became_active":"2024-09-12T00:32:25.003679+0000","last_became_peered":"2024-09-12T00:32:25.003679+0000","last_unstale":"2024-09-12T00:59:29.219199+0000","last_undegraded":"2024-09-12T00:59:29.219199+0000","last_fullsized":"2024-09-12T00:59:29.219199+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:31.977653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"268'23","reported_seq":107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:04.228064+0000","last_change":"2024-09-12T00:30:51.552593+0000","last_active":"2024-09-12T01:00:04.228064+0000","last_peered":"2024-09-12T01:00:04.228064+0000","last_clean":"2024-09-12T01:00:04.228064+0000","last_became_active":"2024-09-12T00:30:51.551554+0000","last_became_peered":"2024-09-12T00:30:51.551554+0000","last_unstale":"2024-09-12T01:00:04.228064+0000","last_undegraded":"2024-09-12T01:00:04.228064+0000","last_fullsized":"2024-09-12T01:00:04.228064+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:19.144268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.989931+0000","last_change":"2024-09-12T00:43:48.287349+0000","last_active":"2024-09-12T01:00:31.989931+0000","last_peered":"2024-09-12T01:00:31.989931+0000","last_clean":"2024-09-12T01:00:31.989931+0000","last_became_active":"2024-09-12T00:43:48.286593+0000","last_became_peered":"2024-09-12T00:43:48.286593+0000","last_unstale":"2024-09-12T01:00:31.989931+0000","last_undegraded":"2024-09-12T01:00:31.989931+0000","last_fullsized":"2024-09-12T01:00:31.989931+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:41.625703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"268'5","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.184398+0000","last_change":"2024-09-12T00:32:28.070368+0000","last_active":"2024-09-12T00:59:33.184398+0000","last_peered":"2024-09-12T00:59:33.184398+0000","last_clean":"2024-09-12T00:59:33.184398+0000","last_became_active":"2024-09-12T00:32:28.069812+0000","last_became_peered":"2024-09-12T00:32:28.069812+0000","last_unstale":"2024-09-12T00:59:33.184398+0000","last_undegraded":"2024-09-12T00:59:33.184398+0000","last_fullsized":"2024-09-12T00:59:33.184398+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:37.247045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":5,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"268'8","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:38.202224+0000","last_change":"2024-09-12T00:32:25.021525+0000","last_active":"2024-09-12T01:01:38.202224+0000","last_peered":"2024-09-12T01:01:38.202224+0000","last_clean":"2024-09-12T01:01:38.202224+0000","last_became_active":"2024-09-12T00:32:25.017138+0000","last_became_peered":"2024-09-12T00:32:25.017138+0000","last_unstale":"2024-09-12T01:01:38.202224+0000","last_undegraded":"2024-09-12T01:01:38.202224+0000","last_fullsized":"2024-09-12T01:01:38.202224+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:39.080595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"268'53","reported_seq":190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:04.227963+0000","last_change":"2024-09-12T00:30:51.553247+0000","last_active":"2024-09-12T01:00:04.227963+0000","last_peered":"2024-09-12T01:00:04.227963+0000","last_clean":"2024-09-12T01:00:04.227963+0000","last_became_active":"2024-09-12T00:30:51.546238+0000","last_became_peered":"2024-09-12T00:30:51.546238+0000","last_unstale":"2024-09-12T01:00:04.227963+0000","last_undegraded":"2024-09-12T01:00:04.227963+0000","last_fullsized":"2024-09-12T01:00:04.227963+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:52.536369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":191,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:29.201979+0000","last_change":"2024-09-12T00:43:48.277891+0000","last_active":"2024-09-12T00:58:29.201979+0000","last_peered":"2024-09-12T00:58:29.201979+0000","last_clean":"2024-09-12T00:58:29.201979+0000","last_became_active":"2024-09-12T00:43:48.277275+0000","last_became_peered":"2024-09-12T00:43:48.277275+0000","last_unstale":"2024-09-12T00:58:29.201979+0000","last_undegraded":"2024-09-12T00:58:29.201979+0000","last_fullsized":"2024-09-12T00:58:29.201979+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:00.758192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.184304+0000","last_change":"2024-09-12T00:32:28.066072+0000","last_active":"2024-09-12T00:59:33.184304+0000","last_peered":"2024-09-12T00:59:33.184304+0000","last_clean":"2024-09-12T00:59:33.184304+0000","last_became_active":"2024-09-12T00:32:28.065320+0000","last_became_peered":"2024-09-12T00:32:28.065320+0000","last_unstale":"2024-09-12T00:59:33.184304+0000","last_undegraded":"2024-09-12T00:59:33.184304+0000","last_fullsized":"2024-09-12T00:59:33.184304+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:36.535395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'3","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185073+0000","last_change":"2024-09-12T00:32:25.017231+0000","last_active":"2024-09-12T00:59:33.185073+0000","last_peered":"2024-09-12T00:59:33.185073+0000","last_clean":"2024-09-12T00:59:33.185073+0000","last_became_active":"2024-09-12T00:32:25.013266+0000","last_became_peered":"2024-09-12T00:32:25.013266+0000","last_unstale":"2024-09-12T00:59:33.185073+0000","last_undegraded":"2024-09-12T00:59:33.185073+0000","last_fullsized":"2024-09-12T00:59:33.185073+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:11.615304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"268'15","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.177113+0000","last_change":"2024-09-12T00:30:51.560130+0000","last_active":"2024-09-12T00:59:03.177113+0000","last_peered":"2024-09-12T00:59:03.177113+0000","last_clean":"2024-09-12T00:59:03.177113+0000","last_became_active":"2024-09-12T00:30:51.559445+0000","last_became_peered":"2024-09-12T00:30:51.559445+0000","last_unstale":"2024-09-12T00:59:03.177113+0000","last_undegraded":"2024-09-12T00:59:03.177113+0000","last_fullsized":"2024-09-12T00:59:03.177113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:54.936785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"268'329","reported_seq":1086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.903151+0000","last_change":"2024-09-12T00:15:55.079016+0000","last_active":"2024-09-12T01:02:37.903151+0000","last_peered":"2024-09-12T01:02:37.903151+0000","last_clean":"2024-09-12T01:02:37.903151+0000","last_became_active":"2024-09-12T00:15:55.078687+0000","last_became_peered":"2024-09-12T00:15:55.078687+0000","last_unstale":"2024-09-12T01:02:37.903151+0000","last_undegraded":"2024-09-12T01:02:37.903151+0000","last_fullsized":"2024-09-12T01:02:37.903151+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:29.403023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340543,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":728,"num_read_kb":39834,"num_write":1219,"num_write_kb":26442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"268'857","reported_seq":2605,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.866154+0000","last_change":"2024-09-12T00:15:57.022290+0000","last_active":"2024-09-12T01:02:10.866154+0000","last_peered":"2024-09-12T01:02:10.866154+0000","last_clean":"2024-09-12T01:02:10.866154+0000","last_became_active":"2024-09-12T00:15:57.021927+0000","last_became_peered":"2024-09-12T00:15:57.021927+0000","last_unstale":"2024-09-12T01:02:10.866154+0000","last_undegraded":"2024-09-12T01:02:10.866154+0000","last_fullsized":"2024-09-12T01:02:10.866154+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:27.786130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4184,"num_read_kb":3812,"num_write":1107,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"268'331","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:26.529497+0000","last_change":"2024-09-12T00:15:55.075731+0000","last_active":"2024-09-12T01:00:26.529497+0000","last_peered":"2024-09-12T01:00:26.529497+0000","last_clean":"2024-09-12T01:00:26.529497+0000","last_became_active":"2024-09-12T00:15:55.075108+0000","last_became_peered":"2024-09-12T00:15:55.075108+0000","last_unstale":"2024-09-12T01:00:26.529497+0000","last_undegraded":"2024-09-12T01:00:26.529497+0000","last_fullsized":"2024-09-12T01:00:26.529497+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:53.644639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1697815,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":553,"num_read_kb":2161,"num_write":1163,"num_write_kb":32030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"268'541","reported_seq":2172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.146646+0000","last_change":"2024-09-12T00:15:57.022914+0000","last_active":"2024-09-12T01:01:02.146646+0000","last_peered":"2024-09-12T01:01:02.146646+0000","last_clean":"2024-09-12T01:01:02.146646+0000","last_became_active":"2024-09-12T00:15:57.022465+0000","last_became_peered":"2024-09-12T00:15:57.022465+0000","last_unstale":"2024-09-12T01:01:02.146646+0000","last_undegraded":"2024-09-12T01:01:02.146646+0000","last_fullsized":"2024-09-12T01:01:02.146646+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:22.255065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2758,"num_read_kb":2563,"num_write":657,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"268'324","reported_seq":1059,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:45.712992+0000","last_change":"2024-09-12T00:15:55.042888+0000","last_active":"2024-09-12T00:59:45.712992+0000","last_peered":"2024-09-12T00:59:45.712992+0000","last_clean":"2024-09-12T00:59:45.712992+0000","last_became_active":"2024-09-12T00:15:55.041491+0000","last_became_peered":"2024-09-12T00:15:55.041491+0000","last_unstale":"2024-09-12T00:59:45.712992+0000","last_undegraded":"2024-09-12T00:59:45.712992+0000","last_fullsized":"2024-09-12T00:59:45.712992+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:29.522820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8843817,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":766,"num_read_kb":4160,"num_write":1203,"num_write_kb":14348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"268'1145","reported_seq":2779,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:59.004596+0000","last_change":"2024-09-12T00:15:57.023106+0000","last_active":"2024-09-12T01:00:59.004596+0000","last_peered":"2024-09-12T01:00:59.004596+0000","last_clean":"2024-09-12T01:00:59.004596+0000","last_became_active":"2024-09-12T00:15:57.022692+0000","last_became_peered":"2024-09-12T00:15:57.022692+0000","last_unstale":"2024-09-12T01:00:59.004596+0000","last_undegraded":"2024-09-12T01:00:59.004596+0000","last_fullsized":"2024-09-12T01:00:59.004596+0000","mapping_epoch":28,"log_start":"268'1100","ondisk_log_start":"268'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":1100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:01.909120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5291,"num_read_kb":4702,"num_write":1570,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"268'355","reported_seq":1038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.154562+0000","last_change":"2024-09-12T00:15:55.046149+0000","last_active":"2024-09-12T01:02:38.154562+0000","last_peered":"2024-09-12T01:02:38.154562+0000","last_clean":"2024-09-12T01:02:38.154562+0000","last_became_active":"2024-09-12T00:15:55.045668+0000","last_became_peered":"2024-09-12T00:15:55.045668+0000","last_unstale":"2024-09-12T01:02:38.154562+0000","last_undegraded":"2024-09-12T01:02:38.154562+0000","last_fullsized":"2024-09-12T01:02:38.154562+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:25.710871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1414102,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":630,"num_read_kb":47789,"num_write":1261,"num_write_kb":53743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"268'567","reported_seq":2201,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506437+0000","last_change":"2024-09-12T00:15:57.019605+0000","last_active":"2024-09-12T01:01:09.506437+0000","last_peered":"2024-09-12T01:01:09.506437+0000","last_clean":"2024-09-12T01:01:09.506437+0000","last_became_active":"2024-09-12T00:15:57.018762+0000","last_became_peered":"2024-09-12T00:15:57.018762+0000","last_unstale":"2024-09-12T01:01:09.506437+0000","last_undegraded":"2024-09-12T01:01:09.506437+0000","last_fullsized":"2024-09-12T01:01:09.506437+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:00.744230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2864,"num_read_kb":2646,"num_write":693,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"268'320","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.001737+0000","last_change":"2024-09-12T00:15:55.072012+0000","last_active":"2024-09-12T01:02:38.001737+0000","last_peered":"2024-09-12T01:02:38.001737+0000","last_clean":"2024-09-12T01:02:38.001737+0000","last_became_active":"2024-09-12T00:15:55.071352+0000","last_became_peered":"2024-09-12T00:15:55.071352+0000","last_unstale":"2024-09-12T01:02:38.001737+0000","last_undegraded":"2024-09-12T01:02:38.001737+0000","last_fullsized":"2024-09-12T01:02:38.001737+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:19.609544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9193056,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":447,"num_read_kb":19398,"num_write":1094,"num_write_kb":53254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"268'458","reported_seq":2076,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:45.897964+0000","last_change":"2024-09-12T00:15:57.052282+0000","last_active":"2024-09-12T01:00:45.897964+0000","last_peered":"2024-09-12T01:00:45.897964+0000","last_clean":"2024-09-12T01:00:45.897964+0000","last_became_active":"2024-09-12T00:15:57.051973+0000","last_became_peered":"2024-09-12T00:15:57.051973+0000","last_unstale":"2024-09-12T01:00:45.897964+0000","last_undegraded":"2024-09-12T01:00:45.897964+0000","last_fullsized":"2024-09-12T01:00:45.897964+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:51.721224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":2348,"num_write":528,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"268'308","reported_seq":948,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.132717+0000","last_change":"2024-09-12T00:15:55.067779+0000","last_active":"2024-09-12T01:02:38.132717+0000","last_peered":"2024-09-12T01:02:38.132717+0000","last_clean":"2024-09-12T01:02:38.132717+0000","last_became_active":"2024-09-12T00:15:55.067030+0000","last_became_peered":"2024-09-12T00:15:55.067030+0000","last_unstale":"2024-09-12T01:02:38.132717+0000","last_undegraded":"2024-09-12T01:02:38.132717+0000","last_fullsized":"2024-09-12T01:02:38.132717+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:15.471567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5268077,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":455,"num_read_kb":33079,"num_write":975,"num_write_kb":28183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"268'485","reported_seq":2072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.168505+0000","last_change":"2024-09-12T00:15:57.037419+0000","last_active":"2024-09-12T01:00:52.168505+0000","last_peered":"2024-09-12T01:00:52.168505+0000","last_clean":"2024-09-12T01:00:52.168505+0000","last_became_active":"2024-09-12T00:15:57.037045+0000","last_became_peered":"2024-09-12T00:15:57.037045+0000","last_unstale":"2024-09-12T01:00:52.168505+0000","last_undegraded":"2024-09-12T01:00:52.168505+0000","last_fullsized":"2024-09-12T01:00:52.168505+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:10.231756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2556,"num_read_kb":2389,"num_write":592,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"268'316","reported_seq":1047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.002382+0000","last_change":"2024-09-12T00:15:55.050401+0000","last_active":"2024-09-12T01:02:38.002382+0000","last_peered":"2024-09-12T01:02:38.002382+0000","last_clean":"2024-09-12T01:02:38.002382+0000","last_became_active":"2024-09-12T00:15:55.041976+0000","last_became_peered":"2024-09-12T00:15:55.041976+0000","last_unstale":"2024-09-12T01:02:38.002382+0000","last_undegraded":"2024-09-12T01:02:38.002382+0000","last_fullsized":"2024-09-12T01:02:38.002382+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:30.850752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7623121,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":613,"num_read_kb":92016,"num_write":1157,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"268'476","reported_seq":1929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506328+0000","last_change":"2024-09-12T00:15:57.013582+0000","last_active":"2024-09-12T01:01:09.506328+0000","last_peered":"2024-09-12T01:01:09.506328+0000","last_clean":"2024-09-12T01:01:09.506328+0000","last_became_active":"2024-09-12T00:15:57.013278+0000","last_became_peered":"2024-09-12T00:15:57.013278+0000","last_unstale":"2024-09-12T01:01:09.506328+0000","last_undegraded":"2024-09-12T01:01:09.506328+0000","last_fullsized":"2024-09-12T01:01:09.506328+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:44.317982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2343,"num_read_kb":2167,"num_write":566,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"268'243","reported_seq":890,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:38.129605+0000","last_change":"2024-09-12T00:15:55.070693+0000","last_active":"2024-09-12T01:00:38.129605+0000","last_peered":"2024-09-12T01:00:38.129605+0000","last_clean":"2024-09-12T01:00:38.129605+0000","last_became_active":"2024-09-12T00:15:55.060127+0000","last_became_peered":"2024-09-12T00:15:55.060127+0000","last_unstale":"2024-09-12T01:00:38.129605+0000","last_undegraded":"2024-09-12T01:00:38.129605+0000","last_fullsized":"2024-09-12T01:00:38.129605+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:18.762399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11570671,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":394,"num_read_kb":41433,"num_write":830,"num_write_kb":44478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"268'983","reported_seq":2514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:48.416472+0000","last_change":"2024-09-12T00:15:57.052355+0000","last_active":"2024-09-12T01:00:48.416472+0000","last_peered":"2024-09-12T01:00:48.416472+0000","last_clean":"2024-09-12T01:00:48.416472+0000","last_became_active":"2024-09-12T00:15:57.051665+0000","last_became_peered":"2024-09-12T00:15:57.051665+0000","last_unstale":"2024-09-12T01:00:48.416472+0000","last_undegraded":"2024-09-12T01:00:48.416472+0000","last_fullsized":"2024-09-12T01:00:48.416472+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":900,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:20.500797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4673,"num_read_kb":4124,"num_write":1393,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"268'888","reported_seq":2500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.446445+0000","last_change":"2024-09-12T00:15:57.032298+0000","last_active":"2024-09-12T01:01:06.446445+0000","last_peered":"2024-09-12T01:01:06.446445+0000","last_clean":"2024-09-12T01:01:06.446445+0000","last_became_active":"2024-09-12T00:15:57.031897+0000","last_became_peered":"2024-09-12T00:15:57.031897+0000","last_unstale":"2024-09-12T01:01:06.446445+0000","last_undegraded":"2024-09-12T01:01:06.446445+0000","last_fullsized":"2024-09-12T01:01:06.446445+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:00.128491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4303,"num_read_kb":3853,"num_write":1201,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"268'277","reported_seq":897,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.211770+0000","last_change":"2024-09-12T00:15:55.064283+0000","last_active":"2024-09-12T01:02:38.211770+0000","last_peered":"2024-09-12T01:02:38.211770+0000","last_clean":"2024-09-12T01:02:38.211770+0000","last_became_active":"2024-09-12T00:15:55.063797+0000","last_became_peered":"2024-09-12T00:15:55.063797+0000","last_unstale":"2024-09-12T01:02:38.211770+0000","last_undegraded":"2024-09-12T01:02:38.211770+0000","last_fullsized":"2024-09-12T01:02:38.211770+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:33.806593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":384,"num_read_kb":7341,"num_write":959,"num_write_kb":14342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"268'782","reported_seq":2212,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.159774+0000","last_change":"2024-09-12T00:15:57.017929+0000","last_active":"2024-09-12T01:01:02.159774+0000","last_peered":"2024-09-12T01:01:02.159774+0000","last_clean":"2024-09-12T01:01:02.159774+0000","last_became_active":"2024-09-12T00:15:57.017679+0000","last_became_peered":"2024-09-12T00:15:57.017679+0000","last_unstale":"2024-09-12T01:01:02.159774+0000","last_undegraded":"2024-09-12T01:01:02.159774+0000","last_fullsized":"2024-09-12T01:01:02.159774+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:58.830951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3571,"num_read_kb":3210,"num_write":1015,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"268'311","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:06.388977+0000","last_change":"2024-09-12T00:16:26.796331+0000","last_active":"2024-09-12T01:02:06.388977+0000","last_peered":"2024-09-12T01:02:06.388977+0000","last_clean":"2024-09-12T01:02:06.388977+0000","last_became_active":"2024-09-12T00:16:26.794438+0000","last_became_peered":"2024-09-12T00:16:26.794438+0000","last_unstale":"2024-09-12T01:02:06.388977+0000","last_undegraded":"2024-09-12T01:02:06.388977+0000","last_fullsized":"2024-09-12T01:02:06.388977+0000","mapping_epoch":39,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:59.877909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10798736,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":569,"num_read_kb":170107,"num_write":1067,"num_write_kb":45359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,6],"acting":[5,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"268'412","reported_seq":1882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:02.267039+0000","last_change":"2024-09-12T00:15:57.039877+0000","last_active":"2024-09-12T01:00:02.267039+0000","last_peered":"2024-09-12T01:00:02.267039+0000","last_clean":"2024-09-12T01:00:02.267039+0000","last_became_active":"2024-09-12T00:15:57.039474+0000","last_became_peered":"2024-09-12T00:15:57.039474+0000","last_unstale":"2024-09-12T01:00:02.267039+0000","last_undegraded":"2024-09-12T01:00:02.267039+0000","last_fullsized":"2024-09-12T01:00:02.267039+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:19.030086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2320,"num_read_kb":2162,"num_write":506,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"268'292","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.959693+0000","last_change":"2024-09-12T00:15:55.066310+0000","last_active":"2024-09-12T01:02:37.959693+0000","last_peered":"2024-09-12T01:02:37.959693+0000","last_clean":"2024-09-12T01:02:37.959693+0000","last_became_active":"2024-09-12T00:15:55.060170+0000","last_became_peered":"2024-09-12T00:15:55.060170+0000","last_unstale":"2024-09-12T01:02:37.959693+0000","last_undegraded":"2024-09-12T01:02:37.959693+0000","last_fullsized":"2024-09-12T01:02:37.959693+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:43.105768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310581,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":576,"num_read_kb":11665,"num_write":1024,"num_write_kb":19684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"268'454","reported_seq":2050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.869036+0000","last_change":"2024-09-12T00:15:57.044727+0000","last_active":"2024-09-12T01:02:10.869036+0000","last_peered":"2024-09-12T01:02:10.869036+0000","last_clean":"2024-09-12T01:02:10.869036+0000","last_became_active":"2024-09-12T00:15:57.044075+0000","last_became_peered":"2024-09-12T00:15:57.044075+0000","last_unstale":"2024-09-12T01:02:10.869036+0000","last_undegraded":"2024-09-12T01:02:10.869036+0000","last_fullsized":"2024-09-12T01:02:10.869036+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:10.231756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2345,"num_read_kb":2229,"num_write":503,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"268'320","reported_seq":1026,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.878031+0000","last_change":"2024-09-12T00:15:55.078923+0000","last_active":"2024-09-12T01:02:37.878031+0000","last_peered":"2024-09-12T01:02:37.878031+0000","last_clean":"2024-09-12T01:02:37.878031+0000","last_became_active":"2024-09-12T00:15:55.078352+0000","last_became_peered":"2024-09-12T00:15:55.078352+0000","last_unstale":"2024-09-12T01:02:37.878031+0000","last_undegraded":"2024-09-12T01:02:37.878031+0000","last_fullsized":"2024-09-12T01:02:37.878031+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:20.005373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3368728,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":620,"num_read_kb":46871,"num_write":1157,"num_write_kb":28820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"268'399","reported_seq":1872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.865538+0000","last_change":"2024-09-12T00:15:57.032920+0000","last_active":"2024-09-12T01:02:10.865538+0000","last_peered":"2024-09-12T01:02:10.865538+0000","last_clean":"2024-09-12T01:02:10.865538+0000","last_became_active":"2024-09-12T00:15:57.032173+0000","last_became_peered":"2024-09-12T00:15:57.032173+0000","last_unstale":"2024-09-12T01:02:10.865538+0000","last_undegraded":"2024-09-12T01:02:10.865538+0000","last_fullsized":"2024-09-12T01:02:10.865538+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:23.061664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2107,"num_read_kb":2010,"num_write":461,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"268'306","reported_seq":1029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.083676+0000","last_change":"2024-09-12T00:15:55.067201+0000","last_active":"2024-09-12T01:02:38.083676+0000","last_peered":"2024-09-12T01:02:38.083676+0000","last_clean":"2024-09-12T01:02:38.083676+0000","last_became_active":"2024-09-12T00:15:55.066304+0000","last_became_peered":"2024-09-12T00:15:55.066304+0000","last_unstale":"2024-09-12T01:02:38.083676+0000","last_undegraded":"2024-09-12T01:02:38.083676+0000","last_fullsized":"2024-09-12T01:02:38.083676+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:31.298321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22043280,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":627,"num_read_kb":58379,"num_write":1099,"num_write_kb":49764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"268'1197","reported_seq":3218,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506270+0000","last_change":"2024-09-12T00:15:57.021981+0000","last_active":"2024-09-12T01:01:09.506270+0000","last_peered":"2024-09-12T01:01:09.506270+0000","last_clean":"2024-09-12T01:01:09.506270+0000","last_became_active":"2024-09-12T00:15:57.021605+0000","last_became_peered":"2024-09-12T00:15:57.021605+0000","last_unstale":"2024-09-12T01:01:09.506270+0000","last_undegraded":"2024-09-12T01:01:09.506270+0000","last_fullsized":"2024-09-12T01:01:09.506270+0000","mapping_epoch":28,"log_start":"268'1100","ondisk_log_start":"268'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":1100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:38.616266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6433,"num_read_kb":5744,"num_write":1768,"num_write_kb":831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"268'263","reported_seq":894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.168707+0000","last_change":"2024-09-12T00:15:55.052710+0000","last_active":"2024-09-12T01:02:38.168707+0000","last_peered":"2024-09-12T01:02:38.168707+0000","last_clean":"2024-09-12T01:02:38.168707+0000","last_became_active":"2024-09-12T00:15:55.050860+0000","last_became_peered":"2024-09-12T00:15:55.050860+0000","last_unstale":"2024-09-12T01:02:38.168707+0000","last_undegraded":"2024-09-12T01:02:38.168707+0000","last_fullsized":"2024-09-12T01:02:38.168707+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:08.086426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439086,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":436,"num_read_kb":8796,"num_write":947,"num_write_kb":26056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"268'150","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.320340+0000","last_change":"2024-09-12T00:16:05.096232+0000","last_active":"2024-09-12T01:01:07.320340+0000","last_peered":"2024-09-12T01:01:07.320340+0000","last_clean":"2024-09-12T01:01:07.320340+0000","last_became_active":"2024-09-12T00:16:05.095632+0000","last_became_peered":"2024-09-12T00:16:05.095632+0000","last_unstale":"2024-09-12T01:01:07.320340+0000","last_undegraded":"2024-09-12T01:01:07.320340+0000","last_fullsized":"2024-09-12T01:01:07.320340+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:47.445460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":139,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"268'388","reported_seq":1858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.446472+0000","last_change":"2024-09-12T00:15:57.044606+0000","last_active":"2024-09-12T01:01:06.446472+0000","last_peered":"2024-09-12T01:01:06.446472+0000","last_clean":"2024-09-12T01:01:06.446472+0000","last_became_active":"2024-09-12T00:15:57.042317+0000","last_became_peered":"2024-09-12T00:15:57.042317+0000","last_unstale":"2024-09-12T01:01:06.446472+0000","last_undegraded":"2024-09-12T01:01:06.446472+0000","last_fullsized":"2024-09-12T01:01:06.446472+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:47.707278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2080,"num_read_kb":1982,"num_write":441,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"268'334","reported_seq":983,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.611122+0000","last_change":"2024-09-12T00:15:55.043571+0000","last_active":"2024-09-12T01:02:38.611122+0000","last_peered":"2024-09-12T01:02:38.611122+0000","last_clean":"2024-09-12T01:02:38.611122+0000","last_became_active":"2024-09-12T00:15:55.042690+0000","last_became_peered":"2024-09-12T00:15:55.042690+0000","last_unstale":"2024-09-12T01:02:38.611122+0000","last_undegraded":"2024-09-12T01:02:38.611122+0000","last_fullsized":"2024-09-12T01:02:38.611122+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:22.575508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288790,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":506,"num_read_kb":60082,"num_write":1091,"num_write_kb":36322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219465+0000","last_change":"2024-09-12T00:15:59.047089+0000","last_active":"2024-09-12T00:59:29.219465+0000","last_peered":"2024-09-12T00:59:29.219465+0000","last_clean":"2024-09-12T00:59:29.219465+0000","last_became_active":"2024-09-12T00:15:59.046334+0000","last_became_peered":"2024-09-12T00:15:59.046334+0000","last_unstale":"2024-09-12T00:59:29.219465+0000","last_undegraded":"2024-09-12T00:59:29.219465+0000","last_fullsized":"2024-09-12T00:59:29.219465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:50.471898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"268'355","reported_seq":970,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.995930+0000","last_change":"2024-09-12T00:16:01.058485+0000","last_active":"2024-09-12T01:02:11.995930+0000","last_peered":"2024-09-12T01:02:11.995930+0000","last_clean":"2024-09-12T01:02:11.995930+0000","last_became_active":"2024-09-12T00:16:01.057657+0000","last_became_peered":"2024-09-12T00:16:01.057657+0000","last_unstale":"2024-09-12T01:02:11.995930+0000","last_undegraded":"2024-09-12T01:02:11.995930+0000","last_fullsized":"2024-09-12T01:02:11.995930+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:28.536472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62439,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":587,"num_read_kb":1145,"num_write":476,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185238+0000","last_change":"2024-09-12T00:16:03.099188+0000","last_active":"2024-09-12T00:59:33.185238+0000","last_peered":"2024-09-12T00:59:33.185238+0000","last_clean":"2024-09-12T00:59:33.185238+0000","last_became_active":"2024-09-12T00:16:03.098506+0000","last_became_peered":"2024-09-12T00:16:03.098506+0000","last_unstale":"2024-09-12T00:59:33.185238+0000","last_undegraded":"2024-09-12T00:59:33.185238+0000","last_fullsized":"2024-09-12T00:59:33.185238+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:09.926077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"268'152","reported_seq":715,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.258951+0000","last_change":"2024-09-12T00:16:05.105689+0000","last_active":"2024-09-12T01:01:02.258951+0000","last_peered":"2024-09-12T01:01:02.258951+0000","last_clean":"2024-09-12T01:01:02.258951+0000","last_became_active":"2024-09-12T00:16:05.105153+0000","last_became_peered":"2024-09-12T00:16:05.105153+0000","last_unstale":"2024-09-12T01:01:02.258951+0000","last_undegraded":"2024-09-12T01:01:02.258951+0000","last_fullsized":"2024-09-12T01:01:02.258951+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:12.364784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":214,"num_write":299,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"268'897","reported_seq":2521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.015147+0000","last_change":"2024-09-12T00:15:57.018776+0000","last_active":"2024-09-12T01:00:47.015147+0000","last_peered":"2024-09-12T01:00:47.015147+0000","last_clean":"2024-09-12T01:00:47.015147+0000","last_became_active":"2024-09-12T00:15:57.018484+0000","last_became_peered":"2024-09-12T00:15:57.018484+0000","last_unstale":"2024-09-12T01:00:47.015147+0000","last_undegraded":"2024-09-12T01:00:47.015147+0000","last_fullsized":"2024-09-12T01:00:47.015147+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":800,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:46.467646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4265,"num_read_kb":3809,"num_write":1199,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"268'332","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.188512+0000","last_change":"2024-09-12T00:15:55.067220+0000","last_active":"2024-09-12T01:02:38.188512+0000","last_peered":"2024-09-12T01:02:38.188512+0000","last_clean":"2024-09-12T01:02:38.188512+0000","last_became_active":"2024-09-12T00:15:55.065476+0000","last_became_peered":"2024-09-12T00:15:55.065476+0000","last_unstale":"2024-09-12T01:02:38.188512+0000","last_undegraded":"2024-09-12T01:02:38.188512+0000","last_fullsized":"2024-09-12T01:02:38.188512+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:58.771415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428686,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":548,"num_read_kb":7666,"num_write":1188,"num_write_kb":15378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:13.159333+0000","last_change":"2024-09-12T00:15:59.041196+0000","last_active":"2024-09-12T00:58:13.159333+0000","last_peered":"2024-09-12T00:58:13.159333+0000","last_clean":"2024-09-12T00:58:13.159333+0000","last_became_active":"2024-09-12T00:15:59.040412+0000","last_became_peered":"2024-09-12T00:15:59.040412+0000","last_unstale":"2024-09-12T00:58:13.159333+0000","last_undegraded":"2024-09-12T00:58:13.159333+0000","last_fullsized":"2024-09-12T00:58:13.159333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:37.117865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"268'89","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:59.917462+0000","last_change":"2024-09-12T00:16:01.067472+0000","last_active":"2024-09-12T00:59:59.917462+0000","last_peered":"2024-09-12T00:59:59.917462+0000","last_clean":"2024-09-12T00:59:59.917462+0000","last_became_active":"2024-09-12T00:16:01.062780+0000","last_became_peered":"2024-09-12T00:16:01.062780+0000","last_unstale":"2024-09-12T00:59:59.917462+0000","last_undegraded":"2024-09-12T00:59:59.917462+0000","last_fullsized":"2024-09-12T00:59:59.917462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:25.299928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185153+0000","last_change":"2024-09-12T00:16:03.092617+0000","last_active":"2024-09-12T00:59:33.185153+0000","last_peered":"2024-09-12T00:59:33.185153+0000","last_clean":"2024-09-12T00:59:33.185153+0000","last_became_active":"2024-09-12T00:16:03.091926+0000","last_became_peered":"2024-09-12T00:16:03.091926+0000","last_unstale":"2024-09-12T00:59:33.185153+0000","last_undegraded":"2024-09-12T00:59:33.185153+0000","last_fullsized":"2024-09-12T00:59:33.185153+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:35.129510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"268'125","reported_seq":621,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:05.844320+0000","last_change":"2024-09-12T00:16:05.115080+0000","last_active":"2024-09-12T01:01:05.844320+0000","last_peered":"2024-09-12T01:01:05.844320+0000","last_clean":"2024-09-12T01:01:05.844320+0000","last_became_active":"2024-09-12T00:16:05.114182+0000","last_became_peered":"2024-09-12T00:16:05.114182+0000","last_unstale":"2024-09-12T01:01:05.844320+0000","last_undegraded":"2024-09-12T01:01:05.844320+0000","last_fullsized":"2024-09-12T01:01:05.844320+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:12.382388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":293,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"268'1230","reported_seq":2685,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.015822+0000","last_change":"2024-09-12T00:15:57.047647+0000","last_active":"2024-09-12T01:00:47.015822+0000","last_peered":"2024-09-12T01:00:47.015822+0000","last_clean":"2024-09-12T01:00:47.015822+0000","last_became_active":"2024-09-12T00:15:57.046916+0000","last_became_peered":"2024-09-12T00:15:57.046916+0000","last_unstale":"2024-09-12T01:00:47.015822+0000","last_undegraded":"2024-09-12T01:00:47.015822+0000","last_fullsized":"2024-09-12T01:00:47.015822+0000","mapping_epoch":28,"log_start":"268'1200","ondisk_log_start":"268'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:00.710335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5641,"num_read_kb":4945,"num_write":1755,"num_write_kb":746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"268'341","reported_seq":1125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.683511+0000","last_change":"2024-09-12T00:15:55.064793+0000","last_active":"2024-09-12T01:02:38.683511+0000","last_peered":"2024-09-12T01:02:38.683511+0000","last_clean":"2024-09-12T01:02:38.683511+0000","last_became_active":"2024-09-12T00:15:55.058428+0000","last_became_peered":"2024-09-12T00:15:55.058428+0000","last_unstale":"2024-09-12T01:02:38.683511+0000","last_undegraded":"2024-09-12T01:02:38.683511+0000","last_fullsized":"2024-09-12T01:02:38.683511+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:12.660366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1929,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":684,"num_read_kb":690,"num_write":1219,"num_write_kb":29311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179931+0000","last_change":"2024-09-12T00:15:59.040242+0000","last_active":"2024-09-12T00:59:33.179931+0000","last_peered":"2024-09-12T00:59:33.179931+0000","last_clean":"2024-09-12T00:59:33.179931+0000","last_became_active":"2024-09-12T00:15:59.039465+0000","last_became_peered":"2024-09-12T00:15:59.039465+0000","last_unstale":"2024-09-12T00:59:33.179931+0000","last_undegraded":"2024-09-12T00:59:33.179931+0000","last_fullsized":"2024-09-12T00:59:33.179931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:02.272155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"268'130","reported_seq":681,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:22.544313+0000","last_change":"2024-09-12T00:16:01.057413+0000","last_active":"2024-09-12T00:59:22.544313+0000","last_peered":"2024-09-12T00:59:22.544313+0000","last_clean":"2024-09-12T00:59:22.544313+0000","last_became_active":"2024-09-12T00:16:01.056702+0000","last_became_peered":"2024-09-12T00:16:01.056702+0000","last_unstale":"2024-09-12T00:59:22.544313+0000","last_undegraded":"2024-09-12T00:59:22.544313+0000","last_fullsized":"2024-09-12T00:59:22.544313+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:41.238549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":144,"num_read_kb":136,"num_write":100,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"268'799","reported_seq":2222,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.130042+0000","last_change":"2024-09-12T00:16:03.104735+0000","last_active":"2024-09-12T01:02:37.130042+0000","last_peered":"2024-09-12T01:02:37.130042+0000","last_clean":"2024-09-12T01:02:37.130042+0000","last_became_active":"2024-09-12T00:16:03.103292+0000","last_became_peered":"2024-09-12T00:16:03.103292+0000","last_unstale":"2024-09-12T01:02:37.130042+0000","last_undegraded":"2024-09-12T01:02:37.130042+0000","last_fullsized":"2024-09-12T01:02:37.130042+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:21.322414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"268'234","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.369432+0000","last_change":"2024-09-12T00:16:05.108369+0000","last_active":"2024-09-12T01:01:07.369432+0000","last_peered":"2024-09-12T01:01:07.369432+0000","last_clean":"2024-09-12T01:01:07.369432+0000","last_became_active":"2024-09-12T00:16:05.107785+0000","last_became_peered":"2024-09-12T00:16:05.107785+0000","last_unstale":"2024-09-12T01:01:07.369432+0000","last_undegraded":"2024-09-12T01:01:07.369432+0000","last_fullsized":"2024-09-12T01:01:07.369432+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:30.275724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":637,"num_write":534,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"268'635","reported_seq":2161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.998760+0000","last_change":"2024-09-12T00:15:57.036539+0000","last_active":"2024-09-12T01:00:39.998760+0000","last_peered":"2024-09-12T01:00:39.998760+0000","last_clean":"2024-09-12T01:00:39.998760+0000","last_became_active":"2024-09-12T00:15:57.035581+0000","last_became_peered":"2024-09-12T00:15:57.035581+0000","last_unstale":"2024-09-12T01:00:39.998760+0000","last_undegraded":"2024-09-12T01:00:39.998760+0000","last_fullsized":"2024-09-12T01:00:39.998760+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":600,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:01.577455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3178,"num_read_kb":2956,"num_write":875,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"268'297","reported_seq":963,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.184044+0000","last_change":"2024-09-12T00:15:55.065992+0000","last_active":"2024-09-12T01:02:38.184044+0000","last_peered":"2024-09-12T01:02:38.184044+0000","last_clean":"2024-09-12T01:02:38.184044+0000","last_became_active":"2024-09-12T00:15:55.065178+0000","last_became_peered":"2024-09-12T00:15:55.065178+0000","last_unstale":"2024-09-12T01:02:38.184044+0000","last_undegraded":"2024-09-12T01:02:38.184044+0000","last_fullsized":"2024-09-12T01:02:38.184044+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:42.418779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289383,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":528,"num_read_kb":563,"num_write":1100,"num_write_kb":21852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219511+0000","last_change":"2024-09-12T00:15:59.040434+0000","last_active":"2024-09-12T00:59:29.219511+0000","last_peered":"2024-09-12T00:59:29.219511+0000","last_clean":"2024-09-12T00:59:29.219511+0000","last_became_active":"2024-09-12T00:15:59.039902+0000","last_became_peered":"2024-09-12T00:15:59.039902+0000","last_unstale":"2024-09-12T00:59:29.219511+0000","last_undegraded":"2024-09-12T00:59:29.219511+0000","last_fullsized":"2024-09-12T00:59:29.219511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:50.427091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"268'275","reported_seq":842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.981756+0000","last_change":"2024-09-12T00:16:01.053456+0000","last_active":"2024-09-12T01:02:11.981756+0000","last_peered":"2024-09-12T01:02:11.981756+0000","last_clean":"2024-09-12T01:02:11.981756+0000","last_became_active":"2024-09-12T00:16:01.052744+0000","last_became_peered":"2024-09-12T00:16:01.052744+0000","last_unstale":"2024-09-12T01:02:11.981756+0000","last_undegraded":"2024-09-12T01:02:11.981756+0000","last_fullsized":"2024-09-12T01:02:11.981756+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:17.018417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56108,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":935,"num_write":372,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"268'810","reported_seq":2455,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.078335+0000","last_change":"2024-09-12T00:16:03.098659+0000","last_active":"2024-09-12T01:02:12.078335+0000","last_peered":"2024-09-12T01:02:12.078335+0000","last_clean":"2024-09-12T01:02:12.078335+0000","last_became_active":"2024-09-12T00:16:03.097895+0000","last_became_peered":"2024-09-12T00:16:03.097895+0000","last_unstale":"2024-09-12T01:02:12.078335+0000","last_undegraded":"2024-09-12T01:02:12.078335+0000","last_fullsized":"2024-09-12T01:02:12.078335+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:25.934943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"268'458","reported_seq":2011,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.582816+0000","last_change":"2024-09-12T00:15:57.023912+0000","last_active":"2024-09-12T01:01:09.582816+0000","last_peered":"2024-09-12T01:01:09.582816+0000","last_clean":"2024-09-12T01:01:09.582816+0000","last_became_active":"2024-09-12T00:15:57.023659+0000","last_became_peered":"2024-09-12T00:15:57.023659+0000","last_unstale":"2024-09-12T01:01:09.582816+0000","last_undegraded":"2024-09-12T01:01:09.582816+0000","last_fullsized":"2024-09-12T01:01:09.582816+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:02.798248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2457,"num_read_kb":2306,"num_write":563,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"268'329","reported_seq":960,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.004795+0000","last_change":"2024-09-12T00:15:55.066577+0000","last_active":"2024-09-12T01:02:38.004795+0000","last_peered":"2024-09-12T01:02:38.004795+0000","last_clean":"2024-09-12T01:02:38.004795+0000","last_became_active":"2024-09-12T00:15:55.060679+0000","last_became_peered":"2024-09-12T00:15:55.060679+0000","last_unstale":"2024-09-12T01:02:38.004795+0000","last_undegraded":"2024-09-12T01:02:38.004795+0000","last_fullsized":"2024-09-12T01:02:38.004795+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:10.882193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39798,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":438,"num_read_kb":16773,"num_write":1098,"num_write_kb":29370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:23.182560+0000","last_change":"2024-09-12T00:15:59.035705+0000","last_active":"2024-09-12T00:59:23.182560+0000","last_peered":"2024-09-12T00:59:23.182560+0000","last_clean":"2024-09-12T00:59:23.182560+0000","last_became_active":"2024-09-12T00:15:59.035288+0000","last_became_peered":"2024-09-12T00:15:59.035288+0000","last_unstale":"2024-09-12T00:59:23.182560+0000","last_undegraded":"2024-09-12T00:59:23.182560+0000","last_fullsized":"2024-09-12T00:59:23.182560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:46.726241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"268'349","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.443258+0000","last_change":"2024-09-12T00:16:01.070645+0000","last_active":"2024-09-12T01:02:37.443258+0000","last_peered":"2024-09-12T01:02:37.443258+0000","last_clean":"2024-09-12T01:02:37.443258+0000","last_became_active":"2024-09-12T00:16:01.069838+0000","last_became_peered":"2024-09-12T00:16:01.069838+0000","last_unstale":"2024-09-12T01:02:37.443258+0000","last_undegraded":"2024-09-12T01:02:37.443258+0000","last_fullsized":"2024-09-12T01:02:37.443258+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:57.640957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45025,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":563,"num_read_kb":1131,"num_write":438,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.162032+0000","last_change":"2024-09-12T00:16:03.090231+0000","last_active":"2024-09-12T00:58:48.162032+0000","last_peered":"2024-09-12T00:58:48.162032+0000","last_clean":"2024-09-12T00:58:48.162032+0000","last_became_active":"2024-09-12T00:16:03.089533+0000","last_became_peered":"2024-09-12T00:16:03.089533+0000","last_unstale":"2024-09-12T00:58:48.162032+0000","last_undegraded":"2024-09-12T00:58:48.162032+0000","last_fullsized":"2024-09-12T00:58:48.162032+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:22.033467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"268'572","reported_seq":1384,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.041861+0000","last_change":"2024-09-12T00:16:05.114168+0000","last_active":"2024-09-12T01:02:12.041861+0000","last_peered":"2024-09-12T01:02:12.041861+0000","last_clean":"2024-09-12T01:02:12.041861+0000","last_became_active":"2024-09-12T00:16:05.112960+0000","last_became_peered":"2024-09-12T00:16:05.112960+0000","last_unstale":"2024-09-12T01:02:12.041861+0000","last_undegraded":"2024-09-12T01:02:12.041861+0000","last_fullsized":"2024-09-12T01:02:12.041861+0000","mapping_epoch":36,"log_start":"268'500","ondisk_log_start":"268'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:15.906818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1305,"num_read_kb":1300,"num_write":1202,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"268'522","reported_seq":2000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.582686+0000","last_change":"2024-09-12T00:15:57.045470+0000","last_active":"2024-09-12T01:01:09.582686+0000","last_peered":"2024-09-12T01:01:09.582686+0000","last_clean":"2024-09-12T01:01:09.582686+0000","last_became_active":"2024-09-12T00:15:57.045141+0000","last_became_peered":"2024-09-12T00:15:57.045141+0000","last_unstale":"2024-09-12T01:01:09.582686+0000","last_undegraded":"2024-09-12T01:01:09.582686+0000","last_fullsized":"2024-09-12T01:01:09.582686+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.221530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2585,"num_read_kb":2367,"num_write":669,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"268'319","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.131979+0000","last_change":"2024-09-12T00:15:55.065308+0000","last_active":"2024-09-12T01:02:38.131979+0000","last_peered":"2024-09-12T01:02:38.131979+0000","last_clean":"2024-09-12T01:02:38.131979+0000","last_became_active":"2024-09-12T00:15:55.063542+0000","last_became_peered":"2024-09-12T00:15:55.063542+0000","last_unstale":"2024-09-12T01:02:38.131979+0000","last_undegraded":"2024-09-12T01:02:38.131979+0000","last_fullsized":"2024-09-12T01:02:38.131979+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:07.380766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6319256,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":508,"num_read_kb":24074,"num_write":1199,"num_write_kb":38232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:23.170976+0000","last_change":"2024-09-12T00:15:59.051412+0000","last_active":"2024-09-12T00:59:23.170976+0000","last_peered":"2024-09-12T00:59:23.170976+0000","last_clean":"2024-09-12T00:59:23.170976+0000","last_became_active":"2024-09-12T00:15:59.050663+0000","last_became_peered":"2024-09-12T00:15:59.050663+0000","last_unstale":"2024-09-12T00:59:23.170976+0000","last_undegraded":"2024-09-12T00:59:23.170976+0000","last_fullsized":"2024-09-12T00:59:23.170976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:36.230495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"268'242","reported_seq":818,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.953612+0000","last_change":"2024-09-12T00:16:01.069772+0000","last_active":"2024-09-12T01:02:11.953612+0000","last_peered":"2024-09-12T01:02:11.953612+0000","last_clean":"2024-09-12T01:02:11.953612+0000","last_became_active":"2024-09-12T00:16:01.068392+0000","last_became_peered":"2024-09-12T00:16:01.068392+0000","last_unstale":"2024-09-12T01:02:11.953612+0000","last_undegraded":"2024-09-12T01:02:11.953612+0000","last_fullsized":"2024-09-12T01:02:11.953612+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:56.300773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":379,"num_read_kb":770,"num_write":302,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179776+0000","last_change":"2024-09-12T00:16:03.087496+0000","last_active":"2024-09-12T00:59:33.179776+0000","last_peered":"2024-09-12T00:59:33.179776+0000","last_clean":"2024-09-12T00:59:33.179776+0000","last_became_active":"2024-09-12T00:16:03.086751+0000","last_became_peered":"2024-09-12T00:16:03.086751+0000","last_unstale":"2024-09-12T00:59:33.179776+0000","last_undegraded":"2024-09-12T00:59:33.179776+0000","last_fullsized":"2024-09-12T00:59:33.179776+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:20.968600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"268'2410","reported_seq":4246,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.403542+0000","last_change":"2024-09-12T00:16:05.115334+0000","last_active":"2024-09-12T01:02:01.403542+0000","last_peered":"2024-09-12T01:02:01.403542+0000","last_clean":"2024-09-12T01:02:01.403542+0000","last_became_active":"2024-09-12T00:16:05.114563+0000","last_became_peered":"2024-09-12T00:16:05.114563+0000","last_unstale":"2024-09-12T01:02:01.403542+0000","last_undegraded":"2024-09-12T01:02:01.403542+0000","last_fullsized":"2024-09-12T01:02:01.403542+0000","mapping_epoch":36,"log_start":"268'2300","ondisk_log_start":"268'2300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":2300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:14.259829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6030,"num_read_kb":6028,"num_write":4877,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"268'783","reported_seq":2354,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.582663+0000","last_change":"2024-09-12T00:15:57.024963+0000","last_active":"2024-09-12T01:01:09.582663+0000","last_peered":"2024-09-12T01:01:09.582663+0000","last_clean":"2024-09-12T01:01:09.582663+0000","last_became_active":"2024-09-12T00:15:57.024509+0000","last_became_peered":"2024-09-12T00:15:57.024509+0000","last_unstale":"2024-09-12T01:01:09.582663+0000","last_undegraded":"2024-09-12T01:01:09.582663+0000","last_fullsized":"2024-09-12T01:01:09.582663+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:39.327515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3769,"num_read_kb":3415,"num_write":1030,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"268'321","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.551960+0000","last_change":"2024-09-12T00:15:55.055309+0000","last_active":"2024-09-12T01:02:38.551960+0000","last_peered":"2024-09-12T01:02:38.551960+0000","last_clean":"2024-09-12T01:02:38.551960+0000","last_became_active":"2024-09-12T00:15:55.052916+0000","last_became_peered":"2024-09-12T00:15:55.052916+0000","last_unstale":"2024-09-12T01:02:38.551960+0000","last_undegraded":"2024-09-12T01:02:38.551960+0000","last_fullsized":"2024-09-12T01:02:38.551960+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:37.807496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331521,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":455,"num_read_kb":37815,"num_write":1117,"num_write_kb":39957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:47.188865+0000","last_change":"2024-09-12T00:15:59.035302+0000","last_active":"2024-09-12T00:58:47.188865+0000","last_peered":"2024-09-12T00:58:47.188865+0000","last_clean":"2024-09-12T00:58:47.188865+0000","last_became_active":"2024-09-12T00:15:59.034650+0000","last_became_peered":"2024-09-12T00:15:59.034650+0000","last_unstale":"2024-09-12T00:58:47.188865+0000","last_undegraded":"2024-09-12T00:58:47.188865+0000","last_fullsized":"2024-09-12T00:58:47.188865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:26.439328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"268'318","reported_seq":922,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.593445+0000","last_change":"2024-09-12T00:16:01.059061+0000","last_active":"2024-09-12T01:02:37.593445+0000","last_peered":"2024-09-12T01:02:37.593445+0000","last_clean":"2024-09-12T01:02:37.593445+0000","last_became_active":"2024-09-12T00:16:01.057281+0000","last_became_peered":"2024-09-12T00:16:01.057281+0000","last_unstale":"2024-09-12T01:02:37.593445+0000","last_undegraded":"2024-09-12T01:02:37.593445+0000","last_fullsized":"2024-09-12T01:02:37.593445+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:55.215685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49581,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":504,"num_read_kb":1060,"num_write":406,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"268'810","reported_seq":2418,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.080945+0000","last_change":"2024-09-12T00:16:03.098169+0000","last_active":"2024-09-12T01:02:12.080945+0000","last_peered":"2024-09-12T01:02:12.080945+0000","last_clean":"2024-09-12T01:02:12.080945+0000","last_became_active":"2024-09-12T00:16:03.097554+0000","last_became_peered":"2024-09-12T00:16:03.097554+0000","last_unstale":"2024-09-12T01:02:12.080945+0000","last_undegraded":"2024-09-12T01:02:12.080945+0000","last_fullsized":"2024-09-12T01:02:12.080945+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:01.820378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"268'94","reported_seq":599,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.780044+0000","last_change":"2024-09-12T00:16:05.113044+0000","last_active":"2024-09-12T01:02:10.780044+0000","last_peered":"2024-09-12T01:02:10.780044+0000","last_clean":"2024-09-12T01:02:10.780044+0000","last_became_active":"2024-09-12T00:16:05.112524+0000","last_became_peered":"2024-09-12T00:16:05.112524+0000","last_unstale":"2024-09-12T01:02:10.780044+0000","last_undegraded":"2024-09-12T01:02:10.780044+0000","last_fullsized":"2024-09-12T01:02:10.780044+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:08.645097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":109,"num_write":225,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"268'456","reported_seq":1823,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.422425+0000","last_change":"2024-09-12T00:15:57.043306+0000","last_active":"2024-09-12T01:01:06.422425+0000","last_peered":"2024-09-12T01:01:06.422425+0000","last_clean":"2024-09-12T01:01:06.422425+0000","last_became_active":"2024-09-12T00:15:57.042663+0000","last_became_peered":"2024-09-12T00:15:57.042663+0000","last_unstale":"2024-09-12T01:01:06.422425+0000","last_undegraded":"2024-09-12T01:01:06.422425+0000","last_fullsized":"2024-09-12T01:01:06.422425+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:27.809795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2110,"num_read_kb":1961,"num_write":540,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"268'313","reported_seq":1054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.871417+0000","last_change":"2024-09-12T00:15:55.060102+0000","last_active":"2024-09-12T01:02:37.871417+0000","last_peered":"2024-09-12T01:02:37.871417+0000","last_clean":"2024-09-12T01:02:37.871417+0000","last_became_active":"2024-09-12T00:15:55.054533+0000","last_became_peered":"2024-09-12T00:15:55.054533+0000","last_unstale":"2024-09-12T01:02:37.871417+0000","last_undegraded":"2024-09-12T01:02:37.871417+0000","last_fullsized":"2024-09-12T01:02:37.871417+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:15.618277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10753529,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":761,"num_read_kb":57067,"num_write":1094,"num_write_kb":15994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.173416+0000","last_change":"2024-09-12T00:15:59.037952+0000","last_active":"2024-09-12T00:59:33.173416+0000","last_peered":"2024-09-12T00:59:33.173416+0000","last_clean":"2024-09-12T00:59:33.173416+0000","last_became_active":"2024-09-12T00:15:59.037145+0000","last_became_peered":"2024-09-12T00:15:59.037145+0000","last_unstale":"2024-09-12T00:59:33.173416+0000","last_undegraded":"2024-09-12T00:59:33.173416+0000","last_fullsized":"2024-09-12T00:59:33.173416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:33.825886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"268'481","reported_seq":1125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.749434+0000","last_change":"2024-09-12T00:16:01.069486+0000","last_active":"2024-09-12T01:02:37.749434+0000","last_peered":"2024-09-12T01:02:37.749434+0000","last_clean":"2024-09-12T01:02:37.749434+0000","last_became_active":"2024-09-12T00:16:01.068496+0000","last_became_peered":"2024-09-12T00:16:01.068496+0000","last_unstale":"2024-09-12T01:02:37.749434+0000","last_undegraded":"2024-09-12T01:02:37.749434+0000","last_fullsized":"2024-09-12T01:02:37.749434+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:18.290612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100877,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":833,"num_read_kb":1897,"num_write":686,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.198874+0000","last_change":"2024-09-12T00:16:03.102755+0000","last_active":"2024-09-12T00:59:27.198874+0000","last_peered":"2024-09-12T00:59:27.198874+0000","last_clean":"2024-09-12T00:59:27.198874+0000","last_became_active":"2024-09-12T00:16:03.101984+0000","last_became_peered":"2024-09-12T00:16:03.101984+0000","last_unstale":"2024-09-12T00:59:27.198874+0000","last_undegraded":"2024-09-12T00:59:27.198874+0000","last_fullsized":"2024-09-12T00:59:27.198874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:46.673834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"268'131","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.211991+0000","last_change":"2024-09-12T00:16:05.105645+0000","last_active":"2024-09-12T01:01:07.211991+0000","last_peered":"2024-09-12T01:01:07.211991+0000","last_clean":"2024-09-12T01:01:07.211991+0000","last_became_active":"2024-09-12T00:16:05.104674+0000","last_became_peered":"2024-09-12T00:16:05.104674+0000","last_unstale":"2024-09-12T01:01:07.211991+0000","last_undegraded":"2024-09-12T01:01:07.211991+0000","last_fullsized":"2024-09-12T01:01:07.211991+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:09.821079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":121,"num_write":297,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"268'781","reported_seq":2286,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.868337+0000","last_change":"2024-09-12T00:15:57.017588+0000","last_active":"2024-09-12T01:02:10.868337+0000","last_peered":"2024-09-12T01:02:10.868337+0000","last_clean":"2024-09-12T01:02:10.868337+0000","last_became_active":"2024-09-12T00:15:57.016954+0000","last_became_peered":"2024-09-12T00:15:57.016954+0000","last_unstale":"2024-09-12T01:02:10.868337+0000","last_undegraded":"2024-09-12T01:02:10.868337+0000","last_fullsized":"2024-09-12T01:02:10.868337+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:04.997592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3833,"num_read_kb":3467,"num_write":1045,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"268'244","reported_seq":847,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:10.266296+0000","last_change":"2024-09-12T00:15:55.063836+0000","last_active":"2024-09-12T00:59:10.266296+0000","last_peered":"2024-09-12T00:59:10.266296+0000","last_clean":"2024-09-12T00:59:10.266296+0000","last_became_active":"2024-09-12T00:15:55.062854+0000","last_became_peered":"2024-09-12T00:15:55.062854+0000","last_unstale":"2024-09-12T00:59:10.266296+0000","last_undegraded":"2024-09-12T00:59:10.266296+0000","last_fullsized":"2024-09-12T00:59:10.266296+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:50.512780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12868368,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":354,"num_read_kb":12698,"num_write":917,"num_write_kb":17642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:47.164632+0000","last_change":"2024-09-12T00:15:59.034591+0000","last_active":"2024-09-12T00:58:47.164632+0000","last_peered":"2024-09-12T00:58:47.164632+0000","last_clean":"2024-09-12T00:58:47.164632+0000","last_became_active":"2024-09-12T00:15:59.033844+0000","last_became_peered":"2024-09-12T00:15:59.033844+0000","last_unstale":"2024-09-12T00:58:47.164632+0000","last_undegraded":"2024-09-12T00:58:47.164632+0000","last_fullsized":"2024-09-12T00:58:47.164632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:37.678048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"268'313","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.965178+0000","last_change":"2024-09-12T00:16:01.068155+0000","last_active":"2024-09-12T01:02:11.965178+0000","last_peered":"2024-09-12T01:02:11.965178+0000","last_clean":"2024-09-12T01:02:11.965178+0000","last_became_active":"2024-09-12T00:16:01.067377+0000","last_became_peered":"2024-09-12T00:16:01.067377+0000","last_unstale":"2024-09-12T01:02:11.965178+0000","last_undegraded":"2024-09-12T01:02:11.965178+0000","last_fullsized":"2024-09-12T01:02:11.965178+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:04.239296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61827,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":1083,"num_write":490,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168204+0000","last_change":"2024-09-12T00:16:03.079750+0000","last_active":"2024-09-12T00:59:02.168204+0000","last_peered":"2024-09-12T00:59:02.168204+0000","last_clean":"2024-09-12T00:59:02.168204+0000","last_became_active":"2024-09-12T00:16:03.079004+0000","last_became_peered":"2024-09-12T00:16:03.079004+0000","last_unstale":"2024-09-12T00:59:02.168204+0000","last_undegraded":"2024-09-12T00:59:02.168204+0000","last_fullsized":"2024-09-12T00:59:02.168204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:46.457515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"268'127","reported_seq":617,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.407863+0000","last_change":"2024-09-12T00:16:05.094605+0000","last_active":"2024-09-12T01:02:01.407863+0000","last_peered":"2024-09-12T01:02:01.407863+0000","last_clean":"2024-09-12T01:02:01.407863+0000","last_became_active":"2024-09-12T00:16:05.093815+0000","last_became_peered":"2024-09-12T00:16:05.093815+0000","last_unstale":"2024-09-12T01:02:01.407863+0000","last_undegraded":"2024-09-12T01:02:01.407863+0000","last_fullsized":"2024-09-12T01:02:01.407863+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:25.421248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":302,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"268'443","reported_seq":1987,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:59.004706+0000","last_change":"2024-09-12T00:15:57.029941+0000","last_active":"2024-09-12T01:00:59.004706+0000","last_peered":"2024-09-12T01:00:59.004706+0000","last_clean":"2024-09-12T01:00:59.004706+0000","last_became_active":"2024-09-12T00:15:57.029290+0000","last_became_peered":"2024-09-12T00:15:57.029290+0000","last_unstale":"2024-09-12T01:00:59.004706+0000","last_undegraded":"2024-09-12T01:00:59.004706+0000","last_fullsized":"2024-09-12T01:00:59.004706+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:52.959133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2290,"num_read_kb":2163,"num_write":517,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"268'322","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.987665+0000","last_change":"2024-09-12T00:16:26.797714+0000","last_active":"2024-09-12T01:02:38.987665+0000","last_peered":"2024-09-12T01:02:38.987665+0000","last_clean":"2024-09-12T01:02:38.987665+0000","last_became_active":"2024-09-12T00:16:26.796888+0000","last_became_peered":"2024-09-12T00:16:26.796888+0000","last_unstale":"2024-09-12T01:02:38.987665+0000","last_undegraded":"2024-09-12T01:02:38.987665+0000","last_fullsized":"2024-09-12T01:02:38.987665+0000","mapping_epoch":39,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:17.037395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6314494,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":469,"num_read_kb":37572,"num_write":1105,"num_write_kb":35076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,6],"acting":[3,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:47.188931+0000","last_change":"2024-09-12T00:15:59.030706+0000","last_active":"2024-09-12T00:58:47.188931+0000","last_peered":"2024-09-12T00:58:47.188931+0000","last_clean":"2024-09-12T00:58:47.188931+0000","last_became_active":"2024-09-12T00:15:59.029998+0000","last_became_peered":"2024-09-12T00:15:59.029998+0000","last_unstale":"2024-09-12T00:58:47.188931+0000","last_undegraded":"2024-09-12T00:58:47.188931+0000","last_fullsized":"2024-09-12T00:58:47.188931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:08.142841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"268'301","reported_seq":879,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:17.001536+0000","last_change":"2024-09-12T00:16:01.054348+0000","last_active":"2024-09-12T01:01:17.001536+0000","last_peered":"2024-09-12T01:01:17.001536+0000","last_clean":"2024-09-12T01:01:17.001536+0000","last_became_active":"2024-09-12T00:16:01.053660+0000","last_became_peered":"2024-09-12T00:16:01.053660+0000","last_unstale":"2024-09-12T01:01:17.001536+0000","last_undegraded":"2024-09-12T01:01:17.001536+0000","last_fullsized":"2024-09-12T01:01:17.001536+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:28.294852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65745,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":999,"num_write":402,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"268'775","reported_seq":2365,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.131465+0000","last_change":"2024-09-12T00:16:03.098769+0000","last_active":"2024-09-12T01:02:37.131465+0000","last_peered":"2024-09-12T01:02:37.131465+0000","last_clean":"2024-09-12T01:02:37.131465+0000","last_became_active":"2024-09-12T00:16:03.098077+0000","last_became_peered":"2024-09-12T00:16:03.098077+0000","last_unstale":"2024-09-12T01:02:37.131465+0000","last_undegraded":"2024-09-12T01:02:37.131465+0000","last_fullsized":"2024-09-12T01:02:37.131465+0000","mapping_epoch":34,"log_start":"268'701","ondisk_log_start":"268'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":701,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:52.835421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"268'151","reported_seq":653,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:03.866324+0000","last_change":"2024-09-12T00:16:05.108146+0000","last_active":"2024-09-12T01:01:03.866324+0000","last_peered":"2024-09-12T01:01:03.866324+0000","last_clean":"2024-09-12T01:01:03.866324+0000","last_became_active":"2024-09-12T00:16:05.107291+0000","last_became_peered":"2024-09-12T00:16:05.107291+0000","last_unstale":"2024-09-12T01:01:03.866324+0000","last_undegraded":"2024-09-12T01:01:03.866324+0000","last_fullsized":"2024-09-12T01:01:03.866324+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:57.906444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":174,"num_read_kb":162,"num_write":365,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"268'796","reported_seq":2308,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.428696+0000","last_change":"2024-09-12T00:15:57.024503+0000","last_active":"2024-09-12T01:01:06.428696+0000","last_peered":"2024-09-12T01:01:06.428696+0000","last_clean":"2024-09-12T01:01:06.428696+0000","last_became_active":"2024-09-12T00:15:57.024185+0000","last_became_peered":"2024-09-12T00:15:57.024185+0000","last_unstale":"2024-09-12T01:01:06.428696+0000","last_undegraded":"2024-09-12T01:01:06.428696+0000","last_fullsized":"2024-09-12T01:01:06.428696+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:13.017889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3776,"num_read_kb":3402,"num_write":1055,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"268'317","reported_seq":963,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.758454+0000","last_change":"2024-09-12T00:15:55.027875+0000","last_active":"2024-09-12T01:02:38.758454+0000","last_peered":"2024-09-12T01:02:38.758454+0000","last_clean":"2024-09-12T01:02:38.758454+0000","last_became_active":"2024-09-12T00:15:55.027001+0000","last_became_peered":"2024-09-12T00:15:55.027001+0000","last_unstale":"2024-09-12T01:02:38.758454+0000","last_undegraded":"2024-09-12T01:02:38.758454+0000","last_fullsized":"2024-09-12T01:02:38.758454+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:37.021357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12858183,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":400,"num_read_kb":53256,"num_write":837,"num_write_kb":32142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1460,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.098953+0000","last_change":"2024-09-12T00:15:59.035799+0000","last_active":"2024-09-12T01:02:37.098953+0000","last_peered":"2024-09-12T01:02:37.098953+0000","last_clean":"2024-09-12T01:02:37.098953+0000","last_became_active":"2024-09-12T00:15:59.035380+0000","last_became_peered":"2024-09-12T00:15:59.035380+0000","last_unstale":"2024-09-12T01:02:37.098953+0000","last_undegraded":"2024-09-12T01:02:37.098953+0000","last_fullsized":"2024-09-12T01:02:37.098953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:37.318095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":957,"num_read_kb":957,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"268'80","reported_seq":596,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:00.682139+0000","last_change":"2024-09-12T00:16:01.065768+0000","last_active":"2024-09-12T01:00:00.682139+0000","last_peered":"2024-09-12T01:00:00.682139+0000","last_clean":"2024-09-12T01:00:00.682139+0000","last_became_active":"2024-09-12T00:16:01.065038+0000","last_became_peered":"2024-09-12T00:16:01.065038+0000","last_unstale":"2024-09-12T01:00:00.682139+0000","last_undegraded":"2024-09-12T01:00:00.682139+0000","last_fullsized":"2024-09-12T01:00:00.682139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:49.222908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"268'797","reported_seq":2364,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.133970+0000","last_change":"2024-09-12T00:16:03.089577+0000","last_active":"2024-09-12T01:02:37.133970+0000","last_peered":"2024-09-12T01:02:37.133970+0000","last_clean":"2024-09-12T01:02:37.133970+0000","last_became_active":"2024-09-12T00:16:03.088856+0000","last_became_peered":"2024-09-12T00:16:03.088856+0000","last_unstale":"2024-09-12T01:02:37.133970+0000","last_undegraded":"2024-09-12T01:02:37.133970+0000","last_fullsized":"2024-09-12T01:02:37.133970+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:36.628955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"268'127","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.435230+0000","last_change":"2024-09-12T00:16:05.108738+0000","last_active":"2024-09-12T01:01:06.435230+0000","last_peered":"2024-09-12T01:01:06.435230+0000","last_clean":"2024-09-12T01:01:06.435230+0000","last_became_active":"2024-09-12T00:16:05.107712+0000","last_became_peered":"2024-09-12T00:16:05.107712+0000","last_unstale":"2024-09-12T01:01:06.435230+0000","last_undegraded":"2024-09-12T01:01:06.435230+0000","last_fullsized":"2024-09-12T01:01:06.435230+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:00.734318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":150,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"268'855","reported_seq":2471,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:53.115073+0000","last_change":"2024-09-12T00:15:57.044791+0000","last_active":"2024-09-12T01:00:53.115073+0000","last_peered":"2024-09-12T01:00:53.115073+0000","last_clean":"2024-09-12T01:00:53.115073+0000","last_became_active":"2024-09-12T00:15:57.043447+0000","last_became_peered":"2024-09-12T00:15:57.043447+0000","last_unstale":"2024-09-12T01:00:53.115073+0000","last_undegraded":"2024-09-12T01:00:53.115073+0000","last_fullsized":"2024-09-12T01:00:53.115073+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:48.004809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4138,"num_read_kb":3738,"num_write":1141,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"268'269","reported_seq":909,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.959042+0000","last_change":"2024-09-12T00:15:55.040492+0000","last_active":"2024-09-12T01:02:37.959042+0000","last_peered":"2024-09-12T01:02:37.959042+0000","last_clean":"2024-09-12T01:02:37.959042+0000","last_became_active":"2024-09-12T00:15:55.039512+0000","last_became_peered":"2024-09-12T00:15:55.039512+0000","last_unstale":"2024-09-12T01:02:37.959042+0000","last_undegraded":"2024-09-12T01:02:37.959042+0000","last_fullsized":"2024-09-12T01:02:37.959042+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:08.086426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12173113,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":377,"num_read_kb":56944,"num_write":937,"num_write_kb":41414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:44.205861+0000","last_change":"2024-09-12T00:15:59.046399+0000","last_active":"2024-09-12T00:58:44.205861+0000","last_peered":"2024-09-12T00:58:44.205861+0000","last_clean":"2024-09-12T00:58:44.205861+0000","last_became_active":"2024-09-12T00:15:59.046018+0000","last_became_peered":"2024-09-12T00:15:59.046018+0000","last_unstale":"2024-09-12T00:58:44.205861+0000","last_undegraded":"2024-09-12T00:58:44.205861+0000","last_fullsized":"2024-09-12T00:58:44.205861+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:02.866037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"268'329","reported_seq":933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.999385+0000","last_change":"2024-09-12T00:16:01.070932+0000","last_active":"2024-09-12T01:02:11.999385+0000","last_peered":"2024-09-12T01:02:11.999385+0000","last_clean":"2024-09-12T01:02:11.999385+0000","last_became_active":"2024-09-12T00:16:01.069078+0000","last_became_peered":"2024-09-12T00:16:01.069078+0000","last_unstale":"2024-09-12T01:02:11.999385+0000","last_undegraded":"2024-09-12T01:02:11.999385+0000","last_fullsized":"2024-09-12T01:02:11.999385+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:54.239828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53080,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":525,"num_read_kb":986,"num_write":414,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.173630+0000","last_change":"2024-09-12T00:16:03.107385+0000","last_active":"2024-09-12T00:58:48.173630+0000","last_peered":"2024-09-12T00:58:48.173630+0000","last_clean":"2024-09-12T00:58:48.173630+0000","last_became_active":"2024-09-12T00:16:03.106662+0000","last_became_peered":"2024-09-12T00:16:03.106662+0000","last_unstale":"2024-09-12T00:58:48.173630+0000","last_undegraded":"2024-09-12T00:58:48.173630+0000","last_fullsized":"2024-09-12T00:58:48.173630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:36.203314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"268'135","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:05.839461+0000","last_change":"2024-09-12T00:16:05.112393+0000","last_active":"2024-09-12T01:01:05.839461+0000","last_peered":"2024-09-12T01:01:05.839461+0000","last_clean":"2024-09-12T01:01:05.839461+0000","last_became_active":"2024-09-12T00:16:05.111705+0000","last_became_peered":"2024-09-12T00:16:05.111705+0000","last_unstale":"2024-09-12T01:01:05.839461+0000","last_undegraded":"2024-09-12T01:01:05.839461+0000","last_fullsized":"2024-09-12T01:01:05.839461+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:21.647320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":316,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"268'515","reported_seq":2096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.227739+0000","last_change":"2024-09-12T00:15:57.029602+0000","last_active":"2024-09-12T01:01:07.227739+0000","last_peered":"2024-09-12T01:01:07.227739+0000","last_clean":"2024-09-12T01:01:07.227739+0000","last_became_active":"2024-09-12T00:15:57.029211+0000","last_became_peered":"2024-09-12T00:15:57.029211+0000","last_unstale":"2024-09-12T01:01:07.227739+0000","last_undegraded":"2024-09-12T01:01:07.227739+0000","last_fullsized":"2024-09-12T01:01:07.227739+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:55.890872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2638,"num_read_kb":2449,"num_write":617,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.188316+0000","last_change":"2024-09-12T00:15:34.148103+0000","last_active":"2024-09-12T00:59:48.188316+0000","last_peered":"2024-09-12T00:59:48.188316+0000","last_clean":"2024-09-12T00:59:48.188316+0000","last_became_active":"2024-09-12T00:15:34.145413+0000","last_became_peered":"2024-09-12T00:15:34.145413+0000","last_unstale":"2024-09-12T00:59:48.188316+0000","last_undegraded":"2024-09-12T00:59:48.188316+0000","last_fullsized":"2024-09-12T00:59:48.188316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.032265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.032265+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.032265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:37.582882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219349+0000","last_change":"2024-09-12T00:15:42.090501+0000","last_active":"2024-09-12T00:59:29.219349+0000","last_peered":"2024-09-12T00:59:29.219349+0000","last_clean":"2024-09-12T00:59:29.219349+0000","last_became_active":"2024-09-12T00:15:40.490486+0000","last_became_peered":"2024-09-12T00:15:40.490486+0000","last_unstale":"2024-09-12T00:59:29.219349+0000","last_undegraded":"2024-09-12T00:59:29.219349+0000","last_fullsized":"2024-09-12T00:59:29.219349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:41.969157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013201490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"268'291","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.988082+0000","last_change":"2024-09-12T00:15:55.049247+0000","last_active":"2024-09-12T01:02:37.988082+0000","last_peered":"2024-09-12T01:02:37.988082+0000","last_clean":"2024-09-12T01:02:37.988082+0000","last_became_active":"2024-09-12T00:15:55.048230+0000","last_became_peered":"2024-09-12T00:15:55.048230+0000","last_unstale":"2024-09-12T01:02:37.988082+0000","last_undegraded":"2024-09-12T01:02:37.988082+0000","last_fullsized":"2024-09-12T01:02:37.988082+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:10.864422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2024205,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":509,"num_read_kb":9775,"num_write":1078,"num_write_kb":32871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.189322+0000","last_change":"2024-09-12T00:15:59.041780+0000","last_active":"2024-09-12T00:59:48.189322+0000","last_peered":"2024-09-12T00:59:48.189322+0000","last_clean":"2024-09-12T00:59:48.189322+0000","last_became_active":"2024-09-12T00:15:59.041357+0000","last_became_peered":"2024-09-12T00:15:59.041357+0000","last_unstale":"2024-09-12T00:59:48.189322+0000","last_undegraded":"2024-09-12T00:59:48.189322+0000","last_fullsized":"2024-09-12T00:59:48.189322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:31.097783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"268'721","reported_seq":1432,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.089760+0000","last_change":"2024-09-12T00:16:01.052726+0000","last_active":"2024-09-12T01:02:38.089760+0000","last_peered":"2024-09-12T01:02:38.089760+0000","last_clean":"2024-09-12T01:02:38.089760+0000","last_became_active":"2024-09-12T00:16:01.052016+0000","last_became_peered":"2024-09-12T00:16:01.052016+0000","last_unstale":"2024-09-12T01:02:38.089760+0000","last_undegraded":"2024-09-12T01:02:38.089760+0000","last_fullsized":"2024-09-12T01:02:38.089760+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:44.346178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169706,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1413,"num_read_kb":3242,"num_write":1312,"num_write_kb":1184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":488,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.199298+0000","last_change":"2024-09-12T00:16:03.099445+0000","last_active":"2024-09-12T00:59:27.199298+0000","last_peered":"2024-09-12T00:59:27.199298+0000","last_clean":"2024-09-12T00:59:27.199298+0000","last_became_active":"2024-09-12T00:16:03.097343+0000","last_became_peered":"2024-09-12T00:16:03.097343+0000","last_unstale":"2024-09-12T00:59:27.199298+0000","last_undegraded":"2024-09-12T00:59:27.199298+0000","last_fullsized":"2024-09-12T00:59:27.199298+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:08.255612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"268'171","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.245431+0000","last_change":"2024-09-12T00:16:05.113881+0000","last_active":"2024-09-12T01:01:07.245431+0000","last_peered":"2024-09-12T01:01:07.245431+0000","last_clean":"2024-09-12T01:01:07.245431+0000","last_became_active":"2024-09-12T00:16:05.113366+0000","last_became_peered":"2024-09-12T00:16:05.113366+0000","last_unstale":"2024-09-12T01:01:07.245431+0000","last_undegraded":"2024-09-12T01:01:07.245431+0000","last_fullsized":"2024-09-12T01:01:07.245431+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:18.255536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1020,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":408,"num_write":348,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"268'1045","reported_seq":2792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.053877+0000","last_change":"2024-09-12T00:15:57.049813+0000","last_active":"2024-09-12T01:00:41.053877+0000","last_peered":"2024-09-12T01:00:41.053877+0000","last_clean":"2024-09-12T01:00:41.053877+0000","last_became_active":"2024-09-12T00:15:57.047672+0000","last_became_peered":"2024-09-12T00:15:57.047672+0000","last_unstale":"2024-09-12T01:00:41.053877+0000","last_undegraded":"2024-09-12T01:00:41.053877+0000","last_fullsized":"2024-09-12T01:00:41.053877+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":1000,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:39.410827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5053,"num_read_kb":4502,"num_write":1469,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:54.225501+0000","last_change":"2024-09-12T00:15:42.090908+0000","last_active":"2024-09-12T00:59:54.225501+0000","last_peered":"2024-09-12T00:59:54.225501+0000","last_clean":"2024-09-12T00:59:54.225501+0000","last_became_active":"2024-09-12T00:15:40.098303+0000","last_became_peered":"2024-09-12T00:15:40.098303+0000","last_unstale":"2024-09-12T00:59:54.225501+0000","last_undegraded":"2024-09-12T00:59:54.225501+0000","last_fullsized":"2024-09-12T00:59:54.225501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:40.232317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017858660000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"268'292","reported_seq":945,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.189405+0000","last_change":"2024-09-12T00:15:55.051725+0000","last_active":"2024-09-12T01:02:38.189405+0000","last_peered":"2024-09-12T01:02:38.189405+0000","last_clean":"2024-09-12T01:02:38.189405+0000","last_became_active":"2024-09-12T00:15:55.050874+0000","last_became_peered":"2024-09-12T00:15:55.050874+0000","last_unstale":"2024-09-12T01:02:38.189405+0000","last_undegraded":"2024-09-12T01:02:38.189405+0000","last_fullsized":"2024-09-12T01:02:38.189405+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:21.733859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22608265,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":426,"num_read_kb":131172,"num_write":1023,"num_write_kb":57813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:19.216989+0000","last_change":"2024-09-12T00:15:59.031231+0000","last_active":"2024-09-12T00:59:19.216989+0000","last_peered":"2024-09-12T00:59:19.216989+0000","last_clean":"2024-09-12T00:59:19.216989+0000","last_became_active":"2024-09-12T00:15:59.030858+0000","last_became_peered":"2024-09-12T00:15:59.030858+0000","last_unstale":"2024-09-12T00:59:19.216989+0000","last_undegraded":"2024-09-12T00:59:19.216989+0000","last_fullsized":"2024-09-12T00:59:19.216989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:14.830144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"268'1298","reported_seq":2785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.183574+0000","last_change":"2024-09-12T00:16:01.058741+0000","last_active":"2024-09-12T01:02:37.183574+0000","last_peered":"2024-09-12T01:02:37.183574+0000","last_clean":"2024-09-12T01:02:37.183574+0000","last_became_active":"2024-09-12T00:16:01.057956+0000","last_became_peered":"2024-09-12T00:16:01.057956+0000","last_unstale":"2024-09-12T01:02:37.183574+0000","last_undegraded":"2024-09-12T01:02:37.183574+0000","last_fullsized":"2024-09-12T01:02:37.183574+0000","mapping_epoch":32,"log_start":"268'1200","ondisk_log_start":"268'1200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":1200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:22.472702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186588,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2032,"num_read_kb":3561,"num_write":1154,"num_write_kb":1000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:59.226747+0000","last_change":"2024-09-12T00:16:03.105384+0000","last_active":"2024-09-12T00:59:59.226747+0000","last_peered":"2024-09-12T00:59:59.226747+0000","last_clean":"2024-09-12T00:59:59.226747+0000","last_became_active":"2024-09-12T00:16:03.104040+0000","last_became_peered":"2024-09-12T00:16:03.104040+0000","last_unstale":"2024-09-12T00:59:59.226747+0000","last_undegraded":"2024-09-12T00:59:59.226747+0000","last_fullsized":"2024-09-12T00:59:59.226747+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:42.422978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"268'221","reported_seq":747,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.969829+0000","last_change":"2024-09-12T00:16:05.100831+0000","last_active":"2024-09-12T01:00:41.969829+0000","last_peered":"2024-09-12T01:00:41.969829+0000","last_clean":"2024-09-12T01:00:41.969829+0000","last_became_active":"2024-09-12T00:16:05.099987+0000","last_became_peered":"2024-09-12T00:16:05.099987+0000","last_unstale":"2024-09-12T01:00:41.969829+0000","last_undegraded":"2024-09-12T01:00:41.969829+0000","last_fullsized":"2024-09-12T01:00:41.969829+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:49.711006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":366,"num_read_kb":355,"num_write":494,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"268'395","reported_seq":1888,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506639+0000","last_change":"2024-09-12T00:15:57.022983+0000","last_active":"2024-09-12T01:01:09.506639+0000","last_peered":"2024-09-12T01:01:09.506639+0000","last_clean":"2024-09-12T01:01:09.506639+0000","last_became_active":"2024-09-12T00:15:57.022193+0000","last_became_peered":"2024-09-12T00:15:57.022193+0000","last_unstale":"2024-09-12T01:01:09.506639+0000","last_undegraded":"2024-09-12T01:01:09.506639+0000","last_fullsized":"2024-09-12T01:01:09.506639+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:12.564764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2164,"num_read_kb":2061,"num_write":440,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174427+0000","last_change":"2024-09-12T00:15:43.065460+0000","last_active":"2024-09-12T00:59:27.174427+0000","last_peered":"2024-09-12T00:59:27.174427+0000","last_clean":"2024-09-12T00:59:27.174427+0000","last_became_active":"2024-09-12T00:15:40.095888+0000","last_became_peered":"2024-09-12T00:15:40.095888+0000","last_unstale":"2024-09-12T00:59:27.174427+0000","last_undegraded":"2024-09-12T00:59:27.174427+0000","last_fullsized":"2024-09-12T00:59:27.174427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:49.939912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000883303,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"268'288","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.386518+0000","last_change":"2024-09-12T00:15:55.055938+0000","last_active":"2024-09-12T01:00:46.386518+0000","last_peered":"2024-09-12T01:00:46.386518+0000","last_clean":"2024-09-12T01:00:46.386518+0000","last_became_active":"2024-09-12T00:15:55.043174+0000","last_became_peered":"2024-09-12T00:15:55.043174+0000","last_unstale":"2024-09-12T01:00:46.386518+0000","last_undegraded":"2024-09-12T01:00:46.386518+0000","last_fullsized":"2024-09-12T01:00:46.386518+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:27.487345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2140715,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":420,"num_read_kb":17440,"num_write":1051,"num_write_kb":28417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:22.173406+0000","last_change":"2024-09-12T00:15:59.035726+0000","last_active":"2024-09-12T00:59:22.173406+0000","last_peered":"2024-09-12T00:59:22.173406+0000","last_clean":"2024-09-12T00:59:22.173406+0000","last_became_active":"2024-09-12T00:15:59.033660+0000","last_became_peered":"2024-09-12T00:15:59.033660+0000","last_unstale":"2024-09-12T00:59:22.173406+0000","last_undegraded":"2024-09-12T00:59:22.173406+0000","last_fullsized":"2024-09-12T00:59:22.173406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:37.650316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"268'251","reported_seq":1356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.831740+0000","last_change":"2024-09-12T00:16:01.073248+0000","last_active":"2024-09-12T01:02:10.831740+0000","last_peered":"2024-09-12T01:02:10.831740+0000","last_clean":"2024-09-12T01:02:10.831740+0000","last_became_active":"2024-09-12T00:16:01.072168+0000","last_became_peered":"2024-09-12T00:16:01.072168+0000","last_unstale":"2024-09-12T01:02:10.831740+0000","last_undegraded":"2024-09-12T01:02:10.831740+0000","last_fullsized":"2024-09-12T01:02:10.831740+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:05.937075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.183287+0000","last_change":"2024-09-12T00:16:03.087413+0000","last_active":"2024-09-12T00:59:48.183287+0000","last_peered":"2024-09-12T00:59:48.183287+0000","last_clean":"2024-09-12T00:59:48.183287+0000","last_became_active":"2024-09-12T00:16:03.086646+0000","last_became_peered":"2024-09-12T00:16:03.086646+0000","last_unstale":"2024-09-12T00:59:48.183287+0000","last_undegraded":"2024-09-12T00:59:48.183287+0000","last_fullsized":"2024-09-12T00:59:48.183287+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:29.789535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"268'260","reported_seq":880,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.425705+0000","last_change":"2024-09-12T00:16:05.095458+0000","last_active":"2024-09-12T01:01:07.425705+0000","last_peered":"2024-09-12T01:01:07.425705+0000","last_clean":"2024-09-12T01:01:07.425705+0000","last_became_active":"2024-09-12T00:16:05.094684+0000","last_became_peered":"2024-09-12T00:16:05.094684+0000","last_unstale":"2024-09-12T01:01:07.425705+0000","last_undegraded":"2024-09-12T01:01:07.425705+0000","last_fullsized":"2024-09-12T01:01:07.425705+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:59.471541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":550,"num_read_kb":556,"num_write":574,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"268'872","reported_seq":2469,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:45.899344+0000","last_change":"2024-09-12T00:15:57.050201+0000","last_active":"2024-09-12T01:00:45.899344+0000","last_peered":"2024-09-12T01:00:45.899344+0000","last_clean":"2024-09-12T01:00:45.899344+0000","last_became_active":"2024-09-12T00:15:57.049533+0000","last_became_peered":"2024-09-12T00:15:57.049533+0000","last_unstale":"2024-09-12T01:00:45.899344+0000","last_undegraded":"2024-09-12T01:00:45.899344+0000","last_fullsized":"2024-09-12T01:00:45.899344+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:22.616019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4105,"num_read_kb":3691,"num_write":1162,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219306+0000","last_change":"2024-09-12T00:15:42.091191+0000","last_active":"2024-09-12T00:59:29.219306+0000","last_peered":"2024-09-12T00:59:29.219306+0000","last_clean":"2024-09-12T00:59:29.219306+0000","last_became_active":"2024-09-12T00:15:40.144614+0000","last_became_peered":"2024-09-12T00:15:40.144614+0000","last_unstale":"2024-09-12T00:59:29.219306+0000","last_undegraded":"2024-09-12T00:59:29.219306+0000","last_fullsized":"2024-09-12T00:59:29.219306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:01.463335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019634679999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"268'308","reported_seq":1007,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.995938+0000","last_change":"2024-09-12T00:15:55.060894+0000","last_active":"2024-09-12T01:02:37.995938+0000","last_peered":"2024-09-12T01:02:37.995938+0000","last_clean":"2024-09-12T01:02:37.995938+0000","last_became_active":"2024-09-12T00:15:55.060303+0000","last_became_peered":"2024-09-12T00:15:55.060303+0000","last_unstale":"2024-09-12T01:02:37.995938+0000","last_undegraded":"2024-09-12T01:02:37.995938+0000","last_fullsized":"2024-09-12T01:02:37.995938+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:25.050199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6585252,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":597,"num_read_kb":10986,"num_write":1285,"num_write_kb":39626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.181987+0000","last_change":"2024-09-12T00:15:59.043416+0000","last_active":"2024-09-12T00:59:57.181987+0000","last_peered":"2024-09-12T00:59:57.181987+0000","last_clean":"2024-09-12T00:59:57.181987+0000","last_became_active":"2024-09-12T00:15:59.042545+0000","last_became_peered":"2024-09-12T00:15:59.042545+0000","last_unstale":"2024-09-12T00:59:57.181987+0000","last_undegraded":"2024-09-12T00:59:57.181987+0000","last_fullsized":"2024-09-12T00:59:57.181987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:22.895073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"268'140","reported_seq":678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:09.645572+0000","last_change":"2024-09-12T00:16:01.048555+0000","last_active":"2024-09-12T01:02:09.645572+0000","last_peered":"2024-09-12T01:02:09.645572+0000","last_clean":"2024-09-12T01:02:09.645572+0000","last_became_active":"2024-09-12T00:16:01.047278+0000","last_became_peered":"2024-09-12T00:16:01.047278+0000","last_unstale":"2024-09-12T01:02:09.645572+0000","last_undegraded":"2024-09-12T01:02:09.645572+0000","last_fullsized":"2024-09-12T01:02:09.645572+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:52.572279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":143,"num_write":118,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:24.218190+0000","last_change":"2024-09-12T00:16:03.097752+0000","last_active":"2024-09-12T00:59:24.218190+0000","last_peered":"2024-09-12T00:59:24.218190+0000","last_clean":"2024-09-12T00:59:24.218190+0000","last_became_active":"2024-09-12T00:16:03.097029+0000","last_became_peered":"2024-09-12T00:16:03.097029+0000","last_unstale":"2024-09-12T00:59:24.218190+0000","last_undegraded":"2024-09-12T00:59:24.218190+0000","last_fullsized":"2024-09-12T00:59:24.218190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:58.710309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"268'157","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.216786+0000","last_change":"2024-09-12T00:16:05.112178+0000","last_active":"2024-09-12T01:01:07.216786+0000","last_peered":"2024-09-12T01:01:07.216786+0000","last_clean":"2024-09-12T01:01:07.216786+0000","last_became_active":"2024-09-12T00:16:05.111534+0000","last_became_peered":"2024-09-12T00:16:05.111534+0000","last_unstale":"2024-09-12T01:01:07.216786+0000","last_undegraded":"2024-09-12T01:01:07.216786+0000","last_fullsized":"2024-09-12T01:01:07.216786+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:54.359907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":344,"num_read_kb":315,"num_write":411,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"268'448","reported_seq":1932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.871086+0000","last_change":"2024-09-12T00:15:57.032372+0000","last_active":"2024-09-12T01:02:10.871086+0000","last_peered":"2024-09-12T01:02:10.871086+0000","last_clean":"2024-09-12T01:02:10.871086+0000","last_became_active":"2024-09-12T00:15:57.023909+0000","last_became_peered":"2024-09-12T00:15:57.023909+0000","last_unstale":"2024-09-12T01:02:10.871086+0000","last_undegraded":"2024-09-12T01:02:10.871086+0000","last_fullsized":"2024-09-12T01:02:10.871086+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:51.721224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2256,"num_read_kb":2116,"num_write":511,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"268'300","reported_seq":943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.141379+0000","last_change":"2024-09-12T00:15:55.057220+0000","last_active":"2024-09-12T01:02:38.141379+0000","last_peered":"2024-09-12T01:02:38.141379+0000","last_clean":"2024-09-12T01:02:38.141379+0000","last_became_active":"2024-09-12T00:15:55.056576+0000","last_became_peered":"2024-09-12T00:15:55.056576+0000","last_unstale":"2024-09-12T01:02:38.141379+0000","last_undegraded":"2024-09-12T01:02:38.141379+0000","last_fullsized":"2024-09-12T01:02:38.141379+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:08.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6554173,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":489,"num_read_kb":507,"num_write":1164,"num_write_kb":27643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.199091+0000","last_change":"2024-09-12T00:15:42.088087+0000","last_active":"2024-09-12T00:59:27.199091+0000","last_peered":"2024-09-12T00:59:27.199091+0000","last_clean":"2024-09-12T00:59:27.199091+0000","last_became_active":"2024-09-12T00:15:40.141037+0000","last_became_peered":"2024-09-12T00:15:40.141037+0000","last_unstale":"2024-09-12T00:59:27.199091+0000","last_undegraded":"2024-09-12T00:59:27.199091+0000","last_fullsized":"2024-09-12T00:59:27.199091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:30.931343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088972300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.183221+0000","last_change":"2024-09-12T00:15:59.045253+0000","last_active":"2024-09-12T00:59:48.183221+0000","last_peered":"2024-09-12T00:59:48.183221+0000","last_clean":"2024-09-12T00:59:48.183221+0000","last_became_active":"2024-09-12T00:15:59.043935+0000","last_became_peered":"2024-09-12T00:15:59.043935+0000","last_unstale":"2024-09-12T00:59:48.183221+0000","last_undegraded":"2024-09-12T00:59:48.183221+0000","last_fullsized":"2024-09-12T00:59:48.183221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:12.203334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"268'551","reported_seq":1215,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.214126+0000","last_change":"2024-09-12T00:16:01.053029+0000","last_active":"2024-09-12T01:02:12.214126+0000","last_peered":"2024-09-12T01:02:12.214126+0000","last_clean":"2024-09-12T01:02:12.214126+0000","last_became_active":"2024-09-12T00:16:01.051753+0000","last_became_peered":"2024-09-12T00:16:01.051753+0000","last_unstale":"2024-09-12T01:02:12.214126+0000","last_undegraded":"2024-09-12T01:02:12.214126+0000","last_fullsized":"2024-09-12T01:02:12.214126+0000","mapping_epoch":32,"log_start":"268'500","ondisk_log_start":"268'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:25.228834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105239,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1542,"num_read_kb":2446,"num_write":2036,"num_write_kb":1873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.188058+0000","last_change":"2024-09-12T00:16:03.100214+0000","last_active":"2024-09-12T00:59:48.188058+0000","last_peered":"2024-09-12T00:59:48.188058+0000","last_clean":"2024-09-12T00:59:48.188058+0000","last_became_active":"2024-09-12T00:16:03.099491+0000","last_became_peered":"2024-09-12T00:16:03.099491+0000","last_unstale":"2024-09-12T00:59:48.188058+0000","last_undegraded":"2024-09-12T00:59:48.188058+0000","last_fullsized":"2024-09-12T00:59:48.188058+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:29.470103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"268'110","reported_seq":605,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:30.754431+0000","last_change":"2024-09-12T00:16:05.100929+0000","last_active":"2024-09-12T01:00:30.754431+0000","last_peered":"2024-09-12T01:00:30.754431+0000","last_clean":"2024-09-12T01:00:30.754431+0000","last_became_active":"2024-09-12T00:16:05.099975+0000","last_became_peered":"2024-09-12T00:16:05.099975+0000","last_unstale":"2024-09-12T01:00:30.754431+0000","last_undegraded":"2024-09-12T01:00:30.754431+0000","last_fullsized":"2024-09-12T01:00:30.754431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:02.033531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":90,"num_write":249,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"268'512","reported_seq":2238,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.869874+0000","last_change":"2024-09-12T00:15:57.020092+0000","last_active":"2024-09-12T01:02:10.869874+0000","last_peered":"2024-09-12T01:02:10.869874+0000","last_clean":"2024-09-12T01:02:10.869874+0000","last_became_active":"2024-09-12T00:15:57.019345+0000","last_became_peered":"2024-09-12T00:15:57.019345+0000","last_unstale":"2024-09-12T01:02:10.869874+0000","last_undegraded":"2024-09-12T01:02:10.869874+0000","last_fullsized":"2024-09-12T01:02:10.869874+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:37.937658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2840,"num_read_kb":2674,"num_write":601,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"268'312","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.170308+0000","last_change":"2024-09-12T00:15:55.068406+0000","last_active":"2024-09-12T01:02:38.170308+0000","last_peered":"2024-09-12T01:02:38.170308+0000","last_clean":"2024-09-12T01:02:38.170308+0000","last_became_active":"2024-09-12T00:15:55.064444+0000","last_became_peered":"2024-09-12T00:15:55.064444+0000","last_unstale":"2024-09-12T01:02:38.170308+0000","last_undegraded":"2024-09-12T01:02:38.170308+0000","last_fullsized":"2024-09-12T01:02:38.170308+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:55.022447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11585769,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":433,"num_read_kb":45787,"num_write":978,"num_write_kb":51853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:39.221977+0000","last_change":"2024-09-12T00:15:42.091937+0000","last_active":"2024-09-12T00:59:39.221977+0000","last_peered":"2024-09-12T00:59:39.221977+0000","last_clean":"2024-09-12T00:59:39.221977+0000","last_became_active":"2024-09-12T00:15:40.093718+0000","last_became_peered":"2024-09-12T00:15:40.093718+0000","last_unstale":"2024-09-12T00:59:39.221977+0000","last_undegraded":"2024-09-12T00:59:39.221977+0000","last_fullsized":"2024-09-12T00:59:39.221977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:26.233329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001992522,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.189215+0000","last_change":"2024-09-12T00:15:59.042002+0000","last_active":"2024-09-12T00:59:48.189215+0000","last_peered":"2024-09-12T00:59:48.189215+0000","last_clean":"2024-09-12T00:59:48.189215+0000","last_became_active":"2024-09-12T00:15:59.041390+0000","last_became_peered":"2024-09-12T00:15:59.041390+0000","last_unstale":"2024-09-12T00:59:48.189215+0000","last_undegraded":"2024-09-12T00:59:48.189215+0000","last_fullsized":"2024-09-12T00:59:48.189215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:47.896665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"268'155","reported_seq":721,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.176909+0000","last_change":"2024-09-12T00:16:01.052772+0000","last_active":"2024-09-12T00:59:48.176909+0000","last_peered":"2024-09-12T00:59:48.176909+0000","last_clean":"2024-09-12T00:59:48.176909+0000","last_became_active":"2024-09-12T00:16:01.050630+0000","last_became_peered":"2024-09-12T00:16:01.050630+0000","last_unstale":"2024-09-12T00:59:48.176909+0000","last_undegraded":"2024-09-12T00:59:48.176909+0000","last_fullsized":"2024-09-12T00:59:48.176909+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:59.467265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":205,"num_read_kb":196,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"268'797","reported_seq":2727,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.127672+0000","last_change":"2024-09-12T00:16:03.104886+0000","last_active":"2024-09-12T01:02:37.127672+0000","last_peered":"2024-09-12T01:02:37.127672+0000","last_clean":"2024-09-12T01:02:37.127672+0000","last_became_active":"2024-09-12T00:16:03.104125+0000","last_became_peered":"2024-09-12T00:16:03.104125+0000","last_unstale":"2024-09-12T01:02:37.127672+0000","last_undegraded":"2024-09-12T01:02:37.127672+0000","last_fullsized":"2024-09-12T01:02:37.127672+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:43.285245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"268'113","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:17.202074+0000","last_change":"2024-09-12T00:16:05.115377+0000","last_active":"2024-09-12T01:01:17.202074+0000","last_peered":"2024-09-12T01:01:17.202074+0000","last_clean":"2024-09-12T01:01:17.202074+0000","last_became_active":"2024-09-12T00:16:05.114695+0000","last_became_peered":"2024-09-12T00:16:05.114695+0000","last_unstale":"2024-09-12T01:01:17.202074+0000","last_undegraded":"2024-09-12T01:01:17.202074+0000","last_fullsized":"2024-09-12T01:01:17.202074+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:16.956956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":134,"num_write":263,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"268'786","reported_seq":2351,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.228575+0000","last_change":"2024-09-12T00:15:57.028597+0000","last_active":"2024-09-12T01:01:07.228575+0000","last_peered":"2024-09-12T01:01:07.228575+0000","last_clean":"2024-09-12T01:01:07.228575+0000","last_became_active":"2024-09-12T00:15:57.027778+0000","last_became_peered":"2024-09-12T00:15:57.027778+0000","last_unstale":"2024-09-12T01:01:07.228575+0000","last_undegraded":"2024-09-12T01:01:07.228575+0000","last_fullsized":"2024-09-12T01:01:07.228575+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:34.509309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3889,"num_read_kb":3532,"num_write":1033,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"268'367","reported_seq":1060,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.977283+0000","last_change":"2024-09-12T00:15:55.049561+0000","last_active":"2024-09-12T01:02:37.977283+0000","last_peered":"2024-09-12T01:02:37.977283+0000","last_clean":"2024-09-12T01:02:37.977283+0000","last_became_active":"2024-09-12T00:15:55.048610+0000","last_became_peered":"2024-09-12T00:15:55.048610+0000","last_unstale":"2024-09-12T01:02:37.977283+0000","last_undegraded":"2024-09-12T01:02:37.977283+0000","last_fullsized":"2024-09-12T01:02:37.977283+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:41.138699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7799667,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":650,"num_read_kb":32494,"num_write":1262,"num_write_kb":43441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.171642+0000","last_change":"2024-09-12T00:15:42.117262+0000","last_active":"2024-09-12T00:59:03.171642+0000","last_peered":"2024-09-12T00:59:03.171642+0000","last_clean":"2024-09-12T00:59:03.171642+0000","last_became_active":"2024-09-12T00:15:40.660718+0000","last_became_peered":"2024-09-12T00:15:40.660718+0000","last_unstale":"2024-09-12T00:59:03.171642+0000","last_undegraded":"2024-09-12T00:59:03.171642+0000","last_fullsized":"2024-09-12T00:59:03.171642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:04.909588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080064100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"38'5","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.084832+0000","last_change":"2024-09-12T00:15:59.023300+0000","last_active":"2024-09-12T01:02:37.084832+0000","last_peered":"2024-09-12T01:02:37.084832+0000","last_clean":"2024-09-12T01:02:37.084832+0000","last_became_active":"2024-09-12T00:15:59.022598+0000","last_became_peered":"2024-09-12T00:15:59.022598+0000","last_unstale":"2024-09-12T01:02:37.084832+0000","last_undegraded":"2024-09-12T01:02:37.084832+0000","last_fullsized":"2024-09-12T01:02:37.084832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:14.157447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"268'111","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:49.224395+0000","last_change":"2024-09-12T00:16:01.063640+0000","last_active":"2024-09-12T00:59:49.224395+0000","last_peered":"2024-09-12T00:59:49.224395+0000","last_clean":"2024-09-12T00:59:49.224395+0000","last_became_active":"2024-09-12T00:16:01.061378+0000","last_became_peered":"2024-09-12T00:16:01.061378+0000","last_unstale":"2024-09-12T00:59:49.224395+0000","last_undegraded":"2024-09-12T00:59:49.224395+0000","last_fullsized":"2024-09-12T00:59:49.224395+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:32.478977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":124,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"268'810","reported_seq":4440,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.075572+0000","last_change":"2024-09-12T00:16:03.098212+0000","last_active":"2024-09-12T01:02:12.075572+0000","last_peered":"2024-09-12T01:02:12.075572+0000","last_clean":"2024-09-12T01:02:12.075572+0000","last_became_active":"2024-09-12T00:16:03.097533+0000","last_became_peered":"2024-09-12T00:16:03.097533+0000","last_unstale":"2024-09-12T01:02:12.075572+0000","last_undegraded":"2024-09-12T01:02:12.075572+0000","last_fullsized":"2024-09-12T01:02:12.075572+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:57.487410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"268'165","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:40.003597+0000","last_change":"2024-09-12T00:16:05.110783+0000","last_active":"2024-09-12T01:00:40.003597+0000","last_peered":"2024-09-12T01:00:40.003597+0000","last_clean":"2024-09-12T01:00:40.003597+0000","last_became_active":"2024-09-12T00:16:05.110012+0000","last_became_peered":"2024-09-12T00:16:05.110012+0000","last_unstale":"2024-09-12T01:00:40.003597+0000","last_undegraded":"2024-09-12T01:00:40.003597+0000","last_fullsized":"2024-09-12T01:00:40.003597+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:27.489900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":392,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"268'378","reported_seq":1830,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.582868+0000","last_change":"2024-09-12T00:15:57.024825+0000","last_active":"2024-09-12T01:01:09.582868+0000","last_peered":"2024-09-12T01:01:09.582868+0000","last_clean":"2024-09-12T01:01:09.582868+0000","last_became_active":"2024-09-12T00:15:57.024399+0000","last_became_peered":"2024-09-12T00:15:57.024399+0000","last_unstale":"2024-09-12T01:01:09.582868+0000","last_undegraded":"2024-09-12T01:01:09.582868+0000","last_fullsized":"2024-09-12T01:01:09.582868+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:54.519754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2040,"num_read_kb":1940,"num_write":430,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"268'296","reported_seq":939,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.968987+0000","last_change":"2024-09-12T00:15:55.065586+0000","last_active":"2024-09-12T01:02:37.968987+0000","last_peered":"2024-09-12T01:02:37.968987+0000","last_clean":"2024-09-12T01:02:37.968987+0000","last_became_active":"2024-09-12T00:15:55.064782+0000","last_became_peered":"2024-09-12T00:15:55.064782+0000","last_unstale":"2024-09-12T01:02:37.968987+0000","last_undegraded":"2024-09-12T01:02:37.968987+0000","last_fullsized":"2024-09-12T01:02:37.968987+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:16.186392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7298334,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":449,"num_read_kb":4021,"num_write":1019,"num_write_kb":34802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:04.213089+0000","last_change":"2024-09-12T00:15:42.091675+0000","last_active":"2024-09-12T00:59:04.213089+0000","last_peered":"2024-09-12T00:59:04.213089+0000","last_clean":"2024-09-12T00:59:04.213089+0000","last_became_active":"2024-09-12T00:15:40.663617+0000","last_became_peered":"2024-09-12T00:15:40.663617+0000","last_unstale":"2024-09-12T00:59:04.213089+0000","last_undegraded":"2024-09-12T00:59:04.213089+0000","last_fullsized":"2024-09-12T00:59:04.213089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:31.309528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002428801,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.189481+0000","last_change":"2024-09-12T00:15:59.040528+0000","last_active":"2024-09-12T01:00:13.189481+0000","last_peered":"2024-09-12T01:00:13.189481+0000","last_clean":"2024-09-12T01:00:13.189481+0000","last_became_active":"2024-09-12T00:15:59.039777+0000","last_became_peered":"2024-09-12T00:15:59.039777+0000","last_unstale":"2024-09-12T01:00:13.189481+0000","last_undegraded":"2024-09-12T01:00:13.189481+0000","last_fullsized":"2024-09-12T01:00:13.189481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:55.960948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"268'739","reported_seq":1448,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.174729+0000","last_change":"2024-09-12T00:16:01.052709+0000","last_active":"2024-09-12T01:02:37.174729+0000","last_peered":"2024-09-12T01:02:37.174729+0000","last_clean":"2024-09-12T01:02:37.174729+0000","last_became_active":"2024-09-12T00:16:01.051967+0000","last_became_peered":"2024-09-12T00:16:01.051967+0000","last_unstale":"2024-09-12T01:02:37.174729+0000","last_undegraded":"2024-09-12T01:02:37.174729+0000","last_fullsized":"2024-09-12T01:02:37.174729+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:10.600964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176700,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1312,"num_read_kb":2809,"num_write":1092,"num_write_kb":916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.183148+0000","last_change":"2024-09-12T00:16:03.092521+0000","last_active":"2024-09-12T00:59:48.183148+0000","last_peered":"2024-09-12T00:59:48.183148+0000","last_clean":"2024-09-12T00:59:48.183148+0000","last_became_active":"2024-09-12T00:16:03.091920+0000","last_became_peered":"2024-09-12T00:16:03.091920+0000","last_unstale":"2024-09-12T00:59:48.183148+0000","last_undegraded":"2024-09-12T00:59:48.183148+0000","last_fullsized":"2024-09-12T00:59:48.183148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:35.406048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"268'139","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.474966+0000","last_change":"2024-09-12T00:16:05.113388+0000","last_active":"2024-09-12T01:01:06.474966+0000","last_peered":"2024-09-12T01:01:06.474966+0000","last_clean":"2024-09-12T01:01:06.474966+0000","last_became_active":"2024-09-12T00:16:05.112774+0000","last_became_peered":"2024-09-12T00:16:05.112774+0000","last_unstale":"2024-09-12T01:01:06.474966+0000","last_undegraded":"2024-09-12T01:01:06.474966+0000","last_fullsized":"2024-09-12T01:01:06.474966+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:27.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":230,"num_write":341,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"268'111","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.376870+0000","last_change":"2024-09-12T00:16:05.098437+0000","last_active":"2024-09-12T01:01:07.376870+0000","last_peered":"2024-09-12T01:01:07.376870+0000","last_clean":"2024-09-12T01:01:07.376870+0000","last_became_active":"2024-09-12T00:16:05.097548+0000","last_became_peered":"2024-09-12T00:16:05.097548+0000","last_unstale":"2024-09-12T01:01:07.376870+0000","last_undegraded":"2024-09-12T01:01:07.376870+0000","last_fullsized":"2024-09-12T01:01:07.376870+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:14.723156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":186,"num_read_kb":184,"num_write":255,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"268'852","reported_seq":2471,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.159422+0000","last_change":"2024-09-12T00:15:57.024504+0000","last_active":"2024-09-12T01:01:02.159422+0000","last_peered":"2024-09-12T01:01:02.159422+0000","last_clean":"2024-09-12T01:01:02.159422+0000","last_became_active":"2024-09-12T00:15:57.024237+0000","last_became_peered":"2024-09-12T00:15:57.024237+0000","last_unstale":"2024-09-12T01:01:02.159422+0000","last_undegraded":"2024-09-12T01:01:02.159422+0000","last_fullsized":"2024-09-12T01:01:02.159422+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:13.214327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4086,"num_read_kb":3684,"num_write":1101,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"268'274","reported_seq":915,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.675585+0000","last_change":"2024-09-12T00:16:26.420540+0000","last_active":"2024-09-12T01:02:38.675585+0000","last_peered":"2024-09-12T01:02:38.675585+0000","last_clean":"2024-09-12T01:02:38.675585+0000","last_became_active":"2024-09-12T00:16:26.420272+0000","last_became_peered":"2024-09-12T00:16:26.420272+0000","last_unstale":"2024-09-12T01:02:38.675585+0000","last_undegraded":"2024-09-12T01:02:38.675585+0000","last_fullsized":"2024-09-12T01:02:38.675585+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:08.598775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239237,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":393,"num_read_kb":13074,"num_write":935,"num_write_kb":25707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,0],"acting":[3,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"38'3","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.085598+0000","last_change":"2024-09-12T00:15:59.040011+0000","last_active":"2024-09-12T01:02:37.085598+0000","last_peered":"2024-09-12T01:02:37.085598+0000","last_clean":"2024-09-12T01:02:37.085598+0000","last_became_active":"2024-09-12T00:15:59.039169+0000","last_became_peered":"2024-09-12T00:15:59.039169+0000","last_unstale":"2024-09-12T01:02:37.085598+0000","last_undegraded":"2024-09-12T01:02:37.085598+0000","last_fullsized":"2024-09-12T01:02:37.085598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:42.316880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"268'285","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.517600+0000","last_change":"2024-09-12T00:16:01.067282+0000","last_active":"2024-09-12T01:02:37.517600+0000","last_peered":"2024-09-12T01:02:37.517600+0000","last_clean":"2024-09-12T01:02:37.517600+0000","last_became_active":"2024-09-12T00:16:01.066524+0000","last_became_peered":"2024-09-12T00:16:01.066524+0000","last_unstale":"2024-09-12T01:02:37.517600+0000","last_undegraded":"2024-09-12T01:02:37.517600+0000","last_fullsized":"2024-09-12T01:02:37.517600+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:46.086778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43678,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1068,"num_write":390,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:07.155814+0000","last_change":"2024-09-12T00:16:03.070194+0000","last_active":"2024-09-12T00:58:07.155814+0000","last_peered":"2024-09-12T00:58:07.155814+0000","last_clean":"2024-09-12T00:58:07.155814+0000","last_became_active":"2024-09-12T00:16:03.069399+0000","last_became_peered":"2024-09-12T00:16:03.069399+0000","last_unstale":"2024-09-12T00:58:07.155814+0000","last_undegraded":"2024-09-12T00:58:07.155814+0000","last_fullsized":"2024-09-12T00:58:07.155814+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:53.022367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"268'132","reported_seq":623,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.173811+0000","last_change":"2024-09-12T00:16:05.103043+0000","last_active":"2024-09-12T01:00:52.173811+0000","last_peered":"2024-09-12T01:00:52.173811+0000","last_clean":"2024-09-12T01:00:52.173811+0000","last_became_active":"2024-09-12T00:16:05.102118+0000","last_became_peered":"2024-09-12T00:16:05.102118+0000","last_unstale":"2024-09-12T01:00:52.173811+0000","last_undegraded":"2024-09-12T01:00:52.173811+0000","last_fullsized":"2024-09-12T01:00:52.173811+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:10.930503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":111,"num_write":330,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"268'496","reported_seq":2220,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.446580+0000","last_change":"2024-09-12T00:15:57.032023+0000","last_active":"2024-09-12T01:01:06.446580+0000","last_peered":"2024-09-12T01:01:06.446580+0000","last_clean":"2024-09-12T01:01:06.446580+0000","last_became_active":"2024-09-12T00:15:57.031322+0000","last_became_peered":"2024-09-12T00:15:57.031322+0000","last_unstale":"2024-09-12T01:01:06.446580+0000","last_undegraded":"2024-09-12T01:01:06.446580+0000","last_fullsized":"2024-09-12T01:01:06.446580+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:25.211444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2639,"num_write":567,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"268'406","reported_seq":1114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.859019+0000","last_change":"2024-09-12T00:15:55.066489+0000","last_active":"2024-09-12T01:02:37.859019+0000","last_peered":"2024-09-12T01:02:37.859019+0000","last_clean":"2024-09-12T01:02:37.859019+0000","last_became_active":"2024-09-12T00:15:55.065964+0000","last_became_peered":"2024-09-12T00:15:55.065964+0000","last_unstale":"2024-09-12T01:02:37.859019+0000","last_undegraded":"2024-09-12T01:02:37.859019+0000","last_fullsized":"2024-09-12T01:02:37.859019+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:04.361682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11388245,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":854,"num_read_kb":8759,"num_write":1256,"num_write_kb":27844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:03.156936+0000","last_change":"2024-09-12T00:15:59.044538+0000","last_active":"2024-09-12T00:58:03.156936+0000","last_peered":"2024-09-12T00:58:03.156936+0000","last_clean":"2024-09-12T00:58:03.156936+0000","last_became_active":"2024-09-12T00:15:59.043146+0000","last_became_peered":"2024-09-12T00:15:59.043146+0000","last_unstale":"2024-09-12T00:58:03.156936+0000","last_undegraded":"2024-09-12T00:58:03.156936+0000","last_fullsized":"2024-09-12T00:58:03.156936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:38.791557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"268'49","reported_seq":557,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:42.098355+0000","last_change":"2024-09-12T00:16:01.055742+0000","last_active":"2024-09-12T00:58:42.098355+0000","last_peered":"2024-09-12T00:58:42.098355+0000","last_clean":"2024-09-12T00:58:42.098355+0000","last_became_active":"2024-09-12T00:16:01.055002+0000","last_became_peered":"2024-09-12T00:16:01.055002+0000","last_unstale":"2024-09-12T00:58:42.098355+0000","last_undegraded":"2024-09-12T00:58:42.098355+0000","last_fullsized":"2024-09-12T00:58:42.098355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:31.414501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:03.161791+0000","last_change":"2024-09-12T00:16:03.108240+0000","last_active":"2024-09-12T00:58:03.161791+0000","last_peered":"2024-09-12T00:58:03.161791+0000","last_clean":"2024-09-12T00:58:03.161791+0000","last_became_active":"2024-09-12T00:16:03.107695+0000","last_became_peered":"2024-09-12T00:16:03.107695+0000","last_unstale":"2024-09-12T00:58:03.161791+0000","last_undegraded":"2024-09-12T00:58:03.161791+0000","last_fullsized":"2024-09-12T00:58:03.161791+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:20.303982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"268'245","reported_seq":797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.454102+0000","last_change":"2024-09-12T00:16:05.107880+0000","last_active":"2024-09-12T01:01:06.454102+0000","last_peered":"2024-09-12T01:01:06.454102+0000","last_clean":"2024-09-12T01:01:06.454102+0000","last_became_active":"2024-09-12T00:16:05.106742+0000","last_became_peered":"2024-09-12T00:16:05.106742+0000","last_unstale":"2024-09-12T01:01:06.454102+0000","last_undegraded":"2024-09-12T01:01:06.454102+0000","last_fullsized":"2024-09-12T01:01:06.454102+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:30.878014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":438,"num_read_kb":396,"num_write":482,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"268'395","reported_seq":1832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:48.415779+0000","last_change":"2024-09-12T00:15:57.016176+0000","last_active":"2024-09-12T01:00:48.415779+0000","last_peered":"2024-09-12T01:00:48.415779+0000","last_clean":"2024-09-12T01:00:48.415779+0000","last_became_active":"2024-09-12T00:15:57.015397+0000","last_became_peered":"2024-09-12T00:15:57.015397+0000","last_unstale":"2024-09-12T01:00:48.415779+0000","last_undegraded":"2024-09-12T01:00:48.415779+0000","last_fullsized":"2024-09-12T01:00:48.415779+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:29.776854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2041,"num_read_kb":1937,"num_write":459,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"268'280","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.041793+0000","last_change":"2024-09-12T00:15:55.064342+0000","last_active":"2024-09-12T01:02:38.041793+0000","last_peered":"2024-09-12T01:02:38.041793+0000","last_clean":"2024-09-12T01:02:38.041793+0000","last_became_active":"2024-09-12T00:15:55.062990+0000","last_became_peered":"2024-09-12T00:15:55.062990+0000","last_unstale":"2024-09-12T01:02:38.041793+0000","last_undegraded":"2024-09-12T01:02:38.041793+0000","last_fullsized":"2024-09-12T01:02:38.041793+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:44.373318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":866212,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":402,"num_read_kb":9756,"num_write":957,"num_write_kb":17415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:03.161732+0000","last_change":"2024-09-12T00:15:59.029632+0000","last_active":"2024-09-12T00:58:03.161732+0000","last_peered":"2024-09-12T00:58:03.161732+0000","last_clean":"2024-09-12T00:58:03.161732+0000","last_became_active":"2024-09-12T00:15:59.029162+0000","last_became_peered":"2024-09-12T00:15:59.029162+0000","last_unstale":"2024-09-12T00:58:03.161732+0000","last_undegraded":"2024-09-12T00:58:03.161732+0000","last_fullsized":"2024-09-12T00:58:03.161732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:41.881067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"268'279","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.978813+0000","last_change":"2024-09-12T00:16:01.060247+0000","last_active":"2024-09-12T01:02:11.978813+0000","last_peered":"2024-09-12T01:02:11.978813+0000","last_clean":"2024-09-12T01:02:11.978813+0000","last_became_active":"2024-09-12T00:16:01.059517+0000","last_became_peered":"2024-09-12T00:16:01.059517+0000","last_unstale":"2024-09-12T01:02:11.978813+0000","last_undegraded":"2024-09-12T01:02:11.978813+0000","last_fullsized":"2024-09-12T01:02:11.978813+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:40.375904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52297,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":447,"num_read_kb":874,"num_write":352,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:03.163061+0000","last_change":"2024-09-12T00:16:03.104263+0000","last_active":"2024-09-12T00:58:03.163061+0000","last_peered":"2024-09-12T00:58:03.163061+0000","last_clean":"2024-09-12T00:58:03.163061+0000","last_became_active":"2024-09-12T00:16:03.103630+0000","last_became_peered":"2024-09-12T00:16:03.103630+0000","last_unstale":"2024-09-12T00:58:03.163061+0000","last_undegraded":"2024-09-12T00:58:03.163061+0000","last_fullsized":"2024-09-12T00:58:03.163061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:39.452322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"268'165","reported_seq":678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:01.555845+0000","last_change":"2024-09-12T00:16:05.110450+0000","last_active":"2024-09-12T01:00:01.555845+0000","last_peered":"2024-09-12T01:00:01.555845+0000","last_clean":"2024-09-12T01:00:01.555845+0000","last_became_active":"2024-09-12T00:16:05.109745+0000","last_became_peered":"2024-09-12T00:16:05.109745+0000","last_unstale":"2024-09-12T01:00:01.555845+0000","last_undegraded":"2024-09-12T01:00:01.555845+0000","last_fullsized":"2024-09-12T01:00:01.555845+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:15.769156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":406,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"268'420","reported_seq":1857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506522+0000","last_change":"2024-09-12T00:15:57.030478+0000","last_active":"2024-09-12T01:01:09.506522+0000","last_peered":"2024-09-12T01:01:09.506522+0000","last_clean":"2024-09-12T01:01:09.506522+0000","last_became_active":"2024-09-12T00:15:57.028820+0000","last_became_peered":"2024-09-12T00:15:57.028820+0000","last_unstale":"2024-09-12T01:01:09.506522+0000","last_undegraded":"2024-09-12T01:01:09.506522+0000","last_fullsized":"2024-09-12T01:01:09.506522+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:55.701403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2332,"num_read_kb":2186,"num_write":478,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"268'251","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:51.564738+0000","last_change":"2024-09-12T00:15:55.059264+0000","last_active":"2024-09-12T01:00:51.564738+0000","last_peered":"2024-09-12T01:00:51.564738+0000","last_clean":"2024-09-12T01:00:51.564738+0000","last_became_active":"2024-09-12T00:15:55.054712+0000","last_became_peered":"2024-09-12T00:15:55.054712+0000","last_unstale":"2024-09-12T01:00:51.564738+0000","last_undegraded":"2024-09-12T01:00:51.564738+0000","last_fullsized":"2024-09-12T01:00:51.564738+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:52.726633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6327961,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":395,"num_read_kb":100892,"num_write":962,"num_write_kb":52799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:19.231696+0000","last_change":"2024-09-12T00:15:59.030022+0000","last_active":"2024-09-12T01:00:19.231696+0000","last_peered":"2024-09-12T01:00:19.231696+0000","last_clean":"2024-09-12T01:00:19.231696+0000","last_became_active":"2024-09-12T00:15:59.028885+0000","last_became_peered":"2024-09-12T00:15:59.028885+0000","last_unstale":"2024-09-12T01:00:19.231696+0000","last_undegraded":"2024-09-12T01:00:19.231696+0000","last_fullsized":"2024-09-12T01:00:19.231696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:22.611802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"268'265","reported_seq":827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.970700+0000","last_change":"2024-09-12T00:16:01.056020+0000","last_active":"2024-09-12T01:02:11.970700+0000","last_peered":"2024-09-12T01:02:11.970700+0000","last_clean":"2024-09-12T01:02:11.970700+0000","last_became_active":"2024-09-12T00:16:01.050654+0000","last_became_peered":"2024-09-12T00:16:01.050654+0000","last_unstale":"2024-09-12T01:02:11.970700+0000","last_undegraded":"2024-09-12T01:02:11.970700+0000","last_fullsized":"2024-09-12T01:02:11.970700+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:07.059509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56239,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":427,"num_read_kb":905,"num_write":352,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:07.155925+0000","last_change":"2024-09-12T00:16:03.089923+0000","last_active":"2024-09-12T00:58:07.155925+0000","last_peered":"2024-09-12T00:58:07.155925+0000","last_clean":"2024-09-12T00:58:07.155925+0000","last_became_active":"2024-09-12T00:16:03.088929+0000","last_became_peered":"2024-09-12T00:16:03.088929+0000","last_unstale":"2024-09-12T00:58:07.155925+0000","last_undegraded":"2024-09-12T00:58:07.155925+0000","last_fullsized":"2024-09-12T00:58:07.155925+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:16.321808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"268'421","reported_seq":2042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.226413+0000","last_change":"2024-09-12T00:15:57.040165+0000","last_active":"2024-09-12T01:01:07.226413+0000","last_peered":"2024-09-12T01:01:07.226413+0000","last_clean":"2024-09-12T01:01:07.226413+0000","last_became_active":"2024-09-12T00:15:57.039919+0000","last_became_peered":"2024-09-12T00:15:57.039919+0000","last_unstale":"2024-09-12T01:01:07.226413+0000","last_undegraded":"2024-09-12T01:01:07.226413+0000","last_fullsized":"2024-09-12T01:01:07.226413+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:23.081811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2299,"num_read_kb":2203,"num_write":481,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"268'232","reported_seq":833,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:56.961783+0000","last_change":"2024-09-12T00:15:55.079982+0000","last_active":"2024-09-12T00:59:56.961783+0000","last_peered":"2024-09-12T00:59:56.961783+0000","last_clean":"2024-09-12T00:59:56.961783+0000","last_became_active":"2024-09-12T00:15:55.079264+0000","last_became_peered":"2024-09-12T00:15:55.079264+0000","last_unstale":"2024-09-12T00:59:56.961783+0000","last_undegraded":"2024-09-12T00:59:56.961783+0000","last_fullsized":"2024-09-12T00:59:56.961783+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:11.776490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8632648,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":313,"num_read_kb":14024,"num_write":835,"num_write_kb":16591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.183037+0000","last_change":"2024-09-12T00:15:59.047833+0000","last_active":"2024-09-12T01:00:13.183037+0000","last_peered":"2024-09-12T01:00:13.183037+0000","last_clean":"2024-09-12T01:00:13.183037+0000","last_became_active":"2024-09-12T00:15:59.039042+0000","last_became_peered":"2024-09-12T00:15:59.039042+0000","last_unstale":"2024-09-12T01:00:13.183037+0000","last_undegraded":"2024-09-12T01:00:13.183037+0000","last_fullsized":"2024-09-12T01:00:13.183037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:09.753392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"268'490","reported_seq":1117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.005904+0000","last_change":"2024-09-12T00:16:01.063315+0000","last_active":"2024-09-12T01:02:38.005904+0000","last_peered":"2024-09-12T01:02:38.005904+0000","last_clean":"2024-09-12T01:02:38.005904+0000","last_became_active":"2024-09-12T00:16:01.062625+0000","last_became_peered":"2024-09-12T00:16:01.062625+0000","last_unstale":"2024-09-12T01:02:38.005904+0000","last_undegraded":"2024-09-12T01:02:38.005904+0000","last_fullsized":"2024-09-12T01:02:38.005904+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:42.064557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99308,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":891,"num_read_kb":2056,"num_write":776,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.169019+0000","last_change":"2024-09-12T00:16:03.088732+0000","last_active":"2024-09-12T00:58:33.169019+0000","last_peered":"2024-09-12T00:58:33.169019+0000","last_clean":"2024-09-12T00:58:33.169019+0000","last_became_active":"2024-09-12T00:16:03.087980+0000","last_became_peered":"2024-09-12T00:16:03.087980+0000","last_unstale":"2024-09-12T00:58:33.169019+0000","last_undegraded":"2024-09-12T00:58:33.169019+0000","last_fullsized":"2024-09-12T00:58:33.169019+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:06.045851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"268'129","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:43.109476+0000","last_change":"2024-09-12T00:16:05.099199+0000","last_active":"2024-09-12T01:00:43.109476+0000","last_peered":"2024-09-12T01:00:43.109476+0000","last_clean":"2024-09-12T01:00:43.109476+0000","last_became_active":"2024-09-12T00:16:05.098424+0000","last_became_peered":"2024-09-12T00:16:05.098424+0000","last_unstale":"2024-09-12T01:00:43.109476+0000","last_undegraded":"2024-09-12T01:00:43.109476+0000","last_fullsized":"2024-09-12T01:00:43.109476+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:24.228012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":165,"num_write":285,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"268'839","reported_seq":2428,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.158434+0000","last_change":"2024-09-12T00:15:57.023405+0000","last_active":"2024-09-12T01:01:02.158434+0000","last_peered":"2024-09-12T01:01:02.158434+0000","last_clean":"2024-09-12T01:01:02.158434+0000","last_became_active":"2024-09-12T00:15:57.022709+0000","last_became_peered":"2024-09-12T00:15:57.022709+0000","last_unstale":"2024-09-12T01:01:02.158434+0000","last_undegraded":"2024-09-12T01:01:02.158434+0000","last_fullsized":"2024-09-12T01:01:02.158434+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:43.347297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3967,"num_read_kb":3571,"num_write":1117,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"268'254","reported_seq":895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.954446+0000","last_change":"2024-09-12T00:15:55.065793+0000","last_active":"2024-09-12T01:02:37.954446+0000","last_peered":"2024-09-12T01:02:37.954446+0000","last_clean":"2024-09-12T01:02:37.954446+0000","last_became_active":"2024-09-12T00:15:55.064940+0000","last_became_peered":"2024-09-12T00:15:55.064940+0000","last_unstale":"2024-09-12T01:02:37.954446+0000","last_undegraded":"2024-09-12T01:02:37.954446+0000","last_fullsized":"2024-09-12T01:02:37.954446+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:58.611447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1910291,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":423,"num_read_kb":2788,"num_write":987,"num_write_kb":39220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.188274+0000","last_change":"2024-09-12T00:15:59.035109+0000","last_active":"2024-09-12T00:59:48.188274+0000","last_peered":"2024-09-12T00:59:48.188274+0000","last_clean":"2024-09-12T00:59:48.188274+0000","last_became_active":"2024-09-12T00:15:59.034648+0000","last_became_peered":"2024-09-12T00:15:59.034648+0000","last_unstale":"2024-09-12T00:59:48.188274+0000","last_undegraded":"2024-09-12T00:59:48.188274+0000","last_fullsized":"2024-09-12T00:59:48.188274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:33.763390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"268'277","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.973151+0000","last_change":"2024-09-12T00:16:01.048774+0000","last_active":"2024-09-12T01:02:11.973151+0000","last_peered":"2024-09-12T01:02:11.973151+0000","last_clean":"2024-09-12T01:02:11.973151+0000","last_became_active":"2024-09-12T00:16:01.046783+0000","last_became_peered":"2024-09-12T00:16:01.046783+0000","last_unstale":"2024-09-12T01:02:11.973151+0000","last_undegraded":"2024-09-12T01:02:11.973151+0000","last_fullsized":"2024-09-12T01:02:11.973151+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:16.650144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51471,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":467,"num_read_kb":911,"num_write":392,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:37.186492+0000","last_change":"2024-09-12T00:16:03.098371+0000","last_active":"2024-09-12T00:58:37.186492+0000","last_peered":"2024-09-12T00:58:37.186492+0000","last_clean":"2024-09-12T00:58:37.186492+0000","last_became_active":"2024-09-12T00:16:03.097160+0000","last_became_peered":"2024-09-12T00:16:03.097160+0000","last_unstale":"2024-09-12T00:58:37.186492+0000","last_undegraded":"2024-09-12T00:58:37.186492+0000","last_fullsized":"2024-09-12T00:58:37.186492+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:26.964444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"268'210","reported_seq":763,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:49.738687+0000","last_change":"2024-09-12T00:16:05.102618+0000","last_active":"2024-09-12T01:00:49.738687+0000","last_peered":"2024-09-12T01:00:49.738687+0000","last_clean":"2024-09-12T01:00:49.738687+0000","last_became_active":"2024-09-12T00:16:05.101338+0000","last_became_peered":"2024-09-12T00:16:05.101338+0000","last_unstale":"2024-09-12T01:00:49.738687+0000","last_undegraded":"2024-09-12T01:00:49.738687+0000","last_fullsized":"2024-09-12T01:00:49.738687+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:45.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1401,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":396,"num_read_kb":348,"num_write":595,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"268'504","reported_seq":2086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:53.114328+0000","last_change":"2024-09-12T00:15:57.035005+0000","last_active":"2024-09-12T01:00:53.114328+0000","last_peered":"2024-09-12T01:00:53.114328+0000","last_clean":"2024-09-12T01:00:53.114328+0000","last_became_active":"2024-09-12T00:15:57.034257+0000","last_became_peered":"2024-09-12T00:15:57.034257+0000","last_unstale":"2024-09-12T01:00:53.114328+0000","last_undegraded":"2024-09-12T01:00:53.114328+0000","last_fullsized":"2024-09-12T01:00:53.114328+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:16.698877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2760,"num_read_kb":2552,"num_write":653,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"268'308","reported_seq":1049,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.215872+0000","last_change":"2024-09-12T00:15:55.036424+0000","last_active":"2024-09-12T01:02:38.215872+0000","last_peered":"2024-09-12T01:02:38.215872+0000","last_clean":"2024-09-12T01:02:38.215872+0000","last_became_active":"2024-09-12T00:15:55.035741+0000","last_became_peered":"2024-09-12T00:15:55.035741+0000","last_unstale":"2024-09-12T01:02:38.215872+0000","last_undegraded":"2024-09-12T01:02:38.215872+0000","last_fullsized":"2024-09-12T01:02:38.215872+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:26.450236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5572564,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":642,"num_read_kb":41169,"num_write":1101,"num_write_kb":26675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.168968+0000","last_change":"2024-09-12T00:15:59.045330+0000","last_active":"2024-09-12T00:58:33.168968+0000","last_peered":"2024-09-12T00:58:33.168968+0000","last_clean":"2024-09-12T00:58:33.168968+0000","last_became_active":"2024-09-12T00:15:59.044761+0000","last_became_peered":"2024-09-12T00:15:59.044761+0000","last_unstale":"2024-09-12T00:58:33.168968+0000","last_undegraded":"2024-09-12T00:58:33.168968+0000","last_fullsized":"2024-09-12T00:58:33.168968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:47.536990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"268'292","reported_seq":872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.823176+0000","last_change":"2024-09-12T00:16:01.053808+0000","last_active":"2024-09-12T01:02:37.823176+0000","last_peered":"2024-09-12T01:02:37.823176+0000","last_clean":"2024-09-12T01:02:37.823176+0000","last_became_active":"2024-09-12T00:16:01.052731+0000","last_became_peered":"2024-09-12T00:16:01.052731+0000","last_unstale":"2024-09-12T01:02:37.823176+0000","last_undegraded":"2024-09-12T01:02:37.823176+0000","last_fullsized":"2024-09-12T01:02:37.823176+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:17.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50253,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":1058,"num_write":380,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:17.186579+0000","last_change":"2024-09-12T00:16:03.081577+0000","last_active":"2024-09-12T01:00:17.186579+0000","last_peered":"2024-09-12T01:00:17.186579+0000","last_clean":"2024-09-12T01:00:17.186579+0000","last_became_active":"2024-09-12T00:16:03.080825+0000","last_became_peered":"2024-09-12T00:16:03.080825+0000","last_unstale":"2024-09-12T01:00:17.186579+0000","last_undegraded":"2024-09-12T01:00:17.186579+0000","last_fullsized":"2024-09-12T01:00:17.186579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:06.840301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"268'153","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.041059+0000","last_change":"2024-09-12T00:16:05.098923+0000","last_active":"2024-09-12T01:02:12.041059+0000","last_peered":"2024-09-12T01:02:12.041059+0000","last_clean":"2024-09-12T01:02:12.041059+0000","last_became_active":"2024-09-12T00:16:05.098180+0000","last_became_peered":"2024-09-12T00:16:05.098180+0000","last_unstale":"2024-09-12T01:02:12.041059+0000","last_undegraded":"2024-09-12T01:02:12.041059+0000","last_fullsized":"2024-09-12T01:02:12.041059+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:05.523259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":95,"num_write":348,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"268'338","reported_seq":1661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.583002+0000","last_change":"2024-09-12T00:15:57.040279+0000","last_active":"2024-09-12T01:01:09.583002+0000","last_peered":"2024-09-12T01:01:09.583002+0000","last_clean":"2024-09-12T01:01:09.583002+0000","last_became_active":"2024-09-12T00:15:57.039580+0000","last_became_peered":"2024-09-12T00:15:57.039580+0000","last_unstale":"2024-09-12T01:01:09.583002+0000","last_undegraded":"2024-09-12T01:01:09.583002+0000","last_fullsized":"2024-09-12T01:01:09.583002+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:54.699867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1750,"num_read_kb":1664,"num_write":383,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"268'289","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.774346+0000","last_change":"2024-09-12T00:15:55.044496+0000","last_active":"2024-09-12T01:02:37.774346+0000","last_peered":"2024-09-12T01:02:37.774346+0000","last_clean":"2024-09-12T01:02:37.774346+0000","last_became_active":"2024-09-12T00:15:55.042851+0000","last_became_peered":"2024-09-12T00:15:55.042851+0000","last_unstale":"2024-09-12T01:02:37.774346+0000","last_undegraded":"2024-09-12T01:02:37.774346+0000","last_fullsized":"2024-09-12T01:02:37.774346+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:43.191900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12455127,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":366,"num_read_kb":20803,"num_write":1060,"num_write_kb":57854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.163967+0000","last_change":"2024-09-12T00:15:59.049421+0000","last_active":"2024-09-12T00:58:33.163967+0000","last_peered":"2024-09-12T00:58:33.163967+0000","last_clean":"2024-09-12T00:58:33.163967+0000","last_became_active":"2024-09-12T00:15:59.048632+0000","last_became_peered":"2024-09-12T00:15:59.048632+0000","last_unstale":"2024-09-12T00:58:33.163967+0000","last_undegraded":"2024-09-12T00:58:33.163967+0000","last_fullsized":"2024-09-12T00:58:33.163967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:08.230944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"268'84","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:14.230651+0000","last_change":"2024-09-12T00:16:01.046254+0000","last_active":"2024-09-12T01:00:14.230651+0000","last_peered":"2024-09-12T01:00:14.230651+0000","last_clean":"2024-09-12T01:00:14.230651+0000","last_became_active":"2024-09-12T00:16:01.045565+0000","last_became_peered":"2024-09-12T00:16:01.045565+0000","last_unstale":"2024-09-12T01:00:14.230651+0000","last_undegraded":"2024-09-12T01:00:14.230651+0000","last_fullsized":"2024-09-12T01:00:14.230651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:51.429929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":132,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"268'784","reported_seq":4428,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.124964+0000","last_change":"2024-09-12T00:16:03.092271+0000","last_active":"2024-09-12T01:02:37.124964+0000","last_peered":"2024-09-12T01:02:37.124964+0000","last_clean":"2024-09-12T01:02:37.124964+0000","last_became_active":"2024-09-12T00:16:03.091506+0000","last_became_peered":"2024-09-12T00:16:03.091506+0000","last_unstale":"2024-09-12T01:02:37.124964+0000","last_undegraded":"2024-09-12T01:02:37.124964+0000","last_fullsized":"2024-09-12T01:02:37.124964+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:30.561330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"268'114","reported_seq":621,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.234041+0000","last_change":"2024-09-12T00:16:05.102360+0000","last_active":"2024-09-12T01:00:29.234041+0000","last_peered":"2024-09-12T01:00:29.234041+0000","last_clean":"2024-09-12T01:00:29.234041+0000","last_became_active":"2024-09-12T00:16:05.101500+0000","last_became_peered":"2024-09-12T00:16:05.101500+0000","last_unstale":"2024-09-12T01:00:29.234041+0000","last_undegraded":"2024-09-12T01:00:29.234041+0000","last_fullsized":"2024-09-12T01:00:29.234041+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.731815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"268'1099","reported_seq":2633,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:58.206504+0000","last_change":"2024-09-12T00:15:57.056750+0000","last_active":"2024-09-12T01:00:58.206504+0000","last_peered":"2024-09-12T01:00:58.206504+0000","last_clean":"2024-09-12T01:00:58.206504+0000","last_became_active":"2024-09-12T00:15:57.056507+0000","last_became_peered":"2024-09-12T00:15:57.056507+0000","last_unstale":"2024-09-12T01:00:58.206504+0000","last_undegraded":"2024-09-12T01:00:58.206504+0000","last_fullsized":"2024-09-12T01:00:58.206504+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":1000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:40.456581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5000,"num_read_kb":4445,"num_write":1493,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"268'324","reported_seq":1179,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.087479+0000","last_change":"2024-09-12T00:15:55.051781+0000","last_active":"2024-09-12T01:02:38.087479+0000","last_peered":"2024-09-12T01:02:38.087479+0000","last_clean":"2024-09-12T01:02:38.087479+0000","last_became_active":"2024-09-12T00:15:55.051336+0000","last_became_peered":"2024-09-12T00:15:55.051336+0000","last_unstale":"2024-09-12T01:02:38.087479+0000","last_undegraded":"2024-09-12T01:02:38.087479+0000","last_fullsized":"2024-09-12T01:02:38.087479+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:16.141015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5744009,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":976,"num_read_kb":8590,"num_write":1248,"num_write_kb":12738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.169997+0000","last_change":"2024-09-12T00:15:59.047376+0000","last_active":"2024-09-12T00:58:33.169997+0000","last_peered":"2024-09-12T00:58:33.169997+0000","last_clean":"2024-09-12T00:58:33.169997+0000","last_became_active":"2024-09-12T00:15:59.046538+0000","last_became_peered":"2024-09-12T00:15:59.046538+0000","last_unstale":"2024-09-12T00:58:33.169997+0000","last_undegraded":"2024-09-12T00:58:33.169997+0000","last_fullsized":"2024-09-12T00:58:33.169997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:18.952950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"268'322","reported_seq":924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.948102+0000","last_change":"2024-09-12T00:16:01.052369+0000","last_active":"2024-09-12T01:02:11.948102+0000","last_peered":"2024-09-12T01:02:11.948102+0000","last_clean":"2024-09-12T01:02:11.948102+0000","last_became_active":"2024-09-12T00:16:01.051648+0000","last_became_peered":"2024-09-12T00:16:01.051648+0000","last_unstale":"2024-09-12T01:02:11.948102+0000","last_undegraded":"2024-09-12T01:02:11.948102+0000","last_fullsized":"2024-09-12T01:02:11.948102+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:31.858718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57323,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":525,"num_read_kb":1023,"num_write":426,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179642+0000","last_change":"2024-09-12T00:16:03.086923+0000","last_active":"2024-09-12T00:59:33.179642+0000","last_peered":"2024-09-12T00:59:33.179642+0000","last_clean":"2024-09-12T00:59:33.179642+0000","last_became_active":"2024-09-12T00:16:03.086333+0000","last_became_peered":"2024-09-12T00:16:03.086333+0000","last_unstale":"2024-09-12T00:59:33.179642+0000","last_undegraded":"2024-09-12T00:59:33.179642+0000","last_fullsized":"2024-09-12T00:59:33.179642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:22.916351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"268'125","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:04.626052+0000","last_change":"2024-09-12T00:16:05.108248+0000","last_active":"2024-09-12T01:01:04.626052+0000","last_peered":"2024-09-12T01:01:04.626052+0000","last_clean":"2024-09-12T01:01:04.626052+0000","last_became_active":"2024-09-12T00:16:05.107284+0000","last_became_peered":"2024-09-12T00:16:05.107284+0000","last_unstale":"2024-09-12T01:01:04.626052+0000","last_undegraded":"2024-09-12T01:01:04.626052+0000","last_fullsized":"2024-09-12T01:01:04.626052+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:25.922474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":114,"num_write":286,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"268'488","reported_seq":2114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.993123+0000","last_change":"2024-09-12T00:15:57.022317+0000","last_active":"2024-09-12T01:00:29.993123+0000","last_peered":"2024-09-12T01:00:29.993123+0000","last_clean":"2024-09-12T01:00:29.993123+0000","last_became_active":"2024-09-12T00:15:57.021526+0000","last_became_peered":"2024-09-12T00:15:57.021526+0000","last_unstale":"2024-09-12T01:00:29.993123+0000","last_undegraded":"2024-09-12T01:00:29.993123+0000","last_fullsized":"2024-09-12T01:00:29.993123+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:49.730181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2702,"num_read_kb":2545,"num_write":554,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"268'327","reported_seq":1007,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.728298+0000","last_change":"2024-09-12T00:15:55.053021+0000","last_active":"2024-09-12T01:02:38.728298+0000","last_peered":"2024-09-12T01:02:38.728298+0000","last_clean":"2024-09-12T01:02:38.728298+0000","last_became_active":"2024-09-12T00:15:55.052503+0000","last_became_peered":"2024-09-12T00:15:55.052503+0000","last_unstale":"2024-09-12T01:02:38.728298+0000","last_undegraded":"2024-09-12T01:02:38.728298+0000","last_fullsized":"2024-09-12T01:02:38.728298+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:07.348592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5440553,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":540,"num_read_kb":52646,"num_write":1012,"num_write_kb":43222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.168868+0000","last_change":"2024-09-12T00:15:59.027111+0000","last_active":"2024-09-12T00:58:33.168868+0000","last_peered":"2024-09-12T00:58:33.168868+0000","last_clean":"2024-09-12T00:58:33.168868+0000","last_became_active":"2024-09-12T00:15:59.024564+0000","last_became_peered":"2024-09-12T00:15:59.024564+0000","last_unstale":"2024-09-12T00:58:33.168868+0000","last_undegraded":"2024-09-12T00:58:33.168868+0000","last_fullsized":"2024-09-12T00:58:33.168868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:49.354490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"268'244","reported_seq":819,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.950866+0000","last_change":"2024-09-12T00:16:01.055584+0000","last_active":"2024-09-12T01:02:11.950866+0000","last_peered":"2024-09-12T01:02:11.950866+0000","last_clean":"2024-09-12T01:02:11.950866+0000","last_became_active":"2024-09-12T00:16:01.051612+0000","last_became_peered":"2024-09-12T00:16:01.051612+0000","last_unstale":"2024-09-12T01:02:11.950866+0000","last_undegraded":"2024-09-12T01:02:11.950866+0000","last_fullsized":"2024-09-12T01:02:11.950866+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:47.313727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49092,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":405,"num_read_kb":839,"num_write":328,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:44.223108+0000","last_change":"2024-09-12T00:16:03.095905+0000","last_active":"2024-09-12T00:59:44.223108+0000","last_peered":"2024-09-12T00:59:44.223108+0000","last_clean":"2024-09-12T00:59:44.223108+0000","last_became_active":"2024-09-12T00:16:03.095016+0000","last_became_peered":"2024-09-12T00:16:03.095016+0000","last_unstale":"2024-09-12T00:59:44.223108+0000","last_undegraded":"2024-09-12T00:59:44.223108+0000","last_fullsized":"2024-09-12T00:59:44.223108+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:35.761981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"268'135","reported_seq":666,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.014067+0000","last_change":"2024-09-12T00:16:05.099520+0000","last_active":"2024-09-12T01:02:02.014067+0000","last_peered":"2024-09-12T01:02:02.014067+0000","last_clean":"2024-09-12T01:02:02.014067+0000","last_became_active":"2024-09-12T00:16:05.098796+0000","last_became_peered":"2024-09-12T00:16:05.098796+0000","last_unstale":"2024-09-12T01:02:02.014067+0000","last_undegraded":"2024-09-12T01:02:02.014067+0000","last_fullsized":"2024-09-12T01:02:02.014067+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:27.979474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":225,"num_write":347,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"268'416","reported_seq":1961,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.872184+0000","last_change":"2024-09-12T00:15:57.038940+0000","last_active":"2024-09-12T01:02:10.872184+0000","last_peered":"2024-09-12T01:02:10.872184+0000","last_clean":"2024-09-12T01:02:10.872184+0000","last_became_active":"2024-09-12T00:15:57.038127+0000","last_became_peered":"2024-09-12T00:15:57.038127+0000","last_unstale":"2024-09-12T01:02:10.872184+0000","last_undegraded":"2024-09-12T01:02:10.872184+0000","last_fullsized":"2024-09-12T01:02:10.872184+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:35.287613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2293,"num_read_kb":2185,"num_write":483,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"268'263","reported_seq":894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:42.506681+0000","last_change":"2024-09-12T00:15:55.076108+0000","last_active":"2024-09-12T01:00:42.506681+0000","last_peered":"2024-09-12T01:00:42.506681+0000","last_clean":"2024-09-12T01:00:42.506681+0000","last_became_active":"2024-09-12T00:15:55.074964+0000","last_became_peered":"2024-09-12T00:15:55.074964+0000","last_unstale":"2024-09-12T01:00:42.506681+0000","last_undegraded":"2024-09-12T01:00:42.506681+0000","last_fullsized":"2024-09-12T01:00:42.506681+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:29.685119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6899581,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":434,"num_read_kb":20127,"num_write":942,"num_write_kb":20535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.184985+0000","last_change":"2024-09-12T00:15:59.036962+0000","last_active":"2024-09-12T00:59:33.184985+0000","last_peered":"2024-09-12T00:59:33.184985+0000","last_clean":"2024-09-12T00:59:33.184985+0000","last_became_active":"2024-09-12T00:15:59.036492+0000","last_became_peered":"2024-09-12T00:15:59.036492+0000","last_unstale":"2024-09-12T00:59:33.184985+0000","last_undegraded":"2024-09-12T00:59:33.184985+0000","last_fullsized":"2024-09-12T00:59:33.184985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:26.416316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"268'247","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.671289+0000","last_change":"2024-09-12T00:16:01.053033+0000","last_active":"2024-09-12T01:02:37.671289+0000","last_peered":"2024-09-12T01:02:37.671289+0000","last_clean":"2024-09-12T01:02:37.671289+0000","last_became_active":"2024-09-12T00:16:01.050746+0000","last_became_peered":"2024-09-12T00:16:01.050746+0000","last_unstale":"2024-09-12T01:02:37.671289+0000","last_undegraded":"2024-09-12T01:02:37.671289+0000","last_fullsized":"2024-09-12T01:02:37.671289+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:56.194861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":412,"num_read_kb":978,"num_write":338,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:34.203198+0000","last_change":"2024-09-12T00:16:03.100996+0000","last_active":"2024-09-12T00:58:34.203198+0000","last_peered":"2024-09-12T00:58:34.203198+0000","last_clean":"2024-09-12T00:58:34.203198+0000","last_became_active":"2024-09-12T00:16:03.099890+0000","last_became_peered":"2024-09-12T00:16:03.099890+0000","last_unstale":"2024-09-12T00:58:34.203198+0000","last_undegraded":"2024-09-12T00:58:34.203198+0000","last_fullsized":"2024-09-12T00:58:34.203198+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:53.876340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"268'186","reported_seq":1673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.781143+0000","last_change":"2024-09-12T00:16:05.113925+0000","last_active":"2024-09-12T01:02:10.781143+0000","last_peered":"2024-09-12T01:02:10.781143+0000","last_clean":"2024-09-12T01:02:10.781143+0000","last_became_active":"2024-09-12T00:16:05.113207+0000","last_became_peered":"2024-09-12T00:16:05.113207+0000","last_unstale":"2024-09-12T01:02:10.781143+0000","last_undegraded":"2024-09-12T01:02:10.781143+0000","last_fullsized":"2024-09-12T01:02:10.781143+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:18.252728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1270,"num_read_kb":1246,"num_write":444,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"268'923","reported_seq":2663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506178+0000","last_change":"2024-09-12T00:15:57.013390+0000","last_active":"2024-09-12T01:01:09.506178+0000","last_peered":"2024-09-12T01:01:09.506178+0000","last_clean":"2024-09-12T01:01:09.506178+0000","last_became_active":"2024-09-12T00:15:57.012136+0000","last_became_peered":"2024-09-12T00:15:57.012136+0000","last_unstale":"2024-09-12T01:01:09.506178+0000","last_undegraded":"2024-09-12T01:01:09.506178+0000","last_fullsized":"2024-09-12T01:01:09.506178+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:10.566262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4477,"num_read_kb":4059,"num_write":1259,"num_write_kb":498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"268'301","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.003380+0000","last_change":"2024-09-12T00:15:55.079920+0000","last_active":"2024-09-12T01:02:10.003380+0000","last_peered":"2024-09-12T01:02:10.003380+0000","last_clean":"2024-09-12T01:02:10.003380+0000","last_became_active":"2024-09-12T00:15:55.079005+0000","last_became_peered":"2024-09-12T00:15:55.079005+0000","last_unstale":"2024-09-12T01:02:10.003380+0000","last_undegraded":"2024-09-12T01:02:10.003380+0000","last_fullsized":"2024-09-12T01:02:10.003380+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:58.600991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":888192,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":473,"num_read_kb":476,"num_write":1113,"num_write_kb":40462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:43.182050+0000","last_change":"2024-09-12T00:15:59.040566+0000","last_active":"2024-09-12T00:59:43.182050+0000","last_peered":"2024-09-12T00:59:43.182050+0000","last_clean":"2024-09-12T00:59:43.182050+0000","last_became_active":"2024-09-12T00:15:59.039674+0000","last_became_peered":"2024-09-12T00:15:59.039674+0000","last_unstale":"2024-09-12T00:59:43.182050+0000","last_undegraded":"2024-09-12T00:59:43.182050+0000","last_fullsized":"2024-09-12T00:59:43.182050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:23.557637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"268'344","reported_seq":946,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.914549+0000","last_change":"2024-09-12T00:16:01.052058+0000","last_active":"2024-09-12T01:02:37.914549+0000","last_peered":"2024-09-12T01:02:37.914549+0000","last_clean":"2024-09-12T01:02:37.914549+0000","last_became_active":"2024-09-12T00:16:01.051324+0000","last_became_peered":"2024-09-12T00:16:01.051324+0000","last_unstale":"2024-09-12T01:02:37.914549+0000","last_undegraded":"2024-09-12T01:02:37.914549+0000","last_fullsized":"2024-09-12T01:02:37.914549+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:07.219892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49632,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":580,"num_read_kb":1323,"num_write":476,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.163885+0000","last_change":"2024-09-12T00:16:03.100444+0000","last_active":"2024-09-12T00:58:33.163885+0000","last_peered":"2024-09-12T00:58:33.163885+0000","last_clean":"2024-09-12T00:58:33.163885+0000","last_became_active":"2024-09-12T00:16:03.099836+0000","last_became_peered":"2024-09-12T00:16:03.099836+0000","last_unstale":"2024-09-12T00:58:33.163885+0000","last_undegraded":"2024-09-12T00:58:33.163885+0000","last_fullsized":"2024-09-12T00:58:33.163885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:28.442530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"268'111","reported_seq":603,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.864539+0000","last_change":"2024-09-12T00:16:05.113973+0000","last_active":"2024-09-12T01:02:10.864539+0000","last_peered":"2024-09-12T01:02:10.864539+0000","last_clean":"2024-09-12T01:02:10.864539+0000","last_became_active":"2024-09-12T00:16:05.113231+0000","last_became_peered":"2024-09-12T00:16:05.113231+0000","last_unstale":"2024-09-12T01:02:10.864539+0000","last_undegraded":"2024-09-12T01:02:10.864539+0000","last_fullsized":"2024-09-12T01:02:10.864539+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:31.200737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":663,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":263,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"268'811","reported_seq":2398,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.231281+0000","last_change":"2024-09-12T00:15:57.031887+0000","last_active":"2024-09-12T01:01:07.231281+0000","last_peered":"2024-09-12T01:01:07.231281+0000","last_clean":"2024-09-12T01:01:07.231281+0000","last_became_active":"2024-09-12T00:15:57.031161+0000","last_became_peered":"2024-09-12T00:15:57.031161+0000","last_unstale":"2024-09-12T01:01:07.231281+0000","last_undegraded":"2024-09-12T01:01:07.231281+0000","last_fullsized":"2024-09-12T01:01:07.231281+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:00.259897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3882,"num_read_kb":3503,"num_write":1069,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"268'314","reported_seq":1080,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.117439+0000","last_change":"2024-09-12T00:15:55.042845+0000","last_active":"2024-09-12T01:02:38.117439+0000","last_peered":"2024-09-12T01:02:38.117439+0000","last_clean":"2024-09-12T01:02:38.117439+0000","last_became_active":"2024-09-12T00:15:55.042134+0000","last_became_peered":"2024-09-12T00:15:55.042134+0000","last_unstale":"2024-09-12T01:02:38.117439+0000","last_undegraded":"2024-09-12T01:02:38.117439+0000","last_fullsized":"2024-09-12T01:02:38.117439+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:24.618191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918416,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":825,"num_read_kb":50816,"num_write":1207,"num_write_kb":44406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'401","reported_seq":1855,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.867542+0000","last_change":"2024-09-12T00:15:57.043703+0000","last_active":"2024-09-12T01:02:10.867542+0000","last_peered":"2024-09-12T01:02:10.867542+0000","last_clean":"2024-09-12T01:02:10.867542+0000","last_became_active":"2024-09-12T00:15:57.043013+0000","last_became_peered":"2024-09-12T00:15:57.043013+0000","last_unstale":"2024-09-12T01:02:10.867542+0000","last_undegraded":"2024-09-12T01:02:10.867542+0000","last_fullsized":"2024-09-12T01:02:10.867542+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:02.318087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2106,"num_read_kb":1998,"num_write":459,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"268'237","reported_seq":864,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:03.258647+0000","last_change":"2024-09-12T00:15:55.063527+0000","last_active":"2024-09-12T01:01:03.258647+0000","last_peered":"2024-09-12T01:01:03.258647+0000","last_clean":"2024-09-12T01:01:03.258647+0000","last_became_active":"2024-09-12T00:15:55.062524+0000","last_became_peered":"2024-09-12T00:15:55.062524+0000","last_unstale":"2024-09-12T01:01:03.258647+0000","last_undegraded":"2024-09-12T01:01:03.258647+0000","last_fullsized":"2024-09-12T01:01:03.258647+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:23.930911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11786426,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":384,"num_read_kb":18226,"num_write":828,"num_write_kb":43043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"268'494","reported_seq":2210,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.226294+0000","last_change":"2024-09-12T00:15:57.029585+0000","last_active":"2024-09-12T01:01:07.226294+0000","last_peered":"2024-09-12T01:01:07.226294+0000","last_clean":"2024-09-12T01:01:07.226294+0000","last_became_active":"2024-09-12T00:15:57.018875+0000","last_became_peered":"2024-09-12T00:15:57.018875+0000","last_unstale":"2024-09-12T01:01:07.226294+0000","last_undegraded":"2024-09-12T01:01:07.226294+0000","last_fullsized":"2024-09-12T01:01:07.226294+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:10.062996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2775,"num_read_kb":2615,"num_write":593,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"268'335","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.974069+0000","last_change":"2024-09-12T00:15:55.064178+0000","last_active":"2024-09-12T01:02:38.974069+0000","last_peered":"2024-09-12T01:02:38.974069+0000","last_clean":"2024-09-12T01:02:38.974069+0000","last_became_active":"2024-09-12T00:15:55.063603+0000","last_became_peered":"2024-09-12T00:15:55.063603+0000","last_unstale":"2024-09-12T01:02:38.974069+0000","last_undegraded":"2024-09-12T01:02:38.974069+0000","last_fullsized":"2024-09-12T01:02:38.974069+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:29.018846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2056490,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":493,"num_read_kb":3291,"num_write":1111,"num_write_kb":12783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"268'390","reported_seq":1797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.016017+0000","last_change":"2024-09-12T00:15:57.031124+0000","last_active":"2024-09-12T01:00:47.016017+0000","last_peered":"2024-09-12T01:00:47.016017+0000","last_clean":"2024-09-12T01:00:47.016017+0000","last_became_active":"2024-09-12T00:15:57.030173+0000","last_became_peered":"2024-09-12T00:15:57.030173+0000","last_unstale":"2024-09-12T01:00:47.016017+0000","last_undegraded":"2024-09-12T01:00:47.016017+0000","last_fullsized":"2024-09-12T01:00:47.016017+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:54.011519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2013,"num_read_kb":1910,"num_write":436,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"268'308","reported_seq":1051,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:45.334227+0000","last_change":"2024-09-12T00:15:55.069041+0000","last_active":"2024-09-12T01:00:45.334227+0000","last_peered":"2024-09-12T01:00:45.334227+0000","last_clean":"2024-09-12T01:00:45.334227+0000","last_became_active":"2024-09-12T00:15:55.068349+0000","last_became_peered":"2024-09-12T00:15:55.068349+0000","last_unstale":"2024-09-12T01:00:45.334227+0000","last_undegraded":"2024-09-12T01:00:45.334227+0000","last_fullsized":"2024-09-12T01:00:45.334227+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:58.205254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13937614,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":785,"num_read_kb":11363,"num_write":1143,"num_write_kb":51000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"268'398","reported_seq":1882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.583028+0000","last_change":"2024-09-12T00:15:57.037970+0000","last_active":"2024-09-12T01:01:09.583028+0000","last_peered":"2024-09-12T01:01:09.583028+0000","last_clean":"2024-09-12T01:01:09.583028+0000","last_became_active":"2024-09-12T00:15:57.037204+0000","last_became_peered":"2024-09-12T00:15:57.037204+0000","last_unstale":"2024-09-12T01:01:09.583028+0000","last_undegraded":"2024-09-12T01:01:09.583028+0000","last_fullsized":"2024-09-12T01:01:09.583028+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:46.963139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2120,"num_read_kb":2017,"num_write":453,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"268'306","reported_seq":941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.178400+0000","last_change":"2024-09-12T00:15:55.072723+0000","last_active":"2024-09-12T01:02:38.178400+0000","last_peered":"2024-09-12T01:02:38.178400+0000","last_clean":"2024-09-12T01:02:38.178400+0000","last_became_active":"2024-09-12T00:15:55.071812+0000","last_became_peered":"2024-09-12T00:15:55.071812+0000","last_unstale":"2024-09-12T01:02:38.178400+0000","last_undegraded":"2024-09-12T01:02:38.178400+0000","last_fullsized":"2024-09-12T01:02:38.178400+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:47.837252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6136414,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":471,"num_read_kb":11485,"num_write":1102,"num_write_kb":34407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"268'581","reported_seq":2263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.158878+0000","last_change":"2024-09-12T00:15:57.033145+0000","last_active":"2024-09-12T01:01:02.158878+0000","last_peered":"2024-09-12T01:01:02.158878+0000","last_clean":"2024-09-12T01:01:02.158878+0000","last_became_active":"2024-09-12T00:15:57.032818+0000","last_became_peered":"2024-09-12T00:15:57.032818+0000","last_unstale":"2024-09-12T01:01:02.158878+0000","last_undegraded":"2024-09-12T01:01:02.158878+0000","last_fullsized":"2024-09-12T01:01:02.158878+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:32.583489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2922,"num_read_kb":2722,"num_write":707,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"268'297","reported_seq":973,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.117965+0000","last_change":"2024-09-12T00:15:55.052766+0000","last_active":"2024-09-12T01:02:38.117965+0000","last_peered":"2024-09-12T01:02:38.117965+0000","last_clean":"2024-09-12T01:02:38.117965+0000","last_became_active":"2024-09-12T00:15:55.050781+0000","last_became_peered":"2024-09-12T00:15:55.050781+0000","last_unstale":"2024-09-12T01:02:38.117965+0000","last_undegraded":"2024-09-12T01:02:38.117965+0000","last_fullsized":"2024-09-12T01:02:38.117965+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:34.653614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12378352,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":446,"num_read_kb":31943,"num_write":1024,"num_write_kb":41212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"268'801","reported_seq":2287,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.226718+0000","last_change":"2024-09-12T00:15:57.046222+0000","last_active":"2024-09-12T01:01:07.226718+0000","last_peered":"2024-09-12T01:01:07.226718+0000","last_clean":"2024-09-12T01:01:07.226718+0000","last_became_active":"2024-09-12T00:15:57.045500+0000","last_became_peered":"2024-09-12T00:15:57.045500+0000","last_unstale":"2024-09-12T01:01:07.226718+0000","last_undegraded":"2024-09-12T01:01:07.226718+0000","last_fullsized":"2024-09-12T01:01:07.226718+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:02.396896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3817,"num_read_kb":3427,"num_write":1098,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"268'267","reported_seq":889,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.190114+0000","last_change":"2024-09-12T00:15:55.055440+0000","last_active":"2024-09-12T01:02:38.190114+0000","last_peered":"2024-09-12T01:02:38.190114+0000","last_clean":"2024-09-12T01:02:38.190114+0000","last_became_active":"2024-09-12T00:15:55.054914+0000","last_became_peered":"2024-09-12T00:15:55.054914+0000","last_unstale":"2024-09-12T01:02:38.190114+0000","last_undegraded":"2024-09-12T01:02:38.190114+0000","last_fullsized":"2024-09-12T01:02:38.190114+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:21.527461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10801766,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":375,"num_read_kb":50632,"num_write":920,"num_write_kb":37363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"268'817","reported_seq":2510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:25.613084+0000","last_change":"2024-09-12T00:15:57.022003+0000","last_active":"2024-09-12T01:00:25.613084+0000","last_peered":"2024-09-12T01:00:25.613084+0000","last_clean":"2024-09-12T01:00:25.613084+0000","last_became_active":"2024-09-12T00:15:57.021622+0000","last_became_peered":"2024-09-12T00:15:57.021622+0000","last_unstale":"2024-09-12T01:00:25.613084+0000","last_undegraded":"2024-09-12T01:00:25.613084+0000","last_fullsized":"2024-09-12T01:00:25.613084+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.960528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4035,"num_read_kb":3684,"num_write":1067,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"268'289","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.489901+0000","last_change":"2024-09-12T00:15:55.068680+0000","last_active":"2024-09-12T01:00:47.489901+0000","last_peered":"2024-09-12T01:00:47.489901+0000","last_clean":"2024-09-12T01:00:47.489901+0000","last_became_active":"2024-09-12T00:15:55.055929+0000","last_became_peered":"2024-09-12T00:15:55.055929+0000","last_unstale":"2024-09-12T01:00:47.489901+0000","last_undegraded":"2024-09-12T01:00:47.489901+0000","last_fullsized":"2024-09-12T01:00:47.489901+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:15.633734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62773,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":490,"num_read_kb":583,"num_write":1145,"num_write_kb":30899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"268'837","reported_seq":2503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.883860+0000","last_change":"2024-09-12T00:15:57.040650+0000","last_active":"2024-09-12T01:02:10.883860+0000","last_peered":"2024-09-12T01:02:10.883860+0000","last_clean":"2024-09-12T01:02:10.883860+0000","last_became_active":"2024-09-12T00:15:57.039946+0000","last_became_peered":"2024-09-12T00:15:57.039946+0000","last_unstale":"2024-09-12T01:02:10.883860+0000","last_undegraded":"2024-09-12T01:02:10.883860+0000","last_fullsized":"2024-09-12T01:02:10.883860+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:12.893023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4272,"num_read_kb":3874,"num_write":1144,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"268'395","reported_seq":1124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.718354+0000","last_change":"2024-09-12T00:15:55.065969+0000","last_active":"2024-09-12T01:02:38.718354+0000","last_peered":"2024-09-12T01:02:38.718354+0000","last_clean":"2024-09-12T01:02:38.718354+0000","last_became_active":"2024-09-12T00:15:55.065129+0000","last_became_peered":"2024-09-12T00:15:55.065129+0000","last_unstale":"2024-09-12T01:02:38.718354+0000","last_undegraded":"2024-09-12T01:02:38.718354+0000","last_fullsized":"2024-09-12T01:02:38.718354+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:11.829722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236434,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":755,"num_read_kb":24147,"num_write":1296,"num_write_kb":32019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"268'876","reported_seq":2654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.883373+0000","last_change":"2024-09-12T00:15:57.052278+0000","last_active":"2024-09-12T01:02:10.883373+0000","last_peered":"2024-09-12T01:02:10.883373+0000","last_clean":"2024-09-12T01:02:10.883373+0000","last_became_active":"2024-09-12T00:15:57.051976+0000","last_became_peered":"2024-09-12T00:15:57.051976+0000","last_unstale":"2024-09-12T01:02:10.883373+0000","last_undegraded":"2024-09-12T01:02:10.883373+0000","last_fullsized":"2024-09-12T01:02:10.883373+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":800,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:02.396896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4749,"num_read_kb":4328,"num_write":1184,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"268'281","reported_seq":909,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.756472+0000","last_change":"2024-09-12T00:15:55.060643+0000","last_active":"2024-09-12T01:02:01.756472+0000","last_peered":"2024-09-12T01:02:01.756472+0000","last_clean":"2024-09-12T01:02:01.756472+0000","last_became_active":"2024-09-12T00:15:55.055449+0000","last_became_peered":"2024-09-12T00:15:55.055449+0000","last_unstale":"2024-09-12T01:02:01.756472+0000","last_undegraded":"2024-09-12T01:02:01.756472+0000","last_fullsized":"2024-09-12T01:02:01.756472+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:27.185874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73940,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":425,"num_read_kb":2263,"num_write":1020,"num_write_kb":24139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"268'787","reported_seq":2366,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.160044+0000","last_change":"2024-09-12T00:15:57.033089+0000","last_active":"2024-09-12T01:01:02.160044+0000","last_peered":"2024-09-12T01:01:02.160044+0000","last_clean":"2024-09-12T01:01:02.160044+0000","last_became_active":"2024-09-12T00:15:57.031976+0000","last_became_peered":"2024-09-12T00:15:57.031976+0000","last_unstale":"2024-09-12T01:01:02.160044+0000","last_undegraded":"2024-09-12T01:01:02.160044+0000","last_fullsized":"2024-09-12T01:01:02.160044+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:30.528175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3862,"num_read_kb":3503,"num_write":1033,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"268'321","reported_seq":971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.206389+0000","last_change":"2024-09-12T00:15:55.052989+0000","last_active":"2024-09-12T01:02:38.206389+0000","last_peered":"2024-09-12T01:02:38.206389+0000","last_clean":"2024-09-12T01:02:38.206389+0000","last_became_active":"2024-09-12T00:15:55.051451+0000","last_became_peered":"2024-09-12T00:15:55.051451+0000","last_unstale":"2024-09-12T01:02:38.206389+0000","last_undegraded":"2024-09-12T01:02:38.206389+0000","last_fullsized":"2024-09-12T01:02:38.206389+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:14.616053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10751670,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":514,"num_read_kb":17814,"num_write":1142,"num_write_kb":26945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"268'483","reported_seq":2159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:58.205844+0000","last_change":"2024-09-12T00:15:57.020535+0000","last_active":"2024-09-12T01:00:58.205844+0000","last_peered":"2024-09-12T01:00:58.205844+0000","last_clean":"2024-09-12T01:00:58.205844+0000","last_became_active":"2024-09-12T00:15:57.019963+0000","last_became_peered":"2024-09-12T00:15:57.019963+0000","last_unstale":"2024-09-12T01:00:58.205844+0000","last_undegraded":"2024-09-12T01:00:58.205844+0000","last_fullsized":"2024-09-12T01:00:58.205844+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:34.340309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2585,"num_read_kb":2455,"num_write":555,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"268'254","reported_seq":878,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.955956+0000","last_change":"2024-09-12T00:15:55.051310+0000","last_active":"2024-09-12T01:02:37.955956+0000","last_peered":"2024-09-12T01:02:37.955956+0000","last_clean":"2024-09-12T01:02:37.955956+0000","last_became_active":"2024-09-12T00:15:55.050267+0000","last_became_peered":"2024-09-12T00:15:55.050267+0000","last_unstale":"2024-09-12T01:02:37.955956+0000","last_undegraded":"2024-09-12T01:02:37.955956+0000","last_fullsized":"2024-09-12T01:02:37.955956+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:25.710871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2136315,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":396,"num_read_kb":8617,"num_write":983,"num_write_kb":22964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1339","reported_seq":3149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.016786+0000","last_change":"2024-09-12T00:15:57.045427+0000","last_active":"2024-09-12T01:00:47.016786+0000","last_peered":"2024-09-12T01:00:47.016786+0000","last_clean":"2024-09-12T01:00:47.016786+0000","last_became_active":"2024-09-12T00:15:57.045076+0000","last_became_peered":"2024-09-12T00:15:57.045076+0000","last_unstale":"2024-09-12T01:00:47.016786+0000","last_undegraded":"2024-09-12T01:00:47.016786+0000","last_fullsized":"2024-09-12T01:00:47.016786+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:48.293590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6209,"num_read_kb":5540,"num_write":1861,"num_write_kb":794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"268'287","reported_seq":925,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.983855+0000","last_change":"2024-09-12T00:15:55.065995+0000","last_active":"2024-09-12T01:02:37.983855+0000","last_peered":"2024-09-12T01:02:37.983855+0000","last_clean":"2024-09-12T01:02:37.983855+0000","last_became_active":"2024-09-12T00:15:55.061287+0000","last_became_peered":"2024-09-12T00:15:55.061287+0000","last_unstale":"2024-09-12T01:02:37.983855+0000","last_undegraded":"2024-09-12T01:02:37.983855+0000","last_fullsized":"2024-09-12T01:02:37.983855+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:58.543361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":479,"num_read_kb":733,"num_write":1182,"num_write_kb":3677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"268'404","reported_seq":1771,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:51.103353+0000","last_change":"2024-09-12T00:15:57.043968+0000","last_active":"2024-09-12T01:00:51.103353+0000","last_peered":"2024-09-12T01:00:51.103353+0000","last_clean":"2024-09-12T01:00:51.103353+0000","last_became_active":"2024-09-12T00:15:57.043158+0000","last_became_peered":"2024-09-12T00:15:57.043158+0000","last_unstale":"2024-09-12T01:00:51.103353+0000","last_undegraded":"2024-09-12T01:00:51.103353+0000","last_fullsized":"2024-09-12T01:00:51.103353+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:06.171447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1978,"num_read_kb":1859,"num_write":462,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"268'365","reported_seq":1051,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.627974+0000","last_change":"2024-09-12T00:15:55.059249+0000","last_active":"2024-09-12T01:02:38.627974+0000","last_peered":"2024-09-12T01:02:38.627974+0000","last_clean":"2024-09-12T01:02:38.627974+0000","last_became_active":"2024-09-12T00:15:55.058726+0000","last_became_peered":"2024-09-12T00:15:55.058726+0000","last_unstale":"2024-09-12T01:02:38.627974+0000","last_undegraded":"2024-09-12T01:02:38.627974+0000","last_fullsized":"2024-09-12T01:02:38.627974+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:59.008674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587009,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":582,"num_read_kb":57120,"num_write":1282,"num_write_kb":58223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"268'1341","reported_seq":2827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:53.114495+0000","last_change":"2024-09-12T00:15:57.045207+0000","last_active":"2024-09-12T01:00:53.114495+0000","last_peered":"2024-09-12T01:00:53.114495+0000","last_clean":"2024-09-12T01:00:53.114495+0000","last_became_active":"2024-09-12T00:15:57.043227+0000","last_became_peered":"2024-09-12T00:15:57.043227+0000","last_unstale":"2024-09-12T01:00:53.114495+0000","last_undegraded":"2024-09-12T01:00:53.114495+0000","last_fullsized":"2024-09-12T01:00:53.114495+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:40.677355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5913,"num_read_kb":5121,"num_write":1910,"num_write_kb":821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"268'231","reported_seq":873,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:03.267756+0000","last_change":"2024-09-12T00:15:55.053474+0000","last_active":"2024-09-12T01:01:03.267756+0000","last_peered":"2024-09-12T01:01:03.267756+0000","last_clean":"2024-09-12T01:01:03.267756+0000","last_became_active":"2024-09-12T00:15:55.052287+0000","last_became_peered":"2024-09-12T00:15:55.052287+0000","last_unstale":"2024-09-12T01:01:03.267756+0000","last_undegraded":"2024-09-12T01:01:03.267756+0000","last_fullsized":"2024-09-12T01:01:03.267756+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:48.478932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13281004,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":413,"num_read_kb":19752,"num_write":853,"num_write_kb":40992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"268'335","reported_seq":1745,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.870604+0000","last_change":"2024-09-12T00:15:57.039951+0000","last_active":"2024-09-12T01:02:10.870604+0000","last_peered":"2024-09-12T01:02:10.870604+0000","last_clean":"2024-09-12T01:02:10.870604+0000","last_became_active":"2024-09-12T00:15:57.039633+0000","last_became_peered":"2024-09-12T00:15:57.039633+0000","last_unstale":"2024-09-12T01:02:10.870604+0000","last_undegraded":"2024-09-12T01:02:10.870604+0000","last_fullsized":"2024-09-12T01:02:10.870604+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:29.316323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1924,"num_read_kb":1842,"num_write":397,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"268'298","reported_seq":980,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.728341+0000","last_change":"2024-09-12T00:15:55.055642+0000","last_active":"2024-09-12T01:02:38.728341+0000","last_peered":"2024-09-12T01:02:38.728341+0000","last_clean":"2024-09-12T01:02:38.728341+0000","last_became_active":"2024-09-12T00:15:55.054952+0000","last_became_peered":"2024-09-12T00:15:55.054952+0000","last_unstale":"2024-09-12T01:02:38.728341+0000","last_undegraded":"2024-09-12T01:02:38.728341+0000","last_fullsized":"2024-09-12T01:02:38.728341+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:10.159478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11646207,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":466,"num_read_kb":117939,"num_write":925,"num_write_kb":46136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"268'363","reported_seq":1021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.485230+0000","last_change":"2024-09-12T00:15:55.053129+0000","last_active":"2024-09-12T01:02:38.485230+0000","last_peered":"2024-09-12T01:02:38.485230+0000","last_clean":"2024-09-12T01:02:38.485230+0000","last_became_active":"2024-09-12T00:15:55.052320+0000","last_became_peered":"2024-09-12T00:15:55.052320+0000","last_unstale":"2024-09-12T01:02:38.485230+0000","last_undegraded":"2024-09-12T01:02:38.485230+0000","last_fullsized":"2024-09-12T01:02:38.485230+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:04.001879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13659026,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":544,"num_read_kb":13864,"num_write":1319,"num_write_kb":55041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"268'475","reported_seq":2091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.171239+0000","last_change":"2024-09-12T00:15:57.055663+0000","last_active":"2024-09-12T01:00:52.171239+0000","last_peered":"2024-09-12T01:00:52.171239+0000","last_clean":"2024-09-12T01:00:52.171239+0000","last_became_active":"2024-09-12T00:15:57.054996+0000","last_became_peered":"2024-09-12T00:15:57.054996+0000","last_unstale":"2024-09-12T01:00:52.171239+0000","last_undegraded":"2024-09-12T01:00:52.171239+0000","last_fullsized":"2024-09-12T01:00:52.171239+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:56.476228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2784,"num_read_kb":2618,"num_write":619,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"268'260","reported_seq":879,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:17.211534+0000","last_change":"2024-09-12T00:15:55.079679+0000","last_active":"2024-09-12T01:00:17.211534+0000","last_peered":"2024-09-12T01:00:17.211534+0000","last_clean":"2024-09-12T01:00:17.211534+0000","last_became_active":"2024-09-12T00:15:55.078832+0000","last_became_peered":"2024-09-12T00:15:55.078832+0000","last_unstale":"2024-09-12T01:00:17.211534+0000","last_undegraded":"2024-09-12T01:00:17.211534+0000","last_fullsized":"2024-09-12T01:00:17.211534+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:54.215633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12399463,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":360,"num_read_kb":33206,"num_write":922,"num_write_kb":34373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"268'950","reported_seq":2368,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:53.114798+0000","last_change":"2024-09-12T00:15:57.027951+0000","last_active":"2024-09-12T01:00:53.114798+0000","last_peered":"2024-09-12T01:00:53.114798+0000","last_clean":"2024-09-12T01:00:53.114798+0000","last_became_active":"2024-09-12T00:15:57.027565+0000","last_became_peered":"2024-09-12T00:15:57.027565+0000","last_unstale":"2024-09-12T01:00:53.114798+0000","last_undegraded":"2024-09-12T01:00:53.114798+0000","last_fullsized":"2024-09-12T01:00:53.114798+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":900,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:55.130874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4238,"num_read_kb":3802,"num_write":1335,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6185,"num_read_kb":4382,"num_write":1972,"num_write_kb":869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1043,"ondisk_log_size":1043,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15033,"num_read_kb":14688,"num_write":16727,"num_write_kb":4883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1560,"ondisk_log_size":1560,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":781,"ondisk_log_size":781,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1728236,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":17413,"num_read_kb":34185,"num_write":14663,"num_write_kb":11510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":1941585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1806,"ondisk_log_size":1806,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2876,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212032,"num_read_kb":193923,"num_write":55063,"num_write_kb":18681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4050,"ondisk_log_size":4050,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":409390098,"num_objects":3171,"num_object_clones":0,"num_object_copies":12684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3171,"num_whiteouts":0,"num_read":33213,"num_read_kb":1967309,"num_write":68729,"num_write_kb":2158407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":596008960,"data_stored":596008960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3804,"ondisk_log_size":3804,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":59857393,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":126,"num_read_kb":197046,"num_write":143,"num_write_kb":127402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":118673408,"data_stored":118669420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":48323057,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":123,"num_read_kb":185778,"num_write":145,"num_write_kb":127402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95604736,"data_stored":95600748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719477304,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305208,"kb_used_data":79552,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94066632,"statfs":{"total":96636764160,"available":96324231168,"internally_reserved":0,"allocated":81461248,"data_stored":79415482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":230947271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510011,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":215396,"kb_used_data":107856,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94156444,"statfs":{"total":96636764160,"available":96416198656,"internally_reserved":0,"allocated":110444544,"data_stored":108404854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110098886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510009,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":387688,"kb_used_data":149720,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":93984152,"statfs":{"total":96636764160,"available":96239771648,"internally_reserved":0,"allocated":153313280,"data_stored":151263128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243661253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510011,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":277812,"kb_used_data":156388,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94094028,"statfs":{"total":96636764160,"available":96352284672,"internally_reserved":0,"allocated":160141312,"data_stored":158119567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124320197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510010,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397512,"kb_used_data":73260,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":93974328,"statfs":{"total":96636764160,"available":96229711872,"internally_reserved":0,"allocated":75018240,"data_stored":72946735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":331872709},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510009,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":234068,"kb_used_data":130644,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94137772,"statfs":{"total":96636764160,"available":96397078528,"internally_reserved":0,"allocated":133779456,"data_stored":131707105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542715,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":358024,"kb_used_data":120056,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":94013816,"statfs":{"total":96636764160,"available":96270147584,"internally_reserved":0,"allocated":122937344,"data_stored":120910860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243661258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542713,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":374740,"kb_used_data":122820,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93997100,"statfs":{"total":96636764160,"available":96253030400,"internally_reserved":0,"allocated":125767680,"data_stored":123715390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":91365376,"data_stored":91365376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":55009280,"data_stored":55009280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90898432,"data_stored":90898432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53452800,"data_stored":53452800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77246464,"data_stored":77246464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":66994176,"data_stored":66994176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":71073792,"data_stored":71073792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":89968640,"data_stored":89968640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":372736,"data_stored":304932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":340798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":80982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":78962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":321461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":399210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":130036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":348160,"data_stored":285204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8391818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12623057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15777056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17915904,"data_stored":17914353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5291296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6332416,"data_stored":6331601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6340608,"data_stored":6339872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10526720,"data_stored":10525905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39845888,"data_stored":39845888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10489856,"data_stored":10488970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:02:41.294 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:02:41.679 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:02:41.692 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-12T01:02:41.700 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":1675,"stamp":"2024-09-12T01:02:40.813567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":519906609,"num_objects":3693,"num_object_clones":0,"num_object_copies":13728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3693,"num_whiteouts":0,"num_read":286616,"num_read_kb":2600254,"num_write":157585,"num_write_kb":2450810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13305,"ondisk_log_size":13305,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2550448,"kb_used_data":940296,"kb_used_omap":12,"kb_used_meta":1609715,"kb_avail":752424272,"statfs":{"total":773094113280,"available":770482454528,"internally_reserved":0,"allocated":962863104,"data_stored":946483121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1648348720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-202258165,"num_objects":-1242,"num_object_clones":0,"num_object_copies":-4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1242,"num_whiteouts":0,"num_read":1413,"num_read_kb":1383,"num_write":1330,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008912"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.173833+0000","last_change":"2024-09-12T00:43:48.284274+0000","last_active":"2024-09-12T00:58:48.173833+0000","last_peered":"2024-09-12T00:58:48.173833+0000","last_clean":"2024-09-12T00:58:48.173833+0000","last_became_active":"2024-09-12T00:43:48.282777+0000","last_became_peered":"2024-09-12T00:43:48.282777+0000","last_unstale":"2024-09-12T00:58:48.173833+0000","last_undegraded":"2024-09-12T00:58:48.173833+0000","last_fullsized":"2024-09-12T00:58:48.173833+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:26.885566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"268'1","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.190566+0000","last_change":"2024-09-12T00:32:28.070403+0000","last_active":"2024-09-12T00:59:58.190566+0000","last_peered":"2024-09-12T00:59:58.190566+0000","last_clean":"2024-09-12T00:59:58.190566+0000","last_became_active":"2024-09-12T00:32:28.069841+0000","last_became_peered":"2024-09-12T00:32:28.069841+0000","last_unstale":"2024-09-12T00:59:58.190566+0000","last_undegraded":"2024-09-12T00:59:58.190566+0000","last_fullsized":"2024-09-12T00:59:58.190566+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:32.102006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.181946+0000","last_change":"2024-09-12T00:32:25.027280+0000","last_active":"2024-09-12T00:59:57.181946+0000","last_peered":"2024-09-12T00:59:57.181946+0000","last_clean":"2024-09-12T00:59:57.181946+0000","last_became_active":"2024-09-12T00:32:25.026726+0000","last_became_peered":"2024-09-12T00:32:25.026726+0000","last_unstale":"2024-09-12T00:59:57.181946+0000","last_undegraded":"2024-09-12T00:59:57.181946+0000","last_fullsized":"2024-09-12T00:59:57.181946+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:47.659267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"268'31","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.187370+0000","last_change":"2024-09-12T00:30:51.544593+0000","last_active":"2024-09-12T01:00:03.187370+0000","last_peered":"2024-09-12T01:00:03.187370+0000","last_clean":"2024-09-12T01:00:03.187370+0000","last_became_active":"2024-09-12T00:30:51.543858+0000","last_became_peered":"2024-09-12T00:30:51.543858+0000","last_unstale":"2024-09-12T01:00:03.187370+0000","last_undegraded":"2024-09-12T01:00:03.187370+0000","last_fullsized":"2024-09-12T01:00:03.187370+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:38.568158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":120,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.161958+0000","last_change":"2024-09-12T00:43:48.286931+0000","last_active":"2024-09-12T00:58:48.161958+0000","last_peered":"2024-09-12T00:58:48.161958+0000","last_clean":"2024-09-12T00:58:48.161958+0000","last_became_active":"2024-09-12T00:43:48.286291+0000","last_became_peered":"2024-09-12T00:43:48.286291+0000","last_unstale":"2024-09-12T00:58:48.161958+0000","last_undegraded":"2024-09-12T00:58:48.161958+0000","last_fullsized":"2024-09-12T00:58:48.161958+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:17.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.190647+0000","last_change":"2024-09-12T00:32:28.070732+0000","last_active":"2024-09-12T00:59:58.190647+0000","last_peered":"2024-09-12T00:59:58.190647+0000","last_clean":"2024-09-12T00:59:58.190647+0000","last_became_active":"2024-09-12T00:32:28.070091+0000","last_became_peered":"2024-09-12T00:32:28.070091+0000","last_unstale":"2024-09-12T00:59:58.190647+0000","last_undegraded":"2024-09-12T00:59:58.190647+0000","last_fullsized":"2024-09-12T00:59:58.190647+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:33.762789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.206709+0000","last_change":"2024-09-12T00:32:25.024486+0000","last_active":"2024-09-12T00:59:57.206709+0000","last_peered":"2024-09-12T00:59:57.206709+0000","last_clean":"2024-09-12T00:59:57.206709+0000","last_became_active":"2024-09-12T00:32:25.023750+0000","last_became_peered":"2024-09-12T00:32:25.023750+0000","last_unstale":"2024-09-12T00:59:57.206709+0000","last_undegraded":"2024-09-12T00:59:57.206709+0000","last_fullsized":"2024-09-12T00:59:57.206709+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:12.053492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"268'20","reported_seq":97,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.273682+0000","last_change":"2024-09-12T00:30:51.555569+0000","last_active":"2024-09-12T01:00:03.273682+0000","last_peered":"2024-09-12T01:00:03.273682+0000","last_clean":"2024-09-12T01:00:03.273682+0000","last_became_active":"2024-09-12T00:30:51.554875+0000","last_became_peered":"2024-09-12T00:30:51.554875+0000","last_unstale":"2024-09-12T01:00:03.273682+0000","last_undegraded":"2024-09-12T01:00:03.273682+0000","last_fullsized":"2024-09-12T01:00:03.273682+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:03.959589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":61,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:18.166602+0000","last_change":"2024-09-12T00:43:48.271637+0000","last_active":"2024-09-12T00:58:18.166602+0000","last_peered":"2024-09-12T00:58:18.166602+0000","last_clean":"2024-09-12T00:58:18.166602+0000","last_became_active":"2024-09-12T00:43:48.270700+0000","last_became_peered":"2024-09-12T00:43:48.270700+0000","last_unstale":"2024-09-12T00:58:18.166602+0000","last_undegraded":"2024-09-12T00:58:18.166602+0000","last_fullsized":"2024-09-12T00:58:18.166602+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:41.349025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"268'2","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.201826+0000","last_change":"2024-09-12T00:32:28.078229+0000","last_active":"2024-09-12T00:59:37.201826+0000","last_peered":"2024-09-12T00:59:37.201826+0000","last_clean":"2024-09-12T00:59:37.201826+0000","last_became_active":"2024-09-12T00:32:28.065497+0000","last_became_peered":"2024-09-12T00:32:28.065497+0000","last_unstale":"2024-09-12T00:59:37.201826+0000","last_undegraded":"2024-09-12T00:59:37.201826+0000","last_fullsized":"2024-09-12T00:59:37.201826+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:04.479825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"268'3","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:37.191813+0000","last_change":"2024-09-12T00:32:25.002095+0000","last_active":"2024-09-12T01:00:37.191813+0000","last_peered":"2024-09-12T01:00:37.191813+0000","last_clean":"2024-09-12T01:00:37.191813+0000","last_became_active":"2024-09-12T00:32:25.001290+0000","last_became_peered":"2024-09-12T00:32:25.001290+0000","last_unstale":"2024-09-12T01:00:37.191813+0000","last_undegraded":"2024-09-12T01:00:37.191813+0000","last_fullsized":"2024-09-12T01:00:37.191813+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:20.950634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2088,"num_write":8,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"268'25","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:02.981579+0000","last_change":"2024-09-12T00:30:51.546159+0000","last_active":"2024-09-12T01:00:02.981579+0000","last_peered":"2024-09-12T01:00:02.981579+0000","last_clean":"2024-09-12T01:00:02.981579+0000","last_became_active":"2024-09-12T00:30:51.544751+0000","last_became_peered":"2024-09-12T00:30:51.544751+0000","last_unstale":"2024-09-12T01:00:02.981579+0000","last_undegraded":"2024-09-12T01:00:02.981579+0000","last_fullsized":"2024-09-12T01:00:02.981579+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:47.192663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":82,"num_write":61,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:27.183725+0000","last_change":"2024-09-12T00:43:48.280902+0000","last_active":"2024-09-12T00:58:27.183725+0000","last_peered":"2024-09-12T00:58:27.183725+0000","last_clean":"2024-09-12T00:58:27.183725+0000","last_became_active":"2024-09-12T00:43:48.280166+0000","last_became_peered":"2024-09-12T00:43:48.280166+0000","last_unstale":"2024-09-12T00:58:27.183725+0000","last_undegraded":"2024-09-12T00:58:27.183725+0000","last_fullsized":"2024-09-12T00:58:27.183725+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:30.937177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:37.186576+0000","last_change":"2024-09-12T00:32:28.078675+0000","last_active":"2024-09-12T00:58:37.186576+0000","last_peered":"2024-09-12T00:58:37.186576+0000","last_clean":"2024-09-12T00:58:37.186576+0000","last_became_active":"2024-09-12T00:32:28.073988+0000","last_became_peered":"2024-09-12T00:32:28.073988+0000","last_unstale":"2024-09-12T00:58:37.186576+0000","last_undegraded":"2024-09-12T00:58:37.186576+0000","last_fullsized":"2024-09-12T00:58:37.186576+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:09.276835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185184+0000","last_change":"2024-09-12T00:32:25.008128+0000","last_active":"2024-09-12T00:59:33.185184+0000","last_peered":"2024-09-12T00:59:33.185184+0000","last_clean":"2024-09-12T00:59:33.185184+0000","last_became_active":"2024-09-12T00:32:25.007732+0000","last_became_peered":"2024-09-12T00:32:25.007732+0000","last_unstale":"2024-09-12T00:59:33.185184+0000","last_undegraded":"2024-09-12T00:59:33.185184+0000","last_fullsized":"2024-09-12T00:59:33.185184+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:28.829369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"268'61","reported_seq":203,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.690930+0000","last_change":"2024-09-12T00:30:51.552185+0000","last_active":"2024-09-12T00:59:57.690930+0000","last_peered":"2024-09-12T00:59:57.690930+0000","last_clean":"2024-09-12T00:59:57.690930+0000","last_became_active":"2024-09-12T00:30:51.551417+0000","last_became_peered":"2024-09-12T00:30:51.551417+0000","last_unstale":"2024-09-12T00:59:57.690930+0000","last_undegraded":"2024-09-12T00:59:57.690930+0000","last_fullsized":"2024-09-12T00:59:57.690930+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:45.506758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":214,"num_write":108,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.182039+0000","last_change":"2024-09-12T00:43:48.284245+0000","last_active":"2024-09-12T00:59:57.182039+0000","last_peered":"2024-09-12T00:59:57.182039+0000","last_clean":"2024-09-12T00:59:57.182039+0000","last_became_active":"2024-09-12T00:43:48.283357+0000","last_became_peered":"2024-09-12T00:43:48.283357+0000","last_unstale":"2024-09-12T00:59:57.182039+0000","last_undegraded":"2024-09-12T00:59:57.182039+0000","last_fullsized":"2024-09-12T00:59:57.182039+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.113641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"268'5","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:38.003769+0000","last_change":"2024-09-12T00:32:28.054309+0000","last_active":"2024-09-12T01:01:38.003769+0000","last_peered":"2024-09-12T01:01:38.003769+0000","last_clean":"2024-09-12T01:01:38.003769+0000","last_became_active":"2024-09-12T00:32:28.053541+0000","last_became_peered":"2024-09-12T00:32:28.053541+0000","last_unstale":"2024-09-12T01:01:38.003769+0000","last_undegraded":"2024-09-12T01:01:38.003769+0000","last_fullsized":"2024-09-12T01:01:38.003769+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.456715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"268'2","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.192266+0000","last_change":"2024-09-12T00:32:25.015629+0000","last_active":"2024-09-12T00:59:02.192266+0000","last_peered":"2024-09-12T00:59:02.192266+0000","last_clean":"2024-09-12T00:59:02.192266+0000","last_became_active":"2024-09-12T00:32:25.014665+0000","last_became_peered":"2024-09-12T00:32:25.014665+0000","last_unstale":"2024-09-12T00:59:02.192266+0000","last_undegraded":"2024-09-12T00:59:02.192266+0000","last_fullsized":"2024-09-12T00:59:02.192266+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:46.651960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"268'40","reported_seq":154,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:23.156361+0000","last_change":"2024-09-12T00:30:51.549303+0000","last_active":"2024-09-12T00:58:23.156361+0000","last_peered":"2024-09-12T00:58:23.156361+0000","last_clean":"2024-09-12T00:58:23.156361+0000","last_became_active":"2024-09-12T00:30:51.547784+0000","last_became_peered":"2024-09-12T00:30:51.547784+0000","last_unstale":"2024-09-12T00:58:23.156361+0000","last_undegraded":"2024-09-12T00:58:23.156361+0000","last_fullsized":"2024-09-12T00:58:23.156361+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:29.971436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":150,"num_write":68,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.192933+0000","last_change":"2024-09-12T00:43:48.278102+0000","last_active":"2024-09-12T01:00:28.192933+0000","last_peered":"2024-09-12T01:00:28.192933+0000","last_clean":"2024-09-12T01:00:28.192933+0000","last_became_active":"2024-09-12T00:43:48.276078+0000","last_became_peered":"2024-09-12T00:43:48.276078+0000","last_unstale":"2024-09-12T01:00:28.192933+0000","last_undegraded":"2024-09-12T01:00:28.192933+0000","last_fullsized":"2024-09-12T01:00:28.192933+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:21.420479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"268'5","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.600193+0000","last_change":"2024-09-12T00:32:28.031279+0000","last_active":"2024-09-12T01:02:37.600193+0000","last_peered":"2024-09-12T01:02:37.600193+0000","last_clean":"2024-09-12T01:02:37.600193+0000","last_became_active":"2024-09-12T00:32:28.030520+0000","last_became_peered":"2024-09-12T00:32:28.030520+0000","last_unstale":"2024-09-12T01:02:37.600193+0000","last_undegraded":"2024-09-12T01:02:37.600193+0000","last_fullsized":"2024-09-12T01:02:37.600193+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:22.614081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"268'3","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:34.014371+0000","last_change":"2024-09-12T00:32:25.010515+0000","last_active":"2024-09-12T01:01:34.014371+0000","last_peered":"2024-09-12T01:01:34.014371+0000","last_clean":"2024-09-12T01:01:34.014371+0000","last_became_active":"2024-09-12T00:32:25.009898+0000","last_became_peered":"2024-09-12T00:32:25.009898+0000","last_unstale":"2024-09-12T01:01:34.014371+0000","last_undegraded":"2024-09-12T01:01:34.014371+0000","last_fullsized":"2024-09-12T01:01:34.014371+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:26.343687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"268'22","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:23.166566+0000","last_change":"2024-09-12T00:30:51.560284+0000","last_active":"2024-09-12T00:58:23.166566+0000","last_peered":"2024-09-12T00:58:23.166566+0000","last_clean":"2024-09-12T00:58:23.166566+0000","last_became_active":"2024-09-12T00:30:51.559544+0000","last_became_peered":"2024-09-12T00:30:51.559544+0000","last_unstale":"2024-09-12T00:58:23.166566+0000","last_undegraded":"2024-09-12T00:58:23.166566+0000","last_fullsized":"2024-09-12T00:58:23.166566+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:21.732816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":79,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.173552+0000","last_change":"2024-09-12T00:43:48.283455+0000","last_active":"2024-09-12T00:58:48.173552+0000","last_peered":"2024-09-12T00:58:48.173552+0000","last_clean":"2024-09-12T00:58:48.173552+0000","last_became_active":"2024-09-12T00:43:48.283057+0000","last_became_peered":"2024-09-12T00:43:48.283057+0000","last_unstale":"2024-09-12T00:58:48.173552+0000","last_undegraded":"2024-09-12T00:58:48.173552+0000","last_fullsized":"2024-09-12T00:58:48.173552+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:33.410879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.190602+0000","last_change":"2024-09-12T00:32:28.066260+0000","last_active":"2024-09-12T00:59:58.190602+0000","last_peered":"2024-09-12T00:59:58.190602+0000","last_clean":"2024-09-12T00:59:58.190602+0000","last_became_active":"2024-09-12T00:32:28.065376+0000","last_became_peered":"2024-09-12T00:32:28.065376+0000","last_unstale":"2024-09-12T00:59:58.190602+0000","last_undegraded":"2024-09-12T00:59:58.190602+0000","last_fullsized":"2024-09-12T00:59:58.190602+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:37.216971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"268'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.191528+0000","last_change":"2024-09-12T00:32:25.000290+0000","last_active":"2024-09-12T00:59:58.191528+0000","last_peered":"2024-09-12T00:59:58.191528+0000","last_clean":"2024-09-12T00:59:58.191528+0000","last_became_active":"2024-09-12T00:32:24.999604+0000","last_became_peered":"2024-09-12T00:32:24.999604+0000","last_unstale":"2024-09-12T00:59:58.191528+0000","last_undegraded":"2024-09-12T00:59:58.191528+0000","last_fullsized":"2024-09-12T00:59:58.191528+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:52.889640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"268'41","reported_seq":153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:04.255372+0000","last_change":"2024-09-12T00:30:51.557465+0000","last_active":"2024-09-12T01:00:04.255372+0000","last_peered":"2024-09-12T01:00:04.255372+0000","last_clean":"2024-09-12T01:00:04.255372+0000","last_became_active":"2024-09-12T00:30:51.556729+0000","last_became_peered":"2024-09-12T00:30:51.556729+0000","last_unstale":"2024-09-12T01:00:04.255372+0000","last_undegraded":"2024-09-12T01:00:04.255372+0000","last_fullsized":"2024-09-12T01:00:04.255372+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:59.334180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":144,"num_write":69,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.174016+0000","last_change":"2024-09-12T00:43:48.282559+0000","last_active":"2024-09-12T00:58:48.174016+0000","last_peered":"2024-09-12T00:58:48.174016+0000","last_clean":"2024-09-12T00:58:48.174016+0000","last_became_active":"2024-09-12T00:43:48.281781+0000","last_became_peered":"2024-09-12T00:43:48.281781+0000","last_unstale":"2024-09-12T00:58:48.174016+0000","last_undegraded":"2024-09-12T00:58:48.174016+0000","last_fullsized":"2024-09-12T00:58:48.174016+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:09.023666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"268'3","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.181867+0000","last_change":"2024-09-12T00:32:28.063332+0000","last_active":"2024-09-12T00:59:57.181867+0000","last_peered":"2024-09-12T00:59:57.181867+0000","last_clean":"2024-09-12T00:59:57.181867+0000","last_became_active":"2024-09-12T00:32:28.062540+0000","last_became_peered":"2024-09-12T00:32:28.062540+0000","last_unstale":"2024-09-12T00:59:57.181867+0000","last_undegraded":"2024-09-12T00:59:57.181867+0000","last_fullsized":"2024-09-12T00:59:57.181867+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:19.133641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.179111+0000","last_change":"2024-09-12T00:32:25.021694+0000","last_active":"2024-09-12T00:59:58.179111+0000","last_peered":"2024-09-12T00:59:58.179111+0000","last_clean":"2024-09-12T00:59:58.179111+0000","last_became_active":"2024-09-12T00:32:25.017715+0000","last_became_peered":"2024-09-12T00:32:25.017715+0000","last_unstale":"2024-09-12T00:59:58.179111+0000","last_undegraded":"2024-09-12T00:59:58.179111+0000","last_fullsized":"2024-09-12T00:59:58.179111+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:02.525100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'8","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:53.178004+0000","last_change":"2024-09-12T00:30:51.547647+0000","last_active":"2024-09-12T00:59:53.178004+0000","last_peered":"2024-09-12T00:59:53.178004+0000","last_clean":"2024-09-12T00:59:53.178004+0000","last_became_active":"2024-09-12T00:30:51.546981+0000","last_became_peered":"2024-09-12T00:30:51.546981+0000","last_unstale":"2024-09-12T00:59:53.178004+0000","last_undegraded":"2024-09-12T00:59:53.178004+0000","last_fullsized":"2024-09-12T00:59:53.178004+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:52.873539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.210443+0000","last_change":"2024-09-12T00:43:48.273242+0000","last_active":"2024-09-12T01:00:12.210443+0000","last_peered":"2024-09-12T01:00:12.210443+0000","last_clean":"2024-09-12T01:00:12.210443+0000","last_became_active":"2024-09-12T00:43:48.272523+0000","last_became_peered":"2024-09-12T00:43:48.272523+0000","last_unstale":"2024-09-12T01:00:12.210443+0000","last_undegraded":"2024-09-12T01:00:12.210443+0000","last_fullsized":"2024-09-12T01:00:12.210443+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:58.897794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"268'8","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168024+0000","last_change":"2024-09-12T00:32:28.069369+0000","last_active":"2024-09-12T00:59:02.168024+0000","last_peered":"2024-09-12T00:59:02.168024+0000","last_clean":"2024-09-12T00:59:02.168024+0000","last_became_active":"2024-09-12T00:32:28.062839+0000","last_became_peered":"2024-09-12T00:32:28.062839+0000","last_unstale":"2024-09-12T00:59:02.168024+0000","last_undegraded":"2024-09-12T00:59:02.168024+0000","last_fullsized":"2024-09-12T00:59:02.168024+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:52.354103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"268'3","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.234269+0000","last_change":"2024-09-12T00:32:25.005903+0000","last_active":"2024-09-12T01:00:29.234269+0000","last_peered":"2024-09-12T01:00:29.234269+0000","last_clean":"2024-09-12T01:00:29.234269+0000","last_became_active":"2024-09-12T00:32:25.005113+0000","last_became_peered":"2024-09-12T00:32:25.005113+0000","last_unstale":"2024-09-12T01:00:29.234269+0000","last_undegraded":"2024-09-12T01:00:29.234269+0000","last_fullsized":"2024-09-12T01:00:29.234269+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:34.390961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3076,"num_write":3,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'62","reported_seq":220,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:53.184530+0000","last_change":"2024-09-12T00:30:51.542763+0000","last_active":"2024-09-12T00:59:53.184530+0000","last_peered":"2024-09-12T00:59:53.184530+0000","last_clean":"2024-09-12T00:59:53.184530+0000","last_became_active":"2024-09-12T00:30:51.541882+0000","last_became_peered":"2024-09-12T00:30:51.541882+0000","last_unstale":"2024-09-12T00:59:53.184530+0000","last_undegraded":"2024-09-12T00:59:53.184530+0000","last_fullsized":"2024-09-12T00:59:53.184530+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.614120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":254,"num_write":98,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.181831+0000","last_change":"2024-09-12T00:43:48.278782+0000","last_active":"2024-09-12T01:00:08.181831+0000","last_peered":"2024-09-12T01:00:08.181831+0000","last_clean":"2024-09-12T01:00:08.181831+0000","last_became_active":"2024-09-12T00:43:48.277883+0000","last_became_peered":"2024-09-12T00:43:48.277883+0000","last_unstale":"2024-09-12T01:00:08.181831+0000","last_undegraded":"2024-09-12T01:00:08.181831+0000","last_fullsized":"2024-09-12T01:00:08.181831+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:35.841252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'5","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:17.180442+0000","last_change":"2024-09-12T00:32:28.052092+0000","last_active":"2024-09-12T00:58:17.180442+0000","last_peered":"2024-09-12T00:58:17.180442+0000","last_clean":"2024-09-12T00:58:17.180442+0000","last_became_active":"2024-09-12T00:32:28.051364+0000","last_became_peered":"2024-09-12T00:32:28.051364+0000","last_unstale":"2024-09-12T00:58:17.180442+0000","last_undegraded":"2024-09-12T00:58:17.180442+0000","last_fullsized":"2024-09-12T00:58:17.180442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:30.719026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5136,"num_write":10,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.178275+0000","last_change":"2024-09-12T00:32:25.009850+0000","last_active":"2024-09-12T00:59:03.178275+0000","last_peered":"2024-09-12T00:59:03.178275+0000","last_clean":"2024-09-12T00:59:03.178275+0000","last_became_active":"2024-09-12T00:32:25.009125+0000","last_became_peered":"2024-09-12T00:32:25.009125+0000","last_unstale":"2024-09-12T00:59:03.178275+0000","last_undegraded":"2024-09-12T00:59:03.178275+0000","last_fullsized":"2024-09-12T00:59:03.178275+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:33.665936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"268'31","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:53.184482+0000","last_change":"2024-09-12T00:30:51.555036+0000","last_active":"2024-09-12T00:59:53.184482+0000","last_peered":"2024-09-12T00:59:53.184482+0000","last_clean":"2024-09-12T00:59:53.184482+0000","last_became_active":"2024-09-12T00:30:51.553919+0000","last_became_peered":"2024-09-12T00:30:51.553919+0000","last_unstale":"2024-09-12T00:59:53.184482+0000","last_undegraded":"2024-09-12T00:59:53.184482+0000","last_fullsized":"2024-09-12T00:59:53.184482+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:07.977904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":104,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.195129+0000","last_change":"2024-09-12T00:43:48.289134+0000","last_active":"2024-09-12T01:00:08.195129+0000","last_peered":"2024-09-12T01:00:08.195129+0000","last_clean":"2024-09-12T01:00:08.195129+0000","last_became_active":"2024-09-12T00:43:48.288517+0000","last_became_peered":"2024-09-12T00:43:48.288517+0000","last_unstale":"2024-09-12T01:00:08.195129+0000","last_undegraded":"2024-09-12T01:00:08.195129+0000","last_fullsized":"2024-09-12T01:00:08.195129+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:05.171146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168160+0000","last_change":"2024-09-12T00:32:28.060574+0000","last_active":"2024-09-12T00:59:02.168160+0000","last_peered":"2024-09-12T00:59:02.168160+0000","last_clean":"2024-09-12T00:59:02.168160+0000","last_became_active":"2024-09-12T00:32:28.059869+0000","last_became_peered":"2024-09-12T00:32:28.059869+0000","last_unstale":"2024-09-12T00:59:02.168160+0000","last_undegraded":"2024-09-12T00:59:02.168160+0000","last_fullsized":"2024-09-12T00:59:02.168160+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:24.600878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168108+0000","last_change":"2024-09-12T00:32:25.027341+0000","last_active":"2024-09-12T00:59:02.168108+0000","last_peered":"2024-09-12T00:59:02.168108+0000","last_clean":"2024-09-12T00:59:02.168108+0000","last_became_active":"2024-09-12T00:32:25.026751+0000","last_became_peered":"2024-09-12T00:32:25.026751+0000","last_unstale":"2024-09-12T00:59:02.168108+0000","last_undegraded":"2024-09-12T00:59:02.168108+0000","last_fullsized":"2024-09-12T00:59:02.168108+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:19.648395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"268'24","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.286940+0000","last_change":"2024-09-12T00:30:51.548842+0000","last_active":"2024-09-12T01:00:03.286940+0000","last_peered":"2024-09-12T01:00:03.286940+0000","last_clean":"2024-09-12T01:00:03.286940+0000","last_became_active":"2024-09-12T00:30:51.548069+0000","last_became_peered":"2024-09-12T00:30:51.548069+0000","last_unstale":"2024-09-12T01:00:03.286940+0000","last_undegraded":"2024-09-12T01:00:03.286940+0000","last_fullsized":"2024-09-12T01:00:03.286940+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:24.452311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":85,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.194752+0000","last_change":"2024-09-12T00:43:48.276141+0000","last_active":"2024-09-12T01:00:08.194752+0000","last_peered":"2024-09-12T01:00:08.194752+0000","last_clean":"2024-09-12T01:00:08.194752+0000","last_became_active":"2024-09-12T00:43:48.274026+0000","last_became_peered":"2024-09-12T00:43:48.274026+0000","last_unstale":"2024-09-12T01:00:08.194752+0000","last_undegraded":"2024-09-12T01:00:08.194752+0000","last_fullsized":"2024-09-12T01:00:08.194752+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:53.384375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"268'1","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.178343+0000","last_change":"2024-09-12T00:32:28.063379+0000","last_active":"2024-09-12T00:59:03.178343+0000","last_peered":"2024-09-12T00:59:03.178343+0000","last_clean":"2024-09-12T00:59:03.178343+0000","last_became_active":"2024-09-12T00:32:28.062657+0000","last_became_peered":"2024-09-12T00:32:28.062657+0000","last_unstale":"2024-09-12T00:59:03.178343+0000","last_undegraded":"2024-09-12T00:59:03.178343+0000","last_fullsized":"2024-09-12T00:59:03.178343+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:10.594711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.192560+0000","last_change":"2024-09-12T00:32:24.997566+0000","last_active":"2024-09-12T00:59:02.192560+0000","last_peered":"2024-09-12T00:59:02.192560+0000","last_clean":"2024-09-12T00:59:02.192560+0000","last_became_active":"2024-09-12T00:32:24.996754+0000","last_became_peered":"2024-09-12T00:32:24.996754+0000","last_unstale":"2024-09-12T00:59:02.192560+0000","last_undegraded":"2024-09-12T00:59:02.192560+0000","last_fullsized":"2024-09-12T00:59:02.192560+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:55.566151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"268'26","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:59.211731+0000","last_change":"2024-09-12T00:30:51.551315+0000","last_active":"2024-09-12T00:58:59.211731+0000","last_peered":"2024-09-12T00:58:59.211731+0000","last_clean":"2024-09-12T00:58:59.211731+0000","last_became_active":"2024-09-12T00:30:51.545679+0000","last_became_peered":"2024-09-12T00:30:51.545679+0000","last_unstale":"2024-09-12T00:58:59.211731+0000","last_undegraded":"2024-09-12T00:58:59.211731+0000","last_fullsized":"2024-09-12T00:58:59.211731+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:48.283586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":84,"num_write":50,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:22.182350+0000","last_change":"2024-09-12T00:43:48.286291+0000","last_active":"2024-09-12T00:58:22.182350+0000","last_peered":"2024-09-12T00:58:22.182350+0000","last_clean":"2024-09-12T00:58:22.182350+0000","last_became_active":"2024-09-12T00:43:48.285657+0000","last_became_peered":"2024-09-12T00:43:48.285657+0000","last_unstale":"2024-09-12T00:58:22.182350+0000","last_undegraded":"2024-09-12T00:58:22.182350+0000","last_fullsized":"2024-09-12T00:58:22.182350+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:25.925943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"268'7","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:12.178896+0000","last_change":"2024-09-12T00:32:28.068135+0000","last_active":"2024-09-12T00:58:12.178896+0000","last_peered":"2024-09-12T00:58:12.178896+0000","last_clean":"2024-09-12T00:58:12.178896+0000","last_became_active":"2024-09-12T00:32:28.067168+0000","last_became_peered":"2024-09-12T00:32:28.067168+0000","last_unstale":"2024-09-12T00:58:12.178896+0000","last_undegraded":"2024-09-12T00:58:12.178896+0000","last_fullsized":"2024-09-12T00:58:12.178896+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:58.886483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"268'9","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:08.164412+0000","last_change":"2024-09-12T00:32:25.012858+0000","last_active":"2024-09-12T00:58:08.164412+0000","last_peered":"2024-09-12T00:58:08.164412+0000","last_clean":"2024-09-12T00:58:08.164412+0000","last_became_active":"2024-09-12T00:32:25.011944+0000","last_became_peered":"2024-09-12T00:32:25.011944+0000","last_unstale":"2024-09-12T00:58:08.164412+0000","last_undegraded":"2024-09-12T00:58:08.164412+0000","last_fullsized":"2024-09-12T00:58:08.164412+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:59.502458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":19,"num_write_kb":10558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"268'29","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:54.210368+0000","last_change":"2024-09-12T00:30:51.551466+0000","last_active":"2024-09-12T00:58:54.210368+0000","last_peered":"2024-09-12T00:58:54.210368+0000","last_clean":"2024-09-12T00:58:54.210368+0000","last_became_active":"2024-09-12T00:30:51.550694+0000","last_became_peered":"2024-09-12T00:30:51.550694+0000","last_unstale":"2024-09-12T00:58:54.210368+0000","last_undegraded":"2024-09-12T00:58:54.210368+0000","last_fullsized":"2024-09-12T00:58:54.210368+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:19.647721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:18.155457+0000","last_change":"2024-09-12T00:43:48.273326+0000","last_active":"2024-09-12T00:58:18.155457+0000","last_peered":"2024-09-12T00:58:18.155457+0000","last_clean":"2024-09-12T00:58:18.155457+0000","last_became_active":"2024-09-12T00:43:48.272356+0000","last_became_peered":"2024-09-12T00:43:48.272356+0000","last_unstale":"2024-09-12T00:58:18.155457+0000","last_undegraded":"2024-09-12T00:58:18.155457+0000","last_fullsized":"2024-09-12T00:58:18.155457+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:10.874661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"268'5","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:12.178797+0000","last_change":"2024-09-12T00:32:28.068097+0000","last_active":"2024-09-12T00:58:12.178797+0000","last_peered":"2024-09-12T00:58:12.178797+0000","last_clean":"2024-09-12T00:58:12.178797+0000","last_became_active":"2024-09-12T00:32:28.067388+0000","last_became_peered":"2024-09-12T00:32:28.067388+0000","last_unstale":"2024-09-12T00:58:12.178797+0000","last_undegraded":"2024-09-12T00:58:12.178797+0000","last_fullsized":"2024-09-12T00:58:12.178797+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:43.197946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:07.177487+0000","last_change":"2024-09-12T00:32:25.009043+0000","last_active":"2024-09-12T00:58:07.177487+0000","last_peered":"2024-09-12T00:58:07.177487+0000","last_clean":"2024-09-12T00:58:07.177487+0000","last_became_active":"2024-09-12T00:32:25.005882+0000","last_became_peered":"2024-09-12T00:32:25.005882+0000","last_unstale":"2024-09-12T00:58:07.177487+0000","last_undegraded":"2024-09-12T00:58:07.177487+0000","last_fullsized":"2024-09-12T00:58:07.177487+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:03.055383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"268'19","reported_seq":95,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:52.165743+0000","last_change":"2024-09-12T00:30:51.555200+0000","last_active":"2024-09-12T00:58:52.165743+0000","last_peered":"2024-09-12T00:58:52.165743+0000","last_clean":"2024-09-12T00:58:52.165743+0000","last_became_active":"2024-09-12T00:30:51.548932+0000","last_became_peered":"2024-09-12T00:30:51.548932+0000","last_unstale":"2024-09-12T00:58:52.165743+0000","last_undegraded":"2024-09-12T00:58:52.165743+0000","last_fullsized":"2024-09-12T00:58:52.165743+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:27.568202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.189591+0000","last_change":"2024-09-12T00:43:48.277526+0000","last_active":"2024-09-12T01:00:13.189591+0000","last_peered":"2024-09-12T01:00:13.189591+0000","last_clean":"2024-09-12T01:00:13.189591+0000","last_became_active":"2024-09-12T00:43:48.274983+0000","last_became_peered":"2024-09-12T00:43:48.274983+0000","last_unstale":"2024-09-12T01:00:13.189591+0000","last_undegraded":"2024-09-12T01:00:13.189591+0000","last_fullsized":"2024-09-12T01:00:13.189591+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:44.126353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"265'5","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:07.155894+0000","last_change":"2024-09-12T00:32:28.050796+0000","last_active":"2024-09-12T00:58:07.155894+0000","last_peered":"2024-09-12T00:58:07.155894+0000","last_clean":"2024-09-12T00:58:07.155894+0000","last_became_active":"2024-09-12T00:32:28.049947+0000","last_became_peered":"2024-09-12T00:32:28.049947+0000","last_unstale":"2024-09-12T00:58:07.155894+0000","last_undegraded":"2024-09-12T00:58:07.155894+0000","last_fullsized":"2024-09-12T00:58:07.155894+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:37.435116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:08.164500+0000","last_change":"2024-09-12T00:32:25.008845+0000","last_active":"2024-09-12T00:58:08.164500+0000","last_peered":"2024-09-12T00:58:08.164500+0000","last_clean":"2024-09-12T00:58:08.164500+0000","last_became_active":"2024-09-12T00:32:25.008089+0000","last_became_peered":"2024-09-12T00:32:25.008089+0000","last_unstale":"2024-09-12T00:58:08.164500+0000","last_undegraded":"2024-09-12T00:58:08.164500+0000","last_fullsized":"2024-09-12T00:58:08.164500+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:32.387676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"268'82","reported_seq":323,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:53.174675+0000","last_change":"2024-09-12T00:30:51.548938+0000","last_active":"2024-09-12T00:58:53.174675+0000","last_peered":"2024-09-12T00:58:53.174675+0000","last_clean":"2024-09-12T00:58:53.174675+0000","last_became_active":"2024-09-12T00:30:51.548232+0000","last_became_peered":"2024-09-12T00:30:51.548232+0000","last_unstale":"2024-09-12T00:58:53.174675+0000","last_undegraded":"2024-09-12T00:58:53.174675+0000","last_fullsized":"2024-09-12T00:58:53.174675+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:32.055820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":390,"num_write":93,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:18.155390+0000","last_change":"2024-09-12T00:43:48.272336+0000","last_active":"2024-09-12T00:58:18.155390+0000","last_peered":"2024-09-12T00:58:18.155390+0000","last_clean":"2024-09-12T00:58:18.155390+0000","last_became_active":"2024-09-12T00:43:48.271560+0000","last_became_peered":"2024-09-12T00:43:48.271560+0000","last_unstale":"2024-09-12T00:58:18.155390+0000","last_undegraded":"2024-09-12T00:58:18.155390+0000","last_fullsized":"2024-09-12T00:58:18.155390+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:33.055656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:09.196589+0000","last_change":"2024-09-12T00:32:28.058883+0000","last_active":"2024-09-12T00:58:09.196589+0000","last_peered":"2024-09-12T00:58:09.196589+0000","last_clean":"2024-09-12T00:58:09.196589+0000","last_became_active":"2024-09-12T00:32:28.058127+0000","last_became_peered":"2024-09-12T00:32:28.058127+0000","last_unstale":"2024-09-12T00:58:09.196589+0000","last_undegraded":"2024-09-12T00:58:09.196589+0000","last_fullsized":"2024-09-12T00:58:09.196589+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:36.704098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"268'3","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.197862+0000","last_change":"2024-09-12T00:32:25.013431+0000","last_active":"2024-09-12T01:00:28.197862+0000","last_peered":"2024-09-12T01:00:28.197862+0000","last_clean":"2024-09-12T01:00:28.197862+0000","last_became_active":"2024-09-12T00:32:25.013042+0000","last_became_peered":"2024-09-12T00:32:25.013042+0000","last_unstale":"2024-09-12T01:00:28.197862+0000","last_undegraded":"2024-09-12T01:00:28.197862+0000","last_fullsized":"2024-09-12T01:00:28.197862+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:01.167610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'29","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:52.165632+0000","last_change":"2024-09-12T00:30:51.548109+0000","last_active":"2024-09-12T00:58:52.165632+0000","last_peered":"2024-09-12T00:58:52.165632+0000","last_clean":"2024-09-12T00:58:52.165632+0000","last_became_active":"2024-09-12T00:30:51.545619+0000","last_became_peered":"2024-09-12T00:30:51.545619+0000","last_unstale":"2024-09-12T00:58:52.165632+0000","last_undegraded":"2024-09-12T00:58:52.165632+0000","last_fullsized":"2024-09-12T00:58:52.165632+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:38.398967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":120,"num_write":40,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:07.193629+0000","last_change":"2024-09-12T00:43:48.280018+0000","last_active":"2024-09-12T00:59:07.193629+0000","last_peered":"2024-09-12T00:59:07.193629+0000","last_clean":"2024-09-12T00:59:07.193629+0000","last_became_active":"2024-09-12T00:43:48.279197+0000","last_became_peered":"2024-09-12T00:43:48.279197+0000","last_unstale":"2024-09-12T00:59:07.193629+0000","last_undegraded":"2024-09-12T00:59:07.193629+0000","last_fullsized":"2024-09-12T00:59:07.193629+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:16.184230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174616+0000","last_change":"2024-09-12T00:32:28.058572+0000","last_active":"2024-09-12T00:59:27.174616+0000","last_peered":"2024-09-12T00:59:27.174616+0000","last_clean":"2024-09-12T00:59:27.174616+0000","last_became_active":"2024-09-12T00:32:28.057839+0000","last_became_peered":"2024-09-12T00:32:28.057839+0000","last_unstale":"2024-09-12T00:59:27.174616+0000","last_undegraded":"2024-09-12T00:59:27.174616+0000","last_fullsized":"2024-09-12T00:59:27.174616+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:41.184079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"268'7","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:28.183290+0000","last_change":"2024-09-12T00:32:25.022238+0000","last_active":"2024-09-12T00:59:28.183290+0000","last_peered":"2024-09-12T00:59:28.183290+0000","last_clean":"2024-09-12T00:59:28.183290+0000","last_became_active":"2024-09-12T00:32:25.021649+0000","last_became_peered":"2024-09-12T00:32:25.021649+0000","last_unstale":"2024-09-12T00:59:28.183290+0000","last_undegraded":"2024-09-12T00:59:28.183290+0000","last_fullsized":"2024-09-12T00:59:28.183290+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:11.939783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"268'68","reported_seq":236,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:17.186626+0000","last_change":"2024-09-12T00:30:51.562713+0000","last_active":"2024-09-12T01:00:17.186626+0000","last_peered":"2024-09-12T01:00:17.186626+0000","last_clean":"2024-09-12T01:00:17.186626+0000","last_became_active":"2024-09-12T00:30:51.562106+0000","last_became_peered":"2024-09-12T00:30:51.562106+0000","last_unstale":"2024-09-12T01:00:17.186626+0000","last_undegraded":"2024-09-12T01:00:17.186626+0000","last_fullsized":"2024-09-12T01:00:17.186626+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:57.176892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":360,"num_read_kb":258,"num_write":123,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185103+0000","last_change":"2024-09-12T00:43:48.287022+0000","last_active":"2024-09-12T00:59:33.185103+0000","last_peered":"2024-09-12T00:59:33.185103+0000","last_clean":"2024-09-12T00:59:33.185103+0000","last_became_active":"2024-09-12T00:43:48.286629+0000","last_became_peered":"2024-09-12T00:43:48.286629+0000","last_unstale":"2024-09-12T00:59:33.185103+0000","last_undegraded":"2024-09-12T00:59:33.185103+0000","last_fullsized":"2024-09-12T00:59:33.185103+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:40.640752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174553+0000","last_change":"2024-09-12T00:32:28.071698+0000","last_active":"2024-09-12T00:59:27.174553+0000","last_peered":"2024-09-12T00:59:27.174553+0000","last_clean":"2024-09-12T00:59:27.174553+0000","last_became_active":"2024-09-12T00:32:28.070913+0000","last_became_peered":"2024-09-12T00:32:28.070913+0000","last_unstale":"2024-09-12T00:59:27.174553+0000","last_undegraded":"2024-09-12T00:59:27.174553+0000","last_fullsized":"2024-09-12T00:59:27.174553+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:34.008495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"268'8","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:28.172420+0000","last_change":"2024-09-12T00:32:25.022141+0000","last_active":"2024-09-12T00:59:28.172420+0000","last_peered":"2024-09-12T00:59:28.172420+0000","last_clean":"2024-09-12T00:59:28.172420+0000","last_became_active":"2024-09-12T00:32:25.007681+0000","last_became_peered":"2024-09-12T00:32:25.007681+0000","last_unstale":"2024-09-12T00:59:28.172420+0000","last_undegraded":"2024-09-12T00:59:28.172420+0000","last_fullsized":"2024-09-12T00:59:28.172420+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:46.593006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5291296,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":4146,"num_write":18,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"268'39","reported_seq":150,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:09.229370+0000","last_change":"2024-09-12T00:30:51.565589+0000","last_active":"2024-09-12T01:00:09.229370+0000","last_peered":"2024-09-12T01:00:09.229370+0000","last_clean":"2024-09-12T01:00:09.229370+0000","last_became_active":"2024-09-12T00:30:51.559520+0000","last_became_peered":"2024-09-12T00:30:51.559520+0000","last_unstale":"2024-09-12T01:00:09.229370+0000","last_undegraded":"2024-09-12T01:00:09.229370+0000","last_fullsized":"2024-09-12T01:00:09.229370+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:38.099204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":143,"num_write":68,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:59.211561+0000","last_change":"2024-09-12T00:43:48.287080+0000","last_active":"2024-09-12T00:58:59.211561+0000","last_peered":"2024-09-12T00:58:59.211561+0000","last_clean":"2024-09-12T00:58:59.211561+0000","last_became_active":"2024-09-12T00:43:48.286079+0000","last_became_peered":"2024-09-12T00:43:48.286079+0000","last_unstale":"2024-09-12T00:58:59.211561+0000","last_undegraded":"2024-09-12T00:58:59.211561+0000","last_fullsized":"2024-09-12T00:58:59.211561+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:57.937242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.177100+0000","last_change":"2024-09-12T00:32:28.075197+0000","last_active":"2024-09-12T00:59:37.177100+0000","last_peered":"2024-09-12T00:59:37.177100+0000","last_clean":"2024-09-12T00:59:37.177100+0000","last_became_active":"2024-09-12T00:32:28.074621+0000","last_became_peered":"2024-09-12T00:32:28.074621+0000","last_unstale":"2024-09-12T00:59:37.177100+0000","last_undegraded":"2024-09-12T00:59:37.177100+0000","last_fullsized":"2024-09-12T00:59:37.177100+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:11.217357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174686+0000","last_change":"2024-09-12T00:32:25.009196+0000","last_active":"2024-09-12T00:59:27.174686+0000","last_peered":"2024-09-12T00:59:27.174686+0000","last_clean":"2024-09-12T00:59:27.174686+0000","last_became_active":"2024-09-12T00:32:25.008419+0000","last_became_peered":"2024-09-12T00:32:25.008419+0000","last_unstale":"2024-09-12T00:59:27.174686+0000","last_undegraded":"2024-09-12T00:59:27.174686+0000","last_fullsized":"2024-09-12T00:59:27.174686+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:01.482915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"268'30","reported_seq":120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.193309+0000","last_change":"2024-09-12T00:30:51.541334+0000","last_active":"2024-09-12T01:00:08.193309+0000","last_peered":"2024-09-12T01:00:08.193309+0000","last_clean":"2024-09-12T01:00:08.193309+0000","last_became_active":"2024-09-12T00:30:51.540434+0000","last_became_peered":"2024-09-12T00:30:51.540434+0000","last_unstale":"2024-09-12T01:00:08.193309+0000","last_undegraded":"2024-09-12T01:00:08.193309+0000","last_fullsized":"2024-09-12T01:00:08.193309+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:01.590635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":92,"num_write":60,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:58.176983+0000","last_change":"2024-09-12T00:43:48.279278+0000","last_active":"2024-09-12T00:58:58.176983+0000","last_peered":"2024-09-12T00:58:58.176983+0000","last_clean":"2024-09-12T00:58:58.176983+0000","last_became_active":"2024-09-12T00:43:48.278477+0000","last_became_peered":"2024-09-12T00:43:48.278477+0000","last_unstale":"2024-09-12T00:58:58.176983+0000","last_undegraded":"2024-09-12T00:58:58.176983+0000","last_fullsized":"2024-09-12T00:58:58.176983+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:23.351907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"268'10","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:32.200462+0000","last_change":"2024-09-12T00:32:28.075698+0000","last_active":"2024-09-12T00:59:32.200462+0000","last_peered":"2024-09-12T00:59:32.200462+0000","last_clean":"2024-09-12T00:59:32.200462+0000","last_became_active":"2024-09-12T00:32:28.066441+0000","last_became_peered":"2024-09-12T00:32:28.066441+0000","last_unstale":"2024-09-12T00:59:32.200462+0000","last_undegraded":"2024-09-12T00:59:32.200462+0000","last_fullsized":"2024-09-12T00:59:32.200462+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:29.911316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":37890,"num_write":20,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.177139+0000","last_change":"2024-09-12T00:32:25.011505+0000","last_active":"2024-09-12T00:59:37.177139+0000","last_peered":"2024-09-12T00:59:37.177139+0000","last_clean":"2024-09-12T00:59:37.177139+0000","last_became_active":"2024-09-12T00:32:25.010752+0000","last_became_peered":"2024-09-12T00:32:25.010752+0000","last_unstale":"2024-09-12T00:59:37.177139+0000","last_undegraded":"2024-09-12T00:59:37.177139+0000","last_fullsized":"2024-09-12T00:59:37.177139+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:38.026878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"268'114","reported_seq":464,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.181883+0000","last_change":"2024-09-12T00:30:51.550820+0000","last_active":"2024-09-12T01:00:08.181883+0000","last_peered":"2024-09-12T01:00:08.181883+0000","last_clean":"2024-09-12T01:00:08.181883+0000","last_became_active":"2024-09-12T00:30:51.550081+0000","last_became_peered":"2024-09-12T00:30:51.550081+0000","last_unstale":"2024-09-12T01:00:08.181883+0000","last_undegraded":"2024-09-12T01:00:08.181883+0000","last_fullsized":"2024-09-12T01:00:08.181883+0000","mapping_epoch":257,"log_start":"265'100","ondisk_log_start":"265'100","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:48.107776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":826,"num_read_kb":599,"num_write":142,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.201751+0000","last_change":"2024-09-12T00:43:48.273417+0000","last_active":"2024-09-12T00:59:37.201751+0000","last_peered":"2024-09-12T00:59:37.201751+0000","last_clean":"2024-09-12T00:59:37.201751+0000","last_became_active":"2024-09-12T00:43:48.272486+0000","last_became_peered":"2024-09-12T00:43:48.272486+0000","last_unstale":"2024-09-12T00:59:37.201751+0000","last_undegraded":"2024-09-12T00:59:37.201751+0000","last_fullsized":"2024-09-12T00:59:37.201751+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:26.875710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:29.201794+0000","last_change":"2024-09-12T00:32:28.051078+0000","last_active":"2024-09-12T00:58:29.201794+0000","last_peered":"2024-09-12T00:58:29.201794+0000","last_clean":"2024-09-12T00:58:29.201794+0000","last_became_active":"2024-09-12T00:32:28.049186+0000","last_became_peered":"2024-09-12T00:32:28.049186+0000","last_unstale":"2024-09-12T00:58:29.201794+0000","last_undegraded":"2024-09-12T00:58:29.201794+0000","last_fullsized":"2024-09-12T00:58:29.201794+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:54.432738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:27.160025+0000","last_change":"2024-09-12T00:32:25.000690+0000","last_active":"2024-09-12T00:58:27.160025+0000","last_peered":"2024-09-12T00:58:27.160025+0000","last_clean":"2024-09-12T00:58:27.160025+0000","last_became_active":"2024-09-12T00:32:24.999633+0000","last_became_peered":"2024-09-12T00:32:24.999633+0000","last_unstale":"2024-09-12T00:58:27.160025+0000","last_undegraded":"2024-09-12T00:58:27.160025+0000","last_fullsized":"2024-09-12T00:58:27.160025+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:09.259657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"268'69","reported_seq":237,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.181761+0000","last_change":"2024-09-12T00:30:51.548507+0000","last_active":"2024-09-12T01:00:08.181761+0000","last_peered":"2024-09-12T01:00:08.181761+0000","last_clean":"2024-09-12T01:00:08.181761+0000","last_became_active":"2024-09-12T00:30:51.546873+0000","last_became_peered":"2024-09-12T00:30:51.546873+0000","last_unstale":"2024-09-12T01:00:08.181761+0000","last_undegraded":"2024-09-12T01:00:08.181761+0000","last_fullsized":"2024-09-12T01:00:08.181761+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:28.201041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":256,"num_write":124,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:38.185725+0000","last_change":"2024-09-12T00:43:48.287793+0000","last_active":"2024-09-12T00:59:38.185725+0000","last_peered":"2024-09-12T00:59:38.185725+0000","last_clean":"2024-09-12T00:59:38.185725+0000","last_became_active":"2024-09-12T00:43:48.287144+0000","last_became_peered":"2024-09-12T00:43:48.287144+0000","last_unstale":"2024-09-12T00:59:38.185725+0000","last_undegraded":"2024-09-12T00:59:38.185725+0000","last_fullsized":"2024-09-12T00:59:38.185725+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:03.320468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:28.167607+0000","last_change":"2024-09-12T00:32:28.064542+0000","last_active":"2024-09-12T00:58:28.167607+0000","last_peered":"2024-09-12T00:58:28.167607+0000","last_clean":"2024-09-12T00:58:28.167607+0000","last_became_active":"2024-09-12T00:32:28.063712+0000","last_became_peered":"2024-09-12T00:32:28.063712+0000","last_unstale":"2024-09-12T00:58:28.167607+0000","last_undegraded":"2024-09-12T00:58:28.167607+0000","last_fullsized":"2024-09-12T00:58:28.167607+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:07.012225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"268'2","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:27.183761+0000","last_change":"2024-09-12T00:32:25.012329+0000","last_active":"2024-09-12T00:58:27.183761+0000","last_peered":"2024-09-12T00:58:27.183761+0000","last_clean":"2024-09-12T00:58:27.183761+0000","last_became_active":"2024-09-12T00:32:25.005902+0000","last_became_peered":"2024-09-12T00:32:25.005902+0000","last_unstale":"2024-09-12T00:58:27.183761+0000","last_undegraded":"2024-09-12T00:58:27.183761+0000","last_fullsized":"2024-09-12T00:58:27.183761+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:34.031714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"268'31","reported_seq":126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:13.179616+0000","last_change":"2024-09-12T00:30:51.545329+0000","last_active":"2024-09-12T00:59:13.179616+0000","last_peered":"2024-09-12T00:59:13.179616+0000","last_clean":"2024-09-12T00:59:13.179616+0000","last_became_active":"2024-09-12T00:30:51.541904+0000","last_became_peered":"2024-09-12T00:30:51.541904+0000","last_unstale":"2024-09-12T00:59:13.179616+0000","last_undegraded":"2024-09-12T00:59:13.179616+0000","last_fullsized":"2024-09-12T00:59:13.179616+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:26.384655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":109,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185912+0000","last_change":"2024-09-12T00:43:48.275537+0000","last_active":"2024-09-12T00:59:33.185912+0000","last_peered":"2024-09-12T00:59:33.185912+0000","last_clean":"2024-09-12T00:59:33.185912+0000","last_became_active":"2024-09-12T00:43:48.274756+0000","last_became_peered":"2024-09-12T00:43:48.274756+0000","last_unstale":"2024-09-12T00:59:33.185912+0000","last_undegraded":"2024-09-12T00:59:33.185912+0000","last_fullsized":"2024-09-12T00:59:33.185912+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:14.072781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"268'3","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:28.172269+0000","last_change":"2024-09-12T00:32:28.066799+0000","last_active":"2024-09-12T00:59:28.172269+0000","last_peered":"2024-09-12T00:59:28.172269+0000","last_clean":"2024-09-12T00:59:28.172269+0000","last_became_active":"2024-09-12T00:32:28.066029+0000","last_became_peered":"2024-09-12T00:32:28.066029+0000","last_unstale":"2024-09-12T00:59:28.172269+0000","last_undegraded":"2024-09-12T00:59:28.172269+0000","last_fullsized":"2024-09-12T00:59:28.172269+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:56.429963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"268'2","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:37.162238+0000","last_change":"2024-09-12T00:32:25.001979+0000","last_active":"2024-09-12T00:58:37.162238+0000","last_peered":"2024-09-12T00:58:37.162238+0000","last_clean":"2024-09-12T00:58:37.162238+0000","last_became_active":"2024-09-12T00:32:25.001194+0000","last_became_peered":"2024-09-12T00:32:25.001194+0000","last_unstale":"2024-09-12T00:58:37.162238+0000","last_undegraded":"2024-09-12T00:58:37.162238+0000","last_fullsized":"2024-09-12T00:58:37.162238+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:06.421742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"268'15","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.192385+0000","last_change":"2024-09-12T00:30:51.544531+0000","last_active":"2024-09-12T00:59:02.192385+0000","last_peered":"2024-09-12T00:59:02.192385+0000","last_clean":"2024-09-12T00:59:02.192385+0000","last_became_active":"2024-09-12T00:30:51.543711+0000","last_became_peered":"2024-09-12T00:30:51.543711+0000","last_unstale":"2024-09-12T00:59:02.192385+0000","last_undegraded":"2024-09-12T00:59:02.192385+0000","last_fullsized":"2024-09-12T00:59:02.192385+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:07.148537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":43,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.176965+0000","last_change":"2024-09-12T00:43:48.290387+0000","last_active":"2024-09-12T00:59:37.176965+0000","last_peered":"2024-09-12T00:59:37.176965+0000","last_clean":"2024-09-12T00:59:37.176965+0000","last_became_active":"2024-09-12T00:43:48.289475+0000","last_became_peered":"2024-09-12T00:43:48.289475+0000","last_unstale":"2024-09-12T00:59:37.176965+0000","last_undegraded":"2024-09-12T00:59:37.176965+0000","last_fullsized":"2024-09-12T00:59:37.176965+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:49.960814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.169772+0000","last_change":"2024-09-12T00:32:28.056626+0000","last_active":"2024-09-12T00:58:33.169772+0000","last_peered":"2024-09-12T00:58:33.169772+0000","last_clean":"2024-09-12T00:58:33.169772+0000","last_became_active":"2024-09-12T00:32:28.055934+0000","last_became_peered":"2024-09-12T00:32:28.055934+0000","last_unstale":"2024-09-12T00:58:33.169772+0000","last_undegraded":"2024-09-12T00:58:33.169772+0000","last_fullsized":"2024-09-12T00:58:33.169772+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:50.220908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"268'2","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:24.218059+0000","last_change":"2024-09-12T00:32:25.005226+0000","last_active":"2024-09-12T00:59:24.218059+0000","last_peered":"2024-09-12T00:59:24.218059+0000","last_clean":"2024-09-12T00:59:24.218059+0000","last_became_active":"2024-09-12T00:32:25.004503+0000","last_became_peered":"2024-09-12T00:32:25.004503+0000","last_unstale":"2024-09-12T00:59:24.218059+0000","last_undegraded":"2024-09-12T00:59:24.218059+0000","last_fullsized":"2024-09-12T00:59:24.218059+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:32.108404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"268'12","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.178118+0000","last_change":"2024-09-12T00:30:51.543743+0000","last_active":"2024-09-12T00:59:03.178118+0000","last_peered":"2024-09-12T00:59:03.178118+0000","last_clean":"2024-09-12T00:59:03.178118+0000","last_became_active":"2024-09-12T00:30:51.542992+0000","last_became_peered":"2024-09-12T00:30:51.542992+0000","last_unstale":"2024-09-12T00:59:03.178118+0000","last_undegraded":"2024-09-12T00:59:03.178118+0000","last_fullsized":"2024-09-12T00:59:03.178118+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:43.711804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.199729+0000","last_change":"2024-09-12T00:43:48.283532+0000","last_active":"2024-09-12T01:00:28.199729+0000","last_peered":"2024-09-12T01:00:28.199729+0000","last_clean":"2024-09-12T01:00:28.199729+0000","last_became_active":"2024-09-12T00:43:48.276293+0000","last_became_peered":"2024-09-12T00:43:48.276293+0000","last_unstale":"2024-09-12T01:00:28.199729+0000","last_undegraded":"2024-09-12T01:00:28.199729+0000","last_fullsized":"2024-09-12T01:00:28.199729+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:45.902022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"268'4","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:42.202970+0000","last_change":"2024-09-12T00:32:28.073623+0000","last_active":"2024-09-12T00:59:42.202970+0000","last_peered":"2024-09-12T00:59:42.202970+0000","last_clean":"2024-09-12T00:59:42.202970+0000","last_became_active":"2024-09-12T00:32:28.067824+0000","last_became_peered":"2024-09-12T00:32:28.067824+0000","last_unstale":"2024-09-12T00:59:42.202970+0000","last_undegraded":"2024-09-12T00:59:42.202970+0000","last_fullsized":"2024-09-12T00:59:42.202970+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:24.607971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":11264,"num_write":4,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"268'3","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:34.014457+0000","last_change":"2024-09-12T00:32:25.022973+0000","last_active":"2024-09-12T01:01:34.014457+0000","last_peered":"2024-09-12T01:01:34.014457+0000","last_clean":"2024-09-12T01:01:34.014457+0000","last_became_active":"2024-09-12T00:32:25.022210+0000","last_became_peered":"2024-09-12T00:32:25.022210+0000","last_unstale":"2024-09-12T01:01:34.014457+0000","last_undegraded":"2024-09-12T01:01:34.014457+0000","last_fullsized":"2024-09-12T01:01:34.014457+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:27.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.171708+0000","last_change":"2024-09-12T00:30:51.550674+0000","last_active":"2024-09-12T00:59:03.171708+0000","last_peered":"2024-09-12T00:59:03.171708+0000","last_clean":"2024-09-12T00:59:03.171708+0000","last_became_active":"2024-09-12T00:30:51.549942+0000","last_became_peered":"2024-09-12T00:30:51.549942+0000","last_unstale":"2024-09-12T00:59:03.171708+0000","last_undegraded":"2024-09-12T00:59:03.171708+0000","last_fullsized":"2024-09-12T00:59:03.171708+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:52.263117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":118,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.199785+0000","last_change":"2024-09-12T00:43:48.276759+0000","last_active":"2024-09-12T01:00:28.199785+0000","last_peered":"2024-09-12T01:00:28.199785+0000","last_clean":"2024-09-12T01:00:28.199785+0000","last_became_active":"2024-09-12T00:43:48.276176+0000","last_became_peered":"2024-09-12T00:43:48.276176+0000","last_unstale":"2024-09-12T01:00:28.199785+0000","last_undegraded":"2024-09-12T01:00:28.199785+0000","last_fullsized":"2024-09-12T01:00:28.199785+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:07.896702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.201670+0000","last_change":"2024-09-12T00:32:28.052395+0000","last_active":"2024-09-12T00:59:37.201670+0000","last_peered":"2024-09-12T00:59:37.201670+0000","last_clean":"2024-09-12T00:59:37.201670+0000","last_became_active":"2024-09-12T00:32:28.051244+0000","last_became_peered":"2024-09-12T00:32:28.051244+0000","last_unstale":"2024-09-12T00:59:37.201670+0000","last_undegraded":"2024-09-12T00:59:37.201670+0000","last_fullsized":"2024-09-12T00:59:37.201670+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:09.633243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"268'2","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.995791+0000","last_change":"2024-09-12T00:32:25.023656+0000","last_active":"2024-09-12T01:01:47.995791+0000","last_peered":"2024-09-12T01:01:47.995791+0000","last_clean":"2024-09-12T01:01:47.995791+0000","last_became_active":"2024-09-12T00:32:25.022757+0000","last_became_peered":"2024-09-12T00:32:25.022757+0000","last_unstale":"2024-09-12T01:01:47.995791+0000","last_undegraded":"2024-09-12T01:01:47.995791+0000","last_fullsized":"2024-09-12T01:01:47.995791+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:59.877231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'12","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:04.213055+0000","last_change":"2024-09-12T00:30:51.566131+0000","last_active":"2024-09-12T00:59:04.213055+0000","last_peered":"2024-09-12T00:59:04.213055+0000","last_clean":"2024-09-12T00:59:04.213055+0000","last_became_active":"2024-09-12T00:30:51.565544+0000","last_became_peered":"2024-09-12T00:30:51.565544+0000","last_unstale":"2024-09-12T00:59:04.213055+0000","last_undegraded":"2024-09-12T00:59:04.213055+0000","last_fullsized":"2024-09-12T00:59:04.213055+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:14.413107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.206539+0000","last_change":"2024-09-12T00:43:48.280037+0000","last_active":"2024-09-12T00:59:57.206539+0000","last_peered":"2024-09-12T00:59:57.206539+0000","last_clean":"2024-09-12T00:59:57.206539+0000","last_became_active":"2024-09-12T00:43:48.279243+0000","last_became_peered":"2024-09-12T00:43:48.279243+0000","last_unstale":"2024-09-12T00:59:57.206539+0000","last_undegraded":"2024-09-12T00:59:57.206539+0000","last_fullsized":"2024-09-12T00:59:57.206539+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:31.525488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"268'2","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:28.168408+0000","last_change":"2024-09-12T00:32:28.060782+0000","last_active":"2024-09-12T00:58:28.168408+0000","last_peered":"2024-09-12T00:58:28.168408+0000","last_clean":"2024-09-12T00:58:28.168408+0000","last_became_active":"2024-09-12T00:32:28.058384+0000","last_became_peered":"2024-09-12T00:32:28.058384+0000","last_unstale":"2024-09-12T00:58:28.168408+0000","last_undegraded":"2024-09-12T00:58:28.168408+0000","last_fullsized":"2024-09-12T00:58:28.168408+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:38.238661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"265'3","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:28.167835+0000","last_change":"2024-09-12T00:32:24.996244+0000","last_active":"2024-09-12T00:58:28.167835+0000","last_peered":"2024-09-12T00:58:28.167835+0000","last_clean":"2024-09-12T00:58:28.167835+0000","last_became_active":"2024-09-12T00:32:24.995532+0000","last_became_peered":"2024-09-12T00:32:24.995532+0000","last_unstale":"2024-09-12T00:58:28.167835+0000","last_undegraded":"2024-09-12T00:58:28.167835+0000","last_fullsized":"2024-09-12T00:58:28.167835+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:39.969617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"268'40","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.196522+0000","last_change":"2024-09-12T00:30:51.554468+0000","last_active":"2024-09-12T01:00:13.196522+0000","last_peered":"2024-09-12T01:00:13.196522+0000","last_clean":"2024-09-12T01:00:13.196522+0000","last_became_active":"2024-09-12T00:30:51.553501+0000","last_became_peered":"2024-09-12T00:30:51.553501+0000","last_unstale":"2024-09-12T01:00:13.196522+0000","last_undegraded":"2024-09-12T01:00:13.196522+0000","last_fullsized":"2024-09-12T01:00:13.196522+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:13.843806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":68,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.234081+0000","last_change":"2024-09-12T00:43:48.281674+0000","last_active":"2024-09-12T01:00:29.234081+0000","last_peered":"2024-09-12T01:00:29.234081+0000","last_clean":"2024-09-12T01:00:29.234081+0000","last_became_active":"2024-09-12T00:43:48.280566+0000","last_became_peered":"2024-09-12T00:43:48.280566+0000","last_unstale":"2024-09-12T01:00:29.234081+0000","last_undegraded":"2024-09-12T01:00:29.234081+0000","last_fullsized":"2024-09-12T01:00:29.234081+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:02.297251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"268'4","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000545+0000","last_change":"2024-09-12T00:32:28.061791+0000","last_active":"2024-09-12T01:00:39.000545+0000","last_peered":"2024-09-12T01:00:39.000545+0000","last_clean":"2024-09-12T01:00:39.000545+0000","last_became_active":"2024-09-12T00:32:28.061089+0000","last_became_peered":"2024-09-12T00:32:28.061089+0000","last_unstale":"2024-09-12T01:00:39.000545+0000","last_undegraded":"2024-09-12T01:00:39.000545+0000","last_fullsized":"2024-09-12T01:00:39.000545+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:12.218155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":326,"num_write":4,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"265'11","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:24.200843+0000","last_change":"2024-09-12T00:32:25.004508+0000","last_active":"2024-09-12T00:58:24.200843+0000","last_peered":"2024-09-12T00:58:24.200843+0000","last_clean":"2024-09-12T00:58:24.200843+0000","last_became_active":"2024-09-12T00:32:25.004199+0000","last_became_peered":"2024-09-12T00:32:25.004199+0000","last_unstale":"2024-09-12T00:58:24.200843+0000","last_undegraded":"2024-09-12T00:58:24.200843+0000","last_fullsized":"2024-09-12T00:58:24.200843+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:38.507054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11280,"num_write":21,"num_write_kb":11280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"268'12","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:02.183087+0000","last_change":"2024-09-12T00:30:51.554784+0000","last_active":"2024-09-12T01:00:02.183087+0000","last_peered":"2024-09-12T01:00:02.183087+0000","last_clean":"2024-09-12T01:00:02.183087+0000","last_became_active":"2024-09-12T00:30:51.548619+0000","last_became_peered":"2024-09-12T00:30:51.548619+0000","last_unstale":"2024-09-12T01:00:02.183087+0000","last_undegraded":"2024-09-12T01:00:02.183087+0000","last_fullsized":"2024-09-12T01:00:02.183087+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:18.858058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168084+0000","last_change":"2024-09-12T00:43:48.284636+0000","last_active":"2024-09-12T00:59:02.168084+0000","last_peered":"2024-09-12T00:59:02.168084+0000","last_clean":"2024-09-12T00:59:02.168084+0000","last_became_active":"2024-09-12T00:43:48.283630+0000","last_became_peered":"2024-09-12T00:43:48.283630+0000","last_unstale":"2024-09-12T00:59:02.168084+0000","last_undegraded":"2024-09-12T00:59:02.168084+0000","last_fullsized":"2024-09-12T00:59:02.168084+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:05.417886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'5","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179689+0000","last_change":"2024-09-12T00:32:28.054779+0000","last_active":"2024-09-12T00:59:33.179689+0000","last_peered":"2024-09-12T00:59:33.179689+0000","last_clean":"2024-09-12T00:59:33.179689+0000","last_became_active":"2024-09-12T00:32:28.054045+0000","last_became_peered":"2024-09-12T00:32:28.054045+0000","last_unstale":"2024-09-12T00:59:33.179689+0000","last_undegraded":"2024-09-12T00:59:33.179689+0000","last_fullsized":"2024-09-12T00:59:33.179689+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:05.598087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'3","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:38.202145+0000","last_change":"2024-09-12T00:32:24.998555+0000","last_active":"2024-09-12T01:00:38.202145+0000","last_peered":"2024-09-12T01:00:38.202145+0000","last_clean":"2024-09-12T01:00:38.202145+0000","last_became_active":"2024-09-12T00:32:24.997768+0000","last_became_peered":"2024-09-12T00:32:24.997768+0000","last_unstale":"2024-09-12T01:00:38.202145+0000","last_undegraded":"2024-09-12T01:00:38.202145+0000","last_fullsized":"2024-09-12T01:00:38.202145+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:01.938274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"268'27","reported_seq":114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.193807+0000","last_change":"2024-09-12T00:30:51.557180+0000","last_active":"2024-09-12T01:00:03.193807+0000","last_peered":"2024-09-12T01:00:03.193807+0000","last_clean":"2024-09-12T01:00:03.193807+0000","last_became_active":"2024-09-12T00:30:51.556456+0000","last_became_peered":"2024-09-12T00:30:51.556456+0000","last_unstale":"2024-09-12T01:00:03.193807+0000","last_undegraded":"2024-09-12T01:00:03.193807+0000","last_fullsized":"2024-09-12T01:00:03.193807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:08.813545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":57,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:58.170620+0000","last_change":"2024-09-12T00:43:48.266541+0000","last_active":"2024-09-12T00:58:58.170620+0000","last_peered":"2024-09-12T00:58:58.170620+0000","last_clean":"2024-09-12T00:58:58.170620+0000","last_became_active":"2024-09-12T00:43:48.265726+0000","last_became_peered":"2024-09-12T00:43:48.265726+0000","last_unstale":"2024-09-12T00:58:58.170620+0000","last_undegraded":"2024-09-12T00:58:58.170620+0000","last_fullsized":"2024-09-12T00:58:58.170620+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:07.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000271+0000","last_change":"2024-09-12T00:32:28.051868+0000","last_active":"2024-09-12T01:00:39.000271+0000","last_peered":"2024-09-12T01:00:39.000271+0000","last_clean":"2024-09-12T01:00:39.000271+0000","last_became_active":"2024-09-12T00:32:28.051145+0000","last_became_peered":"2024-09-12T00:32:28.051145+0000","last_unstale":"2024-09-12T01:00:39.000271+0000","last_undegraded":"2024-09-12T01:00:39.000271+0000","last_fullsized":"2024-09-12T01:00:39.000271+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:26.514177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219199+0000","last_change":"2024-09-12T00:32:25.007529+0000","last_active":"2024-09-12T00:59:29.219199+0000","last_peered":"2024-09-12T00:59:29.219199+0000","last_clean":"2024-09-12T00:59:29.219199+0000","last_became_active":"2024-09-12T00:32:25.003679+0000","last_became_peered":"2024-09-12T00:32:25.003679+0000","last_unstale":"2024-09-12T00:59:29.219199+0000","last_undegraded":"2024-09-12T00:59:29.219199+0000","last_fullsized":"2024-09-12T00:59:29.219199+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:31.977653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"268'23","reported_seq":107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:04.228064+0000","last_change":"2024-09-12T00:30:51.552593+0000","last_active":"2024-09-12T01:00:04.228064+0000","last_peered":"2024-09-12T01:00:04.228064+0000","last_clean":"2024-09-12T01:00:04.228064+0000","last_became_active":"2024-09-12T00:30:51.551554+0000","last_became_peered":"2024-09-12T00:30:51.551554+0000","last_unstale":"2024-09-12T01:00:04.228064+0000","last_undegraded":"2024-09-12T01:00:04.228064+0000","last_fullsized":"2024-09-12T01:00:04.228064+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:19.144268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.989931+0000","last_change":"2024-09-12T00:43:48.287349+0000","last_active":"2024-09-12T01:00:31.989931+0000","last_peered":"2024-09-12T01:00:31.989931+0000","last_clean":"2024-09-12T01:00:31.989931+0000","last_became_active":"2024-09-12T00:43:48.286593+0000","last_became_peered":"2024-09-12T00:43:48.286593+0000","last_unstale":"2024-09-12T01:00:31.989931+0000","last_undegraded":"2024-09-12T01:00:31.989931+0000","last_fullsized":"2024-09-12T01:00:31.989931+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:41.625703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"268'5","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.184398+0000","last_change":"2024-09-12T00:32:28.070368+0000","last_active":"2024-09-12T00:59:33.184398+0000","last_peered":"2024-09-12T00:59:33.184398+0000","last_clean":"2024-09-12T00:59:33.184398+0000","last_became_active":"2024-09-12T00:32:28.069812+0000","last_became_peered":"2024-09-12T00:32:28.069812+0000","last_unstale":"2024-09-12T00:59:33.184398+0000","last_undegraded":"2024-09-12T00:59:33.184398+0000","last_fullsized":"2024-09-12T00:59:33.184398+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:37.247045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":5,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"268'8","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:38.202224+0000","last_change":"2024-09-12T00:32:25.021525+0000","last_active":"2024-09-12T01:01:38.202224+0000","last_peered":"2024-09-12T01:01:38.202224+0000","last_clean":"2024-09-12T01:01:38.202224+0000","last_became_active":"2024-09-12T00:32:25.017138+0000","last_became_peered":"2024-09-12T00:32:25.017138+0000","last_unstale":"2024-09-12T01:01:38.202224+0000","last_undegraded":"2024-09-12T01:01:38.202224+0000","last_fullsized":"2024-09-12T01:01:38.202224+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:39.080595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"268'53","reported_seq":190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:04.227963+0000","last_change":"2024-09-12T00:30:51.553247+0000","last_active":"2024-09-12T01:00:04.227963+0000","last_peered":"2024-09-12T01:00:04.227963+0000","last_clean":"2024-09-12T01:00:04.227963+0000","last_became_active":"2024-09-12T00:30:51.546238+0000","last_became_peered":"2024-09-12T00:30:51.546238+0000","last_unstale":"2024-09-12T01:00:04.227963+0000","last_undegraded":"2024-09-12T01:00:04.227963+0000","last_fullsized":"2024-09-12T01:00:04.227963+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:52.536369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":191,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:29.201979+0000","last_change":"2024-09-12T00:43:48.277891+0000","last_active":"2024-09-12T00:58:29.201979+0000","last_peered":"2024-09-12T00:58:29.201979+0000","last_clean":"2024-09-12T00:58:29.201979+0000","last_became_active":"2024-09-12T00:43:48.277275+0000","last_became_peered":"2024-09-12T00:43:48.277275+0000","last_unstale":"2024-09-12T00:58:29.201979+0000","last_undegraded":"2024-09-12T00:58:29.201979+0000","last_fullsized":"2024-09-12T00:58:29.201979+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:00.758192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.184304+0000","last_change":"2024-09-12T00:32:28.066072+0000","last_active":"2024-09-12T00:59:33.184304+0000","last_peered":"2024-09-12T00:59:33.184304+0000","last_clean":"2024-09-12T00:59:33.184304+0000","last_became_active":"2024-09-12T00:32:28.065320+0000","last_became_peered":"2024-09-12T00:32:28.065320+0000","last_unstale":"2024-09-12T00:59:33.184304+0000","last_undegraded":"2024-09-12T00:59:33.184304+0000","last_fullsized":"2024-09-12T00:59:33.184304+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:36.535395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'3","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185073+0000","last_change":"2024-09-12T00:32:25.017231+0000","last_active":"2024-09-12T00:59:33.185073+0000","last_peered":"2024-09-12T00:59:33.185073+0000","last_clean":"2024-09-12T00:59:33.185073+0000","last_became_active":"2024-09-12T00:32:25.013266+0000","last_became_peered":"2024-09-12T00:32:25.013266+0000","last_unstale":"2024-09-12T00:59:33.185073+0000","last_undegraded":"2024-09-12T00:59:33.185073+0000","last_fullsized":"2024-09-12T00:59:33.185073+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:11.615304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"268'15","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.177113+0000","last_change":"2024-09-12T00:30:51.560130+0000","last_active":"2024-09-12T00:59:03.177113+0000","last_peered":"2024-09-12T00:59:03.177113+0000","last_clean":"2024-09-12T00:59:03.177113+0000","last_became_active":"2024-09-12T00:30:51.559445+0000","last_became_peered":"2024-09-12T00:30:51.559445+0000","last_unstale":"2024-09-12T00:59:03.177113+0000","last_undegraded":"2024-09-12T00:59:03.177113+0000","last_fullsized":"2024-09-12T00:59:03.177113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:54.936785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"268'329","reported_seq":1086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.903151+0000","last_change":"2024-09-12T00:15:55.079016+0000","last_active":"2024-09-12T01:02:37.903151+0000","last_peered":"2024-09-12T01:02:37.903151+0000","last_clean":"2024-09-12T01:02:37.903151+0000","last_became_active":"2024-09-12T00:15:55.078687+0000","last_became_peered":"2024-09-12T00:15:55.078687+0000","last_unstale":"2024-09-12T01:02:37.903151+0000","last_undegraded":"2024-09-12T01:02:37.903151+0000","last_fullsized":"2024-09-12T01:02:37.903151+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:29.403023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340543,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":728,"num_read_kb":39834,"num_write":1219,"num_write_kb":26442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"268'857","reported_seq":2605,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.866154+0000","last_change":"2024-09-12T00:15:57.022290+0000","last_active":"2024-09-12T01:02:10.866154+0000","last_peered":"2024-09-12T01:02:10.866154+0000","last_clean":"2024-09-12T01:02:10.866154+0000","last_became_active":"2024-09-12T00:15:57.021927+0000","last_became_peered":"2024-09-12T00:15:57.021927+0000","last_unstale":"2024-09-12T01:02:10.866154+0000","last_undegraded":"2024-09-12T01:02:10.866154+0000","last_fullsized":"2024-09-12T01:02:10.866154+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:27.786130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4184,"num_read_kb":3812,"num_write":1107,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"268'331","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:26.529497+0000","last_change":"2024-09-12T00:15:55.075731+0000","last_active":"2024-09-12T01:00:26.529497+0000","last_peered":"2024-09-12T01:00:26.529497+0000","last_clean":"2024-09-12T01:00:26.529497+0000","last_became_active":"2024-09-12T00:15:55.075108+0000","last_became_peered":"2024-09-12T00:15:55.075108+0000","last_unstale":"2024-09-12T01:00:26.529497+0000","last_undegraded":"2024-09-12T01:00:26.529497+0000","last_fullsized":"2024-09-12T01:00:26.529497+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:53.644639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1697815,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":553,"num_read_kb":2161,"num_write":1163,"num_write_kb":32030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"268'541","reported_seq":2172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.146646+0000","last_change":"2024-09-12T00:15:57.022914+0000","last_active":"2024-09-12T01:01:02.146646+0000","last_peered":"2024-09-12T01:01:02.146646+0000","last_clean":"2024-09-12T01:01:02.146646+0000","last_became_active":"2024-09-12T00:15:57.022465+0000","last_became_peered":"2024-09-12T00:15:57.022465+0000","last_unstale":"2024-09-12T01:01:02.146646+0000","last_undegraded":"2024-09-12T01:01:02.146646+0000","last_fullsized":"2024-09-12T01:01:02.146646+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:22.255065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2758,"num_read_kb":2563,"num_write":657,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"268'324","reported_seq":1059,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:45.712992+0000","last_change":"2024-09-12T00:15:55.042888+0000","last_active":"2024-09-12T00:59:45.712992+0000","last_peered":"2024-09-12T00:59:45.712992+0000","last_clean":"2024-09-12T00:59:45.712992+0000","last_became_active":"2024-09-12T00:15:55.041491+0000","last_became_peered":"2024-09-12T00:15:55.041491+0000","last_unstale":"2024-09-12T00:59:45.712992+0000","last_undegraded":"2024-09-12T00:59:45.712992+0000","last_fullsized":"2024-09-12T00:59:45.712992+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:29.522820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8843817,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":766,"num_read_kb":4160,"num_write":1203,"num_write_kb":14348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"268'1145","reported_seq":2779,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:59.004596+0000","last_change":"2024-09-12T00:15:57.023106+0000","last_active":"2024-09-12T01:00:59.004596+0000","last_peered":"2024-09-12T01:00:59.004596+0000","last_clean":"2024-09-12T01:00:59.004596+0000","last_became_active":"2024-09-12T00:15:57.022692+0000","last_became_peered":"2024-09-12T00:15:57.022692+0000","last_unstale":"2024-09-12T01:00:59.004596+0000","last_undegraded":"2024-09-12T01:00:59.004596+0000","last_fullsized":"2024-09-12T01:00:59.004596+0000","mapping_epoch":28,"log_start":"268'1100","ondisk_log_start":"268'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":1100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:01.909120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5291,"num_read_kb":4702,"num_write":1570,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"268'355","reported_seq":1038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.154562+0000","last_change":"2024-09-12T00:15:55.046149+0000","last_active":"2024-09-12T01:02:38.154562+0000","last_peered":"2024-09-12T01:02:38.154562+0000","last_clean":"2024-09-12T01:02:38.154562+0000","last_became_active":"2024-09-12T00:15:55.045668+0000","last_became_peered":"2024-09-12T00:15:55.045668+0000","last_unstale":"2024-09-12T01:02:38.154562+0000","last_undegraded":"2024-09-12T01:02:38.154562+0000","last_fullsized":"2024-09-12T01:02:38.154562+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:25.710871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1414102,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":630,"num_read_kb":47789,"num_write":1261,"num_write_kb":53743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"268'567","reported_seq":2201,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506437+0000","last_change":"2024-09-12T00:15:57.019605+0000","last_active":"2024-09-12T01:01:09.506437+0000","last_peered":"2024-09-12T01:01:09.506437+0000","last_clean":"2024-09-12T01:01:09.506437+0000","last_became_active":"2024-09-12T00:15:57.018762+0000","last_became_peered":"2024-09-12T00:15:57.018762+0000","last_unstale":"2024-09-12T01:01:09.506437+0000","last_undegraded":"2024-09-12T01:01:09.506437+0000","last_fullsized":"2024-09-12T01:01:09.506437+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:00.744230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2864,"num_read_kb":2646,"num_write":693,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"268'320","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.001737+0000","last_change":"2024-09-12T00:15:55.072012+0000","last_active":"2024-09-12T01:02:38.001737+0000","last_peered":"2024-09-12T01:02:38.001737+0000","last_clean":"2024-09-12T01:02:38.001737+0000","last_became_active":"2024-09-12T00:15:55.071352+0000","last_became_peered":"2024-09-12T00:15:55.071352+0000","last_unstale":"2024-09-12T01:02:38.001737+0000","last_undegraded":"2024-09-12T01:02:38.001737+0000","last_fullsized":"2024-09-12T01:02:38.001737+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:19.609544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9193056,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":447,"num_read_kb":19398,"num_write":1094,"num_write_kb":53254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"268'458","reported_seq":2076,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:45.897964+0000","last_change":"2024-09-12T00:15:57.052282+0000","last_active":"2024-09-12T01:00:45.897964+0000","last_peered":"2024-09-12T01:00:45.897964+0000","last_clean":"2024-09-12T01:00:45.897964+0000","last_became_active":"2024-09-12T00:15:57.051973+0000","last_became_peered":"2024-09-12T00:15:57.051973+0000","last_unstale":"2024-09-12T01:00:45.897964+0000","last_undegraded":"2024-09-12T01:00:45.897964+0000","last_fullsized":"2024-09-12T01:00:45.897964+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:51.721224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":2348,"num_write":528,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"268'308","reported_seq":948,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.132717+0000","last_change":"2024-09-12T00:15:55.067779+0000","last_active":"2024-09-12T01:02:38.132717+0000","last_peered":"2024-09-12T01:02:38.132717+0000","last_clean":"2024-09-12T01:02:38.132717+0000","last_became_active":"2024-09-12T00:15:55.067030+0000","last_became_peered":"2024-09-12T00:15:55.067030+0000","last_unstale":"2024-09-12T01:02:38.132717+0000","last_undegraded":"2024-09-12T01:02:38.132717+0000","last_fullsized":"2024-09-12T01:02:38.132717+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:15.471567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5268077,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":455,"num_read_kb":33079,"num_write":975,"num_write_kb":28183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"268'485","reported_seq":2072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.168505+0000","last_change":"2024-09-12T00:15:57.037419+0000","last_active":"2024-09-12T01:00:52.168505+0000","last_peered":"2024-09-12T01:00:52.168505+0000","last_clean":"2024-09-12T01:00:52.168505+0000","last_became_active":"2024-09-12T00:15:57.037045+0000","last_became_peered":"2024-09-12T00:15:57.037045+0000","last_unstale":"2024-09-12T01:00:52.168505+0000","last_undegraded":"2024-09-12T01:00:52.168505+0000","last_fullsized":"2024-09-12T01:00:52.168505+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:10.231756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2556,"num_read_kb":2389,"num_write":592,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"268'316","reported_seq":1047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.002382+0000","last_change":"2024-09-12T00:15:55.050401+0000","last_active":"2024-09-12T01:02:38.002382+0000","last_peered":"2024-09-12T01:02:38.002382+0000","last_clean":"2024-09-12T01:02:38.002382+0000","last_became_active":"2024-09-12T00:15:55.041976+0000","last_became_peered":"2024-09-12T00:15:55.041976+0000","last_unstale":"2024-09-12T01:02:38.002382+0000","last_undegraded":"2024-09-12T01:02:38.002382+0000","last_fullsized":"2024-09-12T01:02:38.002382+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:30.850752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7623121,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":613,"num_read_kb":92016,"num_write":1157,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"268'476","reported_seq":1929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506328+0000","last_change":"2024-09-12T00:15:57.013582+0000","last_active":"2024-09-12T01:01:09.506328+0000","last_peered":"2024-09-12T01:01:09.506328+0000","last_clean":"2024-09-12T01:01:09.506328+0000","last_became_active":"2024-09-12T00:15:57.013278+0000","last_became_peered":"2024-09-12T00:15:57.013278+0000","last_unstale":"2024-09-12T01:01:09.506328+0000","last_undegraded":"2024-09-12T01:01:09.506328+0000","last_fullsized":"2024-09-12T01:01:09.506328+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:44.317982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2343,"num_read_kb":2167,"num_write":566,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"268'243","reported_seq":890,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:38.129605+0000","last_change":"2024-09-12T00:15:55.070693+0000","last_active":"2024-09-12T01:00:38.129605+0000","last_peered":"2024-09-12T01:00:38.129605+0000","last_clean":"2024-09-12T01:00:38.129605+0000","last_became_active":"2024-09-12T00:15:55.060127+0000","last_became_peered":"2024-09-12T00:15:55.060127+0000","last_unstale":"2024-09-12T01:00:38.129605+0000","last_undegraded":"2024-09-12T01:00:38.129605+0000","last_fullsized":"2024-09-12T01:00:38.129605+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:18.762399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11570671,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":394,"num_read_kb":41433,"num_write":830,"num_write_kb":44478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"268'983","reported_seq":2514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:48.416472+0000","last_change":"2024-09-12T00:15:57.052355+0000","last_active":"2024-09-12T01:00:48.416472+0000","last_peered":"2024-09-12T01:00:48.416472+0000","last_clean":"2024-09-12T01:00:48.416472+0000","last_became_active":"2024-09-12T00:15:57.051665+0000","last_became_peered":"2024-09-12T00:15:57.051665+0000","last_unstale":"2024-09-12T01:00:48.416472+0000","last_undegraded":"2024-09-12T01:00:48.416472+0000","last_fullsized":"2024-09-12T01:00:48.416472+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":900,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:20.500797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4673,"num_read_kb":4124,"num_write":1393,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"268'888","reported_seq":2500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.446445+0000","last_change":"2024-09-12T00:15:57.032298+0000","last_active":"2024-09-12T01:01:06.446445+0000","last_peered":"2024-09-12T01:01:06.446445+0000","last_clean":"2024-09-12T01:01:06.446445+0000","last_became_active":"2024-09-12T00:15:57.031897+0000","last_became_peered":"2024-09-12T00:15:57.031897+0000","last_unstale":"2024-09-12T01:01:06.446445+0000","last_undegraded":"2024-09-12T01:01:06.446445+0000","last_fullsized":"2024-09-12T01:01:06.446445+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:00.128491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4303,"num_read_kb":3853,"num_write":1201,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"268'277","reported_seq":897,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.211770+0000","last_change":"2024-09-12T00:15:55.064283+0000","last_active":"2024-09-12T01:02:38.211770+0000","last_peered":"2024-09-12T01:02:38.211770+0000","last_clean":"2024-09-12T01:02:38.211770+0000","last_became_active":"2024-09-12T00:15:55.063797+0000","last_became_peered":"2024-09-12T00:15:55.063797+0000","last_unstale":"2024-09-12T01:02:38.211770+0000","last_undegraded":"2024-09-12T01:02:38.211770+0000","last_fullsized":"2024-09-12T01:02:38.211770+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:33.806593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":384,"num_read_kb":7341,"num_write":959,"num_write_kb":14342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"268'782","reported_seq":2212,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.159774+0000","last_change":"2024-09-12T00:15:57.017929+0000","last_active":"2024-09-12T01:01:02.159774+0000","last_peered":"2024-09-12T01:01:02.159774+0000","last_clean":"2024-09-12T01:01:02.159774+0000","last_became_active":"2024-09-12T00:15:57.017679+0000","last_became_peered":"2024-09-12T00:15:57.017679+0000","last_unstale":"2024-09-12T01:01:02.159774+0000","last_undegraded":"2024-09-12T01:01:02.159774+0000","last_fullsized":"2024-09-12T01:01:02.159774+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:58.830951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3571,"num_read_kb":3210,"num_write":1015,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"268'311","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:06.388977+0000","last_change":"2024-09-12T00:16:26.796331+0000","last_active":"2024-09-12T01:02:06.388977+0000","last_peered":"2024-09-12T01:02:06.388977+0000","last_clean":"2024-09-12T01:02:06.388977+0000","last_became_active":"2024-09-12T00:16:26.794438+0000","last_became_peered":"2024-09-12T00:16:26.794438+0000","last_unstale":"2024-09-12T01:02:06.388977+0000","last_undegraded":"2024-09-12T01:02:06.388977+0000","last_fullsized":"2024-09-12T01:02:06.388977+0000","mapping_epoch":39,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:59.877909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10798736,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":569,"num_read_kb":170107,"num_write":1067,"num_write_kb":45359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,6],"acting":[5,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"268'412","reported_seq":1882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:02.267039+0000","last_change":"2024-09-12T00:15:57.039877+0000","last_active":"2024-09-12T01:00:02.267039+0000","last_peered":"2024-09-12T01:00:02.267039+0000","last_clean":"2024-09-12T01:00:02.267039+0000","last_became_active":"2024-09-12T00:15:57.039474+0000","last_became_peered":"2024-09-12T00:15:57.039474+0000","last_unstale":"2024-09-12T01:00:02.267039+0000","last_undegraded":"2024-09-12T01:00:02.267039+0000","last_fullsized":"2024-09-12T01:00:02.267039+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:19.030086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2320,"num_read_kb":2162,"num_write":506,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"268'292","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.959693+0000","last_change":"2024-09-12T00:15:55.066310+0000","last_active":"2024-09-12T01:02:37.959693+0000","last_peered":"2024-09-12T01:02:37.959693+0000","last_clean":"2024-09-12T01:02:37.959693+0000","last_became_active":"2024-09-12T00:15:55.060170+0000","last_became_peered":"2024-09-12T00:15:55.060170+0000","last_unstale":"2024-09-12T01:02:37.959693+0000","last_undegraded":"2024-09-12T01:02:37.959693+0000","last_fullsized":"2024-09-12T01:02:37.959693+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:43.105768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310581,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":576,"num_read_kb":11665,"num_write":1024,"num_write_kb":19684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"268'454","reported_seq":2050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.869036+0000","last_change":"2024-09-12T00:15:57.044727+0000","last_active":"2024-09-12T01:02:10.869036+0000","last_peered":"2024-09-12T01:02:10.869036+0000","last_clean":"2024-09-12T01:02:10.869036+0000","last_became_active":"2024-09-12T00:15:57.044075+0000","last_became_peered":"2024-09-12T00:15:57.044075+0000","last_unstale":"2024-09-12T01:02:10.869036+0000","last_undegraded":"2024-09-12T01:02:10.869036+0000","last_fullsized":"2024-09-12T01:02:10.869036+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:10.231756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2345,"num_read_kb":2229,"num_write":503,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"268'320","reported_seq":1026,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.878031+0000","last_change":"2024-09-12T00:15:55.078923+0000","last_active":"2024-09-12T01:02:37.878031+0000","last_peered":"2024-09-12T01:02:37.878031+0000","last_clean":"2024-09-12T01:02:37.878031+0000","last_became_active":"2024-09-12T00:15:55.078352+0000","last_became_peered":"2024-09-12T00:15:55.078352+0000","last_unstale":"2024-09-12T01:02:37.878031+0000","last_undegraded":"2024-09-12T01:02:37.878031+0000","last_fullsized":"2024-09-12T01:02:37.878031+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:20.005373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3368728,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":620,"num_read_kb":46871,"num_write":1157,"num_write_kb":28820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"268'399","reported_seq":1872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.865538+0000","last_change":"2024-09-12T00:15:57.032920+0000","last_active":"2024-09-12T01:02:10.865538+0000","last_peered":"2024-09-12T01:02:10.865538+0000","last_clean":"2024-09-12T01:02:10.865538+0000","last_became_active":"2024-09-12T00:15:57.032173+0000","last_became_peered":"2024-09-12T00:15:57.032173+0000","last_unstale":"2024-09-12T01:02:10.865538+0000","last_undegraded":"2024-09-12T01:02:10.865538+0000","last_fullsized":"2024-09-12T01:02:10.865538+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:23.061664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2107,"num_read_kb":2010,"num_write":461,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"268'306","reported_seq":1029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.083676+0000","last_change":"2024-09-12T00:15:55.067201+0000","last_active":"2024-09-12T01:02:38.083676+0000","last_peered":"2024-09-12T01:02:38.083676+0000","last_clean":"2024-09-12T01:02:38.083676+0000","last_became_active":"2024-09-12T00:15:55.066304+0000","last_became_peered":"2024-09-12T00:15:55.066304+0000","last_unstale":"2024-09-12T01:02:38.083676+0000","last_undegraded":"2024-09-12T01:02:38.083676+0000","last_fullsized":"2024-09-12T01:02:38.083676+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:31.298321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22043280,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":627,"num_read_kb":58379,"num_write":1099,"num_write_kb":49764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"268'1197","reported_seq":3218,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506270+0000","last_change":"2024-09-12T00:15:57.021981+0000","last_active":"2024-09-12T01:01:09.506270+0000","last_peered":"2024-09-12T01:01:09.506270+0000","last_clean":"2024-09-12T01:01:09.506270+0000","last_became_active":"2024-09-12T00:15:57.021605+0000","last_became_peered":"2024-09-12T00:15:57.021605+0000","last_unstale":"2024-09-12T01:01:09.506270+0000","last_undegraded":"2024-09-12T01:01:09.506270+0000","last_fullsized":"2024-09-12T01:01:09.506270+0000","mapping_epoch":28,"log_start":"268'1100","ondisk_log_start":"268'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":1100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:38.616266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6433,"num_read_kb":5744,"num_write":1768,"num_write_kb":831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"268'263","reported_seq":894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.168707+0000","last_change":"2024-09-12T00:15:55.052710+0000","last_active":"2024-09-12T01:02:38.168707+0000","last_peered":"2024-09-12T01:02:38.168707+0000","last_clean":"2024-09-12T01:02:38.168707+0000","last_became_active":"2024-09-12T00:15:55.050860+0000","last_became_peered":"2024-09-12T00:15:55.050860+0000","last_unstale":"2024-09-12T01:02:38.168707+0000","last_undegraded":"2024-09-12T01:02:38.168707+0000","last_fullsized":"2024-09-12T01:02:38.168707+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:08.086426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439086,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":436,"num_read_kb":8796,"num_write":947,"num_write_kb":26056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"268'150","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.320340+0000","last_change":"2024-09-12T00:16:05.096232+0000","last_active":"2024-09-12T01:01:07.320340+0000","last_peered":"2024-09-12T01:01:07.320340+0000","last_clean":"2024-09-12T01:01:07.320340+0000","last_became_active":"2024-09-12T00:16:05.095632+0000","last_became_peered":"2024-09-12T00:16:05.095632+0000","last_unstale":"2024-09-12T01:01:07.320340+0000","last_undegraded":"2024-09-12T01:01:07.320340+0000","last_fullsized":"2024-09-12T01:01:07.320340+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:47.445460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":139,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"268'388","reported_seq":1858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.446472+0000","last_change":"2024-09-12T00:15:57.044606+0000","last_active":"2024-09-12T01:01:06.446472+0000","last_peered":"2024-09-12T01:01:06.446472+0000","last_clean":"2024-09-12T01:01:06.446472+0000","last_became_active":"2024-09-12T00:15:57.042317+0000","last_became_peered":"2024-09-12T00:15:57.042317+0000","last_unstale":"2024-09-12T01:01:06.446472+0000","last_undegraded":"2024-09-12T01:01:06.446472+0000","last_fullsized":"2024-09-12T01:01:06.446472+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:47.707278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2080,"num_read_kb":1982,"num_write":441,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"268'334","reported_seq":983,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.611122+0000","last_change":"2024-09-12T00:15:55.043571+0000","last_active":"2024-09-12T01:02:38.611122+0000","last_peered":"2024-09-12T01:02:38.611122+0000","last_clean":"2024-09-12T01:02:38.611122+0000","last_became_active":"2024-09-12T00:15:55.042690+0000","last_became_peered":"2024-09-12T00:15:55.042690+0000","last_unstale":"2024-09-12T01:02:38.611122+0000","last_undegraded":"2024-09-12T01:02:38.611122+0000","last_fullsized":"2024-09-12T01:02:38.611122+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:22.575508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288790,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":506,"num_read_kb":60082,"num_write":1091,"num_write_kb":36322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219465+0000","last_change":"2024-09-12T00:15:59.047089+0000","last_active":"2024-09-12T00:59:29.219465+0000","last_peered":"2024-09-12T00:59:29.219465+0000","last_clean":"2024-09-12T00:59:29.219465+0000","last_became_active":"2024-09-12T00:15:59.046334+0000","last_became_peered":"2024-09-12T00:15:59.046334+0000","last_unstale":"2024-09-12T00:59:29.219465+0000","last_undegraded":"2024-09-12T00:59:29.219465+0000","last_fullsized":"2024-09-12T00:59:29.219465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:50.471898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"268'355","reported_seq":970,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.995930+0000","last_change":"2024-09-12T00:16:01.058485+0000","last_active":"2024-09-12T01:02:11.995930+0000","last_peered":"2024-09-12T01:02:11.995930+0000","last_clean":"2024-09-12T01:02:11.995930+0000","last_became_active":"2024-09-12T00:16:01.057657+0000","last_became_peered":"2024-09-12T00:16:01.057657+0000","last_unstale":"2024-09-12T01:02:11.995930+0000","last_undegraded":"2024-09-12T01:02:11.995930+0000","last_fullsized":"2024-09-12T01:02:11.995930+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:28.536472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62439,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":587,"num_read_kb":1145,"num_write":476,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185238+0000","last_change":"2024-09-12T00:16:03.099188+0000","last_active":"2024-09-12T00:59:33.185238+0000","last_peered":"2024-09-12T00:59:33.185238+0000","last_clean":"2024-09-12T00:59:33.185238+0000","last_became_active":"2024-09-12T00:16:03.098506+0000","last_became_peered":"2024-09-12T00:16:03.098506+0000","last_unstale":"2024-09-12T00:59:33.185238+0000","last_undegraded":"2024-09-12T00:59:33.185238+0000","last_fullsized":"2024-09-12T00:59:33.185238+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:09.926077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"268'152","reported_seq":715,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.258951+0000","last_change":"2024-09-12T00:16:05.105689+0000","last_active":"2024-09-12T01:01:02.258951+0000","last_peered":"2024-09-12T01:01:02.258951+0000","last_clean":"2024-09-12T01:01:02.258951+0000","last_became_active":"2024-09-12T00:16:05.105153+0000","last_became_peered":"2024-09-12T00:16:05.105153+0000","last_unstale":"2024-09-12T01:01:02.258951+0000","last_undegraded":"2024-09-12T01:01:02.258951+0000","last_fullsized":"2024-09-12T01:01:02.258951+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:12.364784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":214,"num_write":299,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"268'897","reported_seq":2521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.015147+0000","last_change":"2024-09-12T00:15:57.018776+0000","last_active":"2024-09-12T01:00:47.015147+0000","last_peered":"2024-09-12T01:00:47.015147+0000","last_clean":"2024-09-12T01:00:47.015147+0000","last_became_active":"2024-09-12T00:15:57.018484+0000","last_became_peered":"2024-09-12T00:15:57.018484+0000","last_unstale":"2024-09-12T01:00:47.015147+0000","last_undegraded":"2024-09-12T01:00:47.015147+0000","last_fullsized":"2024-09-12T01:00:47.015147+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":800,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:46.467646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4265,"num_read_kb":3809,"num_write":1199,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"268'332","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.188512+0000","last_change":"2024-09-12T00:15:55.067220+0000","last_active":"2024-09-12T01:02:38.188512+0000","last_peered":"2024-09-12T01:02:38.188512+0000","last_clean":"2024-09-12T01:02:38.188512+0000","last_became_active":"2024-09-12T00:15:55.065476+0000","last_became_peered":"2024-09-12T00:15:55.065476+0000","last_unstale":"2024-09-12T01:02:38.188512+0000","last_undegraded":"2024-09-12T01:02:38.188512+0000","last_fullsized":"2024-09-12T01:02:38.188512+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:58.771415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428686,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":548,"num_read_kb":7666,"num_write":1188,"num_write_kb":15378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:13.159333+0000","last_change":"2024-09-12T00:15:59.041196+0000","last_active":"2024-09-12T00:58:13.159333+0000","last_peered":"2024-09-12T00:58:13.159333+0000","last_clean":"2024-09-12T00:58:13.159333+0000","last_became_active":"2024-09-12T00:15:59.040412+0000","last_became_peered":"2024-09-12T00:15:59.040412+0000","last_unstale":"2024-09-12T00:58:13.159333+0000","last_undegraded":"2024-09-12T00:58:13.159333+0000","last_fullsized":"2024-09-12T00:58:13.159333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:37.117865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"268'89","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:59.917462+0000","last_change":"2024-09-12T00:16:01.067472+0000","last_active":"2024-09-12T00:59:59.917462+0000","last_peered":"2024-09-12T00:59:59.917462+0000","last_clean":"2024-09-12T00:59:59.917462+0000","last_became_active":"2024-09-12T00:16:01.062780+0000","last_became_peered":"2024-09-12T00:16:01.062780+0000","last_unstale":"2024-09-12T00:59:59.917462+0000","last_undegraded":"2024-09-12T00:59:59.917462+0000","last_fullsized":"2024-09-12T00:59:59.917462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:25.299928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185153+0000","last_change":"2024-09-12T00:16:03.092617+0000","last_active":"2024-09-12T00:59:33.185153+0000","last_peered":"2024-09-12T00:59:33.185153+0000","last_clean":"2024-09-12T00:59:33.185153+0000","last_became_active":"2024-09-12T00:16:03.091926+0000","last_became_peered":"2024-09-12T00:16:03.091926+0000","last_unstale":"2024-09-12T00:59:33.185153+0000","last_undegraded":"2024-09-12T00:59:33.185153+0000","last_fullsized":"2024-09-12T00:59:33.185153+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:35.129510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"268'125","reported_seq":621,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:05.844320+0000","last_change":"2024-09-12T00:16:05.115080+0000","last_active":"2024-09-12T01:01:05.844320+0000","last_peered":"2024-09-12T01:01:05.844320+0000","last_clean":"2024-09-12T01:01:05.844320+0000","last_became_active":"2024-09-12T00:16:05.114182+0000","last_became_peered":"2024-09-12T00:16:05.114182+0000","last_unstale":"2024-09-12T01:01:05.844320+0000","last_undegraded":"2024-09-12T01:01:05.844320+0000","last_fullsized":"2024-09-12T01:01:05.844320+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:12.382388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":293,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"268'1230","reported_seq":2685,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.015822+0000","last_change":"2024-09-12T00:15:57.047647+0000","last_active":"2024-09-12T01:00:47.015822+0000","last_peered":"2024-09-12T01:00:47.015822+0000","last_clean":"2024-09-12T01:00:47.015822+0000","last_became_active":"2024-09-12T00:15:57.046916+0000","last_became_peered":"2024-09-12T00:15:57.046916+0000","last_unstale":"2024-09-12T01:00:47.015822+0000","last_undegraded":"2024-09-12T01:00:47.015822+0000","last_fullsized":"2024-09-12T01:00:47.015822+0000","mapping_epoch":28,"log_start":"268'1200","ondisk_log_start":"268'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:00.710335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5641,"num_read_kb":4945,"num_write":1755,"num_write_kb":746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"268'341","reported_seq":1125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.683511+0000","last_change":"2024-09-12T00:15:55.064793+0000","last_active":"2024-09-12T01:02:38.683511+0000","last_peered":"2024-09-12T01:02:38.683511+0000","last_clean":"2024-09-12T01:02:38.683511+0000","last_became_active":"2024-09-12T00:15:55.058428+0000","last_became_peered":"2024-09-12T00:15:55.058428+0000","last_unstale":"2024-09-12T01:02:38.683511+0000","last_undegraded":"2024-09-12T01:02:38.683511+0000","last_fullsized":"2024-09-12T01:02:38.683511+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:12.660366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1929,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":684,"num_read_kb":690,"num_write":1219,"num_write_kb":29311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179931+0000","last_change":"2024-09-12T00:15:59.040242+0000","last_active":"2024-09-12T00:59:33.179931+0000","last_peered":"2024-09-12T00:59:33.179931+0000","last_clean":"2024-09-12T00:59:33.179931+0000","last_became_active":"2024-09-12T00:15:59.039465+0000","last_became_peered":"2024-09-12T00:15:59.039465+0000","last_unstale":"2024-09-12T00:59:33.179931+0000","last_undegraded":"2024-09-12T00:59:33.179931+0000","last_fullsized":"2024-09-12T00:59:33.179931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:02.272155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"268'130","reported_seq":681,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:22.544313+0000","last_change":"2024-09-12T00:16:01.057413+0000","last_active":"2024-09-12T00:59:22.544313+0000","last_peered":"2024-09-12T00:59:22.544313+0000","last_clean":"2024-09-12T00:59:22.544313+0000","last_became_active":"2024-09-12T00:16:01.056702+0000","last_became_peered":"2024-09-12T00:16:01.056702+0000","last_unstale":"2024-09-12T00:59:22.544313+0000","last_undegraded":"2024-09-12T00:59:22.544313+0000","last_fullsized":"2024-09-12T00:59:22.544313+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:41.238549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":144,"num_read_kb":136,"num_write":100,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"268'799","reported_seq":2222,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.130042+0000","last_change":"2024-09-12T00:16:03.104735+0000","last_active":"2024-09-12T01:02:37.130042+0000","last_peered":"2024-09-12T01:02:37.130042+0000","last_clean":"2024-09-12T01:02:37.130042+0000","last_became_active":"2024-09-12T00:16:03.103292+0000","last_became_peered":"2024-09-12T00:16:03.103292+0000","last_unstale":"2024-09-12T01:02:37.130042+0000","last_undegraded":"2024-09-12T01:02:37.130042+0000","last_fullsized":"2024-09-12T01:02:37.130042+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:21.322414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"268'234","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.369432+0000","last_change":"2024-09-12T00:16:05.108369+0000","last_active":"2024-09-12T01:01:07.369432+0000","last_peered":"2024-09-12T01:01:07.369432+0000","last_clean":"2024-09-12T01:01:07.369432+0000","last_became_active":"2024-09-12T00:16:05.107785+0000","last_became_peered":"2024-09-12T00:16:05.107785+0000","last_unstale":"2024-09-12T01:01:07.369432+0000","last_undegraded":"2024-09-12T01:01:07.369432+0000","last_fullsized":"2024-09-12T01:01:07.369432+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:30.275724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":637,"num_write":534,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"268'635","reported_seq":2161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.998760+0000","last_change":"2024-09-12T00:15:57.036539+0000","last_active":"2024-09-12T01:00:39.998760+0000","last_peered":"2024-09-12T01:00:39.998760+0000","last_clean":"2024-09-12T01:00:39.998760+0000","last_became_active":"2024-09-12T00:15:57.035581+0000","last_became_peered":"2024-09-12T00:15:57.035581+0000","last_unstale":"2024-09-12T01:00:39.998760+0000","last_undegraded":"2024-09-12T01:00:39.998760+0000","last_fullsized":"2024-09-12T01:00:39.998760+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":600,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:01.577455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3178,"num_read_kb":2956,"num_write":875,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"268'297","reported_seq":963,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.184044+0000","last_change":"2024-09-12T00:15:55.065992+0000","last_active":"2024-09-12T01:02:38.184044+0000","last_peered":"2024-09-12T01:02:38.184044+0000","last_clean":"2024-09-12T01:02:38.184044+0000","last_became_active":"2024-09-12T00:15:55.065178+0000","last_became_peered":"2024-09-12T00:15:55.065178+0000","last_unstale":"2024-09-12T01:02:38.184044+0000","last_undegraded":"2024-09-12T01:02:38.184044+0000","last_fullsized":"2024-09-12T01:02:38.184044+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:42.418779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289383,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":528,"num_read_kb":563,"num_write":1100,"num_write_kb":21852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219511+0000","last_change":"2024-09-12T00:15:59.040434+0000","last_active":"2024-09-12T00:59:29.219511+0000","last_peered":"2024-09-12T00:59:29.219511+0000","last_clean":"2024-09-12T00:59:29.219511+0000","last_became_active":"2024-09-12T00:15:59.039902+0000","last_became_peered":"2024-09-12T00:15:59.039902+0000","last_unstale":"2024-09-12T00:59:29.219511+0000","last_undegraded":"2024-09-12T00:59:29.219511+0000","last_fullsized":"2024-09-12T00:59:29.219511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:50.427091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"268'275","reported_seq":842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.981756+0000","last_change":"2024-09-12T00:16:01.053456+0000","last_active":"2024-09-12T01:02:11.981756+0000","last_peered":"2024-09-12T01:02:11.981756+0000","last_clean":"2024-09-12T01:02:11.981756+0000","last_became_active":"2024-09-12T00:16:01.052744+0000","last_became_peered":"2024-09-12T00:16:01.052744+0000","last_unstale":"2024-09-12T01:02:11.981756+0000","last_undegraded":"2024-09-12T01:02:11.981756+0000","last_fullsized":"2024-09-12T01:02:11.981756+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:17.018417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56108,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":935,"num_write":372,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"268'810","reported_seq":2455,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.078335+0000","last_change":"2024-09-12T00:16:03.098659+0000","last_active":"2024-09-12T01:02:12.078335+0000","last_peered":"2024-09-12T01:02:12.078335+0000","last_clean":"2024-09-12T01:02:12.078335+0000","last_became_active":"2024-09-12T00:16:03.097895+0000","last_became_peered":"2024-09-12T00:16:03.097895+0000","last_unstale":"2024-09-12T01:02:12.078335+0000","last_undegraded":"2024-09-12T01:02:12.078335+0000","last_fullsized":"2024-09-12T01:02:12.078335+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:25.934943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"268'458","reported_seq":2011,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.582816+0000","last_change":"2024-09-12T00:15:57.023912+0000","last_active":"2024-09-12T01:01:09.582816+0000","last_peered":"2024-09-12T01:01:09.582816+0000","last_clean":"2024-09-12T01:01:09.582816+0000","last_became_active":"2024-09-12T00:15:57.023659+0000","last_became_peered":"2024-09-12T00:15:57.023659+0000","last_unstale":"2024-09-12T01:01:09.582816+0000","last_undegraded":"2024-09-12T01:01:09.582816+0000","last_fullsized":"2024-09-12T01:01:09.582816+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:02.798248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2457,"num_read_kb":2306,"num_write":563,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"268'329","reported_seq":960,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.004795+0000","last_change":"2024-09-12T00:15:55.066577+0000","last_active":"2024-09-12T01:02:38.004795+0000","last_peered":"2024-09-12T01:02:38.004795+0000","last_clean":"2024-09-12T01:02:38.004795+0000","last_became_active":"2024-09-12T00:15:55.060679+0000","last_became_peered":"2024-09-12T00:15:55.060679+0000","last_unstale":"2024-09-12T01:02:38.004795+0000","last_undegraded":"2024-09-12T01:02:38.004795+0000","last_fullsized":"2024-09-12T01:02:38.004795+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:10.882193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39798,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":438,"num_read_kb":16773,"num_write":1098,"num_write_kb":29370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:23.182560+0000","last_change":"2024-09-12T00:15:59.035705+0000","last_active":"2024-09-12T00:59:23.182560+0000","last_peered":"2024-09-12T00:59:23.182560+0000","last_clean":"2024-09-12T00:59:23.182560+0000","last_became_active":"2024-09-12T00:15:59.035288+0000","last_became_peered":"2024-09-12T00:15:59.035288+0000","last_unstale":"2024-09-12T00:59:23.182560+0000","last_undegraded":"2024-09-12T00:59:23.182560+0000","last_fullsized":"2024-09-12T00:59:23.182560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:46.726241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"268'349","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.443258+0000","last_change":"2024-09-12T00:16:01.070645+0000","last_active":"2024-09-12T01:02:37.443258+0000","last_peered":"2024-09-12T01:02:37.443258+0000","last_clean":"2024-09-12T01:02:37.443258+0000","last_became_active":"2024-09-12T00:16:01.069838+0000","last_became_peered":"2024-09-12T00:16:01.069838+0000","last_unstale":"2024-09-12T01:02:37.443258+0000","last_undegraded":"2024-09-12T01:02:37.443258+0000","last_fullsized":"2024-09-12T01:02:37.443258+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:57.640957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45025,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":563,"num_read_kb":1131,"num_write":438,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.162032+0000","last_change":"2024-09-12T00:16:03.090231+0000","last_active":"2024-09-12T00:58:48.162032+0000","last_peered":"2024-09-12T00:58:48.162032+0000","last_clean":"2024-09-12T00:58:48.162032+0000","last_became_active":"2024-09-12T00:16:03.089533+0000","last_became_peered":"2024-09-12T00:16:03.089533+0000","last_unstale":"2024-09-12T00:58:48.162032+0000","last_undegraded":"2024-09-12T00:58:48.162032+0000","last_fullsized":"2024-09-12T00:58:48.162032+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:22.033467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"268'572","reported_seq":1384,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.041861+0000","last_change":"2024-09-12T00:16:05.114168+0000","last_active":"2024-09-12T01:02:12.041861+0000","last_peered":"2024-09-12T01:02:12.041861+0000","last_clean":"2024-09-12T01:02:12.041861+0000","last_became_active":"2024-09-12T00:16:05.112960+0000","last_became_peered":"2024-09-12T00:16:05.112960+0000","last_unstale":"2024-09-12T01:02:12.041861+0000","last_undegraded":"2024-09-12T01:02:12.041861+0000","last_fullsized":"2024-09-12T01:02:12.041861+0000","mapping_epoch":36,"log_start":"268'500","ondisk_log_start":"268'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:15.906818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1305,"num_read_kb":1300,"num_write":1202,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"268'522","reported_seq":2000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.582686+0000","last_change":"2024-09-12T00:15:57.045470+0000","last_active":"2024-09-12T01:01:09.582686+0000","last_peered":"2024-09-12T01:01:09.582686+0000","last_clean":"2024-09-12T01:01:09.582686+0000","last_became_active":"2024-09-12T00:15:57.045141+0000","last_became_peered":"2024-09-12T00:15:57.045141+0000","last_unstale":"2024-09-12T01:01:09.582686+0000","last_undegraded":"2024-09-12T01:01:09.582686+0000","last_fullsized":"2024-09-12T01:01:09.582686+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.221530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2585,"num_read_kb":2367,"num_write":669,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"268'319","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.131979+0000","last_change":"2024-09-12T00:15:55.065308+0000","last_active":"2024-09-12T01:02:38.131979+0000","last_peered":"2024-09-12T01:02:38.131979+0000","last_clean":"2024-09-12T01:02:38.131979+0000","last_became_active":"2024-09-12T00:15:55.063542+0000","last_became_peered":"2024-09-12T00:15:55.063542+0000","last_unstale":"2024-09-12T01:02:38.131979+0000","last_undegraded":"2024-09-12T01:02:38.131979+0000","last_fullsized":"2024-09-12T01:02:38.131979+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:07.380766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6319256,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":508,"num_read_kb":24074,"num_write":1199,"num_write_kb":38232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:23.170976+0000","last_change":"2024-09-12T00:15:59.051412+0000","last_active":"2024-09-12T00:59:23.170976+0000","last_peered":"2024-09-12T00:59:23.170976+0000","last_clean":"2024-09-12T00:59:23.170976+0000","last_became_active":"2024-09-12T00:15:59.050663+0000","last_became_peered":"2024-09-12T00:15:59.050663+0000","last_unstale":"2024-09-12T00:59:23.170976+0000","last_undegraded":"2024-09-12T00:59:23.170976+0000","last_fullsized":"2024-09-12T00:59:23.170976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:36.230495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"268'242","reported_seq":818,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.953612+0000","last_change":"2024-09-12T00:16:01.069772+0000","last_active":"2024-09-12T01:02:11.953612+0000","last_peered":"2024-09-12T01:02:11.953612+0000","last_clean":"2024-09-12T01:02:11.953612+0000","last_became_active":"2024-09-12T00:16:01.068392+0000","last_became_peered":"2024-09-12T00:16:01.068392+0000","last_unstale":"2024-09-12T01:02:11.953612+0000","last_undegraded":"2024-09-12T01:02:11.953612+0000","last_fullsized":"2024-09-12T01:02:11.953612+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:56.300773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":379,"num_read_kb":770,"num_write":302,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179776+0000","last_change":"2024-09-12T00:16:03.087496+0000","last_active":"2024-09-12T00:59:33.179776+0000","last_peered":"2024-09-12T00:59:33.179776+0000","last_clean":"2024-09-12T00:59:33.179776+0000","last_became_active":"2024-09-12T00:16:03.086751+0000","last_became_peered":"2024-09-12T00:16:03.086751+0000","last_unstale":"2024-09-12T00:59:33.179776+0000","last_undegraded":"2024-09-12T00:59:33.179776+0000","last_fullsized":"2024-09-12T00:59:33.179776+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:20.968600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"268'2410","reported_seq":4246,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.403542+0000","last_change":"2024-09-12T00:16:05.115334+0000","last_active":"2024-09-12T01:02:01.403542+0000","last_peered":"2024-09-12T01:02:01.403542+0000","last_clean":"2024-09-12T01:02:01.403542+0000","last_became_active":"2024-09-12T00:16:05.114563+0000","last_became_peered":"2024-09-12T00:16:05.114563+0000","last_unstale":"2024-09-12T01:02:01.403542+0000","last_undegraded":"2024-09-12T01:02:01.403542+0000","last_fullsized":"2024-09-12T01:02:01.403542+0000","mapping_epoch":36,"log_start":"268'2300","ondisk_log_start":"268'2300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":2300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:14.259829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6030,"num_read_kb":6028,"num_write":4877,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"268'783","reported_seq":2354,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.582663+0000","last_change":"2024-09-12T00:15:57.024963+0000","last_active":"2024-09-12T01:01:09.582663+0000","last_peered":"2024-09-12T01:01:09.582663+0000","last_clean":"2024-09-12T01:01:09.582663+0000","last_became_active":"2024-09-12T00:15:57.024509+0000","last_became_peered":"2024-09-12T00:15:57.024509+0000","last_unstale":"2024-09-12T01:01:09.582663+0000","last_undegraded":"2024-09-12T01:01:09.582663+0000","last_fullsized":"2024-09-12T01:01:09.582663+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:39.327515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3769,"num_read_kb":3415,"num_write":1030,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"268'321","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.551960+0000","last_change":"2024-09-12T00:15:55.055309+0000","last_active":"2024-09-12T01:02:38.551960+0000","last_peered":"2024-09-12T01:02:38.551960+0000","last_clean":"2024-09-12T01:02:38.551960+0000","last_became_active":"2024-09-12T00:15:55.052916+0000","last_became_peered":"2024-09-12T00:15:55.052916+0000","last_unstale":"2024-09-12T01:02:38.551960+0000","last_undegraded":"2024-09-12T01:02:38.551960+0000","last_fullsized":"2024-09-12T01:02:38.551960+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:37.807496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331521,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":455,"num_read_kb":37815,"num_write":1117,"num_write_kb":39957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:47.188865+0000","last_change":"2024-09-12T00:15:59.035302+0000","last_active":"2024-09-12T00:58:47.188865+0000","last_peered":"2024-09-12T00:58:47.188865+0000","last_clean":"2024-09-12T00:58:47.188865+0000","last_became_active":"2024-09-12T00:15:59.034650+0000","last_became_peered":"2024-09-12T00:15:59.034650+0000","last_unstale":"2024-09-12T00:58:47.188865+0000","last_undegraded":"2024-09-12T00:58:47.188865+0000","last_fullsized":"2024-09-12T00:58:47.188865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:26.439328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"268'318","reported_seq":922,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.593445+0000","last_change":"2024-09-12T00:16:01.059061+0000","last_active":"2024-09-12T01:02:37.593445+0000","last_peered":"2024-09-12T01:02:37.593445+0000","last_clean":"2024-09-12T01:02:37.593445+0000","last_became_active":"2024-09-12T00:16:01.057281+0000","last_became_peered":"2024-09-12T00:16:01.057281+0000","last_unstale":"2024-09-12T01:02:37.593445+0000","last_undegraded":"2024-09-12T01:02:37.593445+0000","last_fullsized":"2024-09-12T01:02:37.593445+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:55.215685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49581,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":504,"num_read_kb":1060,"num_write":406,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"268'810","reported_seq":2418,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.080945+0000","last_change":"2024-09-12T00:16:03.098169+0000","last_active":"2024-09-12T01:02:12.080945+0000","last_peered":"2024-09-12T01:02:12.080945+0000","last_clean":"2024-09-12T01:02:12.080945+0000","last_became_active":"2024-09-12T00:16:03.097554+0000","last_became_peered":"2024-09-12T00:16:03.097554+0000","last_unstale":"2024-09-12T01:02:12.080945+0000","last_undegraded":"2024-09-12T01:02:12.080945+0000","last_fullsized":"2024-09-12T01:02:12.080945+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:01.820378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"268'94","reported_seq":599,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.780044+0000","last_change":"2024-09-12T00:16:05.113044+0000","last_active":"2024-09-12T01:02:10.780044+0000","last_peered":"2024-09-12T01:02:10.780044+0000","last_clean":"2024-09-12T01:02:10.780044+0000","last_became_active":"2024-09-12T00:16:05.112524+0000","last_became_peered":"2024-09-12T00:16:05.112524+0000","last_unstale":"2024-09-12T01:02:10.780044+0000","last_undegraded":"2024-09-12T01:02:10.780044+0000","last_fullsized":"2024-09-12T01:02:10.780044+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:08.645097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":109,"num_write":225,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"268'456","reported_seq":1823,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.422425+0000","last_change":"2024-09-12T00:15:57.043306+0000","last_active":"2024-09-12T01:01:06.422425+0000","last_peered":"2024-09-12T01:01:06.422425+0000","last_clean":"2024-09-12T01:01:06.422425+0000","last_became_active":"2024-09-12T00:15:57.042663+0000","last_became_peered":"2024-09-12T00:15:57.042663+0000","last_unstale":"2024-09-12T01:01:06.422425+0000","last_undegraded":"2024-09-12T01:01:06.422425+0000","last_fullsized":"2024-09-12T01:01:06.422425+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:27.809795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2110,"num_read_kb":1961,"num_write":540,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"268'313","reported_seq":1054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.871417+0000","last_change":"2024-09-12T00:15:55.060102+0000","last_active":"2024-09-12T01:02:37.871417+0000","last_peered":"2024-09-12T01:02:37.871417+0000","last_clean":"2024-09-12T01:02:37.871417+0000","last_became_active":"2024-09-12T00:15:55.054533+0000","last_became_peered":"2024-09-12T00:15:55.054533+0000","last_unstale":"2024-09-12T01:02:37.871417+0000","last_undegraded":"2024-09-12T01:02:37.871417+0000","last_fullsized":"2024-09-12T01:02:37.871417+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:15.618277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10753529,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":761,"num_read_kb":57067,"num_write":1094,"num_write_kb":15994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.173416+0000","last_change":"2024-09-12T00:15:59.037952+0000","last_active":"2024-09-12T00:59:33.173416+0000","last_peered":"2024-09-12T00:59:33.173416+0000","last_clean":"2024-09-12T00:59:33.173416+0000","last_became_active":"2024-09-12T00:15:59.037145+0000","last_became_peered":"2024-09-12T00:15:59.037145+0000","last_unstale":"2024-09-12T00:59:33.173416+0000","last_undegraded":"2024-09-12T00:59:33.173416+0000","last_fullsized":"2024-09-12T00:59:33.173416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:33.825886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"268'481","reported_seq":1125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.749434+0000","last_change":"2024-09-12T00:16:01.069486+0000","last_active":"2024-09-12T01:02:37.749434+0000","last_peered":"2024-09-12T01:02:37.749434+0000","last_clean":"2024-09-12T01:02:37.749434+0000","last_became_active":"2024-09-12T00:16:01.068496+0000","last_became_peered":"2024-09-12T00:16:01.068496+0000","last_unstale":"2024-09-12T01:02:37.749434+0000","last_undegraded":"2024-09-12T01:02:37.749434+0000","last_fullsized":"2024-09-12T01:02:37.749434+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:18.290612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100877,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":833,"num_read_kb":1897,"num_write":686,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.198874+0000","last_change":"2024-09-12T00:16:03.102755+0000","last_active":"2024-09-12T00:59:27.198874+0000","last_peered":"2024-09-12T00:59:27.198874+0000","last_clean":"2024-09-12T00:59:27.198874+0000","last_became_active":"2024-09-12T00:16:03.101984+0000","last_became_peered":"2024-09-12T00:16:03.101984+0000","last_unstale":"2024-09-12T00:59:27.198874+0000","last_undegraded":"2024-09-12T00:59:27.198874+0000","last_fullsized":"2024-09-12T00:59:27.198874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:46.673834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"268'131","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.211991+0000","last_change":"2024-09-12T00:16:05.105645+0000","last_active":"2024-09-12T01:01:07.211991+0000","last_peered":"2024-09-12T01:01:07.211991+0000","last_clean":"2024-09-12T01:01:07.211991+0000","last_became_active":"2024-09-12T00:16:05.104674+0000","last_became_peered":"2024-09-12T00:16:05.104674+0000","last_unstale":"2024-09-12T01:01:07.211991+0000","last_undegraded":"2024-09-12T01:01:07.211991+0000","last_fullsized":"2024-09-12T01:01:07.211991+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:09.821079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":121,"num_write":297,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"268'781","reported_seq":2286,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.868337+0000","last_change":"2024-09-12T00:15:57.017588+0000","last_active":"2024-09-12T01:02:10.868337+0000","last_peered":"2024-09-12T01:02:10.868337+0000","last_clean":"2024-09-12T01:02:10.868337+0000","last_became_active":"2024-09-12T00:15:57.016954+0000","last_became_peered":"2024-09-12T00:15:57.016954+0000","last_unstale":"2024-09-12T01:02:10.868337+0000","last_undegraded":"2024-09-12T01:02:10.868337+0000","last_fullsized":"2024-09-12T01:02:10.868337+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:04.997592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3833,"num_read_kb":3467,"num_write":1045,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"268'244","reported_seq":847,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:10.266296+0000","last_change":"2024-09-12T00:15:55.063836+0000","last_active":"2024-09-12T00:59:10.266296+0000","last_peered":"2024-09-12T00:59:10.266296+0000","last_clean":"2024-09-12T00:59:10.266296+0000","last_became_active":"2024-09-12T00:15:55.062854+0000","last_became_peered":"2024-09-12T00:15:55.062854+0000","last_unstale":"2024-09-12T00:59:10.266296+0000","last_undegraded":"2024-09-12T00:59:10.266296+0000","last_fullsized":"2024-09-12T00:59:10.266296+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:50.512780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12868368,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":354,"num_read_kb":12698,"num_write":917,"num_write_kb":17642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:47.164632+0000","last_change":"2024-09-12T00:15:59.034591+0000","last_active":"2024-09-12T00:58:47.164632+0000","last_peered":"2024-09-12T00:58:47.164632+0000","last_clean":"2024-09-12T00:58:47.164632+0000","last_became_active":"2024-09-12T00:15:59.033844+0000","last_became_peered":"2024-09-12T00:15:59.033844+0000","last_unstale":"2024-09-12T00:58:47.164632+0000","last_undegraded":"2024-09-12T00:58:47.164632+0000","last_fullsized":"2024-09-12T00:58:47.164632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:37.678048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"268'313","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.965178+0000","last_change":"2024-09-12T00:16:01.068155+0000","last_active":"2024-09-12T01:02:11.965178+0000","last_peered":"2024-09-12T01:02:11.965178+0000","last_clean":"2024-09-12T01:02:11.965178+0000","last_became_active":"2024-09-12T00:16:01.067377+0000","last_became_peered":"2024-09-12T00:16:01.067377+0000","last_unstale":"2024-09-12T01:02:11.965178+0000","last_undegraded":"2024-09-12T01:02:11.965178+0000","last_fullsized":"2024-09-12T01:02:11.965178+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:04.239296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61827,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":1083,"num_write":490,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168204+0000","last_change":"2024-09-12T00:16:03.079750+0000","last_active":"2024-09-12T00:59:02.168204+0000","last_peered":"2024-09-12T00:59:02.168204+0000","last_clean":"2024-09-12T00:59:02.168204+0000","last_became_active":"2024-09-12T00:16:03.079004+0000","last_became_peered":"2024-09-12T00:16:03.079004+0000","last_unstale":"2024-09-12T00:59:02.168204+0000","last_undegraded":"2024-09-12T00:59:02.168204+0000","last_fullsized":"2024-09-12T00:59:02.168204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:46.457515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"268'127","reported_seq":617,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.407863+0000","last_change":"2024-09-12T00:16:05.094605+0000","last_active":"2024-09-12T01:02:01.407863+0000","last_peered":"2024-09-12T01:02:01.407863+0000","last_clean":"2024-09-12T01:02:01.407863+0000","last_became_active":"2024-09-12T00:16:05.093815+0000","last_became_peered":"2024-09-12T00:16:05.093815+0000","last_unstale":"2024-09-12T01:02:01.407863+0000","last_undegraded":"2024-09-12T01:02:01.407863+0000","last_fullsized":"2024-09-12T01:02:01.407863+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:25.421248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":302,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"268'443","reported_seq":1987,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:59.004706+0000","last_change":"2024-09-12T00:15:57.029941+0000","last_active":"2024-09-12T01:00:59.004706+0000","last_peered":"2024-09-12T01:00:59.004706+0000","last_clean":"2024-09-12T01:00:59.004706+0000","last_became_active":"2024-09-12T00:15:57.029290+0000","last_became_peered":"2024-09-12T00:15:57.029290+0000","last_unstale":"2024-09-12T01:00:59.004706+0000","last_undegraded":"2024-09-12T01:00:59.004706+0000","last_fullsized":"2024-09-12T01:00:59.004706+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:52.959133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2290,"num_read_kb":2163,"num_write":517,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"268'322","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.987665+0000","last_change":"2024-09-12T00:16:26.797714+0000","last_active":"2024-09-12T01:02:38.987665+0000","last_peered":"2024-09-12T01:02:38.987665+0000","last_clean":"2024-09-12T01:02:38.987665+0000","last_became_active":"2024-09-12T00:16:26.796888+0000","last_became_peered":"2024-09-12T00:16:26.796888+0000","last_unstale":"2024-09-12T01:02:38.987665+0000","last_undegraded":"2024-09-12T01:02:38.987665+0000","last_fullsized":"2024-09-12T01:02:38.987665+0000","mapping_epoch":39,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:17.037395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6314494,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":469,"num_read_kb":37572,"num_write":1105,"num_write_kb":35076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,6],"acting":[3,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:47.188931+0000","last_change":"2024-09-12T00:15:59.030706+0000","last_active":"2024-09-12T00:58:47.188931+0000","last_peered":"2024-09-12T00:58:47.188931+0000","last_clean":"2024-09-12T00:58:47.188931+0000","last_became_active":"2024-09-12T00:15:59.029998+0000","last_became_peered":"2024-09-12T00:15:59.029998+0000","last_unstale":"2024-09-12T00:58:47.188931+0000","last_undegraded":"2024-09-12T00:58:47.188931+0000","last_fullsized":"2024-09-12T00:58:47.188931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:08.142841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"268'301","reported_seq":879,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:17.001536+0000","last_change":"2024-09-12T00:16:01.054348+0000","last_active":"2024-09-12T01:01:17.001536+0000","last_peered":"2024-09-12T01:01:17.001536+0000","last_clean":"2024-09-12T01:01:17.001536+0000","last_became_active":"2024-09-12T00:16:01.053660+0000","last_became_peered":"2024-09-12T00:16:01.053660+0000","last_unstale":"2024-09-12T01:01:17.001536+0000","last_undegraded":"2024-09-12T01:01:17.001536+0000","last_fullsized":"2024-09-12T01:01:17.001536+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:28.294852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65745,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":999,"num_write":402,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"268'775","reported_seq":2365,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.131465+0000","last_change":"2024-09-12T00:16:03.098769+0000","last_active":"2024-09-12T01:02:37.131465+0000","last_peered":"2024-09-12T01:02:37.131465+0000","last_clean":"2024-09-12T01:02:37.131465+0000","last_became_active":"2024-09-12T00:16:03.098077+0000","last_became_peered":"2024-09-12T00:16:03.098077+0000","last_unstale":"2024-09-12T01:02:37.131465+0000","last_undegraded":"2024-09-12T01:02:37.131465+0000","last_fullsized":"2024-09-12T01:02:37.131465+0000","mapping_epoch":34,"log_start":"268'701","ondisk_log_start":"268'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":701,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:52.835421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"268'151","reported_seq":653,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:03.866324+0000","last_change":"2024-09-12T00:16:05.108146+0000","last_active":"2024-09-12T01:01:03.866324+0000","last_peered":"2024-09-12T01:01:03.866324+0000","last_clean":"2024-09-12T01:01:03.866324+0000","last_became_active":"2024-09-12T00:16:05.107291+0000","last_became_peered":"2024-09-12T00:16:05.107291+0000","last_unstale":"2024-09-12T01:01:03.866324+0000","last_undegraded":"2024-09-12T01:01:03.866324+0000","last_fullsized":"2024-09-12T01:01:03.866324+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:57.906444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":174,"num_read_kb":162,"num_write":365,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"268'796","reported_seq":2308,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.428696+0000","last_change":"2024-09-12T00:15:57.024503+0000","last_active":"2024-09-12T01:01:06.428696+0000","last_peered":"2024-09-12T01:01:06.428696+0000","last_clean":"2024-09-12T01:01:06.428696+0000","last_became_active":"2024-09-12T00:15:57.024185+0000","last_became_peered":"2024-09-12T00:15:57.024185+0000","last_unstale":"2024-09-12T01:01:06.428696+0000","last_undegraded":"2024-09-12T01:01:06.428696+0000","last_fullsized":"2024-09-12T01:01:06.428696+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:13.017889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3776,"num_read_kb":3402,"num_write":1055,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"268'317","reported_seq":963,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.758454+0000","last_change":"2024-09-12T00:15:55.027875+0000","last_active":"2024-09-12T01:02:38.758454+0000","last_peered":"2024-09-12T01:02:38.758454+0000","last_clean":"2024-09-12T01:02:38.758454+0000","last_became_active":"2024-09-12T00:15:55.027001+0000","last_became_peered":"2024-09-12T00:15:55.027001+0000","last_unstale":"2024-09-12T01:02:38.758454+0000","last_undegraded":"2024-09-12T01:02:38.758454+0000","last_fullsized":"2024-09-12T01:02:38.758454+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:37.021357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12858183,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":400,"num_read_kb":53256,"num_write":837,"num_write_kb":32142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1460,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.098953+0000","last_change":"2024-09-12T00:15:59.035799+0000","last_active":"2024-09-12T01:02:37.098953+0000","last_peered":"2024-09-12T01:02:37.098953+0000","last_clean":"2024-09-12T01:02:37.098953+0000","last_became_active":"2024-09-12T00:15:59.035380+0000","last_became_peered":"2024-09-12T00:15:59.035380+0000","last_unstale":"2024-09-12T01:02:37.098953+0000","last_undegraded":"2024-09-12T01:02:37.098953+0000","last_fullsized":"2024-09-12T01:02:37.098953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:37.318095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":957,"num_read_kb":957,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"268'80","reported_seq":596,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:00.682139+0000","last_change":"2024-09-12T00:16:01.065768+0000","last_active":"2024-09-12T01:00:00.682139+0000","last_peered":"2024-09-12T01:00:00.682139+0000","last_clean":"2024-09-12T01:00:00.682139+0000","last_became_active":"2024-09-12T00:16:01.065038+0000","last_became_peered":"2024-09-12T00:16:01.065038+0000","last_unstale":"2024-09-12T01:00:00.682139+0000","last_undegraded":"2024-09-12T01:00:00.682139+0000","last_fullsized":"2024-09-12T01:00:00.682139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:49.222908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"268'797","reported_seq":2364,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.133970+0000","last_change":"2024-09-12T00:16:03.089577+0000","last_active":"2024-09-12T01:02:37.133970+0000","last_peered":"2024-09-12T01:02:37.133970+0000","last_clean":"2024-09-12T01:02:37.133970+0000","last_became_active":"2024-09-12T00:16:03.088856+0000","last_became_peered":"2024-09-12T00:16:03.088856+0000","last_unstale":"2024-09-12T01:02:37.133970+0000","last_undegraded":"2024-09-12T01:02:37.133970+0000","last_fullsized":"2024-09-12T01:02:37.133970+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:36.628955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"268'127","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.435230+0000","last_change":"2024-09-12T00:16:05.108738+0000","last_active":"2024-09-12T01:01:06.435230+0000","last_peered":"2024-09-12T01:01:06.435230+0000","last_clean":"2024-09-12T01:01:06.435230+0000","last_became_active":"2024-09-12T00:16:05.107712+0000","last_became_peered":"2024-09-12T00:16:05.107712+0000","last_unstale":"2024-09-12T01:01:06.435230+0000","last_undegraded":"2024-09-12T01:01:06.435230+0000","last_fullsized":"2024-09-12T01:01:06.435230+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:00.734318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":150,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"268'855","reported_seq":2471,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:53.115073+0000","last_change":"2024-09-12T00:15:57.044791+0000","last_active":"2024-09-12T01:00:53.115073+0000","last_peered":"2024-09-12T01:00:53.115073+0000","last_clean":"2024-09-12T01:00:53.115073+0000","last_became_active":"2024-09-12T00:15:57.043447+0000","last_became_peered":"2024-09-12T00:15:57.043447+0000","last_unstale":"2024-09-12T01:00:53.115073+0000","last_undegraded":"2024-09-12T01:00:53.115073+0000","last_fullsized":"2024-09-12T01:00:53.115073+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:48.004809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4138,"num_read_kb":3738,"num_write":1141,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"268'269","reported_seq":909,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.959042+0000","last_change":"2024-09-12T00:15:55.040492+0000","last_active":"2024-09-12T01:02:37.959042+0000","last_peered":"2024-09-12T01:02:37.959042+0000","last_clean":"2024-09-12T01:02:37.959042+0000","last_became_active":"2024-09-12T00:15:55.039512+0000","last_became_peered":"2024-09-12T00:15:55.039512+0000","last_unstale":"2024-09-12T01:02:37.959042+0000","last_undegraded":"2024-09-12T01:02:37.959042+0000","last_fullsized":"2024-09-12T01:02:37.959042+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:08.086426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12173113,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":377,"num_read_kb":56944,"num_write":937,"num_write_kb":41414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:44.205861+0000","last_change":"2024-09-12T00:15:59.046399+0000","last_active":"2024-09-12T00:58:44.205861+0000","last_peered":"2024-09-12T00:58:44.205861+0000","last_clean":"2024-09-12T00:58:44.205861+0000","last_became_active":"2024-09-12T00:15:59.046018+0000","last_became_peered":"2024-09-12T00:15:59.046018+0000","last_unstale":"2024-09-12T00:58:44.205861+0000","last_undegraded":"2024-09-12T00:58:44.205861+0000","last_fullsized":"2024-09-12T00:58:44.205861+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:02.866037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"268'329","reported_seq":933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.999385+0000","last_change":"2024-09-12T00:16:01.070932+0000","last_active":"2024-09-12T01:02:11.999385+0000","last_peered":"2024-09-12T01:02:11.999385+0000","last_clean":"2024-09-12T01:02:11.999385+0000","last_became_active":"2024-09-12T00:16:01.069078+0000","last_became_peered":"2024-09-12T00:16:01.069078+0000","last_unstale":"2024-09-12T01:02:11.999385+0000","last_undegraded":"2024-09-12T01:02:11.999385+0000","last_fullsized":"2024-09-12T01:02:11.999385+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:54.239828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53080,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":525,"num_read_kb":986,"num_write":414,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.173630+0000","last_change":"2024-09-12T00:16:03.107385+0000","last_active":"2024-09-12T00:58:48.173630+0000","last_peered":"2024-09-12T00:58:48.173630+0000","last_clean":"2024-09-12T00:58:48.173630+0000","last_became_active":"2024-09-12T00:16:03.106662+0000","last_became_peered":"2024-09-12T00:16:03.106662+0000","last_unstale":"2024-09-12T00:58:48.173630+0000","last_undegraded":"2024-09-12T00:58:48.173630+0000","last_fullsized":"2024-09-12T00:58:48.173630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:36.203314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"268'135","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:05.839461+0000","last_change":"2024-09-12T00:16:05.112393+0000","last_active":"2024-09-12T01:01:05.839461+0000","last_peered":"2024-09-12T01:01:05.839461+0000","last_clean":"2024-09-12T01:01:05.839461+0000","last_became_active":"2024-09-12T00:16:05.111705+0000","last_became_peered":"2024-09-12T00:16:05.111705+0000","last_unstale":"2024-09-12T01:01:05.839461+0000","last_undegraded":"2024-09-12T01:01:05.839461+0000","last_fullsized":"2024-09-12T01:01:05.839461+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:21.647320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":316,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"268'515","reported_seq":2096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.227739+0000","last_change":"2024-09-12T00:15:57.029602+0000","last_active":"2024-09-12T01:01:07.227739+0000","last_peered":"2024-09-12T01:01:07.227739+0000","last_clean":"2024-09-12T01:01:07.227739+0000","last_became_active":"2024-09-12T00:15:57.029211+0000","last_became_peered":"2024-09-12T00:15:57.029211+0000","last_unstale":"2024-09-12T01:01:07.227739+0000","last_undegraded":"2024-09-12T01:01:07.227739+0000","last_fullsized":"2024-09-12T01:01:07.227739+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:55.890872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2638,"num_read_kb":2449,"num_write":617,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.188316+0000","last_change":"2024-09-12T00:15:34.148103+0000","last_active":"2024-09-12T00:59:48.188316+0000","last_peered":"2024-09-12T00:59:48.188316+0000","last_clean":"2024-09-12T00:59:48.188316+0000","last_became_active":"2024-09-12T00:15:34.145413+0000","last_became_peered":"2024-09-12T00:15:34.145413+0000","last_unstale":"2024-09-12T00:59:48.188316+0000","last_undegraded":"2024-09-12T00:59:48.188316+0000","last_fullsized":"2024-09-12T00:59:48.188316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.032265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.032265+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.032265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:37.582882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219349+0000","last_change":"2024-09-12T00:15:42.090501+0000","last_active":"2024-09-12T00:59:29.219349+0000","last_peered":"2024-09-12T00:59:29.219349+0000","last_clean":"2024-09-12T00:59:29.219349+0000","last_became_active":"2024-09-12T00:15:40.490486+0000","last_became_peered":"2024-09-12T00:15:40.490486+0000","last_unstale":"2024-09-12T00:59:29.219349+0000","last_undegraded":"2024-09-12T00:59:29.219349+0000","last_fullsized":"2024-09-12T00:59:29.219349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:41.969157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013201490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"268'291","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.988082+0000","last_change":"2024-09-12T00:15:55.049247+0000","last_active":"2024-09-12T01:02:37.988082+0000","last_peered":"2024-09-12T01:02:37.988082+0000","last_clean":"2024-09-12T01:02:37.988082+0000","last_became_active":"2024-09-12T00:15:55.048230+0000","last_became_peered":"2024-09-12T00:15:55.048230+0000","last_unstale":"2024-09-12T01:02:37.988082+0000","last_undegraded":"2024-09-12T01:02:37.988082+0000","last_fullsized":"2024-09-12T01:02:37.988082+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:10.864422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2024205,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":509,"num_read_kb":9775,"num_write":1078,"num_write_kb":32871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.189322+0000","last_change":"2024-09-12T00:15:59.041780+0000","last_active":"2024-09-12T00:59:48.189322+0000","last_peered":"2024-09-12T00:59:48.189322+0000","last_clean":"2024-09-12T00:59:48.189322+0000","last_became_active":"2024-09-12T00:15:59.041357+0000","last_became_peered":"2024-09-12T00:15:59.041357+0000","last_unstale":"2024-09-12T00:59:48.189322+0000","last_undegraded":"2024-09-12T00:59:48.189322+0000","last_fullsized":"2024-09-12T00:59:48.189322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:31.097783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"268'721","reported_seq":1432,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.089760+0000","last_change":"2024-09-12T00:16:01.052726+0000","last_active":"2024-09-12T01:02:38.089760+0000","last_peered":"2024-09-12T01:02:38.089760+0000","last_clean":"2024-09-12T01:02:38.089760+0000","last_became_active":"2024-09-12T00:16:01.052016+0000","last_became_peered":"2024-09-12T00:16:01.052016+0000","last_unstale":"2024-09-12T01:02:38.089760+0000","last_undegraded":"2024-09-12T01:02:38.089760+0000","last_fullsized":"2024-09-12T01:02:38.089760+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:44.346178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169706,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1413,"num_read_kb":3242,"num_write":1312,"num_write_kb":1184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":488,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.199298+0000","last_change":"2024-09-12T00:16:03.099445+0000","last_active":"2024-09-12T00:59:27.199298+0000","last_peered":"2024-09-12T00:59:27.199298+0000","last_clean":"2024-09-12T00:59:27.199298+0000","last_became_active":"2024-09-12T00:16:03.097343+0000","last_became_peered":"2024-09-12T00:16:03.097343+0000","last_unstale":"2024-09-12T00:59:27.199298+0000","last_undegraded":"2024-09-12T00:59:27.199298+0000","last_fullsized":"2024-09-12T00:59:27.199298+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:08.255612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"268'171","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.245431+0000","last_change":"2024-09-12T00:16:05.113881+0000","last_active":"2024-09-12T01:01:07.245431+0000","last_peered":"2024-09-12T01:01:07.245431+0000","last_clean":"2024-09-12T01:01:07.245431+0000","last_became_active":"2024-09-12T00:16:05.113366+0000","last_became_peered":"2024-09-12T00:16:05.113366+0000","last_unstale":"2024-09-12T01:01:07.245431+0000","last_undegraded":"2024-09-12T01:01:07.245431+0000","last_fullsized":"2024-09-12T01:01:07.245431+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:18.255536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1020,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":408,"num_write":348,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"268'1045","reported_seq":2792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.053877+0000","last_change":"2024-09-12T00:15:57.049813+0000","last_active":"2024-09-12T01:00:41.053877+0000","last_peered":"2024-09-12T01:00:41.053877+0000","last_clean":"2024-09-12T01:00:41.053877+0000","last_became_active":"2024-09-12T00:15:57.047672+0000","last_became_peered":"2024-09-12T00:15:57.047672+0000","last_unstale":"2024-09-12T01:00:41.053877+0000","last_undegraded":"2024-09-12T01:00:41.053877+0000","last_fullsized":"2024-09-12T01:00:41.053877+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":1000,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:39.410827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5053,"num_read_kb":4502,"num_write":1469,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:54.225501+0000","last_change":"2024-09-12T00:15:42.090908+0000","last_active":"2024-09-12T00:59:54.225501+0000","last_peered":"2024-09-12T00:59:54.225501+0000","last_clean":"2024-09-12T00:59:54.225501+0000","last_became_active":"2024-09-12T00:15:40.098303+0000","last_became_peered":"2024-09-12T00:15:40.098303+0000","last_unstale":"2024-09-12T00:59:54.225501+0000","last_undegraded":"2024-09-12T00:59:54.225501+0000","last_fullsized":"2024-09-12T00:59:54.225501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:40.232317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017858660000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"268'292","reported_seq":945,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.189405+0000","last_change":"2024-09-12T00:15:55.051725+0000","last_active":"2024-09-12T01:02:38.189405+0000","last_peered":"2024-09-12T01:02:38.189405+0000","last_clean":"2024-09-12T01:02:38.189405+0000","last_became_active":"2024-09-12T00:15:55.050874+0000","last_became_peered":"2024-09-12T00:15:55.050874+0000","last_unstale":"2024-09-12T01:02:38.189405+0000","last_undegraded":"2024-09-12T01:02:38.189405+0000","last_fullsized":"2024-09-12T01:02:38.189405+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:21.733859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22608265,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":426,"num_read_kb":131172,"num_write":1023,"num_write_kb":57813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:19.216989+0000","last_change":"2024-09-12T00:15:59.031231+0000","last_active":"2024-09-12T00:59:19.216989+0000","last_peered":"2024-09-12T00:59:19.216989+0000","last_clean":"2024-09-12T00:59:19.216989+0000","last_became_active":"2024-09-12T00:15:59.030858+0000","last_became_peered":"2024-09-12T00:15:59.030858+0000","last_unstale":"2024-09-12T00:59:19.216989+0000","last_undegraded":"2024-09-12T00:59:19.216989+0000","last_fullsized":"2024-09-12T00:59:19.216989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:14.830144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"268'1298","reported_seq":2785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.183574+0000","last_change":"2024-09-12T00:16:01.058741+0000","last_active":"2024-09-12T01:02:37.183574+0000","last_peered":"2024-09-12T01:02:37.183574+0000","last_clean":"2024-09-12T01:02:37.183574+0000","last_became_active":"2024-09-12T00:16:01.057956+0000","last_became_peered":"2024-09-12T00:16:01.057956+0000","last_unstale":"2024-09-12T01:02:37.183574+0000","last_undegraded":"2024-09-12T01:02:37.183574+0000","last_fullsized":"2024-09-12T01:02:37.183574+0000","mapping_epoch":32,"log_start":"268'1200","ondisk_log_start":"268'1200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":1200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:22.472702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186588,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2032,"num_read_kb":3561,"num_write":1154,"num_write_kb":1000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:59.226747+0000","last_change":"2024-09-12T00:16:03.105384+0000","last_active":"2024-09-12T00:59:59.226747+0000","last_peered":"2024-09-12T00:59:59.226747+0000","last_clean":"2024-09-12T00:59:59.226747+0000","last_became_active":"2024-09-12T00:16:03.104040+0000","last_became_peered":"2024-09-12T00:16:03.104040+0000","last_unstale":"2024-09-12T00:59:59.226747+0000","last_undegraded":"2024-09-12T00:59:59.226747+0000","last_fullsized":"2024-09-12T00:59:59.226747+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:42.422978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"268'221","reported_seq":747,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.969829+0000","last_change":"2024-09-12T00:16:05.100831+0000","last_active":"2024-09-12T01:00:41.969829+0000","last_peered":"2024-09-12T01:00:41.969829+0000","last_clean":"2024-09-12T01:00:41.969829+0000","last_became_active":"2024-09-12T00:16:05.099987+0000","last_became_peered":"2024-09-12T00:16:05.099987+0000","last_unstale":"2024-09-12T01:00:41.969829+0000","last_undegraded":"2024-09-12T01:00:41.969829+0000","last_fullsized":"2024-09-12T01:00:41.969829+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:49.711006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":366,"num_read_kb":355,"num_write":494,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"268'395","reported_seq":1888,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506639+0000","last_change":"2024-09-12T00:15:57.022983+0000","last_active":"2024-09-12T01:01:09.506639+0000","last_peered":"2024-09-12T01:01:09.506639+0000","last_clean":"2024-09-12T01:01:09.506639+0000","last_became_active":"2024-09-12T00:15:57.022193+0000","last_became_peered":"2024-09-12T00:15:57.022193+0000","last_unstale":"2024-09-12T01:01:09.506639+0000","last_undegraded":"2024-09-12T01:01:09.506639+0000","last_fullsized":"2024-09-12T01:01:09.506639+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:12.564764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2164,"num_read_kb":2061,"num_write":440,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174427+0000","last_change":"2024-09-12T00:15:43.065460+0000","last_active":"2024-09-12T00:59:27.174427+0000","last_peered":"2024-09-12T00:59:27.174427+0000","last_clean":"2024-09-12T00:59:27.174427+0000","last_became_active":"2024-09-12T00:15:40.095888+0000","last_became_peered":"2024-09-12T00:15:40.095888+0000","last_unstale":"2024-09-12T00:59:27.174427+0000","last_undegraded":"2024-09-12T00:59:27.174427+0000","last_fullsized":"2024-09-12T00:59:27.174427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:49.939912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000883303,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"268'288","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.386518+0000","last_change":"2024-09-12T00:15:55.055938+0000","last_active":"2024-09-12T01:00:46.386518+0000","last_peered":"2024-09-12T01:00:46.386518+0000","last_clean":"2024-09-12T01:00:46.386518+0000","last_became_active":"2024-09-12T00:15:55.043174+0000","last_became_peered":"2024-09-12T00:15:55.043174+0000","last_unstale":"2024-09-12T01:00:46.386518+0000","last_undegraded":"2024-09-12T01:00:46.386518+0000","last_fullsized":"2024-09-12T01:00:46.386518+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:27.487345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2140715,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":420,"num_read_kb":17440,"num_write":1051,"num_write_kb":28417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:22.173406+0000","last_change":"2024-09-12T00:15:59.035726+0000","last_active":"2024-09-12T00:59:22.173406+0000","last_peered":"2024-09-12T00:59:22.173406+0000","last_clean":"2024-09-12T00:59:22.173406+0000","last_became_active":"2024-09-12T00:15:59.033660+0000","last_became_peered":"2024-09-12T00:15:59.033660+0000","last_unstale":"2024-09-12T00:59:22.173406+0000","last_undegraded":"2024-09-12T00:59:22.173406+0000","last_fullsized":"2024-09-12T00:59:22.173406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:37.650316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"268'251","reported_seq":1356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.831740+0000","last_change":"2024-09-12T00:16:01.073248+0000","last_active":"2024-09-12T01:02:10.831740+0000","last_peered":"2024-09-12T01:02:10.831740+0000","last_clean":"2024-09-12T01:02:10.831740+0000","last_became_active":"2024-09-12T00:16:01.072168+0000","last_became_peered":"2024-09-12T00:16:01.072168+0000","last_unstale":"2024-09-12T01:02:10.831740+0000","last_undegraded":"2024-09-12T01:02:10.831740+0000","last_fullsized":"2024-09-12T01:02:10.831740+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:05.937075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.183287+0000","last_change":"2024-09-12T00:16:03.087413+0000","last_active":"2024-09-12T00:59:48.183287+0000","last_peered":"2024-09-12T00:59:48.183287+0000","last_clean":"2024-09-12T00:59:48.183287+0000","last_became_active":"2024-09-12T00:16:03.086646+0000","last_became_peered":"2024-09-12T00:16:03.086646+0000","last_unstale":"2024-09-12T00:59:48.183287+0000","last_undegraded":"2024-09-12T00:59:48.183287+0000","last_fullsized":"2024-09-12T00:59:48.183287+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:29.789535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"268'260","reported_seq":880,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.425705+0000","last_change":"2024-09-12T00:16:05.095458+0000","last_active":"2024-09-12T01:01:07.425705+0000","last_peered":"2024-09-12T01:01:07.425705+0000","last_clean":"2024-09-12T01:01:07.425705+0000","last_became_active":"2024-09-12T00:16:05.094684+0000","last_became_peered":"2024-09-12T00:16:05.094684+0000","last_unstale":"2024-09-12T01:01:07.425705+0000","last_undegraded":"2024-09-12T01:01:07.425705+0000","last_fullsized":"2024-09-12T01:01:07.425705+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:59.471541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":550,"num_read_kb":556,"num_write":574,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"268'872","reported_seq":2469,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:45.899344+0000","last_change":"2024-09-12T00:15:57.050201+0000","last_active":"2024-09-12T01:00:45.899344+0000","last_peered":"2024-09-12T01:00:45.899344+0000","last_clean":"2024-09-12T01:00:45.899344+0000","last_became_active":"2024-09-12T00:15:57.049533+0000","last_became_peered":"2024-09-12T00:15:57.049533+0000","last_unstale":"2024-09-12T01:00:45.899344+0000","last_undegraded":"2024-09-12T01:00:45.899344+0000","last_fullsized":"2024-09-12T01:00:45.899344+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:22.616019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4105,"num_read_kb":3691,"num_write":1162,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219306+0000","last_change":"2024-09-12T00:15:42.091191+0000","last_active":"2024-09-12T00:59:29.219306+0000","last_peered":"2024-09-12T00:59:29.219306+0000","last_clean":"2024-09-12T00:59:29.219306+0000","last_became_active":"2024-09-12T00:15:40.144614+0000","last_became_peered":"2024-09-12T00:15:40.144614+0000","last_unstale":"2024-09-12T00:59:29.219306+0000","last_undegraded":"2024-09-12T00:59:29.219306+0000","last_fullsized":"2024-09-12T00:59:29.219306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:01.463335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019634679999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"268'308","reported_seq":1007,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.995938+0000","last_change":"2024-09-12T00:15:55.060894+0000","last_active":"2024-09-12T01:02:37.995938+0000","last_peered":"2024-09-12T01:02:37.995938+0000","last_clean":"2024-09-12T01:02:37.995938+0000","last_became_active":"2024-09-12T00:15:55.060303+0000","last_became_peered":"2024-09-12T00:15:55.060303+0000","last_unstale":"2024-09-12T01:02:37.995938+0000","last_undegraded":"2024-09-12T01:02:37.995938+0000","last_fullsized":"2024-09-12T01:02:37.995938+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:25.050199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6585252,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":597,"num_read_kb":10986,"num_write":1285,"num_write_kb":39626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.181987+0000","last_change":"2024-09-12T00:15:59.043416+0000","last_active":"2024-09-12T00:59:57.181987+0000","last_peered":"2024-09-12T00:59:57.181987+0000","last_clean":"2024-09-12T00:59:57.181987+0000","last_became_active":"2024-09-12T00:15:59.042545+0000","last_became_peered":"2024-09-12T00:15:59.042545+0000","last_unstale":"2024-09-12T00:59:57.181987+0000","last_undegraded":"2024-09-12T00:59:57.181987+0000","last_fullsized":"2024-09-12T00:59:57.181987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:22.895073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"268'140","reported_seq":678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:09.645572+0000","last_change":"2024-09-12T00:16:01.048555+0000","last_active":"2024-09-12T01:02:09.645572+0000","last_peered":"2024-09-12T01:02:09.645572+0000","last_clean":"2024-09-12T01:02:09.645572+0000","last_became_active":"2024-09-12T00:16:01.047278+0000","last_became_peered":"2024-09-12T00:16:01.047278+0000","last_unstale":"2024-09-12T01:02:09.645572+0000","last_undegraded":"2024-09-12T01:02:09.645572+0000","last_fullsized":"2024-09-12T01:02:09.645572+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:52.572279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":143,"num_write":118,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:24.218190+0000","last_change":"2024-09-12T00:16:03.097752+0000","last_active":"2024-09-12T00:59:24.218190+0000","last_peered":"2024-09-12T00:59:24.218190+0000","last_clean":"2024-09-12T00:59:24.218190+0000","last_became_active":"2024-09-12T00:16:03.097029+0000","last_became_peered":"2024-09-12T00:16:03.097029+0000","last_unstale":"2024-09-12T00:59:24.218190+0000","last_undegraded":"2024-09-12T00:59:24.218190+0000","last_fullsized":"2024-09-12T00:59:24.218190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:58.710309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"268'157","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.216786+0000","last_change":"2024-09-12T00:16:05.112178+0000","last_active":"2024-09-12T01:01:07.216786+0000","last_peered":"2024-09-12T01:01:07.216786+0000","last_clean":"2024-09-12T01:01:07.216786+0000","last_became_active":"2024-09-12T00:16:05.111534+0000","last_became_peered":"2024-09-12T00:16:05.111534+0000","last_unstale":"2024-09-12T01:01:07.216786+0000","last_undegraded":"2024-09-12T01:01:07.216786+0000","last_fullsized":"2024-09-12T01:01:07.216786+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:54.359907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":344,"num_read_kb":315,"num_write":411,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"268'448","reported_seq":1932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.871086+0000","last_change":"2024-09-12T00:15:57.032372+0000","last_active":"2024-09-12T01:02:10.871086+0000","last_peered":"2024-09-12T01:02:10.871086+0000","last_clean":"2024-09-12T01:02:10.871086+0000","last_became_active":"2024-09-12T00:15:57.023909+0000","last_became_peered":"2024-09-12T00:15:57.023909+0000","last_unstale":"2024-09-12T01:02:10.871086+0000","last_undegraded":"2024-09-12T01:02:10.871086+0000","last_fullsized":"2024-09-12T01:02:10.871086+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:51.721224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2256,"num_read_kb":2116,"num_write":511,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"268'300","reported_seq":943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.141379+0000","last_change":"2024-09-12T00:15:55.057220+0000","last_active":"2024-09-12T01:02:38.141379+0000","last_peered":"2024-09-12T01:02:38.141379+0000","last_clean":"2024-09-12T01:02:38.141379+0000","last_became_active":"2024-09-12T00:15:55.056576+0000","last_became_peered":"2024-09-12T00:15:55.056576+0000","last_unstale":"2024-09-12T01:02:38.141379+0000","last_undegraded":"2024-09-12T01:02:38.141379+0000","last_fullsized":"2024-09-12T01:02:38.141379+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:08.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6554173,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":489,"num_read_kb":507,"num_write":1164,"num_write_kb":27643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.199091+0000","last_change":"2024-09-12T00:15:42.088087+0000","last_active":"2024-09-12T00:59:27.199091+0000","last_peered":"2024-09-12T00:59:27.199091+0000","last_clean":"2024-09-12T00:59:27.199091+0000","last_became_active":"2024-09-12T00:15:40.141037+0000","last_became_peered":"2024-09-12T00:15:40.141037+0000","last_unstale":"2024-09-12T00:59:27.199091+0000","last_undegraded":"2024-09-12T00:59:27.199091+0000","last_fullsized":"2024-09-12T00:59:27.199091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:30.931343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088972300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.183221+0000","last_change":"2024-09-12T00:15:59.045253+0000","last_active":"2024-09-12T00:59:48.183221+0000","last_peered":"2024-09-12T00:59:48.183221+0000","last_clean":"2024-09-12T00:59:48.183221+0000","last_became_active":"2024-09-12T00:15:59.043935+0000","last_became_peered":"2024-09-12T00:15:59.043935+0000","last_unstale":"2024-09-12T00:59:48.183221+0000","last_undegraded":"2024-09-12T00:59:48.183221+0000","last_fullsized":"2024-09-12T00:59:48.183221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:12.203334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"268'551","reported_seq":1215,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.214126+0000","last_change":"2024-09-12T00:16:01.053029+0000","last_active":"2024-09-12T01:02:12.214126+0000","last_peered":"2024-09-12T01:02:12.214126+0000","last_clean":"2024-09-12T01:02:12.214126+0000","last_became_active":"2024-09-12T00:16:01.051753+0000","last_became_peered":"2024-09-12T00:16:01.051753+0000","last_unstale":"2024-09-12T01:02:12.214126+0000","last_undegraded":"2024-09-12T01:02:12.214126+0000","last_fullsized":"2024-09-12T01:02:12.214126+0000","mapping_epoch":32,"log_start":"268'500","ondisk_log_start":"268'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:25.228834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105239,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1542,"num_read_kb":2446,"num_write":2036,"num_write_kb":1873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.188058+0000","last_change":"2024-09-12T00:16:03.100214+0000","last_active":"2024-09-12T00:59:48.188058+0000","last_peered":"2024-09-12T00:59:48.188058+0000","last_clean":"2024-09-12T00:59:48.188058+0000","last_became_active":"2024-09-12T00:16:03.099491+0000","last_became_peered":"2024-09-12T00:16:03.099491+0000","last_unstale":"2024-09-12T00:59:48.188058+0000","last_undegraded":"2024-09-12T00:59:48.188058+0000","last_fullsized":"2024-09-12T00:59:48.188058+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:29.470103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"268'110","reported_seq":605,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:30.754431+0000","last_change":"2024-09-12T00:16:05.100929+0000","last_active":"2024-09-12T01:00:30.754431+0000","last_peered":"2024-09-12T01:00:30.754431+0000","last_clean":"2024-09-12T01:00:30.754431+0000","last_became_active":"2024-09-12T00:16:05.099975+0000","last_became_peered":"2024-09-12T00:16:05.099975+0000","last_unstale":"2024-09-12T01:00:30.754431+0000","last_undegraded":"2024-09-12T01:00:30.754431+0000","last_fullsized":"2024-09-12T01:00:30.754431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:02.033531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":90,"num_write":249,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"268'512","reported_seq":2238,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.869874+0000","last_change":"2024-09-12T00:15:57.020092+0000","last_active":"2024-09-12T01:02:10.869874+0000","last_peered":"2024-09-12T01:02:10.869874+0000","last_clean":"2024-09-12T01:02:10.869874+0000","last_became_active":"2024-09-12T00:15:57.019345+0000","last_became_peered":"2024-09-12T00:15:57.019345+0000","last_unstale":"2024-09-12T01:02:10.869874+0000","last_undegraded":"2024-09-12T01:02:10.869874+0000","last_fullsized":"2024-09-12T01:02:10.869874+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:37.937658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2840,"num_read_kb":2674,"num_write":601,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"268'312","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.170308+0000","last_change":"2024-09-12T00:15:55.068406+0000","last_active":"2024-09-12T01:02:38.170308+0000","last_peered":"2024-09-12T01:02:38.170308+0000","last_clean":"2024-09-12T01:02:38.170308+0000","last_became_active":"2024-09-12T00:15:55.064444+0000","last_became_peered":"2024-09-12T00:15:55.064444+0000","last_unstale":"2024-09-12T01:02:38.170308+0000","last_undegraded":"2024-09-12T01:02:38.170308+0000","last_fullsized":"2024-09-12T01:02:38.170308+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:55.022447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11585769,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":433,"num_read_kb":45787,"num_write":978,"num_write_kb":51853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:39.221977+0000","last_change":"2024-09-12T00:15:42.091937+0000","last_active":"2024-09-12T00:59:39.221977+0000","last_peered":"2024-09-12T00:59:39.221977+0000","last_clean":"2024-09-12T00:59:39.221977+0000","last_became_active":"2024-09-12T00:15:40.093718+0000","last_became_peered":"2024-09-12T00:15:40.093718+0000","last_unstale":"2024-09-12T00:59:39.221977+0000","last_undegraded":"2024-09-12T00:59:39.221977+0000","last_fullsized":"2024-09-12T00:59:39.221977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:26.233329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001992522,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.189215+0000","last_change":"2024-09-12T00:15:59.042002+0000","last_active":"2024-09-12T00:59:48.189215+0000","last_peered":"2024-09-12T00:59:48.189215+0000","last_clean":"2024-09-12T00:59:48.189215+0000","last_became_active":"2024-09-12T00:15:59.041390+0000","last_became_peered":"2024-09-12T00:15:59.041390+0000","last_unstale":"2024-09-12T00:59:48.189215+0000","last_undegraded":"2024-09-12T00:59:48.189215+0000","last_fullsized":"2024-09-12T00:59:48.189215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:47.896665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"268'155","reported_seq":721,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.176909+0000","last_change":"2024-09-12T00:16:01.052772+0000","last_active":"2024-09-12T00:59:48.176909+0000","last_peered":"2024-09-12T00:59:48.176909+0000","last_clean":"2024-09-12T00:59:48.176909+0000","last_became_active":"2024-09-12T00:16:01.050630+0000","last_became_peered":"2024-09-12T00:16:01.050630+0000","last_unstale":"2024-09-12T00:59:48.176909+0000","last_undegraded":"2024-09-12T00:59:48.176909+0000","last_fullsized":"2024-09-12T00:59:48.176909+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:59.467265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":205,"num_read_kb":196,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"268'797","reported_seq":2727,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.127672+0000","last_change":"2024-09-12T00:16:03.104886+0000","last_active":"2024-09-12T01:02:37.127672+0000","last_peered":"2024-09-12T01:02:37.127672+0000","last_clean":"2024-09-12T01:02:37.127672+0000","last_became_active":"2024-09-12T00:16:03.104125+0000","last_became_peered":"2024-09-12T00:16:03.104125+0000","last_unstale":"2024-09-12T01:02:37.127672+0000","last_undegraded":"2024-09-12T01:02:37.127672+0000","last_fullsized":"2024-09-12T01:02:37.127672+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:43.285245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"268'113","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:17.202074+0000","last_change":"2024-09-12T00:16:05.115377+0000","last_active":"2024-09-12T01:01:17.202074+0000","last_peered":"2024-09-12T01:01:17.202074+0000","last_clean":"2024-09-12T01:01:17.202074+0000","last_became_active":"2024-09-12T00:16:05.114695+0000","last_became_peered":"2024-09-12T00:16:05.114695+0000","last_unstale":"2024-09-12T01:01:17.202074+0000","last_undegraded":"2024-09-12T01:01:17.202074+0000","last_fullsized":"2024-09-12T01:01:17.202074+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:16.956956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":134,"num_write":263,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"268'786","reported_seq":2351,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.228575+0000","last_change":"2024-09-12T00:15:57.028597+0000","last_active":"2024-09-12T01:01:07.228575+0000","last_peered":"2024-09-12T01:01:07.228575+0000","last_clean":"2024-09-12T01:01:07.228575+0000","last_became_active":"2024-09-12T00:15:57.027778+0000","last_became_peered":"2024-09-12T00:15:57.027778+0000","last_unstale":"2024-09-12T01:01:07.228575+0000","last_undegraded":"2024-09-12T01:01:07.228575+0000","last_fullsized":"2024-09-12T01:01:07.228575+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:34.509309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3889,"num_read_kb":3532,"num_write":1033,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"268'367","reported_seq":1060,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.977283+0000","last_change":"2024-09-12T00:15:55.049561+0000","last_active":"2024-09-12T01:02:37.977283+0000","last_peered":"2024-09-12T01:02:37.977283+0000","last_clean":"2024-09-12T01:02:37.977283+0000","last_became_active":"2024-09-12T00:15:55.048610+0000","last_became_peered":"2024-09-12T00:15:55.048610+0000","last_unstale":"2024-09-12T01:02:37.977283+0000","last_undegraded":"2024-09-12T01:02:37.977283+0000","last_fullsized":"2024-09-12T01:02:37.977283+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:41.138699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7799667,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":650,"num_read_kb":32494,"num_write":1262,"num_write_kb":43441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.171642+0000","last_change":"2024-09-12T00:15:42.117262+0000","last_active":"2024-09-12T00:59:03.171642+0000","last_peered":"2024-09-12T00:59:03.171642+0000","last_clean":"2024-09-12T00:59:03.171642+0000","last_became_active":"2024-09-12T00:15:40.660718+0000","last_became_peered":"2024-09-12T00:15:40.660718+0000","last_unstale":"2024-09-12T00:59:03.171642+0000","last_undegraded":"2024-09-12T00:59:03.171642+0000","last_fullsized":"2024-09-12T00:59:03.171642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:04.909588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080064100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"38'5","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.084832+0000","last_change":"2024-09-12T00:15:59.023300+0000","last_active":"2024-09-12T01:02:37.084832+0000","last_peered":"2024-09-12T01:02:37.084832+0000","last_clean":"2024-09-12T01:02:37.084832+0000","last_became_active":"2024-09-12T00:15:59.022598+0000","last_became_peered":"2024-09-12T00:15:59.022598+0000","last_unstale":"2024-09-12T01:02:37.084832+0000","last_undegraded":"2024-09-12T01:02:37.084832+0000","last_fullsized":"2024-09-12T01:02:37.084832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:14.157447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"268'111","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:49.224395+0000","last_change":"2024-09-12T00:16:01.063640+0000","last_active":"2024-09-12T00:59:49.224395+0000","last_peered":"2024-09-12T00:59:49.224395+0000","last_clean":"2024-09-12T00:59:49.224395+0000","last_became_active":"2024-09-12T00:16:01.061378+0000","last_became_peered":"2024-09-12T00:16:01.061378+0000","last_unstale":"2024-09-12T00:59:49.224395+0000","last_undegraded":"2024-09-12T00:59:49.224395+0000","last_fullsized":"2024-09-12T00:59:49.224395+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:32.478977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":124,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"268'810","reported_seq":4440,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.075572+0000","last_change":"2024-09-12T00:16:03.098212+0000","last_active":"2024-09-12T01:02:12.075572+0000","last_peered":"2024-09-12T01:02:12.075572+0000","last_clean":"2024-09-12T01:02:12.075572+0000","last_became_active":"2024-09-12T00:16:03.097533+0000","last_became_peered":"2024-09-12T00:16:03.097533+0000","last_unstale":"2024-09-12T01:02:12.075572+0000","last_undegraded":"2024-09-12T01:02:12.075572+0000","last_fullsized":"2024-09-12T01:02:12.075572+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:57.487410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"268'165","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:40.003597+0000","last_change":"2024-09-12T00:16:05.110783+0000","last_active":"2024-09-12T01:00:40.003597+0000","last_peered":"2024-09-12T01:00:40.003597+0000","last_clean":"2024-09-12T01:00:40.003597+0000","last_became_active":"2024-09-12T00:16:05.110012+0000","last_became_peered":"2024-09-12T00:16:05.110012+0000","last_unstale":"2024-09-12T01:00:40.003597+0000","last_undegraded":"2024-09-12T01:00:40.003597+0000","last_fullsized":"2024-09-12T01:00:40.003597+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:27.489900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":392,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"268'378","reported_seq":1830,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.582868+0000","last_change":"2024-09-12T00:15:57.024825+0000","last_active":"2024-09-12T01:01:09.582868+0000","last_peered":"2024-09-12T01:01:09.582868+0000","last_clean":"2024-09-12T01:01:09.582868+0000","last_became_active":"2024-09-12T00:15:57.024399+0000","last_became_peered":"2024-09-12T00:15:57.024399+0000","last_unstale":"2024-09-12T01:01:09.582868+0000","last_undegraded":"2024-09-12T01:01:09.582868+0000","last_fullsized":"2024-09-12T01:01:09.582868+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:54.519754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2040,"num_read_kb":1940,"num_write":430,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"268'296","reported_seq":939,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.968987+0000","last_change":"2024-09-12T00:15:55.065586+0000","last_active":"2024-09-12T01:02:37.968987+0000","last_peered":"2024-09-12T01:02:37.968987+0000","last_clean":"2024-09-12T01:02:37.968987+0000","last_became_active":"2024-09-12T00:15:55.064782+0000","last_became_peered":"2024-09-12T00:15:55.064782+0000","last_unstale":"2024-09-12T01:02:37.968987+0000","last_undegraded":"2024-09-12T01:02:37.968987+0000","last_fullsized":"2024-09-12T01:02:37.968987+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:16.186392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7298334,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":449,"num_read_kb":4021,"num_write":1019,"num_write_kb":34802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:04.213089+0000","last_change":"2024-09-12T00:15:42.091675+0000","last_active":"2024-09-12T00:59:04.213089+0000","last_peered":"2024-09-12T00:59:04.213089+0000","last_clean":"2024-09-12T00:59:04.213089+0000","last_became_active":"2024-09-12T00:15:40.663617+0000","last_became_peered":"2024-09-12T00:15:40.663617+0000","last_unstale":"2024-09-12T00:59:04.213089+0000","last_undegraded":"2024-09-12T00:59:04.213089+0000","last_fullsized":"2024-09-12T00:59:04.213089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:31.309528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002428801,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.189481+0000","last_change":"2024-09-12T00:15:59.040528+0000","last_active":"2024-09-12T01:00:13.189481+0000","last_peered":"2024-09-12T01:00:13.189481+0000","last_clean":"2024-09-12T01:00:13.189481+0000","last_became_active":"2024-09-12T00:15:59.039777+0000","last_became_peered":"2024-09-12T00:15:59.039777+0000","last_unstale":"2024-09-12T01:00:13.189481+0000","last_undegraded":"2024-09-12T01:00:13.189481+0000","last_fullsized":"2024-09-12T01:00:13.189481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:55.960948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"268'739","reported_seq":1448,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.174729+0000","last_change":"2024-09-12T00:16:01.052709+0000","last_active":"2024-09-12T01:02:37.174729+0000","last_peered":"2024-09-12T01:02:37.174729+0000","last_clean":"2024-09-12T01:02:37.174729+0000","last_became_active":"2024-09-12T00:16:01.051967+0000","last_became_peered":"2024-09-12T00:16:01.051967+0000","last_unstale":"2024-09-12T01:02:37.174729+0000","last_undegraded":"2024-09-12T01:02:37.174729+0000","last_fullsized":"2024-09-12T01:02:37.174729+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:10.600964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176700,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1312,"num_read_kb":2809,"num_write":1092,"num_write_kb":916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.183148+0000","last_change":"2024-09-12T00:16:03.092521+0000","last_active":"2024-09-12T00:59:48.183148+0000","last_peered":"2024-09-12T00:59:48.183148+0000","last_clean":"2024-09-12T00:59:48.183148+0000","last_became_active":"2024-09-12T00:16:03.091920+0000","last_became_peered":"2024-09-12T00:16:03.091920+0000","last_unstale":"2024-09-12T00:59:48.183148+0000","last_undegraded":"2024-09-12T00:59:48.183148+0000","last_fullsized":"2024-09-12T00:59:48.183148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:35.406048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"268'139","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.474966+0000","last_change":"2024-09-12T00:16:05.113388+0000","last_active":"2024-09-12T01:01:06.474966+0000","last_peered":"2024-09-12T01:01:06.474966+0000","last_clean":"2024-09-12T01:01:06.474966+0000","last_became_active":"2024-09-12T00:16:05.112774+0000","last_became_peered":"2024-09-12T00:16:05.112774+0000","last_unstale":"2024-09-12T01:01:06.474966+0000","last_undegraded":"2024-09-12T01:01:06.474966+0000","last_fullsized":"2024-09-12T01:01:06.474966+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:27.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":230,"num_write":341,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"268'111","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.376870+0000","last_change":"2024-09-12T00:16:05.098437+0000","last_active":"2024-09-12T01:01:07.376870+0000","last_peered":"2024-09-12T01:01:07.376870+0000","last_clean":"2024-09-12T01:01:07.376870+0000","last_became_active":"2024-09-12T00:16:05.097548+0000","last_became_peered":"2024-09-12T00:16:05.097548+0000","last_unstale":"2024-09-12T01:01:07.376870+0000","last_undegraded":"2024-09-12T01:01:07.376870+0000","last_fullsized":"2024-09-12T01:01:07.376870+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:14.723156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":186,"num_read_kb":184,"num_write":255,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"268'852","reported_seq":2471,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.159422+0000","last_change":"2024-09-12T00:15:57.024504+0000","last_active":"2024-09-12T01:01:02.159422+0000","last_peered":"2024-09-12T01:01:02.159422+0000","last_clean":"2024-09-12T01:01:02.159422+0000","last_became_active":"2024-09-12T00:15:57.024237+0000","last_became_peered":"2024-09-12T00:15:57.024237+0000","last_unstale":"2024-09-12T01:01:02.159422+0000","last_undegraded":"2024-09-12T01:01:02.159422+0000","last_fullsized":"2024-09-12T01:01:02.159422+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:13.214327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4086,"num_read_kb":3684,"num_write":1101,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"268'274","reported_seq":915,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.675585+0000","last_change":"2024-09-12T00:16:26.420540+0000","last_active":"2024-09-12T01:02:38.675585+0000","last_peered":"2024-09-12T01:02:38.675585+0000","last_clean":"2024-09-12T01:02:38.675585+0000","last_became_active":"2024-09-12T00:16:26.420272+0000","last_became_peered":"2024-09-12T00:16:26.420272+0000","last_unstale":"2024-09-12T01:02:38.675585+0000","last_undegraded":"2024-09-12T01:02:38.675585+0000","last_fullsized":"2024-09-12T01:02:38.675585+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:08.598775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239237,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":393,"num_read_kb":13074,"num_write":935,"num_write_kb":25707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,0],"acting":[3,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"38'3","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.085598+0000","last_change":"2024-09-12T00:15:59.040011+0000","last_active":"2024-09-12T01:02:37.085598+0000","last_peered":"2024-09-12T01:02:37.085598+0000","last_clean":"2024-09-12T01:02:37.085598+0000","last_became_active":"2024-09-12T00:15:59.039169+0000","last_became_peered":"2024-09-12T00:15:59.039169+0000","last_unstale":"2024-09-12T01:02:37.085598+0000","last_undegraded":"2024-09-12T01:02:37.085598+0000","last_fullsized":"2024-09-12T01:02:37.085598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:42.316880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"268'285","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.517600+0000","last_change":"2024-09-12T00:16:01.067282+0000","last_active":"2024-09-12T01:02:37.517600+0000","last_peered":"2024-09-12T01:02:37.517600+0000","last_clean":"2024-09-12T01:02:37.517600+0000","last_became_active":"2024-09-12T00:16:01.066524+0000","last_became_peered":"2024-09-12T00:16:01.066524+0000","last_unstale":"2024-09-12T01:02:37.517600+0000","last_undegraded":"2024-09-12T01:02:37.517600+0000","last_fullsized":"2024-09-12T01:02:37.517600+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:46.086778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43678,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1068,"num_write":390,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:07.155814+0000","last_change":"2024-09-12T00:16:03.070194+0000","last_active":"2024-09-12T00:58:07.155814+0000","last_peered":"2024-09-12T00:58:07.155814+0000","last_clean":"2024-09-12T00:58:07.155814+0000","last_became_active":"2024-09-12T00:16:03.069399+0000","last_became_peered":"2024-09-12T00:16:03.069399+0000","last_unstale":"2024-09-12T00:58:07.155814+0000","last_undegraded":"2024-09-12T00:58:07.155814+0000","last_fullsized":"2024-09-12T00:58:07.155814+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:53.022367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"268'132","reported_seq":623,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.173811+0000","last_change":"2024-09-12T00:16:05.103043+0000","last_active":"2024-09-12T01:00:52.173811+0000","last_peered":"2024-09-12T01:00:52.173811+0000","last_clean":"2024-09-12T01:00:52.173811+0000","last_became_active":"2024-09-12T00:16:05.102118+0000","last_became_peered":"2024-09-12T00:16:05.102118+0000","last_unstale":"2024-09-12T01:00:52.173811+0000","last_undegraded":"2024-09-12T01:00:52.173811+0000","last_fullsized":"2024-09-12T01:00:52.173811+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:10.930503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":111,"num_write":330,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"268'496","reported_seq":2220,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.446580+0000","last_change":"2024-09-12T00:15:57.032023+0000","last_active":"2024-09-12T01:01:06.446580+0000","last_peered":"2024-09-12T01:01:06.446580+0000","last_clean":"2024-09-12T01:01:06.446580+0000","last_became_active":"2024-09-12T00:15:57.031322+0000","last_became_peered":"2024-09-12T00:15:57.031322+0000","last_unstale":"2024-09-12T01:01:06.446580+0000","last_undegraded":"2024-09-12T01:01:06.446580+0000","last_fullsized":"2024-09-12T01:01:06.446580+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:25.211444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2639,"num_write":567,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"268'406","reported_seq":1114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.859019+0000","last_change":"2024-09-12T00:15:55.066489+0000","last_active":"2024-09-12T01:02:37.859019+0000","last_peered":"2024-09-12T01:02:37.859019+0000","last_clean":"2024-09-12T01:02:37.859019+0000","last_became_active":"2024-09-12T00:15:55.065964+0000","last_became_peered":"2024-09-12T00:15:55.065964+0000","last_unstale":"2024-09-12T01:02:37.859019+0000","last_undegraded":"2024-09-12T01:02:37.859019+0000","last_fullsized":"2024-09-12T01:02:37.859019+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:04.361682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11388245,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":854,"num_read_kb":8759,"num_write":1256,"num_write_kb":27844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:03.156936+0000","last_change":"2024-09-12T00:15:59.044538+0000","last_active":"2024-09-12T00:58:03.156936+0000","last_peered":"2024-09-12T00:58:03.156936+0000","last_clean":"2024-09-12T00:58:03.156936+0000","last_became_active":"2024-09-12T00:15:59.043146+0000","last_became_peered":"2024-09-12T00:15:59.043146+0000","last_unstale":"2024-09-12T00:58:03.156936+0000","last_undegraded":"2024-09-12T00:58:03.156936+0000","last_fullsized":"2024-09-12T00:58:03.156936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:38.791557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"268'49","reported_seq":557,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:42.098355+0000","last_change":"2024-09-12T00:16:01.055742+0000","last_active":"2024-09-12T00:58:42.098355+0000","last_peered":"2024-09-12T00:58:42.098355+0000","last_clean":"2024-09-12T00:58:42.098355+0000","last_became_active":"2024-09-12T00:16:01.055002+0000","last_became_peered":"2024-09-12T00:16:01.055002+0000","last_unstale":"2024-09-12T00:58:42.098355+0000","last_undegraded":"2024-09-12T00:58:42.098355+0000","last_fullsized":"2024-09-12T00:58:42.098355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:31.414501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:03.161791+0000","last_change":"2024-09-12T00:16:03.108240+0000","last_active":"2024-09-12T00:58:03.161791+0000","last_peered":"2024-09-12T00:58:03.161791+0000","last_clean":"2024-09-12T00:58:03.161791+0000","last_became_active":"2024-09-12T00:16:03.107695+0000","last_became_peered":"2024-09-12T00:16:03.107695+0000","last_unstale":"2024-09-12T00:58:03.161791+0000","last_undegraded":"2024-09-12T00:58:03.161791+0000","last_fullsized":"2024-09-12T00:58:03.161791+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:20.303982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"268'245","reported_seq":797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.454102+0000","last_change":"2024-09-12T00:16:05.107880+0000","last_active":"2024-09-12T01:01:06.454102+0000","last_peered":"2024-09-12T01:01:06.454102+0000","last_clean":"2024-09-12T01:01:06.454102+0000","last_became_active":"2024-09-12T00:16:05.106742+0000","last_became_peered":"2024-09-12T00:16:05.106742+0000","last_unstale":"2024-09-12T01:01:06.454102+0000","last_undegraded":"2024-09-12T01:01:06.454102+0000","last_fullsized":"2024-09-12T01:01:06.454102+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:30.878014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":438,"num_read_kb":396,"num_write":482,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"268'395","reported_seq":1832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:48.415779+0000","last_change":"2024-09-12T00:15:57.016176+0000","last_active":"2024-09-12T01:00:48.415779+0000","last_peered":"2024-09-12T01:00:48.415779+0000","last_clean":"2024-09-12T01:00:48.415779+0000","last_became_active":"2024-09-12T00:15:57.015397+0000","last_became_peered":"2024-09-12T00:15:57.015397+0000","last_unstale":"2024-09-12T01:00:48.415779+0000","last_undegraded":"2024-09-12T01:00:48.415779+0000","last_fullsized":"2024-09-12T01:00:48.415779+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:29.776854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2041,"num_read_kb":1937,"num_write":459,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"268'280","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.041793+0000","last_change":"2024-09-12T00:15:55.064342+0000","last_active":"2024-09-12T01:02:38.041793+0000","last_peered":"2024-09-12T01:02:38.041793+0000","last_clean":"2024-09-12T01:02:38.041793+0000","last_became_active":"2024-09-12T00:15:55.062990+0000","last_became_peered":"2024-09-12T00:15:55.062990+0000","last_unstale":"2024-09-12T01:02:38.041793+0000","last_undegraded":"2024-09-12T01:02:38.041793+0000","last_fullsized":"2024-09-12T01:02:38.041793+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:44.373318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":866212,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":402,"num_read_kb":9756,"num_write":957,"num_write_kb":17415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:03.161732+0000","last_change":"2024-09-12T00:15:59.029632+0000","last_active":"2024-09-12T00:58:03.161732+0000","last_peered":"2024-09-12T00:58:03.161732+0000","last_clean":"2024-09-12T00:58:03.161732+0000","last_became_active":"2024-09-12T00:15:59.029162+0000","last_became_peered":"2024-09-12T00:15:59.029162+0000","last_unstale":"2024-09-12T00:58:03.161732+0000","last_undegraded":"2024-09-12T00:58:03.161732+0000","last_fullsized":"2024-09-12T00:58:03.161732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:41.881067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"268'279","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.978813+0000","last_change":"2024-09-12T00:16:01.060247+0000","last_active":"2024-09-12T01:02:11.978813+0000","last_peered":"2024-09-12T01:02:11.978813+0000","last_clean":"2024-09-12T01:02:11.978813+0000","last_became_active":"2024-09-12T00:16:01.059517+0000","last_became_peered":"2024-09-12T00:16:01.059517+0000","last_unstale":"2024-09-12T01:02:11.978813+0000","last_undegraded":"2024-09-12T01:02:11.978813+0000","last_fullsized":"2024-09-12T01:02:11.978813+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:40.375904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52297,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":447,"num_read_kb":874,"num_write":352,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:03.163061+0000","last_change":"2024-09-12T00:16:03.104263+0000","last_active":"2024-09-12T00:58:03.163061+0000","last_peered":"2024-09-12T00:58:03.163061+0000","last_clean":"2024-09-12T00:58:03.163061+0000","last_became_active":"2024-09-12T00:16:03.103630+0000","last_became_peered":"2024-09-12T00:16:03.103630+0000","last_unstale":"2024-09-12T00:58:03.163061+0000","last_undegraded":"2024-09-12T00:58:03.163061+0000","last_fullsized":"2024-09-12T00:58:03.163061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:39.452322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"268'165","reported_seq":678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:01.555845+0000","last_change":"2024-09-12T00:16:05.110450+0000","last_active":"2024-09-12T01:00:01.555845+0000","last_peered":"2024-09-12T01:00:01.555845+0000","last_clean":"2024-09-12T01:00:01.555845+0000","last_became_active":"2024-09-12T00:16:05.109745+0000","last_became_peered":"2024-09-12T00:16:05.109745+0000","last_unstale":"2024-09-12T01:00:01.555845+0000","last_undegraded":"2024-09-12T01:00:01.555845+0000","last_fullsized":"2024-09-12T01:00:01.555845+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:15.769156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":406,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"268'420","reported_seq":1857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506522+0000","last_change":"2024-09-12T00:15:57.030478+0000","last_active":"2024-09-12T01:01:09.506522+0000","last_peered":"2024-09-12T01:01:09.506522+0000","last_clean":"2024-09-12T01:01:09.506522+0000","last_became_active":"2024-09-12T00:15:57.028820+0000","last_became_peered":"2024-09-12T00:15:57.028820+0000","last_unstale":"2024-09-12T01:01:09.506522+0000","last_undegraded":"2024-09-12T01:01:09.506522+0000","last_fullsized":"2024-09-12T01:01:09.506522+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:55.701403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2332,"num_read_kb":2186,"num_write":478,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"268'251","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:51.564738+0000","last_change":"2024-09-12T00:15:55.059264+0000","last_active":"2024-09-12T01:00:51.564738+0000","last_peered":"2024-09-12T01:00:51.564738+0000","last_clean":"2024-09-12T01:00:51.564738+0000","last_became_active":"2024-09-12T00:15:55.054712+0000","last_became_peered":"2024-09-12T00:15:55.054712+0000","last_unstale":"2024-09-12T01:00:51.564738+0000","last_undegraded":"2024-09-12T01:00:51.564738+0000","last_fullsized":"2024-09-12T01:00:51.564738+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:52.726633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6327961,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":395,"num_read_kb":100892,"num_write":962,"num_write_kb":52799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:19.231696+0000","last_change":"2024-09-12T00:15:59.030022+0000","last_active":"2024-09-12T01:00:19.231696+0000","last_peered":"2024-09-12T01:00:19.231696+0000","last_clean":"2024-09-12T01:00:19.231696+0000","last_became_active":"2024-09-12T00:15:59.028885+0000","last_became_peered":"2024-09-12T00:15:59.028885+0000","last_unstale":"2024-09-12T01:00:19.231696+0000","last_undegraded":"2024-09-12T01:00:19.231696+0000","last_fullsized":"2024-09-12T01:00:19.231696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:22.611802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"268'265","reported_seq":827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.970700+0000","last_change":"2024-09-12T00:16:01.056020+0000","last_active":"2024-09-12T01:02:11.970700+0000","last_peered":"2024-09-12T01:02:11.970700+0000","last_clean":"2024-09-12T01:02:11.970700+0000","last_became_active":"2024-09-12T00:16:01.050654+0000","last_became_peered":"2024-09-12T00:16:01.050654+0000","last_unstale":"2024-09-12T01:02:11.970700+0000","last_undegraded":"2024-09-12T01:02:11.970700+0000","last_fullsized":"2024-09-12T01:02:11.970700+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:07.059509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56239,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":427,"num_read_kb":905,"num_write":352,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:07.155925+0000","last_change":"2024-09-12T00:16:03.089923+0000","last_active":"2024-09-12T00:58:07.155925+0000","last_peered":"2024-09-12T00:58:07.155925+0000","last_clean":"2024-09-12T00:58:07.155925+0000","last_became_active":"2024-09-12T00:16:03.088929+0000","last_became_peered":"2024-09-12T00:16:03.088929+0000","last_unstale":"2024-09-12T00:58:07.155925+0000","last_undegraded":"2024-09-12T00:58:07.155925+0000","last_fullsized":"2024-09-12T00:58:07.155925+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:16.321808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"268'421","reported_seq":2042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.226413+0000","last_change":"2024-09-12T00:15:57.040165+0000","last_active":"2024-09-12T01:01:07.226413+0000","last_peered":"2024-09-12T01:01:07.226413+0000","last_clean":"2024-09-12T01:01:07.226413+0000","last_became_active":"2024-09-12T00:15:57.039919+0000","last_became_peered":"2024-09-12T00:15:57.039919+0000","last_unstale":"2024-09-12T01:01:07.226413+0000","last_undegraded":"2024-09-12T01:01:07.226413+0000","last_fullsized":"2024-09-12T01:01:07.226413+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:23.081811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2299,"num_read_kb":2203,"num_write":481,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"268'232","reported_seq":833,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:56.961783+0000","last_change":"2024-09-12T00:15:55.079982+0000","last_active":"2024-09-12T00:59:56.961783+0000","last_peered":"2024-09-12T00:59:56.961783+0000","last_clean":"2024-09-12T00:59:56.961783+0000","last_became_active":"2024-09-12T00:15:55.079264+0000","last_became_peered":"2024-09-12T00:15:55.079264+0000","last_unstale":"2024-09-12T00:59:56.961783+0000","last_undegraded":"2024-09-12T00:59:56.961783+0000","last_fullsized":"2024-09-12T00:59:56.961783+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:11.776490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8632648,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":313,"num_read_kb":14024,"num_write":835,"num_write_kb":16591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.183037+0000","last_change":"2024-09-12T00:15:59.047833+0000","last_active":"2024-09-12T01:00:13.183037+0000","last_peered":"2024-09-12T01:00:13.183037+0000","last_clean":"2024-09-12T01:00:13.183037+0000","last_became_active":"2024-09-12T00:15:59.039042+0000","last_became_peered":"2024-09-12T00:15:59.039042+0000","last_unstale":"2024-09-12T01:00:13.183037+0000","last_undegraded":"2024-09-12T01:00:13.183037+0000","last_fullsized":"2024-09-12T01:00:13.183037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:09.753392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"268'490","reported_seq":1117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.005904+0000","last_change":"2024-09-12T00:16:01.063315+0000","last_active":"2024-09-12T01:02:38.005904+0000","last_peered":"2024-09-12T01:02:38.005904+0000","last_clean":"2024-09-12T01:02:38.005904+0000","last_became_active":"2024-09-12T00:16:01.062625+0000","last_became_peered":"2024-09-12T00:16:01.062625+0000","last_unstale":"2024-09-12T01:02:38.005904+0000","last_undegraded":"2024-09-12T01:02:38.005904+0000","last_fullsized":"2024-09-12T01:02:38.005904+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:42.064557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99308,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":891,"num_read_kb":2056,"num_write":776,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.169019+0000","last_change":"2024-09-12T00:16:03.088732+0000","last_active":"2024-09-12T00:58:33.169019+0000","last_peered":"2024-09-12T00:58:33.169019+0000","last_clean":"2024-09-12T00:58:33.169019+0000","last_became_active":"2024-09-12T00:16:03.087980+0000","last_became_peered":"2024-09-12T00:16:03.087980+0000","last_unstale":"2024-09-12T00:58:33.169019+0000","last_undegraded":"2024-09-12T00:58:33.169019+0000","last_fullsized":"2024-09-12T00:58:33.169019+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:06.045851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"268'129","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:43.109476+0000","last_change":"2024-09-12T00:16:05.099199+0000","last_active":"2024-09-12T01:00:43.109476+0000","last_peered":"2024-09-12T01:00:43.109476+0000","last_clean":"2024-09-12T01:00:43.109476+0000","last_became_active":"2024-09-12T00:16:05.098424+0000","last_became_peered":"2024-09-12T00:16:05.098424+0000","last_unstale":"2024-09-12T01:00:43.109476+0000","last_undegraded":"2024-09-12T01:00:43.109476+0000","last_fullsized":"2024-09-12T01:00:43.109476+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:24.228012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":165,"num_write":285,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"268'839","reported_seq":2428,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.158434+0000","last_change":"2024-09-12T00:15:57.023405+0000","last_active":"2024-09-12T01:01:02.158434+0000","last_peered":"2024-09-12T01:01:02.158434+0000","last_clean":"2024-09-12T01:01:02.158434+0000","last_became_active":"2024-09-12T00:15:57.022709+0000","last_became_peered":"2024-09-12T00:15:57.022709+0000","last_unstale":"2024-09-12T01:01:02.158434+0000","last_undegraded":"2024-09-12T01:01:02.158434+0000","last_fullsized":"2024-09-12T01:01:02.158434+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:43.347297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3967,"num_read_kb":3571,"num_write":1117,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"268'254","reported_seq":895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.954446+0000","last_change":"2024-09-12T00:15:55.065793+0000","last_active":"2024-09-12T01:02:37.954446+0000","last_peered":"2024-09-12T01:02:37.954446+0000","last_clean":"2024-09-12T01:02:37.954446+0000","last_became_active":"2024-09-12T00:15:55.064940+0000","last_became_peered":"2024-09-12T00:15:55.064940+0000","last_unstale":"2024-09-12T01:02:37.954446+0000","last_undegraded":"2024-09-12T01:02:37.954446+0000","last_fullsized":"2024-09-12T01:02:37.954446+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:58.611447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1910291,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":423,"num_read_kb":2788,"num_write":987,"num_write_kb":39220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.188274+0000","last_change":"2024-09-12T00:15:59.035109+0000","last_active":"2024-09-12T00:59:48.188274+0000","last_peered":"2024-09-12T00:59:48.188274+0000","last_clean":"2024-09-12T00:59:48.188274+0000","last_became_active":"2024-09-12T00:15:59.034648+0000","last_became_peered":"2024-09-12T00:15:59.034648+0000","last_unstale":"2024-09-12T00:59:48.188274+0000","last_undegraded":"2024-09-12T00:59:48.188274+0000","last_fullsized":"2024-09-12T00:59:48.188274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:33.763390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"268'277","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.973151+0000","last_change":"2024-09-12T00:16:01.048774+0000","last_active":"2024-09-12T01:02:11.973151+0000","last_peered":"2024-09-12T01:02:11.973151+0000","last_clean":"2024-09-12T01:02:11.973151+0000","last_became_active":"2024-09-12T00:16:01.046783+0000","last_became_peered":"2024-09-12T00:16:01.046783+0000","last_unstale":"2024-09-12T01:02:11.973151+0000","last_undegraded":"2024-09-12T01:02:11.973151+0000","last_fullsized":"2024-09-12T01:02:11.973151+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:16.650144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51471,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":467,"num_read_kb":911,"num_write":392,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:37.186492+0000","last_change":"2024-09-12T00:16:03.098371+0000","last_active":"2024-09-12T00:58:37.186492+0000","last_peered":"2024-09-12T00:58:37.186492+0000","last_clean":"2024-09-12T00:58:37.186492+0000","last_became_active":"2024-09-12T00:16:03.097160+0000","last_became_peered":"2024-09-12T00:16:03.097160+0000","last_unstale":"2024-09-12T00:58:37.186492+0000","last_undegraded":"2024-09-12T00:58:37.186492+0000","last_fullsized":"2024-09-12T00:58:37.186492+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:26.964444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"268'210","reported_seq":763,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:49.738687+0000","last_change":"2024-09-12T00:16:05.102618+0000","last_active":"2024-09-12T01:00:49.738687+0000","last_peered":"2024-09-12T01:00:49.738687+0000","last_clean":"2024-09-12T01:00:49.738687+0000","last_became_active":"2024-09-12T00:16:05.101338+0000","last_became_peered":"2024-09-12T00:16:05.101338+0000","last_unstale":"2024-09-12T01:00:49.738687+0000","last_undegraded":"2024-09-12T01:00:49.738687+0000","last_fullsized":"2024-09-12T01:00:49.738687+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:45.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1401,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":396,"num_read_kb":348,"num_write":595,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"268'504","reported_seq":2086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:53.114328+0000","last_change":"2024-09-12T00:15:57.035005+0000","last_active":"2024-09-12T01:00:53.114328+0000","last_peered":"2024-09-12T01:00:53.114328+0000","last_clean":"2024-09-12T01:00:53.114328+0000","last_became_active":"2024-09-12T00:15:57.034257+0000","last_became_peered":"2024-09-12T00:15:57.034257+0000","last_unstale":"2024-09-12T01:00:53.114328+0000","last_undegraded":"2024-09-12T01:00:53.114328+0000","last_fullsized":"2024-09-12T01:00:53.114328+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:16.698877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2760,"num_read_kb":2552,"num_write":653,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"268'308","reported_seq":1049,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.215872+0000","last_change":"2024-09-12T00:15:55.036424+0000","last_active":"2024-09-12T01:02:38.215872+0000","last_peered":"2024-09-12T01:02:38.215872+0000","last_clean":"2024-09-12T01:02:38.215872+0000","last_became_active":"2024-09-12T00:15:55.035741+0000","last_became_peered":"2024-09-12T00:15:55.035741+0000","last_unstale":"2024-09-12T01:02:38.215872+0000","last_undegraded":"2024-09-12T01:02:38.215872+0000","last_fullsized":"2024-09-12T01:02:38.215872+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:26.450236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5572564,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":642,"num_read_kb":41169,"num_write":1101,"num_write_kb":26675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.168968+0000","last_change":"2024-09-12T00:15:59.045330+0000","last_active":"2024-09-12T00:58:33.168968+0000","last_peered":"2024-09-12T00:58:33.168968+0000","last_clean":"2024-09-12T00:58:33.168968+0000","last_became_active":"2024-09-12T00:15:59.044761+0000","last_became_peered":"2024-09-12T00:15:59.044761+0000","last_unstale":"2024-09-12T00:58:33.168968+0000","last_undegraded":"2024-09-12T00:58:33.168968+0000","last_fullsized":"2024-09-12T00:58:33.168968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:47.536990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"268'292","reported_seq":872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.823176+0000","last_change":"2024-09-12T00:16:01.053808+0000","last_active":"2024-09-12T01:02:37.823176+0000","last_peered":"2024-09-12T01:02:37.823176+0000","last_clean":"2024-09-12T01:02:37.823176+0000","last_became_active":"2024-09-12T00:16:01.052731+0000","last_became_peered":"2024-09-12T00:16:01.052731+0000","last_unstale":"2024-09-12T01:02:37.823176+0000","last_undegraded":"2024-09-12T01:02:37.823176+0000","last_fullsized":"2024-09-12T01:02:37.823176+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:17.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50253,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":1058,"num_write":380,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:17.186579+0000","last_change":"2024-09-12T00:16:03.081577+0000","last_active":"2024-09-12T01:00:17.186579+0000","last_peered":"2024-09-12T01:00:17.186579+0000","last_clean":"2024-09-12T01:00:17.186579+0000","last_became_active":"2024-09-12T00:16:03.080825+0000","last_became_peered":"2024-09-12T00:16:03.080825+0000","last_unstale":"2024-09-12T01:00:17.186579+0000","last_undegraded":"2024-09-12T01:00:17.186579+0000","last_fullsized":"2024-09-12T01:00:17.186579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:06.840301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"268'153","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.041059+0000","last_change":"2024-09-12T00:16:05.098923+0000","last_active":"2024-09-12T01:02:12.041059+0000","last_peered":"2024-09-12T01:02:12.041059+0000","last_clean":"2024-09-12T01:02:12.041059+0000","last_became_active":"2024-09-12T00:16:05.098180+0000","last_became_peered":"2024-09-12T00:16:05.098180+0000","last_unstale":"2024-09-12T01:02:12.041059+0000","last_undegraded":"2024-09-12T01:02:12.041059+0000","last_fullsized":"2024-09-12T01:02:12.041059+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:05.523259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":95,"num_write":348,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"268'338","reported_seq":1661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.583002+0000","last_change":"2024-09-12T00:15:57.040279+0000","last_active":"2024-09-12T01:01:09.583002+0000","last_peered":"2024-09-12T01:01:09.583002+0000","last_clean":"2024-09-12T01:01:09.583002+0000","last_became_active":"2024-09-12T00:15:57.039580+0000","last_became_peered":"2024-09-12T00:15:57.039580+0000","last_unstale":"2024-09-12T01:01:09.583002+0000","last_undegraded":"2024-09-12T01:01:09.583002+0000","last_fullsized":"2024-09-12T01:01:09.583002+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:54.699867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1750,"num_read_kb":1664,"num_write":383,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"268'289","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.774346+0000","last_change":"2024-09-12T00:15:55.044496+0000","last_active":"2024-09-12T01:02:37.774346+0000","last_peered":"2024-09-12T01:02:37.774346+0000","last_clean":"2024-09-12T01:02:37.774346+0000","last_became_active":"2024-09-12T00:15:55.042851+0000","last_became_peered":"2024-09-12T00:15:55.042851+0000","last_unstale":"2024-09-12T01:02:37.774346+0000","last_undegraded":"2024-09-12T01:02:37.774346+0000","last_fullsized":"2024-09-12T01:02:37.774346+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:43.191900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12455127,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":366,"num_read_kb":20803,"num_write":1060,"num_write_kb":57854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.163967+0000","last_change":"2024-09-12T00:15:59.049421+0000","last_active":"2024-09-12T00:58:33.163967+0000","last_peered":"2024-09-12T00:58:33.163967+0000","last_clean":"2024-09-12T00:58:33.163967+0000","last_became_active":"2024-09-12T00:15:59.048632+0000","last_became_peered":"2024-09-12T00:15:59.048632+0000","last_unstale":"2024-09-12T00:58:33.163967+0000","last_undegraded":"2024-09-12T00:58:33.163967+0000","last_fullsized":"2024-09-12T00:58:33.163967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:08.230944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"268'84","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:14.230651+0000","last_change":"2024-09-12T00:16:01.046254+0000","last_active":"2024-09-12T01:00:14.230651+0000","last_peered":"2024-09-12T01:00:14.230651+0000","last_clean":"2024-09-12T01:00:14.230651+0000","last_became_active":"2024-09-12T00:16:01.045565+0000","last_became_peered":"2024-09-12T00:16:01.045565+0000","last_unstale":"2024-09-12T01:00:14.230651+0000","last_undegraded":"2024-09-12T01:00:14.230651+0000","last_fullsized":"2024-09-12T01:00:14.230651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:51.429929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":132,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"268'784","reported_seq":4428,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.124964+0000","last_change":"2024-09-12T00:16:03.092271+0000","last_active":"2024-09-12T01:02:37.124964+0000","last_peered":"2024-09-12T01:02:37.124964+0000","last_clean":"2024-09-12T01:02:37.124964+0000","last_became_active":"2024-09-12T00:16:03.091506+0000","last_became_peered":"2024-09-12T00:16:03.091506+0000","last_unstale":"2024-09-12T01:02:37.124964+0000","last_undegraded":"2024-09-12T01:02:37.124964+0000","last_fullsized":"2024-09-12T01:02:37.124964+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:30.561330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"268'114","reported_seq":621,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.234041+0000","last_change":"2024-09-12T00:16:05.102360+0000","last_active":"2024-09-12T01:00:29.234041+0000","last_peered":"2024-09-12T01:00:29.234041+0000","last_clean":"2024-09-12T01:00:29.234041+0000","last_became_active":"2024-09-12T00:16:05.101500+0000","last_became_peered":"2024-09-12T00:16:05.101500+0000","last_unstale":"2024-09-12T01:00:29.234041+0000","last_undegraded":"2024-09-12T01:00:29.234041+0000","last_fullsized":"2024-09-12T01:00:29.234041+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.731815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"268'1099","reported_seq":2633,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:58.206504+0000","last_change":"2024-09-12T00:15:57.056750+0000","last_active":"2024-09-12T01:00:58.206504+0000","last_peered":"2024-09-12T01:00:58.206504+0000","last_clean":"2024-09-12T01:00:58.206504+0000","last_became_active":"2024-09-12T00:15:57.056507+0000","last_became_peered":"2024-09-12T00:15:57.056507+0000","last_unstale":"2024-09-12T01:00:58.206504+0000","last_undegraded":"2024-09-12T01:00:58.206504+0000","last_fullsized":"2024-09-12T01:00:58.206504+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":1000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:40.456581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5000,"num_read_kb":4445,"num_write":1493,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"268'324","reported_seq":1179,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.087479+0000","last_change":"2024-09-12T00:15:55.051781+0000","last_active":"2024-09-12T01:02:38.087479+0000","last_peered":"2024-09-12T01:02:38.087479+0000","last_clean":"2024-09-12T01:02:38.087479+0000","last_became_active":"2024-09-12T00:15:55.051336+0000","last_became_peered":"2024-09-12T00:15:55.051336+0000","last_unstale":"2024-09-12T01:02:38.087479+0000","last_undegraded":"2024-09-12T01:02:38.087479+0000","last_fullsized":"2024-09-12T01:02:38.087479+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:16.141015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5744009,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":976,"num_read_kb":8590,"num_write":1248,"num_write_kb":12738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.169997+0000","last_change":"2024-09-12T00:15:59.047376+0000","last_active":"2024-09-12T00:58:33.169997+0000","last_peered":"2024-09-12T00:58:33.169997+0000","last_clean":"2024-09-12T00:58:33.169997+0000","last_became_active":"2024-09-12T00:15:59.046538+0000","last_became_peered":"2024-09-12T00:15:59.046538+0000","last_unstale":"2024-09-12T00:58:33.169997+0000","last_undegraded":"2024-09-12T00:58:33.169997+0000","last_fullsized":"2024-09-12T00:58:33.169997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:18.952950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"268'322","reported_seq":924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.948102+0000","last_change":"2024-09-12T00:16:01.052369+0000","last_active":"2024-09-12T01:02:11.948102+0000","last_peered":"2024-09-12T01:02:11.948102+0000","last_clean":"2024-09-12T01:02:11.948102+0000","last_became_active":"2024-09-12T00:16:01.051648+0000","last_became_peered":"2024-09-12T00:16:01.051648+0000","last_unstale":"2024-09-12T01:02:11.948102+0000","last_undegraded":"2024-09-12T01:02:11.948102+0000","last_fullsized":"2024-09-12T01:02:11.948102+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:31.858718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57323,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":525,"num_read_kb":1023,"num_write":426,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179642+0000","last_change":"2024-09-12T00:16:03.086923+0000","last_active":"2024-09-12T00:59:33.179642+0000","last_peered":"2024-09-12T00:59:33.179642+0000","last_clean":"2024-09-12T00:59:33.179642+0000","last_became_active":"2024-09-12T00:16:03.086333+0000","last_became_peered":"2024-09-12T00:16:03.086333+0000","last_unstale":"2024-09-12T00:59:33.179642+0000","last_undegraded":"2024-09-12T00:59:33.179642+0000","last_fullsized":"2024-09-12T00:59:33.179642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:22.916351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"268'125","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:04.626052+0000","last_change":"2024-09-12T00:16:05.108248+0000","last_active":"2024-09-12T01:01:04.626052+0000","last_peered":"2024-09-12T01:01:04.626052+0000","last_clean":"2024-09-12T01:01:04.626052+0000","last_became_active":"2024-09-12T00:16:05.107284+0000","last_became_peered":"2024-09-12T00:16:05.107284+0000","last_unstale":"2024-09-12T01:01:04.626052+0000","last_undegraded":"2024-09-12T01:01:04.626052+0000","last_fullsized":"2024-09-12T01:01:04.626052+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:25.922474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":114,"num_write":286,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"268'488","reported_seq":2114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.993123+0000","last_change":"2024-09-12T00:15:57.022317+0000","last_active":"2024-09-12T01:00:29.993123+0000","last_peered":"2024-09-12T01:00:29.993123+0000","last_clean":"2024-09-12T01:00:29.993123+0000","last_became_active":"2024-09-12T00:15:57.021526+0000","last_became_peered":"2024-09-12T00:15:57.021526+0000","last_unstale":"2024-09-12T01:00:29.993123+0000","last_undegraded":"2024-09-12T01:00:29.993123+0000","last_fullsized":"2024-09-12T01:00:29.993123+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:49.730181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2702,"num_read_kb":2545,"num_write":554,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"268'327","reported_seq":1007,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.728298+0000","last_change":"2024-09-12T00:15:55.053021+0000","last_active":"2024-09-12T01:02:38.728298+0000","last_peered":"2024-09-12T01:02:38.728298+0000","last_clean":"2024-09-12T01:02:38.728298+0000","last_became_active":"2024-09-12T00:15:55.052503+0000","last_became_peered":"2024-09-12T00:15:55.052503+0000","last_unstale":"2024-09-12T01:02:38.728298+0000","last_undegraded":"2024-09-12T01:02:38.728298+0000","last_fullsized":"2024-09-12T01:02:38.728298+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:07.348592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5440553,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":540,"num_read_kb":52646,"num_write":1012,"num_write_kb":43222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.168868+0000","last_change":"2024-09-12T00:15:59.027111+0000","last_active":"2024-09-12T00:58:33.168868+0000","last_peered":"2024-09-12T00:58:33.168868+0000","last_clean":"2024-09-12T00:58:33.168868+0000","last_became_active":"2024-09-12T00:15:59.024564+0000","last_became_peered":"2024-09-12T00:15:59.024564+0000","last_unstale":"2024-09-12T00:58:33.168868+0000","last_undegraded":"2024-09-12T00:58:33.168868+0000","last_fullsized":"2024-09-12T00:58:33.168868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:49.354490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"268'244","reported_seq":819,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.950866+0000","last_change":"2024-09-12T00:16:01.055584+0000","last_active":"2024-09-12T01:02:11.950866+0000","last_peered":"2024-09-12T01:02:11.950866+0000","last_clean":"2024-09-12T01:02:11.950866+0000","last_became_active":"2024-09-12T00:16:01.051612+0000","last_became_peered":"2024-09-12T00:16:01.051612+0000","last_unstale":"2024-09-12T01:02:11.950866+0000","last_undegraded":"2024-09-12T01:02:11.950866+0000","last_fullsized":"2024-09-12T01:02:11.950866+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:47.313727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49092,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":405,"num_read_kb":839,"num_write":328,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:44.223108+0000","last_change":"2024-09-12T00:16:03.095905+0000","last_active":"2024-09-12T00:59:44.223108+0000","last_peered":"2024-09-12T00:59:44.223108+0000","last_clean":"2024-09-12T00:59:44.223108+0000","last_became_active":"2024-09-12T00:16:03.095016+0000","last_became_peered":"2024-09-12T00:16:03.095016+0000","last_unstale":"2024-09-12T00:59:44.223108+0000","last_undegraded":"2024-09-12T00:59:44.223108+0000","last_fullsized":"2024-09-12T00:59:44.223108+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:35.761981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"268'135","reported_seq":666,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.014067+0000","last_change":"2024-09-12T00:16:05.099520+0000","last_active":"2024-09-12T01:02:02.014067+0000","last_peered":"2024-09-12T01:02:02.014067+0000","last_clean":"2024-09-12T01:02:02.014067+0000","last_became_active":"2024-09-12T00:16:05.098796+0000","last_became_peered":"2024-09-12T00:16:05.098796+0000","last_unstale":"2024-09-12T01:02:02.014067+0000","last_undegraded":"2024-09-12T01:02:02.014067+0000","last_fullsized":"2024-09-12T01:02:02.014067+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:27.979474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":225,"num_write":347,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"268'416","reported_seq":1961,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.872184+0000","last_change":"2024-09-12T00:15:57.038940+0000","last_active":"2024-09-12T01:02:10.872184+0000","last_peered":"2024-09-12T01:02:10.872184+0000","last_clean":"2024-09-12T01:02:10.872184+0000","last_became_active":"2024-09-12T00:15:57.038127+0000","last_became_peered":"2024-09-12T00:15:57.038127+0000","last_unstale":"2024-09-12T01:02:10.872184+0000","last_undegraded":"2024-09-12T01:02:10.872184+0000","last_fullsized":"2024-09-12T01:02:10.872184+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:35.287613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2293,"num_read_kb":2185,"num_write":483,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"268'263","reported_seq":894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:42.506681+0000","last_change":"2024-09-12T00:15:55.076108+0000","last_active":"2024-09-12T01:00:42.506681+0000","last_peered":"2024-09-12T01:00:42.506681+0000","last_clean":"2024-09-12T01:00:42.506681+0000","last_became_active":"2024-09-12T00:15:55.074964+0000","last_became_peered":"2024-09-12T00:15:55.074964+0000","last_unstale":"2024-09-12T01:00:42.506681+0000","last_undegraded":"2024-09-12T01:00:42.506681+0000","last_fullsized":"2024-09-12T01:00:42.506681+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:29.685119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6899581,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":434,"num_read_kb":20127,"num_write":942,"num_write_kb":20535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.184985+0000","last_change":"2024-09-12T00:15:59.036962+0000","last_active":"2024-09-12T00:59:33.184985+0000","last_peered":"2024-09-12T00:59:33.184985+0000","last_clean":"2024-09-12T00:59:33.184985+0000","last_became_active":"2024-09-12T00:15:59.036492+0000","last_became_peered":"2024-09-12T00:15:59.036492+0000","last_unstale":"2024-09-12T00:59:33.184985+0000","last_undegraded":"2024-09-12T00:59:33.184985+0000","last_fullsized":"2024-09-12T00:59:33.184985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:26.416316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"268'247","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.671289+0000","last_change":"2024-09-12T00:16:01.053033+0000","last_active":"2024-09-12T01:02:37.671289+0000","last_peered":"2024-09-12T01:02:37.671289+0000","last_clean":"2024-09-12T01:02:37.671289+0000","last_became_active":"2024-09-12T00:16:01.050746+0000","last_became_peered":"2024-09-12T00:16:01.050746+0000","last_unstale":"2024-09-12T01:02:37.671289+0000","last_undegraded":"2024-09-12T01:02:37.671289+0000","last_fullsized":"2024-09-12T01:02:37.671289+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:56.194861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":412,"num_read_kb":978,"num_write":338,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:34.203198+0000","last_change":"2024-09-12T00:16:03.100996+0000","last_active":"2024-09-12T00:58:34.203198+0000","last_peered":"2024-09-12T00:58:34.203198+0000","last_clean":"2024-09-12T00:58:34.203198+0000","last_became_active":"2024-09-12T00:16:03.099890+0000","last_became_peered":"2024-09-12T00:16:03.099890+0000","last_unstale":"2024-09-12T00:58:34.203198+0000","last_undegraded":"2024-09-12T00:58:34.203198+0000","last_fullsized":"2024-09-12T00:58:34.203198+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:53.876340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"268'186","reported_seq":1673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.781143+0000","last_change":"2024-09-12T00:16:05.113925+0000","last_active":"2024-09-12T01:02:10.781143+0000","last_peered":"2024-09-12T01:02:10.781143+0000","last_clean":"2024-09-12T01:02:10.781143+0000","last_became_active":"2024-09-12T00:16:05.113207+0000","last_became_peered":"2024-09-12T00:16:05.113207+0000","last_unstale":"2024-09-12T01:02:10.781143+0000","last_undegraded":"2024-09-12T01:02:10.781143+0000","last_fullsized":"2024-09-12T01:02:10.781143+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:18.252728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1270,"num_read_kb":1246,"num_write":444,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"268'923","reported_seq":2663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506178+0000","last_change":"2024-09-12T00:15:57.013390+0000","last_active":"2024-09-12T01:01:09.506178+0000","last_peered":"2024-09-12T01:01:09.506178+0000","last_clean":"2024-09-12T01:01:09.506178+0000","last_became_active":"2024-09-12T00:15:57.012136+0000","last_became_peered":"2024-09-12T00:15:57.012136+0000","last_unstale":"2024-09-12T01:01:09.506178+0000","last_undegraded":"2024-09-12T01:01:09.506178+0000","last_fullsized":"2024-09-12T01:01:09.506178+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:10.566262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4477,"num_read_kb":4059,"num_write":1259,"num_write_kb":498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"268'301","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.003380+0000","last_change":"2024-09-12T00:15:55.079920+0000","last_active":"2024-09-12T01:02:10.003380+0000","last_peered":"2024-09-12T01:02:10.003380+0000","last_clean":"2024-09-12T01:02:10.003380+0000","last_became_active":"2024-09-12T00:15:55.079005+0000","last_became_peered":"2024-09-12T00:15:55.079005+0000","last_unstale":"2024-09-12T01:02:10.003380+0000","last_undegraded":"2024-09-12T01:02:10.003380+0000","last_fullsized":"2024-09-12T01:02:10.003380+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:58.600991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":888192,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":473,"num_read_kb":476,"num_write":1113,"num_write_kb":40462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:43.182050+0000","last_change":"2024-09-12T00:15:59.040566+0000","last_active":"2024-09-12T00:59:43.182050+0000","last_peered":"2024-09-12T00:59:43.182050+0000","last_clean":"2024-09-12T00:59:43.182050+0000","last_became_active":"2024-09-12T00:15:59.039674+0000","last_became_peered":"2024-09-12T00:15:59.039674+0000","last_unstale":"2024-09-12T00:59:43.182050+0000","last_undegraded":"2024-09-12T00:59:43.182050+0000","last_fullsized":"2024-09-12T00:59:43.182050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:23.557637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"268'344","reported_seq":946,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.914549+0000","last_change":"2024-09-12T00:16:01.052058+0000","last_active":"2024-09-12T01:02:37.914549+0000","last_peered":"2024-09-12T01:02:37.914549+0000","last_clean":"2024-09-12T01:02:37.914549+0000","last_became_active":"2024-09-12T00:16:01.051324+0000","last_became_peered":"2024-09-12T00:16:01.051324+0000","last_unstale":"2024-09-12T01:02:37.914549+0000","last_undegraded":"2024-09-12T01:02:37.914549+0000","last_fullsized":"2024-09-12T01:02:37.914549+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:07.219892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49632,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":580,"num_read_kb":1323,"num_write":476,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.163885+0000","last_change":"2024-09-12T00:16:03.100444+0000","last_active":"2024-09-12T00:58:33.163885+0000","last_peered":"2024-09-12T00:58:33.163885+0000","last_clean":"2024-09-12T00:58:33.163885+0000","last_became_active":"2024-09-12T00:16:03.099836+0000","last_became_peered":"2024-09-12T00:16:03.099836+0000","last_unstale":"2024-09-12T00:58:33.163885+0000","last_undegraded":"2024-09-12T00:58:33.163885+0000","last_fullsized":"2024-09-12T00:58:33.163885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:28.442530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"268'111","reported_seq":603,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.864539+0000","last_change":"2024-09-12T00:16:05.113973+0000","last_active":"2024-09-12T01:02:10.864539+0000","last_peered":"2024-09-12T01:02:10.864539+0000","last_clean":"2024-09-12T01:02:10.864539+0000","last_became_active":"2024-09-12T00:16:05.113231+0000","last_became_peered":"2024-09-12T00:16:05.113231+0000","last_unstale":"2024-09-12T01:02:10.864539+0000","last_undegraded":"2024-09-12T01:02:10.864539+0000","last_fullsized":"2024-09-12T01:02:10.864539+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:31.200737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":663,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":263,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"268'811","reported_seq":2398,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.231281+0000","last_change":"2024-09-12T00:15:57.031887+0000","last_active":"2024-09-12T01:01:07.231281+0000","last_peered":"2024-09-12T01:01:07.231281+0000","last_clean":"2024-09-12T01:01:07.231281+0000","last_became_active":"2024-09-12T00:15:57.031161+0000","last_became_peered":"2024-09-12T00:15:57.031161+0000","last_unstale":"2024-09-12T01:01:07.231281+0000","last_undegraded":"2024-09-12T01:01:07.231281+0000","last_fullsized":"2024-09-12T01:01:07.231281+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:00.259897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3882,"num_read_kb":3503,"num_write":1069,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"268'314","reported_seq":1080,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.117439+0000","last_change":"2024-09-12T00:15:55.042845+0000","last_active":"2024-09-12T01:02:38.117439+0000","last_peered":"2024-09-12T01:02:38.117439+0000","last_clean":"2024-09-12T01:02:38.117439+0000","last_became_active":"2024-09-12T00:15:55.042134+0000","last_became_peered":"2024-09-12T00:15:55.042134+0000","last_unstale":"2024-09-12T01:02:38.117439+0000","last_undegraded":"2024-09-12T01:02:38.117439+0000","last_fullsized":"2024-09-12T01:02:38.117439+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:24.618191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918416,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":825,"num_read_kb":50816,"num_write":1207,"num_write_kb":44406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'401","reported_seq":1855,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.867542+0000","last_change":"2024-09-12T00:15:57.043703+0000","last_active":"2024-09-12T01:02:10.867542+0000","last_peered":"2024-09-12T01:02:10.867542+0000","last_clean":"2024-09-12T01:02:10.867542+0000","last_became_active":"2024-09-12T00:15:57.043013+0000","last_became_peered":"2024-09-12T00:15:57.043013+0000","last_unstale":"2024-09-12T01:02:10.867542+0000","last_undegraded":"2024-09-12T01:02:10.867542+0000","last_fullsized":"2024-09-12T01:02:10.867542+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:02.318087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2106,"num_read_kb":1998,"num_write":459,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"268'237","reported_seq":864,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:03.258647+0000","last_change":"2024-09-12T00:15:55.063527+0000","last_active":"2024-09-12T01:01:03.258647+0000","last_peered":"2024-09-12T01:01:03.258647+0000","last_clean":"2024-09-12T01:01:03.258647+0000","last_became_active":"2024-09-12T00:15:55.062524+0000","last_became_peered":"2024-09-12T00:15:55.062524+0000","last_unstale":"2024-09-12T01:01:03.258647+0000","last_undegraded":"2024-09-12T01:01:03.258647+0000","last_fullsized":"2024-09-12T01:01:03.258647+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:23.930911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11786426,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":384,"num_read_kb":18226,"num_write":828,"num_write_kb":43043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"268'494","reported_seq":2210,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.226294+0000","last_change":"2024-09-12T00:15:57.029585+0000","last_active":"2024-09-12T01:01:07.226294+0000","last_peered":"2024-09-12T01:01:07.226294+0000","last_clean":"2024-09-12T01:01:07.226294+0000","last_became_active":"2024-09-12T00:15:57.018875+0000","last_became_peered":"2024-09-12T00:15:57.018875+0000","last_unstale":"2024-09-12T01:01:07.226294+0000","last_undegraded":"2024-09-12T01:01:07.226294+0000","last_fullsized":"2024-09-12T01:01:07.226294+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:10.062996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2775,"num_read_kb":2615,"num_write":593,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"268'335","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.974069+0000","last_change":"2024-09-12T00:15:55.064178+0000","last_active":"2024-09-12T01:02:38.974069+0000","last_peered":"2024-09-12T01:02:38.974069+0000","last_clean":"2024-09-12T01:02:38.974069+0000","last_became_active":"2024-09-12T00:15:55.063603+0000","last_became_peered":"2024-09-12T00:15:55.063603+0000","last_unstale":"2024-09-12T01:02:38.974069+0000","last_undegraded":"2024-09-12T01:02:38.974069+0000","last_fullsized":"2024-09-12T01:02:38.974069+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:29.018846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2056490,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":493,"num_read_kb":3291,"num_write":1111,"num_write_kb":12783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"268'390","reported_seq":1797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.016017+0000","last_change":"2024-09-12T00:15:57.031124+0000","last_active":"2024-09-12T01:00:47.016017+0000","last_peered":"2024-09-12T01:00:47.016017+0000","last_clean":"2024-09-12T01:00:47.016017+0000","last_became_active":"2024-09-12T00:15:57.030173+0000","last_became_peered":"2024-09-12T00:15:57.030173+0000","last_unstale":"2024-09-12T01:00:47.016017+0000","last_undegraded":"2024-09-12T01:00:47.016017+0000","last_fullsized":"2024-09-12T01:00:47.016017+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:54.011519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2013,"num_read_kb":1910,"num_write":436,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"268'308","reported_seq":1051,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:45.334227+0000","last_change":"2024-09-12T00:15:55.069041+0000","last_active":"2024-09-12T01:00:45.334227+0000","last_peered":"2024-09-12T01:00:45.334227+0000","last_clean":"2024-09-12T01:00:45.334227+0000","last_became_active":"2024-09-12T00:15:55.068349+0000","last_became_peered":"2024-09-12T00:15:55.068349+0000","last_unstale":"2024-09-12T01:00:45.334227+0000","last_undegraded":"2024-09-12T01:00:45.334227+0000","last_fullsized":"2024-09-12T01:00:45.334227+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:58.205254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13937614,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":785,"num_read_kb":11363,"num_write":1143,"num_write_kb":51000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"268'398","reported_seq":1882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.583028+0000","last_change":"2024-09-12T00:15:57.037970+0000","last_active":"2024-09-12T01:01:09.583028+0000","last_peered":"2024-09-12T01:01:09.583028+0000","last_clean":"2024-09-12T01:01:09.583028+0000","last_became_active":"2024-09-12T00:15:57.037204+0000","last_became_peered":"2024-09-12T00:15:57.037204+0000","last_unstale":"2024-09-12T01:01:09.583028+0000","last_undegraded":"2024-09-12T01:01:09.583028+0000","last_fullsized":"2024-09-12T01:01:09.583028+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:46.963139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2120,"num_read_kb":2017,"num_write":453,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"268'306","reported_seq":941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.178400+0000","last_change":"2024-09-12T00:15:55.072723+0000","last_active":"2024-09-12T01:02:38.178400+0000","last_peered":"2024-09-12T01:02:38.178400+0000","last_clean":"2024-09-12T01:02:38.178400+0000","last_became_active":"2024-09-12T00:15:55.071812+0000","last_became_peered":"2024-09-12T00:15:55.071812+0000","last_unstale":"2024-09-12T01:02:38.178400+0000","last_undegraded":"2024-09-12T01:02:38.178400+0000","last_fullsized":"2024-09-12T01:02:38.178400+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:47.837252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6136414,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":471,"num_read_kb":11485,"num_write":1102,"num_write_kb":34407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"268'581","reported_seq":2263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.158878+0000","last_change":"2024-09-12T00:15:57.033145+0000","last_active":"2024-09-12T01:01:02.158878+0000","last_peered":"2024-09-12T01:01:02.158878+0000","last_clean":"2024-09-12T01:01:02.158878+0000","last_became_active":"2024-09-12T00:15:57.032818+0000","last_became_peered":"2024-09-12T00:15:57.032818+0000","last_unstale":"2024-09-12T01:01:02.158878+0000","last_undegraded":"2024-09-12T01:01:02.158878+0000","last_fullsized":"2024-09-12T01:01:02.158878+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:32.583489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2922,"num_read_kb":2722,"num_write":707,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"268'297","reported_seq":973,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.117965+0000","last_change":"2024-09-12T00:15:55.052766+0000","last_active":"2024-09-12T01:02:38.117965+0000","last_peered":"2024-09-12T01:02:38.117965+0000","last_clean":"2024-09-12T01:02:38.117965+0000","last_became_active":"2024-09-12T00:15:55.050781+0000","last_became_peered":"2024-09-12T00:15:55.050781+0000","last_unstale":"2024-09-12T01:02:38.117965+0000","last_undegraded":"2024-09-12T01:02:38.117965+0000","last_fullsized":"2024-09-12T01:02:38.117965+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:34.653614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12378352,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":446,"num_read_kb":31943,"num_write":1024,"num_write_kb":41212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"268'801","reported_seq":2287,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.226718+0000","last_change":"2024-09-12T00:15:57.046222+0000","last_active":"2024-09-12T01:01:07.226718+0000","last_peered":"2024-09-12T01:01:07.226718+0000","last_clean":"2024-09-12T01:01:07.226718+0000","last_became_active":"2024-09-12T00:15:57.045500+0000","last_became_peered":"2024-09-12T00:15:57.045500+0000","last_unstale":"2024-09-12T01:01:07.226718+0000","last_undegraded":"2024-09-12T01:01:07.226718+0000","last_fullsized":"2024-09-12T01:01:07.226718+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:02.396896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3817,"num_read_kb":3427,"num_write":1098,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"268'267","reported_seq":889,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.190114+0000","last_change":"2024-09-12T00:15:55.055440+0000","last_active":"2024-09-12T01:02:38.190114+0000","last_peered":"2024-09-12T01:02:38.190114+0000","last_clean":"2024-09-12T01:02:38.190114+0000","last_became_active":"2024-09-12T00:15:55.054914+0000","last_became_peered":"2024-09-12T00:15:55.054914+0000","last_unstale":"2024-09-12T01:02:38.190114+0000","last_undegraded":"2024-09-12T01:02:38.190114+0000","last_fullsized":"2024-09-12T01:02:38.190114+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:21.527461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10801766,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":375,"num_read_kb":50632,"num_write":920,"num_write_kb":37363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"268'817","reported_seq":2510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:25.613084+0000","last_change":"2024-09-12T00:15:57.022003+0000","last_active":"2024-09-12T01:00:25.613084+0000","last_peered":"2024-09-12T01:00:25.613084+0000","last_clean":"2024-09-12T01:00:25.613084+0000","last_became_active":"2024-09-12T00:15:57.021622+0000","last_became_peered":"2024-09-12T00:15:57.021622+0000","last_unstale":"2024-09-12T01:00:25.613084+0000","last_undegraded":"2024-09-12T01:00:25.613084+0000","last_fullsized":"2024-09-12T01:00:25.613084+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.960528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4035,"num_read_kb":3684,"num_write":1067,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"268'289","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.489901+0000","last_change":"2024-09-12T00:15:55.068680+0000","last_active":"2024-09-12T01:00:47.489901+0000","last_peered":"2024-09-12T01:00:47.489901+0000","last_clean":"2024-09-12T01:00:47.489901+0000","last_became_active":"2024-09-12T00:15:55.055929+0000","last_became_peered":"2024-09-12T00:15:55.055929+0000","last_unstale":"2024-09-12T01:00:47.489901+0000","last_undegraded":"2024-09-12T01:00:47.489901+0000","last_fullsized":"2024-09-12T01:00:47.489901+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:15.633734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62773,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":490,"num_read_kb":583,"num_write":1145,"num_write_kb":30899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"268'837","reported_seq":2503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.883860+0000","last_change":"2024-09-12T00:15:57.040650+0000","last_active":"2024-09-12T01:02:10.883860+0000","last_peered":"2024-09-12T01:02:10.883860+0000","last_clean":"2024-09-12T01:02:10.883860+0000","last_became_active":"2024-09-12T00:15:57.039946+0000","last_became_peered":"2024-09-12T00:15:57.039946+0000","last_unstale":"2024-09-12T01:02:10.883860+0000","last_undegraded":"2024-09-12T01:02:10.883860+0000","last_fullsized":"2024-09-12T01:02:10.883860+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:12.893023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4272,"num_read_kb":3874,"num_write":1144,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"268'395","reported_seq":1124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.718354+0000","last_change":"2024-09-12T00:15:55.065969+0000","last_active":"2024-09-12T01:02:38.718354+0000","last_peered":"2024-09-12T01:02:38.718354+0000","last_clean":"2024-09-12T01:02:38.718354+0000","last_became_active":"2024-09-12T00:15:55.065129+0000","last_became_peered":"2024-09-12T00:15:55.065129+0000","last_unstale":"2024-09-12T01:02:38.718354+0000","last_undegraded":"2024-09-12T01:02:38.718354+0000","last_fullsized":"2024-09-12T01:02:38.718354+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:11.829722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236434,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":755,"num_read_kb":24147,"num_write":1296,"num_write_kb":32019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"268'876","reported_seq":2654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.883373+0000","last_change":"2024-09-12T00:15:57.052278+0000","last_active":"2024-09-12T01:02:10.883373+0000","last_peered":"2024-09-12T01:02:10.883373+0000","last_clean":"2024-09-12T01:02:10.883373+0000","last_became_active":"2024-09-12T00:15:57.051976+0000","last_became_peered":"2024-09-12T00:15:57.051976+0000","last_unstale":"2024-09-12T01:02:10.883373+0000","last_undegraded":"2024-09-12T01:02:10.883373+0000","last_fullsized":"2024-09-12T01:02:10.883373+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":800,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:02.396896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4749,"num_read_kb":4328,"num_write":1184,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"268'281","reported_seq":909,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.756472+0000","last_change":"2024-09-12T00:15:55.060643+0000","last_active":"2024-09-12T01:02:01.756472+0000","last_peered":"2024-09-12T01:02:01.756472+0000","last_clean":"2024-09-12T01:02:01.756472+0000","last_became_active":"2024-09-12T00:15:55.055449+0000","last_became_peered":"2024-09-12T00:15:55.055449+0000","last_unstale":"2024-09-12T01:02:01.756472+0000","last_undegraded":"2024-09-12T01:02:01.756472+0000","last_fullsized":"2024-09-12T01:02:01.756472+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:27.185874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73940,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":425,"num_read_kb":2263,"num_write":1020,"num_write_kb":24139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"268'787","reported_seq":2366,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.160044+0000","last_change":"2024-09-12T00:15:57.033089+0000","last_active":"2024-09-12T01:01:02.160044+0000","last_peered":"2024-09-12T01:01:02.160044+0000","last_clean":"2024-09-12T01:01:02.160044+0000","last_became_active":"2024-09-12T00:15:57.031976+0000","last_became_peered":"2024-09-12T00:15:57.031976+0000","last_unstale":"2024-09-12T01:01:02.160044+0000","last_undegraded":"2024-09-12T01:01:02.160044+0000","last_fullsized":"2024-09-12T01:01:02.160044+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:30.528175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3862,"num_read_kb":3503,"num_write":1033,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"268'321","reported_seq":971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.206389+0000","last_change":"2024-09-12T00:15:55.052989+0000","last_active":"2024-09-12T01:02:38.206389+0000","last_peered":"2024-09-12T01:02:38.206389+0000","last_clean":"2024-09-12T01:02:38.206389+0000","last_became_active":"2024-09-12T00:15:55.051451+0000","last_became_peered":"2024-09-12T00:15:55.051451+0000","last_unstale":"2024-09-12T01:02:38.206389+0000","last_undegraded":"2024-09-12T01:02:38.206389+0000","last_fullsized":"2024-09-12T01:02:38.206389+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:14.616053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10751670,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":514,"num_read_kb":17814,"num_write":1142,"num_write_kb":26945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"268'483","reported_seq":2159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:58.205844+0000","last_change":"2024-09-12T00:15:57.020535+0000","last_active":"2024-09-12T01:00:58.205844+0000","last_peered":"2024-09-12T01:00:58.205844+0000","last_clean":"2024-09-12T01:00:58.205844+0000","last_became_active":"2024-09-12T00:15:57.019963+0000","last_became_peered":"2024-09-12T00:15:57.019963+0000","last_unstale":"2024-09-12T01:00:58.205844+0000","last_undegraded":"2024-09-12T01:00:58.205844+0000","last_fullsized":"2024-09-12T01:00:58.205844+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:34.340309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2585,"num_read_kb":2455,"num_write":555,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"268'254","reported_seq":878,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.955956+0000","last_change":"2024-09-12T00:15:55.051310+0000","last_active":"2024-09-12T01:02:37.955956+0000","last_peered":"2024-09-12T01:02:37.955956+0000","last_clean":"2024-09-12T01:02:37.955956+0000","last_became_active":"2024-09-12T00:15:55.050267+0000","last_became_peered":"2024-09-12T00:15:55.050267+0000","last_unstale":"2024-09-12T01:02:37.955956+0000","last_undegraded":"2024-09-12T01:02:37.955956+0000","last_fullsized":"2024-09-12T01:02:37.955956+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:25.710871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2136315,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":396,"num_read_kb":8617,"num_write":983,"num_write_kb":22964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1339","reported_seq":3149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.016786+0000","last_change":"2024-09-12T00:15:57.045427+0000","last_active":"2024-09-12T01:00:47.016786+0000","last_peered":"2024-09-12T01:00:47.016786+0000","last_clean":"2024-09-12T01:00:47.016786+0000","last_became_active":"2024-09-12T00:15:57.045076+0000","last_became_peered":"2024-09-12T00:15:57.045076+0000","last_unstale":"2024-09-12T01:00:47.016786+0000","last_undegraded":"2024-09-12T01:00:47.016786+0000","last_fullsized":"2024-09-12T01:00:47.016786+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:48.293590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6209,"num_read_kb":5540,"num_write":1861,"num_write_kb":794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"268'287","reported_seq":925,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.983855+0000","last_change":"2024-09-12T00:15:55.065995+0000","last_active":"2024-09-12T01:02:37.983855+0000","last_peered":"2024-09-12T01:02:37.983855+0000","last_clean":"2024-09-12T01:02:37.983855+0000","last_became_active":"2024-09-12T00:15:55.061287+0000","last_became_peered":"2024-09-12T00:15:55.061287+0000","last_unstale":"2024-09-12T01:02:37.983855+0000","last_undegraded":"2024-09-12T01:02:37.983855+0000","last_fullsized":"2024-09-12T01:02:37.983855+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:58.543361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":479,"num_read_kb":733,"num_write":1182,"num_write_kb":3677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"268'404","reported_seq":1771,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:51.103353+0000","last_change":"2024-09-12T00:15:57.043968+0000","last_active":"2024-09-12T01:00:51.103353+0000","last_peered":"2024-09-12T01:00:51.103353+0000","last_clean":"2024-09-12T01:00:51.103353+0000","last_became_active":"2024-09-12T00:15:57.043158+0000","last_became_peered":"2024-09-12T00:15:57.043158+0000","last_unstale":"2024-09-12T01:00:51.103353+0000","last_undegraded":"2024-09-12T01:00:51.103353+0000","last_fullsized":"2024-09-12T01:00:51.103353+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:06.171447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1978,"num_read_kb":1859,"num_write":462,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"268'365","reported_seq":1051,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.627974+0000","last_change":"2024-09-12T00:15:55.059249+0000","last_active":"2024-09-12T01:02:38.627974+0000","last_peered":"2024-09-12T01:02:38.627974+0000","last_clean":"2024-09-12T01:02:38.627974+0000","last_became_active":"2024-09-12T00:15:55.058726+0000","last_became_peered":"2024-09-12T00:15:55.058726+0000","last_unstale":"2024-09-12T01:02:38.627974+0000","last_undegraded":"2024-09-12T01:02:38.627974+0000","last_fullsized":"2024-09-12T01:02:38.627974+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:59.008674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587009,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":582,"num_read_kb":57120,"num_write":1282,"num_write_kb":58223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"268'1341","reported_seq":2827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:53.114495+0000","last_change":"2024-09-12T00:15:57.045207+0000","last_active":"2024-09-12T01:00:53.114495+0000","last_peered":"2024-09-12T01:00:53.114495+0000","last_clean":"2024-09-12T01:00:53.114495+0000","last_became_active":"2024-09-12T00:15:57.043227+0000","last_became_peered":"2024-09-12T00:15:57.043227+0000","last_unstale":"2024-09-12T01:00:53.114495+0000","last_undegraded":"2024-09-12T01:00:53.114495+0000","last_fullsized":"2024-09-12T01:00:53.114495+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:40.677355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5913,"num_read_kb":5121,"num_write":1910,"num_write_kb":821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"268'231","reported_seq":873,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:03.267756+0000","last_change":"2024-09-12T00:15:55.053474+0000","last_active":"2024-09-12T01:01:03.267756+0000","last_peered":"2024-09-12T01:01:03.267756+0000","last_clean":"2024-09-12T01:01:03.267756+0000","last_became_active":"2024-09-12T00:15:55.052287+0000","last_became_peered":"2024-09-12T00:15:55.052287+0000","last_unstale":"2024-09-12T01:01:03.267756+0000","last_undegraded":"2024-09-12T01:01:03.267756+0000","last_fullsized":"2024-09-12T01:01:03.267756+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:48.478932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13281004,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":413,"num_read_kb":19752,"num_write":853,"num_write_kb":40992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"268'335","reported_seq":1745,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.870604+0000","last_change":"2024-09-12T00:15:57.039951+0000","last_active":"2024-09-12T01:02:10.870604+0000","last_peered":"2024-09-12T01:02:10.870604+0000","last_clean":"2024-09-12T01:02:10.870604+0000","last_became_active":"2024-09-12T00:15:57.039633+0000","last_became_peered":"2024-09-12T00:15:57.039633+0000","last_unstale":"2024-09-12T01:02:10.870604+0000","last_undegraded":"2024-09-12T01:02:10.870604+0000","last_fullsized":"2024-09-12T01:02:10.870604+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:29.316323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1924,"num_read_kb":1842,"num_write":397,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"268'298","reported_seq":980,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.728341+0000","last_change":"2024-09-12T00:15:55.055642+0000","last_active":"2024-09-12T01:02:38.728341+0000","last_peered":"2024-09-12T01:02:38.728341+0000","last_clean":"2024-09-12T01:02:38.728341+0000","last_became_active":"2024-09-12T00:15:55.054952+0000","last_became_peered":"2024-09-12T00:15:55.054952+0000","last_unstale":"2024-09-12T01:02:38.728341+0000","last_undegraded":"2024-09-12T01:02:38.728341+0000","last_fullsized":"2024-09-12T01:02:38.728341+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:10.159478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11646207,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":466,"num_read_kb":117939,"num_write":925,"num_write_kb":46136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"268'363","reported_seq":1021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.485230+0000","last_change":"2024-09-12T00:15:55.053129+0000","last_active":"2024-09-12T01:02:38.485230+0000","last_peered":"2024-09-12T01:02:38.485230+0000","last_clean":"2024-09-12T01:02:38.485230+0000","last_became_active":"2024-09-12T00:15:55.052320+0000","last_became_peered":"2024-09-12T00:15:55.052320+0000","last_unstale":"2024-09-12T01:02:38.485230+0000","last_undegraded":"2024-09-12T01:02:38.485230+0000","last_fullsized":"2024-09-12T01:02:38.485230+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:04.001879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13659026,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":544,"num_read_kb":13864,"num_write":1319,"num_write_kb":55041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"268'475","reported_seq":2091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.171239+0000","last_change":"2024-09-12T00:15:57.055663+0000","last_active":"2024-09-12T01:00:52.171239+0000","last_peered":"2024-09-12T01:00:52.171239+0000","last_clean":"2024-09-12T01:00:52.171239+0000","last_became_active":"2024-09-12T00:15:57.054996+0000","last_became_peered":"2024-09-12T00:15:57.054996+0000","last_unstale":"2024-09-12T01:00:52.171239+0000","last_undegraded":"2024-09-12T01:00:52.171239+0000","last_fullsized":"2024-09-12T01:00:52.171239+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:56.476228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2784,"num_read_kb":2618,"num_write":619,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"268'260","reported_seq":879,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:17.211534+0000","last_change":"2024-09-12T00:15:55.079679+0000","last_active":"2024-09-12T01:00:17.211534+0000","last_peered":"2024-09-12T01:00:17.211534+0000","last_clean":"2024-09-12T01:00:17.211534+0000","last_became_active":"2024-09-12T00:15:55.078832+0000","last_became_peered":"2024-09-12T00:15:55.078832+0000","last_unstale":"2024-09-12T01:00:17.211534+0000","last_undegraded":"2024-09-12T01:00:17.211534+0000","last_fullsized":"2024-09-12T01:00:17.211534+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:54.215633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12399463,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":360,"num_read_kb":33206,"num_write":922,"num_write_kb":34373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"268'950","reported_seq":2368,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:53.114798+0000","last_change":"2024-09-12T00:15:57.027951+0000","last_active":"2024-09-12T01:00:53.114798+0000","last_peered":"2024-09-12T01:00:53.114798+0000","last_clean":"2024-09-12T01:00:53.114798+0000","last_became_active":"2024-09-12T00:15:57.027565+0000","last_became_peered":"2024-09-12T00:15:57.027565+0000","last_unstale":"2024-09-12T01:00:53.114798+0000","last_undegraded":"2024-09-12T01:00:53.114798+0000","last_fullsized":"2024-09-12T01:00:53.114798+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":900,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:55.130874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4238,"num_read_kb":3802,"num_write":1335,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6185,"num_read_kb":4382,"num_write":1972,"num_write_kb":869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1043,"ondisk_log_size":1043,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15033,"num_read_kb":14688,"num_write":16727,"num_write_kb":4883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1560,"ondisk_log_size":1560,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":781,"ondisk_log_size":781,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1728236,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":17413,"num_read_kb":34185,"num_write":14663,"num_write_kb":11510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":1941585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1806,"ondisk_log_size":1806,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2876,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212032,"num_read_kb":193923,"num_write":55063,"num_write_kb":18681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4050,"ondisk_log_size":4050,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":409390098,"num_objects":3171,"num_object_clones":0,"num_object_copies":12684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3171,"num_whiteouts":0,"num_read":33213,"num_read_kb":1967309,"num_write":68729,"num_write_kb":2158407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":596008960,"data_stored":596008960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3804,"ondisk_log_size":3804,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":59857393,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":126,"num_read_kb":197046,"num_write":143,"num_write_kb":127402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":118673408,"data_stored":118669420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":48323057,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":123,"num_read_kb":185778,"num_write":145,"num_write_kb":127402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95604736,"data_stored":95600748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719477304,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305208,"kb_used_data":79552,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94066632,"statfs":{"total":96636764160,"available":96324231168,"internally_reserved":0,"allocated":81461248,"data_stored":79415482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":230947271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510011,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":215396,"kb_used_data":107856,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94156444,"statfs":{"total":96636764160,"available":96416198656,"internally_reserved":0,"allocated":110444544,"data_stored":108404854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110098886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510009,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":387688,"kb_used_data":149720,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":93984152,"statfs":{"total":96636764160,"available":96239771648,"internally_reserved":0,"allocated":153313280,"data_stored":151263128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243661253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510011,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":277812,"kb_used_data":156388,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94094028,"statfs":{"total":96636764160,"available":96352284672,"internally_reserved":0,"allocated":160141312,"data_stored":158119567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124320197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510010,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397512,"kb_used_data":73260,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":93974328,"statfs":{"total":96636764160,"available":96229711872,"internally_reserved":0,"allocated":75018240,"data_stored":72946735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":331872709},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510009,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":234068,"kb_used_data":130644,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94137772,"statfs":{"total":96636764160,"available":96397078528,"internally_reserved":0,"allocated":133779456,"data_stored":131707105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542715,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":358024,"kb_used_data":120056,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":94013816,"statfs":{"total":96636764160,"available":96270147584,"internally_reserved":0,"allocated":122937344,"data_stored":120910860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243661258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542713,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":374740,"kb_used_data":122820,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93997100,"statfs":{"total":96636764160,"available":96253030400,"internally_reserved":0,"allocated":125767680,"data_stored":123715390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":91365376,"data_stored":91365376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":55009280,"data_stored":55009280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90898432,"data_stored":90898432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53452800,"data_stored":53452800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77246464,"data_stored":77246464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":66994176,"data_stored":66994176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":71073792,"data_stored":71073792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":89968640,"data_stored":89968640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":372736,"data_stored":304932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":340798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":80982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":78962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":321461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":399210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":130036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":348160,"data_stored":285204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8391818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12623057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15777056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17915904,"data_stored":17914353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5291296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6332416,"data_stored":6331601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6340608,"data_stored":6339872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10526720,"data_stored":10525905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39845888,"data_stored":39845888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10489856,"data_stored":10488970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:02:41.715 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:02:41.715 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:02:42.091 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:02:42.103 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-12T01:02:42.111 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":1675,"stamp":"2024-09-12T01:02:40.813567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":519906609,"num_objects":3693,"num_object_clones":0,"num_object_copies":13728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3693,"num_whiteouts":0,"num_read":286616,"num_read_kb":2600254,"num_write":157585,"num_write_kb":2450810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13305,"ondisk_log_size":13305,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2550448,"kb_used_data":940296,"kb_used_omap":12,"kb_used_meta":1609715,"kb_avail":752424272,"statfs":{"total":773094113280,"available":770482454528,"internally_reserved":0,"allocated":962863104,"data_stored":946483121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1648348720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-202258165,"num_objects":-1242,"num_object_clones":0,"num_object_copies":-4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1242,"num_whiteouts":0,"num_read":1413,"num_read_kb":1383,"num_write":1330,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008912"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.173833+0000","last_change":"2024-09-12T00:43:48.284274+0000","last_active":"2024-09-12T00:58:48.173833+0000","last_peered":"2024-09-12T00:58:48.173833+0000","last_clean":"2024-09-12T00:58:48.173833+0000","last_became_active":"2024-09-12T00:43:48.282777+0000","last_became_peered":"2024-09-12T00:43:48.282777+0000","last_unstale":"2024-09-12T00:58:48.173833+0000","last_undegraded":"2024-09-12T00:58:48.173833+0000","last_fullsized":"2024-09-12T00:58:48.173833+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:26.885566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"268'1","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.190566+0000","last_change":"2024-09-12T00:32:28.070403+0000","last_active":"2024-09-12T00:59:58.190566+0000","last_peered":"2024-09-12T00:59:58.190566+0000","last_clean":"2024-09-12T00:59:58.190566+0000","last_became_active":"2024-09-12T00:32:28.069841+0000","last_became_peered":"2024-09-12T00:32:28.069841+0000","last_unstale":"2024-09-12T00:59:58.190566+0000","last_undegraded":"2024-09-12T00:59:58.190566+0000","last_fullsized":"2024-09-12T00:59:58.190566+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:32.102006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.181946+0000","last_change":"2024-09-12T00:32:25.027280+0000","last_active":"2024-09-12T00:59:57.181946+0000","last_peered":"2024-09-12T00:59:57.181946+0000","last_clean":"2024-09-12T00:59:57.181946+0000","last_became_active":"2024-09-12T00:32:25.026726+0000","last_became_peered":"2024-09-12T00:32:25.026726+0000","last_unstale":"2024-09-12T00:59:57.181946+0000","last_undegraded":"2024-09-12T00:59:57.181946+0000","last_fullsized":"2024-09-12T00:59:57.181946+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:47.659267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"268'31","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.187370+0000","last_change":"2024-09-12T00:30:51.544593+0000","last_active":"2024-09-12T01:00:03.187370+0000","last_peered":"2024-09-12T01:00:03.187370+0000","last_clean":"2024-09-12T01:00:03.187370+0000","last_became_active":"2024-09-12T00:30:51.543858+0000","last_became_peered":"2024-09-12T00:30:51.543858+0000","last_unstale":"2024-09-12T01:00:03.187370+0000","last_undegraded":"2024-09-12T01:00:03.187370+0000","last_fullsized":"2024-09-12T01:00:03.187370+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:38.568158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":120,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.161958+0000","last_change":"2024-09-12T00:43:48.286931+0000","last_active":"2024-09-12T00:58:48.161958+0000","last_peered":"2024-09-12T00:58:48.161958+0000","last_clean":"2024-09-12T00:58:48.161958+0000","last_became_active":"2024-09-12T00:43:48.286291+0000","last_became_peered":"2024-09-12T00:43:48.286291+0000","last_unstale":"2024-09-12T00:58:48.161958+0000","last_undegraded":"2024-09-12T00:58:48.161958+0000","last_fullsized":"2024-09-12T00:58:48.161958+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:17.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.190647+0000","last_change":"2024-09-12T00:32:28.070732+0000","last_active":"2024-09-12T00:59:58.190647+0000","last_peered":"2024-09-12T00:59:58.190647+0000","last_clean":"2024-09-12T00:59:58.190647+0000","last_became_active":"2024-09-12T00:32:28.070091+0000","last_became_peered":"2024-09-12T00:32:28.070091+0000","last_unstale":"2024-09-12T00:59:58.190647+0000","last_undegraded":"2024-09-12T00:59:58.190647+0000","last_fullsized":"2024-09-12T00:59:58.190647+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:33.762789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.206709+0000","last_change":"2024-09-12T00:32:25.024486+0000","last_active":"2024-09-12T00:59:57.206709+0000","last_peered":"2024-09-12T00:59:57.206709+0000","last_clean":"2024-09-12T00:59:57.206709+0000","last_became_active":"2024-09-12T00:32:25.023750+0000","last_became_peered":"2024-09-12T00:32:25.023750+0000","last_unstale":"2024-09-12T00:59:57.206709+0000","last_undegraded":"2024-09-12T00:59:57.206709+0000","last_fullsized":"2024-09-12T00:59:57.206709+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:12.053492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"268'20","reported_seq":97,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.273682+0000","last_change":"2024-09-12T00:30:51.555569+0000","last_active":"2024-09-12T01:00:03.273682+0000","last_peered":"2024-09-12T01:00:03.273682+0000","last_clean":"2024-09-12T01:00:03.273682+0000","last_became_active":"2024-09-12T00:30:51.554875+0000","last_became_peered":"2024-09-12T00:30:51.554875+0000","last_unstale":"2024-09-12T01:00:03.273682+0000","last_undegraded":"2024-09-12T01:00:03.273682+0000","last_fullsized":"2024-09-12T01:00:03.273682+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:03.959589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":61,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:18.166602+0000","last_change":"2024-09-12T00:43:48.271637+0000","last_active":"2024-09-12T00:58:18.166602+0000","last_peered":"2024-09-12T00:58:18.166602+0000","last_clean":"2024-09-12T00:58:18.166602+0000","last_became_active":"2024-09-12T00:43:48.270700+0000","last_became_peered":"2024-09-12T00:43:48.270700+0000","last_unstale":"2024-09-12T00:58:18.166602+0000","last_undegraded":"2024-09-12T00:58:18.166602+0000","last_fullsized":"2024-09-12T00:58:18.166602+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:41.349025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"268'2","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.201826+0000","last_change":"2024-09-12T00:32:28.078229+0000","last_active":"2024-09-12T00:59:37.201826+0000","last_peered":"2024-09-12T00:59:37.201826+0000","last_clean":"2024-09-12T00:59:37.201826+0000","last_became_active":"2024-09-12T00:32:28.065497+0000","last_became_peered":"2024-09-12T00:32:28.065497+0000","last_unstale":"2024-09-12T00:59:37.201826+0000","last_undegraded":"2024-09-12T00:59:37.201826+0000","last_fullsized":"2024-09-12T00:59:37.201826+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:04.479825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"268'3","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:37.191813+0000","last_change":"2024-09-12T00:32:25.002095+0000","last_active":"2024-09-12T01:00:37.191813+0000","last_peered":"2024-09-12T01:00:37.191813+0000","last_clean":"2024-09-12T01:00:37.191813+0000","last_became_active":"2024-09-12T00:32:25.001290+0000","last_became_peered":"2024-09-12T00:32:25.001290+0000","last_unstale":"2024-09-12T01:00:37.191813+0000","last_undegraded":"2024-09-12T01:00:37.191813+0000","last_fullsized":"2024-09-12T01:00:37.191813+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:20.950634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1088721,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2088,"num_write":8,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"268'25","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:02.981579+0000","last_change":"2024-09-12T00:30:51.546159+0000","last_active":"2024-09-12T01:00:02.981579+0000","last_peered":"2024-09-12T01:00:02.981579+0000","last_clean":"2024-09-12T01:00:02.981579+0000","last_became_active":"2024-09-12T00:30:51.544751+0000","last_became_peered":"2024-09-12T00:30:51.544751+0000","last_unstale":"2024-09-12T01:00:02.981579+0000","last_undegraded":"2024-09-12T01:00:02.981579+0000","last_fullsized":"2024-09-12T01:00:02.981579+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:47.192663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":82,"num_write":61,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:27.183725+0000","last_change":"2024-09-12T00:43:48.280902+0000","last_active":"2024-09-12T00:58:27.183725+0000","last_peered":"2024-09-12T00:58:27.183725+0000","last_clean":"2024-09-12T00:58:27.183725+0000","last_became_active":"2024-09-12T00:43:48.280166+0000","last_became_peered":"2024-09-12T00:43:48.280166+0000","last_unstale":"2024-09-12T00:58:27.183725+0000","last_undegraded":"2024-09-12T00:58:27.183725+0000","last_fullsized":"2024-09-12T00:58:27.183725+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:30.937177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:37.186576+0000","last_change":"2024-09-12T00:32:28.078675+0000","last_active":"2024-09-12T00:58:37.186576+0000","last_peered":"2024-09-12T00:58:37.186576+0000","last_clean":"2024-09-12T00:58:37.186576+0000","last_became_active":"2024-09-12T00:32:28.073988+0000","last_became_peered":"2024-09-12T00:32:28.073988+0000","last_unstale":"2024-09-12T00:58:37.186576+0000","last_undegraded":"2024-09-12T00:58:37.186576+0000","last_fullsized":"2024-09-12T00:58:37.186576+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:09.276835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185184+0000","last_change":"2024-09-12T00:32:25.008128+0000","last_active":"2024-09-12T00:59:33.185184+0000","last_peered":"2024-09-12T00:59:33.185184+0000","last_clean":"2024-09-12T00:59:33.185184+0000","last_became_active":"2024-09-12T00:32:25.007732+0000","last_became_peered":"2024-09-12T00:32:25.007732+0000","last_unstale":"2024-09-12T00:59:33.185184+0000","last_undegraded":"2024-09-12T00:59:33.185184+0000","last_fullsized":"2024-09-12T00:59:33.185184+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:28.829369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"268'61","reported_seq":203,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.690930+0000","last_change":"2024-09-12T00:30:51.552185+0000","last_active":"2024-09-12T00:59:57.690930+0000","last_peered":"2024-09-12T00:59:57.690930+0000","last_clean":"2024-09-12T00:59:57.690930+0000","last_became_active":"2024-09-12T00:30:51.551417+0000","last_became_peered":"2024-09-12T00:30:51.551417+0000","last_unstale":"2024-09-12T00:59:57.690930+0000","last_undegraded":"2024-09-12T00:59:57.690930+0000","last_fullsized":"2024-09-12T00:59:57.690930+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:45.506758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":214,"num_write":108,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.182039+0000","last_change":"2024-09-12T00:43:48.284245+0000","last_active":"2024-09-12T00:59:57.182039+0000","last_peered":"2024-09-12T00:59:57.182039+0000","last_clean":"2024-09-12T00:59:57.182039+0000","last_became_active":"2024-09-12T00:43:48.283357+0000","last_became_peered":"2024-09-12T00:43:48.283357+0000","last_unstale":"2024-09-12T00:59:57.182039+0000","last_undegraded":"2024-09-12T00:59:57.182039+0000","last_fullsized":"2024-09-12T00:59:57.182039+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.113641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"268'5","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:38.003769+0000","last_change":"2024-09-12T00:32:28.054309+0000","last_active":"2024-09-12T01:01:38.003769+0000","last_peered":"2024-09-12T01:01:38.003769+0000","last_clean":"2024-09-12T01:01:38.003769+0000","last_became_active":"2024-09-12T00:32:28.053541+0000","last_became_peered":"2024-09-12T00:32:28.053541+0000","last_unstale":"2024-09-12T01:01:38.003769+0000","last_undegraded":"2024-09-12T01:01:38.003769+0000","last_fullsized":"2024-09-12T01:01:38.003769+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.456715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"268'2","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.192266+0000","last_change":"2024-09-12T00:32:25.015629+0000","last_active":"2024-09-12T00:59:02.192266+0000","last_peered":"2024-09-12T00:59:02.192266+0000","last_clean":"2024-09-12T00:59:02.192266+0000","last_became_active":"2024-09-12T00:32:25.014665+0000","last_became_peered":"2024-09-12T00:32:25.014665+0000","last_unstale":"2024-09-12T00:59:02.192266+0000","last_undegraded":"2024-09-12T00:59:02.192266+0000","last_fullsized":"2024-09-12T00:59:02.192266+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:46.651960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"268'40","reported_seq":154,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:23.156361+0000","last_change":"2024-09-12T00:30:51.549303+0000","last_active":"2024-09-12T00:58:23.156361+0000","last_peered":"2024-09-12T00:58:23.156361+0000","last_clean":"2024-09-12T00:58:23.156361+0000","last_became_active":"2024-09-12T00:30:51.547784+0000","last_became_peered":"2024-09-12T00:30:51.547784+0000","last_unstale":"2024-09-12T00:58:23.156361+0000","last_undegraded":"2024-09-12T00:58:23.156361+0000","last_fullsized":"2024-09-12T00:58:23.156361+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:29.971436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":150,"num_write":68,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.192933+0000","last_change":"2024-09-12T00:43:48.278102+0000","last_active":"2024-09-12T01:00:28.192933+0000","last_peered":"2024-09-12T01:00:28.192933+0000","last_clean":"2024-09-12T01:00:28.192933+0000","last_became_active":"2024-09-12T00:43:48.276078+0000","last_became_peered":"2024-09-12T00:43:48.276078+0000","last_unstale":"2024-09-12T01:00:28.192933+0000","last_undegraded":"2024-09-12T01:00:28.192933+0000","last_fullsized":"2024-09-12T01:00:28.192933+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:21.420479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"268'5","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.600193+0000","last_change":"2024-09-12T00:32:28.031279+0000","last_active":"2024-09-12T01:02:37.600193+0000","last_peered":"2024-09-12T01:02:37.600193+0000","last_clean":"2024-09-12T01:02:37.600193+0000","last_became_active":"2024-09-12T00:32:28.030520+0000","last_became_peered":"2024-09-12T00:32:28.030520+0000","last_unstale":"2024-09-12T01:02:37.600193+0000","last_undegraded":"2024-09-12T01:02:37.600193+0000","last_fullsized":"2024-09-12T01:02:37.600193+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:22.614081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"268'3","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:34.014371+0000","last_change":"2024-09-12T00:32:25.010515+0000","last_active":"2024-09-12T01:01:34.014371+0000","last_peered":"2024-09-12T01:01:34.014371+0000","last_clean":"2024-09-12T01:01:34.014371+0000","last_became_active":"2024-09-12T00:32:25.009898+0000","last_became_peered":"2024-09-12T00:32:25.009898+0000","last_unstale":"2024-09-12T01:01:34.014371+0000","last_undegraded":"2024-09-12T01:01:34.014371+0000","last_fullsized":"2024-09-12T01:01:34.014371+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:26.343687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"268'22","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:23.166566+0000","last_change":"2024-09-12T00:30:51.560284+0000","last_active":"2024-09-12T00:58:23.166566+0000","last_peered":"2024-09-12T00:58:23.166566+0000","last_clean":"2024-09-12T00:58:23.166566+0000","last_became_active":"2024-09-12T00:30:51.559544+0000","last_became_peered":"2024-09-12T00:30:51.559544+0000","last_unstale":"2024-09-12T00:58:23.166566+0000","last_undegraded":"2024-09-12T00:58:23.166566+0000","last_fullsized":"2024-09-12T00:58:23.166566+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:21.732816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":79,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.173552+0000","last_change":"2024-09-12T00:43:48.283455+0000","last_active":"2024-09-12T00:58:48.173552+0000","last_peered":"2024-09-12T00:58:48.173552+0000","last_clean":"2024-09-12T00:58:48.173552+0000","last_became_active":"2024-09-12T00:43:48.283057+0000","last_became_peered":"2024-09-12T00:43:48.283057+0000","last_unstale":"2024-09-12T00:58:48.173552+0000","last_undegraded":"2024-09-12T00:58:48.173552+0000","last_fullsized":"2024-09-12T00:58:48.173552+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:33.410879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.190602+0000","last_change":"2024-09-12T00:32:28.066260+0000","last_active":"2024-09-12T00:59:58.190602+0000","last_peered":"2024-09-12T00:59:58.190602+0000","last_clean":"2024-09-12T00:59:58.190602+0000","last_became_active":"2024-09-12T00:32:28.065376+0000","last_became_peered":"2024-09-12T00:32:28.065376+0000","last_unstale":"2024-09-12T00:59:58.190602+0000","last_undegraded":"2024-09-12T00:59:58.190602+0000","last_fullsized":"2024-09-12T00:59:58.190602+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:37.216971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"268'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.191528+0000","last_change":"2024-09-12T00:32:25.000290+0000","last_active":"2024-09-12T00:59:58.191528+0000","last_peered":"2024-09-12T00:59:58.191528+0000","last_clean":"2024-09-12T00:59:58.191528+0000","last_became_active":"2024-09-12T00:32:24.999604+0000","last_became_peered":"2024-09-12T00:32:24.999604+0000","last_unstale":"2024-09-12T00:59:58.191528+0000","last_undegraded":"2024-09-12T00:59:58.191528+0000","last_fullsized":"2024-09-12T00:59:58.191528+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:52.889640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"268'41","reported_seq":153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:04.255372+0000","last_change":"2024-09-12T00:30:51.557465+0000","last_active":"2024-09-12T01:00:04.255372+0000","last_peered":"2024-09-12T01:00:04.255372+0000","last_clean":"2024-09-12T01:00:04.255372+0000","last_became_active":"2024-09-12T00:30:51.556729+0000","last_became_peered":"2024-09-12T00:30:51.556729+0000","last_unstale":"2024-09-12T01:00:04.255372+0000","last_undegraded":"2024-09-12T01:00:04.255372+0000","last_fullsized":"2024-09-12T01:00:04.255372+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:59.334180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":144,"num_write":69,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.174016+0000","last_change":"2024-09-12T00:43:48.282559+0000","last_active":"2024-09-12T00:58:48.174016+0000","last_peered":"2024-09-12T00:58:48.174016+0000","last_clean":"2024-09-12T00:58:48.174016+0000","last_became_active":"2024-09-12T00:43:48.281781+0000","last_became_peered":"2024-09-12T00:43:48.281781+0000","last_unstale":"2024-09-12T00:58:48.174016+0000","last_undegraded":"2024-09-12T00:58:48.174016+0000","last_fullsized":"2024-09-12T00:58:48.174016+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:09.023666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"268'3","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.181867+0000","last_change":"2024-09-12T00:32:28.063332+0000","last_active":"2024-09-12T00:59:57.181867+0000","last_peered":"2024-09-12T00:59:57.181867+0000","last_clean":"2024-09-12T00:59:57.181867+0000","last_became_active":"2024-09-12T00:32:28.062540+0000","last_became_peered":"2024-09-12T00:32:28.062540+0000","last_unstale":"2024-09-12T00:59:57.181867+0000","last_undegraded":"2024-09-12T00:59:57.181867+0000","last_fullsized":"2024-09-12T00:59:57.181867+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:19.133641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.179111+0000","last_change":"2024-09-12T00:32:25.021694+0000","last_active":"2024-09-12T00:59:58.179111+0000","last_peered":"2024-09-12T00:59:58.179111+0000","last_clean":"2024-09-12T00:59:58.179111+0000","last_became_active":"2024-09-12T00:32:25.017715+0000","last_became_peered":"2024-09-12T00:32:25.017715+0000","last_unstale":"2024-09-12T00:59:58.179111+0000","last_undegraded":"2024-09-12T00:59:58.179111+0000","last_fullsized":"2024-09-12T00:59:58.179111+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:02.525100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'8","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:53.178004+0000","last_change":"2024-09-12T00:30:51.547647+0000","last_active":"2024-09-12T00:59:53.178004+0000","last_peered":"2024-09-12T00:59:53.178004+0000","last_clean":"2024-09-12T00:59:53.178004+0000","last_became_active":"2024-09-12T00:30:51.546981+0000","last_became_peered":"2024-09-12T00:30:51.546981+0000","last_unstale":"2024-09-12T00:59:53.178004+0000","last_undegraded":"2024-09-12T00:59:53.178004+0000","last_fullsized":"2024-09-12T00:59:53.178004+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:52.873539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.210443+0000","last_change":"2024-09-12T00:43:48.273242+0000","last_active":"2024-09-12T01:00:12.210443+0000","last_peered":"2024-09-12T01:00:12.210443+0000","last_clean":"2024-09-12T01:00:12.210443+0000","last_became_active":"2024-09-12T00:43:48.272523+0000","last_became_peered":"2024-09-12T00:43:48.272523+0000","last_unstale":"2024-09-12T01:00:12.210443+0000","last_undegraded":"2024-09-12T01:00:12.210443+0000","last_fullsized":"2024-09-12T01:00:12.210443+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:58.897794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"268'8","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168024+0000","last_change":"2024-09-12T00:32:28.069369+0000","last_active":"2024-09-12T00:59:02.168024+0000","last_peered":"2024-09-12T00:59:02.168024+0000","last_clean":"2024-09-12T00:59:02.168024+0000","last_became_active":"2024-09-12T00:32:28.062839+0000","last_became_peered":"2024-09-12T00:32:28.062839+0000","last_unstale":"2024-09-12T00:59:02.168024+0000","last_undegraded":"2024-09-12T00:59:02.168024+0000","last_fullsized":"2024-09-12T00:59:02.168024+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:52.354103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":13,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"268'3","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.234269+0000","last_change":"2024-09-12T00:32:25.005903+0000","last_active":"2024-09-12T01:00:29.234269+0000","last_peered":"2024-09-12T01:00:29.234269+0000","last_clean":"2024-09-12T01:00:29.234269+0000","last_became_active":"2024-09-12T00:32:25.005113+0000","last_became_peered":"2024-09-12T00:32:25.005113+0000","last_unstale":"2024-09-12T01:00:29.234269+0000","last_undegraded":"2024-09-12T01:00:29.234269+0000","last_fullsized":"2024-09-12T01:00:29.234269+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:34.390961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3076,"num_write":3,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'62","reported_seq":220,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:53.184530+0000","last_change":"2024-09-12T00:30:51.542763+0000","last_active":"2024-09-12T00:59:53.184530+0000","last_peered":"2024-09-12T00:59:53.184530+0000","last_clean":"2024-09-12T00:59:53.184530+0000","last_became_active":"2024-09-12T00:30:51.541882+0000","last_became_peered":"2024-09-12T00:30:51.541882+0000","last_unstale":"2024-09-12T00:59:53.184530+0000","last_undegraded":"2024-09-12T00:59:53.184530+0000","last_fullsized":"2024-09-12T00:59:53.184530+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.614120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":254,"num_write":98,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.181831+0000","last_change":"2024-09-12T00:43:48.278782+0000","last_active":"2024-09-12T01:00:08.181831+0000","last_peered":"2024-09-12T01:00:08.181831+0000","last_clean":"2024-09-12T01:00:08.181831+0000","last_became_active":"2024-09-12T00:43:48.277883+0000","last_became_peered":"2024-09-12T00:43:48.277883+0000","last_unstale":"2024-09-12T01:00:08.181831+0000","last_undegraded":"2024-09-12T01:00:08.181831+0000","last_fullsized":"2024-09-12T01:00:08.181831+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:35.841252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'5","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:17.180442+0000","last_change":"2024-09-12T00:32:28.052092+0000","last_active":"2024-09-12T00:58:17.180442+0000","last_peered":"2024-09-12T00:58:17.180442+0000","last_clean":"2024-09-12T00:58:17.180442+0000","last_became_active":"2024-09-12T00:32:28.051364+0000","last_became_peered":"2024-09-12T00:32:28.051364+0000","last_unstale":"2024-09-12T00:58:17.180442+0000","last_undegraded":"2024-09-12T00:58:17.180442+0000","last_fullsized":"2024-09-12T00:58:17.180442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:30.719026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5136,"num_write":10,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"268'1","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.178275+0000","last_change":"2024-09-12T00:32:25.009850+0000","last_active":"2024-09-12T00:59:03.178275+0000","last_peered":"2024-09-12T00:59:03.178275+0000","last_clean":"2024-09-12T00:59:03.178275+0000","last_became_active":"2024-09-12T00:32:25.009125+0000","last_became_peered":"2024-09-12T00:32:25.009125+0000","last_unstale":"2024-09-12T00:59:03.178275+0000","last_undegraded":"2024-09-12T00:59:03.178275+0000","last_fullsized":"2024-09-12T00:59:03.178275+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:33.665936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"268'31","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:53.184482+0000","last_change":"2024-09-12T00:30:51.555036+0000","last_active":"2024-09-12T00:59:53.184482+0000","last_peered":"2024-09-12T00:59:53.184482+0000","last_clean":"2024-09-12T00:59:53.184482+0000","last_became_active":"2024-09-12T00:30:51.553919+0000","last_became_peered":"2024-09-12T00:30:51.553919+0000","last_unstale":"2024-09-12T00:59:53.184482+0000","last_undegraded":"2024-09-12T00:59:53.184482+0000","last_fullsized":"2024-09-12T00:59:53.184482+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:07.977904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":104,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.195129+0000","last_change":"2024-09-12T00:43:48.289134+0000","last_active":"2024-09-12T01:00:08.195129+0000","last_peered":"2024-09-12T01:00:08.195129+0000","last_clean":"2024-09-12T01:00:08.195129+0000","last_became_active":"2024-09-12T00:43:48.288517+0000","last_became_peered":"2024-09-12T00:43:48.288517+0000","last_unstale":"2024-09-12T01:00:08.195129+0000","last_undegraded":"2024-09-12T01:00:08.195129+0000","last_fullsized":"2024-09-12T01:00:08.195129+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:05.171146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168160+0000","last_change":"2024-09-12T00:32:28.060574+0000","last_active":"2024-09-12T00:59:02.168160+0000","last_peered":"2024-09-12T00:59:02.168160+0000","last_clean":"2024-09-12T00:59:02.168160+0000","last_became_active":"2024-09-12T00:32:28.059869+0000","last_became_peered":"2024-09-12T00:32:28.059869+0000","last_unstale":"2024-09-12T00:59:02.168160+0000","last_undegraded":"2024-09-12T00:59:02.168160+0000","last_fullsized":"2024-09-12T00:59:02.168160+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:24.600878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168108+0000","last_change":"2024-09-12T00:32:25.027341+0000","last_active":"2024-09-12T00:59:02.168108+0000","last_peered":"2024-09-12T00:59:02.168108+0000","last_clean":"2024-09-12T00:59:02.168108+0000","last_became_active":"2024-09-12T00:32:25.026751+0000","last_became_peered":"2024-09-12T00:32:25.026751+0000","last_unstale":"2024-09-12T00:59:02.168108+0000","last_undegraded":"2024-09-12T00:59:02.168108+0000","last_fullsized":"2024-09-12T00:59:02.168108+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:19.648395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"268'24","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.286940+0000","last_change":"2024-09-12T00:30:51.548842+0000","last_active":"2024-09-12T01:00:03.286940+0000","last_peered":"2024-09-12T01:00:03.286940+0000","last_clean":"2024-09-12T01:00:03.286940+0000","last_became_active":"2024-09-12T00:30:51.548069+0000","last_became_peered":"2024-09-12T00:30:51.548069+0000","last_unstale":"2024-09-12T01:00:03.286940+0000","last_undegraded":"2024-09-12T01:00:03.286940+0000","last_fullsized":"2024-09-12T01:00:03.286940+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:24.452311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":85,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.194752+0000","last_change":"2024-09-12T00:43:48.276141+0000","last_active":"2024-09-12T01:00:08.194752+0000","last_peered":"2024-09-12T01:00:08.194752+0000","last_clean":"2024-09-12T01:00:08.194752+0000","last_became_active":"2024-09-12T00:43:48.274026+0000","last_became_peered":"2024-09-12T00:43:48.274026+0000","last_unstale":"2024-09-12T01:00:08.194752+0000","last_undegraded":"2024-09-12T01:00:08.194752+0000","last_fullsized":"2024-09-12T01:00:08.194752+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:53.384375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"268'1","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.178343+0000","last_change":"2024-09-12T00:32:28.063379+0000","last_active":"2024-09-12T00:59:03.178343+0000","last_peered":"2024-09-12T00:59:03.178343+0000","last_clean":"2024-09-12T00:59:03.178343+0000","last_became_active":"2024-09-12T00:32:28.062657+0000","last_became_peered":"2024-09-12T00:32:28.062657+0000","last_unstale":"2024-09-12T00:59:03.178343+0000","last_undegraded":"2024-09-12T00:59:03.178343+0000","last_fullsized":"2024-09-12T00:59:03.178343+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:10.594711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":48,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.192560+0000","last_change":"2024-09-12T00:32:24.997566+0000","last_active":"2024-09-12T00:59:02.192560+0000","last_peered":"2024-09-12T00:59:02.192560+0000","last_clean":"2024-09-12T00:59:02.192560+0000","last_became_active":"2024-09-12T00:32:24.996754+0000","last_became_peered":"2024-09-12T00:32:24.996754+0000","last_unstale":"2024-09-12T00:59:02.192560+0000","last_undegraded":"2024-09-12T00:59:02.192560+0000","last_fullsized":"2024-09-12T00:59:02.192560+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:55.566151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"268'26","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:59.211731+0000","last_change":"2024-09-12T00:30:51.551315+0000","last_active":"2024-09-12T00:58:59.211731+0000","last_peered":"2024-09-12T00:58:59.211731+0000","last_clean":"2024-09-12T00:58:59.211731+0000","last_became_active":"2024-09-12T00:30:51.545679+0000","last_became_peered":"2024-09-12T00:30:51.545679+0000","last_unstale":"2024-09-12T00:58:59.211731+0000","last_undegraded":"2024-09-12T00:58:59.211731+0000","last_fullsized":"2024-09-12T00:58:59.211731+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:48.283586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":84,"num_write":50,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:22.182350+0000","last_change":"2024-09-12T00:43:48.286291+0000","last_active":"2024-09-12T00:58:22.182350+0000","last_peered":"2024-09-12T00:58:22.182350+0000","last_clean":"2024-09-12T00:58:22.182350+0000","last_became_active":"2024-09-12T00:43:48.285657+0000","last_became_peered":"2024-09-12T00:43:48.285657+0000","last_unstale":"2024-09-12T00:58:22.182350+0000","last_undegraded":"2024-09-12T00:58:22.182350+0000","last_fullsized":"2024-09-12T00:58:22.182350+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:25.925943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"268'7","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:12.178896+0000","last_change":"2024-09-12T00:32:28.068135+0000","last_active":"2024-09-12T00:58:12.178896+0000","last_peered":"2024-09-12T00:58:12.178896+0000","last_clean":"2024-09-12T00:58:12.178896+0000","last_became_active":"2024-09-12T00:32:28.067168+0000","last_became_peered":"2024-09-12T00:32:28.067168+0000","last_unstale":"2024-09-12T00:58:12.178896+0000","last_undegraded":"2024-09-12T00:58:12.178896+0000","last_fullsized":"2024-09-12T00:58:12.178896+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:58.886483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"268'9","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:08.164412+0000","last_change":"2024-09-12T00:32:25.012858+0000","last_active":"2024-09-12T00:58:08.164412+0000","last_peered":"2024-09-12T00:58:08.164412+0000","last_clean":"2024-09-12T00:58:08.164412+0000","last_became_active":"2024-09-12T00:32:25.011944+0000","last_became_peered":"2024-09-12T00:32:25.011944+0000","last_unstale":"2024-09-12T00:58:08.164412+0000","last_undegraded":"2024-09-12T00:58:08.164412+0000","last_fullsized":"2024-09-12T00:58:08.164412+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:59.502458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":20800,"num_write":19,"num_write_kb":10558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"268'29","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:54.210368+0000","last_change":"2024-09-12T00:30:51.551466+0000","last_active":"2024-09-12T00:58:54.210368+0000","last_peered":"2024-09-12T00:58:54.210368+0000","last_clean":"2024-09-12T00:58:54.210368+0000","last_became_active":"2024-09-12T00:30:51.550694+0000","last_became_peered":"2024-09-12T00:30:51.550694+0000","last_unstale":"2024-09-12T00:58:54.210368+0000","last_undegraded":"2024-09-12T00:58:54.210368+0000","last_fullsized":"2024-09-12T00:58:54.210368+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:19.647721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:18.155457+0000","last_change":"2024-09-12T00:43:48.273326+0000","last_active":"2024-09-12T00:58:18.155457+0000","last_peered":"2024-09-12T00:58:18.155457+0000","last_clean":"2024-09-12T00:58:18.155457+0000","last_became_active":"2024-09-12T00:43:48.272356+0000","last_became_peered":"2024-09-12T00:43:48.272356+0000","last_unstale":"2024-09-12T00:58:18.155457+0000","last_undegraded":"2024-09-12T00:58:18.155457+0000","last_fullsized":"2024-09-12T00:58:18.155457+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:10.874661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"268'5","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:12.178797+0000","last_change":"2024-09-12T00:32:28.068097+0000","last_active":"2024-09-12T00:58:12.178797+0000","last_peered":"2024-09-12T00:58:12.178797+0000","last_clean":"2024-09-12T00:58:12.178797+0000","last_became_active":"2024-09-12T00:32:28.067388+0000","last_became_peered":"2024-09-12T00:32:28.067388+0000","last_unstale":"2024-09-12T00:58:12.178797+0000","last_undegraded":"2024-09-12T00:58:12.178797+0000","last_fullsized":"2024-09-12T00:58:12.178797+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:43.197946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":15,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:07.177487+0000","last_change":"2024-09-12T00:32:25.009043+0000","last_active":"2024-09-12T00:58:07.177487+0000","last_peered":"2024-09-12T00:58:07.177487+0000","last_clean":"2024-09-12T00:58:07.177487+0000","last_became_active":"2024-09-12T00:32:25.005882+0000","last_became_peered":"2024-09-12T00:32:25.005882+0000","last_unstale":"2024-09-12T00:58:07.177487+0000","last_undegraded":"2024-09-12T00:58:07.177487+0000","last_fullsized":"2024-09-12T00:58:07.177487+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:03.055383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"268'19","reported_seq":95,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:52.165743+0000","last_change":"2024-09-12T00:30:51.555200+0000","last_active":"2024-09-12T00:58:52.165743+0000","last_peered":"2024-09-12T00:58:52.165743+0000","last_clean":"2024-09-12T00:58:52.165743+0000","last_became_active":"2024-09-12T00:30:51.548932+0000","last_became_peered":"2024-09-12T00:30:51.548932+0000","last_unstale":"2024-09-12T00:58:52.165743+0000","last_undegraded":"2024-09-12T00:58:52.165743+0000","last_fullsized":"2024-09-12T00:58:52.165743+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:27.568202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.189591+0000","last_change":"2024-09-12T00:43:48.277526+0000","last_active":"2024-09-12T01:00:13.189591+0000","last_peered":"2024-09-12T01:00:13.189591+0000","last_clean":"2024-09-12T01:00:13.189591+0000","last_became_active":"2024-09-12T00:43:48.274983+0000","last_became_peered":"2024-09-12T00:43:48.274983+0000","last_unstale":"2024-09-12T01:00:13.189591+0000","last_undegraded":"2024-09-12T01:00:13.189591+0000","last_fullsized":"2024-09-12T01:00:13.189591+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:44.126353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"265'5","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:07.155894+0000","last_change":"2024-09-12T00:32:28.050796+0000","last_active":"2024-09-12T00:58:07.155894+0000","last_peered":"2024-09-12T00:58:07.155894+0000","last_clean":"2024-09-12T00:58:07.155894+0000","last_became_active":"2024-09-12T00:32:28.049947+0000","last_became_peered":"2024-09-12T00:32:28.049947+0000","last_unstale":"2024-09-12T00:58:07.155894+0000","last_undegraded":"2024-09-12T00:58:07.155894+0000","last_fullsized":"2024-09-12T00:58:07.155894+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:37.435116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:08.164500+0000","last_change":"2024-09-12T00:32:25.008845+0000","last_active":"2024-09-12T00:58:08.164500+0000","last_peered":"2024-09-12T00:58:08.164500+0000","last_clean":"2024-09-12T00:58:08.164500+0000","last_became_active":"2024-09-12T00:32:25.008089+0000","last_became_peered":"2024-09-12T00:32:25.008089+0000","last_unstale":"2024-09-12T00:58:08.164500+0000","last_undegraded":"2024-09-12T00:58:08.164500+0000","last_fullsized":"2024-09-12T00:58:08.164500+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:32.387676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"268'82","reported_seq":323,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:53.174675+0000","last_change":"2024-09-12T00:30:51.548938+0000","last_active":"2024-09-12T00:58:53.174675+0000","last_peered":"2024-09-12T00:58:53.174675+0000","last_clean":"2024-09-12T00:58:53.174675+0000","last_became_active":"2024-09-12T00:30:51.548232+0000","last_became_peered":"2024-09-12T00:30:51.548232+0000","last_unstale":"2024-09-12T00:58:53.174675+0000","last_undegraded":"2024-09-12T00:58:53.174675+0000","last_fullsized":"2024-09-12T00:58:53.174675+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:32.055820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":390,"num_write":93,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:18.155390+0000","last_change":"2024-09-12T00:43:48.272336+0000","last_active":"2024-09-12T00:58:18.155390+0000","last_peered":"2024-09-12T00:58:18.155390+0000","last_clean":"2024-09-12T00:58:18.155390+0000","last_became_active":"2024-09-12T00:43:48.271560+0000","last_became_peered":"2024-09-12T00:43:48.271560+0000","last_unstale":"2024-09-12T00:58:18.155390+0000","last_undegraded":"2024-09-12T00:58:18.155390+0000","last_fullsized":"2024-09-12T00:58:18.155390+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:33.055656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:09.196589+0000","last_change":"2024-09-12T00:32:28.058883+0000","last_active":"2024-09-12T00:58:09.196589+0000","last_peered":"2024-09-12T00:58:09.196589+0000","last_clean":"2024-09-12T00:58:09.196589+0000","last_became_active":"2024-09-12T00:32:28.058127+0000","last_became_peered":"2024-09-12T00:32:28.058127+0000","last_unstale":"2024-09-12T00:58:09.196589+0000","last_undegraded":"2024-09-12T00:58:09.196589+0000","last_fullsized":"2024-09-12T00:58:09.196589+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:36.704098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"268'3","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.197862+0000","last_change":"2024-09-12T00:32:25.013431+0000","last_active":"2024-09-12T01:00:28.197862+0000","last_peered":"2024-09-12T01:00:28.197862+0000","last_clean":"2024-09-12T01:00:28.197862+0000","last_became_active":"2024-09-12T00:32:25.013042+0000","last_became_peered":"2024-09-12T00:32:25.013042+0000","last_unstale":"2024-09-12T01:00:28.197862+0000","last_undegraded":"2024-09-12T01:00:28.197862+0000","last_fullsized":"2024-09-12T01:00:28.197862+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:01.167610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'29","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:52.165632+0000","last_change":"2024-09-12T00:30:51.548109+0000","last_active":"2024-09-12T00:58:52.165632+0000","last_peered":"2024-09-12T00:58:52.165632+0000","last_clean":"2024-09-12T00:58:52.165632+0000","last_became_active":"2024-09-12T00:30:51.545619+0000","last_became_peered":"2024-09-12T00:30:51.545619+0000","last_unstale":"2024-09-12T00:58:52.165632+0000","last_undegraded":"2024-09-12T00:58:52.165632+0000","last_fullsized":"2024-09-12T00:58:52.165632+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:38.398967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":120,"num_write":40,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:07.193629+0000","last_change":"2024-09-12T00:43:48.280018+0000","last_active":"2024-09-12T00:59:07.193629+0000","last_peered":"2024-09-12T00:59:07.193629+0000","last_clean":"2024-09-12T00:59:07.193629+0000","last_became_active":"2024-09-12T00:43:48.279197+0000","last_became_peered":"2024-09-12T00:43:48.279197+0000","last_unstale":"2024-09-12T00:59:07.193629+0000","last_undegraded":"2024-09-12T00:59:07.193629+0000","last_fullsized":"2024-09-12T00:59:07.193629+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:16.184230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174616+0000","last_change":"2024-09-12T00:32:28.058572+0000","last_active":"2024-09-12T00:59:27.174616+0000","last_peered":"2024-09-12T00:59:27.174616+0000","last_clean":"2024-09-12T00:59:27.174616+0000","last_became_active":"2024-09-12T00:32:28.057839+0000","last_became_peered":"2024-09-12T00:32:28.057839+0000","last_unstale":"2024-09-12T00:59:27.174616+0000","last_undegraded":"2024-09-12T00:59:27.174616+0000","last_fullsized":"2024-09-12T00:59:27.174616+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:41.184079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"268'7","reported_seq":57,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:28.183290+0000","last_change":"2024-09-12T00:32:25.022238+0000","last_active":"2024-09-12T00:59:28.183290+0000","last_peered":"2024-09-12T00:59:28.183290+0000","last_clean":"2024-09-12T00:59:28.183290+0000","last_became_active":"2024-09-12T00:32:25.021649+0000","last_became_peered":"2024-09-12T00:32:25.021649+0000","last_unstale":"2024-09-12T00:59:28.183290+0000","last_undegraded":"2024-09-12T00:59:28.183290+0000","last_fullsized":"2024-09-12T00:59:28.183290+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:11.939783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"268'68","reported_seq":236,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:17.186626+0000","last_change":"2024-09-12T00:30:51.562713+0000","last_active":"2024-09-12T01:00:17.186626+0000","last_peered":"2024-09-12T01:00:17.186626+0000","last_clean":"2024-09-12T01:00:17.186626+0000","last_became_active":"2024-09-12T00:30:51.562106+0000","last_became_peered":"2024-09-12T00:30:51.562106+0000","last_unstale":"2024-09-12T01:00:17.186626+0000","last_undegraded":"2024-09-12T01:00:17.186626+0000","last_fullsized":"2024-09-12T01:00:17.186626+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:57.176892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":360,"num_read_kb":258,"num_write":123,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185103+0000","last_change":"2024-09-12T00:43:48.287022+0000","last_active":"2024-09-12T00:59:33.185103+0000","last_peered":"2024-09-12T00:59:33.185103+0000","last_clean":"2024-09-12T00:59:33.185103+0000","last_became_active":"2024-09-12T00:43:48.286629+0000","last_became_peered":"2024-09-12T00:43:48.286629+0000","last_unstale":"2024-09-12T00:59:33.185103+0000","last_undegraded":"2024-09-12T00:59:33.185103+0000","last_fullsized":"2024-09-12T00:59:33.185103+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:40.640752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174553+0000","last_change":"2024-09-12T00:32:28.071698+0000","last_active":"2024-09-12T00:59:27.174553+0000","last_peered":"2024-09-12T00:59:27.174553+0000","last_clean":"2024-09-12T00:59:27.174553+0000","last_became_active":"2024-09-12T00:32:28.070913+0000","last_became_peered":"2024-09-12T00:32:28.070913+0000","last_unstale":"2024-09-12T00:59:27.174553+0000","last_undegraded":"2024-09-12T00:59:27.174553+0000","last_fullsized":"2024-09-12T00:59:27.174553+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:34.008495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"268'8","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:28.172420+0000","last_change":"2024-09-12T00:32:25.022141+0000","last_active":"2024-09-12T00:59:28.172420+0000","last_peered":"2024-09-12T00:59:28.172420+0000","last_clean":"2024-09-12T00:59:28.172420+0000","last_became_active":"2024-09-12T00:32:25.007681+0000","last_became_peered":"2024-09-12T00:32:25.007681+0000","last_unstale":"2024-09-12T00:59:28.172420+0000","last_undegraded":"2024-09-12T00:59:28.172420+0000","last_fullsized":"2024-09-12T00:59:28.172420+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:46.593006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5291296,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":4146,"num_write":18,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"268'39","reported_seq":150,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:09.229370+0000","last_change":"2024-09-12T00:30:51.565589+0000","last_active":"2024-09-12T01:00:09.229370+0000","last_peered":"2024-09-12T01:00:09.229370+0000","last_clean":"2024-09-12T01:00:09.229370+0000","last_became_active":"2024-09-12T00:30:51.559520+0000","last_became_peered":"2024-09-12T00:30:51.559520+0000","last_unstale":"2024-09-12T01:00:09.229370+0000","last_undegraded":"2024-09-12T01:00:09.229370+0000","last_fullsized":"2024-09-12T01:00:09.229370+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:38.099204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":143,"num_write":68,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:59.211561+0000","last_change":"2024-09-12T00:43:48.287080+0000","last_active":"2024-09-12T00:58:59.211561+0000","last_peered":"2024-09-12T00:58:59.211561+0000","last_clean":"2024-09-12T00:58:59.211561+0000","last_became_active":"2024-09-12T00:43:48.286079+0000","last_became_peered":"2024-09-12T00:43:48.286079+0000","last_unstale":"2024-09-12T00:58:59.211561+0000","last_undegraded":"2024-09-12T00:58:59.211561+0000","last_fullsized":"2024-09-12T00:58:59.211561+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:57.937242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.177100+0000","last_change":"2024-09-12T00:32:28.075197+0000","last_active":"2024-09-12T00:59:37.177100+0000","last_peered":"2024-09-12T00:59:37.177100+0000","last_clean":"2024-09-12T00:59:37.177100+0000","last_became_active":"2024-09-12T00:32:28.074621+0000","last_became_peered":"2024-09-12T00:32:28.074621+0000","last_unstale":"2024-09-12T00:59:37.177100+0000","last_undegraded":"2024-09-12T00:59:37.177100+0000","last_fullsized":"2024-09-12T00:59:37.177100+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:11.217357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174686+0000","last_change":"2024-09-12T00:32:25.009196+0000","last_active":"2024-09-12T00:59:27.174686+0000","last_peered":"2024-09-12T00:59:27.174686+0000","last_clean":"2024-09-12T00:59:27.174686+0000","last_became_active":"2024-09-12T00:32:25.008419+0000","last_became_peered":"2024-09-12T00:32:25.008419+0000","last_unstale":"2024-09-12T00:59:27.174686+0000","last_undegraded":"2024-09-12T00:59:27.174686+0000","last_fullsized":"2024-09-12T00:59:27.174686+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:01.482915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"268'30","reported_seq":120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.193309+0000","last_change":"2024-09-12T00:30:51.541334+0000","last_active":"2024-09-12T01:00:08.193309+0000","last_peered":"2024-09-12T01:00:08.193309+0000","last_clean":"2024-09-12T01:00:08.193309+0000","last_became_active":"2024-09-12T00:30:51.540434+0000","last_became_peered":"2024-09-12T00:30:51.540434+0000","last_unstale":"2024-09-12T01:00:08.193309+0000","last_undegraded":"2024-09-12T01:00:08.193309+0000","last_fullsized":"2024-09-12T01:00:08.193309+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:01.590635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":92,"num_write":60,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:58.176983+0000","last_change":"2024-09-12T00:43:48.279278+0000","last_active":"2024-09-12T00:58:58.176983+0000","last_peered":"2024-09-12T00:58:58.176983+0000","last_clean":"2024-09-12T00:58:58.176983+0000","last_became_active":"2024-09-12T00:43:48.278477+0000","last_became_peered":"2024-09-12T00:43:48.278477+0000","last_unstale":"2024-09-12T00:58:58.176983+0000","last_undegraded":"2024-09-12T00:58:58.176983+0000","last_fullsized":"2024-09-12T00:58:58.176983+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:23.351907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"268'10","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:32.200462+0000","last_change":"2024-09-12T00:32:28.075698+0000","last_active":"2024-09-12T00:59:32.200462+0000","last_peered":"2024-09-12T00:59:32.200462+0000","last_clean":"2024-09-12T00:59:32.200462+0000","last_became_active":"2024-09-12T00:32:28.066441+0000","last_became_peered":"2024-09-12T00:32:28.066441+0000","last_unstale":"2024-09-12T00:59:32.200462+0000","last_undegraded":"2024-09-12T00:59:32.200462+0000","last_fullsized":"2024-09-12T00:59:32.200462+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:29.911316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":37890,"num_write":20,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.177139+0000","last_change":"2024-09-12T00:32:25.011505+0000","last_active":"2024-09-12T00:59:37.177139+0000","last_peered":"2024-09-12T00:59:37.177139+0000","last_clean":"2024-09-12T00:59:37.177139+0000","last_became_active":"2024-09-12T00:32:25.010752+0000","last_became_peered":"2024-09-12T00:32:25.010752+0000","last_unstale":"2024-09-12T00:59:37.177139+0000","last_undegraded":"2024-09-12T00:59:37.177139+0000","last_fullsized":"2024-09-12T00:59:37.177139+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:38.026878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"268'114","reported_seq":464,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.181883+0000","last_change":"2024-09-12T00:30:51.550820+0000","last_active":"2024-09-12T01:00:08.181883+0000","last_peered":"2024-09-12T01:00:08.181883+0000","last_clean":"2024-09-12T01:00:08.181883+0000","last_became_active":"2024-09-12T00:30:51.550081+0000","last_became_peered":"2024-09-12T00:30:51.550081+0000","last_unstale":"2024-09-12T01:00:08.181883+0000","last_undegraded":"2024-09-12T01:00:08.181883+0000","last_fullsized":"2024-09-12T01:00:08.181883+0000","mapping_epoch":257,"log_start":"265'100","ondisk_log_start":"265'100","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:48.107776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":826,"num_read_kb":599,"num_write":142,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.201751+0000","last_change":"2024-09-12T00:43:48.273417+0000","last_active":"2024-09-12T00:59:37.201751+0000","last_peered":"2024-09-12T00:59:37.201751+0000","last_clean":"2024-09-12T00:59:37.201751+0000","last_became_active":"2024-09-12T00:43:48.272486+0000","last_became_peered":"2024-09-12T00:43:48.272486+0000","last_unstale":"2024-09-12T00:59:37.201751+0000","last_undegraded":"2024-09-12T00:59:37.201751+0000","last_fullsized":"2024-09-12T00:59:37.201751+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:26.875710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:29.201794+0000","last_change":"2024-09-12T00:32:28.051078+0000","last_active":"2024-09-12T00:58:29.201794+0000","last_peered":"2024-09-12T00:58:29.201794+0000","last_clean":"2024-09-12T00:58:29.201794+0000","last_became_active":"2024-09-12T00:32:28.049186+0000","last_became_peered":"2024-09-12T00:32:28.049186+0000","last_unstale":"2024-09-12T00:58:29.201794+0000","last_undegraded":"2024-09-12T00:58:29.201794+0000","last_fullsized":"2024-09-12T00:58:29.201794+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:54.432738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:27.160025+0000","last_change":"2024-09-12T00:32:25.000690+0000","last_active":"2024-09-12T00:58:27.160025+0000","last_peered":"2024-09-12T00:58:27.160025+0000","last_clean":"2024-09-12T00:58:27.160025+0000","last_became_active":"2024-09-12T00:32:24.999633+0000","last_became_peered":"2024-09-12T00:32:24.999633+0000","last_unstale":"2024-09-12T00:58:27.160025+0000","last_undegraded":"2024-09-12T00:58:27.160025+0000","last_fullsized":"2024-09-12T00:58:27.160025+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:09.259657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"268'69","reported_seq":237,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.181761+0000","last_change":"2024-09-12T00:30:51.548507+0000","last_active":"2024-09-12T01:00:08.181761+0000","last_peered":"2024-09-12T01:00:08.181761+0000","last_clean":"2024-09-12T01:00:08.181761+0000","last_became_active":"2024-09-12T00:30:51.546873+0000","last_became_peered":"2024-09-12T00:30:51.546873+0000","last_unstale":"2024-09-12T01:00:08.181761+0000","last_undegraded":"2024-09-12T01:00:08.181761+0000","last_fullsized":"2024-09-12T01:00:08.181761+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:28.201041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":256,"num_write":124,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:38.185725+0000","last_change":"2024-09-12T00:43:48.287793+0000","last_active":"2024-09-12T00:59:38.185725+0000","last_peered":"2024-09-12T00:59:38.185725+0000","last_clean":"2024-09-12T00:59:38.185725+0000","last_became_active":"2024-09-12T00:43:48.287144+0000","last_became_peered":"2024-09-12T00:43:48.287144+0000","last_unstale":"2024-09-12T00:59:38.185725+0000","last_undegraded":"2024-09-12T00:59:38.185725+0000","last_fullsized":"2024-09-12T00:59:38.185725+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:03.320468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:28.167607+0000","last_change":"2024-09-12T00:32:28.064542+0000","last_active":"2024-09-12T00:58:28.167607+0000","last_peered":"2024-09-12T00:58:28.167607+0000","last_clean":"2024-09-12T00:58:28.167607+0000","last_became_active":"2024-09-12T00:32:28.063712+0000","last_became_peered":"2024-09-12T00:32:28.063712+0000","last_unstale":"2024-09-12T00:58:28.167607+0000","last_undegraded":"2024-09-12T00:58:28.167607+0000","last_fullsized":"2024-09-12T00:58:28.167607+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:07.012225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"268'2","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:27.183761+0000","last_change":"2024-09-12T00:32:25.012329+0000","last_active":"2024-09-12T00:58:27.183761+0000","last_peered":"2024-09-12T00:58:27.183761+0000","last_clean":"2024-09-12T00:58:27.183761+0000","last_became_active":"2024-09-12T00:32:25.005902+0000","last_became_peered":"2024-09-12T00:32:25.005902+0000","last_unstale":"2024-09-12T00:58:27.183761+0000","last_undegraded":"2024-09-12T00:58:27.183761+0000","last_fullsized":"2024-09-12T00:58:27.183761+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:34.031714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"268'31","reported_seq":126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:13.179616+0000","last_change":"2024-09-12T00:30:51.545329+0000","last_active":"2024-09-12T00:59:13.179616+0000","last_peered":"2024-09-12T00:59:13.179616+0000","last_clean":"2024-09-12T00:59:13.179616+0000","last_became_active":"2024-09-12T00:30:51.541904+0000","last_became_peered":"2024-09-12T00:30:51.541904+0000","last_unstale":"2024-09-12T00:59:13.179616+0000","last_undegraded":"2024-09-12T00:59:13.179616+0000","last_fullsized":"2024-09-12T00:59:13.179616+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:26.384655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":109,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185912+0000","last_change":"2024-09-12T00:43:48.275537+0000","last_active":"2024-09-12T00:59:33.185912+0000","last_peered":"2024-09-12T00:59:33.185912+0000","last_clean":"2024-09-12T00:59:33.185912+0000","last_became_active":"2024-09-12T00:43:48.274756+0000","last_became_peered":"2024-09-12T00:43:48.274756+0000","last_unstale":"2024-09-12T00:59:33.185912+0000","last_undegraded":"2024-09-12T00:59:33.185912+0000","last_fullsized":"2024-09-12T00:59:33.185912+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:14.072781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"268'3","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:28.172269+0000","last_change":"2024-09-12T00:32:28.066799+0000","last_active":"2024-09-12T00:59:28.172269+0000","last_peered":"2024-09-12T00:59:28.172269+0000","last_clean":"2024-09-12T00:59:28.172269+0000","last_became_active":"2024-09-12T00:32:28.066029+0000","last_became_peered":"2024-09-12T00:32:28.066029+0000","last_unstale":"2024-09-12T00:59:28.172269+0000","last_undegraded":"2024-09-12T00:59:28.172269+0000","last_fullsized":"2024-09-12T00:59:28.172269+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:56.429963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"268'2","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:37.162238+0000","last_change":"2024-09-12T00:32:25.001979+0000","last_active":"2024-09-12T00:58:37.162238+0000","last_peered":"2024-09-12T00:58:37.162238+0000","last_clean":"2024-09-12T00:58:37.162238+0000","last_became_active":"2024-09-12T00:32:25.001194+0000","last_became_peered":"2024-09-12T00:32:25.001194+0000","last_unstale":"2024-09-12T00:58:37.162238+0000","last_undegraded":"2024-09-12T00:58:37.162238+0000","last_fullsized":"2024-09-12T00:58:37.162238+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:06.421742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"268'15","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.192385+0000","last_change":"2024-09-12T00:30:51.544531+0000","last_active":"2024-09-12T00:59:02.192385+0000","last_peered":"2024-09-12T00:59:02.192385+0000","last_clean":"2024-09-12T00:59:02.192385+0000","last_became_active":"2024-09-12T00:30:51.543711+0000","last_became_peered":"2024-09-12T00:30:51.543711+0000","last_unstale":"2024-09-12T00:59:02.192385+0000","last_undegraded":"2024-09-12T00:59:02.192385+0000","last_fullsized":"2024-09-12T00:59:02.192385+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:07.148537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":43,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.176965+0000","last_change":"2024-09-12T00:43:48.290387+0000","last_active":"2024-09-12T00:59:37.176965+0000","last_peered":"2024-09-12T00:59:37.176965+0000","last_clean":"2024-09-12T00:59:37.176965+0000","last_became_active":"2024-09-12T00:43:48.289475+0000","last_became_peered":"2024-09-12T00:43:48.289475+0000","last_unstale":"2024-09-12T00:59:37.176965+0000","last_undegraded":"2024-09-12T00:59:37.176965+0000","last_fullsized":"2024-09-12T00:59:37.176965+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:49.960814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.169772+0000","last_change":"2024-09-12T00:32:28.056626+0000","last_active":"2024-09-12T00:58:33.169772+0000","last_peered":"2024-09-12T00:58:33.169772+0000","last_clean":"2024-09-12T00:58:33.169772+0000","last_became_active":"2024-09-12T00:32:28.055934+0000","last_became_peered":"2024-09-12T00:32:28.055934+0000","last_unstale":"2024-09-12T00:58:33.169772+0000","last_undegraded":"2024-09-12T00:58:33.169772+0000","last_fullsized":"2024-09-12T00:58:33.169772+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:50.220908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"268'2","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:24.218059+0000","last_change":"2024-09-12T00:32:25.005226+0000","last_active":"2024-09-12T00:59:24.218059+0000","last_peered":"2024-09-12T00:59:24.218059+0000","last_clean":"2024-09-12T00:59:24.218059+0000","last_became_active":"2024-09-12T00:32:25.004503+0000","last_became_peered":"2024-09-12T00:32:25.004503+0000","last_unstale":"2024-09-12T00:59:24.218059+0000","last_undegraded":"2024-09-12T00:59:24.218059+0000","last_fullsized":"2024-09-12T00:59:24.218059+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:32.108404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"268'12","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.178118+0000","last_change":"2024-09-12T00:30:51.543743+0000","last_active":"2024-09-12T00:59:03.178118+0000","last_peered":"2024-09-12T00:59:03.178118+0000","last_clean":"2024-09-12T00:59:03.178118+0000","last_became_active":"2024-09-12T00:30:51.542992+0000","last_became_peered":"2024-09-12T00:30:51.542992+0000","last_unstale":"2024-09-12T00:59:03.178118+0000","last_undegraded":"2024-09-12T00:59:03.178118+0000","last_fullsized":"2024-09-12T00:59:03.178118+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:43.711804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.199729+0000","last_change":"2024-09-12T00:43:48.283532+0000","last_active":"2024-09-12T01:00:28.199729+0000","last_peered":"2024-09-12T01:00:28.199729+0000","last_clean":"2024-09-12T01:00:28.199729+0000","last_became_active":"2024-09-12T00:43:48.276293+0000","last_became_peered":"2024-09-12T00:43:48.276293+0000","last_unstale":"2024-09-12T01:00:28.199729+0000","last_undegraded":"2024-09-12T01:00:28.199729+0000","last_fullsized":"2024-09-12T01:00:28.199729+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:45.902022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"268'4","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:42.202970+0000","last_change":"2024-09-12T00:32:28.073623+0000","last_active":"2024-09-12T00:59:42.202970+0000","last_peered":"2024-09-12T00:59:42.202970+0000","last_clean":"2024-09-12T00:59:42.202970+0000","last_became_active":"2024-09-12T00:32:28.067824+0000","last_became_peered":"2024-09-12T00:32:28.067824+0000","last_unstale":"2024-09-12T00:59:42.202970+0000","last_undegraded":"2024-09-12T00:59:42.202970+0000","last_fullsized":"2024-09-12T00:59:42.202970+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:24.607971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":11264,"num_write":4,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"268'3","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:34.014457+0000","last_change":"2024-09-12T00:32:25.022973+0000","last_active":"2024-09-12T01:01:34.014457+0000","last_peered":"2024-09-12T01:01:34.014457+0000","last_clean":"2024-09-12T01:01:34.014457+0000","last_became_active":"2024-09-12T00:32:25.022210+0000","last_became_peered":"2024-09-12T00:32:25.022210+0000","last_unstale":"2024-09-12T01:01:34.014457+0000","last_undegraded":"2024-09-12T01:01:34.014457+0000","last_fullsized":"2024-09-12T01:01:34.014457+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:27.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.171708+0000","last_change":"2024-09-12T00:30:51.550674+0000","last_active":"2024-09-12T00:59:03.171708+0000","last_peered":"2024-09-12T00:59:03.171708+0000","last_clean":"2024-09-12T00:59:03.171708+0000","last_became_active":"2024-09-12T00:30:51.549942+0000","last_became_peered":"2024-09-12T00:30:51.549942+0000","last_unstale":"2024-09-12T00:59:03.171708+0000","last_undegraded":"2024-09-12T00:59:03.171708+0000","last_fullsized":"2024-09-12T00:59:03.171708+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:52.263117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":118,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.199785+0000","last_change":"2024-09-12T00:43:48.276759+0000","last_active":"2024-09-12T01:00:28.199785+0000","last_peered":"2024-09-12T01:00:28.199785+0000","last_clean":"2024-09-12T01:00:28.199785+0000","last_became_active":"2024-09-12T00:43:48.276176+0000","last_became_peered":"2024-09-12T00:43:48.276176+0000","last_unstale":"2024-09-12T01:00:28.199785+0000","last_undegraded":"2024-09-12T01:00:28.199785+0000","last_fullsized":"2024-09-12T01:00:28.199785+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:07.896702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.201670+0000","last_change":"2024-09-12T00:32:28.052395+0000","last_active":"2024-09-12T00:59:37.201670+0000","last_peered":"2024-09-12T00:59:37.201670+0000","last_clean":"2024-09-12T00:59:37.201670+0000","last_became_active":"2024-09-12T00:32:28.051244+0000","last_became_peered":"2024-09-12T00:32:28.051244+0000","last_unstale":"2024-09-12T00:59:37.201670+0000","last_undegraded":"2024-09-12T00:59:37.201670+0000","last_fullsized":"2024-09-12T00:59:37.201670+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:09.633243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"268'2","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.995791+0000","last_change":"2024-09-12T00:32:25.023656+0000","last_active":"2024-09-12T01:01:47.995791+0000","last_peered":"2024-09-12T01:01:47.995791+0000","last_clean":"2024-09-12T01:01:47.995791+0000","last_became_active":"2024-09-12T00:32:25.022757+0000","last_became_peered":"2024-09-12T00:32:25.022757+0000","last_unstale":"2024-09-12T01:01:47.995791+0000","last_undegraded":"2024-09-12T01:01:47.995791+0000","last_fullsized":"2024-09-12T01:01:47.995791+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:59.877231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'12","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:04.213055+0000","last_change":"2024-09-12T00:30:51.566131+0000","last_active":"2024-09-12T00:59:04.213055+0000","last_peered":"2024-09-12T00:59:04.213055+0000","last_clean":"2024-09-12T00:59:04.213055+0000","last_became_active":"2024-09-12T00:30:51.565544+0000","last_became_peered":"2024-09-12T00:30:51.565544+0000","last_unstale":"2024-09-12T00:59:04.213055+0000","last_undegraded":"2024-09-12T00:59:04.213055+0000","last_fullsized":"2024-09-12T00:59:04.213055+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:14.413107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.206539+0000","last_change":"2024-09-12T00:43:48.280037+0000","last_active":"2024-09-12T00:59:57.206539+0000","last_peered":"2024-09-12T00:59:57.206539+0000","last_clean":"2024-09-12T00:59:57.206539+0000","last_became_active":"2024-09-12T00:43:48.279243+0000","last_became_peered":"2024-09-12T00:43:48.279243+0000","last_unstale":"2024-09-12T00:59:57.206539+0000","last_undegraded":"2024-09-12T00:59:57.206539+0000","last_fullsized":"2024-09-12T00:59:57.206539+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:31.525488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"268'2","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:28.168408+0000","last_change":"2024-09-12T00:32:28.060782+0000","last_active":"2024-09-12T00:58:28.168408+0000","last_peered":"2024-09-12T00:58:28.168408+0000","last_clean":"2024-09-12T00:58:28.168408+0000","last_became_active":"2024-09-12T00:32:28.058384+0000","last_became_peered":"2024-09-12T00:32:28.058384+0000","last_unstale":"2024-09-12T00:58:28.168408+0000","last_undegraded":"2024-09-12T00:58:28.168408+0000","last_fullsized":"2024-09-12T00:58:28.168408+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:38.238661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"265'3","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:28.167835+0000","last_change":"2024-09-12T00:32:24.996244+0000","last_active":"2024-09-12T00:58:28.167835+0000","last_peered":"2024-09-12T00:58:28.167835+0000","last_clean":"2024-09-12T00:58:28.167835+0000","last_became_active":"2024-09-12T00:32:24.995532+0000","last_became_peered":"2024-09-12T00:32:24.995532+0000","last_unstale":"2024-09-12T00:58:28.167835+0000","last_undegraded":"2024-09-12T00:58:28.167835+0000","last_fullsized":"2024-09-12T00:58:28.167835+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:39.969617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"268'40","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.196522+0000","last_change":"2024-09-12T00:30:51.554468+0000","last_active":"2024-09-12T01:00:13.196522+0000","last_peered":"2024-09-12T01:00:13.196522+0000","last_clean":"2024-09-12T01:00:13.196522+0000","last_became_active":"2024-09-12T00:30:51.553501+0000","last_became_peered":"2024-09-12T00:30:51.553501+0000","last_unstale":"2024-09-12T01:00:13.196522+0000","last_undegraded":"2024-09-12T01:00:13.196522+0000","last_fullsized":"2024-09-12T01:00:13.196522+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:13.843806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":68,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.234081+0000","last_change":"2024-09-12T00:43:48.281674+0000","last_active":"2024-09-12T01:00:29.234081+0000","last_peered":"2024-09-12T01:00:29.234081+0000","last_clean":"2024-09-12T01:00:29.234081+0000","last_became_active":"2024-09-12T00:43:48.280566+0000","last_became_peered":"2024-09-12T00:43:48.280566+0000","last_unstale":"2024-09-12T01:00:29.234081+0000","last_undegraded":"2024-09-12T01:00:29.234081+0000","last_fullsized":"2024-09-12T01:00:29.234081+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:02.297251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"268'4","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000545+0000","last_change":"2024-09-12T00:32:28.061791+0000","last_active":"2024-09-12T01:00:39.000545+0000","last_peered":"2024-09-12T01:00:39.000545+0000","last_clean":"2024-09-12T01:00:39.000545+0000","last_became_active":"2024-09-12T00:32:28.061089+0000","last_became_peered":"2024-09-12T00:32:28.061089+0000","last_unstale":"2024-09-12T01:00:39.000545+0000","last_undegraded":"2024-09-12T01:00:39.000545+0000","last_fullsized":"2024-09-12T01:00:39.000545+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:12.218155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":326,"num_write":4,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"265'11","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:24.200843+0000","last_change":"2024-09-12T00:32:25.004508+0000","last_active":"2024-09-12T00:58:24.200843+0000","last_peered":"2024-09-12T00:58:24.200843+0000","last_clean":"2024-09-12T00:58:24.200843+0000","last_became_active":"2024-09-12T00:32:25.004199+0000","last_became_peered":"2024-09-12T00:32:25.004199+0000","last_unstale":"2024-09-12T00:58:24.200843+0000","last_undegraded":"2024-09-12T00:58:24.200843+0000","last_fullsized":"2024-09-12T00:58:24.200843+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:38.507054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11280,"num_write":21,"num_write_kb":11280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"268'12","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:02.183087+0000","last_change":"2024-09-12T00:30:51.554784+0000","last_active":"2024-09-12T01:00:02.183087+0000","last_peered":"2024-09-12T01:00:02.183087+0000","last_clean":"2024-09-12T01:00:02.183087+0000","last_became_active":"2024-09-12T00:30:51.548619+0000","last_became_peered":"2024-09-12T00:30:51.548619+0000","last_unstale":"2024-09-12T01:00:02.183087+0000","last_undegraded":"2024-09-12T01:00:02.183087+0000","last_fullsized":"2024-09-12T01:00:02.183087+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:18.858058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168084+0000","last_change":"2024-09-12T00:43:48.284636+0000","last_active":"2024-09-12T00:59:02.168084+0000","last_peered":"2024-09-12T00:59:02.168084+0000","last_clean":"2024-09-12T00:59:02.168084+0000","last_became_active":"2024-09-12T00:43:48.283630+0000","last_became_peered":"2024-09-12T00:43:48.283630+0000","last_unstale":"2024-09-12T00:59:02.168084+0000","last_undegraded":"2024-09-12T00:59:02.168084+0000","last_fullsized":"2024-09-12T00:59:02.168084+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:05.417886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'5","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179689+0000","last_change":"2024-09-12T00:32:28.054779+0000","last_active":"2024-09-12T00:59:33.179689+0000","last_peered":"2024-09-12T00:59:33.179689+0000","last_clean":"2024-09-12T00:59:33.179689+0000","last_became_active":"2024-09-12T00:32:28.054045+0000","last_became_peered":"2024-09-12T00:32:28.054045+0000","last_unstale":"2024-09-12T00:59:33.179689+0000","last_undegraded":"2024-09-12T00:59:33.179689+0000","last_fullsized":"2024-09-12T00:59:33.179689+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:05.598087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'3","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:38.202145+0000","last_change":"2024-09-12T00:32:24.998555+0000","last_active":"2024-09-12T01:00:38.202145+0000","last_peered":"2024-09-12T01:00:38.202145+0000","last_clean":"2024-09-12T01:00:38.202145+0000","last_became_active":"2024-09-12T00:32:24.997768+0000","last_became_peered":"2024-09-12T00:32:24.997768+0000","last_unstale":"2024-09-12T01:00:38.202145+0000","last_undegraded":"2024-09-12T01:00:38.202145+0000","last_fullsized":"2024-09-12T01:00:38.202145+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:01.938274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"268'27","reported_seq":114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.193807+0000","last_change":"2024-09-12T00:30:51.557180+0000","last_active":"2024-09-12T01:00:03.193807+0000","last_peered":"2024-09-12T01:00:03.193807+0000","last_clean":"2024-09-12T01:00:03.193807+0000","last_became_active":"2024-09-12T00:30:51.556456+0000","last_became_peered":"2024-09-12T00:30:51.556456+0000","last_unstale":"2024-09-12T01:00:03.193807+0000","last_undegraded":"2024-09-12T01:00:03.193807+0000","last_fullsized":"2024-09-12T01:00:03.193807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:08.813545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":57,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:58.170620+0000","last_change":"2024-09-12T00:43:48.266541+0000","last_active":"2024-09-12T00:58:58.170620+0000","last_peered":"2024-09-12T00:58:58.170620+0000","last_clean":"2024-09-12T00:58:58.170620+0000","last_became_active":"2024-09-12T00:43:48.265726+0000","last_became_peered":"2024-09-12T00:43:48.265726+0000","last_unstale":"2024-09-12T00:58:58.170620+0000","last_undegraded":"2024-09-12T00:58:58.170620+0000","last_fullsized":"2024-09-12T00:58:58.170620+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:07.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000271+0000","last_change":"2024-09-12T00:32:28.051868+0000","last_active":"2024-09-12T01:00:39.000271+0000","last_peered":"2024-09-12T01:00:39.000271+0000","last_clean":"2024-09-12T01:00:39.000271+0000","last_became_active":"2024-09-12T00:32:28.051145+0000","last_became_peered":"2024-09-12T00:32:28.051145+0000","last_unstale":"2024-09-12T01:00:39.000271+0000","last_undegraded":"2024-09-12T01:00:39.000271+0000","last_fullsized":"2024-09-12T01:00:39.000271+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:26.514177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219199+0000","last_change":"2024-09-12T00:32:25.007529+0000","last_active":"2024-09-12T00:59:29.219199+0000","last_peered":"2024-09-12T00:59:29.219199+0000","last_clean":"2024-09-12T00:59:29.219199+0000","last_became_active":"2024-09-12T00:32:25.003679+0000","last_became_peered":"2024-09-12T00:32:25.003679+0000","last_unstale":"2024-09-12T00:59:29.219199+0000","last_undegraded":"2024-09-12T00:59:29.219199+0000","last_fullsized":"2024-09-12T00:59:29.219199+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:31.977653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"268'23","reported_seq":107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:04.228064+0000","last_change":"2024-09-12T00:30:51.552593+0000","last_active":"2024-09-12T01:00:04.228064+0000","last_peered":"2024-09-12T01:00:04.228064+0000","last_clean":"2024-09-12T01:00:04.228064+0000","last_became_active":"2024-09-12T00:30:51.551554+0000","last_became_peered":"2024-09-12T00:30:51.551554+0000","last_unstale":"2024-09-12T01:00:04.228064+0000","last_undegraded":"2024-09-12T01:00:04.228064+0000","last_fullsized":"2024-09-12T01:00:04.228064+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:19.144268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.989931+0000","last_change":"2024-09-12T00:43:48.287349+0000","last_active":"2024-09-12T01:00:31.989931+0000","last_peered":"2024-09-12T01:00:31.989931+0000","last_clean":"2024-09-12T01:00:31.989931+0000","last_became_active":"2024-09-12T00:43:48.286593+0000","last_became_peered":"2024-09-12T00:43:48.286593+0000","last_unstale":"2024-09-12T01:00:31.989931+0000","last_undegraded":"2024-09-12T01:00:31.989931+0000","last_fullsized":"2024-09-12T01:00:31.989931+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:41.625703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"268'5","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.184398+0000","last_change":"2024-09-12T00:32:28.070368+0000","last_active":"2024-09-12T00:59:33.184398+0000","last_peered":"2024-09-12T00:59:33.184398+0000","last_clean":"2024-09-12T00:59:33.184398+0000","last_became_active":"2024-09-12T00:32:28.069812+0000","last_became_peered":"2024-09-12T00:32:28.069812+0000","last_unstale":"2024-09-12T00:59:33.184398+0000","last_undegraded":"2024-09-12T00:59:33.184398+0000","last_fullsized":"2024-09-12T00:59:33.184398+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:37.247045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":16384,"num_write":5,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"268'8","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:38.202224+0000","last_change":"2024-09-12T00:32:25.021525+0000","last_active":"2024-09-12T01:01:38.202224+0000","last_peered":"2024-09-12T01:01:38.202224+0000","last_clean":"2024-09-12T01:01:38.202224+0000","last_became_active":"2024-09-12T00:32:25.017138+0000","last_became_peered":"2024-09-12T00:32:25.017138+0000","last_unstale":"2024-09-12T01:01:38.202224+0000","last_undegraded":"2024-09-12T01:01:38.202224+0000","last_fullsized":"2024-09-12T01:01:38.202224+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:39.080595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"268'53","reported_seq":190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:04.227963+0000","last_change":"2024-09-12T00:30:51.553247+0000","last_active":"2024-09-12T01:00:04.227963+0000","last_peered":"2024-09-12T01:00:04.227963+0000","last_clean":"2024-09-12T01:00:04.227963+0000","last_became_active":"2024-09-12T00:30:51.546238+0000","last_became_peered":"2024-09-12T00:30:51.546238+0000","last_unstale":"2024-09-12T01:00:04.227963+0000","last_undegraded":"2024-09-12T01:00:04.227963+0000","last_fullsized":"2024-09-12T01:00:04.227963+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:52.536369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":191,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:29.201979+0000","last_change":"2024-09-12T00:43:48.277891+0000","last_active":"2024-09-12T00:58:29.201979+0000","last_peered":"2024-09-12T00:58:29.201979+0000","last_clean":"2024-09-12T00:58:29.201979+0000","last_became_active":"2024-09-12T00:43:48.277275+0000","last_became_peered":"2024-09-12T00:43:48.277275+0000","last_unstale":"2024-09-12T00:58:29.201979+0000","last_undegraded":"2024-09-12T00:58:29.201979+0000","last_fullsized":"2024-09-12T00:58:29.201979+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:00.758192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.184304+0000","last_change":"2024-09-12T00:32:28.066072+0000","last_active":"2024-09-12T00:59:33.184304+0000","last_peered":"2024-09-12T00:59:33.184304+0000","last_clean":"2024-09-12T00:59:33.184304+0000","last_became_active":"2024-09-12T00:32:28.065320+0000","last_became_peered":"2024-09-12T00:32:28.065320+0000","last_unstale":"2024-09-12T00:59:33.184304+0000","last_undegraded":"2024-09-12T00:59:33.184304+0000","last_fullsized":"2024-09-12T00:59:33.184304+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:36.535395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'3","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185073+0000","last_change":"2024-09-12T00:32:25.017231+0000","last_active":"2024-09-12T00:59:33.185073+0000","last_peered":"2024-09-12T00:59:33.185073+0000","last_clean":"2024-09-12T00:59:33.185073+0000","last_became_active":"2024-09-12T00:32:25.013266+0000","last_became_peered":"2024-09-12T00:32:25.013266+0000","last_unstale":"2024-09-12T00:59:33.185073+0000","last_undegraded":"2024-09-12T00:59:33.185073+0000","last_fullsized":"2024-09-12T00:59:33.185073+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:11.615304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"268'15","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.177113+0000","last_change":"2024-09-12T00:30:51.560130+0000","last_active":"2024-09-12T00:59:03.177113+0000","last_peered":"2024-09-12T00:59:03.177113+0000","last_clean":"2024-09-12T00:59:03.177113+0000","last_became_active":"2024-09-12T00:30:51.559445+0000","last_became_peered":"2024-09-12T00:30:51.559445+0000","last_unstale":"2024-09-12T00:59:03.177113+0000","last_undegraded":"2024-09-12T00:59:03.177113+0000","last_fullsized":"2024-09-12T00:59:03.177113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:54.936785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"268'329","reported_seq":1086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.903151+0000","last_change":"2024-09-12T00:15:55.079016+0000","last_active":"2024-09-12T01:02:37.903151+0000","last_peered":"2024-09-12T01:02:37.903151+0000","last_clean":"2024-09-12T01:02:37.903151+0000","last_became_active":"2024-09-12T00:15:55.078687+0000","last_became_peered":"2024-09-12T00:15:55.078687+0000","last_unstale":"2024-09-12T01:02:37.903151+0000","last_undegraded":"2024-09-12T01:02:37.903151+0000","last_fullsized":"2024-09-12T01:02:37.903151+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:29.403023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340543,"num_objects":48,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":0,"num_read":728,"num_read_kb":39834,"num_write":1219,"num_write_kb":26442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"268'857","reported_seq":2605,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.866154+0000","last_change":"2024-09-12T00:15:57.022290+0000","last_active":"2024-09-12T01:02:10.866154+0000","last_peered":"2024-09-12T01:02:10.866154+0000","last_clean":"2024-09-12T01:02:10.866154+0000","last_became_active":"2024-09-12T00:15:57.021927+0000","last_became_peered":"2024-09-12T00:15:57.021927+0000","last_unstale":"2024-09-12T01:02:10.866154+0000","last_undegraded":"2024-09-12T01:02:10.866154+0000","last_fullsized":"2024-09-12T01:02:10.866154+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:27.786130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4184,"num_read_kb":3812,"num_write":1107,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"268'331","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:26.529497+0000","last_change":"2024-09-12T00:15:55.075731+0000","last_active":"2024-09-12T01:00:26.529497+0000","last_peered":"2024-09-12T01:00:26.529497+0000","last_clean":"2024-09-12T01:00:26.529497+0000","last_became_active":"2024-09-12T00:15:55.075108+0000","last_became_peered":"2024-09-12T00:15:55.075108+0000","last_unstale":"2024-09-12T01:00:26.529497+0000","last_undegraded":"2024-09-12T01:00:26.529497+0000","last_fullsized":"2024-09-12T01:00:26.529497+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:53.644639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1697815,"num_objects":64,"num_object_clones":0,"num_object_copies":256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":553,"num_read_kb":2161,"num_write":1163,"num_write_kb":32030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"268'541","reported_seq":2172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.146646+0000","last_change":"2024-09-12T00:15:57.022914+0000","last_active":"2024-09-12T01:01:02.146646+0000","last_peered":"2024-09-12T01:01:02.146646+0000","last_clean":"2024-09-12T01:01:02.146646+0000","last_became_active":"2024-09-12T00:15:57.022465+0000","last_became_peered":"2024-09-12T00:15:57.022465+0000","last_unstale":"2024-09-12T01:01:02.146646+0000","last_undegraded":"2024-09-12T01:01:02.146646+0000","last_fullsized":"2024-09-12T01:01:02.146646+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:22.255065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2758,"num_read_kb":2563,"num_write":657,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"268'324","reported_seq":1059,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:45.712992+0000","last_change":"2024-09-12T00:15:55.042888+0000","last_active":"2024-09-12T00:59:45.712992+0000","last_peered":"2024-09-12T00:59:45.712992+0000","last_clean":"2024-09-12T00:59:45.712992+0000","last_became_active":"2024-09-12T00:15:55.041491+0000","last_became_peered":"2024-09-12T00:15:55.041491+0000","last_unstale":"2024-09-12T00:59:45.712992+0000","last_undegraded":"2024-09-12T00:59:45.712992+0000","last_fullsized":"2024-09-12T00:59:45.712992+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:29.522820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8843817,"num_objects":70,"num_object_clones":0,"num_object_copies":280,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":766,"num_read_kb":4160,"num_write":1203,"num_write_kb":14348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"268'1145","reported_seq":2779,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:59.004596+0000","last_change":"2024-09-12T00:15:57.023106+0000","last_active":"2024-09-12T01:00:59.004596+0000","last_peered":"2024-09-12T01:00:59.004596+0000","last_clean":"2024-09-12T01:00:59.004596+0000","last_became_active":"2024-09-12T00:15:57.022692+0000","last_became_peered":"2024-09-12T00:15:57.022692+0000","last_unstale":"2024-09-12T01:00:59.004596+0000","last_undegraded":"2024-09-12T01:00:59.004596+0000","last_fullsized":"2024-09-12T01:00:59.004596+0000","mapping_epoch":28,"log_start":"268'1100","ondisk_log_start":"268'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":1100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:01.909120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5291,"num_read_kb":4702,"num_write":1570,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"268'355","reported_seq":1038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.154562+0000","last_change":"2024-09-12T00:15:55.046149+0000","last_active":"2024-09-12T01:02:38.154562+0000","last_peered":"2024-09-12T01:02:38.154562+0000","last_clean":"2024-09-12T01:02:38.154562+0000","last_became_active":"2024-09-12T00:15:55.045668+0000","last_became_peered":"2024-09-12T00:15:55.045668+0000","last_unstale":"2024-09-12T01:02:38.154562+0000","last_undegraded":"2024-09-12T01:02:38.154562+0000","last_fullsized":"2024-09-12T01:02:38.154562+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:25.710871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1414102,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":630,"num_read_kb":47789,"num_write":1261,"num_write_kb":53743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"268'567","reported_seq":2201,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506437+0000","last_change":"2024-09-12T00:15:57.019605+0000","last_active":"2024-09-12T01:01:09.506437+0000","last_peered":"2024-09-12T01:01:09.506437+0000","last_clean":"2024-09-12T01:01:09.506437+0000","last_became_active":"2024-09-12T00:15:57.018762+0000","last_became_peered":"2024-09-12T00:15:57.018762+0000","last_unstale":"2024-09-12T01:01:09.506437+0000","last_undegraded":"2024-09-12T01:01:09.506437+0000","last_fullsized":"2024-09-12T01:01:09.506437+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:00.744230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2864,"num_read_kb":2646,"num_write":693,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"268'320","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.001737+0000","last_change":"2024-09-12T00:15:55.072012+0000","last_active":"2024-09-12T01:02:38.001737+0000","last_peered":"2024-09-12T01:02:38.001737+0000","last_clean":"2024-09-12T01:02:38.001737+0000","last_became_active":"2024-09-12T00:15:55.071352+0000","last_became_peered":"2024-09-12T00:15:55.071352+0000","last_unstale":"2024-09-12T01:02:38.001737+0000","last_undegraded":"2024-09-12T01:02:38.001737+0000","last_fullsized":"2024-09-12T01:02:38.001737+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:19.609544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9193056,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":447,"num_read_kb":19398,"num_write":1094,"num_write_kb":53254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"268'458","reported_seq":2076,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:45.897964+0000","last_change":"2024-09-12T00:15:57.052282+0000","last_active":"2024-09-12T01:00:45.897964+0000","last_peered":"2024-09-12T01:00:45.897964+0000","last_clean":"2024-09-12T01:00:45.897964+0000","last_became_active":"2024-09-12T00:15:57.051973+0000","last_became_peered":"2024-09-12T00:15:57.051973+0000","last_unstale":"2024-09-12T01:00:45.897964+0000","last_undegraded":"2024-09-12T01:00:45.897964+0000","last_fullsized":"2024-09-12T01:00:45.897964+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:51.721224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":2348,"num_write":528,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"268'308","reported_seq":948,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.132717+0000","last_change":"2024-09-12T00:15:55.067779+0000","last_active":"2024-09-12T01:02:38.132717+0000","last_peered":"2024-09-12T01:02:38.132717+0000","last_clean":"2024-09-12T01:02:38.132717+0000","last_became_active":"2024-09-12T00:15:55.067030+0000","last_became_peered":"2024-09-12T00:15:55.067030+0000","last_unstale":"2024-09-12T01:02:38.132717+0000","last_undegraded":"2024-09-12T01:02:38.132717+0000","last_fullsized":"2024-09-12T01:02:38.132717+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:15.471567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5268077,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":455,"num_read_kb":33079,"num_write":975,"num_write_kb":28183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"268'485","reported_seq":2072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.168505+0000","last_change":"2024-09-12T00:15:57.037419+0000","last_active":"2024-09-12T01:00:52.168505+0000","last_peered":"2024-09-12T01:00:52.168505+0000","last_clean":"2024-09-12T01:00:52.168505+0000","last_became_active":"2024-09-12T00:15:57.037045+0000","last_became_peered":"2024-09-12T00:15:57.037045+0000","last_unstale":"2024-09-12T01:00:52.168505+0000","last_undegraded":"2024-09-12T01:00:52.168505+0000","last_fullsized":"2024-09-12T01:00:52.168505+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:10.231756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2556,"num_read_kb":2389,"num_write":592,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"268'316","reported_seq":1047,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.002382+0000","last_change":"2024-09-12T00:15:55.050401+0000","last_active":"2024-09-12T01:02:38.002382+0000","last_peered":"2024-09-12T01:02:38.002382+0000","last_clean":"2024-09-12T01:02:38.002382+0000","last_became_active":"2024-09-12T00:15:55.041976+0000","last_became_peered":"2024-09-12T00:15:55.041976+0000","last_unstale":"2024-09-12T01:02:38.002382+0000","last_undegraded":"2024-09-12T01:02:38.002382+0000","last_fullsized":"2024-09-12T01:02:38.002382+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:30.850752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7623121,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":613,"num_read_kb":92016,"num_write":1157,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"268'476","reported_seq":1929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506328+0000","last_change":"2024-09-12T00:15:57.013582+0000","last_active":"2024-09-12T01:01:09.506328+0000","last_peered":"2024-09-12T01:01:09.506328+0000","last_clean":"2024-09-12T01:01:09.506328+0000","last_became_active":"2024-09-12T00:15:57.013278+0000","last_became_peered":"2024-09-12T00:15:57.013278+0000","last_unstale":"2024-09-12T01:01:09.506328+0000","last_undegraded":"2024-09-12T01:01:09.506328+0000","last_fullsized":"2024-09-12T01:01:09.506328+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:44.317982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2343,"num_read_kb":2167,"num_write":566,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"268'243","reported_seq":890,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:38.129605+0000","last_change":"2024-09-12T00:15:55.070693+0000","last_active":"2024-09-12T01:00:38.129605+0000","last_peered":"2024-09-12T01:00:38.129605+0000","last_clean":"2024-09-12T01:00:38.129605+0000","last_became_active":"2024-09-12T00:15:55.060127+0000","last_became_peered":"2024-09-12T00:15:55.060127+0000","last_unstale":"2024-09-12T01:00:38.129605+0000","last_undegraded":"2024-09-12T01:00:38.129605+0000","last_fullsized":"2024-09-12T01:00:38.129605+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:18.762399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11570671,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":394,"num_read_kb":41433,"num_write":830,"num_write_kb":44478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"268'983","reported_seq":2514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:48.416472+0000","last_change":"2024-09-12T00:15:57.052355+0000","last_active":"2024-09-12T01:00:48.416472+0000","last_peered":"2024-09-12T01:00:48.416472+0000","last_clean":"2024-09-12T01:00:48.416472+0000","last_became_active":"2024-09-12T00:15:57.051665+0000","last_became_peered":"2024-09-12T00:15:57.051665+0000","last_unstale":"2024-09-12T01:00:48.416472+0000","last_undegraded":"2024-09-12T01:00:48.416472+0000","last_fullsized":"2024-09-12T01:00:48.416472+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":900,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:20.500797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4673,"num_read_kb":4124,"num_write":1393,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"268'888","reported_seq":2500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.446445+0000","last_change":"2024-09-12T00:15:57.032298+0000","last_active":"2024-09-12T01:01:06.446445+0000","last_peered":"2024-09-12T01:01:06.446445+0000","last_clean":"2024-09-12T01:01:06.446445+0000","last_became_active":"2024-09-12T00:15:57.031897+0000","last_became_peered":"2024-09-12T00:15:57.031897+0000","last_unstale":"2024-09-12T01:01:06.446445+0000","last_undegraded":"2024-09-12T01:01:06.446445+0000","last_fullsized":"2024-09-12T01:01:06.446445+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:00.128491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4303,"num_read_kb":3853,"num_write":1201,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"268'277","reported_seq":897,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.211770+0000","last_change":"2024-09-12T00:15:55.064283+0000","last_active":"2024-09-12T01:02:38.211770+0000","last_peered":"2024-09-12T01:02:38.211770+0000","last_clean":"2024-09-12T01:02:38.211770+0000","last_became_active":"2024-09-12T00:15:55.063797+0000","last_became_peered":"2024-09-12T00:15:55.063797+0000","last_unstale":"2024-09-12T01:02:38.211770+0000","last_undegraded":"2024-09-12T01:02:38.211770+0000","last_fullsized":"2024-09-12T01:02:38.211770+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:33.806593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":634,"num_objects":45,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":384,"num_read_kb":7341,"num_write":959,"num_write_kb":14342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"268'782","reported_seq":2212,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.159774+0000","last_change":"2024-09-12T00:15:57.017929+0000","last_active":"2024-09-12T01:01:02.159774+0000","last_peered":"2024-09-12T01:01:02.159774+0000","last_clean":"2024-09-12T01:01:02.159774+0000","last_became_active":"2024-09-12T00:15:57.017679+0000","last_became_peered":"2024-09-12T00:15:57.017679+0000","last_unstale":"2024-09-12T01:01:02.159774+0000","last_undegraded":"2024-09-12T01:01:02.159774+0000","last_fullsized":"2024-09-12T01:01:02.159774+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:58.830951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3571,"num_read_kb":3210,"num_write":1015,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"268'311","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:06.388977+0000","last_change":"2024-09-12T00:16:26.796331+0000","last_active":"2024-09-12T01:02:06.388977+0000","last_peered":"2024-09-12T01:02:06.388977+0000","last_clean":"2024-09-12T01:02:06.388977+0000","last_became_active":"2024-09-12T00:16:26.794438+0000","last_became_peered":"2024-09-12T00:16:26.794438+0000","last_unstale":"2024-09-12T01:02:06.388977+0000","last_undegraded":"2024-09-12T01:02:06.388977+0000","last_fullsized":"2024-09-12T01:02:06.388977+0000","mapping_epoch":39,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:59.877909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10798736,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":569,"num_read_kb":170107,"num_write":1067,"num_write_kb":45359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,6],"acting":[5,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"268'412","reported_seq":1882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:02.267039+0000","last_change":"2024-09-12T00:15:57.039877+0000","last_active":"2024-09-12T01:00:02.267039+0000","last_peered":"2024-09-12T01:00:02.267039+0000","last_clean":"2024-09-12T01:00:02.267039+0000","last_became_active":"2024-09-12T00:15:57.039474+0000","last_became_peered":"2024-09-12T00:15:57.039474+0000","last_unstale":"2024-09-12T01:00:02.267039+0000","last_undegraded":"2024-09-12T01:00:02.267039+0000","last_fullsized":"2024-09-12T01:00:02.267039+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:19.030086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2320,"num_read_kb":2162,"num_write":506,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"268'292","reported_seq":1034,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.959693+0000","last_change":"2024-09-12T00:15:55.066310+0000","last_active":"2024-09-12T01:02:37.959693+0000","last_peered":"2024-09-12T01:02:37.959693+0000","last_clean":"2024-09-12T01:02:37.959693+0000","last_became_active":"2024-09-12T00:15:55.060170+0000","last_became_peered":"2024-09-12T00:15:55.060170+0000","last_unstale":"2024-09-12T01:02:37.959693+0000","last_undegraded":"2024-09-12T01:02:37.959693+0000","last_fullsized":"2024-09-12T01:02:37.959693+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:43.105768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":310581,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":576,"num_read_kb":11665,"num_write":1024,"num_write_kb":19684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"268'454","reported_seq":2050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.869036+0000","last_change":"2024-09-12T00:15:57.044727+0000","last_active":"2024-09-12T01:02:10.869036+0000","last_peered":"2024-09-12T01:02:10.869036+0000","last_clean":"2024-09-12T01:02:10.869036+0000","last_became_active":"2024-09-12T00:15:57.044075+0000","last_became_peered":"2024-09-12T00:15:57.044075+0000","last_unstale":"2024-09-12T01:02:10.869036+0000","last_undegraded":"2024-09-12T01:02:10.869036+0000","last_fullsized":"2024-09-12T01:02:10.869036+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:10.231756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2345,"num_read_kb":2229,"num_write":503,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"268'320","reported_seq":1026,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.878031+0000","last_change":"2024-09-12T00:15:55.078923+0000","last_active":"2024-09-12T01:02:37.878031+0000","last_peered":"2024-09-12T01:02:37.878031+0000","last_clean":"2024-09-12T01:02:37.878031+0000","last_became_active":"2024-09-12T00:15:55.078352+0000","last_became_peered":"2024-09-12T00:15:55.078352+0000","last_unstale":"2024-09-12T01:02:37.878031+0000","last_undegraded":"2024-09-12T01:02:37.878031+0000","last_fullsized":"2024-09-12T01:02:37.878031+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:20.005373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3368728,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":620,"num_read_kb":46871,"num_write":1157,"num_write_kb":28820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"268'399","reported_seq":1872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.865538+0000","last_change":"2024-09-12T00:15:57.032920+0000","last_active":"2024-09-12T01:02:10.865538+0000","last_peered":"2024-09-12T01:02:10.865538+0000","last_clean":"2024-09-12T01:02:10.865538+0000","last_became_active":"2024-09-12T00:15:57.032173+0000","last_became_peered":"2024-09-12T00:15:57.032173+0000","last_unstale":"2024-09-12T01:02:10.865538+0000","last_undegraded":"2024-09-12T01:02:10.865538+0000","last_fullsized":"2024-09-12T01:02:10.865538+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:23.061664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2107,"num_read_kb":2010,"num_write":461,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"268'306","reported_seq":1029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.083676+0000","last_change":"2024-09-12T00:15:55.067201+0000","last_active":"2024-09-12T01:02:38.083676+0000","last_peered":"2024-09-12T01:02:38.083676+0000","last_clean":"2024-09-12T01:02:38.083676+0000","last_became_active":"2024-09-12T00:15:55.066304+0000","last_became_peered":"2024-09-12T00:15:55.066304+0000","last_unstale":"2024-09-12T01:02:38.083676+0000","last_undegraded":"2024-09-12T01:02:38.083676+0000","last_fullsized":"2024-09-12T01:02:38.083676+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:31.298321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22043280,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":627,"num_read_kb":58379,"num_write":1099,"num_write_kb":49764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"268'1197","reported_seq":3218,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506270+0000","last_change":"2024-09-12T00:15:57.021981+0000","last_active":"2024-09-12T01:01:09.506270+0000","last_peered":"2024-09-12T01:01:09.506270+0000","last_clean":"2024-09-12T01:01:09.506270+0000","last_became_active":"2024-09-12T00:15:57.021605+0000","last_became_peered":"2024-09-12T00:15:57.021605+0000","last_unstale":"2024-09-12T01:01:09.506270+0000","last_undegraded":"2024-09-12T01:01:09.506270+0000","last_fullsized":"2024-09-12T01:01:09.506270+0000","mapping_epoch":28,"log_start":"268'1100","ondisk_log_start":"268'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":1100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:38.616266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6433,"num_read_kb":5744,"num_write":1768,"num_write_kb":831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"268'263","reported_seq":894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.168707+0000","last_change":"2024-09-12T00:15:55.052710+0000","last_active":"2024-09-12T01:02:38.168707+0000","last_peered":"2024-09-12T01:02:38.168707+0000","last_clean":"2024-09-12T01:02:38.168707+0000","last_became_active":"2024-09-12T00:15:55.050860+0000","last_became_peered":"2024-09-12T00:15:55.050860+0000","last_unstale":"2024-09-12T01:02:38.168707+0000","last_undegraded":"2024-09-12T01:02:38.168707+0000","last_fullsized":"2024-09-12T01:02:38.168707+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:08.086426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439086,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":436,"num_read_kb":8796,"num_write":947,"num_write_kb":26056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"268'150","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.320340+0000","last_change":"2024-09-12T00:16:05.096232+0000","last_active":"2024-09-12T01:01:07.320340+0000","last_peered":"2024-09-12T01:01:07.320340+0000","last_clean":"2024-09-12T01:01:07.320340+0000","last_became_active":"2024-09-12T00:16:05.095632+0000","last_became_peered":"2024-09-12T00:16:05.095632+0000","last_unstale":"2024-09-12T01:01:07.320340+0000","last_undegraded":"2024-09-12T01:01:07.320340+0000","last_fullsized":"2024-09-12T01:01:07.320340+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:47.445460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":139,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"268'388","reported_seq":1858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.446472+0000","last_change":"2024-09-12T00:15:57.044606+0000","last_active":"2024-09-12T01:01:06.446472+0000","last_peered":"2024-09-12T01:01:06.446472+0000","last_clean":"2024-09-12T01:01:06.446472+0000","last_became_active":"2024-09-12T00:15:57.042317+0000","last_became_peered":"2024-09-12T00:15:57.042317+0000","last_unstale":"2024-09-12T01:01:06.446472+0000","last_undegraded":"2024-09-12T01:01:06.446472+0000","last_fullsized":"2024-09-12T01:01:06.446472+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:47.707278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2080,"num_read_kb":1982,"num_write":441,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"268'334","reported_seq":983,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.611122+0000","last_change":"2024-09-12T00:15:55.043571+0000","last_active":"2024-09-12T01:02:38.611122+0000","last_peered":"2024-09-12T01:02:38.611122+0000","last_clean":"2024-09-12T01:02:38.611122+0000","last_became_active":"2024-09-12T00:15:55.042690+0000","last_became_peered":"2024-09-12T00:15:55.042690+0000","last_unstale":"2024-09-12T01:02:38.611122+0000","last_undegraded":"2024-09-12T01:02:38.611122+0000","last_fullsized":"2024-09-12T01:02:38.611122+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:22.575508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288790,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":506,"num_read_kb":60082,"num_write":1091,"num_write_kb":36322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219465+0000","last_change":"2024-09-12T00:15:59.047089+0000","last_active":"2024-09-12T00:59:29.219465+0000","last_peered":"2024-09-12T00:59:29.219465+0000","last_clean":"2024-09-12T00:59:29.219465+0000","last_became_active":"2024-09-12T00:15:59.046334+0000","last_became_peered":"2024-09-12T00:15:59.046334+0000","last_unstale":"2024-09-12T00:59:29.219465+0000","last_undegraded":"2024-09-12T00:59:29.219465+0000","last_fullsized":"2024-09-12T00:59:29.219465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:50.471898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"268'355","reported_seq":970,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.995930+0000","last_change":"2024-09-12T00:16:01.058485+0000","last_active":"2024-09-12T01:02:11.995930+0000","last_peered":"2024-09-12T01:02:11.995930+0000","last_clean":"2024-09-12T01:02:11.995930+0000","last_became_active":"2024-09-12T00:16:01.057657+0000","last_became_peered":"2024-09-12T00:16:01.057657+0000","last_unstale":"2024-09-12T01:02:11.995930+0000","last_undegraded":"2024-09-12T01:02:11.995930+0000","last_fullsized":"2024-09-12T01:02:11.995930+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:28.536472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62439,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":587,"num_read_kb":1145,"num_write":476,"num_write_kb":344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185238+0000","last_change":"2024-09-12T00:16:03.099188+0000","last_active":"2024-09-12T00:59:33.185238+0000","last_peered":"2024-09-12T00:59:33.185238+0000","last_clean":"2024-09-12T00:59:33.185238+0000","last_became_active":"2024-09-12T00:16:03.098506+0000","last_became_peered":"2024-09-12T00:16:03.098506+0000","last_unstale":"2024-09-12T00:59:33.185238+0000","last_undegraded":"2024-09-12T00:59:33.185238+0000","last_fullsized":"2024-09-12T00:59:33.185238+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:09.926077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"268'152","reported_seq":715,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.258951+0000","last_change":"2024-09-12T00:16:05.105689+0000","last_active":"2024-09-12T01:01:02.258951+0000","last_peered":"2024-09-12T01:01:02.258951+0000","last_clean":"2024-09-12T01:01:02.258951+0000","last_became_active":"2024-09-12T00:16:05.105153+0000","last_became_peered":"2024-09-12T00:16:05.105153+0000","last_unstale":"2024-09-12T01:01:02.258951+0000","last_undegraded":"2024-09-12T01:01:02.258951+0000","last_fullsized":"2024-09-12T01:01:02.258951+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:12.364784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":214,"num_write":299,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"268'897","reported_seq":2521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.015147+0000","last_change":"2024-09-12T00:15:57.018776+0000","last_active":"2024-09-12T01:00:47.015147+0000","last_peered":"2024-09-12T01:00:47.015147+0000","last_clean":"2024-09-12T01:00:47.015147+0000","last_became_active":"2024-09-12T00:15:57.018484+0000","last_became_peered":"2024-09-12T00:15:57.018484+0000","last_unstale":"2024-09-12T01:00:47.015147+0000","last_undegraded":"2024-09-12T01:00:47.015147+0000","last_fullsized":"2024-09-12T01:00:47.015147+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":800,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:46.467646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4265,"num_read_kb":3809,"num_write":1199,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"268'332","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.188512+0000","last_change":"2024-09-12T00:15:55.067220+0000","last_active":"2024-09-12T01:02:38.188512+0000","last_peered":"2024-09-12T01:02:38.188512+0000","last_clean":"2024-09-12T01:02:38.188512+0000","last_became_active":"2024-09-12T00:15:55.065476+0000","last_became_peered":"2024-09-12T00:15:55.065476+0000","last_unstale":"2024-09-12T01:02:38.188512+0000","last_undegraded":"2024-09-12T01:02:38.188512+0000","last_fullsized":"2024-09-12T01:02:38.188512+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:58.771415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":428686,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":548,"num_read_kb":7666,"num_write":1188,"num_write_kb":15378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:13.159333+0000","last_change":"2024-09-12T00:15:59.041196+0000","last_active":"2024-09-12T00:58:13.159333+0000","last_peered":"2024-09-12T00:58:13.159333+0000","last_clean":"2024-09-12T00:58:13.159333+0000","last_became_active":"2024-09-12T00:15:59.040412+0000","last_became_peered":"2024-09-12T00:15:59.040412+0000","last_unstale":"2024-09-12T00:58:13.159333+0000","last_undegraded":"2024-09-12T00:58:13.159333+0000","last_fullsized":"2024-09-12T00:58:13.159333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:37.117865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"268'89","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:59.917462+0000","last_change":"2024-09-12T00:16:01.067472+0000","last_active":"2024-09-12T00:59:59.917462+0000","last_peered":"2024-09-12T00:59:59.917462+0000","last_clean":"2024-09-12T00:59:59.917462+0000","last_became_active":"2024-09-12T00:16:01.062780+0000","last_became_peered":"2024-09-12T00:16:01.062780+0000","last_unstale":"2024-09-12T00:59:59.917462+0000","last_undegraded":"2024-09-12T00:59:59.917462+0000","last_fullsized":"2024-09-12T00:59:59.917462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:25.299928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185153+0000","last_change":"2024-09-12T00:16:03.092617+0000","last_active":"2024-09-12T00:59:33.185153+0000","last_peered":"2024-09-12T00:59:33.185153+0000","last_clean":"2024-09-12T00:59:33.185153+0000","last_became_active":"2024-09-12T00:16:03.091926+0000","last_became_peered":"2024-09-12T00:16:03.091926+0000","last_unstale":"2024-09-12T00:59:33.185153+0000","last_undegraded":"2024-09-12T00:59:33.185153+0000","last_fullsized":"2024-09-12T00:59:33.185153+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:35.129510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"268'125","reported_seq":621,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:05.844320+0000","last_change":"2024-09-12T00:16:05.115080+0000","last_active":"2024-09-12T01:01:05.844320+0000","last_peered":"2024-09-12T01:01:05.844320+0000","last_clean":"2024-09-12T01:01:05.844320+0000","last_became_active":"2024-09-12T00:16:05.114182+0000","last_became_peered":"2024-09-12T00:16:05.114182+0000","last_unstale":"2024-09-12T01:01:05.844320+0000","last_undegraded":"2024-09-12T01:01:05.844320+0000","last_fullsized":"2024-09-12T01:01:05.844320+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:12.382388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":293,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"268'1230","reported_seq":2685,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.015822+0000","last_change":"2024-09-12T00:15:57.047647+0000","last_active":"2024-09-12T01:00:47.015822+0000","last_peered":"2024-09-12T01:00:47.015822+0000","last_clean":"2024-09-12T01:00:47.015822+0000","last_became_active":"2024-09-12T00:15:57.046916+0000","last_became_peered":"2024-09-12T00:15:57.046916+0000","last_unstale":"2024-09-12T01:00:47.015822+0000","last_undegraded":"2024-09-12T01:00:47.015822+0000","last_fullsized":"2024-09-12T01:00:47.015822+0000","mapping_epoch":28,"log_start":"268'1200","ondisk_log_start":"268'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:00.710335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5641,"num_read_kb":4945,"num_write":1755,"num_write_kb":746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"268'341","reported_seq":1125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.683511+0000","last_change":"2024-09-12T00:15:55.064793+0000","last_active":"2024-09-12T01:02:38.683511+0000","last_peered":"2024-09-12T01:02:38.683511+0000","last_clean":"2024-09-12T01:02:38.683511+0000","last_became_active":"2024-09-12T00:15:55.058428+0000","last_became_peered":"2024-09-12T00:15:55.058428+0000","last_unstale":"2024-09-12T01:02:38.683511+0000","last_undegraded":"2024-09-12T01:02:38.683511+0000","last_fullsized":"2024-09-12T01:02:38.683511+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:12.660366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1929,"num_objects":43,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":684,"num_read_kb":690,"num_write":1219,"num_write_kb":29311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179931+0000","last_change":"2024-09-12T00:15:59.040242+0000","last_active":"2024-09-12T00:59:33.179931+0000","last_peered":"2024-09-12T00:59:33.179931+0000","last_clean":"2024-09-12T00:59:33.179931+0000","last_became_active":"2024-09-12T00:15:59.039465+0000","last_became_peered":"2024-09-12T00:15:59.039465+0000","last_unstale":"2024-09-12T00:59:33.179931+0000","last_undegraded":"2024-09-12T00:59:33.179931+0000","last_fullsized":"2024-09-12T00:59:33.179931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:02.272155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"268'130","reported_seq":681,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:22.544313+0000","last_change":"2024-09-12T00:16:01.057413+0000","last_active":"2024-09-12T00:59:22.544313+0000","last_peered":"2024-09-12T00:59:22.544313+0000","last_clean":"2024-09-12T00:59:22.544313+0000","last_became_active":"2024-09-12T00:16:01.056702+0000","last_became_peered":"2024-09-12T00:16:01.056702+0000","last_unstale":"2024-09-12T00:59:22.544313+0000","last_undegraded":"2024-09-12T00:59:22.544313+0000","last_fullsized":"2024-09-12T00:59:22.544313+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:41.238549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":144,"num_read_kb":136,"num_write":100,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"268'799","reported_seq":2222,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.130042+0000","last_change":"2024-09-12T00:16:03.104735+0000","last_active":"2024-09-12T01:02:37.130042+0000","last_peered":"2024-09-12T01:02:37.130042+0000","last_clean":"2024-09-12T01:02:37.130042+0000","last_became_active":"2024-09-12T00:16:03.103292+0000","last_became_peered":"2024-09-12T00:16:03.103292+0000","last_unstale":"2024-09-12T01:02:37.130042+0000","last_undegraded":"2024-09-12T01:02:37.130042+0000","last_fullsized":"2024-09-12T01:02:37.130042+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:21.322414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"268'234","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.369432+0000","last_change":"2024-09-12T00:16:05.108369+0000","last_active":"2024-09-12T01:01:07.369432+0000","last_peered":"2024-09-12T01:01:07.369432+0000","last_clean":"2024-09-12T01:01:07.369432+0000","last_became_active":"2024-09-12T00:16:05.107785+0000","last_became_peered":"2024-09-12T00:16:05.107785+0000","last_unstale":"2024-09-12T01:01:07.369432+0000","last_undegraded":"2024-09-12T01:01:07.369432+0000","last_fullsized":"2024-09-12T01:01:07.369432+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:30.275724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":637,"num_write":534,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"268'635","reported_seq":2161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.998760+0000","last_change":"2024-09-12T00:15:57.036539+0000","last_active":"2024-09-12T01:00:39.998760+0000","last_peered":"2024-09-12T01:00:39.998760+0000","last_clean":"2024-09-12T01:00:39.998760+0000","last_became_active":"2024-09-12T00:15:57.035581+0000","last_became_peered":"2024-09-12T00:15:57.035581+0000","last_unstale":"2024-09-12T01:00:39.998760+0000","last_undegraded":"2024-09-12T01:00:39.998760+0000","last_fullsized":"2024-09-12T01:00:39.998760+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":600,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:01.577455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3178,"num_read_kb":2956,"num_write":875,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"268'297","reported_seq":963,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.184044+0000","last_change":"2024-09-12T00:15:55.065992+0000","last_active":"2024-09-12T01:02:38.184044+0000","last_peered":"2024-09-12T01:02:38.184044+0000","last_clean":"2024-09-12T01:02:38.184044+0000","last_became_active":"2024-09-12T00:15:55.065178+0000","last_became_peered":"2024-09-12T00:15:55.065178+0000","last_unstale":"2024-09-12T01:02:38.184044+0000","last_undegraded":"2024-09-12T01:02:38.184044+0000","last_fullsized":"2024-09-12T01:02:38.184044+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:42.418779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289383,"num_objects":47,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":528,"num_read_kb":563,"num_write":1100,"num_write_kb":21852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219511+0000","last_change":"2024-09-12T00:15:59.040434+0000","last_active":"2024-09-12T00:59:29.219511+0000","last_peered":"2024-09-12T00:59:29.219511+0000","last_clean":"2024-09-12T00:59:29.219511+0000","last_became_active":"2024-09-12T00:15:59.039902+0000","last_became_peered":"2024-09-12T00:15:59.039902+0000","last_unstale":"2024-09-12T00:59:29.219511+0000","last_undegraded":"2024-09-12T00:59:29.219511+0000","last_fullsized":"2024-09-12T00:59:29.219511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:50.427091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"268'275","reported_seq":842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.981756+0000","last_change":"2024-09-12T00:16:01.053456+0000","last_active":"2024-09-12T01:02:11.981756+0000","last_peered":"2024-09-12T01:02:11.981756+0000","last_clean":"2024-09-12T01:02:11.981756+0000","last_became_active":"2024-09-12T00:16:01.052744+0000","last_became_peered":"2024-09-12T00:16:01.052744+0000","last_unstale":"2024-09-12T01:02:11.981756+0000","last_undegraded":"2024-09-12T01:02:11.981756+0000","last_fullsized":"2024-09-12T01:02:11.981756+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:17.018417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56108,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":935,"num_write":372,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"268'810","reported_seq":2455,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.078335+0000","last_change":"2024-09-12T00:16:03.098659+0000","last_active":"2024-09-12T01:02:12.078335+0000","last_peered":"2024-09-12T01:02:12.078335+0000","last_clean":"2024-09-12T01:02:12.078335+0000","last_became_active":"2024-09-12T00:16:03.097895+0000","last_became_peered":"2024-09-12T00:16:03.097895+0000","last_unstale":"2024-09-12T01:02:12.078335+0000","last_undegraded":"2024-09-12T01:02:12.078335+0000","last_fullsized":"2024-09-12T01:02:12.078335+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:25.934943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"268'458","reported_seq":2011,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.582816+0000","last_change":"2024-09-12T00:15:57.023912+0000","last_active":"2024-09-12T01:01:09.582816+0000","last_peered":"2024-09-12T01:01:09.582816+0000","last_clean":"2024-09-12T01:01:09.582816+0000","last_became_active":"2024-09-12T00:15:57.023659+0000","last_became_peered":"2024-09-12T00:15:57.023659+0000","last_unstale":"2024-09-12T01:01:09.582816+0000","last_undegraded":"2024-09-12T01:01:09.582816+0000","last_fullsized":"2024-09-12T01:01:09.582816+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:02.798248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2457,"num_read_kb":2306,"num_write":563,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"268'329","reported_seq":960,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.004795+0000","last_change":"2024-09-12T00:15:55.066577+0000","last_active":"2024-09-12T01:02:38.004795+0000","last_peered":"2024-09-12T01:02:38.004795+0000","last_clean":"2024-09-12T01:02:38.004795+0000","last_became_active":"2024-09-12T00:15:55.060679+0000","last_became_peered":"2024-09-12T00:15:55.060679+0000","last_unstale":"2024-09-12T01:02:38.004795+0000","last_undegraded":"2024-09-12T01:02:38.004795+0000","last_fullsized":"2024-09-12T01:02:38.004795+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:10.882193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39798,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":438,"num_read_kb":16773,"num_write":1098,"num_write_kb":29370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:23.182560+0000","last_change":"2024-09-12T00:15:59.035705+0000","last_active":"2024-09-12T00:59:23.182560+0000","last_peered":"2024-09-12T00:59:23.182560+0000","last_clean":"2024-09-12T00:59:23.182560+0000","last_became_active":"2024-09-12T00:15:59.035288+0000","last_became_peered":"2024-09-12T00:15:59.035288+0000","last_unstale":"2024-09-12T00:59:23.182560+0000","last_undegraded":"2024-09-12T00:59:23.182560+0000","last_fullsized":"2024-09-12T00:59:23.182560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:46.726241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"268'349","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.443258+0000","last_change":"2024-09-12T00:16:01.070645+0000","last_active":"2024-09-12T01:02:37.443258+0000","last_peered":"2024-09-12T01:02:37.443258+0000","last_clean":"2024-09-12T01:02:37.443258+0000","last_became_active":"2024-09-12T00:16:01.069838+0000","last_became_peered":"2024-09-12T00:16:01.069838+0000","last_unstale":"2024-09-12T01:02:37.443258+0000","last_undegraded":"2024-09-12T01:02:37.443258+0000","last_fullsized":"2024-09-12T01:02:37.443258+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:57.640957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45025,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":563,"num_read_kb":1131,"num_write":438,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.162032+0000","last_change":"2024-09-12T00:16:03.090231+0000","last_active":"2024-09-12T00:58:48.162032+0000","last_peered":"2024-09-12T00:58:48.162032+0000","last_clean":"2024-09-12T00:58:48.162032+0000","last_became_active":"2024-09-12T00:16:03.089533+0000","last_became_peered":"2024-09-12T00:16:03.089533+0000","last_unstale":"2024-09-12T00:58:48.162032+0000","last_undegraded":"2024-09-12T00:58:48.162032+0000","last_fullsized":"2024-09-12T00:58:48.162032+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:22.033467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"268'572","reported_seq":1384,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.041861+0000","last_change":"2024-09-12T00:16:05.114168+0000","last_active":"2024-09-12T01:02:12.041861+0000","last_peered":"2024-09-12T01:02:12.041861+0000","last_clean":"2024-09-12T01:02:12.041861+0000","last_became_active":"2024-09-12T00:16:05.112960+0000","last_became_peered":"2024-09-12T00:16:05.112960+0000","last_unstale":"2024-09-12T01:02:12.041861+0000","last_undegraded":"2024-09-12T01:02:12.041861+0000","last_fullsized":"2024-09-12T01:02:12.041861+0000","mapping_epoch":36,"log_start":"268'500","ondisk_log_start":"268'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:15.906818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1305,"num_read_kb":1300,"num_write":1202,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"268'522","reported_seq":2000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.582686+0000","last_change":"2024-09-12T00:15:57.045470+0000","last_active":"2024-09-12T01:01:09.582686+0000","last_peered":"2024-09-12T01:01:09.582686+0000","last_clean":"2024-09-12T01:01:09.582686+0000","last_became_active":"2024-09-12T00:15:57.045141+0000","last_became_peered":"2024-09-12T00:15:57.045141+0000","last_unstale":"2024-09-12T01:01:09.582686+0000","last_undegraded":"2024-09-12T01:01:09.582686+0000","last_fullsized":"2024-09-12T01:01:09.582686+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.221530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2585,"num_read_kb":2367,"num_write":669,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"268'319","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.131979+0000","last_change":"2024-09-12T00:15:55.065308+0000","last_active":"2024-09-12T01:02:38.131979+0000","last_peered":"2024-09-12T01:02:38.131979+0000","last_clean":"2024-09-12T01:02:38.131979+0000","last_became_active":"2024-09-12T00:15:55.063542+0000","last_became_peered":"2024-09-12T00:15:55.063542+0000","last_unstale":"2024-09-12T01:02:38.131979+0000","last_undegraded":"2024-09-12T01:02:38.131979+0000","last_fullsized":"2024-09-12T01:02:38.131979+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:07.380766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6319256,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":508,"num_read_kb":24074,"num_write":1199,"num_write_kb":38232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:23.170976+0000","last_change":"2024-09-12T00:15:59.051412+0000","last_active":"2024-09-12T00:59:23.170976+0000","last_peered":"2024-09-12T00:59:23.170976+0000","last_clean":"2024-09-12T00:59:23.170976+0000","last_became_active":"2024-09-12T00:15:59.050663+0000","last_became_peered":"2024-09-12T00:15:59.050663+0000","last_unstale":"2024-09-12T00:59:23.170976+0000","last_undegraded":"2024-09-12T00:59:23.170976+0000","last_fullsized":"2024-09-12T00:59:23.170976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:36.230495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"268'242","reported_seq":818,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.953612+0000","last_change":"2024-09-12T00:16:01.069772+0000","last_active":"2024-09-12T01:02:11.953612+0000","last_peered":"2024-09-12T01:02:11.953612+0000","last_clean":"2024-09-12T01:02:11.953612+0000","last_became_active":"2024-09-12T00:16:01.068392+0000","last_became_peered":"2024-09-12T00:16:01.068392+0000","last_unstale":"2024-09-12T01:02:11.953612+0000","last_undegraded":"2024-09-12T01:02:11.953612+0000","last_fullsized":"2024-09-12T01:02:11.953612+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:56.300773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44027,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":379,"num_read_kb":770,"num_write":302,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179776+0000","last_change":"2024-09-12T00:16:03.087496+0000","last_active":"2024-09-12T00:59:33.179776+0000","last_peered":"2024-09-12T00:59:33.179776+0000","last_clean":"2024-09-12T00:59:33.179776+0000","last_became_active":"2024-09-12T00:16:03.086751+0000","last_became_peered":"2024-09-12T00:16:03.086751+0000","last_unstale":"2024-09-12T00:59:33.179776+0000","last_undegraded":"2024-09-12T00:59:33.179776+0000","last_fullsized":"2024-09-12T00:59:33.179776+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:20.968600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"268'2410","reported_seq":4246,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.403542+0000","last_change":"2024-09-12T00:16:05.115334+0000","last_active":"2024-09-12T01:02:01.403542+0000","last_peered":"2024-09-12T01:02:01.403542+0000","last_clean":"2024-09-12T01:02:01.403542+0000","last_became_active":"2024-09-12T00:16:05.114563+0000","last_became_peered":"2024-09-12T00:16:05.114563+0000","last_unstale":"2024-09-12T01:02:01.403542+0000","last_undegraded":"2024-09-12T01:02:01.403542+0000","last_fullsized":"2024-09-12T01:02:01.403542+0000","mapping_epoch":36,"log_start":"268'2300","ondisk_log_start":"268'2300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":2300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:14.259829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6030,"num_read_kb":6028,"num_write":4877,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"268'783","reported_seq":2354,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.582663+0000","last_change":"2024-09-12T00:15:57.024963+0000","last_active":"2024-09-12T01:01:09.582663+0000","last_peered":"2024-09-12T01:01:09.582663+0000","last_clean":"2024-09-12T01:01:09.582663+0000","last_became_active":"2024-09-12T00:15:57.024509+0000","last_became_peered":"2024-09-12T00:15:57.024509+0000","last_unstale":"2024-09-12T01:01:09.582663+0000","last_undegraded":"2024-09-12T01:01:09.582663+0000","last_fullsized":"2024-09-12T01:01:09.582663+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:39.327515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3769,"num_read_kb":3415,"num_write":1030,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"268'321","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.551960+0000","last_change":"2024-09-12T00:15:55.055309+0000","last_active":"2024-09-12T01:02:38.551960+0000","last_peered":"2024-09-12T01:02:38.551960+0000","last_clean":"2024-09-12T01:02:38.551960+0000","last_became_active":"2024-09-12T00:15:55.052916+0000","last_became_peered":"2024-09-12T00:15:55.052916+0000","last_unstale":"2024-09-12T01:02:38.551960+0000","last_undegraded":"2024-09-12T01:02:38.551960+0000","last_fullsized":"2024-09-12T01:02:38.551960+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:37.807496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":331521,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":455,"num_read_kb":37815,"num_write":1117,"num_write_kb":39957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:47.188865+0000","last_change":"2024-09-12T00:15:59.035302+0000","last_active":"2024-09-12T00:58:47.188865+0000","last_peered":"2024-09-12T00:58:47.188865+0000","last_clean":"2024-09-12T00:58:47.188865+0000","last_became_active":"2024-09-12T00:15:59.034650+0000","last_became_peered":"2024-09-12T00:15:59.034650+0000","last_unstale":"2024-09-12T00:58:47.188865+0000","last_undegraded":"2024-09-12T00:58:47.188865+0000","last_fullsized":"2024-09-12T00:58:47.188865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:26.439328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"268'318","reported_seq":922,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.593445+0000","last_change":"2024-09-12T00:16:01.059061+0000","last_active":"2024-09-12T01:02:37.593445+0000","last_peered":"2024-09-12T01:02:37.593445+0000","last_clean":"2024-09-12T01:02:37.593445+0000","last_became_active":"2024-09-12T00:16:01.057281+0000","last_became_peered":"2024-09-12T00:16:01.057281+0000","last_unstale":"2024-09-12T01:02:37.593445+0000","last_undegraded":"2024-09-12T01:02:37.593445+0000","last_fullsized":"2024-09-12T01:02:37.593445+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:55.215685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49581,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":504,"num_read_kb":1060,"num_write":406,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"268'810","reported_seq":2418,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.080945+0000","last_change":"2024-09-12T00:16:03.098169+0000","last_active":"2024-09-12T01:02:12.080945+0000","last_peered":"2024-09-12T01:02:12.080945+0000","last_clean":"2024-09-12T01:02:12.080945+0000","last_became_active":"2024-09-12T00:16:03.097554+0000","last_became_peered":"2024-09-12T00:16:03.097554+0000","last_unstale":"2024-09-12T01:02:12.080945+0000","last_undegraded":"2024-09-12T01:02:12.080945+0000","last_fullsized":"2024-09-12T01:02:12.080945+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:01.820378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"268'94","reported_seq":599,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.780044+0000","last_change":"2024-09-12T00:16:05.113044+0000","last_active":"2024-09-12T01:02:10.780044+0000","last_peered":"2024-09-12T01:02:10.780044+0000","last_clean":"2024-09-12T01:02:10.780044+0000","last_became_active":"2024-09-12T00:16:05.112524+0000","last_became_peered":"2024-09-12T00:16:05.112524+0000","last_unstale":"2024-09-12T01:02:10.780044+0000","last_undegraded":"2024-09-12T01:02:10.780044+0000","last_fullsized":"2024-09-12T01:02:10.780044+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:08.645097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":109,"num_write":225,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"268'456","reported_seq":1823,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.422425+0000","last_change":"2024-09-12T00:15:57.043306+0000","last_active":"2024-09-12T01:01:06.422425+0000","last_peered":"2024-09-12T01:01:06.422425+0000","last_clean":"2024-09-12T01:01:06.422425+0000","last_became_active":"2024-09-12T00:15:57.042663+0000","last_became_peered":"2024-09-12T00:15:57.042663+0000","last_unstale":"2024-09-12T01:01:06.422425+0000","last_undegraded":"2024-09-12T01:01:06.422425+0000","last_fullsized":"2024-09-12T01:01:06.422425+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:27.809795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2110,"num_read_kb":1961,"num_write":540,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"268'313","reported_seq":1054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.871417+0000","last_change":"2024-09-12T00:15:55.060102+0000","last_active":"2024-09-12T01:02:37.871417+0000","last_peered":"2024-09-12T01:02:37.871417+0000","last_clean":"2024-09-12T01:02:37.871417+0000","last_became_active":"2024-09-12T00:15:55.054533+0000","last_became_peered":"2024-09-12T00:15:55.054533+0000","last_unstale":"2024-09-12T01:02:37.871417+0000","last_undegraded":"2024-09-12T01:02:37.871417+0000","last_fullsized":"2024-09-12T01:02:37.871417+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:15.618277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10753529,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":761,"num_read_kb":57067,"num_write":1094,"num_write_kb":15994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.173416+0000","last_change":"2024-09-12T00:15:59.037952+0000","last_active":"2024-09-12T00:59:33.173416+0000","last_peered":"2024-09-12T00:59:33.173416+0000","last_clean":"2024-09-12T00:59:33.173416+0000","last_became_active":"2024-09-12T00:15:59.037145+0000","last_became_peered":"2024-09-12T00:15:59.037145+0000","last_unstale":"2024-09-12T00:59:33.173416+0000","last_undegraded":"2024-09-12T00:59:33.173416+0000","last_fullsized":"2024-09-12T00:59:33.173416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:33.825886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"268'481","reported_seq":1125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.749434+0000","last_change":"2024-09-12T00:16:01.069486+0000","last_active":"2024-09-12T01:02:37.749434+0000","last_peered":"2024-09-12T01:02:37.749434+0000","last_clean":"2024-09-12T01:02:37.749434+0000","last_became_active":"2024-09-12T00:16:01.068496+0000","last_became_peered":"2024-09-12T00:16:01.068496+0000","last_unstale":"2024-09-12T01:02:37.749434+0000","last_undegraded":"2024-09-12T01:02:37.749434+0000","last_fullsized":"2024-09-12T01:02:37.749434+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":400,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:18.290612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100877,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":833,"num_read_kb":1897,"num_write":686,"num_write_kb":579,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.198874+0000","last_change":"2024-09-12T00:16:03.102755+0000","last_active":"2024-09-12T00:59:27.198874+0000","last_peered":"2024-09-12T00:59:27.198874+0000","last_clean":"2024-09-12T00:59:27.198874+0000","last_became_active":"2024-09-12T00:16:03.101984+0000","last_became_peered":"2024-09-12T00:16:03.101984+0000","last_unstale":"2024-09-12T00:59:27.198874+0000","last_undegraded":"2024-09-12T00:59:27.198874+0000","last_fullsized":"2024-09-12T00:59:27.198874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:46.673834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"268'131","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.211991+0000","last_change":"2024-09-12T00:16:05.105645+0000","last_active":"2024-09-12T01:01:07.211991+0000","last_peered":"2024-09-12T01:01:07.211991+0000","last_clean":"2024-09-12T01:01:07.211991+0000","last_became_active":"2024-09-12T00:16:05.104674+0000","last_became_peered":"2024-09-12T00:16:05.104674+0000","last_unstale":"2024-09-12T01:01:07.211991+0000","last_undegraded":"2024-09-12T01:01:07.211991+0000","last_fullsized":"2024-09-12T01:01:07.211991+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:09.821079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":121,"num_write":297,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"268'781","reported_seq":2286,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.868337+0000","last_change":"2024-09-12T00:15:57.017588+0000","last_active":"2024-09-12T01:02:10.868337+0000","last_peered":"2024-09-12T01:02:10.868337+0000","last_clean":"2024-09-12T01:02:10.868337+0000","last_became_active":"2024-09-12T00:15:57.016954+0000","last_became_peered":"2024-09-12T00:15:57.016954+0000","last_unstale":"2024-09-12T01:02:10.868337+0000","last_undegraded":"2024-09-12T01:02:10.868337+0000","last_fullsized":"2024-09-12T01:02:10.868337+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:04.997592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3833,"num_read_kb":3467,"num_write":1045,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"268'244","reported_seq":847,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:10.266296+0000","last_change":"2024-09-12T00:15:55.063836+0000","last_active":"2024-09-12T00:59:10.266296+0000","last_peered":"2024-09-12T00:59:10.266296+0000","last_clean":"2024-09-12T00:59:10.266296+0000","last_became_active":"2024-09-12T00:15:55.062854+0000","last_became_peered":"2024-09-12T00:15:55.062854+0000","last_unstale":"2024-09-12T00:59:10.266296+0000","last_undegraded":"2024-09-12T00:59:10.266296+0000","last_fullsized":"2024-09-12T00:59:10.266296+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:50.512780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12868368,"num_objects":63,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":354,"num_read_kb":12698,"num_write":917,"num_write_kb":17642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:47.164632+0000","last_change":"2024-09-12T00:15:59.034591+0000","last_active":"2024-09-12T00:58:47.164632+0000","last_peered":"2024-09-12T00:58:47.164632+0000","last_clean":"2024-09-12T00:58:47.164632+0000","last_became_active":"2024-09-12T00:15:59.033844+0000","last_became_peered":"2024-09-12T00:15:59.033844+0000","last_unstale":"2024-09-12T00:58:47.164632+0000","last_undegraded":"2024-09-12T00:58:47.164632+0000","last_fullsized":"2024-09-12T00:58:47.164632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:37.678048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"268'313","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.965178+0000","last_change":"2024-09-12T00:16:01.068155+0000","last_active":"2024-09-12T01:02:11.965178+0000","last_peered":"2024-09-12T01:02:11.965178+0000","last_clean":"2024-09-12T01:02:11.965178+0000","last_became_active":"2024-09-12T00:16:01.067377+0000","last_became_peered":"2024-09-12T00:16:01.067377+0000","last_unstale":"2024-09-12T01:02:11.965178+0000","last_undegraded":"2024-09-12T01:02:11.965178+0000","last_fullsized":"2024-09-12T01:02:11.965178+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:04.239296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61827,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":536,"num_read_kb":1083,"num_write":490,"num_write_kb":411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168204+0000","last_change":"2024-09-12T00:16:03.079750+0000","last_active":"2024-09-12T00:59:02.168204+0000","last_peered":"2024-09-12T00:59:02.168204+0000","last_clean":"2024-09-12T00:59:02.168204+0000","last_became_active":"2024-09-12T00:16:03.079004+0000","last_became_peered":"2024-09-12T00:16:03.079004+0000","last_unstale":"2024-09-12T00:59:02.168204+0000","last_undegraded":"2024-09-12T00:59:02.168204+0000","last_fullsized":"2024-09-12T00:59:02.168204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:46.457515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"268'127","reported_seq":617,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.407863+0000","last_change":"2024-09-12T00:16:05.094605+0000","last_active":"2024-09-12T01:02:01.407863+0000","last_peered":"2024-09-12T01:02:01.407863+0000","last_clean":"2024-09-12T01:02:01.407863+0000","last_became_active":"2024-09-12T00:16:05.093815+0000","last_became_peered":"2024-09-12T00:16:05.093815+0000","last_unstale":"2024-09-12T01:02:01.407863+0000","last_undegraded":"2024-09-12T01:02:01.407863+0000","last_fullsized":"2024-09-12T01:02:01.407863+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:25.421248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":302,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"268'443","reported_seq":1987,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:59.004706+0000","last_change":"2024-09-12T00:15:57.029941+0000","last_active":"2024-09-12T01:00:59.004706+0000","last_peered":"2024-09-12T01:00:59.004706+0000","last_clean":"2024-09-12T01:00:59.004706+0000","last_became_active":"2024-09-12T00:15:57.029290+0000","last_became_peered":"2024-09-12T00:15:57.029290+0000","last_unstale":"2024-09-12T01:00:59.004706+0000","last_undegraded":"2024-09-12T01:00:59.004706+0000","last_fullsized":"2024-09-12T01:00:59.004706+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:52.959133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2290,"num_read_kb":2163,"num_write":517,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"268'322","reported_seq":984,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.987665+0000","last_change":"2024-09-12T00:16:26.797714+0000","last_active":"2024-09-12T01:02:38.987665+0000","last_peered":"2024-09-12T01:02:38.987665+0000","last_clean":"2024-09-12T01:02:38.987665+0000","last_became_active":"2024-09-12T00:16:26.796888+0000","last_became_peered":"2024-09-12T00:16:26.796888+0000","last_unstale":"2024-09-12T01:02:38.987665+0000","last_undegraded":"2024-09-12T01:02:38.987665+0000","last_fullsized":"2024-09-12T01:02:38.987665+0000","mapping_epoch":39,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:17.037395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6314494,"num_objects":31,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":469,"num_read_kb":37572,"num_write":1105,"num_write_kb":35076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,6],"acting":[3,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:47.188931+0000","last_change":"2024-09-12T00:15:59.030706+0000","last_active":"2024-09-12T00:58:47.188931+0000","last_peered":"2024-09-12T00:58:47.188931+0000","last_clean":"2024-09-12T00:58:47.188931+0000","last_became_active":"2024-09-12T00:15:59.029998+0000","last_became_peered":"2024-09-12T00:15:59.029998+0000","last_unstale":"2024-09-12T00:58:47.188931+0000","last_undegraded":"2024-09-12T00:58:47.188931+0000","last_fullsized":"2024-09-12T00:58:47.188931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:08.142841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"268'301","reported_seq":879,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:17.001536+0000","last_change":"2024-09-12T00:16:01.054348+0000","last_active":"2024-09-12T01:01:17.001536+0000","last_peered":"2024-09-12T01:01:17.001536+0000","last_clean":"2024-09-12T01:01:17.001536+0000","last_became_active":"2024-09-12T00:16:01.053660+0000","last_became_peered":"2024-09-12T00:16:01.053660+0000","last_unstale":"2024-09-12T01:01:17.001536+0000","last_undegraded":"2024-09-12T01:01:17.001536+0000","last_fullsized":"2024-09-12T01:01:17.001536+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:28.294852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65745,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":491,"num_read_kb":999,"num_write":402,"num_write_kb":312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"268'775","reported_seq":2365,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.131465+0000","last_change":"2024-09-12T00:16:03.098769+0000","last_active":"2024-09-12T01:02:37.131465+0000","last_peered":"2024-09-12T01:02:37.131465+0000","last_clean":"2024-09-12T01:02:37.131465+0000","last_became_active":"2024-09-12T00:16:03.098077+0000","last_became_peered":"2024-09-12T00:16:03.098077+0000","last_unstale":"2024-09-12T01:02:37.131465+0000","last_undegraded":"2024-09-12T01:02:37.131465+0000","last_fullsized":"2024-09-12T01:02:37.131465+0000","mapping_epoch":34,"log_start":"268'701","ondisk_log_start":"268'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":701,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:52.835421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"268'151","reported_seq":653,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:03.866324+0000","last_change":"2024-09-12T00:16:05.108146+0000","last_active":"2024-09-12T01:01:03.866324+0000","last_peered":"2024-09-12T01:01:03.866324+0000","last_clean":"2024-09-12T01:01:03.866324+0000","last_became_active":"2024-09-12T00:16:05.107291+0000","last_became_peered":"2024-09-12T00:16:05.107291+0000","last_unstale":"2024-09-12T01:01:03.866324+0000","last_undegraded":"2024-09-12T01:01:03.866324+0000","last_fullsized":"2024-09-12T01:01:03.866324+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:57.906444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":174,"num_read_kb":162,"num_write":365,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"268'796","reported_seq":2308,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.428696+0000","last_change":"2024-09-12T00:15:57.024503+0000","last_active":"2024-09-12T01:01:06.428696+0000","last_peered":"2024-09-12T01:01:06.428696+0000","last_clean":"2024-09-12T01:01:06.428696+0000","last_became_active":"2024-09-12T00:15:57.024185+0000","last_became_peered":"2024-09-12T00:15:57.024185+0000","last_unstale":"2024-09-12T01:01:06.428696+0000","last_undegraded":"2024-09-12T01:01:06.428696+0000","last_fullsized":"2024-09-12T01:01:06.428696+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:13.017889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3776,"num_read_kb":3402,"num_write":1055,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"268'317","reported_seq":963,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.758454+0000","last_change":"2024-09-12T00:15:55.027875+0000","last_active":"2024-09-12T01:02:38.758454+0000","last_peered":"2024-09-12T01:02:38.758454+0000","last_clean":"2024-09-12T01:02:38.758454+0000","last_became_active":"2024-09-12T00:15:55.027001+0000","last_became_peered":"2024-09-12T00:15:55.027001+0000","last_unstale":"2024-09-12T01:02:38.758454+0000","last_undegraded":"2024-09-12T01:02:38.758454+0000","last_fullsized":"2024-09-12T01:02:38.758454+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:37.021357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12858183,"num_objects":34,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":400,"num_read_kb":53256,"num_write":837,"num_write_kb":32142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1460,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.098953+0000","last_change":"2024-09-12T00:15:59.035799+0000","last_active":"2024-09-12T01:02:37.098953+0000","last_peered":"2024-09-12T01:02:37.098953+0000","last_clean":"2024-09-12T01:02:37.098953+0000","last_became_active":"2024-09-12T00:15:59.035380+0000","last_became_peered":"2024-09-12T00:15:59.035380+0000","last_unstale":"2024-09-12T01:02:37.098953+0000","last_undegraded":"2024-09-12T01:02:37.098953+0000","last_fullsized":"2024-09-12T01:02:37.098953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:37.318095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":957,"num_read_kb":957,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"268'80","reported_seq":596,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:00.682139+0000","last_change":"2024-09-12T00:16:01.065768+0000","last_active":"2024-09-12T01:00:00.682139+0000","last_peered":"2024-09-12T01:00:00.682139+0000","last_clean":"2024-09-12T01:00:00.682139+0000","last_became_active":"2024-09-12T00:16:01.065038+0000","last_became_peered":"2024-09-12T00:16:01.065038+0000","last_unstale":"2024-09-12T01:00:00.682139+0000","last_undegraded":"2024-09-12T01:00:00.682139+0000","last_fullsized":"2024-09-12T01:00:00.682139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:49.222908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"268'797","reported_seq":2364,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.133970+0000","last_change":"2024-09-12T00:16:03.089577+0000","last_active":"2024-09-12T01:02:37.133970+0000","last_peered":"2024-09-12T01:02:37.133970+0000","last_clean":"2024-09-12T01:02:37.133970+0000","last_became_active":"2024-09-12T00:16:03.088856+0000","last_became_peered":"2024-09-12T00:16:03.088856+0000","last_unstale":"2024-09-12T01:02:37.133970+0000","last_undegraded":"2024-09-12T01:02:37.133970+0000","last_fullsized":"2024-09-12T01:02:37.133970+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:36.628955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"268'127","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.435230+0000","last_change":"2024-09-12T00:16:05.108738+0000","last_active":"2024-09-12T01:01:06.435230+0000","last_peered":"2024-09-12T01:01:06.435230+0000","last_clean":"2024-09-12T01:01:06.435230+0000","last_became_active":"2024-09-12T00:16:05.107712+0000","last_became_peered":"2024-09-12T00:16:05.107712+0000","last_unstale":"2024-09-12T01:01:06.435230+0000","last_undegraded":"2024-09-12T01:01:06.435230+0000","last_fullsized":"2024-09-12T01:01:06.435230+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:00.734318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":150,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"268'855","reported_seq":2471,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:53.115073+0000","last_change":"2024-09-12T00:15:57.044791+0000","last_active":"2024-09-12T01:00:53.115073+0000","last_peered":"2024-09-12T01:00:53.115073+0000","last_clean":"2024-09-12T01:00:53.115073+0000","last_became_active":"2024-09-12T00:15:57.043447+0000","last_became_peered":"2024-09-12T00:15:57.043447+0000","last_unstale":"2024-09-12T01:00:53.115073+0000","last_undegraded":"2024-09-12T01:00:53.115073+0000","last_fullsized":"2024-09-12T01:00:53.115073+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:48.004809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4138,"num_read_kb":3738,"num_write":1141,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"268'269","reported_seq":909,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.959042+0000","last_change":"2024-09-12T00:15:55.040492+0000","last_active":"2024-09-12T01:02:37.959042+0000","last_peered":"2024-09-12T01:02:37.959042+0000","last_clean":"2024-09-12T01:02:37.959042+0000","last_became_active":"2024-09-12T00:15:55.039512+0000","last_became_peered":"2024-09-12T00:15:55.039512+0000","last_unstale":"2024-09-12T01:02:37.959042+0000","last_undegraded":"2024-09-12T01:02:37.959042+0000","last_fullsized":"2024-09-12T01:02:37.959042+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:08.086426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12173113,"num_objects":55,"num_object_clones":0,"num_object_copies":220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":377,"num_read_kb":56944,"num_write":937,"num_write_kb":41414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:44.205861+0000","last_change":"2024-09-12T00:15:59.046399+0000","last_active":"2024-09-12T00:58:44.205861+0000","last_peered":"2024-09-12T00:58:44.205861+0000","last_clean":"2024-09-12T00:58:44.205861+0000","last_became_active":"2024-09-12T00:15:59.046018+0000","last_became_peered":"2024-09-12T00:15:59.046018+0000","last_unstale":"2024-09-12T00:58:44.205861+0000","last_undegraded":"2024-09-12T00:58:44.205861+0000","last_fullsized":"2024-09-12T00:58:44.205861+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:02.866037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"268'329","reported_seq":933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.999385+0000","last_change":"2024-09-12T00:16:01.070932+0000","last_active":"2024-09-12T01:02:11.999385+0000","last_peered":"2024-09-12T01:02:11.999385+0000","last_clean":"2024-09-12T01:02:11.999385+0000","last_became_active":"2024-09-12T00:16:01.069078+0000","last_became_peered":"2024-09-12T00:16:01.069078+0000","last_unstale":"2024-09-12T01:02:11.999385+0000","last_undegraded":"2024-09-12T01:02:11.999385+0000","last_fullsized":"2024-09-12T01:02:11.999385+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:54.239828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53080,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":525,"num_read_kb":986,"num_write":414,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.173630+0000","last_change":"2024-09-12T00:16:03.107385+0000","last_active":"2024-09-12T00:58:48.173630+0000","last_peered":"2024-09-12T00:58:48.173630+0000","last_clean":"2024-09-12T00:58:48.173630+0000","last_became_active":"2024-09-12T00:16:03.106662+0000","last_became_peered":"2024-09-12T00:16:03.106662+0000","last_unstale":"2024-09-12T00:58:48.173630+0000","last_undegraded":"2024-09-12T00:58:48.173630+0000","last_fullsized":"2024-09-12T00:58:48.173630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:36.203314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"268'135","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:05.839461+0000","last_change":"2024-09-12T00:16:05.112393+0000","last_active":"2024-09-12T01:01:05.839461+0000","last_peered":"2024-09-12T01:01:05.839461+0000","last_clean":"2024-09-12T01:01:05.839461+0000","last_became_active":"2024-09-12T00:16:05.111705+0000","last_became_peered":"2024-09-12T00:16:05.111705+0000","last_unstale":"2024-09-12T01:01:05.839461+0000","last_undegraded":"2024-09-12T01:01:05.839461+0000","last_fullsized":"2024-09-12T01:01:05.839461+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:21.647320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":316,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"268'515","reported_seq":2096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.227739+0000","last_change":"2024-09-12T00:15:57.029602+0000","last_active":"2024-09-12T01:01:07.227739+0000","last_peered":"2024-09-12T01:01:07.227739+0000","last_clean":"2024-09-12T01:01:07.227739+0000","last_became_active":"2024-09-12T00:15:57.029211+0000","last_became_peered":"2024-09-12T00:15:57.029211+0000","last_unstale":"2024-09-12T01:01:07.227739+0000","last_undegraded":"2024-09-12T01:01:07.227739+0000","last_fullsized":"2024-09-12T01:01:07.227739+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:55.890872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2638,"num_read_kb":2449,"num_write":617,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.188316+0000","last_change":"2024-09-12T00:15:34.148103+0000","last_active":"2024-09-12T00:59:48.188316+0000","last_peered":"2024-09-12T00:59:48.188316+0000","last_clean":"2024-09-12T00:59:48.188316+0000","last_became_active":"2024-09-12T00:15:34.145413+0000","last_became_peered":"2024-09-12T00:15:34.145413+0000","last_unstale":"2024-09-12T00:59:48.188316+0000","last_undegraded":"2024-09-12T00:59:48.188316+0000","last_fullsized":"2024-09-12T00:59:48.188316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.032265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.032265+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.032265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:37.582882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219349+0000","last_change":"2024-09-12T00:15:42.090501+0000","last_active":"2024-09-12T00:59:29.219349+0000","last_peered":"2024-09-12T00:59:29.219349+0000","last_clean":"2024-09-12T00:59:29.219349+0000","last_became_active":"2024-09-12T00:15:40.490486+0000","last_became_peered":"2024-09-12T00:15:40.490486+0000","last_unstale":"2024-09-12T00:59:29.219349+0000","last_undegraded":"2024-09-12T00:59:29.219349+0000","last_fullsized":"2024-09-12T00:59:29.219349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:41.969157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013201490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"268'291","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.988082+0000","last_change":"2024-09-12T00:15:55.049247+0000","last_active":"2024-09-12T01:02:37.988082+0000","last_peered":"2024-09-12T01:02:37.988082+0000","last_clean":"2024-09-12T01:02:37.988082+0000","last_became_active":"2024-09-12T00:15:55.048230+0000","last_became_peered":"2024-09-12T00:15:55.048230+0000","last_unstale":"2024-09-12T01:02:37.988082+0000","last_undegraded":"2024-09-12T01:02:37.988082+0000","last_fullsized":"2024-09-12T01:02:37.988082+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:10.864422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2024205,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":509,"num_read_kb":9775,"num_write":1078,"num_write_kb":32871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.189322+0000","last_change":"2024-09-12T00:15:59.041780+0000","last_active":"2024-09-12T00:59:48.189322+0000","last_peered":"2024-09-12T00:59:48.189322+0000","last_clean":"2024-09-12T00:59:48.189322+0000","last_became_active":"2024-09-12T00:15:59.041357+0000","last_became_peered":"2024-09-12T00:15:59.041357+0000","last_unstale":"2024-09-12T00:59:48.189322+0000","last_undegraded":"2024-09-12T00:59:48.189322+0000","last_fullsized":"2024-09-12T00:59:48.189322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:31.097783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"268'721","reported_seq":1432,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.089760+0000","last_change":"2024-09-12T00:16:01.052726+0000","last_active":"2024-09-12T01:02:38.089760+0000","last_peered":"2024-09-12T01:02:38.089760+0000","last_clean":"2024-09-12T01:02:38.089760+0000","last_became_active":"2024-09-12T00:16:01.052016+0000","last_became_peered":"2024-09-12T00:16:01.052016+0000","last_unstale":"2024-09-12T01:02:38.089760+0000","last_undegraded":"2024-09-12T01:02:38.089760+0000","last_fullsized":"2024-09-12T01:02:38.089760+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":700,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:44.346178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169706,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1413,"num_read_kb":3242,"num_write":1312,"num_write_kb":1184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":488,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.199298+0000","last_change":"2024-09-12T00:16:03.099445+0000","last_active":"2024-09-12T00:59:27.199298+0000","last_peered":"2024-09-12T00:59:27.199298+0000","last_clean":"2024-09-12T00:59:27.199298+0000","last_became_active":"2024-09-12T00:16:03.097343+0000","last_became_peered":"2024-09-12T00:16:03.097343+0000","last_unstale":"2024-09-12T00:59:27.199298+0000","last_undegraded":"2024-09-12T00:59:27.199298+0000","last_fullsized":"2024-09-12T00:59:27.199298+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:08.255612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"268'171","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.245431+0000","last_change":"2024-09-12T00:16:05.113881+0000","last_active":"2024-09-12T01:01:07.245431+0000","last_peered":"2024-09-12T01:01:07.245431+0000","last_clean":"2024-09-12T01:01:07.245431+0000","last_became_active":"2024-09-12T00:16:05.113366+0000","last_became_peered":"2024-09-12T00:16:05.113366+0000","last_unstale":"2024-09-12T01:01:07.245431+0000","last_undegraded":"2024-09-12T01:01:07.245431+0000","last_fullsized":"2024-09-12T01:01:07.245431+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:18.255536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1020,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":408,"num_write":348,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"268'1045","reported_seq":2792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.053877+0000","last_change":"2024-09-12T00:15:57.049813+0000","last_active":"2024-09-12T01:00:41.053877+0000","last_peered":"2024-09-12T01:00:41.053877+0000","last_clean":"2024-09-12T01:00:41.053877+0000","last_became_active":"2024-09-12T00:15:57.047672+0000","last_became_peered":"2024-09-12T00:15:57.047672+0000","last_unstale":"2024-09-12T01:00:41.053877+0000","last_undegraded":"2024-09-12T01:00:41.053877+0000","last_fullsized":"2024-09-12T01:00:41.053877+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":1000,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:39.410827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5053,"num_read_kb":4502,"num_write":1469,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:54.225501+0000","last_change":"2024-09-12T00:15:42.090908+0000","last_active":"2024-09-12T00:59:54.225501+0000","last_peered":"2024-09-12T00:59:54.225501+0000","last_clean":"2024-09-12T00:59:54.225501+0000","last_became_active":"2024-09-12T00:15:40.098303+0000","last_became_peered":"2024-09-12T00:15:40.098303+0000","last_unstale":"2024-09-12T00:59:54.225501+0000","last_undegraded":"2024-09-12T00:59:54.225501+0000","last_fullsized":"2024-09-12T00:59:54.225501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:40.232317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017858660000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"268'292","reported_seq":945,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.189405+0000","last_change":"2024-09-12T00:15:55.051725+0000","last_active":"2024-09-12T01:02:38.189405+0000","last_peered":"2024-09-12T01:02:38.189405+0000","last_clean":"2024-09-12T01:02:38.189405+0000","last_became_active":"2024-09-12T00:15:55.050874+0000","last_became_peered":"2024-09-12T00:15:55.050874+0000","last_unstale":"2024-09-12T01:02:38.189405+0000","last_undegraded":"2024-09-12T01:02:38.189405+0000","last_fullsized":"2024-09-12T01:02:38.189405+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:21.733859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22608265,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":426,"num_read_kb":131172,"num_write":1023,"num_write_kb":57813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:19.216989+0000","last_change":"2024-09-12T00:15:59.031231+0000","last_active":"2024-09-12T00:59:19.216989+0000","last_peered":"2024-09-12T00:59:19.216989+0000","last_clean":"2024-09-12T00:59:19.216989+0000","last_became_active":"2024-09-12T00:15:59.030858+0000","last_became_peered":"2024-09-12T00:15:59.030858+0000","last_unstale":"2024-09-12T00:59:19.216989+0000","last_undegraded":"2024-09-12T00:59:19.216989+0000","last_fullsized":"2024-09-12T00:59:19.216989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:14.830144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"268'1298","reported_seq":2785,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.183574+0000","last_change":"2024-09-12T00:16:01.058741+0000","last_active":"2024-09-12T01:02:37.183574+0000","last_peered":"2024-09-12T01:02:37.183574+0000","last_clean":"2024-09-12T01:02:37.183574+0000","last_became_active":"2024-09-12T00:16:01.057956+0000","last_became_peered":"2024-09-12T00:16:01.057956+0000","last_unstale":"2024-09-12T01:02:37.183574+0000","last_undegraded":"2024-09-12T01:02:37.183574+0000","last_fullsized":"2024-09-12T01:02:37.183574+0000","mapping_epoch":32,"log_start":"268'1200","ondisk_log_start":"268'1200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":1200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:22.472702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186588,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2032,"num_read_kb":3561,"num_write":1154,"num_write_kb":1000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:59.226747+0000","last_change":"2024-09-12T00:16:03.105384+0000","last_active":"2024-09-12T00:59:59.226747+0000","last_peered":"2024-09-12T00:59:59.226747+0000","last_clean":"2024-09-12T00:59:59.226747+0000","last_became_active":"2024-09-12T00:16:03.104040+0000","last_became_peered":"2024-09-12T00:16:03.104040+0000","last_unstale":"2024-09-12T00:59:59.226747+0000","last_undegraded":"2024-09-12T00:59:59.226747+0000","last_fullsized":"2024-09-12T00:59:59.226747+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:42.422978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"268'221","reported_seq":747,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.969829+0000","last_change":"2024-09-12T00:16:05.100831+0000","last_active":"2024-09-12T01:00:41.969829+0000","last_peered":"2024-09-12T01:00:41.969829+0000","last_clean":"2024-09-12T01:00:41.969829+0000","last_became_active":"2024-09-12T00:16:05.099987+0000","last_became_peered":"2024-09-12T00:16:05.099987+0000","last_unstale":"2024-09-12T01:00:41.969829+0000","last_undegraded":"2024-09-12T01:00:41.969829+0000","last_fullsized":"2024-09-12T01:00:41.969829+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:49.711006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":366,"num_read_kb":355,"num_write":494,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"268'395","reported_seq":1888,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506639+0000","last_change":"2024-09-12T00:15:57.022983+0000","last_active":"2024-09-12T01:01:09.506639+0000","last_peered":"2024-09-12T01:01:09.506639+0000","last_clean":"2024-09-12T01:01:09.506639+0000","last_became_active":"2024-09-12T00:15:57.022193+0000","last_became_peered":"2024-09-12T00:15:57.022193+0000","last_unstale":"2024-09-12T01:01:09.506639+0000","last_undegraded":"2024-09-12T01:01:09.506639+0000","last_fullsized":"2024-09-12T01:01:09.506639+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:12.564764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2164,"num_read_kb":2061,"num_write":440,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174427+0000","last_change":"2024-09-12T00:15:43.065460+0000","last_active":"2024-09-12T00:59:27.174427+0000","last_peered":"2024-09-12T00:59:27.174427+0000","last_clean":"2024-09-12T00:59:27.174427+0000","last_became_active":"2024-09-12T00:15:40.095888+0000","last_became_peered":"2024-09-12T00:15:40.095888+0000","last_unstale":"2024-09-12T00:59:27.174427+0000","last_undegraded":"2024-09-12T00:59:27.174427+0000","last_fullsized":"2024-09-12T00:59:27.174427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:49.939912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000883303,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"268'288","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.386518+0000","last_change":"2024-09-12T00:15:55.055938+0000","last_active":"2024-09-12T01:00:46.386518+0000","last_peered":"2024-09-12T01:00:46.386518+0000","last_clean":"2024-09-12T01:00:46.386518+0000","last_became_active":"2024-09-12T00:15:55.043174+0000","last_became_peered":"2024-09-12T00:15:55.043174+0000","last_unstale":"2024-09-12T01:00:46.386518+0000","last_undegraded":"2024-09-12T01:00:46.386518+0000","last_fullsized":"2024-09-12T01:00:46.386518+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:27.487345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2140715,"num_objects":83,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":420,"num_read_kb":17440,"num_write":1051,"num_write_kb":28417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:22.173406+0000","last_change":"2024-09-12T00:15:59.035726+0000","last_active":"2024-09-12T00:59:22.173406+0000","last_peered":"2024-09-12T00:59:22.173406+0000","last_clean":"2024-09-12T00:59:22.173406+0000","last_became_active":"2024-09-12T00:15:59.033660+0000","last_became_peered":"2024-09-12T00:15:59.033660+0000","last_unstale":"2024-09-12T00:59:22.173406+0000","last_undegraded":"2024-09-12T00:59:22.173406+0000","last_fullsized":"2024-09-12T00:59:22.173406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:37.650316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"268'251","reported_seq":1356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.831740+0000","last_change":"2024-09-12T00:16:01.073248+0000","last_active":"2024-09-12T01:02:10.831740+0000","last_peered":"2024-09-12T01:02:10.831740+0000","last_clean":"2024-09-12T01:02:10.831740+0000","last_became_active":"2024-09-12T00:16:01.072168+0000","last_became_peered":"2024-09-12T00:16:01.072168+0000","last_unstale":"2024-09-12T01:02:10.831740+0000","last_undegraded":"2024-09-12T01:02:10.831740+0000","last_fullsized":"2024-09-12T01:02:10.831740+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:05.937075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.183287+0000","last_change":"2024-09-12T00:16:03.087413+0000","last_active":"2024-09-12T00:59:48.183287+0000","last_peered":"2024-09-12T00:59:48.183287+0000","last_clean":"2024-09-12T00:59:48.183287+0000","last_became_active":"2024-09-12T00:16:03.086646+0000","last_became_peered":"2024-09-12T00:16:03.086646+0000","last_unstale":"2024-09-12T00:59:48.183287+0000","last_undegraded":"2024-09-12T00:59:48.183287+0000","last_fullsized":"2024-09-12T00:59:48.183287+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:29.789535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"268'260","reported_seq":880,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.425705+0000","last_change":"2024-09-12T00:16:05.095458+0000","last_active":"2024-09-12T01:01:07.425705+0000","last_peered":"2024-09-12T01:01:07.425705+0000","last_clean":"2024-09-12T01:01:07.425705+0000","last_became_active":"2024-09-12T00:16:05.094684+0000","last_became_peered":"2024-09-12T00:16:05.094684+0000","last_unstale":"2024-09-12T01:01:07.425705+0000","last_undegraded":"2024-09-12T01:01:07.425705+0000","last_fullsized":"2024-09-12T01:01:07.425705+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:59.471541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":550,"num_read_kb":556,"num_write":574,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"268'872","reported_seq":2469,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:45.899344+0000","last_change":"2024-09-12T00:15:57.050201+0000","last_active":"2024-09-12T01:00:45.899344+0000","last_peered":"2024-09-12T01:00:45.899344+0000","last_clean":"2024-09-12T01:00:45.899344+0000","last_became_active":"2024-09-12T00:15:57.049533+0000","last_became_peered":"2024-09-12T00:15:57.049533+0000","last_unstale":"2024-09-12T01:00:45.899344+0000","last_undegraded":"2024-09-12T01:00:45.899344+0000","last_fullsized":"2024-09-12T01:00:45.899344+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:22.616019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4105,"num_read_kb":3691,"num_write":1162,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219306+0000","last_change":"2024-09-12T00:15:42.091191+0000","last_active":"2024-09-12T00:59:29.219306+0000","last_peered":"2024-09-12T00:59:29.219306+0000","last_clean":"2024-09-12T00:59:29.219306+0000","last_became_active":"2024-09-12T00:15:40.144614+0000","last_became_peered":"2024-09-12T00:15:40.144614+0000","last_unstale":"2024-09-12T00:59:29.219306+0000","last_undegraded":"2024-09-12T00:59:29.219306+0000","last_fullsized":"2024-09-12T00:59:29.219306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:01.463335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019634679999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"268'308","reported_seq":1007,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.995938+0000","last_change":"2024-09-12T00:15:55.060894+0000","last_active":"2024-09-12T01:02:37.995938+0000","last_peered":"2024-09-12T01:02:37.995938+0000","last_clean":"2024-09-12T01:02:37.995938+0000","last_became_active":"2024-09-12T00:15:55.060303+0000","last_became_peered":"2024-09-12T00:15:55.060303+0000","last_unstale":"2024-09-12T01:02:37.995938+0000","last_undegraded":"2024-09-12T01:02:37.995938+0000","last_fullsized":"2024-09-12T01:02:37.995938+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:25.050199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6585252,"num_objects":49,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":0,"num_read":597,"num_read_kb":10986,"num_write":1285,"num_write_kb":39626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.181987+0000","last_change":"2024-09-12T00:15:59.043416+0000","last_active":"2024-09-12T00:59:57.181987+0000","last_peered":"2024-09-12T00:59:57.181987+0000","last_clean":"2024-09-12T00:59:57.181987+0000","last_became_active":"2024-09-12T00:15:59.042545+0000","last_became_peered":"2024-09-12T00:15:59.042545+0000","last_unstale":"2024-09-12T00:59:57.181987+0000","last_undegraded":"2024-09-12T00:59:57.181987+0000","last_fullsized":"2024-09-12T00:59:57.181987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:22.895073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"268'140","reported_seq":678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:09.645572+0000","last_change":"2024-09-12T00:16:01.048555+0000","last_active":"2024-09-12T01:02:09.645572+0000","last_peered":"2024-09-12T01:02:09.645572+0000","last_clean":"2024-09-12T01:02:09.645572+0000","last_became_active":"2024-09-12T00:16:01.047278+0000","last_became_peered":"2024-09-12T00:16:01.047278+0000","last_unstale":"2024-09-12T01:02:09.645572+0000","last_undegraded":"2024-09-12T01:02:09.645572+0000","last_fullsized":"2024-09-12T01:02:09.645572+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:52.572279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":143,"num_write":118,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:24.218190+0000","last_change":"2024-09-12T00:16:03.097752+0000","last_active":"2024-09-12T00:59:24.218190+0000","last_peered":"2024-09-12T00:59:24.218190+0000","last_clean":"2024-09-12T00:59:24.218190+0000","last_became_active":"2024-09-12T00:16:03.097029+0000","last_became_peered":"2024-09-12T00:16:03.097029+0000","last_unstale":"2024-09-12T00:59:24.218190+0000","last_undegraded":"2024-09-12T00:59:24.218190+0000","last_fullsized":"2024-09-12T00:59:24.218190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:58.710309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"268'157","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.216786+0000","last_change":"2024-09-12T00:16:05.112178+0000","last_active":"2024-09-12T01:01:07.216786+0000","last_peered":"2024-09-12T01:01:07.216786+0000","last_clean":"2024-09-12T01:01:07.216786+0000","last_became_active":"2024-09-12T00:16:05.111534+0000","last_became_peered":"2024-09-12T00:16:05.111534+0000","last_unstale":"2024-09-12T01:01:07.216786+0000","last_undegraded":"2024-09-12T01:01:07.216786+0000","last_fullsized":"2024-09-12T01:01:07.216786+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:54.359907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":344,"num_read_kb":315,"num_write":411,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"268'448","reported_seq":1932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.871086+0000","last_change":"2024-09-12T00:15:57.032372+0000","last_active":"2024-09-12T01:02:10.871086+0000","last_peered":"2024-09-12T01:02:10.871086+0000","last_clean":"2024-09-12T01:02:10.871086+0000","last_became_active":"2024-09-12T00:15:57.023909+0000","last_became_peered":"2024-09-12T00:15:57.023909+0000","last_unstale":"2024-09-12T01:02:10.871086+0000","last_undegraded":"2024-09-12T01:02:10.871086+0000","last_fullsized":"2024-09-12T01:02:10.871086+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:51.721224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2256,"num_read_kb":2116,"num_write":511,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"268'300","reported_seq":943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.141379+0000","last_change":"2024-09-12T00:15:55.057220+0000","last_active":"2024-09-12T01:02:38.141379+0000","last_peered":"2024-09-12T01:02:38.141379+0000","last_clean":"2024-09-12T01:02:38.141379+0000","last_became_active":"2024-09-12T00:15:55.056576+0000","last_became_peered":"2024-09-12T00:15:55.056576+0000","last_unstale":"2024-09-12T01:02:38.141379+0000","last_undegraded":"2024-09-12T01:02:38.141379+0000","last_fullsized":"2024-09-12T01:02:38.141379+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:08.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6554173,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":489,"num_read_kb":507,"num_write":1164,"num_write_kb":27643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.199091+0000","last_change":"2024-09-12T00:15:42.088087+0000","last_active":"2024-09-12T00:59:27.199091+0000","last_peered":"2024-09-12T00:59:27.199091+0000","last_clean":"2024-09-12T00:59:27.199091+0000","last_became_active":"2024-09-12T00:15:40.141037+0000","last_became_peered":"2024-09-12T00:15:40.141037+0000","last_unstale":"2024-09-12T00:59:27.199091+0000","last_undegraded":"2024-09-12T00:59:27.199091+0000","last_fullsized":"2024-09-12T00:59:27.199091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:30.931343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088972300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.183221+0000","last_change":"2024-09-12T00:15:59.045253+0000","last_active":"2024-09-12T00:59:48.183221+0000","last_peered":"2024-09-12T00:59:48.183221+0000","last_clean":"2024-09-12T00:59:48.183221+0000","last_became_active":"2024-09-12T00:15:59.043935+0000","last_became_peered":"2024-09-12T00:15:59.043935+0000","last_unstale":"2024-09-12T00:59:48.183221+0000","last_undegraded":"2024-09-12T00:59:48.183221+0000","last_fullsized":"2024-09-12T00:59:48.183221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:12.203334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"268'551","reported_seq":1215,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.214126+0000","last_change":"2024-09-12T00:16:01.053029+0000","last_active":"2024-09-12T01:02:12.214126+0000","last_peered":"2024-09-12T01:02:12.214126+0000","last_clean":"2024-09-12T01:02:12.214126+0000","last_became_active":"2024-09-12T00:16:01.051753+0000","last_became_peered":"2024-09-12T00:16:01.051753+0000","last_unstale":"2024-09-12T01:02:12.214126+0000","last_undegraded":"2024-09-12T01:02:12.214126+0000","last_fullsized":"2024-09-12T01:02:12.214126+0000","mapping_epoch":32,"log_start":"268'500","ondisk_log_start":"268'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:25.228834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":105239,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1542,"num_read_kb":2446,"num_write":2036,"num_write_kb":1873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.188058+0000","last_change":"2024-09-12T00:16:03.100214+0000","last_active":"2024-09-12T00:59:48.188058+0000","last_peered":"2024-09-12T00:59:48.188058+0000","last_clean":"2024-09-12T00:59:48.188058+0000","last_became_active":"2024-09-12T00:16:03.099491+0000","last_became_peered":"2024-09-12T00:16:03.099491+0000","last_unstale":"2024-09-12T00:59:48.188058+0000","last_undegraded":"2024-09-12T00:59:48.188058+0000","last_fullsized":"2024-09-12T00:59:48.188058+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:29.470103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"268'110","reported_seq":605,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:30.754431+0000","last_change":"2024-09-12T00:16:05.100929+0000","last_active":"2024-09-12T01:00:30.754431+0000","last_peered":"2024-09-12T01:00:30.754431+0000","last_clean":"2024-09-12T01:00:30.754431+0000","last_became_active":"2024-09-12T00:16:05.099975+0000","last_became_peered":"2024-09-12T00:16:05.099975+0000","last_unstale":"2024-09-12T01:00:30.754431+0000","last_undegraded":"2024-09-12T01:00:30.754431+0000","last_fullsized":"2024-09-12T01:00:30.754431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:02.033531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":90,"num_write":249,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"268'512","reported_seq":2238,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.869874+0000","last_change":"2024-09-12T00:15:57.020092+0000","last_active":"2024-09-12T01:02:10.869874+0000","last_peered":"2024-09-12T01:02:10.869874+0000","last_clean":"2024-09-12T01:02:10.869874+0000","last_became_active":"2024-09-12T00:15:57.019345+0000","last_became_peered":"2024-09-12T00:15:57.019345+0000","last_unstale":"2024-09-12T01:02:10.869874+0000","last_undegraded":"2024-09-12T01:02:10.869874+0000","last_fullsized":"2024-09-12T01:02:10.869874+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:37.937658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2840,"num_read_kb":2674,"num_write":601,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"268'312","reported_seq":949,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.170308+0000","last_change":"2024-09-12T00:15:55.068406+0000","last_active":"2024-09-12T01:02:38.170308+0000","last_peered":"2024-09-12T01:02:38.170308+0000","last_clean":"2024-09-12T01:02:38.170308+0000","last_became_active":"2024-09-12T00:15:55.064444+0000","last_became_peered":"2024-09-12T00:15:55.064444+0000","last_unstale":"2024-09-12T01:02:38.170308+0000","last_undegraded":"2024-09-12T01:02:38.170308+0000","last_fullsized":"2024-09-12T01:02:38.170308+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:55.022447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11585769,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":433,"num_read_kb":45787,"num_write":978,"num_write_kb":51853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:39.221977+0000","last_change":"2024-09-12T00:15:42.091937+0000","last_active":"2024-09-12T00:59:39.221977+0000","last_peered":"2024-09-12T00:59:39.221977+0000","last_clean":"2024-09-12T00:59:39.221977+0000","last_became_active":"2024-09-12T00:15:40.093718+0000","last_became_peered":"2024-09-12T00:15:40.093718+0000","last_unstale":"2024-09-12T00:59:39.221977+0000","last_undegraded":"2024-09-12T00:59:39.221977+0000","last_fullsized":"2024-09-12T00:59:39.221977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:26.233329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001992522,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.189215+0000","last_change":"2024-09-12T00:15:59.042002+0000","last_active":"2024-09-12T00:59:48.189215+0000","last_peered":"2024-09-12T00:59:48.189215+0000","last_clean":"2024-09-12T00:59:48.189215+0000","last_became_active":"2024-09-12T00:15:59.041390+0000","last_became_peered":"2024-09-12T00:15:59.041390+0000","last_unstale":"2024-09-12T00:59:48.189215+0000","last_undegraded":"2024-09-12T00:59:48.189215+0000","last_fullsized":"2024-09-12T00:59:48.189215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:47.896665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"268'155","reported_seq":721,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.176909+0000","last_change":"2024-09-12T00:16:01.052772+0000","last_active":"2024-09-12T00:59:48.176909+0000","last_peered":"2024-09-12T00:59:48.176909+0000","last_clean":"2024-09-12T00:59:48.176909+0000","last_became_active":"2024-09-12T00:16:01.050630+0000","last_became_peered":"2024-09-12T00:16:01.050630+0000","last_unstale":"2024-09-12T00:59:48.176909+0000","last_undegraded":"2024-09-12T00:59:48.176909+0000","last_fullsized":"2024-09-12T00:59:48.176909+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:59.467265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":205,"num_read_kb":196,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"268'797","reported_seq":2727,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.127672+0000","last_change":"2024-09-12T00:16:03.104886+0000","last_active":"2024-09-12T01:02:37.127672+0000","last_peered":"2024-09-12T01:02:37.127672+0000","last_clean":"2024-09-12T01:02:37.127672+0000","last_became_active":"2024-09-12T00:16:03.104125+0000","last_became_peered":"2024-09-12T00:16:03.104125+0000","last_unstale":"2024-09-12T01:02:37.127672+0000","last_undegraded":"2024-09-12T01:02:37.127672+0000","last_fullsized":"2024-09-12T01:02:37.127672+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:43.285245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"268'113","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:17.202074+0000","last_change":"2024-09-12T00:16:05.115377+0000","last_active":"2024-09-12T01:01:17.202074+0000","last_peered":"2024-09-12T01:01:17.202074+0000","last_clean":"2024-09-12T01:01:17.202074+0000","last_became_active":"2024-09-12T00:16:05.114695+0000","last_became_peered":"2024-09-12T00:16:05.114695+0000","last_unstale":"2024-09-12T01:01:17.202074+0000","last_undegraded":"2024-09-12T01:01:17.202074+0000","last_fullsized":"2024-09-12T01:01:17.202074+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:16.956956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":134,"num_write":263,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"268'786","reported_seq":2351,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.228575+0000","last_change":"2024-09-12T00:15:57.028597+0000","last_active":"2024-09-12T01:01:07.228575+0000","last_peered":"2024-09-12T01:01:07.228575+0000","last_clean":"2024-09-12T01:01:07.228575+0000","last_became_active":"2024-09-12T00:15:57.027778+0000","last_became_peered":"2024-09-12T00:15:57.027778+0000","last_unstale":"2024-09-12T01:01:07.228575+0000","last_undegraded":"2024-09-12T01:01:07.228575+0000","last_fullsized":"2024-09-12T01:01:07.228575+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:34.509309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3889,"num_read_kb":3532,"num_write":1033,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"268'367","reported_seq":1060,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.977283+0000","last_change":"2024-09-12T00:15:55.049561+0000","last_active":"2024-09-12T01:02:37.977283+0000","last_peered":"2024-09-12T01:02:37.977283+0000","last_clean":"2024-09-12T01:02:37.977283+0000","last_became_active":"2024-09-12T00:15:55.048610+0000","last_became_peered":"2024-09-12T00:15:55.048610+0000","last_unstale":"2024-09-12T01:02:37.977283+0000","last_undegraded":"2024-09-12T01:02:37.977283+0000","last_fullsized":"2024-09-12T01:02:37.977283+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:41.138699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7799667,"num_objects":51,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":0,"num_read":650,"num_read_kb":32494,"num_write":1262,"num_write_kb":43441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.171642+0000","last_change":"2024-09-12T00:15:42.117262+0000","last_active":"2024-09-12T00:59:03.171642+0000","last_peered":"2024-09-12T00:59:03.171642+0000","last_clean":"2024-09-12T00:59:03.171642+0000","last_became_active":"2024-09-12T00:15:40.660718+0000","last_became_peered":"2024-09-12T00:15:40.660718+0000","last_unstale":"2024-09-12T00:59:03.171642+0000","last_undegraded":"2024-09-12T00:59:03.171642+0000","last_fullsized":"2024-09-12T00:59:03.171642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:04.909588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080064100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"38'5","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.084832+0000","last_change":"2024-09-12T00:15:59.023300+0000","last_active":"2024-09-12T01:02:37.084832+0000","last_peered":"2024-09-12T01:02:37.084832+0000","last_clean":"2024-09-12T01:02:37.084832+0000","last_became_active":"2024-09-12T00:15:59.022598+0000","last_became_peered":"2024-09-12T00:15:59.022598+0000","last_unstale":"2024-09-12T01:02:37.084832+0000","last_undegraded":"2024-09-12T01:02:37.084832+0000","last_fullsized":"2024-09-12T01:02:37.084832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:14.157447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"268'111","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:49.224395+0000","last_change":"2024-09-12T00:16:01.063640+0000","last_active":"2024-09-12T00:59:49.224395+0000","last_peered":"2024-09-12T00:59:49.224395+0000","last_clean":"2024-09-12T00:59:49.224395+0000","last_became_active":"2024-09-12T00:16:01.061378+0000","last_became_peered":"2024-09-12T00:16:01.061378+0000","last_unstale":"2024-09-12T00:59:49.224395+0000","last_undegraded":"2024-09-12T00:59:49.224395+0000","last_fullsized":"2024-09-12T00:59:49.224395+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:32.478977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":124,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"268'810","reported_seq":4440,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.075572+0000","last_change":"2024-09-12T00:16:03.098212+0000","last_active":"2024-09-12T01:02:12.075572+0000","last_peered":"2024-09-12T01:02:12.075572+0000","last_clean":"2024-09-12T01:02:12.075572+0000","last_became_active":"2024-09-12T00:16:03.097533+0000","last_became_peered":"2024-09-12T00:16:03.097533+0000","last_unstale":"2024-09-12T01:02:12.075572+0000","last_undegraded":"2024-09-12T01:02:12.075572+0000","last_fullsized":"2024-09-12T01:02:12.075572+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:57.487410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"268'165","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:40.003597+0000","last_change":"2024-09-12T00:16:05.110783+0000","last_active":"2024-09-12T01:00:40.003597+0000","last_peered":"2024-09-12T01:00:40.003597+0000","last_clean":"2024-09-12T01:00:40.003597+0000","last_became_active":"2024-09-12T00:16:05.110012+0000","last_became_peered":"2024-09-12T00:16:05.110012+0000","last_unstale":"2024-09-12T01:00:40.003597+0000","last_undegraded":"2024-09-12T01:00:40.003597+0000","last_fullsized":"2024-09-12T01:00:40.003597+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:27.489900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":392,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"268'378","reported_seq":1830,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.582868+0000","last_change":"2024-09-12T00:15:57.024825+0000","last_active":"2024-09-12T01:01:09.582868+0000","last_peered":"2024-09-12T01:01:09.582868+0000","last_clean":"2024-09-12T01:01:09.582868+0000","last_became_active":"2024-09-12T00:15:57.024399+0000","last_became_peered":"2024-09-12T00:15:57.024399+0000","last_unstale":"2024-09-12T01:01:09.582868+0000","last_undegraded":"2024-09-12T01:01:09.582868+0000","last_fullsized":"2024-09-12T01:01:09.582868+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:54.519754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2040,"num_read_kb":1940,"num_write":430,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"268'296","reported_seq":939,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.968987+0000","last_change":"2024-09-12T00:15:55.065586+0000","last_active":"2024-09-12T01:02:37.968987+0000","last_peered":"2024-09-12T01:02:37.968987+0000","last_clean":"2024-09-12T01:02:37.968987+0000","last_became_active":"2024-09-12T00:15:55.064782+0000","last_became_peered":"2024-09-12T00:15:55.064782+0000","last_unstale":"2024-09-12T01:02:37.968987+0000","last_undegraded":"2024-09-12T01:02:37.968987+0000","last_fullsized":"2024-09-12T01:02:37.968987+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:16.186392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7298334,"num_objects":50,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":50,"num_whiteouts":0,"num_read":449,"num_read_kb":4021,"num_write":1019,"num_write_kb":34802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:04.213089+0000","last_change":"2024-09-12T00:15:42.091675+0000","last_active":"2024-09-12T00:59:04.213089+0000","last_peered":"2024-09-12T00:59:04.213089+0000","last_clean":"2024-09-12T00:59:04.213089+0000","last_became_active":"2024-09-12T00:15:40.663617+0000","last_became_peered":"2024-09-12T00:15:40.663617+0000","last_unstale":"2024-09-12T00:59:04.213089+0000","last_undegraded":"2024-09-12T00:59:04.213089+0000","last_fullsized":"2024-09-12T00:59:04.213089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:31.309528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002428801,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.189481+0000","last_change":"2024-09-12T00:15:59.040528+0000","last_active":"2024-09-12T01:00:13.189481+0000","last_peered":"2024-09-12T01:00:13.189481+0000","last_clean":"2024-09-12T01:00:13.189481+0000","last_became_active":"2024-09-12T00:15:59.039777+0000","last_became_peered":"2024-09-12T00:15:59.039777+0000","last_unstale":"2024-09-12T01:00:13.189481+0000","last_undegraded":"2024-09-12T01:00:13.189481+0000","last_fullsized":"2024-09-12T01:00:13.189481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:55.960948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"268'739","reported_seq":1448,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.174729+0000","last_change":"2024-09-12T00:16:01.052709+0000","last_active":"2024-09-12T01:02:37.174729+0000","last_peered":"2024-09-12T01:02:37.174729+0000","last_clean":"2024-09-12T01:02:37.174729+0000","last_became_active":"2024-09-12T00:16:01.051967+0000","last_became_peered":"2024-09-12T00:16:01.051967+0000","last_unstale":"2024-09-12T01:02:37.174729+0000","last_undegraded":"2024-09-12T01:02:37.174729+0000","last_fullsized":"2024-09-12T01:02:37.174729+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":700,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:10.600964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176700,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1312,"num_read_kb":2809,"num_write":1092,"num_write_kb":916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.183148+0000","last_change":"2024-09-12T00:16:03.092521+0000","last_active":"2024-09-12T00:59:48.183148+0000","last_peered":"2024-09-12T00:59:48.183148+0000","last_clean":"2024-09-12T00:59:48.183148+0000","last_became_active":"2024-09-12T00:16:03.091920+0000","last_became_peered":"2024-09-12T00:16:03.091920+0000","last_unstale":"2024-09-12T00:59:48.183148+0000","last_undegraded":"2024-09-12T00:59:48.183148+0000","last_fullsized":"2024-09-12T00:59:48.183148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:35.406048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"268'139","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.474966+0000","last_change":"2024-09-12T00:16:05.113388+0000","last_active":"2024-09-12T01:01:06.474966+0000","last_peered":"2024-09-12T01:01:06.474966+0000","last_clean":"2024-09-12T01:01:06.474966+0000","last_became_active":"2024-09-12T00:16:05.112774+0000","last_became_peered":"2024-09-12T00:16:05.112774+0000","last_unstale":"2024-09-12T01:01:06.474966+0000","last_undegraded":"2024-09-12T01:01:06.474966+0000","last_fullsized":"2024-09-12T01:01:06.474966+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:27.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":230,"num_write":341,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"268'111","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.376870+0000","last_change":"2024-09-12T00:16:05.098437+0000","last_active":"2024-09-12T01:01:07.376870+0000","last_peered":"2024-09-12T01:01:07.376870+0000","last_clean":"2024-09-12T01:01:07.376870+0000","last_became_active":"2024-09-12T00:16:05.097548+0000","last_became_peered":"2024-09-12T00:16:05.097548+0000","last_unstale":"2024-09-12T01:01:07.376870+0000","last_undegraded":"2024-09-12T01:01:07.376870+0000","last_fullsized":"2024-09-12T01:01:07.376870+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:14.723156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":186,"num_read_kb":184,"num_write":255,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"268'852","reported_seq":2471,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.159422+0000","last_change":"2024-09-12T00:15:57.024504+0000","last_active":"2024-09-12T01:01:02.159422+0000","last_peered":"2024-09-12T01:01:02.159422+0000","last_clean":"2024-09-12T01:01:02.159422+0000","last_became_active":"2024-09-12T00:15:57.024237+0000","last_became_peered":"2024-09-12T00:15:57.024237+0000","last_unstale":"2024-09-12T01:01:02.159422+0000","last_undegraded":"2024-09-12T01:01:02.159422+0000","last_fullsized":"2024-09-12T01:01:02.159422+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:13.214327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4086,"num_read_kb":3684,"num_write":1101,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"268'274","reported_seq":915,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.675585+0000","last_change":"2024-09-12T00:16:26.420540+0000","last_active":"2024-09-12T01:02:38.675585+0000","last_peered":"2024-09-12T01:02:38.675585+0000","last_clean":"2024-09-12T01:02:38.675585+0000","last_became_active":"2024-09-12T00:16:26.420272+0000","last_became_peered":"2024-09-12T00:16:26.420272+0000","last_unstale":"2024-09-12T01:02:38.675585+0000","last_undegraded":"2024-09-12T01:02:38.675585+0000","last_fullsized":"2024-09-12T01:02:38.675585+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:08.598775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239237,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":393,"num_read_kb":13074,"num_write":935,"num_write_kb":25707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,0],"acting":[3,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"38'3","reported_seq":976,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.085598+0000","last_change":"2024-09-12T00:15:59.040011+0000","last_active":"2024-09-12T01:02:37.085598+0000","last_peered":"2024-09-12T01:02:37.085598+0000","last_clean":"2024-09-12T01:02:37.085598+0000","last_became_active":"2024-09-12T00:15:59.039169+0000","last_became_peered":"2024-09-12T00:15:59.039169+0000","last_unstale":"2024-09-12T01:02:37.085598+0000","last_undegraded":"2024-09-12T01:02:37.085598+0000","last_fullsized":"2024-09-12T01:02:37.085598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:42.316880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"268'285","reported_seq":862,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.517600+0000","last_change":"2024-09-12T00:16:01.067282+0000","last_active":"2024-09-12T01:02:37.517600+0000","last_peered":"2024-09-12T01:02:37.517600+0000","last_clean":"2024-09-12T01:02:37.517600+0000","last_became_active":"2024-09-12T00:16:01.066524+0000","last_became_peered":"2024-09-12T00:16:01.066524+0000","last_unstale":"2024-09-12T01:02:37.517600+0000","last_undegraded":"2024-09-12T01:02:37.517600+0000","last_fullsized":"2024-09-12T01:02:37.517600+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:46.086778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43678,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1068,"num_write":390,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:07.155814+0000","last_change":"2024-09-12T00:16:03.070194+0000","last_active":"2024-09-12T00:58:07.155814+0000","last_peered":"2024-09-12T00:58:07.155814+0000","last_clean":"2024-09-12T00:58:07.155814+0000","last_became_active":"2024-09-12T00:16:03.069399+0000","last_became_peered":"2024-09-12T00:16:03.069399+0000","last_unstale":"2024-09-12T00:58:07.155814+0000","last_undegraded":"2024-09-12T00:58:07.155814+0000","last_fullsized":"2024-09-12T00:58:07.155814+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:53.022367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"268'132","reported_seq":623,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.173811+0000","last_change":"2024-09-12T00:16:05.103043+0000","last_active":"2024-09-12T01:00:52.173811+0000","last_peered":"2024-09-12T01:00:52.173811+0000","last_clean":"2024-09-12T01:00:52.173811+0000","last_became_active":"2024-09-12T00:16:05.102118+0000","last_became_peered":"2024-09-12T00:16:05.102118+0000","last_unstale":"2024-09-12T01:00:52.173811+0000","last_undegraded":"2024-09-12T01:00:52.173811+0000","last_fullsized":"2024-09-12T01:00:52.173811+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:10.930503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":111,"num_write":330,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"268'496","reported_seq":2220,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.446580+0000","last_change":"2024-09-12T00:15:57.032023+0000","last_active":"2024-09-12T01:01:06.446580+0000","last_peered":"2024-09-12T01:01:06.446580+0000","last_clean":"2024-09-12T01:01:06.446580+0000","last_became_active":"2024-09-12T00:15:57.031322+0000","last_became_peered":"2024-09-12T00:15:57.031322+0000","last_unstale":"2024-09-12T01:01:06.446580+0000","last_undegraded":"2024-09-12T01:01:06.446580+0000","last_fullsized":"2024-09-12T01:01:06.446580+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:25.211444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2639,"num_write":567,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"268'406","reported_seq":1114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.859019+0000","last_change":"2024-09-12T00:15:55.066489+0000","last_active":"2024-09-12T01:02:37.859019+0000","last_peered":"2024-09-12T01:02:37.859019+0000","last_clean":"2024-09-12T01:02:37.859019+0000","last_became_active":"2024-09-12T00:15:55.065964+0000","last_became_peered":"2024-09-12T00:15:55.065964+0000","last_unstale":"2024-09-12T01:02:37.859019+0000","last_undegraded":"2024-09-12T01:02:37.859019+0000","last_fullsized":"2024-09-12T01:02:37.859019+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:04.361682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11388245,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":854,"num_read_kb":8759,"num_write":1256,"num_write_kb":27844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:03.156936+0000","last_change":"2024-09-12T00:15:59.044538+0000","last_active":"2024-09-12T00:58:03.156936+0000","last_peered":"2024-09-12T00:58:03.156936+0000","last_clean":"2024-09-12T00:58:03.156936+0000","last_became_active":"2024-09-12T00:15:59.043146+0000","last_became_peered":"2024-09-12T00:15:59.043146+0000","last_unstale":"2024-09-12T00:58:03.156936+0000","last_undegraded":"2024-09-12T00:58:03.156936+0000","last_fullsized":"2024-09-12T00:58:03.156936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:38.791557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"268'49","reported_seq":557,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:42.098355+0000","last_change":"2024-09-12T00:16:01.055742+0000","last_active":"2024-09-12T00:58:42.098355+0000","last_peered":"2024-09-12T00:58:42.098355+0000","last_clean":"2024-09-12T00:58:42.098355+0000","last_became_active":"2024-09-12T00:16:01.055002+0000","last_became_peered":"2024-09-12T00:16:01.055002+0000","last_unstale":"2024-09-12T00:58:42.098355+0000","last_undegraded":"2024-09-12T00:58:42.098355+0000","last_fullsized":"2024-09-12T00:58:42.098355+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:31.414501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:03.161791+0000","last_change":"2024-09-12T00:16:03.108240+0000","last_active":"2024-09-12T00:58:03.161791+0000","last_peered":"2024-09-12T00:58:03.161791+0000","last_clean":"2024-09-12T00:58:03.161791+0000","last_became_active":"2024-09-12T00:16:03.107695+0000","last_became_peered":"2024-09-12T00:16:03.107695+0000","last_unstale":"2024-09-12T00:58:03.161791+0000","last_undegraded":"2024-09-12T00:58:03.161791+0000","last_fullsized":"2024-09-12T00:58:03.161791+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:20.303982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"268'245","reported_seq":797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.454102+0000","last_change":"2024-09-12T00:16:05.107880+0000","last_active":"2024-09-12T01:01:06.454102+0000","last_peered":"2024-09-12T01:01:06.454102+0000","last_clean":"2024-09-12T01:01:06.454102+0000","last_became_active":"2024-09-12T00:16:05.106742+0000","last_became_peered":"2024-09-12T00:16:05.106742+0000","last_unstale":"2024-09-12T01:01:06.454102+0000","last_undegraded":"2024-09-12T01:01:06.454102+0000","last_fullsized":"2024-09-12T01:01:06.454102+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:30.878014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":438,"num_read_kb":396,"num_write":482,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"268'395","reported_seq":1832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:48.415779+0000","last_change":"2024-09-12T00:15:57.016176+0000","last_active":"2024-09-12T01:00:48.415779+0000","last_peered":"2024-09-12T01:00:48.415779+0000","last_clean":"2024-09-12T01:00:48.415779+0000","last_became_active":"2024-09-12T00:15:57.015397+0000","last_became_peered":"2024-09-12T00:15:57.015397+0000","last_unstale":"2024-09-12T01:00:48.415779+0000","last_undegraded":"2024-09-12T01:00:48.415779+0000","last_fullsized":"2024-09-12T01:00:48.415779+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:29.776854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2041,"num_read_kb":1937,"num_write":459,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"268'280","reported_seq":907,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.041793+0000","last_change":"2024-09-12T00:15:55.064342+0000","last_active":"2024-09-12T01:02:38.041793+0000","last_peered":"2024-09-12T01:02:38.041793+0000","last_clean":"2024-09-12T01:02:38.041793+0000","last_became_active":"2024-09-12T00:15:55.062990+0000","last_became_peered":"2024-09-12T00:15:55.062990+0000","last_unstale":"2024-09-12T01:02:38.041793+0000","last_undegraded":"2024-09-12T01:02:38.041793+0000","last_fullsized":"2024-09-12T01:02:38.041793+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:44.373318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":866212,"num_objects":46,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":402,"num_read_kb":9756,"num_write":957,"num_write_kb":17415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:03.161732+0000","last_change":"2024-09-12T00:15:59.029632+0000","last_active":"2024-09-12T00:58:03.161732+0000","last_peered":"2024-09-12T00:58:03.161732+0000","last_clean":"2024-09-12T00:58:03.161732+0000","last_became_active":"2024-09-12T00:15:59.029162+0000","last_became_peered":"2024-09-12T00:15:59.029162+0000","last_unstale":"2024-09-12T00:58:03.161732+0000","last_undegraded":"2024-09-12T00:58:03.161732+0000","last_fullsized":"2024-09-12T00:58:03.161732+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:41.881067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"268'279","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.978813+0000","last_change":"2024-09-12T00:16:01.060247+0000","last_active":"2024-09-12T01:02:11.978813+0000","last_peered":"2024-09-12T01:02:11.978813+0000","last_clean":"2024-09-12T01:02:11.978813+0000","last_became_active":"2024-09-12T00:16:01.059517+0000","last_became_peered":"2024-09-12T00:16:01.059517+0000","last_unstale":"2024-09-12T01:02:11.978813+0000","last_undegraded":"2024-09-12T01:02:11.978813+0000","last_fullsized":"2024-09-12T01:02:11.978813+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:40.375904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52297,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":447,"num_read_kb":874,"num_write":352,"num_write_kb":257,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:03.163061+0000","last_change":"2024-09-12T00:16:03.104263+0000","last_active":"2024-09-12T00:58:03.163061+0000","last_peered":"2024-09-12T00:58:03.163061+0000","last_clean":"2024-09-12T00:58:03.163061+0000","last_became_active":"2024-09-12T00:16:03.103630+0000","last_became_peered":"2024-09-12T00:16:03.103630+0000","last_unstale":"2024-09-12T00:58:03.163061+0000","last_undegraded":"2024-09-12T00:58:03.163061+0000","last_fullsized":"2024-09-12T00:58:03.163061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:39.452322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"268'165","reported_seq":678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:01.555845+0000","last_change":"2024-09-12T00:16:05.110450+0000","last_active":"2024-09-12T01:00:01.555845+0000","last_peered":"2024-09-12T01:00:01.555845+0000","last_clean":"2024-09-12T01:00:01.555845+0000","last_became_active":"2024-09-12T00:16:05.109745+0000","last_became_peered":"2024-09-12T00:16:05.109745+0000","last_unstale":"2024-09-12T01:00:01.555845+0000","last_undegraded":"2024-09-12T01:00:01.555845+0000","last_fullsized":"2024-09-12T01:00:01.555845+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:15.769156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":406,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"268'420","reported_seq":1857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506522+0000","last_change":"2024-09-12T00:15:57.030478+0000","last_active":"2024-09-12T01:01:09.506522+0000","last_peered":"2024-09-12T01:01:09.506522+0000","last_clean":"2024-09-12T01:01:09.506522+0000","last_became_active":"2024-09-12T00:15:57.028820+0000","last_became_peered":"2024-09-12T00:15:57.028820+0000","last_unstale":"2024-09-12T01:01:09.506522+0000","last_undegraded":"2024-09-12T01:01:09.506522+0000","last_fullsized":"2024-09-12T01:01:09.506522+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:55.701403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2332,"num_read_kb":2186,"num_write":478,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"268'251","reported_seq":902,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:51.564738+0000","last_change":"2024-09-12T00:15:55.059264+0000","last_active":"2024-09-12T01:00:51.564738+0000","last_peered":"2024-09-12T01:00:51.564738+0000","last_clean":"2024-09-12T01:00:51.564738+0000","last_became_active":"2024-09-12T00:15:55.054712+0000","last_became_peered":"2024-09-12T00:15:55.054712+0000","last_unstale":"2024-09-12T01:00:51.564738+0000","last_undegraded":"2024-09-12T01:00:51.564738+0000","last_fullsized":"2024-09-12T01:00:51.564738+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:52.726633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6327961,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":395,"num_read_kb":100892,"num_write":962,"num_write_kb":52799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:19.231696+0000","last_change":"2024-09-12T00:15:59.030022+0000","last_active":"2024-09-12T01:00:19.231696+0000","last_peered":"2024-09-12T01:00:19.231696+0000","last_clean":"2024-09-12T01:00:19.231696+0000","last_became_active":"2024-09-12T00:15:59.028885+0000","last_became_peered":"2024-09-12T00:15:59.028885+0000","last_unstale":"2024-09-12T01:00:19.231696+0000","last_undegraded":"2024-09-12T01:00:19.231696+0000","last_fullsized":"2024-09-12T01:00:19.231696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:22.611802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"268'265","reported_seq":827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.970700+0000","last_change":"2024-09-12T00:16:01.056020+0000","last_active":"2024-09-12T01:02:11.970700+0000","last_peered":"2024-09-12T01:02:11.970700+0000","last_clean":"2024-09-12T01:02:11.970700+0000","last_became_active":"2024-09-12T00:16:01.050654+0000","last_became_peered":"2024-09-12T00:16:01.050654+0000","last_unstale":"2024-09-12T01:02:11.970700+0000","last_undegraded":"2024-09-12T01:02:11.970700+0000","last_fullsized":"2024-09-12T01:02:11.970700+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:07.059509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56239,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":427,"num_read_kb":905,"num_write":352,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:07.155925+0000","last_change":"2024-09-12T00:16:03.089923+0000","last_active":"2024-09-12T00:58:07.155925+0000","last_peered":"2024-09-12T00:58:07.155925+0000","last_clean":"2024-09-12T00:58:07.155925+0000","last_became_active":"2024-09-12T00:16:03.088929+0000","last_became_peered":"2024-09-12T00:16:03.088929+0000","last_unstale":"2024-09-12T00:58:07.155925+0000","last_undegraded":"2024-09-12T00:58:07.155925+0000","last_fullsized":"2024-09-12T00:58:07.155925+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:16.321808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"268'421","reported_seq":2042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.226413+0000","last_change":"2024-09-12T00:15:57.040165+0000","last_active":"2024-09-12T01:01:07.226413+0000","last_peered":"2024-09-12T01:01:07.226413+0000","last_clean":"2024-09-12T01:01:07.226413+0000","last_became_active":"2024-09-12T00:15:57.039919+0000","last_became_peered":"2024-09-12T00:15:57.039919+0000","last_unstale":"2024-09-12T01:01:07.226413+0000","last_undegraded":"2024-09-12T01:01:07.226413+0000","last_fullsized":"2024-09-12T01:01:07.226413+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:23.081811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2299,"num_read_kb":2203,"num_write":481,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"268'232","reported_seq":833,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:56.961783+0000","last_change":"2024-09-12T00:15:55.079982+0000","last_active":"2024-09-12T00:59:56.961783+0000","last_peered":"2024-09-12T00:59:56.961783+0000","last_clean":"2024-09-12T00:59:56.961783+0000","last_became_active":"2024-09-12T00:15:55.079264+0000","last_became_peered":"2024-09-12T00:15:55.079264+0000","last_unstale":"2024-09-12T00:59:56.961783+0000","last_undegraded":"2024-09-12T00:59:56.961783+0000","last_fullsized":"2024-09-12T00:59:56.961783+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:11.776490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8632648,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":313,"num_read_kb":14024,"num_write":835,"num_write_kb":16591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.183037+0000","last_change":"2024-09-12T00:15:59.047833+0000","last_active":"2024-09-12T01:00:13.183037+0000","last_peered":"2024-09-12T01:00:13.183037+0000","last_clean":"2024-09-12T01:00:13.183037+0000","last_became_active":"2024-09-12T00:15:59.039042+0000","last_became_peered":"2024-09-12T00:15:59.039042+0000","last_unstale":"2024-09-12T01:00:13.183037+0000","last_undegraded":"2024-09-12T01:00:13.183037+0000","last_fullsized":"2024-09-12T01:00:13.183037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:09.753392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"268'490","reported_seq":1117,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.005904+0000","last_change":"2024-09-12T00:16:01.063315+0000","last_active":"2024-09-12T01:02:38.005904+0000","last_peered":"2024-09-12T01:02:38.005904+0000","last_clean":"2024-09-12T01:02:38.005904+0000","last_became_active":"2024-09-12T00:16:01.062625+0000","last_became_peered":"2024-09-12T00:16:01.062625+0000","last_unstale":"2024-09-12T01:02:38.005904+0000","last_undegraded":"2024-09-12T01:02:38.005904+0000","last_fullsized":"2024-09-12T01:02:38.005904+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:42.064557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99308,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":891,"num_read_kb":2056,"num_write":776,"num_write_kb":694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.169019+0000","last_change":"2024-09-12T00:16:03.088732+0000","last_active":"2024-09-12T00:58:33.169019+0000","last_peered":"2024-09-12T00:58:33.169019+0000","last_clean":"2024-09-12T00:58:33.169019+0000","last_became_active":"2024-09-12T00:16:03.087980+0000","last_became_peered":"2024-09-12T00:16:03.087980+0000","last_unstale":"2024-09-12T00:58:33.169019+0000","last_undegraded":"2024-09-12T00:58:33.169019+0000","last_fullsized":"2024-09-12T00:58:33.169019+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:06.045851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"268'129","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:43.109476+0000","last_change":"2024-09-12T00:16:05.099199+0000","last_active":"2024-09-12T01:00:43.109476+0000","last_peered":"2024-09-12T01:00:43.109476+0000","last_clean":"2024-09-12T01:00:43.109476+0000","last_became_active":"2024-09-12T00:16:05.098424+0000","last_became_peered":"2024-09-12T00:16:05.098424+0000","last_unstale":"2024-09-12T01:00:43.109476+0000","last_undegraded":"2024-09-12T01:00:43.109476+0000","last_fullsized":"2024-09-12T01:00:43.109476+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:24.228012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":165,"num_write":285,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"268'839","reported_seq":2428,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.158434+0000","last_change":"2024-09-12T00:15:57.023405+0000","last_active":"2024-09-12T01:01:02.158434+0000","last_peered":"2024-09-12T01:01:02.158434+0000","last_clean":"2024-09-12T01:01:02.158434+0000","last_became_active":"2024-09-12T00:15:57.022709+0000","last_became_peered":"2024-09-12T00:15:57.022709+0000","last_unstale":"2024-09-12T01:01:02.158434+0000","last_undegraded":"2024-09-12T01:01:02.158434+0000","last_fullsized":"2024-09-12T01:01:02.158434+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:43.347297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3967,"num_read_kb":3571,"num_write":1117,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"268'254","reported_seq":895,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.954446+0000","last_change":"2024-09-12T00:15:55.065793+0000","last_active":"2024-09-12T01:02:37.954446+0000","last_peered":"2024-09-12T01:02:37.954446+0000","last_clean":"2024-09-12T01:02:37.954446+0000","last_became_active":"2024-09-12T00:15:55.064940+0000","last_became_peered":"2024-09-12T00:15:55.064940+0000","last_unstale":"2024-09-12T01:02:37.954446+0000","last_undegraded":"2024-09-12T01:02:37.954446+0000","last_fullsized":"2024-09-12T01:02:37.954446+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:58.611447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1910291,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":423,"num_read_kb":2788,"num_write":987,"num_write_kb":39220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.188274+0000","last_change":"2024-09-12T00:15:59.035109+0000","last_active":"2024-09-12T00:59:48.188274+0000","last_peered":"2024-09-12T00:59:48.188274+0000","last_clean":"2024-09-12T00:59:48.188274+0000","last_became_active":"2024-09-12T00:15:59.034648+0000","last_became_peered":"2024-09-12T00:15:59.034648+0000","last_unstale":"2024-09-12T00:59:48.188274+0000","last_undegraded":"2024-09-12T00:59:48.188274+0000","last_fullsized":"2024-09-12T00:59:48.188274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:33.763390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"268'277","reported_seq":861,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.973151+0000","last_change":"2024-09-12T00:16:01.048774+0000","last_active":"2024-09-12T01:02:11.973151+0000","last_peered":"2024-09-12T01:02:11.973151+0000","last_clean":"2024-09-12T01:02:11.973151+0000","last_became_active":"2024-09-12T00:16:01.046783+0000","last_became_peered":"2024-09-12T00:16:01.046783+0000","last_unstale":"2024-09-12T01:02:11.973151+0000","last_undegraded":"2024-09-12T01:02:11.973151+0000","last_fullsized":"2024-09-12T01:02:11.973151+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:16.650144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51471,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":467,"num_read_kb":911,"num_write":392,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:37.186492+0000","last_change":"2024-09-12T00:16:03.098371+0000","last_active":"2024-09-12T00:58:37.186492+0000","last_peered":"2024-09-12T00:58:37.186492+0000","last_clean":"2024-09-12T00:58:37.186492+0000","last_became_active":"2024-09-12T00:16:03.097160+0000","last_became_peered":"2024-09-12T00:16:03.097160+0000","last_unstale":"2024-09-12T00:58:37.186492+0000","last_undegraded":"2024-09-12T00:58:37.186492+0000","last_fullsized":"2024-09-12T00:58:37.186492+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:26.964444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"268'210","reported_seq":763,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:49.738687+0000","last_change":"2024-09-12T00:16:05.102618+0000","last_active":"2024-09-12T01:00:49.738687+0000","last_peered":"2024-09-12T01:00:49.738687+0000","last_clean":"2024-09-12T01:00:49.738687+0000","last_became_active":"2024-09-12T00:16:05.101338+0000","last_became_peered":"2024-09-12T00:16:05.101338+0000","last_unstale":"2024-09-12T01:00:49.738687+0000","last_undegraded":"2024-09-12T01:00:49.738687+0000","last_fullsized":"2024-09-12T01:00:49.738687+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:45.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1401,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":396,"num_read_kb":348,"num_write":595,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"268'504","reported_seq":2086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:53.114328+0000","last_change":"2024-09-12T00:15:57.035005+0000","last_active":"2024-09-12T01:00:53.114328+0000","last_peered":"2024-09-12T01:00:53.114328+0000","last_clean":"2024-09-12T01:00:53.114328+0000","last_became_active":"2024-09-12T00:15:57.034257+0000","last_became_peered":"2024-09-12T00:15:57.034257+0000","last_unstale":"2024-09-12T01:00:53.114328+0000","last_undegraded":"2024-09-12T01:00:53.114328+0000","last_fullsized":"2024-09-12T01:00:53.114328+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:16.698877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2760,"num_read_kb":2552,"num_write":653,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"268'308","reported_seq":1049,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.215872+0000","last_change":"2024-09-12T00:15:55.036424+0000","last_active":"2024-09-12T01:02:38.215872+0000","last_peered":"2024-09-12T01:02:38.215872+0000","last_clean":"2024-09-12T01:02:38.215872+0000","last_became_active":"2024-09-12T00:15:55.035741+0000","last_became_peered":"2024-09-12T00:15:55.035741+0000","last_unstale":"2024-09-12T01:02:38.215872+0000","last_undegraded":"2024-09-12T01:02:38.215872+0000","last_fullsized":"2024-09-12T01:02:38.215872+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:26.450236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5572564,"num_objects":61,"num_object_clones":0,"num_object_copies":244,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":642,"num_read_kb":41169,"num_write":1101,"num_write_kb":26675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.168968+0000","last_change":"2024-09-12T00:15:59.045330+0000","last_active":"2024-09-12T00:58:33.168968+0000","last_peered":"2024-09-12T00:58:33.168968+0000","last_clean":"2024-09-12T00:58:33.168968+0000","last_became_active":"2024-09-12T00:15:59.044761+0000","last_became_peered":"2024-09-12T00:15:59.044761+0000","last_unstale":"2024-09-12T00:58:33.168968+0000","last_undegraded":"2024-09-12T00:58:33.168968+0000","last_fullsized":"2024-09-12T00:58:33.168968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:47.536990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"268'292","reported_seq":872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.823176+0000","last_change":"2024-09-12T00:16:01.053808+0000","last_active":"2024-09-12T01:02:37.823176+0000","last_peered":"2024-09-12T01:02:37.823176+0000","last_clean":"2024-09-12T01:02:37.823176+0000","last_became_active":"2024-09-12T00:16:01.052731+0000","last_became_peered":"2024-09-12T00:16:01.052731+0000","last_unstale":"2024-09-12T01:02:37.823176+0000","last_undegraded":"2024-09-12T01:02:37.823176+0000","last_fullsized":"2024-09-12T01:02:37.823176+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:17.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50253,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":1058,"num_write":380,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:17.186579+0000","last_change":"2024-09-12T00:16:03.081577+0000","last_active":"2024-09-12T01:00:17.186579+0000","last_peered":"2024-09-12T01:00:17.186579+0000","last_clean":"2024-09-12T01:00:17.186579+0000","last_became_active":"2024-09-12T00:16:03.080825+0000","last_became_peered":"2024-09-12T00:16:03.080825+0000","last_unstale":"2024-09-12T01:00:17.186579+0000","last_undegraded":"2024-09-12T01:00:17.186579+0000","last_fullsized":"2024-09-12T01:00:17.186579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:06.840301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"268'153","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.041059+0000","last_change":"2024-09-12T00:16:05.098923+0000","last_active":"2024-09-12T01:02:12.041059+0000","last_peered":"2024-09-12T01:02:12.041059+0000","last_clean":"2024-09-12T01:02:12.041059+0000","last_became_active":"2024-09-12T00:16:05.098180+0000","last_became_peered":"2024-09-12T00:16:05.098180+0000","last_unstale":"2024-09-12T01:02:12.041059+0000","last_undegraded":"2024-09-12T01:02:12.041059+0000","last_fullsized":"2024-09-12T01:02:12.041059+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:05.523259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":95,"num_write":348,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"268'338","reported_seq":1661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.583002+0000","last_change":"2024-09-12T00:15:57.040279+0000","last_active":"2024-09-12T01:01:09.583002+0000","last_peered":"2024-09-12T01:01:09.583002+0000","last_clean":"2024-09-12T01:01:09.583002+0000","last_became_active":"2024-09-12T00:15:57.039580+0000","last_became_peered":"2024-09-12T00:15:57.039580+0000","last_unstale":"2024-09-12T01:01:09.583002+0000","last_undegraded":"2024-09-12T01:01:09.583002+0000","last_fullsized":"2024-09-12T01:01:09.583002+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:54.699867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1750,"num_read_kb":1664,"num_write":383,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"268'289","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.774346+0000","last_change":"2024-09-12T00:15:55.044496+0000","last_active":"2024-09-12T01:02:37.774346+0000","last_peered":"2024-09-12T01:02:37.774346+0000","last_clean":"2024-09-12T01:02:37.774346+0000","last_became_active":"2024-09-12T00:15:55.042851+0000","last_became_peered":"2024-09-12T00:15:55.042851+0000","last_unstale":"2024-09-12T01:02:37.774346+0000","last_undegraded":"2024-09-12T01:02:37.774346+0000","last_fullsized":"2024-09-12T01:02:37.774346+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:43.191900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12455127,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":366,"num_read_kb":20803,"num_write":1060,"num_write_kb":57854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.163967+0000","last_change":"2024-09-12T00:15:59.049421+0000","last_active":"2024-09-12T00:58:33.163967+0000","last_peered":"2024-09-12T00:58:33.163967+0000","last_clean":"2024-09-12T00:58:33.163967+0000","last_became_active":"2024-09-12T00:15:59.048632+0000","last_became_peered":"2024-09-12T00:15:59.048632+0000","last_unstale":"2024-09-12T00:58:33.163967+0000","last_undegraded":"2024-09-12T00:58:33.163967+0000","last_fullsized":"2024-09-12T00:58:33.163967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:08.230944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"268'84","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:14.230651+0000","last_change":"2024-09-12T00:16:01.046254+0000","last_active":"2024-09-12T01:00:14.230651+0000","last_peered":"2024-09-12T01:00:14.230651+0000","last_clean":"2024-09-12T01:00:14.230651+0000","last_became_active":"2024-09-12T00:16:01.045565+0000","last_became_peered":"2024-09-12T00:16:01.045565+0000","last_unstale":"2024-09-12T01:00:14.230651+0000","last_undegraded":"2024-09-12T01:00:14.230651+0000","last_fullsized":"2024-09-12T01:00:14.230651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:51.429929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":132,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"268'784","reported_seq":4428,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.124964+0000","last_change":"2024-09-12T00:16:03.092271+0000","last_active":"2024-09-12T01:02:37.124964+0000","last_peered":"2024-09-12T01:02:37.124964+0000","last_clean":"2024-09-12T01:02:37.124964+0000","last_became_active":"2024-09-12T00:16:03.091506+0000","last_became_peered":"2024-09-12T00:16:03.091506+0000","last_unstale":"2024-09-12T01:02:37.124964+0000","last_undegraded":"2024-09-12T01:02:37.124964+0000","last_fullsized":"2024-09-12T01:02:37.124964+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:30.561330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"268'114","reported_seq":621,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.234041+0000","last_change":"2024-09-12T00:16:05.102360+0000","last_active":"2024-09-12T01:00:29.234041+0000","last_peered":"2024-09-12T01:00:29.234041+0000","last_clean":"2024-09-12T01:00:29.234041+0000","last_became_active":"2024-09-12T00:16:05.101500+0000","last_became_peered":"2024-09-12T00:16:05.101500+0000","last_unstale":"2024-09-12T01:00:29.234041+0000","last_undegraded":"2024-09-12T01:00:29.234041+0000","last_fullsized":"2024-09-12T01:00:29.234041+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.731815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"268'1099","reported_seq":2633,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:58.206504+0000","last_change":"2024-09-12T00:15:57.056750+0000","last_active":"2024-09-12T01:00:58.206504+0000","last_peered":"2024-09-12T01:00:58.206504+0000","last_clean":"2024-09-12T01:00:58.206504+0000","last_became_active":"2024-09-12T00:15:57.056507+0000","last_became_peered":"2024-09-12T00:15:57.056507+0000","last_unstale":"2024-09-12T01:00:58.206504+0000","last_undegraded":"2024-09-12T01:00:58.206504+0000","last_fullsized":"2024-09-12T01:00:58.206504+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":1000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:40.456581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5000,"num_read_kb":4445,"num_write":1493,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"268'324","reported_seq":1179,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.087479+0000","last_change":"2024-09-12T00:15:55.051781+0000","last_active":"2024-09-12T01:02:38.087479+0000","last_peered":"2024-09-12T01:02:38.087479+0000","last_clean":"2024-09-12T01:02:38.087479+0000","last_became_active":"2024-09-12T00:15:55.051336+0000","last_became_peered":"2024-09-12T00:15:55.051336+0000","last_unstale":"2024-09-12T01:02:38.087479+0000","last_undegraded":"2024-09-12T01:02:38.087479+0000","last_fullsized":"2024-09-12T01:02:38.087479+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:16.141015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5744009,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":976,"num_read_kb":8590,"num_write":1248,"num_write_kb":12738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.169997+0000","last_change":"2024-09-12T00:15:59.047376+0000","last_active":"2024-09-12T00:58:33.169997+0000","last_peered":"2024-09-12T00:58:33.169997+0000","last_clean":"2024-09-12T00:58:33.169997+0000","last_became_active":"2024-09-12T00:15:59.046538+0000","last_became_peered":"2024-09-12T00:15:59.046538+0000","last_unstale":"2024-09-12T00:58:33.169997+0000","last_undegraded":"2024-09-12T00:58:33.169997+0000","last_fullsized":"2024-09-12T00:58:33.169997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:18.952950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"268'322","reported_seq":924,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.948102+0000","last_change":"2024-09-12T00:16:01.052369+0000","last_active":"2024-09-12T01:02:11.948102+0000","last_peered":"2024-09-12T01:02:11.948102+0000","last_clean":"2024-09-12T01:02:11.948102+0000","last_became_active":"2024-09-12T00:16:01.051648+0000","last_became_peered":"2024-09-12T00:16:01.051648+0000","last_unstale":"2024-09-12T01:02:11.948102+0000","last_undegraded":"2024-09-12T01:02:11.948102+0000","last_fullsized":"2024-09-12T01:02:11.948102+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:31.858718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57323,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":525,"num_read_kb":1023,"num_write":426,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179642+0000","last_change":"2024-09-12T00:16:03.086923+0000","last_active":"2024-09-12T00:59:33.179642+0000","last_peered":"2024-09-12T00:59:33.179642+0000","last_clean":"2024-09-12T00:59:33.179642+0000","last_became_active":"2024-09-12T00:16:03.086333+0000","last_became_peered":"2024-09-12T00:16:03.086333+0000","last_unstale":"2024-09-12T00:59:33.179642+0000","last_undegraded":"2024-09-12T00:59:33.179642+0000","last_fullsized":"2024-09-12T00:59:33.179642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:22.916351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"268'125","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:04.626052+0000","last_change":"2024-09-12T00:16:05.108248+0000","last_active":"2024-09-12T01:01:04.626052+0000","last_peered":"2024-09-12T01:01:04.626052+0000","last_clean":"2024-09-12T01:01:04.626052+0000","last_became_active":"2024-09-12T00:16:05.107284+0000","last_became_peered":"2024-09-12T00:16:05.107284+0000","last_unstale":"2024-09-12T01:01:04.626052+0000","last_undegraded":"2024-09-12T01:01:04.626052+0000","last_fullsized":"2024-09-12T01:01:04.626052+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:25.922474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":114,"num_write":286,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"268'488","reported_seq":2114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.993123+0000","last_change":"2024-09-12T00:15:57.022317+0000","last_active":"2024-09-12T01:00:29.993123+0000","last_peered":"2024-09-12T01:00:29.993123+0000","last_clean":"2024-09-12T01:00:29.993123+0000","last_became_active":"2024-09-12T00:15:57.021526+0000","last_became_peered":"2024-09-12T00:15:57.021526+0000","last_unstale":"2024-09-12T01:00:29.993123+0000","last_undegraded":"2024-09-12T01:00:29.993123+0000","last_fullsized":"2024-09-12T01:00:29.993123+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:49.730181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2702,"num_read_kb":2545,"num_write":554,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"268'327","reported_seq":1007,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.728298+0000","last_change":"2024-09-12T00:15:55.053021+0000","last_active":"2024-09-12T01:02:38.728298+0000","last_peered":"2024-09-12T01:02:38.728298+0000","last_clean":"2024-09-12T01:02:38.728298+0000","last_became_active":"2024-09-12T00:15:55.052503+0000","last_became_peered":"2024-09-12T00:15:55.052503+0000","last_unstale":"2024-09-12T01:02:38.728298+0000","last_undegraded":"2024-09-12T01:02:38.728298+0000","last_fullsized":"2024-09-12T01:02:38.728298+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:07.348592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5440553,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":540,"num_read_kb":52646,"num_write":1012,"num_write_kb":43222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.168868+0000","last_change":"2024-09-12T00:15:59.027111+0000","last_active":"2024-09-12T00:58:33.168868+0000","last_peered":"2024-09-12T00:58:33.168868+0000","last_clean":"2024-09-12T00:58:33.168868+0000","last_became_active":"2024-09-12T00:15:59.024564+0000","last_became_peered":"2024-09-12T00:15:59.024564+0000","last_unstale":"2024-09-12T00:58:33.168868+0000","last_undegraded":"2024-09-12T00:58:33.168868+0000","last_fullsized":"2024-09-12T00:58:33.168868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:49.354490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"268'244","reported_seq":819,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:11.950866+0000","last_change":"2024-09-12T00:16:01.055584+0000","last_active":"2024-09-12T01:02:11.950866+0000","last_peered":"2024-09-12T01:02:11.950866+0000","last_clean":"2024-09-12T01:02:11.950866+0000","last_became_active":"2024-09-12T00:16:01.051612+0000","last_became_peered":"2024-09-12T00:16:01.051612+0000","last_unstale":"2024-09-12T01:02:11.950866+0000","last_undegraded":"2024-09-12T01:02:11.950866+0000","last_fullsized":"2024-09-12T01:02:11.950866+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:47.313727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49092,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":405,"num_read_kb":839,"num_write":328,"num_write_kb":261,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:44.223108+0000","last_change":"2024-09-12T00:16:03.095905+0000","last_active":"2024-09-12T00:59:44.223108+0000","last_peered":"2024-09-12T00:59:44.223108+0000","last_clean":"2024-09-12T00:59:44.223108+0000","last_became_active":"2024-09-12T00:16:03.095016+0000","last_became_peered":"2024-09-12T00:16:03.095016+0000","last_unstale":"2024-09-12T00:59:44.223108+0000","last_undegraded":"2024-09-12T00:59:44.223108+0000","last_fullsized":"2024-09-12T00:59:44.223108+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:35.761981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"268'135","reported_seq":666,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.014067+0000","last_change":"2024-09-12T00:16:05.099520+0000","last_active":"2024-09-12T01:02:02.014067+0000","last_peered":"2024-09-12T01:02:02.014067+0000","last_clean":"2024-09-12T01:02:02.014067+0000","last_became_active":"2024-09-12T00:16:05.098796+0000","last_became_peered":"2024-09-12T00:16:05.098796+0000","last_unstale":"2024-09-12T01:02:02.014067+0000","last_undegraded":"2024-09-12T01:02:02.014067+0000","last_fullsized":"2024-09-12T01:02:02.014067+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:27.979474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":225,"num_write":347,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"268'416","reported_seq":1961,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.872184+0000","last_change":"2024-09-12T00:15:57.038940+0000","last_active":"2024-09-12T01:02:10.872184+0000","last_peered":"2024-09-12T01:02:10.872184+0000","last_clean":"2024-09-12T01:02:10.872184+0000","last_became_active":"2024-09-12T00:15:57.038127+0000","last_became_peered":"2024-09-12T00:15:57.038127+0000","last_unstale":"2024-09-12T01:02:10.872184+0000","last_undegraded":"2024-09-12T01:02:10.872184+0000","last_fullsized":"2024-09-12T01:02:10.872184+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:35.287613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2293,"num_read_kb":2185,"num_write":483,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"268'263","reported_seq":894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:42.506681+0000","last_change":"2024-09-12T00:15:55.076108+0000","last_active":"2024-09-12T01:00:42.506681+0000","last_peered":"2024-09-12T01:00:42.506681+0000","last_clean":"2024-09-12T01:00:42.506681+0000","last_became_active":"2024-09-12T00:15:55.074964+0000","last_became_peered":"2024-09-12T00:15:55.074964+0000","last_unstale":"2024-09-12T01:00:42.506681+0000","last_undegraded":"2024-09-12T01:00:42.506681+0000","last_fullsized":"2024-09-12T01:00:42.506681+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:29.685119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6899581,"num_objects":60,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":434,"num_read_kb":20127,"num_write":942,"num_write_kb":20535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.184985+0000","last_change":"2024-09-12T00:15:59.036962+0000","last_active":"2024-09-12T00:59:33.184985+0000","last_peered":"2024-09-12T00:59:33.184985+0000","last_clean":"2024-09-12T00:59:33.184985+0000","last_became_active":"2024-09-12T00:15:59.036492+0000","last_became_peered":"2024-09-12T00:15:59.036492+0000","last_unstale":"2024-09-12T00:59:33.184985+0000","last_undegraded":"2024-09-12T00:59:33.184985+0000","last_fullsized":"2024-09-12T00:59:33.184985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:26.416316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"268'247","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.671289+0000","last_change":"2024-09-12T00:16:01.053033+0000","last_active":"2024-09-12T01:02:37.671289+0000","last_peered":"2024-09-12T01:02:37.671289+0000","last_clean":"2024-09-12T01:02:37.671289+0000","last_became_active":"2024-09-12T00:16:01.050746+0000","last_became_peered":"2024-09-12T00:16:01.050746+0000","last_unstale":"2024-09-12T01:02:37.671289+0000","last_undegraded":"2024-09-12T01:02:37.671289+0000","last_fullsized":"2024-09-12T01:02:37.671289+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:56.194861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":412,"num_read_kb":978,"num_write":338,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:34.203198+0000","last_change":"2024-09-12T00:16:03.100996+0000","last_active":"2024-09-12T00:58:34.203198+0000","last_peered":"2024-09-12T00:58:34.203198+0000","last_clean":"2024-09-12T00:58:34.203198+0000","last_became_active":"2024-09-12T00:16:03.099890+0000","last_became_peered":"2024-09-12T00:16:03.099890+0000","last_unstale":"2024-09-12T00:58:34.203198+0000","last_undegraded":"2024-09-12T00:58:34.203198+0000","last_fullsized":"2024-09-12T00:58:34.203198+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:53.876340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"268'186","reported_seq":1673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.781143+0000","last_change":"2024-09-12T00:16:05.113925+0000","last_active":"2024-09-12T01:02:10.781143+0000","last_peered":"2024-09-12T01:02:10.781143+0000","last_clean":"2024-09-12T01:02:10.781143+0000","last_became_active":"2024-09-12T00:16:05.113207+0000","last_became_peered":"2024-09-12T00:16:05.113207+0000","last_unstale":"2024-09-12T01:02:10.781143+0000","last_undegraded":"2024-09-12T01:02:10.781143+0000","last_fullsized":"2024-09-12T01:02:10.781143+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:18.252728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1270,"num_read_kb":1246,"num_write":444,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"268'923","reported_seq":2663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506178+0000","last_change":"2024-09-12T00:15:57.013390+0000","last_active":"2024-09-12T01:01:09.506178+0000","last_peered":"2024-09-12T01:01:09.506178+0000","last_clean":"2024-09-12T01:01:09.506178+0000","last_became_active":"2024-09-12T00:15:57.012136+0000","last_became_peered":"2024-09-12T00:15:57.012136+0000","last_unstale":"2024-09-12T01:01:09.506178+0000","last_undegraded":"2024-09-12T01:01:09.506178+0000","last_fullsized":"2024-09-12T01:01:09.506178+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:10.566262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4477,"num_read_kb":4059,"num_write":1259,"num_write_kb":498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"268'301","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.003380+0000","last_change":"2024-09-12T00:15:55.079920+0000","last_active":"2024-09-12T01:02:10.003380+0000","last_peered":"2024-09-12T01:02:10.003380+0000","last_clean":"2024-09-12T01:02:10.003380+0000","last_became_active":"2024-09-12T00:15:55.079005+0000","last_became_peered":"2024-09-12T00:15:55.079005+0000","last_unstale":"2024-09-12T01:02:10.003380+0000","last_undegraded":"2024-09-12T01:02:10.003380+0000","last_fullsized":"2024-09-12T01:02:10.003380+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:58.600991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":888192,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":473,"num_read_kb":476,"num_write":1113,"num_write_kb":40462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:43.182050+0000","last_change":"2024-09-12T00:15:59.040566+0000","last_active":"2024-09-12T00:59:43.182050+0000","last_peered":"2024-09-12T00:59:43.182050+0000","last_clean":"2024-09-12T00:59:43.182050+0000","last_became_active":"2024-09-12T00:15:59.039674+0000","last_became_peered":"2024-09-12T00:15:59.039674+0000","last_unstale":"2024-09-12T00:59:43.182050+0000","last_undegraded":"2024-09-12T00:59:43.182050+0000","last_fullsized":"2024-09-12T00:59:43.182050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:23.557637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"268'344","reported_seq":946,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.914549+0000","last_change":"2024-09-12T00:16:01.052058+0000","last_active":"2024-09-12T01:02:37.914549+0000","last_peered":"2024-09-12T01:02:37.914549+0000","last_clean":"2024-09-12T01:02:37.914549+0000","last_became_active":"2024-09-12T00:16:01.051324+0000","last_became_peered":"2024-09-12T00:16:01.051324+0000","last_unstale":"2024-09-12T01:02:37.914549+0000","last_undegraded":"2024-09-12T01:02:37.914549+0000","last_fullsized":"2024-09-12T01:02:37.914549+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:07.219892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49632,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":580,"num_read_kb":1323,"num_write":476,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.163885+0000","last_change":"2024-09-12T00:16:03.100444+0000","last_active":"2024-09-12T00:58:33.163885+0000","last_peered":"2024-09-12T00:58:33.163885+0000","last_clean":"2024-09-12T00:58:33.163885+0000","last_became_active":"2024-09-12T00:16:03.099836+0000","last_became_peered":"2024-09-12T00:16:03.099836+0000","last_unstale":"2024-09-12T00:58:33.163885+0000","last_undegraded":"2024-09-12T00:58:33.163885+0000","last_fullsized":"2024-09-12T00:58:33.163885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:28.442530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"268'111","reported_seq":603,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.864539+0000","last_change":"2024-09-12T00:16:05.113973+0000","last_active":"2024-09-12T01:02:10.864539+0000","last_peered":"2024-09-12T01:02:10.864539+0000","last_clean":"2024-09-12T01:02:10.864539+0000","last_became_active":"2024-09-12T00:16:05.113231+0000","last_became_peered":"2024-09-12T00:16:05.113231+0000","last_unstale":"2024-09-12T01:02:10.864539+0000","last_undegraded":"2024-09-12T01:02:10.864539+0000","last_fullsized":"2024-09-12T01:02:10.864539+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:31.200737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":663,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":263,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"268'811","reported_seq":2398,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.231281+0000","last_change":"2024-09-12T00:15:57.031887+0000","last_active":"2024-09-12T01:01:07.231281+0000","last_peered":"2024-09-12T01:01:07.231281+0000","last_clean":"2024-09-12T01:01:07.231281+0000","last_became_active":"2024-09-12T00:15:57.031161+0000","last_became_peered":"2024-09-12T00:15:57.031161+0000","last_unstale":"2024-09-12T01:01:07.231281+0000","last_undegraded":"2024-09-12T01:01:07.231281+0000","last_fullsized":"2024-09-12T01:01:07.231281+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:00.259897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3882,"num_read_kb":3503,"num_write":1069,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"268'314","reported_seq":1080,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.117439+0000","last_change":"2024-09-12T00:15:55.042845+0000","last_active":"2024-09-12T01:02:38.117439+0000","last_peered":"2024-09-12T01:02:38.117439+0000","last_clean":"2024-09-12T01:02:38.117439+0000","last_became_active":"2024-09-12T00:15:55.042134+0000","last_became_peered":"2024-09-12T00:15:55.042134+0000","last_unstale":"2024-09-12T01:02:38.117439+0000","last_undegraded":"2024-09-12T01:02:38.117439+0000","last_fullsized":"2024-09-12T01:02:38.117439+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:24.618191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918416,"num_objects":44,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":0,"num_read":825,"num_read_kb":50816,"num_write":1207,"num_write_kb":44406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'401","reported_seq":1855,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.867542+0000","last_change":"2024-09-12T00:15:57.043703+0000","last_active":"2024-09-12T01:02:10.867542+0000","last_peered":"2024-09-12T01:02:10.867542+0000","last_clean":"2024-09-12T01:02:10.867542+0000","last_became_active":"2024-09-12T00:15:57.043013+0000","last_became_peered":"2024-09-12T00:15:57.043013+0000","last_unstale":"2024-09-12T01:02:10.867542+0000","last_undegraded":"2024-09-12T01:02:10.867542+0000","last_fullsized":"2024-09-12T01:02:10.867542+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:02.318087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2106,"num_read_kb":1998,"num_write":459,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"268'237","reported_seq":864,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:03.258647+0000","last_change":"2024-09-12T00:15:55.063527+0000","last_active":"2024-09-12T01:01:03.258647+0000","last_peered":"2024-09-12T01:01:03.258647+0000","last_clean":"2024-09-12T01:01:03.258647+0000","last_became_active":"2024-09-12T00:15:55.062524+0000","last_became_peered":"2024-09-12T00:15:55.062524+0000","last_unstale":"2024-09-12T01:01:03.258647+0000","last_undegraded":"2024-09-12T01:01:03.258647+0000","last_fullsized":"2024-09-12T01:01:03.258647+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:23.930911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11786426,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":384,"num_read_kb":18226,"num_write":828,"num_write_kb":43043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"268'494","reported_seq":2210,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.226294+0000","last_change":"2024-09-12T00:15:57.029585+0000","last_active":"2024-09-12T01:01:07.226294+0000","last_peered":"2024-09-12T01:01:07.226294+0000","last_clean":"2024-09-12T01:01:07.226294+0000","last_became_active":"2024-09-12T00:15:57.018875+0000","last_became_peered":"2024-09-12T00:15:57.018875+0000","last_unstale":"2024-09-12T01:01:07.226294+0000","last_undegraded":"2024-09-12T01:01:07.226294+0000","last_fullsized":"2024-09-12T01:01:07.226294+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:10.062996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2775,"num_read_kb":2615,"num_write":593,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"268'335","reported_seq":985,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.974069+0000","last_change":"2024-09-12T00:15:55.064178+0000","last_active":"2024-09-12T01:02:38.974069+0000","last_peered":"2024-09-12T01:02:38.974069+0000","last_clean":"2024-09-12T01:02:38.974069+0000","last_became_active":"2024-09-12T00:15:55.063603+0000","last_became_peered":"2024-09-12T00:15:55.063603+0000","last_unstale":"2024-09-12T01:02:38.974069+0000","last_undegraded":"2024-09-12T01:02:38.974069+0000","last_fullsized":"2024-09-12T01:02:38.974069+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:29.018846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2056490,"num_objects":32,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":493,"num_read_kb":3291,"num_write":1111,"num_write_kb":12783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"268'390","reported_seq":1797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.016017+0000","last_change":"2024-09-12T00:15:57.031124+0000","last_active":"2024-09-12T01:00:47.016017+0000","last_peered":"2024-09-12T01:00:47.016017+0000","last_clean":"2024-09-12T01:00:47.016017+0000","last_became_active":"2024-09-12T00:15:57.030173+0000","last_became_peered":"2024-09-12T00:15:57.030173+0000","last_unstale":"2024-09-12T01:00:47.016017+0000","last_undegraded":"2024-09-12T01:00:47.016017+0000","last_fullsized":"2024-09-12T01:00:47.016017+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:54.011519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2013,"num_read_kb":1910,"num_write":436,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"268'308","reported_seq":1051,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:45.334227+0000","last_change":"2024-09-12T00:15:55.069041+0000","last_active":"2024-09-12T01:00:45.334227+0000","last_peered":"2024-09-12T01:00:45.334227+0000","last_clean":"2024-09-12T01:00:45.334227+0000","last_became_active":"2024-09-12T00:15:55.068349+0000","last_became_peered":"2024-09-12T00:15:55.068349+0000","last_unstale":"2024-09-12T01:00:45.334227+0000","last_undegraded":"2024-09-12T01:00:45.334227+0000","last_fullsized":"2024-09-12T01:00:45.334227+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:58.205254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13937614,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":785,"num_read_kb":11363,"num_write":1143,"num_write_kb":51000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"268'398","reported_seq":1882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.583028+0000","last_change":"2024-09-12T00:15:57.037970+0000","last_active":"2024-09-12T01:01:09.583028+0000","last_peered":"2024-09-12T01:01:09.583028+0000","last_clean":"2024-09-12T01:01:09.583028+0000","last_became_active":"2024-09-12T00:15:57.037204+0000","last_became_peered":"2024-09-12T00:15:57.037204+0000","last_unstale":"2024-09-12T01:01:09.583028+0000","last_undegraded":"2024-09-12T01:01:09.583028+0000","last_fullsized":"2024-09-12T01:01:09.583028+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:46.963139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2120,"num_read_kb":2017,"num_write":453,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"268'306","reported_seq":941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.178400+0000","last_change":"2024-09-12T00:15:55.072723+0000","last_active":"2024-09-12T01:02:38.178400+0000","last_peered":"2024-09-12T01:02:38.178400+0000","last_clean":"2024-09-12T01:02:38.178400+0000","last_became_active":"2024-09-12T00:15:55.071812+0000","last_became_peered":"2024-09-12T00:15:55.071812+0000","last_unstale":"2024-09-12T01:02:38.178400+0000","last_undegraded":"2024-09-12T01:02:38.178400+0000","last_fullsized":"2024-09-12T01:02:38.178400+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:47.837252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6136414,"num_objects":37,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":471,"num_read_kb":11485,"num_write":1102,"num_write_kb":34407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"268'581","reported_seq":2263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.158878+0000","last_change":"2024-09-12T00:15:57.033145+0000","last_active":"2024-09-12T01:01:02.158878+0000","last_peered":"2024-09-12T01:01:02.158878+0000","last_clean":"2024-09-12T01:01:02.158878+0000","last_became_active":"2024-09-12T00:15:57.032818+0000","last_became_peered":"2024-09-12T00:15:57.032818+0000","last_unstale":"2024-09-12T01:01:02.158878+0000","last_undegraded":"2024-09-12T01:01:02.158878+0000","last_fullsized":"2024-09-12T01:01:02.158878+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:32.583489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2922,"num_read_kb":2722,"num_write":707,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"268'297","reported_seq":973,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.117965+0000","last_change":"2024-09-12T00:15:55.052766+0000","last_active":"2024-09-12T01:02:38.117965+0000","last_peered":"2024-09-12T01:02:38.117965+0000","last_clean":"2024-09-12T01:02:38.117965+0000","last_became_active":"2024-09-12T00:15:55.050781+0000","last_became_peered":"2024-09-12T00:15:55.050781+0000","last_unstale":"2024-09-12T01:02:38.117965+0000","last_undegraded":"2024-09-12T01:02:38.117965+0000","last_fullsized":"2024-09-12T01:02:38.117965+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:34.653614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12378352,"num_objects":52,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":446,"num_read_kb":31943,"num_write":1024,"num_write_kb":41212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"268'801","reported_seq":2287,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.226718+0000","last_change":"2024-09-12T00:15:57.046222+0000","last_active":"2024-09-12T01:01:07.226718+0000","last_peered":"2024-09-12T01:01:07.226718+0000","last_clean":"2024-09-12T01:01:07.226718+0000","last_became_active":"2024-09-12T00:15:57.045500+0000","last_became_peered":"2024-09-12T00:15:57.045500+0000","last_unstale":"2024-09-12T01:01:07.226718+0000","last_undegraded":"2024-09-12T01:01:07.226718+0000","last_fullsized":"2024-09-12T01:01:07.226718+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:02.396896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3817,"num_read_kb":3427,"num_write":1098,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"268'267","reported_seq":889,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.190114+0000","last_change":"2024-09-12T00:15:55.055440+0000","last_active":"2024-09-12T01:02:38.190114+0000","last_peered":"2024-09-12T01:02:38.190114+0000","last_clean":"2024-09-12T01:02:38.190114+0000","last_became_active":"2024-09-12T00:15:55.054914+0000","last_became_peered":"2024-09-12T00:15:55.054914+0000","last_unstale":"2024-09-12T01:02:38.190114+0000","last_undegraded":"2024-09-12T01:02:38.190114+0000","last_fullsized":"2024-09-12T01:02:38.190114+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:21.527461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10801766,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":375,"num_read_kb":50632,"num_write":920,"num_write_kb":37363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"268'817","reported_seq":2510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:25.613084+0000","last_change":"2024-09-12T00:15:57.022003+0000","last_active":"2024-09-12T01:00:25.613084+0000","last_peered":"2024-09-12T01:00:25.613084+0000","last_clean":"2024-09-12T01:00:25.613084+0000","last_became_active":"2024-09-12T00:15:57.021622+0000","last_became_peered":"2024-09-12T00:15:57.021622+0000","last_unstale":"2024-09-12T01:00:25.613084+0000","last_undegraded":"2024-09-12T01:00:25.613084+0000","last_fullsized":"2024-09-12T01:00:25.613084+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.960528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4035,"num_read_kb":3684,"num_write":1067,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"268'289","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.489901+0000","last_change":"2024-09-12T00:15:55.068680+0000","last_active":"2024-09-12T01:00:47.489901+0000","last_peered":"2024-09-12T01:00:47.489901+0000","last_clean":"2024-09-12T01:00:47.489901+0000","last_became_active":"2024-09-12T00:15:55.055929+0000","last_became_peered":"2024-09-12T00:15:55.055929+0000","last_unstale":"2024-09-12T01:00:47.489901+0000","last_undegraded":"2024-09-12T01:00:47.489901+0000","last_fullsized":"2024-09-12T01:00:47.489901+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:15.633734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62773,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":490,"num_read_kb":583,"num_write":1145,"num_write_kb":30899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"268'837","reported_seq":2503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.883860+0000","last_change":"2024-09-12T00:15:57.040650+0000","last_active":"2024-09-12T01:02:10.883860+0000","last_peered":"2024-09-12T01:02:10.883860+0000","last_clean":"2024-09-12T01:02:10.883860+0000","last_became_active":"2024-09-12T00:15:57.039946+0000","last_became_peered":"2024-09-12T00:15:57.039946+0000","last_unstale":"2024-09-12T01:02:10.883860+0000","last_undegraded":"2024-09-12T01:02:10.883860+0000","last_fullsized":"2024-09-12T01:02:10.883860+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:12.893023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4272,"num_read_kb":3874,"num_write":1144,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"268'395","reported_seq":1124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.718354+0000","last_change":"2024-09-12T00:15:55.065969+0000","last_active":"2024-09-12T01:02:38.718354+0000","last_peered":"2024-09-12T01:02:38.718354+0000","last_clean":"2024-09-12T01:02:38.718354+0000","last_became_active":"2024-09-12T00:15:55.065129+0000","last_became_peered":"2024-09-12T00:15:55.065129+0000","last_unstale":"2024-09-12T01:02:38.718354+0000","last_undegraded":"2024-09-12T01:02:38.718354+0000","last_fullsized":"2024-09-12T01:02:38.718354+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:11.829722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236434,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":755,"num_read_kb":24147,"num_write":1296,"num_write_kb":32019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"268'876","reported_seq":2654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.883373+0000","last_change":"2024-09-12T00:15:57.052278+0000","last_active":"2024-09-12T01:02:10.883373+0000","last_peered":"2024-09-12T01:02:10.883373+0000","last_clean":"2024-09-12T01:02:10.883373+0000","last_became_active":"2024-09-12T00:15:57.051976+0000","last_became_peered":"2024-09-12T00:15:57.051976+0000","last_unstale":"2024-09-12T01:02:10.883373+0000","last_undegraded":"2024-09-12T01:02:10.883373+0000","last_fullsized":"2024-09-12T01:02:10.883373+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":800,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:02.396896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4749,"num_read_kb":4328,"num_write":1184,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"268'281","reported_seq":909,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.756472+0000","last_change":"2024-09-12T00:15:55.060643+0000","last_active":"2024-09-12T01:02:01.756472+0000","last_peered":"2024-09-12T01:02:01.756472+0000","last_clean":"2024-09-12T01:02:01.756472+0000","last_became_active":"2024-09-12T00:15:55.055449+0000","last_became_peered":"2024-09-12T00:15:55.055449+0000","last_unstale":"2024-09-12T01:02:01.756472+0000","last_undegraded":"2024-09-12T01:02:01.756472+0000","last_fullsized":"2024-09-12T01:02:01.756472+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:27.185874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73940,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":425,"num_read_kb":2263,"num_write":1020,"num_write_kb":24139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"268'787","reported_seq":2366,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.160044+0000","last_change":"2024-09-12T00:15:57.033089+0000","last_active":"2024-09-12T01:01:02.160044+0000","last_peered":"2024-09-12T01:01:02.160044+0000","last_clean":"2024-09-12T01:01:02.160044+0000","last_became_active":"2024-09-12T00:15:57.031976+0000","last_became_peered":"2024-09-12T00:15:57.031976+0000","last_unstale":"2024-09-12T01:01:02.160044+0000","last_undegraded":"2024-09-12T01:01:02.160044+0000","last_fullsized":"2024-09-12T01:01:02.160044+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:30.528175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3862,"num_read_kb":3503,"num_write":1033,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"268'321","reported_seq":971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.206389+0000","last_change":"2024-09-12T00:15:55.052989+0000","last_active":"2024-09-12T01:02:38.206389+0000","last_peered":"2024-09-12T01:02:38.206389+0000","last_clean":"2024-09-12T01:02:38.206389+0000","last_became_active":"2024-09-12T00:15:55.051451+0000","last_became_peered":"2024-09-12T00:15:55.051451+0000","last_unstale":"2024-09-12T01:02:38.206389+0000","last_undegraded":"2024-09-12T01:02:38.206389+0000","last_fullsized":"2024-09-12T01:02:38.206389+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:14.616053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10751670,"num_objects":42,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":514,"num_read_kb":17814,"num_write":1142,"num_write_kb":26945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"268'483","reported_seq":2159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:58.205844+0000","last_change":"2024-09-12T00:15:57.020535+0000","last_active":"2024-09-12T01:00:58.205844+0000","last_peered":"2024-09-12T01:00:58.205844+0000","last_clean":"2024-09-12T01:00:58.205844+0000","last_became_active":"2024-09-12T00:15:57.019963+0000","last_became_peered":"2024-09-12T00:15:57.019963+0000","last_unstale":"2024-09-12T01:00:58.205844+0000","last_undegraded":"2024-09-12T01:00:58.205844+0000","last_fullsized":"2024-09-12T01:00:58.205844+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:34.340309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2585,"num_read_kb":2455,"num_write":555,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"268'254","reported_seq":878,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.955956+0000","last_change":"2024-09-12T00:15:55.051310+0000","last_active":"2024-09-12T01:02:37.955956+0000","last_peered":"2024-09-12T01:02:37.955956+0000","last_clean":"2024-09-12T01:02:37.955956+0000","last_became_active":"2024-09-12T00:15:55.050267+0000","last_became_peered":"2024-09-12T00:15:55.050267+0000","last_unstale":"2024-09-12T01:02:37.955956+0000","last_undegraded":"2024-09-12T01:02:37.955956+0000","last_fullsized":"2024-09-12T01:02:37.955956+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:25.710871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2136315,"num_objects":40,"num_object_clones":0,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":396,"num_read_kb":8617,"num_write":983,"num_write_kb":22964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1339","reported_seq":3149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.016786+0000","last_change":"2024-09-12T00:15:57.045427+0000","last_active":"2024-09-12T01:00:47.016786+0000","last_peered":"2024-09-12T01:00:47.016786+0000","last_clean":"2024-09-12T01:00:47.016786+0000","last_became_active":"2024-09-12T00:15:57.045076+0000","last_became_peered":"2024-09-12T00:15:57.045076+0000","last_unstale":"2024-09-12T01:00:47.016786+0000","last_undegraded":"2024-09-12T01:00:47.016786+0000","last_fullsized":"2024-09-12T01:00:47.016786+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:48.293590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6209,"num_read_kb":5540,"num_write":1861,"num_write_kb":794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"268'287","reported_seq":925,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.983855+0000","last_change":"2024-09-12T00:15:55.065995+0000","last_active":"2024-09-12T01:02:37.983855+0000","last_peered":"2024-09-12T01:02:37.983855+0000","last_clean":"2024-09-12T01:02:37.983855+0000","last_became_active":"2024-09-12T00:15:55.061287+0000","last_became_peered":"2024-09-12T00:15:55.061287+0000","last_unstale":"2024-09-12T01:02:37.983855+0000","last_undegraded":"2024-09-12T01:02:37.983855+0000","last_fullsized":"2024-09-12T01:02:37.983855+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:58.543361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":482,"num_objects":39,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":479,"num_read_kb":733,"num_write":1182,"num_write_kb":3677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"268'404","reported_seq":1771,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:51.103353+0000","last_change":"2024-09-12T00:15:57.043968+0000","last_active":"2024-09-12T01:00:51.103353+0000","last_peered":"2024-09-12T01:00:51.103353+0000","last_clean":"2024-09-12T01:00:51.103353+0000","last_became_active":"2024-09-12T00:15:57.043158+0000","last_became_peered":"2024-09-12T00:15:57.043158+0000","last_unstale":"2024-09-12T01:00:51.103353+0000","last_undegraded":"2024-09-12T01:00:51.103353+0000","last_fullsized":"2024-09-12T01:00:51.103353+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:06.171447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1978,"num_read_kb":1859,"num_write":462,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"268'365","reported_seq":1051,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.627974+0000","last_change":"2024-09-12T00:15:55.059249+0000","last_active":"2024-09-12T01:02:38.627974+0000","last_peered":"2024-09-12T01:02:38.627974+0000","last_clean":"2024-09-12T01:02:38.627974+0000","last_became_active":"2024-09-12T00:15:55.058726+0000","last_became_peered":"2024-09-12T00:15:55.058726+0000","last_unstale":"2024-09-12T01:02:38.627974+0000","last_undegraded":"2024-09-12T01:02:38.627974+0000","last_fullsized":"2024-09-12T01:02:38.627974+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:59.008674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":587009,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":582,"num_read_kb":57120,"num_write":1282,"num_write_kb":58223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"268'1341","reported_seq":2827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:53.114495+0000","last_change":"2024-09-12T00:15:57.045207+0000","last_active":"2024-09-12T01:00:53.114495+0000","last_peered":"2024-09-12T01:00:53.114495+0000","last_clean":"2024-09-12T01:00:53.114495+0000","last_became_active":"2024-09-12T00:15:57.043227+0000","last_became_peered":"2024-09-12T00:15:57.043227+0000","last_unstale":"2024-09-12T01:00:53.114495+0000","last_undegraded":"2024-09-12T01:00:53.114495+0000","last_fullsized":"2024-09-12T01:00:53.114495+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:40.677355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5913,"num_read_kb":5121,"num_write":1910,"num_write_kb":821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"268'231","reported_seq":873,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:03.267756+0000","last_change":"2024-09-12T00:15:55.053474+0000","last_active":"2024-09-12T01:01:03.267756+0000","last_peered":"2024-09-12T01:01:03.267756+0000","last_clean":"2024-09-12T01:01:03.267756+0000","last_became_active":"2024-09-12T00:15:55.052287+0000","last_became_peered":"2024-09-12T00:15:55.052287+0000","last_unstale":"2024-09-12T01:01:03.267756+0000","last_undegraded":"2024-09-12T01:01:03.267756+0000","last_fullsized":"2024-09-12T01:01:03.267756+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:48.478932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13281004,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":413,"num_read_kb":19752,"num_write":853,"num_write_kb":40992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"268'335","reported_seq":1745,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.870604+0000","last_change":"2024-09-12T00:15:57.039951+0000","last_active":"2024-09-12T01:02:10.870604+0000","last_peered":"2024-09-12T01:02:10.870604+0000","last_clean":"2024-09-12T01:02:10.870604+0000","last_became_active":"2024-09-12T00:15:57.039633+0000","last_became_peered":"2024-09-12T00:15:57.039633+0000","last_unstale":"2024-09-12T01:02:10.870604+0000","last_undegraded":"2024-09-12T01:02:10.870604+0000","last_fullsized":"2024-09-12T01:02:10.870604+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:29.316323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1924,"num_read_kb":1842,"num_write":397,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"268'298","reported_seq":980,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.728341+0000","last_change":"2024-09-12T00:15:55.055642+0000","last_active":"2024-09-12T01:02:38.728341+0000","last_peered":"2024-09-12T01:02:38.728341+0000","last_clean":"2024-09-12T01:02:38.728341+0000","last_became_active":"2024-09-12T00:15:55.054952+0000","last_became_peered":"2024-09-12T00:15:55.054952+0000","last_unstale":"2024-09-12T01:02:38.728341+0000","last_undegraded":"2024-09-12T01:02:38.728341+0000","last_fullsized":"2024-09-12T01:02:38.728341+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:10.159478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11646207,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":466,"num_read_kb":117939,"num_write":925,"num_write_kb":46136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"268'363","reported_seq":1021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.485230+0000","last_change":"2024-09-12T00:15:55.053129+0000","last_active":"2024-09-12T01:02:38.485230+0000","last_peered":"2024-09-12T01:02:38.485230+0000","last_clean":"2024-09-12T01:02:38.485230+0000","last_became_active":"2024-09-12T00:15:55.052320+0000","last_became_peered":"2024-09-12T00:15:55.052320+0000","last_unstale":"2024-09-12T01:02:38.485230+0000","last_undegraded":"2024-09-12T01:02:38.485230+0000","last_fullsized":"2024-09-12T01:02:38.485230+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:04.001879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13659026,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":544,"num_read_kb":13864,"num_write":1319,"num_write_kb":55041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"268'475","reported_seq":2091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.171239+0000","last_change":"2024-09-12T00:15:57.055663+0000","last_active":"2024-09-12T01:00:52.171239+0000","last_peered":"2024-09-12T01:00:52.171239+0000","last_clean":"2024-09-12T01:00:52.171239+0000","last_became_active":"2024-09-12T00:15:57.054996+0000","last_became_peered":"2024-09-12T00:15:57.054996+0000","last_unstale":"2024-09-12T01:00:52.171239+0000","last_undegraded":"2024-09-12T01:00:52.171239+0000","last_fullsized":"2024-09-12T01:00:52.171239+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:56.476228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2784,"num_read_kb":2618,"num_write":619,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"268'260","reported_seq":879,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:17.211534+0000","last_change":"2024-09-12T00:15:55.079679+0000","last_active":"2024-09-12T01:00:17.211534+0000","last_peered":"2024-09-12T01:00:17.211534+0000","last_clean":"2024-09-12T01:00:17.211534+0000","last_became_active":"2024-09-12T00:15:55.078832+0000","last_became_peered":"2024-09-12T00:15:55.078832+0000","last_unstale":"2024-09-12T01:00:17.211534+0000","last_undegraded":"2024-09-12T01:00:17.211534+0000","last_fullsized":"2024-09-12T01:00:17.211534+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:54.215633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12399463,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":360,"num_read_kb":33206,"num_write":922,"num_write_kb":34373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"268'950","reported_seq":2368,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:53.114798+0000","last_change":"2024-09-12T00:15:57.027951+0000","last_active":"2024-09-12T01:00:53.114798+0000","last_peered":"2024-09-12T01:00:53.114798+0000","last_clean":"2024-09-12T01:00:53.114798+0000","last_became_active":"2024-09-12T00:15:57.027565+0000","last_became_peered":"2024-09-12T00:15:57.027565+0000","last_unstale":"2024-09-12T01:00:53.114798+0000","last_undegraded":"2024-09-12T01:00:53.114798+0000","last_fullsized":"2024-09-12T01:00:53.114798+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":900,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:55.130874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4238,"num_read_kb":3802,"num_write":1335,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6185,"num_read_kb":4382,"num_write":1972,"num_write_kb":869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1043,"ondisk_log_size":1043,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15033,"num_read_kb":14688,"num_write":16727,"num_write_kb":4883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1560,"ondisk_log_size":1560,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":781,"ondisk_log_size":781,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1728236,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":17413,"num_read_kb":34185,"num_write":14663,"num_write_kb":11510,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":1941585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1806,"ondisk_log_size":1806,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2876,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212032,"num_read_kb":193923,"num_write":55063,"num_write_kb":18681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4050,"ondisk_log_size":4050,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":409390098,"num_objects":3171,"num_object_clones":0,"num_object_copies":12684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3171,"num_whiteouts":0,"num_read":33213,"num_read_kb":1967309,"num_write":68729,"num_write_kb":2158407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":596008960,"data_stored":596008960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3804,"ondisk_log_size":3804,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":59857393,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":126,"num_read_kb":197046,"num_write":143,"num_write_kb":127402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":118673408,"data_stored":118669420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":48323057,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":123,"num_read_kb":185778,"num_write":145,"num_write_kb":127402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":95604736,"data_stored":95600748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719477304,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305208,"kb_used_data":79552,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94066632,"statfs":{"total":96636764160,"available":96324231168,"internally_reserved":0,"allocated":81461248,"data_stored":79415482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":230947271},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510011,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":215396,"kb_used_data":107856,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94156444,"statfs":{"total":96636764160,"available":96416198656,"internally_reserved":0,"allocated":110444544,"data_stored":108404854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":110098886},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510009,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":387688,"kb_used_data":149720,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":93984152,"statfs":{"total":96636764160,"available":96239771648,"internally_reserved":0,"allocated":153313280,"data_stored":151263128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243661253},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510011,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":277812,"kb_used_data":156388,"kb_used_omap":1,"kb_used_meta":121406,"kb_avail":94094028,"statfs":{"total":96636764160,"available":96352284672,"internally_reserved":0,"allocated":160141312,"data_stored":158119567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":124320197},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510010,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":397512,"kb_used_data":73260,"kb_used_omap":1,"kb_used_meta":324094,"kb_avail":93974328,"statfs":{"total":96636764160,"available":96229711872,"internally_reserved":0,"allocated":75018240,"data_stored":72946735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":331872709},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510009,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":234068,"kb_used_data":130644,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94137772,"statfs":{"total":96636764160,"available":96397078528,"internally_reserved":0,"allocated":133779456,"data_stored":131707105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542715,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":358024,"kb_used_data":120056,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":94013816,"statfs":{"total":96636764160,"available":96270147584,"internally_reserved":0,"allocated":122937344,"data_stored":120910860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":243661258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542713,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":374740,"kb_used_data":122820,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93997100,"statfs":{"total":96636764160,"available":96253030400,"internally_reserved":0,"allocated":125767680,"data_stored":123715390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257948101},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":91365376,"data_stored":91365376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":55009280,"data_stored":55009280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90898432,"data_stored":90898432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53452800,"data_stored":53452800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":77246464,"data_stored":77246464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":66994176,"data_stored":66994176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":71073792,"data_stored":71073792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":89968640,"data_stored":89968640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":372736,"data_stored":304932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":421888,"data_stored":340798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":80982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":78962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":389120,"data_stored":321461,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":462848,"data_stored":399210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":176128,"data_stored":130036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":348160,"data_stored":285204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8392704,"data_stored":8391818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":9437184,"data_stored":9437184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12623872,"data_stored":12623057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":13631488,"data_stored":13631488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15777792,"data_stored":15777056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":17915904,"data_stored":17914353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5292032,"data_stored":5291296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6332416,"data_stored":6331601,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6340608,"data_stored":6339872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10526720,"data_stored":10525905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":39845888,"data_stored":39845888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":18874368,"data_stored":18874368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10489856,"data_stored":10488970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:02:42.127 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:02:42.467 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:02:42.467 INFO:teuthology.orchestra.run.smithi138.stdout:{"epoch":268,"fsid":"16f746b5-6307-4fbc-8384-d9f6a260b7cb","created":"2024-09-12T00:15:19.923397+0000","modified":"2024-09-12T00:43:49.236047+0000","last_up_change":"2024-09-12T00:15:33.032265+0000","last_in_change":"2024-09-12T00:15:22.239170+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":17,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:15:32.937011+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:15:38.096683+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:15:52.977699+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:15:55.387709+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:15:57.123151+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:15:59.134054+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:16:01.080234+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:16:03.213483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T00:30:49.585585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"259","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T00:32:23.657321+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"262","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T00:32:26.222693+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"265","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T00:43:46.652742+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"268","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d6c0d880-a1ba-432e-a77c-5808f1c17a87","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":276276685},{"type":"v1","addr":"172.21.15.138:6809","nonce":276276685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":276276685},{"type":"v1","addr":"172.21.15.138:6811","nonce":276276685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6814","nonce":276276685},{"type":"v1","addr":"172.21.15.138:6815","nonce":276276685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":276276685},{"type":"v1","addr":"172.21.15.138:6813","nonce":276276685}]},"public_addr":"172.21.15.138:6809/276276685","cluster_addr":"172.21.15.138:6811/276276685","heartbeat_back_addr":"172.21.15.138:6815/276276685","heartbeat_front_addr":"172.21.15.138:6813/276276685","state":["exists","up"]},{"osd":1,"uuid":"aef56edf-4581-434d-960b-e3892e3ca69f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":1437861584},{"type":"v1","addr":"172.21.15.138:6801","nonce":1437861584}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":1437861584},{"type":"v1","addr":"172.21.15.138:6803","nonce":1437861584}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":1437861584},{"type":"v1","addr":"172.21.15.138:6807","nonce":1437861584}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":1437861584},{"type":"v1","addr":"172.21.15.138:6805","nonce":1437861584}]},"public_addr":"172.21.15.138:6801/1437861584","cluster_addr":"172.21.15.138:6803/1437861584","heartbeat_back_addr":"172.21.15.138:6807/1437861584","heartbeat_front_addr":"172.21.15.138:6805/1437861584","state":["exists","up"]},{"osd":2,"uuid":"d6c33e6d-8b8f-4764-88bc-2cc19b88e5a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":3496313381},{"type":"v1","addr":"172.21.15.138:6817","nonce":3496313381}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6818","nonce":3496313381},{"type":"v1","addr":"172.21.15.138:6819","nonce":3496313381}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6822","nonce":3496313381},{"type":"v1","addr":"172.21.15.138:6823","nonce":3496313381}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":3496313381},{"type":"v1","addr":"172.21.15.138:6821","nonce":3496313381}]},"public_addr":"172.21.15.138:6817/3496313381","cluster_addr":"172.21.15.138:6819/3496313381","heartbeat_back_addr":"172.21.15.138:6823/3496313381","heartbeat_front_addr":"172.21.15.138:6821/3496313381","state":["exists","up"]},{"osd":3,"uuid":"5141ce2d-e459-4787-a2c7-7e1d38f76caf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":4021037468},{"type":"v1","addr":"172.21.15.138:6825","nonce":4021037468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6826","nonce":4021037468},{"type":"v1","addr":"172.21.15.138:6827","nonce":4021037468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6830","nonce":4021037468},{"type":"v1","addr":"172.21.15.138:6831","nonce":4021037468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":4021037468},{"type":"v1","addr":"172.21.15.138:6829","nonce":4021037468}]},"public_addr":"172.21.15.138:6825/4021037468","cluster_addr":"172.21.15.138:6827/4021037468","heartbeat_back_addr":"172.21.15.138:6831/4021037468","heartbeat_front_addr":"172.21.15.138:6829/4021037468","state":["exists","up"]},{"osd":4,"uuid":"315e9645-3e31-45c9-b23f-febd5f82d1b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6808","nonce":3653702099},{"type":"v1","addr":"172.21.15.178:6810","nonce":3653702099}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6815","nonce":3653702099},{"type":"v1","addr":"172.21.15.178:6818","nonce":3653702099}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6827","nonce":3653702099},{"type":"v1","addr":"172.21.15.178:6830","nonce":3653702099}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6821","nonce":3653702099},{"type":"v1","addr":"172.21.15.178:6825","nonce":3653702099}]},"public_addr":"172.21.15.178:6810/3653702099","cluster_addr":"172.21.15.178:6818/3653702099","heartbeat_back_addr":"172.21.15.178:6830/3653702099","heartbeat_front_addr":"172.21.15.178:6825/3653702099","state":["exists","up"]},{"osd":5,"uuid":"a2e5129b-d56e-46ef-af21-520fbf6eaf8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6800","nonce":833505061},{"type":"v1","addr":"172.21.15.178:6801","nonce":833505061}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6802","nonce":833505061},{"type":"v1","addr":"172.21.15.178:6803","nonce":833505061}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6806","nonce":833505061},{"type":"v1","addr":"172.21.15.178:6807","nonce":833505061}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6804","nonce":833505061},{"type":"v1","addr":"172.21.15.178:6805","nonce":833505061}]},"public_addr":"172.21.15.178:6801/833505061","cluster_addr":"172.21.15.178:6803/833505061","heartbeat_back_addr":"172.21.15.178:6807/833505061","heartbeat_front_addr":"172.21.15.178:6805/833505061","state":["exists","up"]},{"osd":6,"uuid":"d6ac10c3-de6a-490a-84ad-a00d16d1def2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6809","nonce":1109288734},{"type":"v1","addr":"172.21.15.178:6812","nonce":1109288734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6814","nonce":1109288734},{"type":"v1","addr":"172.21.15.178:6817","nonce":1109288734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6824","nonce":1109288734},{"type":"v1","addr":"172.21.15.178:6828","nonce":1109288734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6820","nonce":1109288734},{"type":"v1","addr":"172.21.15.178:6822","nonce":1109288734}]},"public_addr":"172.21.15.178:6812/1109288734","cluster_addr":"172.21.15.178:6817/1109288734","heartbeat_back_addr":"172.21.15.178:6828/1109288734","heartbeat_front_addr":"172.21.15.178:6822/1109288734","state":["exists","up"]},{"osd":7,"uuid":"e5a9abc6-25d2-4ebb-8970-a40dee5ea841","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":266,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6811","nonce":2062234204},{"type":"v1","addr":"172.21.15.178:6813","nonce":2062234204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6816","nonce":2062234204},{"type":"v1","addr":"172.21.15.178:6819","nonce":2062234204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6829","nonce":2062234204},{"type":"v1","addr":"172.21.15.178:6831","nonce":2062234204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.178:6823","nonce":2062234204},{"type":"v1","addr":"172.21.15.178:6826","nonce":2062234204}]},"public_addr":"172.21.15.178:6813/2062234204","cluster_addr":"172.21.15.178:6819/2062234204","heartbeat_back_addr":"172.21.15.178:6831/2062234204","heartbeat_front_addr":"172.21.15.178:6826/2062234204","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.146991+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.082686+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.550166+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.961690+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:29.098585+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:28.735028+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:28.930010+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:15:28.942187+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.a","mappings":[{"from":2,"to":6}]},{"pgid":"3.14","mappings":[{"from":2,"to":5}]},{"pgid":"3.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:02:43.487 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T01:02:43.487 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:02:43.647 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T01:02:43.647 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:02:43.647 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T01:02:43.663 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T01:02:43.961 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T01:02:43.981 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T01:02:43.981 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:02:44.117 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T01:02:44.117 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:02:44.117 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T01:02:44.132 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T01:02:44.421 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T01:02:44.440 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T01:02:44.440 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:02:44.585 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T01:02:44.585 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:02:44.585 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T01:02:44.600 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T01:02:44.896 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T01:02:44.915 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T01:02:44.915 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:02:45.059 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T01:02:45.059 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:02:45.059 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T01:02:45.075 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T01:02:45.381 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T01:02:45.401 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T01:02:45.401 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:02:45.546 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T01:02:45.547 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:02:45.547 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T01:02:45.562 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T01:02:45.851 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T01:02:45.870 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T01:02:45.870 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:02:46.018 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T01:02:46.018 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:02:46.018 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T01:02:46.033 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T01:02:46.319 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T01:02:46.337 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T01:02:46.337 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:02:46.480 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T01:02:46.480 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:02:46.480 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T01:02:46.497 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T01:02:46.781 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T01:02:46.800 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T01:02:46.800 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:02:46.946 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-09-12T01:02:46.946 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:02:46.946 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-09-12T01:02:46.961 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T01:02:47.253 INFO:teuthology.orchestra.run.smithi138.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T01:02:47.271 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:02:47.599 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:02:47.614 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-12T01:02:47.621 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":1678,"stamp":"2024-09-12T01:02:46.818121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":93219632,"num_objects":867,"num_object_clones":0,"num_object_copies":2480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":867,"num_whiteouts":0,"num_read":289757,"num_read_kb":2602955,"num_write":160574,"num_write_kb":2450853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12880,"ondisk_log_size":12880,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1848768,"kb_used_data":155576,"kb_used_omap":12,"kb_used_meta":1691635,"kb_avail":753125952,"statfs":{"total":773094113280,"available":771200974848,"internally_reserved":0,"allocated":159309824,"data_stored":143120806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1732234800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,4,7,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-628945142,"num_objects":-4068,"num_object_clones":0,"num_object_copies":-16196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4068,"num_whiteouts":0,"num_read":4554,"num_read_kb":4084,"num_write":4319,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008948"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.173833+0000","last_change":"2024-09-12T00:43:48.284274+0000","last_active":"2024-09-12T00:58:48.173833+0000","last_peered":"2024-09-12T00:58:48.173833+0000","last_clean":"2024-09-12T00:58:48.173833+0000","last_became_active":"2024-09-12T00:43:48.282777+0000","last_became_peered":"2024-09-12T00:43:48.282777+0000","last_unstale":"2024-09-12T00:58:48.173833+0000","last_undegraded":"2024-09-12T00:58:48.173833+0000","last_fullsized":"2024-09-12T00:58:48.173833+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:26.885566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"268'2","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:28.222443+0000","last_change":"2024-09-12T00:32:28.070403+0000","last_active":"2024-09-12T01:02:28.222443+0000","last_peered":"2024-09-12T01:02:28.222443+0000","last_clean":"2024-09-12T01:02:28.222443+0000","last_became_active":"2024-09-12T00:32:28.069841+0000","last_became_peered":"2024-09-12T00:32:28.069841+0000","last_unstale":"2024-09-12T01:02:28.222443+0000","last_undegraded":"2024-09-12T01:02:28.222443+0000","last_fullsized":"2024-09-12T01:02:28.222443+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:32.102006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.181946+0000","last_change":"2024-09-12T00:32:25.027280+0000","last_active":"2024-09-12T00:59:57.181946+0000","last_peered":"2024-09-12T00:59:57.181946+0000","last_clean":"2024-09-12T00:59:57.181946+0000","last_became_active":"2024-09-12T00:32:25.026726+0000","last_became_peered":"2024-09-12T00:32:25.026726+0000","last_unstale":"2024-09-12T00:59:57.181946+0000","last_undegraded":"2024-09-12T00:59:57.181946+0000","last_fullsized":"2024-09-12T00:59:57.181946+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:47.659267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"268'31","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.187370+0000","last_change":"2024-09-12T00:30:51.544593+0000","last_active":"2024-09-12T01:00:03.187370+0000","last_peered":"2024-09-12T01:00:03.187370+0000","last_clean":"2024-09-12T01:00:03.187370+0000","last_became_active":"2024-09-12T00:30:51.543858+0000","last_became_peered":"2024-09-12T00:30:51.543858+0000","last_unstale":"2024-09-12T01:00:03.187370+0000","last_undegraded":"2024-09-12T01:00:03.187370+0000","last_fullsized":"2024-09-12T01:00:03.187370+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:38.568158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":120,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.161958+0000","last_change":"2024-09-12T00:43:48.286931+0000","last_active":"2024-09-12T00:58:48.161958+0000","last_peered":"2024-09-12T00:58:48.161958+0000","last_clean":"2024-09-12T00:58:48.161958+0000","last_became_active":"2024-09-12T00:43:48.286291+0000","last_became_peered":"2024-09-12T00:43:48.286291+0000","last_unstale":"2024-09-12T00:58:48.161958+0000","last_undegraded":"2024-09-12T00:58:48.161958+0000","last_fullsized":"2024-09-12T00:58:48.161958+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:17.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.190647+0000","last_change":"2024-09-12T00:32:28.070732+0000","last_active":"2024-09-12T00:59:58.190647+0000","last_peered":"2024-09-12T00:59:58.190647+0000","last_clean":"2024-09-12T00:59:58.190647+0000","last_became_active":"2024-09-12T00:32:28.070091+0000","last_became_peered":"2024-09-12T00:32:28.070091+0000","last_unstale":"2024-09-12T00:59:58.190647+0000","last_undegraded":"2024-09-12T00:59:58.190647+0000","last_fullsized":"2024-09-12T00:59:58.190647+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:33.762789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.206709+0000","last_change":"2024-09-12T00:32:25.024486+0000","last_active":"2024-09-12T00:59:57.206709+0000","last_peered":"2024-09-12T00:59:57.206709+0000","last_clean":"2024-09-12T00:59:57.206709+0000","last_became_active":"2024-09-12T00:32:25.023750+0000","last_became_peered":"2024-09-12T00:32:25.023750+0000","last_unstale":"2024-09-12T00:59:57.206709+0000","last_undegraded":"2024-09-12T00:59:57.206709+0000","last_fullsized":"2024-09-12T00:59:57.206709+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:12.053492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"268'20","reported_seq":97,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.273682+0000","last_change":"2024-09-12T00:30:51.555569+0000","last_active":"2024-09-12T01:00:03.273682+0000","last_peered":"2024-09-12T01:00:03.273682+0000","last_clean":"2024-09-12T01:00:03.273682+0000","last_became_active":"2024-09-12T00:30:51.554875+0000","last_became_peered":"2024-09-12T00:30:51.554875+0000","last_unstale":"2024-09-12T01:00:03.273682+0000","last_undegraded":"2024-09-12T01:00:03.273682+0000","last_fullsized":"2024-09-12T01:00:03.273682+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:03.959589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":61,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:18.166602+0000","last_change":"2024-09-12T00:43:48.271637+0000","last_active":"2024-09-12T00:58:18.166602+0000","last_peered":"2024-09-12T00:58:18.166602+0000","last_clean":"2024-09-12T00:58:18.166602+0000","last_became_active":"2024-09-12T00:43:48.270700+0000","last_became_peered":"2024-09-12T00:43:48.270700+0000","last_unstale":"2024-09-12T00:58:18.166602+0000","last_undegraded":"2024-09-12T00:58:18.166602+0000","last_fullsized":"2024-09-12T00:58:18.166602+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:41.349025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"268'3","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:42.008400+0000","last_change":"2024-09-12T00:32:28.078229+0000","last_active":"2024-09-12T01:01:42.008400+0000","last_peered":"2024-09-12T01:01:42.008400+0000","last_clean":"2024-09-12T01:01:42.008400+0000","last_became_active":"2024-09-12T00:32:28.065497+0000","last_became_peered":"2024-09-12T00:32:28.065497+0000","last_unstale":"2024-09-12T01:01:42.008400+0000","last_undegraded":"2024-09-12T01:01:42.008400+0000","last_fullsized":"2024-09-12T01:01:42.008400+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:04.479825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"268'5","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.830875+0000","last_change":"2024-09-12T00:32:25.002095+0000","last_active":"2024-09-12T01:02:37.830875+0000","last_peered":"2024-09-12T01:02:37.830875+0000","last_clean":"2024-09-12T01:02:37.830875+0000","last_became_active":"2024-09-12T00:32:25.001290+0000","last_became_peered":"2024-09-12T00:32:25.001290+0000","last_unstale":"2024-09-12T01:02:37.830875+0000","last_undegraded":"2024-09-12T01:02:37.830875+0000","last_fullsized":"2024-09-12T01:02:37.830875+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:20.950634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"268'25","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:02.981579+0000","last_change":"2024-09-12T00:30:51.546159+0000","last_active":"2024-09-12T01:00:02.981579+0000","last_peered":"2024-09-12T01:00:02.981579+0000","last_clean":"2024-09-12T01:00:02.981579+0000","last_became_active":"2024-09-12T00:30:51.544751+0000","last_became_peered":"2024-09-12T00:30:51.544751+0000","last_unstale":"2024-09-12T01:00:02.981579+0000","last_undegraded":"2024-09-12T01:00:02.981579+0000","last_fullsized":"2024-09-12T01:00:02.981579+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:47.192663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":82,"num_write":61,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:27.183725+0000","last_change":"2024-09-12T00:43:48.280902+0000","last_active":"2024-09-12T00:58:27.183725+0000","last_peered":"2024-09-12T00:58:27.183725+0000","last_clean":"2024-09-12T00:58:27.183725+0000","last_became_active":"2024-09-12T00:43:48.280166+0000","last_became_peered":"2024-09-12T00:43:48.280166+0000","last_unstale":"2024-09-12T00:58:27.183725+0000","last_undegraded":"2024-09-12T00:58:27.183725+0000","last_fullsized":"2024-09-12T00:58:27.183725+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:30.937177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.992420+0000","last_change":"2024-09-12T00:32:28.078675+0000","last_active":"2024-09-12T01:00:41.992420+0000","last_peered":"2024-09-12T01:00:41.992420+0000","last_clean":"2024-09-12T01:00:41.992420+0000","last_became_active":"2024-09-12T00:32:28.073988+0000","last_became_peered":"2024-09-12T00:32:28.073988+0000","last_unstale":"2024-09-12T01:00:41.992420+0000","last_undegraded":"2024-09-12T01:00:41.992420+0000","last_fullsized":"2024-09-12T01:00:41.992420+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:09.276835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185184+0000","last_change":"2024-09-12T00:32:25.008128+0000","last_active":"2024-09-12T00:59:33.185184+0000","last_peered":"2024-09-12T00:59:33.185184+0000","last_clean":"2024-09-12T00:59:33.185184+0000","last_became_active":"2024-09-12T00:32:25.007732+0000","last_became_peered":"2024-09-12T00:32:25.007732+0000","last_unstale":"2024-09-12T00:59:33.185184+0000","last_undegraded":"2024-09-12T00:59:33.185184+0000","last_fullsized":"2024-09-12T00:59:33.185184+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:28.829369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"268'61","reported_seq":203,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.690930+0000","last_change":"2024-09-12T00:30:51.552185+0000","last_active":"2024-09-12T00:59:57.690930+0000","last_peered":"2024-09-12T00:59:57.690930+0000","last_clean":"2024-09-12T00:59:57.690930+0000","last_became_active":"2024-09-12T00:30:51.551417+0000","last_became_peered":"2024-09-12T00:30:51.551417+0000","last_unstale":"2024-09-12T00:59:57.690930+0000","last_undegraded":"2024-09-12T00:59:57.690930+0000","last_fullsized":"2024-09-12T00:59:57.690930+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:45.506758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":214,"num_write":108,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.182039+0000","last_change":"2024-09-12T00:43:48.284245+0000","last_active":"2024-09-12T00:59:57.182039+0000","last_peered":"2024-09-12T00:59:57.182039+0000","last_clean":"2024-09-12T00:59:57.182039+0000","last_became_active":"2024-09-12T00:43:48.283357+0000","last_became_peered":"2024-09-12T00:43:48.283357+0000","last_unstale":"2024-09-12T00:59:57.182039+0000","last_undegraded":"2024-09-12T00:59:57.182039+0000","last_fullsized":"2024-09-12T00:59:57.182039+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.113641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"268'5","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:38.003769+0000","last_change":"2024-09-12T00:32:28.054309+0000","last_active":"2024-09-12T01:01:38.003769+0000","last_peered":"2024-09-12T01:01:38.003769+0000","last_clean":"2024-09-12T01:01:38.003769+0000","last_became_active":"2024-09-12T00:32:28.053541+0000","last_became_peered":"2024-09-12T00:32:28.053541+0000","last_unstale":"2024-09-12T01:01:38.003769+0000","last_undegraded":"2024-09-12T01:01:38.003769+0000","last_fullsized":"2024-09-12T01:01:38.003769+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.456715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"268'3","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:27.004021+0000","last_change":"2024-09-12T00:32:25.015629+0000","last_active":"2024-09-12T01:01:27.004021+0000","last_peered":"2024-09-12T01:01:27.004021+0000","last_clean":"2024-09-12T01:01:27.004021+0000","last_became_active":"2024-09-12T00:32:25.014665+0000","last_became_peered":"2024-09-12T00:32:25.014665+0000","last_unstale":"2024-09-12T01:01:27.004021+0000","last_undegraded":"2024-09-12T01:01:27.004021+0000","last_fullsized":"2024-09-12T01:01:27.004021+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:46.651960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"268'40","reported_seq":154,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:23.156361+0000","last_change":"2024-09-12T00:30:51.549303+0000","last_active":"2024-09-12T00:58:23.156361+0000","last_peered":"2024-09-12T00:58:23.156361+0000","last_clean":"2024-09-12T00:58:23.156361+0000","last_became_active":"2024-09-12T00:30:51.547784+0000","last_became_peered":"2024-09-12T00:30:51.547784+0000","last_unstale":"2024-09-12T00:58:23.156361+0000","last_undegraded":"2024-09-12T00:58:23.156361+0000","last_fullsized":"2024-09-12T00:58:23.156361+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:29.971436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":150,"num_write":68,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.192933+0000","last_change":"2024-09-12T00:43:48.278102+0000","last_active":"2024-09-12T01:00:28.192933+0000","last_peered":"2024-09-12T01:00:28.192933+0000","last_clean":"2024-09-12T01:00:28.192933+0000","last_became_active":"2024-09-12T00:43:48.276078+0000","last_became_peered":"2024-09-12T00:43:48.276078+0000","last_unstale":"2024-09-12T01:00:28.192933+0000","last_undegraded":"2024-09-12T01:00:28.192933+0000","last_fullsized":"2024-09-12T01:00:28.192933+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:21.420479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"268'5","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.600193+0000","last_change":"2024-09-12T00:32:28.031279+0000","last_active":"2024-09-12T01:02:37.600193+0000","last_peered":"2024-09-12T01:02:37.600193+0000","last_clean":"2024-09-12T01:02:37.600193+0000","last_became_active":"2024-09-12T00:32:28.030520+0000","last_became_peered":"2024-09-12T00:32:28.030520+0000","last_unstale":"2024-09-12T01:02:37.600193+0000","last_undegraded":"2024-09-12T01:02:37.600193+0000","last_fullsized":"2024-09-12T01:02:37.600193+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:22.614081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"268'3","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:34.014371+0000","last_change":"2024-09-12T00:32:25.010515+0000","last_active":"2024-09-12T01:01:34.014371+0000","last_peered":"2024-09-12T01:01:34.014371+0000","last_clean":"2024-09-12T01:01:34.014371+0000","last_became_active":"2024-09-12T00:32:25.009898+0000","last_became_peered":"2024-09-12T00:32:25.009898+0000","last_unstale":"2024-09-12T01:01:34.014371+0000","last_undegraded":"2024-09-12T01:01:34.014371+0000","last_fullsized":"2024-09-12T01:01:34.014371+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:26.343687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"268'22","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:23.166566+0000","last_change":"2024-09-12T00:30:51.560284+0000","last_active":"2024-09-12T00:58:23.166566+0000","last_peered":"2024-09-12T00:58:23.166566+0000","last_clean":"2024-09-12T00:58:23.166566+0000","last_became_active":"2024-09-12T00:30:51.559544+0000","last_became_peered":"2024-09-12T00:30:51.559544+0000","last_unstale":"2024-09-12T00:58:23.166566+0000","last_undegraded":"2024-09-12T00:58:23.166566+0000","last_fullsized":"2024-09-12T00:58:23.166566+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:21.732816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":79,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.173552+0000","last_change":"2024-09-12T00:43:48.283455+0000","last_active":"2024-09-12T00:58:48.173552+0000","last_peered":"2024-09-12T00:58:48.173552+0000","last_clean":"2024-09-12T00:58:48.173552+0000","last_became_active":"2024-09-12T00:43:48.283057+0000","last_became_peered":"2024-09-12T00:43:48.283057+0000","last_unstale":"2024-09-12T00:58:48.173552+0000","last_undegraded":"2024-09-12T00:58:48.173552+0000","last_fullsized":"2024-09-12T00:58:48.173552+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:33.410879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.190602+0000","last_change":"2024-09-12T00:32:28.066260+0000","last_active":"2024-09-12T00:59:58.190602+0000","last_peered":"2024-09-12T00:59:58.190602+0000","last_clean":"2024-09-12T00:59:58.190602+0000","last_became_active":"2024-09-12T00:32:28.065376+0000","last_became_peered":"2024-09-12T00:32:28.065376+0000","last_unstale":"2024-09-12T00:59:58.190602+0000","last_undegraded":"2024-09-12T00:59:58.190602+0000","last_fullsized":"2024-09-12T00:59:58.190602+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:37.216971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"268'3","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:28.013438+0000","last_change":"2024-09-12T00:32:25.000290+0000","last_active":"2024-09-12T01:02:28.013438+0000","last_peered":"2024-09-12T01:02:28.013438+0000","last_clean":"2024-09-12T01:02:28.013438+0000","last_became_active":"2024-09-12T00:32:24.999604+0000","last_became_peered":"2024-09-12T00:32:24.999604+0000","last_unstale":"2024-09-12T01:02:28.013438+0000","last_undegraded":"2024-09-12T01:02:28.013438+0000","last_fullsized":"2024-09-12T01:02:28.013438+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:52.889640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"268'41","reported_seq":153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:04.255372+0000","last_change":"2024-09-12T00:30:51.557465+0000","last_active":"2024-09-12T01:00:04.255372+0000","last_peered":"2024-09-12T01:00:04.255372+0000","last_clean":"2024-09-12T01:00:04.255372+0000","last_became_active":"2024-09-12T00:30:51.556729+0000","last_became_peered":"2024-09-12T00:30:51.556729+0000","last_unstale":"2024-09-12T01:00:04.255372+0000","last_undegraded":"2024-09-12T01:00:04.255372+0000","last_fullsized":"2024-09-12T01:00:04.255372+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:59.334180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":144,"num_write":69,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.174016+0000","last_change":"2024-09-12T00:43:48.282559+0000","last_active":"2024-09-12T00:58:48.174016+0000","last_peered":"2024-09-12T00:58:48.174016+0000","last_clean":"2024-09-12T00:58:48.174016+0000","last_became_active":"2024-09-12T00:43:48.281781+0000","last_became_peered":"2024-09-12T00:43:48.281781+0000","last_unstale":"2024-09-12T00:58:48.174016+0000","last_undegraded":"2024-09-12T00:58:48.174016+0000","last_fullsized":"2024-09-12T00:58:48.174016+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:09.023666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"268'5","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.600083+0000","last_change":"2024-09-12T00:32:28.063332+0000","last_active":"2024-09-12T01:02:37.600083+0000","last_peered":"2024-09-12T01:02:37.600083+0000","last_clean":"2024-09-12T01:02:37.600083+0000","last_became_active":"2024-09-12T00:32:28.062540+0000","last_became_peered":"2024-09-12T00:32:28.062540+0000","last_unstale":"2024-09-12T01:02:37.600083+0000","last_undegraded":"2024-09-12T01:02:37.600083+0000","last_fullsized":"2024-09-12T01:02:37.600083+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:19.133641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.179111+0000","last_change":"2024-09-12T00:32:25.021694+0000","last_active":"2024-09-12T00:59:58.179111+0000","last_peered":"2024-09-12T00:59:58.179111+0000","last_clean":"2024-09-12T00:59:58.179111+0000","last_became_active":"2024-09-12T00:32:25.017715+0000","last_became_peered":"2024-09-12T00:32:25.017715+0000","last_unstale":"2024-09-12T00:59:58.179111+0000","last_undegraded":"2024-09-12T00:59:58.179111+0000","last_fullsized":"2024-09-12T00:59:58.179111+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:02.525100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'8","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:53.178004+0000","last_change":"2024-09-12T00:30:51.547647+0000","last_active":"2024-09-12T00:59:53.178004+0000","last_peered":"2024-09-12T00:59:53.178004+0000","last_clean":"2024-09-12T00:59:53.178004+0000","last_became_active":"2024-09-12T00:30:51.546981+0000","last_became_peered":"2024-09-12T00:30:51.546981+0000","last_unstale":"2024-09-12T00:59:53.178004+0000","last_undegraded":"2024-09-12T00:59:53.178004+0000","last_fullsized":"2024-09-12T00:59:53.178004+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:52.873539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.210443+0000","last_change":"2024-09-12T00:43:48.273242+0000","last_active":"2024-09-12T01:00:12.210443+0000","last_peered":"2024-09-12T01:00:12.210443+0000","last_clean":"2024-09-12T01:00:12.210443+0000","last_became_active":"2024-09-12T00:43:48.272523+0000","last_became_peered":"2024-09-12T00:43:48.272523+0000","last_unstale":"2024-09-12T01:00:12.210443+0000","last_undegraded":"2024-09-12T01:00:12.210443+0000","last_fullsized":"2024-09-12T01:00:12.210443+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:58.897794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"268'9","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:27.204203+0000","last_change":"2024-09-12T00:32:28.069369+0000","last_active":"2024-09-12T01:01:27.204203+0000","last_peered":"2024-09-12T01:01:27.204203+0000","last_clean":"2024-09-12T01:01:27.204203+0000","last_became_active":"2024-09-12T00:32:28.062839+0000","last_became_peered":"2024-09-12T00:32:28.062839+0000","last_unstale":"2024-09-12T01:01:27.204203+0000","last_undegraded":"2024-09-12T01:01:27.204203+0000","last_fullsized":"2024-09-12T01:01:27.204203+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:52.354103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"268'4","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.252208+0000","last_change":"2024-09-12T00:32:25.005903+0000","last_active":"2024-09-12T01:02:38.252208+0000","last_peered":"2024-09-12T01:02:38.252208+0000","last_clean":"2024-09-12T01:02:38.252208+0000","last_became_active":"2024-09-12T00:32:25.005113+0000","last_became_peered":"2024-09-12T00:32:25.005113+0000","last_unstale":"2024-09-12T01:02:38.252208+0000","last_undegraded":"2024-09-12T01:02:38.252208+0000","last_fullsized":"2024-09-12T01:02:38.252208+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:34.390961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3076,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'62","reported_seq":220,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:53.184530+0000","last_change":"2024-09-12T00:30:51.542763+0000","last_active":"2024-09-12T00:59:53.184530+0000","last_peered":"2024-09-12T00:59:53.184530+0000","last_clean":"2024-09-12T00:59:53.184530+0000","last_became_active":"2024-09-12T00:30:51.541882+0000","last_became_peered":"2024-09-12T00:30:51.541882+0000","last_unstale":"2024-09-12T00:59:53.184530+0000","last_undegraded":"2024-09-12T00:59:53.184530+0000","last_fullsized":"2024-09-12T00:59:53.184530+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.614120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":254,"num_write":98,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.181831+0000","last_change":"2024-09-12T00:43:48.278782+0000","last_active":"2024-09-12T01:00:08.181831+0000","last_peered":"2024-09-12T01:00:08.181831+0000","last_clean":"2024-09-12T01:00:08.181831+0000","last_became_active":"2024-09-12T00:43:48.277883+0000","last_became_peered":"2024-09-12T00:43:48.277883+0000","last_unstale":"2024-09-12T01:00:08.181831+0000","last_undegraded":"2024-09-12T01:00:08.181831+0000","last_fullsized":"2024-09-12T01:00:08.181831+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:35.841252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'5","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:17.180442+0000","last_change":"2024-09-12T00:32:28.052092+0000","last_active":"2024-09-12T00:58:17.180442+0000","last_peered":"2024-09-12T00:58:17.180442+0000","last_clean":"2024-09-12T00:58:17.180442+0000","last_became_active":"2024-09-12T00:32:28.051364+0000","last_became_peered":"2024-09-12T00:32:28.051364+0000","last_unstale":"2024-09-12T00:58:17.180442+0000","last_undegraded":"2024-09-12T00:58:17.180442+0000","last_fullsized":"2024-09-12T00:58:17.180442+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:30.719026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5136,"num_write":10,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:28.002501+0000","last_change":"2024-09-12T00:32:25.009850+0000","last_active":"2024-09-12T01:01:28.002501+0000","last_peered":"2024-09-12T01:01:28.002501+0000","last_clean":"2024-09-12T01:01:28.002501+0000","last_became_active":"2024-09-12T00:32:25.009125+0000","last_became_peered":"2024-09-12T00:32:25.009125+0000","last_unstale":"2024-09-12T01:01:28.002501+0000","last_undegraded":"2024-09-12T01:01:28.002501+0000","last_fullsized":"2024-09-12T01:01:28.002501+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:33.665936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"268'31","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:53.184482+0000","last_change":"2024-09-12T00:30:51.555036+0000","last_active":"2024-09-12T00:59:53.184482+0000","last_peered":"2024-09-12T00:59:53.184482+0000","last_clean":"2024-09-12T00:59:53.184482+0000","last_became_active":"2024-09-12T00:30:51.553919+0000","last_became_peered":"2024-09-12T00:30:51.553919+0000","last_unstale":"2024-09-12T00:59:53.184482+0000","last_undegraded":"2024-09-12T00:59:53.184482+0000","last_fullsized":"2024-09-12T00:59:53.184482+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:07.977904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":104,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.195129+0000","last_change":"2024-09-12T00:43:48.289134+0000","last_active":"2024-09-12T01:00:08.195129+0000","last_peered":"2024-09-12T01:00:08.195129+0000","last_clean":"2024-09-12T01:00:08.195129+0000","last_became_active":"2024-09-12T00:43:48.288517+0000","last_became_peered":"2024-09-12T00:43:48.288517+0000","last_unstale":"2024-09-12T01:00:08.195129+0000","last_undegraded":"2024-09-12T01:00:08.195129+0000","last_fullsized":"2024-09-12T01:00:08.195129+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:05.171146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168160+0000","last_change":"2024-09-12T00:32:28.060574+0000","last_active":"2024-09-12T00:59:02.168160+0000","last_peered":"2024-09-12T00:59:02.168160+0000","last_clean":"2024-09-12T00:59:02.168160+0000","last_became_active":"2024-09-12T00:32:28.059869+0000","last_became_peered":"2024-09-12T00:32:28.059869+0000","last_unstale":"2024-09-12T00:59:02.168160+0000","last_undegraded":"2024-09-12T00:59:02.168160+0000","last_fullsized":"2024-09-12T00:59:02.168160+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:24.600878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168108+0000","last_change":"2024-09-12T00:32:25.027341+0000","last_active":"2024-09-12T00:59:02.168108+0000","last_peered":"2024-09-12T00:59:02.168108+0000","last_clean":"2024-09-12T00:59:02.168108+0000","last_became_active":"2024-09-12T00:32:25.026751+0000","last_became_peered":"2024-09-12T00:32:25.026751+0000","last_unstale":"2024-09-12T00:59:02.168108+0000","last_undegraded":"2024-09-12T00:59:02.168108+0000","last_fullsized":"2024-09-12T00:59:02.168108+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:19.648395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"268'24","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.286940+0000","last_change":"2024-09-12T00:30:51.548842+0000","last_active":"2024-09-12T01:00:03.286940+0000","last_peered":"2024-09-12T01:00:03.286940+0000","last_clean":"2024-09-12T01:00:03.286940+0000","last_became_active":"2024-09-12T00:30:51.548069+0000","last_became_peered":"2024-09-12T00:30:51.548069+0000","last_unstale":"2024-09-12T01:00:03.286940+0000","last_undegraded":"2024-09-12T01:00:03.286940+0000","last_fullsized":"2024-09-12T01:00:03.286940+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:24.452311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":85,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.194752+0000","last_change":"2024-09-12T00:43:48.276141+0000","last_active":"2024-09-12T01:00:08.194752+0000","last_peered":"2024-09-12T01:00:08.194752+0000","last_clean":"2024-09-12T01:00:08.194752+0000","last_became_active":"2024-09-12T00:43:48.274026+0000","last_became_peered":"2024-09-12T00:43:48.274026+0000","last_unstale":"2024-09-12T01:00:08.194752+0000","last_undegraded":"2024-09-12T01:00:08.194752+0000","last_fullsized":"2024-09-12T01:00:08.194752+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:53.384375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"268'2","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:28.002542+0000","last_change":"2024-09-12T00:32:28.063379+0000","last_active":"2024-09-12T01:01:28.002542+0000","last_peered":"2024-09-12T01:01:28.002542+0000","last_clean":"2024-09-12T01:01:28.002542+0000","last_became_active":"2024-09-12T00:32:28.062657+0000","last_became_peered":"2024-09-12T00:32:28.062657+0000","last_unstale":"2024-09-12T01:01:28.002542+0000","last_undegraded":"2024-09-12T01:01:28.002542+0000","last_fullsized":"2024-09-12T01:01:28.002542+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:10.594711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.192560+0000","last_change":"2024-09-12T00:32:24.997566+0000","last_active":"2024-09-12T00:59:02.192560+0000","last_peered":"2024-09-12T00:59:02.192560+0000","last_clean":"2024-09-12T00:59:02.192560+0000","last_became_active":"2024-09-12T00:32:24.996754+0000","last_became_peered":"2024-09-12T00:32:24.996754+0000","last_unstale":"2024-09-12T00:59:02.192560+0000","last_undegraded":"2024-09-12T00:59:02.192560+0000","last_fullsized":"2024-09-12T00:59:02.192560+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:55.566151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"268'26","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:59.211731+0000","last_change":"2024-09-12T00:30:51.551315+0000","last_active":"2024-09-12T00:58:59.211731+0000","last_peered":"2024-09-12T00:58:59.211731+0000","last_clean":"2024-09-12T00:58:59.211731+0000","last_became_active":"2024-09-12T00:30:51.545679+0000","last_became_peered":"2024-09-12T00:30:51.545679+0000","last_unstale":"2024-09-12T00:58:59.211731+0000","last_undegraded":"2024-09-12T00:58:59.211731+0000","last_fullsized":"2024-09-12T00:58:59.211731+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:48.283586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":84,"num_write":50,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:22.182350+0000","last_change":"2024-09-12T00:43:48.286291+0000","last_active":"2024-09-12T00:58:22.182350+0000","last_peered":"2024-09-12T00:58:22.182350+0000","last_clean":"2024-09-12T00:58:22.182350+0000","last_became_active":"2024-09-12T00:43:48.285657+0000","last_became_peered":"2024-09-12T00:43:48.285657+0000","last_unstale":"2024-09-12T00:58:22.182350+0000","last_undegraded":"2024-09-12T00:58:22.182350+0000","last_fullsized":"2024-09-12T00:58:22.182350+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:25.925943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"268'8","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.989831+0000","last_change":"2024-09-12T00:32:28.068135+0000","last_active":"2024-09-12T01:00:31.989831+0000","last_peered":"2024-09-12T01:00:31.989831+0000","last_clean":"2024-09-12T01:00:31.989831+0000","last_became_active":"2024-09-12T00:32:28.067168+0000","last_became_peered":"2024-09-12T00:32:28.067168+0000","last_unstale":"2024-09-12T01:00:31.989831+0000","last_undegraded":"2024-09-12T01:00:31.989831+0000","last_fullsized":"2024-09-12T01:00:31.989831+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:58.886483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"268'10","reported_seq":59,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.197708+0000","last_change":"2024-09-12T00:32:25.012858+0000","last_active":"2024-09-12T01:00:28.197708+0000","last_peered":"2024-09-12T01:00:28.197708+0000","last_clean":"2024-09-12T01:00:28.197708+0000","last_became_active":"2024-09-12T00:32:25.011944+0000","last_became_peered":"2024-09-12T00:32:25.011944+0000","last_unstale":"2024-09-12T01:00:28.197708+0000","last_undegraded":"2024-09-12T01:00:28.197708+0000","last_fullsized":"2024-09-12T01:00:28.197708+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:59.502458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":20800,"num_write":20,"num_write_kb":10558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"268'29","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:54.210368+0000","last_change":"2024-09-12T00:30:51.551466+0000","last_active":"2024-09-12T00:58:54.210368+0000","last_peered":"2024-09-12T00:58:54.210368+0000","last_clean":"2024-09-12T00:58:54.210368+0000","last_became_active":"2024-09-12T00:30:51.550694+0000","last_became_peered":"2024-09-12T00:30:51.550694+0000","last_unstale":"2024-09-12T00:58:54.210368+0000","last_undegraded":"2024-09-12T00:58:54.210368+0000","last_fullsized":"2024-09-12T00:58:54.210368+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:19.647721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:18.155457+0000","last_change":"2024-09-12T00:43:48.273326+0000","last_active":"2024-09-12T00:58:18.155457+0000","last_peered":"2024-09-12T00:58:18.155457+0000","last_clean":"2024-09-12T00:58:18.155457+0000","last_became_active":"2024-09-12T00:43:48.272356+0000","last_became_peered":"2024-09-12T00:43:48.272356+0000","last_unstale":"2024-09-12T00:58:18.155457+0000","last_undegraded":"2024-09-12T00:58:18.155457+0000","last_fullsized":"2024-09-12T00:58:18.155457+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:10.874661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"268'6","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.989759+0000","last_change":"2024-09-12T00:32:28.068097+0000","last_active":"2024-09-12T01:00:31.989759+0000","last_peered":"2024-09-12T01:00:31.989759+0000","last_clean":"2024-09-12T01:00:31.989759+0000","last_became_active":"2024-09-12T00:32:28.067388+0000","last_became_peered":"2024-09-12T00:32:28.067388+0000","last_unstale":"2024-09-12T01:00:31.989759+0000","last_undegraded":"2024-09-12T01:00:31.989759+0000","last_fullsized":"2024-09-12T01:00:31.989759+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:43.197946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:07.177487+0000","last_change":"2024-09-12T00:32:25.009043+0000","last_active":"2024-09-12T00:58:07.177487+0000","last_peered":"2024-09-12T00:58:07.177487+0000","last_clean":"2024-09-12T00:58:07.177487+0000","last_became_active":"2024-09-12T00:32:25.005882+0000","last_became_peered":"2024-09-12T00:32:25.005882+0000","last_unstale":"2024-09-12T00:58:07.177487+0000","last_undegraded":"2024-09-12T00:58:07.177487+0000","last_fullsized":"2024-09-12T00:58:07.177487+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:03.055383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"268'19","reported_seq":95,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:52.165743+0000","last_change":"2024-09-12T00:30:51.555200+0000","last_active":"2024-09-12T00:58:52.165743+0000","last_peered":"2024-09-12T00:58:52.165743+0000","last_clean":"2024-09-12T00:58:52.165743+0000","last_became_active":"2024-09-12T00:30:51.548932+0000","last_became_peered":"2024-09-12T00:30:51.548932+0000","last_unstale":"2024-09-12T00:58:52.165743+0000","last_undegraded":"2024-09-12T00:58:52.165743+0000","last_fullsized":"2024-09-12T00:58:52.165743+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:27.568202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.189591+0000","last_change":"2024-09-12T00:43:48.277526+0000","last_active":"2024-09-12T01:00:13.189591+0000","last_peered":"2024-09-12T01:00:13.189591+0000","last_clean":"2024-09-12T01:00:13.189591+0000","last_became_active":"2024-09-12T00:43:48.274983+0000","last_became_peered":"2024-09-12T00:43:48.274983+0000","last_unstale":"2024-09-12T01:00:13.189591+0000","last_undegraded":"2024-09-12T01:00:13.189591+0000","last_fullsized":"2024-09-12T01:00:13.189591+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:44.126353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"265'5","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:07.155894+0000","last_change":"2024-09-12T00:32:28.050796+0000","last_active":"2024-09-12T00:58:07.155894+0000","last_peered":"2024-09-12T00:58:07.155894+0000","last_clean":"2024-09-12T00:58:07.155894+0000","last_became_active":"2024-09-12T00:32:28.049947+0000","last_became_peered":"2024-09-12T00:32:28.049947+0000","last_unstale":"2024-09-12T00:58:07.155894+0000","last_undegraded":"2024-09-12T00:58:07.155894+0000","last_fullsized":"2024-09-12T00:58:07.155894+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:37.435116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:08.164500+0000","last_change":"2024-09-12T00:32:25.008845+0000","last_active":"2024-09-12T00:58:08.164500+0000","last_peered":"2024-09-12T00:58:08.164500+0000","last_clean":"2024-09-12T00:58:08.164500+0000","last_became_active":"2024-09-12T00:32:25.008089+0000","last_became_peered":"2024-09-12T00:32:25.008089+0000","last_unstale":"2024-09-12T00:58:08.164500+0000","last_undegraded":"2024-09-12T00:58:08.164500+0000","last_fullsized":"2024-09-12T00:58:08.164500+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:32.387676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"268'82","reported_seq":323,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:53.174675+0000","last_change":"2024-09-12T00:30:51.548938+0000","last_active":"2024-09-12T00:58:53.174675+0000","last_peered":"2024-09-12T00:58:53.174675+0000","last_clean":"2024-09-12T00:58:53.174675+0000","last_became_active":"2024-09-12T00:30:51.548232+0000","last_became_peered":"2024-09-12T00:30:51.548232+0000","last_unstale":"2024-09-12T00:58:53.174675+0000","last_undegraded":"2024-09-12T00:58:53.174675+0000","last_fullsized":"2024-09-12T00:58:53.174675+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:32.055820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":390,"num_write":93,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:18.155390+0000","last_change":"2024-09-12T00:43:48.272336+0000","last_active":"2024-09-12T00:58:18.155390+0000","last_peered":"2024-09-12T00:58:18.155390+0000","last_clean":"2024-09-12T00:58:18.155390+0000","last_became_active":"2024-09-12T00:43:48.271560+0000","last_became_peered":"2024-09-12T00:43:48.271560+0000","last_unstale":"2024-09-12T00:58:18.155390+0000","last_undegraded":"2024-09-12T00:58:18.155390+0000","last_fullsized":"2024-09-12T00:58:18.155390+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:33.055656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:09.196589+0000","last_change":"2024-09-12T00:32:28.058883+0000","last_active":"2024-09-12T00:58:09.196589+0000","last_peered":"2024-09-12T00:58:09.196589+0000","last_clean":"2024-09-12T00:58:09.196589+0000","last_became_active":"2024-09-12T00:32:28.058127+0000","last_became_peered":"2024-09-12T00:32:28.058127+0000","last_unstale":"2024-09-12T00:58:09.196589+0000","last_undegraded":"2024-09-12T00:58:09.196589+0000","last_fullsized":"2024-09-12T00:58:09.196589+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:36.704098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"268'3","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.197862+0000","last_change":"2024-09-12T00:32:25.013431+0000","last_active":"2024-09-12T01:00:28.197862+0000","last_peered":"2024-09-12T01:00:28.197862+0000","last_clean":"2024-09-12T01:00:28.197862+0000","last_became_active":"2024-09-12T00:32:25.013042+0000","last_became_peered":"2024-09-12T00:32:25.013042+0000","last_unstale":"2024-09-12T01:00:28.197862+0000","last_undegraded":"2024-09-12T01:00:28.197862+0000","last_fullsized":"2024-09-12T01:00:28.197862+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:01.167610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'29","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:52.165632+0000","last_change":"2024-09-12T00:30:51.548109+0000","last_active":"2024-09-12T00:58:52.165632+0000","last_peered":"2024-09-12T00:58:52.165632+0000","last_clean":"2024-09-12T00:58:52.165632+0000","last_became_active":"2024-09-12T00:30:51.545619+0000","last_became_peered":"2024-09-12T00:30:51.545619+0000","last_unstale":"2024-09-12T00:58:52.165632+0000","last_undegraded":"2024-09-12T00:58:52.165632+0000","last_fullsized":"2024-09-12T00:58:52.165632+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:38.398967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":120,"num_write":40,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:07.193629+0000","last_change":"2024-09-12T00:43:48.280018+0000","last_active":"2024-09-12T00:59:07.193629+0000","last_peered":"2024-09-12T00:59:07.193629+0000","last_clean":"2024-09-12T00:59:07.193629+0000","last_became_active":"2024-09-12T00:43:48.279197+0000","last_became_peered":"2024-09-12T00:43:48.279197+0000","last_unstale":"2024-09-12T00:59:07.193629+0000","last_undegraded":"2024-09-12T00:59:07.193629+0000","last_fullsized":"2024-09-12T00:59:07.193629+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:16.184230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174616+0000","last_change":"2024-09-12T00:32:28.058572+0000","last_active":"2024-09-12T00:59:27.174616+0000","last_peered":"2024-09-12T00:59:27.174616+0000","last_clean":"2024-09-12T00:59:27.174616+0000","last_became_active":"2024-09-12T00:32:28.057839+0000","last_became_peered":"2024-09-12T00:32:28.057839+0000","last_unstale":"2024-09-12T00:59:27.174616+0000","last_undegraded":"2024-09-12T00:59:27.174616+0000","last_fullsized":"2024-09-12T00:59:27.174616+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:41.184079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"268'8","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:43.213939+0000","last_change":"2024-09-12T00:32:25.022238+0000","last_active":"2024-09-12T01:01:43.213939+0000","last_peered":"2024-09-12T01:01:43.213939+0000","last_clean":"2024-09-12T01:01:43.213939+0000","last_became_active":"2024-09-12T00:32:25.021649+0000","last_became_peered":"2024-09-12T00:32:25.021649+0000","last_unstale":"2024-09-12T01:01:43.213939+0000","last_undegraded":"2024-09-12T01:01:43.213939+0000","last_fullsized":"2024-09-12T01:01:43.213939+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:11.939783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"268'68","reported_seq":236,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:17.186626+0000","last_change":"2024-09-12T00:30:51.562713+0000","last_active":"2024-09-12T01:00:17.186626+0000","last_peered":"2024-09-12T01:00:17.186626+0000","last_clean":"2024-09-12T01:00:17.186626+0000","last_became_active":"2024-09-12T00:30:51.562106+0000","last_became_peered":"2024-09-12T00:30:51.562106+0000","last_unstale":"2024-09-12T01:00:17.186626+0000","last_undegraded":"2024-09-12T01:00:17.186626+0000","last_fullsized":"2024-09-12T01:00:17.186626+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:57.176892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":360,"num_read_kb":258,"num_write":123,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185103+0000","last_change":"2024-09-12T00:43:48.287022+0000","last_active":"2024-09-12T00:59:33.185103+0000","last_peered":"2024-09-12T00:59:33.185103+0000","last_clean":"2024-09-12T00:59:33.185103+0000","last_became_active":"2024-09-12T00:43:48.286629+0000","last_became_peered":"2024-09-12T00:43:48.286629+0000","last_unstale":"2024-09-12T00:59:33.185103+0000","last_undegraded":"2024-09-12T00:59:33.185103+0000","last_fullsized":"2024-09-12T00:59:33.185103+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:40.640752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174553+0000","last_change":"2024-09-12T00:32:28.071698+0000","last_active":"2024-09-12T00:59:27.174553+0000","last_peered":"2024-09-12T00:59:27.174553+0000","last_clean":"2024-09-12T00:59:27.174553+0000","last_became_active":"2024-09-12T00:32:28.070913+0000","last_became_peered":"2024-09-12T00:32:28.070913+0000","last_unstale":"2024-09-12T00:59:27.174553+0000","last_undegraded":"2024-09-12T00:59:27.174553+0000","last_fullsized":"2024-09-12T00:59:27.174553+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:34.008495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"268'10","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.250848+0000","last_change":"2024-09-12T00:32:25.022141+0000","last_active":"2024-09-12T01:02:38.250848+0000","last_peered":"2024-09-12T01:02:38.250848+0000","last_clean":"2024-09-12T01:02:38.250848+0000","last_became_active":"2024-09-12T00:32:25.007681+0000","last_became_peered":"2024-09-12T00:32:25.007681+0000","last_unstale":"2024-09-12T01:02:38.250848+0000","last_undegraded":"2024-09-12T01:02:38.250848+0000","last_fullsized":"2024-09-12T01:02:38.250848+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:46.593006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4146,"num_write":20,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"268'39","reported_seq":150,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:09.229370+0000","last_change":"2024-09-12T00:30:51.565589+0000","last_active":"2024-09-12T01:00:09.229370+0000","last_peered":"2024-09-12T01:00:09.229370+0000","last_clean":"2024-09-12T01:00:09.229370+0000","last_became_active":"2024-09-12T00:30:51.559520+0000","last_became_peered":"2024-09-12T00:30:51.559520+0000","last_unstale":"2024-09-12T01:00:09.229370+0000","last_undegraded":"2024-09-12T01:00:09.229370+0000","last_fullsized":"2024-09-12T01:00:09.229370+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:38.099204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":143,"num_write":68,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:59.211561+0000","last_change":"2024-09-12T00:43:48.287080+0000","last_active":"2024-09-12T00:58:59.211561+0000","last_peered":"2024-09-12T00:58:59.211561+0000","last_clean":"2024-09-12T00:58:59.211561+0000","last_became_active":"2024-09-12T00:43:48.286079+0000","last_became_peered":"2024-09-12T00:43:48.286079+0000","last_unstale":"2024-09-12T00:58:59.211561+0000","last_undegraded":"2024-09-12T00:58:59.211561+0000","last_fullsized":"2024-09-12T00:58:59.211561+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:57.937242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.177100+0000","last_change":"2024-09-12T00:32:28.075197+0000","last_active":"2024-09-12T00:59:37.177100+0000","last_peered":"2024-09-12T00:59:37.177100+0000","last_clean":"2024-09-12T00:59:37.177100+0000","last_became_active":"2024-09-12T00:32:28.074621+0000","last_became_peered":"2024-09-12T00:32:28.074621+0000","last_unstale":"2024-09-12T00:59:37.177100+0000","last_undegraded":"2024-09-12T00:59:37.177100+0000","last_fullsized":"2024-09-12T00:59:37.177100+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:11.217357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174686+0000","last_change":"2024-09-12T00:32:25.009196+0000","last_active":"2024-09-12T00:59:27.174686+0000","last_peered":"2024-09-12T00:59:27.174686+0000","last_clean":"2024-09-12T00:59:27.174686+0000","last_became_active":"2024-09-12T00:32:25.008419+0000","last_became_peered":"2024-09-12T00:32:25.008419+0000","last_unstale":"2024-09-12T00:59:27.174686+0000","last_undegraded":"2024-09-12T00:59:27.174686+0000","last_fullsized":"2024-09-12T00:59:27.174686+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:01.482915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"268'30","reported_seq":120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.193309+0000","last_change":"2024-09-12T00:30:51.541334+0000","last_active":"2024-09-12T01:00:08.193309+0000","last_peered":"2024-09-12T01:00:08.193309+0000","last_clean":"2024-09-12T01:00:08.193309+0000","last_became_active":"2024-09-12T00:30:51.540434+0000","last_became_peered":"2024-09-12T00:30:51.540434+0000","last_unstale":"2024-09-12T01:00:08.193309+0000","last_undegraded":"2024-09-12T01:00:08.193309+0000","last_fullsized":"2024-09-12T01:00:08.193309+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:01.590635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":92,"num_write":60,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:58.176983+0000","last_change":"2024-09-12T00:43:48.279278+0000","last_active":"2024-09-12T00:58:58.176983+0000","last_peered":"2024-09-12T00:58:58.176983+0000","last_clean":"2024-09-12T00:58:58.176983+0000","last_became_active":"2024-09-12T00:43:48.278477+0000","last_became_peered":"2024-09-12T00:43:48.278477+0000","last_unstale":"2024-09-12T00:58:58.176983+0000","last_undegraded":"2024-09-12T00:58:58.176983+0000","last_fullsized":"2024-09-12T00:58:58.176983+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:23.351907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"268'11","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.009743+0000","last_change":"2024-09-12T00:32:28.075698+0000","last_active":"2024-09-12T01:01:47.009743+0000","last_peered":"2024-09-12T01:01:47.009743+0000","last_clean":"2024-09-12T01:01:47.009743+0000","last_became_active":"2024-09-12T00:32:28.066441+0000","last_became_peered":"2024-09-12T00:32:28.066441+0000","last_unstale":"2024-09-12T01:01:47.009743+0000","last_undegraded":"2024-09-12T01:01:47.009743+0000","last_fullsized":"2024-09-12T01:01:47.009743+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:29.911316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":37890,"num_write":21,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.177139+0000","last_change":"2024-09-12T00:32:25.011505+0000","last_active":"2024-09-12T00:59:37.177139+0000","last_peered":"2024-09-12T00:59:37.177139+0000","last_clean":"2024-09-12T00:59:37.177139+0000","last_became_active":"2024-09-12T00:32:25.010752+0000","last_became_peered":"2024-09-12T00:32:25.010752+0000","last_unstale":"2024-09-12T00:59:37.177139+0000","last_undegraded":"2024-09-12T00:59:37.177139+0000","last_fullsized":"2024-09-12T00:59:37.177139+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:38.026878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"268'114","reported_seq":464,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.181883+0000","last_change":"2024-09-12T00:30:51.550820+0000","last_active":"2024-09-12T01:00:08.181883+0000","last_peered":"2024-09-12T01:00:08.181883+0000","last_clean":"2024-09-12T01:00:08.181883+0000","last_became_active":"2024-09-12T00:30:51.550081+0000","last_became_peered":"2024-09-12T00:30:51.550081+0000","last_unstale":"2024-09-12T01:00:08.181883+0000","last_undegraded":"2024-09-12T01:00:08.181883+0000","last_fullsized":"2024-09-12T01:00:08.181883+0000","mapping_epoch":257,"log_start":"265'100","ondisk_log_start":"265'100","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:48.107776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":826,"num_read_kb":599,"num_write":142,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.201751+0000","last_change":"2024-09-12T00:43:48.273417+0000","last_active":"2024-09-12T00:59:37.201751+0000","last_peered":"2024-09-12T00:59:37.201751+0000","last_clean":"2024-09-12T00:59:37.201751+0000","last_became_active":"2024-09-12T00:43:48.272486+0000","last_became_peered":"2024-09-12T00:43:48.272486+0000","last_unstale":"2024-09-12T00:59:37.201751+0000","last_undegraded":"2024-09-12T00:59:37.201751+0000","last_fullsized":"2024-09-12T00:59:37.201751+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:26.875710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:29.201794+0000","last_change":"2024-09-12T00:32:28.051078+0000","last_active":"2024-09-12T00:58:29.201794+0000","last_peered":"2024-09-12T00:58:29.201794+0000","last_clean":"2024-09-12T00:58:29.201794+0000","last_became_active":"2024-09-12T00:32:28.049186+0000","last_became_peered":"2024-09-12T00:32:28.049186+0000","last_unstale":"2024-09-12T00:58:29.201794+0000","last_undegraded":"2024-09-12T00:58:29.201794+0000","last_fullsized":"2024-09-12T00:58:29.201794+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:54.432738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:27.160025+0000","last_change":"2024-09-12T00:32:25.000690+0000","last_active":"2024-09-12T00:58:27.160025+0000","last_peered":"2024-09-12T00:58:27.160025+0000","last_clean":"2024-09-12T00:58:27.160025+0000","last_became_active":"2024-09-12T00:32:24.999633+0000","last_became_peered":"2024-09-12T00:32:24.999633+0000","last_unstale":"2024-09-12T00:58:27.160025+0000","last_undegraded":"2024-09-12T00:58:27.160025+0000","last_fullsized":"2024-09-12T00:58:27.160025+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:09.259657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"268'69","reported_seq":237,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.181761+0000","last_change":"2024-09-12T00:30:51.548507+0000","last_active":"2024-09-12T01:00:08.181761+0000","last_peered":"2024-09-12T01:00:08.181761+0000","last_clean":"2024-09-12T01:00:08.181761+0000","last_became_active":"2024-09-12T00:30:51.546873+0000","last_became_peered":"2024-09-12T00:30:51.546873+0000","last_unstale":"2024-09-12T01:00:08.181761+0000","last_undegraded":"2024-09-12T01:00:08.181761+0000","last_fullsized":"2024-09-12T01:00:08.181761+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:28.201041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":256,"num_write":124,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:38.185725+0000","last_change":"2024-09-12T00:43:48.287793+0000","last_active":"2024-09-12T00:59:38.185725+0000","last_peered":"2024-09-12T00:59:38.185725+0000","last_clean":"2024-09-12T00:59:38.185725+0000","last_became_active":"2024-09-12T00:43:48.287144+0000","last_became_peered":"2024-09-12T00:43:48.287144+0000","last_unstale":"2024-09-12T00:59:38.185725+0000","last_undegraded":"2024-09-12T00:59:38.185725+0000","last_fullsized":"2024-09-12T00:59:38.185725+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:03.320468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:28.167607+0000","last_change":"2024-09-12T00:32:28.064542+0000","last_active":"2024-09-12T00:58:28.167607+0000","last_peered":"2024-09-12T00:58:28.167607+0000","last_clean":"2024-09-12T00:58:28.167607+0000","last_became_active":"2024-09-12T00:32:28.063712+0000","last_became_peered":"2024-09-12T00:32:28.063712+0000","last_unstale":"2024-09-12T00:58:28.167607+0000","last_undegraded":"2024-09-12T00:58:28.167607+0000","last_fullsized":"2024-09-12T00:58:28.167607+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:07.012225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"268'3","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:36.991164+0000","last_change":"2024-09-12T00:32:25.012329+0000","last_active":"2024-09-12T01:00:36.991164+0000","last_peered":"2024-09-12T01:00:36.991164+0000","last_clean":"2024-09-12T01:00:36.991164+0000","last_became_active":"2024-09-12T00:32:25.005902+0000","last_became_peered":"2024-09-12T00:32:25.005902+0000","last_unstale":"2024-09-12T01:00:36.991164+0000","last_undegraded":"2024-09-12T01:00:36.991164+0000","last_fullsized":"2024-09-12T01:00:36.991164+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:34.031714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"268'31","reported_seq":126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:13.179616+0000","last_change":"2024-09-12T00:30:51.545329+0000","last_active":"2024-09-12T00:59:13.179616+0000","last_peered":"2024-09-12T00:59:13.179616+0000","last_clean":"2024-09-12T00:59:13.179616+0000","last_became_active":"2024-09-12T00:30:51.541904+0000","last_became_peered":"2024-09-12T00:30:51.541904+0000","last_unstale":"2024-09-12T00:59:13.179616+0000","last_undegraded":"2024-09-12T00:59:13.179616+0000","last_fullsized":"2024-09-12T00:59:13.179616+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:26.384655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":109,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185912+0000","last_change":"2024-09-12T00:43:48.275537+0000","last_active":"2024-09-12T00:59:33.185912+0000","last_peered":"2024-09-12T00:59:33.185912+0000","last_clean":"2024-09-12T00:59:33.185912+0000","last_became_active":"2024-09-12T00:43:48.274756+0000","last_became_peered":"2024-09-12T00:43:48.274756+0000","last_unstale":"2024-09-12T00:59:33.185912+0000","last_undegraded":"2024-09-12T00:59:33.185912+0000","last_fullsized":"2024-09-12T00:59:33.185912+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:14.072781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"268'5","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.620079+0000","last_change":"2024-09-12T00:32:28.066799+0000","last_active":"2024-09-12T01:02:38.620079+0000","last_peered":"2024-09-12T01:02:38.620079+0000","last_clean":"2024-09-12T01:02:38.620079+0000","last_became_active":"2024-09-12T00:32:28.066029+0000","last_became_peered":"2024-09-12T00:32:28.066029+0000","last_unstale":"2024-09-12T01:02:38.620079+0000","last_undegraded":"2024-09-12T01:02:38.620079+0000","last_fullsized":"2024-09-12T01:02:38.620079+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:56.429963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"268'3","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.193975+0000","last_change":"2024-09-12T00:32:25.001979+0000","last_active":"2024-09-12T01:00:47.193975+0000","last_peered":"2024-09-12T01:00:47.193975+0000","last_clean":"2024-09-12T01:00:47.193975+0000","last_became_active":"2024-09-12T00:32:25.001194+0000","last_became_peered":"2024-09-12T00:32:25.001194+0000","last_unstale":"2024-09-12T01:00:47.193975+0000","last_undegraded":"2024-09-12T01:00:47.193975+0000","last_fullsized":"2024-09-12T01:00:47.193975+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:06.421742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"268'15","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.192385+0000","last_change":"2024-09-12T00:30:51.544531+0000","last_active":"2024-09-12T00:59:02.192385+0000","last_peered":"2024-09-12T00:59:02.192385+0000","last_clean":"2024-09-12T00:59:02.192385+0000","last_became_active":"2024-09-12T00:30:51.543711+0000","last_became_peered":"2024-09-12T00:30:51.543711+0000","last_unstale":"2024-09-12T00:59:02.192385+0000","last_undegraded":"2024-09-12T00:59:02.192385+0000","last_fullsized":"2024-09-12T00:59:02.192385+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:07.148537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":43,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.176965+0000","last_change":"2024-09-12T00:43:48.290387+0000","last_active":"2024-09-12T00:59:37.176965+0000","last_peered":"2024-09-12T00:59:37.176965+0000","last_clean":"2024-09-12T00:59:37.176965+0000","last_became_active":"2024-09-12T00:43:48.289475+0000","last_became_peered":"2024-09-12T00:43:48.289475+0000","last_unstale":"2024-09-12T00:59:37.176965+0000","last_undegraded":"2024-09-12T00:59:37.176965+0000","last_fullsized":"2024-09-12T00:59:37.176965+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:49.960814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.169772+0000","last_change":"2024-09-12T00:32:28.056626+0000","last_active":"2024-09-12T00:58:33.169772+0000","last_peered":"2024-09-12T00:58:33.169772+0000","last_clean":"2024-09-12T00:58:33.169772+0000","last_became_active":"2024-09-12T00:32:28.055934+0000","last_became_peered":"2024-09-12T00:32:28.055934+0000","last_unstale":"2024-09-12T00:58:33.169772+0000","last_undegraded":"2024-09-12T00:58:33.169772+0000","last_fullsized":"2024-09-12T00:58:33.169772+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:50.220908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"268'3","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:39.015217+0000","last_change":"2024-09-12T00:32:25.005226+0000","last_active":"2024-09-12T01:01:39.015217+0000","last_peered":"2024-09-12T01:01:39.015217+0000","last_clean":"2024-09-12T01:01:39.015217+0000","last_became_active":"2024-09-12T00:32:25.004503+0000","last_became_peered":"2024-09-12T00:32:25.004503+0000","last_unstale":"2024-09-12T01:01:39.015217+0000","last_undegraded":"2024-09-12T01:01:39.015217+0000","last_fullsized":"2024-09-12T01:01:39.015217+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:32.108404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"268'12","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.178118+0000","last_change":"2024-09-12T00:30:51.543743+0000","last_active":"2024-09-12T00:59:03.178118+0000","last_peered":"2024-09-12T00:59:03.178118+0000","last_clean":"2024-09-12T00:59:03.178118+0000","last_became_active":"2024-09-12T00:30:51.542992+0000","last_became_peered":"2024-09-12T00:30:51.542992+0000","last_unstale":"2024-09-12T00:59:03.178118+0000","last_undegraded":"2024-09-12T00:59:03.178118+0000","last_fullsized":"2024-09-12T00:59:03.178118+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:43.711804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.199729+0000","last_change":"2024-09-12T00:43:48.283532+0000","last_active":"2024-09-12T01:00:28.199729+0000","last_peered":"2024-09-12T01:00:28.199729+0000","last_clean":"2024-09-12T01:00:28.199729+0000","last_became_active":"2024-09-12T00:43:48.276293+0000","last_became_peered":"2024-09-12T00:43:48.276293+0000","last_unstale":"2024-09-12T01:00:28.199729+0000","last_undegraded":"2024-09-12T01:00:28.199729+0000","last_fullsized":"2024-09-12T01:00:28.199729+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:45.902022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"268'6","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.254038+0000","last_change":"2024-09-12T00:32:28.073623+0000","last_active":"2024-09-12T01:02:39.254038+0000","last_peered":"2024-09-12T01:02:39.254038+0000","last_clean":"2024-09-12T01:02:39.254038+0000","last_became_active":"2024-09-12T00:32:28.067824+0000","last_became_peered":"2024-09-12T00:32:28.067824+0000","last_unstale":"2024-09-12T01:02:39.254038+0000","last_undegraded":"2024-09-12T01:02:39.254038+0000","last_fullsized":"2024-09-12T01:02:39.254038+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:24.607971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"268'3","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:34.014457+0000","last_change":"2024-09-12T00:32:25.022973+0000","last_active":"2024-09-12T01:01:34.014457+0000","last_peered":"2024-09-12T01:01:34.014457+0000","last_clean":"2024-09-12T01:01:34.014457+0000","last_became_active":"2024-09-12T00:32:25.022210+0000","last_became_peered":"2024-09-12T00:32:25.022210+0000","last_unstale":"2024-09-12T01:01:34.014457+0000","last_undegraded":"2024-09-12T01:01:34.014457+0000","last_fullsized":"2024-09-12T01:01:34.014457+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:27.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.171708+0000","last_change":"2024-09-12T00:30:51.550674+0000","last_active":"2024-09-12T00:59:03.171708+0000","last_peered":"2024-09-12T00:59:03.171708+0000","last_clean":"2024-09-12T00:59:03.171708+0000","last_became_active":"2024-09-12T00:30:51.549942+0000","last_became_peered":"2024-09-12T00:30:51.549942+0000","last_unstale":"2024-09-12T00:59:03.171708+0000","last_undegraded":"2024-09-12T00:59:03.171708+0000","last_fullsized":"2024-09-12T00:59:03.171708+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:52.263117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":118,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.199785+0000","last_change":"2024-09-12T00:43:48.276759+0000","last_active":"2024-09-12T01:00:28.199785+0000","last_peered":"2024-09-12T01:00:28.199785+0000","last_clean":"2024-09-12T01:00:28.199785+0000","last_became_active":"2024-09-12T00:43:48.276176+0000","last_became_peered":"2024-09-12T00:43:48.276176+0000","last_unstale":"2024-09-12T01:00:28.199785+0000","last_undegraded":"2024-09-12T01:00:28.199785+0000","last_fullsized":"2024-09-12T01:00:28.199785+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:07.896702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.201670+0000","last_change":"2024-09-12T00:32:28.052395+0000","last_active":"2024-09-12T00:59:37.201670+0000","last_peered":"2024-09-12T00:59:37.201670+0000","last_clean":"2024-09-12T00:59:37.201670+0000","last_became_active":"2024-09-12T00:32:28.051244+0000","last_became_peered":"2024-09-12T00:32:28.051244+0000","last_unstale":"2024-09-12T00:59:37.201670+0000","last_undegraded":"2024-09-12T00:59:37.201670+0000","last_fullsized":"2024-09-12T00:59:37.201670+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:09.633243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"268'2","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.995791+0000","last_change":"2024-09-12T00:32:25.023656+0000","last_active":"2024-09-12T01:01:47.995791+0000","last_peered":"2024-09-12T01:01:47.995791+0000","last_clean":"2024-09-12T01:01:47.995791+0000","last_became_active":"2024-09-12T00:32:25.022757+0000","last_became_peered":"2024-09-12T00:32:25.022757+0000","last_unstale":"2024-09-12T01:01:47.995791+0000","last_undegraded":"2024-09-12T01:01:47.995791+0000","last_fullsized":"2024-09-12T01:01:47.995791+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:59.877231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'12","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:04.213055+0000","last_change":"2024-09-12T00:30:51.566131+0000","last_active":"2024-09-12T00:59:04.213055+0000","last_peered":"2024-09-12T00:59:04.213055+0000","last_clean":"2024-09-12T00:59:04.213055+0000","last_became_active":"2024-09-12T00:30:51.565544+0000","last_became_peered":"2024-09-12T00:30:51.565544+0000","last_unstale":"2024-09-12T00:59:04.213055+0000","last_undegraded":"2024-09-12T00:59:04.213055+0000","last_fullsized":"2024-09-12T00:59:04.213055+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:14.413107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.206539+0000","last_change":"2024-09-12T00:43:48.280037+0000","last_active":"2024-09-12T00:59:57.206539+0000","last_peered":"2024-09-12T00:59:57.206539+0000","last_clean":"2024-09-12T00:59:57.206539+0000","last_became_active":"2024-09-12T00:43:48.279243+0000","last_became_peered":"2024-09-12T00:43:48.279243+0000","last_unstale":"2024-09-12T00:59:57.206539+0000","last_undegraded":"2024-09-12T00:59:57.206539+0000","last_fullsized":"2024-09-12T00:59:57.206539+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:31.525488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"268'3","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:37.992237+0000","last_change":"2024-09-12T00:32:28.060782+0000","last_active":"2024-09-12T01:00:37.992237+0000","last_peered":"2024-09-12T01:00:37.992237+0000","last_clean":"2024-09-12T01:00:37.992237+0000","last_became_active":"2024-09-12T00:32:28.058384+0000","last_became_peered":"2024-09-12T00:32:28.058384+0000","last_unstale":"2024-09-12T01:00:37.992237+0000","last_undegraded":"2024-09-12T01:00:37.992237+0000","last_fullsized":"2024-09-12T01:00:37.992237+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:38.238661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"265'3","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:28.167835+0000","last_change":"2024-09-12T00:32:24.996244+0000","last_active":"2024-09-12T00:58:28.167835+0000","last_peered":"2024-09-12T00:58:28.167835+0000","last_clean":"2024-09-12T00:58:28.167835+0000","last_became_active":"2024-09-12T00:32:24.995532+0000","last_became_peered":"2024-09-12T00:32:24.995532+0000","last_unstale":"2024-09-12T00:58:28.167835+0000","last_undegraded":"2024-09-12T00:58:28.167835+0000","last_fullsized":"2024-09-12T00:58:28.167835+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:39.969617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"268'40","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.196522+0000","last_change":"2024-09-12T00:30:51.554468+0000","last_active":"2024-09-12T01:00:13.196522+0000","last_peered":"2024-09-12T01:00:13.196522+0000","last_clean":"2024-09-12T01:00:13.196522+0000","last_became_active":"2024-09-12T00:30:51.553501+0000","last_became_peered":"2024-09-12T00:30:51.553501+0000","last_unstale":"2024-09-12T01:00:13.196522+0000","last_undegraded":"2024-09-12T01:00:13.196522+0000","last_fullsized":"2024-09-12T01:00:13.196522+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:13.843806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":68,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.234081+0000","last_change":"2024-09-12T00:43:48.281674+0000","last_active":"2024-09-12T01:00:29.234081+0000","last_peered":"2024-09-12T01:00:29.234081+0000","last_clean":"2024-09-12T01:00:29.234081+0000","last_became_active":"2024-09-12T00:43:48.280566+0000","last_became_peered":"2024-09-12T00:43:48.280566+0000","last_unstale":"2024-09-12T01:00:29.234081+0000","last_undegraded":"2024-09-12T01:00:29.234081+0000","last_fullsized":"2024-09-12T01:00:29.234081+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:02.297251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"268'4","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000545+0000","last_change":"2024-09-12T00:32:28.061791+0000","last_active":"2024-09-12T01:00:39.000545+0000","last_peered":"2024-09-12T01:00:39.000545+0000","last_clean":"2024-09-12T01:00:39.000545+0000","last_became_active":"2024-09-12T00:32:28.061089+0000","last_became_peered":"2024-09-12T00:32:28.061089+0000","last_unstale":"2024-09-12T01:00:39.000545+0000","last_undegraded":"2024-09-12T01:00:39.000545+0000","last_fullsized":"2024-09-12T01:00:39.000545+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:12.218155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":326,"num_write":4,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"265'11","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:33.999304+0000","last_change":"2024-09-12T00:32:25.004508+0000","last_active":"2024-09-12T01:00:33.999304+0000","last_peered":"2024-09-12T01:00:33.999304+0000","last_clean":"2024-09-12T01:00:33.999304+0000","last_became_active":"2024-09-12T00:32:25.004199+0000","last_became_peered":"2024-09-12T00:32:25.004199+0000","last_unstale":"2024-09-12T01:00:33.999304+0000","last_undegraded":"2024-09-12T01:00:33.999304+0000","last_fullsized":"2024-09-12T01:00:33.999304+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:38.507054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11280,"num_write":21,"num_write_kb":11280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"268'12","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:02.183087+0000","last_change":"2024-09-12T00:30:51.554784+0000","last_active":"2024-09-12T01:00:02.183087+0000","last_peered":"2024-09-12T01:00:02.183087+0000","last_clean":"2024-09-12T01:00:02.183087+0000","last_became_active":"2024-09-12T00:30:51.548619+0000","last_became_peered":"2024-09-12T00:30:51.548619+0000","last_unstale":"2024-09-12T01:00:02.183087+0000","last_undegraded":"2024-09-12T01:00:02.183087+0000","last_fullsized":"2024-09-12T01:00:02.183087+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:18.858058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168084+0000","last_change":"2024-09-12T00:43:48.284636+0000","last_active":"2024-09-12T00:59:02.168084+0000","last_peered":"2024-09-12T00:59:02.168084+0000","last_clean":"2024-09-12T00:59:02.168084+0000","last_became_active":"2024-09-12T00:43:48.283630+0000","last_became_peered":"2024-09-12T00:43:48.283630+0000","last_unstale":"2024-09-12T00:59:02.168084+0000","last_undegraded":"2024-09-12T00:59:02.168084+0000","last_fullsized":"2024-09-12T00:59:02.168084+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:05.417886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'5","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179689+0000","last_change":"2024-09-12T00:32:28.054779+0000","last_active":"2024-09-12T00:59:33.179689+0000","last_peered":"2024-09-12T00:59:33.179689+0000","last_clean":"2024-09-12T00:59:33.179689+0000","last_became_active":"2024-09-12T00:32:28.054045+0000","last_became_peered":"2024-09-12T00:32:28.054045+0000","last_unstale":"2024-09-12T00:59:33.179689+0000","last_undegraded":"2024-09-12T00:59:33.179689+0000","last_fullsized":"2024-09-12T00:59:33.179689+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:05.598087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'3","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:38.202145+0000","last_change":"2024-09-12T00:32:24.998555+0000","last_active":"2024-09-12T01:00:38.202145+0000","last_peered":"2024-09-12T01:00:38.202145+0000","last_clean":"2024-09-12T01:00:38.202145+0000","last_became_active":"2024-09-12T00:32:24.997768+0000","last_became_peered":"2024-09-12T00:32:24.997768+0000","last_unstale":"2024-09-12T01:00:38.202145+0000","last_undegraded":"2024-09-12T01:00:38.202145+0000","last_fullsized":"2024-09-12T01:00:38.202145+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:01.938274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"268'27","reported_seq":114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.193807+0000","last_change":"2024-09-12T00:30:51.557180+0000","last_active":"2024-09-12T01:00:03.193807+0000","last_peered":"2024-09-12T01:00:03.193807+0000","last_clean":"2024-09-12T01:00:03.193807+0000","last_became_active":"2024-09-12T00:30:51.556456+0000","last_became_peered":"2024-09-12T00:30:51.556456+0000","last_unstale":"2024-09-12T01:00:03.193807+0000","last_undegraded":"2024-09-12T01:00:03.193807+0000","last_fullsized":"2024-09-12T01:00:03.193807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:08.813545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":57,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:58.170620+0000","last_change":"2024-09-12T00:43:48.266541+0000","last_active":"2024-09-12T00:58:58.170620+0000","last_peered":"2024-09-12T00:58:58.170620+0000","last_clean":"2024-09-12T00:58:58.170620+0000","last_became_active":"2024-09-12T00:43:48.265726+0000","last_became_peered":"2024-09-12T00:43:48.265726+0000","last_unstale":"2024-09-12T00:58:58.170620+0000","last_undegraded":"2024-09-12T00:58:58.170620+0000","last_fullsized":"2024-09-12T00:58:58.170620+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:07.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000271+0000","last_change":"2024-09-12T00:32:28.051868+0000","last_active":"2024-09-12T01:00:39.000271+0000","last_peered":"2024-09-12T01:00:39.000271+0000","last_clean":"2024-09-12T01:00:39.000271+0000","last_became_active":"2024-09-12T00:32:28.051145+0000","last_became_peered":"2024-09-12T00:32:28.051145+0000","last_unstale":"2024-09-12T01:00:39.000271+0000","last_undegraded":"2024-09-12T01:00:39.000271+0000","last_fullsized":"2024-09-12T01:00:39.000271+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:26.514177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219199+0000","last_change":"2024-09-12T00:32:25.007529+0000","last_active":"2024-09-12T00:59:29.219199+0000","last_peered":"2024-09-12T00:59:29.219199+0000","last_clean":"2024-09-12T00:59:29.219199+0000","last_became_active":"2024-09-12T00:32:25.003679+0000","last_became_peered":"2024-09-12T00:32:25.003679+0000","last_unstale":"2024-09-12T00:59:29.219199+0000","last_undegraded":"2024-09-12T00:59:29.219199+0000","last_fullsized":"2024-09-12T00:59:29.219199+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:31.977653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"268'23","reported_seq":107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:04.228064+0000","last_change":"2024-09-12T00:30:51.552593+0000","last_active":"2024-09-12T01:00:04.228064+0000","last_peered":"2024-09-12T01:00:04.228064+0000","last_clean":"2024-09-12T01:00:04.228064+0000","last_became_active":"2024-09-12T00:30:51.551554+0000","last_became_peered":"2024-09-12T00:30:51.551554+0000","last_unstale":"2024-09-12T01:00:04.228064+0000","last_undegraded":"2024-09-12T01:00:04.228064+0000","last_fullsized":"2024-09-12T01:00:04.228064+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:19.144268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.989931+0000","last_change":"2024-09-12T00:43:48.287349+0000","last_active":"2024-09-12T01:00:31.989931+0000","last_peered":"2024-09-12T01:00:31.989931+0000","last_clean":"2024-09-12T01:00:31.989931+0000","last_became_active":"2024-09-12T00:43:48.286593+0000","last_became_peered":"2024-09-12T00:43:48.286593+0000","last_unstale":"2024-09-12T01:00:31.989931+0000","last_undegraded":"2024-09-12T01:00:31.989931+0000","last_fullsized":"2024-09-12T01:00:31.989931+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:41.625703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"268'6","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:38.213274+0000","last_change":"2024-09-12T00:32:28.070368+0000","last_active":"2024-09-12T01:01:38.213274+0000","last_peered":"2024-09-12T01:01:38.213274+0000","last_clean":"2024-09-12T01:01:38.213274+0000","last_became_active":"2024-09-12T00:32:28.069812+0000","last_became_peered":"2024-09-12T00:32:28.069812+0000","last_unstale":"2024-09-12T01:01:38.213274+0000","last_undegraded":"2024-09-12T01:01:38.213274+0000","last_fullsized":"2024-09-12T01:01:38.213274+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:37.247045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"268'8","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:38.202224+0000","last_change":"2024-09-12T00:32:25.021525+0000","last_active":"2024-09-12T01:01:38.202224+0000","last_peered":"2024-09-12T01:01:38.202224+0000","last_clean":"2024-09-12T01:01:38.202224+0000","last_became_active":"2024-09-12T00:32:25.017138+0000","last_became_peered":"2024-09-12T00:32:25.017138+0000","last_unstale":"2024-09-12T01:01:38.202224+0000","last_undegraded":"2024-09-12T01:01:38.202224+0000","last_fullsized":"2024-09-12T01:01:38.202224+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:39.080595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"268'53","reported_seq":190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:04.227963+0000","last_change":"2024-09-12T00:30:51.553247+0000","last_active":"2024-09-12T01:00:04.227963+0000","last_peered":"2024-09-12T01:00:04.227963+0000","last_clean":"2024-09-12T01:00:04.227963+0000","last_became_active":"2024-09-12T00:30:51.546238+0000","last_became_peered":"2024-09-12T00:30:51.546238+0000","last_unstale":"2024-09-12T01:00:04.227963+0000","last_undegraded":"2024-09-12T01:00:04.227963+0000","last_fullsized":"2024-09-12T01:00:04.227963+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:52.536369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":191,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000484+0000","last_change":"2024-09-12T00:43:48.277891+0000","last_active":"2024-09-12T01:00:39.000484+0000","last_peered":"2024-09-12T01:00:39.000484+0000","last_clean":"2024-09-12T01:00:39.000484+0000","last_became_active":"2024-09-12T00:43:48.277275+0000","last_became_peered":"2024-09-12T00:43:48.277275+0000","last_unstale":"2024-09-12T01:00:39.000484+0000","last_undegraded":"2024-09-12T01:00:39.000484+0000","last_fullsized":"2024-09-12T01:00:39.000484+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:00.758192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.184304+0000","last_change":"2024-09-12T00:32:28.066072+0000","last_active":"2024-09-12T00:59:33.184304+0000","last_peered":"2024-09-12T00:59:33.184304+0000","last_clean":"2024-09-12T00:59:33.184304+0000","last_became_active":"2024-09-12T00:32:28.065320+0000","last_became_peered":"2024-09-12T00:32:28.065320+0000","last_unstale":"2024-09-12T00:59:33.184304+0000","last_undegraded":"2024-09-12T00:59:33.184304+0000","last_fullsized":"2024-09-12T00:59:33.184304+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:36.535395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'3","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185073+0000","last_change":"2024-09-12T00:32:25.017231+0000","last_active":"2024-09-12T00:59:33.185073+0000","last_peered":"2024-09-12T00:59:33.185073+0000","last_clean":"2024-09-12T00:59:33.185073+0000","last_became_active":"2024-09-12T00:32:25.013266+0000","last_became_peered":"2024-09-12T00:32:25.013266+0000","last_unstale":"2024-09-12T00:59:33.185073+0000","last_undegraded":"2024-09-12T00:59:33.185073+0000","last_fullsized":"2024-09-12T00:59:33.185073+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:11.615304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"268'15","reported_seq":86,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.177113+0000","last_change":"2024-09-12T00:30:51.560130+0000","last_active":"2024-09-12T00:59:03.177113+0000","last_peered":"2024-09-12T00:59:03.177113+0000","last_clean":"2024-09-12T00:59:03.177113+0000","last_became_active":"2024-09-12T00:30:51.559445+0000","last_became_peered":"2024-09-12T00:30:51.559445+0000","last_unstale":"2024-09-12T00:59:03.177113+0000","last_undegraded":"2024-09-12T00:59:03.177113+0000","last_fullsized":"2024-09-12T00:59:03.177113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:54.936785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"268'370","reported_seq":1127,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.949163+0000","last_change":"2024-09-12T00:15:55.079016+0000","last_active":"2024-09-12T01:02:39.949163+0000","last_peered":"2024-09-12T01:02:39.949163+0000","last_clean":"2024-09-12T01:02:39.949163+0000","last_became_active":"2024-09-12T00:15:55.078687+0000","last_became_peered":"2024-09-12T00:15:55.078687+0000","last_unstale":"2024-09-12T01:02:39.949163+0000","last_undegraded":"2024-09-12T01:02:39.949163+0000","last_fullsized":"2024-09-12T01:02:39.949163+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:29.403023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":769,"num_read_kb":39834,"num_write":1260,"num_write_kb":26442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"268'857","reported_seq":2605,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.866154+0000","last_change":"2024-09-12T00:15:57.022290+0000","last_active":"2024-09-12T01:02:10.866154+0000","last_peered":"2024-09-12T01:02:10.866154+0000","last_clean":"2024-09-12T01:02:10.866154+0000","last_became_active":"2024-09-12T00:15:57.021927+0000","last_became_peered":"2024-09-12T00:15:57.021927+0000","last_unstale":"2024-09-12T01:02:10.866154+0000","last_undegraded":"2024-09-12T01:02:10.866154+0000","last_fullsized":"2024-09-12T01:02:10.866154+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":800,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:27.786130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4184,"num_read_kb":3812,"num_write":1107,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"268'392","reported_seq":1046,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.990725+0000","last_change":"2024-09-12T00:15:55.075731+0000","last_active":"2024-09-12T01:02:39.990725+0000","last_peered":"2024-09-12T01:02:39.990725+0000","last_clean":"2024-09-12T01:02:39.990725+0000","last_became_active":"2024-09-12T00:15:55.075108+0000","last_became_peered":"2024-09-12T00:15:55.075108+0000","last_unstale":"2024-09-12T01:02:39.990725+0000","last_undegraded":"2024-09-12T01:02:39.990725+0000","last_fullsized":"2024-09-12T01:02:39.990725+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:53.644639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":2165,"num_write":1224,"num_write_kb":32030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"268'541","reported_seq":2172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.146646+0000","last_change":"2024-09-12T00:15:57.022914+0000","last_active":"2024-09-12T01:01:02.146646+0000","last_peered":"2024-09-12T01:01:02.146646+0000","last_clean":"2024-09-12T01:01:02.146646+0000","last_became_active":"2024-09-12T00:15:57.022465+0000","last_became_peered":"2024-09-12T00:15:57.022465+0000","last_unstale":"2024-09-12T01:01:02.146646+0000","last_undegraded":"2024-09-12T01:01:02.146646+0000","last_fullsized":"2024-09-12T01:01:02.146646+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:22.255065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2758,"num_read_kb":2563,"num_write":657,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"268'389","reported_seq":1124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.960292+0000","last_change":"2024-09-12T00:15:55.042888+0000","last_active":"2024-09-12T01:02:39.960292+0000","last_peered":"2024-09-12T01:02:39.960292+0000","last_clean":"2024-09-12T01:02:39.960292+0000","last_became_active":"2024-09-12T00:15:55.041491+0000","last_became_peered":"2024-09-12T00:15:55.041491+0000","last_unstale":"2024-09-12T01:02:39.960292+0000","last_undegraded":"2024-09-12T01:02:39.960292+0000","last_fullsized":"2024-09-12T01:02:39.960292+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:29.522820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3574871,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":831,"num_read_kb":4160,"num_write":1268,"num_write_kb":14348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"268'1145","reported_seq":2779,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:59.004596+0000","last_change":"2024-09-12T00:15:57.023106+0000","last_active":"2024-09-12T01:00:59.004596+0000","last_peered":"2024-09-12T01:00:59.004596+0000","last_clean":"2024-09-12T01:00:59.004596+0000","last_became_active":"2024-09-12T00:15:57.022692+0000","last_became_peered":"2024-09-12T00:15:57.022692+0000","last_unstale":"2024-09-12T01:00:59.004596+0000","last_undegraded":"2024-09-12T01:00:59.004596+0000","last_fullsized":"2024-09-12T01:00:59.004596+0000","mapping_epoch":28,"log_start":"268'1100","ondisk_log_start":"268'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":1100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:01.909120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5291,"num_read_kb":4702,"num_write":1570,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"268'387","reported_seq":1070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.881786+0000","last_change":"2024-09-12T00:15:55.046149+0000","last_active":"2024-09-12T01:02:39.881786+0000","last_peered":"2024-09-12T01:02:39.881786+0000","last_clean":"2024-09-12T01:02:39.881786+0000","last_became_active":"2024-09-12T00:15:55.045668+0000","last_became_peered":"2024-09-12T00:15:55.045668+0000","last_unstale":"2024-09-12T01:02:39.881786+0000","last_undegraded":"2024-09-12T01:02:39.881786+0000","last_fullsized":"2024-09-12T01:02:39.881786+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:25.710871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":365201,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":662,"num_read_kb":47789,"num_write":1293,"num_write_kb":53743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"268'567","reported_seq":2201,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506437+0000","last_change":"2024-09-12T00:15:57.019605+0000","last_active":"2024-09-12T01:01:09.506437+0000","last_peered":"2024-09-12T01:01:09.506437+0000","last_clean":"2024-09-12T01:01:09.506437+0000","last_became_active":"2024-09-12T00:15:57.018762+0000","last_became_peered":"2024-09-12T00:15:57.018762+0000","last_unstale":"2024-09-12T01:01:09.506437+0000","last_undegraded":"2024-09-12T01:01:09.506437+0000","last_fullsized":"2024-09-12T01:01:09.506437+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:00.744230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2864,"num_read_kb":2646,"num_write":693,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"268'365","reported_seq":1012,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.936727+0000","last_change":"2024-09-12T00:15:55.072012+0000","last_active":"2024-09-12T01:02:39.936727+0000","last_peered":"2024-09-12T01:02:39.936727+0000","last_clean":"2024-09-12T01:02:39.936727+0000","last_became_active":"2024-09-12T00:15:55.071352+0000","last_became_peered":"2024-09-12T00:15:55.071352+0000","last_unstale":"2024-09-12T01:02:39.936727+0000","last_undegraded":"2024-09-12T01:02:39.936727+0000","last_fullsized":"2024-09-12T01:02:39.936727+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:19.609544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8845231,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":491,"num_read_kb":19398,"num_write":1138,"num_write_kb":53254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"268'458","reported_seq":2076,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:45.897964+0000","last_change":"2024-09-12T00:15:57.052282+0000","last_active":"2024-09-12T01:00:45.897964+0000","last_peered":"2024-09-12T01:00:45.897964+0000","last_clean":"2024-09-12T01:00:45.897964+0000","last_became_active":"2024-09-12T00:15:57.051973+0000","last_became_peered":"2024-09-12T00:15:57.051973+0000","last_unstale":"2024-09-12T01:00:45.897964+0000","last_undegraded":"2024-09-12T01:00:45.897964+0000","last_fullsized":"2024-09-12T01:00:45.897964+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:51.721224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":2348,"num_write":528,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"268'352","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.976520+0000","last_change":"2024-09-12T00:15:55.067779+0000","last_active":"2024-09-12T01:02:39.976520+0000","last_peered":"2024-09-12T01:02:39.976520+0000","last_clean":"2024-09-12T01:02:39.976520+0000","last_became_active":"2024-09-12T00:15:55.067030+0000","last_became_peered":"2024-09-12T00:15:55.067030+0000","last_unstale":"2024-09-12T01:02:39.976520+0000","last_undegraded":"2024-09-12T01:02:39.976520+0000","last_fullsized":"2024-09-12T01:02:39.976520+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:15.471567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":499,"num_read_kb":33085,"num_write":1019,"num_write_kb":28183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"268'485","reported_seq":2072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.168505+0000","last_change":"2024-09-12T00:15:57.037419+0000","last_active":"2024-09-12T01:00:52.168505+0000","last_peered":"2024-09-12T01:00:52.168505+0000","last_clean":"2024-09-12T01:00:52.168505+0000","last_became_active":"2024-09-12T00:15:57.037045+0000","last_became_peered":"2024-09-12T00:15:57.037045+0000","last_unstale":"2024-09-12T01:00:52.168505+0000","last_undegraded":"2024-09-12T01:00:52.168505+0000","last_fullsized":"2024-09-12T01:00:52.168505+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:10.231756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2556,"num_read_kb":2389,"num_write":592,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"268'364","reported_seq":1095,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.819613+0000","last_change":"2024-09-12T00:15:55.050401+0000","last_active":"2024-09-12T01:02:39.819613+0000","last_peered":"2024-09-12T01:02:39.819613+0000","last_clean":"2024-09-12T01:02:39.819613+0000","last_became_active":"2024-09-12T00:15:55.041976+0000","last_became_peered":"2024-09-12T00:15:55.041976+0000","last_unstale":"2024-09-12T01:02:39.819613+0000","last_undegraded":"2024-09-12T01:02:39.819613+0000","last_fullsized":"2024-09-12T01:02:39.819613+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:30.850752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055004,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":661,"num_read_kb":92017,"num_write":1205,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"268'476","reported_seq":1929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506328+0000","last_change":"2024-09-12T00:15:57.013582+0000","last_active":"2024-09-12T01:01:09.506328+0000","last_peered":"2024-09-12T01:01:09.506328+0000","last_clean":"2024-09-12T01:01:09.506328+0000","last_became_active":"2024-09-12T00:15:57.013278+0000","last_became_peered":"2024-09-12T00:15:57.013278+0000","last_unstale":"2024-09-12T01:01:09.506328+0000","last_undegraded":"2024-09-12T01:01:09.506328+0000","last_fullsized":"2024-09-12T01:01:09.506328+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:44.317982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2343,"num_read_kb":2167,"num_write":566,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"268'313","reported_seq":960,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.959116+0000","last_change":"2024-09-12T00:15:55.070693+0000","last_active":"2024-09-12T01:02:39.959116+0000","last_peered":"2024-09-12T01:02:39.959116+0000","last_clean":"2024-09-12T01:02:39.959116+0000","last_became_active":"2024-09-12T00:15:55.060127+0000","last_became_peered":"2024-09-12T00:15:55.060127+0000","last_unstale":"2024-09-12T01:02:39.959116+0000","last_undegraded":"2024-09-12T01:02:39.959116+0000","last_fullsized":"2024-09-12T01:02:39.959116+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:18.762399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":41438,"num_write":900,"num_write_kb":44478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"268'983","reported_seq":2514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:48.416472+0000","last_change":"2024-09-12T00:15:57.052355+0000","last_active":"2024-09-12T01:00:48.416472+0000","last_peered":"2024-09-12T01:00:48.416472+0000","last_clean":"2024-09-12T01:00:48.416472+0000","last_became_active":"2024-09-12T00:15:57.051665+0000","last_became_peered":"2024-09-12T00:15:57.051665+0000","last_unstale":"2024-09-12T01:00:48.416472+0000","last_undegraded":"2024-09-12T01:00:48.416472+0000","last_fullsized":"2024-09-12T01:00:48.416472+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":900,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:20.500797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4673,"num_read_kb":4124,"num_write":1393,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"268'888","reported_seq":2500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.446445+0000","last_change":"2024-09-12T00:15:57.032298+0000","last_active":"2024-09-12T01:01:06.446445+0000","last_peered":"2024-09-12T01:01:06.446445+0000","last_clean":"2024-09-12T01:01:06.446445+0000","last_became_active":"2024-09-12T00:15:57.031897+0000","last_became_peered":"2024-09-12T00:15:57.031897+0000","last_unstale":"2024-09-12T01:01:06.446445+0000","last_undegraded":"2024-09-12T01:01:06.446445+0000","last_fullsized":"2024-09-12T01:01:06.446445+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:00.128491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4303,"num_read_kb":3853,"num_write":1201,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"268'315","reported_seq":935,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.951695+0000","last_change":"2024-09-12T00:15:55.064283+0000","last_active":"2024-09-12T01:02:39.951695+0000","last_peered":"2024-09-12T01:02:39.951695+0000","last_clean":"2024-09-12T01:02:39.951695+0000","last_became_active":"2024-09-12T00:15:55.063797+0000","last_became_peered":"2024-09-12T00:15:55.063797+0000","last_unstale":"2024-09-12T01:02:39.951695+0000","last_undegraded":"2024-09-12T01:02:39.951695+0000","last_fullsized":"2024-09-12T01:02:39.951695+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:33.806593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":7341,"num_write":997,"num_write_kb":14342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"268'782","reported_seq":2212,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.159774+0000","last_change":"2024-09-12T00:15:57.017929+0000","last_active":"2024-09-12T01:01:02.159774+0000","last_peered":"2024-09-12T01:01:02.159774+0000","last_clean":"2024-09-12T01:01:02.159774+0000","last_became_active":"2024-09-12T00:15:57.017679+0000","last_became_peered":"2024-09-12T00:15:57.017679+0000","last_unstale":"2024-09-12T01:01:02.159774+0000","last_undegraded":"2024-09-12T01:01:02.159774+0000","last_fullsized":"2024-09-12T01:01:02.159774+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:58.830951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3571,"num_read_kb":3210,"num_write":1015,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"268'379","reported_seq":1062,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.909640+0000","last_change":"2024-09-12T00:16:26.796331+0000","last_active":"2024-09-12T01:02:39.909640+0000","last_peered":"2024-09-12T01:02:39.909640+0000","last_clean":"2024-09-12T01:02:39.909640+0000","last_became_active":"2024-09-12T00:16:26.794438+0000","last_became_peered":"2024-09-12T00:16:26.794438+0000","last_unstale":"2024-09-12T01:02:39.909640+0000","last_undegraded":"2024-09-12T01:02:39.909640+0000","last_fullsized":"2024-09-12T01:02:39.909640+0000","mapping_epoch":39,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:59.877909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":637,"num_read_kb":170107,"num_write":1135,"num_write_kb":45359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,6],"acting":[5,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"268'412","reported_seq":1882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:02.267039+0000","last_change":"2024-09-12T00:15:57.039877+0000","last_active":"2024-09-12T01:00:02.267039+0000","last_peered":"2024-09-12T01:00:02.267039+0000","last_clean":"2024-09-12T01:00:02.267039+0000","last_became_active":"2024-09-12T00:15:57.039474+0000","last_became_peered":"2024-09-12T00:15:57.039474+0000","last_unstale":"2024-09-12T01:00:02.267039+0000","last_undegraded":"2024-09-12T01:00:02.267039+0000","last_fullsized":"2024-09-12T01:00:02.267039+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:19.030086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2320,"num_read_kb":2162,"num_write":506,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"268'339","reported_seq":1081,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.942747+0000","last_change":"2024-09-12T00:15:55.066310+0000","last_active":"2024-09-12T01:02:39.942747+0000","last_peered":"2024-09-12T01:02:39.942747+0000","last_clean":"2024-09-12T01:02:39.942747+0000","last_became_active":"2024-09-12T00:15:55.060170+0000","last_became_peered":"2024-09-12T00:15:55.060170+0000","last_unstale":"2024-09-12T01:02:39.942747+0000","last_undegraded":"2024-09-12T01:02:39.942747+0000","last_fullsized":"2024-09-12T01:02:39.942747+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:43.105768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263219,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":623,"num_read_kb":11665,"num_write":1071,"num_write_kb":19684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"268'454","reported_seq":2050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.869036+0000","last_change":"2024-09-12T00:15:57.044727+0000","last_active":"2024-09-12T01:02:10.869036+0000","last_peered":"2024-09-12T01:02:10.869036+0000","last_clean":"2024-09-12T01:02:10.869036+0000","last_became_active":"2024-09-12T00:15:57.044075+0000","last_became_peered":"2024-09-12T00:15:57.044075+0000","last_unstale":"2024-09-12T01:02:10.869036+0000","last_undegraded":"2024-09-12T01:02:10.869036+0000","last_fullsized":"2024-09-12T01:02:10.869036+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:10.231756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2345,"num_read_kb":2229,"num_write":503,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"268'357","reported_seq":1063,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.887445+0000","last_change":"2024-09-12T00:15:55.078923+0000","last_active":"2024-09-12T01:02:39.887445+0000","last_peered":"2024-09-12T01:02:39.887445+0000","last_clean":"2024-09-12T01:02:39.887445+0000","last_became_active":"2024-09-12T00:15:55.078352+0000","last_became_peered":"2024-09-12T00:15:55.078352+0000","last_unstale":"2024-09-12T01:02:39.887445+0000","last_undegraded":"2024-09-12T01:02:39.887445+0000","last_fullsized":"2024-09-12T01:02:39.887445+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:20.005373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3306265,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":657,"num_read_kb":46871,"num_write":1194,"num_write_kb":28820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"268'399","reported_seq":1872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.865538+0000","last_change":"2024-09-12T00:15:57.032920+0000","last_active":"2024-09-12T01:02:10.865538+0000","last_peered":"2024-09-12T01:02:10.865538+0000","last_clean":"2024-09-12T01:02:10.865538+0000","last_became_active":"2024-09-12T00:15:57.032173+0000","last_became_peered":"2024-09-12T00:15:57.032173+0000","last_unstale":"2024-09-12T01:02:10.865538+0000","last_undegraded":"2024-09-12T01:02:10.865538+0000","last_fullsized":"2024-09-12T01:02:10.865538+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:23.061664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2107,"num_read_kb":2010,"num_write":461,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"268'356","reported_seq":1079,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.896694+0000","last_change":"2024-09-12T00:15:55.067201+0000","last_active":"2024-09-12T01:02:39.896694+0000","last_peered":"2024-09-12T01:02:39.896694+0000","last_clean":"2024-09-12T01:02:39.896694+0000","last_became_active":"2024-09-12T00:15:55.066304+0000","last_became_peered":"2024-09-12T00:15:55.066304+0000","last_unstale":"2024-09-12T01:02:39.896694+0000","last_undegraded":"2024-09-12T01:02:39.896694+0000","last_fullsized":"2024-09-12T01:02:39.896694+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:31.298321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":677,"num_read_kb":58383,"num_write":1149,"num_write_kb":49764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"268'1197","reported_seq":3218,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506270+0000","last_change":"2024-09-12T00:15:57.021981+0000","last_active":"2024-09-12T01:01:09.506270+0000","last_peered":"2024-09-12T01:01:09.506270+0000","last_clean":"2024-09-12T01:01:09.506270+0000","last_became_active":"2024-09-12T00:15:57.021605+0000","last_became_peered":"2024-09-12T00:15:57.021605+0000","last_unstale":"2024-09-12T01:01:09.506270+0000","last_undegraded":"2024-09-12T01:01:09.506270+0000","last_fullsized":"2024-09-12T01:01:09.506270+0000","mapping_epoch":28,"log_start":"268'1100","ondisk_log_start":"268'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":1100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:38.616266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6433,"num_read_kb":5744,"num_write":1768,"num_write_kb":831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"268'298","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.911490+0000","last_change":"2024-09-12T00:15:55.052710+0000","last_active":"2024-09-12T01:02:39.911490+0000","last_peered":"2024-09-12T01:02:39.911490+0000","last_clean":"2024-09-12T01:02:39.911490+0000","last_became_active":"2024-09-12T00:15:55.050860+0000","last_became_peered":"2024-09-12T00:15:55.050860+0000","last_unstale":"2024-09-12T01:02:39.911490+0000","last_undegraded":"2024-09-12T01:02:39.911490+0000","last_fullsized":"2024-09-12T01:02:39.911490+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:08.086426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399261,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":8796,"num_write":982,"num_write_kb":26056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"268'150","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.320340+0000","last_change":"2024-09-12T00:16:05.096232+0000","last_active":"2024-09-12T01:01:07.320340+0000","last_peered":"2024-09-12T01:01:07.320340+0000","last_clean":"2024-09-12T01:01:07.320340+0000","last_became_active":"2024-09-12T00:16:05.095632+0000","last_became_peered":"2024-09-12T00:16:05.095632+0000","last_unstale":"2024-09-12T01:01:07.320340+0000","last_undegraded":"2024-09-12T01:01:07.320340+0000","last_fullsized":"2024-09-12T01:01:07.320340+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:47.445460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":139,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"268'388","reported_seq":1858,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.446472+0000","last_change":"2024-09-12T00:15:57.044606+0000","last_active":"2024-09-12T01:01:06.446472+0000","last_peered":"2024-09-12T01:01:06.446472+0000","last_clean":"2024-09-12T01:01:06.446472+0000","last_became_active":"2024-09-12T00:15:57.042317+0000","last_became_peered":"2024-09-12T00:15:57.042317+0000","last_unstale":"2024-09-12T01:01:06.446472+0000","last_undegraded":"2024-09-12T01:01:06.446472+0000","last_fullsized":"2024-09-12T01:01:06.446472+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":300,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:47.707278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2080,"num_read_kb":1982,"num_write":441,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"268'365","reported_seq":1014,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.971098+0000","last_change":"2024-09-12T00:15:55.043571+0000","last_active":"2024-09-12T01:02:39.971098+0000","last_peered":"2024-09-12T01:02:39.971098+0000","last_clean":"2024-09-12T01:02:39.971098+0000","last_became_active":"2024-09-12T00:15:55.042690+0000","last_became_peered":"2024-09-12T00:15:55.042690+0000","last_unstale":"2024-09-12T01:02:39.971098+0000","last_undegraded":"2024-09-12T01:02:39.971098+0000","last_fullsized":"2024-09-12T01:02:39.971098+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:22.575508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288443,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":537,"num_read_kb":60082,"num_write":1122,"num_write_kb":36322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219465+0000","last_change":"2024-09-12T00:15:59.047089+0000","last_active":"2024-09-12T00:59:29.219465+0000","last_peered":"2024-09-12T00:59:29.219465+0000","last_clean":"2024-09-12T00:59:29.219465+0000","last_became_active":"2024-09-12T00:15:59.046334+0000","last_became_peered":"2024-09-12T00:15:59.046334+0000","last_unstale":"2024-09-12T00:59:29.219465+0000","last_undegraded":"2024-09-12T00:59:29.219465+0000","last_fullsized":"2024-09-12T00:59:29.219465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:50.471898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"268'359","reported_seq":979,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.847733+0000","last_change":"2024-09-12T00:16:01.058485+0000","last_active":"2024-09-12T01:02:39.847733+0000","last_peered":"2024-09-12T01:02:39.847733+0000","last_clean":"2024-09-12T01:02:39.847733+0000","last_became_active":"2024-09-12T00:16:01.057657+0000","last_became_peered":"2024-09-12T00:16:01.057657+0000","last_unstale":"2024-09-12T01:02:39.847733+0000","last_undegraded":"2024-09-12T01:02:39.847733+0000","last_fullsized":"2024-09-12T01:02:39.847733+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:28.536472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49919,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":600,"num_read_kb":1282,"num_write":482,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185238+0000","last_change":"2024-09-12T00:16:03.099188+0000","last_active":"2024-09-12T00:59:33.185238+0000","last_peered":"2024-09-12T00:59:33.185238+0000","last_clean":"2024-09-12T00:59:33.185238+0000","last_became_active":"2024-09-12T00:16:03.098506+0000","last_became_peered":"2024-09-12T00:16:03.098506+0000","last_unstale":"2024-09-12T00:59:33.185238+0000","last_undegraded":"2024-09-12T00:59:33.185238+0000","last_fullsized":"2024-09-12T00:59:33.185238+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:09.926077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"268'152","reported_seq":715,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.258951+0000","last_change":"2024-09-12T00:16:05.105689+0000","last_active":"2024-09-12T01:01:02.258951+0000","last_peered":"2024-09-12T01:01:02.258951+0000","last_clean":"2024-09-12T01:01:02.258951+0000","last_became_active":"2024-09-12T00:16:05.105153+0000","last_became_peered":"2024-09-12T00:16:05.105153+0000","last_unstale":"2024-09-12T01:01:02.258951+0000","last_undegraded":"2024-09-12T01:01:02.258951+0000","last_fullsized":"2024-09-12T01:01:02.258951+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:12.364784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":214,"num_write":299,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"268'897","reported_seq":2521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.015147+0000","last_change":"2024-09-12T00:15:57.018776+0000","last_active":"2024-09-12T01:00:47.015147+0000","last_peered":"2024-09-12T01:00:47.015147+0000","last_clean":"2024-09-12T01:00:47.015147+0000","last_became_active":"2024-09-12T00:15:57.018484+0000","last_became_peered":"2024-09-12T00:15:57.018484+0000","last_unstale":"2024-09-12T01:00:47.015147+0000","last_undegraded":"2024-09-12T01:00:47.015147+0000","last_fullsized":"2024-09-12T01:00:47.015147+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":800,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:46.467646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4265,"num_read_kb":3809,"num_write":1199,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"268'363","reported_seq":1007,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.881003+0000","last_change":"2024-09-12T00:15:55.067220+0000","last_active":"2024-09-12T01:02:39.881003+0000","last_peered":"2024-09-12T01:02:39.881003+0000","last_clean":"2024-09-12T01:02:39.881003+0000","last_became_active":"2024-09-12T00:15:55.065476+0000","last_became_peered":"2024-09-12T00:15:55.065476+0000","last_unstale":"2024-09-12T01:02:39.881003+0000","last_undegraded":"2024-09-12T01:02:39.881003+0000","last_fullsized":"2024-09-12T01:02:39.881003+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:58.771415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399070,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":579,"num_read_kb":7666,"num_write":1219,"num_write_kb":15378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:13.159333+0000","last_change":"2024-09-12T00:15:59.041196+0000","last_active":"2024-09-12T00:58:13.159333+0000","last_peered":"2024-09-12T00:58:13.159333+0000","last_clean":"2024-09-12T00:58:13.159333+0000","last_became_active":"2024-09-12T00:15:59.040412+0000","last_became_peered":"2024-09-12T00:15:59.040412+0000","last_unstale":"2024-09-12T00:58:13.159333+0000","last_undegraded":"2024-09-12T00:58:13.159333+0000","last_fullsized":"2024-09-12T00:58:13.159333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:37.117865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"268'89","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:59.917462+0000","last_change":"2024-09-12T00:16:01.067472+0000","last_active":"2024-09-12T00:59:59.917462+0000","last_peered":"2024-09-12T00:59:59.917462+0000","last_clean":"2024-09-12T00:59:59.917462+0000","last_became_active":"2024-09-12T00:16:01.062780+0000","last_became_peered":"2024-09-12T00:16:01.062780+0000","last_unstale":"2024-09-12T00:59:59.917462+0000","last_undegraded":"2024-09-12T00:59:59.917462+0000","last_fullsized":"2024-09-12T00:59:59.917462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:25.299928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185153+0000","last_change":"2024-09-12T00:16:03.092617+0000","last_active":"2024-09-12T00:59:33.185153+0000","last_peered":"2024-09-12T00:59:33.185153+0000","last_clean":"2024-09-12T00:59:33.185153+0000","last_became_active":"2024-09-12T00:16:03.091926+0000","last_became_peered":"2024-09-12T00:16:03.091926+0000","last_unstale":"2024-09-12T00:59:33.185153+0000","last_undegraded":"2024-09-12T00:59:33.185153+0000","last_fullsized":"2024-09-12T00:59:33.185153+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:35.129510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"268'125","reported_seq":621,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:05.844320+0000","last_change":"2024-09-12T00:16:05.115080+0000","last_active":"2024-09-12T01:01:05.844320+0000","last_peered":"2024-09-12T01:01:05.844320+0000","last_clean":"2024-09-12T01:01:05.844320+0000","last_became_active":"2024-09-12T00:16:05.114182+0000","last_became_peered":"2024-09-12T00:16:05.114182+0000","last_unstale":"2024-09-12T01:01:05.844320+0000","last_undegraded":"2024-09-12T01:01:05.844320+0000","last_fullsized":"2024-09-12T01:01:05.844320+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:12.382388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":293,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"268'1230","reported_seq":2685,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.015822+0000","last_change":"2024-09-12T00:15:57.047647+0000","last_active":"2024-09-12T01:00:47.015822+0000","last_peered":"2024-09-12T01:00:47.015822+0000","last_clean":"2024-09-12T01:00:47.015822+0000","last_became_active":"2024-09-12T00:15:57.046916+0000","last_became_peered":"2024-09-12T00:15:57.046916+0000","last_unstale":"2024-09-12T01:00:47.015822+0000","last_undegraded":"2024-09-12T01:00:47.015822+0000","last_fullsized":"2024-09-12T01:00:47.015822+0000","mapping_epoch":28,"log_start":"268'1200","ondisk_log_start":"268'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:00.710335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5641,"num_read_kb":4945,"num_write":1755,"num_write_kb":746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"268'379","reported_seq":1163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.963738+0000","last_change":"2024-09-12T00:15:55.064793+0000","last_active":"2024-09-12T01:02:39.963738+0000","last_peered":"2024-09-12T01:02:39.963738+0000","last_clean":"2024-09-12T01:02:39.963738+0000","last_became_active":"2024-09-12T00:15:55.058428+0000","last_became_peered":"2024-09-12T00:15:55.058428+0000","last_unstale":"2024-09-12T01:02:39.963738+0000","last_undegraded":"2024-09-12T01:02:39.963738+0000","last_fullsized":"2024-09-12T01:02:39.963738+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:12.660366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":722,"num_read_kb":690,"num_write":1257,"num_write_kb":29311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179931+0000","last_change":"2024-09-12T00:15:59.040242+0000","last_active":"2024-09-12T00:59:33.179931+0000","last_peered":"2024-09-12T00:59:33.179931+0000","last_clean":"2024-09-12T00:59:33.179931+0000","last_became_active":"2024-09-12T00:15:59.039465+0000","last_became_peered":"2024-09-12T00:15:59.039465+0000","last_unstale":"2024-09-12T00:59:33.179931+0000","last_undegraded":"2024-09-12T00:59:33.179931+0000","last_fullsized":"2024-09-12T00:59:33.179931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:02.272155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"268'130","reported_seq":681,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:22.544313+0000","last_change":"2024-09-12T00:16:01.057413+0000","last_active":"2024-09-12T00:59:22.544313+0000","last_peered":"2024-09-12T00:59:22.544313+0000","last_clean":"2024-09-12T00:59:22.544313+0000","last_became_active":"2024-09-12T00:16:01.056702+0000","last_became_peered":"2024-09-12T00:16:01.056702+0000","last_unstale":"2024-09-12T00:59:22.544313+0000","last_undegraded":"2024-09-12T00:59:22.544313+0000","last_fullsized":"2024-09-12T00:59:22.544313+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:41.238549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":144,"num_read_kb":136,"num_write":100,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"268'802","reported_seq":2225,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.481677+0000","last_change":"2024-09-12T00:16:03.104735+0000","last_active":"2024-09-12T01:02:39.481677+0000","last_peered":"2024-09-12T01:02:39.481677+0000","last_clean":"2024-09-12T01:02:39.481677+0000","last_became_active":"2024-09-12T00:16:03.103292+0000","last_became_peered":"2024-09-12T00:16:03.103292+0000","last_unstale":"2024-09-12T01:02:39.481677+0000","last_undegraded":"2024-09-12T01:02:39.481677+0000","last_fullsized":"2024-09-12T01:02:39.481677+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:21.322414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"268'234","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.369432+0000","last_change":"2024-09-12T00:16:05.108369+0000","last_active":"2024-09-12T01:01:07.369432+0000","last_peered":"2024-09-12T01:01:07.369432+0000","last_clean":"2024-09-12T01:01:07.369432+0000","last_became_active":"2024-09-12T00:16:05.107785+0000","last_became_peered":"2024-09-12T00:16:05.107785+0000","last_unstale":"2024-09-12T01:01:07.369432+0000","last_undegraded":"2024-09-12T01:01:07.369432+0000","last_fullsized":"2024-09-12T01:01:07.369432+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:30.275724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":637,"num_write":534,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"268'635","reported_seq":2161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.998760+0000","last_change":"2024-09-12T00:15:57.036539+0000","last_active":"2024-09-12T01:00:39.998760+0000","last_peered":"2024-09-12T01:00:39.998760+0000","last_clean":"2024-09-12T01:00:39.998760+0000","last_became_active":"2024-09-12T00:15:57.035581+0000","last_became_peered":"2024-09-12T00:15:57.035581+0000","last_unstale":"2024-09-12T01:00:39.998760+0000","last_undegraded":"2024-09-12T01:00:39.998760+0000","last_fullsized":"2024-09-12T01:00:39.998760+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":600,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:01.577455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3178,"num_read_kb":2956,"num_write":875,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"268'336","reported_seq":1002,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.895449+0000","last_change":"2024-09-12T00:15:55.065992+0000","last_active":"2024-09-12T01:02:39.895449+0000","last_peered":"2024-09-12T01:02:39.895449+0000","last_clean":"2024-09-12T01:02:39.895449+0000","last_became_active":"2024-09-12T00:15:55.065178+0000","last_became_peered":"2024-09-12T00:15:55.065178+0000","last_unstale":"2024-09-12T01:02:39.895449+0000","last_undegraded":"2024-09-12T01:02:39.895449+0000","last_fullsized":"2024-09-12T01:02:39.895449+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:42.418779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262226,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":565,"num_write":1139,"num_write_kb":21852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219511+0000","last_change":"2024-09-12T00:15:59.040434+0000","last_active":"2024-09-12T00:59:29.219511+0000","last_peered":"2024-09-12T00:59:29.219511+0000","last_clean":"2024-09-12T00:59:29.219511+0000","last_became_active":"2024-09-12T00:15:59.039902+0000","last_became_peered":"2024-09-12T00:15:59.039902+0000","last_unstale":"2024-09-12T00:59:29.219511+0000","last_undegraded":"2024-09-12T00:59:29.219511+0000","last_fullsized":"2024-09-12T00:59:29.219511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:50.427091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"268'279","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.469236+0000","last_change":"2024-09-12T00:16:01.053456+0000","last_active":"2024-09-12T01:02:39.469236+0000","last_peered":"2024-09-12T01:02:39.469236+0000","last_clean":"2024-09-12T01:02:39.469236+0000","last_became_active":"2024-09-12T00:16:01.052744+0000","last_became_peered":"2024-09-12T00:16:01.052744+0000","last_unstale":"2024-09-12T01:02:39.469236+0000","last_undegraded":"2024-09-12T01:02:39.469236+0000","last_fullsized":"2024-09-12T01:02:39.469236+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:17.018417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47709,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":1056,"num_write":378,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"268'815","reported_seq":2460,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.370874+0000","last_change":"2024-09-12T00:16:03.098659+0000","last_active":"2024-09-12T01:02:39.370874+0000","last_peered":"2024-09-12T01:02:39.370874+0000","last_clean":"2024-09-12T01:02:39.370874+0000","last_became_active":"2024-09-12T00:16:03.097895+0000","last_became_peered":"2024-09-12T00:16:03.097895+0000","last_unstale":"2024-09-12T01:02:39.370874+0000","last_undegraded":"2024-09-12T01:02:39.370874+0000","last_fullsized":"2024-09-12T01:02:39.370874+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:25.934943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"268'458","reported_seq":2011,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.582816+0000","last_change":"2024-09-12T00:15:57.023912+0000","last_active":"2024-09-12T01:01:09.582816+0000","last_peered":"2024-09-12T01:01:09.582816+0000","last_clean":"2024-09-12T01:01:09.582816+0000","last_became_active":"2024-09-12T00:15:57.023659+0000","last_became_peered":"2024-09-12T00:15:57.023659+0000","last_unstale":"2024-09-12T01:01:09.582816+0000","last_undegraded":"2024-09-12T01:01:09.582816+0000","last_fullsized":"2024-09-12T01:01:09.582816+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:02.798248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2457,"num_read_kb":2306,"num_write":563,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"268'375","reported_seq":1006,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.773516+0000","last_change":"2024-09-12T00:15:55.066577+0000","last_active":"2024-09-12T01:02:39.773516+0000","last_peered":"2024-09-12T01:02:39.773516+0000","last_clean":"2024-09-12T01:02:39.773516+0000","last_became_active":"2024-09-12T00:15:55.060679+0000","last_became_peered":"2024-09-12T00:15:55.060679+0000","last_unstale":"2024-09-12T01:02:39.773516+0000","last_undegraded":"2024-09-12T01:02:39.773516+0000","last_fullsized":"2024-09-12T01:02:39.773516+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:10.882193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":484,"num_read_kb":16773,"num_write":1144,"num_write_kb":29370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:23.182560+0000","last_change":"2024-09-12T00:15:59.035705+0000","last_active":"2024-09-12T00:59:23.182560+0000","last_peered":"2024-09-12T00:59:23.182560+0000","last_clean":"2024-09-12T00:59:23.182560+0000","last_became_active":"2024-09-12T00:15:59.035288+0000","last_became_peered":"2024-09-12T00:15:59.035288+0000","last_unstale":"2024-09-12T00:59:23.182560+0000","last_undegraded":"2024-09-12T00:59:23.182560+0000","last_fullsized":"2024-09-12T00:59:23.182560+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:46.726241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"268'349","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.443258+0000","last_change":"2024-09-12T00:16:01.070645+0000","last_active":"2024-09-12T01:02:37.443258+0000","last_peered":"2024-09-12T01:02:37.443258+0000","last_clean":"2024-09-12T01:02:37.443258+0000","last_became_active":"2024-09-12T00:16:01.069838+0000","last_became_peered":"2024-09-12T00:16:01.069838+0000","last_unstale":"2024-09-12T01:02:37.443258+0000","last_undegraded":"2024-09-12T01:02:37.443258+0000","last_fullsized":"2024-09-12T01:02:37.443258+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:57.640957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45025,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":563,"num_read_kb":1131,"num_write":438,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.162032+0000","last_change":"2024-09-12T00:16:03.090231+0000","last_active":"2024-09-12T00:58:48.162032+0000","last_peered":"2024-09-12T00:58:48.162032+0000","last_clean":"2024-09-12T00:58:48.162032+0000","last_became_active":"2024-09-12T00:16:03.089533+0000","last_became_peered":"2024-09-12T00:16:03.089533+0000","last_unstale":"2024-09-12T00:58:48.162032+0000","last_undegraded":"2024-09-12T00:58:48.162032+0000","last_fullsized":"2024-09-12T00:58:48.162032+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:22.033467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"268'572","reported_seq":1384,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.041861+0000","last_change":"2024-09-12T00:16:05.114168+0000","last_active":"2024-09-12T01:02:12.041861+0000","last_peered":"2024-09-12T01:02:12.041861+0000","last_clean":"2024-09-12T01:02:12.041861+0000","last_became_active":"2024-09-12T00:16:05.112960+0000","last_became_peered":"2024-09-12T00:16:05.112960+0000","last_unstale":"2024-09-12T01:02:12.041861+0000","last_undegraded":"2024-09-12T01:02:12.041861+0000","last_fullsized":"2024-09-12T01:02:12.041861+0000","mapping_epoch":36,"log_start":"268'500","ondisk_log_start":"268'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:15.906818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1305,"num_read_kb":1300,"num_write":1202,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"268'522","reported_seq":2000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.582686+0000","last_change":"2024-09-12T00:15:57.045470+0000","last_active":"2024-09-12T01:01:09.582686+0000","last_peered":"2024-09-12T01:01:09.582686+0000","last_clean":"2024-09-12T01:01:09.582686+0000","last_became_active":"2024-09-12T00:15:57.045141+0000","last_became_peered":"2024-09-12T00:15:57.045141+0000","last_unstale":"2024-09-12T01:01:09.582686+0000","last_undegraded":"2024-09-12T01:01:09.582686+0000","last_fullsized":"2024-09-12T01:01:09.582686+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.221530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2585,"num_read_kb":2367,"num_write":669,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"268'370","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.954864+0000","last_change":"2024-09-12T00:15:55.065308+0000","last_active":"2024-09-12T01:02:39.954864+0000","last_peered":"2024-09-12T01:02:39.954864+0000","last_clean":"2024-09-12T01:02:39.954864+0000","last_became_active":"2024-09-12T00:15:55.063542+0000","last_became_peered":"2024-09-12T00:15:55.063542+0000","last_unstale":"2024-09-12T01:02:39.954864+0000","last_undegraded":"2024-09-12T01:02:39.954864+0000","last_fullsized":"2024-09-12T01:02:39.954864+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:07.380766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":559,"num_read_kb":24074,"num_write":1250,"num_write_kb":38232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:23.170976+0000","last_change":"2024-09-12T00:15:59.051412+0000","last_active":"2024-09-12T00:59:23.170976+0000","last_peered":"2024-09-12T00:59:23.170976+0000","last_clean":"2024-09-12T00:59:23.170976+0000","last_became_active":"2024-09-12T00:15:59.050663+0000","last_became_peered":"2024-09-12T00:15:59.050663+0000","last_unstale":"2024-09-12T00:59:23.170976+0000","last_undegraded":"2024-09-12T00:59:23.170976+0000","last_fullsized":"2024-09-12T00:59:23.170976+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:38:36.230495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"268'245","reported_seq":825,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.445328+0000","last_change":"2024-09-12T00:16:01.069772+0000","last_active":"2024-09-12T01:02:38.445328+0000","last_peered":"2024-09-12T01:02:38.445328+0000","last_clean":"2024-09-12T01:02:38.445328+0000","last_became_active":"2024-09-12T00:16:01.068392+0000","last_became_peered":"2024-09-12T00:16:01.068392+0000","last_unstale":"2024-09-12T01:02:38.445328+0000","last_undegraded":"2024-09-12T01:02:38.445328+0000","last_fullsized":"2024-09-12T01:02:38.445328+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:56.300773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10400,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":388,"num_read_kb":849,"num_write":306,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179776+0000","last_change":"2024-09-12T00:16:03.087496+0000","last_active":"2024-09-12T00:59:33.179776+0000","last_peered":"2024-09-12T00:59:33.179776+0000","last_clean":"2024-09-12T00:59:33.179776+0000","last_became_active":"2024-09-12T00:16:03.086751+0000","last_became_peered":"2024-09-12T00:16:03.086751+0000","last_unstale":"2024-09-12T00:59:33.179776+0000","last_undegraded":"2024-09-12T00:59:33.179776+0000","last_fullsized":"2024-09-12T00:59:33.179776+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:20.968600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"268'2410","reported_seq":4246,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.403542+0000","last_change":"2024-09-12T00:16:05.115334+0000","last_active":"2024-09-12T01:02:01.403542+0000","last_peered":"2024-09-12T01:02:01.403542+0000","last_clean":"2024-09-12T01:02:01.403542+0000","last_became_active":"2024-09-12T00:16:05.114563+0000","last_became_peered":"2024-09-12T00:16:05.114563+0000","last_unstale":"2024-09-12T01:02:01.403542+0000","last_undegraded":"2024-09-12T01:02:01.403542+0000","last_fullsized":"2024-09-12T01:02:01.403542+0000","mapping_epoch":36,"log_start":"268'2300","ondisk_log_start":"268'2300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":2300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:14.259829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6030,"num_read_kb":6028,"num_write":4877,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"268'783","reported_seq":2354,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.582663+0000","last_change":"2024-09-12T00:15:57.024963+0000","last_active":"2024-09-12T01:01:09.582663+0000","last_peered":"2024-09-12T01:01:09.582663+0000","last_clean":"2024-09-12T01:01:09.582663+0000","last_became_active":"2024-09-12T00:15:57.024509+0000","last_became_peered":"2024-09-12T00:15:57.024509+0000","last_unstale":"2024-09-12T01:01:09.582663+0000","last_undegraded":"2024-09-12T01:01:09.582663+0000","last_fullsized":"2024-09-12T01:01:09.582663+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:39.327515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3769,"num_read_kb":3415,"num_write":1030,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"268'342","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.985356+0000","last_change":"2024-09-12T00:15:55.055309+0000","last_active":"2024-09-12T01:02:39.985356+0000","last_peered":"2024-09-12T01:02:39.985356+0000","last_clean":"2024-09-12T01:02:39.985356+0000","last_became_active":"2024-09-12T00:15:55.052916+0000","last_became_peered":"2024-09-12T00:15:55.052916+0000","last_unstale":"2024-09-12T01:02:39.985356+0000","last_undegraded":"2024-09-12T01:02:39.985356+0000","last_fullsized":"2024-09-12T01:02:39.985356+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:37.807496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306611,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":476,"num_read_kb":37817,"num_write":1138,"num_write_kb":39957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:47.188865+0000","last_change":"2024-09-12T00:15:59.035302+0000","last_active":"2024-09-12T00:58:47.188865+0000","last_peered":"2024-09-12T00:58:47.188865+0000","last_clean":"2024-09-12T00:58:47.188865+0000","last_became_active":"2024-09-12T00:15:59.034650+0000","last_became_peered":"2024-09-12T00:15:59.034650+0000","last_unstale":"2024-09-12T00:58:47.188865+0000","last_undegraded":"2024-09-12T00:58:47.188865+0000","last_fullsized":"2024-09-12T00:58:47.188865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:26.439328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"268'318","reported_seq":922,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.593445+0000","last_change":"2024-09-12T00:16:01.059061+0000","last_active":"2024-09-12T01:02:37.593445+0000","last_peered":"2024-09-12T01:02:37.593445+0000","last_clean":"2024-09-12T01:02:37.593445+0000","last_became_active":"2024-09-12T00:16:01.057281+0000","last_became_peered":"2024-09-12T00:16:01.057281+0000","last_unstale":"2024-09-12T01:02:37.593445+0000","last_undegraded":"2024-09-12T01:02:37.593445+0000","last_fullsized":"2024-09-12T01:02:37.593445+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:55.215685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49581,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":504,"num_read_kb":1060,"num_write":406,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"268'815","reported_seq":2423,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.371700+0000","last_change":"2024-09-12T00:16:03.098169+0000","last_active":"2024-09-12T01:02:39.371700+0000","last_peered":"2024-09-12T01:02:39.371700+0000","last_clean":"2024-09-12T01:02:39.371700+0000","last_became_active":"2024-09-12T00:16:03.097554+0000","last_became_peered":"2024-09-12T00:16:03.097554+0000","last_unstale":"2024-09-12T01:02:39.371700+0000","last_undegraded":"2024-09-12T01:02:39.371700+0000","last_fullsized":"2024-09-12T01:02:39.371700+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:01.820378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"268'94","reported_seq":599,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.780044+0000","last_change":"2024-09-12T00:16:05.113044+0000","last_active":"2024-09-12T01:02:10.780044+0000","last_peered":"2024-09-12T01:02:10.780044+0000","last_clean":"2024-09-12T01:02:10.780044+0000","last_became_active":"2024-09-12T00:16:05.112524+0000","last_became_peered":"2024-09-12T00:16:05.112524+0000","last_unstale":"2024-09-12T01:02:10.780044+0000","last_undegraded":"2024-09-12T01:02:10.780044+0000","last_fullsized":"2024-09-12T01:02:10.780044+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:08.645097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":109,"num_write":225,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"268'456","reported_seq":1823,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.422425+0000","last_change":"2024-09-12T00:15:57.043306+0000","last_active":"2024-09-12T01:01:06.422425+0000","last_peered":"2024-09-12T01:01:06.422425+0000","last_clean":"2024-09-12T01:01:06.422425+0000","last_became_active":"2024-09-12T00:15:57.042663+0000","last_became_peered":"2024-09-12T00:15:57.042663+0000","last_unstale":"2024-09-12T01:01:06.422425+0000","last_undegraded":"2024-09-12T01:01:06.422425+0000","last_fullsized":"2024-09-12T01:01:06.422425+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:27.809795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2110,"num_read_kb":1961,"num_write":540,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"268'346","reported_seq":1087,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.958349+0000","last_change":"2024-09-12T00:15:55.060102+0000","last_active":"2024-09-12T01:02:39.958349+0000","last_peered":"2024-09-12T01:02:39.958349+0000","last_clean":"2024-09-12T01:02:39.958349+0000","last_became_active":"2024-09-12T00:15:55.054533+0000","last_became_peered":"2024-09-12T00:15:55.054533+0000","last_unstale":"2024-09-12T01:02:39.958349+0000","last_undegraded":"2024-09-12T01:02:39.958349+0000","last_fullsized":"2024-09-12T01:02:39.958349+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:15.618277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263223,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":794,"num_read_kb":57067,"num_write":1127,"num_write_kb":15994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.173416+0000","last_change":"2024-09-12T00:15:59.037952+0000","last_active":"2024-09-12T00:59:33.173416+0000","last_peered":"2024-09-12T00:59:33.173416+0000","last_clean":"2024-09-12T00:59:33.173416+0000","last_became_active":"2024-09-12T00:15:59.037145+0000","last_became_peered":"2024-09-12T00:15:59.037145+0000","last_unstale":"2024-09-12T00:59:33.173416+0000","last_undegraded":"2024-09-12T00:59:33.173416+0000","last_fullsized":"2024-09-12T00:59:33.173416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:33.825886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"268'485","reported_seq":1134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.687837+0000","last_change":"2024-09-12T00:16:01.069486+0000","last_active":"2024-09-12T01:02:38.687837+0000","last_peered":"2024-09-12T01:02:38.687837+0000","last_clean":"2024-09-12T01:02:38.687837+0000","last_became_active":"2024-09-12T00:16:01.068496+0000","last_became_peered":"2024-09-12T00:16:01.068496+0000","last_unstale":"2024-09-12T01:02:38.687837+0000","last_undegraded":"2024-09-12T01:02:38.687837+0000","last_fullsized":"2024-09-12T01:02:38.687837+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:18.290612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92831,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":846,"num_read_kb":2016,"num_write":692,"num_write_kb":581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.198874+0000","last_change":"2024-09-12T00:16:03.102755+0000","last_active":"2024-09-12T00:59:27.198874+0000","last_peered":"2024-09-12T00:59:27.198874+0000","last_clean":"2024-09-12T00:59:27.198874+0000","last_became_active":"2024-09-12T00:16:03.101984+0000","last_became_peered":"2024-09-12T00:16:03.101984+0000","last_unstale":"2024-09-12T00:59:27.198874+0000","last_undegraded":"2024-09-12T00:59:27.198874+0000","last_fullsized":"2024-09-12T00:59:27.198874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:46.673834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"268'131","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.211991+0000","last_change":"2024-09-12T00:16:05.105645+0000","last_active":"2024-09-12T01:01:07.211991+0000","last_peered":"2024-09-12T01:01:07.211991+0000","last_clean":"2024-09-12T01:01:07.211991+0000","last_became_active":"2024-09-12T00:16:05.104674+0000","last_became_peered":"2024-09-12T00:16:05.104674+0000","last_unstale":"2024-09-12T01:01:07.211991+0000","last_undegraded":"2024-09-12T01:01:07.211991+0000","last_fullsized":"2024-09-12T01:01:07.211991+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:09.821079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":121,"num_write":297,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"268'781","reported_seq":2286,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.868337+0000","last_change":"2024-09-12T00:15:57.017588+0000","last_active":"2024-09-12T01:02:10.868337+0000","last_peered":"2024-09-12T01:02:10.868337+0000","last_clean":"2024-09-12T01:02:10.868337+0000","last_became_active":"2024-09-12T00:15:57.016954+0000","last_became_peered":"2024-09-12T00:15:57.016954+0000","last_unstale":"2024-09-12T01:02:10.868337+0000","last_undegraded":"2024-09-12T01:02:10.868337+0000","last_fullsized":"2024-09-12T01:02:10.868337+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:04.997592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3833,"num_read_kb":3467,"num_write":1045,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"268'302","reported_seq":905,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.940351+0000","last_change":"2024-09-12T00:15:55.063836+0000","last_active":"2024-09-12T01:02:39.940351+0000","last_peered":"2024-09-12T01:02:39.940351+0000","last_clean":"2024-09-12T01:02:39.940351+0000","last_became_active":"2024-09-12T00:15:55.062854+0000","last_became_peered":"2024-09-12T00:15:55.062854+0000","last_unstale":"2024-09-12T01:02:39.940351+0000","last_undegraded":"2024-09-12T01:02:39.940351+0000","last_fullsized":"2024-09-12T01:02:39.940351+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:50.512780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262214,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":412,"num_read_kb":12698,"num_write":975,"num_write_kb":17642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:47.164632+0000","last_change":"2024-09-12T00:15:59.034591+0000","last_active":"2024-09-12T00:58:47.164632+0000","last_peered":"2024-09-12T00:58:47.164632+0000","last_clean":"2024-09-12T00:58:47.164632+0000","last_became_active":"2024-09-12T00:15:59.033844+0000","last_became_peered":"2024-09-12T00:15:59.033844+0000","last_unstale":"2024-09-12T00:58:47.164632+0000","last_undegraded":"2024-09-12T00:58:47.164632+0000","last_fullsized":"2024-09-12T00:58:47.164632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:37.678048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"268'317","reported_seq":901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.996732+0000","last_change":"2024-09-12T00:16:01.068155+0000","last_active":"2024-09-12T01:02:38.996732+0000","last_peered":"2024-09-12T01:02:38.996732+0000","last_clean":"2024-09-12T01:02:38.996732+0000","last_became_active":"2024-09-12T00:16:01.067377+0000","last_became_peered":"2024-09-12T00:16:01.067377+0000","last_unstale":"2024-09-12T01:02:38.996732+0000","last_undegraded":"2024-09-12T01:02:38.996732+0000","last_fullsized":"2024-09-12T01:02:38.996732+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:04.239296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":549,"num_read_kb":1240,"num_write":496,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168204+0000","last_change":"2024-09-12T00:16:03.079750+0000","last_active":"2024-09-12T00:59:02.168204+0000","last_peered":"2024-09-12T00:59:02.168204+0000","last_clean":"2024-09-12T00:59:02.168204+0000","last_became_active":"2024-09-12T00:16:03.079004+0000","last_became_peered":"2024-09-12T00:16:03.079004+0000","last_unstale":"2024-09-12T00:59:02.168204+0000","last_undegraded":"2024-09-12T00:59:02.168204+0000","last_fullsized":"2024-09-12T00:59:02.168204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:46.457515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"268'127","reported_seq":617,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.407863+0000","last_change":"2024-09-12T00:16:05.094605+0000","last_active":"2024-09-12T01:02:01.407863+0000","last_peered":"2024-09-12T01:02:01.407863+0000","last_clean":"2024-09-12T01:02:01.407863+0000","last_became_active":"2024-09-12T00:16:05.093815+0000","last_became_peered":"2024-09-12T00:16:05.093815+0000","last_unstale":"2024-09-12T01:02:01.407863+0000","last_undegraded":"2024-09-12T01:02:01.407863+0000","last_fullsized":"2024-09-12T01:02:01.407863+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:25.421248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":302,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"268'443","reported_seq":1987,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:59.004706+0000","last_change":"2024-09-12T00:15:57.029941+0000","last_active":"2024-09-12T01:00:59.004706+0000","last_peered":"2024-09-12T01:00:59.004706+0000","last_clean":"2024-09-12T01:00:59.004706+0000","last_became_active":"2024-09-12T00:15:57.029290+0000","last_became_peered":"2024-09-12T00:15:57.029290+0000","last_unstale":"2024-09-12T01:00:59.004706+0000","last_undegraded":"2024-09-12T01:00:59.004706+0000","last_fullsized":"2024-09-12T01:00:59.004706+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:52.959133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2290,"num_read_kb":2163,"num_write":517,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"268'350","reported_seq":1012,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.945157+0000","last_change":"2024-09-12T00:16:26.797714+0000","last_active":"2024-09-12T01:02:39.945157+0000","last_peered":"2024-09-12T01:02:39.945157+0000","last_clean":"2024-09-12T01:02:39.945157+0000","last_became_active":"2024-09-12T00:16:26.796888+0000","last_became_peered":"2024-09-12T00:16:26.796888+0000","last_unstale":"2024-09-12T01:02:39.945157+0000","last_undegraded":"2024-09-12T01:02:39.945157+0000","last_fullsized":"2024-09-12T01:02:39.945157+0000","mapping_epoch":39,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:17.037395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":37574,"num_write":1133,"num_write_kb":35076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,6],"acting":[3,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:47.188931+0000","last_change":"2024-09-12T00:15:59.030706+0000","last_active":"2024-09-12T00:58:47.188931+0000","last_peered":"2024-09-12T00:58:47.188931+0000","last_clean":"2024-09-12T00:58:47.188931+0000","last_became_active":"2024-09-12T00:15:59.029998+0000","last_became_peered":"2024-09-12T00:15:59.029998+0000","last_unstale":"2024-09-12T00:58:47.188931+0000","last_undegraded":"2024-09-12T00:58:47.188931+0000","last_fullsized":"2024-09-12T00:58:47.188931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:08.142841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"268'306","reported_seq":889,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.244753+0000","last_change":"2024-09-12T00:16:01.054348+0000","last_active":"2024-09-12T01:02:38.244753+0000","last_peered":"2024-09-12T01:02:38.244753+0000","last_clean":"2024-09-12T01:02:38.244753+0000","last_became_active":"2024-09-12T00:16:01.053660+0000","last_became_peered":"2024-09-12T00:16:01.053660+0000","last_unstale":"2024-09-12T01:02:38.244753+0000","last_undegraded":"2024-09-12T01:02:38.244753+0000","last_fullsized":"2024-09-12T01:02:38.244753+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:28.294852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54997,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":504,"num_read_kb":1130,"num_write":408,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"268'777","reported_seq":2367,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.569294+0000","last_change":"2024-09-12T00:16:03.098769+0000","last_active":"2024-09-12T01:02:38.569294+0000","last_peered":"2024-09-12T01:02:38.569294+0000","last_clean":"2024-09-12T01:02:38.569294+0000","last_became_active":"2024-09-12T00:16:03.098077+0000","last_became_peered":"2024-09-12T00:16:03.098077+0000","last_unstale":"2024-09-12T01:02:38.569294+0000","last_undegraded":"2024-09-12T01:02:38.569294+0000","last_fullsized":"2024-09-12T01:02:38.569294+0000","mapping_epoch":34,"log_start":"268'701","ondisk_log_start":"268'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":701,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:52.835421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"268'151","reported_seq":653,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:03.866324+0000","last_change":"2024-09-12T00:16:05.108146+0000","last_active":"2024-09-12T01:01:03.866324+0000","last_peered":"2024-09-12T01:01:03.866324+0000","last_clean":"2024-09-12T01:01:03.866324+0000","last_became_active":"2024-09-12T00:16:05.107291+0000","last_became_peered":"2024-09-12T00:16:05.107291+0000","last_unstale":"2024-09-12T01:01:03.866324+0000","last_undegraded":"2024-09-12T01:01:03.866324+0000","last_fullsized":"2024-09-12T01:01:03.866324+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:57.906444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":174,"num_read_kb":162,"num_write":365,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"268'796","reported_seq":2308,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.428696+0000","last_change":"2024-09-12T00:15:57.024503+0000","last_active":"2024-09-12T01:01:06.428696+0000","last_peered":"2024-09-12T01:01:06.428696+0000","last_clean":"2024-09-12T01:01:06.428696+0000","last_became_active":"2024-09-12T00:15:57.024185+0000","last_became_peered":"2024-09-12T00:15:57.024185+0000","last_unstale":"2024-09-12T01:01:06.428696+0000","last_undegraded":"2024-09-12T01:01:06.428696+0000","last_fullsized":"2024-09-12T01:01:06.428696+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:13.017889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3776,"num_read_kb":3402,"num_write":1055,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"268'346","reported_seq":992,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.885472+0000","last_change":"2024-09-12T00:15:55.027875+0000","last_active":"2024-09-12T01:02:39.885472+0000","last_peered":"2024-09-12T01:02:39.885472+0000","last_clean":"2024-09-12T01:02:39.885472+0000","last_became_active":"2024-09-12T00:15:55.027001+0000","last_became_peered":"2024-09-12T00:15:55.027001+0000","last_unstale":"2024-09-12T01:02:39.885472+0000","last_undegraded":"2024-09-12T01:02:39.885472+0000","last_fullsized":"2024-09-12T01:02:39.885472+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:37.021357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7614964,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":429,"num_read_kb":53256,"num_write":866,"num_write_kb":32142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1460,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.098953+0000","last_change":"2024-09-12T00:15:59.035799+0000","last_active":"2024-09-12T01:02:37.098953+0000","last_peered":"2024-09-12T01:02:37.098953+0000","last_clean":"2024-09-12T01:02:37.098953+0000","last_became_active":"2024-09-12T00:15:59.035380+0000","last_became_peered":"2024-09-12T00:15:59.035380+0000","last_unstale":"2024-09-12T01:02:37.098953+0000","last_undegraded":"2024-09-12T01:02:37.098953+0000","last_fullsized":"2024-09-12T01:02:37.098953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:37.318095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":957,"num_read_kb":957,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"268'80","reported_seq":596,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:00.682139+0000","last_change":"2024-09-12T00:16:01.065768+0000","last_active":"2024-09-12T01:00:00.682139+0000","last_peered":"2024-09-12T01:00:00.682139+0000","last_clean":"2024-09-12T01:00:00.682139+0000","last_became_active":"2024-09-12T00:16:01.065038+0000","last_became_peered":"2024-09-12T00:16:01.065038+0000","last_unstale":"2024-09-12T01:00:00.682139+0000","last_undegraded":"2024-09-12T01:00:00.682139+0000","last_fullsized":"2024-09-12T01:00:00.682139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:49.222908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"268'798","reported_seq":2365,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.136299+0000","last_change":"2024-09-12T00:16:03.089577+0000","last_active":"2024-09-12T01:02:37.136299+0000","last_peered":"2024-09-12T01:02:37.136299+0000","last_clean":"2024-09-12T01:02:37.136299+0000","last_became_active":"2024-09-12T00:16:03.088856+0000","last_became_peered":"2024-09-12T00:16:03.088856+0000","last_unstale":"2024-09-12T01:02:37.136299+0000","last_undegraded":"2024-09-12T01:02:37.136299+0000","last_fullsized":"2024-09-12T01:02:37.136299+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:36.628955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"268'127","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.435230+0000","last_change":"2024-09-12T00:16:05.108738+0000","last_active":"2024-09-12T01:01:06.435230+0000","last_peered":"2024-09-12T01:01:06.435230+0000","last_clean":"2024-09-12T01:01:06.435230+0000","last_became_active":"2024-09-12T00:16:05.107712+0000","last_became_peered":"2024-09-12T00:16:05.107712+0000","last_unstale":"2024-09-12T01:01:06.435230+0000","last_undegraded":"2024-09-12T01:01:06.435230+0000","last_fullsized":"2024-09-12T01:01:06.435230+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:00.734318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":150,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"268'855","reported_seq":2471,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:53.115073+0000","last_change":"2024-09-12T00:15:57.044791+0000","last_active":"2024-09-12T01:00:53.115073+0000","last_peered":"2024-09-12T01:00:53.115073+0000","last_clean":"2024-09-12T01:00:53.115073+0000","last_became_active":"2024-09-12T00:15:57.043447+0000","last_became_peered":"2024-09-12T00:15:57.043447+0000","last_unstale":"2024-09-12T01:00:53.115073+0000","last_undegraded":"2024-09-12T01:00:53.115073+0000","last_fullsized":"2024-09-12T01:00:53.115073+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:48.004809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4138,"num_read_kb":3738,"num_write":1141,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"268'317","reported_seq":957,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.971566+0000","last_change":"2024-09-12T00:15:55.040492+0000","last_active":"2024-09-12T01:02:39.971566+0000","last_peered":"2024-09-12T01:02:39.971566+0000","last_clean":"2024-09-12T01:02:39.971566+0000","last_became_active":"2024-09-12T00:15:55.039512+0000","last_became_peered":"2024-09-12T00:15:55.039512+0000","last_unstale":"2024-09-12T01:02:39.971566+0000","last_undegraded":"2024-09-12T01:02:39.971566+0000","last_fullsized":"2024-09-12T01:02:39.971566+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:08.086426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655867,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":425,"num_read_kb":56944,"num_write":985,"num_write_kb":41414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:44.205861+0000","last_change":"2024-09-12T00:15:59.046399+0000","last_active":"2024-09-12T00:58:44.205861+0000","last_peered":"2024-09-12T00:58:44.205861+0000","last_clean":"2024-09-12T00:58:44.205861+0000","last_became_active":"2024-09-12T00:15:59.046018+0000","last_became_peered":"2024-09-12T00:15:59.046018+0000","last_unstale":"2024-09-12T00:58:44.205861+0000","last_undegraded":"2024-09-12T00:58:44.205861+0000","last_fullsized":"2024-09-12T00:58:44.205861+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:02.866037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"268'333","reported_seq":942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.923414+0000","last_change":"2024-09-12T00:16:01.070932+0000","last_active":"2024-09-12T01:02:39.923414+0000","last_peered":"2024-09-12T01:02:39.923414+0000","last_clean":"2024-09-12T01:02:39.923414+0000","last_became_active":"2024-09-12T00:16:01.069078+0000","last_became_peered":"2024-09-12T00:16:01.069078+0000","last_unstale":"2024-09-12T01:02:39.923414+0000","last_undegraded":"2024-09-12T01:02:39.923414+0000","last_fullsized":"2024-09-12T01:02:39.923414+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:54.239828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46997,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":1097,"num_write":420,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.173630+0000","last_change":"2024-09-12T00:16:03.107385+0000","last_active":"2024-09-12T00:58:48.173630+0000","last_peered":"2024-09-12T00:58:48.173630+0000","last_clean":"2024-09-12T00:58:48.173630+0000","last_became_active":"2024-09-12T00:16:03.106662+0000","last_became_peered":"2024-09-12T00:16:03.106662+0000","last_unstale":"2024-09-12T00:58:48.173630+0000","last_undegraded":"2024-09-12T00:58:48.173630+0000","last_fullsized":"2024-09-12T00:58:48.173630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:36.203314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"268'135","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:05.839461+0000","last_change":"2024-09-12T00:16:05.112393+0000","last_active":"2024-09-12T01:01:05.839461+0000","last_peered":"2024-09-12T01:01:05.839461+0000","last_clean":"2024-09-12T01:01:05.839461+0000","last_became_active":"2024-09-12T00:16:05.111705+0000","last_became_peered":"2024-09-12T00:16:05.111705+0000","last_unstale":"2024-09-12T01:01:05.839461+0000","last_undegraded":"2024-09-12T01:01:05.839461+0000","last_fullsized":"2024-09-12T01:01:05.839461+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:21.647320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":316,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"268'515","reported_seq":2096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.227739+0000","last_change":"2024-09-12T00:15:57.029602+0000","last_active":"2024-09-12T01:01:07.227739+0000","last_peered":"2024-09-12T01:01:07.227739+0000","last_clean":"2024-09-12T01:01:07.227739+0000","last_became_active":"2024-09-12T00:15:57.029211+0000","last_became_peered":"2024-09-12T00:15:57.029211+0000","last_unstale":"2024-09-12T01:01:07.227739+0000","last_undegraded":"2024-09-12T01:01:07.227739+0000","last_fullsized":"2024-09-12T01:01:07.227739+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:55.890872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2638,"num_read_kb":2449,"num_write":617,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.188316+0000","last_change":"2024-09-12T00:15:34.148103+0000","last_active":"2024-09-12T00:59:48.188316+0000","last_peered":"2024-09-12T00:59:48.188316+0000","last_clean":"2024-09-12T00:59:48.188316+0000","last_became_active":"2024-09-12T00:15:34.145413+0000","last_became_peered":"2024-09-12T00:15:34.145413+0000","last_unstale":"2024-09-12T00:59:48.188316+0000","last_undegraded":"2024-09-12T00:59:48.188316+0000","last_fullsized":"2024-09-12T00:59:48.188316+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:33.032265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:33.032265+0000","last_clean_scrub_stamp":"2024-09-12T00:15:33.032265+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:37.582882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219349+0000","last_change":"2024-09-12T00:15:42.090501+0000","last_active":"2024-09-12T00:59:29.219349+0000","last_peered":"2024-09-12T00:59:29.219349+0000","last_clean":"2024-09-12T00:59:29.219349+0000","last_became_active":"2024-09-12T00:15:40.490486+0000","last_became_peered":"2024-09-12T00:15:40.490486+0000","last_unstale":"2024-09-12T00:59:29.219349+0000","last_undegraded":"2024-09-12T00:59:29.219349+0000","last_fullsized":"2024-09-12T00:59:29.219349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:41.969157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013201490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"268'332","reported_seq":1008,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.916251+0000","last_change":"2024-09-12T00:15:55.049247+0000","last_active":"2024-09-12T01:02:39.916251+0000","last_peered":"2024-09-12T01:02:39.916251+0000","last_clean":"2024-09-12T01:02:39.916251+0000","last_became_active":"2024-09-12T00:15:55.048230+0000","last_became_peered":"2024-09-12T00:15:55.048230+0000","last_unstale":"2024-09-12T01:02:39.916251+0000","last_undegraded":"2024-09-12T01:02:39.916251+0000","last_fullsized":"2024-09-12T01:02:39.916251+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:10.864422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":550,"num_read_kb":9775,"num_write":1119,"num_write_kb":32871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.189322+0000","last_change":"2024-09-12T00:15:59.041780+0000","last_active":"2024-09-12T00:59:48.189322+0000","last_peered":"2024-09-12T00:59:48.189322+0000","last_clean":"2024-09-12T00:59:48.189322+0000","last_became_active":"2024-09-12T00:15:59.041357+0000","last_became_peered":"2024-09-12T00:15:59.041357+0000","last_unstale":"2024-09-12T00:59:48.189322+0000","last_undegraded":"2024-09-12T00:59:48.189322+0000","last_fullsized":"2024-09-12T00:59:48.189322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:31.097783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"268'725","reported_seq":1441,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.680324+0000","last_change":"2024-09-12T00:16:01.052726+0000","last_active":"2024-09-12T01:02:39.680324+0000","last_peered":"2024-09-12T01:02:39.680324+0000","last_clean":"2024-09-12T01:02:39.680324+0000","last_became_active":"2024-09-12T00:16:01.052016+0000","last_became_peered":"2024-09-12T00:16:01.052016+0000","last_unstale":"2024-09-12T01:02:39.680324+0000","last_undegraded":"2024-09-12T01:02:39.680324+0000","last_fullsized":"2024-09-12T01:02:39.680324+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:44.346178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164258,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1426,"num_read_kb":3353,"num_write":1318,"num_write_kb":1186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":488,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.199298+0000","last_change":"2024-09-12T00:16:03.099445+0000","last_active":"2024-09-12T00:59:27.199298+0000","last_peered":"2024-09-12T00:59:27.199298+0000","last_clean":"2024-09-12T00:59:27.199298+0000","last_became_active":"2024-09-12T00:16:03.097343+0000","last_became_peered":"2024-09-12T00:16:03.097343+0000","last_unstale":"2024-09-12T00:59:27.199298+0000","last_undegraded":"2024-09-12T00:59:27.199298+0000","last_fullsized":"2024-09-12T00:59:27.199298+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:08.255612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"268'171","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.245431+0000","last_change":"2024-09-12T00:16:05.113881+0000","last_active":"2024-09-12T01:01:07.245431+0000","last_peered":"2024-09-12T01:01:07.245431+0000","last_clean":"2024-09-12T01:01:07.245431+0000","last_became_active":"2024-09-12T00:16:05.113366+0000","last_became_peered":"2024-09-12T00:16:05.113366+0000","last_unstale":"2024-09-12T01:01:07.245431+0000","last_undegraded":"2024-09-12T01:01:07.245431+0000","last_fullsized":"2024-09-12T01:01:07.245431+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:18.255536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1020,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":408,"num_write":348,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"268'1045","reported_seq":2792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.053877+0000","last_change":"2024-09-12T00:15:57.049813+0000","last_active":"2024-09-12T01:00:41.053877+0000","last_peered":"2024-09-12T01:00:41.053877+0000","last_clean":"2024-09-12T01:00:41.053877+0000","last_became_active":"2024-09-12T00:15:57.047672+0000","last_became_peered":"2024-09-12T00:15:57.047672+0000","last_unstale":"2024-09-12T01:00:41.053877+0000","last_undegraded":"2024-09-12T01:00:41.053877+0000","last_fullsized":"2024-09-12T01:00:41.053877+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":1000,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:39.410827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5053,"num_read_kb":4502,"num_write":1469,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:54.225501+0000","last_change":"2024-09-12T00:15:42.090908+0000","last_active":"2024-09-12T00:59:54.225501+0000","last_peered":"2024-09-12T00:59:54.225501+0000","last_clean":"2024-09-12T00:59:54.225501+0000","last_became_active":"2024-09-12T00:15:40.098303+0000","last_became_peered":"2024-09-12T00:15:40.098303+0000","last_unstale":"2024-09-12T00:59:54.225501+0000","last_undegraded":"2024-09-12T00:59:54.225501+0000","last_fullsized":"2024-09-12T00:59:54.225501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:40.232317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017858660000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"268'328","reported_seq":981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.935793+0000","last_change":"2024-09-12T00:15:55.051725+0000","last_active":"2024-09-12T01:02:39.935793+0000","last_peered":"2024-09-12T01:02:39.935793+0000","last_clean":"2024-09-12T01:02:39.935793+0000","last_became_active":"2024-09-12T00:15:55.050874+0000","last_became_peered":"2024-09-12T00:15:55.050874+0000","last_unstale":"2024-09-12T01:02:39.935793+0000","last_undegraded":"2024-09-12T01:02:39.935793+0000","last_fullsized":"2024-09-12T01:02:39.935793+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:21.733859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2684897,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":131172,"num_write":1059,"num_write_kb":57813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:19.216989+0000","last_change":"2024-09-12T00:15:59.031231+0000","last_active":"2024-09-12T00:59:19.216989+0000","last_peered":"2024-09-12T00:59:19.216989+0000","last_clean":"2024-09-12T00:59:19.216989+0000","last_became_active":"2024-09-12T00:15:59.030858+0000","last_became_peered":"2024-09-12T00:15:59.030858+0000","last_unstale":"2024-09-12T00:59:19.216989+0000","last_undegraded":"2024-09-12T00:59:19.216989+0000","last_fullsized":"2024-09-12T00:59:19.216989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:14.830144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"268'1312","reported_seq":2814,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.998219+0000","last_change":"2024-09-12T00:16:01.058741+0000","last_active":"2024-09-12T01:02:39.998219+0000","last_peered":"2024-09-12T01:02:39.998219+0000","last_clean":"2024-09-12T01:02:39.998219+0000","last_became_active":"2024-09-12T00:16:01.057956+0000","last_became_peered":"2024-09-12T00:16:01.057956+0000","last_unstale":"2024-09-12T01:02:39.998219+0000","last_undegraded":"2024-09-12T01:02:39.998219+0000","last_fullsized":"2024-09-12T01:02:39.998219+0000","mapping_epoch":32,"log_start":"268'1300","ondisk_log_start":"268'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":1300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:22.472702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158341,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2071,"num_read_kb":3936,"num_write":1172,"num_write_kb":1006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:59.226747+0000","last_change":"2024-09-12T00:16:03.105384+0000","last_active":"2024-09-12T00:59:59.226747+0000","last_peered":"2024-09-12T00:59:59.226747+0000","last_clean":"2024-09-12T00:59:59.226747+0000","last_became_active":"2024-09-12T00:16:03.104040+0000","last_became_peered":"2024-09-12T00:16:03.104040+0000","last_unstale":"2024-09-12T00:59:59.226747+0000","last_undegraded":"2024-09-12T00:59:59.226747+0000","last_fullsized":"2024-09-12T00:59:59.226747+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:42.422978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"268'221","reported_seq":747,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.969829+0000","last_change":"2024-09-12T00:16:05.100831+0000","last_active":"2024-09-12T01:00:41.969829+0000","last_peered":"2024-09-12T01:00:41.969829+0000","last_clean":"2024-09-12T01:00:41.969829+0000","last_became_active":"2024-09-12T00:16:05.099987+0000","last_became_peered":"2024-09-12T00:16:05.099987+0000","last_unstale":"2024-09-12T01:00:41.969829+0000","last_undegraded":"2024-09-12T01:00:41.969829+0000","last_fullsized":"2024-09-12T01:00:41.969829+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:49.711006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":366,"num_read_kb":355,"num_write":494,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"268'395","reported_seq":1888,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506639+0000","last_change":"2024-09-12T00:15:57.022983+0000","last_active":"2024-09-12T01:01:09.506639+0000","last_peered":"2024-09-12T01:01:09.506639+0000","last_clean":"2024-09-12T01:01:09.506639+0000","last_became_active":"2024-09-12T00:15:57.022193+0000","last_became_peered":"2024-09-12T00:15:57.022193+0000","last_unstale":"2024-09-12T01:01:09.506639+0000","last_undegraded":"2024-09-12T01:01:09.506639+0000","last_fullsized":"2024-09-12T01:01:09.506639+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:12.564764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2164,"num_read_kb":2061,"num_write":440,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174427+0000","last_change":"2024-09-12T00:15:43.065460+0000","last_active":"2024-09-12T00:59:27.174427+0000","last_peered":"2024-09-12T00:59:27.174427+0000","last_clean":"2024-09-12T00:59:27.174427+0000","last_became_active":"2024-09-12T00:15:40.095888+0000","last_became_peered":"2024-09-12T00:15:40.095888+0000","last_unstale":"2024-09-12T00:59:27.174427+0000","last_undegraded":"2024-09-12T00:59:27.174427+0000","last_fullsized":"2024-09-12T00:59:27.174427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:49.939912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000883303,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"268'366","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.944482+0000","last_change":"2024-09-12T00:15:55.055938+0000","last_active":"2024-09-12T01:02:39.944482+0000","last_peered":"2024-09-12T01:02:39.944482+0000","last_clean":"2024-09-12T01:02:39.944482+0000","last_became_active":"2024-09-12T00:15:55.043174+0000","last_became_peered":"2024-09-12T00:15:55.043174+0000","last_unstale":"2024-09-12T01:02:39.944482+0000","last_undegraded":"2024-09-12T01:02:39.944482+0000","last_fullsized":"2024-09-12T01:02:39.944482+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:27.487345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":498,"num_read_kb":17440,"num_write":1129,"num_write_kb":28417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:22.173406+0000","last_change":"2024-09-12T00:15:59.035726+0000","last_active":"2024-09-12T00:59:22.173406+0000","last_peered":"2024-09-12T00:59:22.173406+0000","last_clean":"2024-09-12T00:59:22.173406+0000","last_became_active":"2024-09-12T00:15:59.033660+0000","last_became_peered":"2024-09-12T00:15:59.033660+0000","last_unstale":"2024-09-12T00:59:22.173406+0000","last_undegraded":"2024-09-12T00:59:22.173406+0000","last_fullsized":"2024-09-12T00:59:22.173406+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:37.650316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"268'251","reported_seq":1356,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.831740+0000","last_change":"2024-09-12T00:16:01.073248+0000","last_active":"2024-09-12T01:02:10.831740+0000","last_peered":"2024-09-12T01:02:10.831740+0000","last_clean":"2024-09-12T01:02:10.831740+0000","last_became_active":"2024-09-12T00:16:01.072168+0000","last_became_peered":"2024-09-12T00:16:01.072168+0000","last_unstale":"2024-09-12T01:02:10.831740+0000","last_undegraded":"2024-09-12T01:02:10.831740+0000","last_fullsized":"2024-09-12T01:02:10.831740+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:05.937075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.183287+0000","last_change":"2024-09-12T00:16:03.087413+0000","last_active":"2024-09-12T00:59:48.183287+0000","last_peered":"2024-09-12T00:59:48.183287+0000","last_clean":"2024-09-12T00:59:48.183287+0000","last_became_active":"2024-09-12T00:16:03.086646+0000","last_became_peered":"2024-09-12T00:16:03.086646+0000","last_unstale":"2024-09-12T00:59:48.183287+0000","last_undegraded":"2024-09-12T00:59:48.183287+0000","last_fullsized":"2024-09-12T00:59:48.183287+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:29.789535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"268'260","reported_seq":880,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.425705+0000","last_change":"2024-09-12T00:16:05.095458+0000","last_active":"2024-09-12T01:01:07.425705+0000","last_peered":"2024-09-12T01:01:07.425705+0000","last_clean":"2024-09-12T01:01:07.425705+0000","last_became_active":"2024-09-12T00:16:05.094684+0000","last_became_peered":"2024-09-12T00:16:05.094684+0000","last_unstale":"2024-09-12T01:01:07.425705+0000","last_undegraded":"2024-09-12T01:01:07.425705+0000","last_fullsized":"2024-09-12T01:01:07.425705+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:59.471541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":550,"num_read_kb":556,"num_write":574,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"268'872","reported_seq":2469,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:45.899344+0000","last_change":"2024-09-12T00:15:57.050201+0000","last_active":"2024-09-12T01:00:45.899344+0000","last_peered":"2024-09-12T01:00:45.899344+0000","last_clean":"2024-09-12T01:00:45.899344+0000","last_became_active":"2024-09-12T00:15:57.049533+0000","last_became_peered":"2024-09-12T00:15:57.049533+0000","last_unstale":"2024-09-12T01:00:45.899344+0000","last_undegraded":"2024-09-12T01:00:45.899344+0000","last_fullsized":"2024-09-12T01:00:45.899344+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":800,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:22.616019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4105,"num_read_kb":3691,"num_write":1162,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":535,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219306+0000","last_change":"2024-09-12T00:15:42.091191+0000","last_active":"2024-09-12T00:59:29.219306+0000","last_peered":"2024-09-12T00:59:29.219306+0000","last_clean":"2024-09-12T00:59:29.219306+0000","last_became_active":"2024-09-12T00:15:40.144614+0000","last_became_peered":"2024-09-12T00:15:40.144614+0000","last_unstale":"2024-09-12T00:59:29.219306+0000","last_undegraded":"2024-09-12T00:59:29.219306+0000","last_fullsized":"2024-09-12T00:59:29.219306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:01.463335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019634679999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"268'351","reported_seq":1050,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.991161+0000","last_change":"2024-09-12T00:15:55.060894+0000","last_active":"2024-09-12T01:02:39.991161+0000","last_peered":"2024-09-12T01:02:39.991161+0000","last_clean":"2024-09-12T01:02:39.991161+0000","last_became_active":"2024-09-12T00:15:55.060303+0000","last_became_peered":"2024-09-12T00:15:55.060303+0000","last_unstale":"2024-09-12T01:02:39.991161+0000","last_undegraded":"2024-09-12T01:02:39.991161+0000","last_fullsized":"2024-09-12T01:02:39.991161+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:25.050199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262201,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":640,"num_read_kb":10990,"num_write":1328,"num_write_kb":39626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.181987+0000","last_change":"2024-09-12T00:15:59.043416+0000","last_active":"2024-09-12T00:59:57.181987+0000","last_peered":"2024-09-12T00:59:57.181987+0000","last_clean":"2024-09-12T00:59:57.181987+0000","last_became_active":"2024-09-12T00:15:59.042545+0000","last_became_peered":"2024-09-12T00:15:59.042545+0000","last_unstale":"2024-09-12T00:59:57.181987+0000","last_undegraded":"2024-09-12T00:59:57.181987+0000","last_fullsized":"2024-09-12T00:59:57.181987+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:22.895073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"268'140","reported_seq":678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:09.645572+0000","last_change":"2024-09-12T00:16:01.048555+0000","last_active":"2024-09-12T01:02:09.645572+0000","last_peered":"2024-09-12T01:02:09.645572+0000","last_clean":"2024-09-12T01:02:09.645572+0000","last_became_active":"2024-09-12T00:16:01.047278+0000","last_became_peered":"2024-09-12T00:16:01.047278+0000","last_unstale":"2024-09-12T01:02:09.645572+0000","last_undegraded":"2024-09-12T01:02:09.645572+0000","last_fullsized":"2024-09-12T01:02:09.645572+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:52.572279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":143,"num_write":118,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:24.218190+0000","last_change":"2024-09-12T00:16:03.097752+0000","last_active":"2024-09-12T00:59:24.218190+0000","last_peered":"2024-09-12T00:59:24.218190+0000","last_clean":"2024-09-12T00:59:24.218190+0000","last_became_active":"2024-09-12T00:16:03.097029+0000","last_became_peered":"2024-09-12T00:16:03.097029+0000","last_unstale":"2024-09-12T00:59:24.218190+0000","last_undegraded":"2024-09-12T00:59:24.218190+0000","last_fullsized":"2024-09-12T00:59:24.218190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:58.710309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"268'157","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.216786+0000","last_change":"2024-09-12T00:16:05.112178+0000","last_active":"2024-09-12T01:01:07.216786+0000","last_peered":"2024-09-12T01:01:07.216786+0000","last_clean":"2024-09-12T01:01:07.216786+0000","last_became_active":"2024-09-12T00:16:05.111534+0000","last_became_peered":"2024-09-12T00:16:05.111534+0000","last_unstale":"2024-09-12T01:01:07.216786+0000","last_undegraded":"2024-09-12T01:01:07.216786+0000","last_fullsized":"2024-09-12T01:01:07.216786+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:54.359907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":344,"num_read_kb":315,"num_write":411,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"268'448","reported_seq":1932,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.871086+0000","last_change":"2024-09-12T00:15:57.032372+0000","last_active":"2024-09-12T01:02:10.871086+0000","last_peered":"2024-09-12T01:02:10.871086+0000","last_clean":"2024-09-12T01:02:10.871086+0000","last_became_active":"2024-09-12T00:15:57.023909+0000","last_became_peered":"2024-09-12T00:15:57.023909+0000","last_unstale":"2024-09-12T01:02:10.871086+0000","last_undegraded":"2024-09-12T01:02:10.871086+0000","last_fullsized":"2024-09-12T01:02:10.871086+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:51.721224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2256,"num_read_kb":2116,"num_write":511,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"268'339","reported_seq":982,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.819569+0000","last_change":"2024-09-12T00:15:55.057220+0000","last_active":"2024-09-12T01:02:39.819569+0000","last_peered":"2024-09-12T01:02:39.819569+0000","last_clean":"2024-09-12T01:02:39.819569+0000","last_became_active":"2024-09-12T00:15:55.056576+0000","last_became_peered":"2024-09-12T00:15:55.056576+0000","last_unstale":"2024-09-12T01:02:39.819569+0000","last_undegraded":"2024-09-12T01:02:39.819569+0000","last_fullsized":"2024-09-12T01:02:39.819569+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:08.555504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262186,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":507,"num_write":1203,"num_write_kb":27643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.199091+0000","last_change":"2024-09-12T00:15:42.088087+0000","last_active":"2024-09-12T00:59:27.199091+0000","last_peered":"2024-09-12T00:59:27.199091+0000","last_clean":"2024-09-12T00:59:27.199091+0000","last_became_active":"2024-09-12T00:15:40.141037+0000","last_became_peered":"2024-09-12T00:15:40.141037+0000","last_unstale":"2024-09-12T00:59:27.199091+0000","last_undegraded":"2024-09-12T00:59:27.199091+0000","last_fullsized":"2024-09-12T00:59:27.199091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:30.931343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00088972300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.183221+0000","last_change":"2024-09-12T00:15:59.045253+0000","last_active":"2024-09-12T00:59:48.183221+0000","last_peered":"2024-09-12T00:59:48.183221+0000","last_clean":"2024-09-12T00:59:48.183221+0000","last_became_active":"2024-09-12T00:15:59.043935+0000","last_became_peered":"2024-09-12T00:15:59.043935+0000","last_unstale":"2024-09-12T00:59:48.183221+0000","last_undegraded":"2024-09-12T00:59:48.183221+0000","last_fullsized":"2024-09-12T00:59:48.183221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:12.203334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"268'560","reported_seq":1234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.534514+0000","last_change":"2024-09-12T00:16:01.053029+0000","last_active":"2024-09-12T01:02:39.534514+0000","last_peered":"2024-09-12T01:02:39.534514+0000","last_clean":"2024-09-12T01:02:39.534514+0000","last_became_active":"2024-09-12T00:16:01.051753+0000","last_became_peered":"2024-09-12T00:16:01.051753+0000","last_unstale":"2024-09-12T01:02:39.534514+0000","last_undegraded":"2024-09-12T01:02:39.534514+0000","last_fullsized":"2024-09-12T01:02:39.534514+0000","mapping_epoch":32,"log_start":"268'500","ondisk_log_start":"268'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":500,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:25.228834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93866,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1568,"num_read_kb":2666,"num_write":2048,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.188058+0000","last_change":"2024-09-12T00:16:03.100214+0000","last_active":"2024-09-12T00:59:48.188058+0000","last_peered":"2024-09-12T00:59:48.188058+0000","last_clean":"2024-09-12T00:59:48.188058+0000","last_became_active":"2024-09-12T00:16:03.099491+0000","last_became_peered":"2024-09-12T00:16:03.099491+0000","last_unstale":"2024-09-12T00:59:48.188058+0000","last_undegraded":"2024-09-12T00:59:48.188058+0000","last_fullsized":"2024-09-12T00:59:48.188058+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:29.470103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"268'110","reported_seq":605,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:30.754431+0000","last_change":"2024-09-12T00:16:05.100929+0000","last_active":"2024-09-12T01:00:30.754431+0000","last_peered":"2024-09-12T01:00:30.754431+0000","last_clean":"2024-09-12T01:00:30.754431+0000","last_became_active":"2024-09-12T00:16:05.099975+0000","last_became_peered":"2024-09-12T00:16:05.099975+0000","last_unstale":"2024-09-12T01:00:30.754431+0000","last_undegraded":"2024-09-12T01:00:30.754431+0000","last_fullsized":"2024-09-12T01:00:30.754431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:02.033531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":90,"num_write":249,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"268'512","reported_seq":2238,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.869874+0000","last_change":"2024-09-12T00:15:57.020092+0000","last_active":"2024-09-12T01:02:10.869874+0000","last_peered":"2024-09-12T01:02:10.869874+0000","last_clean":"2024-09-12T01:02:10.869874+0000","last_became_active":"2024-09-12T00:15:57.019345+0000","last_became_peered":"2024-09-12T00:15:57.019345+0000","last_unstale":"2024-09-12T01:02:10.869874+0000","last_undegraded":"2024-09-12T01:02:10.869874+0000","last_fullsized":"2024-09-12T01:02:10.869874+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:37.937658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2840,"num_read_kb":2674,"num_write":601,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"268'351","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.929031+0000","last_change":"2024-09-12T00:15:55.068406+0000","last_active":"2024-09-12T01:02:39.929031+0000","last_peered":"2024-09-12T01:02:39.929031+0000","last_clean":"2024-09-12T01:02:39.929031+0000","last_became_active":"2024-09-12T00:15:55.064444+0000","last_became_peered":"2024-09-12T00:15:55.064444+0000","last_unstale":"2024-09-12T01:02:39.929031+0000","last_undegraded":"2024-09-12T01:02:39.929031+0000","last_fullsized":"2024-09-12T01:02:39.929031+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:55.022447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6340294,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":472,"num_read_kb":45788,"num_write":1017,"num_write_kb":51853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:39.221977+0000","last_change":"2024-09-12T00:15:42.091937+0000","last_active":"2024-09-12T00:59:39.221977+0000","last_peered":"2024-09-12T00:59:39.221977+0000","last_clean":"2024-09-12T00:59:39.221977+0000","last_became_active":"2024-09-12T00:15:40.093718+0000","last_became_peered":"2024-09-12T00:15:40.093718+0000","last_unstale":"2024-09-12T00:59:39.221977+0000","last_undegraded":"2024-09-12T00:59:39.221977+0000","last_fullsized":"2024-09-12T00:59:39.221977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:26.233329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001992522,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.189215+0000","last_change":"2024-09-12T00:15:59.042002+0000","last_active":"2024-09-12T00:59:48.189215+0000","last_peered":"2024-09-12T00:59:48.189215+0000","last_clean":"2024-09-12T00:59:48.189215+0000","last_became_active":"2024-09-12T00:15:59.041390+0000","last_became_peered":"2024-09-12T00:15:59.041390+0000","last_unstale":"2024-09-12T00:59:48.189215+0000","last_undegraded":"2024-09-12T00:59:48.189215+0000","last_fullsized":"2024-09-12T00:59:48.189215+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:05:47.896665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"268'155","reported_seq":721,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.176909+0000","last_change":"2024-09-12T00:16:01.052772+0000","last_active":"2024-09-12T00:59:48.176909+0000","last_peered":"2024-09-12T00:59:48.176909+0000","last_clean":"2024-09-12T00:59:48.176909+0000","last_became_active":"2024-09-12T00:16:01.050630+0000","last_became_peered":"2024-09-12T00:16:01.050630+0000","last_unstale":"2024-09-12T00:59:48.176909+0000","last_undegraded":"2024-09-12T00:59:48.176909+0000","last_fullsized":"2024-09-12T00:59:48.176909+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:59.467265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":205,"num_read_kb":196,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"268'798","reported_seq":2728,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.130464+0000","last_change":"2024-09-12T00:16:03.104886+0000","last_active":"2024-09-12T01:02:37.130464+0000","last_peered":"2024-09-12T01:02:37.130464+0000","last_clean":"2024-09-12T01:02:37.130464+0000","last_became_active":"2024-09-12T00:16:03.104125+0000","last_became_peered":"2024-09-12T00:16:03.104125+0000","last_unstale":"2024-09-12T01:02:37.130464+0000","last_undegraded":"2024-09-12T01:02:37.130464+0000","last_fullsized":"2024-09-12T01:02:37.130464+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:43.285245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"268'113","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:17.202074+0000","last_change":"2024-09-12T00:16:05.115377+0000","last_active":"2024-09-12T01:01:17.202074+0000","last_peered":"2024-09-12T01:01:17.202074+0000","last_clean":"2024-09-12T01:01:17.202074+0000","last_became_active":"2024-09-12T00:16:05.114695+0000","last_became_peered":"2024-09-12T00:16:05.114695+0000","last_unstale":"2024-09-12T01:01:17.202074+0000","last_undegraded":"2024-09-12T01:01:17.202074+0000","last_fullsized":"2024-09-12T01:01:17.202074+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:16.956956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":134,"num_write":263,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"268'786","reported_seq":2351,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.228575+0000","last_change":"2024-09-12T00:15:57.028597+0000","last_active":"2024-09-12T01:01:07.228575+0000","last_peered":"2024-09-12T01:01:07.228575+0000","last_clean":"2024-09-12T01:01:07.228575+0000","last_became_active":"2024-09-12T00:15:57.027778+0000","last_became_peered":"2024-09-12T00:15:57.027778+0000","last_unstale":"2024-09-12T01:01:07.228575+0000","last_undegraded":"2024-09-12T01:01:07.228575+0000","last_fullsized":"2024-09-12T01:01:07.228575+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:34.509309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3889,"num_read_kb":3532,"num_write":1033,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"268'413","reported_seq":1106,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.967764+0000","last_change":"2024-09-12T00:15:55.049561+0000","last_active":"2024-09-12T01:02:39.967764+0000","last_peered":"2024-09-12T01:02:39.967764+0000","last_clean":"2024-09-12T01:02:39.967764+0000","last_became_active":"2024-09-12T00:15:55.048610+0000","last_became_peered":"2024-09-12T00:15:55.048610+0000","last_unstale":"2024-09-12T01:02:39.967764+0000","last_undegraded":"2024-09-12T01:02:39.967764+0000","last_fullsized":"2024-09-12T01:02:39.967764+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:41.138699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433395,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":696,"num_read_kb":32495,"num_write":1308,"num_write_kb":43441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.171642+0000","last_change":"2024-09-12T00:15:42.117262+0000","last_active":"2024-09-12T00:59:03.171642+0000","last_peered":"2024-09-12T00:59:03.171642+0000","last_clean":"2024-09-12T00:59:03.171642+0000","last_became_active":"2024-09-12T00:15:40.660718+0000","last_became_peered":"2024-09-12T00:15:40.660718+0000","last_unstale":"2024-09-12T00:59:03.171642+0000","last_undegraded":"2024-09-12T00:59:03.171642+0000","last_fullsized":"2024-09-12T00:59:03.171642+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:04.909588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080064100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"38'5","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.084832+0000","last_change":"2024-09-12T00:15:59.023300+0000","last_active":"2024-09-12T01:02:37.084832+0000","last_peered":"2024-09-12T01:02:37.084832+0000","last_clean":"2024-09-12T01:02:37.084832+0000","last_became_active":"2024-09-12T00:15:59.022598+0000","last_became_peered":"2024-09-12T00:15:59.022598+0000","last_unstale":"2024-09-12T01:02:37.084832+0000","last_undegraded":"2024-09-12T01:02:37.084832+0000","last_fullsized":"2024-09-12T01:02:37.084832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:14.157447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"268'111","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:49.224395+0000","last_change":"2024-09-12T00:16:01.063640+0000","last_active":"2024-09-12T00:59:49.224395+0000","last_peered":"2024-09-12T00:59:49.224395+0000","last_clean":"2024-09-12T00:59:49.224395+0000","last_became_active":"2024-09-12T00:16:01.061378+0000","last_became_peered":"2024-09-12T00:16:01.061378+0000","last_unstale":"2024-09-12T00:59:49.224395+0000","last_undegraded":"2024-09-12T00:59:49.224395+0000","last_fullsized":"2024-09-12T00:59:49.224395+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:32.478977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":124,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"268'815","reported_seq":4445,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.371941+0000","last_change":"2024-09-12T00:16:03.098212+0000","last_active":"2024-09-12T01:02:39.371941+0000","last_peered":"2024-09-12T01:02:39.371941+0000","last_clean":"2024-09-12T01:02:39.371941+0000","last_became_active":"2024-09-12T00:16:03.097533+0000","last_became_peered":"2024-09-12T00:16:03.097533+0000","last_unstale":"2024-09-12T01:02:39.371941+0000","last_undegraded":"2024-09-12T01:02:39.371941+0000","last_fullsized":"2024-09-12T01:02:39.371941+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:57.487410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"268'165","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:40.003597+0000","last_change":"2024-09-12T00:16:05.110783+0000","last_active":"2024-09-12T01:00:40.003597+0000","last_peered":"2024-09-12T01:00:40.003597+0000","last_clean":"2024-09-12T01:00:40.003597+0000","last_became_active":"2024-09-12T00:16:05.110012+0000","last_became_peered":"2024-09-12T00:16:05.110012+0000","last_unstale":"2024-09-12T01:00:40.003597+0000","last_undegraded":"2024-09-12T01:00:40.003597+0000","last_fullsized":"2024-09-12T01:00:40.003597+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:27.489900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":392,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"268'378","reported_seq":1830,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.582868+0000","last_change":"2024-09-12T00:15:57.024825+0000","last_active":"2024-09-12T01:01:09.582868+0000","last_peered":"2024-09-12T01:01:09.582868+0000","last_clean":"2024-09-12T01:01:09.582868+0000","last_became_active":"2024-09-12T00:15:57.024399+0000","last_became_peered":"2024-09-12T00:15:57.024399+0000","last_unstale":"2024-09-12T01:01:09.582868+0000","last_undegraded":"2024-09-12T01:01:09.582868+0000","last_fullsized":"2024-09-12T01:01:09.582868+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:54.519754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2040,"num_read_kb":1940,"num_write":430,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"268'339","reported_seq":982,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.966208+0000","last_change":"2024-09-12T00:15:55.065586+0000","last_active":"2024-09-12T01:02:39.966208+0000","last_peered":"2024-09-12T01:02:39.966208+0000","last_clean":"2024-09-12T01:02:39.966208+0000","last_became_active":"2024-09-12T00:15:55.064782+0000","last_became_peered":"2024-09-12T00:15:55.064782+0000","last_unstale":"2024-09-12T01:02:39.966208+0000","last_undegraded":"2024-09-12T01:02:39.966208+0000","last_fullsized":"2024-09-12T01:02:39.966208+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:16.186392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2054932,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":492,"num_read_kb":4021,"num_write":1062,"num_write_kb":34802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:04.213089+0000","last_change":"2024-09-12T00:15:42.091675+0000","last_active":"2024-09-12T00:59:04.213089+0000","last_peered":"2024-09-12T00:59:04.213089+0000","last_clean":"2024-09-12T00:59:04.213089+0000","last_became_active":"2024-09-12T00:15:40.663617+0000","last_became_peered":"2024-09-12T00:15:40.663617+0000","last_unstale":"2024-09-12T00:59:04.213089+0000","last_undegraded":"2024-09-12T00:59:04.213089+0000","last_fullsized":"2024-09-12T00:59:04.213089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:39.065077+0000","last_clean_scrub_stamp":"2024-09-12T00:15:39.065077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:31.309528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002428801,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.189481+0000","last_change":"2024-09-12T00:15:59.040528+0000","last_active":"2024-09-12T01:00:13.189481+0000","last_peered":"2024-09-12T01:00:13.189481+0000","last_clean":"2024-09-12T01:00:13.189481+0000","last_became_active":"2024-09-12T00:15:59.039777+0000","last_became_peered":"2024-09-12T00:15:59.039777+0000","last_unstale":"2024-09-12T01:00:13.189481+0000","last_undegraded":"2024-09-12T01:00:13.189481+0000","last_fullsized":"2024-09-12T01:00:13.189481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:55.960948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"268'751","reported_seq":1475,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.764109+0000","last_change":"2024-09-12T00:16:01.052709+0000","last_active":"2024-09-12T01:02:39.764109+0000","last_peered":"2024-09-12T01:02:39.764109+0000","last_clean":"2024-09-12T01:02:39.764109+0000","last_became_active":"2024-09-12T00:16:01.051967+0000","last_became_peered":"2024-09-12T00:16:01.051967+0000","last_unstale":"2024-09-12T01:02:39.764109+0000","last_undegraded":"2024-09-12T01:02:39.764109+0000","last_fullsized":"2024-09-12T01:02:39.764109+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:10.600964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138756,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1351,"num_read_kb":3224,"num_write":1110,"num_write_kb":922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.183148+0000","last_change":"2024-09-12T00:16:03.092521+0000","last_active":"2024-09-12T00:59:48.183148+0000","last_peered":"2024-09-12T00:59:48.183148+0000","last_clean":"2024-09-12T00:59:48.183148+0000","last_became_active":"2024-09-12T00:16:03.091920+0000","last_became_peered":"2024-09-12T00:16:03.091920+0000","last_unstale":"2024-09-12T00:59:48.183148+0000","last_undegraded":"2024-09-12T00:59:48.183148+0000","last_fullsized":"2024-09-12T00:59:48.183148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:35.406048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"268'139","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.474966+0000","last_change":"2024-09-12T00:16:05.113388+0000","last_active":"2024-09-12T01:01:06.474966+0000","last_peered":"2024-09-12T01:01:06.474966+0000","last_clean":"2024-09-12T01:01:06.474966+0000","last_became_active":"2024-09-12T00:16:05.112774+0000","last_became_peered":"2024-09-12T00:16:05.112774+0000","last_unstale":"2024-09-12T01:01:06.474966+0000","last_undegraded":"2024-09-12T01:01:06.474966+0000","last_fullsized":"2024-09-12T01:01:06.474966+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:27.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":230,"num_write":341,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"268'111","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.376870+0000","last_change":"2024-09-12T00:16:05.098437+0000","last_active":"2024-09-12T01:01:07.376870+0000","last_peered":"2024-09-12T01:01:07.376870+0000","last_clean":"2024-09-12T01:01:07.376870+0000","last_became_active":"2024-09-12T00:16:05.097548+0000","last_became_peered":"2024-09-12T00:16:05.097548+0000","last_unstale":"2024-09-12T01:01:07.376870+0000","last_undegraded":"2024-09-12T01:01:07.376870+0000","last_fullsized":"2024-09-12T01:01:07.376870+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:14.723156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":186,"num_read_kb":184,"num_write":255,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"268'852","reported_seq":2471,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.159422+0000","last_change":"2024-09-12T00:15:57.024504+0000","last_active":"2024-09-12T01:01:02.159422+0000","last_peered":"2024-09-12T01:01:02.159422+0000","last_clean":"2024-09-12T01:01:02.159422+0000","last_became_active":"2024-09-12T00:15:57.024237+0000","last_became_peered":"2024-09-12T00:15:57.024237+0000","last_unstale":"2024-09-12T01:01:02.159422+0000","last_undegraded":"2024-09-12T01:01:02.159422+0000","last_fullsized":"2024-09-12T01:01:02.159422+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":800,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:13.214327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4086,"num_read_kb":3684,"num_write":1101,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"268'295","reported_seq":936,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.930660+0000","last_change":"2024-09-12T00:16:26.420540+0000","last_active":"2024-09-12T01:02:39.930660+0000","last_peered":"2024-09-12T01:02:39.930660+0000","last_clean":"2024-09-12T01:02:39.930660+0000","last_became_active":"2024-09-12T00:16:26.420272+0000","last_became_peered":"2024-09-12T00:16:26.420272+0000","last_unstale":"2024-09-12T01:02:39.930660+0000","last_undegraded":"2024-09-12T01:02:39.930660+0000","last_fullsized":"2024-09-12T01:02:39.930660+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:08.598775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213277,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":414,"num_read_kb":13074,"num_write":956,"num_write_kb":25707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,0],"acting":[3,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"38'3","reported_seq":977,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.120811+0000","last_change":"2024-09-12T00:15:59.040011+0000","last_active":"2024-09-12T01:02:37.120811+0000","last_peered":"2024-09-12T01:02:37.120811+0000","last_clean":"2024-09-12T01:02:37.120811+0000","last_became_active":"2024-09-12T00:15:59.039169+0000","last_became_peered":"2024-09-12T00:15:59.039169+0000","last_unstale":"2024-09-12T01:02:37.120811+0000","last_undegraded":"2024-09-12T01:02:37.120811+0000","last_fullsized":"2024-09-12T01:02:37.120811+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:42.316880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"268'285","reported_seq":863,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.518533+0000","last_change":"2024-09-12T00:16:01.067282+0000","last_active":"2024-09-12T01:02:37.518533+0000","last_peered":"2024-09-12T01:02:37.518533+0000","last_clean":"2024-09-12T01:02:37.518533+0000","last_became_active":"2024-09-12T00:16:01.066524+0000","last_became_peered":"2024-09-12T00:16:01.066524+0000","last_unstale":"2024-09-12T01:02:37.518533+0000","last_undegraded":"2024-09-12T01:02:37.518533+0000","last_fullsized":"2024-09-12T01:02:37.518533+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:46.086778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43678,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1068,"num_write":390,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:07.155814+0000","last_change":"2024-09-12T00:16:03.070194+0000","last_active":"2024-09-12T00:58:07.155814+0000","last_peered":"2024-09-12T00:58:07.155814+0000","last_clean":"2024-09-12T00:58:07.155814+0000","last_became_active":"2024-09-12T00:16:03.069399+0000","last_became_peered":"2024-09-12T00:16:03.069399+0000","last_unstale":"2024-09-12T00:58:07.155814+0000","last_undegraded":"2024-09-12T00:58:07.155814+0000","last_fullsized":"2024-09-12T00:58:07.155814+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:53.022367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"268'132","reported_seq":623,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.173811+0000","last_change":"2024-09-12T00:16:05.103043+0000","last_active":"2024-09-12T01:00:52.173811+0000","last_peered":"2024-09-12T01:00:52.173811+0000","last_clean":"2024-09-12T01:00:52.173811+0000","last_became_active":"2024-09-12T00:16:05.102118+0000","last_became_peered":"2024-09-12T00:16:05.102118+0000","last_unstale":"2024-09-12T01:00:52.173811+0000","last_undegraded":"2024-09-12T01:00:52.173811+0000","last_fullsized":"2024-09-12T01:00:52.173811+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:10.930503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":111,"num_write":330,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"268'496","reported_seq":2220,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.446580+0000","last_change":"2024-09-12T00:15:57.032023+0000","last_active":"2024-09-12T01:01:06.446580+0000","last_peered":"2024-09-12T01:01:06.446580+0000","last_clean":"2024-09-12T01:01:06.446580+0000","last_became_active":"2024-09-12T00:15:57.031322+0000","last_became_peered":"2024-09-12T00:15:57.031322+0000","last_unstale":"2024-09-12T01:01:06.446580+0000","last_undegraded":"2024-09-12T01:01:06.446580+0000","last_fullsized":"2024-09-12T01:01:06.446580+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:25.211444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2639,"num_write":567,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"268'457","reported_seq":1165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.815201+0000","last_change":"2024-09-12T00:15:55.066489+0000","last_active":"2024-09-12T01:02:39.815201+0000","last_peered":"2024-09-12T01:02:39.815201+0000","last_clean":"2024-09-12T01:02:39.815201+0000","last_became_active":"2024-09-12T00:15:55.065964+0000","last_became_peered":"2024-09-12T00:15:55.065964+0000","last_unstale":"2024-09-12T01:02:39.815201+0000","last_undegraded":"2024-09-12T01:02:39.815201+0000","last_fullsized":"2024-09-12T01:02:39.815201+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:04.361682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5768209,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":905,"num_read_kb":8759,"num_write":1307,"num_write_kb":27844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:23.191792+0000","last_change":"2024-09-12T00:15:59.044538+0000","last_active":"2024-09-12T01:00:23.191792+0000","last_peered":"2024-09-12T01:00:23.191792+0000","last_clean":"2024-09-12T01:00:23.191792+0000","last_became_active":"2024-09-12T00:15:59.043146+0000","last_became_peered":"2024-09-12T00:15:59.043146+0000","last_unstale":"2024-09-12T01:00:23.191792+0000","last_undegraded":"2024-09-12T01:00:23.191792+0000","last_fullsized":"2024-09-12T01:00:23.191792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:38.791557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"268'49","reported_seq":558,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:23.191663+0000","last_change":"2024-09-12T00:16:01.055742+0000","last_active":"2024-09-12T01:00:23.191663+0000","last_peered":"2024-09-12T01:00:23.191663+0000","last_clean":"2024-09-12T01:00:23.191663+0000","last_became_active":"2024-09-12T00:16:01.055002+0000","last_became_peered":"2024-09-12T00:16:01.055002+0000","last_unstale":"2024-09-12T01:00:23.191663+0000","last_undegraded":"2024-09-12T01:00:23.191663+0000","last_fullsized":"2024-09-12T01:00:23.191663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:31.414501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:23.198789+0000","last_change":"2024-09-12T00:16:03.108240+0000","last_active":"2024-09-12T01:00:23.198789+0000","last_peered":"2024-09-12T01:00:23.198789+0000","last_clean":"2024-09-12T01:00:23.198789+0000","last_became_active":"2024-09-12T00:16:03.107695+0000","last_became_peered":"2024-09-12T00:16:03.107695+0000","last_unstale":"2024-09-12T01:00:23.198789+0000","last_undegraded":"2024-09-12T01:00:23.198789+0000","last_fullsized":"2024-09-12T01:00:23.198789+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:20.303982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"268'245","reported_seq":797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.454102+0000","last_change":"2024-09-12T00:16:05.107880+0000","last_active":"2024-09-12T01:01:06.454102+0000","last_peered":"2024-09-12T01:01:06.454102+0000","last_clean":"2024-09-12T01:01:06.454102+0000","last_became_active":"2024-09-12T00:16:05.106742+0000","last_became_peered":"2024-09-12T00:16:05.106742+0000","last_unstale":"2024-09-12T01:01:06.454102+0000","last_undegraded":"2024-09-12T01:01:06.454102+0000","last_fullsized":"2024-09-12T01:01:06.454102+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:30.878014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":438,"num_read_kb":396,"num_write":482,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"268'395","reported_seq":1832,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:48.415779+0000","last_change":"2024-09-12T00:15:57.016176+0000","last_active":"2024-09-12T01:00:48.415779+0000","last_peered":"2024-09-12T01:00:48.415779+0000","last_clean":"2024-09-12T01:00:48.415779+0000","last_became_active":"2024-09-12T00:15:57.015397+0000","last_became_peered":"2024-09-12T00:15:57.015397+0000","last_unstale":"2024-09-12T01:00:48.415779+0000","last_undegraded":"2024-09-12T01:00:48.415779+0000","last_fullsized":"2024-09-12T01:00:48.415779+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:29.776854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2041,"num_read_kb":1937,"num_write":459,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"268'320","reported_seq":947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.967339+0000","last_change":"2024-09-12T00:15:55.064342+0000","last_active":"2024-09-12T01:02:39.967339+0000","last_peered":"2024-09-12T01:02:39.967339+0000","last_clean":"2024-09-12T01:02:39.967339+0000","last_became_active":"2024-09-12T00:15:55.062990+0000","last_became_peered":"2024-09-12T00:15:55.062990+0000","last_unstale":"2024-09-12T01:02:39.967339+0000","last_undegraded":"2024-09-12T01:02:39.967339+0000","last_fullsized":"2024-09-12T01:02:39.967339+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:44.373318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838529,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":442,"num_read_kb":9756,"num_write":997,"num_write_kb":17415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:23.198746+0000","last_change":"2024-09-12T00:15:59.029632+0000","last_active":"2024-09-12T01:00:23.198746+0000","last_peered":"2024-09-12T01:00:23.198746+0000","last_clean":"2024-09-12T01:00:23.198746+0000","last_became_active":"2024-09-12T00:15:59.029162+0000","last_became_peered":"2024-09-12T00:15:59.029162+0000","last_unstale":"2024-09-12T01:00:23.198746+0000","last_undegraded":"2024-09-12T01:00:23.198746+0000","last_fullsized":"2024-09-12T01:00:23.198746+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:41.881067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"268'283","reported_seq":871,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.395561+0000","last_change":"2024-09-12T00:16:01.060247+0000","last_active":"2024-09-12T01:02:39.395561+0000","last_peered":"2024-09-12T01:02:39.395561+0000","last_clean":"2024-09-12T01:02:39.395561+0000","last_became_active":"2024-09-12T00:16:01.059517+0000","last_became_peered":"2024-09-12T00:16:01.059517+0000","last_unstale":"2024-09-12T01:02:39.395561+0000","last_undegraded":"2024-09-12T01:02:39.395561+0000","last_fullsized":"2024-09-12T01:02:39.395561+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:40.375904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51265,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":460,"num_read_kb":973,"num_write":358,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:23.196779+0000","last_change":"2024-09-12T00:16:03.104263+0000","last_active":"2024-09-12T01:00:23.196779+0000","last_peered":"2024-09-12T01:00:23.196779+0000","last_clean":"2024-09-12T01:00:23.196779+0000","last_became_active":"2024-09-12T00:16:03.103630+0000","last_became_peered":"2024-09-12T00:16:03.103630+0000","last_unstale":"2024-09-12T01:00:23.196779+0000","last_undegraded":"2024-09-12T01:00:23.196779+0000","last_fullsized":"2024-09-12T01:00:23.196779+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:39.452322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"268'165","reported_seq":678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:01.555845+0000","last_change":"2024-09-12T00:16:05.110450+0000","last_active":"2024-09-12T01:00:01.555845+0000","last_peered":"2024-09-12T01:00:01.555845+0000","last_clean":"2024-09-12T01:00:01.555845+0000","last_became_active":"2024-09-12T00:16:05.109745+0000","last_became_peered":"2024-09-12T00:16:05.109745+0000","last_unstale":"2024-09-12T01:00:01.555845+0000","last_undegraded":"2024-09-12T01:00:01.555845+0000","last_fullsized":"2024-09-12T01:00:01.555845+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:15.769156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":406,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"268'420","reported_seq":1857,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506522+0000","last_change":"2024-09-12T00:15:57.030478+0000","last_active":"2024-09-12T01:01:09.506522+0000","last_peered":"2024-09-12T01:01:09.506522+0000","last_clean":"2024-09-12T01:01:09.506522+0000","last_became_active":"2024-09-12T00:15:57.028820+0000","last_became_peered":"2024-09-12T00:15:57.028820+0000","last_unstale":"2024-09-12T01:01:09.506522+0000","last_undegraded":"2024-09-12T01:01:09.506522+0000","last_fullsized":"2024-09-12T01:01:09.506522+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:55.701403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2332,"num_read_kb":2186,"num_write":478,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"268'304","reported_seq":955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.760900+0000","last_change":"2024-09-12T00:15:55.059264+0000","last_active":"2024-09-12T01:02:39.760900+0000","last_peered":"2024-09-12T01:02:39.760900+0000","last_clean":"2024-09-12T01:02:39.760900+0000","last_became_active":"2024-09-12T00:15:55.054712+0000","last_became_peered":"2024-09-12T00:15:55.054712+0000","last_unstale":"2024-09-12T01:02:39.760900+0000","last_undegraded":"2024-09-12T01:02:39.760900+0000","last_fullsized":"2024-09-12T01:02:39.760900+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:52.726633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25680,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":448,"num_read_kb":100896,"num_write":1015,"num_write_kb":52799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:19.231696+0000","last_change":"2024-09-12T00:15:59.030022+0000","last_active":"2024-09-12T01:00:19.231696+0000","last_peered":"2024-09-12T01:00:19.231696+0000","last_clean":"2024-09-12T01:00:19.231696+0000","last_became_active":"2024-09-12T00:15:59.028885+0000","last_became_peered":"2024-09-12T00:15:59.028885+0000","last_unstale":"2024-09-12T01:00:19.231696+0000","last_undegraded":"2024-09-12T01:00:19.231696+0000","last_fullsized":"2024-09-12T01:00:19.231696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:22.611802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"268'269","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.181851+0000","last_change":"2024-09-12T00:16:01.056020+0000","last_active":"2024-09-12T01:02:39.181851+0000","last_peered":"2024-09-12T01:02:39.181851+0000","last_clean":"2024-09-12T01:02:39.181851+0000","last_became_active":"2024-09-12T00:16:01.050654+0000","last_became_peered":"2024-09-12T00:16:01.050654+0000","last_unstale":"2024-09-12T01:02:39.181851+0000","last_undegraded":"2024-09-12T01:02:39.181851+0000","last_fullsized":"2024-09-12T01:02:39.181851+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:07.059509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":1024,"num_write":358,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:07.155925+0000","last_change":"2024-09-12T00:16:03.089923+0000","last_active":"2024-09-12T00:58:07.155925+0000","last_peered":"2024-09-12T00:58:07.155925+0000","last_clean":"2024-09-12T00:58:07.155925+0000","last_became_active":"2024-09-12T00:16:03.088929+0000","last_became_peered":"2024-09-12T00:16:03.088929+0000","last_unstale":"2024-09-12T00:58:07.155925+0000","last_undegraded":"2024-09-12T00:58:07.155925+0000","last_fullsized":"2024-09-12T00:58:07.155925+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:16.321808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"268'421","reported_seq":2042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.226413+0000","last_change":"2024-09-12T00:15:57.040165+0000","last_active":"2024-09-12T01:01:07.226413+0000","last_peered":"2024-09-12T01:01:07.226413+0000","last_clean":"2024-09-12T01:01:07.226413+0000","last_became_active":"2024-09-12T00:15:57.039919+0000","last_became_peered":"2024-09-12T00:15:57.039919+0000","last_unstale":"2024-09-12T01:01:07.226413+0000","last_undegraded":"2024-09-12T01:01:07.226413+0000","last_fullsized":"2024-09-12T01:01:07.226413+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:23.081811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2299,"num_read_kb":2203,"num_write":481,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"268'299","reported_seq":900,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.954303+0000","last_change":"2024-09-12T00:15:55.079982+0000","last_active":"2024-09-12T01:02:39.954303+0000","last_peered":"2024-09-12T01:02:39.954303+0000","last_clean":"2024-09-12T01:02:39.954303+0000","last_became_active":"2024-09-12T00:15:55.079264+0000","last_became_peered":"2024-09-12T00:15:55.079264+0000","last_unstale":"2024-09-12T01:02:39.954303+0000","last_undegraded":"2024-09-12T01:02:39.954303+0000","last_fullsized":"2024-09-12T01:02:39.954303+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:11.776490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311670,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":380,"num_read_kb":14024,"num_write":902,"num_write_kb":16591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.183037+0000","last_change":"2024-09-12T00:15:59.047833+0000","last_active":"2024-09-12T01:00:13.183037+0000","last_peered":"2024-09-12T01:00:13.183037+0000","last_clean":"2024-09-12T01:00:13.183037+0000","last_became_active":"2024-09-12T00:15:59.039042+0000","last_became_peered":"2024-09-12T00:15:59.039042+0000","last_unstale":"2024-09-12T01:00:13.183037+0000","last_undegraded":"2024-09-12T01:00:13.183037+0000","last_fullsized":"2024-09-12T01:00:13.183037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:09.753392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"268'494","reported_seq":1126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.106201+0000","last_change":"2024-09-12T00:16:01.063315+0000","last_active":"2024-09-12T01:02:39.106201+0000","last_peered":"2024-09-12T01:02:39.106201+0000","last_clean":"2024-09-12T01:02:39.106201+0000","last_became_active":"2024-09-12T00:16:01.062625+0000","last_became_peered":"2024-09-12T00:16:01.062625+0000","last_unstale":"2024-09-12T01:02:39.106201+0000","last_undegraded":"2024-09-12T01:02:39.106201+0000","last_fullsized":"2024-09-12T01:02:39.106201+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:42.064557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91700,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":904,"num_read_kb":2175,"num_write":782,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.169019+0000","last_change":"2024-09-12T00:16:03.088732+0000","last_active":"2024-09-12T00:58:33.169019+0000","last_peered":"2024-09-12T00:58:33.169019+0000","last_clean":"2024-09-12T00:58:33.169019+0000","last_became_active":"2024-09-12T00:16:03.087980+0000","last_became_peered":"2024-09-12T00:16:03.087980+0000","last_unstale":"2024-09-12T00:58:33.169019+0000","last_undegraded":"2024-09-12T00:58:33.169019+0000","last_fullsized":"2024-09-12T00:58:33.169019+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:06.045851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"268'129","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:43.109476+0000","last_change":"2024-09-12T00:16:05.099199+0000","last_active":"2024-09-12T01:00:43.109476+0000","last_peered":"2024-09-12T01:00:43.109476+0000","last_clean":"2024-09-12T01:00:43.109476+0000","last_became_active":"2024-09-12T00:16:05.098424+0000","last_became_peered":"2024-09-12T00:16:05.098424+0000","last_unstale":"2024-09-12T01:00:43.109476+0000","last_undegraded":"2024-09-12T01:00:43.109476+0000","last_fullsized":"2024-09-12T01:00:43.109476+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:24.228012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":165,"num_write":285,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"268'839","reported_seq":2428,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.158434+0000","last_change":"2024-09-12T00:15:57.023405+0000","last_active":"2024-09-12T01:01:02.158434+0000","last_peered":"2024-09-12T01:01:02.158434+0000","last_clean":"2024-09-12T01:01:02.158434+0000","last_became_active":"2024-09-12T00:15:57.022709+0000","last_became_peered":"2024-09-12T00:15:57.022709+0000","last_unstale":"2024-09-12T01:01:02.158434+0000","last_undegraded":"2024-09-12T01:01:02.158434+0000","last_fullsized":"2024-09-12T01:01:02.158434+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":800,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:43.347297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3967,"num_read_kb":3571,"num_write":1117,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"268'292","reported_seq":933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.901477+0000","last_change":"2024-09-12T00:15:55.065793+0000","last_active":"2024-09-12T01:02:39.901477+0000","last_peered":"2024-09-12T01:02:39.901477+0000","last_clean":"2024-09-12T01:02:39.901477+0000","last_became_active":"2024-09-12T00:15:55.064940+0000","last_became_peered":"2024-09-12T00:15:55.064940+0000","last_unstale":"2024-09-12T01:02:39.901477+0000","last_undegraded":"2024-09-12T01:02:39.901477+0000","last_fullsized":"2024-09-12T01:02:39.901477+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:58.611447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1909911,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":2788,"num_write":1025,"num_write_kb":39220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.188274+0000","last_change":"2024-09-12T00:15:59.035109+0000","last_active":"2024-09-12T00:59:48.188274+0000","last_peered":"2024-09-12T00:59:48.188274+0000","last_clean":"2024-09-12T00:59:48.188274+0000","last_became_active":"2024-09-12T00:15:59.034648+0000","last_became_peered":"2024-09-12T00:15:59.034648+0000","last_unstale":"2024-09-12T00:59:48.188274+0000","last_undegraded":"2024-09-12T00:59:48.188274+0000","last_fullsized":"2024-09-12T00:59:48.188274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:33.763390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"268'281","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.246715+0000","last_change":"2024-09-12T00:16:01.048774+0000","last_active":"2024-09-12T01:02:39.246715+0000","last_peered":"2024-09-12T01:02:39.246715+0000","last_clean":"2024-09-12T01:02:39.246715+0000","last_became_active":"2024-09-12T00:16:01.046783+0000","last_became_peered":"2024-09-12T00:16:01.046783+0000","last_unstale":"2024-09-12T01:02:39.246715+0000","last_undegraded":"2024-09-12T01:02:39.246715+0000","last_fullsized":"2024-09-12T01:02:39.246715+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:16.650144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45699,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":1022,"num_write":398,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:37.186492+0000","last_change":"2024-09-12T00:16:03.098371+0000","last_active":"2024-09-12T00:58:37.186492+0000","last_peered":"2024-09-12T00:58:37.186492+0000","last_clean":"2024-09-12T00:58:37.186492+0000","last_became_active":"2024-09-12T00:16:03.097160+0000","last_became_peered":"2024-09-12T00:16:03.097160+0000","last_unstale":"2024-09-12T00:58:37.186492+0000","last_undegraded":"2024-09-12T00:58:37.186492+0000","last_fullsized":"2024-09-12T00:58:37.186492+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:26.964444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"268'210","reported_seq":763,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:49.738687+0000","last_change":"2024-09-12T00:16:05.102618+0000","last_active":"2024-09-12T01:00:49.738687+0000","last_peered":"2024-09-12T01:00:49.738687+0000","last_clean":"2024-09-12T01:00:49.738687+0000","last_became_active":"2024-09-12T00:16:05.101338+0000","last_became_peered":"2024-09-12T00:16:05.101338+0000","last_unstale":"2024-09-12T01:00:49.738687+0000","last_undegraded":"2024-09-12T01:00:49.738687+0000","last_fullsized":"2024-09-12T01:00:49.738687+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:45.959400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1401,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":396,"num_read_kb":348,"num_write":595,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"268'504","reported_seq":2086,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:53.114328+0000","last_change":"2024-09-12T00:15:57.035005+0000","last_active":"2024-09-12T01:00:53.114328+0000","last_peered":"2024-09-12T01:00:53.114328+0000","last_clean":"2024-09-12T01:00:53.114328+0000","last_became_active":"2024-09-12T00:15:57.034257+0000","last_became_peered":"2024-09-12T00:15:57.034257+0000","last_unstale":"2024-09-12T01:00:53.114328+0000","last_undegraded":"2024-09-12T01:00:53.114328+0000","last_fullsized":"2024-09-12T01:00:53.114328+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:16.698877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2760,"num_read_kb":2552,"num_write":653,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"268'359","reported_seq":1100,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.920409+0000","last_change":"2024-09-12T00:15:55.036424+0000","last_active":"2024-09-12T01:02:39.920409+0000","last_peered":"2024-09-12T01:02:39.920409+0000","last_clean":"2024-09-12T01:02:39.920409+0000","last_became_active":"2024-09-12T00:15:55.035741+0000","last_became_peered":"2024-09-12T00:15:55.035741+0000","last_unstale":"2024-09-12T01:02:39.920409+0000","last_undegraded":"2024-09-12T01:02:39.920409+0000","last_fullsized":"2024-09-12T01:02:39.920409+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:26.450236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":693,"num_read_kb":41169,"num_write":1152,"num_write_kb":26675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.168968+0000","last_change":"2024-09-12T00:15:59.045330+0000","last_active":"2024-09-12T00:58:33.168968+0000","last_peered":"2024-09-12T00:58:33.168968+0000","last_clean":"2024-09-12T00:58:33.168968+0000","last_became_active":"2024-09-12T00:15:59.044761+0000","last_became_peered":"2024-09-12T00:15:59.044761+0000","last_unstale":"2024-09-12T00:58:33.168968+0000","last_undegraded":"2024-09-12T00:58:33.168968+0000","last_fullsized":"2024-09-12T00:58:33.168968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:47.536990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"268'292","reported_seq":872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.823176+0000","last_change":"2024-09-12T00:16:01.053808+0000","last_active":"2024-09-12T01:02:37.823176+0000","last_peered":"2024-09-12T01:02:37.823176+0000","last_clean":"2024-09-12T01:02:37.823176+0000","last_became_active":"2024-09-12T00:16:01.052731+0000","last_became_peered":"2024-09-12T00:16:01.052731+0000","last_unstale":"2024-09-12T01:02:37.823176+0000","last_undegraded":"2024-09-12T01:02:37.823176+0000","last_fullsized":"2024-09-12T01:02:37.823176+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:17.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50253,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":1058,"num_write":380,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:17.186579+0000","last_change":"2024-09-12T00:16:03.081577+0000","last_active":"2024-09-12T01:00:17.186579+0000","last_peered":"2024-09-12T01:00:17.186579+0000","last_clean":"2024-09-12T01:00:17.186579+0000","last_became_active":"2024-09-12T00:16:03.080825+0000","last_became_peered":"2024-09-12T00:16:03.080825+0000","last_unstale":"2024-09-12T01:00:17.186579+0000","last_undegraded":"2024-09-12T01:00:17.186579+0000","last_fullsized":"2024-09-12T01:00:17.186579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:06.840301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"268'153","reported_seq":651,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.041059+0000","last_change":"2024-09-12T00:16:05.098923+0000","last_active":"2024-09-12T01:02:12.041059+0000","last_peered":"2024-09-12T01:02:12.041059+0000","last_clean":"2024-09-12T01:02:12.041059+0000","last_became_active":"2024-09-12T00:16:05.098180+0000","last_became_peered":"2024-09-12T00:16:05.098180+0000","last_unstale":"2024-09-12T01:02:12.041059+0000","last_undegraded":"2024-09-12T01:02:12.041059+0000","last_fullsized":"2024-09-12T01:02:12.041059+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:05.523259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":95,"num_write":348,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"268'338","reported_seq":1661,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.583002+0000","last_change":"2024-09-12T00:15:57.040279+0000","last_active":"2024-09-12T01:01:09.583002+0000","last_peered":"2024-09-12T01:01:09.583002+0000","last_clean":"2024-09-12T01:01:09.583002+0000","last_became_active":"2024-09-12T00:15:57.039580+0000","last_became_peered":"2024-09-12T00:15:57.039580+0000","last_unstale":"2024-09-12T01:01:09.583002+0000","last_undegraded":"2024-09-12T01:01:09.583002+0000","last_fullsized":"2024-09-12T01:01:09.583002+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:54.699867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1750,"num_read_kb":1664,"num_write":383,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"268'336","reported_seq":951,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.984873+0000","last_change":"2024-09-12T00:15:55.044496+0000","last_active":"2024-09-12T01:02:39.984873+0000","last_peered":"2024-09-12T01:02:39.984873+0000","last_clean":"2024-09-12T01:02:39.984873+0000","last_became_active":"2024-09-12T00:15:55.042851+0000","last_became_peered":"2024-09-12T00:15:55.042851+0000","last_unstale":"2024-09-12T01:02:39.984873+0000","last_undegraded":"2024-09-12T01:02:39.984873+0000","last_fullsized":"2024-09-12T01:02:39.984873+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:43.191900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1919007,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":413,"num_read_kb":20803,"num_write":1107,"num_write_kb":57854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.163967+0000","last_change":"2024-09-12T00:15:59.049421+0000","last_active":"2024-09-12T00:58:33.163967+0000","last_peered":"2024-09-12T00:58:33.163967+0000","last_clean":"2024-09-12T00:58:33.163967+0000","last_became_active":"2024-09-12T00:15:59.048632+0000","last_became_peered":"2024-09-12T00:15:59.048632+0000","last_unstale":"2024-09-12T00:58:33.163967+0000","last_undegraded":"2024-09-12T00:58:33.163967+0000","last_fullsized":"2024-09-12T00:58:33.163967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:08.230944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"268'84","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:14.230651+0000","last_change":"2024-09-12T00:16:01.046254+0000","last_active":"2024-09-12T01:00:14.230651+0000","last_peered":"2024-09-12T01:00:14.230651+0000","last_clean":"2024-09-12T01:00:14.230651+0000","last_became_active":"2024-09-12T00:16:01.045565+0000","last_became_peered":"2024-09-12T00:16:01.045565+0000","last_unstale":"2024-09-12T01:00:14.230651+0000","last_undegraded":"2024-09-12T01:00:14.230651+0000","last_fullsized":"2024-09-12T01:00:14.230651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:51.429929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":132,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"268'786","reported_seq":4430,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.278605+0000","last_change":"2024-09-12T00:16:03.092271+0000","last_active":"2024-09-12T01:02:39.278605+0000","last_peered":"2024-09-12T01:02:39.278605+0000","last_clean":"2024-09-12T01:02:39.278605+0000","last_became_active":"2024-09-12T00:16:03.091506+0000","last_became_peered":"2024-09-12T00:16:03.091506+0000","last_unstale":"2024-09-12T01:02:39.278605+0000","last_undegraded":"2024-09-12T01:02:39.278605+0000","last_fullsized":"2024-09-12T01:02:39.278605+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:30.561330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"268'114","reported_seq":621,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.234041+0000","last_change":"2024-09-12T00:16:05.102360+0000","last_active":"2024-09-12T01:00:29.234041+0000","last_peered":"2024-09-12T01:00:29.234041+0000","last_clean":"2024-09-12T01:00:29.234041+0000","last_became_active":"2024-09-12T00:16:05.101500+0000","last_became_peered":"2024-09-12T00:16:05.101500+0000","last_unstale":"2024-09-12T01:00:29.234041+0000","last_undegraded":"2024-09-12T01:00:29.234041+0000","last_fullsized":"2024-09-12T01:00:29.234041+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:44.731815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"268'1099","reported_seq":2633,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:58.206504+0000","last_change":"2024-09-12T00:15:57.056750+0000","last_active":"2024-09-12T01:00:58.206504+0000","last_peered":"2024-09-12T01:00:58.206504+0000","last_clean":"2024-09-12T01:00:58.206504+0000","last_became_active":"2024-09-12T00:15:57.056507+0000","last_became_peered":"2024-09-12T00:15:57.056507+0000","last_unstale":"2024-09-12T01:00:58.206504+0000","last_undegraded":"2024-09-12T01:00:58.206504+0000","last_fullsized":"2024-09-12T01:00:58.206504+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":1000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:40.456581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5000,"num_read_kb":4445,"num_write":1493,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"268'355","reported_seq":1210,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.761233+0000","last_change":"2024-09-12T00:15:55.051781+0000","last_active":"2024-09-12T01:02:39.761233+0000","last_peered":"2024-09-12T01:02:39.761233+0000","last_clean":"2024-09-12T01:02:39.761233+0000","last_became_active":"2024-09-12T00:15:55.051336+0000","last_became_peered":"2024-09-12T00:15:55.051336+0000","last_unstale":"2024-09-12T01:02:39.761233+0000","last_undegraded":"2024-09-12T01:02:39.761233+0000","last_fullsized":"2024-09-12T01:02:39.761233+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:16.141015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174753,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1007,"num_read_kb":8590,"num_write":1279,"num_write_kb":12738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":499,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.169997+0000","last_change":"2024-09-12T00:15:59.047376+0000","last_active":"2024-09-12T00:58:33.169997+0000","last_peered":"2024-09-12T00:58:33.169997+0000","last_clean":"2024-09-12T00:58:33.169997+0000","last_became_active":"2024-09-12T00:15:59.046538+0000","last_became_peered":"2024-09-12T00:15:59.046538+0000","last_unstale":"2024-09-12T00:58:33.169997+0000","last_undegraded":"2024-09-12T00:58:33.169997+0000","last_fullsized":"2024-09-12T00:58:33.169997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:18.952950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"268'326","reported_seq":933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.319745+0000","last_change":"2024-09-12T00:16:01.052369+0000","last_active":"2024-09-12T01:02:38.319745+0000","last_peered":"2024-09-12T01:02:38.319745+0000","last_clean":"2024-09-12T01:02:38.319745+0000","last_became_active":"2024-09-12T00:16:01.051648+0000","last_became_peered":"2024-09-12T00:16:01.051648+0000","last_unstale":"2024-09-12T01:02:38.319745+0000","last_undegraded":"2024-09-12T01:02:38.319745+0000","last_fullsized":"2024-09-12T01:02:38.319745+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:31.858718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50218,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":538,"num_read_kb":1138,"num_write":432,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179642+0000","last_change":"2024-09-12T00:16:03.086923+0000","last_active":"2024-09-12T00:59:33.179642+0000","last_peered":"2024-09-12T00:59:33.179642+0000","last_clean":"2024-09-12T00:59:33.179642+0000","last_became_active":"2024-09-12T00:16:03.086333+0000","last_became_peered":"2024-09-12T00:16:03.086333+0000","last_unstale":"2024-09-12T00:59:33.179642+0000","last_undegraded":"2024-09-12T00:59:33.179642+0000","last_fullsized":"2024-09-12T00:59:33.179642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:22.916351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"268'125","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:04.626052+0000","last_change":"2024-09-12T00:16:05.108248+0000","last_active":"2024-09-12T01:01:04.626052+0000","last_peered":"2024-09-12T01:01:04.626052+0000","last_clean":"2024-09-12T01:01:04.626052+0000","last_became_active":"2024-09-12T00:16:05.107284+0000","last_became_peered":"2024-09-12T00:16:05.107284+0000","last_unstale":"2024-09-12T01:01:04.626052+0000","last_undegraded":"2024-09-12T01:01:04.626052+0000","last_fullsized":"2024-09-12T01:01:04.626052+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:25.922474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":114,"num_write":286,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"268'488","reported_seq":2114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.993123+0000","last_change":"2024-09-12T00:15:57.022317+0000","last_active":"2024-09-12T01:00:29.993123+0000","last_peered":"2024-09-12T01:00:29.993123+0000","last_clean":"2024-09-12T01:00:29.993123+0000","last_became_active":"2024-09-12T00:15:57.021526+0000","last_became_peered":"2024-09-12T00:15:57.021526+0000","last_unstale":"2024-09-12T01:00:29.993123+0000","last_undegraded":"2024-09-12T01:00:29.993123+0000","last_fullsized":"2024-09-12T01:00:29.993123+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:10:49.730181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2702,"num_read_kb":2545,"num_write":554,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"268'350","reported_seq":1030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.938303+0000","last_change":"2024-09-12T00:15:55.053021+0000","last_active":"2024-09-12T01:02:39.938303+0000","last_peered":"2024-09-12T01:02:39.938303+0000","last_clean":"2024-09-12T01:02:39.938303+0000","last_became_active":"2024-09-12T00:15:55.052503+0000","last_became_peered":"2024-09-12T00:15:55.052503+0000","last_unstale":"2024-09-12T01:02:39.938303+0000","last_undegraded":"2024-09-12T01:02:39.938303+0000","last_fullsized":"2024-09-12T01:02:39.938303+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:07.348592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174814,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":52648,"num_write":1035,"num_write_kb":43222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.168868+0000","last_change":"2024-09-12T00:15:59.027111+0000","last_active":"2024-09-12T00:58:33.168868+0000","last_peered":"2024-09-12T00:58:33.168868+0000","last_clean":"2024-09-12T00:58:33.168868+0000","last_became_active":"2024-09-12T00:15:59.024564+0000","last_became_peered":"2024-09-12T00:15:59.024564+0000","last_unstale":"2024-09-12T00:58:33.168868+0000","last_undegraded":"2024-09-12T00:58:33.168868+0000","last_fullsized":"2024-09-12T00:58:33.168868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:49.354490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"268'248","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.384876+0000","last_change":"2024-09-12T00:16:01.055584+0000","last_active":"2024-09-12T01:02:38.384876+0000","last_peered":"2024-09-12T01:02:38.384876+0000","last_clean":"2024-09-12T01:02:38.384876+0000","last_became_active":"2024-09-12T00:16:01.051612+0000","last_became_peered":"2024-09-12T00:16:01.051612+0000","last_unstale":"2024-09-12T01:02:38.384876+0000","last_undegraded":"2024-09-12T01:02:38.384876+0000","last_fullsized":"2024-09-12T01:02:38.384876+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:47.313727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46385,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":418,"num_read_kb":940,"num_write":334,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:44.223108+0000","last_change":"2024-09-12T00:16:03.095905+0000","last_active":"2024-09-12T00:59:44.223108+0000","last_peered":"2024-09-12T00:59:44.223108+0000","last_clean":"2024-09-12T00:59:44.223108+0000","last_became_active":"2024-09-12T00:16:03.095016+0000","last_became_peered":"2024-09-12T00:16:03.095016+0000","last_unstale":"2024-09-12T00:59:44.223108+0000","last_undegraded":"2024-09-12T00:59:44.223108+0000","last_fullsized":"2024-09-12T00:59:44.223108+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:35.761981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"268'135","reported_seq":666,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.014067+0000","last_change":"2024-09-12T00:16:05.099520+0000","last_active":"2024-09-12T01:02:02.014067+0000","last_peered":"2024-09-12T01:02:02.014067+0000","last_clean":"2024-09-12T01:02:02.014067+0000","last_became_active":"2024-09-12T00:16:05.098796+0000","last_became_peered":"2024-09-12T00:16:05.098796+0000","last_unstale":"2024-09-12T01:02:02.014067+0000","last_undegraded":"2024-09-12T01:02:02.014067+0000","last_fullsized":"2024-09-12T01:02:02.014067+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:27.979474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":225,"num_write":347,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"268'416","reported_seq":1961,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.872184+0000","last_change":"2024-09-12T00:15:57.038940+0000","last_active":"2024-09-12T01:02:10.872184+0000","last_peered":"2024-09-12T01:02:10.872184+0000","last_clean":"2024-09-12T01:02:10.872184+0000","last_became_active":"2024-09-12T00:15:57.038127+0000","last_became_peered":"2024-09-12T00:15:57.038127+0000","last_unstale":"2024-09-12T01:02:10.872184+0000","last_undegraded":"2024-09-12T01:02:10.872184+0000","last_fullsized":"2024-09-12T01:02:10.872184+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:35.287613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2293,"num_read_kb":2185,"num_write":483,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"268'320","reported_seq":951,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.884964+0000","last_change":"2024-09-12T00:15:55.076108+0000","last_active":"2024-09-12T01:02:39.884964+0000","last_peered":"2024-09-12T01:02:39.884964+0000","last_clean":"2024-09-12T01:02:39.884964+0000","last_became_active":"2024-09-12T00:15:55.074964+0000","last_became_peered":"2024-09-12T00:15:55.074964+0000","last_unstale":"2024-09-12T01:02:39.884964+0000","last_undegraded":"2024-09-12T01:02:39.884964+0000","last_fullsized":"2024-09-12T01:02:39.884964+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:29.685119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655970,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":20129,"num_write":999,"num_write_kb":20535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.184985+0000","last_change":"2024-09-12T00:15:59.036962+0000","last_active":"2024-09-12T00:59:33.184985+0000","last_peered":"2024-09-12T00:59:33.184985+0000","last_clean":"2024-09-12T00:59:33.184985+0000","last_became_active":"2024-09-12T00:15:59.036492+0000","last_became_peered":"2024-09-12T00:15:59.036492+0000","last_unstale":"2024-09-12T00:59:33.184985+0000","last_undegraded":"2024-09-12T00:59:33.184985+0000","last_fullsized":"2024-09-12T00:59:33.184985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:26.416316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"268'247","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.671289+0000","last_change":"2024-09-12T00:16:01.053033+0000","last_active":"2024-09-12T01:02:37.671289+0000","last_peered":"2024-09-12T01:02:37.671289+0000","last_clean":"2024-09-12T01:02:37.671289+0000","last_became_active":"2024-09-12T00:16:01.050746+0000","last_became_peered":"2024-09-12T00:16:01.050746+0000","last_unstale":"2024-09-12T01:02:37.671289+0000","last_undegraded":"2024-09-12T01:02:37.671289+0000","last_fullsized":"2024-09-12T01:02:37.671289+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:56.194861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":412,"num_read_kb":978,"num_write":338,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:34.203198+0000","last_change":"2024-09-12T00:16:03.100996+0000","last_active":"2024-09-12T00:58:34.203198+0000","last_peered":"2024-09-12T00:58:34.203198+0000","last_clean":"2024-09-12T00:58:34.203198+0000","last_became_active":"2024-09-12T00:16:03.099890+0000","last_became_peered":"2024-09-12T00:16:03.099890+0000","last_unstale":"2024-09-12T00:58:34.203198+0000","last_undegraded":"2024-09-12T00:58:34.203198+0000","last_fullsized":"2024-09-12T00:58:34.203198+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:53.876340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"268'186","reported_seq":1673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.781143+0000","last_change":"2024-09-12T00:16:05.113925+0000","last_active":"2024-09-12T01:02:10.781143+0000","last_peered":"2024-09-12T01:02:10.781143+0000","last_clean":"2024-09-12T01:02:10.781143+0000","last_became_active":"2024-09-12T00:16:05.113207+0000","last_became_peered":"2024-09-12T00:16:05.113207+0000","last_unstale":"2024-09-12T01:02:10.781143+0000","last_undegraded":"2024-09-12T01:02:10.781143+0000","last_fullsized":"2024-09-12T01:02:10.781143+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:18.252728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1270,"num_read_kb":1246,"num_write":444,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"268'923","reported_seq":2663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.506178+0000","last_change":"2024-09-12T00:15:57.013390+0000","last_active":"2024-09-12T01:01:09.506178+0000","last_peered":"2024-09-12T01:01:09.506178+0000","last_clean":"2024-09-12T01:01:09.506178+0000","last_became_active":"2024-09-12T00:15:57.012136+0000","last_became_peered":"2024-09-12T00:15:57.012136+0000","last_unstale":"2024-09-12T01:01:09.506178+0000","last_undegraded":"2024-09-12T01:01:09.506178+0000","last_fullsized":"2024-09-12T01:01:09.506178+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:10.566262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4477,"num_read_kb":4059,"num_write":1259,"num_write_kb":498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"268'359","reported_seq":995,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.900185+0000","last_change":"2024-09-12T00:15:55.079920+0000","last_active":"2024-09-12T01:02:39.900185+0000","last_peered":"2024-09-12T01:02:39.900185+0000","last_clean":"2024-09-12T01:02:39.900185+0000","last_became_active":"2024-09-12T00:15:55.079005+0000","last_became_peered":"2024-09-12T00:15:55.079005+0000","last_unstale":"2024-09-12T01:02:39.900185+0000","last_undegraded":"2024-09-12T01:02:39.900185+0000","last_fullsized":"2024-09-12T01:02:39.900185+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:58.600991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525370,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":531,"num_read_kb":476,"num_write":1171,"num_write_kb":40462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:43.182050+0000","last_change":"2024-09-12T00:15:59.040566+0000","last_active":"2024-09-12T00:59:43.182050+0000","last_peered":"2024-09-12T00:59:43.182050+0000","last_clean":"2024-09-12T00:59:43.182050+0000","last_became_active":"2024-09-12T00:15:59.039674+0000","last_became_peered":"2024-09-12T00:15:59.039674+0000","last_unstale":"2024-09-12T00:59:43.182050+0000","last_undegraded":"2024-09-12T00:59:43.182050+0000","last_fullsized":"2024-09-12T00:59:43.182050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:23.557637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"268'344","reported_seq":946,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.914549+0000","last_change":"2024-09-12T00:16:01.052058+0000","last_active":"2024-09-12T01:02:37.914549+0000","last_peered":"2024-09-12T01:02:37.914549+0000","last_clean":"2024-09-12T01:02:37.914549+0000","last_became_active":"2024-09-12T00:16:01.051324+0000","last_became_peered":"2024-09-12T00:16:01.051324+0000","last_unstale":"2024-09-12T01:02:37.914549+0000","last_undegraded":"2024-09-12T01:02:37.914549+0000","last_fullsized":"2024-09-12T01:02:37.914549+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:07.219892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49632,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":580,"num_read_kb":1323,"num_write":476,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.163885+0000","last_change":"2024-09-12T00:16:03.100444+0000","last_active":"2024-09-12T00:58:33.163885+0000","last_peered":"2024-09-12T00:58:33.163885+0000","last_clean":"2024-09-12T00:58:33.163885+0000","last_became_active":"2024-09-12T00:16:03.099836+0000","last_became_peered":"2024-09-12T00:16:03.099836+0000","last_unstale":"2024-09-12T00:58:33.163885+0000","last_undegraded":"2024-09-12T00:58:33.163885+0000","last_fullsized":"2024-09-12T00:58:33.163885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:28.442530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"268'111","reported_seq":603,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.864539+0000","last_change":"2024-09-12T00:16:05.113973+0000","last_active":"2024-09-12T01:02:10.864539+0000","last_peered":"2024-09-12T01:02:10.864539+0000","last_clean":"2024-09-12T01:02:10.864539+0000","last_became_active":"2024-09-12T00:16:05.113231+0000","last_became_peered":"2024-09-12T00:16:05.113231+0000","last_unstale":"2024-09-12T01:02:10.864539+0000","last_undegraded":"2024-09-12T01:02:10.864539+0000","last_fullsized":"2024-09-12T01:02:10.864539+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:31.200737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":663,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":263,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"268'811","reported_seq":2398,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.231281+0000","last_change":"2024-09-12T00:15:57.031887+0000","last_active":"2024-09-12T01:01:07.231281+0000","last_peered":"2024-09-12T01:01:07.231281+0000","last_clean":"2024-09-12T01:01:07.231281+0000","last_became_active":"2024-09-12T00:15:57.031161+0000","last_became_peered":"2024-09-12T00:15:57.031161+0000","last_unstale":"2024-09-12T01:01:07.231281+0000","last_undegraded":"2024-09-12T01:01:07.231281+0000","last_fullsized":"2024-09-12T01:01:07.231281+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":800,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:00.259897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3882,"num_read_kb":3503,"num_write":1069,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"268'350","reported_seq":1116,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.869826+0000","last_change":"2024-09-12T00:15:55.042845+0000","last_active":"2024-09-12T01:02:39.869826+0000","last_peered":"2024-09-12T01:02:39.869826+0000","last_clean":"2024-09-12T01:02:39.869826+0000","last_became_active":"2024-09-12T00:15:55.042134+0000","last_became_peered":"2024-09-12T00:15:55.042134+0000","last_unstale":"2024-09-12T01:02:39.869826+0000","last_undegraded":"2024-09-12T01:02:39.869826+0000","last_fullsized":"2024-09-12T01:02:39.869826+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:24.618191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918005,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":861,"num_read_kb":50816,"num_write":1243,"num_write_kb":44406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'401","reported_seq":1855,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.867542+0000","last_change":"2024-09-12T00:15:57.043703+0000","last_active":"2024-09-12T01:02:10.867542+0000","last_peered":"2024-09-12T01:02:10.867542+0000","last_clean":"2024-09-12T01:02:10.867542+0000","last_became_active":"2024-09-12T00:15:57.043013+0000","last_became_peered":"2024-09-12T00:15:57.043013+0000","last_unstale":"2024-09-12T01:02:10.867542+0000","last_undegraded":"2024-09-12T01:02:10.867542+0000","last_fullsized":"2024-09-12T01:02:10.867542+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:02.318087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2106,"num_read_kb":1998,"num_write":459,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"268'302","reported_seq":929,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.960213+0000","last_change":"2024-09-12T00:15:55.063527+0000","last_active":"2024-09-12T01:02:39.960213+0000","last_peered":"2024-09-12T01:02:39.960213+0000","last_clean":"2024-09-12T01:02:39.960213+0000","last_became_active":"2024-09-12T00:15:55.062524+0000","last_became_peered":"2024-09-12T00:15:55.062524+0000","last_unstale":"2024-09-12T01:02:39.960213+0000","last_undegraded":"2024-09-12T01:02:39.960213+0000","last_fullsized":"2024-09-12T01:02:39.960213+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:23.930911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291481,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":18226,"num_write":893,"num_write_kb":43043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"268'494","reported_seq":2210,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.226294+0000","last_change":"2024-09-12T00:15:57.029585+0000","last_active":"2024-09-12T01:01:07.226294+0000","last_peered":"2024-09-12T01:01:07.226294+0000","last_clean":"2024-09-12T01:01:07.226294+0000","last_became_active":"2024-09-12T00:15:57.018875+0000","last_became_peered":"2024-09-12T00:15:57.018875+0000","last_unstale":"2024-09-12T01:01:07.226294+0000","last_undegraded":"2024-09-12T01:01:07.226294+0000","last_fullsized":"2024-09-12T01:01:07.226294+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:10.062996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2775,"num_read_kb":2615,"num_write":593,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"268'360","reported_seq":1010,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.870103+0000","last_change":"2024-09-12T00:15:55.064178+0000","last_active":"2024-09-12T01:02:39.870103+0000","last_peered":"2024-09-12T01:02:39.870103+0000","last_clean":"2024-09-12T01:02:39.870103+0000","last_became_active":"2024-09-12T00:15:55.063603+0000","last_became_peered":"2024-09-12T00:15:55.063603+0000","last_unstale":"2024-09-12T01:02:39.870103+0000","last_undegraded":"2024-09-12T01:02:39.870103+0000","last_fullsized":"2024-09-12T01:02:39.870103+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:29.018846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055186,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":518,"num_read_kb":3291,"num_write":1136,"num_write_kb":12783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"268'390","reported_seq":1797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.016017+0000","last_change":"2024-09-12T00:15:57.031124+0000","last_active":"2024-09-12T01:00:47.016017+0000","last_peered":"2024-09-12T01:00:47.016017+0000","last_clean":"2024-09-12T01:00:47.016017+0000","last_became_active":"2024-09-12T00:15:57.030173+0000","last_became_peered":"2024-09-12T00:15:57.030173+0000","last_unstale":"2024-09-12T01:00:47.016017+0000","last_undegraded":"2024-09-12T01:00:47.016017+0000","last_fullsized":"2024-09-12T01:00:47.016017+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:54.011519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2013,"num_read_kb":1910,"num_write":436,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"268'370","reported_seq":1113,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.948734+0000","last_change":"2024-09-12T00:15:55.069041+0000","last_active":"2024-09-12T01:02:39.948734+0000","last_peered":"2024-09-12T01:02:39.948734+0000","last_clean":"2024-09-12T01:02:39.948734+0000","last_became_active":"2024-09-12T00:15:55.068349+0000","last_became_peered":"2024-09-12T00:15:55.068349+0000","last_unstale":"2024-09-12T01:02:39.948734+0000","last_undegraded":"2024-09-12T01:02:39.948734+0000","last_fullsized":"2024-09-12T01:02:39.948734+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:58.205254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5530690,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":847,"num_read_kb":11363,"num_write":1205,"num_write_kb":51000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"268'398","reported_seq":1882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.583028+0000","last_change":"2024-09-12T00:15:57.037970+0000","last_active":"2024-09-12T01:01:09.583028+0000","last_peered":"2024-09-12T01:01:09.583028+0000","last_clean":"2024-09-12T01:01:09.583028+0000","last_became_active":"2024-09-12T00:15:57.037204+0000","last_became_peered":"2024-09-12T00:15:57.037204+0000","last_unstale":"2024-09-12T01:01:09.583028+0000","last_undegraded":"2024-09-12T01:01:09.583028+0000","last_fullsized":"2024-09-12T01:01:09.583028+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:46.963139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2120,"num_read_kb":2017,"num_write":453,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"268'338","reported_seq":973,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.941906+0000","last_change":"2024-09-12T00:15:55.072723+0000","last_active":"2024-09-12T01:02:39.941906+0000","last_peered":"2024-09-12T01:02:39.941906+0000","last_clean":"2024-09-12T01:02:39.941906+0000","last_became_active":"2024-09-12T00:15:55.071812+0000","last_became_peered":"2024-09-12T00:15:55.071812+0000","last_unstale":"2024-09-12T01:02:39.941906+0000","last_undegraded":"2024-09-12T01:02:39.941906+0000","last_fullsized":"2024-09-12T01:02:39.941906+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:47.837252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1919077,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":11487,"num_write":1134,"num_write_kb":34407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"268'581","reported_seq":2263,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.158878+0000","last_change":"2024-09-12T00:15:57.033145+0000","last_active":"2024-09-12T01:01:02.158878+0000","last_peered":"2024-09-12T01:01:02.158878+0000","last_clean":"2024-09-12T01:01:02.158878+0000","last_became_active":"2024-09-12T00:15:57.032818+0000","last_became_peered":"2024-09-12T00:15:57.032818+0000","last_unstale":"2024-09-12T01:01:02.158878+0000","last_undegraded":"2024-09-12T01:01:02.158878+0000","last_fullsized":"2024-09-12T01:01:02.158878+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:32.583489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2922,"num_read_kb":2722,"num_write":707,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"268'345","reported_seq":1021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.874499+0000","last_change":"2024-09-12T00:15:55.052766+0000","last_active":"2024-09-12T01:02:39.874499+0000","last_peered":"2024-09-12T01:02:39.874499+0000","last_clean":"2024-09-12T01:02:39.874499+0000","last_became_active":"2024-09-12T00:15:55.050781+0000","last_became_peered":"2024-09-12T00:15:55.050781+0000","last_unstale":"2024-09-12T01:02:39.874499+0000","last_undegraded":"2024-09-12T01:02:39.874499+0000","last_fullsized":"2024-09-12T01:02:39.874499+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:34.653614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432541,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":494,"num_read_kb":31947,"num_write":1072,"num_write_kb":41212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"268'801","reported_seq":2287,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.226718+0000","last_change":"2024-09-12T00:15:57.046222+0000","last_active":"2024-09-12T01:01:07.226718+0000","last_peered":"2024-09-12T01:01:07.226718+0000","last_clean":"2024-09-12T01:01:07.226718+0000","last_became_active":"2024-09-12T00:15:57.045500+0000","last_became_peered":"2024-09-12T00:15:57.045500+0000","last_unstale":"2024-09-12T01:01:07.226718+0000","last_undegraded":"2024-09-12T01:01:07.226718+0000","last_fullsized":"2024-09-12T01:01:07.226718+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:02.396896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3817,"num_read_kb":3427,"num_write":1098,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"268'312","reported_seq":934,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.904370+0000","last_change":"2024-09-12T00:15:55.055440+0000","last_active":"2024-09-12T01:02:39.904370+0000","last_peered":"2024-09-12T01:02:39.904370+0000","last_clean":"2024-09-12T01:02:39.904370+0000","last_became_active":"2024-09-12T00:15:55.054914+0000","last_became_peered":"2024-09-12T00:15:55.054914+0000","last_unstale":"2024-09-12T01:02:39.904370+0000","last_undegraded":"2024-09-12T01:02:39.904370+0000","last_fullsized":"2024-09-12T01:02:39.904370+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:21.527461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262244,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":420,"num_read_kb":50634,"num_write":965,"num_write_kb":37363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"268'817","reported_seq":2510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:25.613084+0000","last_change":"2024-09-12T00:15:57.022003+0000","last_active":"2024-09-12T01:00:25.613084+0000","last_peered":"2024-09-12T01:00:25.613084+0000","last_clean":"2024-09-12T01:00:25.613084+0000","last_became_active":"2024-09-12T00:15:57.021622+0000","last_became_peered":"2024-09-12T00:15:57.021622+0000","last_unstale":"2024-09-12T01:00:25.613084+0000","last_undegraded":"2024-09-12T01:00:25.613084+0000","last_fullsized":"2024-09-12T01:00:25.613084+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":800,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:00.960528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4035,"num_read_kb":3684,"num_write":1067,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"268'352","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.867771+0000","last_change":"2024-09-12T00:15:55.068680+0000","last_active":"2024-09-12T01:02:39.867771+0000","last_peered":"2024-09-12T01:02:39.867771+0000","last_clean":"2024-09-12T01:02:39.867771+0000","last_became_active":"2024-09-12T00:15:55.055929+0000","last_became_peered":"2024-09-12T00:15:55.055929+0000","last_unstale":"2024-09-12T01:02:39.867771+0000","last_undegraded":"2024-09-12T01:02:39.867771+0000","last_fullsized":"2024-09-12T01:02:39.867771+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:15.633734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":553,"num_read_kb":589,"num_write":1208,"num_write_kb":30899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"268'837","reported_seq":2503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.883860+0000","last_change":"2024-09-12T00:15:57.040650+0000","last_active":"2024-09-12T01:02:10.883860+0000","last_peered":"2024-09-12T01:02:10.883860+0000","last_clean":"2024-09-12T01:02:10.883860+0000","last_became_active":"2024-09-12T00:15:57.039946+0000","last_became_peered":"2024-09-12T00:15:57.039946+0000","last_unstale":"2024-09-12T01:02:10.883860+0000","last_undegraded":"2024-09-12T01:02:10.883860+0000","last_fullsized":"2024-09-12T01:02:10.883860+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:12.893023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4272,"num_read_kb":3874,"num_write":1144,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"268'428","reported_seq":1157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.954765+0000","last_change":"2024-09-12T00:15:55.065969+0000","last_active":"2024-09-12T01:02:39.954765+0000","last_peered":"2024-09-12T01:02:39.954765+0000","last_clean":"2024-09-12T01:02:39.954765+0000","last_became_active":"2024-09-12T00:15:55.065129+0000","last_became_peered":"2024-09-12T00:15:55.065129+0000","last_unstale":"2024-09-12T01:02:39.954765+0000","last_undegraded":"2024-09-12T01:02:39.954765+0000","last_fullsized":"2024-09-12T01:02:39.954765+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:11.829722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170166,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":788,"num_read_kb":24149,"num_write":1329,"num_write_kb":32019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"268'876","reported_seq":2654,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.883373+0000","last_change":"2024-09-12T00:15:57.052278+0000","last_active":"2024-09-12T01:02:10.883373+0000","last_peered":"2024-09-12T01:02:10.883373+0000","last_clean":"2024-09-12T01:02:10.883373+0000","last_became_active":"2024-09-12T00:15:57.051976+0000","last_became_peered":"2024-09-12T00:15:57.051976+0000","last_unstale":"2024-09-12T01:02:10.883373+0000","last_undegraded":"2024-09-12T01:02:10.883373+0000","last_fullsized":"2024-09-12T01:02:10.883373+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":800,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:02.396896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4749,"num_read_kb":4328,"num_write":1184,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"268'343","reported_seq":971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.855626+0000","last_change":"2024-09-12T00:15:55.060643+0000","last_active":"2024-09-12T01:02:39.855626+0000","last_peered":"2024-09-12T01:02:39.855626+0000","last_clean":"2024-09-12T01:02:39.855626+0000","last_became_active":"2024-09-12T00:15:55.055449+0000","last_became_peered":"2024-09-12T00:15:55.055449+0000","last_unstale":"2024-09-12T01:02:39.855626+0000","last_undegraded":"2024-09-12T01:02:39.855626+0000","last_fullsized":"2024-09-12T01:02:39.855626+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:27.185874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":2263,"num_write":1082,"num_write_kb":24139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"268'787","reported_seq":2366,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.160044+0000","last_change":"2024-09-12T00:15:57.033089+0000","last_active":"2024-09-12T01:01:02.160044+0000","last_peered":"2024-09-12T01:01:02.160044+0000","last_clean":"2024-09-12T01:01:02.160044+0000","last_became_active":"2024-09-12T00:15:57.031976+0000","last_became_peered":"2024-09-12T00:15:57.031976+0000","last_unstale":"2024-09-12T01:01:02.160044+0000","last_undegraded":"2024-09-12T01:01:02.160044+0000","last_fullsized":"2024-09-12T01:01:02.160044+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:30.528175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3862,"num_read_kb":3503,"num_write":1033,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"268'359","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.961502+0000","last_change":"2024-09-12T00:15:55.052989+0000","last_active":"2024-09-12T01:02:39.961502+0000","last_peered":"2024-09-12T01:02:39.961502+0000","last_clean":"2024-09-12T01:02:39.961502+0000","last_became_active":"2024-09-12T00:15:55.051451+0000","last_became_peered":"2024-09-12T00:15:55.051451+0000","last_unstale":"2024-09-12T01:02:39.961502+0000","last_undegraded":"2024-09-12T01:02:39.961502+0000","last_fullsized":"2024-09-12T01:02:39.961502+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:14.616053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263237,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":17816,"num_write":1180,"num_write_kb":26945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"268'483","reported_seq":2159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:58.205844+0000","last_change":"2024-09-12T00:15:57.020535+0000","last_active":"2024-09-12T01:00:58.205844+0000","last_peered":"2024-09-12T01:00:58.205844+0000","last_clean":"2024-09-12T01:00:58.205844+0000","last_became_active":"2024-09-12T00:15:57.019963+0000","last_became_peered":"2024-09-12T00:15:57.019963+0000","last_unstale":"2024-09-12T01:00:58.205844+0000","last_undegraded":"2024-09-12T01:00:58.205844+0000","last_fullsized":"2024-09-12T01:00:58.205844+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:34.340309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2585,"num_read_kb":2455,"num_write":555,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"268'290","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.803537+0000","last_change":"2024-09-12T00:15:55.051310+0000","last_active":"2024-09-12T01:02:39.803537+0000","last_peered":"2024-09-12T01:02:39.803537+0000","last_clean":"2024-09-12T01:02:39.803537+0000","last_became_active":"2024-09-12T00:15:55.050267+0000","last_became_peered":"2024-09-12T00:15:55.050267+0000","last_unstale":"2024-09-12T01:02:39.803537+0000","last_undegraded":"2024-09-12T01:02:39.803537+0000","last_fullsized":"2024-09-12T01:02:39.803537+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:25.710871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":8617,"num_write":1019,"num_write_kb":22964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1339","reported_seq":3149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.016786+0000","last_change":"2024-09-12T00:15:57.045427+0000","last_active":"2024-09-12T01:00:47.016786+0000","last_peered":"2024-09-12T01:00:47.016786+0000","last_clean":"2024-09-12T01:00:47.016786+0000","last_became_active":"2024-09-12T00:15:57.045076+0000","last_became_peered":"2024-09-12T00:15:57.045076+0000","last_unstale":"2024-09-12T01:00:47.016786+0000","last_undegraded":"2024-09-12T01:00:47.016786+0000","last_fullsized":"2024-09-12T01:00:47.016786+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:48.293590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6209,"num_read_kb":5540,"num_write":1861,"num_write_kb":794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"268'321","reported_seq":959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.902315+0000","last_change":"2024-09-12T00:15:55.065995+0000","last_active":"2024-09-12T01:02:39.902315+0000","last_peered":"2024-09-12T01:02:39.902315+0000","last_clean":"2024-09-12T01:02:39.902315+0000","last_became_active":"2024-09-12T00:15:55.061287+0000","last_became_peered":"2024-09-12T00:15:55.061287+0000","last_unstale":"2024-09-12T01:02:39.902315+0000","last_undegraded":"2024-09-12T01:02:39.902315+0000","last_fullsized":"2024-09-12T01:02:39.902315+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:58.543361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":733,"num_write":1216,"num_write_kb":3677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"268'404","reported_seq":1771,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:51.103353+0000","last_change":"2024-09-12T00:15:57.043968+0000","last_active":"2024-09-12T01:00:51.103353+0000","last_peered":"2024-09-12T01:00:51.103353+0000","last_clean":"2024-09-12T01:00:51.103353+0000","last_became_active":"2024-09-12T00:15:57.043158+0000","last_became_peered":"2024-09-12T00:15:57.043158+0000","last_unstale":"2024-09-12T01:00:51.103353+0000","last_undegraded":"2024-09-12T01:00:51.103353+0000","last_fullsized":"2024-09-12T01:00:51.103353+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:06.171447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1978,"num_read_kb":1859,"num_write":462,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"268'386","reported_seq":1072,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.795373+0000","last_change":"2024-09-12T00:15:55.059249+0000","last_active":"2024-09-12T01:02:39.795373+0000","last_peered":"2024-09-12T01:02:39.795373+0000","last_clean":"2024-09-12T01:02:39.795373+0000","last_became_active":"2024-09-12T00:15:55.058726+0000","last_became_peered":"2024-09-12T00:15:55.058726+0000","last_unstale":"2024-09-12T01:02:39.795373+0000","last_undegraded":"2024-09-12T01:02:39.795373+0000","last_fullsized":"2024-09-12T01:02:39.795373+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:59.008674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549415,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":603,"num_read_kb":57120,"num_write":1303,"num_write_kb":58223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"268'1341","reported_seq":2827,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:53.114495+0000","last_change":"2024-09-12T00:15:57.045207+0000","last_active":"2024-09-12T01:00:53.114495+0000","last_peered":"2024-09-12T01:00:53.114495+0000","last_clean":"2024-09-12T01:00:53.114495+0000","last_became_active":"2024-09-12T00:15:57.043227+0000","last_became_peered":"2024-09-12T00:15:57.043227+0000","last_unstale":"2024-09-12T01:00:53.114495+0000","last_undegraded":"2024-09-12T01:00:53.114495+0000","last_fullsized":"2024-09-12T01:00:53.114495+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":1300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:40.677355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5913,"num_read_kb":5121,"num_write":1910,"num_write_kb":821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"268'294","reported_seq":936,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.935801+0000","last_change":"2024-09-12T00:15:55.053474+0000","last_active":"2024-09-12T01:02:39.935801+0000","last_peered":"2024-09-12T01:02:39.935801+0000","last_clean":"2024-09-12T01:02:39.935801+0000","last_became_active":"2024-09-12T00:15:55.052287+0000","last_became_peered":"2024-09-12T00:15:55.052287+0000","last_unstale":"2024-09-12T01:02:39.935801+0000","last_undegraded":"2024-09-12T01:02:39.935801+0000","last_fullsized":"2024-09-12T01:02:39.935801+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:48.478932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947345,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":476,"num_read_kb":19752,"num_write":916,"num_write_kb":40992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"268'335","reported_seq":1745,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.870604+0000","last_change":"2024-09-12T00:15:57.039951+0000","last_active":"2024-09-12T01:02:10.870604+0000","last_peered":"2024-09-12T01:02:10.870604+0000","last_clean":"2024-09-12T01:02:10.870604+0000","last_became_active":"2024-09-12T00:15:57.039633+0000","last_became_peered":"2024-09-12T00:15:57.039633+0000","last_unstale":"2024-09-12T01:02:10.870604+0000","last_undegraded":"2024-09-12T01:02:10.870604+0000","last_fullsized":"2024-09-12T01:02:10.870604+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:29.316323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1924,"num_read_kb":1842,"num_write":397,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"268'332","reported_seq":1014,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.955483+0000","last_change":"2024-09-12T00:15:55.055642+0000","last_active":"2024-09-12T01:02:39.955483+0000","last_peered":"2024-09-12T01:02:39.955483+0000","last_clean":"2024-09-12T01:02:39.955483+0000","last_became_active":"2024-09-12T00:15:55.054952+0000","last_became_peered":"2024-09-12T00:15:55.054952+0000","last_unstale":"2024-09-12T01:02:39.955483+0000","last_undegraded":"2024-09-12T01:02:39.955483+0000","last_fullsized":"2024-09-12T01:02:39.955483+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:10.159478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109426,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":117939,"num_write":959,"num_write_kb":46136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"268'394","reported_seq":1052,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.895271+0000","last_change":"2024-09-12T00:15:55.053129+0000","last_active":"2024-09-12T01:02:39.895271+0000","last_peered":"2024-09-12T01:02:39.895271+0000","last_clean":"2024-09-12T01:02:39.895271+0000","last_became_active":"2024-09-12T00:15:55.052320+0000","last_became_peered":"2024-09-12T00:15:55.052320+0000","last_unstale":"2024-09-12T01:02:39.895271+0000","last_undegraded":"2024-09-12T01:02:39.895271+0000","last_fullsized":"2024-09-12T01:02:39.895271+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:04.001879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":13865,"num_write":1350,"num_write_kb":55041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"268'475","reported_seq":2091,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.171239+0000","last_change":"2024-09-12T00:15:57.055663+0000","last_active":"2024-09-12T01:00:52.171239+0000","last_peered":"2024-09-12T01:00:52.171239+0000","last_clean":"2024-09-12T01:00:52.171239+0000","last_became_active":"2024-09-12T00:15:57.054996+0000","last_became_peered":"2024-09-12T00:15:57.054996+0000","last_unstale":"2024-09-12T01:00:52.171239+0000","last_undegraded":"2024-09-12T01:00:52.171239+0000","last_fullsized":"2024-09-12T01:00:52.171239+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:56.476228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2784,"num_read_kb":2618,"num_write":619,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"268'328","reported_seq":947,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.962525+0000","last_change":"2024-09-12T00:15:55.079679+0000","last_active":"2024-09-12T01:02:39.962525+0000","last_peered":"2024-09-12T01:02:39.962525+0000","last_clean":"2024-09-12T01:02:39.962525+0000","last_became_active":"2024-09-12T00:15:55.078832+0000","last_became_peered":"2024-09-12T00:15:55.078832+0000","last_unstale":"2024-09-12T01:02:39.962525+0000","last_undegraded":"2024-09-12T01:02:39.962525+0000","last_fullsized":"2024-09-12T01:02:39.962525+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:54.215633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262198,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":33208,"num_write":990,"num_write_kb":34373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"268'950","reported_seq":2368,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:53.114798+0000","last_change":"2024-09-12T00:15:57.027951+0000","last_active":"2024-09-12T01:00:53.114798+0000","last_peered":"2024-09-12T01:00:53.114798+0000","last_clean":"2024-09-12T01:00:53.114798+0000","last_became_active":"2024-09-12T00:15:57.027565+0000","last_became_peered":"2024-09-12T00:15:57.027565+0000","last_unstale":"2024-09-12T01:00:53.114798+0000","last_undegraded":"2024-09-12T01:00:53.114798+0000","last_fullsized":"2024-09-12T01:00:53.114798+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":900,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:55.130874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4238,"num_read_kb":3802,"num_write":1335,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6185,"num_read_kb":4382,"num_write":1972,"num_write_kb":869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1043,"ondisk_log_size":1043,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15033,"num_read_kb":14688,"num_write":16727,"num_write_kb":4883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1560,"ondisk_log_size":1560,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":505,"ondisk_log_size":505,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1515596,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":17695,"num_read_kb":36825,"num_write":14793,"num_write_kb":11553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1797,"ondisk_log_size":1797,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2876,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212032,"num_read_kb":193923,"num_write":55063,"num_write_kb":18681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4050,"ondisk_log_size":4050,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":91096211,"num_objects":373,"num_object_clones":0,"num_object_copies":1492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":373,"num_whiteouts":0,"num_read":36044,"num_read_kb":1967370,"num_write":71560,"num_write_kb":2158407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":123895808,"data_stored":123895808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3636,"ondisk_log_size":3636,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":197046,"num_write":158,"num_write_kb":127402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":185778,"num_write":158,"num_write_kb":127402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719477305,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249276,"kb_used_data":19380,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122564,"statfs":{"total":96636764160,"available":96381505536,"internally_reserved":0,"allocated":19845120,"data_stored":17804594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3,6,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510012,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114892,"kb_used_data":15536,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94256948,"statfs":{"total":96636764160,"available":96519114752,"internally_reserved":0,"allocated":15908864,"data_stored":13884114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510010,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248836,"kb_used_data":18844,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94123004,"statfs":{"total":96636764160,"available":96381956096,"internally_reserved":0,"allocated":19296256,"data_stored":17280849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235141573},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510012,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189396,"kb_used_data":23472,"kb_used_omap":1,"kb_used_meta":165822,"kb_avail":94182444,"statfs":{"total":96636764160,"available":96442822656,"internally_reserved":0,"allocated":24035328,"data_stored":22022383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169802181},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510011,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":346964,"kb_used_data":18492,"kb_used_omap":1,"kb_used_meta":328254,"kb_avail":94024876,"statfs":{"total":96636764160,"available":96281473024,"internally_reserved":0,"allocated":18935808,"data_stored":16894352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":336132549},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510010,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":151040,"kb_used_data":21276,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94220800,"statfs":{"total":96636764160,"available":96482099200,"internally_reserved":0,"allocated":21786624,"data_stored":19750277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542716,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":267020,"kb_used_data":19016,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":94104820,"statfs":{"total":96636764160,"available":96363335680,"internally_reserved":0,"allocated":19472384,"data_stored":17479323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":253622730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542714,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281344,"kb_used_data":19560,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94090496,"statfs":{"total":96636764160,"available":96348667904,"internally_reserved":0,"allocated":20029440,"data_stored":18004914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17494016,"data_stored":17494016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14049280,"data_stored":14049280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19767296,"data_stored":19767296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15548416,"data_stored":15548416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15024128,"data_stored":15024128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15159296,"data_stored":15159296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11628544,"data_stored":11628544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15224832,"data_stored":15224832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:02:47.639 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.639 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.639 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.640 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.640 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.640 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.640 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.640 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.640 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.640 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.640 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.640 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.641 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.641 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.641 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.641 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.641 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.641 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.641 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.641 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.641 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.642 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.642 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.642 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.642 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.642 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.642 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.642 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.642 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.643 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.643 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.643 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.643 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.643 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.643 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.643 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.643 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.643 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.644 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.644 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.644 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.644 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.644 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.644 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.644 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.644 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.644 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.645 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.645 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.645 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.645 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.645 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.645 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.645 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.645 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.645 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.645 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.646 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.646 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.646 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.646 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.646 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.646 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.646 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.646 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.646 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.647 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.647 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.647 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.647 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.647 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.647 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.647 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.647 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.647 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.648 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.648 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.648 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.648 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.648 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.648 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.648 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.648 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.648 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.648 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.649 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.649 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.649 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.649 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.649 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.649 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.649 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.649 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.650 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.650 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.650 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.650 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.650 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.650 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.650 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.650 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.650 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.651 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.651 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.651 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.651 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.651 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.651 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.651 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.651 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.651 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.652 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.652 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.652 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.652 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.652 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.652 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.652 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.652 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.652 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.652 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.653 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.653 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.653 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.653 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.653 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.653 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.653 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.653 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.654 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.654 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.654 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.654 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.654 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.654 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.654 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.654 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.654 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.655 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.655 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.655 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.655 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.655 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.655 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.655 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.655 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.655 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.656 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.656 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.656 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.656 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.656 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.656 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.656 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.656 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.656 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.656 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.657 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.657 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.657 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.657 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.657 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.657 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.657 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.657 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.658 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.658 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.658 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.658 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.658 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.658 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.658 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.658 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.658 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.659 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.659 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.659 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.659 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.659 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.659 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.659 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.659 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.659 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.659 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.660 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.660 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.660 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.660 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.660 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.660 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.660 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.660 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.660 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.661 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.661 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.661 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.661 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.661 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.661 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.661 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.661 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.662 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.662 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.662 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.662 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.662 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.662 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.662 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.662 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.662 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.663 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.663 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.663 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.663 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.663 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.663 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.663 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.663 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.663 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.664 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.664 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.664 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.664 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.664 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.664 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.664 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.664 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.665 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.665 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.665 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T00:15:33.032265+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.665 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T00:15:39.065077+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.665 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.665 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.665 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.665 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.666 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.666 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.666 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T00:15:39.065077+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.666 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.666 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.666 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.666 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.666 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.666 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.667 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T00:15:39.065077+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.667 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.667 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.667 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.667 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.667 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.667 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.667 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T00:15:39.065077+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.667 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.667 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.668 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.668 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.668 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.668 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.668 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.668 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T00:15:39.065077+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.668 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.668 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.669 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.669 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.669 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.669 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.669 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T00:15:39.065077+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.669 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.669 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.669 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.670 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.670 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.670 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.670 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T00:15:39.065077+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.670 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.670 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.670 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.670 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.670 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.671 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.671 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T00:15:39.065077+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=39, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.671 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.671 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.671 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.671 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.671 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.671 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.671 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.672 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.672 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.672 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.672 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.672 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.672 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.672 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.672 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.673 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.673 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.673 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.673 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.673 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.673 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.673 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.673 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.673 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.674 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.674 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.674 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.674 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.674 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.674 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.674 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.674 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.675 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.675 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.675 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.675 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.675 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.675 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.675 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.675 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.675 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.675 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.676 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.676 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.676 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.676 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.676 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.676 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.676 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.676 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.676 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.677 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.677 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.677 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.677 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.677 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.677 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.677 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.677 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.678 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.678 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.678 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.678 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.678 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.678 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.678 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.678 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.678 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.679 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.679 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.679 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.679 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.679 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.679 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.679 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.679 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.679 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.679 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.680 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.680 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.680 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.680 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.680 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.680 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.680 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.680 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.680 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.681 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.681 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.681 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.681 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.681 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.681 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.681 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.681 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.681 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.682 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.682 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.682 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.682 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.682 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.682 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.682 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.682 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.682 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.682 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.683 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.683 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.683 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.683 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.683 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.683 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:02:47.683 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:03:07.684 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:03:08.054 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:03:08.067 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-12T01:03:08.076 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":1688,"stamp":"2024-09-12T01:03:06.833288+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":93219632,"num_objects":867,"num_object_clones":0,"num_object_copies":2480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":867,"num_whiteouts":0,"num_read":289757,"num_read_kb":2602955,"num_write":160574,"num_write_kb":2450853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":550690,"num_omap_keys":1314,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13042,"ondisk_log_size":13042,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1855672,"kb_used_data":155576,"kb_used_omap":12,"kb_used_meta":1699955,"kb_avail":753119048,"statfs":{"total":773094113280,"available":771193905152,"internally_reserved":0,"allocated":159309824,"data_stored":143120806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1740754480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":545113,"num_omap_keys":1292,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009703"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.173833+0000","last_change":"2024-09-12T00:43:48.284274+0000","last_active":"2024-09-12T00:58:48.173833+0000","last_peered":"2024-09-12T00:58:48.173833+0000","last_clean":"2024-09-12T00:58:48.173833+0000","last_became_active":"2024-09-12T00:43:48.282777+0000","last_became_peered":"2024-09-12T00:43:48.282777+0000","last_unstale":"2024-09-12T00:58:48.173833+0000","last_undegraded":"2024-09-12T00:58:48.173833+0000","last_fullsized":"2024-09-12T00:58:48.173833+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:26.885566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"268'2","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:28.222443+0000","last_change":"2024-09-12T00:32:28.070403+0000","last_active":"2024-09-12T01:02:28.222443+0000","last_peered":"2024-09-12T01:02:28.222443+0000","last_clean":"2024-09-12T01:02:28.222443+0000","last_became_active":"2024-09-12T00:32:28.069841+0000","last_became_peered":"2024-09-12T00:32:28.069841+0000","last_unstale":"2024-09-12T01:02:28.222443+0000","last_undegraded":"2024-09-12T01:02:28.222443+0000","last_fullsized":"2024-09-12T01:02:28.222443+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:32.102006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.181946+0000","last_change":"2024-09-12T00:32:25.027280+0000","last_active":"2024-09-12T00:59:57.181946+0000","last_peered":"2024-09-12T00:59:57.181946+0000","last_clean":"2024-09-12T00:59:57.181946+0000","last_became_active":"2024-09-12T00:32:25.026726+0000","last_became_peered":"2024-09-12T00:32:25.026726+0000","last_unstale":"2024-09-12T00:59:57.181946+0000","last_undegraded":"2024-09-12T00:59:57.181946+0000","last_fullsized":"2024-09-12T00:59:57.181946+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:47.659267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"268'31","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.187370+0000","last_change":"2024-09-12T00:30:51.544593+0000","last_active":"2024-09-12T01:00:03.187370+0000","last_peered":"2024-09-12T01:00:03.187370+0000","last_clean":"2024-09-12T01:00:03.187370+0000","last_became_active":"2024-09-12T00:30:51.543858+0000","last_became_peered":"2024-09-12T00:30:51.543858+0000","last_unstale":"2024-09-12T01:00:03.187370+0000","last_undegraded":"2024-09-12T01:00:03.187370+0000","last_fullsized":"2024-09-12T01:00:03.187370+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:38.568158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":120,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.161958+0000","last_change":"2024-09-12T00:43:48.286931+0000","last_active":"2024-09-12T00:58:48.161958+0000","last_peered":"2024-09-12T00:58:48.161958+0000","last_clean":"2024-09-12T00:58:48.161958+0000","last_became_active":"2024-09-12T00:43:48.286291+0000","last_became_peered":"2024-09-12T00:43:48.286291+0000","last_unstale":"2024-09-12T00:58:48.161958+0000","last_undegraded":"2024-09-12T00:58:48.161958+0000","last_fullsized":"2024-09-12T00:58:48.161958+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:17.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.190647+0000","last_change":"2024-09-12T00:32:28.070732+0000","last_active":"2024-09-12T00:59:58.190647+0000","last_peered":"2024-09-12T00:59:58.190647+0000","last_clean":"2024-09-12T00:59:58.190647+0000","last_became_active":"2024-09-12T00:32:28.070091+0000","last_became_peered":"2024-09-12T00:32:28.070091+0000","last_unstale":"2024-09-12T00:59:58.190647+0000","last_undegraded":"2024-09-12T00:59:58.190647+0000","last_fullsized":"2024-09-12T00:59:58.190647+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:33.762789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.206709+0000","last_change":"2024-09-12T00:32:25.024486+0000","last_active":"2024-09-12T00:59:57.206709+0000","last_peered":"2024-09-12T00:59:57.206709+0000","last_clean":"2024-09-12T00:59:57.206709+0000","last_became_active":"2024-09-12T00:32:25.023750+0000","last_became_peered":"2024-09-12T00:32:25.023750+0000","last_unstale":"2024-09-12T00:59:57.206709+0000","last_undegraded":"2024-09-12T00:59:57.206709+0000","last_fullsized":"2024-09-12T00:59:57.206709+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:12.053492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"268'20","reported_seq":98,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.984591+0000","last_change":"2024-09-12T00:30:51.555569+0000","last_active":"2024-09-12T01:01:02.984591+0000","last_peered":"2024-09-12T01:01:02.984591+0000","last_clean":"2024-09-12T01:01:02.984591+0000","last_became_active":"2024-09-12T00:30:51.554875+0000","last_became_peered":"2024-09-12T00:30:51.554875+0000","last_unstale":"2024-09-12T01:01:02.984591+0000","last_undegraded":"2024-09-12T01:01:02.984591+0000","last_fullsized":"2024-09-12T01:01:02.984591+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":61,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:18.166602+0000","last_change":"2024-09-12T00:43:48.271637+0000","last_active":"2024-09-12T00:58:18.166602+0000","last_peered":"2024-09-12T00:58:18.166602+0000","last_clean":"2024-09-12T00:58:18.166602+0000","last_became_active":"2024-09-12T00:43:48.270700+0000","last_became_peered":"2024-09-12T00:43:48.270700+0000","last_unstale":"2024-09-12T00:58:18.166602+0000","last_undegraded":"2024-09-12T00:58:18.166602+0000","last_fullsized":"2024-09-12T00:58:18.166602+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:41.349025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"268'3","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:42.008400+0000","last_change":"2024-09-12T00:32:28.078229+0000","last_active":"2024-09-12T01:01:42.008400+0000","last_peered":"2024-09-12T01:01:42.008400+0000","last_clean":"2024-09-12T01:01:42.008400+0000","last_became_active":"2024-09-12T00:32:28.065497+0000","last_became_peered":"2024-09-12T00:32:28.065497+0000","last_unstale":"2024-09-12T01:01:42.008400+0000","last_undegraded":"2024-09-12T01:01:42.008400+0000","last_fullsized":"2024-09-12T01:01:42.008400+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:04.479825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"268'5","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.830875+0000","last_change":"2024-09-12T00:32:25.002095+0000","last_active":"2024-09-12T01:02:37.830875+0000","last_peered":"2024-09-12T01:02:37.830875+0000","last_clean":"2024-09-12T01:02:37.830875+0000","last_became_active":"2024-09-12T00:32:25.001290+0000","last_became_peered":"2024-09-12T00:32:25.001290+0000","last_unstale":"2024-09-12T01:02:37.830875+0000","last_undegraded":"2024-09-12T01:02:37.830875+0000","last_fullsized":"2024-09-12T01:02:37.830875+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:20.950634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"268'25","reported_seq":109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:02.981579+0000","last_change":"2024-09-12T00:30:51.546159+0000","last_active":"2024-09-12T01:00:02.981579+0000","last_peered":"2024-09-12T01:00:02.981579+0000","last_clean":"2024-09-12T01:00:02.981579+0000","last_became_active":"2024-09-12T00:30:51.544751+0000","last_became_peered":"2024-09-12T00:30:51.544751+0000","last_unstale":"2024-09-12T01:00:02.981579+0000","last_undegraded":"2024-09-12T01:00:02.981579+0000","last_fullsized":"2024-09-12T01:00:02.981579+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:47.192663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":82,"num_write":61,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:27.183725+0000","last_change":"2024-09-12T00:43:48.280902+0000","last_active":"2024-09-12T00:58:27.183725+0000","last_peered":"2024-09-12T00:58:27.183725+0000","last_clean":"2024-09-12T00:58:27.183725+0000","last_became_active":"2024-09-12T00:43:48.280166+0000","last_became_peered":"2024-09-12T00:43:48.280166+0000","last_unstale":"2024-09-12T00:58:27.183725+0000","last_undegraded":"2024-09-12T00:58:27.183725+0000","last_fullsized":"2024-09-12T00:58:27.183725+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:30.937177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.992420+0000","last_change":"2024-09-12T00:32:28.078675+0000","last_active":"2024-09-12T01:00:41.992420+0000","last_peered":"2024-09-12T01:00:41.992420+0000","last_clean":"2024-09-12T01:00:41.992420+0000","last_became_active":"2024-09-12T00:32:28.073988+0000","last_became_peered":"2024-09-12T00:32:28.073988+0000","last_unstale":"2024-09-12T01:00:41.992420+0000","last_undegraded":"2024-09-12T01:00:41.992420+0000","last_fullsized":"2024-09-12T01:00:41.992420+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:09.276835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185184+0000","last_change":"2024-09-12T00:32:25.008128+0000","last_active":"2024-09-12T00:59:33.185184+0000","last_peered":"2024-09-12T00:59:33.185184+0000","last_clean":"2024-09-12T00:59:33.185184+0000","last_became_active":"2024-09-12T00:32:25.007732+0000","last_became_peered":"2024-09-12T00:32:25.007732+0000","last_unstale":"2024-09-12T00:59:33.185184+0000","last_undegraded":"2024-09-12T00:59:33.185184+0000","last_fullsized":"2024-09-12T00:59:33.185184+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:28.829369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"268'61","reported_seq":203,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.690930+0000","last_change":"2024-09-12T00:30:51.552185+0000","last_active":"2024-09-12T00:59:57.690930+0000","last_peered":"2024-09-12T00:59:57.690930+0000","last_clean":"2024-09-12T00:59:57.690930+0000","last_became_active":"2024-09-12T00:30:51.551417+0000","last_became_peered":"2024-09-12T00:30:51.551417+0000","last_unstale":"2024-09-12T00:59:57.690930+0000","last_undegraded":"2024-09-12T00:59:57.690930+0000","last_fullsized":"2024-09-12T00:59:57.690930+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:45.506758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":214,"num_write":108,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.182039+0000","last_change":"2024-09-12T00:43:48.284245+0000","last_active":"2024-09-12T00:59:57.182039+0000","last_peered":"2024-09-12T00:59:57.182039+0000","last_clean":"2024-09-12T00:59:57.182039+0000","last_became_active":"2024-09-12T00:43:48.283357+0000","last_became_peered":"2024-09-12T00:43:48.283357+0000","last_unstale":"2024-09-12T00:59:57.182039+0000","last_undegraded":"2024-09-12T00:59:57.182039+0000","last_fullsized":"2024-09-12T00:59:57.182039+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.113641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"268'5","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:38.003769+0000","last_change":"2024-09-12T00:32:28.054309+0000","last_active":"2024-09-12T01:01:38.003769+0000","last_peered":"2024-09-12T01:01:38.003769+0000","last_clean":"2024-09-12T01:01:38.003769+0000","last_became_active":"2024-09-12T00:32:28.053541+0000","last_became_peered":"2024-09-12T00:32:28.053541+0000","last_unstale":"2024-09-12T01:01:38.003769+0000","last_undegraded":"2024-09-12T01:01:38.003769+0000","last_fullsized":"2024-09-12T01:01:38.003769+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:40.456715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"268'3","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:27.004021+0000","last_change":"2024-09-12T00:32:25.015629+0000","last_active":"2024-09-12T01:01:27.004021+0000","last_peered":"2024-09-12T01:01:27.004021+0000","last_clean":"2024-09-12T01:01:27.004021+0000","last_became_active":"2024-09-12T00:32:25.014665+0000","last_became_peered":"2024-09-12T00:32:25.014665+0000","last_unstale":"2024-09-12T01:01:27.004021+0000","last_undegraded":"2024-09-12T01:01:27.004021+0000","last_fullsized":"2024-09-12T01:01:27.004021+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:46.651960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"268'40","reported_seq":154,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:23.156361+0000","last_change":"2024-09-12T00:30:51.549303+0000","last_active":"2024-09-12T00:58:23.156361+0000","last_peered":"2024-09-12T00:58:23.156361+0000","last_clean":"2024-09-12T00:58:23.156361+0000","last_became_active":"2024-09-12T00:30:51.547784+0000","last_became_peered":"2024-09-12T00:30:51.547784+0000","last_unstale":"2024-09-12T00:58:23.156361+0000","last_undegraded":"2024-09-12T00:58:23.156361+0000","last_fullsized":"2024-09-12T00:58:23.156361+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:29.971436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":150,"num_write":68,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.192933+0000","last_change":"2024-09-12T00:43:48.278102+0000","last_active":"2024-09-12T01:00:28.192933+0000","last_peered":"2024-09-12T01:00:28.192933+0000","last_clean":"2024-09-12T01:00:28.192933+0000","last_became_active":"2024-09-12T00:43:48.276078+0000","last_became_peered":"2024-09-12T00:43:48.276078+0000","last_unstale":"2024-09-12T01:00:28.192933+0000","last_undegraded":"2024-09-12T01:00:28.192933+0000","last_fullsized":"2024-09-12T01:00:28.192933+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:21.420479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"268'5","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.600193+0000","last_change":"2024-09-12T00:32:28.031279+0000","last_active":"2024-09-12T01:02:37.600193+0000","last_peered":"2024-09-12T01:02:37.600193+0000","last_clean":"2024-09-12T01:02:37.600193+0000","last_became_active":"2024-09-12T00:32:28.030520+0000","last_became_peered":"2024-09-12T00:32:28.030520+0000","last_unstale":"2024-09-12T01:02:37.600193+0000","last_undegraded":"2024-09-12T01:02:37.600193+0000","last_fullsized":"2024-09-12T01:02:37.600193+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:22.614081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"268'3","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:34.014371+0000","last_change":"2024-09-12T00:32:25.010515+0000","last_active":"2024-09-12T01:01:34.014371+0000","last_peered":"2024-09-12T01:01:34.014371+0000","last_clean":"2024-09-12T01:01:34.014371+0000","last_became_active":"2024-09-12T00:32:25.009898+0000","last_became_peered":"2024-09-12T00:32:25.009898+0000","last_unstale":"2024-09-12T01:01:34.014371+0000","last_undegraded":"2024-09-12T01:01:34.014371+0000","last_fullsized":"2024-09-12T01:01:34.014371+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:26.343687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"268'22","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:23.166566+0000","last_change":"2024-09-12T00:30:51.560284+0000","last_active":"2024-09-12T00:58:23.166566+0000","last_peered":"2024-09-12T00:58:23.166566+0000","last_clean":"2024-09-12T00:58:23.166566+0000","last_became_active":"2024-09-12T00:30:51.559544+0000","last_became_peered":"2024-09-12T00:30:51.559544+0000","last_unstale":"2024-09-12T00:58:23.166566+0000","last_undegraded":"2024-09-12T00:58:23.166566+0000","last_fullsized":"2024-09-12T00:58:23.166566+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:21.732816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":79,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.173552+0000","last_change":"2024-09-12T00:43:48.283455+0000","last_active":"2024-09-12T00:58:48.173552+0000","last_peered":"2024-09-12T00:58:48.173552+0000","last_clean":"2024-09-12T00:58:48.173552+0000","last_became_active":"2024-09-12T00:43:48.283057+0000","last_became_peered":"2024-09-12T00:43:48.283057+0000","last_unstale":"2024-09-12T00:58:48.173552+0000","last_undegraded":"2024-09-12T00:58:48.173552+0000","last_fullsized":"2024-09-12T00:58:48.173552+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:33.410879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.190602+0000","last_change":"2024-09-12T00:32:28.066260+0000","last_active":"2024-09-12T00:59:58.190602+0000","last_peered":"2024-09-12T00:59:58.190602+0000","last_clean":"2024-09-12T00:59:58.190602+0000","last_became_active":"2024-09-12T00:32:28.065376+0000","last_became_peered":"2024-09-12T00:32:28.065376+0000","last_unstale":"2024-09-12T00:59:58.190602+0000","last_undegraded":"2024-09-12T00:59:58.190602+0000","last_fullsized":"2024-09-12T00:59:58.190602+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:37.216971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"268'3","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:28.013438+0000","last_change":"2024-09-12T00:32:25.000290+0000","last_active":"2024-09-12T01:02:28.013438+0000","last_peered":"2024-09-12T01:02:28.013438+0000","last_clean":"2024-09-12T01:02:28.013438+0000","last_became_active":"2024-09-12T00:32:24.999604+0000","last_became_peered":"2024-09-12T00:32:24.999604+0000","last_unstale":"2024-09-12T01:02:28.013438+0000","last_undegraded":"2024-09-12T01:02:28.013438+0000","last_fullsized":"2024-09-12T01:02:28.013438+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:52.889640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"268'41","reported_seq":153,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:04.255372+0000","last_change":"2024-09-12T00:30:51.557465+0000","last_active":"2024-09-12T01:00:04.255372+0000","last_peered":"2024-09-12T01:00:04.255372+0000","last_clean":"2024-09-12T01:00:04.255372+0000","last_became_active":"2024-09-12T00:30:51.556729+0000","last_became_peered":"2024-09-12T00:30:51.556729+0000","last_unstale":"2024-09-12T01:00:04.255372+0000","last_undegraded":"2024-09-12T01:00:04.255372+0000","last_fullsized":"2024-09-12T01:00:04.255372+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:59.334180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":144,"num_write":69,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.174016+0000","last_change":"2024-09-12T00:43:48.282559+0000","last_active":"2024-09-12T00:58:48.174016+0000","last_peered":"2024-09-12T00:58:48.174016+0000","last_clean":"2024-09-12T00:58:48.174016+0000","last_became_active":"2024-09-12T00:43:48.281781+0000","last_became_peered":"2024-09-12T00:43:48.281781+0000","last_unstale":"2024-09-12T00:58:48.174016+0000","last_undegraded":"2024-09-12T00:58:48.174016+0000","last_fullsized":"2024-09-12T00:58:48.174016+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:09.023666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"268'5","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.600083+0000","last_change":"2024-09-12T00:32:28.063332+0000","last_active":"2024-09-12T01:02:37.600083+0000","last_peered":"2024-09-12T01:02:37.600083+0000","last_clean":"2024-09-12T01:02:37.600083+0000","last_became_active":"2024-09-12T00:32:28.062540+0000","last_became_peered":"2024-09-12T00:32:28.062540+0000","last_unstale":"2024-09-12T01:02:37.600083+0000","last_undegraded":"2024-09-12T01:02:37.600083+0000","last_fullsized":"2024-09-12T01:02:37.600083+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:19.133641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.179111+0000","last_change":"2024-09-12T00:32:25.021694+0000","last_active":"2024-09-12T00:59:58.179111+0000","last_peered":"2024-09-12T00:59:58.179111+0000","last_clean":"2024-09-12T00:59:58.179111+0000","last_became_active":"2024-09-12T00:32:25.017715+0000","last_became_peered":"2024-09-12T00:32:25.017715+0000","last_unstale":"2024-09-12T00:59:58.179111+0000","last_undegraded":"2024-09-12T00:59:58.179111+0000","last_fullsized":"2024-09-12T00:59:58.179111+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:02.525100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'8","reported_seq":65,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:53.178004+0000","last_change":"2024-09-12T00:30:51.547647+0000","last_active":"2024-09-12T00:59:53.178004+0000","last_peered":"2024-09-12T00:59:53.178004+0000","last_clean":"2024-09-12T00:59:53.178004+0000","last_became_active":"2024-09-12T00:30:51.546981+0000","last_became_peered":"2024-09-12T00:30:51.546981+0000","last_unstale":"2024-09-12T00:59:53.178004+0000","last_undegraded":"2024-09-12T00:59:53.178004+0000","last_fullsized":"2024-09-12T00:59:53.178004+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:52.873539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.210443+0000","last_change":"2024-09-12T00:43:48.273242+0000","last_active":"2024-09-12T01:00:12.210443+0000","last_peered":"2024-09-12T01:00:12.210443+0000","last_clean":"2024-09-12T01:00:12.210443+0000","last_became_active":"2024-09-12T00:43:48.272523+0000","last_became_peered":"2024-09-12T00:43:48.272523+0000","last_unstale":"2024-09-12T01:00:12.210443+0000","last_undegraded":"2024-09-12T01:00:12.210443+0000","last_fullsized":"2024-09-12T01:00:12.210443+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:58.897794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"268'9","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:27.204203+0000","last_change":"2024-09-12T00:32:28.069369+0000","last_active":"2024-09-12T01:01:27.204203+0000","last_peered":"2024-09-12T01:01:27.204203+0000","last_clean":"2024-09-12T01:01:27.204203+0000","last_became_active":"2024-09-12T00:32:28.062839+0000","last_became_peered":"2024-09-12T00:32:28.062839+0000","last_unstale":"2024-09-12T01:01:27.204203+0000","last_undegraded":"2024-09-12T01:01:27.204203+0000","last_fullsized":"2024-09-12T01:01:27.204203+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:52.354103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"268'4","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.334915+0000","last_change":"2024-09-12T00:32:25.005903+0000","last_active":"2024-09-12T01:02:39.334915+0000","last_peered":"2024-09-12T01:02:39.334915+0000","last_clean":"2024-09-12T01:02:39.334915+0000","last_became_active":"2024-09-12T00:32:25.005113+0000","last_became_peered":"2024-09-12T00:32:25.005113+0000","last_unstale":"2024-09-12T01:02:39.334915+0000","last_undegraded":"2024-09-12T01:02:39.334915+0000","last_fullsized":"2024-09-12T01:02:39.334915+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3076,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'62","reported_seq":220,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:53.184530+0000","last_change":"2024-09-12T00:30:51.542763+0000","last_active":"2024-09-12T00:59:53.184530+0000","last_peered":"2024-09-12T00:59:53.184530+0000","last_clean":"2024-09-12T00:59:53.184530+0000","last_became_active":"2024-09-12T00:30:51.541882+0000","last_became_peered":"2024-09-12T00:30:51.541882+0000","last_unstale":"2024-09-12T00:59:53.184530+0000","last_undegraded":"2024-09-12T00:59:53.184530+0000","last_fullsized":"2024-09-12T00:59:53.184530+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.614120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":254,"num_write":98,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.181831+0000","last_change":"2024-09-12T00:43:48.278782+0000","last_active":"2024-09-12T01:00:08.181831+0000","last_peered":"2024-09-12T01:00:08.181831+0000","last_clean":"2024-09-12T01:00:08.181831+0000","last_became_active":"2024-09-12T00:43:48.277883+0000","last_became_peered":"2024-09-12T00:43:48.277883+0000","last_unstale":"2024-09-12T01:00:08.181831+0000","last_undegraded":"2024-09-12T01:00:08.181831+0000","last_fullsized":"2024-09-12T01:00:08.181831+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:35.841252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'5","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.992292+0000","last_change":"2024-09-12T00:32:28.052092+0000","last_active":"2024-09-12T01:00:41.992292+0000","last_peered":"2024-09-12T01:00:41.992292+0000","last_clean":"2024-09-12T01:00:41.992292+0000","last_became_active":"2024-09-12T00:32:28.051364+0000","last_became_peered":"2024-09-12T00:32:28.051364+0000","last_unstale":"2024-09-12T01:00:41.992292+0000","last_undegraded":"2024-09-12T01:00:41.992292+0000","last_fullsized":"2024-09-12T01:00:41.992292+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5136,"num_write":10,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"268'2","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:28.002501+0000","last_change":"2024-09-12T00:32:25.009850+0000","last_active":"2024-09-12T01:01:28.002501+0000","last_peered":"2024-09-12T01:01:28.002501+0000","last_clean":"2024-09-12T01:01:28.002501+0000","last_became_active":"2024-09-12T00:32:25.009125+0000","last_became_peered":"2024-09-12T00:32:25.009125+0000","last_unstale":"2024-09-12T01:01:28.002501+0000","last_undegraded":"2024-09-12T01:01:28.002501+0000","last_fullsized":"2024-09-12T01:01:28.002501+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:33.665936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"268'31","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:53.184482+0000","last_change":"2024-09-12T00:30:51.555036+0000","last_active":"2024-09-12T00:59:53.184482+0000","last_peered":"2024-09-12T00:59:53.184482+0000","last_clean":"2024-09-12T00:59:53.184482+0000","last_became_active":"2024-09-12T00:30:51.553919+0000","last_became_peered":"2024-09-12T00:30:51.553919+0000","last_unstale":"2024-09-12T00:59:53.184482+0000","last_undegraded":"2024-09-12T00:59:53.184482+0000","last_fullsized":"2024-09-12T00:59:53.184482+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:07.977904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":104,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.195129+0000","last_change":"2024-09-12T00:43:48.289134+0000","last_active":"2024-09-12T01:00:08.195129+0000","last_peered":"2024-09-12T01:00:08.195129+0000","last_clean":"2024-09-12T01:00:08.195129+0000","last_became_active":"2024-09-12T00:43:48.288517+0000","last_became_peered":"2024-09-12T00:43:48.288517+0000","last_unstale":"2024-09-12T01:00:08.195129+0000","last_undegraded":"2024-09-12T01:00:08.195129+0000","last_fullsized":"2024-09-12T01:00:08.195129+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:05.171146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168160+0000","last_change":"2024-09-12T00:32:28.060574+0000","last_active":"2024-09-12T00:59:02.168160+0000","last_peered":"2024-09-12T00:59:02.168160+0000","last_clean":"2024-09-12T00:59:02.168160+0000","last_became_active":"2024-09-12T00:32:28.059869+0000","last_became_peered":"2024-09-12T00:32:28.059869+0000","last_unstale":"2024-09-12T00:59:02.168160+0000","last_undegraded":"2024-09-12T00:59:02.168160+0000","last_fullsized":"2024-09-12T00:59:02.168160+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:24.600878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168108+0000","last_change":"2024-09-12T00:32:25.027341+0000","last_active":"2024-09-12T00:59:02.168108+0000","last_peered":"2024-09-12T00:59:02.168108+0000","last_clean":"2024-09-12T00:59:02.168108+0000","last_became_active":"2024-09-12T00:32:25.026751+0000","last_became_peered":"2024-09-12T00:32:25.026751+0000","last_unstale":"2024-09-12T00:59:02.168108+0000","last_undegraded":"2024-09-12T00:59:02.168108+0000","last_fullsized":"2024-09-12T00:59:02.168108+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:19.648395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"268'24","reported_seq":111,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.286940+0000","last_change":"2024-09-12T00:30:51.548842+0000","last_active":"2024-09-12T01:00:03.286940+0000","last_peered":"2024-09-12T01:00:03.286940+0000","last_clean":"2024-09-12T01:00:03.286940+0000","last_became_active":"2024-09-12T00:30:51.548069+0000","last_became_peered":"2024-09-12T00:30:51.548069+0000","last_unstale":"2024-09-12T01:00:03.286940+0000","last_undegraded":"2024-09-12T01:00:03.286940+0000","last_fullsized":"2024-09-12T01:00:03.286940+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:24.452311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":85,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.194752+0000","last_change":"2024-09-12T00:43:48.276141+0000","last_active":"2024-09-12T01:00:08.194752+0000","last_peered":"2024-09-12T01:00:08.194752+0000","last_clean":"2024-09-12T01:00:08.194752+0000","last_became_active":"2024-09-12T00:43:48.274026+0000","last_became_peered":"2024-09-12T00:43:48.274026+0000","last_unstale":"2024-09-12T01:00:08.194752+0000","last_undegraded":"2024-09-12T01:00:08.194752+0000","last_fullsized":"2024-09-12T01:00:08.194752+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:53.384375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"268'2","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:28.002542+0000","last_change":"2024-09-12T00:32:28.063379+0000","last_active":"2024-09-12T01:01:28.002542+0000","last_peered":"2024-09-12T01:01:28.002542+0000","last_clean":"2024-09-12T01:01:28.002542+0000","last_became_active":"2024-09-12T00:32:28.062657+0000","last_became_peered":"2024-09-12T00:32:28.062657+0000","last_unstale":"2024-09-12T01:01:28.002542+0000","last_undegraded":"2024-09-12T01:01:28.002542+0000","last_fullsized":"2024-09-12T01:01:28.002542+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:10.594711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.192560+0000","last_change":"2024-09-12T00:32:24.997566+0000","last_active":"2024-09-12T00:59:02.192560+0000","last_peered":"2024-09-12T00:59:02.192560+0000","last_clean":"2024-09-12T00:59:02.192560+0000","last_became_active":"2024-09-12T00:32:24.996754+0000","last_became_peered":"2024-09-12T00:32:24.996754+0000","last_unstale":"2024-09-12T00:59:02.192560+0000","last_undegraded":"2024-09-12T00:59:02.192560+0000","last_fullsized":"2024-09-12T00:59:02.192560+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:55.566151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"268'26","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:59.211731+0000","last_change":"2024-09-12T00:30:51.551315+0000","last_active":"2024-09-12T00:58:59.211731+0000","last_peered":"2024-09-12T00:58:59.211731+0000","last_clean":"2024-09-12T00:58:59.211731+0000","last_became_active":"2024-09-12T00:30:51.545679+0000","last_became_peered":"2024-09-12T00:30:51.545679+0000","last_unstale":"2024-09-12T00:58:59.211731+0000","last_undegraded":"2024-09-12T00:58:59.211731+0000","last_fullsized":"2024-09-12T00:58:59.211731+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:48.283586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":84,"num_write":50,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:22.182350+0000","last_change":"2024-09-12T00:43:48.286291+0000","last_active":"2024-09-12T00:58:22.182350+0000","last_peered":"2024-09-12T00:58:22.182350+0000","last_clean":"2024-09-12T00:58:22.182350+0000","last_became_active":"2024-09-12T00:43:48.285657+0000","last_became_peered":"2024-09-12T00:43:48.285657+0000","last_unstale":"2024-09-12T00:58:22.182350+0000","last_undegraded":"2024-09-12T00:58:22.182350+0000","last_fullsized":"2024-09-12T00:58:22.182350+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:25.925943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"268'8","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.335677+0000","last_change":"2024-09-12T00:32:28.068135+0000","last_active":"2024-09-12T01:02:39.335677+0000","last_peered":"2024-09-12T01:02:39.335677+0000","last_clean":"2024-09-12T01:02:39.335677+0000","last_became_active":"2024-09-12T00:32:28.067168+0000","last_became_peered":"2024-09-12T00:32:28.067168+0000","last_unstale":"2024-09-12T01:02:39.335677+0000","last_undegraded":"2024-09-12T01:02:39.335677+0000","last_fullsized":"2024-09-12T01:02:39.335677+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"268'10","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.391502+0000","last_change":"2024-09-12T00:32:25.012858+0000","last_active":"2024-09-12T01:02:38.391502+0000","last_peered":"2024-09-12T01:02:38.391502+0000","last_clean":"2024-09-12T01:02:38.391502+0000","last_became_active":"2024-09-12T00:32:25.011944+0000","last_became_peered":"2024-09-12T00:32:25.011944+0000","last_unstale":"2024-09-12T01:02:38.391502+0000","last_undegraded":"2024-09-12T01:02:38.391502+0000","last_fullsized":"2024-09-12T01:02:38.391502+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":20800,"num_write":20,"num_write_kb":10558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"268'29","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:54.210368+0000","last_change":"2024-09-12T00:30:51.551466+0000","last_active":"2024-09-12T00:58:54.210368+0000","last_peered":"2024-09-12T00:58:54.210368+0000","last_clean":"2024-09-12T00:58:54.210368+0000","last_became_active":"2024-09-12T00:30:51.550694+0000","last_became_peered":"2024-09-12T00:30:51.550694+0000","last_unstale":"2024-09-12T00:58:54.210368+0000","last_undegraded":"2024-09-12T00:58:54.210368+0000","last_fullsized":"2024-09-12T00:58:54.210368+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:19.647721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:18.155457+0000","last_change":"2024-09-12T00:43:48.273326+0000","last_active":"2024-09-12T00:58:18.155457+0000","last_peered":"2024-09-12T00:58:18.155457+0000","last_clean":"2024-09-12T00:58:18.155457+0000","last_became_active":"2024-09-12T00:43:48.272356+0000","last_became_peered":"2024-09-12T00:43:48.272356+0000","last_unstale":"2024-09-12T00:58:18.155457+0000","last_undegraded":"2024-09-12T00:58:18.155457+0000","last_fullsized":"2024-09-12T00:58:18.155457+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:10.874661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"268'6","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.920927+0000","last_change":"2024-09-12T00:32:28.068097+0000","last_active":"2024-09-12T01:02:37.920927+0000","last_peered":"2024-09-12T01:02:37.920927+0000","last_clean":"2024-09-12T01:02:37.920927+0000","last_became_active":"2024-09-12T00:32:28.067388+0000","last_became_peered":"2024-09-12T00:32:28.067388+0000","last_unstale":"2024-09-12T01:02:37.920927+0000","last_undegraded":"2024-09-12T01:02:37.920927+0000","last_fullsized":"2024-09-12T01:02:37.920927+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:27.213718+0000","last_change":"2024-09-12T00:32:25.009043+0000","last_active":"2024-09-12T01:00:27.213718+0000","last_peered":"2024-09-12T01:00:27.213718+0000","last_clean":"2024-09-12T01:00:27.213718+0000","last_became_active":"2024-09-12T00:32:25.005882+0000","last_became_peered":"2024-09-12T00:32:25.005882+0000","last_unstale":"2024-09-12T01:00:27.213718+0000","last_undegraded":"2024-09-12T01:00:27.213718+0000","last_fullsized":"2024-09-12T01:00:27.213718+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"268'19","reported_seq":95,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:52.165743+0000","last_change":"2024-09-12T00:30:51.555200+0000","last_active":"2024-09-12T00:58:52.165743+0000","last_peered":"2024-09-12T00:58:52.165743+0000","last_clean":"2024-09-12T00:58:52.165743+0000","last_became_active":"2024-09-12T00:30:51.548932+0000","last_became_peered":"2024-09-12T00:30:51.548932+0000","last_unstale":"2024-09-12T00:58:52.165743+0000","last_undegraded":"2024-09-12T00:58:52.165743+0000","last_fullsized":"2024-09-12T00:58:52.165743+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:27.568202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.189591+0000","last_change":"2024-09-12T00:43:48.277526+0000","last_active":"2024-09-12T01:00:13.189591+0000","last_peered":"2024-09-12T01:00:13.189591+0000","last_clean":"2024-09-12T01:00:13.189591+0000","last_became_active":"2024-09-12T00:43:48.274983+0000","last_became_peered":"2024-09-12T00:43:48.274983+0000","last_unstale":"2024-09-12T01:00:13.189591+0000","last_undegraded":"2024-09-12T01:00:13.189591+0000","last_fullsized":"2024-09-12T01:00:13.189591+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:44.126353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"265'5","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:27.189286+0000","last_change":"2024-09-12T00:32:28.050796+0000","last_active":"2024-09-12T01:00:27.189286+0000","last_peered":"2024-09-12T01:00:27.189286+0000","last_clean":"2024-09-12T01:00:27.189286+0000","last_became_active":"2024-09-12T00:32:28.049947+0000","last_became_peered":"2024-09-12T00:32:28.049947+0000","last_unstale":"2024-09-12T01:00:27.189286+0000","last_undegraded":"2024-09-12T01:00:27.189286+0000","last_fullsized":"2024-09-12T01:00:27.189286+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:37.435116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.197798+0000","last_change":"2024-09-12T00:32:25.008845+0000","last_active":"2024-09-12T01:00:28.197798+0000","last_peered":"2024-09-12T01:00:28.197798+0000","last_clean":"2024-09-12T01:00:28.197798+0000","last_became_active":"2024-09-12T00:32:25.008089+0000","last_became_peered":"2024-09-12T00:32:25.008089+0000","last_unstale":"2024-09-12T01:00:28.197798+0000","last_undegraded":"2024-09-12T01:00:28.197798+0000","last_fullsized":"2024-09-12T01:00:28.197798+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"268'82","reported_seq":323,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:53.174675+0000","last_change":"2024-09-12T00:30:51.548938+0000","last_active":"2024-09-12T00:58:53.174675+0000","last_peered":"2024-09-12T00:58:53.174675+0000","last_clean":"2024-09-12T00:58:53.174675+0000","last_became_active":"2024-09-12T00:30:51.548232+0000","last_became_peered":"2024-09-12T00:30:51.548232+0000","last_unstale":"2024-09-12T00:58:53.174675+0000","last_undegraded":"2024-09-12T00:58:53.174675+0000","last_fullsized":"2024-09-12T00:58:53.174675+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:32.055820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":390,"num_write":93,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:18.155390+0000","last_change":"2024-09-12T00:43:48.272336+0000","last_active":"2024-09-12T00:58:18.155390+0000","last_peered":"2024-09-12T00:58:18.155390+0000","last_clean":"2024-09-12T00:58:18.155390+0000","last_became_active":"2024-09-12T00:43:48.271560+0000","last_became_peered":"2024-09-12T00:43:48.271560+0000","last_unstale":"2024-09-12T00:58:18.155390+0000","last_undegraded":"2024-09-12T00:58:18.155390+0000","last_fullsized":"2024-09-12T00:58:18.155390+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:33.055656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.234163+0000","last_change":"2024-09-12T00:32:28.058883+0000","last_active":"2024-09-12T01:00:29.234163+0000","last_peered":"2024-09-12T01:00:29.234163+0000","last_clean":"2024-09-12T01:00:29.234163+0000","last_became_active":"2024-09-12T00:32:28.058127+0000","last_became_peered":"2024-09-12T00:32:28.058127+0000","last_unstale":"2024-09-12T01:00:29.234163+0000","last_undegraded":"2024-09-12T01:00:29.234163+0000","last_fullsized":"2024-09-12T01:00:29.234163+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"268'3","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.831269+0000","last_change":"2024-09-12T00:32:25.013431+0000","last_active":"2024-09-12T01:02:37.831269+0000","last_peered":"2024-09-12T01:02:37.831269+0000","last_clean":"2024-09-12T01:02:37.831269+0000","last_became_active":"2024-09-12T00:32:25.013042+0000","last_became_peered":"2024-09-12T00:32:25.013042+0000","last_unstale":"2024-09-12T01:02:37.831269+0000","last_undegraded":"2024-09-12T01:02:37.831269+0000","last_fullsized":"2024-09-12T01:02:37.831269+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'29","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:52.165632+0000","last_change":"2024-09-12T00:30:51.548109+0000","last_active":"2024-09-12T00:58:52.165632+0000","last_peered":"2024-09-12T00:58:52.165632+0000","last_clean":"2024-09-12T00:58:52.165632+0000","last_became_active":"2024-09-12T00:30:51.545619+0000","last_became_peered":"2024-09-12T00:30:51.545619+0000","last_unstale":"2024-09-12T00:58:52.165632+0000","last_undegraded":"2024-09-12T00:58:52.165632+0000","last_fullsized":"2024-09-12T00:58:52.165632+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:38.398967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":120,"num_write":40,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:07.193629+0000","last_change":"2024-09-12T00:43:48.280018+0000","last_active":"2024-09-12T00:59:07.193629+0000","last_peered":"2024-09-12T00:59:07.193629+0000","last_clean":"2024-09-12T00:59:07.193629+0000","last_became_active":"2024-09-12T00:43:48.279197+0000","last_became_peered":"2024-09-12T00:43:48.279197+0000","last_unstale":"2024-09-12T00:59:07.193629+0000","last_undegraded":"2024-09-12T00:59:07.193629+0000","last_fullsized":"2024-09-12T00:59:07.193629+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:16.184230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174616+0000","last_change":"2024-09-12T00:32:28.058572+0000","last_active":"2024-09-12T00:59:27.174616+0000","last_peered":"2024-09-12T00:59:27.174616+0000","last_clean":"2024-09-12T00:59:27.174616+0000","last_became_active":"2024-09-12T00:32:28.057839+0000","last_became_peered":"2024-09-12T00:32:28.057839+0000","last_unstale":"2024-09-12T00:59:27.174616+0000","last_undegraded":"2024-09-12T00:59:27.174616+0000","last_fullsized":"2024-09-12T00:59:27.174616+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:41.184079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"268'8","reported_seq":58,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:43.213939+0000","last_change":"2024-09-12T00:32:25.022238+0000","last_active":"2024-09-12T01:01:43.213939+0000","last_peered":"2024-09-12T01:01:43.213939+0000","last_clean":"2024-09-12T01:01:43.213939+0000","last_became_active":"2024-09-12T00:32:25.021649+0000","last_became_peered":"2024-09-12T00:32:25.021649+0000","last_unstale":"2024-09-12T01:01:43.213939+0000","last_undegraded":"2024-09-12T01:01:43.213939+0000","last_fullsized":"2024-09-12T01:01:43.213939+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:11.939783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"268'68","reported_seq":236,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:17.186626+0000","last_change":"2024-09-12T00:30:51.562713+0000","last_active":"2024-09-12T01:00:17.186626+0000","last_peered":"2024-09-12T01:00:17.186626+0000","last_clean":"2024-09-12T01:00:17.186626+0000","last_became_active":"2024-09-12T00:30:51.562106+0000","last_became_peered":"2024-09-12T00:30:51.562106+0000","last_unstale":"2024-09-12T01:00:17.186626+0000","last_undegraded":"2024-09-12T01:00:17.186626+0000","last_fullsized":"2024-09-12T01:00:17.186626+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:57.176892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":360,"num_read_kb":258,"num_write":123,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185103+0000","last_change":"2024-09-12T00:43:48.287022+0000","last_active":"2024-09-12T00:59:33.185103+0000","last_peered":"2024-09-12T00:59:33.185103+0000","last_clean":"2024-09-12T00:59:33.185103+0000","last_became_active":"2024-09-12T00:43:48.286629+0000","last_became_peered":"2024-09-12T00:43:48.286629+0000","last_unstale":"2024-09-12T00:59:33.185103+0000","last_undegraded":"2024-09-12T00:59:33.185103+0000","last_fullsized":"2024-09-12T00:59:33.185103+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:40.640752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174553+0000","last_change":"2024-09-12T00:32:28.071698+0000","last_active":"2024-09-12T00:59:27.174553+0000","last_peered":"2024-09-12T00:59:27.174553+0000","last_clean":"2024-09-12T00:59:27.174553+0000","last_became_active":"2024-09-12T00:32:28.070913+0000","last_became_peered":"2024-09-12T00:32:28.070913+0000","last_unstale":"2024-09-12T00:59:27.174553+0000","last_undegraded":"2024-09-12T00:59:27.174553+0000","last_fullsized":"2024-09-12T00:59:27.174553+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:34.008495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"268'10","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.250848+0000","last_change":"2024-09-12T00:32:25.022141+0000","last_active":"2024-09-12T01:02:38.250848+0000","last_peered":"2024-09-12T01:02:38.250848+0000","last_clean":"2024-09-12T01:02:38.250848+0000","last_became_active":"2024-09-12T00:32:25.007681+0000","last_became_peered":"2024-09-12T00:32:25.007681+0000","last_unstale":"2024-09-12T01:02:38.250848+0000","last_undegraded":"2024-09-12T01:02:38.250848+0000","last_fullsized":"2024-09-12T01:02:38.250848+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:46.593006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4146,"num_write":20,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"268'39","reported_seq":150,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:09.229370+0000","last_change":"2024-09-12T00:30:51.565589+0000","last_active":"2024-09-12T01:00:09.229370+0000","last_peered":"2024-09-12T01:00:09.229370+0000","last_clean":"2024-09-12T01:00:09.229370+0000","last_became_active":"2024-09-12T00:30:51.559520+0000","last_became_peered":"2024-09-12T00:30:51.559520+0000","last_unstale":"2024-09-12T01:00:09.229370+0000","last_undegraded":"2024-09-12T01:00:09.229370+0000","last_fullsized":"2024-09-12T01:00:09.229370+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:38.099204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":143,"num_write":68,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:59.211561+0000","last_change":"2024-09-12T00:43:48.287080+0000","last_active":"2024-09-12T00:58:59.211561+0000","last_peered":"2024-09-12T00:58:59.211561+0000","last_clean":"2024-09-12T00:58:59.211561+0000","last_became_active":"2024-09-12T00:43:48.286079+0000","last_became_peered":"2024-09-12T00:43:48.286079+0000","last_unstale":"2024-09-12T00:58:59.211561+0000","last_undegraded":"2024-09-12T00:58:59.211561+0000","last_fullsized":"2024-09-12T00:58:59.211561+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:57.937242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.177100+0000","last_change":"2024-09-12T00:32:28.075197+0000","last_active":"2024-09-12T00:59:37.177100+0000","last_peered":"2024-09-12T00:59:37.177100+0000","last_clean":"2024-09-12T00:59:37.177100+0000","last_became_active":"2024-09-12T00:32:28.074621+0000","last_became_peered":"2024-09-12T00:32:28.074621+0000","last_unstale":"2024-09-12T00:59:37.177100+0000","last_undegraded":"2024-09-12T00:59:37.177100+0000","last_fullsized":"2024-09-12T00:59:37.177100+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:11.217357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174686+0000","last_change":"2024-09-12T00:32:25.009196+0000","last_active":"2024-09-12T00:59:27.174686+0000","last_peered":"2024-09-12T00:59:27.174686+0000","last_clean":"2024-09-12T00:59:27.174686+0000","last_became_active":"2024-09-12T00:32:25.008419+0000","last_became_peered":"2024-09-12T00:32:25.008419+0000","last_unstale":"2024-09-12T00:59:27.174686+0000","last_undegraded":"2024-09-12T00:59:27.174686+0000","last_fullsized":"2024-09-12T00:59:27.174686+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:01.482915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"268'30","reported_seq":120,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.193309+0000","last_change":"2024-09-12T00:30:51.541334+0000","last_active":"2024-09-12T01:00:08.193309+0000","last_peered":"2024-09-12T01:00:08.193309+0000","last_clean":"2024-09-12T01:00:08.193309+0000","last_became_active":"2024-09-12T00:30:51.540434+0000","last_became_peered":"2024-09-12T00:30:51.540434+0000","last_unstale":"2024-09-12T01:00:08.193309+0000","last_undegraded":"2024-09-12T01:00:08.193309+0000","last_fullsized":"2024-09-12T01:00:08.193309+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:01.590635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":92,"num_write":60,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:58.176983+0000","last_change":"2024-09-12T00:43:48.279278+0000","last_active":"2024-09-12T00:58:58.176983+0000","last_peered":"2024-09-12T00:58:58.176983+0000","last_clean":"2024-09-12T00:58:58.176983+0000","last_became_active":"2024-09-12T00:43:48.278477+0000","last_became_peered":"2024-09-12T00:43:48.278477+0000","last_unstale":"2024-09-12T00:58:58.176983+0000","last_undegraded":"2024-09-12T00:58:58.176983+0000","last_fullsized":"2024-09-12T00:58:58.176983+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:23.351907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"268'11","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.009743+0000","last_change":"2024-09-12T00:32:28.075698+0000","last_active":"2024-09-12T01:01:47.009743+0000","last_peered":"2024-09-12T01:01:47.009743+0000","last_clean":"2024-09-12T01:01:47.009743+0000","last_became_active":"2024-09-12T00:32:28.066441+0000","last_became_peered":"2024-09-12T00:32:28.066441+0000","last_unstale":"2024-09-12T01:01:47.009743+0000","last_undegraded":"2024-09-12T01:01:47.009743+0000","last_fullsized":"2024-09-12T01:01:47.009743+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:29.911316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":37890,"num_write":21,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.177139+0000","last_change":"2024-09-12T00:32:25.011505+0000","last_active":"2024-09-12T00:59:37.177139+0000","last_peered":"2024-09-12T00:59:37.177139+0000","last_clean":"2024-09-12T00:59:37.177139+0000","last_became_active":"2024-09-12T00:32:25.010752+0000","last_became_peered":"2024-09-12T00:32:25.010752+0000","last_unstale":"2024-09-12T00:59:37.177139+0000","last_undegraded":"2024-09-12T00:59:37.177139+0000","last_fullsized":"2024-09-12T00:59:37.177139+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:38.026878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"268'114","reported_seq":464,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.181883+0000","last_change":"2024-09-12T00:30:51.550820+0000","last_active":"2024-09-12T01:00:08.181883+0000","last_peered":"2024-09-12T01:00:08.181883+0000","last_clean":"2024-09-12T01:00:08.181883+0000","last_became_active":"2024-09-12T00:30:51.550081+0000","last_became_peered":"2024-09-12T00:30:51.550081+0000","last_unstale":"2024-09-12T01:00:08.181883+0000","last_undegraded":"2024-09-12T01:00:08.181883+0000","last_fullsized":"2024-09-12T01:00:08.181883+0000","mapping_epoch":257,"log_start":"265'100","ondisk_log_start":"265'100","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:48.107776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":826,"num_read_kb":599,"num_write":142,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.201751+0000","last_change":"2024-09-12T00:43:48.273417+0000","last_active":"2024-09-12T00:59:37.201751+0000","last_peered":"2024-09-12T00:59:37.201751+0000","last_clean":"2024-09-12T00:59:37.201751+0000","last_became_active":"2024-09-12T00:43:48.272486+0000","last_became_peered":"2024-09-12T00:43:48.272486+0000","last_unstale":"2024-09-12T00:59:37.201751+0000","last_undegraded":"2024-09-12T00:59:37.201751+0000","last_fullsized":"2024-09-12T00:59:37.201751+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:26.875710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000354+0000","last_change":"2024-09-12T00:32:28.051078+0000","last_active":"2024-09-12T01:00:39.000354+0000","last_peered":"2024-09-12T01:00:39.000354+0000","last_clean":"2024-09-12T01:00:39.000354+0000","last_became_active":"2024-09-12T00:32:28.049186+0000","last_became_peered":"2024-09-12T00:32:28.049186+0000","last_unstale":"2024-09-12T01:00:39.000354+0000","last_undegraded":"2024-09-12T01:00:39.000354+0000","last_fullsized":"2024-09-12T01:00:39.000354+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:37.191650+0000","last_change":"2024-09-12T00:32:25.000690+0000","last_active":"2024-09-12T01:00:37.191650+0000","last_peered":"2024-09-12T01:00:37.191650+0000","last_clean":"2024-09-12T01:00:37.191650+0000","last_became_active":"2024-09-12T00:32:24.999633+0000","last_became_peered":"2024-09-12T00:32:24.999633+0000","last_unstale":"2024-09-12T01:00:37.191650+0000","last_undegraded":"2024-09-12T01:00:37.191650+0000","last_fullsized":"2024-09-12T01:00:37.191650+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:09.259657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"268'69","reported_seq":237,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.181761+0000","last_change":"2024-09-12T00:30:51.548507+0000","last_active":"2024-09-12T01:00:08.181761+0000","last_peered":"2024-09-12T01:00:08.181761+0000","last_clean":"2024-09-12T01:00:08.181761+0000","last_became_active":"2024-09-12T00:30:51.546873+0000","last_became_peered":"2024-09-12T00:30:51.546873+0000","last_unstale":"2024-09-12T01:00:08.181761+0000","last_undegraded":"2024-09-12T01:00:08.181761+0000","last_fullsized":"2024-09-12T01:00:08.181761+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:28.201041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":256,"num_write":124,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:38.185725+0000","last_change":"2024-09-12T00:43:48.287793+0000","last_active":"2024-09-12T00:59:38.185725+0000","last_peered":"2024-09-12T00:59:38.185725+0000","last_clean":"2024-09-12T00:59:38.185725+0000","last_became_active":"2024-09-12T00:43:48.287144+0000","last_became_peered":"2024-09-12T00:43:48.287144+0000","last_unstale":"2024-09-12T00:59:38.185725+0000","last_undegraded":"2024-09-12T00:59:38.185725+0000","last_fullsized":"2024-09-12T00:59:38.185725+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:03.320468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:38.202196+0000","last_change":"2024-09-12T00:32:28.064542+0000","last_active":"2024-09-12T01:00:38.202196+0000","last_peered":"2024-09-12T01:00:38.202196+0000","last_clean":"2024-09-12T01:00:38.202196+0000","last_became_active":"2024-09-12T00:32:28.063712+0000","last_became_peered":"2024-09-12T00:32:28.063712+0000","last_unstale":"2024-09-12T01:00:38.202196+0000","last_undegraded":"2024-09-12T01:00:38.202196+0000","last_fullsized":"2024-09-12T01:00:38.202196+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"268'3","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.015070+0000","last_change":"2024-09-12T00:32:25.012329+0000","last_active":"2024-09-12T01:02:39.015070+0000","last_peered":"2024-09-12T01:02:39.015070+0000","last_clean":"2024-09-12T01:02:39.015070+0000","last_became_active":"2024-09-12T00:32:25.005902+0000","last_became_peered":"2024-09-12T00:32:25.005902+0000","last_unstale":"2024-09-12T01:02:39.015070+0000","last_undegraded":"2024-09-12T01:02:39.015070+0000","last_fullsized":"2024-09-12T01:02:39.015070+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"268'31","reported_seq":126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:13.179616+0000","last_change":"2024-09-12T00:30:51.545329+0000","last_active":"2024-09-12T00:59:13.179616+0000","last_peered":"2024-09-12T00:59:13.179616+0000","last_clean":"2024-09-12T00:59:13.179616+0000","last_became_active":"2024-09-12T00:30:51.541904+0000","last_became_peered":"2024-09-12T00:30:51.541904+0000","last_unstale":"2024-09-12T00:59:13.179616+0000","last_undegraded":"2024-09-12T00:59:13.179616+0000","last_fullsized":"2024-09-12T00:59:13.179616+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:26.384655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":109,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185912+0000","last_change":"2024-09-12T00:43:48.275537+0000","last_active":"2024-09-12T00:59:33.185912+0000","last_peered":"2024-09-12T00:59:33.185912+0000","last_clean":"2024-09-12T00:59:33.185912+0000","last_became_active":"2024-09-12T00:43:48.274756+0000","last_became_peered":"2024-09-12T00:43:48.274756+0000","last_unstale":"2024-09-12T00:59:33.185912+0000","last_undegraded":"2024-09-12T00:59:33.185912+0000","last_fullsized":"2024-09-12T00:59:33.185912+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:14.072781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"268'5","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.620079+0000","last_change":"2024-09-12T00:32:28.066799+0000","last_active":"2024-09-12T01:02:38.620079+0000","last_peered":"2024-09-12T01:02:38.620079+0000","last_clean":"2024-09-12T01:02:38.620079+0000","last_became_active":"2024-09-12T00:32:28.066029+0000","last_became_peered":"2024-09-12T00:32:28.066029+0000","last_unstale":"2024-09-12T01:02:38.620079+0000","last_undegraded":"2024-09-12T01:02:38.620079+0000","last_fullsized":"2024-09-12T01:02:38.620079+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:56.429963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"268'3","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.678280+0000","last_change":"2024-09-12T00:32:25.001979+0000","last_active":"2024-09-12T01:02:37.678280+0000","last_peered":"2024-09-12T01:02:37.678280+0000","last_clean":"2024-09-12T01:02:37.678280+0000","last_became_active":"2024-09-12T00:32:25.001194+0000","last_became_peered":"2024-09-12T00:32:25.001194+0000","last_unstale":"2024-09-12T01:02:37.678280+0000","last_undegraded":"2024-09-12T01:02:37.678280+0000","last_fullsized":"2024-09-12T01:02:37.678280+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"268'15","reported_seq":82,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.192385+0000","last_change":"2024-09-12T00:30:51.544531+0000","last_active":"2024-09-12T00:59:02.192385+0000","last_peered":"2024-09-12T00:59:02.192385+0000","last_clean":"2024-09-12T00:59:02.192385+0000","last_became_active":"2024-09-12T00:30:51.543711+0000","last_became_peered":"2024-09-12T00:30:51.543711+0000","last_unstale":"2024-09-12T00:59:02.192385+0000","last_undegraded":"2024-09-12T00:59:02.192385+0000","last_fullsized":"2024-09-12T00:59:02.192385+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:07.148537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":43,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.176965+0000","last_change":"2024-09-12T00:43:48.290387+0000","last_active":"2024-09-12T00:59:37.176965+0000","last_peered":"2024-09-12T00:59:37.176965+0000","last_clean":"2024-09-12T00:59:37.176965+0000","last_became_active":"2024-09-12T00:43:48.289475+0000","last_became_peered":"2024-09-12T00:43:48.289475+0000","last_unstale":"2024-09-12T00:59:37.176965+0000","last_undegraded":"2024-09-12T00:59:37.176965+0000","last_fullsized":"2024-09-12T00:59:37.176965+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:49.960814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.994294+0000","last_change":"2024-09-12T00:32:28.056626+0000","last_active":"2024-09-12T01:00:47.994294+0000","last_peered":"2024-09-12T01:00:47.994294+0000","last_clean":"2024-09-12T01:00:47.994294+0000","last_became_active":"2024-09-12T00:32:28.055934+0000","last_became_peered":"2024-09-12T00:32:28.055934+0000","last_unstale":"2024-09-12T01:00:47.994294+0000","last_undegraded":"2024-09-12T01:00:47.994294+0000","last_fullsized":"2024-09-12T01:00:47.994294+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"268'3","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:39.015217+0000","last_change":"2024-09-12T00:32:25.005226+0000","last_active":"2024-09-12T01:01:39.015217+0000","last_peered":"2024-09-12T01:01:39.015217+0000","last_clean":"2024-09-12T01:01:39.015217+0000","last_became_active":"2024-09-12T00:32:25.004503+0000","last_became_peered":"2024-09-12T00:32:25.004503+0000","last_unstale":"2024-09-12T01:01:39.015217+0000","last_undegraded":"2024-09-12T01:01:39.015217+0000","last_fullsized":"2024-09-12T01:01:39.015217+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:32.108404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"268'12","reported_seq":75,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.178118+0000","last_change":"2024-09-12T00:30:51.543743+0000","last_active":"2024-09-12T00:59:03.178118+0000","last_peered":"2024-09-12T00:59:03.178118+0000","last_clean":"2024-09-12T00:59:03.178118+0000","last_became_active":"2024-09-12T00:30:51.542992+0000","last_became_peered":"2024-09-12T00:30:51.542992+0000","last_unstale":"2024-09-12T00:59:03.178118+0000","last_undegraded":"2024-09-12T00:59:03.178118+0000","last_fullsized":"2024-09-12T00:59:03.178118+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:43.711804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.199729+0000","last_change":"2024-09-12T00:43:48.283532+0000","last_active":"2024-09-12T01:00:28.199729+0000","last_peered":"2024-09-12T01:00:28.199729+0000","last_clean":"2024-09-12T01:00:28.199729+0000","last_became_active":"2024-09-12T00:43:48.276293+0000","last_became_peered":"2024-09-12T00:43:48.276293+0000","last_unstale":"2024-09-12T01:00:28.199729+0000","last_undegraded":"2024-09-12T01:00:28.199729+0000","last_fullsized":"2024-09-12T01:00:28.199729+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:45.902022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"268'6","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.254038+0000","last_change":"2024-09-12T00:32:28.073623+0000","last_active":"2024-09-12T01:02:39.254038+0000","last_peered":"2024-09-12T01:02:39.254038+0000","last_clean":"2024-09-12T01:02:39.254038+0000","last_became_active":"2024-09-12T00:32:28.067824+0000","last_became_peered":"2024-09-12T00:32:28.067824+0000","last_unstale":"2024-09-12T01:02:39.254038+0000","last_undegraded":"2024-09-12T01:02:39.254038+0000","last_fullsized":"2024-09-12T01:02:39.254038+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:24.607971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"268'3","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:34.014457+0000","last_change":"2024-09-12T00:32:25.022973+0000","last_active":"2024-09-12T01:01:34.014457+0000","last_peered":"2024-09-12T01:01:34.014457+0000","last_clean":"2024-09-12T01:01:34.014457+0000","last_became_active":"2024-09-12T00:32:25.022210+0000","last_became_peered":"2024-09-12T00:32:25.022210+0000","last_unstale":"2024-09-12T01:01:34.014457+0000","last_undegraded":"2024-09-12T01:01:34.014457+0000","last_fullsized":"2024-09-12T01:01:34.014457+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:27.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:03.171708+0000","last_change":"2024-09-12T00:30:51.550674+0000","last_active":"2024-09-12T00:59:03.171708+0000","last_peered":"2024-09-12T00:59:03.171708+0000","last_clean":"2024-09-12T00:59:03.171708+0000","last_became_active":"2024-09-12T00:30:51.549942+0000","last_became_peered":"2024-09-12T00:30:51.549942+0000","last_unstale":"2024-09-12T00:59:03.171708+0000","last_undegraded":"2024-09-12T00:59:03.171708+0000","last_fullsized":"2024-09-12T00:59:03.171708+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:52.263117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":118,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.199785+0000","last_change":"2024-09-12T00:43:48.276759+0000","last_active":"2024-09-12T01:00:28.199785+0000","last_peered":"2024-09-12T01:00:28.199785+0000","last_clean":"2024-09-12T01:00:28.199785+0000","last_became_active":"2024-09-12T00:43:48.276176+0000","last_became_peered":"2024-09-12T00:43:48.276176+0000","last_unstale":"2024-09-12T01:00:28.199785+0000","last_undegraded":"2024-09-12T01:00:28.199785+0000","last_fullsized":"2024-09-12T01:00:28.199785+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:07.896702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.201670+0000","last_change":"2024-09-12T00:32:28.052395+0000","last_active":"2024-09-12T00:59:37.201670+0000","last_peered":"2024-09-12T00:59:37.201670+0000","last_clean":"2024-09-12T00:59:37.201670+0000","last_became_active":"2024-09-12T00:32:28.051244+0000","last_became_peered":"2024-09-12T00:32:28.051244+0000","last_unstale":"2024-09-12T00:59:37.201670+0000","last_undegraded":"2024-09-12T00:59:37.201670+0000","last_fullsized":"2024-09-12T00:59:37.201670+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:09.633243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"268'2","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.995791+0000","last_change":"2024-09-12T00:32:25.023656+0000","last_active":"2024-09-12T01:01:47.995791+0000","last_peered":"2024-09-12T01:01:47.995791+0000","last_clean":"2024-09-12T01:01:47.995791+0000","last_became_active":"2024-09-12T00:32:25.022757+0000","last_became_peered":"2024-09-12T00:32:25.022757+0000","last_unstale":"2024-09-12T01:01:47.995791+0000","last_undegraded":"2024-09-12T01:01:47.995791+0000","last_fullsized":"2024-09-12T01:01:47.995791+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:59.877231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'12","reported_seq":78,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:04.213055+0000","last_change":"2024-09-12T00:30:51.566131+0000","last_active":"2024-09-12T00:59:04.213055+0000","last_peered":"2024-09-12T00:59:04.213055+0000","last_clean":"2024-09-12T00:59:04.213055+0000","last_became_active":"2024-09-12T00:30:51.565544+0000","last_became_peered":"2024-09-12T00:30:51.565544+0000","last_unstale":"2024-09-12T00:59:04.213055+0000","last_undegraded":"2024-09-12T00:59:04.213055+0000","last_fullsized":"2024-09-12T00:59:04.213055+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:14.413107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.206539+0000","last_change":"2024-09-12T00:43:48.280037+0000","last_active":"2024-09-12T00:59:57.206539+0000","last_peered":"2024-09-12T00:59:57.206539+0000","last_clean":"2024-09-12T00:59:57.206539+0000","last_became_active":"2024-09-12T00:43:48.279243+0000","last_became_peered":"2024-09-12T00:43:48.279243+0000","last_unstale":"2024-09-12T00:59:57.206539+0000","last_undegraded":"2024-09-12T00:59:57.206539+0000","last_fullsized":"2024-09-12T00:59:57.206539+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:31.525488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"268'3","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.253027+0000","last_change":"2024-09-12T00:32:28.060782+0000","last_active":"2024-09-12T01:02:39.253027+0000","last_peered":"2024-09-12T01:02:39.253027+0000","last_clean":"2024-09-12T01:02:39.253027+0000","last_became_active":"2024-09-12T00:32:28.058384+0000","last_became_peered":"2024-09-12T00:32:28.058384+0000","last_unstale":"2024-09-12T01:02:39.253027+0000","last_undegraded":"2024-09-12T01:02:39.253027+0000","last_fullsized":"2024-09-12T01:02:39.253027+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"265'3","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:38.202384+0000","last_change":"2024-09-12T00:32:24.996244+0000","last_active":"2024-09-12T01:00:38.202384+0000","last_peered":"2024-09-12T01:00:38.202384+0000","last_clean":"2024-09-12T01:00:38.202384+0000","last_became_active":"2024-09-12T00:32:24.995532+0000","last_became_peered":"2024-09-12T00:32:24.995532+0000","last_unstale":"2024-09-12T01:00:38.202384+0000","last_undegraded":"2024-09-12T01:00:38.202384+0000","last_fullsized":"2024-09-12T01:00:38.202384+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"268'40","reported_seq":157,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.196522+0000","last_change":"2024-09-12T00:30:51.554468+0000","last_active":"2024-09-12T01:00:13.196522+0000","last_peered":"2024-09-12T01:00:13.196522+0000","last_clean":"2024-09-12T01:00:13.196522+0000","last_became_active":"2024-09-12T00:30:51.553501+0000","last_became_peered":"2024-09-12T00:30:51.553501+0000","last_unstale":"2024-09-12T01:00:13.196522+0000","last_undegraded":"2024-09-12T01:00:13.196522+0000","last_fullsized":"2024-09-12T01:00:13.196522+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:13.843806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":68,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.234081+0000","last_change":"2024-09-12T00:43:48.281674+0000","last_active":"2024-09-12T01:00:29.234081+0000","last_peered":"2024-09-12T01:00:29.234081+0000","last_clean":"2024-09-12T01:00:29.234081+0000","last_became_active":"2024-09-12T00:43:48.280566+0000","last_became_peered":"2024-09-12T00:43:48.280566+0000","last_unstale":"2024-09-12T01:00:29.234081+0000","last_undegraded":"2024-09-12T01:00:29.234081+0000","last_fullsized":"2024-09-12T01:00:29.234081+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:02.297251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"268'4","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.693850+0000","last_change":"2024-09-12T00:32:28.061791+0000","last_active":"2024-09-12T01:02:38.693850+0000","last_peered":"2024-09-12T01:02:38.693850+0000","last_clean":"2024-09-12T01:02:38.693850+0000","last_became_active":"2024-09-12T00:32:28.061089+0000","last_became_peered":"2024-09-12T00:32:28.061089+0000","last_unstale":"2024-09-12T01:02:38.693850+0000","last_undegraded":"2024-09-12T01:02:38.693850+0000","last_fullsized":"2024-09-12T01:02:38.693850+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":326,"num_write":4,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"265'11","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:33.999304+0000","last_change":"2024-09-12T00:32:25.004508+0000","last_active":"2024-09-12T01:00:33.999304+0000","last_peered":"2024-09-12T01:00:33.999304+0000","last_clean":"2024-09-12T01:00:33.999304+0000","last_became_active":"2024-09-12T00:32:25.004199+0000","last_became_peered":"2024-09-12T00:32:25.004199+0000","last_unstale":"2024-09-12T01:00:33.999304+0000","last_undegraded":"2024-09-12T01:00:33.999304+0000","last_fullsized":"2024-09-12T01:00:33.999304+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:38.507054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11280,"num_write":21,"num_write_kb":11280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"268'12","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:02.183087+0000","last_change":"2024-09-12T00:30:51.554784+0000","last_active":"2024-09-12T01:00:02.183087+0000","last_peered":"2024-09-12T01:00:02.183087+0000","last_clean":"2024-09-12T01:00:02.183087+0000","last_became_active":"2024-09-12T00:30:51.548619+0000","last_became_peered":"2024-09-12T00:30:51.548619+0000","last_unstale":"2024-09-12T01:00:02.183087+0000","last_undegraded":"2024-09-12T01:00:02.183087+0000","last_fullsized":"2024-09-12T01:00:02.183087+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:18.858058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168084+0000","last_change":"2024-09-12T00:43:48.284636+0000","last_active":"2024-09-12T00:59:02.168084+0000","last_peered":"2024-09-12T00:59:02.168084+0000","last_clean":"2024-09-12T00:59:02.168084+0000","last_became_active":"2024-09-12T00:43:48.283630+0000","last_became_peered":"2024-09-12T00:43:48.283630+0000","last_unstale":"2024-09-12T00:59:02.168084+0000","last_undegraded":"2024-09-12T00:59:02.168084+0000","last_fullsized":"2024-09-12T00:59:02.168084+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:05.417886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'5","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179689+0000","last_change":"2024-09-12T00:32:28.054779+0000","last_active":"2024-09-12T00:59:33.179689+0000","last_peered":"2024-09-12T00:59:33.179689+0000","last_clean":"2024-09-12T00:59:33.179689+0000","last_became_active":"2024-09-12T00:32:28.054045+0000","last_became_peered":"2024-09-12T00:32:28.054045+0000","last_unstale":"2024-09-12T00:59:33.179689+0000","last_undegraded":"2024-09-12T00:59:33.179689+0000","last_fullsized":"2024-09-12T00:59:33.179689+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:05.598087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'3","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:38.202145+0000","last_change":"2024-09-12T00:32:24.998555+0000","last_active":"2024-09-12T01:00:38.202145+0000","last_peered":"2024-09-12T01:00:38.202145+0000","last_clean":"2024-09-12T01:00:38.202145+0000","last_became_active":"2024-09-12T00:32:24.997768+0000","last_became_peered":"2024-09-12T00:32:24.997768+0000","last_unstale":"2024-09-12T01:00:38.202145+0000","last_undegraded":"2024-09-12T01:00:38.202145+0000","last_fullsized":"2024-09-12T01:00:38.202145+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:01.938274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"268'27","reported_seq":114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.193807+0000","last_change":"2024-09-12T00:30:51.557180+0000","last_active":"2024-09-12T01:00:03.193807+0000","last_peered":"2024-09-12T01:00:03.193807+0000","last_clean":"2024-09-12T01:00:03.193807+0000","last_became_active":"2024-09-12T00:30:51.556456+0000","last_became_peered":"2024-09-12T00:30:51.556456+0000","last_unstale":"2024-09-12T01:00:03.193807+0000","last_undegraded":"2024-09-12T01:00:03.193807+0000","last_fullsized":"2024-09-12T01:00:03.193807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:08.813545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":57,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:58.170620+0000","last_change":"2024-09-12T00:43:48.266541+0000","last_active":"2024-09-12T00:58:58.170620+0000","last_peered":"2024-09-12T00:58:58.170620+0000","last_clean":"2024-09-12T00:58:58.170620+0000","last_became_active":"2024-09-12T00:43:48.265726+0000","last_became_peered":"2024-09-12T00:43:48.265726+0000","last_unstale":"2024-09-12T00:58:58.170620+0000","last_undegraded":"2024-09-12T00:58:58.170620+0000","last_fullsized":"2024-09-12T00:58:58.170620+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:07.603833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000271+0000","last_change":"2024-09-12T00:32:28.051868+0000","last_active":"2024-09-12T01:00:39.000271+0000","last_peered":"2024-09-12T01:00:39.000271+0000","last_clean":"2024-09-12T01:00:39.000271+0000","last_became_active":"2024-09-12T00:32:28.051145+0000","last_became_peered":"2024-09-12T00:32:28.051145+0000","last_unstale":"2024-09-12T01:00:39.000271+0000","last_undegraded":"2024-09-12T01:00:39.000271+0000","last_fullsized":"2024-09-12T01:00:39.000271+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:26.514177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219199+0000","last_change":"2024-09-12T00:32:25.007529+0000","last_active":"2024-09-12T00:59:29.219199+0000","last_peered":"2024-09-12T00:59:29.219199+0000","last_clean":"2024-09-12T00:59:29.219199+0000","last_became_active":"2024-09-12T00:32:25.003679+0000","last_became_peered":"2024-09-12T00:32:25.003679+0000","last_unstale":"2024-09-12T00:59:29.219199+0000","last_undegraded":"2024-09-12T00:59:29.219199+0000","last_fullsized":"2024-09-12T00:59:29.219199+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:31.977653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"268'23","reported_seq":107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:04.228064+0000","last_change":"2024-09-12T00:30:51.552593+0000","last_active":"2024-09-12T01:00:04.228064+0000","last_peered":"2024-09-12T01:00:04.228064+0000","last_clean":"2024-09-12T01:00:04.228064+0000","last_became_active":"2024-09-12T00:30:51.551554+0000","last_became_peered":"2024-09-12T00:30:51.551554+0000","last_unstale":"2024-09-12T01:00:04.228064+0000","last_undegraded":"2024-09-12T01:00:04.228064+0000","last_fullsized":"2024-09-12T01:00:04.228064+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:19.144268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.989931+0000","last_change":"2024-09-12T00:43:48.287349+0000","last_active":"2024-09-12T01:00:31.989931+0000","last_peered":"2024-09-12T01:00:31.989931+0000","last_clean":"2024-09-12T01:00:31.989931+0000","last_became_active":"2024-09-12T00:43:48.286593+0000","last_became_peered":"2024-09-12T00:43:48.286593+0000","last_unstale":"2024-09-12T01:00:31.989931+0000","last_undegraded":"2024-09-12T01:00:31.989931+0000","last_fullsized":"2024-09-12T01:00:31.989931+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:41.625703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"268'6","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:38.213274+0000","last_change":"2024-09-12T00:32:28.070368+0000","last_active":"2024-09-12T01:01:38.213274+0000","last_peered":"2024-09-12T01:01:38.213274+0000","last_clean":"2024-09-12T01:01:38.213274+0000","last_became_active":"2024-09-12T00:32:28.069812+0000","last_became_peered":"2024-09-12T00:32:28.069812+0000","last_unstale":"2024-09-12T01:01:38.213274+0000","last_undegraded":"2024-09-12T01:01:38.213274+0000","last_fullsized":"2024-09-12T01:01:38.213274+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:37.247045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"268'8","reported_seq":61,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:38.202224+0000","last_change":"2024-09-12T00:32:25.021525+0000","last_active":"2024-09-12T01:01:38.202224+0000","last_peered":"2024-09-12T01:01:38.202224+0000","last_clean":"2024-09-12T01:01:38.202224+0000","last_became_active":"2024-09-12T00:32:25.017138+0000","last_became_peered":"2024-09-12T00:32:25.017138+0000","last_unstale":"2024-09-12T01:01:38.202224+0000","last_undegraded":"2024-09-12T01:01:38.202224+0000","last_fullsized":"2024-09-12T01:01:38.202224+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:39.080595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"268'53","reported_seq":190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:04.227963+0000","last_change":"2024-09-12T00:30:51.553247+0000","last_active":"2024-09-12T01:00:04.227963+0000","last_peered":"2024-09-12T01:00:04.227963+0000","last_clean":"2024-09-12T01:00:04.227963+0000","last_became_active":"2024-09-12T00:30:51.546238+0000","last_became_peered":"2024-09-12T00:30:51.546238+0000","last_unstale":"2024-09-12T01:00:04.227963+0000","last_undegraded":"2024-09-12T01:00:04.227963+0000","last_fullsized":"2024-09-12T01:00:04.227963+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:52.536369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":191,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000484+0000","last_change":"2024-09-12T00:43:48.277891+0000","last_active":"2024-09-12T01:00:39.000484+0000","last_peered":"2024-09-12T01:00:39.000484+0000","last_clean":"2024-09-12T01:00:39.000484+0000","last_became_active":"2024-09-12T00:43:48.277275+0000","last_became_peered":"2024-09-12T00:43:48.277275+0000","last_unstale":"2024-09-12T01:00:39.000484+0000","last_undegraded":"2024-09-12T01:00:39.000484+0000","last_fullsized":"2024-09-12T01:00:39.000484+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:00.758192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.184304+0000","last_change":"2024-09-12T00:32:28.066072+0000","last_active":"2024-09-12T00:59:33.184304+0000","last_peered":"2024-09-12T00:59:33.184304+0000","last_clean":"2024-09-12T00:59:33.184304+0000","last_became_active":"2024-09-12T00:32:28.065320+0000","last_became_peered":"2024-09-12T00:32:28.065320+0000","last_unstale":"2024-09-12T00:59:33.184304+0000","last_undegraded":"2024-09-12T00:59:33.184304+0000","last_fullsized":"2024-09-12T00:59:33.184304+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:36.535395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'3","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185073+0000","last_change":"2024-09-12T00:32:25.017231+0000","last_active":"2024-09-12T00:59:33.185073+0000","last_peered":"2024-09-12T00:59:33.185073+0000","last_clean":"2024-09-12T00:59:33.185073+0000","last_became_active":"2024-09-12T00:32:25.013266+0000","last_became_peered":"2024-09-12T00:32:25.013266+0000","last_unstale":"2024-09-12T00:59:33.185073+0000","last_undegraded":"2024-09-12T00:59:33.185073+0000","last_fullsized":"2024-09-12T00:59:33.185073+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:11.615304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"268'15","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:03.207660+0000","last_change":"2024-09-12T00:30:51.560130+0000","last_active":"2024-09-12T01:01:03.207660+0000","last_peered":"2024-09-12T01:01:03.207660+0000","last_clean":"2024-09-12T01:01:03.207660+0000","last_became_active":"2024-09-12T00:30:51.559445+0000","last_became_peered":"2024-09-12T00:30:51.559445+0000","last_unstale":"2024-09-12T01:01:03.207660+0000","last_undegraded":"2024-09-12T01:01:03.207660+0000","last_fullsized":"2024-09-12T01:01:03.207660+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"268'370","reported_seq":1135,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.588695+0000","last_change":"2024-09-12T01:02:49.588695+0000","last_active":"2024-09-12T01:02:49.588695+0000","last_peered":"2024-09-12T01:02:49.588695+0000","last_clean":"2024-09-12T01:02:49.588695+0000","last_became_active":"2024-09-12T00:15:55.078687+0000","last_became_peered":"2024-09-12T00:15:55.078687+0000","last_unstale":"2024-09-12T01:02:49.588695+0000","last_undegraded":"2024-09-12T01:02:49.588695+0000","last_fullsized":"2024-09-12T01:02:49.588695+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-12T01:02:49.588395+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-12T01:02:49.588395+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.588395+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:32.972868+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":769,"num_read_kb":39834,"num_write":1260,"num_write_kb":26442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"268'859","reported_seq":2615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.181836+0000","last_change":"2024-09-12T01:03:00.181836+0000","last_active":"2024-09-12T01:03:00.181836+0000","last_peered":"2024-09-12T01:03:00.181836+0000","last_clean":"2024-09-12T01:03:00.181836+0000","last_became_active":"2024-09-12T00:15:57.021927+0000","last_became_peered":"2024-09-12T00:15:57.021927+0000","last_unstale":"2024-09-12T01:03:00.181836+0000","last_undegraded":"2024-09-12T01:03:00.181836+0000","last_fullsized":"2024-09-12T01:03:00.181836+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'859","last_scrub_stamp":"2024-09-12T01:03:00.181615+0000","last_deep_scrub":"268'859","last_deep_scrub_stamp":"2024-09-12T01:03:00.181615+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.181615+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:29.997742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4184,"num_read_kb":3812,"num_write":1107,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"268'392","reported_seq":1054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.459607+0000","last_change":"2024-09-12T01:02:59.459607+0000","last_active":"2024-09-12T01:02:59.459607+0000","last_peered":"2024-09-12T01:02:59.459607+0000","last_clean":"2024-09-12T01:02:59.459607+0000","last_became_active":"2024-09-12T00:15:55.075108+0000","last_became_peered":"2024-09-12T00:15:55.075108+0000","last_unstale":"2024-09-12T01:02:59.459607+0000","last_undegraded":"2024-09-12T01:02:59.459607+0000","last_fullsized":"2024-09-12T01:02:59.459607+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'392","last_scrub_stamp":"2024-09-12T01:02:59.459315+0000","last_deep_scrub":"268'392","last_deep_scrub_stamp":"2024-09-12T01:02:59.459315+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.459315+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:19.278176+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":2165,"num_write":1224,"num_write_kb":32030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"268'541","reported_seq":2172,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.146646+0000","last_change":"2024-09-12T00:15:57.022914+0000","last_active":"2024-09-12T01:01:02.146646+0000","last_peered":"2024-09-12T01:01:02.146646+0000","last_clean":"2024-09-12T01:01:02.146646+0000","last_became_active":"2024-09-12T00:15:57.022465+0000","last_became_peered":"2024-09-12T00:15:57.022465+0000","last_unstale":"2024-09-12T01:01:02.146646+0000","last_undegraded":"2024-09-12T01:01:02.146646+0000","last_fullsized":"2024-09-12T01:01:02.146646+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:22.255065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2758,"num_read_kb":2563,"num_write":657,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"268'389","reported_seq":1132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.428112+0000","last_change":"2024-09-12T01:02:58.428112+0000","last_active":"2024-09-12T01:02:58.428112+0000","last_peered":"2024-09-12T01:02:58.428112+0000","last_clean":"2024-09-12T01:02:58.428112+0000","last_became_active":"2024-09-12T00:15:55.041491+0000","last_became_peered":"2024-09-12T00:15:55.041491+0000","last_unstale":"2024-09-12T01:02:58.428112+0000","last_undegraded":"2024-09-12T01:02:58.428112+0000","last_fullsized":"2024-09-12T01:02:58.428112+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'389","last_scrub_stamp":"2024-09-12T01:02:58.427815+0000","last_deep_scrub":"268'389","last_deep_scrub_stamp":"2024-09-12T01:02:58.427815+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.427815+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:29.847605+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3574871,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":831,"num_read_kb":4160,"num_write":1268,"num_write_kb":14348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"268'1145","reported_seq":2779,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:59.004596+0000","last_change":"2024-09-12T00:15:57.023106+0000","last_active":"2024-09-12T01:00:59.004596+0000","last_peered":"2024-09-12T01:00:59.004596+0000","last_clean":"2024-09-12T01:00:59.004596+0000","last_became_active":"2024-09-12T00:15:57.022692+0000","last_became_peered":"2024-09-12T00:15:57.022692+0000","last_unstale":"2024-09-12T01:00:59.004596+0000","last_undegraded":"2024-09-12T01:00:59.004596+0000","last_fullsized":"2024-09-12T01:00:59.004596+0000","mapping_epoch":28,"log_start":"268'1100","ondisk_log_start":"268'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":1100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:01.909120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5291,"num_read_kb":4702,"num_write":1570,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"268'387","reported_seq":1078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.667329+0000","last_change":"2024-09-12T01:02:52.667329+0000","last_active":"2024-09-12T01:02:52.667329+0000","last_peered":"2024-09-12T01:02:52.667329+0000","last_clean":"2024-09-12T01:02:52.667329+0000","last_became_active":"2024-09-12T00:15:55.045668+0000","last_became_peered":"2024-09-12T00:15:55.045668+0000","last_unstale":"2024-09-12T01:02:52.667329+0000","last_undegraded":"2024-09-12T01:02:52.667329+0000","last_fullsized":"2024-09-12T01:02:52.667329+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'387","last_scrub_stamp":"2024-09-12T01:02:52.667069+0000","last_deep_scrub":"268'387","last_deep_scrub_stamp":"2024-09-12T01:02:52.667069+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.667069+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:37.302820+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":365201,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":662,"num_read_kb":47789,"num_write":1293,"num_write_kb":53743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"268'571","reported_seq":2213,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.155202+0000","last_change":"2024-09-12T01:03:01.155202+0000","last_active":"2024-09-12T01:03:01.155202+0000","last_peered":"2024-09-12T01:03:01.155202+0000","last_clean":"2024-09-12T01:03:01.155202+0000","last_became_active":"2024-09-12T00:15:57.018762+0000","last_became_peered":"2024-09-12T00:15:57.018762+0000","last_unstale":"2024-09-12T01:03:01.155202+0000","last_undegraded":"2024-09-12T01:03:01.155202+0000","last_fullsized":"2024-09-12T01:03:01.155202+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'571","last_scrub_stamp":"2024-09-12T01:03:01.155003+0000","last_deep_scrub":"268'571","last_deep_scrub_stamp":"2024-09-12T01:03:01.155003+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.155003+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:41.916701+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2864,"num_read_kb":2646,"num_write":693,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":992,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"268'365","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.617387+0000","last_change":"2024-09-12T01:02:50.617387+0000","last_active":"2024-09-12T01:02:50.617387+0000","last_peered":"2024-09-12T01:02:50.617387+0000","last_clean":"2024-09-12T01:02:50.617387+0000","last_became_active":"2024-09-12T00:15:55.071352+0000","last_became_peered":"2024-09-12T00:15:55.071352+0000","last_unstale":"2024-09-12T01:02:50.617387+0000","last_undegraded":"2024-09-12T01:02:50.617387+0000","last_fullsized":"2024-09-12T01:02:50.617387+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-12T01:02:50.617131+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-12T01:02:50.617131+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.617131+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:26.922140+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8845231,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":491,"num_read_kb":19398,"num_write":1138,"num_write_kb":53254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"268'458","reported_seq":2084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.526329+0000","last_change":"2024-09-12T01:03:01.526329+0000","last_active":"2024-09-12T01:03:01.526329+0000","last_peered":"2024-09-12T01:03:01.526329+0000","last_clean":"2024-09-12T01:03:01.526329+0000","last_became_active":"2024-09-12T00:15:57.051973+0000","last_became_peered":"2024-09-12T00:15:57.051973+0000","last_unstale":"2024-09-12T01:03:01.526329+0000","last_undegraded":"2024-09-12T01:03:01.526329+0000","last_fullsized":"2024-09-12T01:03:01.526329+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'458","last_scrub_stamp":"2024-09-12T01:03:01.526143+0000","last_deep_scrub":"268'458","last_deep_scrub_stamp":"2024-09-12T01:03:01.526143+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.526143+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:18.260122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":2348,"num_write":528,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"268'352","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.653874+0000","last_change":"2024-09-12T01:02:50.653874+0000","last_active":"2024-09-12T01:02:50.653874+0000","last_peered":"2024-09-12T01:02:50.653874+0000","last_clean":"2024-09-12T01:02:50.653874+0000","last_became_active":"2024-09-12T00:15:55.067030+0000","last_became_peered":"2024-09-12T00:15:55.067030+0000","last_unstale":"2024-09-12T01:02:50.653874+0000","last_undegraded":"2024-09-12T01:02:50.653874+0000","last_fullsized":"2024-09-12T01:02:50.653874+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'352","last_scrub_stamp":"2024-09-12T01:02:50.653516+0000","last_deep_scrub":"268'352","last_deep_scrub_stamp":"2024-09-12T01:02:50.653516+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.653516+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:30.298045+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":499,"num_read_kb":33085,"num_write":1019,"num_write_kb":28183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"268'487","reported_seq":2082,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.535040+0000","last_change":"2024-09-12T01:02:55.535040+0000","last_active":"2024-09-12T01:02:55.535040+0000","last_peered":"2024-09-12T01:02:55.535040+0000","last_clean":"2024-09-12T01:02:55.535040+0000","last_became_active":"2024-09-12T00:15:57.037045+0000","last_became_peered":"2024-09-12T00:15:57.037045+0000","last_unstale":"2024-09-12T01:02:55.535040+0000","last_undegraded":"2024-09-12T01:02:55.535040+0000","last_fullsized":"2024-09-12T01:02:55.535040+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'487","last_scrub_stamp":"2024-09-12T01:02:55.534815+0000","last_deep_scrub":"268'487","last_deep_scrub_stamp":"2024-09-12T01:02:55.534815+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.534815+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:08.564034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2556,"num_read_kb":2389,"num_write":592,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"268'364","reported_seq":1103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.551146+0000","last_change":"2024-09-12T01:02:48.551146+0000","last_active":"2024-09-12T01:02:48.551146+0000","last_peered":"2024-09-12T01:02:48.551146+0000","last_clean":"2024-09-12T01:02:48.551146+0000","last_became_active":"2024-09-12T00:15:55.041976+0000","last_became_peered":"2024-09-12T00:15:55.041976+0000","last_unstale":"2024-09-12T01:02:48.551146+0000","last_undegraded":"2024-09-12T01:02:48.551146+0000","last_fullsized":"2024-09-12T01:02:48.551146+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-12T01:02:48.550777+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-12T01:02:48.550777+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.550777+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:08.855631+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055004,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":661,"num_read_kb":92017,"num_write":1205,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"268'483","reported_seq":1944,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.623516+0000","last_change":"2024-09-12T01:02:58.623516+0000","last_active":"2024-09-12T01:02:58.623516+0000","last_peered":"2024-09-12T01:02:58.623516+0000","last_clean":"2024-09-12T01:02:58.623516+0000","last_became_active":"2024-09-12T00:15:57.013278+0000","last_became_peered":"2024-09-12T00:15:57.013278+0000","last_unstale":"2024-09-12T01:02:58.623516+0000","last_undegraded":"2024-09-12T01:02:58.623516+0000","last_fullsized":"2024-09-12T01:02:58.623516+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'483","last_scrub_stamp":"2024-09-12T01:02:58.623336+0000","last_deep_scrub":"268'483","last_deep_scrub_stamp":"2024-09-12T01:02:58.623336+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.623336+0000","objects_scrubbed":7,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:39.099184+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2343,"num_read_kb":2167,"num_write":566,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1262,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"268'313","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.417143+0000","last_change":"2024-09-12T01:02:57.417143+0000","last_active":"2024-09-12T01:02:57.417143+0000","last_peered":"2024-09-12T01:02:57.417143+0000","last_clean":"2024-09-12T01:02:57.417143+0000","last_became_active":"2024-09-12T00:15:55.060127+0000","last_became_peered":"2024-09-12T00:15:55.060127+0000","last_unstale":"2024-09-12T01:02:57.417143+0000","last_undegraded":"2024-09-12T01:02:57.417143+0000","last_fullsized":"2024-09-12T01:02:57.417143+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-12T01:02:57.416899+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-12T01:02:57.416899+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.416899+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:10.862046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":41438,"num_write":900,"num_write_kb":44478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"268'983","reported_seq":2514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:48.416472+0000","last_change":"2024-09-12T00:15:57.052355+0000","last_active":"2024-09-12T01:00:48.416472+0000","last_peered":"2024-09-12T01:00:48.416472+0000","last_clean":"2024-09-12T01:00:48.416472+0000","last_became_active":"2024-09-12T00:15:57.051665+0000","last_became_peered":"2024-09-12T00:15:57.051665+0000","last_unstale":"2024-09-12T01:00:48.416472+0000","last_undegraded":"2024-09-12T01:00:48.416472+0000","last_fullsized":"2024-09-12T01:00:48.416472+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":900,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:20.500797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4673,"num_read_kb":4124,"num_write":1393,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"268'888","reported_seq":2500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.446445+0000","last_change":"2024-09-12T00:15:57.032298+0000","last_active":"2024-09-12T01:01:06.446445+0000","last_peered":"2024-09-12T01:01:06.446445+0000","last_clean":"2024-09-12T01:01:06.446445+0000","last_became_active":"2024-09-12T00:15:57.031897+0000","last_became_peered":"2024-09-12T00:15:57.031897+0000","last_unstale":"2024-09-12T01:01:06.446445+0000","last_undegraded":"2024-09-12T01:01:06.446445+0000","last_fullsized":"2024-09-12T01:01:06.446445+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":800,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:00.128491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4303,"num_read_kb":3853,"num_write":1201,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"268'315","reported_seq":943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.254737+0000","last_change":"2024-09-12T01:02:51.254737+0000","last_active":"2024-09-12T01:02:51.254737+0000","last_peered":"2024-09-12T01:02:51.254737+0000","last_clean":"2024-09-12T01:02:51.254737+0000","last_became_active":"2024-09-12T00:15:55.063797+0000","last_became_peered":"2024-09-12T00:15:55.063797+0000","last_unstale":"2024-09-12T01:02:51.254737+0000","last_undegraded":"2024-09-12T01:02:51.254737+0000","last_fullsized":"2024-09-12T01:02:51.254737+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'315","last_scrub_stamp":"2024-09-12T01:02:51.254463+0000","last_deep_scrub":"268'315","last_deep_scrub_stamp":"2024-09-12T01:02:51.254463+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.254463+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:01.868558+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":7341,"num_write":997,"num_write_kb":14342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"268'783","reported_seq":2221,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.530995+0000","last_change":"2024-09-12T01:02:58.530995+0000","last_active":"2024-09-12T01:02:58.530995+0000","last_peered":"2024-09-12T01:02:58.530995+0000","last_clean":"2024-09-12T01:02:58.530995+0000","last_became_active":"2024-09-12T00:15:57.017679+0000","last_became_peered":"2024-09-12T00:15:57.017679+0000","last_unstale":"2024-09-12T01:02:58.530995+0000","last_undegraded":"2024-09-12T01:02:58.530995+0000","last_fullsized":"2024-09-12T01:02:58.530995+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'783","last_scrub_stamp":"2024-09-12T01:02:58.530808+0000","last_deep_scrub":"268'783","last_deep_scrub_stamp":"2024-09-12T01:02:58.530808+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.530808+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:45.670510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3571,"num_read_kb":3210,"num_write":1015,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"268'379","reported_seq":1070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.374153+0000","last_change":"2024-09-12T01:02:56.374153+0000","last_active":"2024-09-12T01:02:56.374153+0000","last_peered":"2024-09-12T01:02:56.374153+0000","last_clean":"2024-09-12T01:02:56.374153+0000","last_became_active":"2024-09-12T00:16:26.794438+0000","last_became_peered":"2024-09-12T00:16:26.794438+0000","last_unstale":"2024-09-12T01:02:56.374153+0000","last_undegraded":"2024-09-12T01:02:56.374153+0000","last_fullsized":"2024-09-12T01:02:56.374153+0000","mapping_epoch":39,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'379","last_scrub_stamp":"2024-09-12T01:02:56.373913+0000","last_deep_scrub":"268'379","last_deep_scrub_stamp":"2024-09-12T01:02:56.373913+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.373913+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:38.623851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":637,"num_read_kb":170107,"num_write":1135,"num_write_kb":45359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,6],"acting":[5,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"268'415","reported_seq":1894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.158518+0000","last_change":"2024-09-12T01:02:55.158518+0000","last_active":"2024-09-12T01:02:55.158518+0000","last_peered":"2024-09-12T01:02:55.158518+0000","last_clean":"2024-09-12T01:02:55.158518+0000","last_became_active":"2024-09-12T00:15:57.039474+0000","last_became_peered":"2024-09-12T00:15:57.039474+0000","last_unstale":"2024-09-12T01:02:55.158518+0000","last_undegraded":"2024-09-12T01:02:55.158518+0000","last_fullsized":"2024-09-12T01:02:55.158518+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'415","last_scrub_stamp":"2024-09-12T01:02:55.158293+0000","last_deep_scrub":"268'415","last_deep_scrub_stamp":"2024-09-12T01:02:55.158293+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.158293+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:03.237879+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2320,"num_read_kb":2162,"num_write":506,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":873,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"268'339","reported_seq":1089,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.574049+0000","last_change":"2024-09-12T01:02:47.574049+0000","last_active":"2024-09-12T01:02:47.574049+0000","last_peered":"2024-09-12T01:02:47.574049+0000","last_clean":"2024-09-12T01:02:47.574049+0000","last_became_active":"2024-09-12T00:15:55.060170+0000","last_became_peered":"2024-09-12T00:15:55.060170+0000","last_unstale":"2024-09-12T01:02:47.574049+0000","last_undegraded":"2024-09-12T01:02:47.574049+0000","last_fullsized":"2024-09-12T01:02:47.574049+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:02:47.573937+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:02:47.573937+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.573937+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:55.671405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263219,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":623,"num_read_kb":11665,"num_write":1071,"num_write_kb":19684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"268'458","reported_seq":2062,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.080840+0000","last_change":"2024-09-12T01:03:00.080840+0000","last_active":"2024-09-12T01:03:00.080840+0000","last_peered":"2024-09-12T01:03:00.080840+0000","last_clean":"2024-09-12T01:03:00.080840+0000","last_became_active":"2024-09-12T00:15:57.044075+0000","last_became_peered":"2024-09-12T00:15:57.044075+0000","last_unstale":"2024-09-12T01:03:00.080840+0000","last_undegraded":"2024-09-12T01:03:00.080840+0000","last_fullsized":"2024-09-12T01:03:00.080840+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'458","last_scrub_stamp":"2024-09-12T01:03:00.080648+0000","last_deep_scrub":"268'458","last_deep_scrub_stamp":"2024-09-12T01:03:00.080648+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.080648+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:43.039820+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2345,"num_read_kb":2229,"num_write":503,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"268'357","reported_seq":1071,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.506774+0000","last_change":"2024-09-12T01:03:00.506774+0000","last_active":"2024-09-12T01:03:00.506774+0000","last_peered":"2024-09-12T01:03:00.506774+0000","last_clean":"2024-09-12T01:03:00.506774+0000","last_became_active":"2024-09-12T00:15:55.078352+0000","last_became_peered":"2024-09-12T00:15:55.078352+0000","last_unstale":"2024-09-12T01:03:00.506774+0000","last_undegraded":"2024-09-12T01:03:00.506774+0000","last_fullsized":"2024-09-12T01:03:00.506774+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'357","last_scrub_stamp":"2024-09-12T01:03:00.506512+0000","last_deep_scrub":"268'357","last_deep_scrub_stamp":"2024-09-12T01:03:00.506512+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.506512+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:30.459461+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3306265,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":657,"num_read_kb":46871,"num_write":1194,"num_write_kb":28820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"268'399","reported_seq":1872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.865538+0000","last_change":"2024-09-12T00:15:57.032920+0000","last_active":"2024-09-12T01:02:10.865538+0000","last_peered":"2024-09-12T01:02:10.865538+0000","last_clean":"2024-09-12T01:02:10.865538+0000","last_became_active":"2024-09-12T00:15:57.032173+0000","last_became_peered":"2024-09-12T00:15:57.032173+0000","last_unstale":"2024-09-12T01:02:10.865538+0000","last_undegraded":"2024-09-12T01:02:10.865538+0000","last_fullsized":"2024-09-12T01:02:10.865538+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:23.061664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2107,"num_read_kb":2010,"num_write":461,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"268'356","reported_seq":1087,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.981634+0000","last_change":"2024-09-12T01:02:52.981634+0000","last_active":"2024-09-12T01:02:52.981634+0000","last_peered":"2024-09-12T01:02:52.981634+0000","last_clean":"2024-09-12T01:02:52.981634+0000","last_became_active":"2024-09-12T00:15:55.066304+0000","last_became_peered":"2024-09-12T00:15:55.066304+0000","last_unstale":"2024-09-12T01:02:52.981634+0000","last_undegraded":"2024-09-12T01:02:52.981634+0000","last_fullsized":"2024-09-12T01:02:52.981634+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'356","last_scrub_stamp":"2024-09-12T01:02:52.981360+0000","last_deep_scrub":"268'356","last_deep_scrub_stamp":"2024-09-12T01:02:52.981360+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.981360+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:19.250065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":677,"num_read_kb":58383,"num_write":1149,"num_write_kb":49764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"268'1199","reported_seq":3228,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.154851+0000","last_change":"2024-09-12T01:02:57.154851+0000","last_active":"2024-09-12T01:02:57.154851+0000","last_peered":"2024-09-12T01:02:57.154851+0000","last_clean":"2024-09-12T01:02:57.154851+0000","last_became_active":"2024-09-12T00:15:57.021605+0000","last_became_peered":"2024-09-12T00:15:57.021605+0000","last_unstale":"2024-09-12T01:02:57.154851+0000","last_undegraded":"2024-09-12T01:02:57.154851+0000","last_fullsized":"2024-09-12T01:02:57.154851+0000","mapping_epoch":28,"log_start":"268'1100","ondisk_log_start":"268'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1199","last_scrub_stamp":"2024-09-12T01:02:57.154667+0000","last_deep_scrub":"268'1199","last_deep_scrub_stamp":"2024-09-12T01:02:57.154667+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.154667+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":1100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:25.819536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6433,"num_read_kb":5744,"num_write":1768,"num_write_kb":831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"268'298","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.033242+0000","last_change":"2024-09-12T01:02:52.033242+0000","last_active":"2024-09-12T01:02:52.033242+0000","last_peered":"2024-09-12T01:02:52.033242+0000","last_clean":"2024-09-12T01:02:52.033242+0000","last_became_active":"2024-09-12T00:15:55.050860+0000","last_became_peered":"2024-09-12T00:15:55.050860+0000","last_unstale":"2024-09-12T01:02:52.033242+0000","last_undegraded":"2024-09-12T01:02:52.033242+0000","last_fullsized":"2024-09-12T01:02:52.033242+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'298","last_scrub_stamp":"2024-09-12T01:02:52.032968+0000","last_deep_scrub":"268'298","last_deep_scrub_stamp":"2024-09-12T01:02:52.032968+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.032968+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:45.831551+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399261,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":8796,"num_write":982,"num_write_kb":26056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"268'150","reported_seq":649,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.320340+0000","last_change":"2024-09-12T00:16:05.096232+0000","last_active":"2024-09-12T01:01:07.320340+0000","last_peered":"2024-09-12T01:01:07.320340+0000","last_clean":"2024-09-12T01:01:07.320340+0000","last_became_active":"2024-09-12T00:16:05.095632+0000","last_became_peered":"2024-09-12T00:16:05.095632+0000","last_unstale":"2024-09-12T01:01:07.320340+0000","last_undegraded":"2024-09-12T01:01:07.320340+0000","last_fullsized":"2024-09-12T01:01:07.320340+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:47.445460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":139,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"268'392","reported_seq":1871,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.048288+0000","last_change":"2024-09-12T01:02:58.048288+0000","last_active":"2024-09-12T01:02:58.048288+0000","last_peered":"2024-09-12T01:02:58.048288+0000","last_clean":"2024-09-12T01:02:58.048288+0000","last_became_active":"2024-09-12T00:15:57.042317+0000","last_became_peered":"2024-09-12T00:15:57.042317+0000","last_unstale":"2024-09-12T01:02:58.048288+0000","last_undegraded":"2024-09-12T01:02:58.048288+0000","last_fullsized":"2024-09-12T01:02:58.048288+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'392","last_scrub_stamp":"2024-09-12T01:02:58.048067+0000","last_deep_scrub":"268'392","last_deep_scrub_stamp":"2024-09-12T01:02:58.048067+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.048067+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:28.572626+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2080,"num_read_kb":1982,"num_write":441,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"268'365","reported_seq":1022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.610527+0000","last_change":"2024-09-12T01:02:51.610527+0000","last_active":"2024-09-12T01:02:51.610527+0000","last_peered":"2024-09-12T01:02:51.610527+0000","last_clean":"2024-09-12T01:02:51.610527+0000","last_became_active":"2024-09-12T00:15:55.042690+0000","last_became_peered":"2024-09-12T00:15:55.042690+0000","last_unstale":"2024-09-12T01:02:51.610527+0000","last_undegraded":"2024-09-12T01:02:51.610527+0000","last_fullsized":"2024-09-12T01:02:51.610527+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-12T01:02:51.610328+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-12T01:02:51.610328+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.610328+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:01.531698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288443,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":537,"num_read_kb":60082,"num_write":1122,"num_write_kb":36322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219465+0000","last_change":"2024-09-12T00:15:59.047089+0000","last_active":"2024-09-12T00:59:29.219465+0000","last_peered":"2024-09-12T00:59:29.219465+0000","last_clean":"2024-09-12T00:59:29.219465+0000","last_became_active":"2024-09-12T00:15:59.046334+0000","last_became_peered":"2024-09-12T00:15:59.046334+0000","last_unstale":"2024-09-12T00:59:29.219465+0000","last_undegraded":"2024-09-12T00:59:29.219465+0000","last_fullsized":"2024-09-12T00:59:29.219465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:50.471898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"268'359","reported_seq":979,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.847733+0000","last_change":"2024-09-12T00:16:01.058485+0000","last_active":"2024-09-12T01:02:39.847733+0000","last_peered":"2024-09-12T01:02:39.847733+0000","last_clean":"2024-09-12T01:02:39.847733+0000","last_became_active":"2024-09-12T00:16:01.057657+0000","last_became_peered":"2024-09-12T00:16:01.057657+0000","last_unstale":"2024-09-12T01:02:39.847733+0000","last_undegraded":"2024-09-12T01:02:39.847733+0000","last_fullsized":"2024-09-12T01:02:39.847733+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:28.536472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49919,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":600,"num_read_kb":1282,"num_write":482,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185238+0000","last_change":"2024-09-12T00:16:03.099188+0000","last_active":"2024-09-12T00:59:33.185238+0000","last_peered":"2024-09-12T00:59:33.185238+0000","last_clean":"2024-09-12T00:59:33.185238+0000","last_became_active":"2024-09-12T00:16:03.098506+0000","last_became_peered":"2024-09-12T00:16:03.098506+0000","last_unstale":"2024-09-12T00:59:33.185238+0000","last_undegraded":"2024-09-12T00:59:33.185238+0000","last_fullsized":"2024-09-12T00:59:33.185238+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:09.926077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"268'152","reported_seq":715,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.258951+0000","last_change":"2024-09-12T00:16:05.105689+0000","last_active":"2024-09-12T01:01:02.258951+0000","last_peered":"2024-09-12T01:01:02.258951+0000","last_clean":"2024-09-12T01:01:02.258951+0000","last_became_active":"2024-09-12T00:16:05.105153+0000","last_became_peered":"2024-09-12T00:16:05.105153+0000","last_unstale":"2024-09-12T01:01:02.258951+0000","last_undegraded":"2024-09-12T01:01:02.258951+0000","last_fullsized":"2024-09-12T01:01:02.258951+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:12.364784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":214,"num_write":299,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"268'900","reported_seq":2532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.592009+0000","last_change":"2024-09-12T01:03:03.592009+0000","last_active":"2024-09-12T01:03:03.592009+0000","last_peered":"2024-09-12T01:03:03.592009+0000","last_clean":"2024-09-12T01:03:03.592009+0000","last_became_active":"2024-09-12T00:15:57.018484+0000","last_became_peered":"2024-09-12T00:15:57.018484+0000","last_unstale":"2024-09-12T01:03:03.592009+0000","last_undegraded":"2024-09-12T01:03:03.592009+0000","last_fullsized":"2024-09-12T01:03:03.592009+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'900","last_scrub_stamp":"2024-09-12T01:03:03.591747+0000","last_deep_scrub":"268'900","last_deep_scrub_stamp":"2024-09-12T01:03:03.591747+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.591747+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:57.427036+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4265,"num_read_kb":3809,"num_write":1199,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"268'363","reported_seq":1015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.060708+0000","last_change":"2024-09-12T01:02:49.060708+0000","last_active":"2024-09-12T01:02:49.060708+0000","last_peered":"2024-09-12T01:02:49.060708+0000","last_clean":"2024-09-12T01:02:49.060708+0000","last_became_active":"2024-09-12T00:15:55.065476+0000","last_became_peered":"2024-09-12T00:15:55.065476+0000","last_unstale":"2024-09-12T01:02:49.060708+0000","last_undegraded":"2024-09-12T01:02:49.060708+0000","last_fullsized":"2024-09-12T01:02:49.060708+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'363","last_scrub_stamp":"2024-09-12T01:02:49.060427+0000","last_deep_scrub":"268'363","last_deep_scrub_stamp":"2024-09-12T01:02:49.060427+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.060427+0000","objects_scrubbed":6,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:51.995984+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399070,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":579,"num_read_kb":7666,"num_write":1219,"num_write_kb":15378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:37.978445+0000","last_change":"2024-09-12T00:15:59.041196+0000","last_active":"2024-09-12T01:00:37.978445+0000","last_peered":"2024-09-12T01:00:37.978445+0000","last_clean":"2024-09-12T01:00:37.978445+0000","last_became_active":"2024-09-12T00:15:59.040412+0000","last_became_peered":"2024-09-12T00:15:59.040412+0000","last_unstale":"2024-09-12T01:00:37.978445+0000","last_undegraded":"2024-09-12T01:00:37.978445+0000","last_fullsized":"2024-09-12T01:00:37.978445+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"268'89","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:59.917462+0000","last_change":"2024-09-12T00:16:01.067472+0000","last_active":"2024-09-12T00:59:59.917462+0000","last_peered":"2024-09-12T00:59:59.917462+0000","last_clean":"2024-09-12T00:59:59.917462+0000","last_became_active":"2024-09-12T00:16:01.062780+0000","last_became_peered":"2024-09-12T00:16:01.062780+0000","last_unstale":"2024-09-12T00:59:59.917462+0000","last_undegraded":"2024-09-12T00:59:59.917462+0000","last_fullsized":"2024-09-12T00:59:59.917462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:25.299928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185153+0000","last_change":"2024-09-12T00:16:03.092617+0000","last_active":"2024-09-12T00:59:33.185153+0000","last_peered":"2024-09-12T00:59:33.185153+0000","last_clean":"2024-09-12T00:59:33.185153+0000","last_became_active":"2024-09-12T00:16:03.091926+0000","last_became_peered":"2024-09-12T00:16:03.091926+0000","last_unstale":"2024-09-12T00:59:33.185153+0000","last_undegraded":"2024-09-12T00:59:33.185153+0000","last_fullsized":"2024-09-12T00:59:33.185153+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:35.129510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"268'125","reported_seq":621,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:05.844320+0000","last_change":"2024-09-12T00:16:05.115080+0000","last_active":"2024-09-12T01:01:05.844320+0000","last_peered":"2024-09-12T01:01:05.844320+0000","last_clean":"2024-09-12T01:01:05.844320+0000","last_became_active":"2024-09-12T00:16:05.114182+0000","last_became_peered":"2024-09-12T00:16:05.114182+0000","last_unstale":"2024-09-12T01:01:05.844320+0000","last_undegraded":"2024-09-12T01:01:05.844320+0000","last_fullsized":"2024-09-12T01:01:05.844320+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:12.382388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":293,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"268'1230","reported_seq":2685,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.015822+0000","last_change":"2024-09-12T00:15:57.047647+0000","last_active":"2024-09-12T01:00:47.015822+0000","last_peered":"2024-09-12T01:00:47.015822+0000","last_clean":"2024-09-12T01:00:47.015822+0000","last_became_active":"2024-09-12T00:15:57.046916+0000","last_became_peered":"2024-09-12T00:15:57.046916+0000","last_unstale":"2024-09-12T01:00:47.015822+0000","last_undegraded":"2024-09-12T01:00:47.015822+0000","last_fullsized":"2024-09-12T01:00:47.015822+0000","mapping_epoch":28,"log_start":"268'1200","ondisk_log_start":"268'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:00.710335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5641,"num_read_kb":4945,"num_write":1755,"num_write_kb":746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"268'379","reported_seq":1171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.585252+0000","last_change":"2024-09-12T01:02:55.585252+0000","last_active":"2024-09-12T01:02:55.585252+0000","last_peered":"2024-09-12T01:02:55.585252+0000","last_clean":"2024-09-12T01:02:55.585252+0000","last_became_active":"2024-09-12T00:15:55.058428+0000","last_became_peered":"2024-09-12T00:15:55.058428+0000","last_unstale":"2024-09-12T01:02:55.585252+0000","last_undegraded":"2024-09-12T01:02:55.585252+0000","last_fullsized":"2024-09-12T01:02:55.585252+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'379","last_scrub_stamp":"2024-09-12T01:02:55.585005+0000","last_deep_scrub":"268'379","last_deep_scrub_stamp":"2024-09-12T01:02:55.585005+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.585005+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:14.899658+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":722,"num_read_kb":690,"num_write":1257,"num_write_kb":29311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179931+0000","last_change":"2024-09-12T00:15:59.040242+0000","last_active":"2024-09-12T00:59:33.179931+0000","last_peered":"2024-09-12T00:59:33.179931+0000","last_clean":"2024-09-12T00:59:33.179931+0000","last_became_active":"2024-09-12T00:15:59.039465+0000","last_became_peered":"2024-09-12T00:15:59.039465+0000","last_unstale":"2024-09-12T00:59:33.179931+0000","last_undegraded":"2024-09-12T00:59:33.179931+0000","last_fullsized":"2024-09-12T00:59:33.179931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:02.272155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"268'130","reported_seq":682,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:37.978523+0000","last_change":"2024-09-12T00:16:01.057413+0000","last_active":"2024-09-12T01:00:37.978523+0000","last_peered":"2024-09-12T01:00:37.978523+0000","last_clean":"2024-09-12T01:00:37.978523+0000","last_became_active":"2024-09-12T00:16:01.056702+0000","last_became_peered":"2024-09-12T00:16:01.056702+0000","last_unstale":"2024-09-12T01:00:37.978523+0000","last_undegraded":"2024-09-12T01:00:37.978523+0000","last_fullsized":"2024-09-12T01:00:37.978523+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":144,"num_read_kb":136,"num_write":100,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"268'802","reported_seq":2225,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.481677+0000","last_change":"2024-09-12T00:16:03.104735+0000","last_active":"2024-09-12T01:02:39.481677+0000","last_peered":"2024-09-12T01:02:39.481677+0000","last_clean":"2024-09-12T01:02:39.481677+0000","last_became_active":"2024-09-12T00:16:03.103292+0000","last_became_peered":"2024-09-12T00:16:03.103292+0000","last_unstale":"2024-09-12T01:02:39.481677+0000","last_undegraded":"2024-09-12T01:02:39.481677+0000","last_fullsized":"2024-09-12T01:02:39.481677+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:21.322414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"268'234","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.369432+0000","last_change":"2024-09-12T00:16:05.108369+0000","last_active":"2024-09-12T01:01:07.369432+0000","last_peered":"2024-09-12T01:01:07.369432+0000","last_clean":"2024-09-12T01:01:07.369432+0000","last_became_active":"2024-09-12T00:16:05.107785+0000","last_became_peered":"2024-09-12T00:16:05.107785+0000","last_unstale":"2024-09-12T01:01:07.369432+0000","last_undegraded":"2024-09-12T01:01:07.369432+0000","last_fullsized":"2024-09-12T01:01:07.369432+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:30.275724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":637,"num_write":534,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"268'635","reported_seq":2161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.998760+0000","last_change":"2024-09-12T00:15:57.036539+0000","last_active":"2024-09-12T01:00:39.998760+0000","last_peered":"2024-09-12T01:00:39.998760+0000","last_clean":"2024-09-12T01:00:39.998760+0000","last_became_active":"2024-09-12T00:15:57.035581+0000","last_became_peered":"2024-09-12T00:15:57.035581+0000","last_unstale":"2024-09-12T01:00:39.998760+0000","last_undegraded":"2024-09-12T01:00:39.998760+0000","last_fullsized":"2024-09-12T01:00:39.998760+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":600,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:01.577455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3178,"num_read_kb":2956,"num_write":875,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"268'336","reported_seq":1010,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.230246+0000","last_change":"2024-09-12T01:02:50.230246+0000","last_active":"2024-09-12T01:02:50.230246+0000","last_peered":"2024-09-12T01:02:50.230246+0000","last_clean":"2024-09-12T01:02:50.230246+0000","last_became_active":"2024-09-12T00:15:55.065178+0000","last_became_peered":"2024-09-12T00:15:55.065178+0000","last_unstale":"2024-09-12T01:02:50.230246+0000","last_undegraded":"2024-09-12T01:02:50.230246+0000","last_fullsized":"2024-09-12T01:02:50.230246+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'336","last_scrub_stamp":"2024-09-12T01:02:50.230018+0000","last_deep_scrub":"268'336","last_deep_scrub_stamp":"2024-09-12T01:02:50.230018+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.230018+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:17.900987+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262226,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":565,"num_write":1139,"num_write_kb":21852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219511+0000","last_change":"2024-09-12T00:15:59.040434+0000","last_active":"2024-09-12T00:59:29.219511+0000","last_peered":"2024-09-12T00:59:29.219511+0000","last_clean":"2024-09-12T00:59:29.219511+0000","last_became_active":"2024-09-12T00:15:59.039902+0000","last_became_peered":"2024-09-12T00:15:59.039902+0000","last_unstale":"2024-09-12T00:59:29.219511+0000","last_undegraded":"2024-09-12T00:59:29.219511+0000","last_fullsized":"2024-09-12T00:59:29.219511+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:50.427091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"268'279","reported_seq":851,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.469236+0000","last_change":"2024-09-12T00:16:01.053456+0000","last_active":"2024-09-12T01:02:39.469236+0000","last_peered":"2024-09-12T01:02:39.469236+0000","last_clean":"2024-09-12T01:02:39.469236+0000","last_became_active":"2024-09-12T00:16:01.052744+0000","last_became_peered":"2024-09-12T00:16:01.052744+0000","last_unstale":"2024-09-12T01:02:39.469236+0000","last_undegraded":"2024-09-12T01:02:39.469236+0000","last_fullsized":"2024-09-12T01:02:39.469236+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:17.018417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47709,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":1056,"num_write":378,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"268'815","reported_seq":2461,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:40.006672+0000","last_change":"2024-09-12T00:16:03.098659+0000","last_active":"2024-09-12T01:02:40.006672+0000","last_peered":"2024-09-12T01:02:40.006672+0000","last_clean":"2024-09-12T01:02:40.006672+0000","last_became_active":"2024-09-12T00:16:03.097895+0000","last_became_peered":"2024-09-12T00:16:03.097895+0000","last_unstale":"2024-09-12T01:02:40.006672+0000","last_undegraded":"2024-09-12T01:02:40.006672+0000","last_fullsized":"2024-09-12T01:02:40.006672+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"268'458","reported_seq":2011,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.582816+0000","last_change":"2024-09-12T00:15:57.023912+0000","last_active":"2024-09-12T01:01:09.582816+0000","last_peered":"2024-09-12T01:01:09.582816+0000","last_clean":"2024-09-12T01:01:09.582816+0000","last_became_active":"2024-09-12T00:15:57.023659+0000","last_became_peered":"2024-09-12T00:15:57.023659+0000","last_unstale":"2024-09-12T01:01:09.582816+0000","last_undegraded":"2024-09-12T01:01:09.582816+0000","last_fullsized":"2024-09-12T01:01:09.582816+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:02.798248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2457,"num_read_kb":2306,"num_write":563,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"268'375","reported_seq":1014,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:44.553031+0000","last_change":"2024-09-12T01:02:44.553031+0000","last_active":"2024-09-12T01:02:44.553031+0000","last_peered":"2024-09-12T01:02:44.553031+0000","last_clean":"2024-09-12T01:02:44.553031+0000","last_became_active":"2024-09-12T00:15:55.060679+0000","last_became_peered":"2024-09-12T00:15:55.060679+0000","last_unstale":"2024-09-12T01:02:44.553031+0000","last_undegraded":"2024-09-12T01:02:44.553031+0000","last_fullsized":"2024-09-12T01:02:44.553031+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'375","last_scrub_stamp":"2024-09-12T01:02:44.552852+0000","last_deep_scrub":"268'375","last_deep_scrub_stamp":"2024-09-12T01:02:44.552852+0000","last_clean_scrub_stamp":"2024-09-12T01:02:44.552852+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:52.618648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":484,"num_read_kb":16773,"num_write":1144,"num_write_kb":29370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.191150+0000","last_change":"2024-09-12T01:02:58.191150+0000","last_active":"2024-09-12T01:02:58.191150+0000","last_peered":"2024-09-12T01:02:58.191150+0000","last_clean":"2024-09-12T01:02:58.191150+0000","last_became_active":"2024-09-12T00:15:59.035288+0000","last_became_peered":"2024-09-12T00:15:59.035288+0000","last_unstale":"2024-09-12T01:02:58.191150+0000","last_undegraded":"2024-09-12T01:02:58.191150+0000","last_fullsized":"2024-09-12T01:02:58.191150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:58.190865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:58.190865+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.190865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:42.772188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"268'349","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.443258+0000","last_change":"2024-09-12T00:16:01.070645+0000","last_active":"2024-09-12T01:02:37.443258+0000","last_peered":"2024-09-12T01:02:37.443258+0000","last_clean":"2024-09-12T01:02:37.443258+0000","last_became_active":"2024-09-12T00:16:01.069838+0000","last_became_peered":"2024-09-12T00:16:01.069838+0000","last_unstale":"2024-09-12T01:02:37.443258+0000","last_undegraded":"2024-09-12T01:02:37.443258+0000","last_fullsized":"2024-09-12T01:02:37.443258+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:57.640957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45025,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":563,"num_read_kb":1131,"num_write":438,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.162032+0000","last_change":"2024-09-12T00:16:03.090231+0000","last_active":"2024-09-12T00:58:48.162032+0000","last_peered":"2024-09-12T00:58:48.162032+0000","last_clean":"2024-09-12T00:58:48.162032+0000","last_became_active":"2024-09-12T00:16:03.089533+0000","last_became_peered":"2024-09-12T00:16:03.089533+0000","last_unstale":"2024-09-12T00:58:48.162032+0000","last_undegraded":"2024-09-12T00:58:48.162032+0000","last_fullsized":"2024-09-12T00:58:48.162032+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:22.033467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"268'572","reported_seq":1384,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.041861+0000","last_change":"2024-09-12T00:16:05.114168+0000","last_active":"2024-09-12T01:02:12.041861+0000","last_peered":"2024-09-12T01:02:12.041861+0000","last_clean":"2024-09-12T01:02:12.041861+0000","last_became_active":"2024-09-12T00:16:05.112960+0000","last_became_peered":"2024-09-12T00:16:05.112960+0000","last_unstale":"2024-09-12T01:02:12.041861+0000","last_undegraded":"2024-09-12T01:02:12.041861+0000","last_fullsized":"2024-09-12T01:02:12.041861+0000","mapping_epoch":36,"log_start":"268'500","ondisk_log_start":"268'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:15.906818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1305,"num_read_kb":1300,"num_write":1202,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"268'525","reported_seq":2011,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.186856+0000","last_change":"2024-09-12T01:02:49.186856+0000","last_active":"2024-09-12T01:02:49.186856+0000","last_peered":"2024-09-12T01:02:49.186856+0000","last_clean":"2024-09-12T01:02:49.186856+0000","last_became_active":"2024-09-12T00:15:57.045141+0000","last_became_peered":"2024-09-12T00:15:57.045141+0000","last_unstale":"2024-09-12T01:02:49.186856+0000","last_undegraded":"2024-09-12T01:02:49.186856+0000","last_fullsized":"2024-09-12T01:02:49.186856+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'525","last_scrub_stamp":"2024-09-12T01:02:49.186637+0000","last_deep_scrub":"268'525","last_deep_scrub_stamp":"2024-09-12T01:02:49.186637+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.186637+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:02.660716+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2585,"num_read_kb":2367,"num_write":669,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"268'370","reported_seq":1024,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:45.502549+0000","last_change":"2024-09-12T01:02:45.502549+0000","last_active":"2024-09-12T01:02:45.502549+0000","last_peered":"2024-09-12T01:02:45.502549+0000","last_clean":"2024-09-12T01:02:45.502549+0000","last_became_active":"2024-09-12T00:15:55.063542+0000","last_became_peered":"2024-09-12T00:15:55.063542+0000","last_unstale":"2024-09-12T01:02:45.502549+0000","last_undegraded":"2024-09-12T01:02:45.502549+0000","last_fullsized":"2024-09-12T01:02:45.502549+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-12T01:02:45.502377+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-12T01:02:45.502377+0000","last_clean_scrub_stamp":"2024-09-12T01:02:45.502377+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:03.174691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":559,"num_read_kb":24074,"num_write":1250,"num_write_kb":38232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.118698+0000","last_change":"2024-09-12T01:03:01.118698+0000","last_active":"2024-09-12T01:03:01.118698+0000","last_peered":"2024-09-12T01:03:01.118698+0000","last_clean":"2024-09-12T01:03:01.118698+0000","last_became_active":"2024-09-12T00:15:59.050663+0000","last_became_peered":"2024-09-12T00:15:59.050663+0000","last_unstale":"2024-09-12T01:03:01.118698+0000","last_undegraded":"2024-09-12T01:03:01.118698+0000","last_fullsized":"2024-09-12T01:03:01.118698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:01.118502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:01.118502+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.118502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:20.630794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"268'245","reported_seq":825,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.445328+0000","last_change":"2024-09-12T00:16:01.069772+0000","last_active":"2024-09-12T01:02:38.445328+0000","last_peered":"2024-09-12T01:02:38.445328+0000","last_clean":"2024-09-12T01:02:38.445328+0000","last_became_active":"2024-09-12T00:16:01.068392+0000","last_became_peered":"2024-09-12T00:16:01.068392+0000","last_unstale":"2024-09-12T01:02:38.445328+0000","last_undegraded":"2024-09-12T01:02:38.445328+0000","last_fullsized":"2024-09-12T01:02:38.445328+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:56.300773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10400,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":388,"num_read_kb":849,"num_write":306,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179776+0000","last_change":"2024-09-12T00:16:03.087496+0000","last_active":"2024-09-12T00:59:33.179776+0000","last_peered":"2024-09-12T00:59:33.179776+0000","last_clean":"2024-09-12T00:59:33.179776+0000","last_became_active":"2024-09-12T00:16:03.086751+0000","last_became_peered":"2024-09-12T00:16:03.086751+0000","last_unstale":"2024-09-12T00:59:33.179776+0000","last_undegraded":"2024-09-12T00:59:33.179776+0000","last_fullsized":"2024-09-12T00:59:33.179776+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:20.968600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"268'2410","reported_seq":4246,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.403542+0000","last_change":"2024-09-12T00:16:05.115334+0000","last_active":"2024-09-12T01:02:01.403542+0000","last_peered":"2024-09-12T01:02:01.403542+0000","last_clean":"2024-09-12T01:02:01.403542+0000","last_became_active":"2024-09-12T00:16:05.114563+0000","last_became_peered":"2024-09-12T00:16:05.114563+0000","last_unstale":"2024-09-12T01:02:01.403542+0000","last_undegraded":"2024-09-12T01:02:01.403542+0000","last_fullsized":"2024-09-12T01:02:01.403542+0000","mapping_epoch":36,"log_start":"268'2300","ondisk_log_start":"268'2300","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":2300,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:14.259829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6030,"num_read_kb":6028,"num_write":4877,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"268'787","reported_seq":2366,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.638877+0000","last_change":"2024-09-12T01:02:51.638877+0000","last_active":"2024-09-12T01:02:51.638877+0000","last_peered":"2024-09-12T01:02:51.638877+0000","last_clean":"2024-09-12T01:02:51.638877+0000","last_became_active":"2024-09-12T00:15:57.024509+0000","last_became_peered":"2024-09-12T00:15:57.024509+0000","last_unstale":"2024-09-12T01:02:51.638877+0000","last_undegraded":"2024-09-12T01:02:51.638877+0000","last_fullsized":"2024-09-12T01:02:51.638877+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'787","last_scrub_stamp":"2024-09-12T01:02:51.638693+0000","last_deep_scrub":"268'787","last_deep_scrub_stamp":"2024-09-12T01:02:51.638693+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.638693+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:49.637175+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3769,"num_read_kb":3415,"num_write":1030,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"268'342","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.680665+0000","last_change":"2024-09-12T01:02:49.680665+0000","last_active":"2024-09-12T01:02:49.680665+0000","last_peered":"2024-09-12T01:02:49.680665+0000","last_clean":"2024-09-12T01:02:49.680665+0000","last_became_active":"2024-09-12T00:15:55.052916+0000","last_became_peered":"2024-09-12T00:15:55.052916+0000","last_unstale":"2024-09-12T01:02:49.680665+0000","last_undegraded":"2024-09-12T01:02:49.680665+0000","last_fullsized":"2024-09-12T01:02:49.680665+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-12T01:02:49.680438+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-12T01:02:49.680438+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.680438+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:55.122798+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306611,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":476,"num_read_kb":37817,"num_write":1138,"num_write_kb":39957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:47.188865+0000","last_change":"2024-09-12T00:15:59.035302+0000","last_active":"2024-09-12T00:58:47.188865+0000","last_peered":"2024-09-12T00:58:47.188865+0000","last_clean":"2024-09-12T00:58:47.188865+0000","last_became_active":"2024-09-12T00:15:59.034650+0000","last_became_peered":"2024-09-12T00:15:59.034650+0000","last_unstale":"2024-09-12T00:58:47.188865+0000","last_undegraded":"2024-09-12T00:58:47.188865+0000","last_fullsized":"2024-09-12T00:58:47.188865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:26.439328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"268'318","reported_seq":922,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.593445+0000","last_change":"2024-09-12T00:16:01.059061+0000","last_active":"2024-09-12T01:02:37.593445+0000","last_peered":"2024-09-12T01:02:37.593445+0000","last_clean":"2024-09-12T01:02:37.593445+0000","last_became_active":"2024-09-12T00:16:01.057281+0000","last_became_peered":"2024-09-12T00:16:01.057281+0000","last_unstale":"2024-09-12T01:02:37.593445+0000","last_undegraded":"2024-09-12T01:02:37.593445+0000","last_fullsized":"2024-09-12T01:02:37.593445+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:55.215685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49581,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":504,"num_read_kb":1060,"num_write":406,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"268'815","reported_seq":2423,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.371700+0000","last_change":"2024-09-12T00:16:03.098169+0000","last_active":"2024-09-12T01:02:39.371700+0000","last_peered":"2024-09-12T01:02:39.371700+0000","last_clean":"2024-09-12T01:02:39.371700+0000","last_became_active":"2024-09-12T00:16:03.097554+0000","last_became_peered":"2024-09-12T00:16:03.097554+0000","last_unstale":"2024-09-12T01:02:39.371700+0000","last_undegraded":"2024-09-12T01:02:39.371700+0000","last_fullsized":"2024-09-12T01:02:39.371700+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:01.820378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"268'94","reported_seq":599,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.780044+0000","last_change":"2024-09-12T00:16:05.113044+0000","last_active":"2024-09-12T01:02:10.780044+0000","last_peered":"2024-09-12T01:02:10.780044+0000","last_clean":"2024-09-12T01:02:10.780044+0000","last_became_active":"2024-09-12T00:16:05.112524+0000","last_became_peered":"2024-09-12T00:16:05.112524+0000","last_unstale":"2024-09-12T01:02:10.780044+0000","last_undegraded":"2024-09-12T01:02:10.780044+0000","last_fullsized":"2024-09-12T01:02:10.780044+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:08.645097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":109,"num_write":225,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"268'459","reported_seq":1834,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.410451+0000","last_change":"2024-09-12T01:03:01.410451+0000","last_active":"2024-09-12T01:03:01.410451+0000","last_peered":"2024-09-12T01:03:01.410451+0000","last_clean":"2024-09-12T01:03:01.410451+0000","last_became_active":"2024-09-12T00:15:57.042663+0000","last_became_peered":"2024-09-12T00:15:57.042663+0000","last_unstale":"2024-09-12T01:03:01.410451+0000","last_undegraded":"2024-09-12T01:03:01.410451+0000","last_fullsized":"2024-09-12T01:03:01.410451+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'459","last_scrub_stamp":"2024-09-12T01:03:01.410256+0000","last_deep_scrub":"268'459","last_deep_scrub_stamp":"2024-09-12T01:03:01.410256+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.410256+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:01.856062+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2110,"num_read_kb":1961,"num_write":540,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"268'346","reported_seq":1095,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.586675+0000","last_change":"2024-09-12T01:02:51.586675+0000","last_active":"2024-09-12T01:02:51.586675+0000","last_peered":"2024-09-12T01:02:51.586675+0000","last_clean":"2024-09-12T01:02:51.586675+0000","last_became_active":"2024-09-12T00:15:55.054533+0000","last_became_peered":"2024-09-12T00:15:55.054533+0000","last_unstale":"2024-09-12T01:02:51.586675+0000","last_undegraded":"2024-09-12T01:02:51.586675+0000","last_fullsized":"2024-09-12T01:02:51.586675+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:02:51.586430+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:02:51.586430+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.586430+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:34.921515+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263223,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":794,"num_read_kb":57067,"num_write":1127,"num_write_kb":15994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.131072+0000","last_change":"2024-09-12T01:03:02.131072+0000","last_active":"2024-09-12T01:03:02.131072+0000","last_peered":"2024-09-12T01:03:02.131072+0000","last_clean":"2024-09-12T01:03:02.131072+0000","last_became_active":"2024-09-12T00:15:59.037145+0000","last_became_peered":"2024-09-12T00:15:59.037145+0000","last_unstale":"2024-09-12T01:03:02.131072+0000","last_undegraded":"2024-09-12T01:03:02.131072+0000","last_fullsized":"2024-09-12T01:03:02.131072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:02.130877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:02.130877+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.130877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:34.886452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"268'485","reported_seq":1134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.687837+0000","last_change":"2024-09-12T00:16:01.069486+0000","last_active":"2024-09-12T01:02:38.687837+0000","last_peered":"2024-09-12T01:02:38.687837+0000","last_clean":"2024-09-12T01:02:38.687837+0000","last_became_active":"2024-09-12T00:16:01.068496+0000","last_became_peered":"2024-09-12T00:16:01.068496+0000","last_unstale":"2024-09-12T01:02:38.687837+0000","last_undegraded":"2024-09-12T01:02:38.687837+0000","last_fullsized":"2024-09-12T01:02:38.687837+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:18.290612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92831,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":846,"num_read_kb":2016,"num_write":692,"num_write_kb":581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.198874+0000","last_change":"2024-09-12T00:16:03.102755+0000","last_active":"2024-09-12T00:59:27.198874+0000","last_peered":"2024-09-12T00:59:27.198874+0000","last_clean":"2024-09-12T00:59:27.198874+0000","last_became_active":"2024-09-12T00:16:03.101984+0000","last_became_peered":"2024-09-12T00:16:03.101984+0000","last_unstale":"2024-09-12T00:59:27.198874+0000","last_undegraded":"2024-09-12T00:59:27.198874+0000","last_fullsized":"2024-09-12T00:59:27.198874+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:46.673834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"268'131","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.211991+0000","last_change":"2024-09-12T00:16:05.105645+0000","last_active":"2024-09-12T01:01:07.211991+0000","last_peered":"2024-09-12T01:01:07.211991+0000","last_clean":"2024-09-12T01:01:07.211991+0000","last_became_active":"2024-09-12T00:16:05.104674+0000","last_became_peered":"2024-09-12T00:16:05.104674+0000","last_unstale":"2024-09-12T01:01:07.211991+0000","last_undegraded":"2024-09-12T01:01:07.211991+0000","last_fullsized":"2024-09-12T01:01:07.211991+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:09.821079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":121,"num_write":297,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"268'781","reported_seq":2294,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.554858+0000","last_change":"2024-09-12T01:02:57.554858+0000","last_active":"2024-09-12T01:02:57.554858+0000","last_peered":"2024-09-12T01:02:57.554858+0000","last_clean":"2024-09-12T01:02:57.554858+0000","last_became_active":"2024-09-12T00:15:57.016954+0000","last_became_peered":"2024-09-12T00:15:57.016954+0000","last_unstale":"2024-09-12T01:02:57.554858+0000","last_undegraded":"2024-09-12T01:02:57.554858+0000","last_fullsized":"2024-09-12T01:02:57.554858+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'781","last_scrub_stamp":"2024-09-12T01:02:57.554627+0000","last_deep_scrub":"268'781","last_deep_scrub_stamp":"2024-09-12T01:02:57.554627+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.554627+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:39.189137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3833,"num_read_kb":3467,"num_write":1045,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"268'302","reported_seq":913,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.716410+0000","last_change":"2024-09-12T01:02:49.716410+0000","last_active":"2024-09-12T01:02:49.716410+0000","last_peered":"2024-09-12T01:02:49.716410+0000","last_clean":"2024-09-12T01:02:49.716410+0000","last_became_active":"2024-09-12T00:15:55.062854+0000","last_became_peered":"2024-09-12T00:15:55.062854+0000","last_unstale":"2024-09-12T01:02:49.716410+0000","last_undegraded":"2024-09-12T01:02:49.716410+0000","last_fullsized":"2024-09-12T01:02:49.716410+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'302","last_scrub_stamp":"2024-09-12T01:02:49.716161+0000","last_deep_scrub":"268'302","last_deep_scrub_stamp":"2024-09-12T01:02:49.716161+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.716161+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:41.591969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262214,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":412,"num_read_kb":12698,"num_write":975,"num_write_kb":17642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.827168+0000","last_change":"2024-09-12T01:03:00.827168+0000","last_active":"2024-09-12T01:03:00.827168+0000","last_peered":"2024-09-12T01:03:00.827168+0000","last_clean":"2024-09-12T01:03:00.827168+0000","last_became_active":"2024-09-12T00:15:59.033844+0000","last_became_peered":"2024-09-12T00:15:59.033844+0000","last_unstale":"2024-09-12T01:03:00.827168+0000","last_undegraded":"2024-09-12T01:03:00.827168+0000","last_fullsized":"2024-09-12T01:03:00.827168+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:00.826990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:00.826990+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.826990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:17.427435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"268'317","reported_seq":901,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.996732+0000","last_change":"2024-09-12T00:16:01.068155+0000","last_active":"2024-09-12T01:02:38.996732+0000","last_peered":"2024-09-12T01:02:38.996732+0000","last_clean":"2024-09-12T01:02:38.996732+0000","last_became_active":"2024-09-12T00:16:01.067377+0000","last_became_peered":"2024-09-12T00:16:01.067377+0000","last_unstale":"2024-09-12T01:02:38.996732+0000","last_undegraded":"2024-09-12T01:02:38.996732+0000","last_fullsized":"2024-09-12T01:02:38.996732+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:04.239296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":549,"num_read_kb":1240,"num_write":496,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168204+0000","last_change":"2024-09-12T00:16:03.079750+0000","last_active":"2024-09-12T00:59:02.168204+0000","last_peered":"2024-09-12T00:59:02.168204+0000","last_clean":"2024-09-12T00:59:02.168204+0000","last_became_active":"2024-09-12T00:16:03.079004+0000","last_became_peered":"2024-09-12T00:16:03.079004+0000","last_unstale":"2024-09-12T00:59:02.168204+0000","last_undegraded":"2024-09-12T00:59:02.168204+0000","last_fullsized":"2024-09-12T00:59:02.168204+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:46.457515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"268'127","reported_seq":617,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:01.407863+0000","last_change":"2024-09-12T00:16:05.094605+0000","last_active":"2024-09-12T01:02:01.407863+0000","last_peered":"2024-09-12T01:02:01.407863+0000","last_clean":"2024-09-12T01:02:01.407863+0000","last_became_active":"2024-09-12T00:16:05.093815+0000","last_became_peered":"2024-09-12T00:16:05.093815+0000","last_unstale":"2024-09-12T01:02:01.407863+0000","last_undegraded":"2024-09-12T01:02:01.407863+0000","last_fullsized":"2024-09-12T01:02:01.407863+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:25.421248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":302,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"268'447","reported_seq":1999,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.542377+0000","last_change":"2024-09-12T01:03:02.542377+0000","last_active":"2024-09-12T01:03:02.542377+0000","last_peered":"2024-09-12T01:03:02.542377+0000","last_clean":"2024-09-12T01:03:02.542377+0000","last_became_active":"2024-09-12T00:15:57.029290+0000","last_became_peered":"2024-09-12T00:15:57.029290+0000","last_unstale":"2024-09-12T01:03:02.542377+0000","last_undegraded":"2024-09-12T01:03:02.542377+0000","last_fullsized":"2024-09-12T01:03:02.542377+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'447","last_scrub_stamp":"2024-09-12T01:03:02.542185+0000","last_deep_scrub":"268'447","last_deep_scrub_stamp":"2024-09-12T01:03:02.542185+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.542185+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:21.152121+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2290,"num_read_kb":2163,"num_write":517,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":469,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"268'350","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.685091+0000","last_change":"2024-09-12T01:02:48.685091+0000","last_active":"2024-09-12T01:02:48.685091+0000","last_peered":"2024-09-12T01:02:48.685091+0000","last_clean":"2024-09-12T01:02:48.685091+0000","last_became_active":"2024-09-12T00:16:26.796888+0000","last_became_peered":"2024-09-12T00:16:26.796888+0000","last_unstale":"2024-09-12T01:02:48.685091+0000","last_undegraded":"2024-09-12T01:02:48.685091+0000","last_fullsized":"2024-09-12T01:02:48.685091+0000","mapping_epoch":39,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T01:02:48.684885+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T01:02:48.684885+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.684885+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:31.844783+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":37574,"num_write":1133,"num_write_kb":35076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,6],"acting":[3,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:47.188931+0000","last_change":"2024-09-12T00:15:59.030706+0000","last_active":"2024-09-12T00:58:47.188931+0000","last_peered":"2024-09-12T00:58:47.188931+0000","last_clean":"2024-09-12T00:58:47.188931+0000","last_became_active":"2024-09-12T00:15:59.029998+0000","last_became_peered":"2024-09-12T00:15:59.029998+0000","last_unstale":"2024-09-12T00:58:47.188931+0000","last_undegraded":"2024-09-12T00:58:47.188931+0000","last_fullsized":"2024-09-12T00:58:47.188931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:08.142841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"268'306","reported_seq":889,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.244753+0000","last_change":"2024-09-12T00:16:01.054348+0000","last_active":"2024-09-12T01:02:38.244753+0000","last_peered":"2024-09-12T01:02:38.244753+0000","last_clean":"2024-09-12T01:02:38.244753+0000","last_became_active":"2024-09-12T00:16:01.053660+0000","last_became_peered":"2024-09-12T00:16:01.053660+0000","last_unstale":"2024-09-12T01:02:38.244753+0000","last_undegraded":"2024-09-12T01:02:38.244753+0000","last_fullsized":"2024-09-12T01:02:38.244753+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:28.294852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54997,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":504,"num_read_kb":1130,"num_write":408,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"268'777","reported_seq":2367,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.569294+0000","last_change":"2024-09-12T00:16:03.098769+0000","last_active":"2024-09-12T01:02:38.569294+0000","last_peered":"2024-09-12T01:02:38.569294+0000","last_clean":"2024-09-12T01:02:38.569294+0000","last_became_active":"2024-09-12T00:16:03.098077+0000","last_became_peered":"2024-09-12T00:16:03.098077+0000","last_unstale":"2024-09-12T01:02:38.569294+0000","last_undegraded":"2024-09-12T01:02:38.569294+0000","last_fullsized":"2024-09-12T01:02:38.569294+0000","mapping_epoch":34,"log_start":"268'701","ondisk_log_start":"268'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":701,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:52.835421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"268'151","reported_seq":653,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:03.866324+0000","last_change":"2024-09-12T00:16:05.108146+0000","last_active":"2024-09-12T01:01:03.866324+0000","last_peered":"2024-09-12T01:01:03.866324+0000","last_clean":"2024-09-12T01:01:03.866324+0000","last_became_active":"2024-09-12T00:16:05.107291+0000","last_became_peered":"2024-09-12T00:16:05.107291+0000","last_unstale":"2024-09-12T01:01:03.866324+0000","last_undegraded":"2024-09-12T01:01:03.866324+0000","last_fullsized":"2024-09-12T01:01:03.866324+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:57.906444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":174,"num_read_kb":162,"num_write":365,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"268'796","reported_seq":2316,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.684735+0000","last_change":"2024-09-12T01:02:53.684735+0000","last_active":"2024-09-12T01:02:53.684735+0000","last_peered":"2024-09-12T01:02:53.684735+0000","last_clean":"2024-09-12T01:02:53.684735+0000","last_became_active":"2024-09-12T00:15:57.024185+0000","last_became_peered":"2024-09-12T00:15:57.024185+0000","last_unstale":"2024-09-12T01:02:53.684735+0000","last_undegraded":"2024-09-12T01:02:53.684735+0000","last_fullsized":"2024-09-12T01:02:53.684735+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'796","last_scrub_stamp":"2024-09-12T01:02:53.684558+0000","last_deep_scrub":"268'796","last_deep_scrub_stamp":"2024-09-12T01:02:53.684558+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.684558+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:16.494973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3776,"num_read_kb":3402,"num_write":1055,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"268'346","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.643233+0000","last_change":"2024-09-12T01:02:52.643233+0000","last_active":"2024-09-12T01:02:52.643233+0000","last_peered":"2024-09-12T01:02:52.643233+0000","last_clean":"2024-09-12T01:02:52.643233+0000","last_became_active":"2024-09-12T00:15:55.027001+0000","last_became_peered":"2024-09-12T00:15:55.027001+0000","last_unstale":"2024-09-12T01:02:52.643233+0000","last_undegraded":"2024-09-12T01:02:52.643233+0000","last_fullsized":"2024-09-12T01:02:52.643233+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:02:52.642900+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:02:52.642900+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.642900+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:21.246963+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7614964,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":429,"num_read_kb":53256,"num_write":866,"num_write_kb":32142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1470,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.204641+0000","last_change":"2024-09-12T01:03:03.204641+0000","last_active":"2024-09-12T01:03:03.204641+0000","last_peered":"2024-09-12T01:03:03.204641+0000","last_clean":"2024-09-12T01:03:03.204641+0000","last_became_active":"2024-09-12T00:15:59.035380+0000","last_became_peered":"2024-09-12T00:15:59.035380+0000","last_unstale":"2024-09-12T01:03:03.204641+0000","last_undegraded":"2024-09-12T01:03:03.204641+0000","last_fullsized":"2024-09-12T01:03:03.204641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:03:03.204443+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:03:03.204443+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.204443+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:11.470633+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":957,"num_read_kb":957,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"268'80","reported_seq":596,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:00.682139+0000","last_change":"2024-09-12T00:16:01.065768+0000","last_active":"2024-09-12T01:00:00.682139+0000","last_peered":"2024-09-12T01:00:00.682139+0000","last_clean":"2024-09-12T01:00:00.682139+0000","last_became_active":"2024-09-12T00:16:01.065038+0000","last_became_peered":"2024-09-12T00:16:01.065038+0000","last_unstale":"2024-09-12T01:00:00.682139+0000","last_undegraded":"2024-09-12T01:00:00.682139+0000","last_fullsized":"2024-09-12T01:00:00.682139+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:49.222908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"268'798","reported_seq":2365,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.136299+0000","last_change":"2024-09-12T00:16:03.089577+0000","last_active":"2024-09-12T01:02:37.136299+0000","last_peered":"2024-09-12T01:02:37.136299+0000","last_clean":"2024-09-12T01:02:37.136299+0000","last_became_active":"2024-09-12T00:16:03.088856+0000","last_became_peered":"2024-09-12T00:16:03.088856+0000","last_unstale":"2024-09-12T01:02:37.136299+0000","last_undegraded":"2024-09-12T01:02:37.136299+0000","last_fullsized":"2024-09-12T01:02:37.136299+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:36.628955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"268'127","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.435230+0000","last_change":"2024-09-12T00:16:05.108738+0000","last_active":"2024-09-12T01:01:06.435230+0000","last_peered":"2024-09-12T01:01:06.435230+0000","last_clean":"2024-09-12T01:01:06.435230+0000","last_became_active":"2024-09-12T00:16:05.107712+0000","last_became_peered":"2024-09-12T00:16:05.107712+0000","last_unstale":"2024-09-12T01:01:06.435230+0000","last_undegraded":"2024-09-12T01:01:06.435230+0000","last_fullsized":"2024-09-12T01:01:06.435230+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:00.734318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":150,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"268'859","reported_seq":2483,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.716343+0000","last_change":"2024-09-12T01:02:50.716343+0000","last_active":"2024-09-12T01:02:50.716343+0000","last_peered":"2024-09-12T01:02:50.716343+0000","last_clean":"2024-09-12T01:02:50.716343+0000","last_became_active":"2024-09-12T00:15:57.043447+0000","last_became_peered":"2024-09-12T00:15:57.043447+0000","last_unstale":"2024-09-12T01:02:50.716343+0000","last_undegraded":"2024-09-12T01:02:50.716343+0000","last_fullsized":"2024-09-12T01:02:50.716343+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'859","last_scrub_stamp":"2024-09-12T01:02:50.716156+0000","last_deep_scrub":"268'859","last_deep_scrub_stamp":"2024-09-12T01:02:50.716156+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.716156+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:50.072424+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4138,"num_read_kb":3738,"num_write":1141,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2781,"num_omap_keys":11,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"268'317","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.303242+0000","last_change":"2024-09-12T01:02:49.303242+0000","last_active":"2024-09-12T01:02:49.303242+0000","last_peered":"2024-09-12T01:02:49.303242+0000","last_clean":"2024-09-12T01:02:49.303242+0000","last_became_active":"2024-09-12T00:15:55.039512+0000","last_became_peered":"2024-09-12T00:15:55.039512+0000","last_unstale":"2024-09-12T01:02:49.303242+0000","last_undegraded":"2024-09-12T01:02:49.303242+0000","last_fullsized":"2024-09-12T01:02:49.303242+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'317","last_scrub_stamp":"2024-09-12T01:02:49.302955+0000","last_deep_scrub":"268'317","last_deep_scrub_stamp":"2024-09-12T01:02:49.302955+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.302955+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:28.690417+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655867,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":425,"num_read_kb":56944,"num_write":985,"num_write_kb":41414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:44.205861+0000","last_change":"2024-09-12T00:15:59.046399+0000","last_active":"2024-09-12T00:58:44.205861+0000","last_peered":"2024-09-12T00:58:44.205861+0000","last_clean":"2024-09-12T00:58:44.205861+0000","last_became_active":"2024-09-12T00:15:59.046018+0000","last_became_peered":"2024-09-12T00:15:59.046018+0000","last_unstale":"2024-09-12T00:58:44.205861+0000","last_undegraded":"2024-09-12T00:58:44.205861+0000","last_fullsized":"2024-09-12T00:58:44.205861+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:02.866037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"268'340","reported_seq":957,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.164857+0000","last_change":"2024-09-12T01:03:02.164857+0000","last_active":"2024-09-12T01:03:02.164857+0000","last_peered":"2024-09-12T01:03:02.164857+0000","last_clean":"2024-09-12T01:03:02.164857+0000","last_became_active":"2024-09-12T00:16:01.069078+0000","last_became_peered":"2024-09-12T00:16:01.069078+0000","last_unstale":"2024-09-12T01:03:02.164857+0000","last_undegraded":"2024-09-12T01:03:02.164857+0000","last_fullsized":"2024-09-12T01:03:02.164857+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'340","last_scrub_stamp":"2024-09-12T01:03:02.164644+0000","last_deep_scrub":"268'340","last_deep_scrub_stamp":"2024-09-12T01:03:02.164644+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.164644+0000","objects_scrubbed":8,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:23.713601+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46997,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":1097,"num_write":420,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.173630+0000","last_change":"2024-09-12T00:16:03.107385+0000","last_active":"2024-09-12T00:58:48.173630+0000","last_peered":"2024-09-12T00:58:48.173630+0000","last_clean":"2024-09-12T00:58:48.173630+0000","last_became_active":"2024-09-12T00:16:03.106662+0000","last_became_peered":"2024-09-12T00:16:03.106662+0000","last_unstale":"2024-09-12T00:58:48.173630+0000","last_undegraded":"2024-09-12T00:58:48.173630+0000","last_fullsized":"2024-09-12T00:58:48.173630+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:36.203314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"268'135","reported_seq":626,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:05.839461+0000","last_change":"2024-09-12T00:16:05.112393+0000","last_active":"2024-09-12T01:01:05.839461+0000","last_peered":"2024-09-12T01:01:05.839461+0000","last_clean":"2024-09-12T01:01:05.839461+0000","last_became_active":"2024-09-12T00:16:05.111705+0000","last_became_peered":"2024-09-12T00:16:05.111705+0000","last_unstale":"2024-09-12T01:01:05.839461+0000","last_undegraded":"2024-09-12T01:01:05.839461+0000","last_fullsized":"2024-09-12T01:01:05.839461+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:21.647320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":316,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"268'515","reported_seq":2104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.567033+0000","last_change":"2024-09-12T01:03:00.567033+0000","last_active":"2024-09-12T01:03:00.567033+0000","last_peered":"2024-09-12T01:03:00.567033+0000","last_clean":"2024-09-12T01:03:00.567033+0000","last_became_active":"2024-09-12T00:15:57.029211+0000","last_became_peered":"2024-09-12T00:15:57.029211+0000","last_unstale":"2024-09-12T01:03:00.567033+0000","last_undegraded":"2024-09-12T01:03:00.567033+0000","last_fullsized":"2024-09-12T01:03:00.567033+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'515","last_scrub_stamp":"2024-09-12T01:03:00.566844+0000","last_deep_scrub":"268'515","last_deep_scrub_stamp":"2024-09-12T01:03:00.566844+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.566844+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:35.368781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2638,"num_read_kb":2449,"num_write":617,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:45.219078+0000","last_change":"2024-09-12T01:02:45.219078+0000","last_active":"2024-09-12T01:02:45.219078+0000","last_peered":"2024-09-12T01:02:45.219078+0000","last_clean":"2024-09-12T01:02:45.219078+0000","last_became_active":"2024-09-12T00:15:34.145413+0000","last_became_peered":"2024-09-12T00:15:34.145413+0000","last_unstale":"2024-09-12T01:02:45.219078+0000","last_undegraded":"2024-09-12T01:02:45.219078+0000","last_fullsized":"2024-09-12T01:02:45.219078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-12T01:02:45.219010+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-12T01:02:45.219010+0000","last_clean_scrub_stamp":"2024-09-12T01:02:45.219010+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:41.967660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.679981+0000","last_change":"2024-09-12T01:02:46.679981+0000","last_active":"2024-09-12T01:02:46.679981+0000","last_peered":"2024-09-12T01:02:46.679981+0000","last_clean":"2024-09-12T01:02:46.679981+0000","last_became_active":"2024-09-12T00:15:40.490486+0000","last_became_peered":"2024-09-12T00:15:40.490486+0000","last_unstale":"2024-09-12T01:02:46.679981+0000","last_undegraded":"2024-09-12T01:02:46.679981+0000","last_fullsized":"2024-09-12T01:02:46.679981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:02:46.679880+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:02:46.679880+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.679880+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:23.630978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013201490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"268'332","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.269848+0000","last_change":"2024-09-12T01:02:48.269848+0000","last_active":"2024-09-12T01:02:48.269848+0000","last_peered":"2024-09-12T01:02:48.269848+0000","last_clean":"2024-09-12T01:02:48.269848+0000","last_became_active":"2024-09-12T00:15:55.048230+0000","last_became_peered":"2024-09-12T00:15:55.048230+0000","last_unstale":"2024-09-12T01:02:48.269848+0000","last_undegraded":"2024-09-12T01:02:48.269848+0000","last_fullsized":"2024-09-12T01:02:48.269848+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'332","last_scrub_stamp":"2024-09-12T01:02:48.269620+0000","last_deep_scrub":"268'332","last_deep_scrub_stamp":"2024-09-12T01:02:48.269620+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.269620+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:21.536299+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":550,"num_read_kb":9775,"num_write":1119,"num_write_kb":32871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.189322+0000","last_change":"2024-09-12T00:15:59.041780+0000","last_active":"2024-09-12T00:59:48.189322+0000","last_peered":"2024-09-12T00:59:48.189322+0000","last_clean":"2024-09-12T00:59:48.189322+0000","last_became_active":"2024-09-12T00:15:59.041357+0000","last_became_peered":"2024-09-12T00:15:59.041357+0000","last_unstale":"2024-09-12T00:59:48.189322+0000","last_undegraded":"2024-09-12T00:59:48.189322+0000","last_fullsized":"2024-09-12T00:59:48.189322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:31.097783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"268'725","reported_seq":1441,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.680324+0000","last_change":"2024-09-12T00:16:01.052726+0000","last_active":"2024-09-12T01:02:39.680324+0000","last_peered":"2024-09-12T01:02:39.680324+0000","last_clean":"2024-09-12T01:02:39.680324+0000","last_became_active":"2024-09-12T00:16:01.052016+0000","last_became_peered":"2024-09-12T00:16:01.052016+0000","last_unstale":"2024-09-12T01:02:39.680324+0000","last_undegraded":"2024-09-12T01:02:39.680324+0000","last_fullsized":"2024-09-12T01:02:39.680324+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:44.346178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164258,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1426,"num_read_kb":3353,"num_write":1318,"num_write_kb":1186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":488,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.199298+0000","last_change":"2024-09-12T00:16:03.099445+0000","last_active":"2024-09-12T00:59:27.199298+0000","last_peered":"2024-09-12T00:59:27.199298+0000","last_clean":"2024-09-12T00:59:27.199298+0000","last_became_active":"2024-09-12T00:16:03.097343+0000","last_became_peered":"2024-09-12T00:16:03.097343+0000","last_unstale":"2024-09-12T00:59:27.199298+0000","last_undegraded":"2024-09-12T00:59:27.199298+0000","last_fullsized":"2024-09-12T00:59:27.199298+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:08.255612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"268'171","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.245431+0000","last_change":"2024-09-12T00:16:05.113881+0000","last_active":"2024-09-12T01:01:07.245431+0000","last_peered":"2024-09-12T01:01:07.245431+0000","last_clean":"2024-09-12T01:01:07.245431+0000","last_became_active":"2024-09-12T00:16:05.113366+0000","last_became_peered":"2024-09-12T00:16:05.113366+0000","last_unstale":"2024-09-12T01:01:07.245431+0000","last_undegraded":"2024-09-12T01:01:07.245431+0000","last_fullsized":"2024-09-12T01:01:07.245431+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:18.255536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1020,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":408,"num_write":348,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"268'1046","reported_seq":2801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.449118+0000","last_change":"2024-09-12T01:03:00.449118+0000","last_active":"2024-09-12T01:03:00.449118+0000","last_peered":"2024-09-12T01:03:00.449118+0000","last_clean":"2024-09-12T01:03:00.449118+0000","last_became_active":"2024-09-12T00:15:57.047672+0000","last_became_peered":"2024-09-12T00:15:57.047672+0000","last_unstale":"2024-09-12T01:03:00.449118+0000","last_undegraded":"2024-09-12T01:03:00.449118+0000","last_fullsized":"2024-09-12T01:03:00.449118+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1046","last_scrub_stamp":"2024-09-12T01:03:00.448926+0000","last_deep_scrub":"268'1046","last_deep_scrub_stamp":"2024-09-12T01:03:00.448926+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.448926+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":1000,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:49.266149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5053,"num_read_kb":4502,"num_write":1469,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":542,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.723987+0000","last_change":"2024-09-12T01:02:47.723987+0000","last_active":"2024-09-12T01:02:47.723987+0000","last_peered":"2024-09-12T01:02:47.723987+0000","last_clean":"2024-09-12T01:02:47.723987+0000","last_became_active":"2024-09-12T00:15:40.098303+0000","last_became_peered":"2024-09-12T00:15:40.098303+0000","last_unstale":"2024-09-12T01:02:47.723987+0000","last_undegraded":"2024-09-12T01:02:47.723987+0000","last_fullsized":"2024-09-12T01:02:47.723987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:47.723827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:47.723827+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.723827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:34.869689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0017858660000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"268'328","reported_seq":989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.047495+0000","last_change":"2024-09-12T01:02:47.047495+0000","last_active":"2024-09-12T01:02:47.047495+0000","last_peered":"2024-09-12T01:02:47.047495+0000","last_clean":"2024-09-12T01:02:47.047495+0000","last_became_active":"2024-09-12T00:15:55.050874+0000","last_became_peered":"2024-09-12T00:15:55.050874+0000","last_unstale":"2024-09-12T01:02:47.047495+0000","last_undegraded":"2024-09-12T01:02:47.047495+0000","last_fullsized":"2024-09-12T01:02:47.047495+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'328","last_scrub_stamp":"2024-09-12T01:02:47.047228+0000","last_deep_scrub":"268'328","last_deep_scrub_stamp":"2024-09-12T01:02:47.047228+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.047228+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:26.163227+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2684897,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":131172,"num_write":1059,"num_write_kb":57813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:19.216989+0000","last_change":"2024-09-12T00:15:59.031231+0000","last_active":"2024-09-12T00:59:19.216989+0000","last_peered":"2024-09-12T00:59:19.216989+0000","last_clean":"2024-09-12T00:59:19.216989+0000","last_became_active":"2024-09-12T00:15:59.030858+0000","last_became_peered":"2024-09-12T00:15:59.030858+0000","last_unstale":"2024-09-12T00:59:19.216989+0000","last_undegraded":"2024-09-12T00:59:19.216989+0000","last_fullsized":"2024-09-12T00:59:19.216989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:14.830144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"268'1312","reported_seq":2814,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.998219+0000","last_change":"2024-09-12T00:16:01.058741+0000","last_active":"2024-09-12T01:02:39.998219+0000","last_peered":"2024-09-12T01:02:39.998219+0000","last_clean":"2024-09-12T01:02:39.998219+0000","last_became_active":"2024-09-12T00:16:01.057956+0000","last_became_peered":"2024-09-12T00:16:01.057956+0000","last_unstale":"2024-09-12T01:02:39.998219+0000","last_undegraded":"2024-09-12T01:02:39.998219+0000","last_fullsized":"2024-09-12T01:02:39.998219+0000","mapping_epoch":32,"log_start":"268'1300","ondisk_log_start":"268'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":1300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:22.472702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158341,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2071,"num_read_kb":3936,"num_write":1172,"num_write_kb":1006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:59.226747+0000","last_change":"2024-09-12T00:16:03.105384+0000","last_active":"2024-09-12T00:59:59.226747+0000","last_peered":"2024-09-12T00:59:59.226747+0000","last_clean":"2024-09-12T00:59:59.226747+0000","last_became_active":"2024-09-12T00:16:03.104040+0000","last_became_peered":"2024-09-12T00:16:03.104040+0000","last_unstale":"2024-09-12T00:59:59.226747+0000","last_undegraded":"2024-09-12T00:59:59.226747+0000","last_fullsized":"2024-09-12T00:59:59.226747+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:42.422978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"268'221","reported_seq":747,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.969829+0000","last_change":"2024-09-12T00:16:05.100831+0000","last_active":"2024-09-12T01:00:41.969829+0000","last_peered":"2024-09-12T01:00:41.969829+0000","last_clean":"2024-09-12T01:00:41.969829+0000","last_became_active":"2024-09-12T00:16:05.099987+0000","last_became_peered":"2024-09-12T00:16:05.099987+0000","last_unstale":"2024-09-12T01:00:41.969829+0000","last_undegraded":"2024-09-12T01:00:41.969829+0000","last_fullsized":"2024-09-12T01:00:41.969829+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:49.711006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":366,"num_read_kb":355,"num_write":494,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"268'397","reported_seq":1898,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.049982+0000","last_change":"2024-09-12T01:02:56.049982+0000","last_active":"2024-09-12T01:02:56.049982+0000","last_peered":"2024-09-12T01:02:56.049982+0000","last_clean":"2024-09-12T01:02:56.049982+0000","last_became_active":"2024-09-12T00:15:57.022193+0000","last_became_peered":"2024-09-12T00:15:57.022193+0000","last_unstale":"2024-09-12T01:02:56.049982+0000","last_undegraded":"2024-09-12T01:02:56.049982+0000","last_fullsized":"2024-09-12T01:02:56.049982+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'397","last_scrub_stamp":"2024-09-12T01:02:56.049789+0000","last_deep_scrub":"268'397","last_deep_scrub_stamp":"2024-09-12T01:02:56.049789+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.049789+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.648345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2164,"num_read_kb":2061,"num_write":440,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1009,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.684705+0000","last_change":"2024-09-12T01:02:47.684705+0000","last_active":"2024-09-12T01:02:47.684705+0000","last_peered":"2024-09-12T01:02:47.684705+0000","last_clean":"2024-09-12T01:02:47.684705+0000","last_became_active":"2024-09-12T00:15:40.095888+0000","last_became_peered":"2024-09-12T00:15:40.095888+0000","last_unstale":"2024-09-12T01:02:47.684705+0000","last_undegraded":"2024-09-12T01:02:47.684705+0000","last_fullsized":"2024-09-12T01:02:47.684705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:47.684478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:47.684478+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.684478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:12.159645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000883303,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"268'366","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.311262+0000","last_change":"2024-09-12T01:02:47.311262+0000","last_active":"2024-09-12T01:02:47.311262+0000","last_peered":"2024-09-12T01:02:47.311262+0000","last_clean":"2024-09-12T01:02:47.311262+0000","last_became_active":"2024-09-12T00:15:55.043174+0000","last_became_peered":"2024-09-12T00:15:55.043174+0000","last_unstale":"2024-09-12T01:02:47.311262+0000","last_undegraded":"2024-09-12T01:02:47.311262+0000","last_fullsized":"2024-09-12T01:02:47.311262+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'366","last_scrub_stamp":"2024-09-12T01:02:47.311008+0000","last_deep_scrub":"268'366","last_deep_scrub_stamp":"2024-09-12T01:02:47.311008+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.311008+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.727357+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":498,"num_read_kb":17440,"num_write":1129,"num_write_kb":28417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.786958+0000","last_change":"2024-09-12T01:02:59.786958+0000","last_active":"2024-09-12T01:02:59.786958+0000","last_peered":"2024-09-12T01:02:59.786958+0000","last_clean":"2024-09-12T01:02:59.786958+0000","last_became_active":"2024-09-12T00:15:59.033660+0000","last_became_peered":"2024-09-12T00:15:59.033660+0000","last_unstale":"2024-09-12T01:02:59.786958+0000","last_undegraded":"2024-09-12T01:02:59.786958+0000","last_fullsized":"2024-09-12T01:02:59.786958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:02:59.786685+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:02:59.786685+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.786685+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:29.273758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"268'260","reported_seq":1373,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.587816+0000","last_change":"2024-09-12T01:03:02.587816+0000","last_active":"2024-09-12T01:03:02.587816+0000","last_peered":"2024-09-12T01:03:02.587816+0000","last_clean":"2024-09-12T01:03:02.587816+0000","last_became_active":"2024-09-12T00:16:01.072168+0000","last_became_peered":"2024-09-12T00:16:01.072168+0000","last_unstale":"2024-09-12T01:03:02.587816+0000","last_undegraded":"2024-09-12T01:03:02.587816+0000","last_fullsized":"2024-09-12T01:03:02.587816+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'260","last_scrub_stamp":"2024-09-12T01:03:02.587570+0000","last_deep_scrub":"268'260","last_deep_scrub_stamp":"2024-09-12T01:03:02.587570+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.587570+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:58.907887+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.183287+0000","last_change":"2024-09-12T00:16:03.087413+0000","last_active":"2024-09-12T00:59:48.183287+0000","last_peered":"2024-09-12T00:59:48.183287+0000","last_clean":"2024-09-12T00:59:48.183287+0000","last_became_active":"2024-09-12T00:16:03.086646+0000","last_became_peered":"2024-09-12T00:16:03.086646+0000","last_unstale":"2024-09-12T00:59:48.183287+0000","last_undegraded":"2024-09-12T00:59:48.183287+0000","last_fullsized":"2024-09-12T00:59:48.183287+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:29.789535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"268'260","reported_seq":880,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.425705+0000","last_change":"2024-09-12T00:16:05.095458+0000","last_active":"2024-09-12T01:01:07.425705+0000","last_peered":"2024-09-12T01:01:07.425705+0000","last_clean":"2024-09-12T01:01:07.425705+0000","last_became_active":"2024-09-12T00:16:05.094684+0000","last_became_peered":"2024-09-12T00:16:05.094684+0000","last_unstale":"2024-09-12T01:01:07.425705+0000","last_undegraded":"2024-09-12T01:01:07.425705+0000","last_fullsized":"2024-09-12T01:01:07.425705+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:59.471541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":550,"num_read_kb":556,"num_write":574,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"268'874","reported_seq":2479,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.005503+0000","last_change":"2024-09-12T01:02:57.005503+0000","last_active":"2024-09-12T01:02:57.005503+0000","last_peered":"2024-09-12T01:02:57.005503+0000","last_clean":"2024-09-12T01:02:57.005503+0000","last_became_active":"2024-09-12T00:15:57.049533+0000","last_became_peered":"2024-09-12T00:15:57.049533+0000","last_unstale":"2024-09-12T01:02:57.005503+0000","last_undegraded":"2024-09-12T01:02:57.005503+0000","last_fullsized":"2024-09-12T01:02:57.005503+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'874","last_scrub_stamp":"2024-09-12T01:02:57.005246+0000","last_deep_scrub":"268'874","last_deep_scrub_stamp":"2024-09-12T01:02:57.005246+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.005246+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:59.310768+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4105,"num_read_kb":3691,"num_write":1162,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":544,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:45.698348+0000","last_change":"2024-09-12T01:02:45.698348+0000","last_active":"2024-09-12T01:02:45.698348+0000","last_peered":"2024-09-12T01:02:45.698348+0000","last_clean":"2024-09-12T01:02:45.698348+0000","last_became_active":"2024-09-12T00:15:40.144614+0000","last_became_peered":"2024-09-12T00:15:40.144614+0000","last_unstale":"2024-09-12T01:02:45.698348+0000","last_undegraded":"2024-09-12T01:02:45.698348+0000","last_fullsized":"2024-09-12T01:02:45.698348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:02:45.698281+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:02:45.698281+0000","last_clean_scrub_stamp":"2024-09-12T01:02:45.698281+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:37.018108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0019634679999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"268'351","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:45.560698+0000","last_change":"2024-09-12T01:02:45.560698+0000","last_active":"2024-09-12T01:02:45.560698+0000","last_peered":"2024-09-12T01:02:45.560698+0000","last_clean":"2024-09-12T01:02:45.560698+0000","last_became_active":"2024-09-12T00:15:55.060303+0000","last_became_peered":"2024-09-12T00:15:55.060303+0000","last_unstale":"2024-09-12T01:02:45.560698+0000","last_undegraded":"2024-09-12T01:02:45.560698+0000","last_fullsized":"2024-09-12T01:02:45.560698+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'351","last_scrub_stamp":"2024-09-12T01:02:45.560574+0000","last_deep_scrub":"268'351","last_deep_scrub_stamp":"2024-09-12T01:02:45.560574+0000","last_clean_scrub_stamp":"2024-09-12T01:02:45.560574+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:31.985568+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262201,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":640,"num_read_kb":10990,"num_write":1328,"num_write_kb":39626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.777064+0000","last_change":"2024-09-12T01:02:57.777064+0000","last_active":"2024-09-12T01:02:57.777064+0000","last_peered":"2024-09-12T01:02:57.777064+0000","last_clean":"2024-09-12T01:02:57.777064+0000","last_became_active":"2024-09-12T00:15:59.042545+0000","last_became_peered":"2024-09-12T00:15:59.042545+0000","last_unstale":"2024-09-12T01:02:57.777064+0000","last_undegraded":"2024-09-12T01:02:57.777064+0000","last_fullsized":"2024-09-12T01:02:57.777064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:57.776886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:57.776886+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.776886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:31.335494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"268'140","reported_seq":678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:09.645572+0000","last_change":"2024-09-12T00:16:01.048555+0000","last_active":"2024-09-12T01:02:09.645572+0000","last_peered":"2024-09-12T01:02:09.645572+0000","last_clean":"2024-09-12T01:02:09.645572+0000","last_became_active":"2024-09-12T00:16:01.047278+0000","last_became_peered":"2024-09-12T00:16:01.047278+0000","last_unstale":"2024-09-12T01:02:09.645572+0000","last_undegraded":"2024-09-12T01:02:09.645572+0000","last_fullsized":"2024-09-12T01:02:09.645572+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:52.572279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":143,"num_write":118,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:24.218190+0000","last_change":"2024-09-12T00:16:03.097752+0000","last_active":"2024-09-12T00:59:24.218190+0000","last_peered":"2024-09-12T00:59:24.218190+0000","last_clean":"2024-09-12T00:59:24.218190+0000","last_became_active":"2024-09-12T00:16:03.097029+0000","last_became_peered":"2024-09-12T00:16:03.097029+0000","last_unstale":"2024-09-12T00:59:24.218190+0000","last_undegraded":"2024-09-12T00:59:24.218190+0000","last_fullsized":"2024-09-12T00:59:24.218190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:58.710309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"268'157","reported_seq":732,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.216786+0000","last_change":"2024-09-12T00:16:05.112178+0000","last_active":"2024-09-12T01:01:07.216786+0000","last_peered":"2024-09-12T01:01:07.216786+0000","last_clean":"2024-09-12T01:01:07.216786+0000","last_became_active":"2024-09-12T00:16:05.111534+0000","last_became_peered":"2024-09-12T00:16:05.111534+0000","last_unstale":"2024-09-12T01:01:07.216786+0000","last_undegraded":"2024-09-12T01:01:07.216786+0000","last_fullsized":"2024-09-12T01:01:07.216786+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:54.359907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":344,"num_read_kb":315,"num_write":411,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"268'449","reported_seq":1941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.027532+0000","last_change":"2024-09-12T01:02:54.027532+0000","last_active":"2024-09-12T01:02:54.027532+0000","last_peered":"2024-09-12T01:02:54.027532+0000","last_clean":"2024-09-12T01:02:54.027532+0000","last_became_active":"2024-09-12T00:15:57.023909+0000","last_became_peered":"2024-09-12T00:15:57.023909+0000","last_unstale":"2024-09-12T01:02:54.027532+0000","last_undegraded":"2024-09-12T01:02:54.027532+0000","last_fullsized":"2024-09-12T01:02:54.027532+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'449","last_scrub_stamp":"2024-09-12T01:02:54.027335+0000","last_deep_scrub":"268'449","last_deep_scrub_stamp":"2024-09-12T01:02:54.027335+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.027335+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:33.856984+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2256,"num_read_kb":2116,"num_write":511,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"268'339","reported_seq":990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.549338+0000","last_change":"2024-09-12T01:02:47.549338+0000","last_active":"2024-09-12T01:02:47.549338+0000","last_peered":"2024-09-12T01:02:47.549338+0000","last_clean":"2024-09-12T01:02:47.549338+0000","last_became_active":"2024-09-12T00:15:55.056576+0000","last_became_peered":"2024-09-12T00:15:55.056576+0000","last_unstale":"2024-09-12T01:02:47.549338+0000","last_undegraded":"2024-09-12T01:02:47.549338+0000","last_fullsized":"2024-09-12T01:02:47.549338+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:02:47.549107+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:02:47.549107+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.549107+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:06.125443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262186,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":507,"num_write":1203,"num_write_kb":27643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.352302+0000","last_change":"2024-09-12T01:02:46.352302+0000","last_active":"2024-09-12T01:02:46.352302+0000","last_peered":"2024-09-12T01:02:46.352302+0000","last_clean":"2024-09-12T01:02:46.352302+0000","last_became_active":"2024-09-12T00:15:40.141037+0000","last_became_peered":"2024-09-12T00:15:40.141037+0000","last_unstale":"2024-09-12T01:02:46.352302+0000","last_undegraded":"2024-09-12T01:02:46.352302+0000","last_fullsized":"2024-09-12T01:02:46.352302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:46.352119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:46.352119+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.352119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:08.133964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00088972300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.183221+0000","last_change":"2024-09-12T00:15:59.045253+0000","last_active":"2024-09-12T00:59:48.183221+0000","last_peered":"2024-09-12T00:59:48.183221+0000","last_clean":"2024-09-12T00:59:48.183221+0000","last_became_active":"2024-09-12T00:15:59.043935+0000","last_became_peered":"2024-09-12T00:15:59.043935+0000","last_unstale":"2024-09-12T00:59:48.183221+0000","last_undegraded":"2024-09-12T00:59:48.183221+0000","last_fullsized":"2024-09-12T00:59:48.183221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:12.203334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"268'569","reported_seq":1251,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.861542+0000","last_change":"2024-09-12T01:03:01.861542+0000","last_active":"2024-09-12T01:03:01.861542+0000","last_peered":"2024-09-12T01:03:01.861542+0000","last_clean":"2024-09-12T01:03:01.861542+0000","last_became_active":"2024-09-12T00:16:01.051753+0000","last_became_peered":"2024-09-12T00:16:01.051753+0000","last_unstale":"2024-09-12T01:03:01.861542+0000","last_undegraded":"2024-09-12T01:03:01.861542+0000","last_fullsized":"2024-09-12T01:03:01.861542+0000","mapping_epoch":32,"log_start":"268'500","ondisk_log_start":"268'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'569","last_scrub_stamp":"2024-09-12T01:03:01.861331+0000","last_deep_scrub":"268'569","last_deep_scrub_stamp":"2024-09-12T01:03:01.861331+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.861331+0000","objects_scrubbed":11,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:48.337067+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93866,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1568,"num_read_kb":2666,"num_write":2048,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508024,"num_omap_keys":1152,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.555774+0000","last_change":"2024-09-12T01:03:02.555774+0000","last_active":"2024-09-12T01:03:02.555774+0000","last_peered":"2024-09-12T01:03:02.555774+0000","last_clean":"2024-09-12T01:03:02.555774+0000","last_became_active":"2024-09-12T00:16:03.099491+0000","last_became_peered":"2024-09-12T00:16:03.099491+0000","last_unstale":"2024-09-12T01:03:02.555774+0000","last_undegraded":"2024-09-12T01:03:02.555774+0000","last_fullsized":"2024-09-12T01:03:02.555774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:02.555464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:02.555464+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.555464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:31.132662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"268'110","reported_seq":605,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:30.754431+0000","last_change":"2024-09-12T00:16:05.100929+0000","last_active":"2024-09-12T01:00:30.754431+0000","last_peered":"2024-09-12T01:00:30.754431+0000","last_clean":"2024-09-12T01:00:30.754431+0000","last_became_active":"2024-09-12T00:16:05.099975+0000","last_became_peered":"2024-09-12T00:16:05.099975+0000","last_unstale":"2024-09-12T01:00:30.754431+0000","last_undegraded":"2024-09-12T01:00:30.754431+0000","last_fullsized":"2024-09-12T01:00:30.754431+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:02.033531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":90,"num_write":249,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"268'516","reported_seq":2250,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.037253+0000","last_change":"2024-09-12T01:02:55.037253+0000","last_active":"2024-09-12T01:02:55.037253+0000","last_peered":"2024-09-12T01:02:55.037253+0000","last_clean":"2024-09-12T01:02:55.037253+0000","last_became_active":"2024-09-12T00:15:57.019345+0000","last_became_peered":"2024-09-12T00:15:57.019345+0000","last_unstale":"2024-09-12T01:02:55.037253+0000","last_undegraded":"2024-09-12T01:02:55.037253+0000","last_fullsized":"2024-09-12T01:02:55.037253+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'516","last_scrub_stamp":"2024-09-12T01:02:55.037012+0000","last_deep_scrub":"268'516","last_deep_scrub_stamp":"2024-09-12T01:02:55.037012+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.037012+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:43.360929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2840,"num_read_kb":2674,"num_write":601,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2992,"num_omap_keys":12,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"268'351","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.075635+0000","last_change":"2024-09-12T01:02:48.075635+0000","last_active":"2024-09-12T01:02:48.075635+0000","last_peered":"2024-09-12T01:02:48.075635+0000","last_clean":"2024-09-12T01:02:48.075635+0000","last_became_active":"2024-09-12T00:15:55.064444+0000","last_became_peered":"2024-09-12T00:15:55.064444+0000","last_unstale":"2024-09-12T01:02:48.075635+0000","last_undegraded":"2024-09-12T01:02:48.075635+0000","last_fullsized":"2024-09-12T01:02:48.075635+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'351","last_scrub_stamp":"2024-09-12T01:02:48.075374+0000","last_deep_scrub":"268'351","last_deep_scrub_stamp":"2024-09-12T01:02:48.075374+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.075374+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:20.154477+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6340294,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":472,"num_read_kb":45788,"num_write":1017,"num_write_kb":51853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.583864+0000","last_change":"2024-09-12T01:02:57.583864+0000","last_active":"2024-09-12T01:02:57.583864+0000","last_peered":"2024-09-12T01:02:57.583864+0000","last_clean":"2024-09-12T01:02:57.583864+0000","last_became_active":"2024-09-12T00:15:40.093718+0000","last_became_peered":"2024-09-12T00:15:40.093718+0000","last_unstale":"2024-09-12T01:02:57.583864+0000","last_undegraded":"2024-09-12T01:02:57.583864+0000","last_fullsized":"2024-09-12T01:02:57.583864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:57.583651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:57.583651+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.583651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:24.058214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001992522,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.571338+0000","last_change":"2024-09-12T01:02:56.571338+0000","last_active":"2024-09-12T01:02:56.571338+0000","last_peered":"2024-09-12T01:02:56.571338+0000","last_clean":"2024-09-12T01:02:56.571338+0000","last_became_active":"2024-09-12T00:15:59.041390+0000","last_became_peered":"2024-09-12T00:15:59.041390+0000","last_unstale":"2024-09-12T01:02:56.571338+0000","last_undegraded":"2024-09-12T01:02:56.571338+0000","last_fullsized":"2024-09-12T01:02:56.571338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:56.571111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:56.571111+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.571111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:00.193486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"268'155","reported_seq":721,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.176909+0000","last_change":"2024-09-12T00:16:01.052772+0000","last_active":"2024-09-12T00:59:48.176909+0000","last_peered":"2024-09-12T00:59:48.176909+0000","last_clean":"2024-09-12T00:59:48.176909+0000","last_became_active":"2024-09-12T00:16:01.050630+0000","last_became_peered":"2024-09-12T00:16:01.050630+0000","last_unstale":"2024-09-12T00:59:48.176909+0000","last_undegraded":"2024-09-12T00:59:48.176909+0000","last_fullsized":"2024-09-12T00:59:48.176909+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:59.467265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":205,"num_read_kb":196,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"268'798","reported_seq":2728,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.130464+0000","last_change":"2024-09-12T00:16:03.104886+0000","last_active":"2024-09-12T01:02:37.130464+0000","last_peered":"2024-09-12T01:02:37.130464+0000","last_clean":"2024-09-12T01:02:37.130464+0000","last_became_active":"2024-09-12T00:16:03.104125+0000","last_became_peered":"2024-09-12T00:16:03.104125+0000","last_unstale":"2024-09-12T01:02:37.130464+0000","last_undegraded":"2024-09-12T01:02:37.130464+0000","last_fullsized":"2024-09-12T01:02:37.130464+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:43.285245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"268'113","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:17.202074+0000","last_change":"2024-09-12T00:16:05.115377+0000","last_active":"2024-09-12T01:01:17.202074+0000","last_peered":"2024-09-12T01:01:17.202074+0000","last_clean":"2024-09-12T01:01:17.202074+0000","last_became_active":"2024-09-12T00:16:05.114695+0000","last_became_peered":"2024-09-12T00:16:05.114695+0000","last_unstale":"2024-09-12T01:01:17.202074+0000","last_undegraded":"2024-09-12T01:01:17.202074+0000","last_fullsized":"2024-09-12T01:01:17.202074+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:16.956956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":134,"num_write":263,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"268'788","reported_seq":2361,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.186009+0000","last_change":"2024-09-12T01:02:55.186009+0000","last_active":"2024-09-12T01:02:55.186009+0000","last_peered":"2024-09-12T01:02:55.186009+0000","last_clean":"2024-09-12T01:02:55.186009+0000","last_became_active":"2024-09-12T00:15:57.027778+0000","last_became_peered":"2024-09-12T00:15:57.027778+0000","last_unstale":"2024-09-12T01:02:55.186009+0000","last_undegraded":"2024-09-12T01:02:55.186009+0000","last_fullsized":"2024-09-12T01:02:55.186009+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'788","last_scrub_stamp":"2024-09-12T01:02:55.185823+0000","last_deep_scrub":"268'788","last_deep_scrub_stamp":"2024-09-12T01:02:55.185823+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.185823+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:34.413708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3889,"num_read_kb":3532,"num_write":1033,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"268'413","reported_seq":1114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.220555+0000","last_change":"2024-09-12T01:02:47.220555+0000","last_active":"2024-09-12T01:02:47.220555+0000","last_peered":"2024-09-12T01:02:47.220555+0000","last_clean":"2024-09-12T01:02:47.220555+0000","last_became_active":"2024-09-12T00:15:55.048610+0000","last_became_peered":"2024-09-12T00:15:55.048610+0000","last_unstale":"2024-09-12T01:02:47.220555+0000","last_undegraded":"2024-09-12T01:02:47.220555+0000","last_fullsized":"2024-09-12T01:02:47.220555+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'413","last_scrub_stamp":"2024-09-12T01:02:47.220177+0000","last_deep_scrub":"268'413","last_deep_scrub_stamp":"2024-09-12T01:02:47.220177+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.220177+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:09.862325+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433395,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":696,"num_read_kb":32495,"num_write":1308,"num_write_kb":43441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":539,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.251707+0000","last_change":"2024-09-12T01:02:46.251707+0000","last_active":"2024-09-12T01:02:46.251707+0000","last_peered":"2024-09-12T01:02:46.251707+0000","last_clean":"2024-09-12T01:02:46.251707+0000","last_became_active":"2024-09-12T00:15:40.660718+0000","last_became_peered":"2024-09-12T00:15:40.660718+0000","last_unstale":"2024-09-12T01:02:46.251707+0000","last_undegraded":"2024-09-12T01:02:46.251707+0000","last_fullsized":"2024-09-12T01:02:46.251707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:46.251521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:46.251521+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.251521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:45.498343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080064100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"38'5","reported_seq":988,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.084832+0000","last_change":"2024-09-12T00:15:59.023300+0000","last_active":"2024-09-12T01:02:37.084832+0000","last_peered":"2024-09-12T01:02:37.084832+0000","last_clean":"2024-09-12T01:02:37.084832+0000","last_became_active":"2024-09-12T00:15:59.022598+0000","last_became_peered":"2024-09-12T00:15:59.022598+0000","last_unstale":"2024-09-12T01:02:37.084832+0000","last_undegraded":"2024-09-12T01:02:37.084832+0000","last_fullsized":"2024-09-12T01:02:37.084832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:14.157447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"268'111","reported_seq":660,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:49.224395+0000","last_change":"2024-09-12T00:16:01.063640+0000","last_active":"2024-09-12T00:59:49.224395+0000","last_peered":"2024-09-12T00:59:49.224395+0000","last_clean":"2024-09-12T00:59:49.224395+0000","last_became_active":"2024-09-12T00:16:01.061378+0000","last_became_peered":"2024-09-12T00:16:01.061378+0000","last_unstale":"2024-09-12T00:59:49.224395+0000","last_undegraded":"2024-09-12T00:59:49.224395+0000","last_fullsized":"2024-09-12T00:59:49.224395+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:32.478977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":124,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"268'815","reported_seq":4445,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.371941+0000","last_change":"2024-09-12T00:16:03.098212+0000","last_active":"2024-09-12T01:02:39.371941+0000","last_peered":"2024-09-12T01:02:39.371941+0000","last_clean":"2024-09-12T01:02:39.371941+0000","last_became_active":"2024-09-12T00:16:03.097533+0000","last_became_peered":"2024-09-12T00:16:03.097533+0000","last_unstale":"2024-09-12T01:02:39.371941+0000","last_undegraded":"2024-09-12T01:02:39.371941+0000","last_fullsized":"2024-09-12T01:02:39.371941+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:57.487410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"268'165","reported_seq":662,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:40.003597+0000","last_change":"2024-09-12T00:16:05.110783+0000","last_active":"2024-09-12T01:00:40.003597+0000","last_peered":"2024-09-12T01:00:40.003597+0000","last_clean":"2024-09-12T01:00:40.003597+0000","last_became_active":"2024-09-12T00:16:05.110012+0000","last_became_peered":"2024-09-12T00:16:05.110012+0000","last_unstale":"2024-09-12T01:00:40.003597+0000","last_undegraded":"2024-09-12T01:00:40.003597+0000","last_fullsized":"2024-09-12T01:00:40.003597+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:27.489900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":392,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"268'380","reported_seq":1840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.497640+0000","last_change":"2024-09-12T01:02:46.497640+0000","last_active":"2024-09-12T01:02:46.497640+0000","last_peered":"2024-09-12T01:02:46.497640+0000","last_clean":"2024-09-12T01:02:46.497640+0000","last_became_active":"2024-09-12T00:15:57.024399+0000","last_became_peered":"2024-09-12T00:15:57.024399+0000","last_unstale":"2024-09-12T01:02:46.497640+0000","last_undegraded":"2024-09-12T01:02:46.497640+0000","last_fullsized":"2024-09-12T01:02:46.497640+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-12T01:02:46.497554+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-12T01:02:46.497554+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.497554+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:56.056557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2040,"num_read_kb":1940,"num_write":430,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"268'339","reported_seq":990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.295542+0000","last_change":"2024-09-12T01:02:51.295542+0000","last_active":"2024-09-12T01:02:51.295542+0000","last_peered":"2024-09-12T01:02:51.295542+0000","last_clean":"2024-09-12T01:02:51.295542+0000","last_became_active":"2024-09-12T00:15:55.064782+0000","last_became_peered":"2024-09-12T00:15:55.064782+0000","last_unstale":"2024-09-12T01:02:51.295542+0000","last_undegraded":"2024-09-12T01:02:51.295542+0000","last_fullsized":"2024-09-12T01:02:51.295542+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:02:51.295109+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:02:51.295109+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.295109+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:28.870116+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2054932,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":492,"num_read_kb":4021,"num_write":1062,"num_write_kb":34802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.634341+0000","last_change":"2024-09-12T01:02:50.634341+0000","last_active":"2024-09-12T01:02:50.634341+0000","last_peered":"2024-09-12T01:02:50.634341+0000","last_clean":"2024-09-12T01:02:50.634341+0000","last_became_active":"2024-09-12T00:15:40.663617+0000","last_became_peered":"2024-09-12T00:15:40.663617+0000","last_unstale":"2024-09-12T01:02:50.634341+0000","last_undegraded":"2024-09-12T01:02:50.634341+0000","last_fullsized":"2024-09-12T01:02:50.634341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:50.634154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:50.634154+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.634154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:09.526825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002428801,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.189481+0000","last_change":"2024-09-12T00:15:59.040528+0000","last_active":"2024-09-12T01:00:13.189481+0000","last_peered":"2024-09-12T01:00:13.189481+0000","last_clean":"2024-09-12T01:00:13.189481+0000","last_became_active":"2024-09-12T00:15:59.039777+0000","last_became_peered":"2024-09-12T00:15:59.039777+0000","last_unstale":"2024-09-12T01:00:13.189481+0000","last_undegraded":"2024-09-12T01:00:13.189481+0000","last_fullsized":"2024-09-12T01:00:13.189481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:55.960948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"268'757","reported_seq":1489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.502826+0000","last_change":"2024-09-12T01:02:59.502826+0000","last_active":"2024-09-12T01:02:59.502826+0000","last_peered":"2024-09-12T01:02:59.502826+0000","last_clean":"2024-09-12T01:02:59.502826+0000","last_became_active":"2024-09-12T00:16:01.051967+0000","last_became_peered":"2024-09-12T00:16:01.051967+0000","last_unstale":"2024-09-12T01:02:59.502826+0000","last_undegraded":"2024-09-12T01:02:59.502826+0000","last_fullsized":"2024-09-12T01:02:59.502826+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'757","last_scrub_stamp":"2024-09-12T01:02:59.502579+0000","last_deep_scrub":"268'757","last_deep_scrub_stamp":"2024-09-12T01:02:59.502579+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.502579+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:00.575310+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138756,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1351,"num_read_kb":3224,"num_write":1110,"num_write_kb":922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.183148+0000","last_change":"2024-09-12T00:16:03.092521+0000","last_active":"2024-09-12T00:59:48.183148+0000","last_peered":"2024-09-12T00:59:48.183148+0000","last_clean":"2024-09-12T00:59:48.183148+0000","last_became_active":"2024-09-12T00:16:03.091920+0000","last_became_peered":"2024-09-12T00:16:03.091920+0000","last_unstale":"2024-09-12T00:59:48.183148+0000","last_undegraded":"2024-09-12T00:59:48.183148+0000","last_fullsized":"2024-09-12T00:59:48.183148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:35.406048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"268'139","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.474966+0000","last_change":"2024-09-12T00:16:05.113388+0000","last_active":"2024-09-12T01:01:06.474966+0000","last_peered":"2024-09-12T01:01:06.474966+0000","last_clean":"2024-09-12T01:01:06.474966+0000","last_became_active":"2024-09-12T00:16:05.112774+0000","last_became_peered":"2024-09-12T00:16:05.112774+0000","last_unstale":"2024-09-12T01:01:06.474966+0000","last_undegraded":"2024-09-12T01:01:06.474966+0000","last_fullsized":"2024-09-12T01:01:06.474966+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:27.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":230,"num_write":341,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"268'111","reported_seq":672,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.376870+0000","last_change":"2024-09-12T00:16:05.098437+0000","last_active":"2024-09-12T01:01:07.376870+0000","last_peered":"2024-09-12T01:01:07.376870+0000","last_clean":"2024-09-12T01:01:07.376870+0000","last_became_active":"2024-09-12T00:16:05.097548+0000","last_became_peered":"2024-09-12T00:16:05.097548+0000","last_unstale":"2024-09-12T01:01:07.376870+0000","last_undegraded":"2024-09-12T01:01:07.376870+0000","last_fullsized":"2024-09-12T01:01:07.376870+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:14.723156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":186,"num_read_kb":184,"num_write":255,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"268'855","reported_seq":2482,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.620835+0000","last_change":"2024-09-12T01:02:55.620835+0000","last_active":"2024-09-12T01:02:55.620835+0000","last_peered":"2024-09-12T01:02:55.620835+0000","last_clean":"2024-09-12T01:02:55.620835+0000","last_became_active":"2024-09-12T00:15:57.024237+0000","last_became_peered":"2024-09-12T00:15:57.024237+0000","last_unstale":"2024-09-12T01:02:55.620835+0000","last_undegraded":"2024-09-12T01:02:55.620835+0000","last_fullsized":"2024-09-12T01:02:55.620835+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'855","last_scrub_stamp":"2024-09-12T01:02:55.620655+0000","last_deep_scrub":"268'855","last_deep_scrub_stamp":"2024-09-12T01:02:55.620655+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.620655+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:41.671381+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4086,"num_read_kb":3684,"num_write":1101,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"268'295","reported_seq":945,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.550626+0000","last_change":"2024-09-12T01:02:56.550626+0000","last_active":"2024-09-12T01:02:56.550626+0000","last_peered":"2024-09-12T01:02:56.550626+0000","last_clean":"2024-09-12T01:02:56.550626+0000","last_became_active":"2024-09-12T00:16:26.420272+0000","last_became_peered":"2024-09-12T00:16:26.420272+0000","last_unstale":"2024-09-12T01:02:56.550626+0000","last_undegraded":"2024-09-12T01:02:56.550626+0000","last_fullsized":"2024-09-12T01:02:56.550626+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'295","last_scrub_stamp":"2024-09-12T01:02:56.550382+0000","last_deep_scrub":"268'295","last_deep_scrub_stamp":"2024-09-12T01:02:56.550382+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.550382+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:32.566018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213277,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":414,"num_read_kb":13074,"num_write":956,"num_write_kb":25707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,0],"acting":[3,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"268'4","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.145180+0000","last_change":"2024-09-12T01:03:03.145180+0000","last_active":"2024-09-12T01:03:03.145180+0000","last_peered":"2024-09-12T01:03:03.145180+0000","last_clean":"2024-09-12T01:03:03.145180+0000","last_became_active":"2024-09-12T00:15:59.039169+0000","last_became_peered":"2024-09-12T00:15:59.039169+0000","last_unstale":"2024-09-12T01:03:03.145180+0000","last_undegraded":"2024-09-12T01:03:03.145180+0000","last_fullsized":"2024-09-12T01:03:03.145180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:03:03.144984+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:03:03.144984+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.144984+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:54.544211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"268'285","reported_seq":863,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.518533+0000","last_change":"2024-09-12T00:16:01.067282+0000","last_active":"2024-09-12T01:02:37.518533+0000","last_peered":"2024-09-12T01:02:37.518533+0000","last_clean":"2024-09-12T01:02:37.518533+0000","last_became_active":"2024-09-12T00:16:01.066524+0000","last_became_peered":"2024-09-12T00:16:01.066524+0000","last_unstale":"2024-09-12T01:02:37.518533+0000","last_undegraded":"2024-09-12T01:02:37.518533+0000","last_fullsized":"2024-09-12T01:02:37.518533+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:46.086778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43678,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1068,"num_write":390,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:27.189140+0000","last_change":"2024-09-12T00:16:03.070194+0000","last_active":"2024-09-12T01:00:27.189140+0000","last_peered":"2024-09-12T01:00:27.189140+0000","last_clean":"2024-09-12T01:00:27.189140+0000","last_became_active":"2024-09-12T00:16:03.069399+0000","last_became_peered":"2024-09-12T00:16:03.069399+0000","last_unstale":"2024-09-12T01:00:27.189140+0000","last_undegraded":"2024-09-12T01:00:27.189140+0000","last_fullsized":"2024-09-12T01:00:27.189140+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:53.022367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"268'132","reported_seq":623,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:52.173811+0000","last_change":"2024-09-12T00:16:05.103043+0000","last_active":"2024-09-12T01:00:52.173811+0000","last_peered":"2024-09-12T01:00:52.173811+0000","last_clean":"2024-09-12T01:00:52.173811+0000","last_became_active":"2024-09-12T00:16:05.102118+0000","last_became_peered":"2024-09-12T00:16:05.102118+0000","last_unstale":"2024-09-12T01:00:52.173811+0000","last_undegraded":"2024-09-12T01:00:52.173811+0000","last_fullsized":"2024-09-12T01:00:52.173811+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:10.930503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":111,"num_write":330,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"268'498","reported_seq":2230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.226442+0000","last_change":"2024-09-12T01:02:53.226442+0000","last_active":"2024-09-12T01:02:53.226442+0000","last_peered":"2024-09-12T01:02:53.226442+0000","last_clean":"2024-09-12T01:02:53.226442+0000","last_became_active":"2024-09-12T00:15:57.031322+0000","last_became_peered":"2024-09-12T00:15:57.031322+0000","last_unstale":"2024-09-12T01:02:53.226442+0000","last_undegraded":"2024-09-12T01:02:53.226442+0000","last_fullsized":"2024-09-12T01:02:53.226442+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'498","last_scrub_stamp":"2024-09-12T01:02:53.226262+0000","last_deep_scrub":"268'498","last_deep_scrub_stamp":"2024-09-12T01:02:53.226262+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.226262+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:59.880724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2639,"num_write":567,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"268'457","reported_seq":1173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.555317+0000","last_change":"2024-09-12T01:02:46.555317+0000","last_active":"2024-09-12T01:02:46.555317+0000","last_peered":"2024-09-12T01:02:46.555317+0000","last_clean":"2024-09-12T01:02:46.555317+0000","last_became_active":"2024-09-12T00:15:55.065964+0000","last_became_peered":"2024-09-12T00:15:55.065964+0000","last_unstale":"2024-09-12T01:02:46.555317+0000","last_undegraded":"2024-09-12T01:02:46.555317+0000","last_fullsized":"2024-09-12T01:02:46.555317+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'457","last_scrub_stamp":"2024-09-12T01:02:46.555204+0000","last_deep_scrub":"268'457","last_deep_scrub_stamp":"2024-09-12T01:02:46.555204+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.555204+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:12.493482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5768209,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":905,"num_read_kb":8759,"num_write":1307,"num_write_kb":27844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:23.191792+0000","last_change":"2024-09-12T00:15:59.044538+0000","last_active":"2024-09-12T01:00:23.191792+0000","last_peered":"2024-09-12T01:00:23.191792+0000","last_clean":"2024-09-12T01:00:23.191792+0000","last_became_active":"2024-09-12T00:15:59.043146+0000","last_became_peered":"2024-09-12T00:15:59.043146+0000","last_unstale":"2024-09-12T01:00:23.191792+0000","last_undegraded":"2024-09-12T01:00:23.191792+0000","last_fullsized":"2024-09-12T01:00:23.191792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:38.791557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"268'49","reported_seq":558,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:23.191663+0000","last_change":"2024-09-12T00:16:01.055742+0000","last_active":"2024-09-12T01:00:23.191663+0000","last_peered":"2024-09-12T01:00:23.191663+0000","last_clean":"2024-09-12T01:00:23.191663+0000","last_became_active":"2024-09-12T00:16:01.055002+0000","last_became_peered":"2024-09-12T00:16:01.055002+0000","last_unstale":"2024-09-12T01:00:23.191663+0000","last_undegraded":"2024-09-12T01:00:23.191663+0000","last_fullsized":"2024-09-12T01:00:23.191663+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:31.414501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:23.198789+0000","last_change":"2024-09-12T00:16:03.108240+0000","last_active":"2024-09-12T01:00:23.198789+0000","last_peered":"2024-09-12T01:00:23.198789+0000","last_clean":"2024-09-12T01:00:23.198789+0000","last_became_active":"2024-09-12T00:16:03.107695+0000","last_became_peered":"2024-09-12T00:16:03.107695+0000","last_unstale":"2024-09-12T01:00:23.198789+0000","last_undegraded":"2024-09-12T01:00:23.198789+0000","last_fullsized":"2024-09-12T01:00:23.198789+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:20.303982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"268'245","reported_seq":797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.454102+0000","last_change":"2024-09-12T00:16:05.107880+0000","last_active":"2024-09-12T01:01:06.454102+0000","last_peered":"2024-09-12T01:01:06.454102+0000","last_clean":"2024-09-12T01:01:06.454102+0000","last_became_active":"2024-09-12T00:16:05.106742+0000","last_became_peered":"2024-09-12T00:16:05.106742+0000","last_unstale":"2024-09-12T01:01:06.454102+0000","last_undegraded":"2024-09-12T01:01:06.454102+0000","last_fullsized":"2024-09-12T01:01:06.454102+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:30.878014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":438,"num_read_kb":396,"num_write":482,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"268'397","reported_seq":1842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.275301+0000","last_change":"2024-09-12T01:02:52.275301+0000","last_active":"2024-09-12T01:02:52.275301+0000","last_peered":"2024-09-12T01:02:52.275301+0000","last_clean":"2024-09-12T01:02:52.275301+0000","last_became_active":"2024-09-12T00:15:57.015397+0000","last_became_peered":"2024-09-12T00:15:57.015397+0000","last_unstale":"2024-09-12T01:02:52.275301+0000","last_undegraded":"2024-09-12T01:02:52.275301+0000","last_fullsized":"2024-09-12T01:02:52.275301+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'397","last_scrub_stamp":"2024-09-12T01:02:52.275074+0000","last_deep_scrub":"268'397","last_deep_scrub_stamp":"2024-09-12T01:02:52.275074+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.275074+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:02.312499+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2041,"num_read_kb":1937,"num_write":459,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"268'320","reported_seq":955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.632454+0000","last_change":"2024-09-12T01:02:49.632454+0000","last_active":"2024-09-12T01:02:49.632454+0000","last_peered":"2024-09-12T01:02:49.632454+0000","last_clean":"2024-09-12T01:02:49.632454+0000","last_became_active":"2024-09-12T00:15:55.062990+0000","last_became_peered":"2024-09-12T00:15:55.062990+0000","last_unstale":"2024-09-12T01:02:49.632454+0000","last_undegraded":"2024-09-12T01:02:49.632454+0000","last_fullsized":"2024-09-12T01:02:49.632454+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-09-12T01:02:49.632190+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-09-12T01:02:49.632190+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.632190+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:54.520313+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838529,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":442,"num_read_kb":9756,"num_write":997,"num_write_kb":17415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.583322+0000","last_change":"2024-09-12T01:03:01.583322+0000","last_active":"2024-09-12T01:03:01.583322+0000","last_peered":"2024-09-12T01:03:01.583322+0000","last_clean":"2024-09-12T01:03:01.583322+0000","last_became_active":"2024-09-12T00:15:59.029162+0000","last_became_peered":"2024-09-12T00:15:59.029162+0000","last_unstale":"2024-09-12T01:03:01.583322+0000","last_undegraded":"2024-09-12T01:03:01.583322+0000","last_fullsized":"2024-09-12T01:03:01.583322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:01.583122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:01.583122+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.583122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:27.595470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"268'283","reported_seq":871,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.395561+0000","last_change":"2024-09-12T00:16:01.060247+0000","last_active":"2024-09-12T01:02:39.395561+0000","last_peered":"2024-09-12T01:02:39.395561+0000","last_clean":"2024-09-12T01:02:39.395561+0000","last_became_active":"2024-09-12T00:16:01.059517+0000","last_became_peered":"2024-09-12T00:16:01.059517+0000","last_unstale":"2024-09-12T01:02:39.395561+0000","last_undegraded":"2024-09-12T01:02:39.395561+0000","last_fullsized":"2024-09-12T01:02:39.395561+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:40.375904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51265,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":460,"num_read_kb":973,"num_write":358,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:23.196779+0000","last_change":"2024-09-12T00:16:03.104263+0000","last_active":"2024-09-12T01:00:23.196779+0000","last_peered":"2024-09-12T01:00:23.196779+0000","last_clean":"2024-09-12T01:00:23.196779+0000","last_became_active":"2024-09-12T00:16:03.103630+0000","last_became_peered":"2024-09-12T00:16:03.103630+0000","last_unstale":"2024-09-12T01:00:23.196779+0000","last_undegraded":"2024-09-12T01:00:23.196779+0000","last_fullsized":"2024-09-12T01:00:23.196779+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:39.452322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"268'165","reported_seq":678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:01.555845+0000","last_change":"2024-09-12T00:16:05.110450+0000","last_active":"2024-09-12T01:00:01.555845+0000","last_peered":"2024-09-12T01:00:01.555845+0000","last_clean":"2024-09-12T01:00:01.555845+0000","last_became_active":"2024-09-12T00:16:05.109745+0000","last_became_peered":"2024-09-12T00:16:05.109745+0000","last_unstale":"2024-09-12T01:00:01.555845+0000","last_undegraded":"2024-09-12T01:00:01.555845+0000","last_fullsized":"2024-09-12T01:00:01.555845+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:15.769156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":406,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"268'423","reported_seq":1868,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.679246+0000","last_change":"2024-09-12T01:02:53.679246+0000","last_active":"2024-09-12T01:02:53.679246+0000","last_peered":"2024-09-12T01:02:53.679246+0000","last_clean":"2024-09-12T01:02:53.679246+0000","last_became_active":"2024-09-12T00:15:57.028820+0000","last_became_peered":"2024-09-12T00:15:57.028820+0000","last_unstale":"2024-09-12T01:02:53.679246+0000","last_undegraded":"2024-09-12T01:02:53.679246+0000","last_fullsized":"2024-09-12T01:02:53.679246+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'423","last_scrub_stamp":"2024-09-12T01:02:53.679070+0000","last_deep_scrub":"268'423","last_deep_scrub_stamp":"2024-09-12T01:02:53.679070+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.679070+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:24.203431+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2332,"num_read_kb":2186,"num_write":478,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1006,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"268'304","reported_seq":963,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.317898+0000","last_change":"2024-09-12T01:02:51.317898+0000","last_active":"2024-09-12T01:02:51.317898+0000","last_peered":"2024-09-12T01:02:51.317898+0000","last_clean":"2024-09-12T01:02:51.317898+0000","last_became_active":"2024-09-12T00:15:55.054712+0000","last_became_peered":"2024-09-12T00:15:55.054712+0000","last_unstale":"2024-09-12T01:02:51.317898+0000","last_undegraded":"2024-09-12T01:02:51.317898+0000","last_fullsized":"2024-09-12T01:02:51.317898+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'304","last_scrub_stamp":"2024-09-12T01:02:51.317700+0000","last_deep_scrub":"268'304","last_deep_scrub_stamp":"2024-09-12T01:02:51.317700+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.317700+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:15.787375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25680,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":448,"num_read_kb":100896,"num_write":1015,"num_write_kb":52799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:19.231696+0000","last_change":"2024-09-12T00:15:59.030022+0000","last_active":"2024-09-12T01:00:19.231696+0000","last_peered":"2024-09-12T01:00:19.231696+0000","last_clean":"2024-09-12T01:00:19.231696+0000","last_became_active":"2024-09-12T00:15:59.028885+0000","last_became_peered":"2024-09-12T00:15:59.028885+0000","last_unstale":"2024-09-12T01:00:19.231696+0000","last_undegraded":"2024-09-12T01:00:19.231696+0000","last_fullsized":"2024-09-12T01:00:19.231696+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:22.611802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"268'269","reported_seq":837,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.181851+0000","last_change":"2024-09-12T00:16:01.056020+0000","last_active":"2024-09-12T01:02:39.181851+0000","last_peered":"2024-09-12T01:02:39.181851+0000","last_clean":"2024-09-12T01:02:39.181851+0000","last_became_active":"2024-09-12T00:16:01.050654+0000","last_became_peered":"2024-09-12T00:16:01.050654+0000","last_unstale":"2024-09-12T01:02:39.181851+0000","last_undegraded":"2024-09-12T01:02:39.181851+0000","last_fullsized":"2024-09-12T01:02:39.181851+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:07.059509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":1024,"num_write":358,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":487,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:27.189339+0000","last_change":"2024-09-12T00:16:03.089923+0000","last_active":"2024-09-12T01:00:27.189339+0000","last_peered":"2024-09-12T01:00:27.189339+0000","last_clean":"2024-09-12T01:00:27.189339+0000","last_became_active":"2024-09-12T00:16:03.088929+0000","last_became_peered":"2024-09-12T00:16:03.088929+0000","last_unstale":"2024-09-12T01:00:27.189339+0000","last_undegraded":"2024-09-12T01:00:27.189339+0000","last_fullsized":"2024-09-12T01:00:27.189339+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:16.321808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"268'421","reported_seq":2042,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.226413+0000","last_change":"2024-09-12T00:15:57.040165+0000","last_active":"2024-09-12T01:01:07.226413+0000","last_peered":"2024-09-12T01:01:07.226413+0000","last_clean":"2024-09-12T01:01:07.226413+0000","last_became_active":"2024-09-12T00:15:57.039919+0000","last_became_peered":"2024-09-12T00:15:57.039919+0000","last_unstale":"2024-09-12T01:01:07.226413+0000","last_undegraded":"2024-09-12T01:01:07.226413+0000","last_fullsized":"2024-09-12T01:01:07.226413+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:23.081811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2299,"num_read_kb":2203,"num_write":481,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"268'299","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.357075+0000","last_change":"2024-09-12T01:02:48.357075+0000","last_active":"2024-09-12T01:02:48.357075+0000","last_peered":"2024-09-12T01:02:48.357075+0000","last_clean":"2024-09-12T01:02:48.357075+0000","last_became_active":"2024-09-12T00:15:55.079264+0000","last_became_peered":"2024-09-12T00:15:55.079264+0000","last_unstale":"2024-09-12T01:02:48.357075+0000","last_undegraded":"2024-09-12T01:02:48.357075+0000","last_fullsized":"2024-09-12T01:02:48.357075+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'299","last_scrub_stamp":"2024-09-12T01:02:48.356731+0000","last_deep_scrub":"268'299","last_deep_scrub_stamp":"2024-09-12T01:02:48.356731+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.356731+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:01.723914+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311670,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":380,"num_read_kb":14024,"num_write":902,"num_write_kb":16591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.183037+0000","last_change":"2024-09-12T00:15:59.047833+0000","last_active":"2024-09-12T01:00:13.183037+0000","last_peered":"2024-09-12T01:00:13.183037+0000","last_clean":"2024-09-12T01:00:13.183037+0000","last_became_active":"2024-09-12T00:15:59.039042+0000","last_became_peered":"2024-09-12T00:15:59.039042+0000","last_unstale":"2024-09-12T01:00:13.183037+0000","last_undegraded":"2024-09-12T01:00:13.183037+0000","last_fullsized":"2024-09-12T01:00:13.183037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:09.753392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"268'494","reported_seq":1126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.106201+0000","last_change":"2024-09-12T00:16:01.063315+0000","last_active":"2024-09-12T01:02:39.106201+0000","last_peered":"2024-09-12T01:02:39.106201+0000","last_clean":"2024-09-12T01:02:39.106201+0000","last_became_active":"2024-09-12T00:16:01.062625+0000","last_became_peered":"2024-09-12T00:16:01.062625+0000","last_unstale":"2024-09-12T01:02:39.106201+0000","last_undegraded":"2024-09-12T01:02:39.106201+0000","last_fullsized":"2024-09-12T01:02:39.106201+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:42.064557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91700,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":904,"num_read_kb":2175,"num_write":782,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.169019+0000","last_change":"2024-09-12T00:16:03.088732+0000","last_active":"2024-09-12T00:58:33.169019+0000","last_peered":"2024-09-12T00:58:33.169019+0000","last_clean":"2024-09-12T00:58:33.169019+0000","last_became_active":"2024-09-12T00:16:03.087980+0000","last_became_peered":"2024-09-12T00:16:03.087980+0000","last_unstale":"2024-09-12T00:58:33.169019+0000","last_undegraded":"2024-09-12T00:58:33.169019+0000","last_fullsized":"2024-09-12T00:58:33.169019+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:06.045851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"268'129","reported_seq":628,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:43.121942+0000","last_change":"2024-09-12T00:16:05.099199+0000","last_active":"2024-09-12T01:00:43.121942+0000","last_peered":"2024-09-12T01:00:43.121942+0000","last_clean":"2024-09-12T01:00:43.121942+0000","last_became_active":"2024-09-12T00:16:05.098424+0000","last_became_peered":"2024-09-12T00:16:05.098424+0000","last_unstale":"2024-09-12T01:00:43.121942+0000","last_undegraded":"2024-09-12T01:00:43.121942+0000","last_fullsized":"2024-09-12T01:00:43.121942+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":165,"num_write":285,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"268'842","reported_seq":2439,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.169938+0000","last_change":"2024-09-12T01:02:56.169938+0000","last_active":"2024-09-12T01:02:56.169938+0000","last_peered":"2024-09-12T01:02:56.169938+0000","last_clean":"2024-09-12T01:02:56.169938+0000","last_became_active":"2024-09-12T00:15:57.022709+0000","last_became_peered":"2024-09-12T00:15:57.022709+0000","last_unstale":"2024-09-12T01:02:56.169938+0000","last_undegraded":"2024-09-12T01:02:56.169938+0000","last_fullsized":"2024-09-12T01:02:56.169938+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'842","last_scrub_stamp":"2024-09-12T01:02:56.169713+0000","last_deep_scrub":"268'842","last_deep_scrub_stamp":"2024-09-12T01:02:56.169713+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.169713+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:31.117935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3967,"num_read_kb":3571,"num_write":1117,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1379,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"268'292","reported_seq":941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.308689+0000","last_change":"2024-09-12T01:02:50.308689+0000","last_active":"2024-09-12T01:02:50.308689+0000","last_peered":"2024-09-12T01:02:50.308689+0000","last_clean":"2024-09-12T01:02:50.308689+0000","last_became_active":"2024-09-12T00:15:55.064940+0000","last_became_peered":"2024-09-12T00:15:55.064940+0000","last_unstale":"2024-09-12T01:02:50.308689+0000","last_undegraded":"2024-09-12T01:02:50.308689+0000","last_fullsized":"2024-09-12T01:02:50.308689+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'292","last_scrub_stamp":"2024-09-12T01:02:50.308457+0000","last_deep_scrub":"268'292","last_deep_scrub_stamp":"2024-09-12T01:02:50.308457+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.308457+0000","objects_scrubbed":6,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:18.717527+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1909911,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":2788,"num_write":1025,"num_write_kb":39220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:48.188274+0000","last_change":"2024-09-12T00:15:59.035109+0000","last_active":"2024-09-12T00:59:48.188274+0000","last_peered":"2024-09-12T00:59:48.188274+0000","last_clean":"2024-09-12T00:59:48.188274+0000","last_became_active":"2024-09-12T00:15:59.034648+0000","last_became_peered":"2024-09-12T00:15:59.034648+0000","last_unstale":"2024-09-12T00:59:48.188274+0000","last_undegraded":"2024-09-12T00:59:48.188274+0000","last_fullsized":"2024-09-12T00:59:48.188274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:33.763390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"268'281","reported_seq":870,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.246715+0000","last_change":"2024-09-12T00:16:01.048774+0000","last_active":"2024-09-12T01:02:39.246715+0000","last_peered":"2024-09-12T01:02:39.246715+0000","last_clean":"2024-09-12T01:02:39.246715+0000","last_became_active":"2024-09-12T00:16:01.046783+0000","last_became_peered":"2024-09-12T00:16:01.046783+0000","last_unstale":"2024-09-12T01:02:39.246715+0000","last_undegraded":"2024-09-12T01:02:39.246715+0000","last_fullsized":"2024-09-12T01:02:39.246715+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:16.650144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45699,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":1022,"num_write":398,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":486,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:37.186492+0000","last_change":"2024-09-12T00:16:03.098371+0000","last_active":"2024-09-12T00:58:37.186492+0000","last_peered":"2024-09-12T00:58:37.186492+0000","last_clean":"2024-09-12T00:58:37.186492+0000","last_became_active":"2024-09-12T00:16:03.097160+0000","last_became_peered":"2024-09-12T00:16:03.097160+0000","last_unstale":"2024-09-12T00:58:37.186492+0000","last_undegraded":"2024-09-12T00:58:37.186492+0000","last_fullsized":"2024-09-12T00:58:37.186492+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:26.964444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"268'210","reported_seq":764,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:49.750132+0000","last_change":"2024-09-12T00:16:05.102618+0000","last_active":"2024-09-12T01:00:49.750132+0000","last_peered":"2024-09-12T01:00:49.750132+0000","last_clean":"2024-09-12T01:00:49.750132+0000","last_became_active":"2024-09-12T00:16:05.101338+0000","last_became_peered":"2024-09-12T00:16:05.101338+0000","last_unstale":"2024-09-12T01:00:49.750132+0000","last_undegraded":"2024-09-12T01:00:49.750132+0000","last_fullsized":"2024-09-12T01:00:49.750132+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1401,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":396,"num_read_kb":348,"num_write":595,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"268'506","reported_seq":2096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.685414+0000","last_change":"2024-09-12T01:02:54.685414+0000","last_active":"2024-09-12T01:02:54.685414+0000","last_peered":"2024-09-12T01:02:54.685414+0000","last_clean":"2024-09-12T01:02:54.685414+0000","last_became_active":"2024-09-12T00:15:57.034257+0000","last_became_peered":"2024-09-12T00:15:57.034257+0000","last_unstale":"2024-09-12T01:02:54.685414+0000","last_undegraded":"2024-09-12T01:02:54.685414+0000","last_fullsized":"2024-09-12T01:02:54.685414+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'506","last_scrub_stamp":"2024-09-12T01:02:54.685233+0000","last_deep_scrub":"268'506","last_deep_scrub_stamp":"2024-09-12T01:02:54.685233+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.685233+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:00.855007+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2760,"num_read_kb":2552,"num_write":653,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"268'359","reported_seq":1108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.174196+0000","last_change":"2024-09-12T01:02:46.174196+0000","last_active":"2024-09-12T01:02:46.174196+0000","last_peered":"2024-09-12T01:02:46.174196+0000","last_clean":"2024-09-12T01:02:46.174196+0000","last_became_active":"2024-09-12T00:15:55.035741+0000","last_became_peered":"2024-09-12T00:15:55.035741+0000","last_unstale":"2024-09-12T01:02:46.174196+0000","last_undegraded":"2024-09-12T01:02:46.174196+0000","last_fullsized":"2024-09-12T01:02:46.174196+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T01:02:46.174096+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T01:02:46.174096+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.174096+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:23.160018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":693,"num_read_kb":41169,"num_write":1152,"num_write_kb":26675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.627134+0000","last_change":"2024-09-12T01:03:00.627134+0000","last_active":"2024-09-12T01:03:00.627134+0000","last_peered":"2024-09-12T01:03:00.627134+0000","last_clean":"2024-09-12T01:03:00.627134+0000","last_became_active":"2024-09-12T00:15:59.044761+0000","last_became_peered":"2024-09-12T00:15:59.044761+0000","last_unstale":"2024-09-12T01:03:00.627134+0000","last_undegraded":"2024-09-12T01:03:00.627134+0000","last_fullsized":"2024-09-12T01:03:00.627134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:00.626946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:00.626946+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.626946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:42.833587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"268'292","reported_seq":872,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.823176+0000","last_change":"2024-09-12T00:16:01.053808+0000","last_active":"2024-09-12T01:02:37.823176+0000","last_peered":"2024-09-12T01:02:37.823176+0000","last_clean":"2024-09-12T01:02:37.823176+0000","last_became_active":"2024-09-12T00:16:01.052731+0000","last_became_peered":"2024-09-12T00:16:01.052731+0000","last_unstale":"2024-09-12T01:02:37.823176+0000","last_undegraded":"2024-09-12T01:02:37.823176+0000","last_fullsized":"2024-09-12T01:02:37.823176+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:17.432079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50253,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":1058,"num_write":380,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:17.186579+0000","last_change":"2024-09-12T00:16:03.081577+0000","last_active":"2024-09-12T01:00:17.186579+0000","last_peered":"2024-09-12T01:00:17.186579+0000","last_clean":"2024-09-12T01:00:17.186579+0000","last_became_active":"2024-09-12T00:16:03.080825+0000","last_became_peered":"2024-09-12T00:16:03.080825+0000","last_unstale":"2024-09-12T01:00:17.186579+0000","last_undegraded":"2024-09-12T01:00:17.186579+0000","last_fullsized":"2024-09-12T01:00:17.186579+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:06.840301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"268'153","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.055860+0000","last_change":"2024-09-12T00:16:05.098923+0000","last_active":"2024-09-12T01:02:12.055860+0000","last_peered":"2024-09-12T01:02:12.055860+0000","last_clean":"2024-09-12T01:02:12.055860+0000","last_became_active":"2024-09-12T00:16:05.098180+0000","last_became_peered":"2024-09-12T00:16:05.098180+0000","last_unstale":"2024-09-12T01:02:12.055860+0000","last_undegraded":"2024-09-12T01:02:12.055860+0000","last_fullsized":"2024-09-12T01:02:12.055860+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":95,"num_write":348,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"268'342","reported_seq":1673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.129621+0000","last_change":"2024-09-12T01:02:57.129621+0000","last_active":"2024-09-12T01:02:57.129621+0000","last_peered":"2024-09-12T01:02:57.129621+0000","last_clean":"2024-09-12T01:02:57.129621+0000","last_became_active":"2024-09-12T00:15:57.039580+0000","last_became_peered":"2024-09-12T00:15:57.039580+0000","last_unstale":"2024-09-12T01:02:57.129621+0000","last_undegraded":"2024-09-12T01:02:57.129621+0000","last_fullsized":"2024-09-12T01:02:57.129621+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-12T01:02:57.129353+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-12T01:02:57.129353+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.129353+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:16.119165+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1750,"num_read_kb":1664,"num_write":383,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"268'336","reported_seq":959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.234365+0000","last_change":"2024-09-12T01:02:54.234365+0000","last_active":"2024-09-12T01:02:54.234365+0000","last_peered":"2024-09-12T01:02:54.234365+0000","last_clean":"2024-09-12T01:02:54.234365+0000","last_became_active":"2024-09-12T00:15:55.042851+0000","last_became_peered":"2024-09-12T00:15:55.042851+0000","last_unstale":"2024-09-12T01:02:54.234365+0000","last_undegraded":"2024-09-12T01:02:54.234365+0000","last_fullsized":"2024-09-12T01:02:54.234365+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'336","last_scrub_stamp":"2024-09-12T01:02:54.233965+0000","last_deep_scrub":"268'336","last_deep_scrub_stamp":"2024-09-12T01:02:54.233965+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.233965+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:37.476942+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1919007,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":413,"num_read_kb":20803,"num_write":1107,"num_write_kb":57854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.163967+0000","last_change":"2024-09-12T00:15:59.049421+0000","last_active":"2024-09-12T00:58:33.163967+0000","last_peered":"2024-09-12T00:58:33.163967+0000","last_clean":"2024-09-12T00:58:33.163967+0000","last_became_active":"2024-09-12T00:15:59.048632+0000","last_became_peered":"2024-09-12T00:15:59.048632+0000","last_unstale":"2024-09-12T00:58:33.163967+0000","last_undegraded":"2024-09-12T00:58:33.163967+0000","last_fullsized":"2024-09-12T00:58:33.163967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:08.230944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"268'84","reported_seq":618,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:14.230651+0000","last_change":"2024-09-12T00:16:01.046254+0000","last_active":"2024-09-12T01:00:14.230651+0000","last_peered":"2024-09-12T01:00:14.230651+0000","last_clean":"2024-09-12T01:00:14.230651+0000","last_became_active":"2024-09-12T00:16:01.045565+0000","last_became_peered":"2024-09-12T00:16:01.045565+0000","last_unstale":"2024-09-12T01:00:14.230651+0000","last_undegraded":"2024-09-12T01:00:14.230651+0000","last_fullsized":"2024-09-12T01:00:14.230651+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:51.429929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":132,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"268'786","reported_seq":4430,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.278605+0000","last_change":"2024-09-12T00:16:03.092271+0000","last_active":"2024-09-12T01:02:39.278605+0000","last_peered":"2024-09-12T01:02:39.278605+0000","last_clean":"2024-09-12T01:02:39.278605+0000","last_became_active":"2024-09-12T00:16:03.091506+0000","last_became_peered":"2024-09-12T00:16:03.091506+0000","last_unstale":"2024-09-12T01:02:39.278605+0000","last_undegraded":"2024-09-12T01:02:39.278605+0000","last_fullsized":"2024-09-12T01:02:39.278605+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:47:30.561330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"268'114","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:04.900585+0000","last_change":"2024-09-12T00:16:05.102360+0000","last_active":"2024-09-12T01:01:04.900585+0000","last_peered":"2024-09-12T01:01:04.900585+0000","last_clean":"2024-09-12T01:01:04.900585+0000","last_became_active":"2024-09-12T00:16:05.101500+0000","last_became_peered":"2024-09-12T00:16:05.101500+0000","last_unstale":"2024-09-12T01:01:04.900585+0000","last_undegraded":"2024-09-12T01:01:04.900585+0000","last_fullsized":"2024-09-12T01:01:04.900585+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"268'1104","reported_seq":2646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.661665+0000","last_change":"2024-09-12T01:02:59.661665+0000","last_active":"2024-09-12T01:02:59.661665+0000","last_peered":"2024-09-12T01:02:59.661665+0000","last_clean":"2024-09-12T01:02:59.661665+0000","last_became_active":"2024-09-12T00:15:57.056507+0000","last_became_peered":"2024-09-12T00:15:57.056507+0000","last_unstale":"2024-09-12T01:02:59.661665+0000","last_undegraded":"2024-09-12T01:02:59.661665+0000","last_fullsized":"2024-09-12T01:02:59.661665+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1104","last_scrub_stamp":"2024-09-12T01:02:59.661368+0000","last_deep_scrub":"268'1104","last_deep_scrub_stamp":"2024-09-12T01:02:59.661368+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.661368+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":1000,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:37.501861+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5000,"num_read_kb":4445,"num_write":1493,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"268'355","reported_seq":1218,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.211133+0000","last_change":"2024-09-12T01:02:47.211133+0000","last_active":"2024-09-12T01:02:47.211133+0000","last_peered":"2024-09-12T01:02:47.211133+0000","last_clean":"2024-09-12T01:02:47.211133+0000","last_became_active":"2024-09-12T00:15:55.051336+0000","last_became_peered":"2024-09-12T00:15:55.051336+0000","last_unstale":"2024-09-12T01:02:47.211133+0000","last_undegraded":"2024-09-12T01:02:47.211133+0000","last_fullsized":"2024-09-12T01:02:47.211133+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'355","last_scrub_stamp":"2024-09-12T01:02:47.210757+0000","last_deep_scrub":"268'355","last_deep_scrub_stamp":"2024-09-12T01:02:47.210757+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.210757+0000","objects_scrubbed":8,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:14.508041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174753,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1007,"num_read_kb":8590,"num_write":1279,"num_write_kb":12738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.157220+0000","last_change":"2024-09-12T01:03:01.157220+0000","last_active":"2024-09-12T01:03:01.157220+0000","last_peered":"2024-09-12T01:03:01.157220+0000","last_clean":"2024-09-12T01:03:01.157220+0000","last_became_active":"2024-09-12T00:15:59.046538+0000","last_became_peered":"2024-09-12T00:15:59.046538+0000","last_unstale":"2024-09-12T01:03:01.157220+0000","last_undegraded":"2024-09-12T01:03:01.157220+0000","last_fullsized":"2024-09-12T01:03:01.157220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:01.157005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:01.157005+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.157005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:05.303663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"268'326","reported_seq":933,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.319745+0000","last_change":"2024-09-12T00:16:01.052369+0000","last_active":"2024-09-12T01:02:38.319745+0000","last_peered":"2024-09-12T01:02:38.319745+0000","last_clean":"2024-09-12T01:02:38.319745+0000","last_became_active":"2024-09-12T00:16:01.051648+0000","last_became_peered":"2024-09-12T00:16:01.051648+0000","last_unstale":"2024-09-12T01:02:38.319745+0000","last_undegraded":"2024-09-12T01:02:38.319745+0000","last_fullsized":"2024-09-12T01:02:38.319745+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:31.858718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50218,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":538,"num_read_kb":1138,"num_write":432,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179642+0000","last_change":"2024-09-12T00:16:03.086923+0000","last_active":"2024-09-12T00:59:33.179642+0000","last_peered":"2024-09-12T00:59:33.179642+0000","last_clean":"2024-09-12T00:59:33.179642+0000","last_became_active":"2024-09-12T00:16:03.086333+0000","last_became_peered":"2024-09-12T00:16:03.086333+0000","last_unstale":"2024-09-12T00:59:33.179642+0000","last_undegraded":"2024-09-12T00:59:33.179642+0000","last_fullsized":"2024-09-12T00:59:33.179642+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:38:22.916351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"268'125","reported_seq":627,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:04.626052+0000","last_change":"2024-09-12T00:16:05.108248+0000","last_active":"2024-09-12T01:01:04.626052+0000","last_peered":"2024-09-12T01:01:04.626052+0000","last_clean":"2024-09-12T01:01:04.626052+0000","last_became_active":"2024-09-12T00:16:05.107284+0000","last_became_peered":"2024-09-12T00:16:05.107284+0000","last_unstale":"2024-09-12T01:01:04.626052+0000","last_undegraded":"2024-09-12T01:01:04.626052+0000","last_fullsized":"2024-09-12T01:01:04.626052+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:25.922474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":114,"num_write":286,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"268'491","reported_seq":2125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.653502+0000","last_change":"2024-09-12T01:02:57.653502+0000","last_active":"2024-09-12T01:02:57.653502+0000","last_peered":"2024-09-12T01:02:57.653502+0000","last_clean":"2024-09-12T01:02:57.653502+0000","last_became_active":"2024-09-12T00:15:57.021526+0000","last_became_peered":"2024-09-12T00:15:57.021526+0000","last_unstale":"2024-09-12T01:02:57.653502+0000","last_undegraded":"2024-09-12T01:02:57.653502+0000","last_fullsized":"2024-09-12T01:02:57.653502+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'491","last_scrub_stamp":"2024-09-12T01:02:57.653321+0000","last_deep_scrub":"268'491","last_deep_scrub_stamp":"2024-09-12T01:02:57.653321+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.653321+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:22.307720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2702,"num_read_kb":2545,"num_write":554,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"268'350","reported_seq":1038,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.624581+0000","last_change":"2024-09-12T01:02:54.624581+0000","last_active":"2024-09-12T01:02:54.624581+0000","last_peered":"2024-09-12T01:02:54.624581+0000","last_clean":"2024-09-12T01:02:54.624581+0000","last_became_active":"2024-09-12T00:15:55.052503+0000","last_became_peered":"2024-09-12T00:15:55.052503+0000","last_unstale":"2024-09-12T01:02:54.624581+0000","last_undegraded":"2024-09-12T01:02:54.624581+0000","last_fullsized":"2024-09-12T01:02:54.624581+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T01:02:54.624378+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T01:02:54.624378+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.624378+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:26.809590+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174814,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":52648,"num_write":1035,"num_write_kb":43222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.168868+0000","last_change":"2024-09-12T00:15:59.027111+0000","last_active":"2024-09-12T00:58:33.168868+0000","last_peered":"2024-09-12T00:58:33.168868+0000","last_clean":"2024-09-12T00:58:33.168868+0000","last_became_active":"2024-09-12T00:15:59.024564+0000","last_became_peered":"2024-09-12T00:15:59.024564+0000","last_unstale":"2024-09-12T00:58:33.168868+0000","last_undegraded":"2024-09-12T00:58:33.168868+0000","last_fullsized":"2024-09-12T00:58:33.168868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:49.354490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"268'248","reported_seq":828,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.384876+0000","last_change":"2024-09-12T00:16:01.055584+0000","last_active":"2024-09-12T01:02:38.384876+0000","last_peered":"2024-09-12T01:02:38.384876+0000","last_clean":"2024-09-12T01:02:38.384876+0000","last_became_active":"2024-09-12T00:16:01.051612+0000","last_became_peered":"2024-09-12T00:16:01.051612+0000","last_unstale":"2024-09-12T01:02:38.384876+0000","last_undegraded":"2024-09-12T01:02:38.384876+0000","last_fullsized":"2024-09-12T01:02:38.384876+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:47.313727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46385,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":418,"num_read_kb":940,"num_write":334,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:44.223108+0000","last_change":"2024-09-12T00:16:03.095905+0000","last_active":"2024-09-12T00:59:44.223108+0000","last_peered":"2024-09-12T00:59:44.223108+0000","last_clean":"2024-09-12T00:59:44.223108+0000","last_became_active":"2024-09-12T00:16:03.095016+0000","last_became_peered":"2024-09-12T00:16:03.095016+0000","last_unstale":"2024-09-12T00:59:44.223108+0000","last_undegraded":"2024-09-12T00:59:44.223108+0000","last_fullsized":"2024-09-12T00:59:44.223108+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:35.761981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"268'135","reported_seq":666,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.014067+0000","last_change":"2024-09-12T00:16:05.099520+0000","last_active":"2024-09-12T01:02:02.014067+0000","last_peered":"2024-09-12T01:02:02.014067+0000","last_clean":"2024-09-12T01:02:02.014067+0000","last_became_active":"2024-09-12T00:16:05.098796+0000","last_became_peered":"2024-09-12T00:16:05.098796+0000","last_unstale":"2024-09-12T01:02:02.014067+0000","last_undegraded":"2024-09-12T01:02:02.014067+0000","last_fullsized":"2024-09-12T01:02:02.014067+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:27.979474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":225,"num_write":347,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"268'418","reported_seq":1971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.676410+0000","last_change":"2024-09-12T01:02:52.676410+0000","last_active":"2024-09-12T01:02:52.676410+0000","last_peered":"2024-09-12T01:02:52.676410+0000","last_clean":"2024-09-12T01:02:52.676410+0000","last_became_active":"2024-09-12T00:15:57.038127+0000","last_became_peered":"2024-09-12T00:15:57.038127+0000","last_unstale":"2024-09-12T01:02:52.676410+0000","last_undegraded":"2024-09-12T01:02:52.676410+0000","last_fullsized":"2024-09-12T01:02:52.676410+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'418","last_scrub_stamp":"2024-09-12T01:02:52.676192+0000","last_deep_scrub":"268'418","last_deep_scrub_stamp":"2024-09-12T01:02:52.676192+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.676192+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:22.108077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2293,"num_read_kb":2185,"num_write":483,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3022,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"268'320","reported_seq":959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.395489+0000","last_change":"2024-09-12T01:02:49.395489+0000","last_active":"2024-09-12T01:02:49.395489+0000","last_peered":"2024-09-12T01:02:49.395489+0000","last_clean":"2024-09-12T01:02:49.395489+0000","last_became_active":"2024-09-12T00:15:55.074964+0000","last_became_peered":"2024-09-12T00:15:55.074964+0000","last_unstale":"2024-09-12T01:02:49.395489+0000","last_undegraded":"2024-09-12T01:02:49.395489+0000","last_fullsized":"2024-09-12T01:02:49.395489+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-09-12T01:02:49.395237+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-09-12T01:02:49.395237+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.395237+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:09.752592+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655970,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":20129,"num_write":999,"num_write_kb":20535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.184985+0000","last_change":"2024-09-12T00:15:59.036962+0000","last_active":"2024-09-12T00:59:33.184985+0000","last_peered":"2024-09-12T00:59:33.184985+0000","last_clean":"2024-09-12T00:59:33.184985+0000","last_became_active":"2024-09-12T00:15:59.036492+0000","last_became_peered":"2024-09-12T00:15:59.036492+0000","last_unstale":"2024-09-12T00:59:33.184985+0000","last_undegraded":"2024-09-12T00:59:33.184985+0000","last_fullsized":"2024-09-12T00:59:33.184985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:26.416316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"268'247","reported_seq":808,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.671289+0000","last_change":"2024-09-12T00:16:01.053033+0000","last_active":"2024-09-12T01:02:37.671289+0000","last_peered":"2024-09-12T01:02:37.671289+0000","last_clean":"2024-09-12T01:02:37.671289+0000","last_became_active":"2024-09-12T00:16:01.050746+0000","last_became_peered":"2024-09-12T00:16:01.050746+0000","last_unstale":"2024-09-12T01:02:37.671289+0000","last_undegraded":"2024-09-12T01:02:37.671289+0000","last_fullsized":"2024-09-12T01:02:37.671289+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:56.194861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":412,"num_read_kb":978,"num_write":338,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:34.203198+0000","last_change":"2024-09-12T00:16:03.100996+0000","last_active":"2024-09-12T00:58:34.203198+0000","last_peered":"2024-09-12T00:58:34.203198+0000","last_clean":"2024-09-12T00:58:34.203198+0000","last_became_active":"2024-09-12T00:16:03.099890+0000","last_became_peered":"2024-09-12T00:16:03.099890+0000","last_unstale":"2024-09-12T00:58:34.203198+0000","last_undegraded":"2024-09-12T00:58:34.203198+0000","last_fullsized":"2024-09-12T00:58:34.203198+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:53.876340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"268'186","reported_seq":1673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.781143+0000","last_change":"2024-09-12T00:16:05.113925+0000","last_active":"2024-09-12T01:02:10.781143+0000","last_peered":"2024-09-12T01:02:10.781143+0000","last_clean":"2024-09-12T01:02:10.781143+0000","last_became_active":"2024-09-12T00:16:05.113207+0000","last_became_peered":"2024-09-12T00:16:05.113207+0000","last_unstale":"2024-09-12T01:02:10.781143+0000","last_undegraded":"2024-09-12T01:02:10.781143+0000","last_fullsized":"2024-09-12T01:02:10.781143+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:18.252728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1270,"num_read_kb":1246,"num_write":444,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"268'926","reported_seq":2674,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.619463+0000","last_change":"2024-09-12T01:02:56.619463+0000","last_active":"2024-09-12T01:02:56.619463+0000","last_peered":"2024-09-12T01:02:56.619463+0000","last_clean":"2024-09-12T01:02:56.619463+0000","last_became_active":"2024-09-12T00:15:57.012136+0000","last_became_peered":"2024-09-12T00:15:57.012136+0000","last_unstale":"2024-09-12T01:02:56.619463+0000","last_undegraded":"2024-09-12T01:02:56.619463+0000","last_fullsized":"2024-09-12T01:02:56.619463+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'926","last_scrub_stamp":"2024-09-12T01:02:56.619272+0000","last_deep_scrub":"268'926","last_deep_scrub_stamp":"2024-09-12T01:02:56.619272+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.619272+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":900,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:34.737350+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4477,"num_read_kb":4059,"num_write":1259,"num_write_kb":498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1011,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"268'359","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.367417+0000","last_change":"2024-09-12T01:02:50.367417+0000","last_active":"2024-09-12T01:02:50.367417+0000","last_peered":"2024-09-12T01:02:50.367417+0000","last_clean":"2024-09-12T01:02:50.367417+0000","last_became_active":"2024-09-12T00:15:55.079005+0000","last_became_peered":"2024-09-12T00:15:55.079005+0000","last_unstale":"2024-09-12T01:02:50.367417+0000","last_undegraded":"2024-09-12T01:02:50.367417+0000","last_fullsized":"2024-09-12T01:02:50.367417+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T01:02:50.366971+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T01:02:50.366971+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.366971+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:04.196096+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525370,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":531,"num_read_kb":476,"num_write":1171,"num_write_kb":40462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:43.182050+0000","last_change":"2024-09-12T00:15:59.040566+0000","last_active":"2024-09-12T00:59:43.182050+0000","last_peered":"2024-09-12T00:59:43.182050+0000","last_clean":"2024-09-12T00:59:43.182050+0000","last_became_active":"2024-09-12T00:15:59.039674+0000","last_became_peered":"2024-09-12T00:15:59.039674+0000","last_unstale":"2024-09-12T00:59:43.182050+0000","last_undegraded":"2024-09-12T00:59:43.182050+0000","last_fullsized":"2024-09-12T00:59:43.182050+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:57.992388+0000","last_clean_scrub_stamp":"2024-09-12T00:15:57.992388+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:23.557637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"268'344","reported_seq":946,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.914549+0000","last_change":"2024-09-12T00:16:01.052058+0000","last_active":"2024-09-12T01:02:37.914549+0000","last_peered":"2024-09-12T01:02:37.914549+0000","last_clean":"2024-09-12T01:02:37.914549+0000","last_became_active":"2024-09-12T00:16:01.051324+0000","last_became_peered":"2024-09-12T00:16:01.051324+0000","last_unstale":"2024-09-12T01:02:37.914549+0000","last_undegraded":"2024-09-12T01:02:37.914549+0000","last_fullsized":"2024-09-12T01:02:37.914549+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:00.006223+0000","last_clean_scrub_stamp":"2024-09-12T00:16:00.006223+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:07.219892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49632,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":580,"num_read_kb":1323,"num_write":476,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:33.163885+0000","last_change":"2024-09-12T00:16:03.100444+0000","last_active":"2024-09-12T00:58:33.163885+0000","last_peered":"2024-09-12T00:58:33.163885+0000","last_clean":"2024-09-12T00:58:33.163885+0000","last_became_active":"2024-09-12T00:16:03.099836+0000","last_became_peered":"2024-09-12T00:16:03.099836+0000","last_unstale":"2024-09-12T00:58:33.163885+0000","last_undegraded":"2024-09-12T00:58:33.163885+0000","last_fullsized":"2024-09-12T00:58:33.163885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:28.442530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"268'111","reported_seq":604,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.889342+0000","last_change":"2024-09-12T00:16:05.113973+0000","last_active":"2024-09-12T01:02:10.889342+0000","last_peered":"2024-09-12T01:02:10.889342+0000","last_clean":"2024-09-12T01:02:10.889342+0000","last_became_active":"2024-09-12T00:16:05.113231+0000","last_became_peered":"2024-09-12T00:16:05.113231+0000","last_unstale":"2024-09-12T01:02:10.889342+0000","last_undegraded":"2024-09-12T01:02:10.889342+0000","last_fullsized":"2024-09-12T01:02:10.889342+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":663,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":263,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"268'812","reported_seq":2407,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.098674+0000","last_change":"2024-09-12T01:02:59.098674+0000","last_active":"2024-09-12T01:02:59.098674+0000","last_peered":"2024-09-12T01:02:59.098674+0000","last_clean":"2024-09-12T01:02:59.098674+0000","last_became_active":"2024-09-12T00:15:57.031161+0000","last_became_peered":"2024-09-12T00:15:57.031161+0000","last_unstale":"2024-09-12T01:02:59.098674+0000","last_undegraded":"2024-09-12T01:02:59.098674+0000","last_fullsized":"2024-09-12T01:02:59.098674+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'812","last_scrub_stamp":"2024-09-12T01:02:59.098486+0000","last_deep_scrub":"268'812","last_deep_scrub_stamp":"2024-09-12T01:02:59.098486+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.098486+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:40.804950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3882,"num_read_kb":3503,"num_write":1069,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"268'350","reported_seq":1124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.589310+0000","last_change":"2024-09-12T01:02:48.589310+0000","last_active":"2024-09-12T01:02:48.589310+0000","last_peered":"2024-09-12T01:02:48.589310+0000","last_clean":"2024-09-12T01:02:48.589310+0000","last_became_active":"2024-09-12T00:15:55.042134+0000","last_became_peered":"2024-09-12T00:15:55.042134+0000","last_unstale":"2024-09-12T01:02:48.589310+0000","last_undegraded":"2024-09-12T01:02:48.589310+0000","last_fullsized":"2024-09-12T01:02:48.589310+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T01:02:48.589008+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T01:02:48.589008+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.589008+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:56.525969+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918005,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":861,"num_read_kb":50816,"num_write":1243,"num_write_kb":44406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'404","reported_seq":1866,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.734203+0000","last_change":"2024-09-12T01:02:56.734203+0000","last_active":"2024-09-12T01:02:56.734203+0000","last_peered":"2024-09-12T01:02:56.734203+0000","last_clean":"2024-09-12T01:02:56.734203+0000","last_became_active":"2024-09-12T00:15:57.043013+0000","last_became_peered":"2024-09-12T00:15:57.043013+0000","last_unstale":"2024-09-12T01:02:56.734203+0000","last_undegraded":"2024-09-12T01:02:56.734203+0000","last_fullsized":"2024-09-12T01:02:56.734203+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'404","last_scrub_stamp":"2024-09-12T01:02:56.734008+0000","last_deep_scrub":"268'404","last_deep_scrub_stamp":"2024-09-12T01:02:56.734008+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.734008+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:54.403896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2106,"num_read_kb":1998,"num_write":459,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"268'302","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.702227+0000","last_change":"2024-09-12T01:02:48.702227+0000","last_active":"2024-09-12T01:02:48.702227+0000","last_peered":"2024-09-12T01:02:48.702227+0000","last_clean":"2024-09-12T01:02:48.702227+0000","last_became_active":"2024-09-12T00:15:55.062524+0000","last_became_peered":"2024-09-12T00:15:55.062524+0000","last_unstale":"2024-09-12T01:02:48.702227+0000","last_undegraded":"2024-09-12T01:02:48.702227+0000","last_fullsized":"2024-09-12T01:02:48.702227+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'302","last_scrub_stamp":"2024-09-12T01:02:48.701961+0000","last_deep_scrub":"268'302","last_deep_scrub_stamp":"2024-09-12T01:02:48.701961+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.701961+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:23.572921+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291481,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":18226,"num_write":893,"num_write_kb":43043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"268'494","reported_seq":2210,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.226294+0000","last_change":"2024-09-12T00:15:57.029585+0000","last_active":"2024-09-12T01:01:07.226294+0000","last_peered":"2024-09-12T01:01:07.226294+0000","last_clean":"2024-09-12T01:01:07.226294+0000","last_became_active":"2024-09-12T00:15:57.018875+0000","last_became_peered":"2024-09-12T00:15:57.018875+0000","last_unstale":"2024-09-12T01:01:07.226294+0000","last_undegraded":"2024-09-12T01:01:07.226294+0000","last_fullsized":"2024-09-12T01:01:07.226294+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":400,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:10.062996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2775,"num_read_kb":2615,"num_write":593,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"268'360","reported_seq":1018,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.598437+0000","last_change":"2024-09-12T01:02:53.598437+0000","last_active":"2024-09-12T01:02:53.598437+0000","last_peered":"2024-09-12T01:02:53.598437+0000","last_clean":"2024-09-12T01:02:53.598437+0000","last_became_active":"2024-09-12T00:15:55.063603+0000","last_became_peered":"2024-09-12T00:15:55.063603+0000","last_unstale":"2024-09-12T01:02:53.598437+0000","last_undegraded":"2024-09-12T01:02:53.598437+0000","last_fullsized":"2024-09-12T01:02:53.598437+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'360","last_scrub_stamp":"2024-09-12T01:02:53.598203+0000","last_deep_scrub":"268'360","last_deep_scrub_stamp":"2024-09-12T01:02:53.598203+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.598203+0000","objects_scrubbed":7,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:20.298117+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055186,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":518,"num_read_kb":3291,"num_write":1136,"num_write_kb":12783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"268'390","reported_seq":1797,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:47.016017+0000","last_change":"2024-09-12T00:15:57.031124+0000","last_active":"2024-09-12T01:00:47.016017+0000","last_peered":"2024-09-12T01:00:47.016017+0000","last_clean":"2024-09-12T01:00:47.016017+0000","last_became_active":"2024-09-12T00:15:57.030173+0000","last_became_peered":"2024-09-12T00:15:57.030173+0000","last_unstale":"2024-09-12T01:00:47.016017+0000","last_undegraded":"2024-09-12T01:00:47.016017+0000","last_fullsized":"2024-09-12T01:00:47.016017+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:54.011519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2013,"num_read_kb":1910,"num_write":436,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"268'370","reported_seq":1121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.286233+0000","last_change":"2024-09-12T01:02:52.286233+0000","last_active":"2024-09-12T01:02:52.286233+0000","last_peered":"2024-09-12T01:02:52.286233+0000","last_clean":"2024-09-12T01:02:52.286233+0000","last_became_active":"2024-09-12T00:15:55.068349+0000","last_became_peered":"2024-09-12T00:15:55.068349+0000","last_unstale":"2024-09-12T01:02:52.286233+0000","last_undegraded":"2024-09-12T01:02:52.286233+0000","last_fullsized":"2024-09-12T01:02:52.286233+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-12T01:02:52.285815+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-12T01:02:52.285815+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.285815+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:42.779294+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5530690,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":847,"num_read_kb":11363,"num_write":1205,"num_write_kb":51000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"268'398","reported_seq":1882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.583028+0000","last_change":"2024-09-12T00:15:57.037970+0000","last_active":"2024-09-12T01:01:09.583028+0000","last_peered":"2024-09-12T01:01:09.583028+0000","last_clean":"2024-09-12T01:01:09.583028+0000","last_became_active":"2024-09-12T00:15:57.037204+0000","last_became_peered":"2024-09-12T00:15:57.037204+0000","last_unstale":"2024-09-12T01:01:09.583028+0000","last_undegraded":"2024-09-12T01:01:09.583028+0000","last_fullsized":"2024-09-12T01:01:09.583028+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:46.963139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2120,"num_read_kb":2017,"num_write":453,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"268'338","reported_seq":981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.070517+0000","last_change":"2024-09-12T01:02:50.070517+0000","last_active":"2024-09-12T01:02:50.070517+0000","last_peered":"2024-09-12T01:02:50.070517+0000","last_clean":"2024-09-12T01:02:50.070517+0000","last_became_active":"2024-09-12T00:15:55.071812+0000","last_became_peered":"2024-09-12T00:15:55.071812+0000","last_unstale":"2024-09-12T01:02:50.070517+0000","last_undegraded":"2024-09-12T01:02:50.070517+0000","last_fullsized":"2024-09-12T01:02:50.070517+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'338","last_scrub_stamp":"2024-09-12T01:02:50.070156+0000","last_deep_scrub":"268'338","last_deep_scrub_stamp":"2024-09-12T01:02:50.070156+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.070156+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:07.290148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1919077,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":11487,"num_write":1134,"num_write_kb":34407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"268'584","reported_seq":2274,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.591872+0000","last_change":"2024-09-12T01:02:53.591872+0000","last_active":"2024-09-12T01:02:53.591872+0000","last_peered":"2024-09-12T01:02:53.591872+0000","last_clean":"2024-09-12T01:02:53.591872+0000","last_became_active":"2024-09-12T00:15:57.032818+0000","last_became_peered":"2024-09-12T00:15:57.032818+0000","last_unstale":"2024-09-12T01:02:53.591872+0000","last_undegraded":"2024-09-12T01:02:53.591872+0000","last_fullsized":"2024-09-12T01:02:53.591872+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'584","last_scrub_stamp":"2024-09-12T01:02:53.591627+0000","last_deep_scrub":"268'584","last_deep_scrub_stamp":"2024-09-12T01:02:53.591627+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.591627+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:25.471327+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2922,"num_read_kb":2722,"num_write":707,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"268'345","reported_seq":1029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.024703+0000","last_change":"2024-09-12T01:02:51.024703+0000","last_active":"2024-09-12T01:02:51.024703+0000","last_peered":"2024-09-12T01:02:51.024703+0000","last_clean":"2024-09-12T01:02:51.024703+0000","last_became_active":"2024-09-12T00:15:55.050781+0000","last_became_peered":"2024-09-12T00:15:55.050781+0000","last_unstale":"2024-09-12T01:02:51.024703+0000","last_undegraded":"2024-09-12T01:02:51.024703+0000","last_fullsized":"2024-09-12T01:02:51.024703+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'345","last_scrub_stamp":"2024-09-12T01:02:51.024453+0000","last_deep_scrub":"268'345","last_deep_scrub_stamp":"2024-09-12T01:02:51.024453+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.024453+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:07.021452+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432541,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":494,"num_read_kb":31947,"num_write":1072,"num_write_kb":41212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"268'801","reported_seq":2295,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.033726+0000","last_change":"2024-09-12T01:02:59.033726+0000","last_active":"2024-09-12T01:02:59.033726+0000","last_peered":"2024-09-12T01:02:59.033726+0000","last_clean":"2024-09-12T01:02:59.033726+0000","last_became_active":"2024-09-12T00:15:57.045500+0000","last_became_peered":"2024-09-12T00:15:57.045500+0000","last_unstale":"2024-09-12T01:02:59.033726+0000","last_undegraded":"2024-09-12T01:02:59.033726+0000","last_fullsized":"2024-09-12T01:02:59.033726+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'801","last_scrub_stamp":"2024-09-12T01:02:59.033539+0000","last_deep_scrub":"268'801","last_deep_scrub_stamp":"2024-09-12T01:02:59.033539+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.033539+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.520622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3817,"num_read_kb":3427,"num_write":1098,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"268'312","reported_seq":942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.668061+0000","last_change":"2024-09-12T01:02:54.668061+0000","last_active":"2024-09-12T01:02:54.668061+0000","last_peered":"2024-09-12T01:02:54.668061+0000","last_clean":"2024-09-12T01:02:54.668061+0000","last_became_active":"2024-09-12T00:15:55.054914+0000","last_became_peered":"2024-09-12T00:15:55.054914+0000","last_unstale":"2024-09-12T01:02:54.668061+0000","last_undegraded":"2024-09-12T01:02:54.668061+0000","last_fullsized":"2024-09-12T01:02:54.668061+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'312","last_scrub_stamp":"2024-09-12T01:02:54.667783+0000","last_deep_scrub":"268'312","last_deep_scrub_stamp":"2024-09-12T01:02:54.667783+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.667783+0000","objects_scrubbed":9,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:58.504933+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262244,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":420,"num_read_kb":50634,"num_write":965,"num_write_kb":37363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"268'819","reported_seq":2520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.205241+0000","last_change":"2024-09-12T01:02:52.205241+0000","last_active":"2024-09-12T01:02:52.205241+0000","last_peered":"2024-09-12T01:02:52.205241+0000","last_clean":"2024-09-12T01:02:52.205241+0000","last_became_active":"2024-09-12T00:15:57.021622+0000","last_became_peered":"2024-09-12T00:15:57.021622+0000","last_unstale":"2024-09-12T01:02:52.205241+0000","last_undegraded":"2024-09-12T01:02:52.205241+0000","last_fullsized":"2024-09-12T01:02:52.205241+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'819","last_scrub_stamp":"2024-09-12T01:02:52.205058+0000","last_deep_scrub":"268'819","last_deep_scrub_stamp":"2024-09-12T01:02:52.205058+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.205058+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:06.846282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4035,"num_read_kb":3684,"num_write":1067,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2043,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"268'352","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.341830+0000","last_change":"2024-09-12T01:02:54.341830+0000","last_active":"2024-09-12T01:02:54.341830+0000","last_peered":"2024-09-12T01:02:54.341830+0000","last_clean":"2024-09-12T01:02:54.341830+0000","last_became_active":"2024-09-12T00:15:55.055929+0000","last_became_peered":"2024-09-12T00:15:55.055929+0000","last_unstale":"2024-09-12T01:02:54.341830+0000","last_undegraded":"2024-09-12T01:02:54.341830+0000","last_fullsized":"2024-09-12T01:02:54.341830+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'352","last_scrub_stamp":"2024-09-12T01:02:54.341405+0000","last_deep_scrub":"268'352","last_deep_scrub_stamp":"2024-09-12T01:02:54.341405+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.341405+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:10.803620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":553,"num_read_kb":589,"num_write":1208,"num_write_kb":30899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"268'838","reported_seq":2512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.745029+0000","last_change":"2024-09-12T01:02:58.745029+0000","last_active":"2024-09-12T01:02:58.745029+0000","last_peered":"2024-09-12T01:02:58.745029+0000","last_clean":"2024-09-12T01:02:58.745029+0000","last_became_active":"2024-09-12T00:15:57.039946+0000","last_became_peered":"2024-09-12T00:15:57.039946+0000","last_unstale":"2024-09-12T01:02:58.745029+0000","last_undegraded":"2024-09-12T01:02:58.745029+0000","last_fullsized":"2024-09-12T01:02:58.745029+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'838","last_scrub_stamp":"2024-09-12T01:02:58.744791+0000","last_deep_scrub":"268'838","last_deep_scrub_stamp":"2024-09-12T01:02:58.744791+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.744791+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:14.176919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4272,"num_read_kb":3874,"num_write":1144,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"268'428","reported_seq":1165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.585054+0000","last_change":"2024-09-12T01:03:01.585054+0000","last_active":"2024-09-12T01:03:01.585054+0000","last_peered":"2024-09-12T01:03:01.585054+0000","last_clean":"2024-09-12T01:03:01.585054+0000","last_became_active":"2024-09-12T00:15:55.065129+0000","last_became_peered":"2024-09-12T00:15:55.065129+0000","last_unstale":"2024-09-12T01:03:01.585054+0000","last_undegraded":"2024-09-12T01:03:01.585054+0000","last_fullsized":"2024-09-12T01:03:01.585054+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'428","last_scrub_stamp":"2024-09-12T01:03:01.584779+0000","last_deep_scrub":"268'428","last_deep_scrub_stamp":"2024-09-12T01:03:01.584779+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.584779+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:46.193473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170166,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":788,"num_read_kb":24149,"num_write":1329,"num_write_kb":32019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"268'878","reported_seq":2664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.582210+0000","last_change":"2024-09-12T01:02:54.582210+0000","last_active":"2024-09-12T01:02:54.582210+0000","last_peered":"2024-09-12T01:02:54.582210+0000","last_clean":"2024-09-12T01:02:54.582210+0000","last_became_active":"2024-09-12T00:15:57.051976+0000","last_became_peered":"2024-09-12T00:15:57.051976+0000","last_unstale":"2024-09-12T01:02:54.582210+0000","last_undegraded":"2024-09-12T01:02:54.582210+0000","last_fullsized":"2024-09-12T01:02:54.582210+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'878","last_scrub_stamp":"2024-09-12T01:02:54.581985+0000","last_deep_scrub":"268'878","last_deep_scrub_stamp":"2024-09-12T01:02:54.581985+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.581985+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":800,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:29.512097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4749,"num_read_kb":4328,"num_write":1184,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3450,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"268'343","reported_seq":979,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.325419+0000","last_change":"2024-09-12T01:02:53.325419+0000","last_active":"2024-09-12T01:02:53.325419+0000","last_peered":"2024-09-12T01:02:53.325419+0000","last_clean":"2024-09-12T01:02:53.325419+0000","last_became_active":"2024-09-12T00:15:55.055449+0000","last_became_peered":"2024-09-12T00:15:55.055449+0000","last_unstale":"2024-09-12T01:02:53.325419+0000","last_undegraded":"2024-09-12T01:02:53.325419+0000","last_fullsized":"2024-09-12T01:02:53.325419+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'343","last_scrub_stamp":"2024-09-12T01:02:53.325099+0000","last_deep_scrub":"268'343","last_deep_scrub_stamp":"2024-09-12T01:02:53.325099+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.325099+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:04.425777+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":2263,"num_write":1082,"num_write_kb":24139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"268'787","reported_seq":2366,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.160044+0000","last_change":"2024-09-12T00:15:57.033089+0000","last_active":"2024-09-12T01:01:02.160044+0000","last_peered":"2024-09-12T01:01:02.160044+0000","last_clean":"2024-09-12T01:01:02.160044+0000","last_became_active":"2024-09-12T00:15:57.031976+0000","last_became_peered":"2024-09-12T00:15:57.031976+0000","last_unstale":"2024-09-12T01:01:02.160044+0000","last_undegraded":"2024-09-12T01:01:02.160044+0000","last_fullsized":"2024-09-12T01:01:02.160044+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:55.985441+0000","last_clean_scrub_stamp":"2024-09-12T00:15:55.985441+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:30.528175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3862,"num_read_kb":3503,"num_write":1033,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"268'359","reported_seq":1017,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.167146+0000","last_change":"2024-09-12T01:02:48.167146+0000","last_active":"2024-09-12T01:02:48.167146+0000","last_peered":"2024-09-12T01:02:48.167146+0000","last_clean":"2024-09-12T01:02:48.167146+0000","last_became_active":"2024-09-12T00:15:55.051451+0000","last_became_peered":"2024-09-12T00:15:55.051451+0000","last_unstale":"2024-09-12T01:02:48.167146+0000","last_undegraded":"2024-09-12T01:02:48.167146+0000","last_fullsized":"2024-09-12T01:02:48.167146+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T01:02:48.166882+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T01:02:48.166882+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.166882+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:13.746661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263237,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":17816,"num_write":1180,"num_write_kb":26945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"268'485","reported_seq":2169,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.125082+0000","last_change":"2024-09-12T01:02:56.125082+0000","last_active":"2024-09-12T01:02:56.125082+0000","last_peered":"2024-09-12T01:02:56.125082+0000","last_clean":"2024-09-12T01:02:56.125082+0000","last_became_active":"2024-09-12T00:15:57.019963+0000","last_became_peered":"2024-09-12T00:15:57.019963+0000","last_unstale":"2024-09-12T01:02:56.125082+0000","last_undegraded":"2024-09-12T01:02:56.125082+0000","last_fullsized":"2024-09-12T01:02:56.125082+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'485","last_scrub_stamp":"2024-09-12T01:02:56.124868+0000","last_deep_scrub":"268'485","last_deep_scrub_stamp":"2024-09-12T01:02:56.124868+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.124868+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:10.557945+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2585,"num_read_kb":2455,"num_write":555,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":983,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"268'290","reported_seq":922,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.093202+0000","last_change":"2024-09-12T01:02:58.093202+0000","last_active":"2024-09-12T01:02:58.093202+0000","last_peered":"2024-09-12T01:02:58.093202+0000","last_clean":"2024-09-12T01:02:58.093202+0000","last_became_active":"2024-09-12T00:15:55.050267+0000","last_became_peered":"2024-09-12T00:15:55.050267+0000","last_unstale":"2024-09-12T01:02:58.093202+0000","last_undegraded":"2024-09-12T01:02:58.093202+0000","last_fullsized":"2024-09-12T01:02:58.093202+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'290","last_scrub_stamp":"2024-09-12T01:02:58.092896+0000","last_deep_scrub":"268'290","last_deep_scrub_stamp":"2024-09-12T01:02:58.092896+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.092896+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:16.075277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":8617,"num_write":1019,"num_write_kb":22964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1340","reported_seq":3158,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.183498+0000","last_change":"2024-09-12T01:02:53.183498+0000","last_active":"2024-09-12T01:02:53.183498+0000","last_peered":"2024-09-12T01:02:53.183498+0000","last_clean":"2024-09-12T01:02:53.183498+0000","last_became_active":"2024-09-12T00:15:57.045076+0000","last_became_peered":"2024-09-12T00:15:57.045076+0000","last_unstale":"2024-09-12T01:02:53.183498+0000","last_undegraded":"2024-09-12T01:02:53.183498+0000","last_fullsized":"2024-09-12T01:02:53.183498+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1340","last_scrub_stamp":"2024-09-12T01:02:53.183271+0000","last_deep_scrub":"268'1340","last_deep_scrub_stamp":"2024-09-12T01:02:53.183271+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.183271+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":1300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:32.397326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6209,"num_read_kb":5540,"num_write":1861,"num_write_kb":794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"268'321","reported_seq":967,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.576069+0000","last_change":"2024-09-12T01:02:52.576069+0000","last_active":"2024-09-12T01:02:52.576069+0000","last_peered":"2024-09-12T01:02:52.576069+0000","last_clean":"2024-09-12T01:02:52.576069+0000","last_became_active":"2024-09-12T00:15:55.061287+0000","last_became_peered":"2024-09-12T00:15:55.061287+0000","last_unstale":"2024-09-12T01:02:52.576069+0000","last_undegraded":"2024-09-12T01:02:52.576069+0000","last_fullsized":"2024-09-12T01:02:52.576069+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'321","last_scrub_stamp":"2024-09-12T01:02:52.575842+0000","last_deep_scrub":"268'321","last_deep_scrub_stamp":"2024-09-12T01:02:52.575842+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.575842+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:54.370349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":733,"num_write":1216,"num_write_kb":3677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"268'406","reported_seq":1781,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.700063+0000","last_change":"2024-09-12T01:02:55.700063+0000","last_active":"2024-09-12T01:02:55.700063+0000","last_peered":"2024-09-12T01:02:55.700063+0000","last_clean":"2024-09-12T01:02:55.700063+0000","last_became_active":"2024-09-12T00:15:57.043158+0000","last_became_peered":"2024-09-12T00:15:57.043158+0000","last_unstale":"2024-09-12T01:02:55.700063+0000","last_undegraded":"2024-09-12T01:02:55.700063+0000","last_fullsized":"2024-09-12T01:02:55.700063+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'406","last_scrub_stamp":"2024-09-12T01:02:55.699871+0000","last_deep_scrub":"268'406","last_deep_scrub_stamp":"2024-09-12T01:02:55.699871+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.699871+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:04.239689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1978,"num_read_kb":1859,"num_write":462,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"268'386","reported_seq":1080,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.568150+0000","last_change":"2024-09-12T01:02:58.568150+0000","last_active":"2024-09-12T01:02:58.568150+0000","last_peered":"2024-09-12T01:02:58.568150+0000","last_clean":"2024-09-12T01:02:58.568150+0000","last_became_active":"2024-09-12T00:15:55.058726+0000","last_became_peered":"2024-09-12T00:15:55.058726+0000","last_unstale":"2024-09-12T01:02:58.568150+0000","last_undegraded":"2024-09-12T01:02:58.568150+0000","last_fullsized":"2024-09-12T01:02:58.568150+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'386","last_scrub_stamp":"2024-09-12T01:02:58.567923+0000","last_deep_scrub":"268'386","last_deep_scrub_stamp":"2024-09-12T01:02:58.567923+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.567923+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:21.225474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549415,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":603,"num_read_kb":57120,"num_write":1303,"num_write_kb":58223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"268'1346","reported_seq":2840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.143067+0000","last_change":"2024-09-12T01:03:00.143067+0000","last_active":"2024-09-12T01:03:00.143067+0000","last_peered":"2024-09-12T01:03:00.143067+0000","last_clean":"2024-09-12T01:03:00.143067+0000","last_became_active":"2024-09-12T00:15:57.043227+0000","last_became_peered":"2024-09-12T00:15:57.043227+0000","last_unstale":"2024-09-12T01:03:00.143067+0000","last_undegraded":"2024-09-12T01:03:00.143067+0000","last_fullsized":"2024-09-12T01:03:00.143067+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1346","last_scrub_stamp":"2024-09-12T01:03:00.142862+0000","last_deep_scrub":"268'1346","last_deep_scrub_stamp":"2024-09-12T01:03:00.142862+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.142862+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":1300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:03.208839+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5913,"num_read_kb":5121,"num_write":1910,"num_write_kb":821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"268'294","reported_seq":944,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.730311+0000","last_change":"2024-09-12T01:02:51.730311+0000","last_active":"2024-09-12T01:02:51.730311+0000","last_peered":"2024-09-12T01:02:51.730311+0000","last_clean":"2024-09-12T01:02:51.730311+0000","last_became_active":"2024-09-12T00:15:55.052287+0000","last_became_peered":"2024-09-12T00:15:55.052287+0000","last_unstale":"2024-09-12T01:02:51.730311+0000","last_undegraded":"2024-09-12T01:02:51.730311+0000","last_fullsized":"2024-09-12T01:02:51.730311+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'294","last_scrub_stamp":"2024-09-12T01:02:51.729966+0000","last_deep_scrub":"268'294","last_deep_scrub_stamp":"2024-09-12T01:02:51.729966+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.729966+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:44.447259+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947345,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":476,"num_read_kb":19752,"num_write":916,"num_write_kb":40992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"268'335","reported_seq":1753,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.134671+0000","last_change":"2024-09-12T01:02:54.134671+0000","last_active":"2024-09-12T01:02:54.134671+0000","last_peered":"2024-09-12T01:02:54.134671+0000","last_clean":"2024-09-12T01:02:54.134671+0000","last_became_active":"2024-09-12T00:15:57.039633+0000","last_became_peered":"2024-09-12T00:15:57.039633+0000","last_unstale":"2024-09-12T01:02:54.134671+0000","last_undegraded":"2024-09-12T01:02:54.134671+0000","last_fullsized":"2024-09-12T01:02:54.134671+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'335","last_scrub_stamp":"2024-09-12T01:02:54.134447+0000","last_deep_scrub":"268'335","last_deep_scrub_stamp":"2024-09-12T01:02:54.134447+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.134447+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:37.275755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1924,"num_read_kb":1842,"num_write":397,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"268'332","reported_seq":1022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.525046+0000","last_change":"2024-09-12T01:02:59.525046+0000","last_active":"2024-09-12T01:02:59.525046+0000","last_peered":"2024-09-12T01:02:59.525046+0000","last_clean":"2024-09-12T01:02:59.525046+0000","last_became_active":"2024-09-12T00:15:55.054952+0000","last_became_peered":"2024-09-12T00:15:55.054952+0000","last_unstale":"2024-09-12T01:02:59.525046+0000","last_undegraded":"2024-09-12T01:02:59.525046+0000","last_fullsized":"2024-09-12T01:02:59.525046+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'332","last_scrub_stamp":"2024-09-12T01:02:59.524837+0000","last_deep_scrub":"268'332","last_deep_scrub_stamp":"2024-09-12T01:02:59.524837+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.524837+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:40.714134+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109426,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":117939,"num_write":959,"num_write_kb":46136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"268'394","reported_seq":1052,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.895271+0000","last_change":"2024-09-12T00:15:55.053129+0000","last_active":"2024-09-12T01:02:39.895271+0000","last_peered":"2024-09-12T01:02:39.895271+0000","last_clean":"2024-09-12T01:02:39.895271+0000","last_became_active":"2024-09-12T00:15:55.052320+0000","last_became_peered":"2024-09-12T00:15:55.052320+0000","last_unstale":"2024-09-12T01:02:39.895271+0000","last_undegraded":"2024-09-12T01:02:39.895271+0000","last_fullsized":"2024-09-12T01:02:39.895271+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:53.966075+0000","last_clean_scrub_stamp":"2024-09-12T00:15:53.966075+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:04.001879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":13865,"num_write":1350,"num_write_kb":55041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"268'477","reported_seq":2101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.187209+0000","last_change":"2024-09-12T01:03:02.187209+0000","last_active":"2024-09-12T01:03:02.187209+0000","last_peered":"2024-09-12T01:03:02.187209+0000","last_clean":"2024-09-12T01:03:02.187209+0000","last_became_active":"2024-09-12T00:15:57.054996+0000","last_became_peered":"2024-09-12T00:15:57.054996+0000","last_unstale":"2024-09-12T01:03:02.187209+0000","last_undegraded":"2024-09-12T01:03:02.187209+0000","last_fullsized":"2024-09-12T01:03:02.187209+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'477","last_scrub_stamp":"2024-09-12T01:03:02.187021+0000","last_deep_scrub":"268'477","last_deep_scrub_stamp":"2024-09-12T01:03:02.187021+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.187021+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:43.118548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2784,"num_read_kb":2618,"num_write":619,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2539,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"268'328","reported_seq":955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.387452+0000","last_change":"2024-09-12T01:02:55.387452+0000","last_active":"2024-09-12T01:02:55.387452+0000","last_peered":"2024-09-12T01:02:55.387452+0000","last_clean":"2024-09-12T01:02:55.387452+0000","last_became_active":"2024-09-12T00:15:55.078832+0000","last_became_peered":"2024-09-12T00:15:55.078832+0000","last_unstale":"2024-09-12T01:02:55.387452+0000","last_undegraded":"2024-09-12T01:02:55.387452+0000","last_fullsized":"2024-09-12T01:02:55.387452+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'328","last_scrub_stamp":"2024-09-12T01:02:55.387211+0000","last_deep_scrub":"268'328","last_deep_scrub_stamp":"2024-09-12T01:02:55.387211+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.387211+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:04.897261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262198,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":33208,"num_write":990,"num_write_kb":34373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"268'953","reported_seq":2379,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.151228+0000","last_change":"2024-09-12T01:02:59.151228+0000","last_active":"2024-09-12T01:02:59.151228+0000","last_peered":"2024-09-12T01:02:59.151228+0000","last_clean":"2024-09-12T01:02:59.151228+0000","last_became_active":"2024-09-12T00:15:57.027565+0000","last_became_peered":"2024-09-12T00:15:57.027565+0000","last_unstale":"2024-09-12T01:02:59.151228+0000","last_undegraded":"2024-09-12T01:02:59.151228+0000","last_fullsized":"2024-09-12T01:02:59.151228+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'953","last_scrub_stamp":"2024-09-12T01:02:59.151013+0000","last_deep_scrub":"268'953","last_deep_scrub_stamp":"2024-09-12T01:02:59.151013+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.151013+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":900,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:17.674152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4238,"num_read_kb":3802,"num_write":1335,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6185,"num_read_kb":4382,"num_write":1972,"num_write_kb":869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1043,"ondisk_log_size":1043,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15033,"num_read_kb":14688,"num_write":16727,"num_write_kb":4883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1560,"ondisk_log_size":1560,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":505,"ondisk_log_size":505,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1515596,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":17695,"num_read_kb":36825,"num_write":14793,"num_write_kb":11553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":513848,"num_omap_keys":1166,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1828,"ondisk_log_size":1828,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2876,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212032,"num_read_kb":193923,"num_write":55063,"num_write_kb":18681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36842,"num_omap_keys":148,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4173,"ondisk_log_size":4173,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":91096211,"num_objects":373,"num_object_clones":0,"num_object_copies":1492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":373,"num_whiteouts":0,"num_read":36044,"num_read_kb":1967370,"num_write":71560,"num_write_kb":2158407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":123895808,"data_stored":123895808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3636,"ondisk_log_size":3636,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":197046,"num_write":158,"num_write_kb":127402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":185778,"num_write":158,"num_write_kb":127402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719477309,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249092,"kb_used_data":19380,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122748,"statfs":{"total":96636764160,"available":96381693952,"internally_reserved":0,"allocated":19845120,"data_stored":17804594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510016,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114752,"kb_used_data":15536,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94257088,"statfs":{"total":96636764160,"available":96519258112,"internally_reserved":0,"allocated":15908864,"data_stored":13884114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510014,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248492,"kb_used_data":18844,"kb_used_omap":1,"kb_used_meta":229630,"kb_avail":94123348,"statfs":{"total":96636764160,"available":96382308352,"internally_reserved":0,"allocated":19296256,"data_stored":17280849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":235141573},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510016,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189312,"kb_used_data":23472,"kb_used_omap":1,"kb_used_meta":165822,"kb_avail":94182528,"statfs":{"total":96636764160,"available":96442908672,"internally_reserved":0,"allocated":24035328,"data_stored":22022383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169802181},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510015,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":350924,"kb_used_data":18492,"kb_used_omap":1,"kb_used_meta":332414,"kb_avail":94020916,"statfs":{"total":96636764160,"available":96277417984,"internally_reserved":0,"allocated":18935808,"data_stored":16894352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":340392389},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510014,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":155180,"kb_used_data":21276,"kb_used_omap":1,"kb_used_meta":133886,"kb_avail":94216660,"statfs":{"total":96636764160,"available":96477859840,"internally_reserved":0,"allocated":21786624,"data_stored":19750277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":137099717},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542720,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266712,"kb_used_data":19016,"kb_used_omap":1,"kb_used_meta":247678,"kb_avail":94105128,"statfs":{"total":96636764160,"available":96363651072,"internally_reserved":0,"allocated":19472384,"data_stored":17479323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":253622730},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542718,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281208,"kb_used_data":19560,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94090632,"statfs":{"total":96636764160,"available":96348807168,"internally_reserved":0,"allocated":20029440,"data_stored":18004914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17494016,"data_stored":17494016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14049280,"data_stored":14049280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19767296,"data_stored":19767296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15548416,"data_stored":15548416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15024128,"data_stored":15024128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15159296,"data_stored":15159296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11628544,"data_stored":11628544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15224832,"data_stored":15224832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:03:08.149 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.150 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.150 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.150 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.150 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.150 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.150 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.150 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.150 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.151 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.151 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.151 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.151 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.151 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.151 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.151 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.151 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.151 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.152 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.152 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.152 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.152 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.152 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.152 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.152 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.152 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.152 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.153 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.153 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.153 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.153 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.153 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.153 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.153 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.153 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.153 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.154 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.154 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.154 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.154 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.154 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.154 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.154 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.154 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.154 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.155 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.155 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.155 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.155 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.155 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.155 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.155 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.155 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.155 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.155 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.156 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.156 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.156 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.156 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.156 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.156 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.156 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.156 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.156 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.157 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.157 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.157 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.157 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.157 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.157 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.157 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.157 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.158 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.158 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.158 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.158 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.158 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.158 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.158 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.158 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.158 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.158 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.159 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.159 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.159 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.159 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.159 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.159 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.159 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.159 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.159 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.160 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.160 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.160 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.160 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.160 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.160 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.160 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.160 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.160 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.161 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.161 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.161 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.161 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.161 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.161 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.161 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.161 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.161 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.162 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.162 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.162 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.162 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.162 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.162 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.162 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.162 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.162 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.163 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.163 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.163 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.163 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.163 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.163 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.163 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.163 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.163 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.164 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.164 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.164 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.164 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.164 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.164 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.165 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.165 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.165 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.165 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.165 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.165 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.165 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.165 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.165 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.166 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.166 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.166 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.166 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.166 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.166 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.166 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.166 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.167 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.167 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.167 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.167 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.167 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.167 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.167 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.168 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.168 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.168 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.168 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.168 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.168 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.168 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.168 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.169 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.169 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.169 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.169 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.169 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.169 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.169 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.170 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.170 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.170 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.170 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.170 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.170 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.170 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.170 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.171 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.171 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.171 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.171 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.171 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.171 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.171 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.171 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.172 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.172 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.172 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.172 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.172 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.172 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.173 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.173 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.173 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.173 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.173 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.174 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.174 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.174 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.174 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.174 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.174 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.174 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.174 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.175 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.175 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.175 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.175 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.175 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.175 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.175 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.175 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.176 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.176 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.176 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.176 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.176 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.176 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.176 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.176 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.176 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.177 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.177 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.177 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.177 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.177 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.177 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.177 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.177 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.178 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.178 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.178 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.178 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.178 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.178 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.178 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.178 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.179 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.179 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.179 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.179 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.179 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:15:57.992388+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.179 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:16:00.006223+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=0, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.179 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.179 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.179 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.180 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.180 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.180 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:15:55.985441+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.180 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:15:53.966075+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:08.180 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:03:28.182 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:03:28.537 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:03:28.551 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-12T01:03:28.563 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":1698,"stamp":"2024-09-12T01:03:26.848712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":93219632,"num_objects":867,"num_object_clones":0,"num_object_copies":2480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":867,"num_whiteouts":0,"num_read":289757,"num_read_kb":2602955,"num_write":160574,"num_write_kb":2450853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":737889,"num_omap_keys":1777,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13019,"ondisk_log_size":13019,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1847352,"kb_used_data":155576,"kb_used_omap":12,"kb_used_meta":1691635,"kb_avail":753127368,"statfs":{"total":773094113280,"available":771202424832,"internally_reserved":0,"allocated":159309824,"data_stored":143120806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1732234800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":131645,"num_omap_keys":323,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009907"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.676684+0000","last_change":"2024-09-12T01:03:21.676684+0000","last_active":"2024-09-12T01:03:21.676684+0000","last_peered":"2024-09-12T01:03:21.676684+0000","last_clean":"2024-09-12T01:03:21.676684+0000","last_became_active":"2024-09-12T00:43:48.282777+0000","last_became_peered":"2024-09-12T00:43:48.282777+0000","last_unstale":"2024-09-12T01:03:21.676684+0000","last_undegraded":"2024-09-12T01:03:21.676684+0000","last_fullsized":"2024-09-12T01:03:21.676684+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:21.676466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:21.676466+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.676466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:10.480447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"268'2","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.259246+0000","last_change":"2024-09-12T01:03:21.259246+0000","last_active":"2024-09-12T01:03:21.259246+0000","last_peered":"2024-09-12T01:03:21.259246+0000","last_clean":"2024-09-12T01:03:21.259246+0000","last_became_active":"2024-09-12T00:32:28.069841+0000","last_became_peered":"2024-09-12T00:32:28.069841+0000","last_unstale":"2024-09-12T01:03:21.259246+0000","last_undegraded":"2024-09-12T01:03:21.259246+0000","last_fullsized":"2024-09-12T01:03:21.259246+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:21.259008+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:21.259008+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.259008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:27.097291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.181946+0000","last_change":"2024-09-12T00:32:25.027280+0000","last_active":"2024-09-12T00:59:57.181946+0000","last_peered":"2024-09-12T00:59:57.181946+0000","last_clean":"2024-09-12T00:59:57.181946+0000","last_became_active":"2024-09-12T00:32:25.026726+0000","last_became_peered":"2024-09-12T00:32:25.026726+0000","last_unstale":"2024-09-12T00:59:57.181946+0000","last_undegraded":"2024-09-12T00:59:57.181946+0000","last_fullsized":"2024-09-12T00:59:57.181946+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:47.659267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"268'31","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:03.187370+0000","last_change":"2024-09-12T00:30:51.544593+0000","last_active":"2024-09-12T01:00:03.187370+0000","last_peered":"2024-09-12T01:00:03.187370+0000","last_clean":"2024-09-12T01:00:03.187370+0000","last_became_active":"2024-09-12T00:30:51.543858+0000","last_became_peered":"2024-09-12T00:30:51.543858+0000","last_unstale":"2024-09-12T01:00:03.187370+0000","last_undegraded":"2024-09-12T01:00:03.187370+0000","last_fullsized":"2024-09-12T01:00:03.187370+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:38.568158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":120,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.161958+0000","last_change":"2024-09-12T00:43:48.286931+0000","last_active":"2024-09-12T00:58:48.161958+0000","last_peered":"2024-09-12T00:58:48.161958+0000","last_clean":"2024-09-12T00:58:48.161958+0000","last_became_active":"2024-09-12T00:43:48.286291+0000","last_became_peered":"2024-09-12T00:43:48.286291+0000","last_unstale":"2024-09-12T00:58:48.161958+0000","last_undegraded":"2024-09-12T00:58:48.161958+0000","last_fullsized":"2024-09-12T00:58:48.161958+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:17.953673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.190647+0000","last_change":"2024-09-12T00:32:28.070732+0000","last_active":"2024-09-12T00:59:58.190647+0000","last_peered":"2024-09-12T00:59:58.190647+0000","last_clean":"2024-09-12T00:59:58.190647+0000","last_became_active":"2024-09-12T00:32:28.070091+0000","last_became_peered":"2024-09-12T00:32:28.070091+0000","last_unstale":"2024-09-12T00:59:58.190647+0000","last_undegraded":"2024-09-12T00:59:58.190647+0000","last_fullsized":"2024-09-12T00:59:58.190647+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:33.762789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.206709+0000","last_change":"2024-09-12T00:32:25.024486+0000","last_active":"2024-09-12T00:59:57.206709+0000","last_peered":"2024-09-12T00:59:57.206709+0000","last_clean":"2024-09-12T00:59:57.206709+0000","last_became_active":"2024-09-12T00:32:25.023750+0000","last_became_peered":"2024-09-12T00:32:25.023750+0000","last_unstale":"2024-09-12T00:59:57.206709+0000","last_undegraded":"2024-09-12T00:59:57.206709+0000","last_fullsized":"2024-09-12T00:59:57.206709+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:12.053492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"268'20","reported_seq":98,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:02.984591+0000","last_change":"2024-09-12T00:30:51.555569+0000","last_active":"2024-09-12T01:01:02.984591+0000","last_peered":"2024-09-12T01:01:02.984591+0000","last_clean":"2024-09-12T01:01:02.984591+0000","last_became_active":"2024-09-12T00:30:51.554875+0000","last_became_peered":"2024-09-12T00:30:51.554875+0000","last_unstale":"2024-09-12T01:01:02.984591+0000","last_undegraded":"2024-09-12T01:01:02.984591+0000","last_fullsized":"2024-09-12T01:01:02.984591+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":61,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:43.201389+0000","last_change":"2024-09-12T00:43:48.271637+0000","last_active":"2024-09-12T01:00:43.201389+0000","last_peered":"2024-09-12T01:00:43.201389+0000","last_clean":"2024-09-12T01:00:43.201389+0000","last_became_active":"2024-09-12T00:43:48.270700+0000","last_became_peered":"2024-09-12T00:43:48.270700+0000","last_unstale":"2024-09-12T01:00:43.201389+0000","last_undegraded":"2024-09-12T01:00:43.201389+0000","last_fullsized":"2024-09-12T01:00:43.201389+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"268'3","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:42.008400+0000","last_change":"2024-09-12T00:32:28.078229+0000","last_active":"2024-09-12T01:01:42.008400+0000","last_peered":"2024-09-12T01:01:42.008400+0000","last_clean":"2024-09-12T01:01:42.008400+0000","last_became_active":"2024-09-12T00:32:28.065497+0000","last_became_peered":"2024-09-12T00:32:28.065497+0000","last_unstale":"2024-09-12T01:01:42.008400+0000","last_undegraded":"2024-09-12T01:01:42.008400+0000","last_fullsized":"2024-09-12T01:01:42.008400+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:04.479825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"268'5","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.830875+0000","last_change":"2024-09-12T00:32:25.002095+0000","last_active":"2024-09-12T01:02:37.830875+0000","last_peered":"2024-09-12T01:02:37.830875+0000","last_clean":"2024-09-12T01:02:37.830875+0000","last_became_active":"2024-09-12T00:32:25.001290+0000","last_became_peered":"2024-09-12T00:32:25.001290+0000","last_unstale":"2024-09-12T01:02:37.830875+0000","last_undegraded":"2024-09-12T01:02:37.830875+0000","last_fullsized":"2024-09-12T01:02:37.830875+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:20.950634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"268'25","reported_seq":118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.196431+0000","last_change":"2024-09-12T01:03:21.196280+0000","last_active":"2024-09-12T01:03:21.196431+0000","last_peered":"2024-09-12T01:03:21.196431+0000","last_clean":"2024-09-12T01:03:21.196431+0000","last_became_active":"2024-09-12T00:30:51.544751+0000","last_became_peered":"2024-09-12T00:30:51.544751+0000","last_unstale":"2024-09-12T01:03:21.196431+0000","last_undegraded":"2024-09-12T01:03:21.196431+0000","last_fullsized":"2024-09-12T01:03:21.196431+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'25","last_scrub_stamp":"2024-09-12T01:03:21.196100+0000","last_deep_scrub":"268'25","last_deep_scrub_stamp":"2024-09-12T01:03:21.196100+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.196100+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:27.636294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":82,"num_write":61,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:56.995839+0000","last_change":"2024-09-12T00:43:48.280902+0000","last_active":"2024-09-12T01:00:56.995839+0000","last_peered":"2024-09-12T01:00:56.995839+0000","last_clean":"2024-09-12T01:00:56.995839+0000","last_became_active":"2024-09-12T00:43:48.280166+0000","last_became_peered":"2024-09-12T00:43:48.280166+0000","last_unstale":"2024-09-12T01:00:56.995839+0000","last_undegraded":"2024-09-12T01:00:56.995839+0000","last_fullsized":"2024-09-12T01:00:56.995839+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":34,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.992420+0000","last_change":"2024-09-12T00:32:28.078675+0000","last_active":"2024-09-12T01:00:41.992420+0000","last_peered":"2024-09-12T01:00:41.992420+0000","last_clean":"2024-09-12T01:00:41.992420+0000","last_became_active":"2024-09-12T00:32:28.073988+0000","last_became_peered":"2024-09-12T00:32:28.073988+0000","last_unstale":"2024-09-12T01:00:41.992420+0000","last_undegraded":"2024-09-12T01:00:41.992420+0000","last_fullsized":"2024-09-12T01:00:41.992420+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:09.276835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.289781+0000","last_change":"2024-09-12T01:03:22.289781+0000","last_active":"2024-09-12T01:03:22.289781+0000","last_peered":"2024-09-12T01:03:22.289781+0000","last_clean":"2024-09-12T01:03:22.289781+0000","last_became_active":"2024-09-12T00:32:25.007732+0000","last_became_peered":"2024-09-12T00:32:25.007732+0000","last_unstale":"2024-09-12T01:03:22.289781+0000","last_undegraded":"2024-09-12T01:03:22.289781+0000","last_fullsized":"2024-09-12T01:03:22.289781+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:22.289600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:22.289600+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.289600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:38.839024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"268'61","reported_seq":212,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.160224+0000","last_change":"2024-09-12T01:03:20.160072+0000","last_active":"2024-09-12T01:03:20.160224+0000","last_peered":"2024-09-12T01:03:20.160224+0000","last_clean":"2024-09-12T01:03:20.160224+0000","last_became_active":"2024-09-12T00:30:51.551417+0000","last_became_peered":"2024-09-12T00:30:51.551417+0000","last_unstale":"2024-09-12T01:03:20.160224+0000","last_undegraded":"2024-09-12T01:03:20.160224+0000","last_fullsized":"2024-09-12T01:03:20.160224+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'61","last_scrub_stamp":"2024-09-12T01:03:20.159892+0000","last_deep_scrub":"268'61","last_deep_scrub_stamp":"2024-09-12T01:03:20.159892+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.159892+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:23.181094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":214,"num_write":108,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.182039+0000","last_change":"2024-09-12T00:43:48.284245+0000","last_active":"2024-09-12T00:59:57.182039+0000","last_peered":"2024-09-12T00:59:57.182039+0000","last_clean":"2024-09-12T00:59:57.182039+0000","last_became_active":"2024-09-12T00:43:48.283357+0000","last_became_peered":"2024-09-12T00:43:48.283357+0000","last_unstale":"2024-09-12T00:59:57.182039+0000","last_undegraded":"2024-09-12T00:59:57.182039+0000","last_fullsized":"2024-09-12T00:59:57.182039+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.113641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"268'5","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.600482+0000","last_change":"2024-09-12T01:03:16.600482+0000","last_active":"2024-09-12T01:03:16.600482+0000","last_peered":"2024-09-12T01:03:16.600482+0000","last_clean":"2024-09-12T01:03:16.600482+0000","last_became_active":"2024-09-12T00:32:28.053541+0000","last_became_peered":"2024-09-12T00:32:28.053541+0000","last_unstale":"2024-09-12T01:03:16.600482+0000","last_undegraded":"2024-09-12T01:03:16.600482+0000","last_fullsized":"2024-09-12T01:03:16.600482+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T01:03:16.600298+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T01:03:16.600298+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.600298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:05.393658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"268'3","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:27.004021+0000","last_change":"2024-09-12T00:32:25.015629+0000","last_active":"2024-09-12T01:01:27.004021+0000","last_peered":"2024-09-12T01:01:27.004021+0000","last_clean":"2024-09-12T01:01:27.004021+0000","last_became_active":"2024-09-12T00:32:25.014665+0000","last_became_peered":"2024-09-12T00:32:25.014665+0000","last_unstale":"2024-09-12T01:01:27.004021+0000","last_undegraded":"2024-09-12T01:01:27.004021+0000","last_fullsized":"2024-09-12T01:01:27.004021+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:46.651960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"268'40","reported_seq":163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.166755+0000","last_change":"2024-09-12T01:03:19.166618+0000","last_active":"2024-09-12T01:03:19.166755+0000","last_peered":"2024-09-12T01:03:19.166755+0000","last_clean":"2024-09-12T01:03:19.166755+0000","last_became_active":"2024-09-12T00:30:51.547784+0000","last_became_peered":"2024-09-12T00:30:51.547784+0000","last_unstale":"2024-09-12T01:03:19.166755+0000","last_undegraded":"2024-09-12T01:03:19.166755+0000","last_fullsized":"2024-09-12T01:03:19.166755+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'40","last_scrub_stamp":"2024-09-12T01:03:19.166420+0000","last_deep_scrub":"268'40","last_deep_scrub_stamp":"2024-09-12T01:03:19.166420+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.166420+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:04.043127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":150,"num_write":68,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.192933+0000","last_change":"2024-09-12T00:43:48.278102+0000","last_active":"2024-09-12T01:00:28.192933+0000","last_peered":"2024-09-12T01:00:28.192933+0000","last_clean":"2024-09-12T01:00:28.192933+0000","last_became_active":"2024-09-12T00:43:48.276078+0000","last_became_peered":"2024-09-12T00:43:48.276078+0000","last_unstale":"2024-09-12T01:00:28.192933+0000","last_undegraded":"2024-09-12T01:00:28.192933+0000","last_fullsized":"2024-09-12T01:00:28.192933+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:21.420479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"268'5","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.600193+0000","last_change":"2024-09-12T00:32:28.031279+0000","last_active":"2024-09-12T01:02:37.600193+0000","last_peered":"2024-09-12T01:02:37.600193+0000","last_clean":"2024-09-12T01:02:37.600193+0000","last_became_active":"2024-09-12T00:32:28.030520+0000","last_became_peered":"2024-09-12T00:32:28.030520+0000","last_unstale":"2024-09-12T01:02:37.600193+0000","last_undegraded":"2024-09-12T01:02:37.600193+0000","last_fullsized":"2024-09-12T01:02:37.600193+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:22.614081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"268'3","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:34.014371+0000","last_change":"2024-09-12T00:32:25.010515+0000","last_active":"2024-09-12T01:01:34.014371+0000","last_peered":"2024-09-12T01:01:34.014371+0000","last_clean":"2024-09-12T01:01:34.014371+0000","last_became_active":"2024-09-12T00:32:25.009898+0000","last_became_peered":"2024-09-12T00:32:25.009898+0000","last_unstale":"2024-09-12T01:01:34.014371+0000","last_undegraded":"2024-09-12T01:01:34.014371+0000","last_fullsized":"2024-09-12T01:01:34.014371+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:26.343687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"268'22","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.605966+0000","last_change":"2024-09-12T01:03:17.605822+0000","last_active":"2024-09-12T01:03:17.605966+0000","last_peered":"2024-09-12T01:03:17.605966+0000","last_clean":"2024-09-12T01:03:17.605966+0000","last_became_active":"2024-09-12T00:30:51.559544+0000","last_became_peered":"2024-09-12T00:30:51.559544+0000","last_unstale":"2024-09-12T01:03:17.605966+0000","last_undegraded":"2024-09-12T01:03:17.605966+0000","last_fullsized":"2024-09-12T01:03:17.605966+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'22","last_scrub_stamp":"2024-09-12T01:03:17.605585+0000","last_deep_scrub":"268'22","last_deep_scrub_stamp":"2024-09-12T01:03:17.605585+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.605585+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:15.764743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":79,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"268'1","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:48.173552+0000","last_change":"2024-09-12T00:43:48.283455+0000","last_active":"2024-09-12T00:58:48.173552+0000","last_peered":"2024-09-12T00:58:48.173552+0000","last_clean":"2024-09-12T00:58:48.173552+0000","last_became_active":"2024-09-12T00:43:48.283057+0000","last_became_peered":"2024-09-12T00:43:48.283057+0000","last_unstale":"2024-09-12T00:58:48.173552+0000","last_undegraded":"2024-09-12T00:58:48.173552+0000","last_fullsized":"2024-09-12T00:58:48.173552+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:33.410879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.190602+0000","last_change":"2024-09-12T00:32:28.066260+0000","last_active":"2024-09-12T00:59:58.190602+0000","last_peered":"2024-09-12T00:59:58.190602+0000","last_clean":"2024-09-12T00:59:58.190602+0000","last_became_active":"2024-09-12T00:32:28.065376+0000","last_became_peered":"2024-09-12T00:32:28.065376+0000","last_unstale":"2024-09-12T00:59:58.190602+0000","last_undegraded":"2024-09-12T00:59:58.190602+0000","last_fullsized":"2024-09-12T00:59:58.190602+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:37.216971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"268'3","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.545423+0000","last_change":"2024-09-12T01:03:14.545423+0000","last_active":"2024-09-12T01:03:14.545423+0000","last_peered":"2024-09-12T01:03:14.545423+0000","last_clean":"2024-09-12T01:03:14.545423+0000","last_became_active":"2024-09-12T00:32:24.999604+0000","last_became_peered":"2024-09-12T00:32:24.999604+0000","last_unstale":"2024-09-12T01:03:14.545423+0000","last_undegraded":"2024-09-12T01:03:14.545423+0000","last_fullsized":"2024-09-12T01:03:14.545423+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:14.545246+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:14.545246+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.545246+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:04.271455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"268'41","reported_seq":161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.880756+0000","last_change":"2024-09-12T01:03:19.880756+0000","last_active":"2024-09-12T01:03:19.880756+0000","last_peered":"2024-09-12T01:03:19.880756+0000","last_clean":"2024-09-12T01:03:19.880756+0000","last_became_active":"2024-09-12T00:30:51.556729+0000","last_became_peered":"2024-09-12T00:30:51.556729+0000","last_unstale":"2024-09-12T01:03:19.880756+0000","last_undegraded":"2024-09-12T01:03:19.880756+0000","last_fullsized":"2024-09-12T01:03:19.880756+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'41","last_scrub_stamp":"2024-09-12T01:03:19.880569+0000","last_deep_scrub":"268'41","last_deep_scrub_stamp":"2024-09-12T01:03:19.880569+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.880569+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:33.118032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":144,"num_write":69,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":28,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.682410+0000","last_change":"2024-09-12T01:03:22.682410+0000","last_active":"2024-09-12T01:03:22.682410+0000","last_peered":"2024-09-12T01:03:22.682410+0000","last_clean":"2024-09-12T01:03:22.682410+0000","last_became_active":"2024-09-12T00:43:48.281781+0000","last_became_peered":"2024-09-12T00:43:48.281781+0000","last_unstale":"2024-09-12T01:03:22.682410+0000","last_undegraded":"2024-09-12T01:03:22.682410+0000","last_fullsized":"2024-09-12T01:03:22.682410+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:22.682226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:22.682226+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.682226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.752061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"268'5","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.600083+0000","last_change":"2024-09-12T00:32:28.063332+0000","last_active":"2024-09-12T01:02:37.600083+0000","last_peered":"2024-09-12T01:02:37.600083+0000","last_clean":"2024-09-12T01:02:37.600083+0000","last_became_active":"2024-09-12T00:32:28.062540+0000","last_became_peered":"2024-09-12T00:32:28.062540+0000","last_unstale":"2024-09-12T01:02:37.600083+0000","last_undegraded":"2024-09-12T01:02:37.600083+0000","last_fullsized":"2024-09-12T01:02:37.600083+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:19.133641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:58.179111+0000","last_change":"2024-09-12T00:32:25.021694+0000","last_active":"2024-09-12T00:59:58.179111+0000","last_peered":"2024-09-12T00:59:58.179111+0000","last_clean":"2024-09-12T00:59:58.179111+0000","last_became_active":"2024-09-12T00:32:25.017715+0000","last_became_peered":"2024-09-12T00:32:25.017715+0000","last_unstale":"2024-09-12T00:59:58.179111+0000","last_undegraded":"2024-09-12T00:59:58.179111+0000","last_fullsized":"2024-09-12T00:59:58.179111+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:02.525100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'8","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.182447+0000","last_change":"2024-09-12T01:03:18.182447+0000","last_active":"2024-09-12T01:03:18.182447+0000","last_peered":"2024-09-12T01:03:18.182447+0000","last_clean":"2024-09-12T01:03:18.182447+0000","last_became_active":"2024-09-12T00:30:51.546981+0000","last_became_peered":"2024-09-12T00:30:51.546981+0000","last_unstale":"2024-09-12T01:03:18.182447+0000","last_undegraded":"2024-09-12T01:03:18.182447+0000","last_fullsized":"2024-09-12T01:03:18.182447+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T01:03:18.182248+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T01:03:18.182248+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.182248+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:50.564435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:12.210443+0000","last_change":"2024-09-12T00:43:48.273242+0000","last_active":"2024-09-12T01:00:12.210443+0000","last_peered":"2024-09-12T01:00:12.210443+0000","last_clean":"2024-09-12T01:00:12.210443+0000","last_became_active":"2024-09-12T00:43:48.272523+0000","last_became_peered":"2024-09-12T00:43:48.272523+0000","last_unstale":"2024-09-12T01:00:12.210443+0000","last_undegraded":"2024-09-12T01:00:12.210443+0000","last_fullsized":"2024-09-12T01:00:12.210443+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:58.897794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"268'9","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:27.204203+0000","last_change":"2024-09-12T00:32:28.069369+0000","last_active":"2024-09-12T01:01:27.204203+0000","last_peered":"2024-09-12T01:01:27.204203+0000","last_clean":"2024-09-12T01:01:27.204203+0000","last_became_active":"2024-09-12T00:32:28.062839+0000","last_became_peered":"2024-09-12T00:32:28.062839+0000","last_unstale":"2024-09-12T01:01:27.204203+0000","last_undegraded":"2024-09-12T01:01:27.204203+0000","last_fullsized":"2024-09-12T01:01:27.204203+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:52.354103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"268'4","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.334915+0000","last_change":"2024-09-12T00:32:25.005903+0000","last_active":"2024-09-12T01:02:39.334915+0000","last_peered":"2024-09-12T01:02:39.334915+0000","last_clean":"2024-09-12T01:02:39.334915+0000","last_became_active":"2024-09-12T00:32:25.005113+0000","last_became_peered":"2024-09-12T00:32:25.005113+0000","last_unstale":"2024-09-12T01:02:39.334915+0000","last_undegraded":"2024-09-12T01:02:39.334915+0000","last_fullsized":"2024-09-12T01:02:39.334915+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3076,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'62","reported_seq":220,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:53.184530+0000","last_change":"2024-09-12T00:30:51.542763+0000","last_active":"2024-09-12T00:59:53.184530+0000","last_peered":"2024-09-12T00:59:53.184530+0000","last_clean":"2024-09-12T00:59:53.184530+0000","last_became_active":"2024-09-12T00:30:51.541882+0000","last_became_peered":"2024-09-12T00:30:51.541882+0000","last_unstale":"2024-09-12T00:59:53.184530+0000","last_undegraded":"2024-09-12T00:59:53.184530+0000","last_fullsized":"2024-09-12T00:59:53.184530+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:23.614120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":254,"num_write":98,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.181831+0000","last_change":"2024-09-12T00:43:48.278782+0000","last_active":"2024-09-12T01:00:08.181831+0000","last_peered":"2024-09-12T01:00:08.181831+0000","last_clean":"2024-09-12T01:00:08.181831+0000","last_became_active":"2024-09-12T00:43:48.277883+0000","last_became_peered":"2024-09-12T00:43:48.277883+0000","last_unstale":"2024-09-12T01:00:08.181831+0000","last_undegraded":"2024-09-12T01:00:08.181831+0000","last_fullsized":"2024-09-12T01:00:08.181831+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:35.841252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'5","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:41.992292+0000","last_change":"2024-09-12T00:32:28.052092+0000","last_active":"2024-09-12T01:00:41.992292+0000","last_peered":"2024-09-12T01:00:41.992292+0000","last_clean":"2024-09-12T01:00:41.992292+0000","last_became_active":"2024-09-12T00:32:28.051364+0000","last_became_peered":"2024-09-12T00:32:28.051364+0000","last_unstale":"2024-09-12T01:00:41.992292+0000","last_undegraded":"2024-09-12T01:00:41.992292+0000","last_fullsized":"2024-09-12T01:00:41.992292+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5136,"num_write":10,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"268'2","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.550499+0000","last_change":"2024-09-12T01:03:12.550499+0000","last_active":"2024-09-12T01:03:12.550499+0000","last_peered":"2024-09-12T01:03:12.550499+0000","last_clean":"2024-09-12T01:03:12.550499+0000","last_became_active":"2024-09-12T00:32:25.009125+0000","last_became_peered":"2024-09-12T00:32:25.009125+0000","last_unstale":"2024-09-12T01:03:12.550499+0000","last_undegraded":"2024-09-12T01:03:12.550499+0000","last_fullsized":"2024-09-12T01:03:12.550499+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:12.550316+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:12.550316+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.550316+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:16.076008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"268'31","reported_seq":125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:53.184482+0000","last_change":"2024-09-12T00:30:51.555036+0000","last_active":"2024-09-12T00:59:53.184482+0000","last_peered":"2024-09-12T00:59:53.184482+0000","last_clean":"2024-09-12T00:59:53.184482+0000","last_became_active":"2024-09-12T00:30:51.553919+0000","last_became_peered":"2024-09-12T00:30:51.553919+0000","last_unstale":"2024-09-12T00:59:53.184482+0000","last_undegraded":"2024-09-12T00:59:53.184482+0000","last_fullsized":"2024-09-12T00:59:53.184482+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:07.977904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":104,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:08.195129+0000","last_change":"2024-09-12T00:43:48.289134+0000","last_active":"2024-09-12T01:00:08.195129+0000","last_peered":"2024-09-12T01:00:08.195129+0000","last_clean":"2024-09-12T01:00:08.195129+0000","last_became_active":"2024-09-12T00:43:48.288517+0000","last_became_peered":"2024-09-12T00:43:48.288517+0000","last_unstale":"2024-09-12T01:00:08.195129+0000","last_undegraded":"2024-09-12T01:00:08.195129+0000","last_fullsized":"2024-09-12T01:00:08.195129+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:05.171146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168160+0000","last_change":"2024-09-12T00:32:28.060574+0000","last_active":"2024-09-12T00:59:02.168160+0000","last_peered":"2024-09-12T00:59:02.168160+0000","last_clean":"2024-09-12T00:59:02.168160+0000","last_became_active":"2024-09-12T00:32:28.059869+0000","last_became_peered":"2024-09-12T00:32:28.059869+0000","last_unstale":"2024-09-12T00:59:02.168160+0000","last_undegraded":"2024-09-12T00:59:02.168160+0000","last_fullsized":"2024-09-12T00:59:02.168160+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:24.600878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.168108+0000","last_change":"2024-09-12T00:32:25.027341+0000","last_active":"2024-09-12T00:59:02.168108+0000","last_peered":"2024-09-12T00:59:02.168108+0000","last_clean":"2024-09-12T00:59:02.168108+0000","last_became_active":"2024-09-12T00:32:25.026751+0000","last_became_peered":"2024-09-12T00:32:25.026751+0000","last_unstale":"2024-09-12T00:59:02.168108+0000","last_undegraded":"2024-09-12T00:59:02.168108+0000","last_fullsized":"2024-09-12T00:59:02.168108+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:19.648395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"268'24","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.873106+0000","last_change":"2024-09-12T01:03:17.873106+0000","last_active":"2024-09-12T01:03:17.873106+0000","last_peered":"2024-09-12T01:03:17.873106+0000","last_clean":"2024-09-12T01:03:17.873106+0000","last_became_active":"2024-09-12T00:30:51.548069+0000","last_became_peered":"2024-09-12T00:30:51.548069+0000","last_unstale":"2024-09-12T01:03:17.873106+0000","last_undegraded":"2024-09-12T01:03:17.873106+0000","last_fullsized":"2024-09-12T01:03:17.873106+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'24","last_scrub_stamp":"2024-09-12T01:03:17.872922+0000","last_deep_scrub":"268'24","last_deep_scrub_stamp":"2024-09-12T01:03:17.872922+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.872922+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:45.795027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":85,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.628949+0000","last_change":"2024-09-12T01:03:20.628949+0000","last_active":"2024-09-12T01:03:20.628949+0000","last_peered":"2024-09-12T01:03:20.628949+0000","last_clean":"2024-09-12T01:03:20.628949+0000","last_became_active":"2024-09-12T00:43:48.274026+0000","last_became_peered":"2024-09-12T00:43:48.274026+0000","last_unstale":"2024-09-12T01:03:20.628949+0000","last_undegraded":"2024-09-12T01:03:20.628949+0000","last_fullsized":"2024-09-12T01:03:20.628949+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:20.628638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:20.628638+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.628638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:44.344922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"268'2","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.561422+0000","last_change":"2024-09-12T01:03:15.561422+0000","last_active":"2024-09-12T01:03:15.561422+0000","last_peered":"2024-09-12T01:03:15.561422+0000","last_clean":"2024-09-12T01:03:15.561422+0000","last_became_active":"2024-09-12T00:32:28.062657+0000","last_became_peered":"2024-09-12T00:32:28.062657+0000","last_unstale":"2024-09-12T01:03:15.561422+0000","last_undegraded":"2024-09-12T01:03:15.561422+0000","last_fullsized":"2024-09-12T01:03:15.561422+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:15.561217+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:15.561217+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.561217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:18.353263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":37,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:02.192560+0000","last_change":"2024-09-12T00:32:24.997566+0000","last_active":"2024-09-12T00:59:02.192560+0000","last_peered":"2024-09-12T00:59:02.192560+0000","last_clean":"2024-09-12T00:59:02.192560+0000","last_became_active":"2024-09-12T00:32:24.996754+0000","last_became_peered":"2024-09-12T00:32:24.996754+0000","last_unstale":"2024-09-12T00:59:02.192560+0000","last_undegraded":"2024-09-12T00:59:02.192560+0000","last_fullsized":"2024-09-12T00:59:02.192560+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:55.566151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"268'26","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:59.211731+0000","last_change":"2024-09-12T00:30:51.551315+0000","last_active":"2024-09-12T00:58:59.211731+0000","last_peered":"2024-09-12T00:58:59.211731+0000","last_clean":"2024-09-12T00:58:59.211731+0000","last_became_active":"2024-09-12T00:30:51.545679+0000","last_became_peered":"2024-09-12T00:30:51.545679+0000","last_unstale":"2024-09-12T00:58:59.211731+0000","last_undegraded":"2024-09-12T00:58:59.211731+0000","last_fullsized":"2024-09-12T00:58:59.211731+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:32:48.283586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":84,"num_write":50,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:46.993530+0000","last_change":"2024-09-12T00:43:48.286291+0000","last_active":"2024-09-12T01:00:46.993530+0000","last_peered":"2024-09-12T01:00:46.993530+0000","last_clean":"2024-09-12T01:00:46.993530+0000","last_became_active":"2024-09-12T00:43:48.285657+0000","last_became_peered":"2024-09-12T00:43:48.285657+0000","last_unstale":"2024-09-12T01:00:46.993530+0000","last_undegraded":"2024-09-12T01:00:46.993530+0000","last_fullsized":"2024-09-12T01:00:46.993530+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"268'8","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.335677+0000","last_change":"2024-09-12T00:32:28.068135+0000","last_active":"2024-09-12T01:02:39.335677+0000","last_peered":"2024-09-12T01:02:39.335677+0000","last_clean":"2024-09-12T01:02:39.335677+0000","last_became_active":"2024-09-12T00:32:28.067168+0000","last_became_peered":"2024-09-12T00:32:28.067168+0000","last_unstale":"2024-09-12T01:02:39.335677+0000","last_undegraded":"2024-09-12T01:02:39.335677+0000","last_fullsized":"2024-09-12T01:02:39.335677+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"268'10","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.259240+0000","last_change":"2024-09-12T01:03:18.259240+0000","last_active":"2024-09-12T01:03:18.259240+0000","last_peered":"2024-09-12T01:03:18.259240+0000","last_clean":"2024-09-12T01:03:18.259240+0000","last_became_active":"2024-09-12T00:32:25.011944+0000","last_became_peered":"2024-09-12T00:32:25.011944+0000","last_unstale":"2024-09-12T01:03:18.259240+0000","last_undegraded":"2024-09-12T01:03:18.259240+0000","last_fullsized":"2024-09-12T01:03:18.259240+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'10","last_scrub_stamp":"2024-09-12T01:03:18.259037+0000","last_deep_scrub":"268'10","last_deep_scrub_stamp":"2024-09-12T01:03:18.259037+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.259037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:43.728684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":20800,"num_write":20,"num_write_kb":10558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"268'29","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:54.210368+0000","last_change":"2024-09-12T00:30:51.551466+0000","last_active":"2024-09-12T00:58:54.210368+0000","last_peered":"2024-09-12T00:58:54.210368+0000","last_clean":"2024-09-12T00:58:54.210368+0000","last_became_active":"2024-09-12T00:30:51.550694+0000","last_became_peered":"2024-09-12T00:30:51.550694+0000","last_unstale":"2024-09-12T00:58:54.210368+0000","last_undegraded":"2024-09-12T00:58:54.210368+0000","last_fullsized":"2024-09-12T00:58:54.210368+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:19.647721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:43.189779+0000","last_change":"2024-09-12T00:43:48.273326+0000","last_active":"2024-09-12T01:00:43.189779+0000","last_peered":"2024-09-12T01:00:43.189779+0000","last_clean":"2024-09-12T01:00:43.189779+0000","last_became_active":"2024-09-12T00:43:48.272356+0000","last_became_peered":"2024-09-12T00:43:48.272356+0000","last_unstale":"2024-09-12T01:00:43.189779+0000","last_undegraded":"2024-09-12T01:00:43.189779+0000","last_fullsized":"2024-09-12T01:00:43.189779+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"268'6","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.920927+0000","last_change":"2024-09-12T00:32:28.068097+0000","last_active":"2024-09-12T01:02:37.920927+0000","last_peered":"2024-09-12T01:02:37.920927+0000","last_clean":"2024-09-12T01:02:37.920927+0000","last_became_active":"2024-09-12T00:32:28.067388+0000","last_became_peered":"2024-09-12T00:32:28.067388+0000","last_unstale":"2024-09-12T01:02:37.920927+0000","last_undegraded":"2024-09-12T01:02:37.920927+0000","last_fullsized":"2024-09-12T01:02:37.920927+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:27.213718+0000","last_change":"2024-09-12T00:32:25.009043+0000","last_active":"2024-09-12T01:00:27.213718+0000","last_peered":"2024-09-12T01:00:27.213718+0000","last_clean":"2024-09-12T01:00:27.213718+0000","last_became_active":"2024-09-12T00:32:25.005882+0000","last_became_peered":"2024-09-12T00:32:25.005882+0000","last_unstale":"2024-09-12T01:00:27.213718+0000","last_undegraded":"2024-09-12T01:00:27.213718+0000","last_fullsized":"2024-09-12T01:00:27.213718+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"268'19","reported_seq":103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.845169+0000","last_change":"2024-09-12T01:03:16.845169+0000","last_active":"2024-09-12T01:03:16.845169+0000","last_peered":"2024-09-12T01:03:16.845169+0000","last_clean":"2024-09-12T01:03:16.845169+0000","last_became_active":"2024-09-12T00:30:51.548932+0000","last_became_peered":"2024-09-12T00:30:51.548932+0000","last_unstale":"2024-09-12T01:03:16.845169+0000","last_undegraded":"2024-09-12T01:03:16.845169+0000","last_fullsized":"2024-09-12T01:03:16.845169+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'19","last_scrub_stamp":"2024-09-12T01:03:16.844979+0000","last_deep_scrub":"268'19","last_deep_scrub_stamp":"2024-09-12T01:03:16.844979+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.844979+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:09.777377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"267'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:13.189591+0000","last_change":"2024-09-12T00:43:48.277526+0000","last_active":"2024-09-12T01:00:13.189591+0000","last_peered":"2024-09-12T01:00:13.189591+0000","last_clean":"2024-09-12T01:00:13.189591+0000","last_became_active":"2024-09-12T00:43:48.274983+0000","last_became_peered":"2024-09-12T00:43:48.274983+0000","last_unstale":"2024-09-12T01:00:13.189591+0000","last_undegraded":"2024-09-12T01:00:13.189591+0000","last_fullsized":"2024-09-12T01:00:13.189591+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:46:44.126353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"265'5","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:27.189286+0000","last_change":"2024-09-12T00:32:28.050796+0000","last_active":"2024-09-12T01:00:27.189286+0000","last_peered":"2024-09-12T01:00:27.189286+0000","last_clean":"2024-09-12T01:00:27.189286+0000","last_became_active":"2024-09-12T00:32:28.049947+0000","last_became_peered":"2024-09-12T00:32:28.049947+0000","last_unstale":"2024-09-12T01:00:27.189286+0000","last_undegraded":"2024-09-12T01:00:27.189286+0000","last_fullsized":"2024-09-12T01:00:27.189286+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:37.435116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.260368+0000","last_change":"2024-09-12T01:03:17.260368+0000","last_active":"2024-09-12T01:03:17.260368+0000","last_peered":"2024-09-12T01:03:17.260368+0000","last_clean":"2024-09-12T01:03:17.260368+0000","last_became_active":"2024-09-12T00:32:25.008089+0000","last_became_peered":"2024-09-12T00:32:25.008089+0000","last_unstale":"2024-09-12T01:03:17.260368+0000","last_undegraded":"2024-09-12T01:03:17.260368+0000","last_fullsized":"2024-09-12T01:03:17.260368+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:17.260180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:17.260180+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.260180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:55.268421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"268'83","reported_seq":332,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.600561+0000","last_change":"2024-09-12T01:03:18.600561+0000","last_active":"2024-09-12T01:03:18.600561+0000","last_peered":"2024-09-12T01:03:18.600561+0000","last_clean":"2024-09-12T01:03:18.600561+0000","last_became_active":"2024-09-12T00:30:51.548232+0000","last_became_peered":"2024-09-12T00:30:51.548232+0000","last_unstale":"2024-09-12T01:03:18.600561+0000","last_undegraded":"2024-09-12T01:03:18.600561+0000","last_fullsized":"2024-09-12T01:03:18.600561+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'83","last_scrub_stamp":"2024-09-12T01:03:18.600292+0000","last_deep_scrub":"268'83","last_deep_scrub_stamp":"2024-09-12T01:03:18.600292+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.600292+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:02.341405+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":390,"num_write":93,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2796,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"268'1","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:43.189673+0000","last_change":"2024-09-12T00:43:48.272336+0000","last_active":"2024-09-12T01:00:43.189673+0000","last_peered":"2024-09-12T01:00:43.189673+0000","last_clean":"2024-09-12T01:00:43.189673+0000","last_became_active":"2024-09-12T00:43:48.271560+0000","last_became_peered":"2024-09-12T00:43:48.271560+0000","last_unstale":"2024-09-12T01:00:43.189673+0000","last_undegraded":"2024-09-12T01:00:43.189673+0000","last_fullsized":"2024-09-12T01:00:43.189673+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.234163+0000","last_change":"2024-09-12T00:32:28.058883+0000","last_active":"2024-09-12T01:00:29.234163+0000","last_peered":"2024-09-12T01:00:29.234163+0000","last_clean":"2024-09-12T01:00:29.234163+0000","last_became_active":"2024-09-12T00:32:28.058127+0000","last_became_peered":"2024-09-12T00:32:28.058127+0000","last_unstale":"2024-09-12T01:00:29.234163+0000","last_undegraded":"2024-09-12T01:00:29.234163+0000","last_fullsized":"2024-09-12T01:00:29.234163+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"268'3","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.218360+0000","last_change":"2024-09-12T01:03:19.218360+0000","last_active":"2024-09-12T01:03:19.218360+0000","last_peered":"2024-09-12T01:03:19.218360+0000","last_clean":"2024-09-12T01:03:19.218360+0000","last_became_active":"2024-09-12T00:32:25.013042+0000","last_became_peered":"2024-09-12T00:32:25.013042+0000","last_unstale":"2024-09-12T01:03:19.218360+0000","last_undegraded":"2024-09-12T01:03:19.218360+0000","last_fullsized":"2024-09-12T01:03:19.218360+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:19.218177+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:19.218177+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.218177+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:33.238245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'29","reported_seq":136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.846217+0000","last_change":"2024-09-12T01:03:15.846217+0000","last_active":"2024-09-12T01:03:15.846217+0000","last_peered":"2024-09-12T01:03:15.846217+0000","last_clean":"2024-09-12T01:03:15.846217+0000","last_became_active":"2024-09-12T00:30:51.545619+0000","last_became_peered":"2024-09-12T00:30:51.545619+0000","last_unstale":"2024-09-12T01:03:15.846217+0000","last_undegraded":"2024-09-12T01:03:15.846217+0000","last_fullsized":"2024-09-12T01:03:15.846217+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-12T01:03:15.845929+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-12T01:03:15.845929+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.845929+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:45.123501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":120,"num_write":40,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:07.193629+0000","last_change":"2024-09-12T00:43:48.280018+0000","last_active":"2024-09-12T00:59:07.193629+0000","last_peered":"2024-09-12T00:59:07.193629+0000","last_clean":"2024-09-12T00:59:07.193629+0000","last_became_active":"2024-09-12T00:43:48.279197+0000","last_became_peered":"2024-09-12T00:43:48.279197+0000","last_unstale":"2024-09-12T00:59:07.193629+0000","last_undegraded":"2024-09-12T00:59:07.193629+0000","last_fullsized":"2024-09-12T00:59:07.193629+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:16.184230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174616+0000","last_change":"2024-09-12T00:32:28.058572+0000","last_active":"2024-09-12T00:59:27.174616+0000","last_peered":"2024-09-12T00:59:27.174616+0000","last_clean":"2024-09-12T00:59:27.174616+0000","last_became_active":"2024-09-12T00:32:28.057839+0000","last_became_peered":"2024-09-12T00:32:28.057839+0000","last_unstale":"2024-09-12T00:59:27.174616+0000","last_undegraded":"2024-09-12T00:59:27.174616+0000","last_fullsized":"2024-09-12T00:59:27.174616+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:41.184079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"268'8","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.606924+0000","last_change":"2024-09-12T01:03:22.606924+0000","last_active":"2024-09-12T01:03:22.606924+0000","last_peered":"2024-09-12T01:03:22.606924+0000","last_clean":"2024-09-12T01:03:22.606924+0000","last_became_active":"2024-09-12T00:32:25.021649+0000","last_became_peered":"2024-09-12T00:32:25.021649+0000","last_unstale":"2024-09-12T01:03:22.606924+0000","last_undegraded":"2024-09-12T01:03:22.606924+0000","last_fullsized":"2024-09-12T01:03:22.606924+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:03:22.606753+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:03:22.606753+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.606753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:45.672695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"268'68","reported_seq":244,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.863606+0000","last_change":"2024-09-12T01:03:14.863606+0000","last_active":"2024-09-12T01:03:14.863606+0000","last_peered":"2024-09-12T01:03:14.863606+0000","last_clean":"2024-09-12T01:03:14.863606+0000","last_became_active":"2024-09-12T00:30:51.562106+0000","last_became_peered":"2024-09-12T00:30:51.562106+0000","last_unstale":"2024-09-12T01:03:14.863606+0000","last_undegraded":"2024-09-12T01:03:14.863606+0000","last_fullsized":"2024-09-12T01:03:14.863606+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'68","last_scrub_stamp":"2024-09-12T01:03:14.863392+0000","last_deep_scrub":"268'68","last_deep_scrub_stamp":"2024-09-12T01:03:14.863392+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.863392+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:39.028253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":360,"num_read_kb":258,"num_write":123,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.185103+0000","last_change":"2024-09-12T00:43:48.287022+0000","last_active":"2024-09-12T00:59:33.185103+0000","last_peered":"2024-09-12T00:59:33.185103+0000","last_clean":"2024-09-12T00:59:33.185103+0000","last_became_active":"2024-09-12T00:43:48.286629+0000","last_became_peered":"2024-09-12T00:43:48.286629+0000","last_unstale":"2024-09-12T00:59:33.185103+0000","last_undegraded":"2024-09-12T00:59:33.185103+0000","last_fullsized":"2024-09-12T00:59:33.185103+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:40.640752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:27.174553+0000","last_change":"2024-09-12T00:32:28.071698+0000","last_active":"2024-09-12T00:59:27.174553+0000","last_peered":"2024-09-12T00:59:27.174553+0000","last_clean":"2024-09-12T00:59:27.174553+0000","last_became_active":"2024-09-12T00:32:28.070913+0000","last_became_peered":"2024-09-12T00:32:28.070913+0000","last_unstale":"2024-09-12T00:59:27.174553+0000","last_undegraded":"2024-09-12T00:59:27.174553+0000","last_fullsized":"2024-09-12T00:59:27.174553+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:34.008495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"268'10","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.250848+0000","last_change":"2024-09-12T00:32:25.022141+0000","last_active":"2024-09-12T01:02:38.250848+0000","last_peered":"2024-09-12T01:02:38.250848+0000","last_clean":"2024-09-12T01:02:38.250848+0000","last_became_active":"2024-09-12T00:32:25.007681+0000","last_became_peered":"2024-09-12T00:32:25.007681+0000","last_unstale":"2024-09-12T01:02:38.250848+0000","last_undegraded":"2024-09-12T01:02:38.250848+0000","last_fullsized":"2024-09-12T01:02:38.250848+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:55:46.593006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4146,"num_write":20,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"268'39","reported_seq":150,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:09.229370+0000","last_change":"2024-09-12T00:30:51.565589+0000","last_active":"2024-09-12T01:00:09.229370+0000","last_peered":"2024-09-12T01:00:09.229370+0000","last_clean":"2024-09-12T01:00:09.229370+0000","last_became_active":"2024-09-12T00:30:51.559520+0000","last_became_peered":"2024-09-12T00:30:51.559520+0000","last_unstale":"2024-09-12T01:00:09.229370+0000","last_undegraded":"2024-09-12T01:00:09.229370+0000","last_fullsized":"2024-09-12T01:00:09.229370+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:38.099204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":143,"num_write":68,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.007105+0000","last_change":"2024-09-12T00:43:48.287080+0000","last_active":"2024-09-12T01:01:09.007105+0000","last_peered":"2024-09-12T01:01:09.007105+0000","last_clean":"2024-09-12T01:01:09.007105+0000","last_became_active":"2024-09-12T00:43:48.286079+0000","last_became_peered":"2024-09-12T00:43:48.286079+0000","last_unstale":"2024-09-12T01:01:09.007105+0000","last_undegraded":"2024-09-12T01:01:09.007105+0000","last_fullsized":"2024-09-12T01:01:09.007105+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.177100+0000","last_change":"2024-09-12T00:32:28.075197+0000","last_active":"2024-09-12T00:59:37.177100+0000","last_peered":"2024-09-12T00:59:37.177100+0000","last_clean":"2024-09-12T00:59:37.177100+0000","last_became_active":"2024-09-12T00:32:28.074621+0000","last_became_peered":"2024-09-12T00:32:28.074621+0000","last_unstale":"2024-09-12T00:59:37.177100+0000","last_undegraded":"2024-09-12T00:59:37.177100+0000","last_fullsized":"2024-09-12T00:59:37.177100+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:11.217357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.848666+0000","last_change":"2024-09-12T01:03:21.848666+0000","last_active":"2024-09-12T01:03:21.848666+0000","last_peered":"2024-09-12T01:03:21.848666+0000","last_clean":"2024-09-12T01:03:21.848666+0000","last_became_active":"2024-09-12T00:32:25.008419+0000","last_became_peered":"2024-09-12T00:32:25.008419+0000","last_unstale":"2024-09-12T01:03:21.848666+0000","last_undegraded":"2024-09-12T01:03:21.848666+0000","last_fullsized":"2024-09-12T01:03:21.848666+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:21.848478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:21.848478+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.848478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:37.368526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"268'30","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.266399+0000","last_change":"2024-09-12T01:03:16.266399+0000","last_active":"2024-09-12T01:03:16.266399+0000","last_peered":"2024-09-12T01:03:16.266399+0000","last_clean":"2024-09-12T01:03:16.266399+0000","last_became_active":"2024-09-12T00:30:51.540434+0000","last_became_peered":"2024-09-12T00:30:51.540434+0000","last_unstale":"2024-09-12T01:03:16.266399+0000","last_undegraded":"2024-09-12T01:03:16.266399+0000","last_fullsized":"2024-09-12T01:03:16.266399+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-12T01:03:16.266214+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-12T01:03:16.266214+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.266214+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:23.214089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":92,"num_write":60,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:08.207953+0000","last_change":"2024-09-12T00:43:48.279278+0000","last_active":"2024-09-12T01:01:08.207953+0000","last_peered":"2024-09-12T01:01:08.207953+0000","last_clean":"2024-09-12T01:01:08.207953+0000","last_became_active":"2024-09-12T00:43:48.278477+0000","last_became_peered":"2024-09-12T00:43:48.278477+0000","last_unstale":"2024-09-12T01:01:08.207953+0000","last_undegraded":"2024-09-12T01:01:08.207953+0000","last_fullsized":"2024-09-12T01:01:08.207953+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"268'11","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.009743+0000","last_change":"2024-09-12T00:32:28.075698+0000","last_active":"2024-09-12T01:01:47.009743+0000","last_peered":"2024-09-12T01:01:47.009743+0000","last_clean":"2024-09-12T01:01:47.009743+0000","last_became_active":"2024-09-12T00:32:28.066441+0000","last_became_peered":"2024-09-12T00:32:28.066441+0000","last_unstale":"2024-09-12T01:01:47.009743+0000","last_undegraded":"2024-09-12T01:01:47.009743+0000","last_fullsized":"2024-09-12T01:01:47.009743+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:29.911316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":37890,"num_write":21,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":38,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.177139+0000","last_change":"2024-09-12T00:32:25.011505+0000","last_active":"2024-09-12T00:59:37.177139+0000","last_peered":"2024-09-12T00:59:37.177139+0000","last_clean":"2024-09-12T00:59:37.177139+0000","last_became_active":"2024-09-12T00:32:25.010752+0000","last_became_peered":"2024-09-12T00:32:25.010752+0000","last_unstale":"2024-09-12T00:59:37.177139+0000","last_undegraded":"2024-09-12T00:59:37.177139+0000","last_fullsized":"2024-09-12T00:59:37.177139+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:38.026878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"268'115","reported_seq":473,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.202043+0000","last_change":"2024-09-12T01:03:17.202043+0000","last_active":"2024-09-12T01:03:17.202043+0000","last_peered":"2024-09-12T01:03:17.202043+0000","last_clean":"2024-09-12T01:03:17.202043+0000","last_became_active":"2024-09-12T00:30:51.550081+0000","last_became_peered":"2024-09-12T00:30:51.550081+0000","last_unstale":"2024-09-12T01:03:17.202043+0000","last_undegraded":"2024-09-12T01:03:17.202043+0000","last_fullsized":"2024-09-12T01:03:17.202043+0000","mapping_epoch":257,"log_start":"265'100","ondisk_log_start":"265'100","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-12T01:03:17.201850+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-12T01:03:17.201850+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.201850+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:23.902914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":826,"num_read_kb":599,"num_write":142,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4473,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.201751+0000","last_change":"2024-09-12T00:43:48.273417+0000","last_active":"2024-09-12T00:59:37.201751+0000","last_peered":"2024-09-12T00:59:37.201751+0000","last_clean":"2024-09-12T00:59:37.201751+0000","last_became_active":"2024-09-12T00:43:48.272486+0000","last_became_peered":"2024-09-12T00:43:48.272486+0000","last_unstale":"2024-09-12T00:59:37.201751+0000","last_undegraded":"2024-09-12T00:59:37.201751+0000","last_fullsized":"2024-09-12T00:59:37.201751+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:26.875710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000354+0000","last_change":"2024-09-12T00:32:28.051078+0000","last_active":"2024-09-12T01:00:39.000354+0000","last_peered":"2024-09-12T01:00:39.000354+0000","last_clean":"2024-09-12T01:00:39.000354+0000","last_became_active":"2024-09-12T00:32:28.049186+0000","last_became_peered":"2024-09-12T00:32:28.049186+0000","last_unstale":"2024-09-12T01:00:39.000354+0000","last_undegraded":"2024-09-12T01:00:39.000354+0000","last_fullsized":"2024-09-12T01:00:39.000354+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.900005+0000","last_change":"2024-09-12T01:03:18.900005+0000","last_active":"2024-09-12T01:03:18.900005+0000","last_peered":"2024-09-12T01:03:18.900005+0000","last_clean":"2024-09-12T01:03:18.900005+0000","last_became_active":"2024-09-12T00:32:24.999633+0000","last_became_peered":"2024-09-12T00:32:24.999633+0000","last_unstale":"2024-09-12T01:03:18.900005+0000","last_undegraded":"2024-09-12T01:03:18.900005+0000","last_fullsized":"2024-09-12T01:03:18.900005+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:18.899817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:18.899817+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.899817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:50.009102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"268'69","reported_seq":245,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.149747+0000","last_change":"2024-09-12T01:03:16.149747+0000","last_active":"2024-09-12T01:03:16.149747+0000","last_peered":"2024-09-12T01:03:16.149747+0000","last_clean":"2024-09-12T01:03:16.149747+0000","last_became_active":"2024-09-12T00:30:51.546873+0000","last_became_peered":"2024-09-12T00:30:51.546873+0000","last_unstale":"2024-09-12T01:03:16.149747+0000","last_undegraded":"2024-09-12T01:03:16.149747+0000","last_fullsized":"2024-09-12T01:03:16.149747+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'69","last_scrub_stamp":"2024-09-12T01:03:16.149570+0000","last_deep_scrub":"268'69","last_deep_scrub_stamp":"2024-09-12T01:03:16.149570+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.149570+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:41.334298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":256,"num_write":124,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:38.185725+0000","last_change":"2024-09-12T00:43:48.287793+0000","last_active":"2024-09-12T00:59:38.185725+0000","last_peered":"2024-09-12T00:59:38.185725+0000","last_clean":"2024-09-12T00:59:38.185725+0000","last_became_active":"2024-09-12T00:43:48.287144+0000","last_became_peered":"2024-09-12T00:43:48.287144+0000","last_unstale":"2024-09-12T00:59:38.185725+0000","last_undegraded":"2024-09-12T00:59:38.185725+0000","last_fullsized":"2024-09-12T00:59:38.185725+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:03.320468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:38.202196+0000","last_change":"2024-09-12T00:32:28.064542+0000","last_active":"2024-09-12T01:00:38.202196+0000","last_peered":"2024-09-12T01:00:38.202196+0000","last_clean":"2024-09-12T01:00:38.202196+0000","last_became_active":"2024-09-12T00:32:28.063712+0000","last_became_peered":"2024-09-12T00:32:28.063712+0000","last_unstale":"2024-09-12T01:00:38.202196+0000","last_undegraded":"2024-09-12T01:00:38.202196+0000","last_fullsized":"2024-09-12T01:00:38.202196+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"268'3","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.015070+0000","last_change":"2024-09-12T00:32:25.012329+0000","last_active":"2024-09-12T01:02:39.015070+0000","last_peered":"2024-09-12T01:02:39.015070+0000","last_clean":"2024-09-12T01:02:39.015070+0000","last_became_active":"2024-09-12T00:32:25.005902+0000","last_became_peered":"2024-09-12T00:32:25.005902+0000","last_unstale":"2024-09-12T01:02:39.015070+0000","last_undegraded":"2024-09-12T01:02:39.015070+0000","last_fullsized":"2024-09-12T01:02:39.015070+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"268'31","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.540434+0000","last_change":"2024-09-12T01:03:14.540434+0000","last_active":"2024-09-12T01:03:14.540434+0000","last_peered":"2024-09-12T01:03:14.540434+0000","last_clean":"2024-09-12T01:03:14.540434+0000","last_became_active":"2024-09-12T00:30:51.541904+0000","last_became_peered":"2024-09-12T00:30:51.541904+0000","last_unstale":"2024-09-12T01:03:14.540434+0000","last_undegraded":"2024-09-12T01:03:14.540434+0000","last_fullsized":"2024-09-12T01:03:14.540434+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-09-12T01:03:14.540261+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-09-12T01:03:14.540261+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.540261+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:50.202651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":109,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.649168+0000","last_change":"2024-09-12T01:03:19.649168+0000","last_active":"2024-09-12T01:03:19.649168+0000","last_peered":"2024-09-12T01:03:19.649168+0000","last_clean":"2024-09-12T01:03:19.649168+0000","last_became_active":"2024-09-12T00:43:48.274756+0000","last_became_peered":"2024-09-12T00:43:48.274756+0000","last_unstale":"2024-09-12T01:03:19.649168+0000","last_undegraded":"2024-09-12T01:03:19.649168+0000","last_fullsized":"2024-09-12T01:03:19.649168+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:19.648922+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:19.648922+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.648922+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:52.437120+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"268'5","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.620079+0000","last_change":"2024-09-12T00:32:28.066799+0000","last_active":"2024-09-12T01:02:38.620079+0000","last_peered":"2024-09-12T01:02:38.620079+0000","last_clean":"2024-09-12T01:02:38.620079+0000","last_became_active":"2024-09-12T00:32:28.066029+0000","last_became_peered":"2024-09-12T00:32:28.066029+0000","last_unstale":"2024-09-12T01:02:38.620079+0000","last_undegraded":"2024-09-12T01:02:38.620079+0000","last_fullsized":"2024-09-12T01:02:38.620079+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:56.429963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"268'3","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.877291+0000","last_change":"2024-09-12T01:03:20.877291+0000","last_active":"2024-09-12T01:03:20.877291+0000","last_peered":"2024-09-12T01:03:20.877291+0000","last_clean":"2024-09-12T01:03:20.877291+0000","last_became_active":"2024-09-12T00:32:25.001194+0000","last_became_peered":"2024-09-12T00:32:25.001194+0000","last_unstale":"2024-09-12T01:03:20.877291+0000","last_undegraded":"2024-09-12T01:03:20.877291+0000","last_fullsized":"2024-09-12T01:03:20.877291+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:20.877064+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:20.877064+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.877064+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:15.612436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"268'15","reported_seq":83,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:11.999971+0000","last_change":"2024-09-12T00:30:51.544531+0000","last_active":"2024-09-12T01:01:11.999971+0000","last_peered":"2024-09-12T01:01:11.999971+0000","last_clean":"2024-09-12T01:01:11.999971+0000","last_became_active":"2024-09-12T00:30:51.543711+0000","last_became_peered":"2024-09-12T00:30:51.543711+0000","last_unstale":"2024-09-12T01:01:11.999971+0000","last_undegraded":"2024-09-12T01:01:11.999971+0000","last_fullsized":"2024-09-12T01:01:11.999971+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":43,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":21,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.176965+0000","last_change":"2024-09-12T00:43:48.290387+0000","last_active":"2024-09-12T00:59:37.176965+0000","last_peered":"2024-09-12T00:59:37.176965+0000","last_clean":"2024-09-12T00:59:37.176965+0000","last_became_active":"2024-09-12T00:43:48.289475+0000","last_became_peered":"2024-09-12T00:43:48.289475+0000","last_unstale":"2024-09-12T00:59:37.176965+0000","last_undegraded":"2024-09-12T00:59:37.176965+0000","last_fullsized":"2024-09-12T00:59:37.176965+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:49.960814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.604673+0000","last_change":"2024-09-12T01:03:18.604673+0000","last_active":"2024-09-12T01:03:18.604673+0000","last_peered":"2024-09-12T01:03:18.604673+0000","last_clean":"2024-09-12T01:03:18.604673+0000","last_became_active":"2024-09-12T00:32:28.055934+0000","last_became_peered":"2024-09-12T00:32:28.055934+0000","last_unstale":"2024-09-12T01:03:18.604673+0000","last_undegraded":"2024-09-12T01:03:18.604673+0000","last_fullsized":"2024-09-12T01:03:18.604673+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:18.604375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:18.604375+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.604375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:11.137151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"268'3","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:39.015217+0000","last_change":"2024-09-12T00:32:25.005226+0000","last_active":"2024-09-12T01:01:39.015217+0000","last_peered":"2024-09-12T01:01:39.015217+0000","last_clean":"2024-09-12T01:01:39.015217+0000","last_became_active":"2024-09-12T00:32:25.004503+0000","last_became_peered":"2024-09-12T00:32:25.004503+0000","last_unstale":"2024-09-12T01:01:39.015217+0000","last_undegraded":"2024-09-12T01:01:39.015217+0000","last_fullsized":"2024-09-12T01:01:39.015217+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:32.108404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"268'12","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.595764+0000","last_change":"2024-09-12T01:03:11.595595+0000","last_active":"2024-09-12T01:03:11.595764+0000","last_peered":"2024-09-12T01:03:11.595764+0000","last_clean":"2024-09-12T01:03:11.595764+0000","last_became_active":"2024-09-12T00:30:51.542992+0000","last_became_peered":"2024-09-12T00:30:51.542992+0000","last_unstale":"2024-09-12T01:03:11.595764+0000","last_undegraded":"2024-09-12T01:03:11.595764+0000","last_fullsized":"2024-09-12T01:03:11.595764+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-09-12T01:03:11.595417+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-09-12T01:03:11.595417+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.595417+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:35.022578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:28.199729+0000","last_change":"2024-09-12T00:43:48.283532+0000","last_active":"2024-09-12T01:00:28.199729+0000","last_peered":"2024-09-12T01:00:28.199729+0000","last_clean":"2024-09-12T01:00:28.199729+0000","last_became_active":"2024-09-12T00:43:48.276293+0000","last_became_peered":"2024-09-12T00:43:48.276293+0000","last_unstale":"2024-09-12T01:00:28.199729+0000","last_undegraded":"2024-09-12T01:00:28.199729+0000","last_fullsized":"2024-09-12T01:00:28.199729+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:45.902022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"268'6","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.254038+0000","last_change":"2024-09-12T00:32:28.073623+0000","last_active":"2024-09-12T01:02:39.254038+0000","last_peered":"2024-09-12T01:02:39.254038+0000","last_clean":"2024-09-12T01:02:39.254038+0000","last_became_active":"2024-09-12T00:32:28.067824+0000","last_became_peered":"2024-09-12T00:32:28.067824+0000","last_unstale":"2024-09-12T01:02:39.254038+0000","last_undegraded":"2024-09-12T01:02:39.254038+0000","last_fullsized":"2024-09-12T01:02:39.254038+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:24.607971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"268'3","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:34.014457+0000","last_change":"2024-09-12T00:32:25.022973+0000","last_active":"2024-09-12T01:01:34.014457+0000","last_peered":"2024-09-12T01:01:34.014457+0000","last_clean":"2024-09-12T01:01:34.014457+0000","last_became_active":"2024-09-12T00:32:25.022210+0000","last_became_peered":"2024-09-12T00:32:25.022210+0000","last_unstale":"2024-09-12T01:01:34.014457+0000","last_undegraded":"2024-09-12T01:01:34.014457+0000","last_fullsized":"2024-09-12T01:01:34.014457+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:27.123041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":134,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.987030+0000","last_change":"2024-09-12T00:30:51.550674+0000","last_active":"2024-09-12T01:01:12.987030+0000","last_peered":"2024-09-12T01:01:12.987030+0000","last_clean":"2024-09-12T01:01:12.987030+0000","last_became_active":"2024-09-12T00:30:51.549942+0000","last_became_peered":"2024-09-12T00:30:51.549942+0000","last_unstale":"2024-09-12T01:01:12.987030+0000","last_undegraded":"2024-09-12T01:01:12.987030+0000","last_fullsized":"2024-09-12T01:01:12.987030+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":118,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.596066+0000","last_change":"2024-09-12T01:03:17.596066+0000","last_active":"2024-09-12T01:03:17.596066+0000","last_peered":"2024-09-12T01:03:17.596066+0000","last_clean":"2024-09-12T01:03:17.596066+0000","last_became_active":"2024-09-12T00:43:48.276176+0000","last_became_peered":"2024-09-12T00:43:48.276176+0000","last_unstale":"2024-09-12T01:03:17.596066+0000","last_undegraded":"2024-09-12T01:03:17.596066+0000","last_fullsized":"2024-09-12T01:03:17.596066+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:17.595889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:17.595889+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.595889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:47.529084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:37.201670+0000","last_change":"2024-09-12T00:32:28.052395+0000","last_active":"2024-09-12T00:59:37.201670+0000","last_peered":"2024-09-12T00:59:37.201670+0000","last_clean":"2024-09-12T00:59:37.201670+0000","last_became_active":"2024-09-12T00:32:28.051244+0000","last_became_peered":"2024-09-12T00:32:28.051244+0000","last_unstale":"2024-09-12T00:59:37.201670+0000","last_undegraded":"2024-09-12T00:59:37.201670+0000","last_fullsized":"2024-09-12T00:59:37.201670+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:09.633243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"268'2","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:47.995791+0000","last_change":"2024-09-12T00:32:25.023656+0000","last_active":"2024-09-12T01:01:47.995791+0000","last_peered":"2024-09-12T01:01:47.995791+0000","last_clean":"2024-09-12T01:01:47.995791+0000","last_became_active":"2024-09-12T00:32:25.022757+0000","last_became_peered":"2024-09-12T00:32:25.022757+0000","last_unstale":"2024-09-12T01:01:47.995791+0000","last_undegraded":"2024-09-12T01:01:47.995791+0000","last_fullsized":"2024-09-12T01:01:47.995791+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:59.877231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'12","reported_seq":79,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:14.010065+0000","last_change":"2024-09-12T00:30:51.566131+0000","last_active":"2024-09-12T01:01:14.010065+0000","last_peered":"2024-09-12T01:01:14.010065+0000","last_clean":"2024-09-12T01:01:14.010065+0000","last_became_active":"2024-09-12T00:30:51.565544+0000","last_became_peered":"2024-09-12T00:30:51.565544+0000","last_unstale":"2024-09-12T01:01:14.010065+0000","last_undegraded":"2024-09-12T01:01:14.010065+0000","last_fullsized":"2024-09-12T01:01:14.010065+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:57.206539+0000","last_change":"2024-09-12T00:43:48.280037+0000","last_active":"2024-09-12T00:59:57.206539+0000","last_peered":"2024-09-12T00:59:57.206539+0000","last_clean":"2024-09-12T00:59:57.206539+0000","last_became_active":"2024-09-12T00:43:48.279243+0000","last_became_peered":"2024-09-12T00:43:48.279243+0000","last_unstale":"2024-09-12T00:59:57.206539+0000","last_undegraded":"2024-09-12T00:59:57.206539+0000","last_fullsized":"2024-09-12T00:59:57.206539+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:31.525488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"268'3","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.577280+0000","last_change":"2024-09-12T01:03:13.577280+0000","last_active":"2024-09-12T01:03:13.577280+0000","last_peered":"2024-09-12T01:03:13.577280+0000","last_clean":"2024-09-12T01:03:13.577280+0000","last_became_active":"2024-09-12T00:32:28.058384+0000","last_became_peered":"2024-09-12T00:32:28.058384+0000","last_unstale":"2024-09-12T01:03:13.577280+0000","last_undegraded":"2024-09-12T01:03:13.577280+0000","last_fullsized":"2024-09-12T01:03:13.577280+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:13.577058+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:13.577058+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.577058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:14.485980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"265'3","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.609581+0000","last_change":"2024-09-12T01:03:21.609581+0000","last_active":"2024-09-12T01:03:21.609581+0000","last_peered":"2024-09-12T01:03:21.609581+0000","last_clean":"2024-09-12T01:03:21.609581+0000","last_became_active":"2024-09-12T00:32:24.995532+0000","last_became_peered":"2024-09-12T00:32:24.995532+0000","last_unstale":"2024-09-12T01:03:21.609581+0000","last_undegraded":"2024-09-12T01:03:21.609581+0000","last_fullsized":"2024-09-12T01:03:21.609581+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:03:21.609383+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:03:21.609383+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.609383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:39.336952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"268'40","reported_seq":165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.597091+0000","last_change":"2024-09-12T01:03:16.597091+0000","last_active":"2024-09-12T01:03:16.597091+0000","last_peered":"2024-09-12T01:03:16.597091+0000","last_clean":"2024-09-12T01:03:16.597091+0000","last_became_active":"2024-09-12T00:30:51.553501+0000","last_became_peered":"2024-09-12T00:30:51.553501+0000","last_unstale":"2024-09-12T01:03:16.597091+0000","last_undegraded":"2024-09-12T01:03:16.597091+0000","last_fullsized":"2024-09-12T01:03:16.597091+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'40","last_scrub_stamp":"2024-09-12T01:03:16.596775+0000","last_deep_scrub":"268'40","last_deep_scrub_stamp":"2024-09-12T01:03:16.596775+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.596775+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:40.998139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":68,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.234081+0000","last_change":"2024-09-12T00:43:48.281674+0000","last_active":"2024-09-12T01:00:29.234081+0000","last_peered":"2024-09-12T01:00:29.234081+0000","last_clean":"2024-09-12T01:00:29.234081+0000","last_became_active":"2024-09-12T00:43:48.280566+0000","last_became_peered":"2024-09-12T00:43:48.280566+0000","last_unstale":"2024-09-12T01:00:29.234081+0000","last_undegraded":"2024-09-12T01:00:29.234081+0000","last_fullsized":"2024-09-12T01:00:29.234081+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:02.297251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"268'4","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.693850+0000","last_change":"2024-09-12T00:32:28.061791+0000","last_active":"2024-09-12T01:02:38.693850+0000","last_peered":"2024-09-12T01:02:38.693850+0000","last_clean":"2024-09-12T01:02:38.693850+0000","last_became_active":"2024-09-12T00:32:28.061089+0000","last_became_peered":"2024-09-12T00:32:28.061089+0000","last_unstale":"2024-09-12T01:02:38.693850+0000","last_undegraded":"2024-09-12T01:02:38.693850+0000","last_fullsized":"2024-09-12T01:02:38.693850+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":326,"num_write":4,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"265'11","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:33.999304+0000","last_change":"2024-09-12T00:32:25.004508+0000","last_active":"2024-09-12T01:00:33.999304+0000","last_peered":"2024-09-12T01:00:33.999304+0000","last_clean":"2024-09-12T01:00:33.999304+0000","last_became_active":"2024-09-12T00:32:25.004199+0000","last_became_peered":"2024-09-12T00:32:25.004199+0000","last_unstale":"2024-09-12T01:00:33.999304+0000","last_undegraded":"2024-09-12T01:00:33.999304+0000","last_fullsized":"2024-09-12T01:00:33.999304+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:38.507054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11280,"num_write":21,"num_write_kb":11280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"268'12","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.898022+0000","last_change":"2024-09-12T01:03:13.898022+0000","last_active":"2024-09-12T01:03:13.898022+0000","last_peered":"2024-09-12T01:03:13.898022+0000","last_clean":"2024-09-12T01:03:13.898022+0000","last_became_active":"2024-09-12T00:30:51.548619+0000","last_became_peered":"2024-09-12T00:30:51.548619+0000","last_unstale":"2024-09-12T01:03:13.898022+0000","last_undegraded":"2024-09-12T01:03:13.898022+0000","last_fullsized":"2024-09-12T01:03:13.898022+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-09-12T01:03:13.897805+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-09-12T01:03:13.897805+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.897805+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:37.589859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"267'1","reported_seq":23,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:12.200182+0000","last_change":"2024-09-12T00:43:48.284636+0000","last_active":"2024-09-12T01:01:12.200182+0000","last_peered":"2024-09-12T01:01:12.200182+0000","last_clean":"2024-09-12T01:01:12.200182+0000","last_became_active":"2024-09-12T00:43:48.283630+0000","last_became_peered":"2024-09-12T00:43:48.283630+0000","last_unstale":"2024-09-12T01:01:12.200182+0000","last_undegraded":"2024-09-12T01:01:12.200182+0000","last_fullsized":"2024-09-12T01:01:12.200182+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'5","reported_seq":44,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.179689+0000","last_change":"2024-09-12T00:32:28.054779+0000","last_active":"2024-09-12T00:59:33.179689+0000","last_peered":"2024-09-12T00:59:33.179689+0000","last_clean":"2024-09-12T00:59:33.179689+0000","last_became_active":"2024-09-12T00:32:28.054045+0000","last_became_peered":"2024-09-12T00:32:28.054045+0000","last_unstale":"2024-09-12T00:59:33.179689+0000","last_undegraded":"2024-09-12T00:59:33.179689+0000","last_fullsized":"2024-09-12T00:59:33.179689+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:05.598087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'3","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.647777+0000","last_change":"2024-09-12T01:03:19.647777+0000","last_active":"2024-09-12T01:03:19.647777+0000","last_peered":"2024-09-12T01:03:19.647777+0000","last_clean":"2024-09-12T01:03:19.647777+0000","last_became_active":"2024-09-12T00:32:24.997768+0000","last_became_peered":"2024-09-12T00:32:24.997768+0000","last_unstale":"2024-09-12T01:03:19.647777+0000","last_undegraded":"2024-09-12T01:03:19.647777+0000","last_fullsized":"2024-09-12T01:03:19.647777+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:03:19.647452+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:03:19.647452+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.647452+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.457762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"268'27","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.573504+0000","last_change":"2024-09-12T01:03:15.573504+0000","last_active":"2024-09-12T01:03:15.573504+0000","last_peered":"2024-09-12T01:03:15.573504+0000","last_clean":"2024-09-12T01:03:15.573504+0000","last_became_active":"2024-09-12T00:30:51.556456+0000","last_became_peered":"2024-09-12T00:30:51.556456+0000","last_unstale":"2024-09-12T01:03:15.573504+0000","last_undegraded":"2024-09-12T01:03:15.573504+0000","last_fullsized":"2024-09-12T01:03:15.573504+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-09-12T01:03:15.573326+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-09-12T01:03:15.573326+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.573326+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:55.863953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":57,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:07.985851+0000","last_change":"2024-09-12T00:43:48.266541+0000","last_active":"2024-09-12T01:01:07.985851+0000","last_peered":"2024-09-12T01:01:07.985851+0000","last_clean":"2024-09-12T01:01:07.985851+0000","last_became_active":"2024-09-12T00:43:48.265726+0000","last_became_peered":"2024-09-12T00:43:48.265726+0000","last_unstale":"2024-09-12T01:01:07.985851+0000","last_undegraded":"2024-09-12T01:01:07.985851+0000","last_fullsized":"2024-09-12T01:01:07.985851+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000271+0000","last_change":"2024-09-12T00:32:28.051868+0000","last_active":"2024-09-12T01:00:39.000271+0000","last_peered":"2024-09-12T01:00:39.000271+0000","last_clean":"2024-09-12T01:00:39.000271+0000","last_became_active":"2024-09-12T00:32:28.051145+0000","last_became_peered":"2024-09-12T00:32:28.051145+0000","last_unstale":"2024-09-12T01:00:39.000271+0000","last_undegraded":"2024-09-12T01:00:39.000271+0000","last_fullsized":"2024-09-12T01:00:39.000271+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:26.514177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:29.219199+0000","last_change":"2024-09-12T00:32:25.007529+0000","last_active":"2024-09-12T00:59:29.219199+0000","last_peered":"2024-09-12T00:59:29.219199+0000","last_clean":"2024-09-12T00:59:29.219199+0000","last_became_active":"2024-09-12T00:32:25.003679+0000","last_became_peered":"2024-09-12T00:32:25.003679+0000","last_unstale":"2024-09-12T00:59:29.219199+0000","last_undegraded":"2024-09-12T00:59:29.219199+0000","last_fullsized":"2024-09-12T00:59:29.219199+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:31.977653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"268'23","reported_seq":107,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:04.228064+0000","last_change":"2024-09-12T00:30:51.552593+0000","last_active":"2024-09-12T01:00:04.228064+0000","last_peered":"2024-09-12T01:00:04.228064+0000","last_clean":"2024-09-12T01:00:04.228064+0000","last_became_active":"2024-09-12T00:30:51.551554+0000","last_became_peered":"2024-09-12T00:30:51.551554+0000","last_unstale":"2024-09-12T01:00:04.228064+0000","last_undegraded":"2024-09-12T01:00:04.228064+0000","last_fullsized":"2024-09-12T01:00:04.228064+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:19.144268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:31.989931+0000","last_change":"2024-09-12T00:43:48.287349+0000","last_active":"2024-09-12T01:00:31.989931+0000","last_peered":"2024-09-12T01:00:31.989931+0000","last_clean":"2024-09-12T01:00:31.989931+0000","last_became_active":"2024-09-12T00:43:48.286593+0000","last_became_peered":"2024-09-12T00:43:48.286593+0000","last_unstale":"2024-09-12T01:00:31.989931+0000","last_undegraded":"2024-09-12T01:00:31.989931+0000","last_fullsized":"2024-09-12T01:00:31.989931+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:41.625703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"268'6","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.655342+0000","last_change":"2024-09-12T01:03:20.655342+0000","last_active":"2024-09-12T01:03:20.655342+0000","last_peered":"2024-09-12T01:03:20.655342+0000","last_clean":"2024-09-12T01:03:20.655342+0000","last_became_active":"2024-09-12T00:32:28.069812+0000","last_became_peered":"2024-09-12T00:32:28.069812+0000","last_unstale":"2024-09-12T01:03:20.655342+0000","last_undegraded":"2024-09-12T01:03:20.655342+0000","last_fullsized":"2024-09-12T01:03:20.655342+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:03:20.655131+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:03:20.655131+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.655131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:06.834953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"268'8","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.243432+0000","last_change":"2024-09-12T01:03:22.243432+0000","last_active":"2024-09-12T01:03:22.243432+0000","last_peered":"2024-09-12T01:03:22.243432+0000","last_clean":"2024-09-12T01:03:22.243432+0000","last_became_active":"2024-09-12T00:32:25.017138+0000","last_became_peered":"2024-09-12T00:32:25.017138+0000","last_unstale":"2024-09-12T01:03:22.243432+0000","last_undegraded":"2024-09-12T01:03:22.243432+0000","last_fullsized":"2024-09-12T01:03:22.243432+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:03:22.243247+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:03:22.243247+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.243247+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:15.153887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"268'53","reported_seq":190,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:04.227963+0000","last_change":"2024-09-12T00:30:51.553247+0000","last_active":"2024-09-12T01:00:04.227963+0000","last_peered":"2024-09-12T01:00:04.227963+0000","last_clean":"2024-09-12T01:00:04.227963+0000","last_became_active":"2024-09-12T00:30:51.546238+0000","last_became_peered":"2024-09-12T00:30:51.546238+0000","last_unstale":"2024-09-12T01:00:04.227963+0000","last_undegraded":"2024-09-12T01:00:04.227963+0000","last_fullsized":"2024-09-12T01:00:04.227963+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:30:50.507419+0000","last_clean_scrub_stamp":"2024-09-12T00:30:50.507419+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:52.536369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":191,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000484+0000","last_change":"2024-09-12T00:43:48.277891+0000","last_active":"2024-09-12T01:00:39.000484+0000","last_peered":"2024-09-12T01:00:39.000484+0000","last_clean":"2024-09-12T01:00:39.000484+0000","last_became_active":"2024-09-12T00:43:48.277275+0000","last_became_peered":"2024-09-12T00:43:48.277275+0000","last_unstale":"2024-09-12T01:00:39.000484+0000","last_undegraded":"2024-09-12T01:00:39.000484+0000","last_fullsized":"2024-09-12T01:00:39.000484+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:00.758192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:33.184304+0000","last_change":"2024-09-12T00:32:28.066072+0000","last_active":"2024-09-12T00:59:33.184304+0000","last_peered":"2024-09-12T00:59:33.184304+0000","last_clean":"2024-09-12T00:59:33.184304+0000","last_became_active":"2024-09-12T00:32:28.065320+0000","last_became_peered":"2024-09-12T00:32:28.065320+0000","last_unstale":"2024-09-12T00:59:33.184304+0000","last_undegraded":"2024-09-12T00:59:33.184304+0000","last_fullsized":"2024-09-12T00:59:33.184304+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:36.535395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'3","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.305196+0000","last_change":"2024-09-12T01:03:15.305196+0000","last_active":"2024-09-12T01:03:15.305196+0000","last_peered":"2024-09-12T01:03:15.305196+0000","last_clean":"2024-09-12T01:03:15.305196+0000","last_became_active":"2024-09-12T00:32:25.013266+0000","last_became_peered":"2024-09-12T00:32:25.013266+0000","last_unstale":"2024-09-12T01:03:15.305196+0000","last_undegraded":"2024-09-12T01:03:15.305196+0000","last_fullsized":"2024-09-12T01:03:15.305196+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:03:15.304984+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:03:15.304984+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.304984+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:55.982092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"268'15","reported_seq":95,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.583636+0000","last_change":"2024-09-12T01:03:11.583636+0000","last_active":"2024-09-12T01:03:11.583636+0000","last_peered":"2024-09-12T01:03:11.583636+0000","last_clean":"2024-09-12T01:03:11.583636+0000","last_became_active":"2024-09-12T00:30:51.559445+0000","last_became_peered":"2024-09-12T00:30:51.559445+0000","last_unstale":"2024-09-12T01:03:11.583636+0000","last_undegraded":"2024-09-12T01:03:11.583636+0000","last_fullsized":"2024-09-12T01:03:11.583636+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'15","last_scrub_stamp":"2024-09-12T01:03:11.583415+0000","last_deep_scrub":"268'15","last_deep_scrub_stamp":"2024-09-12T01:03:11.583415+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.583415+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:28.744442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"268'370","reported_seq":1135,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.588695+0000","last_change":"2024-09-12T01:02:49.588695+0000","last_active":"2024-09-12T01:02:49.588695+0000","last_peered":"2024-09-12T01:02:49.588695+0000","last_clean":"2024-09-12T01:02:49.588695+0000","last_became_active":"2024-09-12T00:15:55.078687+0000","last_became_peered":"2024-09-12T00:15:55.078687+0000","last_unstale":"2024-09-12T01:02:49.588695+0000","last_undegraded":"2024-09-12T01:02:49.588695+0000","last_fullsized":"2024-09-12T01:02:49.588695+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-12T01:02:49.588395+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-12T01:02:49.588395+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.588395+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:32.972868+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":769,"num_read_kb":39834,"num_write":1260,"num_write_kb":26442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"268'859","reported_seq":2615,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.181836+0000","last_change":"2024-09-12T01:03:00.181836+0000","last_active":"2024-09-12T01:03:00.181836+0000","last_peered":"2024-09-12T01:03:00.181836+0000","last_clean":"2024-09-12T01:03:00.181836+0000","last_became_active":"2024-09-12T00:15:57.021927+0000","last_became_peered":"2024-09-12T00:15:57.021927+0000","last_unstale":"2024-09-12T01:03:00.181836+0000","last_undegraded":"2024-09-12T01:03:00.181836+0000","last_fullsized":"2024-09-12T01:03:00.181836+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'859","last_scrub_stamp":"2024-09-12T01:03:00.181615+0000","last_deep_scrub":"268'859","last_deep_scrub_stamp":"2024-09-12T01:03:00.181615+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.181615+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:29.997742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4184,"num_read_kb":3812,"num_write":1107,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"268'392","reported_seq":1054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.459607+0000","last_change":"2024-09-12T01:02:59.459607+0000","last_active":"2024-09-12T01:02:59.459607+0000","last_peered":"2024-09-12T01:02:59.459607+0000","last_clean":"2024-09-12T01:02:59.459607+0000","last_became_active":"2024-09-12T00:15:55.075108+0000","last_became_peered":"2024-09-12T00:15:55.075108+0000","last_unstale":"2024-09-12T01:02:59.459607+0000","last_undegraded":"2024-09-12T01:02:59.459607+0000","last_fullsized":"2024-09-12T01:02:59.459607+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'392","last_scrub_stamp":"2024-09-12T01:02:59.459315+0000","last_deep_scrub":"268'392","last_deep_scrub_stamp":"2024-09-12T01:02:59.459315+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.459315+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:19.278176+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":2165,"num_write":1224,"num_write_kb":32030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"268'545","reported_seq":2184,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.645603+0000","last_change":"2024-09-12T01:03:10.645603+0000","last_active":"2024-09-12T01:03:10.645603+0000","last_peered":"2024-09-12T01:03:10.645603+0000","last_clean":"2024-09-12T01:03:10.645603+0000","last_became_active":"2024-09-12T00:15:57.022465+0000","last_became_peered":"2024-09-12T00:15:57.022465+0000","last_unstale":"2024-09-12T01:03:10.645603+0000","last_undegraded":"2024-09-12T01:03:10.645603+0000","last_fullsized":"2024-09-12T01:03:10.645603+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'545","last_scrub_stamp":"2024-09-12T01:03:10.645403+0000","last_deep_scrub":"268'545","last_deep_scrub_stamp":"2024-09-12T01:03:10.645403+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.645403+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:07.926006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2758,"num_read_kb":2563,"num_write":657,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"268'389","reported_seq":1132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.428112+0000","last_change":"2024-09-12T01:02:58.428112+0000","last_active":"2024-09-12T01:02:58.428112+0000","last_peered":"2024-09-12T01:02:58.428112+0000","last_clean":"2024-09-12T01:02:58.428112+0000","last_became_active":"2024-09-12T00:15:55.041491+0000","last_became_peered":"2024-09-12T00:15:55.041491+0000","last_unstale":"2024-09-12T01:02:58.428112+0000","last_undegraded":"2024-09-12T01:02:58.428112+0000","last_fullsized":"2024-09-12T01:02:58.428112+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'389","last_scrub_stamp":"2024-09-12T01:02:58.427815+0000","last_deep_scrub":"268'389","last_deep_scrub_stamp":"2024-09-12T01:02:58.427815+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.427815+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:29.847605+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3574871,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":831,"num_read_kb":4160,"num_write":1268,"num_write_kb":14348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"268'1149","reported_seq":2791,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.612525+0000","last_change":"2024-09-12T01:03:09.612525+0000","last_active":"2024-09-12T01:03:09.612525+0000","last_peered":"2024-09-12T01:03:09.612525+0000","last_clean":"2024-09-12T01:03:09.612525+0000","last_became_active":"2024-09-12T00:15:57.022692+0000","last_became_peered":"2024-09-12T00:15:57.022692+0000","last_unstale":"2024-09-12T01:03:09.612525+0000","last_undegraded":"2024-09-12T01:03:09.612525+0000","last_fullsized":"2024-09-12T01:03:09.612525+0000","mapping_epoch":28,"log_start":"268'1100","ondisk_log_start":"268'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1149","last_scrub_stamp":"2024-09-12T01:03:09.612336+0000","last_deep_scrub":"268'1149","last_deep_scrub_stamp":"2024-09-12T01:03:09.612336+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.612336+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":1100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:08.545733+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5291,"num_read_kb":4702,"num_write":1570,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"268'387","reported_seq":1078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.667329+0000","last_change":"2024-09-12T01:02:52.667329+0000","last_active":"2024-09-12T01:02:52.667329+0000","last_peered":"2024-09-12T01:02:52.667329+0000","last_clean":"2024-09-12T01:02:52.667329+0000","last_became_active":"2024-09-12T00:15:55.045668+0000","last_became_peered":"2024-09-12T00:15:55.045668+0000","last_unstale":"2024-09-12T01:02:52.667329+0000","last_undegraded":"2024-09-12T01:02:52.667329+0000","last_fullsized":"2024-09-12T01:02:52.667329+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'387","last_scrub_stamp":"2024-09-12T01:02:52.667069+0000","last_deep_scrub":"268'387","last_deep_scrub_stamp":"2024-09-12T01:02:52.667069+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.667069+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:37.302820+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":365201,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":662,"num_read_kb":47789,"num_write":1293,"num_write_kb":53743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"268'571","reported_seq":2213,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.155202+0000","last_change":"2024-09-12T01:03:01.155202+0000","last_active":"2024-09-12T01:03:01.155202+0000","last_peered":"2024-09-12T01:03:01.155202+0000","last_clean":"2024-09-12T01:03:01.155202+0000","last_became_active":"2024-09-12T00:15:57.018762+0000","last_became_peered":"2024-09-12T00:15:57.018762+0000","last_unstale":"2024-09-12T01:03:01.155202+0000","last_undegraded":"2024-09-12T01:03:01.155202+0000","last_fullsized":"2024-09-12T01:03:01.155202+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'571","last_scrub_stamp":"2024-09-12T01:03:01.155003+0000","last_deep_scrub":"268'571","last_deep_scrub_stamp":"2024-09-12T01:03:01.155003+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.155003+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:41.916701+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2864,"num_read_kb":2646,"num_write":693,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":992,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"268'365","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.617387+0000","last_change":"2024-09-12T01:02:50.617387+0000","last_active":"2024-09-12T01:02:50.617387+0000","last_peered":"2024-09-12T01:02:50.617387+0000","last_clean":"2024-09-12T01:02:50.617387+0000","last_became_active":"2024-09-12T00:15:55.071352+0000","last_became_peered":"2024-09-12T00:15:55.071352+0000","last_unstale":"2024-09-12T01:02:50.617387+0000","last_undegraded":"2024-09-12T01:02:50.617387+0000","last_fullsized":"2024-09-12T01:02:50.617387+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-12T01:02:50.617131+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-12T01:02:50.617131+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.617131+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:26.922140+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8845231,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":491,"num_read_kb":19398,"num_write":1138,"num_write_kb":53254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"268'458","reported_seq":2084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.526329+0000","last_change":"2024-09-12T01:03:01.526329+0000","last_active":"2024-09-12T01:03:01.526329+0000","last_peered":"2024-09-12T01:03:01.526329+0000","last_clean":"2024-09-12T01:03:01.526329+0000","last_became_active":"2024-09-12T00:15:57.051973+0000","last_became_peered":"2024-09-12T00:15:57.051973+0000","last_unstale":"2024-09-12T01:03:01.526329+0000","last_undegraded":"2024-09-12T01:03:01.526329+0000","last_fullsized":"2024-09-12T01:03:01.526329+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'458","last_scrub_stamp":"2024-09-12T01:03:01.526143+0000","last_deep_scrub":"268'458","last_deep_scrub_stamp":"2024-09-12T01:03:01.526143+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.526143+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:18.260122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":2348,"num_write":528,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"268'352","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.653874+0000","last_change":"2024-09-12T01:02:50.653874+0000","last_active":"2024-09-12T01:02:50.653874+0000","last_peered":"2024-09-12T01:02:50.653874+0000","last_clean":"2024-09-12T01:02:50.653874+0000","last_became_active":"2024-09-12T00:15:55.067030+0000","last_became_peered":"2024-09-12T00:15:55.067030+0000","last_unstale":"2024-09-12T01:02:50.653874+0000","last_undegraded":"2024-09-12T01:02:50.653874+0000","last_fullsized":"2024-09-12T01:02:50.653874+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'352","last_scrub_stamp":"2024-09-12T01:02:50.653516+0000","last_deep_scrub":"268'352","last_deep_scrub_stamp":"2024-09-12T01:02:50.653516+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.653516+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:30.298045+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":499,"num_read_kb":33085,"num_write":1019,"num_write_kb":28183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"268'487","reported_seq":2082,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.535040+0000","last_change":"2024-09-12T01:02:55.535040+0000","last_active":"2024-09-12T01:02:55.535040+0000","last_peered":"2024-09-12T01:02:55.535040+0000","last_clean":"2024-09-12T01:02:55.535040+0000","last_became_active":"2024-09-12T00:15:57.037045+0000","last_became_peered":"2024-09-12T00:15:57.037045+0000","last_unstale":"2024-09-12T01:02:55.535040+0000","last_undegraded":"2024-09-12T01:02:55.535040+0000","last_fullsized":"2024-09-12T01:02:55.535040+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'487","last_scrub_stamp":"2024-09-12T01:02:55.534815+0000","last_deep_scrub":"268'487","last_deep_scrub_stamp":"2024-09-12T01:02:55.534815+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.534815+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:08.564034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2556,"num_read_kb":2389,"num_write":592,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"268'364","reported_seq":1103,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.551146+0000","last_change":"2024-09-12T01:02:48.551146+0000","last_active":"2024-09-12T01:02:48.551146+0000","last_peered":"2024-09-12T01:02:48.551146+0000","last_clean":"2024-09-12T01:02:48.551146+0000","last_became_active":"2024-09-12T00:15:55.041976+0000","last_became_peered":"2024-09-12T00:15:55.041976+0000","last_unstale":"2024-09-12T01:02:48.551146+0000","last_undegraded":"2024-09-12T01:02:48.551146+0000","last_fullsized":"2024-09-12T01:02:48.551146+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-12T01:02:48.550777+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-12T01:02:48.550777+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.550777+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:08.855631+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055004,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":661,"num_read_kb":92017,"num_write":1205,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"268'483","reported_seq":1944,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.623516+0000","last_change":"2024-09-12T01:02:58.623516+0000","last_active":"2024-09-12T01:02:58.623516+0000","last_peered":"2024-09-12T01:02:58.623516+0000","last_clean":"2024-09-12T01:02:58.623516+0000","last_became_active":"2024-09-12T00:15:57.013278+0000","last_became_peered":"2024-09-12T00:15:57.013278+0000","last_unstale":"2024-09-12T01:02:58.623516+0000","last_undegraded":"2024-09-12T01:02:58.623516+0000","last_fullsized":"2024-09-12T01:02:58.623516+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'483","last_scrub_stamp":"2024-09-12T01:02:58.623336+0000","last_deep_scrub":"268'483","last_deep_scrub_stamp":"2024-09-12T01:02:58.623336+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.623336+0000","objects_scrubbed":7,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:39.099184+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2343,"num_read_kb":2167,"num_write":566,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1262,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"268'313","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.417143+0000","last_change":"2024-09-12T01:02:57.417143+0000","last_active":"2024-09-12T01:02:57.417143+0000","last_peered":"2024-09-12T01:02:57.417143+0000","last_clean":"2024-09-12T01:02:57.417143+0000","last_became_active":"2024-09-12T00:15:55.060127+0000","last_became_peered":"2024-09-12T00:15:55.060127+0000","last_unstale":"2024-09-12T01:02:57.417143+0000","last_undegraded":"2024-09-12T01:02:57.417143+0000","last_fullsized":"2024-09-12T01:02:57.417143+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-12T01:02:57.416899+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-12T01:02:57.416899+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.416899+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:10.862046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":41438,"num_write":900,"num_write_kb":44478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"268'984","reported_seq":2523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.475348+0000","last_change":"2024-09-12T01:03:08.475348+0000","last_active":"2024-09-12T01:03:08.475348+0000","last_peered":"2024-09-12T01:03:08.475348+0000","last_clean":"2024-09-12T01:03:08.475348+0000","last_became_active":"2024-09-12T00:15:57.051665+0000","last_became_peered":"2024-09-12T00:15:57.051665+0000","last_unstale":"2024-09-12T01:03:08.475348+0000","last_undegraded":"2024-09-12T01:03:08.475348+0000","last_fullsized":"2024-09-12T01:03:08.475348+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'984","last_scrub_stamp":"2024-09-12T01:03:08.475166+0000","last_deep_scrub":"268'984","last_deep_scrub_stamp":"2024-09-12T01:03:08.475166+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.475166+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":900,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:39.424371+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4673,"num_read_kb":4124,"num_write":1393,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"268'891","reported_seq":2511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.574863+0000","last_change":"2024-09-12T01:03:08.574863+0000","last_active":"2024-09-12T01:03:08.574863+0000","last_peered":"2024-09-12T01:03:08.574863+0000","last_clean":"2024-09-12T01:03:08.574863+0000","last_became_active":"2024-09-12T00:15:57.031897+0000","last_became_peered":"2024-09-12T00:15:57.031897+0000","last_unstale":"2024-09-12T01:03:08.574863+0000","last_undegraded":"2024-09-12T01:03:08.574863+0000","last_fullsized":"2024-09-12T01:03:08.574863+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'891","last_scrub_stamp":"2024-09-12T01:03:08.574669+0000","last_deep_scrub":"268'891","last_deep_scrub_stamp":"2024-09-12T01:03:08.574669+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.574669+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:36.612992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4303,"num_read_kb":3853,"num_write":1201,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2803,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"268'315","reported_seq":943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.254737+0000","last_change":"2024-09-12T01:02:51.254737+0000","last_active":"2024-09-12T01:02:51.254737+0000","last_peered":"2024-09-12T01:02:51.254737+0000","last_clean":"2024-09-12T01:02:51.254737+0000","last_became_active":"2024-09-12T00:15:55.063797+0000","last_became_peered":"2024-09-12T00:15:55.063797+0000","last_unstale":"2024-09-12T01:02:51.254737+0000","last_undegraded":"2024-09-12T01:02:51.254737+0000","last_fullsized":"2024-09-12T01:02:51.254737+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'315","last_scrub_stamp":"2024-09-12T01:02:51.254463+0000","last_deep_scrub":"268'315","last_deep_scrub_stamp":"2024-09-12T01:02:51.254463+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.254463+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:01.868558+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":7341,"num_write":997,"num_write_kb":14342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"268'783","reported_seq":2221,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.530995+0000","last_change":"2024-09-12T01:02:58.530995+0000","last_active":"2024-09-12T01:02:58.530995+0000","last_peered":"2024-09-12T01:02:58.530995+0000","last_clean":"2024-09-12T01:02:58.530995+0000","last_became_active":"2024-09-12T00:15:57.017679+0000","last_became_peered":"2024-09-12T00:15:57.017679+0000","last_unstale":"2024-09-12T01:02:58.530995+0000","last_undegraded":"2024-09-12T01:02:58.530995+0000","last_fullsized":"2024-09-12T01:02:58.530995+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'783","last_scrub_stamp":"2024-09-12T01:02:58.530808+0000","last_deep_scrub":"268'783","last_deep_scrub_stamp":"2024-09-12T01:02:58.530808+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.530808+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:45.670510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3571,"num_read_kb":3210,"num_write":1015,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"268'379","reported_seq":1070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.374153+0000","last_change":"2024-09-12T01:02:56.374153+0000","last_active":"2024-09-12T01:02:56.374153+0000","last_peered":"2024-09-12T01:02:56.374153+0000","last_clean":"2024-09-12T01:02:56.374153+0000","last_became_active":"2024-09-12T00:16:26.794438+0000","last_became_peered":"2024-09-12T00:16:26.794438+0000","last_unstale":"2024-09-12T01:02:56.374153+0000","last_undegraded":"2024-09-12T01:02:56.374153+0000","last_fullsized":"2024-09-12T01:02:56.374153+0000","mapping_epoch":39,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'379","last_scrub_stamp":"2024-09-12T01:02:56.373913+0000","last_deep_scrub":"268'379","last_deep_scrub_stamp":"2024-09-12T01:02:56.373913+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.373913+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:38.623851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":637,"num_read_kb":170107,"num_write":1135,"num_write_kb":45359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,6],"acting":[5,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"268'415","reported_seq":1894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.158518+0000","last_change":"2024-09-12T01:02:55.158518+0000","last_active":"2024-09-12T01:02:55.158518+0000","last_peered":"2024-09-12T01:02:55.158518+0000","last_clean":"2024-09-12T01:02:55.158518+0000","last_became_active":"2024-09-12T00:15:57.039474+0000","last_became_peered":"2024-09-12T00:15:57.039474+0000","last_unstale":"2024-09-12T01:02:55.158518+0000","last_undegraded":"2024-09-12T01:02:55.158518+0000","last_fullsized":"2024-09-12T01:02:55.158518+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'415","last_scrub_stamp":"2024-09-12T01:02:55.158293+0000","last_deep_scrub":"268'415","last_deep_scrub_stamp":"2024-09-12T01:02:55.158293+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.158293+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:03.237879+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2320,"num_read_kb":2162,"num_write":506,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":873,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"268'339","reported_seq":1089,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.574049+0000","last_change":"2024-09-12T01:02:47.574049+0000","last_active":"2024-09-12T01:02:47.574049+0000","last_peered":"2024-09-12T01:02:47.574049+0000","last_clean":"2024-09-12T01:02:47.574049+0000","last_became_active":"2024-09-12T00:15:55.060170+0000","last_became_peered":"2024-09-12T00:15:55.060170+0000","last_unstale":"2024-09-12T01:02:47.574049+0000","last_undegraded":"2024-09-12T01:02:47.574049+0000","last_fullsized":"2024-09-12T01:02:47.574049+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:02:47.573937+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:02:47.573937+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.573937+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:55.671405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263219,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":623,"num_read_kb":11665,"num_write":1071,"num_write_kb":19684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"268'458","reported_seq":2062,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.080840+0000","last_change":"2024-09-12T01:03:00.080840+0000","last_active":"2024-09-12T01:03:00.080840+0000","last_peered":"2024-09-12T01:03:00.080840+0000","last_clean":"2024-09-12T01:03:00.080840+0000","last_became_active":"2024-09-12T00:15:57.044075+0000","last_became_peered":"2024-09-12T00:15:57.044075+0000","last_unstale":"2024-09-12T01:03:00.080840+0000","last_undegraded":"2024-09-12T01:03:00.080840+0000","last_fullsized":"2024-09-12T01:03:00.080840+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'458","last_scrub_stamp":"2024-09-12T01:03:00.080648+0000","last_deep_scrub":"268'458","last_deep_scrub_stamp":"2024-09-12T01:03:00.080648+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.080648+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:43.039820+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2345,"num_read_kb":2229,"num_write":503,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"268'357","reported_seq":1071,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.506774+0000","last_change":"2024-09-12T01:03:00.506774+0000","last_active":"2024-09-12T01:03:00.506774+0000","last_peered":"2024-09-12T01:03:00.506774+0000","last_clean":"2024-09-12T01:03:00.506774+0000","last_became_active":"2024-09-12T00:15:55.078352+0000","last_became_peered":"2024-09-12T00:15:55.078352+0000","last_unstale":"2024-09-12T01:03:00.506774+0000","last_undegraded":"2024-09-12T01:03:00.506774+0000","last_fullsized":"2024-09-12T01:03:00.506774+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'357","last_scrub_stamp":"2024-09-12T01:03:00.506512+0000","last_deep_scrub":"268'357","last_deep_scrub_stamp":"2024-09-12T01:03:00.506512+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.506512+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:30.459461+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3306265,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":657,"num_read_kb":46871,"num_write":1194,"num_write_kb":28820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"268'401","reported_seq":1882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.517578+0000","last_change":"2024-09-12T01:03:07.517578+0000","last_active":"2024-09-12T01:03:07.517578+0000","last_peered":"2024-09-12T01:03:07.517578+0000","last_clean":"2024-09-12T01:03:07.517578+0000","last_became_active":"2024-09-12T00:15:57.032173+0000","last_became_peered":"2024-09-12T00:15:57.032173+0000","last_unstale":"2024-09-12T01:03:07.517578+0000","last_undegraded":"2024-09-12T01:03:07.517578+0000","last_fullsized":"2024-09-12T01:03:07.517578+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'401","last_scrub_stamp":"2024-09-12T01:03:07.517337+0000","last_deep_scrub":"268'401","last_deep_scrub_stamp":"2024-09-12T01:03:07.517337+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.517337+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:47.949709+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2107,"num_read_kb":2010,"num_write":461,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"268'356","reported_seq":1087,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.981634+0000","last_change":"2024-09-12T01:02:52.981634+0000","last_active":"2024-09-12T01:02:52.981634+0000","last_peered":"2024-09-12T01:02:52.981634+0000","last_clean":"2024-09-12T01:02:52.981634+0000","last_became_active":"2024-09-12T00:15:55.066304+0000","last_became_peered":"2024-09-12T00:15:55.066304+0000","last_unstale":"2024-09-12T01:02:52.981634+0000","last_undegraded":"2024-09-12T01:02:52.981634+0000","last_fullsized":"2024-09-12T01:02:52.981634+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'356","last_scrub_stamp":"2024-09-12T01:02:52.981360+0000","last_deep_scrub":"268'356","last_deep_scrub_stamp":"2024-09-12T01:02:52.981360+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.981360+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:19.250065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":677,"num_read_kb":58383,"num_write":1149,"num_write_kb":49764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"268'1199","reported_seq":3228,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.154851+0000","last_change":"2024-09-12T01:02:57.154851+0000","last_active":"2024-09-12T01:02:57.154851+0000","last_peered":"2024-09-12T01:02:57.154851+0000","last_clean":"2024-09-12T01:02:57.154851+0000","last_became_active":"2024-09-12T00:15:57.021605+0000","last_became_peered":"2024-09-12T00:15:57.021605+0000","last_unstale":"2024-09-12T01:02:57.154851+0000","last_undegraded":"2024-09-12T01:02:57.154851+0000","last_fullsized":"2024-09-12T01:02:57.154851+0000","mapping_epoch":28,"log_start":"268'1100","ondisk_log_start":"268'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1199","last_scrub_stamp":"2024-09-12T01:02:57.154667+0000","last_deep_scrub":"268'1199","last_deep_scrub_stamp":"2024-09-12T01:02:57.154667+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.154667+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":1100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:25.819536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6433,"num_read_kb":5744,"num_write":1768,"num_write_kb":831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"268'298","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.033242+0000","last_change":"2024-09-12T01:02:52.033242+0000","last_active":"2024-09-12T01:02:52.033242+0000","last_peered":"2024-09-12T01:02:52.033242+0000","last_clean":"2024-09-12T01:02:52.033242+0000","last_became_active":"2024-09-12T00:15:55.050860+0000","last_became_peered":"2024-09-12T00:15:55.050860+0000","last_unstale":"2024-09-12T01:02:52.033242+0000","last_undegraded":"2024-09-12T01:02:52.033242+0000","last_fullsized":"2024-09-12T01:02:52.033242+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'298","last_scrub_stamp":"2024-09-12T01:02:52.032968+0000","last_deep_scrub":"268'298","last_deep_scrub_stamp":"2024-09-12T01:02:52.032968+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.032968+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:45.831551+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399261,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":8796,"num_write":982,"num_write_kb":26056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"268'152","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.598825+0000","last_change":"2024-09-12T01:03:10.598825+0000","last_active":"2024-09-12T01:03:10.598825+0000","last_peered":"2024-09-12T01:03:10.598825+0000","last_clean":"2024-09-12T01:03:10.598825+0000","last_became_active":"2024-09-12T00:16:05.095632+0000","last_became_peered":"2024-09-12T00:16:05.095632+0000","last_unstale":"2024-09-12T01:03:10.598825+0000","last_undegraded":"2024-09-12T01:03:10.598825+0000","last_fullsized":"2024-09-12T01:03:10.598825+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'152","last_scrub_stamp":"2024-09-12T01:03:10.598634+0000","last_deep_scrub":"268'152","last_deep_scrub_stamp":"2024-09-12T01:03:10.598634+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.598634+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:07.477069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":139,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"268'392","reported_seq":1871,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.048288+0000","last_change":"2024-09-12T01:02:58.048288+0000","last_active":"2024-09-12T01:02:58.048288+0000","last_peered":"2024-09-12T01:02:58.048288+0000","last_clean":"2024-09-12T01:02:58.048288+0000","last_became_active":"2024-09-12T00:15:57.042317+0000","last_became_peered":"2024-09-12T00:15:57.042317+0000","last_unstale":"2024-09-12T01:02:58.048288+0000","last_undegraded":"2024-09-12T01:02:58.048288+0000","last_fullsized":"2024-09-12T01:02:58.048288+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'392","last_scrub_stamp":"2024-09-12T01:02:58.048067+0000","last_deep_scrub":"268'392","last_deep_scrub_stamp":"2024-09-12T01:02:58.048067+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.048067+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:28.572626+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2080,"num_read_kb":1982,"num_write":441,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"268'365","reported_seq":1022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.610527+0000","last_change":"2024-09-12T01:02:51.610527+0000","last_active":"2024-09-12T01:02:51.610527+0000","last_peered":"2024-09-12T01:02:51.610527+0000","last_clean":"2024-09-12T01:02:51.610527+0000","last_became_active":"2024-09-12T00:15:55.042690+0000","last_became_peered":"2024-09-12T00:15:55.042690+0000","last_unstale":"2024-09-12T01:02:51.610527+0000","last_undegraded":"2024-09-12T01:02:51.610527+0000","last_fullsized":"2024-09-12T01:02:51.610527+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-12T01:02:51.610328+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-12T01:02:51.610328+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.610328+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:01.531698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288443,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":537,"num_read_kb":60082,"num_write":1122,"num_write_kb":36322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.577679+0000","last_change":"2024-09-12T01:03:15.577679+0000","last_active":"2024-09-12T01:03:15.577679+0000","last_peered":"2024-09-12T01:03:15.577679+0000","last_clean":"2024-09-12T01:03:15.577679+0000","last_became_active":"2024-09-12T00:15:59.046334+0000","last_became_peered":"2024-09-12T00:15:59.046334+0000","last_unstale":"2024-09-12T01:03:15.577679+0000","last_undegraded":"2024-09-12T01:03:15.577679+0000","last_fullsized":"2024-09-12T01:03:15.577679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:15.577489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:15.577489+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.577489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:42.549021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"268'365","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.319108+0000","last_change":"2024-09-12T01:03:14.319108+0000","last_active":"2024-09-12T01:03:14.319108+0000","last_peered":"2024-09-12T01:03:14.319108+0000","last_clean":"2024-09-12T01:03:14.319108+0000","last_became_active":"2024-09-12T00:16:01.057657+0000","last_became_peered":"2024-09-12T00:16:01.057657+0000","last_unstale":"2024-09-12T01:03:14.319108+0000","last_undegraded":"2024-09-12T01:03:14.319108+0000","last_fullsized":"2024-09-12T01:03:14.319108+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-12T01:03:14.318931+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-12T01:03:14.318931+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.318931+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:27.369397+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49919,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":600,"num_read_kb":1282,"num_write":482,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.272567+0000","last_change":"2024-09-12T01:03:10.272567+0000","last_active":"2024-09-12T01:03:10.272567+0000","last_peered":"2024-09-12T01:03:10.272567+0000","last_clean":"2024-09-12T01:03:10.272567+0000","last_became_active":"2024-09-12T00:16:03.098506+0000","last_became_peered":"2024-09-12T00:16:03.098506+0000","last_unstale":"2024-09-12T01:03:10.272567+0000","last_undegraded":"2024-09-12T01:03:10.272567+0000","last_fullsized":"2024-09-12T01:03:10.272567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:10.272377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:10.272377+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.272377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:45.071067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"268'155","reported_seq":726,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.345863+0000","last_change":"2024-09-12T01:03:13.345863+0000","last_active":"2024-09-12T01:03:13.345863+0000","last_peered":"2024-09-12T01:03:13.345863+0000","last_clean":"2024-09-12T01:03:13.345863+0000","last_became_active":"2024-09-12T00:16:05.105153+0000","last_became_peered":"2024-09-12T00:16:05.105153+0000","last_unstale":"2024-09-12T01:03:13.345863+0000","last_undegraded":"2024-09-12T01:03:13.345863+0000","last_fullsized":"2024-09-12T01:03:13.345863+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'155","last_scrub_stamp":"2024-09-12T01:03:13.345644+0000","last_deep_scrub":"268'155","last_deep_scrub_stamp":"2024-09-12T01:03:13.345644+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.345644+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:31.200725+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":214,"num_write":299,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"268'900","reported_seq":2532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.592009+0000","last_change":"2024-09-12T01:03:03.592009+0000","last_active":"2024-09-12T01:03:03.592009+0000","last_peered":"2024-09-12T01:03:03.592009+0000","last_clean":"2024-09-12T01:03:03.592009+0000","last_became_active":"2024-09-12T00:15:57.018484+0000","last_became_peered":"2024-09-12T00:15:57.018484+0000","last_unstale":"2024-09-12T01:03:03.592009+0000","last_undegraded":"2024-09-12T01:03:03.592009+0000","last_fullsized":"2024-09-12T01:03:03.592009+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'900","last_scrub_stamp":"2024-09-12T01:03:03.591747+0000","last_deep_scrub":"268'900","last_deep_scrub_stamp":"2024-09-12T01:03:03.591747+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.591747+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:57.427036+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4265,"num_read_kb":3809,"num_write":1199,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"268'363","reported_seq":1015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.060708+0000","last_change":"2024-09-12T01:02:49.060708+0000","last_active":"2024-09-12T01:02:49.060708+0000","last_peered":"2024-09-12T01:02:49.060708+0000","last_clean":"2024-09-12T01:02:49.060708+0000","last_became_active":"2024-09-12T00:15:55.065476+0000","last_became_peered":"2024-09-12T00:15:55.065476+0000","last_unstale":"2024-09-12T01:02:49.060708+0000","last_undegraded":"2024-09-12T01:02:49.060708+0000","last_fullsized":"2024-09-12T01:02:49.060708+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'363","last_scrub_stamp":"2024-09-12T01:02:49.060427+0000","last_deep_scrub":"268'363","last_deep_scrub_stamp":"2024-09-12T01:02:49.060427+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.060427+0000","objects_scrubbed":6,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:51.995984+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399070,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":579,"num_read_kb":7666,"num_write":1219,"num_write_kb":15378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.261725+0000","last_change":"2024-09-12T01:03:06.261725+0000","last_active":"2024-09-12T01:03:06.261725+0000","last_peered":"2024-09-12T01:03:06.261725+0000","last_clean":"2024-09-12T01:03:06.261725+0000","last_became_active":"2024-09-12T00:15:59.040412+0000","last_became_peered":"2024-09-12T00:15:59.040412+0000","last_unstale":"2024-09-12T01:03:06.261725+0000","last_undegraded":"2024-09-12T01:03:06.261725+0000","last_fullsized":"2024-09-12T01:03:06.261725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:06.261443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:06.261443+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.261443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:52.515905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"268'93","reported_seq":634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.263466+0000","last_change":"2024-09-12T01:03:09.263466+0000","last_active":"2024-09-12T01:03:09.263466+0000","last_peered":"2024-09-12T01:03:09.263466+0000","last_clean":"2024-09-12T01:03:09.263466+0000","last_became_active":"2024-09-12T00:16:01.062780+0000","last_became_peered":"2024-09-12T00:16:01.062780+0000","last_unstale":"2024-09-12T01:03:09.263466+0000","last_undegraded":"2024-09-12T01:03:09.263466+0000","last_fullsized":"2024-09-12T01:03:09.263466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'93","last_scrub_stamp":"2024-09-12T01:03:09.263285+0000","last_deep_scrub":"268'93","last_deep_scrub_stamp":"2024-09-12T01:03:09.263285+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.263285+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:30.034157+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.267152+0000","last_change":"2024-09-12T01:03:20.267152+0000","last_active":"2024-09-12T01:03:20.267152+0000","last_peered":"2024-09-12T01:03:20.267152+0000","last_clean":"2024-09-12T01:03:20.267152+0000","last_became_active":"2024-09-12T00:16:03.091926+0000","last_became_peered":"2024-09-12T00:16:03.091926+0000","last_unstale":"2024-09-12T01:03:20.267152+0000","last_undegraded":"2024-09-12T01:03:20.267152+0000","last_fullsized":"2024-09-12T01:03:20.267152+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:20.266968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:20.266968+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.266968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:48.830998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"268'130","reported_seq":634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.242031+0000","last_change":"2024-09-12T01:03:13.242031+0000","last_active":"2024-09-12T01:03:13.242031+0000","last_peered":"2024-09-12T01:03:13.242031+0000","last_clean":"2024-09-12T01:03:13.242031+0000","last_became_active":"2024-09-12T00:16:05.114182+0000","last_became_peered":"2024-09-12T00:16:05.114182+0000","last_unstale":"2024-09-12T01:03:13.242031+0000","last_undegraded":"2024-09-12T01:03:13.242031+0000","last_fullsized":"2024-09-12T01:03:13.242031+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'130","last_scrub_stamp":"2024-09-12T01:03:13.241818+0000","last_deep_scrub":"268'130","last_deep_scrub_stamp":"2024-09-12T01:03:13.241818+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.241818+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:11.870463+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":293,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"268'1231","reported_seq":2694,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.453239+0000","last_change":"2024-09-12T01:03:02.453239+0000","last_active":"2024-09-12T01:03:02.453239+0000","last_peered":"2024-09-12T01:03:02.453239+0000","last_clean":"2024-09-12T01:03:02.453239+0000","last_became_active":"2024-09-12T00:15:57.046916+0000","last_became_peered":"2024-09-12T00:15:57.046916+0000","last_unstale":"2024-09-12T01:03:02.453239+0000","last_undegraded":"2024-09-12T01:03:02.453239+0000","last_fullsized":"2024-09-12T01:03:02.453239+0000","mapping_epoch":28,"log_start":"268'1200","ondisk_log_start":"268'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1231","last_scrub_stamp":"2024-09-12T01:03:02.453053+0000","last_deep_scrub":"268'1231","last_deep_scrub_stamp":"2024-09-12T01:03:02.453053+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.453053+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":1200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:35.974222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5641,"num_read_kb":4945,"num_write":1755,"num_write_kb":746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"268'379","reported_seq":1171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.585252+0000","last_change":"2024-09-12T01:02:55.585252+0000","last_active":"2024-09-12T01:02:55.585252+0000","last_peered":"2024-09-12T01:02:55.585252+0000","last_clean":"2024-09-12T01:02:55.585252+0000","last_became_active":"2024-09-12T00:15:55.058428+0000","last_became_peered":"2024-09-12T00:15:55.058428+0000","last_unstale":"2024-09-12T01:02:55.585252+0000","last_undegraded":"2024-09-12T01:02:55.585252+0000","last_fullsized":"2024-09-12T01:02:55.585252+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'379","last_scrub_stamp":"2024-09-12T01:02:55.585005+0000","last_deep_scrub":"268'379","last_deep_scrub_stamp":"2024-09-12T01:02:55.585005+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.585005+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:14.899658+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":722,"num_read_kb":690,"num_write":1257,"num_write_kb":29311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.228212+0000","last_change":"2024-09-12T01:03:07.228212+0000","last_active":"2024-09-12T01:03:07.228212+0000","last_peered":"2024-09-12T01:03:07.228212+0000","last_clean":"2024-09-12T01:03:07.228212+0000","last_became_active":"2024-09-12T00:15:59.039465+0000","last_became_peered":"2024-09-12T00:15:59.039465+0000","last_unstale":"2024-09-12T01:03:07.228212+0000","last_undegraded":"2024-09-12T01:03:07.228212+0000","last_fullsized":"2024-09-12T01:03:07.228212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:07.227963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:07.227963+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.227963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:54.506391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"268'137","reported_seq":697,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.369141+0000","last_change":"2024-09-12T01:03:13.369141+0000","last_active":"2024-09-12T01:03:13.369141+0000","last_peered":"2024-09-12T01:03:13.369141+0000","last_clean":"2024-09-12T01:03:13.369141+0000","last_became_active":"2024-09-12T00:16:01.056702+0000","last_became_peered":"2024-09-12T00:16:01.056702+0000","last_unstale":"2024-09-12T01:03:13.369141+0000","last_undegraded":"2024-09-12T01:03:13.369141+0000","last_fullsized":"2024-09-12T01:03:13.369141+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'137","last_scrub_stamp":"2024-09-12T01:03:13.368957+0000","last_deep_scrub":"268'137","last_deep_scrub_stamp":"2024-09-12T01:03:13.368957+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.368957+0000","objects_scrubbed":7,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:34.961935+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":144,"num_read_kb":136,"num_write":100,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"268'802","reported_seq":2225,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:39.481677+0000","last_change":"2024-09-12T00:16:03.104735+0000","last_active":"2024-09-12T01:02:39.481677+0000","last_peered":"2024-09-12T01:02:39.481677+0000","last_clean":"2024-09-12T01:02:39.481677+0000","last_became_active":"2024-09-12T00:16:03.103292+0000","last_became_peered":"2024-09-12T00:16:03.103292+0000","last_unstale":"2024-09-12T01:02:39.481677+0000","last_undegraded":"2024-09-12T01:02:39.481677+0000","last_fullsized":"2024-09-12T01:02:39.481677+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:21.322414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"268'236","reported_seq":1068,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.556009+0000","last_change":"2024-09-12T01:03:13.556009+0000","last_active":"2024-09-12T01:03:13.556009+0000","last_peered":"2024-09-12T01:03:13.556009+0000","last_clean":"2024-09-12T01:03:13.556009+0000","last_became_active":"2024-09-12T00:16:05.107785+0000","last_became_peered":"2024-09-12T00:16:05.107785+0000","last_unstale":"2024-09-12T01:03:13.556009+0000","last_undegraded":"2024-09-12T01:03:13.556009+0000","last_fullsized":"2024-09-12T01:03:13.556009+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'236","last_scrub_stamp":"2024-09-12T01:03:13.555830+0000","last_deep_scrub":"268'236","last_deep_scrub_stamp":"2024-09-12T01:03:13.555830+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.555830+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:05.447726+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":637,"num_write":534,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"268'636","reported_seq":2170,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.468669+0000","last_change":"2024-09-12T01:03:03.468669+0000","last_active":"2024-09-12T01:03:03.468669+0000","last_peered":"2024-09-12T01:03:03.468669+0000","last_clean":"2024-09-12T01:03:03.468669+0000","last_became_active":"2024-09-12T00:15:57.035581+0000","last_became_peered":"2024-09-12T00:15:57.035581+0000","last_unstale":"2024-09-12T01:03:03.468669+0000","last_undegraded":"2024-09-12T01:03:03.468669+0000","last_fullsized":"2024-09-12T01:03:03.468669+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'636","last_scrub_stamp":"2024-09-12T01:03:03.468424+0000","last_deep_scrub":"268'636","last_deep_scrub_stamp":"2024-09-12T01:03:03.468424+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.468424+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":600,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:47.919591+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3178,"num_read_kb":2956,"num_write":875,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"268'336","reported_seq":1010,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.230246+0000","last_change":"2024-09-12T01:02:50.230246+0000","last_active":"2024-09-12T01:02:50.230246+0000","last_peered":"2024-09-12T01:02:50.230246+0000","last_clean":"2024-09-12T01:02:50.230246+0000","last_became_active":"2024-09-12T00:15:55.065178+0000","last_became_peered":"2024-09-12T00:15:55.065178+0000","last_unstale":"2024-09-12T01:02:50.230246+0000","last_undegraded":"2024-09-12T01:02:50.230246+0000","last_fullsized":"2024-09-12T01:02:50.230246+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'336","last_scrub_stamp":"2024-09-12T01:02:50.230018+0000","last_deep_scrub":"268'336","last_deep_scrub_stamp":"2024-09-12T01:02:50.230018+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.230018+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:17.900987+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262226,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":565,"num_write":1139,"num_write_kb":21852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.581360+0000","last_change":"2024-09-12T01:03:16.581360+0000","last_active":"2024-09-12T01:03:16.581360+0000","last_peered":"2024-09-12T01:03:16.581360+0000","last_clean":"2024-09-12T01:03:16.581360+0000","last_became_active":"2024-09-12T00:15:59.039902+0000","last_became_peered":"2024-09-12T00:15:59.039902+0000","last_unstale":"2024-09-12T01:03:16.581360+0000","last_undegraded":"2024-09-12T01:03:16.581360+0000","last_fullsized":"2024-09-12T01:03:16.581360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:16.581177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:16.581177+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.581177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:43.991582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"268'283","reported_seq":863,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.569244+0000","last_change":"2024-09-12T01:03:06.569244+0000","last_active":"2024-09-12T01:03:06.569244+0000","last_peered":"2024-09-12T01:03:06.569244+0000","last_clean":"2024-09-12T01:03:06.569244+0000","last_became_active":"2024-09-12T00:16:01.052744+0000","last_became_peered":"2024-09-12T00:16:01.052744+0000","last_unstale":"2024-09-12T01:03:06.569244+0000","last_undegraded":"2024-09-12T01:03:06.569244+0000","last_fullsized":"2024-09-12T01:03:06.569244+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'283","last_scrub_stamp":"2024-09-12T01:03:06.568959+0000","last_deep_scrub":"268'283","last_deep_scrub_stamp":"2024-09-12T01:03:06.568959+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.568959+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:00.450040+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47709,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":1056,"num_write":378,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"268'816","reported_seq":2470,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.561546+0000","last_change":"2024-09-12T01:03:17.561546+0000","last_active":"2024-09-12T01:03:17.561546+0000","last_peered":"2024-09-12T01:03:17.561546+0000","last_clean":"2024-09-12T01:03:17.561546+0000","last_became_active":"2024-09-12T00:16:03.097895+0000","last_became_peered":"2024-09-12T00:16:03.097895+0000","last_unstale":"2024-09-12T01:03:17.561546+0000","last_undegraded":"2024-09-12T01:03:17.561546+0000","last_fullsized":"2024-09-12T01:03:17.561546+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'816","last_scrub_stamp":"2024-09-12T01:03:17.561363+0000","last_deep_scrub":"268'816","last_deep_scrub_stamp":"2024-09-12T01:03:17.561363+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.561363+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:37.539725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"268'460","reported_seq":2021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.599731+0000","last_change":"2024-09-12T01:03:05.599731+0000","last_active":"2024-09-12T01:03:05.599731+0000","last_peered":"2024-09-12T01:03:05.599731+0000","last_clean":"2024-09-12T01:03:05.599731+0000","last_became_active":"2024-09-12T00:15:57.023659+0000","last_became_peered":"2024-09-12T00:15:57.023659+0000","last_unstale":"2024-09-12T01:03:05.599731+0000","last_undegraded":"2024-09-12T01:03:05.599731+0000","last_fullsized":"2024-09-12T01:03:05.599731+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'460","last_scrub_stamp":"2024-09-12T01:03:05.599554+0000","last_deep_scrub":"268'460","last_deep_scrub_stamp":"2024-09-12T01:03:05.599554+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.599554+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:38.313492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2457,"num_read_kb":2306,"num_write":563,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"268'375","reported_seq":1015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:44.553160+0000","last_change":"2024-09-12T01:02:44.553031+0000","last_active":"2024-09-12T01:02:44.553160+0000","last_peered":"2024-09-12T01:02:44.553160+0000","last_clean":"2024-09-12T01:02:44.553160+0000","last_became_active":"2024-09-12T00:15:55.060679+0000","last_became_peered":"2024-09-12T00:15:55.060679+0000","last_unstale":"2024-09-12T01:02:44.553160+0000","last_undegraded":"2024-09-12T01:02:44.553160+0000","last_fullsized":"2024-09-12T01:02:44.553160+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'375","last_scrub_stamp":"2024-09-12T01:02:44.552852+0000","last_deep_scrub":"268'375","last_deep_scrub_stamp":"2024-09-12T01:02:44.552852+0000","last_clean_scrub_stamp":"2024-09-12T01:02:44.552852+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:52.618648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":484,"num_read_kb":16773,"num_write":1144,"num_write_kb":29370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.191150+0000","last_change":"2024-09-12T01:02:58.191150+0000","last_active":"2024-09-12T01:02:58.191150+0000","last_peered":"2024-09-12T01:02:58.191150+0000","last_clean":"2024-09-12T01:02:58.191150+0000","last_became_active":"2024-09-12T00:15:59.035288+0000","last_became_peered":"2024-09-12T00:15:59.035288+0000","last_unstale":"2024-09-12T01:02:58.191150+0000","last_undegraded":"2024-09-12T01:02:58.191150+0000","last_fullsized":"2024-09-12T01:02:58.191150+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:58.190865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:58.190865+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.190865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:42.772188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"268'358","reported_seq":982,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.582233+0000","last_change":"2024-09-12T01:03:04.582233+0000","last_active":"2024-09-12T01:03:04.582233+0000","last_peered":"2024-09-12T01:03:04.582233+0000","last_clean":"2024-09-12T01:03:04.582233+0000","last_became_active":"2024-09-12T00:16:01.069838+0000","last_became_peered":"2024-09-12T00:16:01.069838+0000","last_unstale":"2024-09-12T01:03:04.582233+0000","last_undegraded":"2024-09-12T01:03:04.582233+0000","last_fullsized":"2024-09-12T01:03:04.582233+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-12T01:03:04.582029+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-12T01:03:04.582029+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.582029+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:04.440997+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45025,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":563,"num_read_kb":1131,"num_write":438,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.153517+0000","last_change":"2024-09-12T01:03:11.153393+0000","last_active":"2024-09-12T01:03:11.153517+0000","last_peered":"2024-09-12T01:03:11.153517+0000","last_clean":"2024-09-12T01:03:11.153517+0000","last_became_active":"2024-09-12T00:16:03.089533+0000","last_became_peered":"2024-09-12T00:16:03.089533+0000","last_unstale":"2024-09-12T01:03:11.153517+0000","last_undegraded":"2024-09-12T01:03:11.153517+0000","last_fullsized":"2024-09-12T01:03:11.153517+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:11.153215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:11.153215+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.153215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:32.835270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"268'575","reported_seq":1395,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.581701+0000","last_change":"2024-09-12T01:03:09.581701+0000","last_active":"2024-09-12T01:03:09.581701+0000","last_peered":"2024-09-12T01:03:09.581701+0000","last_clean":"2024-09-12T01:03:09.581701+0000","last_became_active":"2024-09-12T00:16:05.112960+0000","last_became_peered":"2024-09-12T00:16:05.112960+0000","last_unstale":"2024-09-12T01:03:09.581701+0000","last_undegraded":"2024-09-12T01:03:09.581701+0000","last_fullsized":"2024-09-12T01:03:09.581701+0000","mapping_epoch":36,"log_start":"268'500","ondisk_log_start":"268'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'575","last_scrub_stamp":"2024-09-12T01:03:09.581499+0000","last_deep_scrub":"268'575","last_deep_scrub_stamp":"2024-09-12T01:03:09.581499+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.581499+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:17.076524+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1305,"num_read_kb":1300,"num_write":1202,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"268'525","reported_seq":2011,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.186856+0000","last_change":"2024-09-12T01:02:49.186856+0000","last_active":"2024-09-12T01:02:49.186856+0000","last_peered":"2024-09-12T01:02:49.186856+0000","last_clean":"2024-09-12T01:02:49.186856+0000","last_became_active":"2024-09-12T00:15:57.045141+0000","last_became_peered":"2024-09-12T00:15:57.045141+0000","last_unstale":"2024-09-12T01:02:49.186856+0000","last_undegraded":"2024-09-12T01:02:49.186856+0000","last_fullsized":"2024-09-12T01:02:49.186856+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'525","last_scrub_stamp":"2024-09-12T01:02:49.186637+0000","last_deep_scrub":"268'525","last_deep_scrub_stamp":"2024-09-12T01:02:49.186637+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.186637+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:02.660716+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2585,"num_read_kb":2367,"num_write":669,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"268'370","reported_seq":1025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:45.502665+0000","last_change":"2024-09-12T01:02:45.502549+0000","last_active":"2024-09-12T01:02:45.502665+0000","last_peered":"2024-09-12T01:02:45.502665+0000","last_clean":"2024-09-12T01:02:45.502665+0000","last_became_active":"2024-09-12T00:15:55.063542+0000","last_became_peered":"2024-09-12T00:15:55.063542+0000","last_unstale":"2024-09-12T01:02:45.502665+0000","last_undegraded":"2024-09-12T01:02:45.502665+0000","last_fullsized":"2024-09-12T01:02:45.502665+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-12T01:02:45.502377+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-12T01:02:45.502377+0000","last_clean_scrub_stamp":"2024-09-12T01:02:45.502377+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:03.174691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":559,"num_read_kb":24074,"num_write":1250,"num_write_kb":38232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.118698+0000","last_change":"2024-09-12T01:03:01.118698+0000","last_active":"2024-09-12T01:03:01.118698+0000","last_peered":"2024-09-12T01:03:01.118698+0000","last_clean":"2024-09-12T01:03:01.118698+0000","last_became_active":"2024-09-12T00:15:59.050663+0000","last_became_peered":"2024-09-12T00:15:59.050663+0000","last_unstale":"2024-09-12T01:03:01.118698+0000","last_undegraded":"2024-09-12T01:03:01.118698+0000","last_fullsized":"2024-09-12T01:03:01.118698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:01.118502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:01.118502+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.118502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:20.630794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"268'250","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.300044+0000","last_change":"2024-09-12T01:03:11.299779+0000","last_active":"2024-09-12T01:03:11.300044+0000","last_peered":"2024-09-12T01:03:11.300044+0000","last_clean":"2024-09-12T01:03:11.300044+0000","last_became_active":"2024-09-12T00:16:01.068392+0000","last_became_peered":"2024-09-12T00:16:01.068392+0000","last_unstale":"2024-09-12T01:03:11.300044+0000","last_undegraded":"2024-09-12T01:03:11.300044+0000","last_fullsized":"2024-09-12T01:03:11.300044+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'250","last_scrub_stamp":"2024-09-12T01:03:11.299521+0000","last_deep_scrub":"268'250","last_deep_scrub_stamp":"2024-09-12T01:03:11.299521+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.299521+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:46.135518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10400,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":388,"num_read_kb":849,"num_write":306,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.374745+0000","last_change":"2024-09-12T01:03:18.374745+0000","last_active":"2024-09-12T01:03:18.374745+0000","last_peered":"2024-09-12T01:03:18.374745+0000","last_clean":"2024-09-12T01:03:18.374745+0000","last_became_active":"2024-09-12T00:16:03.086751+0000","last_became_peered":"2024-09-12T00:16:03.086751+0000","last_unstale":"2024-09-12T01:03:18.374745+0000","last_undegraded":"2024-09-12T01:03:18.374745+0000","last_fullsized":"2024-09-12T01:03:18.374745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:18.374546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:18.374546+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.374546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:35.922479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"268'2412","reported_seq":4256,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.330226+0000","last_change":"2024-09-12T01:03:11.330226+0000","last_active":"2024-09-12T01:03:11.330226+0000","last_peered":"2024-09-12T01:03:11.330226+0000","last_clean":"2024-09-12T01:03:11.330226+0000","last_became_active":"2024-09-12T00:16:05.114563+0000","last_became_peered":"2024-09-12T00:16:05.114563+0000","last_unstale":"2024-09-12T01:03:11.330226+0000","last_undegraded":"2024-09-12T01:03:11.330226+0000","last_fullsized":"2024-09-12T01:03:11.330226+0000","mapping_epoch":36,"log_start":"268'2401","ondisk_log_start":"268'2401","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2412","last_scrub_stamp":"2024-09-12T01:03:11.330022+0000","last_deep_scrub":"268'2412","last_deep_scrub_stamp":"2024-09-12T01:03:11.330022+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.330022+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":2401,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:27.082423+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6030,"num_read_kb":6028,"num_write":4877,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"268'787","reported_seq":2366,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.638877+0000","last_change":"2024-09-12T01:02:51.638877+0000","last_active":"2024-09-12T01:02:51.638877+0000","last_peered":"2024-09-12T01:02:51.638877+0000","last_clean":"2024-09-12T01:02:51.638877+0000","last_became_active":"2024-09-12T00:15:57.024509+0000","last_became_peered":"2024-09-12T00:15:57.024509+0000","last_unstale":"2024-09-12T01:02:51.638877+0000","last_undegraded":"2024-09-12T01:02:51.638877+0000","last_fullsized":"2024-09-12T01:02:51.638877+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'787","last_scrub_stamp":"2024-09-12T01:02:51.638693+0000","last_deep_scrub":"268'787","last_deep_scrub_stamp":"2024-09-12T01:02:51.638693+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.638693+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:49.637175+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3769,"num_read_kb":3415,"num_write":1030,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"268'342","reported_seq":995,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.680813+0000","last_change":"2024-09-12T01:02:49.680665+0000","last_active":"2024-09-12T01:02:49.680813+0000","last_peered":"2024-09-12T01:02:49.680813+0000","last_clean":"2024-09-12T01:02:49.680813+0000","last_became_active":"2024-09-12T00:15:55.052916+0000","last_became_peered":"2024-09-12T00:15:55.052916+0000","last_unstale":"2024-09-12T01:02:49.680813+0000","last_undegraded":"2024-09-12T01:02:49.680813+0000","last_fullsized":"2024-09-12T01:02:49.680813+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-12T01:02:49.680438+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-12T01:02:49.680438+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.680438+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:55.122798+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306611,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":476,"num_read_kb":37817,"num_write":1138,"num_write_kb":39957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.497054+0000","last_change":"2024-09-12T01:03:09.496915+0000","last_active":"2024-09-12T01:03:09.497054+0000","last_peered":"2024-09-12T01:03:09.497054+0000","last_clean":"2024-09-12T01:03:09.497054+0000","last_became_active":"2024-09-12T00:15:59.034650+0000","last_became_peered":"2024-09-12T00:15:59.034650+0000","last_unstale":"2024-09-12T01:03:09.497054+0000","last_undegraded":"2024-09-12T01:03:09.497054+0000","last_fullsized":"2024-09-12T01:03:09.497054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:09.496742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:09.496742+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.496742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:28.986770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"268'327","reported_seq":939,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.578572+0000","last_change":"2024-09-12T01:03:18.578572+0000","last_active":"2024-09-12T01:03:18.578572+0000","last_peered":"2024-09-12T01:03:18.578572+0000","last_clean":"2024-09-12T01:03:18.578572+0000","last_became_active":"2024-09-12T00:16:01.057281+0000","last_became_peered":"2024-09-12T00:16:01.057281+0000","last_unstale":"2024-09-12T01:03:18.578572+0000","last_undegraded":"2024-09-12T01:03:18.578572+0000","last_fullsized":"2024-09-12T01:03:18.578572+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'327","last_scrub_stamp":"2024-09-12T01:03:18.578375+0000","last_deep_scrub":"268'327","last_deep_scrub_stamp":"2024-09-12T01:03:18.578375+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.578375+0000","objects_scrubbed":9,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:44.728688+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49581,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":504,"num_read_kb":1060,"num_write":406,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"268'816","reported_seq":2432,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.506078+0000","last_change":"2024-09-12T01:03:15.506078+0000","last_active":"2024-09-12T01:03:15.506078+0000","last_peered":"2024-09-12T01:03:15.506078+0000","last_clean":"2024-09-12T01:03:15.506078+0000","last_became_active":"2024-09-12T00:16:03.097554+0000","last_became_peered":"2024-09-12T00:16:03.097554+0000","last_unstale":"2024-09-12T01:03:15.506078+0000","last_undegraded":"2024-09-12T01:03:15.506078+0000","last_fullsized":"2024-09-12T01:03:15.506078+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'816","last_scrub_stamp":"2024-09-12T01:03:15.505876+0000","last_deep_scrub":"268'816","last_deep_scrub_stamp":"2024-09-12T01:03:15.505876+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.505876+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:52.676458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"268'96","reported_seq":609,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.196451+0000","last_change":"2024-09-12T01:03:15.196451+0000","last_active":"2024-09-12T01:03:15.196451+0000","last_peered":"2024-09-12T01:03:15.196451+0000","last_clean":"2024-09-12T01:03:15.196451+0000","last_became_active":"2024-09-12T00:16:05.112524+0000","last_became_peered":"2024-09-12T00:16:05.112524+0000","last_unstale":"2024-09-12T01:03:15.196451+0000","last_undegraded":"2024-09-12T01:03:15.196451+0000","last_fullsized":"2024-09-12T01:03:15.196451+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'96","last_scrub_stamp":"2024-09-12T01:03:15.196178+0000","last_deep_scrub":"268'96","last_deep_scrub_stamp":"2024-09-12T01:03:15.196178+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.196178+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:31.550514+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":109,"num_write":225,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"268'459","reported_seq":1835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.410646+0000","last_change":"2024-09-12T01:03:01.410451+0000","last_active":"2024-09-12T01:03:01.410646+0000","last_peered":"2024-09-12T01:03:01.410646+0000","last_clean":"2024-09-12T01:03:01.410646+0000","last_became_active":"2024-09-12T00:15:57.042663+0000","last_became_peered":"2024-09-12T00:15:57.042663+0000","last_unstale":"2024-09-12T01:03:01.410646+0000","last_undegraded":"2024-09-12T01:03:01.410646+0000","last_fullsized":"2024-09-12T01:03:01.410646+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'459","last_scrub_stamp":"2024-09-12T01:03:01.410256+0000","last_deep_scrub":"268'459","last_deep_scrub_stamp":"2024-09-12T01:03:01.410256+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.410256+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:01.856062+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2110,"num_read_kb":1961,"num_write":540,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"268'346","reported_seq":1096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.586839+0000","last_change":"2024-09-12T01:02:51.586675+0000","last_active":"2024-09-12T01:02:51.586839+0000","last_peered":"2024-09-12T01:02:51.586839+0000","last_clean":"2024-09-12T01:02:51.586839+0000","last_became_active":"2024-09-12T00:15:55.054533+0000","last_became_peered":"2024-09-12T00:15:55.054533+0000","last_unstale":"2024-09-12T01:02:51.586839+0000","last_undegraded":"2024-09-12T01:02:51.586839+0000","last_fullsized":"2024-09-12T01:02:51.586839+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:02:51.586430+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:02:51.586430+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.586430+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:34.921515+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263223,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":794,"num_read_kb":57067,"num_write":1127,"num_write_kb":15994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.131072+0000","last_change":"2024-09-12T01:03:02.131072+0000","last_active":"2024-09-12T01:03:02.131072+0000","last_peered":"2024-09-12T01:03:02.131072+0000","last_clean":"2024-09-12T01:03:02.131072+0000","last_became_active":"2024-09-12T00:15:59.037145+0000","last_became_peered":"2024-09-12T00:15:59.037145+0000","last_unstale":"2024-09-12T01:03:02.131072+0000","last_undegraded":"2024-09-12T01:03:02.131072+0000","last_fullsized":"2024-09-12T01:03:02.131072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:02.130877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:02.130877+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.130877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:34.886452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"268'492","reported_seq":1149,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.257980+0000","last_change":"2024-09-12T01:03:10.257980+0000","last_active":"2024-09-12T01:03:10.257980+0000","last_peered":"2024-09-12T01:03:10.257980+0000","last_clean":"2024-09-12T01:03:10.257980+0000","last_became_active":"2024-09-12T00:16:01.068496+0000","last_became_peered":"2024-09-12T00:16:01.068496+0000","last_unstale":"2024-09-12T01:03:10.257980+0000","last_undegraded":"2024-09-12T01:03:10.257980+0000","last_fullsized":"2024-09-12T01:03:10.257980+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'492","last_scrub_stamp":"2024-09-12T01:03:10.257870+0000","last_deep_scrub":"268'492","last_deep_scrub_stamp":"2024-09-12T01:03:10.257870+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.257870+0000","objects_scrubbed":7,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:35.185896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92831,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":846,"num_read_kb":2016,"num_write":692,"num_write_kb":581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.473305+0000","last_change":"2024-09-12T01:03:14.473305+0000","last_active":"2024-09-12T01:03:14.473305+0000","last_peered":"2024-09-12T01:03:14.473305+0000","last_clean":"2024-09-12T01:03:14.473305+0000","last_became_active":"2024-09-12T00:16:03.101984+0000","last_became_peered":"2024-09-12T00:16:03.101984+0000","last_unstale":"2024-09-12T01:03:14.473305+0000","last_undegraded":"2024-09-12T01:03:14.473305+0000","last_fullsized":"2024-09-12T01:03:14.473305+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:14.473119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:14.473119+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.473119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:56.000451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"268'132","reported_seq":641,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.898479+0000","last_change":"2024-09-12T01:03:10.898479+0000","last_active":"2024-09-12T01:03:10.898479+0000","last_peered":"2024-09-12T01:03:10.898479+0000","last_clean":"2024-09-12T01:03:10.898479+0000","last_became_active":"2024-09-12T00:16:05.104674+0000","last_became_peered":"2024-09-12T00:16:05.104674+0000","last_unstale":"2024-09-12T01:03:10.898479+0000","last_undegraded":"2024-09-12T01:03:10.898479+0000","last_fullsized":"2024-09-12T01:03:10.898479+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'132","last_scrub_stamp":"2024-09-12T01:03:10.898244+0000","last_deep_scrub":"268'132","last_deep_scrub_stamp":"2024-09-12T01:03:10.898244+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.898244+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:44.538905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":121,"num_write":297,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"268'781","reported_seq":2295,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.555105+0000","last_change":"2024-09-12T01:02:57.554858+0000","last_active":"2024-09-12T01:02:57.555105+0000","last_peered":"2024-09-12T01:02:57.555105+0000","last_clean":"2024-09-12T01:02:57.555105+0000","last_became_active":"2024-09-12T00:15:57.016954+0000","last_became_peered":"2024-09-12T00:15:57.016954+0000","last_unstale":"2024-09-12T01:02:57.555105+0000","last_undegraded":"2024-09-12T01:02:57.555105+0000","last_fullsized":"2024-09-12T01:02:57.555105+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'781","last_scrub_stamp":"2024-09-12T01:02:57.554627+0000","last_deep_scrub":"268'781","last_deep_scrub_stamp":"2024-09-12T01:02:57.554627+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.554627+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:39.189137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3833,"num_read_kb":3467,"num_write":1045,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"268'302","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.716691+0000","last_change":"2024-09-12T01:02:49.716410+0000","last_active":"2024-09-12T01:02:49.716691+0000","last_peered":"2024-09-12T01:02:49.716691+0000","last_clean":"2024-09-12T01:02:49.716691+0000","last_became_active":"2024-09-12T00:15:55.062854+0000","last_became_peered":"2024-09-12T00:15:55.062854+0000","last_unstale":"2024-09-12T01:02:49.716691+0000","last_undegraded":"2024-09-12T01:02:49.716691+0000","last_fullsized":"2024-09-12T01:02:49.716691+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'302","last_scrub_stamp":"2024-09-12T01:02:49.716161+0000","last_deep_scrub":"268'302","last_deep_scrub_stamp":"2024-09-12T01:02:49.716161+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.716161+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:41.591969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262214,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":412,"num_read_kb":12698,"num_write":975,"num_write_kb":17642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.827324+0000","last_change":"2024-09-12T01:03:00.827168+0000","last_active":"2024-09-12T01:03:00.827324+0000","last_peered":"2024-09-12T01:03:00.827324+0000","last_clean":"2024-09-12T01:03:00.827324+0000","last_became_active":"2024-09-12T00:15:59.033844+0000","last_became_peered":"2024-09-12T00:15:59.033844+0000","last_unstale":"2024-09-12T01:03:00.827324+0000","last_undegraded":"2024-09-12T01:03:00.827324+0000","last_fullsized":"2024-09-12T01:03:00.827324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:00.826990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:00.826990+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.826990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:17.427435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"268'323","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.264429+0000","last_change":"2024-09-12T01:03:06.264266+0000","last_active":"2024-09-12T01:03:06.264429+0000","last_peered":"2024-09-12T01:03:06.264429+0000","last_clean":"2024-09-12T01:03:06.264429+0000","last_became_active":"2024-09-12T00:16:01.067377+0000","last_became_peered":"2024-09-12T00:16:01.067377+0000","last_unstale":"2024-09-12T01:03:06.264429+0000","last_undegraded":"2024-09-12T01:03:06.264429+0000","last_fullsized":"2024-09-12T01:03:06.264429+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'323","last_scrub_stamp":"2024-09-12T01:03:06.264071+0000","last_deep_scrub":"268'323","last_deep_scrub_stamp":"2024-09-12T01:03:06.264071+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.264071+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:11.054065+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":549,"num_read_kb":1240,"num_write":496,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.894544+0000","last_change":"2024-09-12T01:03:07.894544+0000","last_active":"2024-09-12T01:03:07.894544+0000","last_peered":"2024-09-12T01:03:07.894544+0000","last_clean":"2024-09-12T01:03:07.894544+0000","last_became_active":"2024-09-12T00:16:03.079004+0000","last_became_peered":"2024-09-12T00:16:03.079004+0000","last_unstale":"2024-09-12T01:03:07.894544+0000","last_undegraded":"2024-09-12T01:03:07.894544+0000","last_fullsized":"2024-09-12T01:03:07.894544+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:07.894293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:07.894293+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.894293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:54.640963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"268'133","reported_seq":631,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.649176+0000","last_change":"2024-09-12T01:03:19.649176+0000","last_active":"2024-09-12T01:03:19.649176+0000","last_peered":"2024-09-12T01:03:19.649176+0000","last_clean":"2024-09-12T01:03:19.649176+0000","last_became_active":"2024-09-12T00:16:05.093815+0000","last_became_peered":"2024-09-12T00:16:05.093815+0000","last_unstale":"2024-09-12T01:03:19.649176+0000","last_undegraded":"2024-09-12T01:03:19.649176+0000","last_fullsized":"2024-09-12T01:03:19.649176+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'133","last_scrub_stamp":"2024-09-12T01:03:19.648987+0000","last_deep_scrub":"268'133","last_deep_scrub_stamp":"2024-09-12T01:03:19.648987+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.648987+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:21.363778+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":302,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"268'447","reported_seq":2000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.542538+0000","last_change":"2024-09-12T01:03:02.542377+0000","last_active":"2024-09-12T01:03:02.542538+0000","last_peered":"2024-09-12T01:03:02.542538+0000","last_clean":"2024-09-12T01:03:02.542538+0000","last_became_active":"2024-09-12T00:15:57.029290+0000","last_became_peered":"2024-09-12T00:15:57.029290+0000","last_unstale":"2024-09-12T01:03:02.542538+0000","last_undegraded":"2024-09-12T01:03:02.542538+0000","last_fullsized":"2024-09-12T01:03:02.542538+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'447","last_scrub_stamp":"2024-09-12T01:03:02.542185+0000","last_deep_scrub":"268'447","last_deep_scrub_stamp":"2024-09-12T01:03:02.542185+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.542185+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:21.152121+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2290,"num_read_kb":2163,"num_write":517,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":469,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"268'350","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.685091+0000","last_change":"2024-09-12T01:02:48.685091+0000","last_active":"2024-09-12T01:02:48.685091+0000","last_peered":"2024-09-12T01:02:48.685091+0000","last_clean":"2024-09-12T01:02:48.685091+0000","last_became_active":"2024-09-12T00:16:26.796888+0000","last_became_peered":"2024-09-12T00:16:26.796888+0000","last_unstale":"2024-09-12T01:02:48.685091+0000","last_undegraded":"2024-09-12T01:02:48.685091+0000","last_fullsized":"2024-09-12T01:02:48.685091+0000","mapping_epoch":39,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T01:02:48.684885+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T01:02:48.684885+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.684885+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:31.844783+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":37574,"num_write":1133,"num_write_kb":35076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,6],"acting":[3,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.479209+0000","last_change":"2024-09-12T01:03:10.478940+0000","last_active":"2024-09-12T01:03:10.479209+0000","last_peered":"2024-09-12T01:03:10.479209+0000","last_clean":"2024-09-12T01:03:10.479209+0000","last_became_active":"2024-09-12T00:15:59.029998+0000","last_became_peered":"2024-09-12T00:15:59.029998+0000","last_unstale":"2024-09-12T01:03:10.479209+0000","last_undegraded":"2024-09-12T01:03:10.479209+0000","last_fullsized":"2024-09-12T01:03:10.479209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:10.478741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:10.478741+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.478741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.181120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"268'313","reported_seq":904,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.516160+0000","last_change":"2024-09-12T01:03:11.516160+0000","last_active":"2024-09-12T01:03:11.516160+0000","last_peered":"2024-09-12T01:03:11.516160+0000","last_clean":"2024-09-12T01:03:11.516160+0000","last_became_active":"2024-09-12T00:16:01.053660+0000","last_became_peered":"2024-09-12T00:16:01.053660+0000","last_unstale":"2024-09-12T01:03:11.516160+0000","last_undegraded":"2024-09-12T01:03:11.516160+0000","last_fullsized":"2024-09-12T01:03:11.516160+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-12T01:03:11.515958+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-12T01:03:11.515958+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.515958+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:02.549026+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54997,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":504,"num_read_kb":1130,"num_write":408,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"268'777","reported_seq":2376,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.890344+0000","last_change":"2024-09-12T01:03:03.890196+0000","last_active":"2024-09-12T01:03:03.890344+0000","last_peered":"2024-09-12T01:03:03.890344+0000","last_clean":"2024-09-12T01:03:03.890344+0000","last_became_active":"2024-09-12T00:16:03.098077+0000","last_became_peered":"2024-09-12T00:16:03.098077+0000","last_unstale":"2024-09-12T01:03:03.890344+0000","last_undegraded":"2024-09-12T01:03:03.890344+0000","last_fullsized":"2024-09-12T01:03:03.890344+0000","mapping_epoch":34,"log_start":"268'701","ondisk_log_start":"268'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'777","last_scrub_stamp":"2024-09-12T01:03:03.889993+0000","last_deep_scrub":"268'777","last_deep_scrub_stamp":"2024-09-12T01:03:03.889993+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.889993+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":701,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:19.782671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"268'154","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.204907+0000","last_change":"2024-09-12T01:03:12.204907+0000","last_active":"2024-09-12T01:03:12.204907+0000","last_peered":"2024-09-12T01:03:12.204907+0000","last_clean":"2024-09-12T01:03:12.204907+0000","last_became_active":"2024-09-12T00:16:05.107291+0000","last_became_peered":"2024-09-12T00:16:05.107291+0000","last_unstale":"2024-09-12T01:03:12.204907+0000","last_undegraded":"2024-09-12T01:03:12.204907+0000","last_fullsized":"2024-09-12T01:03:12.204907+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'154","last_scrub_stamp":"2024-09-12T01:03:12.204682+0000","last_deep_scrub":"268'154","last_deep_scrub_stamp":"2024-09-12T01:03:12.204682+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.204682+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:02.743584+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":174,"num_read_kb":162,"num_write":365,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"268'796","reported_seq":2317,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.684896+0000","last_change":"2024-09-12T01:02:53.684735+0000","last_active":"2024-09-12T01:02:53.684896+0000","last_peered":"2024-09-12T01:02:53.684896+0000","last_clean":"2024-09-12T01:02:53.684896+0000","last_became_active":"2024-09-12T00:15:57.024185+0000","last_became_peered":"2024-09-12T00:15:57.024185+0000","last_unstale":"2024-09-12T01:02:53.684896+0000","last_undegraded":"2024-09-12T01:02:53.684896+0000","last_fullsized":"2024-09-12T01:02:53.684896+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'796","last_scrub_stamp":"2024-09-12T01:02:53.684558+0000","last_deep_scrub":"268'796","last_deep_scrub_stamp":"2024-09-12T01:02:53.684558+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.684558+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:16.494973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3776,"num_read_kb":3402,"num_write":1055,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"268'346","reported_seq":1000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.643233+0000","last_change":"2024-09-12T01:02:52.643233+0000","last_active":"2024-09-12T01:02:52.643233+0000","last_peered":"2024-09-12T01:02:52.643233+0000","last_clean":"2024-09-12T01:02:52.643233+0000","last_became_active":"2024-09-12T00:15:55.027001+0000","last_became_peered":"2024-09-12T00:15:55.027001+0000","last_unstale":"2024-09-12T01:02:52.643233+0000","last_undegraded":"2024-09-12T01:02:52.643233+0000","last_fullsized":"2024-09-12T01:02:52.643233+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:02:52.642900+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:02:52.642900+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.642900+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:21.246963+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7614964,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":429,"num_read_kb":53256,"num_write":866,"num_write_kb":32142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1470,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.204641+0000","last_change":"2024-09-12T01:03:03.204641+0000","last_active":"2024-09-12T01:03:03.204641+0000","last_peered":"2024-09-12T01:03:03.204641+0000","last_clean":"2024-09-12T01:03:03.204641+0000","last_became_active":"2024-09-12T00:15:59.035380+0000","last_became_peered":"2024-09-12T00:15:59.035380+0000","last_unstale":"2024-09-12T01:03:03.204641+0000","last_undegraded":"2024-09-12T01:03:03.204641+0000","last_fullsized":"2024-09-12T01:03:03.204641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:03:03.204443+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:03:03.204443+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.204443+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:11.470633+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":957,"num_read_kb":957,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"268'85","reported_seq":610,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.231535+0000","last_change":"2024-09-12T01:03:06.231381+0000","last_active":"2024-09-12T01:03:06.231535+0000","last_peered":"2024-09-12T01:03:06.231535+0000","last_clean":"2024-09-12T01:03:06.231535+0000","last_became_active":"2024-09-12T00:16:01.065038+0000","last_became_peered":"2024-09-12T00:16:01.065038+0000","last_unstale":"2024-09-12T01:03:06.231535+0000","last_undegraded":"2024-09-12T01:03:06.231535+0000","last_fullsized":"2024-09-12T01:03:06.231535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'85","last_scrub_stamp":"2024-09-12T01:03:06.231109+0000","last_deep_scrub":"268'85","last_deep_scrub_stamp":"2024-09-12T01:03:06.231109+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.231109+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:56.855213+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"268'798","reported_seq":2374,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.300957+0000","last_change":"2024-09-12T01:03:08.300708+0000","last_active":"2024-09-12T01:03:08.300957+0000","last_peered":"2024-09-12T01:03:08.300957+0000","last_clean":"2024-09-12T01:03:08.300957+0000","last_became_active":"2024-09-12T00:16:03.088856+0000","last_became_peered":"2024-09-12T00:16:03.088856+0000","last_unstale":"2024-09-12T01:03:08.300957+0000","last_undegraded":"2024-09-12T01:03:08.300957+0000","last_fullsized":"2024-09-12T01:03:08.300957+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'798","last_scrub_stamp":"2024-09-12T01:03:08.300494+0000","last_deep_scrub":"268'798","last_deep_scrub_stamp":"2024-09-12T01:03:08.300494+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.300494+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:31.004109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"268'127","reported_seq":643,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.575118+0000","last_change":"2024-09-12T01:03:10.575118+0000","last_active":"2024-09-12T01:03:10.575118+0000","last_peered":"2024-09-12T01:03:10.575118+0000","last_clean":"2024-09-12T01:03:10.575118+0000","last_became_active":"2024-09-12T00:16:05.107712+0000","last_became_peered":"2024-09-12T00:16:05.107712+0000","last_unstale":"2024-09-12T01:03:10.575118+0000","last_undegraded":"2024-09-12T01:03:10.575118+0000","last_fullsized":"2024-09-12T01:03:10.575118+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-09-12T01:03:10.574900+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-09-12T01:03:10.574900+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.574900+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:18.976742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":150,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"268'859","reported_seq":2484,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.716496+0000","last_change":"2024-09-12T01:02:50.716343+0000","last_active":"2024-09-12T01:02:50.716496+0000","last_peered":"2024-09-12T01:02:50.716496+0000","last_clean":"2024-09-12T01:02:50.716496+0000","last_became_active":"2024-09-12T00:15:57.043447+0000","last_became_peered":"2024-09-12T00:15:57.043447+0000","last_unstale":"2024-09-12T01:02:50.716496+0000","last_undegraded":"2024-09-12T01:02:50.716496+0000","last_fullsized":"2024-09-12T01:02:50.716496+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'859","last_scrub_stamp":"2024-09-12T01:02:50.716156+0000","last_deep_scrub":"268'859","last_deep_scrub_stamp":"2024-09-12T01:02:50.716156+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.716156+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:50.072424+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4138,"num_read_kb":3738,"num_write":1141,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2781,"num_omap_keys":11,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"268'317","reported_seq":965,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.303242+0000","last_change":"2024-09-12T01:02:49.303242+0000","last_active":"2024-09-12T01:02:49.303242+0000","last_peered":"2024-09-12T01:02:49.303242+0000","last_clean":"2024-09-12T01:02:49.303242+0000","last_became_active":"2024-09-12T00:15:55.039512+0000","last_became_peered":"2024-09-12T00:15:55.039512+0000","last_unstale":"2024-09-12T01:02:49.303242+0000","last_undegraded":"2024-09-12T01:02:49.303242+0000","last_fullsized":"2024-09-12T01:02:49.303242+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'317","last_scrub_stamp":"2024-09-12T01:02:49.302955+0000","last_deep_scrub":"268'317","last_deep_scrub_stamp":"2024-09-12T01:02:49.302955+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.302955+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:28.690417+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655867,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":425,"num_read_kb":56944,"num_write":985,"num_write_kb":41414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.587414+0000","last_change":"2024-09-12T01:03:12.587270+0000","last_active":"2024-09-12T01:03:12.587414+0000","last_peered":"2024-09-12T01:03:12.587414+0000","last_clean":"2024-09-12T01:03:12.587414+0000","last_became_active":"2024-09-12T00:15:59.046018+0000","last_became_peered":"2024-09-12T00:15:59.046018+0000","last_unstale":"2024-09-12T01:03:12.587414+0000","last_undegraded":"2024-09-12T01:03:12.587414+0000","last_fullsized":"2024-09-12T01:03:12.587414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:12.587065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:12.587065+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.587065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:50.322069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"268'340","reported_seq":958,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.165014+0000","last_change":"2024-09-12T01:03:02.164857+0000","last_active":"2024-09-12T01:03:02.165014+0000","last_peered":"2024-09-12T01:03:02.165014+0000","last_clean":"2024-09-12T01:03:02.165014+0000","last_became_active":"2024-09-12T00:16:01.069078+0000","last_became_peered":"2024-09-12T00:16:01.069078+0000","last_unstale":"2024-09-12T01:03:02.165014+0000","last_undegraded":"2024-09-12T01:03:02.165014+0000","last_fullsized":"2024-09-12T01:03:02.165014+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'340","last_scrub_stamp":"2024-09-12T01:03:02.164644+0000","last_deep_scrub":"268'340","last_deep_scrub_stamp":"2024-09-12T01:03:02.164644+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.164644+0000","objects_scrubbed":8,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:23.713601+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46997,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":1097,"num_write":420,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.527950+0000","last_change":"2024-09-12T01:03:05.527830+0000","last_active":"2024-09-12T01:03:05.527950+0000","last_peered":"2024-09-12T01:03:05.527950+0000","last_clean":"2024-09-12T01:03:05.527950+0000","last_became_active":"2024-09-12T00:16:03.106662+0000","last_became_peered":"2024-09-12T00:16:03.106662+0000","last_unstale":"2024-09-12T01:03:05.527950+0000","last_undegraded":"2024-09-12T01:03:05.527950+0000","last_fullsized":"2024-09-12T01:03:05.527950+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:05.527635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:05.527635+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.527635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:41.284662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"268'137","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.939466+0000","last_change":"2024-09-12T01:03:09.939466+0000","last_active":"2024-09-12T01:03:09.939466+0000","last_peered":"2024-09-12T01:03:09.939466+0000","last_clean":"2024-09-12T01:03:09.939466+0000","last_became_active":"2024-09-12T00:16:05.111705+0000","last_became_peered":"2024-09-12T00:16:05.111705+0000","last_unstale":"2024-09-12T01:03:09.939466+0000","last_undegraded":"2024-09-12T01:03:09.939466+0000","last_fullsized":"2024-09-12T01:03:09.939466+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'137","last_scrub_stamp":"2024-09-12T01:03:09.939285+0000","last_deep_scrub":"268'137","last_deep_scrub_stamp":"2024-09-12T01:03:09.939285+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.939285+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:38.978042+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":316,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"268'515","reported_seq":2104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.567033+0000","last_change":"2024-09-12T01:03:00.567033+0000","last_active":"2024-09-12T01:03:00.567033+0000","last_peered":"2024-09-12T01:03:00.567033+0000","last_clean":"2024-09-12T01:03:00.567033+0000","last_became_active":"2024-09-12T00:15:57.029211+0000","last_became_peered":"2024-09-12T00:15:57.029211+0000","last_unstale":"2024-09-12T01:03:00.567033+0000","last_undegraded":"2024-09-12T01:03:00.567033+0000","last_fullsized":"2024-09-12T01:03:00.567033+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'515","last_scrub_stamp":"2024-09-12T01:03:00.566844+0000","last_deep_scrub":"268'515","last_deep_scrub_stamp":"2024-09-12T01:03:00.566844+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.566844+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:35.368781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2638,"num_read_kb":2449,"num_write":617,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:45.219078+0000","last_change":"2024-09-12T01:02:45.219078+0000","last_active":"2024-09-12T01:02:45.219078+0000","last_peered":"2024-09-12T01:02:45.219078+0000","last_clean":"2024-09-12T01:02:45.219078+0000","last_became_active":"2024-09-12T00:15:34.145413+0000","last_became_peered":"2024-09-12T00:15:34.145413+0000","last_unstale":"2024-09-12T01:02:45.219078+0000","last_undegraded":"2024-09-12T01:02:45.219078+0000","last_fullsized":"2024-09-12T01:02:45.219078+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-12T01:02:45.219010+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-12T01:02:45.219010+0000","last_clean_scrub_stamp":"2024-09-12T01:02:45.219010+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:41.967660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.679981+0000","last_change":"2024-09-12T01:02:46.679981+0000","last_active":"2024-09-12T01:02:46.679981+0000","last_peered":"2024-09-12T01:02:46.679981+0000","last_clean":"2024-09-12T01:02:46.679981+0000","last_became_active":"2024-09-12T00:15:40.490486+0000","last_became_peered":"2024-09-12T00:15:40.490486+0000","last_unstale":"2024-09-12T01:02:46.679981+0000","last_undegraded":"2024-09-12T01:02:46.679981+0000","last_fullsized":"2024-09-12T01:02:46.679981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:02:46.679880+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:02:46.679880+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.679880+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:23.630978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013201490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"268'332","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.269848+0000","last_change":"2024-09-12T01:02:48.269848+0000","last_active":"2024-09-12T01:02:48.269848+0000","last_peered":"2024-09-12T01:02:48.269848+0000","last_clean":"2024-09-12T01:02:48.269848+0000","last_became_active":"2024-09-12T00:15:55.048230+0000","last_became_peered":"2024-09-12T00:15:55.048230+0000","last_unstale":"2024-09-12T01:02:48.269848+0000","last_undegraded":"2024-09-12T01:02:48.269848+0000","last_fullsized":"2024-09-12T01:02:48.269848+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'332","last_scrub_stamp":"2024-09-12T01:02:48.269620+0000","last_deep_scrub":"268'332","last_deep_scrub_stamp":"2024-09-12T01:02:48.269620+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.269620+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:21.536299+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":550,"num_read_kb":9775,"num_write":1119,"num_write_kb":32871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.587085+0000","last_change":"2024-09-12T01:03:03.587085+0000","last_active":"2024-09-12T01:03:03.587085+0000","last_peered":"2024-09-12T01:03:03.587085+0000","last_clean":"2024-09-12T01:03:03.587085+0000","last_became_active":"2024-09-12T00:15:59.041357+0000","last_became_peered":"2024-09-12T00:15:59.041357+0000","last_unstale":"2024-09-12T01:03:03.587085+0000","last_undegraded":"2024-09-12T01:03:03.587085+0000","last_fullsized":"2024-09-12T01:03:03.587085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:03.586925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:03.586925+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.586925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:02.037337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"268'732","reported_seq":1456,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.633798+0000","last_change":"2024-09-12T01:03:20.633798+0000","last_active":"2024-09-12T01:03:20.633798+0000","last_peered":"2024-09-12T01:03:20.633798+0000","last_clean":"2024-09-12T01:03:20.633798+0000","last_became_active":"2024-09-12T00:16:01.052016+0000","last_became_peered":"2024-09-12T00:16:01.052016+0000","last_unstale":"2024-09-12T01:03:20.633798+0000","last_undegraded":"2024-09-12T01:03:20.633798+0000","last_fullsized":"2024-09-12T01:03:20.633798+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'732","last_scrub_stamp":"2024-09-12T01:03:20.633604+0000","last_deep_scrub":"268'732","last_deep_scrub_stamp":"2024-09-12T01:03:20.633604+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.633604+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:43.763989+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164258,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1426,"num_read_kb":3353,"num_write":1318,"num_write_kb":1186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89358,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.542440+0000","last_change":"2024-09-12T01:03:16.542440+0000","last_active":"2024-09-12T01:03:16.542440+0000","last_peered":"2024-09-12T01:03:16.542440+0000","last_clean":"2024-09-12T01:03:16.542440+0000","last_became_active":"2024-09-12T00:16:03.097343+0000","last_became_peered":"2024-09-12T00:16:03.097343+0000","last_unstale":"2024-09-12T01:03:16.542440+0000","last_undegraded":"2024-09-12T01:03:16.542440+0000","last_fullsized":"2024-09-12T01:03:16.542440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:16.542262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:16.542262+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.542262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:38.878863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"268'175","reported_seq":882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.574673+0000","last_change":"2024-09-12T01:03:07.574673+0000","last_active":"2024-09-12T01:03:07.574673+0000","last_peered":"2024-09-12T01:03:07.574673+0000","last_clean":"2024-09-12T01:03:07.574673+0000","last_became_active":"2024-09-12T00:16:05.113366+0000","last_became_peered":"2024-09-12T00:16:05.113366+0000","last_unstale":"2024-09-12T01:03:07.574673+0000","last_undegraded":"2024-09-12T01:03:07.574673+0000","last_fullsized":"2024-09-12T01:03:07.574673+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'175","last_scrub_stamp":"2024-09-12T01:03:07.574482+0000","last_deep_scrub":"268'175","last_deep_scrub_stamp":"2024-09-12T01:03:07.574482+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.574482+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:52.409139+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1020,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":408,"num_write":348,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"268'1046","reported_seq":2801,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.449118+0000","last_change":"2024-09-12T01:03:00.449118+0000","last_active":"2024-09-12T01:03:00.449118+0000","last_peered":"2024-09-12T01:03:00.449118+0000","last_clean":"2024-09-12T01:03:00.449118+0000","last_became_active":"2024-09-12T00:15:57.047672+0000","last_became_peered":"2024-09-12T00:15:57.047672+0000","last_unstale":"2024-09-12T01:03:00.449118+0000","last_undegraded":"2024-09-12T01:03:00.449118+0000","last_fullsized":"2024-09-12T01:03:00.449118+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1046","last_scrub_stamp":"2024-09-12T01:03:00.448926+0000","last_deep_scrub":"268'1046","last_deep_scrub_stamp":"2024-09-12T01:03:00.448926+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.448926+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":1000,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:49.266149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5053,"num_read_kb":4502,"num_write":1469,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":542,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.723987+0000","last_change":"2024-09-12T01:02:47.723987+0000","last_active":"2024-09-12T01:02:47.723987+0000","last_peered":"2024-09-12T01:02:47.723987+0000","last_clean":"2024-09-12T01:02:47.723987+0000","last_became_active":"2024-09-12T00:15:40.098303+0000","last_became_peered":"2024-09-12T00:15:40.098303+0000","last_unstale":"2024-09-12T01:02:47.723987+0000","last_undegraded":"2024-09-12T01:02:47.723987+0000","last_fullsized":"2024-09-12T01:02:47.723987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:47.723827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:47.723827+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.723827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:34.869689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0017858660000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"268'328","reported_seq":989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.047495+0000","last_change":"2024-09-12T01:02:47.047495+0000","last_active":"2024-09-12T01:02:47.047495+0000","last_peered":"2024-09-12T01:02:47.047495+0000","last_clean":"2024-09-12T01:02:47.047495+0000","last_became_active":"2024-09-12T00:15:55.050874+0000","last_became_peered":"2024-09-12T00:15:55.050874+0000","last_unstale":"2024-09-12T01:02:47.047495+0000","last_undegraded":"2024-09-12T01:02:47.047495+0000","last_fullsized":"2024-09-12T01:02:47.047495+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'328","last_scrub_stamp":"2024-09-12T01:02:47.047228+0000","last_deep_scrub":"268'328","last_deep_scrub_stamp":"2024-09-12T01:02:47.047228+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.047228+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:26.163227+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2684897,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":131172,"num_write":1059,"num_write_kb":57813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.575165+0000","last_change":"2024-09-12T01:03:14.575165+0000","last_active":"2024-09-12T01:03:14.575165+0000","last_peered":"2024-09-12T01:03:14.575165+0000","last_clean":"2024-09-12T01:03:14.575165+0000","last_became_active":"2024-09-12T00:15:59.030858+0000","last_became_peered":"2024-09-12T00:15:59.030858+0000","last_unstale":"2024-09-12T01:03:14.575165+0000","last_undegraded":"2024-09-12T01:03:14.575165+0000","last_fullsized":"2024-09-12T01:03:14.575165+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:14.574985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:14.574985+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.574985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:22.049180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"268'1320","reported_seq":2830,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.853324+0000","last_change":"2024-09-12T01:03:02.853324+0000","last_active":"2024-09-12T01:03:02.853324+0000","last_peered":"2024-09-12T01:03:02.853324+0000","last_clean":"2024-09-12T01:03:02.853324+0000","last_became_active":"2024-09-12T00:16:01.057956+0000","last_became_peered":"2024-09-12T00:16:01.057956+0000","last_unstale":"2024-09-12T01:03:02.853324+0000","last_undegraded":"2024-09-12T01:03:02.853324+0000","last_fullsized":"2024-09-12T01:03:02.853324+0000","mapping_epoch":32,"log_start":"268'1300","ondisk_log_start":"268'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1320","last_scrub_stamp":"2024-09-12T01:03:02.853122+0000","last_deep_scrub":"268'1320","last_deep_scrub_stamp":"2024-09-12T01:03:02.853122+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.853122+0000","objects_scrubbed":12,"log_size":20,"log_dups_size":1300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:44.062604+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158341,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2071,"num_read_kb":3936,"num_write":1172,"num_write_kb":1006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.559225+0000","last_change":"2024-09-12T01:03:23.559225+0000","last_active":"2024-09-12T01:03:23.559225+0000","last_peered":"2024-09-12T01:03:23.559225+0000","last_clean":"2024-09-12T01:03:23.559225+0000","last_became_active":"2024-09-12T00:16:03.104040+0000","last_became_peered":"2024-09-12T00:16:03.104040+0000","last_unstale":"2024-09-12T01:03:23.559225+0000","last_undegraded":"2024-09-12T01:03:23.559225+0000","last_fullsized":"2024-09-12T01:03:23.559225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:23.559011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:23.559011+0000","last_clean_scrub_stamp":"2024-09-12T01:03:23.559011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:45.337736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"268'223","reported_seq":757,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.641357+0000","last_change":"2024-09-12T01:03:20.641357+0000","last_active":"2024-09-12T01:03:20.641357+0000","last_peered":"2024-09-12T01:03:20.641357+0000","last_clean":"2024-09-12T01:03:20.641357+0000","last_became_active":"2024-09-12T00:16:05.099987+0000","last_became_peered":"2024-09-12T00:16:05.099987+0000","last_unstale":"2024-09-12T01:03:20.641357+0000","last_undegraded":"2024-09-12T01:03:20.641357+0000","last_fullsized":"2024-09-12T01:03:20.641357+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'223","last_scrub_stamp":"2024-09-12T01:03:20.641126+0000","last_deep_scrub":"268'223","last_deep_scrub_stamp":"2024-09-12T01:03:20.641126+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.641126+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:03.375193+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":366,"num_read_kb":355,"num_write":494,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"268'397","reported_seq":1898,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.049982+0000","last_change":"2024-09-12T01:02:56.049982+0000","last_active":"2024-09-12T01:02:56.049982+0000","last_peered":"2024-09-12T01:02:56.049982+0000","last_clean":"2024-09-12T01:02:56.049982+0000","last_became_active":"2024-09-12T00:15:57.022193+0000","last_became_peered":"2024-09-12T00:15:57.022193+0000","last_unstale":"2024-09-12T01:02:56.049982+0000","last_undegraded":"2024-09-12T01:02:56.049982+0000","last_fullsized":"2024-09-12T01:02:56.049982+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'397","last_scrub_stamp":"2024-09-12T01:02:56.049789+0000","last_deep_scrub":"268'397","last_deep_scrub_stamp":"2024-09-12T01:02:56.049789+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.049789+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.648345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2164,"num_read_kb":2061,"num_write":440,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1009,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.684705+0000","last_change":"2024-09-12T01:02:47.684705+0000","last_active":"2024-09-12T01:02:47.684705+0000","last_peered":"2024-09-12T01:02:47.684705+0000","last_clean":"2024-09-12T01:02:47.684705+0000","last_became_active":"2024-09-12T00:15:40.095888+0000","last_became_peered":"2024-09-12T00:15:40.095888+0000","last_unstale":"2024-09-12T01:02:47.684705+0000","last_undegraded":"2024-09-12T01:02:47.684705+0000","last_fullsized":"2024-09-12T01:02:47.684705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:47.684478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:47.684478+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.684478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:12.159645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000883303,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"268'366","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.311262+0000","last_change":"2024-09-12T01:02:47.311262+0000","last_active":"2024-09-12T01:02:47.311262+0000","last_peered":"2024-09-12T01:02:47.311262+0000","last_clean":"2024-09-12T01:02:47.311262+0000","last_became_active":"2024-09-12T00:15:55.043174+0000","last_became_peered":"2024-09-12T00:15:55.043174+0000","last_unstale":"2024-09-12T01:02:47.311262+0000","last_undegraded":"2024-09-12T01:02:47.311262+0000","last_fullsized":"2024-09-12T01:02:47.311262+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'366","last_scrub_stamp":"2024-09-12T01:02:47.311008+0000","last_deep_scrub":"268'366","last_deep_scrub_stamp":"2024-09-12T01:02:47.311008+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.311008+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.727357+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":498,"num_read_kb":17440,"num_write":1129,"num_write_kb":28417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.786958+0000","last_change":"2024-09-12T01:02:59.786958+0000","last_active":"2024-09-12T01:02:59.786958+0000","last_peered":"2024-09-12T01:02:59.786958+0000","last_clean":"2024-09-12T01:02:59.786958+0000","last_became_active":"2024-09-12T00:15:59.033660+0000","last_became_peered":"2024-09-12T00:15:59.033660+0000","last_unstale":"2024-09-12T01:02:59.786958+0000","last_undegraded":"2024-09-12T01:02:59.786958+0000","last_fullsized":"2024-09-12T01:02:59.786958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:02:59.786685+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:02:59.786685+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.786685+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:29.273758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"268'260","reported_seq":1373,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.587816+0000","last_change":"2024-09-12T01:03:02.587816+0000","last_active":"2024-09-12T01:03:02.587816+0000","last_peered":"2024-09-12T01:03:02.587816+0000","last_clean":"2024-09-12T01:03:02.587816+0000","last_became_active":"2024-09-12T00:16:01.072168+0000","last_became_peered":"2024-09-12T00:16:01.072168+0000","last_unstale":"2024-09-12T01:03:02.587816+0000","last_undegraded":"2024-09-12T01:03:02.587816+0000","last_fullsized":"2024-09-12T01:03:02.587816+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'260","last_scrub_stamp":"2024-09-12T01:03:02.587570+0000","last_deep_scrub":"268'260","last_deep_scrub_stamp":"2024-09-12T01:03:02.587570+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.587570+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:58.907887+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.355434+0000","last_change":"2024-09-12T01:03:17.355434+0000","last_active":"2024-09-12T01:03:17.355434+0000","last_peered":"2024-09-12T01:03:17.355434+0000","last_clean":"2024-09-12T01:03:17.355434+0000","last_became_active":"2024-09-12T00:16:03.086646+0000","last_became_peered":"2024-09-12T00:16:03.086646+0000","last_unstale":"2024-09-12T01:03:17.355434+0000","last_undegraded":"2024-09-12T01:03:17.355434+0000","last_fullsized":"2024-09-12T01:03:17.355434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:17.355239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:17.355239+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.355239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:34.338519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"268'263","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.308774+0000","last_change":"2024-09-12T01:03:21.308615+0000","last_active":"2024-09-12T01:03:21.308774+0000","last_peered":"2024-09-12T01:03:21.308774+0000","last_clean":"2024-09-12T01:03:21.308774+0000","last_became_active":"2024-09-12T00:16:05.094684+0000","last_became_peered":"2024-09-12T00:16:05.094684+0000","last_unstale":"2024-09-12T01:03:21.308774+0000","last_undegraded":"2024-09-12T01:03:21.308774+0000","last_fullsized":"2024-09-12T01:03:21.308774+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'263","last_scrub_stamp":"2024-09-12T01:03:21.308439+0000","last_deep_scrub":"268'263","last_deep_scrub_stamp":"2024-09-12T01:03:21.308439+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.308439+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:00.925946+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":550,"num_read_kb":556,"num_write":574,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"268'874","reported_seq":2479,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.005503+0000","last_change":"2024-09-12T01:02:57.005503+0000","last_active":"2024-09-12T01:02:57.005503+0000","last_peered":"2024-09-12T01:02:57.005503+0000","last_clean":"2024-09-12T01:02:57.005503+0000","last_became_active":"2024-09-12T00:15:57.049533+0000","last_became_peered":"2024-09-12T00:15:57.049533+0000","last_unstale":"2024-09-12T01:02:57.005503+0000","last_undegraded":"2024-09-12T01:02:57.005503+0000","last_fullsized":"2024-09-12T01:02:57.005503+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'874","last_scrub_stamp":"2024-09-12T01:02:57.005246+0000","last_deep_scrub":"268'874","last_deep_scrub_stamp":"2024-09-12T01:02:57.005246+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.005246+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:59.310768+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4105,"num_read_kb":3691,"num_write":1162,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":544,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:45.698348+0000","last_change":"2024-09-12T01:02:45.698348+0000","last_active":"2024-09-12T01:02:45.698348+0000","last_peered":"2024-09-12T01:02:45.698348+0000","last_clean":"2024-09-12T01:02:45.698348+0000","last_became_active":"2024-09-12T00:15:40.144614+0000","last_became_peered":"2024-09-12T00:15:40.144614+0000","last_unstale":"2024-09-12T01:02:45.698348+0000","last_undegraded":"2024-09-12T01:02:45.698348+0000","last_fullsized":"2024-09-12T01:02:45.698348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:02:45.698281+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:02:45.698281+0000","last_clean_scrub_stamp":"2024-09-12T01:02:45.698281+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:37.018108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0019634679999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"268'351","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:45.560698+0000","last_change":"2024-09-12T01:02:45.560698+0000","last_active":"2024-09-12T01:02:45.560698+0000","last_peered":"2024-09-12T01:02:45.560698+0000","last_clean":"2024-09-12T01:02:45.560698+0000","last_became_active":"2024-09-12T00:15:55.060303+0000","last_became_peered":"2024-09-12T00:15:55.060303+0000","last_unstale":"2024-09-12T01:02:45.560698+0000","last_undegraded":"2024-09-12T01:02:45.560698+0000","last_fullsized":"2024-09-12T01:02:45.560698+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'351","last_scrub_stamp":"2024-09-12T01:02:45.560574+0000","last_deep_scrub":"268'351","last_deep_scrub_stamp":"2024-09-12T01:02:45.560574+0000","last_clean_scrub_stamp":"2024-09-12T01:02:45.560574+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:31.985568+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262201,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":640,"num_read_kb":10990,"num_write":1328,"num_write_kb":39626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.777064+0000","last_change":"2024-09-12T01:02:57.777064+0000","last_active":"2024-09-12T01:02:57.777064+0000","last_peered":"2024-09-12T01:02:57.777064+0000","last_clean":"2024-09-12T01:02:57.777064+0000","last_became_active":"2024-09-12T00:15:59.042545+0000","last_became_peered":"2024-09-12T00:15:59.042545+0000","last_unstale":"2024-09-12T01:02:57.777064+0000","last_undegraded":"2024-09-12T01:02:57.777064+0000","last_fullsized":"2024-09-12T01:02:57.777064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:57.776886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:57.776886+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.776886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:31.335494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"268'147","reported_seq":693,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.523810+0000","last_change":"2024-09-12T01:03:12.523810+0000","last_active":"2024-09-12T01:03:12.523810+0000","last_peered":"2024-09-12T01:03:12.523810+0000","last_clean":"2024-09-12T01:03:12.523810+0000","last_became_active":"2024-09-12T00:16:01.047278+0000","last_became_peered":"2024-09-12T00:16:01.047278+0000","last_unstale":"2024-09-12T01:03:12.523810+0000","last_undegraded":"2024-09-12T01:03:12.523810+0000","last_fullsized":"2024-09-12T01:03:12.523810+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'147","last_scrub_stamp":"2024-09-12T01:03:12.523474+0000","last_deep_scrub":"268'147","last_deep_scrub_stamp":"2024-09-12T01:03:12.523474+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.523474+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:43.617120+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":143,"num_write":118,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:24.218190+0000","last_change":"2024-09-12T00:16:03.097752+0000","last_active":"2024-09-12T00:59:24.218190+0000","last_peered":"2024-09-12T00:59:24.218190+0000","last_clean":"2024-09-12T00:59:24.218190+0000","last_became_active":"2024-09-12T00:16:03.097029+0000","last_became_peered":"2024-09-12T00:16:03.097029+0000","last_unstale":"2024-09-12T00:59:24.218190+0000","last_undegraded":"2024-09-12T00:59:24.218190+0000","last_fullsized":"2024-09-12T00:59:24.218190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:58.710309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"268'158","reported_seq":741,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.301829+0000","last_change":"2024-09-12T01:03:14.301829+0000","last_active":"2024-09-12T01:03:14.301829+0000","last_peered":"2024-09-12T01:03:14.301829+0000","last_clean":"2024-09-12T01:03:14.301829+0000","last_became_active":"2024-09-12T00:16:05.111534+0000","last_became_peered":"2024-09-12T00:16:05.111534+0000","last_unstale":"2024-09-12T01:03:14.301829+0000","last_undegraded":"2024-09-12T01:03:14.301829+0000","last_fullsized":"2024-09-12T01:03:14.301829+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'158","last_scrub_stamp":"2024-09-12T01:03:14.301639+0000","last_deep_scrub":"268'158","last_deep_scrub_stamp":"2024-09-12T01:03:14.301639+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.301639+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:43.779965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":344,"num_read_kb":315,"num_write":411,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"268'449","reported_seq":1941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.027532+0000","last_change":"2024-09-12T01:02:54.027532+0000","last_active":"2024-09-12T01:02:54.027532+0000","last_peered":"2024-09-12T01:02:54.027532+0000","last_clean":"2024-09-12T01:02:54.027532+0000","last_became_active":"2024-09-12T00:15:57.023909+0000","last_became_peered":"2024-09-12T00:15:57.023909+0000","last_unstale":"2024-09-12T01:02:54.027532+0000","last_undegraded":"2024-09-12T01:02:54.027532+0000","last_fullsized":"2024-09-12T01:02:54.027532+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'449","last_scrub_stamp":"2024-09-12T01:02:54.027335+0000","last_deep_scrub":"268'449","last_deep_scrub_stamp":"2024-09-12T01:02:54.027335+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.027335+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:33.856984+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2256,"num_read_kb":2116,"num_write":511,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"268'339","reported_seq":990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.549338+0000","last_change":"2024-09-12T01:02:47.549338+0000","last_active":"2024-09-12T01:02:47.549338+0000","last_peered":"2024-09-12T01:02:47.549338+0000","last_clean":"2024-09-12T01:02:47.549338+0000","last_became_active":"2024-09-12T00:15:55.056576+0000","last_became_peered":"2024-09-12T00:15:55.056576+0000","last_unstale":"2024-09-12T01:02:47.549338+0000","last_undegraded":"2024-09-12T01:02:47.549338+0000","last_fullsized":"2024-09-12T01:02:47.549338+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:02:47.549107+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:02:47.549107+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.549107+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:06.125443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262186,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":507,"num_write":1203,"num_write_kb":27643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.352302+0000","last_change":"2024-09-12T01:02:46.352302+0000","last_active":"2024-09-12T01:02:46.352302+0000","last_peered":"2024-09-12T01:02:46.352302+0000","last_clean":"2024-09-12T01:02:46.352302+0000","last_became_active":"2024-09-12T00:15:40.141037+0000","last_became_peered":"2024-09-12T00:15:40.141037+0000","last_unstale":"2024-09-12T01:02:46.352302+0000","last_undegraded":"2024-09-12T01:02:46.352302+0000","last_fullsized":"2024-09-12T01:02:46.352302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:46.352119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:46.352119+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.352119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:08.133964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00088972300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.247303+0000","last_change":"2024-09-12T01:03:04.247303+0000","last_active":"2024-09-12T01:03:04.247303+0000","last_peered":"2024-09-12T01:03:04.247303+0000","last_clean":"2024-09-12T01:03:04.247303+0000","last_became_active":"2024-09-12T00:15:59.043935+0000","last_became_peered":"2024-09-12T00:15:59.043935+0000","last_unstale":"2024-09-12T01:03:04.247303+0000","last_undegraded":"2024-09-12T01:03:04.247303+0000","last_fullsized":"2024-09-12T01:03:04.247303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:04.247115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:04.247115+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.247115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:28.609481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"268'569","reported_seq":1251,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.861542+0000","last_change":"2024-09-12T01:03:01.861542+0000","last_active":"2024-09-12T01:03:01.861542+0000","last_peered":"2024-09-12T01:03:01.861542+0000","last_clean":"2024-09-12T01:03:01.861542+0000","last_became_active":"2024-09-12T00:16:01.051753+0000","last_became_peered":"2024-09-12T00:16:01.051753+0000","last_unstale":"2024-09-12T01:03:01.861542+0000","last_undegraded":"2024-09-12T01:03:01.861542+0000","last_fullsized":"2024-09-12T01:03:01.861542+0000","mapping_epoch":32,"log_start":"268'500","ondisk_log_start":"268'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'569","last_scrub_stamp":"2024-09-12T01:03:01.861331+0000","last_deep_scrub":"268'569","last_deep_scrub_stamp":"2024-09-12T01:03:01.861331+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.861331+0000","objects_scrubbed":11,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:48.337067+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93866,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1568,"num_read_kb":2666,"num_write":2048,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508024,"num_omap_keys":1152,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.555774+0000","last_change":"2024-09-12T01:03:02.555774+0000","last_active":"2024-09-12T01:03:02.555774+0000","last_peered":"2024-09-12T01:03:02.555774+0000","last_clean":"2024-09-12T01:03:02.555774+0000","last_became_active":"2024-09-12T00:16:03.099491+0000","last_became_peered":"2024-09-12T00:16:03.099491+0000","last_unstale":"2024-09-12T01:03:02.555774+0000","last_undegraded":"2024-09-12T01:03:02.555774+0000","last_fullsized":"2024-09-12T01:03:02.555774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:02.555464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:02.555464+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.555464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:31.132662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"268'115","reported_seq":619,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.606620+0000","last_change":"2024-09-12T01:03:21.606441+0000","last_active":"2024-09-12T01:03:21.606620+0000","last_peered":"2024-09-12T01:03:21.606620+0000","last_clean":"2024-09-12T01:03:21.606620+0000","last_became_active":"2024-09-12T00:16:05.099975+0000","last_became_peered":"2024-09-12T00:16:05.099975+0000","last_unstale":"2024-09-12T01:03:21.606620+0000","last_undegraded":"2024-09-12T01:03:21.606620+0000","last_fullsized":"2024-09-12T01:03:21.606620+0000","mapping_epoch":36,"log_start":"268'101","ondisk_log_start":"268'101","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-12T01:03:21.606224+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-12T01:03:21.606224+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.606224+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":101,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:41.692200+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":90,"num_write":249,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"268'516","reported_seq":2250,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.037253+0000","last_change":"2024-09-12T01:02:55.037253+0000","last_active":"2024-09-12T01:02:55.037253+0000","last_peered":"2024-09-12T01:02:55.037253+0000","last_clean":"2024-09-12T01:02:55.037253+0000","last_became_active":"2024-09-12T00:15:57.019345+0000","last_became_peered":"2024-09-12T00:15:57.019345+0000","last_unstale":"2024-09-12T01:02:55.037253+0000","last_undegraded":"2024-09-12T01:02:55.037253+0000","last_fullsized":"2024-09-12T01:02:55.037253+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'516","last_scrub_stamp":"2024-09-12T01:02:55.037012+0000","last_deep_scrub":"268'516","last_deep_scrub_stamp":"2024-09-12T01:02:55.037012+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.037012+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:43.360929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2840,"num_read_kb":2674,"num_write":601,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2992,"num_omap_keys":12,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"268'351","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.075635+0000","last_change":"2024-09-12T01:02:48.075635+0000","last_active":"2024-09-12T01:02:48.075635+0000","last_peered":"2024-09-12T01:02:48.075635+0000","last_clean":"2024-09-12T01:02:48.075635+0000","last_became_active":"2024-09-12T00:15:55.064444+0000","last_became_peered":"2024-09-12T00:15:55.064444+0000","last_unstale":"2024-09-12T01:02:48.075635+0000","last_undegraded":"2024-09-12T01:02:48.075635+0000","last_fullsized":"2024-09-12T01:02:48.075635+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'351","last_scrub_stamp":"2024-09-12T01:02:48.075374+0000","last_deep_scrub":"268'351","last_deep_scrub_stamp":"2024-09-12T01:02:48.075374+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.075374+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:20.154477+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6340294,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":472,"num_read_kb":45788,"num_write":1017,"num_write_kb":51853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.583864+0000","last_change":"2024-09-12T01:02:57.583864+0000","last_active":"2024-09-12T01:02:57.583864+0000","last_peered":"2024-09-12T01:02:57.583864+0000","last_clean":"2024-09-12T01:02:57.583864+0000","last_became_active":"2024-09-12T00:15:40.093718+0000","last_became_peered":"2024-09-12T00:15:40.093718+0000","last_unstale":"2024-09-12T01:02:57.583864+0000","last_undegraded":"2024-09-12T01:02:57.583864+0000","last_fullsized":"2024-09-12T01:02:57.583864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:57.583651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:57.583651+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.583651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:24.058214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001992522,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.571338+0000","last_change":"2024-09-12T01:02:56.571338+0000","last_active":"2024-09-12T01:02:56.571338+0000","last_peered":"2024-09-12T01:02:56.571338+0000","last_clean":"2024-09-12T01:02:56.571338+0000","last_became_active":"2024-09-12T00:15:59.041390+0000","last_became_peered":"2024-09-12T00:15:59.041390+0000","last_unstale":"2024-09-12T01:02:56.571338+0000","last_undegraded":"2024-09-12T01:02:56.571338+0000","last_fullsized":"2024-09-12T01:02:56.571338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:56.571111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:56.571111+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.571111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:00.193486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"268'163","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.191543+0000","last_change":"2024-09-12T01:03:05.191543+0000","last_active":"2024-09-12T01:03:05.191543+0000","last_peered":"2024-09-12T01:03:05.191543+0000","last_clean":"2024-09-12T01:03:05.191543+0000","last_became_active":"2024-09-12T00:16:01.050630+0000","last_became_peered":"2024-09-12T00:16:01.050630+0000","last_unstale":"2024-09-12T01:03:05.191543+0000","last_undegraded":"2024-09-12T01:03:05.191543+0000","last_fullsized":"2024-09-12T01:03:05.191543+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'163","last_scrub_stamp":"2024-09-12T01:03:05.191433+0000","last_deep_scrub":"268'163","last_deep_scrub_stamp":"2024-09-12T01:03:05.191433+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.191433+0000","objects_scrubbed":8,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:08.125461+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":205,"num_read_kb":196,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"268'798","reported_seq":2736,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.261963+0000","last_change":"2024-09-12T01:03:07.261963+0000","last_active":"2024-09-12T01:03:07.261963+0000","last_peered":"2024-09-12T01:03:07.261963+0000","last_clean":"2024-09-12T01:03:07.261963+0000","last_became_active":"2024-09-12T00:16:03.104125+0000","last_became_peered":"2024-09-12T00:16:03.104125+0000","last_unstale":"2024-09-12T01:03:07.261963+0000","last_undegraded":"2024-09-12T01:03:07.261963+0000","last_fullsized":"2024-09-12T01:03:07.261963+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'798","last_scrub_stamp":"2024-09-12T01:03:07.261772+0000","last_deep_scrub":"268'798","last_deep_scrub_stamp":"2024-09-12T01:03:07.261772+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.261772+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:32.205899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"268'118","reported_seq":631,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.939925+0000","last_change":"2024-09-12T01:03:11.939925+0000","last_active":"2024-09-12T01:03:11.939925+0000","last_peered":"2024-09-12T01:03:11.939925+0000","last_clean":"2024-09-12T01:03:11.939925+0000","last_became_active":"2024-09-12T00:16:05.114695+0000","last_became_peered":"2024-09-12T00:16:05.114695+0000","last_unstale":"2024-09-12T01:03:11.939925+0000","last_undegraded":"2024-09-12T01:03:11.939925+0000","last_fullsized":"2024-09-12T01:03:11.939925+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'118","last_scrub_stamp":"2024-09-12T01:03:11.939705+0000","last_deep_scrub":"268'118","last_deep_scrub_stamp":"2024-09-12T01:03:11.939705+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.939705+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:54.343129+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":134,"num_write":263,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"268'788","reported_seq":2361,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.186009+0000","last_change":"2024-09-12T01:02:55.186009+0000","last_active":"2024-09-12T01:02:55.186009+0000","last_peered":"2024-09-12T01:02:55.186009+0000","last_clean":"2024-09-12T01:02:55.186009+0000","last_became_active":"2024-09-12T00:15:57.027778+0000","last_became_peered":"2024-09-12T00:15:57.027778+0000","last_unstale":"2024-09-12T01:02:55.186009+0000","last_undegraded":"2024-09-12T01:02:55.186009+0000","last_fullsized":"2024-09-12T01:02:55.186009+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'788","last_scrub_stamp":"2024-09-12T01:02:55.185823+0000","last_deep_scrub":"268'788","last_deep_scrub_stamp":"2024-09-12T01:02:55.185823+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.185823+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:34.413708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3889,"num_read_kb":3532,"num_write":1033,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"268'413","reported_seq":1114,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.220555+0000","last_change":"2024-09-12T01:02:47.220555+0000","last_active":"2024-09-12T01:02:47.220555+0000","last_peered":"2024-09-12T01:02:47.220555+0000","last_clean":"2024-09-12T01:02:47.220555+0000","last_became_active":"2024-09-12T00:15:55.048610+0000","last_became_peered":"2024-09-12T00:15:55.048610+0000","last_unstale":"2024-09-12T01:02:47.220555+0000","last_undegraded":"2024-09-12T01:02:47.220555+0000","last_fullsized":"2024-09-12T01:02:47.220555+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'413","last_scrub_stamp":"2024-09-12T01:02:47.220177+0000","last_deep_scrub":"268'413","last_deep_scrub_stamp":"2024-09-12T01:02:47.220177+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.220177+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:09.862325+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433395,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":696,"num_read_kb":32495,"num_write":1308,"num_write_kb":43441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.251879+0000","last_change":"2024-09-12T01:02:46.251707+0000","last_active":"2024-09-12T01:02:46.251879+0000","last_peered":"2024-09-12T01:02:46.251879+0000","last_clean":"2024-09-12T01:02:46.251879+0000","last_became_active":"2024-09-12T00:15:40.660718+0000","last_became_peered":"2024-09-12T00:15:40.660718+0000","last_unstale":"2024-09-12T01:02:46.251879+0000","last_undegraded":"2024-09-12T01:02:46.251879+0000","last_fullsized":"2024-09-12T01:02:46.251879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:46.251521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:46.251521+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.251521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:45.498343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080064100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"268'6","reported_seq":997,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.597770+0000","last_change":"2024-09-12T01:03:11.597770+0000","last_active":"2024-09-12T01:03:11.597770+0000","last_peered":"2024-09-12T01:03:11.597770+0000","last_clean":"2024-09-12T01:03:11.597770+0000","last_became_active":"2024-09-12T00:15:59.022598+0000","last_became_peered":"2024-09-12T00:15:59.022598+0000","last_unstale":"2024-09-12T01:03:11.597770+0000","last_undegraded":"2024-09-12T01:03:11.597770+0000","last_fullsized":"2024-09-12T01:03:11.597770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:03:11.597536+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:03:11.597536+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.597536+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:23.814626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"268'117","reported_seq":674,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.580915+0000","last_change":"2024-09-12T01:03:17.580915+0000","last_active":"2024-09-12T01:03:17.580915+0000","last_peered":"2024-09-12T01:03:17.580915+0000","last_clean":"2024-09-12T01:03:17.580915+0000","last_became_active":"2024-09-12T00:16:01.061378+0000","last_became_peered":"2024-09-12T00:16:01.061378+0000","last_unstale":"2024-09-12T01:03:17.580915+0000","last_undegraded":"2024-09-12T01:03:17.580915+0000","last_fullsized":"2024-09-12T01:03:17.580915+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'117","last_scrub_stamp":"2024-09-12T01:03:17.580694+0000","last_deep_scrub":"268'117","last_deep_scrub_stamp":"2024-09-12T01:03:17.580694+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.580694+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.530726+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":124,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"268'816","reported_seq":4454,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.478711+0000","last_change":"2024-09-12T01:03:13.478711+0000","last_active":"2024-09-12T01:03:13.478711+0000","last_peered":"2024-09-12T01:03:13.478711+0000","last_clean":"2024-09-12T01:03:13.478711+0000","last_became_active":"2024-09-12T00:16:03.097533+0000","last_became_peered":"2024-09-12T00:16:03.097533+0000","last_unstale":"2024-09-12T01:03:13.478711+0000","last_undegraded":"2024-09-12T01:03:13.478711+0000","last_fullsized":"2024-09-12T01:03:13.478711+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'816","last_scrub_stamp":"2024-09-12T01:03:13.478485+0000","last_deep_scrub":"268'816","last_deep_scrub_stamp":"2024-09-12T01:03:13.478485+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.478485+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:54.004043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"268'165","reported_seq":663,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:06.998687+0000","last_change":"2024-09-12T00:16:05.110783+0000","last_active":"2024-09-12T01:01:06.998687+0000","last_peered":"2024-09-12T01:01:06.998687+0000","last_clean":"2024-09-12T01:01:06.998687+0000","last_became_active":"2024-09-12T00:16:05.110012+0000","last_became_peered":"2024-09-12T00:16:05.110012+0000","last_unstale":"2024-09-12T01:01:06.998687+0000","last_undegraded":"2024-09-12T01:01:06.998687+0000","last_fullsized":"2024-09-12T01:01:06.998687+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":392,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"268'380","reported_seq":1840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.497640+0000","last_change":"2024-09-12T01:02:46.497640+0000","last_active":"2024-09-12T01:02:46.497640+0000","last_peered":"2024-09-12T01:02:46.497640+0000","last_clean":"2024-09-12T01:02:46.497640+0000","last_became_active":"2024-09-12T00:15:57.024399+0000","last_became_peered":"2024-09-12T00:15:57.024399+0000","last_unstale":"2024-09-12T01:02:46.497640+0000","last_undegraded":"2024-09-12T01:02:46.497640+0000","last_fullsized":"2024-09-12T01:02:46.497640+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-12T01:02:46.497554+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-12T01:02:46.497554+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.497554+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:56.056557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2040,"num_read_kb":1940,"num_write":430,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"268'339","reported_seq":990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.295542+0000","last_change":"2024-09-12T01:02:51.295542+0000","last_active":"2024-09-12T01:02:51.295542+0000","last_peered":"2024-09-12T01:02:51.295542+0000","last_clean":"2024-09-12T01:02:51.295542+0000","last_became_active":"2024-09-12T00:15:55.064782+0000","last_became_peered":"2024-09-12T00:15:55.064782+0000","last_unstale":"2024-09-12T01:02:51.295542+0000","last_undegraded":"2024-09-12T01:02:51.295542+0000","last_fullsized":"2024-09-12T01:02:51.295542+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:02:51.295109+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:02:51.295109+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.295109+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:28.870116+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2054932,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":492,"num_read_kb":4021,"num_write":1062,"num_write_kb":34802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.634503+0000","last_change":"2024-09-12T01:02:50.634341+0000","last_active":"2024-09-12T01:02:50.634503+0000","last_peered":"2024-09-12T01:02:50.634503+0000","last_clean":"2024-09-12T01:02:50.634503+0000","last_became_active":"2024-09-12T00:15:40.663617+0000","last_became_peered":"2024-09-12T00:15:40.663617+0000","last_unstale":"2024-09-12T01:02:50.634503+0000","last_undegraded":"2024-09-12T01:02:50.634503+0000","last_fullsized":"2024-09-12T01:02:50.634503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:50.634154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:50.634154+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.634154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:09.526825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002428801,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.197315+0000","last_change":"2024-09-12T01:03:03.197315+0000","last_active":"2024-09-12T01:03:03.197315+0000","last_peered":"2024-09-12T01:03:03.197315+0000","last_clean":"2024-09-12T01:03:03.197315+0000","last_became_active":"2024-09-12T00:15:59.039777+0000","last_became_peered":"2024-09-12T00:15:59.039777+0000","last_unstale":"2024-09-12T01:03:03.197315+0000","last_undegraded":"2024-09-12T01:03:03.197315+0000","last_fullsized":"2024-09-12T01:03:03.197315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:03.197128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:03.197128+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.197128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.560737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"268'757","reported_seq":1489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.502826+0000","last_change":"2024-09-12T01:02:59.502826+0000","last_active":"2024-09-12T01:02:59.502826+0000","last_peered":"2024-09-12T01:02:59.502826+0000","last_clean":"2024-09-12T01:02:59.502826+0000","last_became_active":"2024-09-12T00:16:01.051967+0000","last_became_peered":"2024-09-12T00:16:01.051967+0000","last_unstale":"2024-09-12T01:02:59.502826+0000","last_undegraded":"2024-09-12T01:02:59.502826+0000","last_fullsized":"2024-09-12T01:02:59.502826+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'757","last_scrub_stamp":"2024-09-12T01:02:59.502579+0000","last_deep_scrub":"268'757","last_deep_scrub_stamp":"2024-09-12T01:02:59.502579+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.502579+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:00.575310+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138756,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1351,"num_read_kb":3224,"num_write":1110,"num_write_kb":922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.353870+0000","last_change":"2024-09-12T01:03:16.353870+0000","last_active":"2024-09-12T01:03:16.353870+0000","last_peered":"2024-09-12T01:03:16.353870+0000","last_clean":"2024-09-12T01:03:16.353870+0000","last_became_active":"2024-09-12T00:16:03.091920+0000","last_became_peered":"2024-09-12T00:16:03.091920+0000","last_unstale":"2024-09-12T01:03:16.353870+0000","last_undegraded":"2024-09-12T01:03:16.353870+0000","last_fullsized":"2024-09-12T01:03:16.353870+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:16.353684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:16.353684+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.353684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:25.336831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"268'141","reported_seq":674,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.561334+0000","last_change":"2024-09-12T01:03:12.561204+0000","last_active":"2024-09-12T01:03:12.561334+0000","last_peered":"2024-09-12T01:03:12.561334+0000","last_clean":"2024-09-12T01:03:12.561334+0000","last_became_active":"2024-09-12T00:16:05.112774+0000","last_became_peered":"2024-09-12T00:16:05.112774+0000","last_unstale":"2024-09-12T01:03:12.561334+0000","last_undegraded":"2024-09-12T01:03:12.561334+0000","last_fullsized":"2024-09-12T01:03:12.561334+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'141","last_scrub_stamp":"2024-09-12T01:03:12.561023+0000","last_deep_scrub":"268'141","last_deep_scrub_stamp":"2024-09-12T01:03:12.561023+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.561023+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:48.581308+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":230,"num_write":341,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"268'115","reported_seq":684,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.318860+0000","last_change":"2024-09-12T01:03:22.318860+0000","last_active":"2024-09-12T01:03:22.318860+0000","last_peered":"2024-09-12T01:03:22.318860+0000","last_clean":"2024-09-12T01:03:22.318860+0000","last_became_active":"2024-09-12T00:16:05.097548+0000","last_became_peered":"2024-09-12T00:16:05.097548+0000","last_unstale":"2024-09-12T01:03:22.318860+0000","last_undegraded":"2024-09-12T01:03:22.318860+0000","last_fullsized":"2024-09-12T01:03:22.318860+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-12T01:03:22.318681+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-12T01:03:22.318681+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.318681+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:22.176966+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":186,"num_read_kb":184,"num_write":255,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"268'855","reported_seq":2482,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.620835+0000","last_change":"2024-09-12T01:02:55.620835+0000","last_active":"2024-09-12T01:02:55.620835+0000","last_peered":"2024-09-12T01:02:55.620835+0000","last_clean":"2024-09-12T01:02:55.620835+0000","last_became_active":"2024-09-12T00:15:57.024237+0000","last_became_peered":"2024-09-12T00:15:57.024237+0000","last_unstale":"2024-09-12T01:02:55.620835+0000","last_undegraded":"2024-09-12T01:02:55.620835+0000","last_fullsized":"2024-09-12T01:02:55.620835+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'855","last_scrub_stamp":"2024-09-12T01:02:55.620655+0000","last_deep_scrub":"268'855","last_deep_scrub_stamp":"2024-09-12T01:02:55.620655+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.620655+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:41.671381+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4086,"num_read_kb":3684,"num_write":1101,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"268'295","reported_seq":945,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.550626+0000","last_change":"2024-09-12T01:02:56.550626+0000","last_active":"2024-09-12T01:02:56.550626+0000","last_peered":"2024-09-12T01:02:56.550626+0000","last_clean":"2024-09-12T01:02:56.550626+0000","last_became_active":"2024-09-12T00:16:26.420272+0000","last_became_peered":"2024-09-12T00:16:26.420272+0000","last_unstale":"2024-09-12T01:02:56.550626+0000","last_undegraded":"2024-09-12T01:02:56.550626+0000","last_fullsized":"2024-09-12T01:02:56.550626+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'295","last_scrub_stamp":"2024-09-12T01:02:56.550382+0000","last_deep_scrub":"268'295","last_deep_scrub_stamp":"2024-09-12T01:02:56.550382+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.550382+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:32.566018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213277,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":414,"num_read_kb":13074,"num_write":956,"num_write_kb":25707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,0],"acting":[3,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"268'4","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.145180+0000","last_change":"2024-09-12T01:03:03.145180+0000","last_active":"2024-09-12T01:03:03.145180+0000","last_peered":"2024-09-12T01:03:03.145180+0000","last_clean":"2024-09-12T01:03:03.145180+0000","last_became_active":"2024-09-12T00:15:59.039169+0000","last_became_peered":"2024-09-12T00:15:59.039169+0000","last_unstale":"2024-09-12T01:03:03.145180+0000","last_undegraded":"2024-09-12T01:03:03.145180+0000","last_fullsized":"2024-09-12T01:03:03.145180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:03:03.144984+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:03:03.144984+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.144984+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:54.544211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"268'291","reported_seq":877,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.230273+0000","last_change":"2024-09-12T01:03:09.230273+0000","last_active":"2024-09-12T01:03:09.230273+0000","last_peered":"2024-09-12T01:03:09.230273+0000","last_clean":"2024-09-12T01:03:09.230273+0000","last_became_active":"2024-09-12T00:16:01.066524+0000","last_became_peered":"2024-09-12T00:16:01.066524+0000","last_unstale":"2024-09-12T01:03:09.230273+0000","last_undegraded":"2024-09-12T01:03:09.230273+0000","last_fullsized":"2024-09-12T01:03:09.230273+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'291","last_scrub_stamp":"2024-09-12T01:03:09.230064+0000","last_deep_scrub":"268'291","last_deep_scrub_stamp":"2024-09-12T01:03:09.230064+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.230064+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:35.110694+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43678,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1068,"num_write":390,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.896686+0000","last_change":"2024-09-12T01:03:05.896686+0000","last_active":"2024-09-12T01:03:05.896686+0000","last_peered":"2024-09-12T01:03:05.896686+0000","last_clean":"2024-09-12T01:03:05.896686+0000","last_became_active":"2024-09-12T00:16:03.069399+0000","last_became_peered":"2024-09-12T00:16:03.069399+0000","last_unstale":"2024-09-12T01:03:05.896686+0000","last_undegraded":"2024-09-12T01:03:05.896686+0000","last_fullsized":"2024-09-12T01:03:05.896686+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:05.896501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:05.896501+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.896501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:45.361950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"268'132","reported_seq":631,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.923979+0000","last_change":"2024-09-12T01:03:12.923979+0000","last_active":"2024-09-12T01:03:12.923979+0000","last_peered":"2024-09-12T01:03:12.923979+0000","last_clean":"2024-09-12T01:03:12.923979+0000","last_became_active":"2024-09-12T00:16:05.102118+0000","last_became_peered":"2024-09-12T00:16:05.102118+0000","last_unstale":"2024-09-12T01:03:12.923979+0000","last_undegraded":"2024-09-12T01:03:12.923979+0000","last_fullsized":"2024-09-12T01:03:12.923979+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'132","last_scrub_stamp":"2024-09-12T01:03:12.923802+0000","last_deep_scrub":"268'132","last_deep_scrub_stamp":"2024-09-12T01:03:12.923802+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.923802+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:59.417375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":111,"num_write":330,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"268'498","reported_seq":2230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.226442+0000","last_change":"2024-09-12T01:02:53.226442+0000","last_active":"2024-09-12T01:02:53.226442+0000","last_peered":"2024-09-12T01:02:53.226442+0000","last_clean":"2024-09-12T01:02:53.226442+0000","last_became_active":"2024-09-12T00:15:57.031322+0000","last_became_peered":"2024-09-12T00:15:57.031322+0000","last_unstale":"2024-09-12T01:02:53.226442+0000","last_undegraded":"2024-09-12T01:02:53.226442+0000","last_fullsized":"2024-09-12T01:02:53.226442+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'498","last_scrub_stamp":"2024-09-12T01:02:53.226262+0000","last_deep_scrub":"268'498","last_deep_scrub_stamp":"2024-09-12T01:02:53.226262+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.226262+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:59.880724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2639,"num_write":567,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"268'457","reported_seq":1173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.555317+0000","last_change":"2024-09-12T01:02:46.555317+0000","last_active":"2024-09-12T01:02:46.555317+0000","last_peered":"2024-09-12T01:02:46.555317+0000","last_clean":"2024-09-12T01:02:46.555317+0000","last_became_active":"2024-09-12T00:15:55.065964+0000","last_became_peered":"2024-09-12T00:15:55.065964+0000","last_unstale":"2024-09-12T01:02:46.555317+0000","last_undegraded":"2024-09-12T01:02:46.555317+0000","last_fullsized":"2024-09-12T01:02:46.555317+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'457","last_scrub_stamp":"2024-09-12T01:02:46.555204+0000","last_deep_scrub":"268'457","last_deep_scrub_stamp":"2024-09-12T01:02:46.555204+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.555204+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:12.493482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5768209,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":905,"num_read_kb":8759,"num_write":1307,"num_write_kb":27844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.258104+0000","last_change":"2024-09-12T01:03:05.258104+0000","last_active":"2024-09-12T01:03:05.258104+0000","last_peered":"2024-09-12T01:03:05.258104+0000","last_clean":"2024-09-12T01:03:05.258104+0000","last_became_active":"2024-09-12T00:15:59.043146+0000","last_became_peered":"2024-09-12T00:15:59.043146+0000","last_unstale":"2024-09-12T01:03:05.258104+0000","last_undegraded":"2024-09-12T01:03:05.258104+0000","last_fullsized":"2024-09-12T01:03:05.258104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:05.257925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:05.257925+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.257925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:40.514412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"268'52","reported_seq":569,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.329141+0000","last_change":"2024-09-12T01:03:12.329141+0000","last_active":"2024-09-12T01:03:12.329141+0000","last_peered":"2024-09-12T01:03:12.329141+0000","last_clean":"2024-09-12T01:03:12.329141+0000","last_became_active":"2024-09-12T00:16:01.055002+0000","last_became_peered":"2024-09-12T00:16:01.055002+0000","last_unstale":"2024-09-12T01:03:12.329141+0000","last_undegraded":"2024-09-12T01:03:12.329141+0000","last_fullsized":"2024-09-12T01:03:12.329141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'52","last_scrub_stamp":"2024-09-12T01:03:12.328903+0000","last_deep_scrub":"268'52","last_deep_scrub_stamp":"2024-09-12T01:03:12.328903+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.328903+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:35.047822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.554003+0000","last_change":"2024-09-12T01:03:08.554003+0000","last_active":"2024-09-12T01:03:08.554003+0000","last_peered":"2024-09-12T01:03:08.554003+0000","last_clean":"2024-09-12T01:03:08.554003+0000","last_became_active":"2024-09-12T00:16:03.107695+0000","last_became_peered":"2024-09-12T00:16:03.107695+0000","last_unstale":"2024-09-12T01:03:08.554003+0000","last_undegraded":"2024-09-12T01:03:08.554003+0000","last_fullsized":"2024-09-12T01:03:08.554003+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:08.553798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:08.553798+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.553798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:15.552997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"268'246","reported_seq":806,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.231702+0000","last_change":"2024-09-12T01:03:14.231702+0000","last_active":"2024-09-12T01:03:14.231702+0000","last_peered":"2024-09-12T01:03:14.231702+0000","last_clean":"2024-09-12T01:03:14.231702+0000","last_became_active":"2024-09-12T00:16:05.106742+0000","last_became_peered":"2024-09-12T00:16:05.106742+0000","last_unstale":"2024-09-12T01:03:14.231702+0000","last_undegraded":"2024-09-12T01:03:14.231702+0000","last_fullsized":"2024-09-12T01:03:14.231702+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'246","last_scrub_stamp":"2024-09-12T01:03:14.231510+0000","last_deep_scrub":"268'246","last_deep_scrub_stamp":"2024-09-12T01:03:14.231510+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.231510+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:02.610669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":438,"num_read_kb":396,"num_write":482,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"268'397","reported_seq":1842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.275301+0000","last_change":"2024-09-12T01:02:52.275301+0000","last_active":"2024-09-12T01:02:52.275301+0000","last_peered":"2024-09-12T01:02:52.275301+0000","last_clean":"2024-09-12T01:02:52.275301+0000","last_became_active":"2024-09-12T00:15:57.015397+0000","last_became_peered":"2024-09-12T00:15:57.015397+0000","last_unstale":"2024-09-12T01:02:52.275301+0000","last_undegraded":"2024-09-12T01:02:52.275301+0000","last_fullsized":"2024-09-12T01:02:52.275301+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'397","last_scrub_stamp":"2024-09-12T01:02:52.275074+0000","last_deep_scrub":"268'397","last_deep_scrub_stamp":"2024-09-12T01:02:52.275074+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.275074+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:02.312499+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2041,"num_read_kb":1937,"num_write":459,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"268'320","reported_seq":955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.632454+0000","last_change":"2024-09-12T01:02:49.632454+0000","last_active":"2024-09-12T01:02:49.632454+0000","last_peered":"2024-09-12T01:02:49.632454+0000","last_clean":"2024-09-12T01:02:49.632454+0000","last_became_active":"2024-09-12T00:15:55.062990+0000","last_became_peered":"2024-09-12T00:15:55.062990+0000","last_unstale":"2024-09-12T01:02:49.632454+0000","last_undegraded":"2024-09-12T01:02:49.632454+0000","last_fullsized":"2024-09-12T01:02:49.632454+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-09-12T01:02:49.632190+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-09-12T01:02:49.632190+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.632190+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:54.520313+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838529,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":442,"num_read_kb":9756,"num_write":997,"num_write_kb":17415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.583322+0000","last_change":"2024-09-12T01:03:01.583322+0000","last_active":"2024-09-12T01:03:01.583322+0000","last_peered":"2024-09-12T01:03:01.583322+0000","last_clean":"2024-09-12T01:03:01.583322+0000","last_became_active":"2024-09-12T00:15:59.029162+0000","last_became_peered":"2024-09-12T00:15:59.029162+0000","last_unstale":"2024-09-12T01:03:01.583322+0000","last_undegraded":"2024-09-12T01:03:01.583322+0000","last_fullsized":"2024-09-12T01:03:01.583322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:01.583122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:01.583122+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.583122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:27.595470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"268'287","reported_seq":883,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.940481+0000","last_change":"2024-09-12T01:03:04.940481+0000","last_active":"2024-09-12T01:03:04.940481+0000","last_peered":"2024-09-12T01:03:04.940481+0000","last_clean":"2024-09-12T01:03:04.940481+0000","last_became_active":"2024-09-12T00:16:01.059517+0000","last_became_peered":"2024-09-12T00:16:01.059517+0000","last_unstale":"2024-09-12T01:03:04.940481+0000","last_undegraded":"2024-09-12T01:03:04.940481+0000","last_fullsized":"2024-09-12T01:03:04.940481+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'287","last_scrub_stamp":"2024-09-12T01:03:04.940283+0000","last_deep_scrub":"268'287","last_deep_scrub_stamp":"2024-09-12T01:03:04.940283+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.940283+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:24.528106+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51265,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":460,"num_read_kb":973,"num_write":358,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.224169+0000","last_change":"2024-09-12T01:03:05.224169+0000","last_active":"2024-09-12T01:03:05.224169+0000","last_peered":"2024-09-12T01:03:05.224169+0000","last_clean":"2024-09-12T01:03:05.224169+0000","last_became_active":"2024-09-12T00:16:03.103630+0000","last_became_peered":"2024-09-12T00:16:03.103630+0000","last_unstale":"2024-09-12T01:03:05.224169+0000","last_undegraded":"2024-09-12T01:03:05.224169+0000","last_fullsized":"2024-09-12T01:03:05.224169+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:05.223967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:05.223967+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.223967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:01.031493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"268'165","reported_seq":678,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:01.555845+0000","last_change":"2024-09-12T00:16:05.110450+0000","last_active":"2024-09-12T01:00:01.555845+0000","last_peered":"2024-09-12T01:00:01.555845+0000","last_clean":"2024-09-12T01:00:01.555845+0000","last_became_active":"2024-09-12T00:16:05.109745+0000","last_became_peered":"2024-09-12T00:16:05.109745+0000","last_unstale":"2024-09-12T01:00:01.555845+0000","last_undegraded":"2024-09-12T01:00:01.555845+0000","last_fullsized":"2024-09-12T01:00:01.555845+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:15.769156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":406,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"268'423","reported_seq":1868,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.679246+0000","last_change":"2024-09-12T01:02:53.679246+0000","last_active":"2024-09-12T01:02:53.679246+0000","last_peered":"2024-09-12T01:02:53.679246+0000","last_clean":"2024-09-12T01:02:53.679246+0000","last_became_active":"2024-09-12T00:15:57.028820+0000","last_became_peered":"2024-09-12T00:15:57.028820+0000","last_unstale":"2024-09-12T01:02:53.679246+0000","last_undegraded":"2024-09-12T01:02:53.679246+0000","last_fullsized":"2024-09-12T01:02:53.679246+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'423","last_scrub_stamp":"2024-09-12T01:02:53.679070+0000","last_deep_scrub":"268'423","last_deep_scrub_stamp":"2024-09-12T01:02:53.679070+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.679070+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:24.203431+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2332,"num_read_kb":2186,"num_write":478,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1006,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"268'304","reported_seq":963,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.317898+0000","last_change":"2024-09-12T01:02:51.317898+0000","last_active":"2024-09-12T01:02:51.317898+0000","last_peered":"2024-09-12T01:02:51.317898+0000","last_clean":"2024-09-12T01:02:51.317898+0000","last_became_active":"2024-09-12T00:15:55.054712+0000","last_became_peered":"2024-09-12T00:15:55.054712+0000","last_unstale":"2024-09-12T01:02:51.317898+0000","last_undegraded":"2024-09-12T01:02:51.317898+0000","last_fullsized":"2024-09-12T01:02:51.317898+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'304","last_scrub_stamp":"2024-09-12T01:02:51.317700+0000","last_deep_scrub":"268'304","last_deep_scrub_stamp":"2024-09-12T01:02:51.317700+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.317700+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:15.787375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25680,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":448,"num_read_kb":100896,"num_write":1015,"num_write_kb":52799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.612965+0000","last_change":"2024-09-12T01:03:13.612965+0000","last_active":"2024-09-12T01:03:13.612965+0000","last_peered":"2024-09-12T01:03:13.612965+0000","last_clean":"2024-09-12T01:03:13.612965+0000","last_became_active":"2024-09-12T00:15:59.028885+0000","last_became_peered":"2024-09-12T00:15:59.028885+0000","last_unstale":"2024-09-12T01:03:13.612965+0000","last_undegraded":"2024-09-12T01:03:13.612965+0000","last_fullsized":"2024-09-12T01:03:13.612965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:13.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:13.612747+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:15.856950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"268'273","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.600517+0000","last_change":"2024-09-12T01:03:09.600517+0000","last_active":"2024-09-12T01:03:09.600517+0000","last_peered":"2024-09-12T01:03:09.600517+0000","last_clean":"2024-09-12T01:03:09.600517+0000","last_became_active":"2024-09-12T00:16:01.050654+0000","last_became_peered":"2024-09-12T00:16:01.050654+0000","last_unstale":"2024-09-12T01:03:09.600517+0000","last_undegraded":"2024-09-12T01:03:09.600517+0000","last_fullsized":"2024-09-12T01:03:09.600517+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'273","last_scrub_stamp":"2024-09-12T01:03:09.600297+0000","last_deep_scrub":"268'273","last_deep_scrub_stamp":"2024-09-12T01:03:09.600297+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.600297+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:17.048401+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":1024,"num_write":358,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.863748+0000","last_change":"2024-09-12T01:03:06.863748+0000","last_active":"2024-09-12T01:03:06.863748+0000","last_peered":"2024-09-12T01:03:06.863748+0000","last_clean":"2024-09-12T01:03:06.863748+0000","last_became_active":"2024-09-12T00:16:03.088929+0000","last_became_peered":"2024-09-12T00:16:03.088929+0000","last_unstale":"2024-09-12T01:03:06.863748+0000","last_undegraded":"2024-09-12T01:03:06.863748+0000","last_fullsized":"2024-09-12T01:03:06.863748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:06.863544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:06.863544+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.863544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:13.284749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"268'422","reported_seq":2051,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.543894+0000","last_change":"2024-09-12T01:03:07.543894+0000","last_active":"2024-09-12T01:03:07.543894+0000","last_peered":"2024-09-12T01:03:07.543894+0000","last_clean":"2024-09-12T01:03:07.543894+0000","last_became_active":"2024-09-12T00:15:57.039919+0000","last_became_peered":"2024-09-12T00:15:57.039919+0000","last_unstale":"2024-09-12T01:03:07.543894+0000","last_undegraded":"2024-09-12T01:03:07.543894+0000","last_fullsized":"2024-09-12T01:03:07.543894+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'422","last_scrub_stamp":"2024-09-12T01:03:07.543688+0000","last_deep_scrub":"268'422","last_deep_scrub_stamp":"2024-09-12T01:03:07.543688+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.543688+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:37.918345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2299,"num_read_kb":2203,"num_write":481,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"268'299","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.357075+0000","last_change":"2024-09-12T01:02:48.357075+0000","last_active":"2024-09-12T01:02:48.357075+0000","last_peered":"2024-09-12T01:02:48.357075+0000","last_clean":"2024-09-12T01:02:48.357075+0000","last_became_active":"2024-09-12T00:15:55.079264+0000","last_became_peered":"2024-09-12T00:15:55.079264+0000","last_unstale":"2024-09-12T01:02:48.357075+0000","last_undegraded":"2024-09-12T01:02:48.357075+0000","last_fullsized":"2024-09-12T01:02:48.357075+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'299","last_scrub_stamp":"2024-09-12T01:02:48.356731+0000","last_deep_scrub":"268'299","last_deep_scrub_stamp":"2024-09-12T01:02:48.356731+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.356731+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:01.723914+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311670,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":380,"num_read_kb":14024,"num_write":902,"num_write_kb":16591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.166848+0000","last_change":"2024-09-12T01:03:04.166848+0000","last_active":"2024-09-12T01:03:04.166848+0000","last_peered":"2024-09-12T01:03:04.166848+0000","last_clean":"2024-09-12T01:03:04.166848+0000","last_became_active":"2024-09-12T00:15:59.039042+0000","last_became_peered":"2024-09-12T00:15:59.039042+0000","last_unstale":"2024-09-12T01:03:04.166848+0000","last_undegraded":"2024-09-12T01:03:04.166848+0000","last_fullsized":"2024-09-12T01:03:04.166848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:04.166656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:04.166656+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.166656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:47.847682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"268'500","reported_seq":1140,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.253187+0000","last_change":"2024-09-12T01:03:08.253187+0000","last_active":"2024-09-12T01:03:08.253187+0000","last_peered":"2024-09-12T01:03:08.253187+0000","last_clean":"2024-09-12T01:03:08.253187+0000","last_became_active":"2024-09-12T00:16:01.062625+0000","last_became_peered":"2024-09-12T00:16:01.062625+0000","last_unstale":"2024-09-12T01:03:08.253187+0000","last_undegraded":"2024-09-12T01:03:08.253187+0000","last_fullsized":"2024-09-12T01:03:08.253187+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'500","last_scrub_stamp":"2024-09-12T01:03:08.252996+0000","last_deep_scrub":"268'500","last_deep_scrub_stamp":"2024-09-12T01:03:08.252996+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.252996+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:40.522444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91700,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":904,"num_read_kb":2175,"num_write":782,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.547461+0000","last_change":"2024-09-12T01:03:07.547461+0000","last_active":"2024-09-12T01:03:07.547461+0000","last_peered":"2024-09-12T01:03:07.547461+0000","last_clean":"2024-09-12T01:03:07.547461+0000","last_became_active":"2024-09-12T00:16:03.087980+0000","last_became_peered":"2024-09-12T00:16:03.087980+0000","last_unstale":"2024-09-12T01:03:07.547461+0000","last_undegraded":"2024-09-12T01:03:07.547461+0000","last_fullsized":"2024-09-12T01:03:07.547461+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:07.547227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:07.547227+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.547227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:14.697460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"268'129","reported_seq":628,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:43.121942+0000","last_change":"2024-09-12T00:16:05.099199+0000","last_active":"2024-09-12T01:00:43.121942+0000","last_peered":"2024-09-12T01:00:43.121942+0000","last_clean":"2024-09-12T01:00:43.121942+0000","last_became_active":"2024-09-12T00:16:05.098424+0000","last_became_peered":"2024-09-12T00:16:05.098424+0000","last_unstale":"2024-09-12T01:00:43.121942+0000","last_undegraded":"2024-09-12T01:00:43.121942+0000","last_fullsized":"2024-09-12T01:00:43.121942+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":165,"num_write":285,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"268'842","reported_seq":2439,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.169938+0000","last_change":"2024-09-12T01:02:56.169938+0000","last_active":"2024-09-12T01:02:56.169938+0000","last_peered":"2024-09-12T01:02:56.169938+0000","last_clean":"2024-09-12T01:02:56.169938+0000","last_became_active":"2024-09-12T00:15:57.022709+0000","last_became_peered":"2024-09-12T00:15:57.022709+0000","last_unstale":"2024-09-12T01:02:56.169938+0000","last_undegraded":"2024-09-12T01:02:56.169938+0000","last_fullsized":"2024-09-12T01:02:56.169938+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'842","last_scrub_stamp":"2024-09-12T01:02:56.169713+0000","last_deep_scrub":"268'842","last_deep_scrub_stamp":"2024-09-12T01:02:56.169713+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.169713+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:31.117935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3967,"num_read_kb":3571,"num_write":1117,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1379,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"268'292","reported_seq":941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.308689+0000","last_change":"2024-09-12T01:02:50.308689+0000","last_active":"2024-09-12T01:02:50.308689+0000","last_peered":"2024-09-12T01:02:50.308689+0000","last_clean":"2024-09-12T01:02:50.308689+0000","last_became_active":"2024-09-12T00:15:55.064940+0000","last_became_peered":"2024-09-12T00:15:55.064940+0000","last_unstale":"2024-09-12T01:02:50.308689+0000","last_undegraded":"2024-09-12T01:02:50.308689+0000","last_fullsized":"2024-09-12T01:02:50.308689+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'292","last_scrub_stamp":"2024-09-12T01:02:50.308457+0000","last_deep_scrub":"268'292","last_deep_scrub_stamp":"2024-09-12T01:02:50.308457+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.308457+0000","objects_scrubbed":6,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:18.717527+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1909911,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":2788,"num_write":1025,"num_write_kb":39220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.545155+0000","last_change":"2024-09-12T01:03:04.545155+0000","last_active":"2024-09-12T01:03:04.545155+0000","last_peered":"2024-09-12T01:03:04.545155+0000","last_clean":"2024-09-12T01:03:04.545155+0000","last_became_active":"2024-09-12T00:15:59.034648+0000","last_became_peered":"2024-09-12T00:15:59.034648+0000","last_unstale":"2024-09-12T01:03:04.545155+0000","last_undegraded":"2024-09-12T01:03:04.545155+0000","last_fullsized":"2024-09-12T01:03:04.545155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:04.544977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:04.544977+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.544977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:15.428165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"268'289","reported_seq":886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.599928+0000","last_change":"2024-09-12T01:03:21.599928+0000","last_active":"2024-09-12T01:03:21.599928+0000","last_peered":"2024-09-12T01:03:21.599928+0000","last_clean":"2024-09-12T01:03:21.599928+0000","last_became_active":"2024-09-12T00:16:01.046783+0000","last_became_peered":"2024-09-12T00:16:01.046783+0000","last_unstale":"2024-09-12T01:03:21.599928+0000","last_undegraded":"2024-09-12T01:03:21.599928+0000","last_fullsized":"2024-09-12T01:03:21.599928+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'289","last_scrub_stamp":"2024-09-12T01:03:21.599715+0000","last_deep_scrub":"268'289","last_deep_scrub_stamp":"2024-09-12T01:03:21.599715+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.599715+0000","objects_scrubbed":8,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:04.490478+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45699,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":1022,"num_write":398,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.602862+0000","last_change":"2024-09-12T01:03:18.602862+0000","last_active":"2024-09-12T01:03:18.602862+0000","last_peered":"2024-09-12T01:03:18.602862+0000","last_clean":"2024-09-12T01:03:18.602862+0000","last_became_active":"2024-09-12T00:16:03.097160+0000","last_became_peered":"2024-09-12T00:16:03.097160+0000","last_unstale":"2024-09-12T01:03:18.602862+0000","last_undegraded":"2024-09-12T01:03:18.602862+0000","last_fullsized":"2024-09-12T01:03:18.602862+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:18.602579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:18.602579+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.602579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:11.353722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"268'210","reported_seq":764,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:49.750132+0000","last_change":"2024-09-12T00:16:05.102618+0000","last_active":"2024-09-12T01:00:49.750132+0000","last_peered":"2024-09-12T01:00:49.750132+0000","last_clean":"2024-09-12T01:00:49.750132+0000","last_became_active":"2024-09-12T00:16:05.101338+0000","last_became_peered":"2024-09-12T00:16:05.101338+0000","last_unstale":"2024-09-12T01:00:49.750132+0000","last_undegraded":"2024-09-12T01:00:49.750132+0000","last_fullsized":"2024-09-12T01:00:49.750132+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1401,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":396,"num_read_kb":348,"num_write":595,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"268'506","reported_seq":2096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.685414+0000","last_change":"2024-09-12T01:02:54.685414+0000","last_active":"2024-09-12T01:02:54.685414+0000","last_peered":"2024-09-12T01:02:54.685414+0000","last_clean":"2024-09-12T01:02:54.685414+0000","last_became_active":"2024-09-12T00:15:57.034257+0000","last_became_peered":"2024-09-12T00:15:57.034257+0000","last_unstale":"2024-09-12T01:02:54.685414+0000","last_undegraded":"2024-09-12T01:02:54.685414+0000","last_fullsized":"2024-09-12T01:02:54.685414+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'506","last_scrub_stamp":"2024-09-12T01:02:54.685233+0000","last_deep_scrub":"268'506","last_deep_scrub_stamp":"2024-09-12T01:02:54.685233+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.685233+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:00.855007+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2760,"num_read_kb":2552,"num_write":653,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"268'359","reported_seq":1108,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.174196+0000","last_change":"2024-09-12T01:02:46.174196+0000","last_active":"2024-09-12T01:02:46.174196+0000","last_peered":"2024-09-12T01:02:46.174196+0000","last_clean":"2024-09-12T01:02:46.174196+0000","last_became_active":"2024-09-12T00:15:55.035741+0000","last_became_peered":"2024-09-12T00:15:55.035741+0000","last_unstale":"2024-09-12T01:02:46.174196+0000","last_undegraded":"2024-09-12T01:02:46.174196+0000","last_fullsized":"2024-09-12T01:02:46.174196+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T01:02:46.174096+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T01:02:46.174096+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.174096+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:23.160018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":693,"num_read_kb":41169,"num_write":1152,"num_write_kb":26675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.627134+0000","last_change":"2024-09-12T01:03:00.627134+0000","last_active":"2024-09-12T01:03:00.627134+0000","last_peered":"2024-09-12T01:03:00.627134+0000","last_clean":"2024-09-12T01:03:00.627134+0000","last_became_active":"2024-09-12T00:15:59.044761+0000","last_became_peered":"2024-09-12T00:15:59.044761+0000","last_unstale":"2024-09-12T01:03:00.627134+0000","last_undegraded":"2024-09-12T01:03:00.627134+0000","last_fullsized":"2024-09-12T01:03:00.627134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:00.626946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:00.626946+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.626946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:42.833587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"268'298","reported_seq":886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.201939+0000","last_change":"2024-09-12T01:03:10.201939+0000","last_active":"2024-09-12T01:03:10.201939+0000","last_peered":"2024-09-12T01:03:10.201939+0000","last_clean":"2024-09-12T01:03:10.201939+0000","last_became_active":"2024-09-12T00:16:01.052731+0000","last_became_peered":"2024-09-12T00:16:01.052731+0000","last_unstale":"2024-09-12T01:03:10.201939+0000","last_undegraded":"2024-09-12T01:03:10.201939+0000","last_fullsized":"2024-09-12T01:03:10.201939+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'298","last_scrub_stamp":"2024-09-12T01:03:10.201739+0000","last_deep_scrub":"268'298","last_deep_scrub_stamp":"2024-09-12T01:03:10.201739+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.201739+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:36.025785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50253,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":1058,"num_write":380,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.924910+0000","last_change":"2024-09-12T01:03:08.924910+0000","last_active":"2024-09-12T01:03:08.924910+0000","last_peered":"2024-09-12T01:03:08.924910+0000","last_clean":"2024-09-12T01:03:08.924910+0000","last_became_active":"2024-09-12T00:16:03.080825+0000","last_became_peered":"2024-09-12T00:16:03.080825+0000","last_unstale":"2024-09-12T01:03:08.924910+0000","last_undegraded":"2024-09-12T01:03:08.924910+0000","last_fullsized":"2024-09-12T01:03:08.924910+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:08.924731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:08.924731+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.924731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:25.806325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"268'153","reported_seq":652,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:12.055860+0000","last_change":"2024-09-12T00:16:05.098923+0000","last_active":"2024-09-12T01:02:12.055860+0000","last_peered":"2024-09-12T01:02:12.055860+0000","last_clean":"2024-09-12T01:02:12.055860+0000","last_became_active":"2024-09-12T00:16:05.098180+0000","last_became_peered":"2024-09-12T00:16:05.098180+0000","last_unstale":"2024-09-12T01:02:12.055860+0000","last_undegraded":"2024-09-12T01:02:12.055860+0000","last_fullsized":"2024-09-12T01:02:12.055860+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":95,"num_write":348,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"268'342","reported_seq":1673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.129621+0000","last_change":"2024-09-12T01:02:57.129621+0000","last_active":"2024-09-12T01:02:57.129621+0000","last_peered":"2024-09-12T01:02:57.129621+0000","last_clean":"2024-09-12T01:02:57.129621+0000","last_became_active":"2024-09-12T00:15:57.039580+0000","last_became_peered":"2024-09-12T00:15:57.039580+0000","last_unstale":"2024-09-12T01:02:57.129621+0000","last_undegraded":"2024-09-12T01:02:57.129621+0000","last_fullsized":"2024-09-12T01:02:57.129621+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-12T01:02:57.129353+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-12T01:02:57.129353+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.129353+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:16.119165+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1750,"num_read_kb":1664,"num_write":383,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"268'336","reported_seq":959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.234365+0000","last_change":"2024-09-12T01:02:54.234365+0000","last_active":"2024-09-12T01:02:54.234365+0000","last_peered":"2024-09-12T01:02:54.234365+0000","last_clean":"2024-09-12T01:02:54.234365+0000","last_became_active":"2024-09-12T00:15:55.042851+0000","last_became_peered":"2024-09-12T00:15:55.042851+0000","last_unstale":"2024-09-12T01:02:54.234365+0000","last_undegraded":"2024-09-12T01:02:54.234365+0000","last_fullsized":"2024-09-12T01:02:54.234365+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'336","last_scrub_stamp":"2024-09-12T01:02:54.233965+0000","last_deep_scrub":"268'336","last_deep_scrub_stamp":"2024-09-12T01:02:54.233965+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.233965+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:37.476942+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1919007,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":413,"num_read_kb":20803,"num_write":1107,"num_write_kb":57854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":509,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.223088+0000","last_change":"2024-09-12T01:03:09.223088+0000","last_active":"2024-09-12T01:03:09.223088+0000","last_peered":"2024-09-12T01:03:09.223088+0000","last_clean":"2024-09-12T01:03:09.223088+0000","last_became_active":"2024-09-12T00:15:59.048632+0000","last_became_peered":"2024-09-12T00:15:59.048632+0000","last_unstale":"2024-09-12T01:03:09.223088+0000","last_undegraded":"2024-09-12T01:03:09.223088+0000","last_fullsized":"2024-09-12T01:03:09.223088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:09.222897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:09.222897+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.222897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:54.272835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"268'92","reported_seq":634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.598105+0000","last_change":"2024-09-12T01:03:22.598105+0000","last_active":"2024-09-12T01:03:22.598105+0000","last_peered":"2024-09-12T01:03:22.598105+0000","last_clean":"2024-09-12T01:03:22.598105+0000","last_became_active":"2024-09-12T00:16:01.045565+0000","last_became_peered":"2024-09-12T00:16:01.045565+0000","last_unstale":"2024-09-12T01:03:22.598105+0000","last_undegraded":"2024-09-12T01:03:22.598105+0000","last_fullsized":"2024-09-12T01:03:22.598105+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'92","last_scrub_stamp":"2024-09-12T01:03:22.597904+0000","last_deep_scrub":"268'92","last_deep_scrub_stamp":"2024-09-12T01:03:22.597904+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.597904+0000","objects_scrubbed":8,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:28.342106+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":132,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"268'786","reported_seq":4438,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.534702+0000","last_change":"2024-09-12T01:03:06.534702+0000","last_active":"2024-09-12T01:03:06.534702+0000","last_peered":"2024-09-12T01:03:06.534702+0000","last_clean":"2024-09-12T01:03:06.534702+0000","last_became_active":"2024-09-12T00:16:03.091506+0000","last_became_peered":"2024-09-12T00:16:03.091506+0000","last_unstale":"2024-09-12T01:03:06.534702+0000","last_undegraded":"2024-09-12T01:03:06.534702+0000","last_fullsized":"2024-09-12T01:03:06.534702+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'786","last_scrub_stamp":"2024-09-12T01:03:06.534512+0000","last_deep_scrub":"268'786","last_deep_scrub_stamp":"2024-09-12T01:03:06.534512+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.534512+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:02.777021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"268'114","reported_seq":622,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:04.900585+0000","last_change":"2024-09-12T00:16:05.102360+0000","last_active":"2024-09-12T01:01:04.900585+0000","last_peered":"2024-09-12T01:01:04.900585+0000","last_clean":"2024-09-12T01:01:04.900585+0000","last_became_active":"2024-09-12T00:16:05.101500+0000","last_became_peered":"2024-09-12T00:16:05.101500+0000","last_unstale":"2024-09-12T01:01:04.900585+0000","last_undegraded":"2024-09-12T01:01:04.900585+0000","last_fullsized":"2024-09-12T01:01:04.900585+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"268'1104","reported_seq":2646,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.661665+0000","last_change":"2024-09-12T01:02:59.661665+0000","last_active":"2024-09-12T01:02:59.661665+0000","last_peered":"2024-09-12T01:02:59.661665+0000","last_clean":"2024-09-12T01:02:59.661665+0000","last_became_active":"2024-09-12T00:15:57.056507+0000","last_became_peered":"2024-09-12T00:15:57.056507+0000","last_unstale":"2024-09-12T01:02:59.661665+0000","last_undegraded":"2024-09-12T01:02:59.661665+0000","last_fullsized":"2024-09-12T01:02:59.661665+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1104","last_scrub_stamp":"2024-09-12T01:02:59.661368+0000","last_deep_scrub":"268'1104","last_deep_scrub_stamp":"2024-09-12T01:02:59.661368+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.661368+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":1000,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:37.501861+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5000,"num_read_kb":4445,"num_write":1493,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"268'355","reported_seq":1218,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.211133+0000","last_change":"2024-09-12T01:02:47.211133+0000","last_active":"2024-09-12T01:02:47.211133+0000","last_peered":"2024-09-12T01:02:47.211133+0000","last_clean":"2024-09-12T01:02:47.211133+0000","last_became_active":"2024-09-12T00:15:55.051336+0000","last_became_peered":"2024-09-12T00:15:55.051336+0000","last_unstale":"2024-09-12T01:02:47.211133+0000","last_undegraded":"2024-09-12T01:02:47.211133+0000","last_fullsized":"2024-09-12T01:02:47.211133+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'355","last_scrub_stamp":"2024-09-12T01:02:47.210757+0000","last_deep_scrub":"268'355","last_deep_scrub_stamp":"2024-09-12T01:02:47.210757+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.210757+0000","objects_scrubbed":8,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:14.508041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174753,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1007,"num_read_kb":8590,"num_write":1279,"num_write_kb":12738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.157220+0000","last_change":"2024-09-12T01:03:01.157220+0000","last_active":"2024-09-12T01:03:01.157220+0000","last_peered":"2024-09-12T01:03:01.157220+0000","last_clean":"2024-09-12T01:03:01.157220+0000","last_became_active":"2024-09-12T00:15:59.046538+0000","last_became_peered":"2024-09-12T00:15:59.046538+0000","last_unstale":"2024-09-12T01:03:01.157220+0000","last_undegraded":"2024-09-12T01:03:01.157220+0000","last_fullsized":"2024-09-12T01:03:01.157220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:01.157005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:01.157005+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.157005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:05.303663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"268'336","reported_seq":951,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.576715+0000","last_change":"2024-09-12T01:03:05.576715+0000","last_active":"2024-09-12T01:03:05.576715+0000","last_peered":"2024-09-12T01:03:05.576715+0000","last_clean":"2024-09-12T01:03:05.576715+0000","last_became_active":"2024-09-12T00:16:01.051648+0000","last_became_peered":"2024-09-12T00:16:01.051648+0000","last_unstale":"2024-09-12T01:03:05.576715+0000","last_undegraded":"2024-09-12T01:03:05.576715+0000","last_fullsized":"2024-09-12T01:03:05.576715+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'336","last_scrub_stamp":"2024-09-12T01:03:05.576460+0000","last_deep_scrub":"268'336","last_deep_scrub_stamp":"2024-09-12T01:03:05.576460+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.576460+0000","objects_scrubbed":11,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:44.168273+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50218,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":538,"num_read_kb":1138,"num_write":432,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.329374+0000","last_change":"2024-09-12T01:03:20.329374+0000","last_active":"2024-09-12T01:03:20.329374+0000","last_peered":"2024-09-12T01:03:20.329374+0000","last_clean":"2024-09-12T01:03:20.329374+0000","last_became_active":"2024-09-12T00:16:03.086333+0000","last_became_peered":"2024-09-12T00:16:03.086333+0000","last_unstale":"2024-09-12T01:03:20.329374+0000","last_undegraded":"2024-09-12T01:03:20.329374+0000","last_fullsized":"2024-09-12T01:03:20.329374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:20.329196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:20.329196+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.329196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:26.619682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"268'129","reported_seq":639,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.316540+0000","last_change":"2024-09-12T01:03:12.316540+0000","last_active":"2024-09-12T01:03:12.316540+0000","last_peered":"2024-09-12T01:03:12.316540+0000","last_clean":"2024-09-12T01:03:12.316540+0000","last_became_active":"2024-09-12T00:16:05.107284+0000","last_became_peered":"2024-09-12T00:16:05.107284+0000","last_unstale":"2024-09-12T01:03:12.316540+0000","last_undegraded":"2024-09-12T01:03:12.316540+0000","last_fullsized":"2024-09-12T01:03:12.316540+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'129","last_scrub_stamp":"2024-09-12T01:03:12.316341+0000","last_deep_scrub":"268'129","last_deep_scrub_stamp":"2024-09-12T01:03:12.316341+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.316341+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:28.418713+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":114,"num_write":286,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"268'491","reported_seq":2125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.653502+0000","last_change":"2024-09-12T01:02:57.653502+0000","last_active":"2024-09-12T01:02:57.653502+0000","last_peered":"2024-09-12T01:02:57.653502+0000","last_clean":"2024-09-12T01:02:57.653502+0000","last_became_active":"2024-09-12T00:15:57.021526+0000","last_became_peered":"2024-09-12T00:15:57.021526+0000","last_unstale":"2024-09-12T01:02:57.653502+0000","last_undegraded":"2024-09-12T01:02:57.653502+0000","last_fullsized":"2024-09-12T01:02:57.653502+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'491","last_scrub_stamp":"2024-09-12T01:02:57.653321+0000","last_deep_scrub":"268'491","last_deep_scrub_stamp":"2024-09-12T01:02:57.653321+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.653321+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:22.307720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2702,"num_read_kb":2545,"num_write":554,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"268'350","reported_seq":1039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.624753+0000","last_change":"2024-09-12T01:02:54.624581+0000","last_active":"2024-09-12T01:02:54.624753+0000","last_peered":"2024-09-12T01:02:54.624753+0000","last_clean":"2024-09-12T01:02:54.624753+0000","last_became_active":"2024-09-12T00:15:55.052503+0000","last_became_peered":"2024-09-12T00:15:55.052503+0000","last_unstale":"2024-09-12T01:02:54.624753+0000","last_undegraded":"2024-09-12T01:02:54.624753+0000","last_fullsized":"2024-09-12T01:02:54.624753+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T01:02:54.624378+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T01:02:54.624378+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.624378+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:26.809590+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174814,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":52648,"num_write":1035,"num_write_kb":43222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.551002+0000","last_change":"2024-09-12T01:03:03.551002+0000","last_active":"2024-09-12T01:03:03.551002+0000","last_peered":"2024-09-12T01:03:03.551002+0000","last_clean":"2024-09-12T01:03:03.551002+0000","last_became_active":"2024-09-12T00:15:59.024564+0000","last_became_peered":"2024-09-12T00:15:59.024564+0000","last_unstale":"2024-09-12T01:03:03.551002+0000","last_undegraded":"2024-09-12T01:03:03.551002+0000","last_fullsized":"2024-09-12T01:03:03.551002+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:03.550913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:03.550913+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.550913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:02.329399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"268'253","reported_seq":841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.338971+0000","last_change":"2024-09-12T01:03:15.338971+0000","last_active":"2024-09-12T01:03:15.338971+0000","last_peered":"2024-09-12T01:03:15.338971+0000","last_clean":"2024-09-12T01:03:15.338971+0000","last_became_active":"2024-09-12T00:16:01.051612+0000","last_became_peered":"2024-09-12T00:16:01.051612+0000","last_unstale":"2024-09-12T01:03:15.338971+0000","last_undegraded":"2024-09-12T01:03:15.338971+0000","last_fullsized":"2024-09-12T01:03:15.338971+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'253","last_scrub_stamp":"2024-09-12T01:03:15.338659+0000","last_deep_scrub":"268'253","last_deep_scrub_stamp":"2024-09-12T01:03:15.338659+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.338659+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:04.996974+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46385,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":418,"num_read_kb":940,"num_write":334,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:59:44.223108+0000","last_change":"2024-09-12T00:16:03.095905+0000","last_active":"2024-09-12T00:59:44.223108+0000","last_peered":"2024-09-12T00:59:44.223108+0000","last_clean":"2024-09-12T00:59:44.223108+0000","last_became_active":"2024-09-12T00:16:03.095016+0000","last_became_peered":"2024-09-12T00:16:03.095016+0000","last_unstale":"2024-09-12T00:59:44.223108+0000","last_undegraded":"2024-09-12T00:59:44.223108+0000","last_fullsized":"2024-09-12T00:59:44.223108+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:20:35.761981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"268'135","reported_seq":666,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:02.014067+0000","last_change":"2024-09-12T00:16:05.099520+0000","last_active":"2024-09-12T01:02:02.014067+0000","last_peered":"2024-09-12T01:02:02.014067+0000","last_clean":"2024-09-12T01:02:02.014067+0000","last_became_active":"2024-09-12T00:16:05.098796+0000","last_became_peered":"2024-09-12T00:16:05.098796+0000","last_unstale":"2024-09-12T01:02:02.014067+0000","last_undegraded":"2024-09-12T01:02:02.014067+0000","last_fullsized":"2024-09-12T01:02:02.014067+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:21:27.979474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":225,"num_write":347,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"268'418","reported_seq":1971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.676410+0000","last_change":"2024-09-12T01:02:52.676410+0000","last_active":"2024-09-12T01:02:52.676410+0000","last_peered":"2024-09-12T01:02:52.676410+0000","last_clean":"2024-09-12T01:02:52.676410+0000","last_became_active":"2024-09-12T00:15:57.038127+0000","last_became_peered":"2024-09-12T00:15:57.038127+0000","last_unstale":"2024-09-12T01:02:52.676410+0000","last_undegraded":"2024-09-12T01:02:52.676410+0000","last_fullsized":"2024-09-12T01:02:52.676410+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'418","last_scrub_stamp":"2024-09-12T01:02:52.676192+0000","last_deep_scrub":"268'418","last_deep_scrub_stamp":"2024-09-12T01:02:52.676192+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.676192+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:22.108077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2293,"num_read_kb":2185,"num_write":483,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3022,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"268'320","reported_seq":959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.395489+0000","last_change":"2024-09-12T01:02:49.395489+0000","last_active":"2024-09-12T01:02:49.395489+0000","last_peered":"2024-09-12T01:02:49.395489+0000","last_clean":"2024-09-12T01:02:49.395489+0000","last_became_active":"2024-09-12T00:15:55.074964+0000","last_became_peered":"2024-09-12T00:15:55.074964+0000","last_unstale":"2024-09-12T01:02:49.395489+0000","last_undegraded":"2024-09-12T01:02:49.395489+0000","last_fullsized":"2024-09-12T01:02:49.395489+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-09-12T01:02:49.395237+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-09-12T01:02:49.395237+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.395237+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:09.752592+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655970,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":20129,"num_write":999,"num_write_kb":20535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.198645+0000","last_change":"2024-09-12T01:03:04.198645+0000","last_active":"2024-09-12T01:03:04.198645+0000","last_peered":"2024-09-12T01:03:04.198645+0000","last_clean":"2024-09-12T01:03:04.198645+0000","last_became_active":"2024-09-12T00:15:59.036492+0000","last_became_peered":"2024-09-12T00:15:59.036492+0000","last_unstale":"2024-09-12T01:03:04.198645+0000","last_undegraded":"2024-09-12T01:03:04.198645+0000","last_fullsized":"2024-09-12T01:03:04.198645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:04.198465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:04.198465+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.198465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:22.027363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"268'249","reported_seq":818,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.271501+0000","last_change":"2024-09-12T01:03:07.271501+0000","last_active":"2024-09-12T01:03:07.271501+0000","last_peered":"2024-09-12T01:03:07.271501+0000","last_clean":"2024-09-12T01:03:07.271501+0000","last_became_active":"2024-09-12T00:16:01.050746+0000","last_became_peered":"2024-09-12T00:16:01.050746+0000","last_unstale":"2024-09-12T01:03:07.271501+0000","last_undegraded":"2024-09-12T01:03:07.271501+0000","last_fullsized":"2024-09-12T01:03:07.271501+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'249","last_scrub_stamp":"2024-09-12T01:03:07.271298+0000","last_deep_scrub":"268'249","last_deep_scrub_stamp":"2024-09-12T01:03:07.271298+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.271298+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:45.855519+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":412,"num_read_kb":978,"num_write":338,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T00:58:34.203198+0000","last_change":"2024-09-12T00:16:03.100996+0000","last_active":"2024-09-12T00:58:34.203198+0000","last_peered":"2024-09-12T00:58:34.203198+0000","last_clean":"2024-09-12T00:58:34.203198+0000","last_became_active":"2024-09-12T00:16:03.099890+0000","last_became_peered":"2024-09-12T00:16:03.099890+0000","last_unstale":"2024-09-12T00:58:34.203198+0000","last_undegraded":"2024-09-12T00:58:34.203198+0000","last_fullsized":"2024-09-12T00:58:34.203198+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:02.024460+0000","last_clean_scrub_stamp":"2024-09-12T00:16:02.024460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:53.876340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"268'186","reported_seq":1673,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:10.781143+0000","last_change":"2024-09-12T00:16:05.113925+0000","last_active":"2024-09-12T01:02:10.781143+0000","last_peered":"2024-09-12T01:02:10.781143+0000","last_clean":"2024-09-12T01:02:10.781143+0000","last_became_active":"2024-09-12T00:16:05.113207+0000","last_became_peered":"2024-09-12T00:16:05.113207+0000","last_unstale":"2024-09-12T01:02:10.781143+0000","last_undegraded":"2024-09-12T01:02:10.781143+0000","last_fullsized":"2024-09-12T01:02:10.781143+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:16:04.048078+0000","last_clean_scrub_stamp":"2024-09-12T00:16:04.048078+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:18.252728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1270,"num_read_kb":1246,"num_write":444,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"268'926","reported_seq":2674,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.619463+0000","last_change":"2024-09-12T01:02:56.619463+0000","last_active":"2024-09-12T01:02:56.619463+0000","last_peered":"2024-09-12T01:02:56.619463+0000","last_clean":"2024-09-12T01:02:56.619463+0000","last_became_active":"2024-09-12T00:15:57.012136+0000","last_became_peered":"2024-09-12T00:15:57.012136+0000","last_unstale":"2024-09-12T01:02:56.619463+0000","last_undegraded":"2024-09-12T01:02:56.619463+0000","last_fullsized":"2024-09-12T01:02:56.619463+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'926","last_scrub_stamp":"2024-09-12T01:02:56.619272+0000","last_deep_scrub":"268'926","last_deep_scrub_stamp":"2024-09-12T01:02:56.619272+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.619272+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":900,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:34.737350+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4477,"num_read_kb":4059,"num_write":1259,"num_write_kb":498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1011,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"268'359","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.367417+0000","last_change":"2024-09-12T01:02:50.367417+0000","last_active":"2024-09-12T01:02:50.367417+0000","last_peered":"2024-09-12T01:02:50.367417+0000","last_clean":"2024-09-12T01:02:50.367417+0000","last_became_active":"2024-09-12T00:15:55.079005+0000","last_became_peered":"2024-09-12T00:15:55.079005+0000","last_unstale":"2024-09-12T01:02:50.367417+0000","last_undegraded":"2024-09-12T01:02:50.367417+0000","last_fullsized":"2024-09-12T01:02:50.367417+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T01:02:50.366971+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T01:02:50.366971+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.366971+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:04.196096+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525370,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":531,"num_read_kb":476,"num_write":1171,"num_write_kb":40462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.241251+0000","last_change":"2024-09-12T01:03:08.241251+0000","last_active":"2024-09-12T01:03:08.241251+0000","last_peered":"2024-09-12T01:03:08.241251+0000","last_clean":"2024-09-12T01:03:08.241251+0000","last_became_active":"2024-09-12T00:15:59.039674+0000","last_became_peered":"2024-09-12T00:15:59.039674+0000","last_unstale":"2024-09-12T01:03:08.241251+0000","last_undegraded":"2024-09-12T01:03:08.241251+0000","last_fullsized":"2024-09-12T01:03:08.241251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:08.241064+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:08.241064+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.241064+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:41.346192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"268'350","reported_seq":960,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.584713+0000","last_change":"2024-09-12T01:03:19.584713+0000","last_active":"2024-09-12T01:03:19.584713+0000","last_peered":"2024-09-12T01:03:19.584713+0000","last_clean":"2024-09-12T01:03:19.584713+0000","last_became_active":"2024-09-12T00:16:01.051324+0000","last_became_peered":"2024-09-12T00:16:01.051324+0000","last_unstale":"2024-09-12T01:03:19.584713+0000","last_undegraded":"2024-09-12T01:03:19.584713+0000","last_fullsized":"2024-09-12T01:03:19.584713+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T01:03:19.584505+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T01:03:19.584505+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.584505+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:32.091357+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49632,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":580,"num_read_kb":1323,"num_write":476,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.347866+0000","last_change":"2024-09-12T01:03:19.347866+0000","last_active":"2024-09-12T01:03:19.347866+0000","last_peered":"2024-09-12T01:03:19.347866+0000","last_clean":"2024-09-12T01:03:19.347866+0000","last_became_active":"2024-09-12T00:16:03.099836+0000","last_became_peered":"2024-09-12T00:16:03.099836+0000","last_unstale":"2024-09-12T01:03:19.347866+0000","last_undegraded":"2024-09-12T01:03:19.347866+0000","last_fullsized":"2024-09-12T01:03:19.347866+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:19.347683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:19.347683+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.347683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:54.373409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"268'116","reported_seq":617,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.623160+0000","last_change":"2024-09-12T01:03:08.623160+0000","last_active":"2024-09-12T01:03:08.623160+0000","last_peered":"2024-09-12T01:03:08.623160+0000","last_clean":"2024-09-12T01:03:08.623160+0000","last_became_active":"2024-09-12T00:16:05.113231+0000","last_became_peered":"2024-09-12T00:16:05.113231+0000","last_unstale":"2024-09-12T01:03:08.623160+0000","last_undegraded":"2024-09-12T01:03:08.623160+0000","last_fullsized":"2024-09-12T01:03:08.623160+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'116","last_scrub_stamp":"2024-09-12T01:03:08.622957+0000","last_deep_scrub":"268'116","last_deep_scrub_stamp":"2024-09-12T01:03:08.622957+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.622957+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:44.955515+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":663,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":263,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"268'812","reported_seq":2407,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.098674+0000","last_change":"2024-09-12T01:02:59.098674+0000","last_active":"2024-09-12T01:02:59.098674+0000","last_peered":"2024-09-12T01:02:59.098674+0000","last_clean":"2024-09-12T01:02:59.098674+0000","last_became_active":"2024-09-12T00:15:57.031161+0000","last_became_peered":"2024-09-12T00:15:57.031161+0000","last_unstale":"2024-09-12T01:02:59.098674+0000","last_undegraded":"2024-09-12T01:02:59.098674+0000","last_fullsized":"2024-09-12T01:02:59.098674+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'812","last_scrub_stamp":"2024-09-12T01:02:59.098486+0000","last_deep_scrub":"268'812","last_deep_scrub_stamp":"2024-09-12T01:02:59.098486+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.098486+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:40.804950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3882,"num_read_kb":3503,"num_write":1069,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"268'350","reported_seq":1124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.589310+0000","last_change":"2024-09-12T01:02:48.589310+0000","last_active":"2024-09-12T01:02:48.589310+0000","last_peered":"2024-09-12T01:02:48.589310+0000","last_clean":"2024-09-12T01:02:48.589310+0000","last_became_active":"2024-09-12T00:15:55.042134+0000","last_became_peered":"2024-09-12T00:15:55.042134+0000","last_unstale":"2024-09-12T01:02:48.589310+0000","last_undegraded":"2024-09-12T01:02:48.589310+0000","last_fullsized":"2024-09-12T01:02:48.589310+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T01:02:48.589008+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T01:02:48.589008+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.589008+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:56.525969+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918005,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":861,"num_read_kb":50816,"num_write":1243,"num_write_kb":44406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'404","reported_seq":1866,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.734203+0000","last_change":"2024-09-12T01:02:56.734203+0000","last_active":"2024-09-12T01:02:56.734203+0000","last_peered":"2024-09-12T01:02:56.734203+0000","last_clean":"2024-09-12T01:02:56.734203+0000","last_became_active":"2024-09-12T00:15:57.043013+0000","last_became_peered":"2024-09-12T00:15:57.043013+0000","last_unstale":"2024-09-12T01:02:56.734203+0000","last_undegraded":"2024-09-12T01:02:56.734203+0000","last_fullsized":"2024-09-12T01:02:56.734203+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'404","last_scrub_stamp":"2024-09-12T01:02:56.734008+0000","last_deep_scrub":"268'404","last_deep_scrub_stamp":"2024-09-12T01:02:56.734008+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.734008+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:54.403896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2106,"num_read_kb":1998,"num_write":459,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"268'302","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.702227+0000","last_change":"2024-09-12T01:02:48.702227+0000","last_active":"2024-09-12T01:02:48.702227+0000","last_peered":"2024-09-12T01:02:48.702227+0000","last_clean":"2024-09-12T01:02:48.702227+0000","last_became_active":"2024-09-12T00:15:55.062524+0000","last_became_peered":"2024-09-12T00:15:55.062524+0000","last_unstale":"2024-09-12T01:02:48.702227+0000","last_undegraded":"2024-09-12T01:02:48.702227+0000","last_fullsized":"2024-09-12T01:02:48.702227+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'302","last_scrub_stamp":"2024-09-12T01:02:48.701961+0000","last_deep_scrub":"268'302","last_deep_scrub_stamp":"2024-09-12T01:02:48.701961+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.701961+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:23.572921+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291481,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":18226,"num_write":893,"num_write_kb":43043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"268'497","reported_seq":2221,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.575277+0000","last_change":"2024-09-12T01:03:06.575277+0000","last_active":"2024-09-12T01:03:06.575277+0000","last_peered":"2024-09-12T01:03:06.575277+0000","last_clean":"2024-09-12T01:03:06.575277+0000","last_became_active":"2024-09-12T00:15:57.018875+0000","last_became_peered":"2024-09-12T00:15:57.018875+0000","last_unstale":"2024-09-12T01:03:06.575277+0000","last_undegraded":"2024-09-12T01:03:06.575277+0000","last_fullsized":"2024-09-12T01:03:06.575277+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'497","last_scrub_stamp":"2024-09-12T01:03:06.575054+0000","last_deep_scrub":"268'497","last_deep_scrub_stamp":"2024-09-12T01:03:06.575054+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.575054+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:10.216944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2775,"num_read_kb":2615,"num_write":593,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1776,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"268'360","reported_seq":1018,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.598437+0000","last_change":"2024-09-12T01:02:53.598437+0000","last_active":"2024-09-12T01:02:53.598437+0000","last_peered":"2024-09-12T01:02:53.598437+0000","last_clean":"2024-09-12T01:02:53.598437+0000","last_became_active":"2024-09-12T00:15:55.063603+0000","last_became_peered":"2024-09-12T00:15:55.063603+0000","last_unstale":"2024-09-12T01:02:53.598437+0000","last_undegraded":"2024-09-12T01:02:53.598437+0000","last_fullsized":"2024-09-12T01:02:53.598437+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'360","last_scrub_stamp":"2024-09-12T01:02:53.598203+0000","last_deep_scrub":"268'360","last_deep_scrub_stamp":"2024-09-12T01:02:53.598203+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.598203+0000","objects_scrubbed":7,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:20.298117+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055186,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":518,"num_read_kb":3291,"num_write":1136,"num_write_kb":12783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"268'394","reported_seq":1809,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.505984+0000","last_change":"2024-09-12T01:03:06.505984+0000","last_active":"2024-09-12T01:03:06.505984+0000","last_peered":"2024-09-12T01:03:06.505984+0000","last_clean":"2024-09-12T01:03:06.505984+0000","last_became_active":"2024-09-12T00:15:57.030173+0000","last_became_peered":"2024-09-12T00:15:57.030173+0000","last_unstale":"2024-09-12T01:03:06.505984+0000","last_undegraded":"2024-09-12T01:03:06.505984+0000","last_fullsized":"2024-09-12T01:03:06.505984+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T01:03:06.505753+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T01:03:06.505753+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.505753+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:29.265131+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2013,"num_read_kb":1910,"num_write":436,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":961,"num_omap_keys":4,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"268'370","reported_seq":1121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.286233+0000","last_change":"2024-09-12T01:02:52.286233+0000","last_active":"2024-09-12T01:02:52.286233+0000","last_peered":"2024-09-12T01:02:52.286233+0000","last_clean":"2024-09-12T01:02:52.286233+0000","last_became_active":"2024-09-12T00:15:55.068349+0000","last_became_peered":"2024-09-12T00:15:55.068349+0000","last_unstale":"2024-09-12T01:02:52.286233+0000","last_undegraded":"2024-09-12T01:02:52.286233+0000","last_fullsized":"2024-09-12T01:02:52.286233+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-12T01:02:52.285815+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-12T01:02:52.285815+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.285815+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:42.779294+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5530690,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":847,"num_read_kb":11363,"num_write":1205,"num_write_kb":51000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"268'400","reported_seq":1892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.517091+0000","last_change":"2024-09-12T01:03:04.517091+0000","last_active":"2024-09-12T01:03:04.517091+0000","last_peered":"2024-09-12T01:03:04.517091+0000","last_clean":"2024-09-12T01:03:04.517091+0000","last_became_active":"2024-09-12T00:15:57.037204+0000","last_became_peered":"2024-09-12T00:15:57.037204+0000","last_unstale":"2024-09-12T01:03:04.517091+0000","last_undegraded":"2024-09-12T01:03:04.517091+0000","last_fullsized":"2024-09-12T01:03:04.517091+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'400","last_scrub_stamp":"2024-09-12T01:03:04.516852+0000","last_deep_scrub":"268'400","last_deep_scrub_stamp":"2024-09-12T01:03:04.516852+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.516852+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:17.030355+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2120,"num_read_kb":2017,"num_write":453,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"268'338","reported_seq":981,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.070517+0000","last_change":"2024-09-12T01:02:50.070517+0000","last_active":"2024-09-12T01:02:50.070517+0000","last_peered":"2024-09-12T01:02:50.070517+0000","last_clean":"2024-09-12T01:02:50.070517+0000","last_became_active":"2024-09-12T00:15:55.071812+0000","last_became_peered":"2024-09-12T00:15:55.071812+0000","last_unstale":"2024-09-12T01:02:50.070517+0000","last_undegraded":"2024-09-12T01:02:50.070517+0000","last_fullsized":"2024-09-12T01:02:50.070517+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'338","last_scrub_stamp":"2024-09-12T01:02:50.070156+0000","last_deep_scrub":"268'338","last_deep_scrub_stamp":"2024-09-12T01:02:50.070156+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.070156+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:07.290148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1919077,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":11487,"num_write":1134,"num_write_kb":34407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"268'584","reported_seq":2274,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.591872+0000","last_change":"2024-09-12T01:02:53.591872+0000","last_active":"2024-09-12T01:02:53.591872+0000","last_peered":"2024-09-12T01:02:53.591872+0000","last_clean":"2024-09-12T01:02:53.591872+0000","last_became_active":"2024-09-12T00:15:57.032818+0000","last_became_peered":"2024-09-12T00:15:57.032818+0000","last_unstale":"2024-09-12T01:02:53.591872+0000","last_undegraded":"2024-09-12T01:02:53.591872+0000","last_fullsized":"2024-09-12T01:02:53.591872+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'584","last_scrub_stamp":"2024-09-12T01:02:53.591627+0000","last_deep_scrub":"268'584","last_deep_scrub_stamp":"2024-09-12T01:02:53.591627+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.591627+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:25.471327+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2922,"num_read_kb":2722,"num_write":707,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"268'345","reported_seq":1029,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.024703+0000","last_change":"2024-09-12T01:02:51.024703+0000","last_active":"2024-09-12T01:02:51.024703+0000","last_peered":"2024-09-12T01:02:51.024703+0000","last_clean":"2024-09-12T01:02:51.024703+0000","last_became_active":"2024-09-12T00:15:55.050781+0000","last_became_peered":"2024-09-12T00:15:55.050781+0000","last_unstale":"2024-09-12T01:02:51.024703+0000","last_undegraded":"2024-09-12T01:02:51.024703+0000","last_fullsized":"2024-09-12T01:02:51.024703+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'345","last_scrub_stamp":"2024-09-12T01:02:51.024453+0000","last_deep_scrub":"268'345","last_deep_scrub_stamp":"2024-09-12T01:02:51.024453+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.024453+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:07.021452+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432541,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":494,"num_read_kb":31947,"num_write":1072,"num_write_kb":41212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"268'801","reported_seq":2295,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.033726+0000","last_change":"2024-09-12T01:02:59.033726+0000","last_active":"2024-09-12T01:02:59.033726+0000","last_peered":"2024-09-12T01:02:59.033726+0000","last_clean":"2024-09-12T01:02:59.033726+0000","last_became_active":"2024-09-12T00:15:57.045500+0000","last_became_peered":"2024-09-12T00:15:57.045500+0000","last_unstale":"2024-09-12T01:02:59.033726+0000","last_undegraded":"2024-09-12T01:02:59.033726+0000","last_fullsized":"2024-09-12T01:02:59.033726+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'801","last_scrub_stamp":"2024-09-12T01:02:59.033539+0000","last_deep_scrub":"268'801","last_deep_scrub_stamp":"2024-09-12T01:02:59.033539+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.033539+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.520622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3817,"num_read_kb":3427,"num_write":1098,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"268'312","reported_seq":942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.668061+0000","last_change":"2024-09-12T01:02:54.668061+0000","last_active":"2024-09-12T01:02:54.668061+0000","last_peered":"2024-09-12T01:02:54.668061+0000","last_clean":"2024-09-12T01:02:54.668061+0000","last_became_active":"2024-09-12T00:15:55.054914+0000","last_became_peered":"2024-09-12T00:15:55.054914+0000","last_unstale":"2024-09-12T01:02:54.668061+0000","last_undegraded":"2024-09-12T01:02:54.668061+0000","last_fullsized":"2024-09-12T01:02:54.668061+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'312","last_scrub_stamp":"2024-09-12T01:02:54.667783+0000","last_deep_scrub":"268'312","last_deep_scrub_stamp":"2024-09-12T01:02:54.667783+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.667783+0000","objects_scrubbed":9,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:58.504933+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262244,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":420,"num_read_kb":50634,"num_write":965,"num_write_kb":37363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"268'819","reported_seq":2520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.205241+0000","last_change":"2024-09-12T01:02:52.205241+0000","last_active":"2024-09-12T01:02:52.205241+0000","last_peered":"2024-09-12T01:02:52.205241+0000","last_clean":"2024-09-12T01:02:52.205241+0000","last_became_active":"2024-09-12T00:15:57.021622+0000","last_became_peered":"2024-09-12T00:15:57.021622+0000","last_unstale":"2024-09-12T01:02:52.205241+0000","last_undegraded":"2024-09-12T01:02:52.205241+0000","last_fullsized":"2024-09-12T01:02:52.205241+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'819","last_scrub_stamp":"2024-09-12T01:02:52.205058+0000","last_deep_scrub":"268'819","last_deep_scrub_stamp":"2024-09-12T01:02:52.205058+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.205058+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:06.846282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4035,"num_read_kb":3684,"num_write":1067,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2043,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"268'352","reported_seq":1009,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.341830+0000","last_change":"2024-09-12T01:02:54.341830+0000","last_active":"2024-09-12T01:02:54.341830+0000","last_peered":"2024-09-12T01:02:54.341830+0000","last_clean":"2024-09-12T01:02:54.341830+0000","last_became_active":"2024-09-12T00:15:55.055929+0000","last_became_peered":"2024-09-12T00:15:55.055929+0000","last_unstale":"2024-09-12T01:02:54.341830+0000","last_undegraded":"2024-09-12T01:02:54.341830+0000","last_fullsized":"2024-09-12T01:02:54.341830+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'352","last_scrub_stamp":"2024-09-12T01:02:54.341405+0000","last_deep_scrub":"268'352","last_deep_scrub_stamp":"2024-09-12T01:02:54.341405+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.341405+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:10.803620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":553,"num_read_kb":589,"num_write":1208,"num_write_kb":30899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"268'838","reported_seq":2512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.745029+0000","last_change":"2024-09-12T01:02:58.745029+0000","last_active":"2024-09-12T01:02:58.745029+0000","last_peered":"2024-09-12T01:02:58.745029+0000","last_clean":"2024-09-12T01:02:58.745029+0000","last_became_active":"2024-09-12T00:15:57.039946+0000","last_became_peered":"2024-09-12T00:15:57.039946+0000","last_unstale":"2024-09-12T01:02:58.745029+0000","last_undegraded":"2024-09-12T01:02:58.745029+0000","last_fullsized":"2024-09-12T01:02:58.745029+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'838","last_scrub_stamp":"2024-09-12T01:02:58.744791+0000","last_deep_scrub":"268'838","last_deep_scrub_stamp":"2024-09-12T01:02:58.744791+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.744791+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:14.176919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4272,"num_read_kb":3874,"num_write":1144,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"268'428","reported_seq":1165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.585054+0000","last_change":"2024-09-12T01:03:01.585054+0000","last_active":"2024-09-12T01:03:01.585054+0000","last_peered":"2024-09-12T01:03:01.585054+0000","last_clean":"2024-09-12T01:03:01.585054+0000","last_became_active":"2024-09-12T00:15:55.065129+0000","last_became_peered":"2024-09-12T00:15:55.065129+0000","last_unstale":"2024-09-12T01:03:01.585054+0000","last_undegraded":"2024-09-12T01:03:01.585054+0000","last_fullsized":"2024-09-12T01:03:01.585054+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'428","last_scrub_stamp":"2024-09-12T01:03:01.584779+0000","last_deep_scrub":"268'428","last_deep_scrub_stamp":"2024-09-12T01:03:01.584779+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.584779+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:46.193473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170166,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":788,"num_read_kb":24149,"num_write":1329,"num_write_kb":32019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"268'878","reported_seq":2664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.582210+0000","last_change":"2024-09-12T01:02:54.582210+0000","last_active":"2024-09-12T01:02:54.582210+0000","last_peered":"2024-09-12T01:02:54.582210+0000","last_clean":"2024-09-12T01:02:54.582210+0000","last_became_active":"2024-09-12T00:15:57.051976+0000","last_became_peered":"2024-09-12T00:15:57.051976+0000","last_unstale":"2024-09-12T01:02:54.582210+0000","last_undegraded":"2024-09-12T01:02:54.582210+0000","last_fullsized":"2024-09-12T01:02:54.582210+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'878","last_scrub_stamp":"2024-09-12T01:02:54.581985+0000","last_deep_scrub":"268'878","last_deep_scrub_stamp":"2024-09-12T01:02:54.581985+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.581985+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":800,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:29.512097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4749,"num_read_kb":4328,"num_write":1184,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3450,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"268'343","reported_seq":980,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.325668+0000","last_change":"2024-09-12T01:02:53.325419+0000","last_active":"2024-09-12T01:02:53.325668+0000","last_peered":"2024-09-12T01:02:53.325668+0000","last_clean":"2024-09-12T01:02:53.325668+0000","last_became_active":"2024-09-12T00:15:55.055449+0000","last_became_peered":"2024-09-12T00:15:55.055449+0000","last_unstale":"2024-09-12T01:02:53.325668+0000","last_undegraded":"2024-09-12T01:02:53.325668+0000","last_fullsized":"2024-09-12T01:02:53.325668+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'343","last_scrub_stamp":"2024-09-12T01:02:53.325099+0000","last_deep_scrub":"268'343","last_deep_scrub_stamp":"2024-09-12T01:02:53.325099+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.325099+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:04.425777+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":2263,"num_write":1082,"num_write_kb":24139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"268'790","reported_seq":2377,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.479981+0000","last_change":"2024-09-12T01:03:05.479981+0000","last_active":"2024-09-12T01:03:05.479981+0000","last_peered":"2024-09-12T01:03:05.479981+0000","last_clean":"2024-09-12T01:03:05.479981+0000","last_became_active":"2024-09-12T00:15:57.031976+0000","last_became_peered":"2024-09-12T00:15:57.031976+0000","last_unstale":"2024-09-12T01:03:05.479981+0000","last_undegraded":"2024-09-12T01:03:05.479981+0000","last_fullsized":"2024-09-12T01:03:05.479981+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'790","last_scrub_stamp":"2024-09-12T01:03:05.479793+0000","last_deep_scrub":"268'790","last_deep_scrub_stamp":"2024-09-12T01:03:05.479793+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.479793+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:48.321978+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3862,"num_read_kb":3503,"num_write":1033,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"268'359","reported_seq":1018,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.167331+0000","last_change":"2024-09-12T01:02:48.167146+0000","last_active":"2024-09-12T01:02:48.167331+0000","last_peered":"2024-09-12T01:02:48.167331+0000","last_clean":"2024-09-12T01:02:48.167331+0000","last_became_active":"2024-09-12T00:15:55.051451+0000","last_became_peered":"2024-09-12T00:15:55.051451+0000","last_unstale":"2024-09-12T01:02:48.167331+0000","last_undegraded":"2024-09-12T01:02:48.167331+0000","last_fullsized":"2024-09-12T01:02:48.167331+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T01:02:48.166882+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T01:02:48.166882+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.166882+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:13.746661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263237,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":17816,"num_write":1180,"num_write_kb":26945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"268'485","reported_seq":2170,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.125316+0000","last_change":"2024-09-12T01:02:56.125082+0000","last_active":"2024-09-12T01:02:56.125316+0000","last_peered":"2024-09-12T01:02:56.125316+0000","last_clean":"2024-09-12T01:02:56.125316+0000","last_became_active":"2024-09-12T00:15:57.019963+0000","last_became_peered":"2024-09-12T00:15:57.019963+0000","last_unstale":"2024-09-12T01:02:56.125316+0000","last_undegraded":"2024-09-12T01:02:56.125316+0000","last_fullsized":"2024-09-12T01:02:56.125316+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'485","last_scrub_stamp":"2024-09-12T01:02:56.124868+0000","last_deep_scrub":"268'485","last_deep_scrub_stamp":"2024-09-12T01:02:56.124868+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.124868+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:10.557945+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2585,"num_read_kb":2455,"num_write":555,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":983,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"268'290","reported_seq":923,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.093495+0000","last_change":"2024-09-12T01:02:58.093202+0000","last_active":"2024-09-12T01:02:58.093495+0000","last_peered":"2024-09-12T01:02:58.093495+0000","last_clean":"2024-09-12T01:02:58.093495+0000","last_became_active":"2024-09-12T00:15:55.050267+0000","last_became_peered":"2024-09-12T00:15:55.050267+0000","last_unstale":"2024-09-12T01:02:58.093495+0000","last_undegraded":"2024-09-12T01:02:58.093495+0000","last_fullsized":"2024-09-12T01:02:58.093495+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'290","last_scrub_stamp":"2024-09-12T01:02:58.092896+0000","last_deep_scrub":"268'290","last_deep_scrub_stamp":"2024-09-12T01:02:58.092896+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.092896+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:16.075277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":8617,"num_write":1019,"num_write_kb":22964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1340","reported_seq":3159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.183746+0000","last_change":"2024-09-12T01:02:53.183498+0000","last_active":"2024-09-12T01:02:53.183746+0000","last_peered":"2024-09-12T01:02:53.183746+0000","last_clean":"2024-09-12T01:02:53.183746+0000","last_became_active":"2024-09-12T00:15:57.045076+0000","last_became_peered":"2024-09-12T00:15:57.045076+0000","last_unstale":"2024-09-12T01:02:53.183746+0000","last_undegraded":"2024-09-12T01:02:53.183746+0000","last_fullsized":"2024-09-12T01:02:53.183746+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1340","last_scrub_stamp":"2024-09-12T01:02:53.183271+0000","last_deep_scrub":"268'1340","last_deep_scrub_stamp":"2024-09-12T01:02:53.183271+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.183271+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":1300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:32.397326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6209,"num_read_kb":5540,"num_write":1861,"num_write_kb":794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"268'321","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.576244+0000","last_change":"2024-09-12T01:02:52.576069+0000","last_active":"2024-09-12T01:02:52.576244+0000","last_peered":"2024-09-12T01:02:52.576244+0000","last_clean":"2024-09-12T01:02:52.576244+0000","last_became_active":"2024-09-12T00:15:55.061287+0000","last_became_peered":"2024-09-12T00:15:55.061287+0000","last_unstale":"2024-09-12T01:02:52.576244+0000","last_undegraded":"2024-09-12T01:02:52.576244+0000","last_fullsized":"2024-09-12T01:02:52.576244+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'321","last_scrub_stamp":"2024-09-12T01:02:52.575842+0000","last_deep_scrub":"268'321","last_deep_scrub_stamp":"2024-09-12T01:02:52.575842+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.575842+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:54.370349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":733,"num_write":1216,"num_write_kb":3677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"268'406","reported_seq":1782,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.700207+0000","last_change":"2024-09-12T01:02:55.700063+0000","last_active":"2024-09-12T01:02:55.700207+0000","last_peered":"2024-09-12T01:02:55.700207+0000","last_clean":"2024-09-12T01:02:55.700207+0000","last_became_active":"2024-09-12T00:15:57.043158+0000","last_became_peered":"2024-09-12T00:15:57.043158+0000","last_unstale":"2024-09-12T01:02:55.700207+0000","last_undegraded":"2024-09-12T01:02:55.700207+0000","last_fullsized":"2024-09-12T01:02:55.700207+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'406","last_scrub_stamp":"2024-09-12T01:02:55.699871+0000","last_deep_scrub":"268'406","last_deep_scrub_stamp":"2024-09-12T01:02:55.699871+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.699871+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:04.239689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1978,"num_read_kb":1859,"num_write":462,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"268'386","reported_seq":1081,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.568297+0000","last_change":"2024-09-12T01:02:58.568150+0000","last_active":"2024-09-12T01:02:58.568297+0000","last_peered":"2024-09-12T01:02:58.568297+0000","last_clean":"2024-09-12T01:02:58.568297+0000","last_became_active":"2024-09-12T00:15:55.058726+0000","last_became_peered":"2024-09-12T00:15:55.058726+0000","last_unstale":"2024-09-12T01:02:58.568297+0000","last_undegraded":"2024-09-12T01:02:58.568297+0000","last_fullsized":"2024-09-12T01:02:58.568297+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'386","last_scrub_stamp":"2024-09-12T01:02:58.567923+0000","last_deep_scrub":"268'386","last_deep_scrub_stamp":"2024-09-12T01:02:58.567923+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.567923+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:21.225474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549415,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":603,"num_read_kb":57120,"num_write":1303,"num_write_kb":58223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"268'1346","reported_seq":2841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.143246+0000","last_change":"2024-09-12T01:03:00.143067+0000","last_active":"2024-09-12T01:03:00.143246+0000","last_peered":"2024-09-12T01:03:00.143246+0000","last_clean":"2024-09-12T01:03:00.143246+0000","last_became_active":"2024-09-12T00:15:57.043227+0000","last_became_peered":"2024-09-12T00:15:57.043227+0000","last_unstale":"2024-09-12T01:03:00.143246+0000","last_undegraded":"2024-09-12T01:03:00.143246+0000","last_fullsized":"2024-09-12T01:03:00.143246+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1346","last_scrub_stamp":"2024-09-12T01:03:00.142862+0000","last_deep_scrub":"268'1346","last_deep_scrub_stamp":"2024-09-12T01:03:00.142862+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.142862+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":1300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:03.208839+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5913,"num_read_kb":5121,"num_write":1910,"num_write_kb":821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"268'294","reported_seq":944,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.730311+0000","last_change":"2024-09-12T01:02:51.730311+0000","last_active":"2024-09-12T01:02:51.730311+0000","last_peered":"2024-09-12T01:02:51.730311+0000","last_clean":"2024-09-12T01:02:51.730311+0000","last_became_active":"2024-09-12T00:15:55.052287+0000","last_became_peered":"2024-09-12T00:15:55.052287+0000","last_unstale":"2024-09-12T01:02:51.730311+0000","last_undegraded":"2024-09-12T01:02:51.730311+0000","last_fullsized":"2024-09-12T01:02:51.730311+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'294","last_scrub_stamp":"2024-09-12T01:02:51.729966+0000","last_deep_scrub":"268'294","last_deep_scrub_stamp":"2024-09-12T01:02:51.729966+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.729966+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:44.447259+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947345,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":476,"num_read_kb":19752,"num_write":916,"num_write_kb":40992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"268'335","reported_seq":1753,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.134671+0000","last_change":"2024-09-12T01:02:54.134671+0000","last_active":"2024-09-12T01:02:54.134671+0000","last_peered":"2024-09-12T01:02:54.134671+0000","last_clean":"2024-09-12T01:02:54.134671+0000","last_became_active":"2024-09-12T00:15:57.039633+0000","last_became_peered":"2024-09-12T00:15:57.039633+0000","last_unstale":"2024-09-12T01:02:54.134671+0000","last_undegraded":"2024-09-12T01:02:54.134671+0000","last_fullsized":"2024-09-12T01:02:54.134671+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'335","last_scrub_stamp":"2024-09-12T01:02:54.134447+0000","last_deep_scrub":"268'335","last_deep_scrub_stamp":"2024-09-12T01:02:54.134447+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.134447+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:37.275755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1924,"num_read_kb":1842,"num_write":397,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"268'332","reported_seq":1022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.525046+0000","last_change":"2024-09-12T01:02:59.525046+0000","last_active":"2024-09-12T01:02:59.525046+0000","last_peered":"2024-09-12T01:02:59.525046+0000","last_clean":"2024-09-12T01:02:59.525046+0000","last_became_active":"2024-09-12T00:15:55.054952+0000","last_became_peered":"2024-09-12T00:15:55.054952+0000","last_unstale":"2024-09-12T01:02:59.525046+0000","last_undegraded":"2024-09-12T01:02:59.525046+0000","last_fullsized":"2024-09-12T01:02:59.525046+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'332","last_scrub_stamp":"2024-09-12T01:02:59.524837+0000","last_deep_scrub":"268'332","last_deep_scrub_stamp":"2024-09-12T01:02:59.524837+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.524837+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:40.714134+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109426,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":117939,"num_write":959,"num_write_kb":46136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"268'394","reported_seq":1060,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.601429+0000","last_change":"2024-09-12T01:03:04.601429+0000","last_active":"2024-09-12T01:03:04.601429+0000","last_peered":"2024-09-12T01:03:04.601429+0000","last_clean":"2024-09-12T01:03:04.601429+0000","last_became_active":"2024-09-12T00:15:55.052320+0000","last_became_peered":"2024-09-12T00:15:55.052320+0000","last_unstale":"2024-09-12T01:03:04.601429+0000","last_undegraded":"2024-09-12T01:03:04.601429+0000","last_fullsized":"2024-09-12T01:03:04.601429+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T01:03:04.601179+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T01:03:04.601179+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.601179+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:40.828736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":13865,"num_write":1350,"num_write_kb":55041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"268'477","reported_seq":2101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.187209+0000","last_change":"2024-09-12T01:03:02.187209+0000","last_active":"2024-09-12T01:03:02.187209+0000","last_peered":"2024-09-12T01:03:02.187209+0000","last_clean":"2024-09-12T01:03:02.187209+0000","last_became_active":"2024-09-12T00:15:57.054996+0000","last_became_peered":"2024-09-12T00:15:57.054996+0000","last_unstale":"2024-09-12T01:03:02.187209+0000","last_undegraded":"2024-09-12T01:03:02.187209+0000","last_fullsized":"2024-09-12T01:03:02.187209+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'477","last_scrub_stamp":"2024-09-12T01:03:02.187021+0000","last_deep_scrub":"268'477","last_deep_scrub_stamp":"2024-09-12T01:03:02.187021+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.187021+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:43.118548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2784,"num_read_kb":2618,"num_write":619,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2539,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"268'328","reported_seq":955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.387452+0000","last_change":"2024-09-12T01:02:55.387452+0000","last_active":"2024-09-12T01:02:55.387452+0000","last_peered":"2024-09-12T01:02:55.387452+0000","last_clean":"2024-09-12T01:02:55.387452+0000","last_became_active":"2024-09-12T00:15:55.078832+0000","last_became_peered":"2024-09-12T00:15:55.078832+0000","last_unstale":"2024-09-12T01:02:55.387452+0000","last_undegraded":"2024-09-12T01:02:55.387452+0000","last_fullsized":"2024-09-12T01:02:55.387452+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'328","last_scrub_stamp":"2024-09-12T01:02:55.387211+0000","last_deep_scrub":"268'328","last_deep_scrub_stamp":"2024-09-12T01:02:55.387211+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.387211+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:04.897261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262198,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":33208,"num_write":990,"num_write_kb":34373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"268'953","reported_seq":2379,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.151228+0000","last_change":"2024-09-12T01:02:59.151228+0000","last_active":"2024-09-12T01:02:59.151228+0000","last_peered":"2024-09-12T01:02:59.151228+0000","last_clean":"2024-09-12T01:02:59.151228+0000","last_became_active":"2024-09-12T00:15:57.027565+0000","last_became_peered":"2024-09-12T00:15:57.027565+0000","last_unstale":"2024-09-12T01:02:59.151228+0000","last_undegraded":"2024-09-12T01:02:59.151228+0000","last_fullsized":"2024-09-12T01:02:59.151228+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'953","last_scrub_stamp":"2024-09-12T01:02:59.151013+0000","last_deep_scrub":"268'953","last_deep_scrub_stamp":"2024-09-12T01:02:59.151013+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.151013+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":900,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:17.674152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4238,"num_read_kb":3802,"num_write":1335,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6185,"num_read_kb":4382,"num_write":1972,"num_write_kb":869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7269,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1045,"ondisk_log_size":1045,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15033,"num_read_kb":14688,"num_write":16727,"num_write_kb":4883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2756,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1425,"ondisk_log_size":1425,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":508,"ondisk_log_size":508,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1515596,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":17695,"num_read_kb":36825,"num_write":14793,"num_write_kb":11553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":683890,"num_omap_keys":1566,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1901,"ondisk_log_size":1901,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2876,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212032,"num_read_kb":193923,"num_write":55063,"num_write_kb":18681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43786,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4204,"ondisk_log_size":4204,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":91096211,"num_objects":373,"num_object_clones":0,"num_object_copies":1492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":373,"num_whiteouts":0,"num_read":36044,"num_read_kb":1967370,"num_write":71560,"num_write_kb":2158407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":123895808,"data_stored":123895808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3636,"ondisk_log_size":3636,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":197046,"num_write":158,"num_write_kb":127402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":185778,"num_write":158,"num_write_kb":127402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719477313,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249092,"kb_used_data":19380,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122748,"statfs":{"total":96636764160,"available":96381693952,"internally_reserved":0,"allocated":19845120,"data_stored":17804594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510020,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114752,"kb_used_data":15536,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94257088,"statfs":{"total":96636764160,"available":96519258112,"internally_reserved":0,"allocated":15908864,"data_stored":13884114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510018,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252652,"kb_used_data":18844,"kb_used_omap":1,"kb_used_meta":233790,"kb_avail":94119188,"statfs":{"total":96636764160,"available":96378048512,"internally_reserved":0,"allocated":19296256,"data_stored":17280849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239401413},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510020,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189312,"kb_used_data":23472,"kb_used_omap":1,"kb_used_meta":165822,"kb_avail":94182528,"statfs":{"total":96636764160,"available":96442908672,"internally_reserved":0,"allocated":24035328,"data_stored":22022383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169802181},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510019,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":350924,"kb_used_data":18492,"kb_used_omap":1,"kb_used_meta":332414,"kb_avail":94020916,"statfs":{"total":96636764160,"available":96277417984,"internally_reserved":0,"allocated":18935808,"data_stored":16894352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":340392389},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510018,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138540,"kb_used_data":21276,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94233300,"statfs":{"total":96636764160,"available":96494899200,"internally_reserved":0,"allocated":21786624,"data_stored":19750277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542724,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":270872,"kb_used_data":19016,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94100968,"statfs":{"total":96636764160,"available":96359391232,"internally_reserved":0,"allocated":19472384,"data_stored":17479323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":257882570},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542722,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281208,"kb_used_data":19560,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94090632,"statfs":{"total":96636764160,"available":96348807168,"internally_reserved":0,"allocated":20029440,"data_stored":18004914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17494016,"data_stored":17494016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14049280,"data_stored":14049280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19767296,"data_stored":19767296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15548416,"data_stored":15548416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15024128,"data_stored":15024128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15159296,"data_stored":15159296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11628544,"data_stored":11628544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15224832,"data_stored":15224832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:03:28.577 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.578 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.578 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.578 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.578 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.578 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.578 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.578 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.579 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.579 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.579 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.579 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.579 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.579 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.579 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.579 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.579 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.580 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.580 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.580 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.580 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.580 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.580 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.580 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.580 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.581 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.581 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.581 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.581 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.581 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.581 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.581 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.581 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.582 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.582 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.582 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.582 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.582 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.582 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.582 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.583 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.583 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.583 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.583 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.583 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.583 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.583 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.584 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.584 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.584 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.584 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.584 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.584 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.584 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.584 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.585 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.585 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.585 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.585 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.585 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.585 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.585 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.585 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.586 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.586 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.586 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.586 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.586 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.586 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.586 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.586 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.587 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.587 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.587 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.587 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.587 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.587 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.587 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.587 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.588 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.588 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:30:50.507419+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=30, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.588 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.588 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.589 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.590 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.590 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.590 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.591 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.591 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.591 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.591 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.592 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.592 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.592 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:16:02.024460+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.592 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:16:04.048078+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=16, tm_sec=4, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:28.593 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:03:48.594 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:03:48.967 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:03:48.979 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-12T01:03:48.984 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":1709,"stamp":"2024-09-12T01:03:48.864848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":93219632,"num_objects":867,"num_object_clones":0,"num_object_copies":2480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":867,"num_whiteouts":0,"num_read":289757,"num_read_kb":2602955,"num_write":160574,"num_write_kb":2450853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":738829,"num_omap_keys":1787,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12950,"ondisk_log_size":12950,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1847352,"kb_used_data":155576,"kb_used_omap":12,"kb_used_meta":1691635,"kb_avail":753127368,"statfs":{"total":773094113280,"available":771202424832,"internally_reserved":0,"allocated":159309824,"data_stored":143120806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1732234800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008350"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.676823+0000","last_change":"2024-09-12T01:03:21.676684+0000","last_active":"2024-09-12T01:03:21.676823+0000","last_peered":"2024-09-12T01:03:21.676823+0000","last_clean":"2024-09-12T01:03:21.676823+0000","last_became_active":"2024-09-12T00:43:48.282777+0000","last_became_peered":"2024-09-12T00:43:48.282777+0000","last_unstale":"2024-09-12T01:03:21.676823+0000","last_undegraded":"2024-09-12T01:03:21.676823+0000","last_fullsized":"2024-09-12T01:03:21.676823+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:21.676466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:21.676466+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.676466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:10.480447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"268'2","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.259246+0000","last_change":"2024-09-12T01:03:21.259246+0000","last_active":"2024-09-12T01:03:21.259246+0000","last_peered":"2024-09-12T01:03:21.259246+0000","last_clean":"2024-09-12T01:03:21.259246+0000","last_became_active":"2024-09-12T00:32:28.069841+0000","last_became_peered":"2024-09-12T00:32:28.069841+0000","last_unstale":"2024-09-12T01:03:21.259246+0000","last_undegraded":"2024-09-12T01:03:21.259246+0000","last_fullsized":"2024-09-12T01:03:21.259246+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:21.259008+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:21.259008+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.259008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:27.097291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.820216+0000","last_change":"2024-09-12T01:03:24.820216+0000","last_active":"2024-09-12T01:03:24.820216+0000","last_peered":"2024-09-12T01:03:24.820216+0000","last_clean":"2024-09-12T01:03:24.820216+0000","last_became_active":"2024-09-12T00:32:25.026726+0000","last_became_peered":"2024-09-12T00:32:25.026726+0000","last_unstale":"2024-09-12T01:03:24.820216+0000","last_undegraded":"2024-09-12T01:03:24.820216+0000","last_fullsized":"2024-09-12T01:03:24.820216+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:03:24.820029+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:03:24.820029+0000","last_clean_scrub_stamp":"2024-09-12T01:03:24.820029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:01.041170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"268'31","reported_seq":142,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:27.355412+0000","last_change":"2024-09-12T01:03:27.355412+0000","last_active":"2024-09-12T01:03:27.355412+0000","last_peered":"2024-09-12T01:03:27.355412+0000","last_clean":"2024-09-12T01:03:27.355412+0000","last_became_active":"2024-09-12T00:30:51.543858+0000","last_became_peered":"2024-09-12T00:30:51.543858+0000","last_unstale":"2024-09-12T01:03:27.355412+0000","last_undegraded":"2024-09-12T01:03:27.355412+0000","last_fullsized":"2024-09-12T01:03:27.355412+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-09-12T01:03:27.355232+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-09-12T01:03:27.355232+0000","last_clean_scrub_stamp":"2024-09-12T01:03:27.355232+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:22.444239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":120,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:28.346882+0000","last_change":"2024-09-12T01:03:28.346656+0000","last_active":"2024-09-12T01:03:28.346882+0000","last_peered":"2024-09-12T01:03:28.346882+0000","last_clean":"2024-09-12T01:03:28.346882+0000","last_became_active":"2024-09-12T00:43:48.286291+0000","last_became_peered":"2024-09-12T00:43:48.286291+0000","last_unstale":"2024-09-12T01:03:28.346882+0000","last_undegraded":"2024-09-12T01:03:28.346882+0000","last_fullsized":"2024-09-12T01:03:28.346882+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:28.346354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:28.346354+0000","last_clean_scrub_stamp":"2024-09-12T01:03:28.346354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:34.904877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.633077+0000","last_change":"2024-09-12T01:03:26.633077+0000","last_active":"2024-09-12T01:03:26.633077+0000","last_peered":"2024-09-12T01:03:26.633077+0000","last_clean":"2024-09-12T01:03:26.633077+0000","last_became_active":"2024-09-12T00:32:28.070091+0000","last_became_peered":"2024-09-12T00:32:28.070091+0000","last_unstale":"2024-09-12T01:03:26.633077+0000","last_undegraded":"2024-09-12T01:03:26.633077+0000","last_fullsized":"2024-09-12T01:03:26.633077+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:26.632902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:26.632902+0000","last_clean_scrub_stamp":"2024-09-12T01:03:26.632902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:01.925368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:30.859845+0000","last_change":"2024-09-12T01:03:30.859845+0000","last_active":"2024-09-12T01:03:30.859845+0000","last_peered":"2024-09-12T01:03:30.859845+0000","last_clean":"2024-09-12T01:03:30.859845+0000","last_became_active":"2024-09-12T00:32:25.023750+0000","last_became_peered":"2024-09-12T00:32:25.023750+0000","last_unstale":"2024-09-12T01:03:30.859845+0000","last_undegraded":"2024-09-12T01:03:30.859845+0000","last_fullsized":"2024-09-12T01:03:30.859845+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:30.859661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:30.859661+0000","last_clean_scrub_stamp":"2024-09-12T01:03:30.859661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:50.354271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"268'20","reported_seq":106,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.366037+0000","last_change":"2024-09-12T01:03:26.366037+0000","last_active":"2024-09-12T01:03:26.366037+0000","last_peered":"2024-09-12T01:03:26.366037+0000","last_clean":"2024-09-12T01:03:26.366037+0000","last_became_active":"2024-09-12T00:30:51.554875+0000","last_became_peered":"2024-09-12T00:30:51.554875+0000","last_unstale":"2024-09-12T01:03:26.366037+0000","last_undegraded":"2024-09-12T01:03:26.366037+0000","last_fullsized":"2024-09-12T01:03:26.366037+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-12T01:03:26.365854+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-12T01:03:26.365854+0000","last_clean_scrub_stamp":"2024-09-12T01:03:26.365854+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:40.259560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":61,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.246911+0000","last_change":"2024-09-12T01:03:25.246911+0000","last_active":"2024-09-12T01:03:25.246911+0000","last_peered":"2024-09-12T01:03:25.246911+0000","last_clean":"2024-09-12T01:03:25.246911+0000","last_became_active":"2024-09-12T00:43:48.270700+0000","last_became_peered":"2024-09-12T00:43:48.270700+0000","last_unstale":"2024-09-12T01:03:25.246911+0000","last_undegraded":"2024-09-12T01:03:25.246911+0000","last_fullsized":"2024-09-12T01:03:25.246911+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:25.246726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:25.246726+0000","last_clean_scrub_stamp":"2024-09-12T01:03:25.246726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:22.826848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"268'3","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:38.841817+0000","last_change":"2024-09-12T01:03:38.841669+0000","last_active":"2024-09-12T01:03:38.841817+0000","last_peered":"2024-09-12T01:03:38.841817+0000","last_clean":"2024-09-12T01:03:38.841817+0000","last_became_active":"2024-09-12T00:32:28.065497+0000","last_became_peered":"2024-09-12T00:32:28.065497+0000","last_unstale":"2024-09-12T01:03:38.841817+0000","last_undegraded":"2024-09-12T01:03:38.841817+0000","last_fullsized":"2024-09-12T01:03:38.841817+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:38.841479+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:38.841479+0000","last_clean_scrub_stamp":"2024-09-12T01:03:38.841479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:31.771058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"268'5","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.866220+0000","last_change":"2024-09-12T01:03:25.866220+0000","last_active":"2024-09-12T01:03:25.866220+0000","last_peered":"2024-09-12T01:03:25.866220+0000","last_clean":"2024-09-12T01:03:25.866220+0000","last_became_active":"2024-09-12T00:32:25.001290+0000","last_became_peered":"2024-09-12T00:32:25.001290+0000","last_unstale":"2024-09-12T01:03:25.866220+0000","last_undegraded":"2024-09-12T01:03:25.866220+0000","last_fullsized":"2024-09-12T01:03:25.866220+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T01:03:25.865983+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T01:03:25.865983+0000","last_clean_scrub_stamp":"2024-09-12T01:03:25.865983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:09.004155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"268'25","reported_seq":118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.196431+0000","last_change":"2024-09-12T01:03:21.196280+0000","last_active":"2024-09-12T01:03:21.196431+0000","last_peered":"2024-09-12T01:03:21.196431+0000","last_clean":"2024-09-12T01:03:21.196431+0000","last_became_active":"2024-09-12T00:30:51.544751+0000","last_became_peered":"2024-09-12T00:30:51.544751+0000","last_unstale":"2024-09-12T01:03:21.196431+0000","last_undegraded":"2024-09-12T01:03:21.196431+0000","last_fullsized":"2024-09-12T01:03:21.196431+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'25","last_scrub_stamp":"2024-09-12T01:03:21.196100+0000","last_deep_scrub":"268'25","last_deep_scrub_stamp":"2024-09-12T01:03:21.196100+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.196100+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:27.636294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":82,"num_write":61,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.778656+0000","last_change":"2024-09-12T01:03:44.778656+0000","last_active":"2024-09-12T01:03:44.778656+0000","last_peered":"2024-09-12T01:03:44.778656+0000","last_clean":"2024-09-12T01:03:44.778656+0000","last_became_active":"2024-09-12T00:43:48.280166+0000","last_became_peered":"2024-09-12T00:43:48.280166+0000","last_unstale":"2024-09-12T01:03:44.778656+0000","last_undegraded":"2024-09-12T01:03:44.778656+0000","last_fullsized":"2024-09-12T01:03:44.778656+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:44.778433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:44.778433+0000","last_clean_scrub_stamp":"2024-09-12T01:03:44.778433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:04.955812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.816263+0000","last_change":"2024-09-12T01:03:37.816263+0000","last_active":"2024-09-12T01:03:37.816263+0000","last_peered":"2024-09-12T01:03:37.816263+0000","last_clean":"2024-09-12T01:03:37.816263+0000","last_became_active":"2024-09-12T00:32:28.073988+0000","last_became_peered":"2024-09-12T00:32:28.073988+0000","last_unstale":"2024-09-12T01:03:37.816263+0000","last_undegraded":"2024-09-12T01:03:37.816263+0000","last_fullsized":"2024-09-12T01:03:37.816263+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:37.816051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:37.816051+0000","last_clean_scrub_stamp":"2024-09-12T01:03:37.816051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:39.636596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.289934+0000","last_change":"2024-09-12T01:03:22.289781+0000","last_active":"2024-09-12T01:03:22.289934+0000","last_peered":"2024-09-12T01:03:22.289934+0000","last_clean":"2024-09-12T01:03:22.289934+0000","last_became_active":"2024-09-12T00:32:25.007732+0000","last_became_peered":"2024-09-12T00:32:25.007732+0000","last_unstale":"2024-09-12T01:03:22.289934+0000","last_undegraded":"2024-09-12T01:03:22.289934+0000","last_fullsized":"2024-09-12T01:03:22.289934+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:22.289600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:22.289600+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.289600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:38.839024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"268'61","reported_seq":212,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.160224+0000","last_change":"2024-09-12T01:03:20.160072+0000","last_active":"2024-09-12T01:03:20.160224+0000","last_peered":"2024-09-12T01:03:20.160224+0000","last_clean":"2024-09-12T01:03:20.160224+0000","last_became_active":"2024-09-12T00:30:51.551417+0000","last_became_peered":"2024-09-12T00:30:51.551417+0000","last_unstale":"2024-09-12T01:03:20.160224+0000","last_undegraded":"2024-09-12T01:03:20.160224+0000","last_fullsized":"2024-09-12T01:03:20.160224+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'61","last_scrub_stamp":"2024-09-12T01:03:20.159892+0000","last_deep_scrub":"268'61","last_deep_scrub_stamp":"2024-09-12T01:03:20.159892+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.159892+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:23.181094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":214,"num_write":108,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:35.933952+0000","last_change":"2024-09-12T01:03:35.933952+0000","last_active":"2024-09-12T01:03:35.933952+0000","last_peered":"2024-09-12T01:03:35.933952+0000","last_clean":"2024-09-12T01:03:35.933952+0000","last_became_active":"2024-09-12T00:43:48.283357+0000","last_became_peered":"2024-09-12T00:43:48.283357+0000","last_unstale":"2024-09-12T01:03:35.933952+0000","last_undegraded":"2024-09-12T01:03:35.933952+0000","last_fullsized":"2024-09-12T01:03:35.933952+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:35.933733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:35.933733+0000","last_clean_scrub_stamp":"2024-09-12T01:03:35.933733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:35.322431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"268'5","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.600482+0000","last_change":"2024-09-12T01:03:16.600482+0000","last_active":"2024-09-12T01:03:16.600482+0000","last_peered":"2024-09-12T01:03:16.600482+0000","last_clean":"2024-09-12T01:03:16.600482+0000","last_became_active":"2024-09-12T00:32:28.053541+0000","last_became_peered":"2024-09-12T00:32:28.053541+0000","last_unstale":"2024-09-12T01:03:16.600482+0000","last_undegraded":"2024-09-12T01:03:16.600482+0000","last_fullsized":"2024-09-12T01:03:16.600482+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T01:03:16.600298+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T01:03:16.600298+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.600298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:05.393658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"268'3","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.825072+0000","last_change":"2024-09-12T01:03:29.825072+0000","last_active":"2024-09-12T01:03:29.825072+0000","last_peered":"2024-09-12T01:03:29.825072+0000","last_clean":"2024-09-12T01:03:29.825072+0000","last_became_active":"2024-09-12T00:32:25.014665+0000","last_became_peered":"2024-09-12T00:32:25.014665+0000","last_unstale":"2024-09-12T01:03:29.825072+0000","last_undegraded":"2024-09-12T01:03:29.825072+0000","last_fullsized":"2024-09-12T01:03:29.825072+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:29.824892+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:29.824892+0000","last_clean_scrub_stamp":"2024-09-12T01:03:29.824892+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:45.015465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"268'40","reported_seq":163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.166755+0000","last_change":"2024-09-12T01:03:19.166618+0000","last_active":"2024-09-12T01:03:19.166755+0000","last_peered":"2024-09-12T01:03:19.166755+0000","last_clean":"2024-09-12T01:03:19.166755+0000","last_became_active":"2024-09-12T00:30:51.547784+0000","last_became_peered":"2024-09-12T00:30:51.547784+0000","last_unstale":"2024-09-12T01:03:19.166755+0000","last_undegraded":"2024-09-12T01:03:19.166755+0000","last_fullsized":"2024-09-12T01:03:19.166755+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'40","last_scrub_stamp":"2024-09-12T01:03:19.166420+0000","last_deep_scrub":"268'40","last_deep_scrub_stamp":"2024-09-12T01:03:19.166420+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.166420+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:04.043127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":150,"num_write":68,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:31.408665+0000","last_change":"2024-09-12T01:03:31.408665+0000","last_active":"2024-09-12T01:03:31.408665+0000","last_peered":"2024-09-12T01:03:31.408665+0000","last_clean":"2024-09-12T01:03:31.408665+0000","last_became_active":"2024-09-12T00:43:48.276078+0000","last_became_peered":"2024-09-12T00:43:48.276078+0000","last_unstale":"2024-09-12T01:03:31.408665+0000","last_undegraded":"2024-09-12T01:03:31.408665+0000","last_fullsized":"2024-09-12T01:03:31.408665+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:31.408474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:31.408474+0000","last_clean_scrub_stamp":"2024-09-12T01:03:31.408474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:45.580029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"268'5","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:37.600193+0000","last_change":"2024-09-12T00:32:28.031279+0000","last_active":"2024-09-12T01:02:37.600193+0000","last_peered":"2024-09-12T01:02:37.600193+0000","last_clean":"2024-09-12T01:02:37.600193+0000","last_became_active":"2024-09-12T00:32:28.030520+0000","last_became_peered":"2024-09-12T00:32:28.030520+0000","last_unstale":"2024-09-12T01:02:37.600193+0000","last_undegraded":"2024-09-12T01:02:37.600193+0000","last_fullsized":"2024-09-12T01:02:37.600193+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:22.614081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"268'3","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:34.014371+0000","last_change":"2024-09-12T00:32:25.010515+0000","last_active":"2024-09-12T01:01:34.014371+0000","last_peered":"2024-09-12T01:01:34.014371+0000","last_clean":"2024-09-12T01:01:34.014371+0000","last_became_active":"2024-09-12T00:32:25.009898+0000","last_became_peered":"2024-09-12T00:32:25.009898+0000","last_unstale":"2024-09-12T01:01:34.014371+0000","last_undegraded":"2024-09-12T01:01:34.014371+0000","last_fullsized":"2024-09-12T01:01:34.014371+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:23.956284+0000","last_clean_scrub_stamp":"2024-09-12T00:32:23.956284+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:26.343687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"268'22","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.605966+0000","last_change":"2024-09-12T01:03:17.605822+0000","last_active":"2024-09-12T01:03:17.605966+0000","last_peered":"2024-09-12T01:03:17.605966+0000","last_clean":"2024-09-12T01:03:17.605966+0000","last_became_active":"2024-09-12T00:30:51.559544+0000","last_became_peered":"2024-09-12T00:30:51.559544+0000","last_unstale":"2024-09-12T01:03:17.605966+0000","last_undegraded":"2024-09-12T01:03:17.605966+0000","last_fullsized":"2024-09-12T01:03:17.605966+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'22","last_scrub_stamp":"2024-09-12T01:03:17.605585+0000","last_deep_scrub":"268'22","last_deep_scrub_stamp":"2024-09-12T01:03:17.605585+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.605585+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:15.764743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":79,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:28.605077+0000","last_change":"2024-09-12T01:03:28.604949+0000","last_active":"2024-09-12T01:03:28.605077+0000","last_peered":"2024-09-12T01:03:28.605077+0000","last_clean":"2024-09-12T01:03:28.605077+0000","last_became_active":"2024-09-12T00:43:48.283057+0000","last_became_peered":"2024-09-12T00:43:48.283057+0000","last_unstale":"2024-09-12T01:03:28.605077+0000","last_undegraded":"2024-09-12T01:03:28.605077+0000","last_fullsized":"2024-09-12T01:03:28.605077+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:28.604828+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:28.604828+0000","last_clean_scrub_stamp":"2024-09-12T01:03:28.604828+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:21.064542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.656695+0000","last_change":"2024-09-12T01:03:24.656695+0000","last_active":"2024-09-12T01:03:24.656695+0000","last_peered":"2024-09-12T01:03:24.656695+0000","last_clean":"2024-09-12T01:03:24.656695+0000","last_became_active":"2024-09-12T00:32:28.065376+0000","last_became_peered":"2024-09-12T00:32:28.065376+0000","last_unstale":"2024-09-12T01:03:24.656695+0000","last_undegraded":"2024-09-12T01:03:24.656695+0000","last_fullsized":"2024-09-12T01:03:24.656695+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:24.656507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:24.656507+0000","last_clean_scrub_stamp":"2024-09-12T01:03:24.656507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:44.979172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"268'3","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.545423+0000","last_change":"2024-09-12T01:03:14.545423+0000","last_active":"2024-09-12T01:03:14.545423+0000","last_peered":"2024-09-12T01:03:14.545423+0000","last_clean":"2024-09-12T01:03:14.545423+0000","last_became_active":"2024-09-12T00:32:24.999604+0000","last_became_peered":"2024-09-12T00:32:24.999604+0000","last_unstale":"2024-09-12T01:03:14.545423+0000","last_undegraded":"2024-09-12T01:03:14.545423+0000","last_fullsized":"2024-09-12T01:03:14.545423+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:14.545246+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:14.545246+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.545246+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:04.271455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"268'41","reported_seq":161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.880756+0000","last_change":"2024-09-12T01:03:19.880756+0000","last_active":"2024-09-12T01:03:19.880756+0000","last_peered":"2024-09-12T01:03:19.880756+0000","last_clean":"2024-09-12T01:03:19.880756+0000","last_became_active":"2024-09-12T00:30:51.556729+0000","last_became_peered":"2024-09-12T00:30:51.556729+0000","last_unstale":"2024-09-12T01:03:19.880756+0000","last_undegraded":"2024-09-12T01:03:19.880756+0000","last_fullsized":"2024-09-12T01:03:19.880756+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'41","last_scrub_stamp":"2024-09-12T01:03:19.880569+0000","last_deep_scrub":"268'41","last_deep_scrub_stamp":"2024-09-12T01:03:19.880569+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.880569+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:33.118032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":144,"num_write":69,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.682541+0000","last_change":"2024-09-12T01:03:22.682410+0000","last_active":"2024-09-12T01:03:22.682541+0000","last_peered":"2024-09-12T01:03:22.682541+0000","last_clean":"2024-09-12T01:03:22.682541+0000","last_became_active":"2024-09-12T00:43:48.281781+0000","last_became_peered":"2024-09-12T00:43:48.281781+0000","last_unstale":"2024-09-12T01:03:22.682541+0000","last_undegraded":"2024-09-12T01:03:22.682541+0000","last_fullsized":"2024-09-12T01:03:22.682541+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:22.682226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:22.682226+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.682226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.752061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"268'5","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:33.977912+0000","last_change":"2024-09-12T01:03:33.977912+0000","last_active":"2024-09-12T01:03:33.977912+0000","last_peered":"2024-09-12T01:03:33.977912+0000","last_clean":"2024-09-12T01:03:33.977912+0000","last_became_active":"2024-09-12T00:32:28.062540+0000","last_became_peered":"2024-09-12T00:32:28.062540+0000","last_unstale":"2024-09-12T01:03:33.977912+0000","last_undegraded":"2024-09-12T01:03:33.977912+0000","last_fullsized":"2024-09-12T01:03:33.977912+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T01:03:33.977728+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T01:03:33.977728+0000","last_clean_scrub_stamp":"2024-09-12T01:03:33.977728+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:34.793165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.277464+0000","last_change":"2024-09-12T01:03:24.277464+0000","last_active":"2024-09-12T01:03:24.277464+0000","last_peered":"2024-09-12T01:03:24.277464+0000","last_clean":"2024-09-12T01:03:24.277464+0000","last_became_active":"2024-09-12T00:32:25.017715+0000","last_became_peered":"2024-09-12T00:32:25.017715+0000","last_unstale":"2024-09-12T01:03:24.277464+0000","last_undegraded":"2024-09-12T01:03:24.277464+0000","last_fullsized":"2024-09-12T01:03:24.277464+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:24.277282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:24.277282+0000","last_clean_scrub_stamp":"2024-09-12T01:03:24.277282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.031697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'8","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.182447+0000","last_change":"2024-09-12T01:03:18.182447+0000","last_active":"2024-09-12T01:03:18.182447+0000","last_peered":"2024-09-12T01:03:18.182447+0000","last_clean":"2024-09-12T01:03:18.182447+0000","last_became_active":"2024-09-12T00:30:51.546981+0000","last_became_peered":"2024-09-12T00:30:51.546981+0000","last_unstale":"2024-09-12T01:03:18.182447+0000","last_undegraded":"2024-09-12T01:03:18.182447+0000","last_fullsized":"2024-09-12T01:03:18.182447+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T01:03:18.182248+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T01:03:18.182248+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.182248+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:50.564435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:43.824876+0000","last_change":"2024-09-12T01:03:43.824876+0000","last_active":"2024-09-12T01:03:43.824876+0000","last_peered":"2024-09-12T01:03:43.824876+0000","last_clean":"2024-09-12T01:03:43.824876+0000","last_became_active":"2024-09-12T00:43:48.272523+0000","last_became_peered":"2024-09-12T00:43:48.272523+0000","last_unstale":"2024-09-12T01:03:43.824876+0000","last_undegraded":"2024-09-12T01:03:43.824876+0000","last_fullsized":"2024-09-12T01:03:43.824876+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:43.824601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:43.824601+0000","last_clean_scrub_stamp":"2024-09-12T01:03:43.824601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:27.699372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"268'9","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:30.899116+0000","last_change":"2024-09-12T01:03:30.899116+0000","last_active":"2024-09-12T01:03:30.899116+0000","last_peered":"2024-09-12T01:03:30.899116+0000","last_clean":"2024-09-12T01:03:30.899116+0000","last_became_active":"2024-09-12T00:32:28.062839+0000","last_became_peered":"2024-09-12T00:32:28.062839+0000","last_unstale":"2024-09-12T01:03:30.899116+0000","last_undegraded":"2024-09-12T01:03:30.899116+0000","last_fullsized":"2024-09-12T01:03:30.899116+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-09-12T01:03:30.898938+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-09-12T01:03:30.898938+0000","last_clean_scrub_stamp":"2024-09-12T01:03:30.898938+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:52.637468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"268'4","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:43.577075+0000","last_change":"2024-09-12T01:03:43.577075+0000","last_active":"2024-09-12T01:03:43.577075+0000","last_peered":"2024-09-12T01:03:43.577075+0000","last_clean":"2024-09-12T01:03:43.577075+0000","last_became_active":"2024-09-12T00:32:25.005113+0000","last_became_peered":"2024-09-12T00:32:25.005113+0000","last_unstale":"2024-09-12T01:03:43.577075+0000","last_undegraded":"2024-09-12T01:03:43.577075+0000","last_fullsized":"2024-09-12T01:03:43.577075+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:03:43.576890+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:03:43.576890+0000","last_clean_scrub_stamp":"2024-09-12T01:03:43.576890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:00.054896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3076,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'62","reported_seq":228,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.379426+0000","last_change":"2024-09-12T01:03:24.379426+0000","last_active":"2024-09-12T01:03:24.379426+0000","last_peered":"2024-09-12T01:03:24.379426+0000","last_clean":"2024-09-12T01:03:24.379426+0000","last_became_active":"2024-09-12T00:30:51.541882+0000","last_became_peered":"2024-09-12T00:30:51.541882+0000","last_unstale":"2024-09-12T01:03:24.379426+0000","last_undegraded":"2024-09-12T01:03:24.379426+0000","last_fullsized":"2024-09-12T01:03:24.379426+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'62","last_scrub_stamp":"2024-09-12T01:03:24.379229+0000","last_deep_scrub":"265'62","last_deep_scrub_stamp":"2024-09-12T01:03:24.379229+0000","last_clean_scrub_stamp":"2024-09-12T01:03:24.379229+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.634144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":254,"num_write":98,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.289216+0000","last_change":"2024-09-12T01:03:26.289216+0000","last_active":"2024-09-12T01:03:26.289216+0000","last_peered":"2024-09-12T01:03:26.289216+0000","last_clean":"2024-09-12T01:03:26.289216+0000","last_became_active":"2024-09-12T00:43:48.277883+0000","last_became_peered":"2024-09-12T00:43:48.277883+0000","last_unstale":"2024-09-12T01:03:26.289216+0000","last_undegraded":"2024-09-12T01:03:26.289216+0000","last_fullsized":"2024-09-12T01:03:26.289216+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:26.289039+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:26.289039+0000","last_clean_scrub_stamp":"2024-09-12T01:03:26.289039+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:22.524425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'5","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:36.835461+0000","last_change":"2024-09-12T01:03:36.835461+0000","last_active":"2024-09-12T01:03:36.835461+0000","last_peered":"2024-09-12T01:03:36.835461+0000","last_clean":"2024-09-12T01:03:36.835461+0000","last_became_active":"2024-09-12T00:32:28.051364+0000","last_became_peered":"2024-09-12T00:32:28.051364+0000","last_unstale":"2024-09-12T01:03:36.835461+0000","last_undegraded":"2024-09-12T01:03:36.835461+0000","last_fullsized":"2024-09-12T01:03:36.835461+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:03:36.835253+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:03:36.835253+0000","last_clean_scrub_stamp":"2024-09-12T01:03:36.835253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.532179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5136,"num_write":10,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"268'2","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.550499+0000","last_change":"2024-09-12T01:03:12.550499+0000","last_active":"2024-09-12T01:03:12.550499+0000","last_peered":"2024-09-12T01:03:12.550499+0000","last_clean":"2024-09-12T01:03:12.550499+0000","last_became_active":"2024-09-12T00:32:25.009125+0000","last_became_peered":"2024-09-12T00:32:25.009125+0000","last_unstale":"2024-09-12T01:03:12.550499+0000","last_undegraded":"2024-09-12T01:03:12.550499+0000","last_fullsized":"2024-09-12T01:03:12.550499+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:12.550316+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:12.550316+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.550316+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:16.076008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"268'31","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.372809+0000","last_change":"2024-09-12T01:03:25.372809+0000","last_active":"2024-09-12T01:03:25.372809+0000","last_peered":"2024-09-12T01:03:25.372809+0000","last_clean":"2024-09-12T01:03:25.372809+0000","last_became_active":"2024-09-12T00:30:51.553919+0000","last_became_peered":"2024-09-12T00:30:51.553919+0000","last_unstale":"2024-09-12T01:03:25.372809+0000","last_undegraded":"2024-09-12T01:03:25.372809+0000","last_fullsized":"2024-09-12T01:03:25.372809+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-09-12T01:03:25.372582+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-09-12T01:03:25.372582+0000","last_clean_scrub_stamp":"2024-09-12T01:03:25.372582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:39.785992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":104,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.576727+0000","last_change":"2024-09-12T01:03:29.576727+0000","last_active":"2024-09-12T01:03:29.576727+0000","last_peered":"2024-09-12T01:03:29.576727+0000","last_clean":"2024-09-12T01:03:29.576727+0000","last_became_active":"2024-09-12T00:43:48.288517+0000","last_became_peered":"2024-09-12T00:43:48.288517+0000","last_unstale":"2024-09-12T01:03:29.576727+0000","last_undegraded":"2024-09-12T01:03:29.576727+0000","last_fullsized":"2024-09-12T01:03:29.576727+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:29.576549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:29.576549+0000","last_clean_scrub_stamp":"2024-09-12T01:03:29.576549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:43.611153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:31.920818+0000","last_change":"2024-09-12T01:03:31.920818+0000","last_active":"2024-09-12T01:03:31.920818+0000","last_peered":"2024-09-12T01:03:31.920818+0000","last_clean":"2024-09-12T01:03:31.920818+0000","last_became_active":"2024-09-12T00:32:28.059869+0000","last_became_peered":"2024-09-12T00:32:28.059869+0000","last_unstale":"2024-09-12T01:03:31.920818+0000","last_undegraded":"2024-09-12T01:03:31.920818+0000","last_fullsized":"2024-09-12T01:03:31.920818+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:31.920640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:31.920640+0000","last_clean_scrub_stamp":"2024-09-12T01:03:31.920640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:56.606103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.835656+0000","last_change":"2024-09-12T01:03:23.835656+0000","last_active":"2024-09-12T01:03:23.835656+0000","last_peered":"2024-09-12T01:03:23.835656+0000","last_clean":"2024-09-12T01:03:23.835656+0000","last_became_active":"2024-09-12T00:32:25.026751+0000","last_became_peered":"2024-09-12T00:32:25.026751+0000","last_unstale":"2024-09-12T01:03:23.835656+0000","last_undegraded":"2024-09-12T01:03:23.835656+0000","last_fullsized":"2024-09-12T01:03:23.835656+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:03:23.835464+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:03:23.835464+0000","last_clean_scrub_stamp":"2024-09-12T01:03:23.835464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:17.545698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"268'24","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.873106+0000","last_change":"2024-09-12T01:03:17.873106+0000","last_active":"2024-09-12T01:03:17.873106+0000","last_peered":"2024-09-12T01:03:17.873106+0000","last_clean":"2024-09-12T01:03:17.873106+0000","last_became_active":"2024-09-12T00:30:51.548069+0000","last_became_peered":"2024-09-12T00:30:51.548069+0000","last_unstale":"2024-09-12T01:03:17.873106+0000","last_undegraded":"2024-09-12T01:03:17.873106+0000","last_fullsized":"2024-09-12T01:03:17.873106+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'24","last_scrub_stamp":"2024-09-12T01:03:17.872922+0000","last_deep_scrub":"268'24","last_deep_scrub_stamp":"2024-09-12T01:03:17.872922+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.872922+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:45.795027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":85,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.628949+0000","last_change":"2024-09-12T01:03:20.628949+0000","last_active":"2024-09-12T01:03:20.628949+0000","last_peered":"2024-09-12T01:03:20.628949+0000","last_clean":"2024-09-12T01:03:20.628949+0000","last_became_active":"2024-09-12T00:43:48.274026+0000","last_became_peered":"2024-09-12T00:43:48.274026+0000","last_unstale":"2024-09-12T01:03:20.628949+0000","last_undegraded":"2024-09-12T01:03:20.628949+0000","last_fullsized":"2024-09-12T01:03:20.628949+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:20.628638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:20.628638+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.628638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:44.344922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"268'2","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.561422+0000","last_change":"2024-09-12T01:03:15.561422+0000","last_active":"2024-09-12T01:03:15.561422+0000","last_peered":"2024-09-12T01:03:15.561422+0000","last_clean":"2024-09-12T01:03:15.561422+0000","last_became_active":"2024-09-12T00:32:28.062657+0000","last_became_peered":"2024-09-12T00:32:28.062657+0000","last_unstale":"2024-09-12T01:03:15.561422+0000","last_undegraded":"2024-09-12T01:03:15.561422+0000","last_fullsized":"2024-09-12T01:03:15.561422+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:15.561217+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:15.561217+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.561217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:18.353263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:28.802785+0000","last_change":"2024-09-12T01:03:28.802785+0000","last_active":"2024-09-12T01:03:28.802785+0000","last_peered":"2024-09-12T01:03:28.802785+0000","last_clean":"2024-09-12T01:03:28.802785+0000","last_became_active":"2024-09-12T00:32:24.996754+0000","last_became_peered":"2024-09-12T00:32:24.996754+0000","last_unstale":"2024-09-12T01:03:28.802785+0000","last_undegraded":"2024-09-12T01:03:28.802785+0000","last_fullsized":"2024-09-12T01:03:28.802785+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:28.802598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:28.802598+0000","last_clean_scrub_stamp":"2024-09-12T01:03:28.802598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:56.047209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"268'26","reported_seq":121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.598661+0000","last_change":"2024-09-12T01:03:37.598501+0000","last_active":"2024-09-12T01:03:37.598661+0000","last_peered":"2024-09-12T01:03:37.598661+0000","last_clean":"2024-09-12T01:03:37.598661+0000","last_became_active":"2024-09-12T00:30:51.545679+0000","last_became_peered":"2024-09-12T00:30:51.545679+0000","last_unstale":"2024-09-12T01:03:37.598661+0000","last_undegraded":"2024-09-12T01:03:37.598661+0000","last_fullsized":"2024-09-12T01:03:37.598661+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-09-12T01:03:37.598326+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-09-12T01:03:37.598326+0000","last_clean_scrub_stamp":"2024-09-12T01:03:37.598326+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:41.738949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":84,"num_write":50,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:45.800344+0000","last_change":"2024-09-12T01:03:45.800344+0000","last_active":"2024-09-12T01:03:45.800344+0000","last_peered":"2024-09-12T01:03:45.800344+0000","last_clean":"2024-09-12T01:03:45.800344+0000","last_became_active":"2024-09-12T00:43:48.285657+0000","last_became_peered":"2024-09-12T00:43:48.285657+0000","last_unstale":"2024-09-12T01:03:45.800344+0000","last_undegraded":"2024-09-12T01:03:45.800344+0000","last_fullsized":"2024-09-12T01:03:45.800344+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:45.800158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:45.800158+0000","last_clean_scrub_stamp":"2024-09-12T01:03:45.800158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:22.892358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"268'8","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:35.803246+0000","last_change":"2024-09-12T01:03:35.803246+0000","last_active":"2024-09-12T01:03:35.803246+0000","last_peered":"2024-09-12T01:03:35.803246+0000","last_clean":"2024-09-12T01:03:35.803246+0000","last_became_active":"2024-09-12T00:32:28.067168+0000","last_became_peered":"2024-09-12T00:32:28.067168+0000","last_unstale":"2024-09-12T01:03:35.803246+0000","last_undegraded":"2024-09-12T01:03:35.803246+0000","last_fullsized":"2024-09-12T01:03:35.803246+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:03:35.803057+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:03:35.803057+0000","last_clean_scrub_stamp":"2024-09-12T01:03:35.803057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:55.339465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"268'10","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.259240+0000","last_change":"2024-09-12T01:03:18.259240+0000","last_active":"2024-09-12T01:03:18.259240+0000","last_peered":"2024-09-12T01:03:18.259240+0000","last_clean":"2024-09-12T01:03:18.259240+0000","last_became_active":"2024-09-12T00:32:25.011944+0000","last_became_peered":"2024-09-12T00:32:25.011944+0000","last_unstale":"2024-09-12T01:03:18.259240+0000","last_undegraded":"2024-09-12T01:03:18.259240+0000","last_fullsized":"2024-09-12T01:03:18.259240+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'10","last_scrub_stamp":"2024-09-12T01:03:18.259037+0000","last_deep_scrub":"268'10","last_deep_scrub_stamp":"2024-09-12T01:03:18.259037+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.259037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:43.728684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":20800,"num_write":20,"num_write_kb":10558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"268'29","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.608618+0000","last_change":"2024-09-12T01:03:39.608618+0000","last_active":"2024-09-12T01:03:39.608618+0000","last_peered":"2024-09-12T01:03:39.608618+0000","last_clean":"2024-09-12T01:03:39.608618+0000","last_became_active":"2024-09-12T00:30:51.550694+0000","last_became_peered":"2024-09-12T00:30:51.550694+0000","last_unstale":"2024-09-12T01:03:39.608618+0000","last_undegraded":"2024-09-12T01:03:39.608618+0000","last_fullsized":"2024-09-12T01:03:39.608618+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'29","last_scrub_stamp":"2024-09-12T01:03:39.608428+0000","last_deep_scrub":"268'29","last_deep_scrub_stamp":"2024-09-12T01:03:39.608428+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.608428+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:30.277492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.370339+0000","last_change":"2024-09-12T01:03:29.370339+0000","last_active":"2024-09-12T01:03:29.370339+0000","last_peered":"2024-09-12T01:03:29.370339+0000","last_clean":"2024-09-12T01:03:29.370339+0000","last_became_active":"2024-09-12T00:43:48.272356+0000","last_became_peered":"2024-09-12T00:43:48.272356+0000","last_unstale":"2024-09-12T01:03:29.370339+0000","last_undegraded":"2024-09-12T01:03:29.370339+0000","last_fullsized":"2024-09-12T01:03:29.370339+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:29.370142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:29.370142+0000","last_clean_scrub_stamp":"2024-09-12T01:03:29.370142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:52.163438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"268'6","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:33.855135+0000","last_change":"2024-09-12T01:03:33.855135+0000","last_active":"2024-09-12T01:03:33.855135+0000","last_peered":"2024-09-12T01:03:33.855135+0000","last_clean":"2024-09-12T01:03:33.855135+0000","last_became_active":"2024-09-12T00:32:28.067388+0000","last_became_peered":"2024-09-12T00:32:28.067388+0000","last_unstale":"2024-09-12T01:03:33.855135+0000","last_undegraded":"2024-09-12T01:03:33.855135+0000","last_fullsized":"2024-09-12T01:03:33.855135+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:03:33.854948+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:03:33.854948+0000","last_clean_scrub_stamp":"2024-09-12T01:03:33.854948+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:16.321215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:27.773653+0000","last_change":"2024-09-12T01:03:27.773653+0000","last_active":"2024-09-12T01:03:27.773653+0000","last_peered":"2024-09-12T01:03:27.773653+0000","last_clean":"2024-09-12T01:03:27.773653+0000","last_became_active":"2024-09-12T00:32:25.005882+0000","last_became_peered":"2024-09-12T00:32:25.005882+0000","last_unstale":"2024-09-12T01:03:27.773653+0000","last_undegraded":"2024-09-12T01:03:27.773653+0000","last_fullsized":"2024-09-12T01:03:27.773653+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:27.773442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:27.773442+0000","last_clean_scrub_stamp":"2024-09-12T01:03:27.773442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:58.468642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"268'19","reported_seq":104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.845346+0000","last_change":"2024-09-12T01:03:16.845169+0000","last_active":"2024-09-12T01:03:16.845346+0000","last_peered":"2024-09-12T01:03:16.845346+0000","last_clean":"2024-09-12T01:03:16.845346+0000","last_became_active":"2024-09-12T00:30:51.548932+0000","last_became_peered":"2024-09-12T00:30:51.548932+0000","last_unstale":"2024-09-12T01:03:16.845346+0000","last_undegraded":"2024-09-12T01:03:16.845346+0000","last_fullsized":"2024-09-12T01:03:16.845346+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'19","last_scrub_stamp":"2024-09-12T01:03:16.844979+0000","last_deep_scrub":"268'19","last_deep_scrub_stamp":"2024-09-12T01:03:16.844979+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.844979+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:09.777377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:32.405175+0000","last_change":"2024-09-12T01:03:32.405175+0000","last_active":"2024-09-12T01:03:32.405175+0000","last_peered":"2024-09-12T01:03:32.405175+0000","last_clean":"2024-09-12T01:03:32.405175+0000","last_became_active":"2024-09-12T00:43:48.274983+0000","last_became_peered":"2024-09-12T00:43:48.274983+0000","last_unstale":"2024-09-12T01:03:32.405175+0000","last_undegraded":"2024-09-12T01:03:32.405175+0000","last_fullsized":"2024-09-12T01:03:32.405175+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:32.404954+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:32.404954+0000","last_clean_scrub_stamp":"2024-09-12T01:03:32.404954+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:27.530313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"265'5","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.921405+0000","last_change":"2024-09-12T01:03:29.921405+0000","last_active":"2024-09-12T01:03:29.921405+0000","last_peered":"2024-09-12T01:03:29.921405+0000","last_clean":"2024-09-12T01:03:29.921405+0000","last_became_active":"2024-09-12T00:32:28.049947+0000","last_became_peered":"2024-09-12T00:32:28.049947+0000","last_unstale":"2024-09-12T01:03:29.921405+0000","last_undegraded":"2024-09-12T01:03:29.921405+0000","last_fullsized":"2024-09-12T01:03:29.921405+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:03:29.921211+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:03:29.921211+0000","last_clean_scrub_stamp":"2024-09-12T01:03:29.921211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:03.277478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.260368+0000","last_change":"2024-09-12T01:03:17.260368+0000","last_active":"2024-09-12T01:03:17.260368+0000","last_peered":"2024-09-12T01:03:17.260368+0000","last_clean":"2024-09-12T01:03:17.260368+0000","last_became_active":"2024-09-12T00:32:25.008089+0000","last_became_peered":"2024-09-12T00:32:25.008089+0000","last_unstale":"2024-09-12T01:03:17.260368+0000","last_undegraded":"2024-09-12T01:03:17.260368+0000","last_fullsized":"2024-09-12T01:03:17.260368+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:17.260180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:17.260180+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.260180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:55.268421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"268'83","reported_seq":333,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.600802+0000","last_change":"2024-09-12T01:03:18.600561+0000","last_active":"2024-09-12T01:03:18.600802+0000","last_peered":"2024-09-12T01:03:18.600802+0000","last_clean":"2024-09-12T01:03:18.600802+0000","last_became_active":"2024-09-12T00:30:51.548232+0000","last_became_peered":"2024-09-12T00:30:51.548232+0000","last_unstale":"2024-09-12T01:03:18.600802+0000","last_undegraded":"2024-09-12T01:03:18.600802+0000","last_fullsized":"2024-09-12T01:03:18.600802+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'83","last_scrub_stamp":"2024-09-12T01:03:18.600292+0000","last_deep_scrub":"268'83","last_deep_scrub_stamp":"2024-09-12T01:03:18.600292+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.600292+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:02.341405+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":390,"num_write":93,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2796,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:27.335286+0000","last_change":"2024-09-12T01:03:27.335286+0000","last_active":"2024-09-12T01:03:27.335286+0000","last_peered":"2024-09-12T01:03:27.335286+0000","last_clean":"2024-09-12T01:03:27.335286+0000","last_became_active":"2024-09-12T00:43:48.271560+0000","last_became_peered":"2024-09-12T00:43:48.271560+0000","last_unstale":"2024-09-12T01:03:27.335286+0000","last_undegraded":"2024-09-12T01:03:27.335286+0000","last_fullsized":"2024-09-12T01:03:27.335286+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:27.335097+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:27.335097+0000","last_clean_scrub_stamp":"2024-09-12T01:03:27.335097+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:55.194135+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.234163+0000","last_change":"2024-09-12T00:32:28.058883+0000","last_active":"2024-09-12T01:00:29.234163+0000","last_peered":"2024-09-12T01:00:29.234163+0000","last_clean":"2024-09-12T01:00:29.234163+0000","last_became_active":"2024-09-12T00:32:28.058127+0000","last_became_peered":"2024-09-12T00:32:28.058127+0000","last_unstale":"2024-09-12T01:00:29.234163+0000","last_undegraded":"2024-09-12T01:00:29.234163+0000","last_fullsized":"2024-09-12T01:00:29.234163+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"268'3","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.218360+0000","last_change":"2024-09-12T01:03:19.218360+0000","last_active":"2024-09-12T01:03:19.218360+0000","last_peered":"2024-09-12T01:03:19.218360+0000","last_clean":"2024-09-12T01:03:19.218360+0000","last_became_active":"2024-09-12T00:32:25.013042+0000","last_became_peered":"2024-09-12T00:32:25.013042+0000","last_unstale":"2024-09-12T01:03:19.218360+0000","last_undegraded":"2024-09-12T01:03:19.218360+0000","last_fullsized":"2024-09-12T01:03:19.218360+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:19.218177+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:19.218177+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.218177+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:33.238245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'29","reported_seq":137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.846534+0000","last_change":"2024-09-12T01:03:15.846217+0000","last_active":"2024-09-12T01:03:15.846534+0000","last_peered":"2024-09-12T01:03:15.846534+0000","last_clean":"2024-09-12T01:03:15.846534+0000","last_became_active":"2024-09-12T00:30:51.545619+0000","last_became_peered":"2024-09-12T00:30:51.545619+0000","last_unstale":"2024-09-12T01:03:15.846534+0000","last_undegraded":"2024-09-12T01:03:15.846534+0000","last_fullsized":"2024-09-12T01:03:15.846534+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-12T01:03:15.845929+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-12T01:03:15.845929+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.845929+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:45.123501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":120,"num_write":40,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.844268+0000","last_change":"2024-09-12T01:03:39.844268+0000","last_active":"2024-09-12T01:03:39.844268+0000","last_peered":"2024-09-12T01:03:39.844268+0000","last_clean":"2024-09-12T01:03:39.844268+0000","last_became_active":"2024-09-12T00:43:48.279197+0000","last_became_peered":"2024-09-12T00:43:48.279197+0000","last_unstale":"2024-09-12T01:03:39.844268+0000","last_undegraded":"2024-09-12T01:03:39.844268+0000","last_fullsized":"2024-09-12T01:03:39.844268+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.844077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.844077+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.844077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:58.507981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:27.904790+0000","last_change":"2024-09-12T01:03:27.904790+0000","last_active":"2024-09-12T01:03:27.904790+0000","last_peered":"2024-09-12T01:03:27.904790+0000","last_clean":"2024-09-12T01:03:27.904790+0000","last_became_active":"2024-09-12T00:32:28.057839+0000","last_became_peered":"2024-09-12T00:32:28.057839+0000","last_unstale":"2024-09-12T01:03:27.904790+0000","last_undegraded":"2024-09-12T01:03:27.904790+0000","last_fullsized":"2024-09-12T01:03:27.904790+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:27.904609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:27.904609+0000","last_clean_scrub_stamp":"2024-09-12T01:03:27.904609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:12.429334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"268'8","reported_seq":66,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.606924+0000","last_change":"2024-09-12T01:03:22.606924+0000","last_active":"2024-09-12T01:03:22.606924+0000","last_peered":"2024-09-12T01:03:22.606924+0000","last_clean":"2024-09-12T01:03:22.606924+0000","last_became_active":"2024-09-12T00:32:25.021649+0000","last_became_peered":"2024-09-12T00:32:25.021649+0000","last_unstale":"2024-09-12T01:03:22.606924+0000","last_undegraded":"2024-09-12T01:03:22.606924+0000","last_fullsized":"2024-09-12T01:03:22.606924+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:03:22.606753+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:03:22.606753+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.606753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:45.672695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"268'68","reported_seq":244,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.863606+0000","last_change":"2024-09-12T01:03:14.863606+0000","last_active":"2024-09-12T01:03:14.863606+0000","last_peered":"2024-09-12T01:03:14.863606+0000","last_clean":"2024-09-12T01:03:14.863606+0000","last_became_active":"2024-09-12T00:30:51.562106+0000","last_became_peered":"2024-09-12T00:30:51.562106+0000","last_unstale":"2024-09-12T01:03:14.863606+0000","last_undegraded":"2024-09-12T01:03:14.863606+0000","last_fullsized":"2024-09-12T01:03:14.863606+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'68","last_scrub_stamp":"2024-09-12T01:03:14.863392+0000","last_deep_scrub":"268'68","last_deep_scrub_stamp":"2024-09-12T01:03:14.863392+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.863392+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:39.028253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":360,"num_read_kb":258,"num_write":123,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.271914+0000","last_change":"2024-09-12T01:03:23.271914+0000","last_active":"2024-09-12T01:03:23.271914+0000","last_peered":"2024-09-12T01:03:23.271914+0000","last_clean":"2024-09-12T01:03:23.271914+0000","last_became_active":"2024-09-12T00:43:48.286629+0000","last_became_peered":"2024-09-12T00:43:48.286629+0000","last_unstale":"2024-09-12T01:03:23.271914+0000","last_undegraded":"2024-09-12T01:03:23.271914+0000","last_fullsized":"2024-09-12T01:03:23.271914+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:23.271732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:23.271732+0000","last_clean_scrub_stamp":"2024-09-12T01:03:23.271732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:59.975818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.869196+0000","last_change":"2024-09-12T01:03:26.869196+0000","last_active":"2024-09-12T01:03:26.869196+0000","last_peered":"2024-09-12T01:03:26.869196+0000","last_clean":"2024-09-12T01:03:26.869196+0000","last_became_active":"2024-09-12T00:32:28.070913+0000","last_became_peered":"2024-09-12T00:32:28.070913+0000","last_unstale":"2024-09-12T01:03:26.869196+0000","last_undegraded":"2024-09-12T01:03:26.869196+0000","last_fullsized":"2024-09-12T01:03:26.869196+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:26.869003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:26.869003+0000","last_clean_scrub_stamp":"2024-09-12T01:03:26.869003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:51.193560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"268'10","reported_seq":63,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.271953+0000","last_change":"2024-09-12T01:03:23.271953+0000","last_active":"2024-09-12T01:03:23.271953+0000","last_peered":"2024-09-12T01:03:23.271953+0000","last_clean":"2024-09-12T01:03:23.271953+0000","last_became_active":"2024-09-12T00:32:25.007681+0000","last_became_peered":"2024-09-12T00:32:25.007681+0000","last_unstale":"2024-09-12T01:03:23.271953+0000","last_undegraded":"2024-09-12T01:03:23.271953+0000","last_fullsized":"2024-09-12T01:03:23.271953+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'10","last_scrub_stamp":"2024-09-12T01:03:23.271777+0000","last_deep_scrub":"268'10","last_deep_scrub_stamp":"2024-09-12T01:03:23.271777+0000","last_clean_scrub_stamp":"2024-09-12T01:03:23.271777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:38.486892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4146,"num_write":20,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"268'39","reported_seq":158,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:36.585030+0000","last_change":"2024-09-12T01:03:36.585030+0000","last_active":"2024-09-12T01:03:36.585030+0000","last_peered":"2024-09-12T01:03:36.585030+0000","last_clean":"2024-09-12T01:03:36.585030+0000","last_became_active":"2024-09-12T00:30:51.559520+0000","last_became_peered":"2024-09-12T00:30:51.559520+0000","last_unstale":"2024-09-12T01:03:36.585030+0000","last_undegraded":"2024-09-12T01:03:36.585030+0000","last_fullsized":"2024-09-12T01:03:36.585030+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'39","last_scrub_stamp":"2024-09-12T01:03:36.584838+0000","last_deep_scrub":"268'39","last_deep_scrub_stamp":"2024-09-12T01:03:36.584838+0000","last_clean_scrub_stamp":"2024-09-12T01:03:36.584838+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:32.471824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":143,"num_write":68,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:01:09.007105+0000","last_change":"2024-09-12T00:43:48.287080+0000","last_active":"2024-09-12T01:01:09.007105+0000","last_peered":"2024-09-12T01:01:09.007105+0000","last_clean":"2024-09-12T01:01:09.007105+0000","last_became_active":"2024-09-12T00:43:48.286079+0000","last_became_peered":"2024-09-12T00:43:48.286079+0000","last_unstale":"2024-09-12T01:01:09.007105+0000","last_undegraded":"2024-09-12T01:01:09.007105+0000","last_fullsized":"2024-09-12T01:01:09.007105+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:28.896022+0000","last_change":"2024-09-12T01:03:28.896022+0000","last_active":"2024-09-12T01:03:28.896022+0000","last_peered":"2024-09-12T01:03:28.896022+0000","last_clean":"2024-09-12T01:03:28.896022+0000","last_became_active":"2024-09-12T00:32:28.074621+0000","last_became_peered":"2024-09-12T00:32:28.074621+0000","last_unstale":"2024-09-12T01:03:28.896022+0000","last_undegraded":"2024-09-12T01:03:28.896022+0000","last_fullsized":"2024-09-12T01:03:28.896022+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:28.895840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:28.895840+0000","last_clean_scrub_stamp":"2024-09-12T01:03:28.895840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:11.927530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.848666+0000","last_change":"2024-09-12T01:03:21.848666+0000","last_active":"2024-09-12T01:03:21.848666+0000","last_peered":"2024-09-12T01:03:21.848666+0000","last_clean":"2024-09-12T01:03:21.848666+0000","last_became_active":"2024-09-12T00:32:25.008419+0000","last_became_peered":"2024-09-12T00:32:25.008419+0000","last_unstale":"2024-09-12T01:03:21.848666+0000","last_undegraded":"2024-09-12T01:03:21.848666+0000","last_fullsized":"2024-09-12T01:03:21.848666+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:21.848478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:21.848478+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.848478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:37.368526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"268'30","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.266399+0000","last_change":"2024-09-12T01:03:16.266399+0000","last_active":"2024-09-12T01:03:16.266399+0000","last_peered":"2024-09-12T01:03:16.266399+0000","last_clean":"2024-09-12T01:03:16.266399+0000","last_became_active":"2024-09-12T00:30:51.540434+0000","last_became_peered":"2024-09-12T00:30:51.540434+0000","last_unstale":"2024-09-12T01:03:16.266399+0000","last_undegraded":"2024-09-12T01:03:16.266399+0000","last_fullsized":"2024-09-12T01:03:16.266399+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-12T01:03:16.266214+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-12T01:03:16.266214+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.266214+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:23.214089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":92,"num_write":60,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.293765+0000","last_change":"2024-09-12T01:03:24.293765+0000","last_active":"2024-09-12T01:03:24.293765+0000","last_peered":"2024-09-12T01:03:24.293765+0000","last_clean":"2024-09-12T01:03:24.293765+0000","last_became_active":"2024-09-12T00:43:48.278477+0000","last_became_peered":"2024-09-12T00:43:48.278477+0000","last_unstale":"2024-09-12T01:03:24.293765+0000","last_undegraded":"2024-09-12T01:03:24.293765+0000","last_fullsized":"2024-09-12T01:03:24.293765+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:24.293583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:24.293583+0000","last_clean_scrub_stamp":"2024-09-12T01:03:24.293583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:45.657684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"268'11","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:32.838051+0000","last_change":"2024-09-12T01:03:32.838051+0000","last_active":"2024-09-12T01:03:32.838051+0000","last_peered":"2024-09-12T01:03:32.838051+0000","last_clean":"2024-09-12T01:03:32.838051+0000","last_became_active":"2024-09-12T00:32:28.066441+0000","last_became_peered":"2024-09-12T00:32:28.066441+0000","last_unstale":"2024-09-12T01:03:32.838051+0000","last_undegraded":"2024-09-12T01:03:32.838051+0000","last_fullsized":"2024-09-12T01:03:32.838051+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'11","last_scrub_stamp":"2024-09-12T01:03:32.837882+0000","last_deep_scrub":"268'11","last_deep_scrub_stamp":"2024-09-12T01:03:32.837882+0000","last_clean_scrub_stamp":"2024-09-12T01:03:32.837882+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:07.881204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":37890,"num_write":21,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.819368+0000","last_change":"2024-09-12T01:03:22.819368+0000","last_active":"2024-09-12T01:03:22.819368+0000","last_peered":"2024-09-12T01:03:22.819368+0000","last_clean":"2024-09-12T01:03:22.819368+0000","last_became_active":"2024-09-12T00:32:25.010752+0000","last_became_peered":"2024-09-12T00:32:25.010752+0000","last_unstale":"2024-09-12T01:03:22.819368+0000","last_undegraded":"2024-09-12T01:03:22.819368+0000","last_fullsized":"2024-09-12T01:03:22.819368+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:22.819184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:22.819184+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.819184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:26.792829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"268'115","reported_seq":473,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.202043+0000","last_change":"2024-09-12T01:03:17.202043+0000","last_active":"2024-09-12T01:03:17.202043+0000","last_peered":"2024-09-12T01:03:17.202043+0000","last_clean":"2024-09-12T01:03:17.202043+0000","last_became_active":"2024-09-12T00:30:51.550081+0000","last_became_peered":"2024-09-12T00:30:51.550081+0000","last_unstale":"2024-09-12T01:03:17.202043+0000","last_undegraded":"2024-09-12T01:03:17.202043+0000","last_fullsized":"2024-09-12T01:03:17.202043+0000","mapping_epoch":257,"log_start":"265'100","ondisk_log_start":"265'100","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-12T01:03:17.201850+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-12T01:03:17.201850+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.201850+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:23.902914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":826,"num_read_kb":599,"num_write":142,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4473,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:41.853630+0000","last_change":"2024-09-12T01:03:41.853630+0000","last_active":"2024-09-12T01:03:41.853630+0000","last_peered":"2024-09-12T01:03:41.853630+0000","last_clean":"2024-09-12T01:03:41.853630+0000","last_became_active":"2024-09-12T00:43:48.272486+0000","last_became_peered":"2024-09-12T00:43:48.272486+0000","last_unstale":"2024-09-12T01:03:41.853630+0000","last_undegraded":"2024-09-12T01:03:41.853630+0000","last_fullsized":"2024-09-12T01:03:41.853630+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:41.853437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:41.853437+0000","last_clean_scrub_stamp":"2024-09-12T01:03:41.853437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:01.403207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":33,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000354+0000","last_change":"2024-09-12T00:32:28.051078+0000","last_active":"2024-09-12T01:00:39.000354+0000","last_peered":"2024-09-12T01:00:39.000354+0000","last_clean":"2024-09-12T01:00:39.000354+0000","last_became_active":"2024-09-12T00:32:28.049186+0000","last_became_peered":"2024-09-12T00:32:28.049186+0000","last_unstale":"2024-09-12T01:00:39.000354+0000","last_undegraded":"2024-09-12T01:00:39.000354+0000","last_fullsized":"2024-09-12T01:00:39.000354+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.900005+0000","last_change":"2024-09-12T01:03:18.900005+0000","last_active":"2024-09-12T01:03:18.900005+0000","last_peered":"2024-09-12T01:03:18.900005+0000","last_clean":"2024-09-12T01:03:18.900005+0000","last_became_active":"2024-09-12T00:32:24.999633+0000","last_became_peered":"2024-09-12T00:32:24.999633+0000","last_unstale":"2024-09-12T01:03:18.900005+0000","last_undegraded":"2024-09-12T01:03:18.900005+0000","last_fullsized":"2024-09-12T01:03:18.900005+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:18.899817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:18.899817+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.899817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:50.009102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"268'69","reported_seq":245,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.149747+0000","last_change":"2024-09-12T01:03:16.149747+0000","last_active":"2024-09-12T01:03:16.149747+0000","last_peered":"2024-09-12T01:03:16.149747+0000","last_clean":"2024-09-12T01:03:16.149747+0000","last_became_active":"2024-09-12T00:30:51.546873+0000","last_became_peered":"2024-09-12T00:30:51.546873+0000","last_unstale":"2024-09-12T01:03:16.149747+0000","last_undegraded":"2024-09-12T01:03:16.149747+0000","last_fullsized":"2024-09-12T01:03:16.149747+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'69","last_scrub_stamp":"2024-09-12T01:03:16.149570+0000","last_deep_scrub":"268'69","last_deep_scrub_stamp":"2024-09-12T01:03:16.149570+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.149570+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:41.334298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":256,"num_write":124,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.645229+0000","last_change":"2024-09-12T01:03:25.645229+0000","last_active":"2024-09-12T01:03:25.645229+0000","last_peered":"2024-09-12T01:03:25.645229+0000","last_clean":"2024-09-12T01:03:25.645229+0000","last_became_active":"2024-09-12T00:43:48.287144+0000","last_became_peered":"2024-09-12T00:43:48.287144+0000","last_unstale":"2024-09-12T01:03:25.645229+0000","last_undegraded":"2024-09-12T01:03:25.645229+0000","last_fullsized":"2024-09-12T01:03:25.645229+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:25.645045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:25.645045+0000","last_clean_scrub_stamp":"2024-09-12T01:03:25.645045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:15.791265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:27.604111+0000","last_change":"2024-09-12T01:03:27.604111+0000","last_active":"2024-09-12T01:03:27.604111+0000","last_peered":"2024-09-12T01:03:27.604111+0000","last_clean":"2024-09-12T01:03:27.604111+0000","last_became_active":"2024-09-12T00:32:28.063712+0000","last_became_peered":"2024-09-12T00:32:28.063712+0000","last_unstale":"2024-09-12T01:03:27.604111+0000","last_undegraded":"2024-09-12T01:03:27.604111+0000","last_fullsized":"2024-09-12T01:03:27.604111+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:27.603936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:27.603936+0000","last_clean_scrub_stamp":"2024-09-12T01:03:27.603936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:49.872350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"268'3","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.767024+0000","last_change":"2024-09-12T01:03:26.767024+0000","last_active":"2024-09-12T01:03:26.767024+0000","last_peered":"2024-09-12T01:03:26.767024+0000","last_clean":"2024-09-12T01:03:26.767024+0000","last_became_active":"2024-09-12T00:32:25.005902+0000","last_became_peered":"2024-09-12T00:32:25.005902+0000","last_unstale":"2024-09-12T01:03:26.767024+0000","last_undegraded":"2024-09-12T01:03:26.767024+0000","last_fullsized":"2024-09-12T01:03:26.767024+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:26.766795+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:26.766795+0000","last_clean_scrub_stamp":"2024-09-12T01:03:26.766795+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:33.560560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"268'31","reported_seq":135,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.540572+0000","last_change":"2024-09-12T01:03:14.540434+0000","last_active":"2024-09-12T01:03:14.540572+0000","last_peered":"2024-09-12T01:03:14.540572+0000","last_clean":"2024-09-12T01:03:14.540572+0000","last_became_active":"2024-09-12T00:30:51.541904+0000","last_became_peered":"2024-09-12T00:30:51.541904+0000","last_unstale":"2024-09-12T01:03:14.540572+0000","last_undegraded":"2024-09-12T01:03:14.540572+0000","last_fullsized":"2024-09-12T01:03:14.540572+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-09-12T01:03:14.540261+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-09-12T01:03:14.540261+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.540261+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:50.202651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":109,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.649168+0000","last_change":"2024-09-12T01:03:19.649168+0000","last_active":"2024-09-12T01:03:19.649168+0000","last_peered":"2024-09-12T01:03:19.649168+0000","last_clean":"2024-09-12T01:03:19.649168+0000","last_became_active":"2024-09-12T00:43:48.274756+0000","last_became_peered":"2024-09-12T00:43:48.274756+0000","last_unstale":"2024-09-12T01:03:19.649168+0000","last_undegraded":"2024-09-12T01:03:19.649168+0000","last_fullsized":"2024-09-12T01:03:19.649168+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:19.648922+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:19.648922+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.648922+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:52.437120+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"268'5","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.282336+0000","last_change":"2024-09-12T01:03:25.282336+0000","last_active":"2024-09-12T01:03:25.282336+0000","last_peered":"2024-09-12T01:03:25.282336+0000","last_clean":"2024-09-12T01:03:25.282336+0000","last_became_active":"2024-09-12T00:32:28.066029+0000","last_became_peered":"2024-09-12T00:32:28.066029+0000","last_unstale":"2024-09-12T01:03:25.282336+0000","last_undegraded":"2024-09-12T01:03:25.282336+0000","last_fullsized":"2024-09-12T01:03:25.282336+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T01:03:25.282160+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T01:03:25.282160+0000","last_clean_scrub_stamp":"2024-09-12T01:03:25.282160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:20.419173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"268'3","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.877291+0000","last_change":"2024-09-12T01:03:20.877291+0000","last_active":"2024-09-12T01:03:20.877291+0000","last_peered":"2024-09-12T01:03:20.877291+0000","last_clean":"2024-09-12T01:03:20.877291+0000","last_became_active":"2024-09-12T00:32:25.001194+0000","last_became_peered":"2024-09-12T00:32:25.001194+0000","last_unstale":"2024-09-12T01:03:20.877291+0000","last_undegraded":"2024-09-12T01:03:20.877291+0000","last_fullsized":"2024-09-12T01:03:20.877291+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:20.877064+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:20.877064+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.877064+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:15.612436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"268'15","reported_seq":91,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.685317+0000","last_change":"2024-09-12T01:03:24.685317+0000","last_active":"2024-09-12T01:03:24.685317+0000","last_peered":"2024-09-12T01:03:24.685317+0000","last_clean":"2024-09-12T01:03:24.685317+0000","last_became_active":"2024-09-12T00:30:51.543711+0000","last_became_peered":"2024-09-12T00:30:51.543711+0000","last_unstale":"2024-09-12T01:03:24.685317+0000","last_undegraded":"2024-09-12T01:03:24.685317+0000","last_fullsized":"2024-09-12T01:03:24.685317+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'15","last_scrub_stamp":"2024-09-12T01:03:24.685137+0000","last_deep_scrub":"268'15","last_deep_scrub_stamp":"2024-09-12T01:03:24.685137+0000","last_clean_scrub_stamp":"2024-09-12T01:03:24.685137+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:54.374975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":43,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:32.946873+0000","last_change":"2024-09-12T01:03:32.946873+0000","last_active":"2024-09-12T01:03:32.946873+0000","last_peered":"2024-09-12T01:03:32.946873+0000","last_clean":"2024-09-12T01:03:32.946873+0000","last_became_active":"2024-09-12T00:43:48.289475+0000","last_became_peered":"2024-09-12T00:43:48.289475+0000","last_unstale":"2024-09-12T01:03:32.946873+0000","last_undegraded":"2024-09-12T01:03:32.946873+0000","last_fullsized":"2024-09-12T01:03:32.946873+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:32.946660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:32.946660+0000","last_clean_scrub_stamp":"2024-09-12T01:03:32.946660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:44.883634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.604673+0000","last_change":"2024-09-12T01:03:18.604673+0000","last_active":"2024-09-12T01:03:18.604673+0000","last_peered":"2024-09-12T01:03:18.604673+0000","last_clean":"2024-09-12T01:03:18.604673+0000","last_became_active":"2024-09-12T00:32:28.055934+0000","last_became_peered":"2024-09-12T00:32:28.055934+0000","last_unstale":"2024-09-12T01:03:18.604673+0000","last_undegraded":"2024-09-12T01:03:18.604673+0000","last_fullsized":"2024-09-12T01:03:18.604673+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:18.604375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:18.604375+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.604375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:11.137151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"268'3","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:41.611751+0000","last_change":"2024-09-12T01:03:41.611751+0000","last_active":"2024-09-12T01:03:41.611751+0000","last_peered":"2024-09-12T01:03:41.611751+0000","last_clean":"2024-09-12T01:03:41.611751+0000","last_became_active":"2024-09-12T00:32:25.004503+0000","last_became_peered":"2024-09-12T00:32:25.004503+0000","last_unstale":"2024-09-12T01:03:41.611751+0000","last_undegraded":"2024-09-12T01:03:41.611751+0000","last_fullsized":"2024-09-12T01:03:41.611751+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:41.611558+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:41.611558+0000","last_clean_scrub_stamp":"2024-09-12T01:03:41.611558+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:11.851497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"268'12","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.595764+0000","last_change":"2024-09-12T01:03:11.595595+0000","last_active":"2024-09-12T01:03:11.595764+0000","last_peered":"2024-09-12T01:03:11.595764+0000","last_clean":"2024-09-12T01:03:11.595764+0000","last_became_active":"2024-09-12T00:30:51.542992+0000","last_became_peered":"2024-09-12T00:30:51.542992+0000","last_unstale":"2024-09-12T01:03:11.595764+0000","last_undegraded":"2024-09-12T01:03:11.595764+0000","last_fullsized":"2024-09-12T01:03:11.595764+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-09-12T01:03:11.595417+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-09-12T01:03:11.595417+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.595417+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:35.022578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.644001+0000","last_change":"2024-09-12T01:03:23.644001+0000","last_active":"2024-09-12T01:03:23.644001+0000","last_peered":"2024-09-12T01:03:23.644001+0000","last_clean":"2024-09-12T01:03:23.644001+0000","last_became_active":"2024-09-12T00:43:48.276293+0000","last_became_peered":"2024-09-12T00:43:48.276293+0000","last_unstale":"2024-09-12T01:03:23.644001+0000","last_undegraded":"2024-09-12T01:03:23.644001+0000","last_fullsized":"2024-09-12T01:03:23.644001+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:23.643816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:23.643816+0000","last_clean_scrub_stamp":"2024-09-12T01:03:23.643816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:29.972414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"268'6","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.821345+0000","last_change":"2024-09-12T01:03:34.821345+0000","last_active":"2024-09-12T01:03:34.821345+0000","last_peered":"2024-09-12T01:03:34.821345+0000","last_clean":"2024-09-12T01:03:34.821345+0000","last_became_active":"2024-09-12T00:32:28.067824+0000","last_became_peered":"2024-09-12T00:32:28.067824+0000","last_unstale":"2024-09-12T01:03:34.821345+0000","last_undegraded":"2024-09-12T01:03:34.821345+0000","last_fullsized":"2024-09-12T01:03:34.821345+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:03:34.821139+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:03:34.821139+0000","last_clean_scrub_stamp":"2024-09-12T01:03:34.821139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:25.409721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"268'3","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:40.626101+0000","last_change":"2024-09-12T01:03:40.626101+0000","last_active":"2024-09-12T01:03:40.626101+0000","last_peered":"2024-09-12T01:03:40.626101+0000","last_clean":"2024-09-12T01:03:40.626101+0000","last_became_active":"2024-09-12T00:32:25.022210+0000","last_became_peered":"2024-09-12T00:32:25.022210+0000","last_unstale":"2024-09-12T01:03:40.626101+0000","last_undegraded":"2024-09-12T01:03:40.626101+0000","last_fullsized":"2024-09-12T01:03:40.626101+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:40.625914+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:40.625914+0000","last_clean_scrub_stamp":"2024-09-12T01:03:40.625914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:29.752085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":142,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.336103+0000","last_change":"2024-09-12T01:03:23.336103+0000","last_active":"2024-09-12T01:03:23.336103+0000","last_peered":"2024-09-12T01:03:23.336103+0000","last_clean":"2024-09-12T01:03:23.336103+0000","last_became_active":"2024-09-12T00:30:51.549942+0000","last_became_peered":"2024-09-12T00:30:51.549942+0000","last_unstale":"2024-09-12T01:03:23.336103+0000","last_undegraded":"2024-09-12T01:03:23.336103+0000","last_fullsized":"2024-09-12T01:03:23.336103+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'33","last_scrub_stamp":"2024-09-12T01:03:23.335921+0000","last_deep_scrub":"268'33","last_deep_scrub_stamp":"2024-09-12T01:03:23.335921+0000","last_clean_scrub_stamp":"2024-09-12T01:03:23.335921+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:28.099431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":118,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.596066+0000","last_change":"2024-09-12T01:03:17.596066+0000","last_active":"2024-09-12T01:03:17.596066+0000","last_peered":"2024-09-12T01:03:17.596066+0000","last_clean":"2024-09-12T01:03:17.596066+0000","last_became_active":"2024-09-12T00:43:48.276176+0000","last_became_peered":"2024-09-12T00:43:48.276176+0000","last_unstale":"2024-09-12T01:03:17.596066+0000","last_undegraded":"2024-09-12T01:03:17.596066+0000","last_fullsized":"2024-09-12T01:03:17.596066+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:17.595889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:17.595889+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.595889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:47.529084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:31.864406+0000","last_change":"2024-09-12T01:03:31.864248+0000","last_active":"2024-09-12T01:03:31.864406+0000","last_peered":"2024-09-12T01:03:31.864406+0000","last_clean":"2024-09-12T01:03:31.864406+0000","last_became_active":"2024-09-12T00:32:28.051244+0000","last_became_peered":"2024-09-12T00:32:28.051244+0000","last_unstale":"2024-09-12T01:03:31.864406+0000","last_undegraded":"2024-09-12T01:03:31.864406+0000","last_fullsized":"2024-09-12T01:03:31.864406+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:31.864057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:31.864057+0000","last_clean_scrub_stamp":"2024-09-12T01:03:31.864057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:47.473421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"268'2","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:28.350566+0000","last_change":"2024-09-12T01:03:28.350566+0000","last_active":"2024-09-12T01:03:28.350566+0000","last_peered":"2024-09-12T01:03:28.350566+0000","last_clean":"2024-09-12T01:03:28.350566+0000","last_became_active":"2024-09-12T00:32:25.022757+0000","last_became_peered":"2024-09-12T00:32:25.022757+0000","last_unstale":"2024-09-12T01:03:28.350566+0000","last_undegraded":"2024-09-12T01:03:28.350566+0000","last_fullsized":"2024-09-12T01:03:28.350566+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:28.350349+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:28.350349+0000","last_clean_scrub_stamp":"2024-09-12T01:03:28.350349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:04.396560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'12","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:35.557685+0000","last_change":"2024-09-12T01:03:35.557685+0000","last_active":"2024-09-12T01:03:35.557685+0000","last_peered":"2024-09-12T01:03:35.557685+0000","last_clean":"2024-09-12T01:03:35.557685+0000","last_became_active":"2024-09-12T00:30:51.565544+0000","last_became_peered":"2024-09-12T00:30:51.565544+0000","last_unstale":"2024-09-12T01:03:35.557685+0000","last_undegraded":"2024-09-12T01:03:35.557685+0000","last_fullsized":"2024-09-12T01:03:35.557685+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-12T01:03:35.557495+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-12T01:03:35.557495+0000","last_clean_scrub_stamp":"2024-09-12T01:03:35.557495+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:42.468001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:40.870101+0000","last_change":"2024-09-12T01:03:40.870101+0000","last_active":"2024-09-12T01:03:40.870101+0000","last_peered":"2024-09-12T01:03:40.870101+0000","last_clean":"2024-09-12T01:03:40.870101+0000","last_became_active":"2024-09-12T00:43:48.279243+0000","last_became_peered":"2024-09-12T00:43:48.279243+0000","last_unstale":"2024-09-12T01:03:40.870101+0000","last_undegraded":"2024-09-12T01:03:40.870101+0000","last_fullsized":"2024-09-12T01:03:40.870101+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:40.869913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:40.869913+0000","last_clean_scrub_stamp":"2024-09-12T01:03:40.869913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:40.351436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"268'3","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.577280+0000","last_change":"2024-09-12T01:03:13.577280+0000","last_active":"2024-09-12T01:03:13.577280+0000","last_peered":"2024-09-12T01:03:13.577280+0000","last_clean":"2024-09-12T01:03:13.577280+0000","last_became_active":"2024-09-12T00:32:28.058384+0000","last_became_peered":"2024-09-12T00:32:28.058384+0000","last_unstale":"2024-09-12T01:03:13.577280+0000","last_undegraded":"2024-09-12T01:03:13.577280+0000","last_fullsized":"2024-09-12T01:03:13.577280+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:13.577058+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:13.577058+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.577058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:14.485980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"265'3","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.609581+0000","last_change":"2024-09-12T01:03:21.609581+0000","last_active":"2024-09-12T01:03:21.609581+0000","last_peered":"2024-09-12T01:03:21.609581+0000","last_clean":"2024-09-12T01:03:21.609581+0000","last_became_active":"2024-09-12T00:32:24.995532+0000","last_became_peered":"2024-09-12T00:32:24.995532+0000","last_unstale":"2024-09-12T01:03:21.609581+0000","last_undegraded":"2024-09-12T01:03:21.609581+0000","last_fullsized":"2024-09-12T01:03:21.609581+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:03:21.609383+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:03:21.609383+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.609383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:39.336952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"268'40","reported_seq":165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.597091+0000","last_change":"2024-09-12T01:03:16.597091+0000","last_active":"2024-09-12T01:03:16.597091+0000","last_peered":"2024-09-12T01:03:16.597091+0000","last_clean":"2024-09-12T01:03:16.597091+0000","last_became_active":"2024-09-12T00:30:51.553501+0000","last_became_peered":"2024-09-12T00:30:51.553501+0000","last_unstale":"2024-09-12T01:03:16.597091+0000","last_undegraded":"2024-09-12T01:03:16.597091+0000","last_fullsized":"2024-09-12T01:03:16.597091+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'40","last_scrub_stamp":"2024-09-12T01:03:16.596775+0000","last_deep_scrub":"268'40","last_deep_scrub_stamp":"2024-09-12T01:03:16.596775+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.596775+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:40.998139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":68,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:29.234081+0000","last_change":"2024-09-12T00:43:48.281674+0000","last_active":"2024-09-12T01:00:29.234081+0000","last_peered":"2024-09-12T01:00:29.234081+0000","last_clean":"2024-09-12T01:00:29.234081+0000","last_became_active":"2024-09-12T00:43:48.280566+0000","last_became_peered":"2024-09-12T00:43:48.280566+0000","last_unstale":"2024-09-12T01:00:29.234081+0000","last_undegraded":"2024-09-12T01:00:29.234081+0000","last_fullsized":"2024-09-12T01:00:29.234081+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:02.297251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"268'4","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:38.693850+0000","last_change":"2024-09-12T00:32:28.061791+0000","last_active":"2024-09-12T01:02:38.693850+0000","last_peered":"2024-09-12T01:02:38.693850+0000","last_clean":"2024-09-12T01:02:38.693850+0000","last_became_active":"2024-09-12T00:32:28.061089+0000","last_became_peered":"2024-09-12T00:32:28.061089+0000","last_unstale":"2024-09-12T01:02:38.693850+0000","last_undegraded":"2024-09-12T01:02:38.693850+0000","last_fullsized":"2024-09-12T01:02:38.693850+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":326,"num_write":4,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"265'11","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:42.606702+0000","last_change":"2024-09-12T01:03:42.606702+0000","last_active":"2024-09-12T01:03:42.606702+0000","last_peered":"2024-09-12T01:03:42.606702+0000","last_clean":"2024-09-12T01:03:42.606702+0000","last_became_active":"2024-09-12T00:32:25.004199+0000","last_became_peered":"2024-09-12T00:32:25.004199+0000","last_unstale":"2024-09-12T01:03:42.606702+0000","last_undegraded":"2024-09-12T01:03:42.606702+0000","last_fullsized":"2024-09-12T01:03:42.606702+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T01:03:42.606509+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T01:03:42.606509+0000","last_clean_scrub_stamp":"2024-09-12T01:03:42.606509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:05.036865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11280,"num_write":21,"num_write_kb":11280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"268'12","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.898022+0000","last_change":"2024-09-12T01:03:13.898022+0000","last_active":"2024-09-12T01:03:13.898022+0000","last_peered":"2024-09-12T01:03:13.898022+0000","last_clean":"2024-09-12T01:03:13.898022+0000","last_became_active":"2024-09-12T00:30:51.548619+0000","last_became_peered":"2024-09-12T00:30:51.548619+0000","last_unstale":"2024-09-12T01:03:13.898022+0000","last_undegraded":"2024-09-12T01:03:13.898022+0000","last_fullsized":"2024-09-12T01:03:13.898022+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-09-12T01:03:13.897805+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-09-12T01:03:13.897805+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.897805+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:37.589859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"268'2","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.961225+0000","last_change":"2024-09-12T01:03:34.961225+0000","last_active":"2024-09-12T01:03:34.961225+0000","last_peered":"2024-09-12T01:03:34.961225+0000","last_clean":"2024-09-12T01:03:34.961225+0000","last_became_active":"2024-09-12T00:43:48.283630+0000","last_became_peered":"2024-09-12T00:43:48.283630+0000","last_unstale":"2024-09-12T01:03:34.961225+0000","last_undegraded":"2024-09-12T01:03:34.961225+0000","last_fullsized":"2024-09-12T01:03:34.961225+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:34.961009+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:34.961009+0000","last_clean_scrub_stamp":"2024-09-12T01:03:34.961009+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:30.727100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'5","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:30.387025+0000","last_change":"2024-09-12T01:03:30.386881+0000","last_active":"2024-09-12T01:03:30.387025+0000","last_peered":"2024-09-12T01:03:30.387025+0000","last_clean":"2024-09-12T01:03:30.387025+0000","last_became_active":"2024-09-12T00:32:28.054045+0000","last_became_peered":"2024-09-12T00:32:28.054045+0000","last_unstale":"2024-09-12T01:03:30.387025+0000","last_undegraded":"2024-09-12T01:03:30.387025+0000","last_fullsized":"2024-09-12T01:03:30.387025+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:03:30.386648+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:03:30.386648+0000","last_clean_scrub_stamp":"2024-09-12T01:03:30.386648+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:48.463320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'3","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.647777+0000","last_change":"2024-09-12T01:03:19.647777+0000","last_active":"2024-09-12T01:03:19.647777+0000","last_peered":"2024-09-12T01:03:19.647777+0000","last_clean":"2024-09-12T01:03:19.647777+0000","last_became_active":"2024-09-12T00:32:24.997768+0000","last_became_peered":"2024-09-12T00:32:24.997768+0000","last_unstale":"2024-09-12T01:03:19.647777+0000","last_undegraded":"2024-09-12T01:03:19.647777+0000","last_fullsized":"2024-09-12T01:03:19.647777+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:03:19.647452+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:03:19.647452+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.647452+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.457762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"268'27","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.573504+0000","last_change":"2024-09-12T01:03:15.573504+0000","last_active":"2024-09-12T01:03:15.573504+0000","last_peered":"2024-09-12T01:03:15.573504+0000","last_clean":"2024-09-12T01:03:15.573504+0000","last_became_active":"2024-09-12T00:30:51.556456+0000","last_became_peered":"2024-09-12T00:30:51.556456+0000","last_unstale":"2024-09-12T01:03:15.573504+0000","last_undegraded":"2024-09-12T01:03:15.573504+0000","last_fullsized":"2024-09-12T01:03:15.573504+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-09-12T01:03:15.573326+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-09-12T01:03:15.573326+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.573326+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:55.863953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":57,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.396603+0000","last_change":"2024-09-12T01:03:29.396603+0000","last_active":"2024-09-12T01:03:29.396603+0000","last_peered":"2024-09-12T01:03:29.396603+0000","last_clean":"2024-09-12T01:03:29.396603+0000","last_became_active":"2024-09-12T00:43:48.265726+0000","last_became_peered":"2024-09-12T00:43:48.265726+0000","last_unstale":"2024-09-12T01:03:29.396603+0000","last_undegraded":"2024-09-12T01:03:29.396603+0000","last_fullsized":"2024-09-12T01:03:29.396603+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:29.396399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:29.396399+0000","last_clean_scrub_stamp":"2024-09-12T01:03:29.396399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:34.292189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000271+0000","last_change":"2024-09-12T00:32:28.051868+0000","last_active":"2024-09-12T01:00:39.000271+0000","last_peered":"2024-09-12T01:00:39.000271+0000","last_clean":"2024-09-12T01:00:39.000271+0000","last_became_active":"2024-09-12T00:32:28.051145+0000","last_became_peered":"2024-09-12T00:32:28.051145+0000","last_unstale":"2024-09-12T01:00:39.000271+0000","last_undegraded":"2024-09-12T01:00:39.000271+0000","last_fullsized":"2024-09-12T01:00:39.000271+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:32:26.997731+0000","last_clean_scrub_stamp":"2024-09-12T00:32:26.997731+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:26.514177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:38.601358+0000","last_change":"2024-09-12T01:03:38.601215+0000","last_active":"2024-09-12T01:03:38.601358+0000","last_peered":"2024-09-12T01:03:38.601358+0000","last_clean":"2024-09-12T01:03:38.601358+0000","last_became_active":"2024-09-12T00:32:25.003679+0000","last_became_peered":"2024-09-12T00:32:25.003679+0000","last_unstale":"2024-09-12T01:03:38.601358+0000","last_undegraded":"2024-09-12T01:03:38.601358+0000","last_fullsized":"2024-09-12T01:03:38.601358+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:38.601035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:38.601035+0000","last_clean_scrub_stamp":"2024-09-12T01:03:38.601035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:29.732483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"268'23","reported_seq":115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.606930+0000","last_change":"2024-09-12T01:03:34.606930+0000","last_active":"2024-09-12T01:03:34.606930+0000","last_peered":"2024-09-12T01:03:34.606930+0000","last_clean":"2024-09-12T01:03:34.606930+0000","last_became_active":"2024-09-12T00:30:51.551554+0000","last_became_peered":"2024-09-12T00:30:51.551554+0000","last_unstale":"2024-09-12T01:03:34.606930+0000","last_undegraded":"2024-09-12T01:03:34.606930+0000","last_fullsized":"2024-09-12T01:03:34.606930+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'23","last_scrub_stamp":"2024-09-12T01:03:34.606713+0000","last_deep_scrub":"268'23","last_deep_scrub_stamp":"2024-09-12T01:03:34.606713+0000","last_clean_scrub_stamp":"2024-09-12T01:03:34.606713+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:49.185113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:42.856188+0000","last_change":"2024-09-12T01:03:42.856188+0000","last_active":"2024-09-12T01:03:42.856188+0000","last_peered":"2024-09-12T01:03:42.856188+0000","last_clean":"2024-09-12T01:03:42.856188+0000","last_became_active":"2024-09-12T00:43:48.286593+0000","last_became_peered":"2024-09-12T00:43:48.286593+0000","last_unstale":"2024-09-12T01:03:42.856188+0000","last_undegraded":"2024-09-12T01:03:42.856188+0000","last_fullsized":"2024-09-12T01:03:42.856188+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:42.855908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:42.855908+0000","last_clean_scrub_stamp":"2024-09-12T01:03:42.855908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:21.669803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"268'6","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.655503+0000","last_change":"2024-09-12T01:03:20.655342+0000","last_active":"2024-09-12T01:03:20.655503+0000","last_peered":"2024-09-12T01:03:20.655503+0000","last_clean":"2024-09-12T01:03:20.655503+0000","last_became_active":"2024-09-12T00:32:28.069812+0000","last_became_peered":"2024-09-12T00:32:28.069812+0000","last_unstale":"2024-09-12T01:03:20.655503+0000","last_undegraded":"2024-09-12T01:03:20.655503+0000","last_fullsized":"2024-09-12T01:03:20.655503+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:03:20.655131+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:03:20.655131+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.655131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:06.834953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"268'8","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.243572+0000","last_change":"2024-09-12T01:03:22.243432+0000","last_active":"2024-09-12T01:03:22.243572+0000","last_peered":"2024-09-12T01:03:22.243572+0000","last_clean":"2024-09-12T01:03:22.243572+0000","last_became_active":"2024-09-12T00:32:25.017138+0000","last_became_peered":"2024-09-12T00:32:25.017138+0000","last_unstale":"2024-09-12T01:03:22.243572+0000","last_undegraded":"2024-09-12T01:03:22.243572+0000","last_fullsized":"2024-09-12T01:03:22.243572+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:03:22.243247+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:03:22.243247+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.243247+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:15.153887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"268'53","reported_seq":198,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:33.566574+0000","last_change":"2024-09-12T01:03:33.566574+0000","last_active":"2024-09-12T01:03:33.566574+0000","last_peered":"2024-09-12T01:03:33.566574+0000","last_clean":"2024-09-12T01:03:33.566574+0000","last_became_active":"2024-09-12T00:30:51.546238+0000","last_became_peered":"2024-09-12T00:30:51.546238+0000","last_unstale":"2024-09-12T01:03:33.566574+0000","last_undegraded":"2024-09-12T01:03:33.566574+0000","last_fullsized":"2024-09-12T01:03:33.566574+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'53","last_scrub_stamp":"2024-09-12T01:03:33.566391+0000","last_deep_scrub":"268'53","last_deep_scrub_stamp":"2024-09-12T01:03:33.566391+0000","last_clean_scrub_stamp":"2024-09-12T01:03:33.566391+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:35.853970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":191,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":22,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:00:39.000484+0000","last_change":"2024-09-12T00:43:48.277891+0000","last_active":"2024-09-12T01:00:39.000484+0000","last_peered":"2024-09-12T01:00:39.000484+0000","last_clean":"2024-09-12T01:00:39.000484+0000","last_became_active":"2024-09-12T00:43:48.277275+0000","last_became_peered":"2024-09-12T00:43:48.277275+0000","last_unstale":"2024-09-12T01:00:39.000484+0000","last_undegraded":"2024-09-12T01:00:39.000484+0000","last_fullsized":"2024-09-12T01:00:39.000484+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:47.215582+0000","last_clean_scrub_stamp":"2024-09-12T00:43:47.215582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:00.758192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.624406+0000","last_change":"2024-09-12T01:03:23.624277+0000","last_active":"2024-09-12T01:03:23.624406+0000","last_peered":"2024-09-12T01:03:23.624406+0000","last_clean":"2024-09-12T01:03:23.624406+0000","last_became_active":"2024-09-12T00:32:28.065320+0000","last_became_peered":"2024-09-12T00:32:28.065320+0000","last_unstale":"2024-09-12T01:03:23.624406+0000","last_undegraded":"2024-09-12T01:03:23.624406+0000","last_fullsized":"2024-09-12T01:03:23.624406+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:23.624094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:23.624094+0000","last_clean_scrub_stamp":"2024-09-12T01:03:23.624094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:53.727926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'3","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.305353+0000","last_change":"2024-09-12T01:03:15.305196+0000","last_active":"2024-09-12T01:03:15.305353+0000","last_peered":"2024-09-12T01:03:15.305353+0000","last_clean":"2024-09-12T01:03:15.305353+0000","last_became_active":"2024-09-12T00:32:25.013266+0000","last_became_peered":"2024-09-12T00:32:25.013266+0000","last_unstale":"2024-09-12T01:03:15.305353+0000","last_undegraded":"2024-09-12T01:03:15.305353+0000","last_fullsized":"2024-09-12T01:03:15.305353+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:03:15.304984+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:03:15.304984+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.304984+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:55.982092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"268'15","reported_seq":95,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.583636+0000","last_change":"2024-09-12T01:03:11.583636+0000","last_active":"2024-09-12T01:03:11.583636+0000","last_peered":"2024-09-12T01:03:11.583636+0000","last_clean":"2024-09-12T01:03:11.583636+0000","last_became_active":"2024-09-12T00:30:51.559445+0000","last_became_peered":"2024-09-12T00:30:51.559445+0000","last_unstale":"2024-09-12T01:03:11.583636+0000","last_undegraded":"2024-09-12T01:03:11.583636+0000","last_fullsized":"2024-09-12T01:03:11.583636+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'15","last_scrub_stamp":"2024-09-12T01:03:11.583415+0000","last_deep_scrub":"268'15","last_deep_scrub_stamp":"2024-09-12T01:03:11.583415+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.583415+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:28.744442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"268'370","reported_seq":1135,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.588695+0000","last_change":"2024-09-12T01:02:49.588695+0000","last_active":"2024-09-12T01:02:49.588695+0000","last_peered":"2024-09-12T01:02:49.588695+0000","last_clean":"2024-09-12T01:02:49.588695+0000","last_became_active":"2024-09-12T00:15:55.078687+0000","last_became_peered":"2024-09-12T00:15:55.078687+0000","last_unstale":"2024-09-12T01:02:49.588695+0000","last_undegraded":"2024-09-12T01:02:49.588695+0000","last_fullsized":"2024-09-12T01:02:49.588695+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-12T01:02:49.588395+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-12T01:02:49.588395+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.588395+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:32.972868+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":769,"num_read_kb":39834,"num_write":1260,"num_write_kb":26442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"268'859","reported_seq":2616,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.181970+0000","last_change":"2024-09-12T01:03:00.181836+0000","last_active":"2024-09-12T01:03:00.181970+0000","last_peered":"2024-09-12T01:03:00.181970+0000","last_clean":"2024-09-12T01:03:00.181970+0000","last_became_active":"2024-09-12T00:15:57.021927+0000","last_became_peered":"2024-09-12T00:15:57.021927+0000","last_unstale":"2024-09-12T01:03:00.181970+0000","last_undegraded":"2024-09-12T01:03:00.181970+0000","last_fullsized":"2024-09-12T01:03:00.181970+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'859","last_scrub_stamp":"2024-09-12T01:03:00.181615+0000","last_deep_scrub":"268'859","last_deep_scrub_stamp":"2024-09-12T01:03:00.181615+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.181615+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:29.997742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4184,"num_read_kb":3812,"num_write":1107,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"268'392","reported_seq":1054,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.459607+0000","last_change":"2024-09-12T01:02:59.459607+0000","last_active":"2024-09-12T01:02:59.459607+0000","last_peered":"2024-09-12T01:02:59.459607+0000","last_clean":"2024-09-12T01:02:59.459607+0000","last_became_active":"2024-09-12T00:15:55.075108+0000","last_became_peered":"2024-09-12T00:15:55.075108+0000","last_unstale":"2024-09-12T01:02:59.459607+0000","last_undegraded":"2024-09-12T01:02:59.459607+0000","last_fullsized":"2024-09-12T01:02:59.459607+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'392","last_scrub_stamp":"2024-09-12T01:02:59.459315+0000","last_deep_scrub":"268'392","last_deep_scrub_stamp":"2024-09-12T01:02:59.459315+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.459315+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:19.278176+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":2165,"num_write":1224,"num_write_kb":32030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"268'545","reported_seq":2185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.645744+0000","last_change":"2024-09-12T01:03:10.645603+0000","last_active":"2024-09-12T01:03:10.645744+0000","last_peered":"2024-09-12T01:03:10.645744+0000","last_clean":"2024-09-12T01:03:10.645744+0000","last_became_active":"2024-09-12T00:15:57.022465+0000","last_became_peered":"2024-09-12T00:15:57.022465+0000","last_unstale":"2024-09-12T01:03:10.645744+0000","last_undegraded":"2024-09-12T01:03:10.645744+0000","last_fullsized":"2024-09-12T01:03:10.645744+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'545","last_scrub_stamp":"2024-09-12T01:03:10.645403+0000","last_deep_scrub":"268'545","last_deep_scrub_stamp":"2024-09-12T01:03:10.645403+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.645403+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:07.926006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2758,"num_read_kb":2563,"num_write":657,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"268'389","reported_seq":1132,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.428112+0000","last_change":"2024-09-12T01:02:58.428112+0000","last_active":"2024-09-12T01:02:58.428112+0000","last_peered":"2024-09-12T01:02:58.428112+0000","last_clean":"2024-09-12T01:02:58.428112+0000","last_became_active":"2024-09-12T00:15:55.041491+0000","last_became_peered":"2024-09-12T00:15:55.041491+0000","last_unstale":"2024-09-12T01:02:58.428112+0000","last_undegraded":"2024-09-12T01:02:58.428112+0000","last_fullsized":"2024-09-12T01:02:58.428112+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'389","last_scrub_stamp":"2024-09-12T01:02:58.427815+0000","last_deep_scrub":"268'389","last_deep_scrub_stamp":"2024-09-12T01:02:58.427815+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.427815+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:29.847605+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3574871,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":831,"num_read_kb":4160,"num_write":1268,"num_write_kb":14348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"268'1149","reported_seq":2792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.612684+0000","last_change":"2024-09-12T01:03:09.612525+0000","last_active":"2024-09-12T01:03:09.612684+0000","last_peered":"2024-09-12T01:03:09.612684+0000","last_clean":"2024-09-12T01:03:09.612684+0000","last_became_active":"2024-09-12T00:15:57.022692+0000","last_became_peered":"2024-09-12T00:15:57.022692+0000","last_unstale":"2024-09-12T01:03:09.612684+0000","last_undegraded":"2024-09-12T01:03:09.612684+0000","last_fullsized":"2024-09-12T01:03:09.612684+0000","mapping_epoch":28,"log_start":"268'1100","ondisk_log_start":"268'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1149","last_scrub_stamp":"2024-09-12T01:03:09.612336+0000","last_deep_scrub":"268'1149","last_deep_scrub_stamp":"2024-09-12T01:03:09.612336+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.612336+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":1100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:08.545733+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5291,"num_read_kb":4702,"num_write":1570,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"268'387","reported_seq":1078,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.667329+0000","last_change":"2024-09-12T01:02:52.667329+0000","last_active":"2024-09-12T01:02:52.667329+0000","last_peered":"2024-09-12T01:02:52.667329+0000","last_clean":"2024-09-12T01:02:52.667329+0000","last_became_active":"2024-09-12T00:15:55.045668+0000","last_became_peered":"2024-09-12T00:15:55.045668+0000","last_unstale":"2024-09-12T01:02:52.667329+0000","last_undegraded":"2024-09-12T01:02:52.667329+0000","last_fullsized":"2024-09-12T01:02:52.667329+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'387","last_scrub_stamp":"2024-09-12T01:02:52.667069+0000","last_deep_scrub":"268'387","last_deep_scrub_stamp":"2024-09-12T01:02:52.667069+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.667069+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:37.302820+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":365201,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":662,"num_read_kb":47789,"num_write":1293,"num_write_kb":53743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"268'571","reported_seq":2214,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.155354+0000","last_change":"2024-09-12T01:03:01.155202+0000","last_active":"2024-09-12T01:03:01.155354+0000","last_peered":"2024-09-12T01:03:01.155354+0000","last_clean":"2024-09-12T01:03:01.155354+0000","last_became_active":"2024-09-12T00:15:57.018762+0000","last_became_peered":"2024-09-12T00:15:57.018762+0000","last_unstale":"2024-09-12T01:03:01.155354+0000","last_undegraded":"2024-09-12T01:03:01.155354+0000","last_fullsized":"2024-09-12T01:03:01.155354+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'571","last_scrub_stamp":"2024-09-12T01:03:01.155003+0000","last_deep_scrub":"268'571","last_deep_scrub_stamp":"2024-09-12T01:03:01.155003+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.155003+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:41.916701+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2864,"num_read_kb":2646,"num_write":693,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":992,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"268'365","reported_seq":1021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.617536+0000","last_change":"2024-09-12T01:02:50.617387+0000","last_active":"2024-09-12T01:02:50.617536+0000","last_peered":"2024-09-12T01:02:50.617536+0000","last_clean":"2024-09-12T01:02:50.617536+0000","last_became_active":"2024-09-12T00:15:55.071352+0000","last_became_peered":"2024-09-12T00:15:55.071352+0000","last_unstale":"2024-09-12T01:02:50.617536+0000","last_undegraded":"2024-09-12T01:02:50.617536+0000","last_fullsized":"2024-09-12T01:02:50.617536+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-12T01:02:50.617131+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-12T01:02:50.617131+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.617131+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:26.922140+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8845231,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":491,"num_read_kb":19398,"num_write":1138,"num_write_kb":53254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"268'458","reported_seq":2084,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.526329+0000","last_change":"2024-09-12T01:03:01.526329+0000","last_active":"2024-09-12T01:03:01.526329+0000","last_peered":"2024-09-12T01:03:01.526329+0000","last_clean":"2024-09-12T01:03:01.526329+0000","last_became_active":"2024-09-12T00:15:57.051973+0000","last_became_peered":"2024-09-12T00:15:57.051973+0000","last_unstale":"2024-09-12T01:03:01.526329+0000","last_undegraded":"2024-09-12T01:03:01.526329+0000","last_fullsized":"2024-09-12T01:03:01.526329+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'458","last_scrub_stamp":"2024-09-12T01:03:01.526143+0000","last_deep_scrub":"268'458","last_deep_scrub_stamp":"2024-09-12T01:03:01.526143+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.526143+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:18.260122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":2348,"num_write":528,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"268'352","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.654023+0000","last_change":"2024-09-12T01:02:50.653874+0000","last_active":"2024-09-12T01:02:50.654023+0000","last_peered":"2024-09-12T01:02:50.654023+0000","last_clean":"2024-09-12T01:02:50.654023+0000","last_became_active":"2024-09-12T00:15:55.067030+0000","last_became_peered":"2024-09-12T00:15:55.067030+0000","last_unstale":"2024-09-12T01:02:50.654023+0000","last_undegraded":"2024-09-12T01:02:50.654023+0000","last_fullsized":"2024-09-12T01:02:50.654023+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'352","last_scrub_stamp":"2024-09-12T01:02:50.653516+0000","last_deep_scrub":"268'352","last_deep_scrub_stamp":"2024-09-12T01:02:50.653516+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.653516+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:30.298045+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":499,"num_read_kb":33085,"num_write":1019,"num_write_kb":28183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"268'487","reported_seq":2082,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.535040+0000","last_change":"2024-09-12T01:02:55.535040+0000","last_active":"2024-09-12T01:02:55.535040+0000","last_peered":"2024-09-12T01:02:55.535040+0000","last_clean":"2024-09-12T01:02:55.535040+0000","last_became_active":"2024-09-12T00:15:57.037045+0000","last_became_peered":"2024-09-12T00:15:57.037045+0000","last_unstale":"2024-09-12T01:02:55.535040+0000","last_undegraded":"2024-09-12T01:02:55.535040+0000","last_fullsized":"2024-09-12T01:02:55.535040+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'487","last_scrub_stamp":"2024-09-12T01:02:55.534815+0000","last_deep_scrub":"268'487","last_deep_scrub_stamp":"2024-09-12T01:02:55.534815+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.534815+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:08.564034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2556,"num_read_kb":2389,"num_write":592,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"268'364","reported_seq":1104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.551327+0000","last_change":"2024-09-12T01:02:48.551146+0000","last_active":"2024-09-12T01:02:48.551327+0000","last_peered":"2024-09-12T01:02:48.551327+0000","last_clean":"2024-09-12T01:02:48.551327+0000","last_became_active":"2024-09-12T00:15:55.041976+0000","last_became_peered":"2024-09-12T00:15:55.041976+0000","last_unstale":"2024-09-12T01:02:48.551327+0000","last_undegraded":"2024-09-12T01:02:48.551327+0000","last_fullsized":"2024-09-12T01:02:48.551327+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-12T01:02:48.550777+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-12T01:02:48.550777+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.550777+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:08.855631+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055004,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":661,"num_read_kb":92017,"num_write":1205,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"268'483","reported_seq":1944,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.623516+0000","last_change":"2024-09-12T01:02:58.623516+0000","last_active":"2024-09-12T01:02:58.623516+0000","last_peered":"2024-09-12T01:02:58.623516+0000","last_clean":"2024-09-12T01:02:58.623516+0000","last_became_active":"2024-09-12T00:15:57.013278+0000","last_became_peered":"2024-09-12T00:15:57.013278+0000","last_unstale":"2024-09-12T01:02:58.623516+0000","last_undegraded":"2024-09-12T01:02:58.623516+0000","last_fullsized":"2024-09-12T01:02:58.623516+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'483","last_scrub_stamp":"2024-09-12T01:02:58.623336+0000","last_deep_scrub":"268'483","last_deep_scrub_stamp":"2024-09-12T01:02:58.623336+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.623336+0000","objects_scrubbed":7,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:39.099184+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2343,"num_read_kb":2167,"num_write":566,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1262,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"268'313","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.417304+0000","last_change":"2024-09-12T01:02:57.417143+0000","last_active":"2024-09-12T01:02:57.417304+0000","last_peered":"2024-09-12T01:02:57.417304+0000","last_clean":"2024-09-12T01:02:57.417304+0000","last_became_active":"2024-09-12T00:15:55.060127+0000","last_became_peered":"2024-09-12T00:15:55.060127+0000","last_unstale":"2024-09-12T01:02:57.417304+0000","last_undegraded":"2024-09-12T01:02:57.417304+0000","last_fullsized":"2024-09-12T01:02:57.417304+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-12T01:02:57.416899+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-12T01:02:57.416899+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.416899+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:10.862046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":41438,"num_write":900,"num_write_kb":44478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"268'984","reported_seq":2523,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.475348+0000","last_change":"2024-09-12T01:03:08.475348+0000","last_active":"2024-09-12T01:03:08.475348+0000","last_peered":"2024-09-12T01:03:08.475348+0000","last_clean":"2024-09-12T01:03:08.475348+0000","last_became_active":"2024-09-12T00:15:57.051665+0000","last_became_peered":"2024-09-12T00:15:57.051665+0000","last_unstale":"2024-09-12T01:03:08.475348+0000","last_undegraded":"2024-09-12T01:03:08.475348+0000","last_fullsized":"2024-09-12T01:03:08.475348+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'984","last_scrub_stamp":"2024-09-12T01:03:08.475166+0000","last_deep_scrub":"268'984","last_deep_scrub_stamp":"2024-09-12T01:03:08.475166+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.475166+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":900,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:39.424371+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4673,"num_read_kb":4124,"num_write":1393,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"268'891","reported_seq":2511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.574863+0000","last_change":"2024-09-12T01:03:08.574863+0000","last_active":"2024-09-12T01:03:08.574863+0000","last_peered":"2024-09-12T01:03:08.574863+0000","last_clean":"2024-09-12T01:03:08.574863+0000","last_became_active":"2024-09-12T00:15:57.031897+0000","last_became_peered":"2024-09-12T00:15:57.031897+0000","last_unstale":"2024-09-12T01:03:08.574863+0000","last_undegraded":"2024-09-12T01:03:08.574863+0000","last_fullsized":"2024-09-12T01:03:08.574863+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'891","last_scrub_stamp":"2024-09-12T01:03:08.574669+0000","last_deep_scrub":"268'891","last_deep_scrub_stamp":"2024-09-12T01:03:08.574669+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.574669+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:36.612992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4303,"num_read_kb":3853,"num_write":1201,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2803,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"268'315","reported_seq":943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.254737+0000","last_change":"2024-09-12T01:02:51.254737+0000","last_active":"2024-09-12T01:02:51.254737+0000","last_peered":"2024-09-12T01:02:51.254737+0000","last_clean":"2024-09-12T01:02:51.254737+0000","last_became_active":"2024-09-12T00:15:55.063797+0000","last_became_peered":"2024-09-12T00:15:55.063797+0000","last_unstale":"2024-09-12T01:02:51.254737+0000","last_undegraded":"2024-09-12T01:02:51.254737+0000","last_fullsized":"2024-09-12T01:02:51.254737+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'315","last_scrub_stamp":"2024-09-12T01:02:51.254463+0000","last_deep_scrub":"268'315","last_deep_scrub_stamp":"2024-09-12T01:02:51.254463+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.254463+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:01.868558+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":7341,"num_write":997,"num_write_kb":14342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"268'783","reported_seq":2221,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.530995+0000","last_change":"2024-09-12T01:02:58.530995+0000","last_active":"2024-09-12T01:02:58.530995+0000","last_peered":"2024-09-12T01:02:58.530995+0000","last_clean":"2024-09-12T01:02:58.530995+0000","last_became_active":"2024-09-12T00:15:57.017679+0000","last_became_peered":"2024-09-12T00:15:57.017679+0000","last_unstale":"2024-09-12T01:02:58.530995+0000","last_undegraded":"2024-09-12T01:02:58.530995+0000","last_fullsized":"2024-09-12T01:02:58.530995+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'783","last_scrub_stamp":"2024-09-12T01:02:58.530808+0000","last_deep_scrub":"268'783","last_deep_scrub_stamp":"2024-09-12T01:02:58.530808+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.530808+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:45.670510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3571,"num_read_kb":3210,"num_write":1015,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"268'379","reported_seq":1070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.374153+0000","last_change":"2024-09-12T01:02:56.374153+0000","last_active":"2024-09-12T01:02:56.374153+0000","last_peered":"2024-09-12T01:02:56.374153+0000","last_clean":"2024-09-12T01:02:56.374153+0000","last_became_active":"2024-09-12T00:16:26.794438+0000","last_became_peered":"2024-09-12T00:16:26.794438+0000","last_unstale":"2024-09-12T01:02:56.374153+0000","last_undegraded":"2024-09-12T01:02:56.374153+0000","last_fullsized":"2024-09-12T01:02:56.374153+0000","mapping_epoch":39,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'379","last_scrub_stamp":"2024-09-12T01:02:56.373913+0000","last_deep_scrub":"268'379","last_deep_scrub_stamp":"2024-09-12T01:02:56.373913+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.373913+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:38.623851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":637,"num_read_kb":170107,"num_write":1135,"num_write_kb":45359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,6],"acting":[5,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"268'415","reported_seq":1894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.158518+0000","last_change":"2024-09-12T01:02:55.158518+0000","last_active":"2024-09-12T01:02:55.158518+0000","last_peered":"2024-09-12T01:02:55.158518+0000","last_clean":"2024-09-12T01:02:55.158518+0000","last_became_active":"2024-09-12T00:15:57.039474+0000","last_became_peered":"2024-09-12T00:15:57.039474+0000","last_unstale":"2024-09-12T01:02:55.158518+0000","last_undegraded":"2024-09-12T01:02:55.158518+0000","last_fullsized":"2024-09-12T01:02:55.158518+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'415","last_scrub_stamp":"2024-09-12T01:02:55.158293+0000","last_deep_scrub":"268'415","last_deep_scrub_stamp":"2024-09-12T01:02:55.158293+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.158293+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:03.237879+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2320,"num_read_kb":2162,"num_write":506,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":873,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"268'339","reported_seq":1089,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.574049+0000","last_change":"2024-09-12T01:02:47.574049+0000","last_active":"2024-09-12T01:02:47.574049+0000","last_peered":"2024-09-12T01:02:47.574049+0000","last_clean":"2024-09-12T01:02:47.574049+0000","last_became_active":"2024-09-12T00:15:55.060170+0000","last_became_peered":"2024-09-12T00:15:55.060170+0000","last_unstale":"2024-09-12T01:02:47.574049+0000","last_undegraded":"2024-09-12T01:02:47.574049+0000","last_fullsized":"2024-09-12T01:02:47.574049+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:02:47.573937+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:02:47.573937+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.573937+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:55.671405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263219,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":623,"num_read_kb":11665,"num_write":1071,"num_write_kb":19684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"268'458","reported_seq":2062,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.080840+0000","last_change":"2024-09-12T01:03:00.080840+0000","last_active":"2024-09-12T01:03:00.080840+0000","last_peered":"2024-09-12T01:03:00.080840+0000","last_clean":"2024-09-12T01:03:00.080840+0000","last_became_active":"2024-09-12T00:15:57.044075+0000","last_became_peered":"2024-09-12T00:15:57.044075+0000","last_unstale":"2024-09-12T01:03:00.080840+0000","last_undegraded":"2024-09-12T01:03:00.080840+0000","last_fullsized":"2024-09-12T01:03:00.080840+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'458","last_scrub_stamp":"2024-09-12T01:03:00.080648+0000","last_deep_scrub":"268'458","last_deep_scrub_stamp":"2024-09-12T01:03:00.080648+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.080648+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:43.039820+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2345,"num_read_kb":2229,"num_write":503,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"268'357","reported_seq":1071,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.506774+0000","last_change":"2024-09-12T01:03:00.506774+0000","last_active":"2024-09-12T01:03:00.506774+0000","last_peered":"2024-09-12T01:03:00.506774+0000","last_clean":"2024-09-12T01:03:00.506774+0000","last_became_active":"2024-09-12T00:15:55.078352+0000","last_became_peered":"2024-09-12T00:15:55.078352+0000","last_unstale":"2024-09-12T01:03:00.506774+0000","last_undegraded":"2024-09-12T01:03:00.506774+0000","last_fullsized":"2024-09-12T01:03:00.506774+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'357","last_scrub_stamp":"2024-09-12T01:03:00.506512+0000","last_deep_scrub":"268'357","last_deep_scrub_stamp":"2024-09-12T01:03:00.506512+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.506512+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:30.459461+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3306265,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":657,"num_read_kb":46871,"num_write":1194,"num_write_kb":28820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"268'401","reported_seq":1882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.517578+0000","last_change":"2024-09-12T01:03:07.517578+0000","last_active":"2024-09-12T01:03:07.517578+0000","last_peered":"2024-09-12T01:03:07.517578+0000","last_clean":"2024-09-12T01:03:07.517578+0000","last_became_active":"2024-09-12T00:15:57.032173+0000","last_became_peered":"2024-09-12T00:15:57.032173+0000","last_unstale":"2024-09-12T01:03:07.517578+0000","last_undegraded":"2024-09-12T01:03:07.517578+0000","last_fullsized":"2024-09-12T01:03:07.517578+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'401","last_scrub_stamp":"2024-09-12T01:03:07.517337+0000","last_deep_scrub":"268'401","last_deep_scrub_stamp":"2024-09-12T01:03:07.517337+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.517337+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:47.949709+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2107,"num_read_kb":2010,"num_write":461,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"268'356","reported_seq":1087,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.981634+0000","last_change":"2024-09-12T01:02:52.981634+0000","last_active":"2024-09-12T01:02:52.981634+0000","last_peered":"2024-09-12T01:02:52.981634+0000","last_clean":"2024-09-12T01:02:52.981634+0000","last_became_active":"2024-09-12T00:15:55.066304+0000","last_became_peered":"2024-09-12T00:15:55.066304+0000","last_unstale":"2024-09-12T01:02:52.981634+0000","last_undegraded":"2024-09-12T01:02:52.981634+0000","last_fullsized":"2024-09-12T01:02:52.981634+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'356","last_scrub_stamp":"2024-09-12T01:02:52.981360+0000","last_deep_scrub":"268'356","last_deep_scrub_stamp":"2024-09-12T01:02:52.981360+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.981360+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:19.250065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":677,"num_read_kb":58383,"num_write":1149,"num_write_kb":49764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"268'1199","reported_seq":3228,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.154851+0000","last_change":"2024-09-12T01:02:57.154851+0000","last_active":"2024-09-12T01:02:57.154851+0000","last_peered":"2024-09-12T01:02:57.154851+0000","last_clean":"2024-09-12T01:02:57.154851+0000","last_became_active":"2024-09-12T00:15:57.021605+0000","last_became_peered":"2024-09-12T00:15:57.021605+0000","last_unstale":"2024-09-12T01:02:57.154851+0000","last_undegraded":"2024-09-12T01:02:57.154851+0000","last_fullsized":"2024-09-12T01:02:57.154851+0000","mapping_epoch":28,"log_start":"268'1100","ondisk_log_start":"268'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1199","last_scrub_stamp":"2024-09-12T01:02:57.154667+0000","last_deep_scrub":"268'1199","last_deep_scrub_stamp":"2024-09-12T01:02:57.154667+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.154667+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":1100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:25.819536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6433,"num_read_kb":5744,"num_write":1768,"num_write_kb":831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"268'298","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.033242+0000","last_change":"2024-09-12T01:02:52.033242+0000","last_active":"2024-09-12T01:02:52.033242+0000","last_peered":"2024-09-12T01:02:52.033242+0000","last_clean":"2024-09-12T01:02:52.033242+0000","last_became_active":"2024-09-12T00:15:55.050860+0000","last_became_peered":"2024-09-12T00:15:55.050860+0000","last_unstale":"2024-09-12T01:02:52.033242+0000","last_undegraded":"2024-09-12T01:02:52.033242+0000","last_fullsized":"2024-09-12T01:02:52.033242+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'298","last_scrub_stamp":"2024-09-12T01:02:52.032968+0000","last_deep_scrub":"268'298","last_deep_scrub_stamp":"2024-09-12T01:02:52.032968+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.032968+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:45.831551+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399261,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":8796,"num_write":982,"num_write_kb":26056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"268'152","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.598825+0000","last_change":"2024-09-12T01:03:10.598825+0000","last_active":"2024-09-12T01:03:10.598825+0000","last_peered":"2024-09-12T01:03:10.598825+0000","last_clean":"2024-09-12T01:03:10.598825+0000","last_became_active":"2024-09-12T00:16:05.095632+0000","last_became_peered":"2024-09-12T00:16:05.095632+0000","last_unstale":"2024-09-12T01:03:10.598825+0000","last_undegraded":"2024-09-12T01:03:10.598825+0000","last_fullsized":"2024-09-12T01:03:10.598825+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'152","last_scrub_stamp":"2024-09-12T01:03:10.598634+0000","last_deep_scrub":"268'152","last_deep_scrub_stamp":"2024-09-12T01:03:10.598634+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.598634+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:07.477069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":139,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"268'392","reported_seq":1871,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.048288+0000","last_change":"2024-09-12T01:02:58.048288+0000","last_active":"2024-09-12T01:02:58.048288+0000","last_peered":"2024-09-12T01:02:58.048288+0000","last_clean":"2024-09-12T01:02:58.048288+0000","last_became_active":"2024-09-12T00:15:57.042317+0000","last_became_peered":"2024-09-12T00:15:57.042317+0000","last_unstale":"2024-09-12T01:02:58.048288+0000","last_undegraded":"2024-09-12T01:02:58.048288+0000","last_fullsized":"2024-09-12T01:02:58.048288+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'392","last_scrub_stamp":"2024-09-12T01:02:58.048067+0000","last_deep_scrub":"268'392","last_deep_scrub_stamp":"2024-09-12T01:02:58.048067+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.048067+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:28.572626+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2080,"num_read_kb":1982,"num_write":441,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"268'365","reported_seq":1022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.610527+0000","last_change":"2024-09-12T01:02:51.610527+0000","last_active":"2024-09-12T01:02:51.610527+0000","last_peered":"2024-09-12T01:02:51.610527+0000","last_clean":"2024-09-12T01:02:51.610527+0000","last_became_active":"2024-09-12T00:15:55.042690+0000","last_became_peered":"2024-09-12T00:15:55.042690+0000","last_unstale":"2024-09-12T01:02:51.610527+0000","last_undegraded":"2024-09-12T01:02:51.610527+0000","last_fullsized":"2024-09-12T01:02:51.610527+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-12T01:02:51.610328+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-12T01:02:51.610328+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.610328+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:01.531698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288443,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":537,"num_read_kb":60082,"num_write":1122,"num_write_kb":36322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.577679+0000","last_change":"2024-09-12T01:03:15.577679+0000","last_active":"2024-09-12T01:03:15.577679+0000","last_peered":"2024-09-12T01:03:15.577679+0000","last_clean":"2024-09-12T01:03:15.577679+0000","last_became_active":"2024-09-12T00:15:59.046334+0000","last_became_peered":"2024-09-12T00:15:59.046334+0000","last_unstale":"2024-09-12T01:03:15.577679+0000","last_undegraded":"2024-09-12T01:03:15.577679+0000","last_fullsized":"2024-09-12T01:03:15.577679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:15.577489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:15.577489+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.577489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:42.549021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"268'365","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.319108+0000","last_change":"2024-09-12T01:03:14.319108+0000","last_active":"2024-09-12T01:03:14.319108+0000","last_peered":"2024-09-12T01:03:14.319108+0000","last_clean":"2024-09-12T01:03:14.319108+0000","last_became_active":"2024-09-12T00:16:01.057657+0000","last_became_peered":"2024-09-12T00:16:01.057657+0000","last_unstale":"2024-09-12T01:03:14.319108+0000","last_undegraded":"2024-09-12T01:03:14.319108+0000","last_fullsized":"2024-09-12T01:03:14.319108+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-12T01:03:14.318931+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-12T01:03:14.318931+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.318931+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:27.369397+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49919,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":600,"num_read_kb":1282,"num_write":482,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.272567+0000","last_change":"2024-09-12T01:03:10.272567+0000","last_active":"2024-09-12T01:03:10.272567+0000","last_peered":"2024-09-12T01:03:10.272567+0000","last_clean":"2024-09-12T01:03:10.272567+0000","last_became_active":"2024-09-12T00:16:03.098506+0000","last_became_peered":"2024-09-12T00:16:03.098506+0000","last_unstale":"2024-09-12T01:03:10.272567+0000","last_undegraded":"2024-09-12T01:03:10.272567+0000","last_fullsized":"2024-09-12T01:03:10.272567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:10.272377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:10.272377+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.272377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:45.071067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"268'155","reported_seq":726,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.345863+0000","last_change":"2024-09-12T01:03:13.345863+0000","last_active":"2024-09-12T01:03:13.345863+0000","last_peered":"2024-09-12T01:03:13.345863+0000","last_clean":"2024-09-12T01:03:13.345863+0000","last_became_active":"2024-09-12T00:16:05.105153+0000","last_became_peered":"2024-09-12T00:16:05.105153+0000","last_unstale":"2024-09-12T01:03:13.345863+0000","last_undegraded":"2024-09-12T01:03:13.345863+0000","last_fullsized":"2024-09-12T01:03:13.345863+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'155","last_scrub_stamp":"2024-09-12T01:03:13.345644+0000","last_deep_scrub":"268'155","last_deep_scrub_stamp":"2024-09-12T01:03:13.345644+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.345644+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:31.200725+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":214,"num_write":299,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"268'900","reported_seq":2532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.592009+0000","last_change":"2024-09-12T01:03:03.592009+0000","last_active":"2024-09-12T01:03:03.592009+0000","last_peered":"2024-09-12T01:03:03.592009+0000","last_clean":"2024-09-12T01:03:03.592009+0000","last_became_active":"2024-09-12T00:15:57.018484+0000","last_became_peered":"2024-09-12T00:15:57.018484+0000","last_unstale":"2024-09-12T01:03:03.592009+0000","last_undegraded":"2024-09-12T01:03:03.592009+0000","last_fullsized":"2024-09-12T01:03:03.592009+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'900","last_scrub_stamp":"2024-09-12T01:03:03.591747+0000","last_deep_scrub":"268'900","last_deep_scrub_stamp":"2024-09-12T01:03:03.591747+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.591747+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:57.427036+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4265,"num_read_kb":3809,"num_write":1199,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"268'363","reported_seq":1015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.060708+0000","last_change":"2024-09-12T01:02:49.060708+0000","last_active":"2024-09-12T01:02:49.060708+0000","last_peered":"2024-09-12T01:02:49.060708+0000","last_clean":"2024-09-12T01:02:49.060708+0000","last_became_active":"2024-09-12T00:15:55.065476+0000","last_became_peered":"2024-09-12T00:15:55.065476+0000","last_unstale":"2024-09-12T01:02:49.060708+0000","last_undegraded":"2024-09-12T01:02:49.060708+0000","last_fullsized":"2024-09-12T01:02:49.060708+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'363","last_scrub_stamp":"2024-09-12T01:02:49.060427+0000","last_deep_scrub":"268'363","last_deep_scrub_stamp":"2024-09-12T01:02:49.060427+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.060427+0000","objects_scrubbed":6,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:51.995984+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399070,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":579,"num_read_kb":7666,"num_write":1219,"num_write_kb":15378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.261725+0000","last_change":"2024-09-12T01:03:06.261725+0000","last_active":"2024-09-12T01:03:06.261725+0000","last_peered":"2024-09-12T01:03:06.261725+0000","last_clean":"2024-09-12T01:03:06.261725+0000","last_became_active":"2024-09-12T00:15:59.040412+0000","last_became_peered":"2024-09-12T00:15:59.040412+0000","last_unstale":"2024-09-12T01:03:06.261725+0000","last_undegraded":"2024-09-12T01:03:06.261725+0000","last_fullsized":"2024-09-12T01:03:06.261725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:06.261443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:06.261443+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.261443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:52.515905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"268'93","reported_seq":634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.263466+0000","last_change":"2024-09-12T01:03:09.263466+0000","last_active":"2024-09-12T01:03:09.263466+0000","last_peered":"2024-09-12T01:03:09.263466+0000","last_clean":"2024-09-12T01:03:09.263466+0000","last_became_active":"2024-09-12T00:16:01.062780+0000","last_became_peered":"2024-09-12T00:16:01.062780+0000","last_unstale":"2024-09-12T01:03:09.263466+0000","last_undegraded":"2024-09-12T01:03:09.263466+0000","last_fullsized":"2024-09-12T01:03:09.263466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'93","last_scrub_stamp":"2024-09-12T01:03:09.263285+0000","last_deep_scrub":"268'93","last_deep_scrub_stamp":"2024-09-12T01:03:09.263285+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.263285+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:30.034157+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.267152+0000","last_change":"2024-09-12T01:03:20.267152+0000","last_active":"2024-09-12T01:03:20.267152+0000","last_peered":"2024-09-12T01:03:20.267152+0000","last_clean":"2024-09-12T01:03:20.267152+0000","last_became_active":"2024-09-12T00:16:03.091926+0000","last_became_peered":"2024-09-12T00:16:03.091926+0000","last_unstale":"2024-09-12T01:03:20.267152+0000","last_undegraded":"2024-09-12T01:03:20.267152+0000","last_fullsized":"2024-09-12T01:03:20.267152+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:20.266968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:20.266968+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.266968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:48.830998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"268'130","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.242196+0000","last_change":"2024-09-12T01:03:13.242031+0000","last_active":"2024-09-12T01:03:13.242196+0000","last_peered":"2024-09-12T01:03:13.242196+0000","last_clean":"2024-09-12T01:03:13.242196+0000","last_became_active":"2024-09-12T00:16:05.114182+0000","last_became_peered":"2024-09-12T00:16:05.114182+0000","last_unstale":"2024-09-12T01:03:13.242196+0000","last_undegraded":"2024-09-12T01:03:13.242196+0000","last_fullsized":"2024-09-12T01:03:13.242196+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'130","last_scrub_stamp":"2024-09-12T01:03:13.241818+0000","last_deep_scrub":"268'130","last_deep_scrub_stamp":"2024-09-12T01:03:13.241818+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.241818+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:11.870463+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":293,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"268'1231","reported_seq":2694,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.453239+0000","last_change":"2024-09-12T01:03:02.453239+0000","last_active":"2024-09-12T01:03:02.453239+0000","last_peered":"2024-09-12T01:03:02.453239+0000","last_clean":"2024-09-12T01:03:02.453239+0000","last_became_active":"2024-09-12T00:15:57.046916+0000","last_became_peered":"2024-09-12T00:15:57.046916+0000","last_unstale":"2024-09-12T01:03:02.453239+0000","last_undegraded":"2024-09-12T01:03:02.453239+0000","last_fullsized":"2024-09-12T01:03:02.453239+0000","mapping_epoch":28,"log_start":"268'1200","ondisk_log_start":"268'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1231","last_scrub_stamp":"2024-09-12T01:03:02.453053+0000","last_deep_scrub":"268'1231","last_deep_scrub_stamp":"2024-09-12T01:03:02.453053+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.453053+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":1200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:35.974222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5641,"num_read_kb":4945,"num_write":1755,"num_write_kb":746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"268'379","reported_seq":1171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.585252+0000","last_change":"2024-09-12T01:02:55.585252+0000","last_active":"2024-09-12T01:02:55.585252+0000","last_peered":"2024-09-12T01:02:55.585252+0000","last_clean":"2024-09-12T01:02:55.585252+0000","last_became_active":"2024-09-12T00:15:55.058428+0000","last_became_peered":"2024-09-12T00:15:55.058428+0000","last_unstale":"2024-09-12T01:02:55.585252+0000","last_undegraded":"2024-09-12T01:02:55.585252+0000","last_fullsized":"2024-09-12T01:02:55.585252+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'379","last_scrub_stamp":"2024-09-12T01:02:55.585005+0000","last_deep_scrub":"268'379","last_deep_scrub_stamp":"2024-09-12T01:02:55.585005+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.585005+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:14.899658+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":722,"num_read_kb":690,"num_write":1257,"num_write_kb":29311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.228212+0000","last_change":"2024-09-12T01:03:07.228212+0000","last_active":"2024-09-12T01:03:07.228212+0000","last_peered":"2024-09-12T01:03:07.228212+0000","last_clean":"2024-09-12T01:03:07.228212+0000","last_became_active":"2024-09-12T00:15:59.039465+0000","last_became_peered":"2024-09-12T00:15:59.039465+0000","last_unstale":"2024-09-12T01:03:07.228212+0000","last_undegraded":"2024-09-12T01:03:07.228212+0000","last_fullsized":"2024-09-12T01:03:07.228212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:07.227963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:07.227963+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.227963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:54.506391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"268'137","reported_seq":697,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.369141+0000","last_change":"2024-09-12T01:03:13.369141+0000","last_active":"2024-09-12T01:03:13.369141+0000","last_peered":"2024-09-12T01:03:13.369141+0000","last_clean":"2024-09-12T01:03:13.369141+0000","last_became_active":"2024-09-12T00:16:01.056702+0000","last_became_peered":"2024-09-12T00:16:01.056702+0000","last_unstale":"2024-09-12T01:03:13.369141+0000","last_undegraded":"2024-09-12T01:03:13.369141+0000","last_fullsized":"2024-09-12T01:03:13.369141+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'137","last_scrub_stamp":"2024-09-12T01:03:13.368957+0000","last_deep_scrub":"268'137","last_deep_scrub_stamp":"2024-09-12T01:03:13.368957+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.368957+0000","objects_scrubbed":7,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:34.961935+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":144,"num_read_kb":136,"num_write":100,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"268'803","reported_seq":2234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.604032+0000","last_change":"2024-09-12T01:03:24.604032+0000","last_active":"2024-09-12T01:03:24.604032+0000","last_peered":"2024-09-12T01:03:24.604032+0000","last_clean":"2024-09-12T01:03:24.604032+0000","last_became_active":"2024-09-12T00:16:03.103292+0000","last_became_peered":"2024-09-12T00:16:03.103292+0000","last_unstale":"2024-09-12T01:03:24.604032+0000","last_undegraded":"2024-09-12T01:03:24.604032+0000","last_fullsized":"2024-09-12T01:03:24.604032+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'803","last_scrub_stamp":"2024-09-12T01:03:24.603746+0000","last_deep_scrub":"268'803","last_deep_scrub_stamp":"2024-09-12T01:03:24.603746+0000","last_clean_scrub_stamp":"2024-09-12T01:03:24.603746+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:07.482869+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"268'236","reported_seq":1069,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.556161+0000","last_change":"2024-09-12T01:03:13.556009+0000","last_active":"2024-09-12T01:03:13.556161+0000","last_peered":"2024-09-12T01:03:13.556161+0000","last_clean":"2024-09-12T01:03:13.556161+0000","last_became_active":"2024-09-12T00:16:05.107785+0000","last_became_peered":"2024-09-12T00:16:05.107785+0000","last_unstale":"2024-09-12T01:03:13.556161+0000","last_undegraded":"2024-09-12T01:03:13.556161+0000","last_fullsized":"2024-09-12T01:03:13.556161+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'236","last_scrub_stamp":"2024-09-12T01:03:13.555830+0000","last_deep_scrub":"268'236","last_deep_scrub_stamp":"2024-09-12T01:03:13.555830+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.555830+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:05.447726+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":637,"num_write":534,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"268'636","reported_seq":2170,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.468669+0000","last_change":"2024-09-12T01:03:03.468669+0000","last_active":"2024-09-12T01:03:03.468669+0000","last_peered":"2024-09-12T01:03:03.468669+0000","last_clean":"2024-09-12T01:03:03.468669+0000","last_became_active":"2024-09-12T00:15:57.035581+0000","last_became_peered":"2024-09-12T00:15:57.035581+0000","last_unstale":"2024-09-12T01:03:03.468669+0000","last_undegraded":"2024-09-12T01:03:03.468669+0000","last_fullsized":"2024-09-12T01:03:03.468669+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'636","last_scrub_stamp":"2024-09-12T01:03:03.468424+0000","last_deep_scrub":"268'636","last_deep_scrub_stamp":"2024-09-12T01:03:03.468424+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.468424+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":600,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:47.919591+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3178,"num_read_kb":2956,"num_write":875,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"268'336","reported_seq":1010,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.230246+0000","last_change":"2024-09-12T01:02:50.230246+0000","last_active":"2024-09-12T01:02:50.230246+0000","last_peered":"2024-09-12T01:02:50.230246+0000","last_clean":"2024-09-12T01:02:50.230246+0000","last_became_active":"2024-09-12T00:15:55.065178+0000","last_became_peered":"2024-09-12T00:15:55.065178+0000","last_unstale":"2024-09-12T01:02:50.230246+0000","last_undegraded":"2024-09-12T01:02:50.230246+0000","last_fullsized":"2024-09-12T01:02:50.230246+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'336","last_scrub_stamp":"2024-09-12T01:02:50.230018+0000","last_deep_scrub":"268'336","last_deep_scrub_stamp":"2024-09-12T01:02:50.230018+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.230018+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:17.900987+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262226,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":565,"num_write":1139,"num_write_kb":21852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.581360+0000","last_change":"2024-09-12T01:03:16.581360+0000","last_active":"2024-09-12T01:03:16.581360+0000","last_peered":"2024-09-12T01:03:16.581360+0000","last_clean":"2024-09-12T01:03:16.581360+0000","last_became_active":"2024-09-12T00:15:59.039902+0000","last_became_peered":"2024-09-12T00:15:59.039902+0000","last_unstale":"2024-09-12T01:03:16.581360+0000","last_undegraded":"2024-09-12T01:03:16.581360+0000","last_fullsized":"2024-09-12T01:03:16.581360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:16.581177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:16.581177+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.581177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:43.991582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"268'283","reported_seq":863,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.569244+0000","last_change":"2024-09-12T01:03:06.569244+0000","last_active":"2024-09-12T01:03:06.569244+0000","last_peered":"2024-09-12T01:03:06.569244+0000","last_clean":"2024-09-12T01:03:06.569244+0000","last_became_active":"2024-09-12T00:16:01.052744+0000","last_became_peered":"2024-09-12T00:16:01.052744+0000","last_unstale":"2024-09-12T01:03:06.569244+0000","last_undegraded":"2024-09-12T01:03:06.569244+0000","last_fullsized":"2024-09-12T01:03:06.569244+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'283","last_scrub_stamp":"2024-09-12T01:03:06.568959+0000","last_deep_scrub":"268'283","last_deep_scrub_stamp":"2024-09-12T01:03:06.568959+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.568959+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:00.450040+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47709,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":1056,"num_write":378,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"268'816","reported_seq":2470,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.561546+0000","last_change":"2024-09-12T01:03:17.561546+0000","last_active":"2024-09-12T01:03:17.561546+0000","last_peered":"2024-09-12T01:03:17.561546+0000","last_clean":"2024-09-12T01:03:17.561546+0000","last_became_active":"2024-09-12T00:16:03.097895+0000","last_became_peered":"2024-09-12T00:16:03.097895+0000","last_unstale":"2024-09-12T01:03:17.561546+0000","last_undegraded":"2024-09-12T01:03:17.561546+0000","last_fullsized":"2024-09-12T01:03:17.561546+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'816","last_scrub_stamp":"2024-09-12T01:03:17.561363+0000","last_deep_scrub":"268'816","last_deep_scrub_stamp":"2024-09-12T01:03:17.561363+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.561363+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:37.539725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"268'460","reported_seq":2022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.599890+0000","last_change":"2024-09-12T01:03:05.599731+0000","last_active":"2024-09-12T01:03:05.599890+0000","last_peered":"2024-09-12T01:03:05.599890+0000","last_clean":"2024-09-12T01:03:05.599890+0000","last_became_active":"2024-09-12T00:15:57.023659+0000","last_became_peered":"2024-09-12T00:15:57.023659+0000","last_unstale":"2024-09-12T01:03:05.599890+0000","last_undegraded":"2024-09-12T01:03:05.599890+0000","last_fullsized":"2024-09-12T01:03:05.599890+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'460","last_scrub_stamp":"2024-09-12T01:03:05.599554+0000","last_deep_scrub":"268'460","last_deep_scrub_stamp":"2024-09-12T01:03:05.599554+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.599554+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:38.313492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2457,"num_read_kb":2306,"num_write":563,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"268'375","reported_seq":1015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:44.553160+0000","last_change":"2024-09-12T01:02:44.553031+0000","last_active":"2024-09-12T01:02:44.553160+0000","last_peered":"2024-09-12T01:02:44.553160+0000","last_clean":"2024-09-12T01:02:44.553160+0000","last_became_active":"2024-09-12T00:15:55.060679+0000","last_became_peered":"2024-09-12T00:15:55.060679+0000","last_unstale":"2024-09-12T01:02:44.553160+0000","last_undegraded":"2024-09-12T01:02:44.553160+0000","last_fullsized":"2024-09-12T01:02:44.553160+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'375","last_scrub_stamp":"2024-09-12T01:02:44.552852+0000","last_deep_scrub":"268'375","last_deep_scrub_stamp":"2024-09-12T01:02:44.552852+0000","last_clean_scrub_stamp":"2024-09-12T01:02:44.552852+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:52.618648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":484,"num_read_kb":16773,"num_write":1144,"num_write_kb":29370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.191300+0000","last_change":"2024-09-12T01:02:58.191150+0000","last_active":"2024-09-12T01:02:58.191300+0000","last_peered":"2024-09-12T01:02:58.191300+0000","last_clean":"2024-09-12T01:02:58.191300+0000","last_became_active":"2024-09-12T00:15:59.035288+0000","last_became_peered":"2024-09-12T00:15:59.035288+0000","last_unstale":"2024-09-12T01:02:58.191300+0000","last_undegraded":"2024-09-12T01:02:58.191300+0000","last_fullsized":"2024-09-12T01:02:58.191300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:58.190865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:58.190865+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.190865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:42.772188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"268'358","reported_seq":982,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.582233+0000","last_change":"2024-09-12T01:03:04.582233+0000","last_active":"2024-09-12T01:03:04.582233+0000","last_peered":"2024-09-12T01:03:04.582233+0000","last_clean":"2024-09-12T01:03:04.582233+0000","last_became_active":"2024-09-12T00:16:01.069838+0000","last_became_peered":"2024-09-12T00:16:01.069838+0000","last_unstale":"2024-09-12T01:03:04.582233+0000","last_undegraded":"2024-09-12T01:03:04.582233+0000","last_fullsized":"2024-09-12T01:03:04.582233+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-12T01:03:04.582029+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-12T01:03:04.582029+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.582029+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:04.440997+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45025,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":563,"num_read_kb":1131,"num_write":438,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.153517+0000","last_change":"2024-09-12T01:03:11.153393+0000","last_active":"2024-09-12T01:03:11.153517+0000","last_peered":"2024-09-12T01:03:11.153517+0000","last_clean":"2024-09-12T01:03:11.153517+0000","last_became_active":"2024-09-12T00:16:03.089533+0000","last_became_peered":"2024-09-12T00:16:03.089533+0000","last_unstale":"2024-09-12T01:03:11.153517+0000","last_undegraded":"2024-09-12T01:03:11.153517+0000","last_fullsized":"2024-09-12T01:03:11.153517+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:11.153215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:11.153215+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.153215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:32.835270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"268'575","reported_seq":1395,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.581701+0000","last_change":"2024-09-12T01:03:09.581701+0000","last_active":"2024-09-12T01:03:09.581701+0000","last_peered":"2024-09-12T01:03:09.581701+0000","last_clean":"2024-09-12T01:03:09.581701+0000","last_became_active":"2024-09-12T00:16:05.112960+0000","last_became_peered":"2024-09-12T00:16:05.112960+0000","last_unstale":"2024-09-12T01:03:09.581701+0000","last_undegraded":"2024-09-12T01:03:09.581701+0000","last_fullsized":"2024-09-12T01:03:09.581701+0000","mapping_epoch":36,"log_start":"268'500","ondisk_log_start":"268'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'575","last_scrub_stamp":"2024-09-12T01:03:09.581499+0000","last_deep_scrub":"268'575","last_deep_scrub_stamp":"2024-09-12T01:03:09.581499+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.581499+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:17.076524+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1305,"num_read_kb":1300,"num_write":1202,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"268'525","reported_seq":2012,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.187071+0000","last_change":"2024-09-12T01:02:49.186856+0000","last_active":"2024-09-12T01:02:49.187071+0000","last_peered":"2024-09-12T01:02:49.187071+0000","last_clean":"2024-09-12T01:02:49.187071+0000","last_became_active":"2024-09-12T00:15:57.045141+0000","last_became_peered":"2024-09-12T00:15:57.045141+0000","last_unstale":"2024-09-12T01:02:49.187071+0000","last_undegraded":"2024-09-12T01:02:49.187071+0000","last_fullsized":"2024-09-12T01:02:49.187071+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'525","last_scrub_stamp":"2024-09-12T01:02:49.186637+0000","last_deep_scrub":"268'525","last_deep_scrub_stamp":"2024-09-12T01:02:49.186637+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.186637+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:02.660716+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2585,"num_read_kb":2367,"num_write":669,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"268'370","reported_seq":1025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:45.502665+0000","last_change":"2024-09-12T01:02:45.502549+0000","last_active":"2024-09-12T01:02:45.502665+0000","last_peered":"2024-09-12T01:02:45.502665+0000","last_clean":"2024-09-12T01:02:45.502665+0000","last_became_active":"2024-09-12T00:15:55.063542+0000","last_became_peered":"2024-09-12T00:15:55.063542+0000","last_unstale":"2024-09-12T01:02:45.502665+0000","last_undegraded":"2024-09-12T01:02:45.502665+0000","last_fullsized":"2024-09-12T01:02:45.502665+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-12T01:02:45.502377+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-12T01:02:45.502377+0000","last_clean_scrub_stamp":"2024-09-12T01:02:45.502377+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:03.174691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":559,"num_read_kb":24074,"num_write":1250,"num_write_kb":38232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.118827+0000","last_change":"2024-09-12T01:03:01.118698+0000","last_active":"2024-09-12T01:03:01.118827+0000","last_peered":"2024-09-12T01:03:01.118827+0000","last_clean":"2024-09-12T01:03:01.118827+0000","last_became_active":"2024-09-12T00:15:59.050663+0000","last_became_peered":"2024-09-12T00:15:59.050663+0000","last_unstale":"2024-09-12T01:03:01.118827+0000","last_undegraded":"2024-09-12T01:03:01.118827+0000","last_fullsized":"2024-09-12T01:03:01.118827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:01.118502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:01.118502+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.118502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:20.630794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"268'250","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.300044+0000","last_change":"2024-09-12T01:03:11.299779+0000","last_active":"2024-09-12T01:03:11.300044+0000","last_peered":"2024-09-12T01:03:11.300044+0000","last_clean":"2024-09-12T01:03:11.300044+0000","last_became_active":"2024-09-12T00:16:01.068392+0000","last_became_peered":"2024-09-12T00:16:01.068392+0000","last_unstale":"2024-09-12T01:03:11.300044+0000","last_undegraded":"2024-09-12T01:03:11.300044+0000","last_fullsized":"2024-09-12T01:03:11.300044+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'250","last_scrub_stamp":"2024-09-12T01:03:11.299521+0000","last_deep_scrub":"268'250","last_deep_scrub_stamp":"2024-09-12T01:03:11.299521+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.299521+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:46.135518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10400,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":388,"num_read_kb":849,"num_write":306,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.374745+0000","last_change":"2024-09-12T01:03:18.374745+0000","last_active":"2024-09-12T01:03:18.374745+0000","last_peered":"2024-09-12T01:03:18.374745+0000","last_clean":"2024-09-12T01:03:18.374745+0000","last_became_active":"2024-09-12T00:16:03.086751+0000","last_became_peered":"2024-09-12T00:16:03.086751+0000","last_unstale":"2024-09-12T01:03:18.374745+0000","last_undegraded":"2024-09-12T01:03:18.374745+0000","last_fullsized":"2024-09-12T01:03:18.374745+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:18.374546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:18.374546+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.374546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:35.922479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"268'2412","reported_seq":4256,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.330226+0000","last_change":"2024-09-12T01:03:11.330226+0000","last_active":"2024-09-12T01:03:11.330226+0000","last_peered":"2024-09-12T01:03:11.330226+0000","last_clean":"2024-09-12T01:03:11.330226+0000","last_became_active":"2024-09-12T00:16:05.114563+0000","last_became_peered":"2024-09-12T00:16:05.114563+0000","last_unstale":"2024-09-12T01:03:11.330226+0000","last_undegraded":"2024-09-12T01:03:11.330226+0000","last_fullsized":"2024-09-12T01:03:11.330226+0000","mapping_epoch":36,"log_start":"268'2401","ondisk_log_start":"268'2401","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2412","last_scrub_stamp":"2024-09-12T01:03:11.330022+0000","last_deep_scrub":"268'2412","last_deep_scrub_stamp":"2024-09-12T01:03:11.330022+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.330022+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":2401,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:27.082423+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6030,"num_read_kb":6028,"num_write":4877,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"268'787","reported_seq":2367,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.639010+0000","last_change":"2024-09-12T01:02:51.638877+0000","last_active":"2024-09-12T01:02:51.639010+0000","last_peered":"2024-09-12T01:02:51.639010+0000","last_clean":"2024-09-12T01:02:51.639010+0000","last_became_active":"2024-09-12T00:15:57.024509+0000","last_became_peered":"2024-09-12T00:15:57.024509+0000","last_unstale":"2024-09-12T01:02:51.639010+0000","last_undegraded":"2024-09-12T01:02:51.639010+0000","last_fullsized":"2024-09-12T01:02:51.639010+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'787","last_scrub_stamp":"2024-09-12T01:02:51.638693+0000","last_deep_scrub":"268'787","last_deep_scrub_stamp":"2024-09-12T01:02:51.638693+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.638693+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:49.637175+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3769,"num_read_kb":3415,"num_write":1030,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"268'342","reported_seq":995,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.680813+0000","last_change":"2024-09-12T01:02:49.680665+0000","last_active":"2024-09-12T01:02:49.680813+0000","last_peered":"2024-09-12T01:02:49.680813+0000","last_clean":"2024-09-12T01:02:49.680813+0000","last_became_active":"2024-09-12T00:15:55.052916+0000","last_became_peered":"2024-09-12T00:15:55.052916+0000","last_unstale":"2024-09-12T01:02:49.680813+0000","last_undegraded":"2024-09-12T01:02:49.680813+0000","last_fullsized":"2024-09-12T01:02:49.680813+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-12T01:02:49.680438+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-12T01:02:49.680438+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.680438+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:55.122798+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306611,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":476,"num_read_kb":37817,"num_write":1138,"num_write_kb":39957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.497054+0000","last_change":"2024-09-12T01:03:09.496915+0000","last_active":"2024-09-12T01:03:09.497054+0000","last_peered":"2024-09-12T01:03:09.497054+0000","last_clean":"2024-09-12T01:03:09.497054+0000","last_became_active":"2024-09-12T00:15:59.034650+0000","last_became_peered":"2024-09-12T00:15:59.034650+0000","last_unstale":"2024-09-12T01:03:09.497054+0000","last_undegraded":"2024-09-12T01:03:09.497054+0000","last_fullsized":"2024-09-12T01:03:09.497054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:09.496742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:09.496742+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.496742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:28.986770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"268'327","reported_seq":940,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.578723+0000","last_change":"2024-09-12T01:03:18.578572+0000","last_active":"2024-09-12T01:03:18.578723+0000","last_peered":"2024-09-12T01:03:18.578723+0000","last_clean":"2024-09-12T01:03:18.578723+0000","last_became_active":"2024-09-12T00:16:01.057281+0000","last_became_peered":"2024-09-12T00:16:01.057281+0000","last_unstale":"2024-09-12T01:03:18.578723+0000","last_undegraded":"2024-09-12T01:03:18.578723+0000","last_fullsized":"2024-09-12T01:03:18.578723+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'327","last_scrub_stamp":"2024-09-12T01:03:18.578375+0000","last_deep_scrub":"268'327","last_deep_scrub_stamp":"2024-09-12T01:03:18.578375+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.578375+0000","objects_scrubbed":9,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:44.728688+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49581,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":504,"num_read_kb":1060,"num_write":406,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"268'816","reported_seq":2433,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.506232+0000","last_change":"2024-09-12T01:03:15.506078+0000","last_active":"2024-09-12T01:03:15.506232+0000","last_peered":"2024-09-12T01:03:15.506232+0000","last_clean":"2024-09-12T01:03:15.506232+0000","last_became_active":"2024-09-12T00:16:03.097554+0000","last_became_peered":"2024-09-12T00:16:03.097554+0000","last_unstale":"2024-09-12T01:03:15.506232+0000","last_undegraded":"2024-09-12T01:03:15.506232+0000","last_fullsized":"2024-09-12T01:03:15.506232+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'816","last_scrub_stamp":"2024-09-12T01:03:15.505876+0000","last_deep_scrub":"268'816","last_deep_scrub_stamp":"2024-09-12T01:03:15.505876+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.505876+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:52.676458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"268'96","reported_seq":610,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.196672+0000","last_change":"2024-09-12T01:03:15.196451+0000","last_active":"2024-09-12T01:03:15.196672+0000","last_peered":"2024-09-12T01:03:15.196672+0000","last_clean":"2024-09-12T01:03:15.196672+0000","last_became_active":"2024-09-12T00:16:05.112524+0000","last_became_peered":"2024-09-12T00:16:05.112524+0000","last_unstale":"2024-09-12T01:03:15.196672+0000","last_undegraded":"2024-09-12T01:03:15.196672+0000","last_fullsized":"2024-09-12T01:03:15.196672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'96","last_scrub_stamp":"2024-09-12T01:03:15.196178+0000","last_deep_scrub":"268'96","last_deep_scrub_stamp":"2024-09-12T01:03:15.196178+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.196178+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:31.550514+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":109,"num_write":225,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"268'459","reported_seq":1835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.410646+0000","last_change":"2024-09-12T01:03:01.410451+0000","last_active":"2024-09-12T01:03:01.410646+0000","last_peered":"2024-09-12T01:03:01.410646+0000","last_clean":"2024-09-12T01:03:01.410646+0000","last_became_active":"2024-09-12T00:15:57.042663+0000","last_became_peered":"2024-09-12T00:15:57.042663+0000","last_unstale":"2024-09-12T01:03:01.410646+0000","last_undegraded":"2024-09-12T01:03:01.410646+0000","last_fullsized":"2024-09-12T01:03:01.410646+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'459","last_scrub_stamp":"2024-09-12T01:03:01.410256+0000","last_deep_scrub":"268'459","last_deep_scrub_stamp":"2024-09-12T01:03:01.410256+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.410256+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:01.856062+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2110,"num_read_kb":1961,"num_write":540,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"268'346","reported_seq":1096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.586839+0000","last_change":"2024-09-12T01:02:51.586675+0000","last_active":"2024-09-12T01:02:51.586839+0000","last_peered":"2024-09-12T01:02:51.586839+0000","last_clean":"2024-09-12T01:02:51.586839+0000","last_became_active":"2024-09-12T00:15:55.054533+0000","last_became_peered":"2024-09-12T00:15:55.054533+0000","last_unstale":"2024-09-12T01:02:51.586839+0000","last_undegraded":"2024-09-12T01:02:51.586839+0000","last_fullsized":"2024-09-12T01:02:51.586839+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:02:51.586430+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:02:51.586430+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.586430+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:34.921515+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263223,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":794,"num_read_kb":57067,"num_write":1127,"num_write_kb":15994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.131072+0000","last_change":"2024-09-12T01:03:02.131072+0000","last_active":"2024-09-12T01:03:02.131072+0000","last_peered":"2024-09-12T01:03:02.131072+0000","last_clean":"2024-09-12T01:03:02.131072+0000","last_became_active":"2024-09-12T00:15:59.037145+0000","last_became_peered":"2024-09-12T00:15:59.037145+0000","last_unstale":"2024-09-12T01:03:02.131072+0000","last_undegraded":"2024-09-12T01:03:02.131072+0000","last_fullsized":"2024-09-12T01:03:02.131072+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:02.130877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:02.130877+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.130877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:34.886452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"268'492","reported_seq":1150,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.258077+0000","last_change":"2024-09-12T01:03:10.257980+0000","last_active":"2024-09-12T01:03:10.258077+0000","last_peered":"2024-09-12T01:03:10.258077+0000","last_clean":"2024-09-12T01:03:10.258077+0000","last_became_active":"2024-09-12T00:16:01.068496+0000","last_became_peered":"2024-09-12T00:16:01.068496+0000","last_unstale":"2024-09-12T01:03:10.258077+0000","last_undegraded":"2024-09-12T01:03:10.258077+0000","last_fullsized":"2024-09-12T01:03:10.258077+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'492","last_scrub_stamp":"2024-09-12T01:03:10.257870+0000","last_deep_scrub":"268'492","last_deep_scrub_stamp":"2024-09-12T01:03:10.257870+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.257870+0000","objects_scrubbed":7,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:35.185896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92831,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":846,"num_read_kb":2016,"num_write":692,"num_write_kb":581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.473441+0000","last_change":"2024-09-12T01:03:14.473305+0000","last_active":"2024-09-12T01:03:14.473441+0000","last_peered":"2024-09-12T01:03:14.473441+0000","last_clean":"2024-09-12T01:03:14.473441+0000","last_became_active":"2024-09-12T00:16:03.101984+0000","last_became_peered":"2024-09-12T00:16:03.101984+0000","last_unstale":"2024-09-12T01:03:14.473441+0000","last_undegraded":"2024-09-12T01:03:14.473441+0000","last_fullsized":"2024-09-12T01:03:14.473441+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:14.473119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:14.473119+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.473119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:56.000451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"268'132","reported_seq":642,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.898625+0000","last_change":"2024-09-12T01:03:10.898479+0000","last_active":"2024-09-12T01:03:10.898625+0000","last_peered":"2024-09-12T01:03:10.898625+0000","last_clean":"2024-09-12T01:03:10.898625+0000","last_became_active":"2024-09-12T00:16:05.104674+0000","last_became_peered":"2024-09-12T00:16:05.104674+0000","last_unstale":"2024-09-12T01:03:10.898625+0000","last_undegraded":"2024-09-12T01:03:10.898625+0000","last_fullsized":"2024-09-12T01:03:10.898625+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'132","last_scrub_stamp":"2024-09-12T01:03:10.898244+0000","last_deep_scrub":"268'132","last_deep_scrub_stamp":"2024-09-12T01:03:10.898244+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.898244+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:44.538905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":121,"num_write":297,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"268'781","reported_seq":2295,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.555105+0000","last_change":"2024-09-12T01:02:57.554858+0000","last_active":"2024-09-12T01:02:57.555105+0000","last_peered":"2024-09-12T01:02:57.555105+0000","last_clean":"2024-09-12T01:02:57.555105+0000","last_became_active":"2024-09-12T00:15:57.016954+0000","last_became_peered":"2024-09-12T00:15:57.016954+0000","last_unstale":"2024-09-12T01:02:57.555105+0000","last_undegraded":"2024-09-12T01:02:57.555105+0000","last_fullsized":"2024-09-12T01:02:57.555105+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'781","last_scrub_stamp":"2024-09-12T01:02:57.554627+0000","last_deep_scrub":"268'781","last_deep_scrub_stamp":"2024-09-12T01:02:57.554627+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.554627+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:39.189137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3833,"num_read_kb":3467,"num_write":1045,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"268'302","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.716691+0000","last_change":"2024-09-12T01:02:49.716410+0000","last_active":"2024-09-12T01:02:49.716691+0000","last_peered":"2024-09-12T01:02:49.716691+0000","last_clean":"2024-09-12T01:02:49.716691+0000","last_became_active":"2024-09-12T00:15:55.062854+0000","last_became_peered":"2024-09-12T00:15:55.062854+0000","last_unstale":"2024-09-12T01:02:49.716691+0000","last_undegraded":"2024-09-12T01:02:49.716691+0000","last_fullsized":"2024-09-12T01:02:49.716691+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'302","last_scrub_stamp":"2024-09-12T01:02:49.716161+0000","last_deep_scrub":"268'302","last_deep_scrub_stamp":"2024-09-12T01:02:49.716161+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.716161+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:41.591969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262214,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":412,"num_read_kb":12698,"num_write":975,"num_write_kb":17642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.827324+0000","last_change":"2024-09-12T01:03:00.827168+0000","last_active":"2024-09-12T01:03:00.827324+0000","last_peered":"2024-09-12T01:03:00.827324+0000","last_clean":"2024-09-12T01:03:00.827324+0000","last_became_active":"2024-09-12T00:15:59.033844+0000","last_became_peered":"2024-09-12T00:15:59.033844+0000","last_unstale":"2024-09-12T01:03:00.827324+0000","last_undegraded":"2024-09-12T01:03:00.827324+0000","last_fullsized":"2024-09-12T01:03:00.827324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:00.826990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:00.826990+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.826990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:17.427435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"268'323","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.264429+0000","last_change":"2024-09-12T01:03:06.264266+0000","last_active":"2024-09-12T01:03:06.264429+0000","last_peered":"2024-09-12T01:03:06.264429+0000","last_clean":"2024-09-12T01:03:06.264429+0000","last_became_active":"2024-09-12T00:16:01.067377+0000","last_became_peered":"2024-09-12T00:16:01.067377+0000","last_unstale":"2024-09-12T01:03:06.264429+0000","last_undegraded":"2024-09-12T01:03:06.264429+0000","last_fullsized":"2024-09-12T01:03:06.264429+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'323","last_scrub_stamp":"2024-09-12T01:03:06.264071+0000","last_deep_scrub":"268'323","last_deep_scrub_stamp":"2024-09-12T01:03:06.264071+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.264071+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:11.054065+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":549,"num_read_kb":1240,"num_write":496,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.894777+0000","last_change":"2024-09-12T01:03:07.894544+0000","last_active":"2024-09-12T01:03:07.894777+0000","last_peered":"2024-09-12T01:03:07.894777+0000","last_clean":"2024-09-12T01:03:07.894777+0000","last_became_active":"2024-09-12T00:16:03.079004+0000","last_became_peered":"2024-09-12T00:16:03.079004+0000","last_unstale":"2024-09-12T01:03:07.894777+0000","last_undegraded":"2024-09-12T01:03:07.894777+0000","last_fullsized":"2024-09-12T01:03:07.894777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:07.894293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:07.894293+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.894293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:54.640963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"268'133","reported_seq":631,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.649176+0000","last_change":"2024-09-12T01:03:19.649176+0000","last_active":"2024-09-12T01:03:19.649176+0000","last_peered":"2024-09-12T01:03:19.649176+0000","last_clean":"2024-09-12T01:03:19.649176+0000","last_became_active":"2024-09-12T00:16:05.093815+0000","last_became_peered":"2024-09-12T00:16:05.093815+0000","last_unstale":"2024-09-12T01:03:19.649176+0000","last_undegraded":"2024-09-12T01:03:19.649176+0000","last_fullsized":"2024-09-12T01:03:19.649176+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'133","last_scrub_stamp":"2024-09-12T01:03:19.648987+0000","last_deep_scrub":"268'133","last_deep_scrub_stamp":"2024-09-12T01:03:19.648987+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.648987+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:21.363778+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":302,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"268'447","reported_seq":2000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.542538+0000","last_change":"2024-09-12T01:03:02.542377+0000","last_active":"2024-09-12T01:03:02.542538+0000","last_peered":"2024-09-12T01:03:02.542538+0000","last_clean":"2024-09-12T01:03:02.542538+0000","last_became_active":"2024-09-12T00:15:57.029290+0000","last_became_peered":"2024-09-12T00:15:57.029290+0000","last_unstale":"2024-09-12T01:03:02.542538+0000","last_undegraded":"2024-09-12T01:03:02.542538+0000","last_fullsized":"2024-09-12T01:03:02.542538+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'447","last_scrub_stamp":"2024-09-12T01:03:02.542185+0000","last_deep_scrub":"268'447","last_deep_scrub_stamp":"2024-09-12T01:03:02.542185+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.542185+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:21.152121+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2290,"num_read_kb":2163,"num_write":517,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":469,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"268'350","reported_seq":1020,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.685091+0000","last_change":"2024-09-12T01:02:48.685091+0000","last_active":"2024-09-12T01:02:48.685091+0000","last_peered":"2024-09-12T01:02:48.685091+0000","last_clean":"2024-09-12T01:02:48.685091+0000","last_became_active":"2024-09-12T00:16:26.796888+0000","last_became_peered":"2024-09-12T00:16:26.796888+0000","last_unstale":"2024-09-12T01:02:48.685091+0000","last_undegraded":"2024-09-12T01:02:48.685091+0000","last_fullsized":"2024-09-12T01:02:48.685091+0000","mapping_epoch":39,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T01:02:48.684885+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T01:02:48.684885+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.684885+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:31.844783+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":37574,"num_write":1133,"num_write_kb":35076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,6],"acting":[3,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.479209+0000","last_change":"2024-09-12T01:03:10.478940+0000","last_active":"2024-09-12T01:03:10.479209+0000","last_peered":"2024-09-12T01:03:10.479209+0000","last_clean":"2024-09-12T01:03:10.479209+0000","last_became_active":"2024-09-12T00:15:59.029998+0000","last_became_peered":"2024-09-12T00:15:59.029998+0000","last_unstale":"2024-09-12T01:03:10.479209+0000","last_undegraded":"2024-09-12T01:03:10.479209+0000","last_fullsized":"2024-09-12T01:03:10.479209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:10.478741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:10.478741+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.478741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.181120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"268'313","reported_seq":905,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.516343+0000","last_change":"2024-09-12T01:03:11.516160+0000","last_active":"2024-09-12T01:03:11.516343+0000","last_peered":"2024-09-12T01:03:11.516343+0000","last_clean":"2024-09-12T01:03:11.516343+0000","last_became_active":"2024-09-12T00:16:01.053660+0000","last_became_peered":"2024-09-12T00:16:01.053660+0000","last_unstale":"2024-09-12T01:03:11.516343+0000","last_undegraded":"2024-09-12T01:03:11.516343+0000","last_fullsized":"2024-09-12T01:03:11.516343+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-12T01:03:11.515958+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-12T01:03:11.515958+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.515958+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:02.549026+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54997,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":504,"num_read_kb":1130,"num_write":408,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"268'777","reported_seq":2376,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.890344+0000","last_change":"2024-09-12T01:03:03.890196+0000","last_active":"2024-09-12T01:03:03.890344+0000","last_peered":"2024-09-12T01:03:03.890344+0000","last_clean":"2024-09-12T01:03:03.890344+0000","last_became_active":"2024-09-12T00:16:03.098077+0000","last_became_peered":"2024-09-12T00:16:03.098077+0000","last_unstale":"2024-09-12T01:03:03.890344+0000","last_undegraded":"2024-09-12T01:03:03.890344+0000","last_fullsized":"2024-09-12T01:03:03.890344+0000","mapping_epoch":34,"log_start":"268'701","ondisk_log_start":"268'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'777","last_scrub_stamp":"2024-09-12T01:03:03.889993+0000","last_deep_scrub":"268'777","last_deep_scrub_stamp":"2024-09-12T01:03:03.889993+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.889993+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":701,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:19.782671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"268'154","reported_seq":664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.204907+0000","last_change":"2024-09-12T01:03:12.204907+0000","last_active":"2024-09-12T01:03:12.204907+0000","last_peered":"2024-09-12T01:03:12.204907+0000","last_clean":"2024-09-12T01:03:12.204907+0000","last_became_active":"2024-09-12T00:16:05.107291+0000","last_became_peered":"2024-09-12T00:16:05.107291+0000","last_unstale":"2024-09-12T01:03:12.204907+0000","last_undegraded":"2024-09-12T01:03:12.204907+0000","last_fullsized":"2024-09-12T01:03:12.204907+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'154","last_scrub_stamp":"2024-09-12T01:03:12.204682+0000","last_deep_scrub":"268'154","last_deep_scrub_stamp":"2024-09-12T01:03:12.204682+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.204682+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:02.743584+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":174,"num_read_kb":162,"num_write":365,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"268'796","reported_seq":2317,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.684896+0000","last_change":"2024-09-12T01:02:53.684735+0000","last_active":"2024-09-12T01:02:53.684896+0000","last_peered":"2024-09-12T01:02:53.684896+0000","last_clean":"2024-09-12T01:02:53.684896+0000","last_became_active":"2024-09-12T00:15:57.024185+0000","last_became_peered":"2024-09-12T00:15:57.024185+0000","last_unstale":"2024-09-12T01:02:53.684896+0000","last_undegraded":"2024-09-12T01:02:53.684896+0000","last_fullsized":"2024-09-12T01:02:53.684896+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'796","last_scrub_stamp":"2024-09-12T01:02:53.684558+0000","last_deep_scrub":"268'796","last_deep_scrub_stamp":"2024-09-12T01:02:53.684558+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.684558+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:16.494973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3776,"num_read_kb":3402,"num_write":1055,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"268'346","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.643400+0000","last_change":"2024-09-12T01:02:52.643233+0000","last_active":"2024-09-12T01:02:52.643400+0000","last_peered":"2024-09-12T01:02:52.643400+0000","last_clean":"2024-09-12T01:02:52.643400+0000","last_became_active":"2024-09-12T00:15:55.027001+0000","last_became_peered":"2024-09-12T00:15:55.027001+0000","last_unstale":"2024-09-12T01:02:52.643400+0000","last_undegraded":"2024-09-12T01:02:52.643400+0000","last_fullsized":"2024-09-12T01:02:52.643400+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:02:52.642900+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:02:52.642900+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.642900+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:21.246963+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7614964,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":429,"num_read_kb":53256,"num_write":866,"num_write_kb":32142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1471,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.204787+0000","last_change":"2024-09-12T01:03:03.204641+0000","last_active":"2024-09-12T01:03:03.204787+0000","last_peered":"2024-09-12T01:03:03.204787+0000","last_clean":"2024-09-12T01:03:03.204787+0000","last_became_active":"2024-09-12T00:15:59.035380+0000","last_became_peered":"2024-09-12T00:15:59.035380+0000","last_unstale":"2024-09-12T01:03:03.204787+0000","last_undegraded":"2024-09-12T01:03:03.204787+0000","last_fullsized":"2024-09-12T01:03:03.204787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:03:03.204443+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:03:03.204443+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.204443+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:11.470633+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":957,"num_read_kb":957,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"268'85","reported_seq":610,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.231535+0000","last_change":"2024-09-12T01:03:06.231381+0000","last_active":"2024-09-12T01:03:06.231535+0000","last_peered":"2024-09-12T01:03:06.231535+0000","last_clean":"2024-09-12T01:03:06.231535+0000","last_became_active":"2024-09-12T00:16:01.065038+0000","last_became_peered":"2024-09-12T00:16:01.065038+0000","last_unstale":"2024-09-12T01:03:06.231535+0000","last_undegraded":"2024-09-12T01:03:06.231535+0000","last_fullsized":"2024-09-12T01:03:06.231535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'85","last_scrub_stamp":"2024-09-12T01:03:06.231109+0000","last_deep_scrub":"268'85","last_deep_scrub_stamp":"2024-09-12T01:03:06.231109+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.231109+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:56.855213+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"268'798","reported_seq":2374,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.300957+0000","last_change":"2024-09-12T01:03:08.300708+0000","last_active":"2024-09-12T01:03:08.300957+0000","last_peered":"2024-09-12T01:03:08.300957+0000","last_clean":"2024-09-12T01:03:08.300957+0000","last_became_active":"2024-09-12T00:16:03.088856+0000","last_became_peered":"2024-09-12T00:16:03.088856+0000","last_unstale":"2024-09-12T01:03:08.300957+0000","last_undegraded":"2024-09-12T01:03:08.300957+0000","last_fullsized":"2024-09-12T01:03:08.300957+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'798","last_scrub_stamp":"2024-09-12T01:03:08.300494+0000","last_deep_scrub":"268'798","last_deep_scrub_stamp":"2024-09-12T01:03:08.300494+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.300494+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:31.004109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"268'127","reported_seq":643,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.575118+0000","last_change":"2024-09-12T01:03:10.575118+0000","last_active":"2024-09-12T01:03:10.575118+0000","last_peered":"2024-09-12T01:03:10.575118+0000","last_clean":"2024-09-12T01:03:10.575118+0000","last_became_active":"2024-09-12T00:16:05.107712+0000","last_became_peered":"2024-09-12T00:16:05.107712+0000","last_unstale":"2024-09-12T01:03:10.575118+0000","last_undegraded":"2024-09-12T01:03:10.575118+0000","last_fullsized":"2024-09-12T01:03:10.575118+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-09-12T01:03:10.574900+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-09-12T01:03:10.574900+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.574900+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:18.976742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":150,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"268'859","reported_seq":2484,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.716496+0000","last_change":"2024-09-12T01:02:50.716343+0000","last_active":"2024-09-12T01:02:50.716496+0000","last_peered":"2024-09-12T01:02:50.716496+0000","last_clean":"2024-09-12T01:02:50.716496+0000","last_became_active":"2024-09-12T00:15:57.043447+0000","last_became_peered":"2024-09-12T00:15:57.043447+0000","last_unstale":"2024-09-12T01:02:50.716496+0000","last_undegraded":"2024-09-12T01:02:50.716496+0000","last_fullsized":"2024-09-12T01:02:50.716496+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'859","last_scrub_stamp":"2024-09-12T01:02:50.716156+0000","last_deep_scrub":"268'859","last_deep_scrub_stamp":"2024-09-12T01:02:50.716156+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.716156+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:50.072424+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4138,"num_read_kb":3738,"num_write":1141,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2781,"num_omap_keys":11,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"268'317","reported_seq":966,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.303400+0000","last_change":"2024-09-12T01:02:49.303242+0000","last_active":"2024-09-12T01:02:49.303400+0000","last_peered":"2024-09-12T01:02:49.303400+0000","last_clean":"2024-09-12T01:02:49.303400+0000","last_became_active":"2024-09-12T00:15:55.039512+0000","last_became_peered":"2024-09-12T00:15:55.039512+0000","last_unstale":"2024-09-12T01:02:49.303400+0000","last_undegraded":"2024-09-12T01:02:49.303400+0000","last_fullsized":"2024-09-12T01:02:49.303400+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'317","last_scrub_stamp":"2024-09-12T01:02:49.302955+0000","last_deep_scrub":"268'317","last_deep_scrub_stamp":"2024-09-12T01:02:49.302955+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.302955+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:28.690417+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655867,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":425,"num_read_kb":56944,"num_write":985,"num_write_kb":41414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.587414+0000","last_change":"2024-09-12T01:03:12.587270+0000","last_active":"2024-09-12T01:03:12.587414+0000","last_peered":"2024-09-12T01:03:12.587414+0000","last_clean":"2024-09-12T01:03:12.587414+0000","last_became_active":"2024-09-12T00:15:59.046018+0000","last_became_peered":"2024-09-12T00:15:59.046018+0000","last_unstale":"2024-09-12T01:03:12.587414+0000","last_undegraded":"2024-09-12T01:03:12.587414+0000","last_fullsized":"2024-09-12T01:03:12.587414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:12.587065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:12.587065+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.587065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:50.322069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"268'340","reported_seq":958,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.165014+0000","last_change":"2024-09-12T01:03:02.164857+0000","last_active":"2024-09-12T01:03:02.165014+0000","last_peered":"2024-09-12T01:03:02.165014+0000","last_clean":"2024-09-12T01:03:02.165014+0000","last_became_active":"2024-09-12T00:16:01.069078+0000","last_became_peered":"2024-09-12T00:16:01.069078+0000","last_unstale":"2024-09-12T01:03:02.165014+0000","last_undegraded":"2024-09-12T01:03:02.165014+0000","last_fullsized":"2024-09-12T01:03:02.165014+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'340","last_scrub_stamp":"2024-09-12T01:03:02.164644+0000","last_deep_scrub":"268'340","last_deep_scrub_stamp":"2024-09-12T01:03:02.164644+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.164644+0000","objects_scrubbed":8,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:23.713601+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46997,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":1097,"num_write":420,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.527950+0000","last_change":"2024-09-12T01:03:05.527830+0000","last_active":"2024-09-12T01:03:05.527950+0000","last_peered":"2024-09-12T01:03:05.527950+0000","last_clean":"2024-09-12T01:03:05.527950+0000","last_became_active":"2024-09-12T00:16:03.106662+0000","last_became_peered":"2024-09-12T00:16:03.106662+0000","last_unstale":"2024-09-12T01:03:05.527950+0000","last_undegraded":"2024-09-12T01:03:05.527950+0000","last_fullsized":"2024-09-12T01:03:05.527950+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:05.527635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:05.527635+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.527635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:41.284662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"268'137","reported_seq":636,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.939466+0000","last_change":"2024-09-12T01:03:09.939466+0000","last_active":"2024-09-12T01:03:09.939466+0000","last_peered":"2024-09-12T01:03:09.939466+0000","last_clean":"2024-09-12T01:03:09.939466+0000","last_became_active":"2024-09-12T00:16:05.111705+0000","last_became_peered":"2024-09-12T00:16:05.111705+0000","last_unstale":"2024-09-12T01:03:09.939466+0000","last_undegraded":"2024-09-12T01:03:09.939466+0000","last_fullsized":"2024-09-12T01:03:09.939466+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'137","last_scrub_stamp":"2024-09-12T01:03:09.939285+0000","last_deep_scrub":"268'137","last_deep_scrub_stamp":"2024-09-12T01:03:09.939285+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.939285+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:38.978042+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":316,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"268'515","reported_seq":2104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.567033+0000","last_change":"2024-09-12T01:03:00.567033+0000","last_active":"2024-09-12T01:03:00.567033+0000","last_peered":"2024-09-12T01:03:00.567033+0000","last_clean":"2024-09-12T01:03:00.567033+0000","last_became_active":"2024-09-12T00:15:57.029211+0000","last_became_peered":"2024-09-12T00:15:57.029211+0000","last_unstale":"2024-09-12T01:03:00.567033+0000","last_undegraded":"2024-09-12T01:03:00.567033+0000","last_fullsized":"2024-09-12T01:03:00.567033+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'515","last_scrub_stamp":"2024-09-12T01:03:00.566844+0000","last_deep_scrub":"268'515","last_deep_scrub_stamp":"2024-09-12T01:03:00.566844+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.566844+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:35.368781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2638,"num_read_kb":2449,"num_write":617,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":633,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:45.219135+0000","last_change":"2024-09-12T01:02:45.219078+0000","last_active":"2024-09-12T01:02:45.219135+0000","last_peered":"2024-09-12T01:02:45.219135+0000","last_clean":"2024-09-12T01:02:45.219135+0000","last_became_active":"2024-09-12T00:15:34.145413+0000","last_became_peered":"2024-09-12T00:15:34.145413+0000","last_unstale":"2024-09-12T01:02:45.219135+0000","last_undegraded":"2024-09-12T01:02:45.219135+0000","last_fullsized":"2024-09-12T01:02:45.219135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-12T01:02:45.219010+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-12T01:02:45.219010+0000","last_clean_scrub_stamp":"2024-09-12T01:02:45.219010+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:41.967660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":544,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.680071+0000","last_change":"2024-09-12T01:02:46.679981+0000","last_active":"2024-09-12T01:02:46.680071+0000","last_peered":"2024-09-12T01:02:46.680071+0000","last_clean":"2024-09-12T01:02:46.680071+0000","last_became_active":"2024-09-12T00:15:40.490486+0000","last_became_peered":"2024-09-12T00:15:40.490486+0000","last_unstale":"2024-09-12T01:02:46.680071+0000","last_undegraded":"2024-09-12T01:02:46.680071+0000","last_fullsized":"2024-09-12T01:02:46.680071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:02:46.679880+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:02:46.679880+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.679880+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:23.630978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013201490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"268'332","reported_seq":1016,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.269848+0000","last_change":"2024-09-12T01:02:48.269848+0000","last_active":"2024-09-12T01:02:48.269848+0000","last_peered":"2024-09-12T01:02:48.269848+0000","last_clean":"2024-09-12T01:02:48.269848+0000","last_became_active":"2024-09-12T00:15:55.048230+0000","last_became_peered":"2024-09-12T00:15:55.048230+0000","last_unstale":"2024-09-12T01:02:48.269848+0000","last_undegraded":"2024-09-12T01:02:48.269848+0000","last_fullsized":"2024-09-12T01:02:48.269848+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'332","last_scrub_stamp":"2024-09-12T01:02:48.269620+0000","last_deep_scrub":"268'332","last_deep_scrub_stamp":"2024-09-12T01:02:48.269620+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.269620+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:21.536299+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":550,"num_read_kb":9775,"num_write":1119,"num_write_kb":32871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.587085+0000","last_change":"2024-09-12T01:03:03.587085+0000","last_active":"2024-09-12T01:03:03.587085+0000","last_peered":"2024-09-12T01:03:03.587085+0000","last_clean":"2024-09-12T01:03:03.587085+0000","last_became_active":"2024-09-12T00:15:59.041357+0000","last_became_peered":"2024-09-12T00:15:59.041357+0000","last_unstale":"2024-09-12T01:03:03.587085+0000","last_undegraded":"2024-09-12T01:03:03.587085+0000","last_fullsized":"2024-09-12T01:03:03.587085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:03.586925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:03.586925+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.586925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:02.037337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"268'732","reported_seq":1457,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.633939+0000","last_change":"2024-09-12T01:03:20.633798+0000","last_active":"2024-09-12T01:03:20.633939+0000","last_peered":"2024-09-12T01:03:20.633939+0000","last_clean":"2024-09-12T01:03:20.633939+0000","last_became_active":"2024-09-12T00:16:01.052016+0000","last_became_peered":"2024-09-12T00:16:01.052016+0000","last_unstale":"2024-09-12T01:03:20.633939+0000","last_undegraded":"2024-09-12T01:03:20.633939+0000","last_fullsized":"2024-09-12T01:03:20.633939+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'732","last_scrub_stamp":"2024-09-12T01:03:20.633604+0000","last_deep_scrub":"268'732","last_deep_scrub_stamp":"2024-09-12T01:03:20.633604+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.633604+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:43.763989+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164258,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1426,"num_read_kb":3353,"num_write":1318,"num_write_kb":1186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89358,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.542586+0000","last_change":"2024-09-12T01:03:16.542440+0000","last_active":"2024-09-12T01:03:16.542586+0000","last_peered":"2024-09-12T01:03:16.542586+0000","last_clean":"2024-09-12T01:03:16.542586+0000","last_became_active":"2024-09-12T00:16:03.097343+0000","last_became_peered":"2024-09-12T00:16:03.097343+0000","last_unstale":"2024-09-12T01:03:16.542586+0000","last_undegraded":"2024-09-12T01:03:16.542586+0000","last_fullsized":"2024-09-12T01:03:16.542586+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:16.542262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:16.542262+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.542262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:38.878863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"268'175","reported_seq":883,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.574819+0000","last_change":"2024-09-12T01:03:07.574673+0000","last_active":"2024-09-12T01:03:07.574819+0000","last_peered":"2024-09-12T01:03:07.574819+0000","last_clean":"2024-09-12T01:03:07.574819+0000","last_became_active":"2024-09-12T00:16:05.113366+0000","last_became_peered":"2024-09-12T00:16:05.113366+0000","last_unstale":"2024-09-12T01:03:07.574819+0000","last_undegraded":"2024-09-12T01:03:07.574819+0000","last_fullsized":"2024-09-12T01:03:07.574819+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'175","last_scrub_stamp":"2024-09-12T01:03:07.574482+0000","last_deep_scrub":"268'175","last_deep_scrub_stamp":"2024-09-12T01:03:07.574482+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.574482+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:52.409139+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1020,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":408,"num_write":348,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"268'1046","reported_seq":2802,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.449275+0000","last_change":"2024-09-12T01:03:00.449118+0000","last_active":"2024-09-12T01:03:00.449275+0000","last_peered":"2024-09-12T01:03:00.449275+0000","last_clean":"2024-09-12T01:03:00.449275+0000","last_became_active":"2024-09-12T00:15:57.047672+0000","last_became_peered":"2024-09-12T00:15:57.047672+0000","last_unstale":"2024-09-12T01:03:00.449275+0000","last_undegraded":"2024-09-12T01:03:00.449275+0000","last_fullsized":"2024-09-12T01:03:00.449275+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1046","last_scrub_stamp":"2024-09-12T01:03:00.448926+0000","last_deep_scrub":"268'1046","last_deep_scrub_stamp":"2024-09-12T01:03:00.448926+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.448926+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":1000,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:49.266149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5053,"num_read_kb":4502,"num_write":1469,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":542,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.723987+0000","last_change":"2024-09-12T01:02:47.723987+0000","last_active":"2024-09-12T01:02:47.723987+0000","last_peered":"2024-09-12T01:02:47.723987+0000","last_clean":"2024-09-12T01:02:47.723987+0000","last_became_active":"2024-09-12T00:15:40.098303+0000","last_became_peered":"2024-09-12T00:15:40.098303+0000","last_unstale":"2024-09-12T01:02:47.723987+0000","last_undegraded":"2024-09-12T01:02:47.723987+0000","last_fullsized":"2024-09-12T01:02:47.723987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:47.723827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:47.723827+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.723827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:34.869689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0017858660000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"268'328","reported_seq":989,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.047495+0000","last_change":"2024-09-12T01:02:47.047495+0000","last_active":"2024-09-12T01:02:47.047495+0000","last_peered":"2024-09-12T01:02:47.047495+0000","last_clean":"2024-09-12T01:02:47.047495+0000","last_became_active":"2024-09-12T00:15:55.050874+0000","last_became_peered":"2024-09-12T00:15:55.050874+0000","last_unstale":"2024-09-12T01:02:47.047495+0000","last_undegraded":"2024-09-12T01:02:47.047495+0000","last_fullsized":"2024-09-12T01:02:47.047495+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'328","last_scrub_stamp":"2024-09-12T01:02:47.047228+0000","last_deep_scrub":"268'328","last_deep_scrub_stamp":"2024-09-12T01:02:47.047228+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.047228+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:26.163227+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2684897,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":131172,"num_write":1059,"num_write_kb":57813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.575314+0000","last_change":"2024-09-12T01:03:14.575165+0000","last_active":"2024-09-12T01:03:14.575314+0000","last_peered":"2024-09-12T01:03:14.575314+0000","last_clean":"2024-09-12T01:03:14.575314+0000","last_became_active":"2024-09-12T00:15:59.030858+0000","last_became_peered":"2024-09-12T00:15:59.030858+0000","last_unstale":"2024-09-12T01:03:14.575314+0000","last_undegraded":"2024-09-12T01:03:14.575314+0000","last_fullsized":"2024-09-12T01:03:14.575314+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:14.574985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:14.574985+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.574985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:22.049180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"268'1320","reported_seq":2830,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.853324+0000","last_change":"2024-09-12T01:03:02.853324+0000","last_active":"2024-09-12T01:03:02.853324+0000","last_peered":"2024-09-12T01:03:02.853324+0000","last_clean":"2024-09-12T01:03:02.853324+0000","last_became_active":"2024-09-12T00:16:01.057956+0000","last_became_peered":"2024-09-12T00:16:01.057956+0000","last_unstale":"2024-09-12T01:03:02.853324+0000","last_undegraded":"2024-09-12T01:03:02.853324+0000","last_fullsized":"2024-09-12T01:03:02.853324+0000","mapping_epoch":32,"log_start":"268'1300","ondisk_log_start":"268'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1320","last_scrub_stamp":"2024-09-12T01:03:02.853122+0000","last_deep_scrub":"268'1320","last_deep_scrub_stamp":"2024-09-12T01:03:02.853122+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.853122+0000","objects_scrubbed":12,"log_size":20,"log_dups_size":1300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:44.062604+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158341,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2071,"num_read_kb":3936,"num_write":1172,"num_write_kb":1006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.559225+0000","last_change":"2024-09-12T01:03:23.559225+0000","last_active":"2024-09-12T01:03:23.559225+0000","last_peered":"2024-09-12T01:03:23.559225+0000","last_clean":"2024-09-12T01:03:23.559225+0000","last_became_active":"2024-09-12T00:16:03.104040+0000","last_became_peered":"2024-09-12T00:16:03.104040+0000","last_unstale":"2024-09-12T01:03:23.559225+0000","last_undegraded":"2024-09-12T01:03:23.559225+0000","last_fullsized":"2024-09-12T01:03:23.559225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:23.559011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:23.559011+0000","last_clean_scrub_stamp":"2024-09-12T01:03:23.559011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:45.337736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"268'223","reported_seq":757,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.641357+0000","last_change":"2024-09-12T01:03:20.641357+0000","last_active":"2024-09-12T01:03:20.641357+0000","last_peered":"2024-09-12T01:03:20.641357+0000","last_clean":"2024-09-12T01:03:20.641357+0000","last_became_active":"2024-09-12T00:16:05.099987+0000","last_became_peered":"2024-09-12T00:16:05.099987+0000","last_unstale":"2024-09-12T01:03:20.641357+0000","last_undegraded":"2024-09-12T01:03:20.641357+0000","last_fullsized":"2024-09-12T01:03:20.641357+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'223","last_scrub_stamp":"2024-09-12T01:03:20.641126+0000","last_deep_scrub":"268'223","last_deep_scrub_stamp":"2024-09-12T01:03:20.641126+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.641126+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:03.375193+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":366,"num_read_kb":355,"num_write":494,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"268'397","reported_seq":1899,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.050123+0000","last_change":"2024-09-12T01:02:56.049982+0000","last_active":"2024-09-12T01:02:56.050123+0000","last_peered":"2024-09-12T01:02:56.050123+0000","last_clean":"2024-09-12T01:02:56.050123+0000","last_became_active":"2024-09-12T00:15:57.022193+0000","last_became_peered":"2024-09-12T00:15:57.022193+0000","last_unstale":"2024-09-12T01:02:56.050123+0000","last_undegraded":"2024-09-12T01:02:56.050123+0000","last_fullsized":"2024-09-12T01:02:56.050123+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'397","last_scrub_stamp":"2024-09-12T01:02:56.049789+0000","last_deep_scrub":"268'397","last_deep_scrub_stamp":"2024-09-12T01:02:56.049789+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.049789+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.648345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2164,"num_read_kb":2061,"num_write":440,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1009,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.684987+0000","last_change":"2024-09-12T01:02:47.684705+0000","last_active":"2024-09-12T01:02:47.684987+0000","last_peered":"2024-09-12T01:02:47.684987+0000","last_clean":"2024-09-12T01:02:47.684987+0000","last_became_active":"2024-09-12T00:15:40.095888+0000","last_became_peered":"2024-09-12T00:15:40.095888+0000","last_unstale":"2024-09-12T01:02:47.684987+0000","last_undegraded":"2024-09-12T01:02:47.684987+0000","last_fullsized":"2024-09-12T01:02:47.684987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:47.684478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:47.684478+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.684478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:12.159645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000883303,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"268'366","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.311262+0000","last_change":"2024-09-12T01:02:47.311262+0000","last_active":"2024-09-12T01:02:47.311262+0000","last_peered":"2024-09-12T01:02:47.311262+0000","last_clean":"2024-09-12T01:02:47.311262+0000","last_became_active":"2024-09-12T00:15:55.043174+0000","last_became_peered":"2024-09-12T00:15:55.043174+0000","last_unstale":"2024-09-12T01:02:47.311262+0000","last_undegraded":"2024-09-12T01:02:47.311262+0000","last_fullsized":"2024-09-12T01:02:47.311262+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'366","last_scrub_stamp":"2024-09-12T01:02:47.311008+0000","last_deep_scrub":"268'366","last_deep_scrub_stamp":"2024-09-12T01:02:47.311008+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.311008+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.727357+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":498,"num_read_kb":17440,"num_write":1129,"num_write_kb":28417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.787225+0000","last_change":"2024-09-12T01:02:59.786958+0000","last_active":"2024-09-12T01:02:59.787225+0000","last_peered":"2024-09-12T01:02:59.787225+0000","last_clean":"2024-09-12T01:02:59.787225+0000","last_became_active":"2024-09-12T00:15:59.033660+0000","last_became_peered":"2024-09-12T00:15:59.033660+0000","last_unstale":"2024-09-12T01:02:59.787225+0000","last_undegraded":"2024-09-12T01:02:59.787225+0000","last_fullsized":"2024-09-12T01:02:59.787225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:02:59.786685+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:02:59.786685+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.786685+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:29.273758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"268'260","reported_seq":1373,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.587816+0000","last_change":"2024-09-12T01:03:02.587816+0000","last_active":"2024-09-12T01:03:02.587816+0000","last_peered":"2024-09-12T01:03:02.587816+0000","last_clean":"2024-09-12T01:03:02.587816+0000","last_became_active":"2024-09-12T00:16:01.072168+0000","last_became_peered":"2024-09-12T00:16:01.072168+0000","last_unstale":"2024-09-12T01:03:02.587816+0000","last_undegraded":"2024-09-12T01:03:02.587816+0000","last_fullsized":"2024-09-12T01:03:02.587816+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'260","last_scrub_stamp":"2024-09-12T01:03:02.587570+0000","last_deep_scrub":"268'260","last_deep_scrub_stamp":"2024-09-12T01:03:02.587570+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.587570+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:58.907887+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.355434+0000","last_change":"2024-09-12T01:03:17.355434+0000","last_active":"2024-09-12T01:03:17.355434+0000","last_peered":"2024-09-12T01:03:17.355434+0000","last_clean":"2024-09-12T01:03:17.355434+0000","last_became_active":"2024-09-12T00:16:03.086646+0000","last_became_peered":"2024-09-12T00:16:03.086646+0000","last_unstale":"2024-09-12T01:03:17.355434+0000","last_undegraded":"2024-09-12T01:03:17.355434+0000","last_fullsized":"2024-09-12T01:03:17.355434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:17.355239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:17.355239+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.355239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:34.338519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"268'263","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.308774+0000","last_change":"2024-09-12T01:03:21.308615+0000","last_active":"2024-09-12T01:03:21.308774+0000","last_peered":"2024-09-12T01:03:21.308774+0000","last_clean":"2024-09-12T01:03:21.308774+0000","last_became_active":"2024-09-12T00:16:05.094684+0000","last_became_peered":"2024-09-12T00:16:05.094684+0000","last_unstale":"2024-09-12T01:03:21.308774+0000","last_undegraded":"2024-09-12T01:03:21.308774+0000","last_fullsized":"2024-09-12T01:03:21.308774+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'263","last_scrub_stamp":"2024-09-12T01:03:21.308439+0000","last_deep_scrub":"268'263","last_deep_scrub_stamp":"2024-09-12T01:03:21.308439+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.308439+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:00.925946+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":550,"num_read_kb":556,"num_write":574,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"268'874","reported_seq":2479,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.005503+0000","last_change":"2024-09-12T01:02:57.005503+0000","last_active":"2024-09-12T01:02:57.005503+0000","last_peered":"2024-09-12T01:02:57.005503+0000","last_clean":"2024-09-12T01:02:57.005503+0000","last_became_active":"2024-09-12T00:15:57.049533+0000","last_became_peered":"2024-09-12T00:15:57.049533+0000","last_unstale":"2024-09-12T01:02:57.005503+0000","last_undegraded":"2024-09-12T01:02:57.005503+0000","last_fullsized":"2024-09-12T01:02:57.005503+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'874","last_scrub_stamp":"2024-09-12T01:02:57.005246+0000","last_deep_scrub":"268'874","last_deep_scrub_stamp":"2024-09-12T01:02:57.005246+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.005246+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:59.310768+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4105,"num_read_kb":3691,"num_write":1162,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":545,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:45.698415+0000","last_change":"2024-09-12T01:02:45.698348+0000","last_active":"2024-09-12T01:02:45.698415+0000","last_peered":"2024-09-12T01:02:45.698415+0000","last_clean":"2024-09-12T01:02:45.698415+0000","last_became_active":"2024-09-12T00:15:40.144614+0000","last_became_peered":"2024-09-12T00:15:40.144614+0000","last_unstale":"2024-09-12T01:02:45.698415+0000","last_undegraded":"2024-09-12T01:02:45.698415+0000","last_fullsized":"2024-09-12T01:02:45.698415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:02:45.698281+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:02:45.698281+0000","last_clean_scrub_stamp":"2024-09-12T01:02:45.698281+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:37.018108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0019634679999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"268'351","reported_seq":1058,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:45.560698+0000","last_change":"2024-09-12T01:02:45.560698+0000","last_active":"2024-09-12T01:02:45.560698+0000","last_peered":"2024-09-12T01:02:45.560698+0000","last_clean":"2024-09-12T01:02:45.560698+0000","last_became_active":"2024-09-12T00:15:55.060303+0000","last_became_peered":"2024-09-12T00:15:55.060303+0000","last_unstale":"2024-09-12T01:02:45.560698+0000","last_undegraded":"2024-09-12T01:02:45.560698+0000","last_fullsized":"2024-09-12T01:02:45.560698+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'351","last_scrub_stamp":"2024-09-12T01:02:45.560574+0000","last_deep_scrub":"268'351","last_deep_scrub_stamp":"2024-09-12T01:02:45.560574+0000","last_clean_scrub_stamp":"2024-09-12T01:02:45.560574+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:31.985568+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262201,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":640,"num_read_kb":10990,"num_write":1328,"num_write_kb":39626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.777064+0000","last_change":"2024-09-12T01:02:57.777064+0000","last_active":"2024-09-12T01:02:57.777064+0000","last_peered":"2024-09-12T01:02:57.777064+0000","last_clean":"2024-09-12T01:02:57.777064+0000","last_became_active":"2024-09-12T00:15:59.042545+0000","last_became_peered":"2024-09-12T00:15:59.042545+0000","last_unstale":"2024-09-12T01:02:57.777064+0000","last_undegraded":"2024-09-12T01:02:57.777064+0000","last_fullsized":"2024-09-12T01:02:57.777064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:57.776886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:57.776886+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.776886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:31.335494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"268'147","reported_seq":694,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.524008+0000","last_change":"2024-09-12T01:03:12.523810+0000","last_active":"2024-09-12T01:03:12.524008+0000","last_peered":"2024-09-12T01:03:12.524008+0000","last_clean":"2024-09-12T01:03:12.524008+0000","last_became_active":"2024-09-12T00:16:01.047278+0000","last_became_peered":"2024-09-12T00:16:01.047278+0000","last_unstale":"2024-09-12T01:03:12.524008+0000","last_undegraded":"2024-09-12T01:03:12.524008+0000","last_fullsized":"2024-09-12T01:03:12.524008+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'147","last_scrub_stamp":"2024-09-12T01:03:12.523474+0000","last_deep_scrub":"268'147","last_deep_scrub_stamp":"2024-09-12T01:03:12.523474+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.523474+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:43.617120+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":143,"num_write":118,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.580190+0000","last_change":"2024-09-12T01:03:26.580031+0000","last_active":"2024-09-12T01:03:26.580190+0000","last_peered":"2024-09-12T01:03:26.580190+0000","last_clean":"2024-09-12T01:03:26.580190+0000","last_became_active":"2024-09-12T00:16:03.097029+0000","last_became_peered":"2024-09-12T00:16:03.097029+0000","last_unstale":"2024-09-12T01:03:26.580190+0000","last_undegraded":"2024-09-12T01:03:26.580190+0000","last_fullsized":"2024-09-12T01:03:26.580190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:26.579853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:26.579853+0000","last_clean_scrub_stamp":"2024-09-12T01:03:26.579853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:20.359345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"268'158","reported_seq":742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.301982+0000","last_change":"2024-09-12T01:03:14.301829+0000","last_active":"2024-09-12T01:03:14.301982+0000","last_peered":"2024-09-12T01:03:14.301982+0000","last_clean":"2024-09-12T01:03:14.301982+0000","last_became_active":"2024-09-12T00:16:05.111534+0000","last_became_peered":"2024-09-12T00:16:05.111534+0000","last_unstale":"2024-09-12T01:03:14.301982+0000","last_undegraded":"2024-09-12T01:03:14.301982+0000","last_fullsized":"2024-09-12T01:03:14.301982+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'158","last_scrub_stamp":"2024-09-12T01:03:14.301639+0000","last_deep_scrub":"268'158","last_deep_scrub_stamp":"2024-09-12T01:03:14.301639+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.301639+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:43.779965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":344,"num_read_kb":315,"num_write":411,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"268'449","reported_seq":1941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.027532+0000","last_change":"2024-09-12T01:02:54.027532+0000","last_active":"2024-09-12T01:02:54.027532+0000","last_peered":"2024-09-12T01:02:54.027532+0000","last_clean":"2024-09-12T01:02:54.027532+0000","last_became_active":"2024-09-12T00:15:57.023909+0000","last_became_peered":"2024-09-12T00:15:57.023909+0000","last_unstale":"2024-09-12T01:02:54.027532+0000","last_undegraded":"2024-09-12T01:02:54.027532+0000","last_fullsized":"2024-09-12T01:02:54.027532+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'449","last_scrub_stamp":"2024-09-12T01:02:54.027335+0000","last_deep_scrub":"268'449","last_deep_scrub_stamp":"2024-09-12T01:02:54.027335+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.027335+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:33.856984+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2256,"num_read_kb":2116,"num_write":511,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"268'339","reported_seq":990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.549338+0000","last_change":"2024-09-12T01:02:47.549338+0000","last_active":"2024-09-12T01:02:47.549338+0000","last_peered":"2024-09-12T01:02:47.549338+0000","last_clean":"2024-09-12T01:02:47.549338+0000","last_became_active":"2024-09-12T00:15:55.056576+0000","last_became_peered":"2024-09-12T00:15:55.056576+0000","last_unstale":"2024-09-12T01:02:47.549338+0000","last_undegraded":"2024-09-12T01:02:47.549338+0000","last_fullsized":"2024-09-12T01:02:47.549338+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:02:47.549107+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:02:47.549107+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.549107+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:06.125443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262186,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":507,"num_write":1203,"num_write_kb":27643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.352459+0000","last_change":"2024-09-12T01:02:46.352302+0000","last_active":"2024-09-12T01:02:46.352459+0000","last_peered":"2024-09-12T01:02:46.352459+0000","last_clean":"2024-09-12T01:02:46.352459+0000","last_became_active":"2024-09-12T00:15:40.141037+0000","last_became_peered":"2024-09-12T00:15:40.141037+0000","last_unstale":"2024-09-12T01:02:46.352459+0000","last_undegraded":"2024-09-12T01:02:46.352459+0000","last_fullsized":"2024-09-12T01:02:46.352459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:46.352119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:46.352119+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.352119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:08.133964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00088972300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.247303+0000","last_change":"2024-09-12T01:03:04.247303+0000","last_active":"2024-09-12T01:03:04.247303+0000","last_peered":"2024-09-12T01:03:04.247303+0000","last_clean":"2024-09-12T01:03:04.247303+0000","last_became_active":"2024-09-12T00:15:59.043935+0000","last_became_peered":"2024-09-12T00:15:59.043935+0000","last_unstale":"2024-09-12T01:03:04.247303+0000","last_undegraded":"2024-09-12T01:03:04.247303+0000","last_fullsized":"2024-09-12T01:03:04.247303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:04.247115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:04.247115+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.247115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:28.609481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"268'569","reported_seq":1251,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.861542+0000","last_change":"2024-09-12T01:03:01.861542+0000","last_active":"2024-09-12T01:03:01.861542+0000","last_peered":"2024-09-12T01:03:01.861542+0000","last_clean":"2024-09-12T01:03:01.861542+0000","last_became_active":"2024-09-12T00:16:01.051753+0000","last_became_peered":"2024-09-12T00:16:01.051753+0000","last_unstale":"2024-09-12T01:03:01.861542+0000","last_undegraded":"2024-09-12T01:03:01.861542+0000","last_fullsized":"2024-09-12T01:03:01.861542+0000","mapping_epoch":32,"log_start":"268'500","ondisk_log_start":"268'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'569","last_scrub_stamp":"2024-09-12T01:03:01.861331+0000","last_deep_scrub":"268'569","last_deep_scrub_stamp":"2024-09-12T01:03:01.861331+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.861331+0000","objects_scrubbed":11,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:48.337067+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93866,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1568,"num_read_kb":2666,"num_write":2048,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508024,"num_omap_keys":1152,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.555774+0000","last_change":"2024-09-12T01:03:02.555774+0000","last_active":"2024-09-12T01:03:02.555774+0000","last_peered":"2024-09-12T01:03:02.555774+0000","last_clean":"2024-09-12T01:03:02.555774+0000","last_became_active":"2024-09-12T00:16:03.099491+0000","last_became_peered":"2024-09-12T00:16:03.099491+0000","last_unstale":"2024-09-12T01:03:02.555774+0000","last_undegraded":"2024-09-12T01:03:02.555774+0000","last_fullsized":"2024-09-12T01:03:02.555774+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:02.555464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:02.555464+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.555464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:31.132662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"268'115","reported_seq":619,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.606620+0000","last_change":"2024-09-12T01:03:21.606441+0000","last_active":"2024-09-12T01:03:21.606620+0000","last_peered":"2024-09-12T01:03:21.606620+0000","last_clean":"2024-09-12T01:03:21.606620+0000","last_became_active":"2024-09-12T00:16:05.099975+0000","last_became_peered":"2024-09-12T00:16:05.099975+0000","last_unstale":"2024-09-12T01:03:21.606620+0000","last_undegraded":"2024-09-12T01:03:21.606620+0000","last_fullsized":"2024-09-12T01:03:21.606620+0000","mapping_epoch":36,"log_start":"268'101","ondisk_log_start":"268'101","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-12T01:03:21.606224+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-12T01:03:21.606224+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.606224+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":101,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:41.692200+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":90,"num_write":249,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"268'516","reported_seq":2250,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.037253+0000","last_change":"2024-09-12T01:02:55.037253+0000","last_active":"2024-09-12T01:02:55.037253+0000","last_peered":"2024-09-12T01:02:55.037253+0000","last_clean":"2024-09-12T01:02:55.037253+0000","last_became_active":"2024-09-12T00:15:57.019345+0000","last_became_peered":"2024-09-12T00:15:57.019345+0000","last_unstale":"2024-09-12T01:02:55.037253+0000","last_undegraded":"2024-09-12T01:02:55.037253+0000","last_fullsized":"2024-09-12T01:02:55.037253+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'516","last_scrub_stamp":"2024-09-12T01:02:55.037012+0000","last_deep_scrub":"268'516","last_deep_scrub_stamp":"2024-09-12T01:02:55.037012+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.037012+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:43.360929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2840,"num_read_kb":2674,"num_write":601,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2992,"num_omap_keys":12,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"268'351","reported_seq":996,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.075635+0000","last_change":"2024-09-12T01:02:48.075635+0000","last_active":"2024-09-12T01:02:48.075635+0000","last_peered":"2024-09-12T01:02:48.075635+0000","last_clean":"2024-09-12T01:02:48.075635+0000","last_became_active":"2024-09-12T00:15:55.064444+0000","last_became_peered":"2024-09-12T00:15:55.064444+0000","last_unstale":"2024-09-12T01:02:48.075635+0000","last_undegraded":"2024-09-12T01:02:48.075635+0000","last_fullsized":"2024-09-12T01:02:48.075635+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'351","last_scrub_stamp":"2024-09-12T01:02:48.075374+0000","last_deep_scrub":"268'351","last_deep_scrub_stamp":"2024-09-12T01:02:48.075374+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.075374+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:20.154477+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6340294,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":472,"num_read_kb":45788,"num_write":1017,"num_write_kb":51853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.583864+0000","last_change":"2024-09-12T01:02:57.583864+0000","last_active":"2024-09-12T01:02:57.583864+0000","last_peered":"2024-09-12T01:02:57.583864+0000","last_clean":"2024-09-12T01:02:57.583864+0000","last_became_active":"2024-09-12T00:15:40.093718+0000","last_became_peered":"2024-09-12T00:15:40.093718+0000","last_unstale":"2024-09-12T01:02:57.583864+0000","last_undegraded":"2024-09-12T01:02:57.583864+0000","last_fullsized":"2024-09-12T01:02:57.583864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:57.583651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:57.583651+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.583651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:24.058214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001992522,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.571338+0000","last_change":"2024-09-12T01:02:56.571338+0000","last_active":"2024-09-12T01:02:56.571338+0000","last_peered":"2024-09-12T01:02:56.571338+0000","last_clean":"2024-09-12T01:02:56.571338+0000","last_became_active":"2024-09-12T00:15:59.041390+0000","last_became_peered":"2024-09-12T00:15:59.041390+0000","last_unstale":"2024-09-12T01:02:56.571338+0000","last_undegraded":"2024-09-12T01:02:56.571338+0000","last_fullsized":"2024-09-12T01:02:56.571338+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:56.571111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:56.571111+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.571111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:00.193486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"268'163","reported_seq":737,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.191543+0000","last_change":"2024-09-12T01:03:05.191543+0000","last_active":"2024-09-12T01:03:05.191543+0000","last_peered":"2024-09-12T01:03:05.191543+0000","last_clean":"2024-09-12T01:03:05.191543+0000","last_became_active":"2024-09-12T00:16:01.050630+0000","last_became_peered":"2024-09-12T00:16:01.050630+0000","last_unstale":"2024-09-12T01:03:05.191543+0000","last_undegraded":"2024-09-12T01:03:05.191543+0000","last_fullsized":"2024-09-12T01:03:05.191543+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'163","last_scrub_stamp":"2024-09-12T01:03:05.191433+0000","last_deep_scrub":"268'163","last_deep_scrub_stamp":"2024-09-12T01:03:05.191433+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.191433+0000","objects_scrubbed":8,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:08.125461+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":205,"num_read_kb":196,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"268'798","reported_seq":2736,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.261963+0000","last_change":"2024-09-12T01:03:07.261963+0000","last_active":"2024-09-12T01:03:07.261963+0000","last_peered":"2024-09-12T01:03:07.261963+0000","last_clean":"2024-09-12T01:03:07.261963+0000","last_became_active":"2024-09-12T00:16:03.104125+0000","last_became_peered":"2024-09-12T00:16:03.104125+0000","last_unstale":"2024-09-12T01:03:07.261963+0000","last_undegraded":"2024-09-12T01:03:07.261963+0000","last_fullsized":"2024-09-12T01:03:07.261963+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'798","last_scrub_stamp":"2024-09-12T01:03:07.261772+0000","last_deep_scrub":"268'798","last_deep_scrub_stamp":"2024-09-12T01:03:07.261772+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.261772+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:32.205899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"268'118","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.940076+0000","last_change":"2024-09-12T01:03:11.939925+0000","last_active":"2024-09-12T01:03:11.940076+0000","last_peered":"2024-09-12T01:03:11.940076+0000","last_clean":"2024-09-12T01:03:11.940076+0000","last_became_active":"2024-09-12T00:16:05.114695+0000","last_became_peered":"2024-09-12T00:16:05.114695+0000","last_unstale":"2024-09-12T01:03:11.940076+0000","last_undegraded":"2024-09-12T01:03:11.940076+0000","last_fullsized":"2024-09-12T01:03:11.940076+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'118","last_scrub_stamp":"2024-09-12T01:03:11.939705+0000","last_deep_scrub":"268'118","last_deep_scrub_stamp":"2024-09-12T01:03:11.939705+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.939705+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:54.343129+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":134,"num_write":263,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"268'788","reported_seq":2361,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.186009+0000","last_change":"2024-09-12T01:02:55.186009+0000","last_active":"2024-09-12T01:02:55.186009+0000","last_peered":"2024-09-12T01:02:55.186009+0000","last_clean":"2024-09-12T01:02:55.186009+0000","last_became_active":"2024-09-12T00:15:57.027778+0000","last_became_peered":"2024-09-12T00:15:57.027778+0000","last_unstale":"2024-09-12T01:02:55.186009+0000","last_undegraded":"2024-09-12T01:02:55.186009+0000","last_fullsized":"2024-09-12T01:02:55.186009+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'788","last_scrub_stamp":"2024-09-12T01:02:55.185823+0000","last_deep_scrub":"268'788","last_deep_scrub_stamp":"2024-09-12T01:02:55.185823+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.185823+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:34.413708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3889,"num_read_kb":3532,"num_write":1033,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"268'413","reported_seq":1115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.220812+0000","last_change":"2024-09-12T01:02:47.220555+0000","last_active":"2024-09-12T01:02:47.220812+0000","last_peered":"2024-09-12T01:02:47.220812+0000","last_clean":"2024-09-12T01:02:47.220812+0000","last_became_active":"2024-09-12T00:15:55.048610+0000","last_became_peered":"2024-09-12T00:15:55.048610+0000","last_unstale":"2024-09-12T01:02:47.220812+0000","last_undegraded":"2024-09-12T01:02:47.220812+0000","last_fullsized":"2024-09-12T01:02:47.220812+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'413","last_scrub_stamp":"2024-09-12T01:02:47.220177+0000","last_deep_scrub":"268'413","last_deep_scrub_stamp":"2024-09-12T01:02:47.220177+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.220177+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:09.862325+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433395,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":696,"num_read_kb":32495,"num_write":1308,"num_write_kb":43441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.251879+0000","last_change":"2024-09-12T01:02:46.251707+0000","last_active":"2024-09-12T01:02:46.251879+0000","last_peered":"2024-09-12T01:02:46.251879+0000","last_clean":"2024-09-12T01:02:46.251879+0000","last_became_active":"2024-09-12T00:15:40.660718+0000","last_became_peered":"2024-09-12T00:15:40.660718+0000","last_unstale":"2024-09-12T01:02:46.251879+0000","last_undegraded":"2024-09-12T01:02:46.251879+0000","last_fullsized":"2024-09-12T01:02:46.251879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:46.251521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:46.251521+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.251521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:45.498343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080064100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"268'6","reported_seq":997,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.597770+0000","last_change":"2024-09-12T01:03:11.597770+0000","last_active":"2024-09-12T01:03:11.597770+0000","last_peered":"2024-09-12T01:03:11.597770+0000","last_clean":"2024-09-12T01:03:11.597770+0000","last_became_active":"2024-09-12T00:15:59.022598+0000","last_became_peered":"2024-09-12T00:15:59.022598+0000","last_unstale":"2024-09-12T01:03:11.597770+0000","last_undegraded":"2024-09-12T01:03:11.597770+0000","last_fullsized":"2024-09-12T01:03:11.597770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:03:11.597536+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:03:11.597536+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.597536+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:23.814626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"268'117","reported_seq":674,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.580915+0000","last_change":"2024-09-12T01:03:17.580915+0000","last_active":"2024-09-12T01:03:17.580915+0000","last_peered":"2024-09-12T01:03:17.580915+0000","last_clean":"2024-09-12T01:03:17.580915+0000","last_became_active":"2024-09-12T00:16:01.061378+0000","last_became_peered":"2024-09-12T00:16:01.061378+0000","last_unstale":"2024-09-12T01:03:17.580915+0000","last_undegraded":"2024-09-12T01:03:17.580915+0000","last_fullsized":"2024-09-12T01:03:17.580915+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'117","last_scrub_stamp":"2024-09-12T01:03:17.580694+0000","last_deep_scrub":"268'117","last_deep_scrub_stamp":"2024-09-12T01:03:17.580694+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.580694+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.530726+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":124,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"268'816","reported_seq":4454,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.478711+0000","last_change":"2024-09-12T01:03:13.478711+0000","last_active":"2024-09-12T01:03:13.478711+0000","last_peered":"2024-09-12T01:03:13.478711+0000","last_clean":"2024-09-12T01:03:13.478711+0000","last_became_active":"2024-09-12T00:16:03.097533+0000","last_became_peered":"2024-09-12T00:16:03.097533+0000","last_unstale":"2024-09-12T01:03:13.478711+0000","last_undegraded":"2024-09-12T01:03:13.478711+0000","last_fullsized":"2024-09-12T01:03:13.478711+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'816","last_scrub_stamp":"2024-09-12T01:03:13.478485+0000","last_deep_scrub":"268'816","last_deep_scrub_stamp":"2024-09-12T01:03:13.478485+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.478485+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:54.004043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"268'168","reported_seq":674,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.623147+0000","last_change":"2024-09-12T01:03:22.623147+0000","last_active":"2024-09-12T01:03:22.623147+0000","last_peered":"2024-09-12T01:03:22.623147+0000","last_clean":"2024-09-12T01:03:22.623147+0000","last_became_active":"2024-09-12T00:16:05.110012+0000","last_became_peered":"2024-09-12T00:16:05.110012+0000","last_unstale":"2024-09-12T01:03:22.623147+0000","last_undegraded":"2024-09-12T01:03:22.623147+0000","last_fullsized":"2024-09-12T01:03:22.623147+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'168","last_scrub_stamp":"2024-09-12T01:03:22.622954+0000","last_deep_scrub":"268'168","last_deep_scrub_stamp":"2024-09-12T01:03:22.622954+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.622954+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:28.531402+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":392,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"268'380","reported_seq":1840,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.497640+0000","last_change":"2024-09-12T01:02:46.497640+0000","last_active":"2024-09-12T01:02:46.497640+0000","last_peered":"2024-09-12T01:02:46.497640+0000","last_clean":"2024-09-12T01:02:46.497640+0000","last_became_active":"2024-09-12T00:15:57.024399+0000","last_became_peered":"2024-09-12T00:15:57.024399+0000","last_unstale":"2024-09-12T01:02:46.497640+0000","last_undegraded":"2024-09-12T01:02:46.497640+0000","last_fullsized":"2024-09-12T01:02:46.497640+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-12T01:02:46.497554+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-12T01:02:46.497554+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.497554+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:56.056557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2040,"num_read_kb":1940,"num_write":430,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"268'339","reported_seq":991,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.295768+0000","last_change":"2024-09-12T01:02:51.295542+0000","last_active":"2024-09-12T01:02:51.295768+0000","last_peered":"2024-09-12T01:02:51.295768+0000","last_clean":"2024-09-12T01:02:51.295768+0000","last_became_active":"2024-09-12T00:15:55.064782+0000","last_became_peered":"2024-09-12T00:15:55.064782+0000","last_unstale":"2024-09-12T01:02:51.295768+0000","last_undegraded":"2024-09-12T01:02:51.295768+0000","last_fullsized":"2024-09-12T01:02:51.295768+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:02:51.295109+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:02:51.295109+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.295109+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:28.870116+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2054932,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":492,"num_read_kb":4021,"num_write":1062,"num_write_kb":34802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.634503+0000","last_change":"2024-09-12T01:02:50.634341+0000","last_active":"2024-09-12T01:02:50.634503+0000","last_peered":"2024-09-12T01:02:50.634503+0000","last_clean":"2024-09-12T01:02:50.634503+0000","last_became_active":"2024-09-12T00:15:40.663617+0000","last_became_peered":"2024-09-12T00:15:40.663617+0000","last_unstale":"2024-09-12T01:02:50.634503+0000","last_undegraded":"2024-09-12T01:02:50.634503+0000","last_fullsized":"2024-09-12T01:02:50.634503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:50.634154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:50.634154+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.634154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:09.526825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002428801,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.197315+0000","last_change":"2024-09-12T01:03:03.197315+0000","last_active":"2024-09-12T01:03:03.197315+0000","last_peered":"2024-09-12T01:03:03.197315+0000","last_clean":"2024-09-12T01:03:03.197315+0000","last_became_active":"2024-09-12T00:15:59.039777+0000","last_became_peered":"2024-09-12T00:15:59.039777+0000","last_unstale":"2024-09-12T01:03:03.197315+0000","last_undegraded":"2024-09-12T01:03:03.197315+0000","last_fullsized":"2024-09-12T01:03:03.197315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:03.197128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:03.197128+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.197128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.560737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"268'757","reported_seq":1489,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.502826+0000","last_change":"2024-09-12T01:02:59.502826+0000","last_active":"2024-09-12T01:02:59.502826+0000","last_peered":"2024-09-12T01:02:59.502826+0000","last_clean":"2024-09-12T01:02:59.502826+0000","last_became_active":"2024-09-12T00:16:01.051967+0000","last_became_peered":"2024-09-12T00:16:01.051967+0000","last_unstale":"2024-09-12T01:02:59.502826+0000","last_undegraded":"2024-09-12T01:02:59.502826+0000","last_fullsized":"2024-09-12T01:02:59.502826+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'757","last_scrub_stamp":"2024-09-12T01:02:59.502579+0000","last_deep_scrub":"268'757","last_deep_scrub_stamp":"2024-09-12T01:02:59.502579+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.502579+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:00.575310+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138756,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1351,"num_read_kb":3224,"num_write":1110,"num_write_kb":922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.353870+0000","last_change":"2024-09-12T01:03:16.353870+0000","last_active":"2024-09-12T01:03:16.353870+0000","last_peered":"2024-09-12T01:03:16.353870+0000","last_clean":"2024-09-12T01:03:16.353870+0000","last_became_active":"2024-09-12T00:16:03.091920+0000","last_became_peered":"2024-09-12T00:16:03.091920+0000","last_unstale":"2024-09-12T01:03:16.353870+0000","last_undegraded":"2024-09-12T01:03:16.353870+0000","last_fullsized":"2024-09-12T01:03:16.353870+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:16.353684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:16.353684+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.353684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:25.336831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"268'141","reported_seq":674,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.561334+0000","last_change":"2024-09-12T01:03:12.561204+0000","last_active":"2024-09-12T01:03:12.561334+0000","last_peered":"2024-09-12T01:03:12.561334+0000","last_clean":"2024-09-12T01:03:12.561334+0000","last_became_active":"2024-09-12T00:16:05.112774+0000","last_became_peered":"2024-09-12T00:16:05.112774+0000","last_unstale":"2024-09-12T01:03:12.561334+0000","last_undegraded":"2024-09-12T01:03:12.561334+0000","last_fullsized":"2024-09-12T01:03:12.561334+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'141","last_scrub_stamp":"2024-09-12T01:03:12.561023+0000","last_deep_scrub":"268'141","last_deep_scrub_stamp":"2024-09-12T01:03:12.561023+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.561023+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:48.581308+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":230,"num_write":341,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"268'115","reported_seq":684,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.318860+0000","last_change":"2024-09-12T01:03:22.318860+0000","last_active":"2024-09-12T01:03:22.318860+0000","last_peered":"2024-09-12T01:03:22.318860+0000","last_clean":"2024-09-12T01:03:22.318860+0000","last_became_active":"2024-09-12T00:16:05.097548+0000","last_became_peered":"2024-09-12T00:16:05.097548+0000","last_unstale":"2024-09-12T01:03:22.318860+0000","last_undegraded":"2024-09-12T01:03:22.318860+0000","last_fullsized":"2024-09-12T01:03:22.318860+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-12T01:03:22.318681+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-12T01:03:22.318681+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.318681+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:22.176966+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":186,"num_read_kb":184,"num_write":255,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"268'855","reported_seq":2482,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.620835+0000","last_change":"2024-09-12T01:02:55.620835+0000","last_active":"2024-09-12T01:02:55.620835+0000","last_peered":"2024-09-12T01:02:55.620835+0000","last_clean":"2024-09-12T01:02:55.620835+0000","last_became_active":"2024-09-12T00:15:57.024237+0000","last_became_peered":"2024-09-12T00:15:57.024237+0000","last_unstale":"2024-09-12T01:02:55.620835+0000","last_undegraded":"2024-09-12T01:02:55.620835+0000","last_fullsized":"2024-09-12T01:02:55.620835+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'855","last_scrub_stamp":"2024-09-12T01:02:55.620655+0000","last_deep_scrub":"268'855","last_deep_scrub_stamp":"2024-09-12T01:02:55.620655+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.620655+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:41.671381+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4086,"num_read_kb":3684,"num_write":1101,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"268'295","reported_seq":945,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.550626+0000","last_change":"2024-09-12T01:02:56.550626+0000","last_active":"2024-09-12T01:02:56.550626+0000","last_peered":"2024-09-12T01:02:56.550626+0000","last_clean":"2024-09-12T01:02:56.550626+0000","last_became_active":"2024-09-12T00:16:26.420272+0000","last_became_peered":"2024-09-12T00:16:26.420272+0000","last_unstale":"2024-09-12T01:02:56.550626+0000","last_undegraded":"2024-09-12T01:02:56.550626+0000","last_fullsized":"2024-09-12T01:02:56.550626+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'295","last_scrub_stamp":"2024-09-12T01:02:56.550382+0000","last_deep_scrub":"268'295","last_deep_scrub_stamp":"2024-09-12T01:02:56.550382+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.550382+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:32.566018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213277,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":414,"num_read_kb":13074,"num_write":956,"num_write_kb":25707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,0],"acting":[3,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"268'4","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.145180+0000","last_change":"2024-09-12T01:03:03.145180+0000","last_active":"2024-09-12T01:03:03.145180+0000","last_peered":"2024-09-12T01:03:03.145180+0000","last_clean":"2024-09-12T01:03:03.145180+0000","last_became_active":"2024-09-12T00:15:59.039169+0000","last_became_peered":"2024-09-12T00:15:59.039169+0000","last_unstale":"2024-09-12T01:03:03.145180+0000","last_undegraded":"2024-09-12T01:03:03.145180+0000","last_fullsized":"2024-09-12T01:03:03.145180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:03:03.144984+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:03:03.144984+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.144984+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:54.544211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"268'291","reported_seq":877,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.230273+0000","last_change":"2024-09-12T01:03:09.230273+0000","last_active":"2024-09-12T01:03:09.230273+0000","last_peered":"2024-09-12T01:03:09.230273+0000","last_clean":"2024-09-12T01:03:09.230273+0000","last_became_active":"2024-09-12T00:16:01.066524+0000","last_became_peered":"2024-09-12T00:16:01.066524+0000","last_unstale":"2024-09-12T01:03:09.230273+0000","last_undegraded":"2024-09-12T01:03:09.230273+0000","last_fullsized":"2024-09-12T01:03:09.230273+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'291","last_scrub_stamp":"2024-09-12T01:03:09.230064+0000","last_deep_scrub":"268'291","last_deep_scrub_stamp":"2024-09-12T01:03:09.230064+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.230064+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:35.110694+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43678,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1068,"num_write":390,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.896686+0000","last_change":"2024-09-12T01:03:05.896686+0000","last_active":"2024-09-12T01:03:05.896686+0000","last_peered":"2024-09-12T01:03:05.896686+0000","last_clean":"2024-09-12T01:03:05.896686+0000","last_became_active":"2024-09-12T00:16:03.069399+0000","last_became_peered":"2024-09-12T00:16:03.069399+0000","last_unstale":"2024-09-12T01:03:05.896686+0000","last_undegraded":"2024-09-12T01:03:05.896686+0000","last_fullsized":"2024-09-12T01:03:05.896686+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:05.896501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:05.896501+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.896501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:45.361950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"268'132","reported_seq":631,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.923979+0000","last_change":"2024-09-12T01:03:12.923979+0000","last_active":"2024-09-12T01:03:12.923979+0000","last_peered":"2024-09-12T01:03:12.923979+0000","last_clean":"2024-09-12T01:03:12.923979+0000","last_became_active":"2024-09-12T00:16:05.102118+0000","last_became_peered":"2024-09-12T00:16:05.102118+0000","last_unstale":"2024-09-12T01:03:12.923979+0000","last_undegraded":"2024-09-12T01:03:12.923979+0000","last_fullsized":"2024-09-12T01:03:12.923979+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'132","last_scrub_stamp":"2024-09-12T01:03:12.923802+0000","last_deep_scrub":"268'132","last_deep_scrub_stamp":"2024-09-12T01:03:12.923802+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.923802+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:59.417375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":111,"num_write":330,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"268'498","reported_seq":2230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.226442+0000","last_change":"2024-09-12T01:02:53.226442+0000","last_active":"2024-09-12T01:02:53.226442+0000","last_peered":"2024-09-12T01:02:53.226442+0000","last_clean":"2024-09-12T01:02:53.226442+0000","last_became_active":"2024-09-12T00:15:57.031322+0000","last_became_peered":"2024-09-12T00:15:57.031322+0000","last_unstale":"2024-09-12T01:02:53.226442+0000","last_undegraded":"2024-09-12T01:02:53.226442+0000","last_fullsized":"2024-09-12T01:02:53.226442+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'498","last_scrub_stamp":"2024-09-12T01:02:53.226262+0000","last_deep_scrub":"268'498","last_deep_scrub_stamp":"2024-09-12T01:02:53.226262+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.226262+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:59.880724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2639,"num_write":567,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"268'457","reported_seq":1173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.555317+0000","last_change":"2024-09-12T01:02:46.555317+0000","last_active":"2024-09-12T01:02:46.555317+0000","last_peered":"2024-09-12T01:02:46.555317+0000","last_clean":"2024-09-12T01:02:46.555317+0000","last_became_active":"2024-09-12T00:15:55.065964+0000","last_became_peered":"2024-09-12T00:15:55.065964+0000","last_unstale":"2024-09-12T01:02:46.555317+0000","last_undegraded":"2024-09-12T01:02:46.555317+0000","last_fullsized":"2024-09-12T01:02:46.555317+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'457","last_scrub_stamp":"2024-09-12T01:02:46.555204+0000","last_deep_scrub":"268'457","last_deep_scrub_stamp":"2024-09-12T01:02:46.555204+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.555204+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:12.493482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5768209,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":905,"num_read_kb":8759,"num_write":1307,"num_write_kb":27844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.258104+0000","last_change":"2024-09-12T01:03:05.258104+0000","last_active":"2024-09-12T01:03:05.258104+0000","last_peered":"2024-09-12T01:03:05.258104+0000","last_clean":"2024-09-12T01:03:05.258104+0000","last_became_active":"2024-09-12T00:15:59.043146+0000","last_became_peered":"2024-09-12T00:15:59.043146+0000","last_unstale":"2024-09-12T01:03:05.258104+0000","last_undegraded":"2024-09-12T01:03:05.258104+0000","last_fullsized":"2024-09-12T01:03:05.258104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:05.257925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:05.257925+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.257925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:40.514412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"268'52","reported_seq":569,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.329141+0000","last_change":"2024-09-12T01:03:12.329141+0000","last_active":"2024-09-12T01:03:12.329141+0000","last_peered":"2024-09-12T01:03:12.329141+0000","last_clean":"2024-09-12T01:03:12.329141+0000","last_became_active":"2024-09-12T00:16:01.055002+0000","last_became_peered":"2024-09-12T00:16:01.055002+0000","last_unstale":"2024-09-12T01:03:12.329141+0000","last_undegraded":"2024-09-12T01:03:12.329141+0000","last_fullsized":"2024-09-12T01:03:12.329141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'52","last_scrub_stamp":"2024-09-12T01:03:12.328903+0000","last_deep_scrub":"268'52","last_deep_scrub_stamp":"2024-09-12T01:03:12.328903+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.328903+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:35.047822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.554003+0000","last_change":"2024-09-12T01:03:08.554003+0000","last_active":"2024-09-12T01:03:08.554003+0000","last_peered":"2024-09-12T01:03:08.554003+0000","last_clean":"2024-09-12T01:03:08.554003+0000","last_became_active":"2024-09-12T00:16:03.107695+0000","last_became_peered":"2024-09-12T00:16:03.107695+0000","last_unstale":"2024-09-12T01:03:08.554003+0000","last_undegraded":"2024-09-12T01:03:08.554003+0000","last_fullsized":"2024-09-12T01:03:08.554003+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:08.553798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:08.553798+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.553798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:15.552997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"268'246","reported_seq":807,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.231868+0000","last_change":"2024-09-12T01:03:14.231702+0000","last_active":"2024-09-12T01:03:14.231868+0000","last_peered":"2024-09-12T01:03:14.231868+0000","last_clean":"2024-09-12T01:03:14.231868+0000","last_became_active":"2024-09-12T00:16:05.106742+0000","last_became_peered":"2024-09-12T00:16:05.106742+0000","last_unstale":"2024-09-12T01:03:14.231868+0000","last_undegraded":"2024-09-12T01:03:14.231868+0000","last_fullsized":"2024-09-12T01:03:14.231868+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'246","last_scrub_stamp":"2024-09-12T01:03:14.231510+0000","last_deep_scrub":"268'246","last_deep_scrub_stamp":"2024-09-12T01:03:14.231510+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.231510+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:02.610669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":438,"num_read_kb":396,"num_write":482,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"268'397","reported_seq":1842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.275301+0000","last_change":"2024-09-12T01:02:52.275301+0000","last_active":"2024-09-12T01:02:52.275301+0000","last_peered":"2024-09-12T01:02:52.275301+0000","last_clean":"2024-09-12T01:02:52.275301+0000","last_became_active":"2024-09-12T00:15:57.015397+0000","last_became_peered":"2024-09-12T00:15:57.015397+0000","last_unstale":"2024-09-12T01:02:52.275301+0000","last_undegraded":"2024-09-12T01:02:52.275301+0000","last_fullsized":"2024-09-12T01:02:52.275301+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'397","last_scrub_stamp":"2024-09-12T01:02:52.275074+0000","last_deep_scrub":"268'397","last_deep_scrub_stamp":"2024-09-12T01:02:52.275074+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.275074+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:02.312499+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2041,"num_read_kb":1937,"num_write":459,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"268'320","reported_seq":955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.632454+0000","last_change":"2024-09-12T01:02:49.632454+0000","last_active":"2024-09-12T01:02:49.632454+0000","last_peered":"2024-09-12T01:02:49.632454+0000","last_clean":"2024-09-12T01:02:49.632454+0000","last_became_active":"2024-09-12T00:15:55.062990+0000","last_became_peered":"2024-09-12T00:15:55.062990+0000","last_unstale":"2024-09-12T01:02:49.632454+0000","last_undegraded":"2024-09-12T01:02:49.632454+0000","last_fullsized":"2024-09-12T01:02:49.632454+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-09-12T01:02:49.632190+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-09-12T01:02:49.632190+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.632190+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:54.520313+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838529,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":442,"num_read_kb":9756,"num_write":997,"num_write_kb":17415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.583322+0000","last_change":"2024-09-12T01:03:01.583322+0000","last_active":"2024-09-12T01:03:01.583322+0000","last_peered":"2024-09-12T01:03:01.583322+0000","last_clean":"2024-09-12T01:03:01.583322+0000","last_became_active":"2024-09-12T00:15:59.029162+0000","last_became_peered":"2024-09-12T00:15:59.029162+0000","last_unstale":"2024-09-12T01:03:01.583322+0000","last_undegraded":"2024-09-12T01:03:01.583322+0000","last_fullsized":"2024-09-12T01:03:01.583322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:01.583122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:01.583122+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.583122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:27.595470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"268'287","reported_seq":883,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.940481+0000","last_change":"2024-09-12T01:03:04.940481+0000","last_active":"2024-09-12T01:03:04.940481+0000","last_peered":"2024-09-12T01:03:04.940481+0000","last_clean":"2024-09-12T01:03:04.940481+0000","last_became_active":"2024-09-12T00:16:01.059517+0000","last_became_peered":"2024-09-12T00:16:01.059517+0000","last_unstale":"2024-09-12T01:03:04.940481+0000","last_undegraded":"2024-09-12T01:03:04.940481+0000","last_fullsized":"2024-09-12T01:03:04.940481+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'287","last_scrub_stamp":"2024-09-12T01:03:04.940283+0000","last_deep_scrub":"268'287","last_deep_scrub_stamp":"2024-09-12T01:03:04.940283+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.940283+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:24.528106+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51265,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":460,"num_read_kb":973,"num_write":358,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.224169+0000","last_change":"2024-09-12T01:03:05.224169+0000","last_active":"2024-09-12T01:03:05.224169+0000","last_peered":"2024-09-12T01:03:05.224169+0000","last_clean":"2024-09-12T01:03:05.224169+0000","last_became_active":"2024-09-12T00:16:03.103630+0000","last_became_peered":"2024-09-12T00:16:03.103630+0000","last_unstale":"2024-09-12T01:03:05.224169+0000","last_undegraded":"2024-09-12T01:03:05.224169+0000","last_fullsized":"2024-09-12T01:03:05.224169+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:05.223967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:05.223967+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.223967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:01.031493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"268'168","reported_seq":690,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:32.538071+0000","last_change":"2024-09-12T01:03:32.537841+0000","last_active":"2024-09-12T01:03:32.538071+0000","last_peered":"2024-09-12T01:03:32.538071+0000","last_clean":"2024-09-12T01:03:32.538071+0000","last_became_active":"2024-09-12T00:16:05.109745+0000","last_became_peered":"2024-09-12T00:16:05.109745+0000","last_unstale":"2024-09-12T01:03:32.538071+0000","last_undegraded":"2024-09-12T01:03:32.538071+0000","last_fullsized":"2024-09-12T01:03:32.538071+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'168","last_scrub_stamp":"2024-09-12T01:03:32.537604+0000","last_deep_scrub":"268'168","last_deep_scrub_stamp":"2024-09-12T01:03:32.537604+0000","last_clean_scrub_stamp":"2024-09-12T01:03:32.537604+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:16.574263+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":406,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"268'423","reported_seq":1868,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.679246+0000","last_change":"2024-09-12T01:02:53.679246+0000","last_active":"2024-09-12T01:02:53.679246+0000","last_peered":"2024-09-12T01:02:53.679246+0000","last_clean":"2024-09-12T01:02:53.679246+0000","last_became_active":"2024-09-12T00:15:57.028820+0000","last_became_peered":"2024-09-12T00:15:57.028820+0000","last_unstale":"2024-09-12T01:02:53.679246+0000","last_undegraded":"2024-09-12T01:02:53.679246+0000","last_fullsized":"2024-09-12T01:02:53.679246+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'423","last_scrub_stamp":"2024-09-12T01:02:53.679070+0000","last_deep_scrub":"268'423","last_deep_scrub_stamp":"2024-09-12T01:02:53.679070+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.679070+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:24.203431+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2332,"num_read_kb":2186,"num_write":478,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1006,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"268'304","reported_seq":963,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.317898+0000","last_change":"2024-09-12T01:02:51.317898+0000","last_active":"2024-09-12T01:02:51.317898+0000","last_peered":"2024-09-12T01:02:51.317898+0000","last_clean":"2024-09-12T01:02:51.317898+0000","last_became_active":"2024-09-12T00:15:55.054712+0000","last_became_peered":"2024-09-12T00:15:55.054712+0000","last_unstale":"2024-09-12T01:02:51.317898+0000","last_undegraded":"2024-09-12T01:02:51.317898+0000","last_fullsized":"2024-09-12T01:02:51.317898+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'304","last_scrub_stamp":"2024-09-12T01:02:51.317700+0000","last_deep_scrub":"268'304","last_deep_scrub_stamp":"2024-09-12T01:02:51.317700+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.317700+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:15.787375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25680,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":448,"num_read_kb":100896,"num_write":1015,"num_write_kb":52799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.612965+0000","last_change":"2024-09-12T01:03:13.612965+0000","last_active":"2024-09-12T01:03:13.612965+0000","last_peered":"2024-09-12T01:03:13.612965+0000","last_clean":"2024-09-12T01:03:13.612965+0000","last_became_active":"2024-09-12T00:15:59.028885+0000","last_became_peered":"2024-09-12T00:15:59.028885+0000","last_unstale":"2024-09-12T01:03:13.612965+0000","last_undegraded":"2024-09-12T01:03:13.612965+0000","last_fullsized":"2024-09-12T01:03:13.612965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:13.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:13.612747+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:15.856950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"268'273","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.600517+0000","last_change":"2024-09-12T01:03:09.600517+0000","last_active":"2024-09-12T01:03:09.600517+0000","last_peered":"2024-09-12T01:03:09.600517+0000","last_clean":"2024-09-12T01:03:09.600517+0000","last_became_active":"2024-09-12T00:16:01.050654+0000","last_became_peered":"2024-09-12T00:16:01.050654+0000","last_unstale":"2024-09-12T01:03:09.600517+0000","last_undegraded":"2024-09-12T01:03:09.600517+0000","last_fullsized":"2024-09-12T01:03:09.600517+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'273","last_scrub_stamp":"2024-09-12T01:03:09.600297+0000","last_deep_scrub":"268'273","last_deep_scrub_stamp":"2024-09-12T01:03:09.600297+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.600297+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:17.048401+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":1024,"num_write":358,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.863748+0000","last_change":"2024-09-12T01:03:06.863748+0000","last_active":"2024-09-12T01:03:06.863748+0000","last_peered":"2024-09-12T01:03:06.863748+0000","last_clean":"2024-09-12T01:03:06.863748+0000","last_became_active":"2024-09-12T00:16:03.088929+0000","last_became_peered":"2024-09-12T00:16:03.088929+0000","last_unstale":"2024-09-12T01:03:06.863748+0000","last_undegraded":"2024-09-12T01:03:06.863748+0000","last_fullsized":"2024-09-12T01:03:06.863748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:06.863544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:06.863544+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.863544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:13.284749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"268'422","reported_seq":2051,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.543894+0000","last_change":"2024-09-12T01:03:07.543894+0000","last_active":"2024-09-12T01:03:07.543894+0000","last_peered":"2024-09-12T01:03:07.543894+0000","last_clean":"2024-09-12T01:03:07.543894+0000","last_became_active":"2024-09-12T00:15:57.039919+0000","last_became_peered":"2024-09-12T00:15:57.039919+0000","last_unstale":"2024-09-12T01:03:07.543894+0000","last_undegraded":"2024-09-12T01:03:07.543894+0000","last_fullsized":"2024-09-12T01:03:07.543894+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'422","last_scrub_stamp":"2024-09-12T01:03:07.543688+0000","last_deep_scrub":"268'422","last_deep_scrub_stamp":"2024-09-12T01:03:07.543688+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.543688+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:37.918345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2299,"num_read_kb":2203,"num_write":481,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"268'299","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.357075+0000","last_change":"2024-09-12T01:02:48.357075+0000","last_active":"2024-09-12T01:02:48.357075+0000","last_peered":"2024-09-12T01:02:48.357075+0000","last_clean":"2024-09-12T01:02:48.357075+0000","last_became_active":"2024-09-12T00:15:55.079264+0000","last_became_peered":"2024-09-12T00:15:55.079264+0000","last_unstale":"2024-09-12T01:02:48.357075+0000","last_undegraded":"2024-09-12T01:02:48.357075+0000","last_fullsized":"2024-09-12T01:02:48.357075+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'299","last_scrub_stamp":"2024-09-12T01:02:48.356731+0000","last_deep_scrub":"268'299","last_deep_scrub_stamp":"2024-09-12T01:02:48.356731+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.356731+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:01.723914+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311670,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":380,"num_read_kb":14024,"num_write":902,"num_write_kb":16591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.166848+0000","last_change":"2024-09-12T01:03:04.166848+0000","last_active":"2024-09-12T01:03:04.166848+0000","last_peered":"2024-09-12T01:03:04.166848+0000","last_clean":"2024-09-12T01:03:04.166848+0000","last_became_active":"2024-09-12T00:15:59.039042+0000","last_became_peered":"2024-09-12T00:15:59.039042+0000","last_unstale":"2024-09-12T01:03:04.166848+0000","last_undegraded":"2024-09-12T01:03:04.166848+0000","last_fullsized":"2024-09-12T01:03:04.166848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:04.166656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:04.166656+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.166656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:47.847682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"268'500","reported_seq":1141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.253325+0000","last_change":"2024-09-12T01:03:08.253187+0000","last_active":"2024-09-12T01:03:08.253325+0000","last_peered":"2024-09-12T01:03:08.253325+0000","last_clean":"2024-09-12T01:03:08.253325+0000","last_became_active":"2024-09-12T00:16:01.062625+0000","last_became_peered":"2024-09-12T00:16:01.062625+0000","last_unstale":"2024-09-12T01:03:08.253325+0000","last_undegraded":"2024-09-12T01:03:08.253325+0000","last_fullsized":"2024-09-12T01:03:08.253325+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'500","last_scrub_stamp":"2024-09-12T01:03:08.252996+0000","last_deep_scrub":"268'500","last_deep_scrub_stamp":"2024-09-12T01:03:08.252996+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.252996+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:40.522444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91700,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":904,"num_read_kb":2175,"num_write":782,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.547683+0000","last_change":"2024-09-12T01:03:07.547461+0000","last_active":"2024-09-12T01:03:07.547683+0000","last_peered":"2024-09-12T01:03:07.547683+0000","last_clean":"2024-09-12T01:03:07.547683+0000","last_became_active":"2024-09-12T00:16:03.087980+0000","last_became_peered":"2024-09-12T00:16:03.087980+0000","last_unstale":"2024-09-12T01:03:07.547683+0000","last_undegraded":"2024-09-12T01:03:07.547683+0000","last_fullsized":"2024-09-12T01:03:07.547683+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:07.547227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:07.547227+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.547227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:14.697460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"268'131","reported_seq":638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.664635+0000","last_change":"2024-09-12T01:03:23.664635+0000","last_active":"2024-09-12T01:03:23.664635+0000","last_peered":"2024-09-12T01:03:23.664635+0000","last_clean":"2024-09-12T01:03:23.664635+0000","last_became_active":"2024-09-12T00:16:05.098424+0000","last_became_peered":"2024-09-12T00:16:05.098424+0000","last_unstale":"2024-09-12T01:03:23.664635+0000","last_undegraded":"2024-09-12T01:03:23.664635+0000","last_fullsized":"2024-09-12T01:03:23.664635+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'131","last_scrub_stamp":"2024-09-12T01:03:23.664450+0000","last_deep_scrub":"268'131","last_deep_scrub_stamp":"2024-09-12T01:03:23.664450+0000","last_clean_scrub_stamp":"2024-09-12T01:03:23.664450+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:04.081604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":165,"num_write":285,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"268'842","reported_seq":2439,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.169938+0000","last_change":"2024-09-12T01:02:56.169938+0000","last_active":"2024-09-12T01:02:56.169938+0000","last_peered":"2024-09-12T01:02:56.169938+0000","last_clean":"2024-09-12T01:02:56.169938+0000","last_became_active":"2024-09-12T00:15:57.022709+0000","last_became_peered":"2024-09-12T00:15:57.022709+0000","last_unstale":"2024-09-12T01:02:56.169938+0000","last_undegraded":"2024-09-12T01:02:56.169938+0000","last_fullsized":"2024-09-12T01:02:56.169938+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'842","last_scrub_stamp":"2024-09-12T01:02:56.169713+0000","last_deep_scrub":"268'842","last_deep_scrub_stamp":"2024-09-12T01:02:56.169713+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.169713+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:31.117935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3967,"num_read_kb":3571,"num_write":1117,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1379,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"268'292","reported_seq":941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.308689+0000","last_change":"2024-09-12T01:02:50.308689+0000","last_active":"2024-09-12T01:02:50.308689+0000","last_peered":"2024-09-12T01:02:50.308689+0000","last_clean":"2024-09-12T01:02:50.308689+0000","last_became_active":"2024-09-12T00:15:55.064940+0000","last_became_peered":"2024-09-12T00:15:55.064940+0000","last_unstale":"2024-09-12T01:02:50.308689+0000","last_undegraded":"2024-09-12T01:02:50.308689+0000","last_fullsized":"2024-09-12T01:02:50.308689+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'292","last_scrub_stamp":"2024-09-12T01:02:50.308457+0000","last_deep_scrub":"268'292","last_deep_scrub_stamp":"2024-09-12T01:02:50.308457+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.308457+0000","objects_scrubbed":6,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:18.717527+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1909911,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":2788,"num_write":1025,"num_write_kb":39220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.545155+0000","last_change":"2024-09-12T01:03:04.545155+0000","last_active":"2024-09-12T01:03:04.545155+0000","last_peered":"2024-09-12T01:03:04.545155+0000","last_clean":"2024-09-12T01:03:04.545155+0000","last_became_active":"2024-09-12T00:15:59.034648+0000","last_became_peered":"2024-09-12T00:15:59.034648+0000","last_unstale":"2024-09-12T01:03:04.545155+0000","last_undegraded":"2024-09-12T01:03:04.545155+0000","last_fullsized":"2024-09-12T01:03:04.545155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:04.544977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:04.544977+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.544977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:15.428165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"268'289","reported_seq":887,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.600067+0000","last_change":"2024-09-12T01:03:21.599928+0000","last_active":"2024-09-12T01:03:21.600067+0000","last_peered":"2024-09-12T01:03:21.600067+0000","last_clean":"2024-09-12T01:03:21.600067+0000","last_became_active":"2024-09-12T00:16:01.046783+0000","last_became_peered":"2024-09-12T00:16:01.046783+0000","last_unstale":"2024-09-12T01:03:21.600067+0000","last_undegraded":"2024-09-12T01:03:21.600067+0000","last_fullsized":"2024-09-12T01:03:21.600067+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'289","last_scrub_stamp":"2024-09-12T01:03:21.599715+0000","last_deep_scrub":"268'289","last_deep_scrub_stamp":"2024-09-12T01:03:21.599715+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.599715+0000","objects_scrubbed":8,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:04.490478+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45699,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":1022,"num_write":398,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.603068+0000","last_change":"2024-09-12T01:03:18.602862+0000","last_active":"2024-09-12T01:03:18.603068+0000","last_peered":"2024-09-12T01:03:18.603068+0000","last_clean":"2024-09-12T01:03:18.603068+0000","last_became_active":"2024-09-12T00:16:03.097160+0000","last_became_peered":"2024-09-12T00:16:03.097160+0000","last_unstale":"2024-09-12T01:03:18.603068+0000","last_undegraded":"2024-09-12T01:03:18.603068+0000","last_fullsized":"2024-09-12T01:03:18.603068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:18.602579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:18.602579+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.602579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:11.353722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"268'215","reported_seq":777,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:30.566931+0000","last_change":"2024-09-12T01:03:30.566931+0000","last_active":"2024-09-12T01:03:30.566931+0000","last_peered":"2024-09-12T01:03:30.566931+0000","last_clean":"2024-09-12T01:03:30.566931+0000","last_became_active":"2024-09-12T00:16:05.101338+0000","last_became_peered":"2024-09-12T00:16:05.101338+0000","last_unstale":"2024-09-12T01:03:30.566931+0000","last_undegraded":"2024-09-12T01:03:30.566931+0000","last_fullsized":"2024-09-12T01:03:30.566931+0000","mapping_epoch":36,"log_start":"268'201","ondisk_log_start":"268'201","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'215","last_scrub_stamp":"2024-09-12T01:03:30.566693+0000","last_deep_scrub":"268'215","last_deep_scrub_stamp":"2024-09-12T01:03:30.566693+0000","last_clean_scrub_stamp":"2024-09-12T01:03:30.566693+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":201,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:00.382434+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1401,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":396,"num_read_kb":348,"num_write":595,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"268'506","reported_seq":2097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.685588+0000","last_change":"2024-09-12T01:02:54.685414+0000","last_active":"2024-09-12T01:02:54.685588+0000","last_peered":"2024-09-12T01:02:54.685588+0000","last_clean":"2024-09-12T01:02:54.685588+0000","last_became_active":"2024-09-12T00:15:57.034257+0000","last_became_peered":"2024-09-12T00:15:57.034257+0000","last_unstale":"2024-09-12T01:02:54.685588+0000","last_undegraded":"2024-09-12T01:02:54.685588+0000","last_fullsized":"2024-09-12T01:02:54.685588+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'506","last_scrub_stamp":"2024-09-12T01:02:54.685233+0000","last_deep_scrub":"268'506","last_deep_scrub_stamp":"2024-09-12T01:02:54.685233+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.685233+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:00.855007+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2760,"num_read_kb":2552,"num_write":653,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"268'359","reported_seq":1109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.174248+0000","last_change":"2024-09-12T01:02:46.174196+0000","last_active":"2024-09-12T01:02:46.174248+0000","last_peered":"2024-09-12T01:02:46.174248+0000","last_clean":"2024-09-12T01:02:46.174248+0000","last_became_active":"2024-09-12T00:15:55.035741+0000","last_became_peered":"2024-09-12T00:15:55.035741+0000","last_unstale":"2024-09-12T01:02:46.174248+0000","last_undegraded":"2024-09-12T01:02:46.174248+0000","last_fullsized":"2024-09-12T01:02:46.174248+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T01:02:46.174096+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T01:02:46.174096+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.174096+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:23.160018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":693,"num_read_kb":41169,"num_write":1152,"num_write_kb":26675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.627283+0000","last_change":"2024-09-12T01:03:00.627134+0000","last_active":"2024-09-12T01:03:00.627283+0000","last_peered":"2024-09-12T01:03:00.627283+0000","last_clean":"2024-09-12T01:03:00.627283+0000","last_became_active":"2024-09-12T00:15:59.044761+0000","last_became_peered":"2024-09-12T00:15:59.044761+0000","last_unstale":"2024-09-12T01:03:00.627283+0000","last_undegraded":"2024-09-12T01:03:00.627283+0000","last_fullsized":"2024-09-12T01:03:00.627283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:00.626946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:00.626946+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.626946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:42.833587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"268'298","reported_seq":886,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.201939+0000","last_change":"2024-09-12T01:03:10.201939+0000","last_active":"2024-09-12T01:03:10.201939+0000","last_peered":"2024-09-12T01:03:10.201939+0000","last_clean":"2024-09-12T01:03:10.201939+0000","last_became_active":"2024-09-12T00:16:01.052731+0000","last_became_peered":"2024-09-12T00:16:01.052731+0000","last_unstale":"2024-09-12T01:03:10.201939+0000","last_undegraded":"2024-09-12T01:03:10.201939+0000","last_fullsized":"2024-09-12T01:03:10.201939+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'298","last_scrub_stamp":"2024-09-12T01:03:10.201739+0000","last_deep_scrub":"268'298","last_deep_scrub_stamp":"2024-09-12T01:03:10.201739+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.201739+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:36.025785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50253,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":1058,"num_write":380,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.924910+0000","last_change":"2024-09-12T01:03:08.924910+0000","last_active":"2024-09-12T01:03:08.924910+0000","last_peered":"2024-09-12T01:03:08.924910+0000","last_clean":"2024-09-12T01:03:08.924910+0000","last_became_active":"2024-09-12T00:16:03.080825+0000","last_became_peered":"2024-09-12T00:16:03.080825+0000","last_unstale":"2024-09-12T01:03:08.924910+0000","last_undegraded":"2024-09-12T01:03:08.924910+0000","last_fullsized":"2024-09-12T01:03:08.924910+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:08.924731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:08.924731+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.924731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:25.806325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"268'158","reported_seq":665,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.572592+0000","last_change":"2024-09-12T01:03:29.572592+0000","last_active":"2024-09-12T01:03:29.572592+0000","last_peered":"2024-09-12T01:03:29.572592+0000","last_clean":"2024-09-12T01:03:29.572592+0000","last_became_active":"2024-09-12T00:16:05.098180+0000","last_became_peered":"2024-09-12T00:16:05.098180+0000","last_unstale":"2024-09-12T01:03:29.572592+0000","last_undegraded":"2024-09-12T01:03:29.572592+0000","last_fullsized":"2024-09-12T01:03:29.572592+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'158","last_scrub_stamp":"2024-09-12T01:03:29.572401+0000","last_deep_scrub":"268'158","last_deep_scrub_stamp":"2024-09-12T01:03:29.572401+0000","last_clean_scrub_stamp":"2024-09-12T01:03:29.572401+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:02.677911+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":95,"num_write":348,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"268'342","reported_seq":1674,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.129910+0000","last_change":"2024-09-12T01:02:57.129621+0000","last_active":"2024-09-12T01:02:57.129910+0000","last_peered":"2024-09-12T01:02:57.129910+0000","last_clean":"2024-09-12T01:02:57.129910+0000","last_became_active":"2024-09-12T00:15:57.039580+0000","last_became_peered":"2024-09-12T00:15:57.039580+0000","last_unstale":"2024-09-12T01:02:57.129910+0000","last_undegraded":"2024-09-12T01:02:57.129910+0000","last_fullsized":"2024-09-12T01:02:57.129910+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-12T01:02:57.129353+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-12T01:02:57.129353+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.129353+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:16.119165+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1750,"num_read_kb":1664,"num_write":383,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"268'336","reported_seq":960,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.234545+0000","last_change":"2024-09-12T01:02:54.234365+0000","last_active":"2024-09-12T01:02:54.234545+0000","last_peered":"2024-09-12T01:02:54.234545+0000","last_clean":"2024-09-12T01:02:54.234545+0000","last_became_active":"2024-09-12T00:15:55.042851+0000","last_became_peered":"2024-09-12T00:15:55.042851+0000","last_unstale":"2024-09-12T01:02:54.234545+0000","last_undegraded":"2024-09-12T01:02:54.234545+0000","last_fullsized":"2024-09-12T01:02:54.234545+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'336","last_scrub_stamp":"2024-09-12T01:02:54.233965+0000","last_deep_scrub":"268'336","last_deep_scrub_stamp":"2024-09-12T01:02:54.233965+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.233965+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:37.476942+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1919007,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":413,"num_read_kb":20803,"num_write":1107,"num_write_kb":57854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.223216+0000","last_change":"2024-09-12T01:03:09.223088+0000","last_active":"2024-09-12T01:03:09.223216+0000","last_peered":"2024-09-12T01:03:09.223216+0000","last_clean":"2024-09-12T01:03:09.223216+0000","last_became_active":"2024-09-12T00:15:59.048632+0000","last_became_peered":"2024-09-12T00:15:59.048632+0000","last_unstale":"2024-09-12T01:03:09.223216+0000","last_undegraded":"2024-09-12T01:03:09.223216+0000","last_fullsized":"2024-09-12T01:03:09.223216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:09.222897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:09.222897+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.222897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:54.272835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"268'92","reported_seq":634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.598105+0000","last_change":"2024-09-12T01:03:22.598105+0000","last_active":"2024-09-12T01:03:22.598105+0000","last_peered":"2024-09-12T01:03:22.598105+0000","last_clean":"2024-09-12T01:03:22.598105+0000","last_became_active":"2024-09-12T00:16:01.045565+0000","last_became_peered":"2024-09-12T00:16:01.045565+0000","last_unstale":"2024-09-12T01:03:22.598105+0000","last_undegraded":"2024-09-12T01:03:22.598105+0000","last_fullsized":"2024-09-12T01:03:22.598105+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'92","last_scrub_stamp":"2024-09-12T01:03:22.597904+0000","last_deep_scrub":"268'92","last_deep_scrub_stamp":"2024-09-12T01:03:22.597904+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.597904+0000","objects_scrubbed":8,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:28.342106+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":132,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"268'786","reported_seq":4438,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.534702+0000","last_change":"2024-09-12T01:03:06.534702+0000","last_active":"2024-09-12T01:03:06.534702+0000","last_peered":"2024-09-12T01:03:06.534702+0000","last_clean":"2024-09-12T01:03:06.534702+0000","last_became_active":"2024-09-12T00:16:03.091506+0000","last_became_peered":"2024-09-12T00:16:03.091506+0000","last_unstale":"2024-09-12T01:03:06.534702+0000","last_undegraded":"2024-09-12T01:03:06.534702+0000","last_fullsized":"2024-09-12T01:03:06.534702+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'786","last_scrub_stamp":"2024-09-12T01:03:06.534512+0000","last_deep_scrub":"268'786","last_deep_scrub_stamp":"2024-09-12T01:03:06.534512+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.534512+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:02.777021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"268'115","reported_seq":631,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:28.588926+0000","last_change":"2024-09-12T01:03:28.588926+0000","last_active":"2024-09-12T01:03:28.588926+0000","last_peered":"2024-09-12T01:03:28.588926+0000","last_clean":"2024-09-12T01:03:28.588926+0000","last_became_active":"2024-09-12T00:16:05.101500+0000","last_became_peered":"2024-09-12T00:16:05.101500+0000","last_unstale":"2024-09-12T01:03:28.588926+0000","last_undegraded":"2024-09-12T01:03:28.588926+0000","last_fullsized":"2024-09-12T01:03:28.588926+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-12T01:03:28.588847+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-12T01:03:28.588847+0000","last_clean_scrub_stamp":"2024-09-12T01:03:28.588847+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:53.839494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"268'1104","reported_seq":2647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.661907+0000","last_change":"2024-09-12T01:02:59.661665+0000","last_active":"2024-09-12T01:02:59.661907+0000","last_peered":"2024-09-12T01:02:59.661907+0000","last_clean":"2024-09-12T01:02:59.661907+0000","last_became_active":"2024-09-12T00:15:57.056507+0000","last_became_peered":"2024-09-12T00:15:57.056507+0000","last_unstale":"2024-09-12T01:02:59.661907+0000","last_undegraded":"2024-09-12T01:02:59.661907+0000","last_fullsized":"2024-09-12T01:02:59.661907+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1104","last_scrub_stamp":"2024-09-12T01:02:59.661368+0000","last_deep_scrub":"268'1104","last_deep_scrub_stamp":"2024-09-12T01:02:59.661368+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.661368+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":1000,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:37.501861+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5000,"num_read_kb":4445,"num_write":1493,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"268'355","reported_seq":1219,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.211403+0000","last_change":"2024-09-12T01:02:47.211133+0000","last_active":"2024-09-12T01:02:47.211403+0000","last_peered":"2024-09-12T01:02:47.211403+0000","last_clean":"2024-09-12T01:02:47.211403+0000","last_became_active":"2024-09-12T00:15:55.051336+0000","last_became_peered":"2024-09-12T00:15:55.051336+0000","last_unstale":"2024-09-12T01:02:47.211403+0000","last_undegraded":"2024-09-12T01:02:47.211403+0000","last_fullsized":"2024-09-12T01:02:47.211403+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'355","last_scrub_stamp":"2024-09-12T01:02:47.210757+0000","last_deep_scrub":"268'355","last_deep_scrub_stamp":"2024-09-12T01:02:47.210757+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.210757+0000","objects_scrubbed":8,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:14.508041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174753,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1007,"num_read_kb":8590,"num_write":1279,"num_write_kb":12738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.157441+0000","last_change":"2024-09-12T01:03:01.157220+0000","last_active":"2024-09-12T01:03:01.157441+0000","last_peered":"2024-09-12T01:03:01.157441+0000","last_clean":"2024-09-12T01:03:01.157441+0000","last_became_active":"2024-09-12T00:15:59.046538+0000","last_became_peered":"2024-09-12T00:15:59.046538+0000","last_unstale":"2024-09-12T01:03:01.157441+0000","last_undegraded":"2024-09-12T01:03:01.157441+0000","last_fullsized":"2024-09-12T01:03:01.157441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:01.157005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:01.157005+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.157005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:05.303663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"268'336","reported_seq":951,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.576715+0000","last_change":"2024-09-12T01:03:05.576715+0000","last_active":"2024-09-12T01:03:05.576715+0000","last_peered":"2024-09-12T01:03:05.576715+0000","last_clean":"2024-09-12T01:03:05.576715+0000","last_became_active":"2024-09-12T00:16:01.051648+0000","last_became_peered":"2024-09-12T00:16:01.051648+0000","last_unstale":"2024-09-12T01:03:05.576715+0000","last_undegraded":"2024-09-12T01:03:05.576715+0000","last_fullsized":"2024-09-12T01:03:05.576715+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'336","last_scrub_stamp":"2024-09-12T01:03:05.576460+0000","last_deep_scrub":"268'336","last_deep_scrub_stamp":"2024-09-12T01:03:05.576460+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.576460+0000","objects_scrubbed":11,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:44.168273+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50218,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":538,"num_read_kb":1138,"num_write":432,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.329374+0000","last_change":"2024-09-12T01:03:20.329374+0000","last_active":"2024-09-12T01:03:20.329374+0000","last_peered":"2024-09-12T01:03:20.329374+0000","last_clean":"2024-09-12T01:03:20.329374+0000","last_became_active":"2024-09-12T00:16:03.086333+0000","last_became_peered":"2024-09-12T00:16:03.086333+0000","last_unstale":"2024-09-12T01:03:20.329374+0000","last_undegraded":"2024-09-12T01:03:20.329374+0000","last_fullsized":"2024-09-12T01:03:20.329374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:20.329196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:20.329196+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.329196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:26.619682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"268'129","reported_seq":639,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.316540+0000","last_change":"2024-09-12T01:03:12.316540+0000","last_active":"2024-09-12T01:03:12.316540+0000","last_peered":"2024-09-12T01:03:12.316540+0000","last_clean":"2024-09-12T01:03:12.316540+0000","last_became_active":"2024-09-12T00:16:05.107284+0000","last_became_peered":"2024-09-12T00:16:05.107284+0000","last_unstale":"2024-09-12T01:03:12.316540+0000","last_undegraded":"2024-09-12T01:03:12.316540+0000","last_fullsized":"2024-09-12T01:03:12.316540+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'129","last_scrub_stamp":"2024-09-12T01:03:12.316341+0000","last_deep_scrub":"268'129","last_deep_scrub_stamp":"2024-09-12T01:03:12.316341+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.316341+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:28.418713+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":114,"num_write":286,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"268'491","reported_seq":2126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.653655+0000","last_change":"2024-09-12T01:02:57.653502+0000","last_active":"2024-09-12T01:02:57.653655+0000","last_peered":"2024-09-12T01:02:57.653655+0000","last_clean":"2024-09-12T01:02:57.653655+0000","last_became_active":"2024-09-12T00:15:57.021526+0000","last_became_peered":"2024-09-12T00:15:57.021526+0000","last_unstale":"2024-09-12T01:02:57.653655+0000","last_undegraded":"2024-09-12T01:02:57.653655+0000","last_fullsized":"2024-09-12T01:02:57.653655+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'491","last_scrub_stamp":"2024-09-12T01:02:57.653321+0000","last_deep_scrub":"268'491","last_deep_scrub_stamp":"2024-09-12T01:02:57.653321+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.653321+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:22.307720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2702,"num_read_kb":2545,"num_write":554,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"268'350","reported_seq":1039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.624753+0000","last_change":"2024-09-12T01:02:54.624581+0000","last_active":"2024-09-12T01:02:54.624753+0000","last_peered":"2024-09-12T01:02:54.624753+0000","last_clean":"2024-09-12T01:02:54.624753+0000","last_became_active":"2024-09-12T00:15:55.052503+0000","last_became_peered":"2024-09-12T00:15:55.052503+0000","last_unstale":"2024-09-12T01:02:54.624753+0000","last_undegraded":"2024-09-12T01:02:54.624753+0000","last_fullsized":"2024-09-12T01:02:54.624753+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T01:02:54.624378+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T01:02:54.624378+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.624378+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:26.809590+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174814,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":52648,"num_write":1035,"num_write_kb":43222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.551087+0000","last_change":"2024-09-12T01:03:03.551002+0000","last_active":"2024-09-12T01:03:03.551087+0000","last_peered":"2024-09-12T01:03:03.551087+0000","last_clean":"2024-09-12T01:03:03.551087+0000","last_became_active":"2024-09-12T00:15:59.024564+0000","last_became_peered":"2024-09-12T00:15:59.024564+0000","last_unstale":"2024-09-12T01:03:03.551087+0000","last_undegraded":"2024-09-12T01:03:03.551087+0000","last_fullsized":"2024-09-12T01:03:03.551087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:03.550913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:03.550913+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.550913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:02.329399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"268'253","reported_seq":841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.338971+0000","last_change":"2024-09-12T01:03:15.338971+0000","last_active":"2024-09-12T01:03:15.338971+0000","last_peered":"2024-09-12T01:03:15.338971+0000","last_clean":"2024-09-12T01:03:15.338971+0000","last_became_active":"2024-09-12T00:16:01.051612+0000","last_became_peered":"2024-09-12T00:16:01.051612+0000","last_unstale":"2024-09-12T01:03:15.338971+0000","last_undegraded":"2024-09-12T01:03:15.338971+0000","last_fullsized":"2024-09-12T01:03:15.338971+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'253","last_scrub_stamp":"2024-09-12T01:03:15.338659+0000","last_deep_scrub":"268'253","last_deep_scrub_stamp":"2024-09-12T01:03:15.338659+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.338659+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:04.996974+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46385,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":418,"num_read_kb":940,"num_write":334,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.564199+0000","last_change":"2024-09-12T01:03:25.564199+0000","last_active":"2024-09-12T01:03:25.564199+0000","last_peered":"2024-09-12T01:03:25.564199+0000","last_clean":"2024-09-12T01:03:25.564199+0000","last_became_active":"2024-09-12T00:16:03.095016+0000","last_became_peered":"2024-09-12T00:16:03.095016+0000","last_unstale":"2024-09-12T01:03:25.564199+0000","last_undegraded":"2024-09-12T01:03:25.564199+0000","last_fullsized":"2024-09-12T01:03:25.564199+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:25.564018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:25.564018+0000","last_clean_scrub_stamp":"2024-09-12T01:03:25.564018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:40.464867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"268'137","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.722423+0000","last_change":"2024-09-12T01:03:25.722423+0000","last_active":"2024-09-12T01:03:25.722423+0000","last_peered":"2024-09-12T01:03:25.722423+0000","last_clean":"2024-09-12T01:03:25.722423+0000","last_became_active":"2024-09-12T00:16:05.098796+0000","last_became_peered":"2024-09-12T00:16:05.098796+0000","last_unstale":"2024-09-12T01:03:25.722423+0000","last_undegraded":"2024-09-12T01:03:25.722423+0000","last_fullsized":"2024-09-12T01:03:25.722423+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'137","last_scrub_stamp":"2024-09-12T01:03:25.722226+0000","last_deep_scrub":"268'137","last_deep_scrub_stamp":"2024-09-12T01:03:25.722226+0000","last_clean_scrub_stamp":"2024-09-12T01:03:25.722226+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:56.957492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":225,"num_write":347,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"268'418","reported_seq":1971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.676410+0000","last_change":"2024-09-12T01:02:52.676410+0000","last_active":"2024-09-12T01:02:52.676410+0000","last_peered":"2024-09-12T01:02:52.676410+0000","last_clean":"2024-09-12T01:02:52.676410+0000","last_became_active":"2024-09-12T00:15:57.038127+0000","last_became_peered":"2024-09-12T00:15:57.038127+0000","last_unstale":"2024-09-12T01:02:52.676410+0000","last_undegraded":"2024-09-12T01:02:52.676410+0000","last_fullsized":"2024-09-12T01:02:52.676410+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'418","last_scrub_stamp":"2024-09-12T01:02:52.676192+0000","last_deep_scrub":"268'418","last_deep_scrub_stamp":"2024-09-12T01:02:52.676192+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.676192+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:22.108077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2293,"num_read_kb":2185,"num_write":483,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3022,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"268'320","reported_seq":959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.395489+0000","last_change":"2024-09-12T01:02:49.395489+0000","last_active":"2024-09-12T01:02:49.395489+0000","last_peered":"2024-09-12T01:02:49.395489+0000","last_clean":"2024-09-12T01:02:49.395489+0000","last_became_active":"2024-09-12T00:15:55.074964+0000","last_became_peered":"2024-09-12T00:15:55.074964+0000","last_unstale":"2024-09-12T01:02:49.395489+0000","last_undegraded":"2024-09-12T01:02:49.395489+0000","last_fullsized":"2024-09-12T01:02:49.395489+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-09-12T01:02:49.395237+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-09-12T01:02:49.395237+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.395237+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:09.752592+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655970,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":20129,"num_write":999,"num_write_kb":20535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.198645+0000","last_change":"2024-09-12T01:03:04.198645+0000","last_active":"2024-09-12T01:03:04.198645+0000","last_peered":"2024-09-12T01:03:04.198645+0000","last_clean":"2024-09-12T01:03:04.198645+0000","last_became_active":"2024-09-12T00:15:59.036492+0000","last_became_peered":"2024-09-12T00:15:59.036492+0000","last_unstale":"2024-09-12T01:03:04.198645+0000","last_undegraded":"2024-09-12T01:03:04.198645+0000","last_fullsized":"2024-09-12T01:03:04.198645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:04.198465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:04.198465+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.198465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:22.027363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"268'249","reported_seq":819,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.271646+0000","last_change":"2024-09-12T01:03:07.271501+0000","last_active":"2024-09-12T01:03:07.271646+0000","last_peered":"2024-09-12T01:03:07.271646+0000","last_clean":"2024-09-12T01:03:07.271646+0000","last_became_active":"2024-09-12T00:16:01.050746+0000","last_became_peered":"2024-09-12T00:16:01.050746+0000","last_unstale":"2024-09-12T01:03:07.271646+0000","last_undegraded":"2024-09-12T01:03:07.271646+0000","last_fullsized":"2024-09-12T01:03:07.271646+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'249","last_scrub_stamp":"2024-09-12T01:03:07.271298+0000","last_deep_scrub":"268'249","last_deep_scrub_stamp":"2024-09-12T01:03:07.271298+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.271298+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:45.855519+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":412,"num_read_kb":978,"num_write":338,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:27.548023+0000","last_change":"2024-09-12T01:03:27.547797+0000","last_active":"2024-09-12T01:03:27.548023+0000","last_peered":"2024-09-12T01:03:27.548023+0000","last_clean":"2024-09-12T01:03:27.548023+0000","last_became_active":"2024-09-12T00:16:03.099890+0000","last_became_peered":"2024-09-12T00:16:03.099890+0000","last_unstale":"2024-09-12T01:03:27.548023+0000","last_undegraded":"2024-09-12T01:03:27.548023+0000","last_fullsized":"2024-09-12T01:03:27.548023+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:27.547584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:27.547584+0000","last_clean_scrub_stamp":"2024-09-12T01:03:27.547584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:14.776930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"268'191","reported_seq":1686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:31.588583+0000","last_change":"2024-09-12T01:03:31.588583+0000","last_active":"2024-09-12T01:03:31.588583+0000","last_peered":"2024-09-12T01:03:31.588583+0000","last_clean":"2024-09-12T01:03:31.588583+0000","last_became_active":"2024-09-12T00:16:05.113207+0000","last_became_peered":"2024-09-12T00:16:05.113207+0000","last_unstale":"2024-09-12T01:03:31.588583+0000","last_undegraded":"2024-09-12T01:03:31.588583+0000","last_fullsized":"2024-09-12T01:03:31.588583+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'191","last_scrub_stamp":"2024-09-12T01:03:31.588376+0000","last_deep_scrub":"268'191","last_deep_scrub_stamp":"2024-09-12T01:03:31.588376+0000","last_clean_scrub_stamp":"2024-09-12T01:03:31.588376+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:09.293036+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1270,"num_read_kb":1246,"num_write":444,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"268'926","reported_seq":2674,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.619463+0000","last_change":"2024-09-12T01:02:56.619463+0000","last_active":"2024-09-12T01:02:56.619463+0000","last_peered":"2024-09-12T01:02:56.619463+0000","last_clean":"2024-09-12T01:02:56.619463+0000","last_became_active":"2024-09-12T00:15:57.012136+0000","last_became_peered":"2024-09-12T00:15:57.012136+0000","last_unstale":"2024-09-12T01:02:56.619463+0000","last_undegraded":"2024-09-12T01:02:56.619463+0000","last_fullsized":"2024-09-12T01:02:56.619463+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'926","last_scrub_stamp":"2024-09-12T01:02:56.619272+0000","last_deep_scrub":"268'926","last_deep_scrub_stamp":"2024-09-12T01:02:56.619272+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.619272+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":900,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:34.737350+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4477,"num_read_kb":4059,"num_write":1259,"num_write_kb":498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1011,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"268'359","reported_seq":1003,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.367417+0000","last_change":"2024-09-12T01:02:50.367417+0000","last_active":"2024-09-12T01:02:50.367417+0000","last_peered":"2024-09-12T01:02:50.367417+0000","last_clean":"2024-09-12T01:02:50.367417+0000","last_became_active":"2024-09-12T00:15:55.079005+0000","last_became_peered":"2024-09-12T00:15:55.079005+0000","last_unstale":"2024-09-12T01:02:50.367417+0000","last_undegraded":"2024-09-12T01:02:50.367417+0000","last_fullsized":"2024-09-12T01:02:50.367417+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T01:02:50.366971+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T01:02:50.366971+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.366971+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:04.196096+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525370,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":531,"num_read_kb":476,"num_write":1171,"num_write_kb":40462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.241251+0000","last_change":"2024-09-12T01:03:08.241251+0000","last_active":"2024-09-12T01:03:08.241251+0000","last_peered":"2024-09-12T01:03:08.241251+0000","last_clean":"2024-09-12T01:03:08.241251+0000","last_became_active":"2024-09-12T00:15:59.039674+0000","last_became_peered":"2024-09-12T00:15:59.039674+0000","last_unstale":"2024-09-12T01:03:08.241251+0000","last_undegraded":"2024-09-12T01:03:08.241251+0000","last_fullsized":"2024-09-12T01:03:08.241251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:08.241064+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:08.241064+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.241064+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:41.346192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"268'350","reported_seq":961,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.584868+0000","last_change":"2024-09-12T01:03:19.584713+0000","last_active":"2024-09-12T01:03:19.584868+0000","last_peered":"2024-09-12T01:03:19.584868+0000","last_clean":"2024-09-12T01:03:19.584868+0000","last_became_active":"2024-09-12T00:16:01.051324+0000","last_became_peered":"2024-09-12T00:16:01.051324+0000","last_unstale":"2024-09-12T01:03:19.584868+0000","last_undegraded":"2024-09-12T01:03:19.584868+0000","last_fullsized":"2024-09-12T01:03:19.584868+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T01:03:19.584505+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T01:03:19.584505+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.584505+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:32.091357+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49632,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":580,"num_read_kb":1323,"num_write":476,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.348005+0000","last_change":"2024-09-12T01:03:19.347866+0000","last_active":"2024-09-12T01:03:19.348005+0000","last_peered":"2024-09-12T01:03:19.348005+0000","last_clean":"2024-09-12T01:03:19.348005+0000","last_became_active":"2024-09-12T00:16:03.099836+0000","last_became_peered":"2024-09-12T00:16:03.099836+0000","last_unstale":"2024-09-12T01:03:19.348005+0000","last_undegraded":"2024-09-12T01:03:19.348005+0000","last_fullsized":"2024-09-12T01:03:19.348005+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:19.347683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:19.347683+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.347683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:54.373409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"268'116","reported_seq":617,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.623160+0000","last_change":"2024-09-12T01:03:08.623160+0000","last_active":"2024-09-12T01:03:08.623160+0000","last_peered":"2024-09-12T01:03:08.623160+0000","last_clean":"2024-09-12T01:03:08.623160+0000","last_became_active":"2024-09-12T00:16:05.113231+0000","last_became_peered":"2024-09-12T00:16:05.113231+0000","last_unstale":"2024-09-12T01:03:08.623160+0000","last_undegraded":"2024-09-12T01:03:08.623160+0000","last_fullsized":"2024-09-12T01:03:08.623160+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'116","last_scrub_stamp":"2024-09-12T01:03:08.622957+0000","last_deep_scrub":"268'116","last_deep_scrub_stamp":"2024-09-12T01:03:08.622957+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.622957+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:44.955515+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":663,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":263,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"268'812","reported_seq":2408,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.098804+0000","last_change":"2024-09-12T01:02:59.098674+0000","last_active":"2024-09-12T01:02:59.098804+0000","last_peered":"2024-09-12T01:02:59.098804+0000","last_clean":"2024-09-12T01:02:59.098804+0000","last_became_active":"2024-09-12T00:15:57.031161+0000","last_became_peered":"2024-09-12T00:15:57.031161+0000","last_unstale":"2024-09-12T01:02:59.098804+0000","last_undegraded":"2024-09-12T01:02:59.098804+0000","last_fullsized":"2024-09-12T01:02:59.098804+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'812","last_scrub_stamp":"2024-09-12T01:02:59.098486+0000","last_deep_scrub":"268'812","last_deep_scrub_stamp":"2024-09-12T01:02:59.098486+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.098486+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:40.804950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3882,"num_read_kb":3503,"num_write":1069,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"268'350","reported_seq":1124,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.589310+0000","last_change":"2024-09-12T01:02:48.589310+0000","last_active":"2024-09-12T01:02:48.589310+0000","last_peered":"2024-09-12T01:02:48.589310+0000","last_clean":"2024-09-12T01:02:48.589310+0000","last_became_active":"2024-09-12T00:15:55.042134+0000","last_became_peered":"2024-09-12T00:15:55.042134+0000","last_unstale":"2024-09-12T01:02:48.589310+0000","last_undegraded":"2024-09-12T01:02:48.589310+0000","last_fullsized":"2024-09-12T01:02:48.589310+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T01:02:48.589008+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T01:02:48.589008+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.589008+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:56.525969+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918005,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":861,"num_read_kb":50816,"num_write":1243,"num_write_kb":44406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'404","reported_seq":1867,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.734420+0000","last_change":"2024-09-12T01:02:56.734203+0000","last_active":"2024-09-12T01:02:56.734420+0000","last_peered":"2024-09-12T01:02:56.734420+0000","last_clean":"2024-09-12T01:02:56.734420+0000","last_became_active":"2024-09-12T00:15:57.043013+0000","last_became_peered":"2024-09-12T00:15:57.043013+0000","last_unstale":"2024-09-12T01:02:56.734420+0000","last_undegraded":"2024-09-12T01:02:56.734420+0000","last_fullsized":"2024-09-12T01:02:56.734420+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'404","last_scrub_stamp":"2024-09-12T01:02:56.734008+0000","last_deep_scrub":"268'404","last_deep_scrub_stamp":"2024-09-12T01:02:56.734008+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.734008+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:54.403896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2106,"num_read_kb":1998,"num_write":459,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"268'302","reported_seq":937,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.702227+0000","last_change":"2024-09-12T01:02:48.702227+0000","last_active":"2024-09-12T01:02:48.702227+0000","last_peered":"2024-09-12T01:02:48.702227+0000","last_clean":"2024-09-12T01:02:48.702227+0000","last_became_active":"2024-09-12T00:15:55.062524+0000","last_became_peered":"2024-09-12T00:15:55.062524+0000","last_unstale":"2024-09-12T01:02:48.702227+0000","last_undegraded":"2024-09-12T01:02:48.702227+0000","last_fullsized":"2024-09-12T01:02:48.702227+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'302","last_scrub_stamp":"2024-09-12T01:02:48.701961+0000","last_deep_scrub":"268'302","last_deep_scrub_stamp":"2024-09-12T01:02:48.701961+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.701961+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:23.572921+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291481,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":18226,"num_write":893,"num_write_kb":43043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"268'497","reported_seq":2222,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.575417+0000","last_change":"2024-09-12T01:03:06.575277+0000","last_active":"2024-09-12T01:03:06.575417+0000","last_peered":"2024-09-12T01:03:06.575417+0000","last_clean":"2024-09-12T01:03:06.575417+0000","last_became_active":"2024-09-12T00:15:57.018875+0000","last_became_peered":"2024-09-12T00:15:57.018875+0000","last_unstale":"2024-09-12T01:03:06.575417+0000","last_undegraded":"2024-09-12T01:03:06.575417+0000","last_fullsized":"2024-09-12T01:03:06.575417+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'497","last_scrub_stamp":"2024-09-12T01:03:06.575054+0000","last_deep_scrub":"268'497","last_deep_scrub_stamp":"2024-09-12T01:03:06.575054+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.575054+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:10.216944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2775,"num_read_kb":2615,"num_write":593,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1776,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"268'360","reported_seq":1018,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.598437+0000","last_change":"2024-09-12T01:02:53.598437+0000","last_active":"2024-09-12T01:02:53.598437+0000","last_peered":"2024-09-12T01:02:53.598437+0000","last_clean":"2024-09-12T01:02:53.598437+0000","last_became_active":"2024-09-12T00:15:55.063603+0000","last_became_peered":"2024-09-12T00:15:55.063603+0000","last_unstale":"2024-09-12T01:02:53.598437+0000","last_undegraded":"2024-09-12T01:02:53.598437+0000","last_fullsized":"2024-09-12T01:02:53.598437+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'360","last_scrub_stamp":"2024-09-12T01:02:53.598203+0000","last_deep_scrub":"268'360","last_deep_scrub_stamp":"2024-09-12T01:02:53.598203+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.598203+0000","objects_scrubbed":7,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:20.298117+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055186,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":518,"num_read_kb":3291,"num_write":1136,"num_write_kb":12783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"268'394","reported_seq":1810,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.506241+0000","last_change":"2024-09-12T01:03:06.505984+0000","last_active":"2024-09-12T01:03:06.506241+0000","last_peered":"2024-09-12T01:03:06.506241+0000","last_clean":"2024-09-12T01:03:06.506241+0000","last_became_active":"2024-09-12T00:15:57.030173+0000","last_became_peered":"2024-09-12T00:15:57.030173+0000","last_unstale":"2024-09-12T01:03:06.506241+0000","last_undegraded":"2024-09-12T01:03:06.506241+0000","last_fullsized":"2024-09-12T01:03:06.506241+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T01:03:06.505753+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T01:03:06.505753+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.505753+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:29.265131+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2013,"num_read_kb":1910,"num_write":436,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":961,"num_omap_keys":4,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"268'370","reported_seq":1121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.286233+0000","last_change":"2024-09-12T01:02:52.286233+0000","last_active":"2024-09-12T01:02:52.286233+0000","last_peered":"2024-09-12T01:02:52.286233+0000","last_clean":"2024-09-12T01:02:52.286233+0000","last_became_active":"2024-09-12T00:15:55.068349+0000","last_became_peered":"2024-09-12T00:15:55.068349+0000","last_unstale":"2024-09-12T01:02:52.286233+0000","last_undegraded":"2024-09-12T01:02:52.286233+0000","last_fullsized":"2024-09-12T01:02:52.286233+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-12T01:02:52.285815+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-12T01:02:52.285815+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.285815+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:42.779294+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5530690,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":847,"num_read_kb":11363,"num_write":1205,"num_write_kb":51000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"268'400","reported_seq":1892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.517091+0000","last_change":"2024-09-12T01:03:04.517091+0000","last_active":"2024-09-12T01:03:04.517091+0000","last_peered":"2024-09-12T01:03:04.517091+0000","last_clean":"2024-09-12T01:03:04.517091+0000","last_became_active":"2024-09-12T00:15:57.037204+0000","last_became_peered":"2024-09-12T00:15:57.037204+0000","last_unstale":"2024-09-12T01:03:04.517091+0000","last_undegraded":"2024-09-12T01:03:04.517091+0000","last_fullsized":"2024-09-12T01:03:04.517091+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'400","last_scrub_stamp":"2024-09-12T01:03:04.516852+0000","last_deep_scrub":"268'400","last_deep_scrub_stamp":"2024-09-12T01:03:04.516852+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.516852+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:17.030355+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2120,"num_read_kb":2017,"num_write":453,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"268'338","reported_seq":982,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.070834+0000","last_change":"2024-09-12T01:02:50.070517+0000","last_active":"2024-09-12T01:02:50.070834+0000","last_peered":"2024-09-12T01:02:50.070834+0000","last_clean":"2024-09-12T01:02:50.070834+0000","last_became_active":"2024-09-12T00:15:55.071812+0000","last_became_peered":"2024-09-12T00:15:55.071812+0000","last_unstale":"2024-09-12T01:02:50.070834+0000","last_undegraded":"2024-09-12T01:02:50.070834+0000","last_fullsized":"2024-09-12T01:02:50.070834+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'338","last_scrub_stamp":"2024-09-12T01:02:50.070156+0000","last_deep_scrub":"268'338","last_deep_scrub_stamp":"2024-09-12T01:02:50.070156+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.070156+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:07.290148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1919077,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":11487,"num_write":1134,"num_write_kb":34407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"268'584","reported_seq":2274,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.591872+0000","last_change":"2024-09-12T01:02:53.591872+0000","last_active":"2024-09-12T01:02:53.591872+0000","last_peered":"2024-09-12T01:02:53.591872+0000","last_clean":"2024-09-12T01:02:53.591872+0000","last_became_active":"2024-09-12T00:15:57.032818+0000","last_became_peered":"2024-09-12T00:15:57.032818+0000","last_unstale":"2024-09-12T01:02:53.591872+0000","last_undegraded":"2024-09-12T01:02:53.591872+0000","last_fullsized":"2024-09-12T01:02:53.591872+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'584","last_scrub_stamp":"2024-09-12T01:02:53.591627+0000","last_deep_scrub":"268'584","last_deep_scrub_stamp":"2024-09-12T01:02:53.591627+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.591627+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:25.471327+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2922,"num_read_kb":2722,"num_write":707,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"268'345","reported_seq":1030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.024847+0000","last_change":"2024-09-12T01:02:51.024703+0000","last_active":"2024-09-12T01:02:51.024847+0000","last_peered":"2024-09-12T01:02:51.024847+0000","last_clean":"2024-09-12T01:02:51.024847+0000","last_became_active":"2024-09-12T00:15:55.050781+0000","last_became_peered":"2024-09-12T00:15:55.050781+0000","last_unstale":"2024-09-12T01:02:51.024847+0000","last_undegraded":"2024-09-12T01:02:51.024847+0000","last_fullsized":"2024-09-12T01:02:51.024847+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'345","last_scrub_stamp":"2024-09-12T01:02:51.024453+0000","last_deep_scrub":"268'345","last_deep_scrub_stamp":"2024-09-12T01:02:51.024453+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.024453+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:07.021452+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432541,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":494,"num_read_kb":31947,"num_write":1072,"num_write_kb":41212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"268'801","reported_seq":2295,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.033726+0000","last_change":"2024-09-12T01:02:59.033726+0000","last_active":"2024-09-12T01:02:59.033726+0000","last_peered":"2024-09-12T01:02:59.033726+0000","last_clean":"2024-09-12T01:02:59.033726+0000","last_became_active":"2024-09-12T00:15:57.045500+0000","last_became_peered":"2024-09-12T00:15:57.045500+0000","last_unstale":"2024-09-12T01:02:59.033726+0000","last_undegraded":"2024-09-12T01:02:59.033726+0000","last_fullsized":"2024-09-12T01:02:59.033726+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'801","last_scrub_stamp":"2024-09-12T01:02:59.033539+0000","last_deep_scrub":"268'801","last_deep_scrub_stamp":"2024-09-12T01:02:59.033539+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.033539+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.520622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3817,"num_read_kb":3427,"num_write":1098,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"268'312","reported_seq":943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.668203+0000","last_change":"2024-09-12T01:02:54.668061+0000","last_active":"2024-09-12T01:02:54.668203+0000","last_peered":"2024-09-12T01:02:54.668203+0000","last_clean":"2024-09-12T01:02:54.668203+0000","last_became_active":"2024-09-12T00:15:55.054914+0000","last_became_peered":"2024-09-12T00:15:55.054914+0000","last_unstale":"2024-09-12T01:02:54.668203+0000","last_undegraded":"2024-09-12T01:02:54.668203+0000","last_fullsized":"2024-09-12T01:02:54.668203+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'312","last_scrub_stamp":"2024-09-12T01:02:54.667783+0000","last_deep_scrub":"268'312","last_deep_scrub_stamp":"2024-09-12T01:02:54.667783+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.667783+0000","objects_scrubbed":9,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:58.504933+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262244,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":420,"num_read_kb":50634,"num_write":965,"num_write_kb":37363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"268'819","reported_seq":2520,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.205241+0000","last_change":"2024-09-12T01:02:52.205241+0000","last_active":"2024-09-12T01:02:52.205241+0000","last_peered":"2024-09-12T01:02:52.205241+0000","last_clean":"2024-09-12T01:02:52.205241+0000","last_became_active":"2024-09-12T00:15:57.021622+0000","last_became_peered":"2024-09-12T00:15:57.021622+0000","last_unstale":"2024-09-12T01:02:52.205241+0000","last_undegraded":"2024-09-12T01:02:52.205241+0000","last_fullsized":"2024-09-12T01:02:52.205241+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'819","last_scrub_stamp":"2024-09-12T01:02:52.205058+0000","last_deep_scrub":"268'819","last_deep_scrub_stamp":"2024-09-12T01:02:52.205058+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.205058+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:06.846282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4035,"num_read_kb":3684,"num_write":1067,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2043,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"268'352","reported_seq":1010,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.342132+0000","last_change":"2024-09-12T01:02:54.341830+0000","last_active":"2024-09-12T01:02:54.342132+0000","last_peered":"2024-09-12T01:02:54.342132+0000","last_clean":"2024-09-12T01:02:54.342132+0000","last_became_active":"2024-09-12T00:15:55.055929+0000","last_became_peered":"2024-09-12T00:15:55.055929+0000","last_unstale":"2024-09-12T01:02:54.342132+0000","last_undegraded":"2024-09-12T01:02:54.342132+0000","last_fullsized":"2024-09-12T01:02:54.342132+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'352","last_scrub_stamp":"2024-09-12T01:02:54.341405+0000","last_deep_scrub":"268'352","last_deep_scrub_stamp":"2024-09-12T01:02:54.341405+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.341405+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:10.803620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":553,"num_read_kb":589,"num_write":1208,"num_write_kb":30899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"268'838","reported_seq":2512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.745029+0000","last_change":"2024-09-12T01:02:58.745029+0000","last_active":"2024-09-12T01:02:58.745029+0000","last_peered":"2024-09-12T01:02:58.745029+0000","last_clean":"2024-09-12T01:02:58.745029+0000","last_became_active":"2024-09-12T00:15:57.039946+0000","last_became_peered":"2024-09-12T00:15:57.039946+0000","last_unstale":"2024-09-12T01:02:58.745029+0000","last_undegraded":"2024-09-12T01:02:58.745029+0000","last_fullsized":"2024-09-12T01:02:58.745029+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'838","last_scrub_stamp":"2024-09-12T01:02:58.744791+0000","last_deep_scrub":"268'838","last_deep_scrub_stamp":"2024-09-12T01:02:58.744791+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.744791+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:14.176919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4272,"num_read_kb":3874,"num_write":1144,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"268'428","reported_seq":1165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.585054+0000","last_change":"2024-09-12T01:03:01.585054+0000","last_active":"2024-09-12T01:03:01.585054+0000","last_peered":"2024-09-12T01:03:01.585054+0000","last_clean":"2024-09-12T01:03:01.585054+0000","last_became_active":"2024-09-12T00:15:55.065129+0000","last_became_peered":"2024-09-12T00:15:55.065129+0000","last_unstale":"2024-09-12T01:03:01.585054+0000","last_undegraded":"2024-09-12T01:03:01.585054+0000","last_fullsized":"2024-09-12T01:03:01.585054+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'428","last_scrub_stamp":"2024-09-12T01:03:01.584779+0000","last_deep_scrub":"268'428","last_deep_scrub_stamp":"2024-09-12T01:03:01.584779+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.584779+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:46.193473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170166,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":788,"num_read_kb":24149,"num_write":1329,"num_write_kb":32019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"268'878","reported_seq":2664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.582210+0000","last_change":"2024-09-12T01:02:54.582210+0000","last_active":"2024-09-12T01:02:54.582210+0000","last_peered":"2024-09-12T01:02:54.582210+0000","last_clean":"2024-09-12T01:02:54.582210+0000","last_became_active":"2024-09-12T00:15:57.051976+0000","last_became_peered":"2024-09-12T00:15:57.051976+0000","last_unstale":"2024-09-12T01:02:54.582210+0000","last_undegraded":"2024-09-12T01:02:54.582210+0000","last_fullsized":"2024-09-12T01:02:54.582210+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'878","last_scrub_stamp":"2024-09-12T01:02:54.581985+0000","last_deep_scrub":"268'878","last_deep_scrub_stamp":"2024-09-12T01:02:54.581985+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.581985+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":800,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:29.512097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4749,"num_read_kb":4328,"num_write":1184,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3450,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"268'343","reported_seq":980,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.325668+0000","last_change":"2024-09-12T01:02:53.325419+0000","last_active":"2024-09-12T01:02:53.325668+0000","last_peered":"2024-09-12T01:02:53.325668+0000","last_clean":"2024-09-12T01:02:53.325668+0000","last_became_active":"2024-09-12T00:15:55.055449+0000","last_became_peered":"2024-09-12T00:15:55.055449+0000","last_unstale":"2024-09-12T01:02:53.325668+0000","last_undegraded":"2024-09-12T01:02:53.325668+0000","last_fullsized":"2024-09-12T01:02:53.325668+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'343","last_scrub_stamp":"2024-09-12T01:02:53.325099+0000","last_deep_scrub":"268'343","last_deep_scrub_stamp":"2024-09-12T01:02:53.325099+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.325099+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:04.425777+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":2263,"num_write":1082,"num_write_kb":24139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"268'790","reported_seq":2378,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.480115+0000","last_change":"2024-09-12T01:03:05.479981+0000","last_active":"2024-09-12T01:03:05.480115+0000","last_peered":"2024-09-12T01:03:05.480115+0000","last_clean":"2024-09-12T01:03:05.480115+0000","last_became_active":"2024-09-12T00:15:57.031976+0000","last_became_peered":"2024-09-12T00:15:57.031976+0000","last_unstale":"2024-09-12T01:03:05.480115+0000","last_undegraded":"2024-09-12T01:03:05.480115+0000","last_fullsized":"2024-09-12T01:03:05.480115+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'790","last_scrub_stamp":"2024-09-12T01:03:05.479793+0000","last_deep_scrub":"268'790","last_deep_scrub_stamp":"2024-09-12T01:03:05.479793+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.479793+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:48.321978+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3862,"num_read_kb":3503,"num_write":1033,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"268'359","reported_seq":1018,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.167331+0000","last_change":"2024-09-12T01:02:48.167146+0000","last_active":"2024-09-12T01:02:48.167331+0000","last_peered":"2024-09-12T01:02:48.167331+0000","last_clean":"2024-09-12T01:02:48.167331+0000","last_became_active":"2024-09-12T00:15:55.051451+0000","last_became_peered":"2024-09-12T00:15:55.051451+0000","last_unstale":"2024-09-12T01:02:48.167331+0000","last_undegraded":"2024-09-12T01:02:48.167331+0000","last_fullsized":"2024-09-12T01:02:48.167331+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T01:02:48.166882+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T01:02:48.166882+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.166882+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:13.746661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263237,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":17816,"num_write":1180,"num_write_kb":26945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"268'485","reported_seq":2170,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.125316+0000","last_change":"2024-09-12T01:02:56.125082+0000","last_active":"2024-09-12T01:02:56.125316+0000","last_peered":"2024-09-12T01:02:56.125316+0000","last_clean":"2024-09-12T01:02:56.125316+0000","last_became_active":"2024-09-12T00:15:57.019963+0000","last_became_peered":"2024-09-12T00:15:57.019963+0000","last_unstale":"2024-09-12T01:02:56.125316+0000","last_undegraded":"2024-09-12T01:02:56.125316+0000","last_fullsized":"2024-09-12T01:02:56.125316+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'485","last_scrub_stamp":"2024-09-12T01:02:56.124868+0000","last_deep_scrub":"268'485","last_deep_scrub_stamp":"2024-09-12T01:02:56.124868+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.124868+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:10.557945+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2585,"num_read_kb":2455,"num_write":555,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":983,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"268'290","reported_seq":923,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.093495+0000","last_change":"2024-09-12T01:02:58.093202+0000","last_active":"2024-09-12T01:02:58.093495+0000","last_peered":"2024-09-12T01:02:58.093495+0000","last_clean":"2024-09-12T01:02:58.093495+0000","last_became_active":"2024-09-12T00:15:55.050267+0000","last_became_peered":"2024-09-12T00:15:55.050267+0000","last_unstale":"2024-09-12T01:02:58.093495+0000","last_undegraded":"2024-09-12T01:02:58.093495+0000","last_fullsized":"2024-09-12T01:02:58.093495+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'290","last_scrub_stamp":"2024-09-12T01:02:58.092896+0000","last_deep_scrub":"268'290","last_deep_scrub_stamp":"2024-09-12T01:02:58.092896+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.092896+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:16.075277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":8617,"num_write":1019,"num_write_kb":22964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1340","reported_seq":3159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.183746+0000","last_change":"2024-09-12T01:02:53.183498+0000","last_active":"2024-09-12T01:02:53.183746+0000","last_peered":"2024-09-12T01:02:53.183746+0000","last_clean":"2024-09-12T01:02:53.183746+0000","last_became_active":"2024-09-12T00:15:57.045076+0000","last_became_peered":"2024-09-12T00:15:57.045076+0000","last_unstale":"2024-09-12T01:02:53.183746+0000","last_undegraded":"2024-09-12T01:02:53.183746+0000","last_fullsized":"2024-09-12T01:02:53.183746+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1340","last_scrub_stamp":"2024-09-12T01:02:53.183271+0000","last_deep_scrub":"268'1340","last_deep_scrub_stamp":"2024-09-12T01:02:53.183271+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.183271+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":1300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:32.397326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6209,"num_read_kb":5540,"num_write":1861,"num_write_kb":794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"268'321","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.576244+0000","last_change":"2024-09-12T01:02:52.576069+0000","last_active":"2024-09-12T01:02:52.576244+0000","last_peered":"2024-09-12T01:02:52.576244+0000","last_clean":"2024-09-12T01:02:52.576244+0000","last_became_active":"2024-09-12T00:15:55.061287+0000","last_became_peered":"2024-09-12T00:15:55.061287+0000","last_unstale":"2024-09-12T01:02:52.576244+0000","last_undegraded":"2024-09-12T01:02:52.576244+0000","last_fullsized":"2024-09-12T01:02:52.576244+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'321","last_scrub_stamp":"2024-09-12T01:02:52.575842+0000","last_deep_scrub":"268'321","last_deep_scrub_stamp":"2024-09-12T01:02:52.575842+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.575842+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:54.370349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":733,"num_write":1216,"num_write_kb":3677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"268'406","reported_seq":1782,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.700207+0000","last_change":"2024-09-12T01:02:55.700063+0000","last_active":"2024-09-12T01:02:55.700207+0000","last_peered":"2024-09-12T01:02:55.700207+0000","last_clean":"2024-09-12T01:02:55.700207+0000","last_became_active":"2024-09-12T00:15:57.043158+0000","last_became_peered":"2024-09-12T00:15:57.043158+0000","last_unstale":"2024-09-12T01:02:55.700207+0000","last_undegraded":"2024-09-12T01:02:55.700207+0000","last_fullsized":"2024-09-12T01:02:55.700207+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'406","last_scrub_stamp":"2024-09-12T01:02:55.699871+0000","last_deep_scrub":"268'406","last_deep_scrub_stamp":"2024-09-12T01:02:55.699871+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.699871+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:04.239689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1978,"num_read_kb":1859,"num_write":462,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"268'386","reported_seq":1081,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.568297+0000","last_change":"2024-09-12T01:02:58.568150+0000","last_active":"2024-09-12T01:02:58.568297+0000","last_peered":"2024-09-12T01:02:58.568297+0000","last_clean":"2024-09-12T01:02:58.568297+0000","last_became_active":"2024-09-12T00:15:55.058726+0000","last_became_peered":"2024-09-12T00:15:55.058726+0000","last_unstale":"2024-09-12T01:02:58.568297+0000","last_undegraded":"2024-09-12T01:02:58.568297+0000","last_fullsized":"2024-09-12T01:02:58.568297+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'386","last_scrub_stamp":"2024-09-12T01:02:58.567923+0000","last_deep_scrub":"268'386","last_deep_scrub_stamp":"2024-09-12T01:02:58.567923+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.567923+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:21.225474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549415,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":603,"num_read_kb":57120,"num_write":1303,"num_write_kb":58223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"268'1346","reported_seq":2841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.143246+0000","last_change":"2024-09-12T01:03:00.143067+0000","last_active":"2024-09-12T01:03:00.143246+0000","last_peered":"2024-09-12T01:03:00.143246+0000","last_clean":"2024-09-12T01:03:00.143246+0000","last_became_active":"2024-09-12T00:15:57.043227+0000","last_became_peered":"2024-09-12T00:15:57.043227+0000","last_unstale":"2024-09-12T01:03:00.143246+0000","last_undegraded":"2024-09-12T01:03:00.143246+0000","last_fullsized":"2024-09-12T01:03:00.143246+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1346","last_scrub_stamp":"2024-09-12T01:03:00.142862+0000","last_deep_scrub":"268'1346","last_deep_scrub_stamp":"2024-09-12T01:03:00.142862+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.142862+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":1300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:03.208839+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5913,"num_read_kb":5121,"num_write":1910,"num_write_kb":821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"268'294","reported_seq":944,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.730311+0000","last_change":"2024-09-12T01:02:51.730311+0000","last_active":"2024-09-12T01:02:51.730311+0000","last_peered":"2024-09-12T01:02:51.730311+0000","last_clean":"2024-09-12T01:02:51.730311+0000","last_became_active":"2024-09-12T00:15:55.052287+0000","last_became_peered":"2024-09-12T00:15:55.052287+0000","last_unstale":"2024-09-12T01:02:51.730311+0000","last_undegraded":"2024-09-12T01:02:51.730311+0000","last_fullsized":"2024-09-12T01:02:51.730311+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'294","last_scrub_stamp":"2024-09-12T01:02:51.729966+0000","last_deep_scrub":"268'294","last_deep_scrub_stamp":"2024-09-12T01:02:51.729966+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.729966+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:44.447259+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947345,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":476,"num_read_kb":19752,"num_write":916,"num_write_kb":40992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"268'335","reported_seq":1754,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.134930+0000","last_change":"2024-09-12T01:02:54.134671+0000","last_active":"2024-09-12T01:02:54.134930+0000","last_peered":"2024-09-12T01:02:54.134930+0000","last_clean":"2024-09-12T01:02:54.134930+0000","last_became_active":"2024-09-12T00:15:57.039633+0000","last_became_peered":"2024-09-12T00:15:57.039633+0000","last_unstale":"2024-09-12T01:02:54.134930+0000","last_undegraded":"2024-09-12T01:02:54.134930+0000","last_fullsized":"2024-09-12T01:02:54.134930+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'335","last_scrub_stamp":"2024-09-12T01:02:54.134447+0000","last_deep_scrub":"268'335","last_deep_scrub_stamp":"2024-09-12T01:02:54.134447+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.134447+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:37.275755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1924,"num_read_kb":1842,"num_write":397,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"268'332","reported_seq":1022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.525046+0000","last_change":"2024-09-12T01:02:59.525046+0000","last_active":"2024-09-12T01:02:59.525046+0000","last_peered":"2024-09-12T01:02:59.525046+0000","last_clean":"2024-09-12T01:02:59.525046+0000","last_became_active":"2024-09-12T00:15:55.054952+0000","last_became_peered":"2024-09-12T00:15:55.054952+0000","last_unstale":"2024-09-12T01:02:59.525046+0000","last_undegraded":"2024-09-12T01:02:59.525046+0000","last_fullsized":"2024-09-12T01:02:59.525046+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'332","last_scrub_stamp":"2024-09-12T01:02:59.524837+0000","last_deep_scrub":"268'332","last_deep_scrub_stamp":"2024-09-12T01:02:59.524837+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.524837+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:40.714134+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109426,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":117939,"num_write":959,"num_write_kb":46136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"268'394","reported_seq":1060,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.601429+0000","last_change":"2024-09-12T01:03:04.601429+0000","last_active":"2024-09-12T01:03:04.601429+0000","last_peered":"2024-09-12T01:03:04.601429+0000","last_clean":"2024-09-12T01:03:04.601429+0000","last_became_active":"2024-09-12T00:15:55.052320+0000","last_became_peered":"2024-09-12T00:15:55.052320+0000","last_unstale":"2024-09-12T01:03:04.601429+0000","last_undegraded":"2024-09-12T01:03:04.601429+0000","last_fullsized":"2024-09-12T01:03:04.601429+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T01:03:04.601179+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T01:03:04.601179+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.601179+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:40.828736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":13865,"num_write":1350,"num_write_kb":55041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"268'477","reported_seq":2101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.187209+0000","last_change":"2024-09-12T01:03:02.187209+0000","last_active":"2024-09-12T01:03:02.187209+0000","last_peered":"2024-09-12T01:03:02.187209+0000","last_clean":"2024-09-12T01:03:02.187209+0000","last_became_active":"2024-09-12T00:15:57.054996+0000","last_became_peered":"2024-09-12T00:15:57.054996+0000","last_unstale":"2024-09-12T01:03:02.187209+0000","last_undegraded":"2024-09-12T01:03:02.187209+0000","last_fullsized":"2024-09-12T01:03:02.187209+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'477","last_scrub_stamp":"2024-09-12T01:03:02.187021+0000","last_deep_scrub":"268'477","last_deep_scrub_stamp":"2024-09-12T01:03:02.187021+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.187021+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:43.118548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2784,"num_read_kb":2618,"num_write":619,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2539,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"268'328","reported_seq":955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.387452+0000","last_change":"2024-09-12T01:02:55.387452+0000","last_active":"2024-09-12T01:02:55.387452+0000","last_peered":"2024-09-12T01:02:55.387452+0000","last_clean":"2024-09-12T01:02:55.387452+0000","last_became_active":"2024-09-12T00:15:55.078832+0000","last_became_peered":"2024-09-12T00:15:55.078832+0000","last_unstale":"2024-09-12T01:02:55.387452+0000","last_undegraded":"2024-09-12T01:02:55.387452+0000","last_fullsized":"2024-09-12T01:02:55.387452+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'328","last_scrub_stamp":"2024-09-12T01:02:55.387211+0000","last_deep_scrub":"268'328","last_deep_scrub_stamp":"2024-09-12T01:02:55.387211+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.387211+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:04.897261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262198,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":33208,"num_write":990,"num_write_kb":34373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"268'953","reported_seq":2379,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.151228+0000","last_change":"2024-09-12T01:02:59.151228+0000","last_active":"2024-09-12T01:02:59.151228+0000","last_peered":"2024-09-12T01:02:59.151228+0000","last_clean":"2024-09-12T01:02:59.151228+0000","last_became_active":"2024-09-12T00:15:57.027565+0000","last_became_peered":"2024-09-12T00:15:57.027565+0000","last_unstale":"2024-09-12T01:02:59.151228+0000","last_undegraded":"2024-09-12T01:02:59.151228+0000","last_fullsized":"2024-09-12T01:02:59.151228+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'953","last_scrub_stamp":"2024-09-12T01:02:59.151013+0000","last_deep_scrub":"268'953","last_deep_scrub_stamp":"2024-09-12T01:02:59.151013+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.151013+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":900,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:17.674152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4238,"num_read_kb":3802,"num_write":1335,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6185,"num_read_kb":4382,"num_write":1972,"num_write_kb":869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7269,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1045,"ondisk_log_size":1045,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15033,"num_read_kb":14688,"num_write":16727,"num_write_kb":4883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2756,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1350,"ondisk_log_size":1350,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":509,"ondisk_log_size":509,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1515596,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":17695,"num_read_kb":36825,"num_write":14793,"num_write_kb":11553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":683890,"num_omap_keys":1566,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1901,"ondisk_log_size":1901,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2876,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212032,"num_read_kb":193923,"num_write":55063,"num_write_kb":18681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43786,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4204,"ondisk_log_size":4204,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":91096211,"num_objects":373,"num_object_clones":0,"num_object_copies":1492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":373,"num_whiteouts":0,"num_read":36044,"num_read_kb":1967370,"num_write":71560,"num_write_kb":2158407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":123895808,"data_stored":123895808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3636,"ondisk_log_size":3636,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":197046,"num_write":158,"num_write_kb":127402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":185778,"num_write":158,"num_write_kb":127402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719477317,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249092,"kb_used_data":19380,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122748,"statfs":{"total":96636764160,"available":96381693952,"internally_reserved":0,"allocated":19845120,"data_stored":17804594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510025,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114752,"kb_used_data":15536,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94257088,"statfs":{"total":96636764160,"available":96519258112,"internally_reserved":0,"allocated":15908864,"data_stored":13884114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510023,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252652,"kb_used_data":18844,"kb_used_omap":1,"kb_used_meta":233790,"kb_avail":94119188,"statfs":{"total":96636764160,"available":96378048512,"internally_reserved":0,"allocated":19296256,"data_stored":17280849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239401413},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510025,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189312,"kb_used_data":23472,"kb_used_omap":1,"kb_used_meta":165822,"kb_avail":94182528,"statfs":{"total":96636764160,"available":96442908672,"internally_reserved":0,"allocated":24035328,"data_stored":22022383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169802181},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510024,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":350924,"kb_used_data":18492,"kb_used_omap":1,"kb_used_meta":332414,"kb_avail":94020916,"statfs":{"total":96636764160,"available":96277417984,"internally_reserved":0,"allocated":18935808,"data_stored":16894352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":340392389},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510023,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138540,"kb_used_data":21276,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94233300,"statfs":{"total":96636764160,"available":96494899200,"internally_reserved":0,"allocated":21786624,"data_stored":19750277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542729,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":270872,"kb_used_data":19016,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94100968,"statfs":{"total":96636764160,"available":96359391232,"internally_reserved":0,"allocated":19472384,"data_stored":17479323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":257882570},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542727,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281208,"kb_used_data":19560,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94090632,"statfs":{"total":96636764160,"available":96348807168,"internally_reserved":0,"allocated":20029440,"data_stored":18004914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17494016,"data_stored":17494016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14049280,"data_stored":14049280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19767296,"data_stored":19767296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15548416,"data_stored":15548416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15024128,"data_stored":15024128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15159296,"data_stored":15159296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11628544,"data_stored":11628544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15224832,"data_stored":15224832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:03:48.999 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:48.999 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:32:23.956284+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=23, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:49.000 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:49.000 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:49.000 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:49.001 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:49.001 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:49.001 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:32:26.997731+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=32, tm_sec=26, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:49.001 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:43:47.215582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:03:49.004 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:04:09.006 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:04:09.372 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-09-12T01:04:09.384 INFO:teuthology.orchestra.run.smithi138.stderr:dumped all 2024-09-12T01:04:09.397 INFO:teuthology.orchestra.run.smithi138.stdout:{"pg_ready":true,"pg_map":{"version":1719,"stamp":"2024-09-12T01:04:08.879877+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":93219632,"num_objects":867,"num_object_clones":0,"num_object_copies":2480,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":867,"num_whiteouts":0,"num_read":289757,"num_read_kb":2602955,"num_write":160574,"num_write_kb":2450853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":203,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":738829,"num_omap_keys":1787,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12950,"ondisk_log_size":12950,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1847352,"kb_used_data":155576,"kb_used_omap":12,"kb_used_meta":1691635,"kb_avail":753127368,"statfs":{"total":773094113280,"available":771202424832,"internally_reserved":0,"allocated":159309824,"data_stored":143120806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1732234800},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008091"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.676823+0000","last_change":"2024-09-12T01:03:21.676684+0000","last_active":"2024-09-12T01:03:21.676823+0000","last_peered":"2024-09-12T01:03:21.676823+0000","last_clean":"2024-09-12T01:03:21.676823+0000","last_became_active":"2024-09-12T00:43:48.282777+0000","last_became_peered":"2024-09-12T00:43:48.282777+0000","last_unstale":"2024-09-12T01:03:21.676823+0000","last_undegraded":"2024-09-12T01:03:21.676823+0000","last_fullsized":"2024-09-12T01:03:21.676823+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:21.676466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:21.676466+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.676466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:10.480447+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"268'2","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.259246+0000","last_change":"2024-09-12T01:03:21.259246+0000","last_active":"2024-09-12T01:03:21.259246+0000","last_peered":"2024-09-12T01:03:21.259246+0000","last_clean":"2024-09-12T01:03:21.259246+0000","last_became_active":"2024-09-12T00:32:28.069841+0000","last_became_peered":"2024-09-12T00:32:28.069841+0000","last_unstale":"2024-09-12T01:03:21.259246+0000","last_undegraded":"2024-09-12T01:03:21.259246+0000","last_fullsized":"2024-09-12T01:03:21.259246+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:21.259008+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:21.259008+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.259008+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:27.097291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"265'3","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.820216+0000","last_change":"2024-09-12T01:03:24.820216+0000","last_active":"2024-09-12T01:03:24.820216+0000","last_peered":"2024-09-12T01:03:24.820216+0000","last_clean":"2024-09-12T01:03:24.820216+0000","last_became_active":"2024-09-12T00:32:25.026726+0000","last_became_peered":"2024-09-12T00:32:25.026726+0000","last_unstale":"2024-09-12T01:03:24.820216+0000","last_undegraded":"2024-09-12T01:03:24.820216+0000","last_fullsized":"2024-09-12T01:03:24.820216+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:03:24.820029+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:03:24.820029+0000","last_clean_scrub_stamp":"2024-09-12T01:03:24.820029+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:01.041170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"268'31","reported_seq":142,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:27.355412+0000","last_change":"2024-09-12T01:03:27.355412+0000","last_active":"2024-09-12T01:03:27.355412+0000","last_peered":"2024-09-12T01:03:27.355412+0000","last_clean":"2024-09-12T01:03:27.355412+0000","last_became_active":"2024-09-12T00:30:51.543858+0000","last_became_peered":"2024-09-12T00:30:51.543858+0000","last_unstale":"2024-09-12T01:03:27.355412+0000","last_undegraded":"2024-09-12T01:03:27.355412+0000","last_fullsized":"2024-09-12T01:03:27.355412+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-09-12T01:03:27.355232+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-09-12T01:03:27.355232+0000","last_clean_scrub_stamp":"2024-09-12T01:03:27.355232+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:22.444239+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":120,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:28.346882+0000","last_change":"2024-09-12T01:03:28.346656+0000","last_active":"2024-09-12T01:03:28.346882+0000","last_peered":"2024-09-12T01:03:28.346882+0000","last_clean":"2024-09-12T01:03:28.346882+0000","last_became_active":"2024-09-12T00:43:48.286291+0000","last_became_peered":"2024-09-12T00:43:48.286291+0000","last_unstale":"2024-09-12T01:03:28.346882+0000","last_undegraded":"2024-09-12T01:03:28.346882+0000","last_fullsized":"2024-09-12T01:03:28.346882+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:28.346354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:28.346354+0000","last_clean_scrub_stamp":"2024-09-12T01:03:28.346354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:34.904877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.633077+0000","last_change":"2024-09-12T01:03:26.633077+0000","last_active":"2024-09-12T01:03:26.633077+0000","last_peered":"2024-09-12T01:03:26.633077+0000","last_clean":"2024-09-12T01:03:26.633077+0000","last_became_active":"2024-09-12T00:32:28.070091+0000","last_became_peered":"2024-09-12T00:32:28.070091+0000","last_unstale":"2024-09-12T01:03:26.633077+0000","last_undegraded":"2024-09-12T01:03:26.633077+0000","last_fullsized":"2024-09-12T01:03:26.633077+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:26.632902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:26.632902+0000","last_clean_scrub_stamp":"2024-09-12T01:03:26.632902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:01.925368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:30.859845+0000","last_change":"2024-09-12T01:03:30.859845+0000","last_active":"2024-09-12T01:03:30.859845+0000","last_peered":"2024-09-12T01:03:30.859845+0000","last_clean":"2024-09-12T01:03:30.859845+0000","last_became_active":"2024-09-12T00:32:25.023750+0000","last_became_peered":"2024-09-12T00:32:25.023750+0000","last_unstale":"2024-09-12T01:03:30.859845+0000","last_undegraded":"2024-09-12T01:03:30.859845+0000","last_fullsized":"2024-09-12T01:03:30.859845+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:30.859661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:30.859661+0000","last_clean_scrub_stamp":"2024-09-12T01:03:30.859661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:50.354271+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"268'20","reported_seq":106,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.366037+0000","last_change":"2024-09-12T01:03:26.366037+0000","last_active":"2024-09-12T01:03:26.366037+0000","last_peered":"2024-09-12T01:03:26.366037+0000","last_clean":"2024-09-12T01:03:26.366037+0000","last_became_active":"2024-09-12T00:30:51.554875+0000","last_became_peered":"2024-09-12T00:30:51.554875+0000","last_unstale":"2024-09-12T01:03:26.366037+0000","last_undegraded":"2024-09-12T01:03:26.366037+0000","last_fullsized":"2024-09-12T01:03:26.366037+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'20","last_scrub_stamp":"2024-09-12T01:03:26.365854+0000","last_deep_scrub":"268'20","last_deep_scrub_stamp":"2024-09-12T01:03:26.365854+0000","last_clean_scrub_stamp":"2024-09-12T01:03:26.365854+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:40.259560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":61,"num_write":42,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.246911+0000","last_change":"2024-09-12T01:03:25.246911+0000","last_active":"2024-09-12T01:03:25.246911+0000","last_peered":"2024-09-12T01:03:25.246911+0000","last_clean":"2024-09-12T01:03:25.246911+0000","last_became_active":"2024-09-12T00:43:48.270700+0000","last_became_peered":"2024-09-12T00:43:48.270700+0000","last_unstale":"2024-09-12T01:03:25.246911+0000","last_undegraded":"2024-09-12T01:03:25.246911+0000","last_fullsized":"2024-09-12T01:03:25.246911+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:25.246726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:25.246726+0000","last_clean_scrub_stamp":"2024-09-12T01:03:25.246726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:22.826848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"268'3","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:38.841817+0000","last_change":"2024-09-12T01:03:38.841669+0000","last_active":"2024-09-12T01:03:38.841817+0000","last_peered":"2024-09-12T01:03:38.841817+0000","last_clean":"2024-09-12T01:03:38.841817+0000","last_became_active":"2024-09-12T00:32:28.065497+0000","last_became_peered":"2024-09-12T00:32:28.065497+0000","last_unstale":"2024-09-12T01:03:38.841817+0000","last_undegraded":"2024-09-12T01:03:38.841817+0000","last_fullsized":"2024-09-12T01:03:38.841817+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:38.841479+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:38.841479+0000","last_clean_scrub_stamp":"2024-09-12T01:03:38.841479+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:31.771058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"268'5","reported_seq":56,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.866220+0000","last_change":"2024-09-12T01:03:25.866220+0000","last_active":"2024-09-12T01:03:25.866220+0000","last_peered":"2024-09-12T01:03:25.866220+0000","last_clean":"2024-09-12T01:03:25.866220+0000","last_became_active":"2024-09-12T00:32:25.001290+0000","last_became_peered":"2024-09-12T00:32:25.001290+0000","last_unstale":"2024-09-12T01:03:25.866220+0000","last_undegraded":"2024-09-12T01:03:25.866220+0000","last_fullsized":"2024-09-12T01:03:25.866220+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T01:03:25.865983+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T01:03:25.865983+0000","last_clean_scrub_stamp":"2024-09-12T01:03:25.865983+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:09.004155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2088,"num_write":10,"num_write_kb":1064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"268'25","reported_seq":118,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.196431+0000","last_change":"2024-09-12T01:03:21.196280+0000","last_active":"2024-09-12T01:03:21.196431+0000","last_peered":"2024-09-12T01:03:21.196431+0000","last_clean":"2024-09-12T01:03:21.196431+0000","last_became_active":"2024-09-12T00:30:51.544751+0000","last_became_peered":"2024-09-12T00:30:51.544751+0000","last_unstale":"2024-09-12T01:03:21.196431+0000","last_undegraded":"2024-09-12T01:03:21.196431+0000","last_fullsized":"2024-09-12T01:03:21.196431+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'25","last_scrub_stamp":"2024-09-12T01:03:21.196100+0000","last_deep_scrub":"268'25","last_deep_scrub_stamp":"2024-09-12T01:03:21.196100+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.196100+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:27.636294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":82,"num_write":61,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.778656+0000","last_change":"2024-09-12T01:03:44.778656+0000","last_active":"2024-09-12T01:03:44.778656+0000","last_peered":"2024-09-12T01:03:44.778656+0000","last_clean":"2024-09-12T01:03:44.778656+0000","last_became_active":"2024-09-12T00:43:48.280166+0000","last_became_peered":"2024-09-12T00:43:48.280166+0000","last_unstale":"2024-09-12T01:03:44.778656+0000","last_undegraded":"2024-09-12T01:03:44.778656+0000","last_fullsized":"2024-09-12T01:03:44.778656+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:44.778433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:44.778433+0000","last_clean_scrub_stamp":"2024-09-12T01:03:44.778433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:04.955812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.816263+0000","last_change":"2024-09-12T01:03:37.816263+0000","last_active":"2024-09-12T01:03:37.816263+0000","last_peered":"2024-09-12T01:03:37.816263+0000","last_clean":"2024-09-12T01:03:37.816263+0000","last_became_active":"2024-09-12T00:32:28.073988+0000","last_became_peered":"2024-09-12T00:32:28.073988+0000","last_unstale":"2024-09-12T01:03:37.816263+0000","last_undegraded":"2024-09-12T01:03:37.816263+0000","last_fullsized":"2024-09-12T01:03:37.816263+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:37.816051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:37.816051+0000","last_clean_scrub_stamp":"2024-09-12T01:03:37.816051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:39.636596+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.289934+0000","last_change":"2024-09-12T01:03:22.289781+0000","last_active":"2024-09-12T01:03:22.289934+0000","last_peered":"2024-09-12T01:03:22.289934+0000","last_clean":"2024-09-12T01:03:22.289934+0000","last_became_active":"2024-09-12T00:32:25.007732+0000","last_became_peered":"2024-09-12T00:32:25.007732+0000","last_unstale":"2024-09-12T01:03:22.289934+0000","last_undegraded":"2024-09-12T01:03:22.289934+0000","last_fullsized":"2024-09-12T01:03:22.289934+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:22.289600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:22.289600+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.289600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:38.839024+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"268'61","reported_seq":212,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.160224+0000","last_change":"2024-09-12T01:03:20.160072+0000","last_active":"2024-09-12T01:03:20.160224+0000","last_peered":"2024-09-12T01:03:20.160224+0000","last_clean":"2024-09-12T01:03:20.160224+0000","last_became_active":"2024-09-12T00:30:51.551417+0000","last_became_peered":"2024-09-12T00:30:51.551417+0000","last_unstale":"2024-09-12T01:03:20.160224+0000","last_undegraded":"2024-09-12T01:03:20.160224+0000","last_fullsized":"2024-09-12T01:03:20.160224+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'61","last_scrub_stamp":"2024-09-12T01:03:20.159892+0000","last_deep_scrub":"268'61","last_deep_scrub_stamp":"2024-09-12T01:03:20.159892+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.159892+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:23.181094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":214,"num_write":108,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:35.934184+0000","last_change":"2024-09-12T01:03:35.933952+0000","last_active":"2024-09-12T01:03:35.934184+0000","last_peered":"2024-09-12T01:03:35.934184+0000","last_clean":"2024-09-12T01:03:35.934184+0000","last_became_active":"2024-09-12T00:43:48.283357+0000","last_became_peered":"2024-09-12T00:43:48.283357+0000","last_unstale":"2024-09-12T01:03:35.934184+0000","last_undegraded":"2024-09-12T01:03:35.934184+0000","last_fullsized":"2024-09-12T01:03:35.934184+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:35.933733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:35.933733+0000","last_clean_scrub_stamp":"2024-09-12T01:03:35.933733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:35.322431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"268'5","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.600622+0000","last_change":"2024-09-12T01:03:16.600482+0000","last_active":"2024-09-12T01:03:16.600622+0000","last_peered":"2024-09-12T01:03:16.600622+0000","last_clean":"2024-09-12T01:03:16.600622+0000","last_became_active":"2024-09-12T00:32:28.053541+0000","last_became_peered":"2024-09-12T00:32:28.053541+0000","last_unstale":"2024-09-12T01:03:16.600622+0000","last_undegraded":"2024-09-12T01:03:16.600622+0000","last_fullsized":"2024-09-12T01:03:16.600622+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T01:03:16.600298+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T01:03:16.600298+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.600298+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:05.393658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"268'3","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.825222+0000","last_change":"2024-09-12T01:03:29.825072+0000","last_active":"2024-09-12T01:03:29.825222+0000","last_peered":"2024-09-12T01:03:29.825222+0000","last_clean":"2024-09-12T01:03:29.825222+0000","last_became_active":"2024-09-12T00:32:25.014665+0000","last_became_peered":"2024-09-12T00:32:25.014665+0000","last_unstale":"2024-09-12T01:03:29.825222+0000","last_undegraded":"2024-09-12T01:03:29.825222+0000","last_fullsized":"2024-09-12T01:03:29.825222+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:29.824892+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:29.824892+0000","last_clean_scrub_stamp":"2024-09-12T01:03:29.824892+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:45.015465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"268'40","reported_seq":163,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.166755+0000","last_change":"2024-09-12T01:03:19.166618+0000","last_active":"2024-09-12T01:03:19.166755+0000","last_peered":"2024-09-12T01:03:19.166755+0000","last_clean":"2024-09-12T01:03:19.166755+0000","last_became_active":"2024-09-12T00:30:51.547784+0000","last_became_peered":"2024-09-12T00:30:51.547784+0000","last_unstale":"2024-09-12T01:03:19.166755+0000","last_undegraded":"2024-09-12T01:03:19.166755+0000","last_fullsized":"2024-09-12T01:03:19.166755+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'40","last_scrub_stamp":"2024-09-12T01:03:19.166420+0000","last_deep_scrub":"268'40","last_deep_scrub_stamp":"2024-09-12T01:03:19.166420+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.166420+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:04.043127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":150,"num_write":68,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:31.408665+0000","last_change":"2024-09-12T01:03:31.408665+0000","last_active":"2024-09-12T01:03:31.408665+0000","last_peered":"2024-09-12T01:03:31.408665+0000","last_clean":"2024-09-12T01:03:31.408665+0000","last_became_active":"2024-09-12T00:43:48.276078+0000","last_became_peered":"2024-09-12T00:43:48.276078+0000","last_unstale":"2024-09-12T01:03:31.408665+0000","last_undegraded":"2024-09-12T01:03:31.408665+0000","last_fullsized":"2024-09-12T01:03:31.408665+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:31.408474+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:31.408474+0000","last_clean_scrub_stamp":"2024-09-12T01:03:31.408474+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:45.580029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"268'5","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:49.651628+0000","last_change":"2024-09-12T01:03:49.651482+0000","last_active":"2024-09-12T01:03:49.651628+0000","last_peered":"2024-09-12T01:03:49.651628+0000","last_clean":"2024-09-12T01:03:49.651628+0000","last_became_active":"2024-09-12T00:32:28.030520+0000","last_became_peered":"2024-09-12T00:32:28.030520+0000","last_unstale":"2024-09-12T01:03:49.651628+0000","last_undegraded":"2024-09-12T01:03:49.651628+0000","last_fullsized":"2024-09-12T01:03:49.651628+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T01:03:49.651296+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T01:03:49.651296+0000","last_clean_scrub_stamp":"2024-09-12T01:03:49.651296+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:36.348120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"268'3","reported_seq":51,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:44.621232+0000","last_change":"2024-09-12T01:03:44.621086+0000","last_active":"2024-09-12T01:03:44.621232+0000","last_peered":"2024-09-12T01:03:44.621232+0000","last_clean":"2024-09-12T01:03:44.621232+0000","last_became_active":"2024-09-12T00:32:25.009898+0000","last_became_peered":"2024-09-12T00:32:25.009898+0000","last_unstale":"2024-09-12T01:03:44.621232+0000","last_undegraded":"2024-09-12T01:03:44.621232+0000","last_fullsized":"2024-09-12T01:03:44.621232+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:44.620883+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:44.620883+0000","last_clean_scrub_stamp":"2024-09-12T01:03:44.620883+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:51.998407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"268'22","reported_seq":112,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.605966+0000","last_change":"2024-09-12T01:03:17.605822+0000","last_active":"2024-09-12T01:03:17.605966+0000","last_peered":"2024-09-12T01:03:17.605966+0000","last_clean":"2024-09-12T01:03:17.605966+0000","last_became_active":"2024-09-12T00:30:51.559544+0000","last_became_peered":"2024-09-12T00:30:51.559544+0000","last_unstale":"2024-09-12T01:03:17.605966+0000","last_undegraded":"2024-09-12T01:03:17.605966+0000","last_fullsized":"2024-09-12T01:03:17.605966+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'22","last_scrub_stamp":"2024-09-12T01:03:17.605585+0000","last_deep_scrub":"268'22","last_deep_scrub_stamp":"2024-09-12T01:03:17.605585+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.605585+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:15.764743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":79,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:28.605077+0000","last_change":"2024-09-12T01:03:28.604949+0000","last_active":"2024-09-12T01:03:28.605077+0000","last_peered":"2024-09-12T01:03:28.605077+0000","last_clean":"2024-09-12T01:03:28.605077+0000","last_became_active":"2024-09-12T00:43:48.283057+0000","last_became_peered":"2024-09-12T00:43:48.283057+0000","last_unstale":"2024-09-12T01:03:28.605077+0000","last_undegraded":"2024-09-12T01:03:28.605077+0000","last_fullsized":"2024-09-12T01:03:28.605077+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:28.604828+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:28.604828+0000","last_clean_scrub_stamp":"2024-09-12T01:03:28.604828+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:21.064542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":39,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.656695+0000","last_change":"2024-09-12T01:03:24.656695+0000","last_active":"2024-09-12T01:03:24.656695+0000","last_peered":"2024-09-12T01:03:24.656695+0000","last_clean":"2024-09-12T01:03:24.656695+0000","last_became_active":"2024-09-12T00:32:28.065376+0000","last_became_peered":"2024-09-12T00:32:28.065376+0000","last_unstale":"2024-09-12T01:03:24.656695+0000","last_undegraded":"2024-09-12T01:03:24.656695+0000","last_fullsized":"2024-09-12T01:03:24.656695+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:24.656507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:24.656507+0000","last_clean_scrub_stamp":"2024-09-12T01:03:24.656507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:02:44.979172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"268'3","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.545423+0000","last_change":"2024-09-12T01:03:14.545423+0000","last_active":"2024-09-12T01:03:14.545423+0000","last_peered":"2024-09-12T01:03:14.545423+0000","last_clean":"2024-09-12T01:03:14.545423+0000","last_became_active":"2024-09-12T00:32:24.999604+0000","last_became_peered":"2024-09-12T00:32:24.999604+0000","last_unstale":"2024-09-12T01:03:14.545423+0000","last_undegraded":"2024-09-12T01:03:14.545423+0000","last_fullsized":"2024-09-12T01:03:14.545423+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:14.545246+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:14.545246+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.545246+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:04.271455+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"268'41","reported_seq":161,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.880756+0000","last_change":"2024-09-12T01:03:19.880756+0000","last_active":"2024-09-12T01:03:19.880756+0000","last_peered":"2024-09-12T01:03:19.880756+0000","last_clean":"2024-09-12T01:03:19.880756+0000","last_became_active":"2024-09-12T00:30:51.556729+0000","last_became_peered":"2024-09-12T00:30:51.556729+0000","last_unstale":"2024-09-12T01:03:19.880756+0000","last_undegraded":"2024-09-12T01:03:19.880756+0000","last_fullsized":"2024-09-12T01:03:19.880756+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'41","last_scrub_stamp":"2024-09-12T01:03:19.880569+0000","last_deep_scrub":"268'41","last_deep_scrub_stamp":"2024-09-12T01:03:19.880569+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.880569+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:33.118032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":144,"num_write":69,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.682541+0000","last_change":"2024-09-12T01:03:22.682410+0000","last_active":"2024-09-12T01:03:22.682541+0000","last_peered":"2024-09-12T01:03:22.682541+0000","last_clean":"2024-09-12T01:03:22.682541+0000","last_became_active":"2024-09-12T00:43:48.281781+0000","last_became_peered":"2024-09-12T00:43:48.281781+0000","last_unstale":"2024-09-12T01:03:22.682541+0000","last_undegraded":"2024-09-12T01:03:22.682541+0000","last_fullsized":"2024-09-12T01:03:22.682541+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:22.682226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:22.682226+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.682226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.752061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"268'5","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:33.977912+0000","last_change":"2024-09-12T01:03:33.977912+0000","last_active":"2024-09-12T01:03:33.977912+0000","last_peered":"2024-09-12T01:03:33.977912+0000","last_clean":"2024-09-12T01:03:33.977912+0000","last_became_active":"2024-09-12T00:32:28.062540+0000","last_became_peered":"2024-09-12T00:32:28.062540+0000","last_unstale":"2024-09-12T01:03:33.977912+0000","last_undegraded":"2024-09-12T01:03:33.977912+0000","last_fullsized":"2024-09-12T01:03:33.977912+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T01:03:33.977728+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T01:03:33.977728+0000","last_clean_scrub_stamp":"2024-09-12T01:03:33.977728+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:34.793165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":45,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.277464+0000","last_change":"2024-09-12T01:03:24.277464+0000","last_active":"2024-09-12T01:03:24.277464+0000","last_peered":"2024-09-12T01:03:24.277464+0000","last_clean":"2024-09-12T01:03:24.277464+0000","last_became_active":"2024-09-12T00:32:25.017715+0000","last_became_peered":"2024-09-12T00:32:25.017715+0000","last_unstale":"2024-09-12T01:03:24.277464+0000","last_undegraded":"2024-09-12T01:03:24.277464+0000","last_fullsized":"2024-09-12T01:03:24.277464+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:24.277282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:24.277282+0000","last_clean_scrub_stamp":"2024-09-12T01:03:24.277282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.031697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'8","reported_seq":73,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.182447+0000","last_change":"2024-09-12T01:03:18.182447+0000","last_active":"2024-09-12T01:03:18.182447+0000","last_peered":"2024-09-12T01:03:18.182447+0000","last_clean":"2024-09-12T01:03:18.182447+0000","last_became_active":"2024-09-12T00:30:51.546981+0000","last_became_peered":"2024-09-12T00:30:51.546981+0000","last_unstale":"2024-09-12T01:03:18.182447+0000","last_undegraded":"2024-09-12T01:03:18.182447+0000","last_fullsized":"2024-09-12T01:03:18.182447+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T01:03:18.182248+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T01:03:18.182248+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.182248+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:50.564435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:43.824876+0000","last_change":"2024-09-12T01:03:43.824876+0000","last_active":"2024-09-12T01:03:43.824876+0000","last_peered":"2024-09-12T01:03:43.824876+0000","last_clean":"2024-09-12T01:03:43.824876+0000","last_became_active":"2024-09-12T00:43:48.272523+0000","last_became_peered":"2024-09-12T00:43:48.272523+0000","last_unstale":"2024-09-12T01:03:43.824876+0000","last_undegraded":"2024-09-12T01:03:43.824876+0000","last_fullsized":"2024-09-12T01:03:43.824876+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:43.824601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:43.824601+0000","last_clean_scrub_stamp":"2024-09-12T01:03:43.824601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:27.699372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"268'9","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:30.899270+0000","last_change":"2024-09-12T01:03:30.899116+0000","last_active":"2024-09-12T01:03:30.899270+0000","last_peered":"2024-09-12T01:03:30.899270+0000","last_clean":"2024-09-12T01:03:30.899270+0000","last_became_active":"2024-09-12T00:32:28.062839+0000","last_became_peered":"2024-09-12T00:32:28.062839+0000","last_unstale":"2024-09-12T01:03:30.899270+0000","last_undegraded":"2024-09-12T01:03:30.899270+0000","last_fullsized":"2024-09-12T01:03:30.899270+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'9","last_scrub_stamp":"2024-09-12T01:03:30.898938+0000","last_deep_scrub":"268'9","last_deep_scrub_stamp":"2024-09-12T01:03:30.898938+0000","last_clean_scrub_stamp":"2024-09-12T01:03:30.898938+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:52.637468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":11264,"num_write":14,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"268'4","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:43.577075+0000","last_change":"2024-09-12T01:03:43.577075+0000","last_active":"2024-09-12T01:03:43.577075+0000","last_peered":"2024-09-12T01:03:43.577075+0000","last_clean":"2024-09-12T01:03:43.577075+0000","last_became_active":"2024-09-12T00:32:25.005113+0000","last_became_peered":"2024-09-12T00:32:25.005113+0000","last_unstale":"2024-09-12T01:03:43.577075+0000","last_undegraded":"2024-09-12T01:03:43.577075+0000","last_fullsized":"2024-09-12T01:03:43.577075+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:03:43.576890+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:03:43.576890+0000","last_clean_scrub_stamp":"2024-09-12T01:03:43.576890+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:00.054896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3076,"num_write":4,"num_write_kb":3076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'62","reported_seq":228,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.379426+0000","last_change":"2024-09-12T01:03:24.379426+0000","last_active":"2024-09-12T01:03:24.379426+0000","last_peered":"2024-09-12T01:03:24.379426+0000","last_clean":"2024-09-12T01:03:24.379426+0000","last_became_active":"2024-09-12T00:30:51.541882+0000","last_became_peered":"2024-09-12T00:30:51.541882+0000","last_unstale":"2024-09-12T01:03:24.379426+0000","last_undegraded":"2024-09-12T01:03:24.379426+0000","last_fullsized":"2024-09-12T01:03:24.379426+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'62","last_scrub_stamp":"2024-09-12T01:03:24.379229+0000","last_deep_scrub":"265'62","last_deep_scrub_stamp":"2024-09-12T01:03:24.379229+0000","last_clean_scrub_stamp":"2024-09-12T01:03:24.379229+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:51.634144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":339,"num_read_kb":254,"num_write":98,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.289216+0000","last_change":"2024-09-12T01:03:26.289216+0000","last_active":"2024-09-12T01:03:26.289216+0000","last_peered":"2024-09-12T01:03:26.289216+0000","last_clean":"2024-09-12T01:03:26.289216+0000","last_became_active":"2024-09-12T00:43:48.277883+0000","last_became_peered":"2024-09-12T00:43:48.277883+0000","last_unstale":"2024-09-12T01:03:26.289216+0000","last_undegraded":"2024-09-12T01:03:26.289216+0000","last_fullsized":"2024-09-12T01:03:26.289216+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:26.289039+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:26.289039+0000","last_clean_scrub_stamp":"2024-09-12T01:03:26.289039+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:22.524425+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'5","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:36.835461+0000","last_change":"2024-09-12T01:03:36.835461+0000","last_active":"2024-09-12T01:03:36.835461+0000","last_peered":"2024-09-12T01:03:36.835461+0000","last_clean":"2024-09-12T01:03:36.835461+0000","last_became_active":"2024-09-12T00:32:28.051364+0000","last_became_peered":"2024-09-12T00:32:28.051364+0000","last_unstale":"2024-09-12T01:03:36.835461+0000","last_undegraded":"2024-09-12T01:03:36.835461+0000","last_fullsized":"2024-09-12T01:03:36.835461+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:03:36.835253+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:03:36.835253+0000","last_clean_scrub_stamp":"2024-09-12T01:03:36.835253+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.532179+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5136,"num_write":10,"num_write_kb":5136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"268'2","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.550633+0000","last_change":"2024-09-12T01:03:12.550499+0000","last_active":"2024-09-12T01:03:12.550633+0000","last_peered":"2024-09-12T01:03:12.550633+0000","last_clean":"2024-09-12T01:03:12.550633+0000","last_became_active":"2024-09-12T00:32:25.009125+0000","last_became_peered":"2024-09-12T00:32:25.009125+0000","last_unstale":"2024-09-12T01:03:12.550633+0000","last_undegraded":"2024-09-12T01:03:12.550633+0000","last_fullsized":"2024-09-12T01:03:12.550633+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:12.550316+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:12.550316+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.550316+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:16.076008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"268'31","reported_seq":133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.372809+0000","last_change":"2024-09-12T01:03:25.372809+0000","last_active":"2024-09-12T01:03:25.372809+0000","last_peered":"2024-09-12T01:03:25.372809+0000","last_clean":"2024-09-12T01:03:25.372809+0000","last_became_active":"2024-09-12T00:30:51.553919+0000","last_became_peered":"2024-09-12T00:30:51.553919+0000","last_unstale":"2024-09-12T01:03:25.372809+0000","last_undegraded":"2024-09-12T01:03:25.372809+0000","last_fullsized":"2024-09-12T01:03:25.372809+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-09-12T01:03:25.372582+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-09-12T01:03:25.372582+0000","last_clean_scrub_stamp":"2024-09-12T01:03:25.372582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:39.785992+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":104,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.576727+0000","last_change":"2024-09-12T01:03:29.576727+0000","last_active":"2024-09-12T01:03:29.576727+0000","last_peered":"2024-09-12T01:03:29.576727+0000","last_clean":"2024-09-12T01:03:29.576727+0000","last_became_active":"2024-09-12T00:43:48.288517+0000","last_became_peered":"2024-09-12T00:43:48.288517+0000","last_unstale":"2024-09-12T01:03:29.576727+0000","last_undegraded":"2024-09-12T01:03:29.576727+0000","last_fullsized":"2024-09-12T01:03:29.576727+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:29.576549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:29.576549+0000","last_clean_scrub_stamp":"2024-09-12T01:03:29.576549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:43.611153+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:31.920981+0000","last_change":"2024-09-12T01:03:31.920818+0000","last_active":"2024-09-12T01:03:31.920981+0000","last_peered":"2024-09-12T01:03:31.920981+0000","last_clean":"2024-09-12T01:03:31.920981+0000","last_became_active":"2024-09-12T00:32:28.059869+0000","last_became_peered":"2024-09-12T00:32:28.059869+0000","last_unstale":"2024-09-12T01:03:31.920981+0000","last_undegraded":"2024-09-12T01:03:31.920981+0000","last_fullsized":"2024-09-12T01:03:31.920981+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:31.920640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:31.920640+0000","last_clean_scrub_stamp":"2024-09-12T01:03:31.920640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:56.606103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"265'2","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.835844+0000","last_change":"2024-09-12T01:03:23.835656+0000","last_active":"2024-09-12T01:03:23.835844+0000","last_peered":"2024-09-12T01:03:23.835844+0000","last_clean":"2024-09-12T01:03:23.835844+0000","last_became_active":"2024-09-12T00:32:25.026751+0000","last_became_peered":"2024-09-12T00:32:25.026751+0000","last_unstale":"2024-09-12T01:03:23.835844+0000","last_undegraded":"2024-09-12T01:03:23.835844+0000","last_fullsized":"2024-09-12T01:03:23.835844+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:03:23.835464+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:03:23.835464+0000","last_clean_scrub_stamp":"2024-09-12T01:03:23.835464+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:17.545698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"268'24","reported_seq":119,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.873106+0000","last_change":"2024-09-12T01:03:17.873106+0000","last_active":"2024-09-12T01:03:17.873106+0000","last_peered":"2024-09-12T01:03:17.873106+0000","last_clean":"2024-09-12T01:03:17.873106+0000","last_became_active":"2024-09-12T00:30:51.548069+0000","last_became_peered":"2024-09-12T00:30:51.548069+0000","last_unstale":"2024-09-12T01:03:17.873106+0000","last_undegraded":"2024-09-12T01:03:17.873106+0000","last_fullsized":"2024-09-12T01:03:17.873106+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'24","last_scrub_stamp":"2024-09-12T01:03:17.872922+0000","last_deep_scrub":"268'24","last_deep_scrub_stamp":"2024-09-12T01:03:17.872922+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.872922+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:45.795027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":85,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.628949+0000","last_change":"2024-09-12T01:03:20.628949+0000","last_active":"2024-09-12T01:03:20.628949+0000","last_peered":"2024-09-12T01:03:20.628949+0000","last_clean":"2024-09-12T01:03:20.628949+0000","last_became_active":"2024-09-12T00:43:48.274026+0000","last_became_peered":"2024-09-12T00:43:48.274026+0000","last_unstale":"2024-09-12T01:03:20.628949+0000","last_undegraded":"2024-09-12T01:03:20.628949+0000","last_fullsized":"2024-09-12T01:03:20.628949+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:20.628638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:20.628638+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.628638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:44.344922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"268'2","reported_seq":43,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.561562+0000","last_change":"2024-09-12T01:03:15.561422+0000","last_active":"2024-09-12T01:03:15.561562+0000","last_peered":"2024-09-12T01:03:15.561562+0000","last_clean":"2024-09-12T01:03:15.561562+0000","last_became_active":"2024-09-12T00:32:28.062657+0000","last_became_peered":"2024-09-12T00:32:28.062657+0000","last_unstale":"2024-09-12T01:03:15.561562+0000","last_undegraded":"2024-09-12T01:03:15.561562+0000","last_fullsized":"2024-09-12T01:03:15.561562+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:15.561217+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:15.561217+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.561217+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:18.353263+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":48,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:28.802933+0000","last_change":"2024-09-12T01:03:28.802785+0000","last_active":"2024-09-12T01:03:28.802933+0000","last_peered":"2024-09-12T01:03:28.802933+0000","last_clean":"2024-09-12T01:03:28.802933+0000","last_became_active":"2024-09-12T00:32:24.996754+0000","last_became_peered":"2024-09-12T00:32:24.996754+0000","last_unstale":"2024-09-12T01:03:28.802933+0000","last_undegraded":"2024-09-12T01:03:28.802933+0000","last_fullsized":"2024-09-12T01:03:28.802933+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:28.802598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:28.802598+0000","last_clean_scrub_stamp":"2024-09-12T01:03:28.802598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:56.047209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"268'26","reported_seq":121,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:37.598661+0000","last_change":"2024-09-12T01:03:37.598501+0000","last_active":"2024-09-12T01:03:37.598661+0000","last_peered":"2024-09-12T01:03:37.598661+0000","last_clean":"2024-09-12T01:03:37.598661+0000","last_became_active":"2024-09-12T00:30:51.545679+0000","last_became_peered":"2024-09-12T00:30:51.545679+0000","last_unstale":"2024-09-12T01:03:37.598661+0000","last_undegraded":"2024-09-12T01:03:37.598661+0000","last_fullsized":"2024-09-12T01:03:37.598661+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'26","last_scrub_stamp":"2024-09-12T01:03:37.598326+0000","last_deep_scrub":"268'26","last_deep_scrub_stamp":"2024-09-12T01:03:37.598326+0000","last_clean_scrub_stamp":"2024-09-12T01:03:37.598326+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:41.738949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":123,"num_read_kb":84,"num_write":50,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:45.800344+0000","last_change":"2024-09-12T01:03:45.800344+0000","last_active":"2024-09-12T01:03:45.800344+0000","last_peered":"2024-09-12T01:03:45.800344+0000","last_clean":"2024-09-12T01:03:45.800344+0000","last_became_active":"2024-09-12T00:43:48.285657+0000","last_became_peered":"2024-09-12T00:43:48.285657+0000","last_unstale":"2024-09-12T01:03:45.800344+0000","last_undegraded":"2024-09-12T01:03:45.800344+0000","last_fullsized":"2024-09-12T01:03:45.800344+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:45.800158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:45.800158+0000","last_clean_scrub_stamp":"2024-09-12T01:03:45.800158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:22.892358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"268'8","reported_seq":60,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:35.803246+0000","last_change":"2024-09-12T01:03:35.803246+0000","last_active":"2024-09-12T01:03:35.803246+0000","last_peered":"2024-09-12T01:03:35.803246+0000","last_clean":"2024-09-12T01:03:35.803246+0000","last_became_active":"2024-09-12T00:32:28.067168+0000","last_became_peered":"2024-09-12T00:32:28.067168+0000","last_unstale":"2024-09-12T01:03:35.803246+0000","last_undegraded":"2024-09-12T01:03:35.803246+0000","last_fullsized":"2024-09-12T01:03:35.803246+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:03:35.803057+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:03:35.803057+0000","last_clean_scrub_stamp":"2024-09-12T01:03:35.803057+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:55.339465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":13,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"268'10","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.259240+0000","last_change":"2024-09-12T01:03:18.259240+0000","last_active":"2024-09-12T01:03:18.259240+0000","last_peered":"2024-09-12T01:03:18.259240+0000","last_clean":"2024-09-12T01:03:18.259240+0000","last_became_active":"2024-09-12T00:32:25.011944+0000","last_became_peered":"2024-09-12T00:32:25.011944+0000","last_unstale":"2024-09-12T01:03:18.259240+0000","last_undegraded":"2024-09-12T01:03:18.259240+0000","last_fullsized":"2024-09-12T01:03:18.259240+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'10","last_scrub_stamp":"2024-09-12T01:03:18.259037+0000","last_deep_scrub":"268'10","last_deep_scrub_stamp":"2024-09-12T01:03:18.259037+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.259037+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:43.728684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":20800,"num_write":20,"num_write_kb":10558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"268'29","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.608618+0000","last_change":"2024-09-12T01:03:39.608618+0000","last_active":"2024-09-12T01:03:39.608618+0000","last_peered":"2024-09-12T01:03:39.608618+0000","last_clean":"2024-09-12T01:03:39.608618+0000","last_became_active":"2024-09-12T00:30:51.550694+0000","last_became_peered":"2024-09-12T00:30:51.550694+0000","last_unstale":"2024-09-12T01:03:39.608618+0000","last_undegraded":"2024-09-12T01:03:39.608618+0000","last_fullsized":"2024-09-12T01:03:39.608618+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'29","last_scrub_stamp":"2024-09-12T01:03:39.608428+0000","last_deep_scrub":"268'29","last_deep_scrub_stamp":"2024-09-12T01:03:39.608428+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.608428+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:30.277492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":142,"num_read_kb":98,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":29,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.370339+0000","last_change":"2024-09-12T01:03:29.370339+0000","last_active":"2024-09-12T01:03:29.370339+0000","last_peered":"2024-09-12T01:03:29.370339+0000","last_clean":"2024-09-12T01:03:29.370339+0000","last_became_active":"2024-09-12T00:43:48.272356+0000","last_became_peered":"2024-09-12T00:43:48.272356+0000","last_unstale":"2024-09-12T01:03:29.370339+0000","last_undegraded":"2024-09-12T01:03:29.370339+0000","last_fullsized":"2024-09-12T01:03:29.370339+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:29.370142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:29.370142+0000","last_clean_scrub_stamp":"2024-09-12T01:03:29.370142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:52.163438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"268'6","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:33.855135+0000","last_change":"2024-09-12T01:03:33.855135+0000","last_active":"2024-09-12T01:03:33.855135+0000","last_peered":"2024-09-12T01:03:33.855135+0000","last_clean":"2024-09-12T01:03:33.855135+0000","last_became_active":"2024-09-12T00:32:28.067388+0000","last_became_peered":"2024-09-12T00:32:28.067388+0000","last_unstale":"2024-09-12T01:03:33.855135+0000","last_undegraded":"2024-09-12T01:03:33.855135+0000","last_fullsized":"2024-09-12T01:03:33.855135+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:03:33.854948+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:03:33.854948+0000","last_clean_scrub_stamp":"2024-09-12T01:03:33.854948+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:16.321215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":1024,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:27.773653+0000","last_change":"2024-09-12T01:03:27.773653+0000","last_active":"2024-09-12T01:03:27.773653+0000","last_peered":"2024-09-12T01:03:27.773653+0000","last_clean":"2024-09-12T01:03:27.773653+0000","last_became_active":"2024-09-12T00:32:25.005882+0000","last_became_peered":"2024-09-12T00:32:25.005882+0000","last_unstale":"2024-09-12T01:03:27.773653+0000","last_undegraded":"2024-09-12T01:03:27.773653+0000","last_fullsized":"2024-09-12T01:03:27.773653+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:27.773442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:27.773442+0000","last_clean_scrub_stamp":"2024-09-12T01:03:27.773442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:58.468642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"268'19","reported_seq":104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.845346+0000","last_change":"2024-09-12T01:03:16.845169+0000","last_active":"2024-09-12T01:03:16.845346+0000","last_peered":"2024-09-12T01:03:16.845346+0000","last_clean":"2024-09-12T01:03:16.845346+0000","last_became_active":"2024-09-12T00:30:51.548932+0000","last_became_peered":"2024-09-12T00:30:51.548932+0000","last_unstale":"2024-09-12T01:03:16.845346+0000","last_undegraded":"2024-09-12T01:03:16.845346+0000","last_fullsized":"2024-09-12T01:03:16.845346+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'19","last_scrub_stamp":"2024-09-12T01:03:16.844979+0000","last_deep_scrub":"268'19","last_deep_scrub_stamp":"2024-09-12T01:03:16.844979+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.844979+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:09.777377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":66,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:32.405175+0000","last_change":"2024-09-12T01:03:32.405175+0000","last_active":"2024-09-12T01:03:32.405175+0000","last_peered":"2024-09-12T01:03:32.405175+0000","last_clean":"2024-09-12T01:03:32.405175+0000","last_became_active":"2024-09-12T00:43:48.274983+0000","last_became_peered":"2024-09-12T00:43:48.274983+0000","last_unstale":"2024-09-12T01:03:32.405175+0000","last_undegraded":"2024-09-12T01:03:32.405175+0000","last_fullsized":"2024-09-12T01:03:32.405175+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:32.404954+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:32.404954+0000","last_clean_scrub_stamp":"2024-09-12T01:03:32.404954+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:27.530313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"265'5","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.921405+0000","last_change":"2024-09-12T01:03:29.921405+0000","last_active":"2024-09-12T01:03:29.921405+0000","last_peered":"2024-09-12T01:03:29.921405+0000","last_clean":"2024-09-12T01:03:29.921405+0000","last_became_active":"2024-09-12T00:32:28.049947+0000","last_became_peered":"2024-09-12T00:32:28.049947+0000","last_unstale":"2024-09-12T01:03:29.921405+0000","last_undegraded":"2024-09-12T01:03:29.921405+0000","last_fullsized":"2024-09-12T01:03:29.921405+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:03:29.921211+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:03:29.921211+0000","last_clean_scrub_stamp":"2024-09-12T01:03:29.921211+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:03.277478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":46,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.260368+0000","last_change":"2024-09-12T01:03:17.260368+0000","last_active":"2024-09-12T01:03:17.260368+0000","last_peered":"2024-09-12T01:03:17.260368+0000","last_clean":"2024-09-12T01:03:17.260368+0000","last_became_active":"2024-09-12T00:32:25.008089+0000","last_became_peered":"2024-09-12T00:32:25.008089+0000","last_unstale":"2024-09-12T01:03:17.260368+0000","last_undegraded":"2024-09-12T01:03:17.260368+0000","last_fullsized":"2024-09-12T01:03:17.260368+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:17.260180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:17.260180+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.260180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:55.268421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"268'83","reported_seq":333,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.600802+0000","last_change":"2024-09-12T01:03:18.600561+0000","last_active":"2024-09-12T01:03:18.600802+0000","last_peered":"2024-09-12T01:03:18.600802+0000","last_clean":"2024-09-12T01:03:18.600802+0000","last_became_active":"2024-09-12T00:30:51.548232+0000","last_became_peered":"2024-09-12T00:30:51.548232+0000","last_unstale":"2024-09-12T01:03:18.600802+0000","last_undegraded":"2024-09-12T01:03:18.600802+0000","last_fullsized":"2024-09-12T01:03:18.600802+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'83","last_scrub_stamp":"2024-09-12T01:03:18.600292+0000","last_deep_scrub":"268'83","last_deep_scrub_stamp":"2024-09-12T01:03:18.600292+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.600292+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:02.341405+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":555,"num_read_kb":390,"num_write":93,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2796,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"268'2","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:27.335286+0000","last_change":"2024-09-12T01:03:27.335286+0000","last_active":"2024-09-12T01:03:27.335286+0000","last_peered":"2024-09-12T01:03:27.335286+0000","last_clean":"2024-09-12T01:03:27.335286+0000","last_became_active":"2024-09-12T00:43:48.271560+0000","last_became_peered":"2024-09-12T00:43:48.271560+0000","last_unstale":"2024-09-12T01:03:27.335286+0000","last_undegraded":"2024-09-12T01:03:27.335286+0000","last_fullsized":"2024-09-12T01:03:27.335286+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:27.335097+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:27.335097+0000","last_clean_scrub_stamp":"2024-09-12T01:03:27.335097+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:55.194135+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":40,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:47.705356+0000","last_change":"2024-09-12T01:03:47.705356+0000","last_active":"2024-09-12T01:03:47.705356+0000","last_peered":"2024-09-12T01:03:47.705356+0000","last_clean":"2024-09-12T01:03:47.705356+0000","last_became_active":"2024-09-12T00:32:28.058127+0000","last_became_peered":"2024-09-12T00:32:28.058127+0000","last_unstale":"2024-09-12T01:03:47.705356+0000","last_undegraded":"2024-09-12T01:03:47.705356+0000","last_fullsized":"2024-09-12T01:03:47.705356+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:47.705165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:47.705165+0000","last_clean_scrub_stamp":"2024-09-12T01:03:47.705165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:38.104817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"268'3","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.218360+0000","last_change":"2024-09-12T01:03:19.218360+0000","last_active":"2024-09-12T01:03:19.218360+0000","last_peered":"2024-09-12T01:03:19.218360+0000","last_clean":"2024-09-12T01:03:19.218360+0000","last_became_active":"2024-09-12T00:32:25.013042+0000","last_became_peered":"2024-09-12T00:32:25.013042+0000","last_unstale":"2024-09-12T01:03:19.218360+0000","last_undegraded":"2024-09-12T01:03:19.218360+0000","last_fullsized":"2024-09-12T01:03:19.218360+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:19.218177+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:19.218177+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.218177+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:33.238245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'29","reported_seq":137,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.846534+0000","last_change":"2024-09-12T01:03:15.846217+0000","last_active":"2024-09-12T01:03:15.846534+0000","last_peered":"2024-09-12T01:03:15.846534+0000","last_clean":"2024-09-12T01:03:15.846534+0000","last_became_active":"2024-09-12T00:30:51.545619+0000","last_became_peered":"2024-09-12T00:30:51.545619+0000","last_unstale":"2024-09-12T01:03:15.846534+0000","last_undegraded":"2024-09-12T01:03:15.846534+0000","last_fullsized":"2024-09-12T01:03:15.846534+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'29","last_scrub_stamp":"2024-09-12T01:03:15.845929+0000","last_deep_scrub":"265'29","last_deep_scrub_stamp":"2024-09-12T01:03:15.845929+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.845929+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:45.123501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":120,"num_write":40,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:39.844268+0000","last_change":"2024-09-12T01:03:39.844268+0000","last_active":"2024-09-12T01:03:39.844268+0000","last_peered":"2024-09-12T01:03:39.844268+0000","last_clean":"2024-09-12T01:03:39.844268+0000","last_became_active":"2024-09-12T00:43:48.279197+0000","last_became_peered":"2024-09-12T00:43:48.279197+0000","last_unstale":"2024-09-12T01:03:39.844268+0000","last_undegraded":"2024-09-12T01:03:39.844268+0000","last_fullsized":"2024-09-12T01:03:39.844268+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:39.844077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:39.844077+0000","last_clean_scrub_stamp":"2024-09-12T01:03:39.844077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:58.507981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:27.904926+0000","last_change":"2024-09-12T01:03:27.904790+0000","last_active":"2024-09-12T01:03:27.904926+0000","last_peered":"2024-09-12T01:03:27.904926+0000","last_clean":"2024-09-12T01:03:27.904926+0000","last_became_active":"2024-09-12T00:32:28.057839+0000","last_became_peered":"2024-09-12T00:32:28.057839+0000","last_unstale":"2024-09-12T01:03:27.904926+0000","last_undegraded":"2024-09-12T01:03:27.904926+0000","last_fullsized":"2024-09-12T01:03:27.904926+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:27.904609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:27.904609+0000","last_clean_scrub_stamp":"2024-09-12T01:03:27.904609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:12.429334+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"268'8","reported_seq":67,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.607055+0000","last_change":"2024-09-12T01:03:22.606924+0000","last_active":"2024-09-12T01:03:22.607055+0000","last_peered":"2024-09-12T01:03:22.607055+0000","last_clean":"2024-09-12T01:03:22.607055+0000","last_became_active":"2024-09-12T00:32:25.021649+0000","last_became_peered":"2024-09-12T00:32:25.021649+0000","last_unstale":"2024-09-12T01:03:22.607055+0000","last_undegraded":"2024-09-12T01:03:22.607055+0000","last_fullsized":"2024-09-12T01:03:22.607055+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:03:22.606753+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:03:22.606753+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.606753+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:45.672695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":13,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"268'68","reported_seq":244,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.863606+0000","last_change":"2024-09-12T01:03:14.863606+0000","last_active":"2024-09-12T01:03:14.863606+0000","last_peered":"2024-09-12T01:03:14.863606+0000","last_clean":"2024-09-12T01:03:14.863606+0000","last_became_active":"2024-09-12T00:30:51.562106+0000","last_became_peered":"2024-09-12T00:30:51.562106+0000","last_unstale":"2024-09-12T01:03:14.863606+0000","last_undegraded":"2024-09-12T01:03:14.863606+0000","last_fullsized":"2024-09-12T01:03:14.863606+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'68","last_scrub_stamp":"2024-09-12T01:03:14.863392+0000","last_deep_scrub":"268'68","last_deep_scrub_stamp":"2024-09-12T01:03:14.863392+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.863392+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:39.028253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":360,"num_read_kb":258,"num_write":123,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.272036+0000","last_change":"2024-09-12T01:03:23.271914+0000","last_active":"2024-09-12T01:03:23.272036+0000","last_peered":"2024-09-12T01:03:23.272036+0000","last_clean":"2024-09-12T01:03:23.272036+0000","last_became_active":"2024-09-12T00:43:48.286629+0000","last_became_peered":"2024-09-12T00:43:48.286629+0000","last_unstale":"2024-09-12T01:03:23.272036+0000","last_undegraded":"2024-09-12T01:03:23.272036+0000","last_fullsized":"2024-09-12T01:03:23.272036+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:23.271732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:23.271732+0000","last_clean_scrub_stamp":"2024-09-12T01:03:23.271732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:59.975818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.869328+0000","last_change":"2024-09-12T01:03:26.869196+0000","last_active":"2024-09-12T01:03:26.869328+0000","last_peered":"2024-09-12T01:03:26.869328+0000","last_clean":"2024-09-12T01:03:26.869328+0000","last_became_active":"2024-09-12T00:32:28.070913+0000","last_became_peered":"2024-09-12T00:32:28.070913+0000","last_unstale":"2024-09-12T01:03:26.869328+0000","last_undegraded":"2024-09-12T01:03:26.869328+0000","last_fullsized":"2024-09-12T01:03:26.869328+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:26.869003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:26.869003+0000","last_clean_scrub_stamp":"2024-09-12T01:03:26.869003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:51.193560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"268'10","reported_seq":64,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.272105+0000","last_change":"2024-09-12T01:03:23.271953+0000","last_active":"2024-09-12T01:03:23.272105+0000","last_peered":"2024-09-12T01:03:23.272105+0000","last_clean":"2024-09-12T01:03:23.272105+0000","last_became_active":"2024-09-12T00:32:25.007681+0000","last_became_peered":"2024-09-12T00:32:25.007681+0000","last_unstale":"2024-09-12T01:03:23.272105+0000","last_undegraded":"2024-09-12T01:03:23.272105+0000","last_fullsized":"2024-09-12T01:03:23.272105+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'10","last_scrub_stamp":"2024-09-12T01:03:23.271777+0000","last_deep_scrub":"268'10","last_deep_scrub_stamp":"2024-09-12T01:03:23.271777+0000","last_clean_scrub_stamp":"2024-09-12T01:03:23.271777+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:38.486892+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4146,"num_write":20,"num_write_kb":6192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"268'39","reported_seq":158,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:36.585030+0000","last_change":"2024-09-12T01:03:36.585030+0000","last_active":"2024-09-12T01:03:36.585030+0000","last_peered":"2024-09-12T01:03:36.585030+0000","last_clean":"2024-09-12T01:03:36.585030+0000","last_became_active":"2024-09-12T00:30:51.559520+0000","last_became_peered":"2024-09-12T00:30:51.559520+0000","last_unstale":"2024-09-12T01:03:36.585030+0000","last_undegraded":"2024-09-12T01:03:36.585030+0000","last_fullsized":"2024-09-12T01:03:36.585030+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'39","last_scrub_stamp":"2024-09-12T01:03:36.584838+0000","last_deep_scrub":"268'39","last_deep_scrub_stamp":"2024-09-12T01:03:36.584838+0000","last_clean_scrub_stamp":"2024-09-12T01:03:36.584838+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:32.471824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":143,"num_write":68,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:52.670556+0000","last_change":"2024-09-12T01:03:52.670556+0000","last_active":"2024-09-12T01:03:52.670556+0000","last_peered":"2024-09-12T01:03:52.670556+0000","last_clean":"2024-09-12T01:03:52.670556+0000","last_became_active":"2024-09-12T00:43:48.286079+0000","last_became_peered":"2024-09-12T00:43:48.286079+0000","last_unstale":"2024-09-12T01:03:52.670556+0000","last_undegraded":"2024-09-12T01:03:52.670556+0000","last_fullsized":"2024-09-12T01:03:52.670556+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:52.670375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:52.670375+0000","last_clean_scrub_stamp":"2024-09-12T01:03:52.670375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:11.954972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:28.896191+0000","last_change":"2024-09-12T01:03:28.896022+0000","last_active":"2024-09-12T01:03:28.896191+0000","last_peered":"2024-09-12T01:03:28.896191+0000","last_clean":"2024-09-12T01:03:28.896191+0000","last_became_active":"2024-09-12T00:32:28.074621+0000","last_became_peered":"2024-09-12T00:32:28.074621+0000","last_unstale":"2024-09-12T01:03:28.896191+0000","last_undegraded":"2024-09-12T01:03:28.896191+0000","last_fullsized":"2024-09-12T01:03:28.896191+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:28.895840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:28.895840+0000","last_clean_scrub_stamp":"2024-09-12T01:03:28.895840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:11.927530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.848820+0000","last_change":"2024-09-12T01:03:21.848666+0000","last_active":"2024-09-12T01:03:21.848820+0000","last_peered":"2024-09-12T01:03:21.848820+0000","last_clean":"2024-09-12T01:03:21.848820+0000","last_became_active":"2024-09-12T00:32:25.008419+0000","last_became_peered":"2024-09-12T00:32:25.008419+0000","last_unstale":"2024-09-12T01:03:21.848820+0000","last_undegraded":"2024-09-12T01:03:21.848820+0000","last_fullsized":"2024-09-12T01:03:21.848820+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:21.848478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:21.848478+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.848478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:37.368526+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"268'30","reported_seq":128,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.266399+0000","last_change":"2024-09-12T01:03:16.266399+0000","last_active":"2024-09-12T01:03:16.266399+0000","last_peered":"2024-09-12T01:03:16.266399+0000","last_clean":"2024-09-12T01:03:16.266399+0000","last_became_active":"2024-09-12T00:30:51.540434+0000","last_became_peered":"2024-09-12T00:30:51.540434+0000","last_unstale":"2024-09-12T01:03:16.266399+0000","last_undegraded":"2024-09-12T01:03:16.266399+0000","last_fullsized":"2024-09-12T01:03:16.266399+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'30","last_scrub_stamp":"2024-09-12T01:03:16.266214+0000","last_deep_scrub":"268'30","last_deep_scrub_stamp":"2024-09-12T01:03:16.266214+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.266214+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:23.214089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":92,"num_write":60,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.293765+0000","last_change":"2024-09-12T01:03:24.293765+0000","last_active":"2024-09-12T01:03:24.293765+0000","last_peered":"2024-09-12T01:03:24.293765+0000","last_clean":"2024-09-12T01:03:24.293765+0000","last_became_active":"2024-09-12T00:43:48.278477+0000","last_became_peered":"2024-09-12T00:43:48.278477+0000","last_unstale":"2024-09-12T01:03:24.293765+0000","last_undegraded":"2024-09-12T01:03:24.293765+0000","last_fullsized":"2024-09-12T01:03:24.293765+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:24.293583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:24.293583+0000","last_clean_scrub_stamp":"2024-09-12T01:03:24.293583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:45.657684+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"268'11","reported_seq":69,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:32.838190+0000","last_change":"2024-09-12T01:03:32.838051+0000","last_active":"2024-09-12T01:03:32.838190+0000","last_peered":"2024-09-12T01:03:32.838190+0000","last_clean":"2024-09-12T01:03:32.838190+0000","last_became_active":"2024-09-12T00:32:28.066441+0000","last_became_peered":"2024-09-12T00:32:28.066441+0000","last_unstale":"2024-09-12T01:03:32.838190+0000","last_undegraded":"2024-09-12T01:03:32.838190+0000","last_fullsized":"2024-09-12T01:03:32.838190+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'11","last_scrub_stamp":"2024-09-12T01:03:32.837882+0000","last_deep_scrub":"268'11","last_deep_scrub_stamp":"2024-09-12T01:03:32.837882+0000","last_clean_scrub_stamp":"2024-09-12T01:03:32.837882+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:07.881204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":37890,"num_write":21,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.819533+0000","last_change":"2024-09-12T01:03:22.819368+0000","last_active":"2024-09-12T01:03:22.819533+0000","last_peered":"2024-09-12T01:03:22.819533+0000","last_clean":"2024-09-12T01:03:22.819533+0000","last_became_active":"2024-09-12T00:32:25.010752+0000","last_became_peered":"2024-09-12T00:32:25.010752+0000","last_unstale":"2024-09-12T01:03:22.819533+0000","last_undegraded":"2024-09-12T01:03:22.819533+0000","last_fullsized":"2024-09-12T01:03:22.819533+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:22.819184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:22.819184+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.819184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:26.792829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"268'115","reported_seq":473,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.202043+0000","last_change":"2024-09-12T01:03:17.202043+0000","last_active":"2024-09-12T01:03:17.202043+0000","last_peered":"2024-09-12T01:03:17.202043+0000","last_clean":"2024-09-12T01:03:17.202043+0000","last_became_active":"2024-09-12T00:30:51.550081+0000","last_became_peered":"2024-09-12T00:30:51.550081+0000","last_unstale":"2024-09-12T01:03:17.202043+0000","last_undegraded":"2024-09-12T01:03:17.202043+0000","last_fullsized":"2024-09-12T01:03:17.202043+0000","mapping_epoch":257,"log_start":"265'100","ondisk_log_start":"265'100","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-12T01:03:17.201850+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-12T01:03:17.201850+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.201850+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:23.902914+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":826,"num_read_kb":599,"num_write":142,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4473,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:41.853765+0000","last_change":"2024-09-12T01:03:41.853630+0000","last_active":"2024-09-12T01:03:41.853765+0000","last_peered":"2024-09-12T01:03:41.853765+0000","last_clean":"2024-09-12T01:03:41.853765+0000","last_became_active":"2024-09-12T00:43:48.272486+0000","last_became_peered":"2024-09-12T00:43:48.272486+0000","last_unstale":"2024-09-12T01:03:41.853765+0000","last_undegraded":"2024-09-12T01:03:41.853765+0000","last_fullsized":"2024-09-12T01:03:41.853765+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:41.853437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:41.853437+0000","last_clean_scrub_stamp":"2024-09-12T01:03:41.853437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:01.403207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:46.681947+0000","last_change":"2024-09-12T01:03:46.681947+0000","last_active":"2024-09-12T01:03:46.681947+0000","last_peered":"2024-09-12T01:03:46.681947+0000","last_clean":"2024-09-12T01:03:46.681947+0000","last_became_active":"2024-09-12T00:32:28.049186+0000","last_became_peered":"2024-09-12T00:32:28.049186+0000","last_unstale":"2024-09-12T01:03:46.681947+0000","last_undegraded":"2024-09-12T01:03:46.681947+0000","last_fullsized":"2024-09-12T01:03:46.681947+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:46.681768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:46.681768+0000","last_clean_scrub_stamp":"2024-09-12T01:03:46.681768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:37.296751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":47,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.900005+0000","last_change":"2024-09-12T01:03:18.900005+0000","last_active":"2024-09-12T01:03:18.900005+0000","last_peered":"2024-09-12T01:03:18.900005+0000","last_clean":"2024-09-12T01:03:18.900005+0000","last_became_active":"2024-09-12T00:32:24.999633+0000","last_became_peered":"2024-09-12T00:32:24.999633+0000","last_unstale":"2024-09-12T01:03:18.900005+0000","last_undegraded":"2024-09-12T01:03:18.900005+0000","last_fullsized":"2024-09-12T01:03:18.900005+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:18.899817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:18.899817+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.899817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:50.009102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"268'69","reported_seq":245,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.149747+0000","last_change":"2024-09-12T01:03:16.149747+0000","last_active":"2024-09-12T01:03:16.149747+0000","last_peered":"2024-09-12T01:03:16.149747+0000","last_clean":"2024-09-12T01:03:16.149747+0000","last_became_active":"2024-09-12T00:30:51.546873+0000","last_became_peered":"2024-09-12T00:30:51.546873+0000","last_unstale":"2024-09-12T01:03:16.149747+0000","last_undegraded":"2024-09-12T01:03:16.149747+0000","last_fullsized":"2024-09-12T01:03:16.149747+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'69","last_scrub_stamp":"2024-09-12T01:03:16.149570+0000","last_deep_scrub":"268'69","last_deep_scrub_stamp":"2024-09-12T01:03:16.149570+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.149570+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:41.334298+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":364,"num_read_kb":256,"num_write":124,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.645409+0000","last_change":"2024-09-12T01:03:25.645229+0000","last_active":"2024-09-12T01:03:25.645409+0000","last_peered":"2024-09-12T01:03:25.645409+0000","last_clean":"2024-09-12T01:03:25.645409+0000","last_became_active":"2024-09-12T00:43:48.287144+0000","last_became_peered":"2024-09-12T00:43:48.287144+0000","last_unstale":"2024-09-12T01:03:25.645409+0000","last_undegraded":"2024-09-12T01:03:25.645409+0000","last_fullsized":"2024-09-12T01:03:25.645409+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:25.645045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:25.645045+0000","last_clean_scrub_stamp":"2024-09-12T01:03:25.645045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:15.791265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:27.604111+0000","last_change":"2024-09-12T01:03:27.604111+0000","last_active":"2024-09-12T01:03:27.604111+0000","last_peered":"2024-09-12T01:03:27.604111+0000","last_clean":"2024-09-12T01:03:27.604111+0000","last_became_active":"2024-09-12T00:32:28.063712+0000","last_became_peered":"2024-09-12T00:32:28.063712+0000","last_unstale":"2024-09-12T01:03:27.604111+0000","last_undegraded":"2024-09-12T01:03:27.604111+0000","last_fullsized":"2024-09-12T01:03:27.604111+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:27.603936+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:27.603936+0000","last_clean_scrub_stamp":"2024-09-12T01:03:27.603936+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:49.872350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"268'3","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.767024+0000","last_change":"2024-09-12T01:03:26.767024+0000","last_active":"2024-09-12T01:03:26.767024+0000","last_peered":"2024-09-12T01:03:26.767024+0000","last_clean":"2024-09-12T01:03:26.767024+0000","last_became_active":"2024-09-12T00:32:25.005902+0000","last_became_peered":"2024-09-12T00:32:25.005902+0000","last_unstale":"2024-09-12T01:03:26.767024+0000","last_undegraded":"2024-09-12T01:03:26.767024+0000","last_fullsized":"2024-09-12T01:03:26.767024+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:26.766795+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:26.766795+0000","last_clean_scrub_stamp":"2024-09-12T01:03:26.766795+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:33.560560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"268'31","reported_seq":135,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.540572+0000","last_change":"2024-09-12T01:03:14.540434+0000","last_active":"2024-09-12T01:03:14.540572+0000","last_peered":"2024-09-12T01:03:14.540572+0000","last_clean":"2024-09-12T01:03:14.540572+0000","last_became_active":"2024-09-12T00:30:51.541904+0000","last_became_peered":"2024-09-12T00:30:51.541904+0000","last_unstale":"2024-09-12T01:03:14.540572+0000","last_undegraded":"2024-09-12T01:03:14.540572+0000","last_fullsized":"2024-09-12T01:03:14.540572+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'31","last_scrub_stamp":"2024-09-12T01:03:14.540261+0000","last_deep_scrub":"268'31","last_deep_scrub_stamp":"2024-09-12T01:03:14.540261+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.540261+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:50.202651+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":109,"num_write":54,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"268'2","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.649338+0000","last_change":"2024-09-12T01:03:19.649168+0000","last_active":"2024-09-12T01:03:19.649338+0000","last_peered":"2024-09-12T01:03:19.649338+0000","last_clean":"2024-09-12T01:03:19.649338+0000","last_became_active":"2024-09-12T00:43:48.274756+0000","last_became_peered":"2024-09-12T00:43:48.274756+0000","last_unstale":"2024-09-12T01:03:19.649338+0000","last_undegraded":"2024-09-12T01:03:19.649338+0000","last_fullsized":"2024-09-12T01:03:19.649338+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:19.648922+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:19.648922+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.648922+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:52.437120+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"268'5","reported_seq":50,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.282492+0000","last_change":"2024-09-12T01:03:25.282336+0000","last_active":"2024-09-12T01:03:25.282492+0000","last_peered":"2024-09-12T01:03:25.282492+0000","last_clean":"2024-09-12T01:03:25.282492+0000","last_became_active":"2024-09-12T00:32:28.066029+0000","last_became_peered":"2024-09-12T00:32:28.066029+0000","last_unstale":"2024-09-12T01:03:25.282492+0000","last_undegraded":"2024-09-12T01:03:25.282492+0000","last_fullsized":"2024-09-12T01:03:25.282492+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'5","last_scrub_stamp":"2024-09-12T01:03:25.282160+0000","last_deep_scrub":"268'5","last_deep_scrub_stamp":"2024-09-12T01:03:25.282160+0000","last_clean_scrub_stamp":"2024-09-12T01:03:25.282160+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:20.419173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":8192,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"268'3","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.877291+0000","last_change":"2024-09-12T01:03:20.877291+0000","last_active":"2024-09-12T01:03:20.877291+0000","last_peered":"2024-09-12T01:03:20.877291+0000","last_clean":"2024-09-12T01:03:20.877291+0000","last_became_active":"2024-09-12T00:32:25.001194+0000","last_became_peered":"2024-09-12T00:32:25.001194+0000","last_unstale":"2024-09-12T01:03:20.877291+0000","last_undegraded":"2024-09-12T01:03:20.877291+0000","last_fullsized":"2024-09-12T01:03:20.877291+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:20.877064+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:20.877064+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.877064+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:15.612436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"268'15","reported_seq":91,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.685317+0000","last_change":"2024-09-12T01:03:24.685317+0000","last_active":"2024-09-12T01:03:24.685317+0000","last_peered":"2024-09-12T01:03:24.685317+0000","last_clean":"2024-09-12T01:03:24.685317+0000","last_became_active":"2024-09-12T00:30:51.543711+0000","last_became_peered":"2024-09-12T00:30:51.543711+0000","last_unstale":"2024-09-12T01:03:24.685317+0000","last_undegraded":"2024-09-12T01:03:24.685317+0000","last_fullsized":"2024-09-12T01:03:24.685317+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'15","last_scrub_stamp":"2024-09-12T01:03:24.685137+0000","last_deep_scrub":"268'15","last_deep_scrub_stamp":"2024-09-12T01:03:24.685137+0000","last_clean_scrub_stamp":"2024-09-12T01:03:24.685137+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:54.374975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":43,"num_write":36,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:32.947111+0000","last_change":"2024-09-12T01:03:32.946873+0000","last_active":"2024-09-12T01:03:32.947111+0000","last_peered":"2024-09-12T01:03:32.947111+0000","last_clean":"2024-09-12T01:03:32.947111+0000","last_became_active":"2024-09-12T00:43:48.289475+0000","last_became_peered":"2024-09-12T00:43:48.289475+0000","last_unstale":"2024-09-12T01:03:32.947111+0000","last_undegraded":"2024-09-12T01:03:32.947111+0000","last_fullsized":"2024-09-12T01:03:32.947111+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:32.946660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:32.946660+0000","last_clean_scrub_stamp":"2024-09-12T01:03:32.946660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:44.883634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":41,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.604673+0000","last_change":"2024-09-12T01:03:18.604673+0000","last_active":"2024-09-12T01:03:18.604673+0000","last_peered":"2024-09-12T01:03:18.604673+0000","last_clean":"2024-09-12T01:03:18.604673+0000","last_became_active":"2024-09-12T00:32:28.055934+0000","last_became_peered":"2024-09-12T00:32:28.055934+0000","last_unstale":"2024-09-12T01:03:18.604673+0000","last_undegraded":"2024-09-12T01:03:18.604673+0000","last_fullsized":"2024-09-12T01:03:18.604673+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:18.604375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:18.604375+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.604375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:11.137151+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"268'3","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:41.611904+0000","last_change":"2024-09-12T01:03:41.611751+0000","last_active":"2024-09-12T01:03:41.611904+0000","last_peered":"2024-09-12T01:03:41.611904+0000","last_clean":"2024-09-12T01:03:41.611904+0000","last_became_active":"2024-09-12T00:32:25.004503+0000","last_became_peered":"2024-09-12T00:32:25.004503+0000","last_unstale":"2024-09-12T01:03:41.611904+0000","last_undegraded":"2024-09-12T01:03:41.611904+0000","last_fullsized":"2024-09-12T01:03:41.611904+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:41.611558+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:41.611558+0000","last_clean_scrub_stamp":"2024-09-12T01:03:41.611558+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:11.851497+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"268'12","reported_seq":84,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.595764+0000","last_change":"2024-09-12T01:03:11.595595+0000","last_active":"2024-09-12T01:03:11.595764+0000","last_peered":"2024-09-12T01:03:11.595764+0000","last_clean":"2024-09-12T01:03:11.595764+0000","last_became_active":"2024-09-12T00:30:51.542992+0000","last_became_peered":"2024-09-12T00:30:51.542992+0000","last_unstale":"2024-09-12T01:03:11.595764+0000","last_undegraded":"2024-09-12T01:03:11.595764+0000","last_fullsized":"2024-09-12T01:03:11.595764+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-09-12T01:03:11.595417+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-09-12T01:03:11.595417+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.595417+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:35.022578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":39,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.644001+0000","last_change":"2024-09-12T01:03:23.644001+0000","last_active":"2024-09-12T01:03:23.644001+0000","last_peered":"2024-09-12T01:03:23.644001+0000","last_clean":"2024-09-12T01:03:23.644001+0000","last_became_active":"2024-09-12T00:43:48.276293+0000","last_became_peered":"2024-09-12T00:43:48.276293+0000","last_unstale":"2024-09-12T01:03:23.644001+0000","last_undegraded":"2024-09-12T01:03:23.644001+0000","last_fullsized":"2024-09-12T01:03:23.644001+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:23.643816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:23.643816+0000","last_clean_scrub_stamp":"2024-09-12T01:03:23.643816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:29.972414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"268'6","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.821480+0000","last_change":"2024-09-12T01:03:34.821345+0000","last_active":"2024-09-12T01:03:34.821480+0000","last_peered":"2024-09-12T01:03:34.821480+0000","last_clean":"2024-09-12T01:03:34.821480+0000","last_became_active":"2024-09-12T00:32:28.067824+0000","last_became_peered":"2024-09-12T00:32:28.067824+0000","last_unstale":"2024-09-12T01:03:34.821480+0000","last_undegraded":"2024-09-12T01:03:34.821480+0000","last_fullsized":"2024-09-12T01:03:34.821480+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:03:34.821139+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:03:34.821139+0000","last_clean_scrub_stamp":"2024-09-12T01:03:34.821139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:25.409721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"268'3","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:40.626101+0000","last_change":"2024-09-12T01:03:40.626101+0000","last_active":"2024-09-12T01:03:40.626101+0000","last_peered":"2024-09-12T01:03:40.626101+0000","last_clean":"2024-09-12T01:03:40.626101+0000","last_became_active":"2024-09-12T00:32:25.022210+0000","last_became_peered":"2024-09-12T00:32:25.022210+0000","last_unstale":"2024-09-12T01:03:40.626101+0000","last_undegraded":"2024-09-12T01:03:40.626101+0000","last_fullsized":"2024-09-12T01:03:40.626101+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:40.625914+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:40.625914+0000","last_clean_scrub_stamp":"2024-09-12T01:03:40.625914+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:29.752085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"268'33","reported_seq":142,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.336103+0000","last_change":"2024-09-12T01:03:23.336103+0000","last_active":"2024-09-12T01:03:23.336103+0000","last_peered":"2024-09-12T01:03:23.336103+0000","last_clean":"2024-09-12T01:03:23.336103+0000","last_became_active":"2024-09-12T00:30:51.549942+0000","last_became_peered":"2024-09-12T00:30:51.549942+0000","last_unstale":"2024-09-12T01:03:23.336103+0000","last_undegraded":"2024-09-12T01:03:23.336103+0000","last_fullsized":"2024-09-12T01:03:23.336103+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'33","last_scrub_stamp":"2024-09-12T01:03:23.335921+0000","last_deep_scrub":"268'33","last_deep_scrub_stamp":"2024-09-12T01:03:23.335921+0000","last_clean_scrub_stamp":"2024-09-12T01:03:23.335921+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:28.099431+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":167,"num_read_kb":118,"num_write":65,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.596066+0000","last_change":"2024-09-12T01:03:17.596066+0000","last_active":"2024-09-12T01:03:17.596066+0000","last_peered":"2024-09-12T01:03:17.596066+0000","last_clean":"2024-09-12T01:03:17.596066+0000","last_became_active":"2024-09-12T00:43:48.276176+0000","last_became_peered":"2024-09-12T00:43:48.276176+0000","last_unstale":"2024-09-12T01:03:17.596066+0000","last_undegraded":"2024-09-12T01:03:17.596066+0000","last_fullsized":"2024-09-12T01:03:17.596066+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:17.595889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:17.595889+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.595889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:47.529084+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:31.864406+0000","last_change":"2024-09-12T01:03:31.864248+0000","last_active":"2024-09-12T01:03:31.864406+0000","last_peered":"2024-09-12T01:03:31.864406+0000","last_clean":"2024-09-12T01:03:31.864406+0000","last_became_active":"2024-09-12T00:32:28.051244+0000","last_became_peered":"2024-09-12T00:32:28.051244+0000","last_unstale":"2024-09-12T01:03:31.864406+0000","last_undegraded":"2024-09-12T01:03:31.864406+0000","last_fullsized":"2024-09-12T01:03:31.864406+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:31.864057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:31.864057+0000","last_clean_scrub_stamp":"2024-09-12T01:03:31.864057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:47.473421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"268'2","reported_seq":52,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:28.350702+0000","last_change":"2024-09-12T01:03:28.350566+0000","last_active":"2024-09-12T01:03:28.350702+0000","last_peered":"2024-09-12T01:03:28.350702+0000","last_clean":"2024-09-12T01:03:28.350702+0000","last_became_active":"2024-09-12T00:32:25.022757+0000","last_became_peered":"2024-09-12T00:32:25.022757+0000","last_unstale":"2024-09-12T01:03:28.350702+0000","last_undegraded":"2024-09-12T01:03:28.350702+0000","last_fullsized":"2024-09-12T01:03:28.350702+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:28.350349+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:28.350349+0000","last_clean_scrub_stamp":"2024-09-12T01:03:28.350349+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:04.396560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'12","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:35.557685+0000","last_change":"2024-09-12T01:03:35.557685+0000","last_active":"2024-09-12T01:03:35.557685+0000","last_peered":"2024-09-12T01:03:35.557685+0000","last_clean":"2024-09-12T01:03:35.557685+0000","last_became_active":"2024-09-12T00:30:51.565544+0000","last_became_peered":"2024-09-12T00:30:51.565544+0000","last_unstale":"2024-09-12T01:03:35.557685+0000","last_undegraded":"2024-09-12T01:03:35.557685+0000","last_fullsized":"2024-09-12T01:03:35.557685+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'12","last_scrub_stamp":"2024-09-12T01:03:35.557495+0000","last_deep_scrub":"265'12","last_deep_scrub_stamp":"2024-09-12T01:03:35.557495+0000","last_clean_scrub_stamp":"2024-09-12T01:03:35.557495+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:42.468001+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":31,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:40.870248+0000","last_change":"2024-09-12T01:03:40.870101+0000","last_active":"2024-09-12T01:03:40.870248+0000","last_peered":"2024-09-12T01:03:40.870248+0000","last_clean":"2024-09-12T01:03:40.870248+0000","last_became_active":"2024-09-12T00:43:48.279243+0000","last_became_peered":"2024-09-12T00:43:48.279243+0000","last_unstale":"2024-09-12T01:03:40.870248+0000","last_undegraded":"2024-09-12T01:03:40.870248+0000","last_fullsized":"2024-09-12T01:03:40.870248+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:40.869913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:40.869913+0000","last_clean_scrub_stamp":"2024-09-12T01:03:40.869913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:40.351436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"268'3","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.577280+0000","last_change":"2024-09-12T01:03:13.577280+0000","last_active":"2024-09-12T01:03:13.577280+0000","last_peered":"2024-09-12T01:03:13.577280+0000","last_clean":"2024-09-12T01:03:13.577280+0000","last_became_active":"2024-09-12T00:32:28.058384+0000","last_became_peered":"2024-09-12T00:32:28.058384+0000","last_unstale":"2024-09-12T01:03:13.577280+0000","last_undegraded":"2024-09-12T01:03:13.577280+0000","last_fullsized":"2024-09-12T01:03:13.577280+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:03:13.577058+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:03:13.577058+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.577058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:14.485980+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"265'3","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.609581+0000","last_change":"2024-09-12T01:03:21.609581+0000","last_active":"2024-09-12T01:03:21.609581+0000","last_peered":"2024-09-12T01:03:21.609581+0000","last_clean":"2024-09-12T01:03:21.609581+0000","last_became_active":"2024-09-12T00:32:24.995532+0000","last_became_peered":"2024-09-12T00:32:24.995532+0000","last_unstale":"2024-09-12T01:03:21.609581+0000","last_undegraded":"2024-09-12T01:03:21.609581+0000","last_fullsized":"2024-09-12T01:03:21.609581+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:03:21.609383+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:03:21.609383+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.609383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:39.336952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"268'40","reported_seq":165,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.597091+0000","last_change":"2024-09-12T01:03:16.597091+0000","last_active":"2024-09-12T01:03:16.597091+0000","last_peered":"2024-09-12T01:03:16.597091+0000","last_clean":"2024-09-12T01:03:16.597091+0000","last_became_active":"2024-09-12T00:30:51.553501+0000","last_became_peered":"2024-09-12T00:30:51.553501+0000","last_unstale":"2024-09-12T01:03:16.597091+0000","last_undegraded":"2024-09-12T01:03:16.597091+0000","last_fullsized":"2024-09-12T01:03:16.597091+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'40","last_scrub_stamp":"2024-09-12T01:03:16.596775+0000","last_deep_scrub":"268'40","last_deep_scrub_stamp":"2024-09-12T01:03:16.596775+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.596775+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:40.998139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":150,"num_write":68,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:50.679492+0000","last_change":"2024-09-12T01:03:50.679492+0000","last_active":"2024-09-12T01:03:50.679492+0000","last_peered":"2024-09-12T01:03:50.679492+0000","last_clean":"2024-09-12T01:03:50.679492+0000","last_became_active":"2024-09-12T00:43:48.280566+0000","last_became_peered":"2024-09-12T00:43:48.280566+0000","last_unstale":"2024-09-12T01:03:50.679492+0000","last_undegraded":"2024-09-12T01:03:50.679492+0000","last_fullsized":"2024-09-12T01:03:50.679492+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:50.679305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:50.679305+0000","last_clean_scrub_stamp":"2024-09-12T01:03:50.679305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:18.987886+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"268'4","reported_seq":49,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:48.664354+0000","last_change":"2024-09-12T01:03:48.664354+0000","last_active":"2024-09-12T01:03:48.664354+0000","last_peered":"2024-09-12T01:03:48.664354+0000","last_clean":"2024-09-12T01:03:48.664354+0000","last_became_active":"2024-09-12T00:32:28.061089+0000","last_became_peered":"2024-09-12T00:32:28.061089+0000","last_unstale":"2024-09-12T01:03:48.664354+0000","last_undegraded":"2024-09-12T01:03:48.664354+0000","last_fullsized":"2024-09-12T01:03:48.664354+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:03:48.664211+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:03:48.664211+0000","last_clean_scrub_stamp":"2024-09-12T01:03:48.664211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:37.072400+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":326,"num_write":4,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"265'11","reported_seq":68,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:42.606702+0000","last_change":"2024-09-12T01:03:42.606702+0000","last_active":"2024-09-12T01:03:42.606702+0000","last_peered":"2024-09-12T01:03:42.606702+0000","last_clean":"2024-09-12T01:03:42.606702+0000","last_became_active":"2024-09-12T00:32:25.004199+0000","last_became_peered":"2024-09-12T00:32:25.004199+0000","last_unstale":"2024-09-12T01:03:42.606702+0000","last_undegraded":"2024-09-12T01:03:42.606702+0000","last_fullsized":"2024-09-12T01:03:42.606702+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T01:03:42.606509+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T01:03:42.606509+0000","last_clean_scrub_stamp":"2024-09-12T01:03:42.606509+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:05.036865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":11280,"num_write":21,"num_write_kb":11280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"268'12","reported_seq":87,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.898022+0000","last_change":"2024-09-12T01:03:13.898022+0000","last_active":"2024-09-12T01:03:13.898022+0000","last_peered":"2024-09-12T01:03:13.898022+0000","last_clean":"2024-09-12T01:03:13.898022+0000","last_became_active":"2024-09-12T00:30:51.548619+0000","last_became_peered":"2024-09-12T00:30:51.548619+0000","last_unstale":"2024-09-12T01:03:13.898022+0000","last_undegraded":"2024-09-12T01:03:13.898022+0000","last_fullsized":"2024-09-12T01:03:13.898022+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'12","last_scrub_stamp":"2024-09-12T01:03:13.897805+0000","last_deep_scrub":"268'12","last_deep_scrub_stamp":"2024-09-12T01:03:13.897805+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.897805+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:37.589859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":45,"num_write":22,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"268'2","reported_seq":32,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.961225+0000","last_change":"2024-09-12T01:03:34.961225+0000","last_active":"2024-09-12T01:03:34.961225+0000","last_peered":"2024-09-12T01:03:34.961225+0000","last_clean":"2024-09-12T01:03:34.961225+0000","last_became_active":"2024-09-12T00:43:48.283630+0000","last_became_peered":"2024-09-12T00:43:48.283630+0000","last_unstale":"2024-09-12T01:03:34.961225+0000","last_undegraded":"2024-09-12T01:03:34.961225+0000","last_fullsized":"2024-09-12T01:03:34.961225+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:34.961009+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:34.961009+0000","last_clean_scrub_stamp":"2024-09-12T01:03:34.961009+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:30.727100+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'5","reported_seq":53,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:30.387025+0000","last_change":"2024-09-12T01:03:30.386881+0000","last_active":"2024-09-12T01:03:30.387025+0000","last_peered":"2024-09-12T01:03:30.387025+0000","last_clean":"2024-09-12T01:03:30.387025+0000","last_became_active":"2024-09-12T00:32:28.054045+0000","last_became_peered":"2024-09-12T00:32:28.054045+0000","last_unstale":"2024-09-12T01:03:30.387025+0000","last_undegraded":"2024-09-12T01:03:30.387025+0000","last_fullsized":"2024-09-12T01:03:30.387025+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:03:30.386648+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:03:30.386648+0000","last_clean_scrub_stamp":"2024-09-12T01:03:30.386648+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:48.463320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'3","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.647777+0000","last_change":"2024-09-12T01:03:19.647777+0000","last_active":"2024-09-12T01:03:19.647777+0000","last_peered":"2024-09-12T01:03:19.647777+0000","last_clean":"2024-09-12T01:03:19.647777+0000","last_became_active":"2024-09-12T00:32:24.997768+0000","last_became_peered":"2024-09-12T00:32:24.997768+0000","last_unstale":"2024-09-12T01:03:19.647777+0000","last_undegraded":"2024-09-12T01:03:19.647777+0000","last_fullsized":"2024-09-12T01:03:19.647777+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:03:19.647452+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:03:19.647452+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.647452+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:36.457762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"268'27","reported_seq":122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.573504+0000","last_change":"2024-09-12T01:03:15.573504+0000","last_active":"2024-09-12T01:03:15.573504+0000","last_peered":"2024-09-12T01:03:15.573504+0000","last_clean":"2024-09-12T01:03:15.573504+0000","last_became_active":"2024-09-12T00:30:51.556456+0000","last_became_peered":"2024-09-12T00:30:51.556456+0000","last_unstale":"2024-09-12T01:03:15.573504+0000","last_undegraded":"2024-09-12T01:03:15.573504+0000","last_fullsized":"2024-09-12T01:03:15.573504+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'27","last_scrub_stamp":"2024-09-12T01:03:15.573326+0000","last_deep_scrub":"268'27","last_deep_scrub_stamp":"2024-09-12T01:03:15.573326+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.573326+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:55.863953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":124,"num_read_kb":86,"num_write":57,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.396603+0000","last_change":"2024-09-12T01:03:29.396603+0000","last_active":"2024-09-12T01:03:29.396603+0000","last_peered":"2024-09-12T01:03:29.396603+0000","last_clean":"2024-09-12T01:03:29.396603+0000","last_became_active":"2024-09-12T00:43:48.265726+0000","last_became_peered":"2024-09-12T00:43:48.265726+0000","last_unstale":"2024-09-12T01:03:29.396603+0000","last_undegraded":"2024-09-12T01:03:29.396603+0000","last_fullsized":"2024-09-12T01:03:29.396603+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:29.396399+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:29.396399+0000","last_clean_scrub_stamp":"2024-09-12T01:03:29.396399+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:34.292189+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"265'3","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:45.664566+0000","last_change":"2024-09-12T01:03:45.664566+0000","last_active":"2024-09-12T01:03:45.664566+0000","last_peered":"2024-09-12T01:03:45.664566+0000","last_clean":"2024-09-12T01:03:45.664566+0000","last_became_active":"2024-09-12T00:32:28.051145+0000","last_became_peered":"2024-09-12T00:32:28.051145+0000","last_unstale":"2024-09-12T01:03:45.664566+0000","last_undegraded":"2024-09-12T01:03:45.664566+0000","last_fullsized":"2024-09-12T01:03:45.664566+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:03:45.664378+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:03:45.664378+0000","last_clean_scrub_stamp":"2024-09-12T01:03:45.664378+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:06.433668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":48,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:38.601358+0000","last_change":"2024-09-12T01:03:38.601215+0000","last_active":"2024-09-12T01:03:38.601358+0000","last_peered":"2024-09-12T01:03:38.601358+0000","last_clean":"2024-09-12T01:03:38.601358+0000","last_became_active":"2024-09-12T00:32:25.003679+0000","last_became_peered":"2024-09-12T00:32:25.003679+0000","last_unstale":"2024-09-12T01:03:38.601358+0000","last_undegraded":"2024-09-12T01:03:38.601358+0000","last_fullsized":"2024-09-12T01:03:38.601358+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:38.601035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:38.601035+0000","last_clean_scrub_stamp":"2024-09-12T01:03:38.601035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:29.732483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"268'23","reported_seq":115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:34.606930+0000","last_change":"2024-09-12T01:03:34.606930+0000","last_active":"2024-09-12T01:03:34.606930+0000","last_peered":"2024-09-12T01:03:34.606930+0000","last_clean":"2024-09-12T01:03:34.606930+0000","last_became_active":"2024-09-12T00:30:51.551554+0000","last_became_peered":"2024-09-12T00:30:51.551554+0000","last_unstale":"2024-09-12T01:03:34.606930+0000","last_undegraded":"2024-09-12T01:03:34.606930+0000","last_fullsized":"2024-09-12T01:03:34.606930+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'23","last_scrub_stamp":"2024-09-12T01:03:34.606713+0000","last_deep_scrub":"268'23","last_deep_scrub_stamp":"2024-09-12T01:03:34.606713+0000","last_clean_scrub_stamp":"2024-09-12T01:03:34.606713+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:49.185113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":80,"num_write":40,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:42.856188+0000","last_change":"2024-09-12T01:03:42.856188+0000","last_active":"2024-09-12T01:03:42.856188+0000","last_peered":"2024-09-12T01:03:42.856188+0000","last_clean":"2024-09-12T01:03:42.856188+0000","last_became_active":"2024-09-12T00:43:48.286593+0000","last_became_peered":"2024-09-12T00:43:48.286593+0000","last_unstale":"2024-09-12T01:03:42.856188+0000","last_undegraded":"2024-09-12T01:03:42.856188+0000","last_fullsized":"2024-09-12T01:03:42.856188+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:42.855908+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:42.855908+0000","last_clean_scrub_stamp":"2024-09-12T01:03:42.855908+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:21.669803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"268'6","reported_seq":55,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.655503+0000","last_change":"2024-09-12T01:03:20.655342+0000","last_active":"2024-09-12T01:03:20.655503+0000","last_peered":"2024-09-12T01:03:20.655503+0000","last_clean":"2024-09-12T01:03:20.655503+0000","last_became_active":"2024-09-12T00:32:28.069812+0000","last_became_peered":"2024-09-12T00:32:28.069812+0000","last_unstale":"2024-09-12T01:03:20.655503+0000","last_undegraded":"2024-09-12T01:03:20.655503+0000","last_fullsized":"2024-09-12T01:03:20.655503+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:03:20.655131+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:03:20.655131+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.655131+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:06.834953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16384,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"268'8","reported_seq":70,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.243572+0000","last_change":"2024-09-12T01:03:22.243432+0000","last_active":"2024-09-12T01:03:22.243572+0000","last_peered":"2024-09-12T01:03:22.243572+0000","last_clean":"2024-09-12T01:03:22.243572+0000","last_became_active":"2024-09-12T00:32:25.017138+0000","last_became_peered":"2024-09-12T00:32:25.017138+0000","last_unstale":"2024-09-12T01:03:22.243572+0000","last_undegraded":"2024-09-12T01:03:22.243572+0000","last_fullsized":"2024-09-12T01:03:22.243572+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'8","last_scrub_stamp":"2024-09-12T01:03:22.243247+0000","last_deep_scrub":"268'8","last_deep_scrub_stamp":"2024-09-12T01:03:22.243247+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.243247+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:15.153887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32770,"num_write":8,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"268'53","reported_seq":198,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:33.566574+0000","last_change":"2024-09-12T01:03:33.566574+0000","last_active":"2024-09-12T01:03:33.566574+0000","last_peered":"2024-09-12T01:03:33.566574+0000","last_clean":"2024-09-12T01:03:33.566574+0000","last_became_active":"2024-09-12T00:30:51.546238+0000","last_became_peered":"2024-09-12T00:30:51.546238+0000","last_unstale":"2024-09-12T01:03:33.566574+0000","last_undegraded":"2024-09-12T01:03:33.566574+0000","last_fullsized":"2024-09-12T01:03:33.566574+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'53","last_scrub_stamp":"2024-09-12T01:03:33.566391+0000","last_deep_scrub":"268'53","last_deep_scrub_stamp":"2024-09-12T01:03:33.566391+0000","last_clean_scrub_stamp":"2024-09-12T01:03:33.566391+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:35.853970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":276,"num_read_kb":191,"num_write":88,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:51.705507+0000","last_change":"2024-09-12T01:03:51.705507+0000","last_active":"2024-09-12T01:03:51.705507+0000","last_peered":"2024-09-12T01:03:51.705507+0000","last_clean":"2024-09-12T01:03:51.705507+0000","last_became_active":"2024-09-12T00:43:48.277275+0000","last_became_peered":"2024-09-12T00:43:48.277275+0000","last_unstale":"2024-09-12T01:03:51.705507+0000","last_undegraded":"2024-09-12T01:03:51.705507+0000","last_fullsized":"2024-09-12T01:03:51.705507+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":266,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:51.705322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:51.705322+0000","last_clean_scrub_stamp":"2024-09-12T01:03:51.705322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:22.370529+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"0'0","reported_seq":42,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.624406+0000","last_change":"2024-09-12T01:03:23.624277+0000","last_active":"2024-09-12T01:03:23.624406+0000","last_peered":"2024-09-12T01:03:23.624406+0000","last_clean":"2024-09-12T01:03:23.624406+0000","last_became_active":"2024-09-12T00:32:28.065320+0000","last_became_peered":"2024-09-12T00:32:28.065320+0000","last_unstale":"2024-09-12T01:03:23.624406+0000","last_undegraded":"2024-09-12T01:03:23.624406+0000","last_fullsized":"2024-09-12T01:03:23.624406+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:23.624094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:23.624094+0000","last_clean_scrub_stamp":"2024-09-12T01:03:23.624094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:53.727926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'3","reported_seq":54,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.305353+0000","last_change":"2024-09-12T01:03:15.305196+0000","last_active":"2024-09-12T01:03:15.305353+0000","last_peered":"2024-09-12T01:03:15.305353+0000","last_clean":"2024-09-12T01:03:15.305353+0000","last_became_active":"2024-09-12T00:32:25.013266+0000","last_became_peered":"2024-09-12T00:32:25.013266+0000","last_unstale":"2024-09-12T01:03:15.305353+0000","last_undegraded":"2024-09-12T01:03:15.305353+0000","last_fullsized":"2024-09-12T01:03:15.305353+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:03:15.304984+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:03:15.304984+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.304984+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:55.982092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"268'15","reported_seq":95,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.583636+0000","last_change":"2024-09-12T01:03:11.583636+0000","last_active":"2024-09-12T01:03:11.583636+0000","last_peered":"2024-09-12T01:03:11.583636+0000","last_clean":"2024-09-12T01:03:11.583636+0000","last_became_active":"2024-09-12T00:30:51.559445+0000","last_became_peered":"2024-09-12T00:30:51.559445+0000","last_unstale":"2024-09-12T01:03:11.583636+0000","last_undegraded":"2024-09-12T01:03:11.583636+0000","last_fullsized":"2024-09-12T01:03:11.583636+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'15","last_scrub_stamp":"2024-09-12T01:03:11.583415+0000","last_deep_scrub":"268'15","last_deep_scrub_stamp":"2024-09-12T01:03:11.583415+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.583415+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:28.744442+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":31,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"268'370","reported_seq":1136,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.588959+0000","last_change":"2024-09-12T01:02:49.588695+0000","last_active":"2024-09-12T01:02:49.588959+0000","last_peered":"2024-09-12T01:02:49.588959+0000","last_clean":"2024-09-12T01:02:49.588959+0000","last_became_active":"2024-09-12T00:15:55.078687+0000","last_became_peered":"2024-09-12T00:15:55.078687+0000","last_unstale":"2024-09-12T01:02:49.588959+0000","last_undegraded":"2024-09-12T01:02:49.588959+0000","last_fullsized":"2024-09-12T01:02:49.588959+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-12T01:02:49.588395+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-12T01:02:49.588395+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.588395+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:32.972868+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":769,"num_read_kb":39834,"num_write":1260,"num_write_kb":26442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"268'859","reported_seq":2616,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.181970+0000","last_change":"2024-09-12T01:03:00.181836+0000","last_active":"2024-09-12T01:03:00.181970+0000","last_peered":"2024-09-12T01:03:00.181970+0000","last_clean":"2024-09-12T01:03:00.181970+0000","last_became_active":"2024-09-12T00:15:57.021927+0000","last_became_peered":"2024-09-12T00:15:57.021927+0000","last_unstale":"2024-09-12T01:03:00.181970+0000","last_undegraded":"2024-09-12T01:03:00.181970+0000","last_fullsized":"2024-09-12T01:03:00.181970+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'859","last_scrub_stamp":"2024-09-12T01:03:00.181615+0000","last_deep_scrub":"268'859","last_deep_scrub_stamp":"2024-09-12T01:03:00.181615+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.181615+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:29.997742+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4184,"num_read_kb":3812,"num_write":1107,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"268'392","reported_seq":1055,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.459885+0000","last_change":"2024-09-12T01:02:59.459607+0000","last_active":"2024-09-12T01:02:59.459885+0000","last_peered":"2024-09-12T01:02:59.459885+0000","last_clean":"2024-09-12T01:02:59.459885+0000","last_became_active":"2024-09-12T00:15:55.075108+0000","last_became_peered":"2024-09-12T00:15:55.075108+0000","last_unstale":"2024-09-12T01:02:59.459885+0000","last_undegraded":"2024-09-12T01:02:59.459885+0000","last_fullsized":"2024-09-12T01:02:59.459885+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'392","last_scrub_stamp":"2024-09-12T01:02:59.459315+0000","last_deep_scrub":"268'392","last_deep_scrub_stamp":"2024-09-12T01:02:59.459315+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.459315+0000","objects_scrubbed":5,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:19.278176+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":2165,"num_write":1224,"num_write_kb":32030,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"268'545","reported_seq":2185,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.645744+0000","last_change":"2024-09-12T01:03:10.645603+0000","last_active":"2024-09-12T01:03:10.645744+0000","last_peered":"2024-09-12T01:03:10.645744+0000","last_clean":"2024-09-12T01:03:10.645744+0000","last_became_active":"2024-09-12T00:15:57.022465+0000","last_became_peered":"2024-09-12T00:15:57.022465+0000","last_unstale":"2024-09-12T01:03:10.645744+0000","last_undegraded":"2024-09-12T01:03:10.645744+0000","last_fullsized":"2024-09-12T01:03:10.645744+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'545","last_scrub_stamp":"2024-09-12T01:03:10.645403+0000","last_deep_scrub":"268'545","last_deep_scrub_stamp":"2024-09-12T01:03:10.645403+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.645403+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:07.926006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2758,"num_read_kb":2563,"num_write":657,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"268'389","reported_seq":1133,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.428256+0000","last_change":"2024-09-12T01:02:58.428112+0000","last_active":"2024-09-12T01:02:58.428256+0000","last_peered":"2024-09-12T01:02:58.428256+0000","last_clean":"2024-09-12T01:02:58.428256+0000","last_became_active":"2024-09-12T00:15:55.041491+0000","last_became_peered":"2024-09-12T00:15:55.041491+0000","last_unstale":"2024-09-12T01:02:58.428256+0000","last_undegraded":"2024-09-12T01:02:58.428256+0000","last_fullsized":"2024-09-12T01:02:58.428256+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'389","last_scrub_stamp":"2024-09-12T01:02:58.427815+0000","last_deep_scrub":"268'389","last_deep_scrub_stamp":"2024-09-12T01:02:58.427815+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.427815+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:29.847605+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3574871,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":831,"num_read_kb":4160,"num_write":1268,"num_write_kb":14348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"268'1149","reported_seq":2792,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.612684+0000","last_change":"2024-09-12T01:03:09.612525+0000","last_active":"2024-09-12T01:03:09.612684+0000","last_peered":"2024-09-12T01:03:09.612684+0000","last_clean":"2024-09-12T01:03:09.612684+0000","last_became_active":"2024-09-12T00:15:57.022692+0000","last_became_peered":"2024-09-12T00:15:57.022692+0000","last_unstale":"2024-09-12T01:03:09.612684+0000","last_undegraded":"2024-09-12T01:03:09.612684+0000","last_fullsized":"2024-09-12T01:03:09.612684+0000","mapping_epoch":28,"log_start":"268'1100","ondisk_log_start":"268'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1149","last_scrub_stamp":"2024-09-12T01:03:09.612336+0000","last_deep_scrub":"268'1149","last_deep_scrub_stamp":"2024-09-12T01:03:09.612336+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.612336+0000","objects_scrubbed":4,"log_size":49,"log_dups_size":1100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:08.545733+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5291,"num_read_kb":4702,"num_write":1570,"num_write_kb":628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"268'387","reported_seq":1079,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.667479+0000","last_change":"2024-09-12T01:02:52.667329+0000","last_active":"2024-09-12T01:02:52.667479+0000","last_peered":"2024-09-12T01:02:52.667479+0000","last_clean":"2024-09-12T01:02:52.667479+0000","last_became_active":"2024-09-12T00:15:55.045668+0000","last_became_peered":"2024-09-12T00:15:55.045668+0000","last_unstale":"2024-09-12T01:02:52.667479+0000","last_undegraded":"2024-09-12T01:02:52.667479+0000","last_fullsized":"2024-09-12T01:02:52.667479+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'387","last_scrub_stamp":"2024-09-12T01:02:52.667069+0000","last_deep_scrub":"268'387","last_deep_scrub_stamp":"2024-09-12T01:02:52.667069+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.667069+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:37.302820+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":365201,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":662,"num_read_kb":47789,"num_write":1293,"num_write_kb":53743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"268'571","reported_seq":2214,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.155354+0000","last_change":"2024-09-12T01:03:01.155202+0000","last_active":"2024-09-12T01:03:01.155354+0000","last_peered":"2024-09-12T01:03:01.155354+0000","last_clean":"2024-09-12T01:03:01.155354+0000","last_became_active":"2024-09-12T00:15:57.018762+0000","last_became_peered":"2024-09-12T00:15:57.018762+0000","last_unstale":"2024-09-12T01:03:01.155354+0000","last_undegraded":"2024-09-12T01:03:01.155354+0000","last_fullsized":"2024-09-12T01:03:01.155354+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'571","last_scrub_stamp":"2024-09-12T01:03:01.155003+0000","last_deep_scrub":"268'571","last_deep_scrub_stamp":"2024-09-12T01:03:01.155003+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.155003+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:41.916701+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2864,"num_read_kb":2646,"num_write":693,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":992,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"268'365","reported_seq":1021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.617536+0000","last_change":"2024-09-12T01:02:50.617387+0000","last_active":"2024-09-12T01:02:50.617536+0000","last_peered":"2024-09-12T01:02:50.617536+0000","last_clean":"2024-09-12T01:02:50.617536+0000","last_became_active":"2024-09-12T00:15:55.071352+0000","last_became_peered":"2024-09-12T00:15:55.071352+0000","last_unstale":"2024-09-12T01:02:50.617536+0000","last_undegraded":"2024-09-12T01:02:50.617536+0000","last_fullsized":"2024-09-12T01:02:50.617536+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-12T01:02:50.617131+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-12T01:02:50.617131+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.617131+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:26.922140+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8845231,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":491,"num_read_kb":19398,"num_write":1138,"num_write_kb":53254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"268'458","reported_seq":2085,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.526496+0000","last_change":"2024-09-12T01:03:01.526329+0000","last_active":"2024-09-12T01:03:01.526496+0000","last_peered":"2024-09-12T01:03:01.526496+0000","last_clean":"2024-09-12T01:03:01.526496+0000","last_became_active":"2024-09-12T00:15:57.051973+0000","last_became_peered":"2024-09-12T00:15:57.051973+0000","last_unstale":"2024-09-12T01:03:01.526496+0000","last_undegraded":"2024-09-12T01:03:01.526496+0000","last_fullsized":"2024-09-12T01:03:01.526496+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'458","last_scrub_stamp":"2024-09-12T01:03:01.526143+0000","last_deep_scrub":"268'458","last_deep_scrub_stamp":"2024-09-12T01:03:01.526143+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.526143+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:18.260122+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2489,"num_read_kb":2348,"num_write":528,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"268'352","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.654023+0000","last_change":"2024-09-12T01:02:50.653874+0000","last_active":"2024-09-12T01:02:50.654023+0000","last_peered":"2024-09-12T01:02:50.654023+0000","last_clean":"2024-09-12T01:02:50.654023+0000","last_became_active":"2024-09-12T00:15:55.067030+0000","last_became_peered":"2024-09-12T00:15:55.067030+0000","last_unstale":"2024-09-12T01:02:50.654023+0000","last_undegraded":"2024-09-12T01:02:50.654023+0000","last_fullsized":"2024-09-12T01:02:50.654023+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'352","last_scrub_stamp":"2024-09-12T01:02:50.653516+0000","last_deep_scrub":"268'352","last_deep_scrub_stamp":"2024-09-12T01:02:50.653516+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.653516+0000","objects_scrubbed":8,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:30.298045+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":499,"num_read_kb":33085,"num_write":1019,"num_write_kb":28183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"268'487","reported_seq":2083,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.535309+0000","last_change":"2024-09-12T01:02:55.535040+0000","last_active":"2024-09-12T01:02:55.535309+0000","last_peered":"2024-09-12T01:02:55.535309+0000","last_clean":"2024-09-12T01:02:55.535309+0000","last_became_active":"2024-09-12T00:15:57.037045+0000","last_became_peered":"2024-09-12T00:15:57.037045+0000","last_unstale":"2024-09-12T01:02:55.535309+0000","last_undegraded":"2024-09-12T01:02:55.535309+0000","last_fullsized":"2024-09-12T01:02:55.535309+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'487","last_scrub_stamp":"2024-09-12T01:02:55.534815+0000","last_deep_scrub":"268'487","last_deep_scrub_stamp":"2024-09-12T01:02:55.534815+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.534815+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:08.564034+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2556,"num_read_kb":2389,"num_write":592,"num_write_kb":142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"268'364","reported_seq":1104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.551327+0000","last_change":"2024-09-12T01:02:48.551146+0000","last_active":"2024-09-12T01:02:48.551327+0000","last_peered":"2024-09-12T01:02:48.551327+0000","last_clean":"2024-09-12T01:02:48.551327+0000","last_became_active":"2024-09-12T00:15:55.041976+0000","last_became_peered":"2024-09-12T00:15:55.041976+0000","last_unstale":"2024-09-12T01:02:48.551327+0000","last_undegraded":"2024-09-12T01:02:48.551327+0000","last_fullsized":"2024-09-12T01:02:48.551327+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'364","last_scrub_stamp":"2024-09-12T01:02:48.550777+0000","last_deep_scrub":"268'364","last_deep_scrub_stamp":"2024-09-12T01:02:48.550777+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.550777+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:08.855631+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055004,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":661,"num_read_kb":92017,"num_write":1205,"num_write_kb":32064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"268'483","reported_seq":1945,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.623660+0000","last_change":"2024-09-12T01:02:58.623516+0000","last_active":"2024-09-12T01:02:58.623660+0000","last_peered":"2024-09-12T01:02:58.623660+0000","last_clean":"2024-09-12T01:02:58.623660+0000","last_became_active":"2024-09-12T00:15:57.013278+0000","last_became_peered":"2024-09-12T00:15:57.013278+0000","last_unstale":"2024-09-12T01:02:58.623660+0000","last_undegraded":"2024-09-12T01:02:58.623660+0000","last_fullsized":"2024-09-12T01:02:58.623660+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'483","last_scrub_stamp":"2024-09-12T01:02:58.623336+0000","last_deep_scrub":"268'483","last_deep_scrub_stamp":"2024-09-12T01:02:58.623336+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.623336+0000","objects_scrubbed":7,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:39.099184+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2343,"num_read_kb":2167,"num_write":566,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1262,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"268'313","reported_seq":969,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.417304+0000","last_change":"2024-09-12T01:02:57.417143+0000","last_active":"2024-09-12T01:02:57.417304+0000","last_peered":"2024-09-12T01:02:57.417304+0000","last_clean":"2024-09-12T01:02:57.417304+0000","last_became_active":"2024-09-12T00:15:55.060127+0000","last_became_peered":"2024-09-12T00:15:55.060127+0000","last_unstale":"2024-09-12T01:02:57.417304+0000","last_undegraded":"2024-09-12T01:02:57.417304+0000","last_fullsized":"2024-09-12T01:02:57.417304+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-12T01:02:57.416899+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-12T01:02:57.416899+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.416899+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:10.862046+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":41438,"num_write":900,"num_write_kb":44478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"268'984","reported_seq":2524,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.475482+0000","last_change":"2024-09-12T01:03:08.475348+0000","last_active":"2024-09-12T01:03:08.475482+0000","last_peered":"2024-09-12T01:03:08.475482+0000","last_clean":"2024-09-12T01:03:08.475482+0000","last_became_active":"2024-09-12T00:15:57.051665+0000","last_became_peered":"2024-09-12T00:15:57.051665+0000","last_unstale":"2024-09-12T01:03:08.475482+0000","last_undegraded":"2024-09-12T01:03:08.475482+0000","last_fullsized":"2024-09-12T01:03:08.475482+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'984","last_scrub_stamp":"2024-09-12T01:03:08.475166+0000","last_deep_scrub":"268'984","last_deep_scrub_stamp":"2024-09-12T01:03:08.475166+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.475166+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":900,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:39.424371+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4673,"num_read_kb":4124,"num_write":1393,"num_write_kb":554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"268'891","reported_seq":2511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.574863+0000","last_change":"2024-09-12T01:03:08.574863+0000","last_active":"2024-09-12T01:03:08.574863+0000","last_peered":"2024-09-12T01:03:08.574863+0000","last_clean":"2024-09-12T01:03:08.574863+0000","last_became_active":"2024-09-12T00:15:57.031897+0000","last_became_peered":"2024-09-12T00:15:57.031897+0000","last_unstale":"2024-09-12T01:03:08.574863+0000","last_undegraded":"2024-09-12T01:03:08.574863+0000","last_fullsized":"2024-09-12T01:03:08.574863+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'891","last_scrub_stamp":"2024-09-12T01:03:08.574669+0000","last_deep_scrub":"268'891","last_deep_scrub_stamp":"2024-09-12T01:03:08.574669+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.574669+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:36.612992+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4303,"num_read_kb":3853,"num_write":1201,"num_write_kb":458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2803,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"268'315","reported_seq":943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.254737+0000","last_change":"2024-09-12T01:02:51.254737+0000","last_active":"2024-09-12T01:02:51.254737+0000","last_peered":"2024-09-12T01:02:51.254737+0000","last_clean":"2024-09-12T01:02:51.254737+0000","last_became_active":"2024-09-12T00:15:55.063797+0000","last_became_peered":"2024-09-12T00:15:55.063797+0000","last_unstale":"2024-09-12T01:02:51.254737+0000","last_undegraded":"2024-09-12T01:02:51.254737+0000","last_fullsized":"2024-09-12T01:02:51.254737+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'315","last_scrub_stamp":"2024-09-12T01:02:51.254463+0000","last_deep_scrub":"268'315","last_deep_scrub_stamp":"2024-09-12T01:02:51.254463+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.254463+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:01.868558+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":99,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":422,"num_read_kb":7341,"num_write":997,"num_write_kb":14342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"268'783","reported_seq":2221,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.530995+0000","last_change":"2024-09-12T01:02:58.530995+0000","last_active":"2024-09-12T01:02:58.530995+0000","last_peered":"2024-09-12T01:02:58.530995+0000","last_clean":"2024-09-12T01:02:58.530995+0000","last_became_active":"2024-09-12T00:15:57.017679+0000","last_became_peered":"2024-09-12T00:15:57.017679+0000","last_unstale":"2024-09-12T01:02:58.530995+0000","last_undegraded":"2024-09-12T01:02:58.530995+0000","last_fullsized":"2024-09-12T01:02:58.530995+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'783","last_scrub_stamp":"2024-09-12T01:02:58.530808+0000","last_deep_scrub":"268'783","last_deep_scrub_stamp":"2024-09-12T01:02:58.530808+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.530808+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:45.670510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3571,"num_read_kb":3210,"num_write":1015,"num_write_kb":364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"268'379","reported_seq":1070,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.374153+0000","last_change":"2024-09-12T01:02:56.374153+0000","last_active":"2024-09-12T01:02:56.374153+0000","last_peered":"2024-09-12T01:02:56.374153+0000","last_clean":"2024-09-12T01:02:56.374153+0000","last_became_active":"2024-09-12T00:16:26.794438+0000","last_became_peered":"2024-09-12T00:16:26.794438+0000","last_unstale":"2024-09-12T01:02:56.374153+0000","last_undegraded":"2024-09-12T01:02:56.374153+0000","last_fullsized":"2024-09-12T01:02:56.374153+0000","mapping_epoch":39,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'379","last_scrub_stamp":"2024-09-12T01:02:56.373913+0000","last_deep_scrub":"268'379","last_deep_scrub_stamp":"2024-09-12T01:02:56.373913+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.373913+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:38.623851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":637,"num_read_kb":170107,"num_write":1135,"num_write_kb":45359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,6],"acting":[5,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.32","version":"268'415","reported_seq":1894,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.158518+0000","last_change":"2024-09-12T01:02:55.158518+0000","last_active":"2024-09-12T01:02:55.158518+0000","last_peered":"2024-09-12T01:02:55.158518+0000","last_clean":"2024-09-12T01:02:55.158518+0000","last_became_active":"2024-09-12T00:15:57.039474+0000","last_became_peered":"2024-09-12T00:15:57.039474+0000","last_unstale":"2024-09-12T01:02:55.158518+0000","last_undegraded":"2024-09-12T01:02:55.158518+0000","last_fullsized":"2024-09-12T01:02:55.158518+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'415","last_scrub_stamp":"2024-09-12T01:02:55.158293+0000","last_deep_scrub":"268'415","last_deep_scrub_stamp":"2024-09-12T01:02:55.158293+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.158293+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":400,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:03.237879+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2320,"num_read_kb":2162,"num_write":506,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":873,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"268'339","reported_seq":1089,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.574049+0000","last_change":"2024-09-12T01:02:47.574049+0000","last_active":"2024-09-12T01:02:47.574049+0000","last_peered":"2024-09-12T01:02:47.574049+0000","last_clean":"2024-09-12T01:02:47.574049+0000","last_became_active":"2024-09-12T00:15:55.060170+0000","last_became_peered":"2024-09-12T00:15:55.060170+0000","last_unstale":"2024-09-12T01:02:47.574049+0000","last_undegraded":"2024-09-12T01:02:47.574049+0000","last_fullsized":"2024-09-12T01:02:47.574049+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:02:47.573937+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:02:47.573937+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.573937+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:55.671405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263219,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":623,"num_read_kb":11665,"num_write":1071,"num_write_kb":19684,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"268'458","reported_seq":2062,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.080840+0000","last_change":"2024-09-12T01:03:00.080840+0000","last_active":"2024-09-12T01:03:00.080840+0000","last_peered":"2024-09-12T01:03:00.080840+0000","last_clean":"2024-09-12T01:03:00.080840+0000","last_became_active":"2024-09-12T00:15:57.044075+0000","last_became_peered":"2024-09-12T00:15:57.044075+0000","last_unstale":"2024-09-12T01:03:00.080840+0000","last_undegraded":"2024-09-12T01:03:00.080840+0000","last_fullsized":"2024-09-12T01:03:00.080840+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'458","last_scrub_stamp":"2024-09-12T01:03:00.080648+0000","last_deep_scrub":"268'458","last_deep_scrub_stamp":"2024-09-12T01:03:00.080648+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.080648+0000","objects_scrubbed":4,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:43.039820+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2345,"num_read_kb":2229,"num_write":503,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"268'357","reported_seq":1071,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.506774+0000","last_change":"2024-09-12T01:03:00.506774+0000","last_active":"2024-09-12T01:03:00.506774+0000","last_peered":"2024-09-12T01:03:00.506774+0000","last_clean":"2024-09-12T01:03:00.506774+0000","last_became_active":"2024-09-12T00:15:55.078352+0000","last_became_peered":"2024-09-12T00:15:55.078352+0000","last_unstale":"2024-09-12T01:03:00.506774+0000","last_undegraded":"2024-09-12T01:03:00.506774+0000","last_fullsized":"2024-09-12T01:03:00.506774+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'357","last_scrub_stamp":"2024-09-12T01:03:00.506512+0000","last_deep_scrub":"268'357","last_deep_scrub_stamp":"2024-09-12T01:03:00.506512+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.506512+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:30.459461+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3306265,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":657,"num_read_kb":46871,"num_write":1194,"num_write_kb":28820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"268'401","reported_seq":1882,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.517578+0000","last_change":"2024-09-12T01:03:07.517578+0000","last_active":"2024-09-12T01:03:07.517578+0000","last_peered":"2024-09-12T01:03:07.517578+0000","last_clean":"2024-09-12T01:03:07.517578+0000","last_became_active":"2024-09-12T00:15:57.032173+0000","last_became_peered":"2024-09-12T00:15:57.032173+0000","last_unstale":"2024-09-12T01:03:07.517578+0000","last_undegraded":"2024-09-12T01:03:07.517578+0000","last_fullsized":"2024-09-12T01:03:07.517578+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'401","last_scrub_stamp":"2024-09-12T01:03:07.517337+0000","last_deep_scrub":"268'401","last_deep_scrub_stamp":"2024-09-12T01:03:07.517337+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.517337+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:47.949709+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2107,"num_read_kb":2010,"num_write":461,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"268'356","reported_seq":1087,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.981634+0000","last_change":"2024-09-12T01:02:52.981634+0000","last_active":"2024-09-12T01:02:52.981634+0000","last_peered":"2024-09-12T01:02:52.981634+0000","last_clean":"2024-09-12T01:02:52.981634+0000","last_became_active":"2024-09-12T00:15:55.066304+0000","last_became_peered":"2024-09-12T00:15:55.066304+0000","last_unstale":"2024-09-12T01:02:52.981634+0000","last_undegraded":"2024-09-12T01:02:52.981634+0000","last_fullsized":"2024-09-12T01:02:52.981634+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'356","last_scrub_stamp":"2024-09-12T01:02:52.981360+0000","last_deep_scrub":"268'356","last_deep_scrub_stamp":"2024-09-12T01:02:52.981360+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.981360+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:19.250065+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":677,"num_read_kb":58383,"num_write":1149,"num_write_kb":49764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"268'1199","reported_seq":3228,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.154851+0000","last_change":"2024-09-12T01:02:57.154851+0000","last_active":"2024-09-12T01:02:57.154851+0000","last_peered":"2024-09-12T01:02:57.154851+0000","last_clean":"2024-09-12T01:02:57.154851+0000","last_became_active":"2024-09-12T00:15:57.021605+0000","last_became_peered":"2024-09-12T00:15:57.021605+0000","last_unstale":"2024-09-12T01:02:57.154851+0000","last_undegraded":"2024-09-12T01:02:57.154851+0000","last_fullsized":"2024-09-12T01:02:57.154851+0000","mapping_epoch":28,"log_start":"268'1100","ondisk_log_start":"268'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1199","last_scrub_stamp":"2024-09-12T01:02:57.154667+0000","last_deep_scrub":"268'1199","last_deep_scrub_stamp":"2024-09-12T01:02:57.154667+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.154667+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":1100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:25.819536+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6433,"num_read_kb":5744,"num_write":1768,"num_write_kb":831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":505,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"268'298","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.033242+0000","last_change":"2024-09-12T01:02:52.033242+0000","last_active":"2024-09-12T01:02:52.033242+0000","last_peered":"2024-09-12T01:02:52.033242+0000","last_clean":"2024-09-12T01:02:52.033242+0000","last_became_active":"2024-09-12T00:15:55.050860+0000","last_became_peered":"2024-09-12T00:15:55.050860+0000","last_unstale":"2024-09-12T01:02:52.033242+0000","last_undegraded":"2024-09-12T01:02:52.033242+0000","last_fullsized":"2024-09-12T01:02:52.033242+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'298","last_scrub_stamp":"2024-09-12T01:02:52.032968+0000","last_deep_scrub":"268'298","last_deep_scrub_stamp":"2024-09-12T01:02:52.032968+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.032968+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:45.831551+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399261,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":471,"num_read_kb":8796,"num_write":982,"num_write_kb":26056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"268'152","reported_seq":659,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.598825+0000","last_change":"2024-09-12T01:03:10.598825+0000","last_active":"2024-09-12T01:03:10.598825+0000","last_peered":"2024-09-12T01:03:10.598825+0000","last_clean":"2024-09-12T01:03:10.598825+0000","last_became_active":"2024-09-12T00:16:05.095632+0000","last_became_peered":"2024-09-12T00:16:05.095632+0000","last_unstale":"2024-09-12T01:03:10.598825+0000","last_undegraded":"2024-09-12T01:03:10.598825+0000","last_fullsized":"2024-09-12T01:03:10.598825+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'152","last_scrub_stamp":"2024-09-12T01:03:10.598634+0000","last_deep_scrub":"268'152","last_deep_scrub_stamp":"2024-09-12T01:03:10.598634+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.598634+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:07.477069+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":141,"num_read_kb":139,"num_write":341,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"268'392","reported_seq":1871,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.048288+0000","last_change":"2024-09-12T01:02:58.048288+0000","last_active":"2024-09-12T01:02:58.048288+0000","last_peered":"2024-09-12T01:02:58.048288+0000","last_clean":"2024-09-12T01:02:58.048288+0000","last_became_active":"2024-09-12T00:15:57.042317+0000","last_became_peered":"2024-09-12T00:15:57.042317+0000","last_unstale":"2024-09-12T01:02:58.048288+0000","last_undegraded":"2024-09-12T01:02:58.048288+0000","last_fullsized":"2024-09-12T01:02:58.048288+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'392","last_scrub_stamp":"2024-09-12T01:02:58.048067+0000","last_deep_scrub":"268'392","last_deep_scrub_stamp":"2024-09-12T01:02:58.048067+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.048067+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:28.572626+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2080,"num_read_kb":1982,"num_write":441,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":471,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"268'365","reported_seq":1022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.610527+0000","last_change":"2024-09-12T01:02:51.610527+0000","last_active":"2024-09-12T01:02:51.610527+0000","last_peered":"2024-09-12T01:02:51.610527+0000","last_clean":"2024-09-12T01:02:51.610527+0000","last_became_active":"2024-09-12T00:15:55.042690+0000","last_became_peered":"2024-09-12T00:15:55.042690+0000","last_unstale":"2024-09-12T01:02:51.610527+0000","last_undegraded":"2024-09-12T01:02:51.610527+0000","last_fullsized":"2024-09-12T01:02:51.610527+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-12T01:02:51.610328+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-12T01:02:51.610328+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.610328+0000","objects_scrubbed":3,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:01.531698+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288443,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":537,"num_read_kb":60082,"num_write":1122,"num_write_kb":36322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.577679+0000","last_change":"2024-09-12T01:03:15.577679+0000","last_active":"2024-09-12T01:03:15.577679+0000","last_peered":"2024-09-12T01:03:15.577679+0000","last_clean":"2024-09-12T01:03:15.577679+0000","last_became_active":"2024-09-12T00:15:59.046334+0000","last_became_peered":"2024-09-12T00:15:59.046334+0000","last_unstale":"2024-09-12T01:03:15.577679+0000","last_undegraded":"2024-09-12T01:03:15.577679+0000","last_fullsized":"2024-09-12T01:03:15.577679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:15.577489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:15.577489+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.577489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:42.549021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"268'365","reported_seq":993,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.319108+0000","last_change":"2024-09-12T01:03:14.319108+0000","last_active":"2024-09-12T01:03:14.319108+0000","last_peered":"2024-09-12T01:03:14.319108+0000","last_clean":"2024-09-12T01:03:14.319108+0000","last_became_active":"2024-09-12T00:16:01.057657+0000","last_became_peered":"2024-09-12T00:16:01.057657+0000","last_unstale":"2024-09-12T01:03:14.319108+0000","last_undegraded":"2024-09-12T01:03:14.319108+0000","last_fullsized":"2024-09-12T01:03:14.319108+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'365","last_scrub_stamp":"2024-09-12T01:03:14.318931+0000","last_deep_scrub":"268'365","last_deep_scrub_stamp":"2024-09-12T01:03:14.318931+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.318931+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:27.369397+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49919,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":600,"num_read_kb":1282,"num_write":482,"num_write_kb":346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.272567+0000","last_change":"2024-09-12T01:03:10.272567+0000","last_active":"2024-09-12T01:03:10.272567+0000","last_peered":"2024-09-12T01:03:10.272567+0000","last_clean":"2024-09-12T01:03:10.272567+0000","last_became_active":"2024-09-12T00:16:03.098506+0000","last_became_peered":"2024-09-12T00:16:03.098506+0000","last_unstale":"2024-09-12T01:03:10.272567+0000","last_undegraded":"2024-09-12T01:03:10.272567+0000","last_fullsized":"2024-09-12T01:03:10.272567+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:10.272377+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:10.272377+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.272377+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:45.071067+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"268'155","reported_seq":726,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.345863+0000","last_change":"2024-09-12T01:03:13.345863+0000","last_active":"2024-09-12T01:03:13.345863+0000","last_peered":"2024-09-12T01:03:13.345863+0000","last_clean":"2024-09-12T01:03:13.345863+0000","last_became_active":"2024-09-12T00:16:05.105153+0000","last_became_peered":"2024-09-12T00:16:05.105153+0000","last_unstale":"2024-09-12T01:03:13.345863+0000","last_undegraded":"2024-09-12T01:03:13.345863+0000","last_fullsized":"2024-09-12T01:03:13.345863+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'155","last_scrub_stamp":"2024-09-12T01:03:13.345644+0000","last_deep_scrub":"268'155","last_deep_scrub_stamp":"2024-09-12T01:03:13.345644+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.345644+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:31.200725+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":198,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":224,"num_read_kb":214,"num_write":299,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"268'900","reported_seq":2532,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.592009+0000","last_change":"2024-09-12T01:03:03.592009+0000","last_active":"2024-09-12T01:03:03.592009+0000","last_peered":"2024-09-12T01:03:03.592009+0000","last_clean":"2024-09-12T01:03:03.592009+0000","last_became_active":"2024-09-12T00:15:57.018484+0000","last_became_peered":"2024-09-12T00:15:57.018484+0000","last_unstale":"2024-09-12T01:03:03.592009+0000","last_undegraded":"2024-09-12T01:03:03.592009+0000","last_fullsized":"2024-09-12T01:03:03.592009+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'900","last_scrub_stamp":"2024-09-12T01:03:03.591747+0000","last_deep_scrub":"268'900","last_deep_scrub_stamp":"2024-09-12T01:03:03.591747+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.591747+0000","objects_scrubbed":3,"log_size":100,"log_dups_size":800,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:57.427036+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4265,"num_read_kb":3809,"num_write":1199,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":472,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"268'363","reported_seq":1015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.060708+0000","last_change":"2024-09-12T01:02:49.060708+0000","last_active":"2024-09-12T01:02:49.060708+0000","last_peered":"2024-09-12T01:02:49.060708+0000","last_clean":"2024-09-12T01:02:49.060708+0000","last_became_active":"2024-09-12T00:15:55.065476+0000","last_became_peered":"2024-09-12T00:15:55.065476+0000","last_unstale":"2024-09-12T01:02:49.060708+0000","last_undegraded":"2024-09-12T01:02:49.060708+0000","last_fullsized":"2024-09-12T01:02:49.060708+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'363","last_scrub_stamp":"2024-09-12T01:02:49.060427+0000","last_deep_scrub":"268'363","last_deep_scrub_stamp":"2024-09-12T01:02:49.060427+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.060427+0000","objects_scrubbed":6,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:51.995984+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399070,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":579,"num_read_kb":7666,"num_write":1219,"num_write_kb":15378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.261725+0000","last_change":"2024-09-12T01:03:06.261725+0000","last_active":"2024-09-12T01:03:06.261725+0000","last_peered":"2024-09-12T01:03:06.261725+0000","last_clean":"2024-09-12T01:03:06.261725+0000","last_became_active":"2024-09-12T00:15:59.040412+0000","last_became_peered":"2024-09-12T00:15:59.040412+0000","last_unstale":"2024-09-12T01:03:06.261725+0000","last_undegraded":"2024-09-12T01:03:06.261725+0000","last_fullsized":"2024-09-12T01:03:06.261725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:06.261443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:06.261443+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.261443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:52.515905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"268'93","reported_seq":634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.263466+0000","last_change":"2024-09-12T01:03:09.263466+0000","last_active":"2024-09-12T01:03:09.263466+0000","last_peered":"2024-09-12T01:03:09.263466+0000","last_clean":"2024-09-12T01:03:09.263466+0000","last_became_active":"2024-09-12T00:16:01.062780+0000","last_became_peered":"2024-09-12T00:16:01.062780+0000","last_unstale":"2024-09-12T01:03:09.263466+0000","last_undegraded":"2024-09-12T01:03:09.263466+0000","last_fullsized":"2024-09-12T01:03:09.263466+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'93","last_scrub_stamp":"2024-09-12T01:03:09.263285+0000","last_deep_scrub":"268'93","last_deep_scrub_stamp":"2024-09-12T01:03:09.263285+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.263285+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:30.034157+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":500,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.267152+0000","last_change":"2024-09-12T01:03:20.267152+0000","last_active":"2024-09-12T01:03:20.267152+0000","last_peered":"2024-09-12T01:03:20.267152+0000","last_clean":"2024-09-12T01:03:20.267152+0000","last_became_active":"2024-09-12T00:16:03.091926+0000","last_became_peered":"2024-09-12T00:16:03.091926+0000","last_unstale":"2024-09-12T01:03:20.267152+0000","last_undegraded":"2024-09-12T01:03:20.267152+0000","last_fullsized":"2024-09-12T01:03:20.267152+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:20.266968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:20.266968+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.266968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:48.830998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"268'130","reported_seq":635,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.242196+0000","last_change":"2024-09-12T01:03:13.242031+0000","last_active":"2024-09-12T01:03:13.242196+0000","last_peered":"2024-09-12T01:03:13.242196+0000","last_clean":"2024-09-12T01:03:13.242196+0000","last_became_active":"2024-09-12T00:16:05.114182+0000","last_became_peered":"2024-09-12T00:16:05.114182+0000","last_unstale":"2024-09-12T01:03:13.242196+0000","last_undegraded":"2024-09-12T01:03:13.242196+0000","last_fullsized":"2024-09-12T01:03:13.242196+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'130","last_scrub_stamp":"2024-09-12T01:03:13.241818+0000","last_deep_scrub":"268'130","last_deep_scrub_stamp":"2024-09-12T01:03:13.241818+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.241818+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:11.870463+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":666,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":120,"num_read_kb":119,"num_write":293,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"268'1231","reported_seq":2694,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.453239+0000","last_change":"2024-09-12T01:03:02.453239+0000","last_active":"2024-09-12T01:03:02.453239+0000","last_peered":"2024-09-12T01:03:02.453239+0000","last_clean":"2024-09-12T01:03:02.453239+0000","last_became_active":"2024-09-12T00:15:57.046916+0000","last_became_peered":"2024-09-12T00:15:57.046916+0000","last_unstale":"2024-09-12T01:03:02.453239+0000","last_undegraded":"2024-09-12T01:03:02.453239+0000","last_fullsized":"2024-09-12T01:03:02.453239+0000","mapping_epoch":28,"log_start":"268'1200","ondisk_log_start":"268'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1231","last_scrub_stamp":"2024-09-12T01:03:02.453053+0000","last_deep_scrub":"268'1231","last_deep_scrub_stamp":"2024-09-12T01:03:02.453053+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.453053+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":1200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:35.974222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5641,"num_read_kb":4945,"num_write":1755,"num_write_kb":746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"268'379","reported_seq":1171,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.585252+0000","last_change":"2024-09-12T01:02:55.585252+0000","last_active":"2024-09-12T01:02:55.585252+0000","last_peered":"2024-09-12T01:02:55.585252+0000","last_clean":"2024-09-12T01:02:55.585252+0000","last_became_active":"2024-09-12T00:15:55.058428+0000","last_became_peered":"2024-09-12T00:15:55.058428+0000","last_unstale":"2024-09-12T01:02:55.585252+0000","last_undegraded":"2024-09-12T01:02:55.585252+0000","last_fullsized":"2024-09-12T01:02:55.585252+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'379","last_scrub_stamp":"2024-09-12T01:02:55.585005+0000","last_deep_scrub":"268'379","last_deep_scrub_stamp":"2024-09-12T01:02:55.585005+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.585005+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:14.899658+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":722,"num_read_kb":690,"num_write":1257,"num_write_kb":29311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.228212+0000","last_change":"2024-09-12T01:03:07.228212+0000","last_active":"2024-09-12T01:03:07.228212+0000","last_peered":"2024-09-12T01:03:07.228212+0000","last_clean":"2024-09-12T01:03:07.228212+0000","last_became_active":"2024-09-12T00:15:59.039465+0000","last_became_peered":"2024-09-12T00:15:59.039465+0000","last_unstale":"2024-09-12T01:03:07.228212+0000","last_undegraded":"2024-09-12T01:03:07.228212+0000","last_fullsized":"2024-09-12T01:03:07.228212+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:07.227963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:07.227963+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.227963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:13:54.506391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"268'137","reported_seq":697,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.369141+0000","last_change":"2024-09-12T01:03:13.369141+0000","last_active":"2024-09-12T01:03:13.369141+0000","last_peered":"2024-09-12T01:03:13.369141+0000","last_clean":"2024-09-12T01:03:13.369141+0000","last_became_active":"2024-09-12T00:16:01.056702+0000","last_became_peered":"2024-09-12T00:16:01.056702+0000","last_unstale":"2024-09-12T01:03:13.369141+0000","last_undegraded":"2024-09-12T01:03:13.369141+0000","last_fullsized":"2024-09-12T01:03:13.369141+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'137","last_scrub_stamp":"2024-09-12T01:03:13.368957+0000","last_deep_scrub":"268'137","last_deep_scrub_stamp":"2024-09-12T01:03:13.368957+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.368957+0000","objects_scrubbed":7,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:34.961935+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":144,"num_read_kb":136,"num_write":100,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"268'803","reported_seq":2234,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:24.604032+0000","last_change":"2024-09-12T01:03:24.604032+0000","last_active":"2024-09-12T01:03:24.604032+0000","last_peered":"2024-09-12T01:03:24.604032+0000","last_clean":"2024-09-12T01:03:24.604032+0000","last_became_active":"2024-09-12T00:16:03.103292+0000","last_became_peered":"2024-09-12T00:16:03.103292+0000","last_unstale":"2024-09-12T01:03:24.604032+0000","last_undegraded":"2024-09-12T01:03:24.604032+0000","last_fullsized":"2024-09-12T01:03:24.604032+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'803","last_scrub_stamp":"2024-09-12T01:03:24.603746+0000","last_deep_scrub":"268'803","last_deep_scrub_stamp":"2024-09-12T01:03:24.603746+0000","last_clean_scrub_stamp":"2024-09-12T01:03:24.603746+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:07.482869+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"268'236","reported_seq":1069,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.556161+0000","last_change":"2024-09-12T01:03:13.556009+0000","last_active":"2024-09-12T01:03:13.556161+0000","last_peered":"2024-09-12T01:03:13.556161+0000","last_clean":"2024-09-12T01:03:13.556161+0000","last_became_active":"2024-09-12T00:16:05.107785+0000","last_became_peered":"2024-09-12T00:16:05.107785+0000","last_unstale":"2024-09-12T01:03:13.556161+0000","last_undegraded":"2024-09-12T01:03:13.556161+0000","last_fullsized":"2024-09-12T01:03:13.556161+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'236","last_scrub_stamp":"2024-09-12T01:03:13.555830+0000","last_deep_scrub":"268'236","last_deep_scrub_stamp":"2024-09-12T01:03:13.555830+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.555830+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":200,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:05.447726+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":637,"num_write":534,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"268'636","reported_seq":2170,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.468669+0000","last_change":"2024-09-12T01:03:03.468669+0000","last_active":"2024-09-12T01:03:03.468669+0000","last_peered":"2024-09-12T01:03:03.468669+0000","last_clean":"2024-09-12T01:03:03.468669+0000","last_became_active":"2024-09-12T00:15:57.035581+0000","last_became_peered":"2024-09-12T00:15:57.035581+0000","last_unstale":"2024-09-12T01:03:03.468669+0000","last_undegraded":"2024-09-12T01:03:03.468669+0000","last_fullsized":"2024-09-12T01:03:03.468669+0000","mapping_epoch":28,"log_start":"268'600","ondisk_log_start":"268'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'636","last_scrub_stamp":"2024-09-12T01:03:03.468424+0000","last_deep_scrub":"268'636","last_deep_scrub_stamp":"2024-09-12T01:03:03.468424+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.468424+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":600,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:47.919591+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3178,"num_read_kb":2956,"num_write":875,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"268'336","reported_seq":1010,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.230246+0000","last_change":"2024-09-12T01:02:50.230246+0000","last_active":"2024-09-12T01:02:50.230246+0000","last_peered":"2024-09-12T01:02:50.230246+0000","last_clean":"2024-09-12T01:02:50.230246+0000","last_became_active":"2024-09-12T00:15:55.065178+0000","last_became_peered":"2024-09-12T00:15:55.065178+0000","last_unstale":"2024-09-12T01:02:50.230246+0000","last_undegraded":"2024-09-12T01:02:50.230246+0000","last_fullsized":"2024-09-12T01:02:50.230246+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'336","last_scrub_stamp":"2024-09-12T01:02:50.230018+0000","last_deep_scrub":"268'336","last_deep_scrub_stamp":"2024-09-12T01:02:50.230018+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.230018+0000","objects_scrubbed":9,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:17.900987+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262226,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":567,"num_read_kb":565,"num_write":1139,"num_write_kb":21852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.581360+0000","last_change":"2024-09-12T01:03:16.581360+0000","last_active":"2024-09-12T01:03:16.581360+0000","last_peered":"2024-09-12T01:03:16.581360+0000","last_clean":"2024-09-12T01:03:16.581360+0000","last_became_active":"2024-09-12T00:15:59.039902+0000","last_became_peered":"2024-09-12T00:15:59.039902+0000","last_unstale":"2024-09-12T01:03:16.581360+0000","last_undegraded":"2024-09-12T01:03:16.581360+0000","last_fullsized":"2024-09-12T01:03:16.581360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:16.581177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:16.581177+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.581177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:43.991582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"268'283","reported_seq":863,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.569244+0000","last_change":"2024-09-12T01:03:06.569244+0000","last_active":"2024-09-12T01:03:06.569244+0000","last_peered":"2024-09-12T01:03:06.569244+0000","last_clean":"2024-09-12T01:03:06.569244+0000","last_became_active":"2024-09-12T00:16:01.052744+0000","last_became_peered":"2024-09-12T00:16:01.052744+0000","last_unstale":"2024-09-12T01:03:06.569244+0000","last_undegraded":"2024-09-12T01:03:06.569244+0000","last_fullsized":"2024-09-12T01:03:06.569244+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'283","last_scrub_stamp":"2024-09-12T01:03:06.568959+0000","last_deep_scrub":"268'283","last_deep_scrub_stamp":"2024-09-12T01:03:06.568959+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.568959+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:00.450040+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47709,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":1056,"num_write":378,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"268'816","reported_seq":2470,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.561546+0000","last_change":"2024-09-12T01:03:17.561546+0000","last_active":"2024-09-12T01:03:17.561546+0000","last_peered":"2024-09-12T01:03:17.561546+0000","last_clean":"2024-09-12T01:03:17.561546+0000","last_became_active":"2024-09-12T00:16:03.097895+0000","last_became_peered":"2024-09-12T00:16:03.097895+0000","last_unstale":"2024-09-12T01:03:17.561546+0000","last_undegraded":"2024-09-12T01:03:17.561546+0000","last_fullsized":"2024-09-12T01:03:17.561546+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'816","last_scrub_stamp":"2024-09-12T01:03:17.561363+0000","last_deep_scrub":"268'816","last_deep_scrub_stamp":"2024-09-12T01:03:17.561363+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.561363+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:37.539725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"268'460","reported_seq":2022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.599890+0000","last_change":"2024-09-12T01:03:05.599731+0000","last_active":"2024-09-12T01:03:05.599890+0000","last_peered":"2024-09-12T01:03:05.599890+0000","last_clean":"2024-09-12T01:03:05.599890+0000","last_became_active":"2024-09-12T00:15:57.023659+0000","last_became_peered":"2024-09-12T00:15:57.023659+0000","last_unstale":"2024-09-12T01:03:05.599890+0000","last_undegraded":"2024-09-12T01:03:05.599890+0000","last_fullsized":"2024-09-12T01:03:05.599890+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'460","last_scrub_stamp":"2024-09-12T01:03:05.599554+0000","last_deep_scrub":"268'460","last_deep_scrub_stamp":"2024-09-12T01:03:05.599554+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.599554+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:38.313492+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2457,"num_read_kb":2306,"num_write":563,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":254,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"268'375","reported_seq":1015,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:44.553160+0000","last_change":"2024-09-12T01:02:44.553031+0000","last_active":"2024-09-12T01:02:44.553160+0000","last_peered":"2024-09-12T01:02:44.553160+0000","last_clean":"2024-09-12T01:02:44.553160+0000","last_became_active":"2024-09-12T00:15:55.060679+0000","last_became_peered":"2024-09-12T00:15:55.060679+0000","last_unstale":"2024-09-12T01:02:44.553160+0000","last_undegraded":"2024-09-12T01:02:44.553160+0000","last_fullsized":"2024-09-12T01:02:44.553160+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'375","last_scrub_stamp":"2024-09-12T01:02:44.552852+0000","last_deep_scrub":"268'375","last_deep_scrub_stamp":"2024-09-12T01:02:44.552852+0000","last_clean_scrub_stamp":"2024-09-12T01:02:44.552852+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:59:52.618648+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":484,"num_read_kb":16773,"num_write":1144,"num_write_kb":29370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.191300+0000","last_change":"2024-09-12T01:02:58.191150+0000","last_active":"2024-09-12T01:02:58.191300+0000","last_peered":"2024-09-12T01:02:58.191300+0000","last_clean":"2024-09-12T01:02:58.191300+0000","last_became_active":"2024-09-12T00:15:59.035288+0000","last_became_peered":"2024-09-12T00:15:59.035288+0000","last_unstale":"2024-09-12T01:02:58.191300+0000","last_undegraded":"2024-09-12T01:02:58.191300+0000","last_fullsized":"2024-09-12T01:02:58.191300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:58.190865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:58.190865+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.190865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:42.772188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"268'358","reported_seq":983,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.582373+0000","last_change":"2024-09-12T01:03:04.582233+0000","last_active":"2024-09-12T01:03:04.582373+0000","last_peered":"2024-09-12T01:03:04.582373+0000","last_clean":"2024-09-12T01:03:04.582373+0000","last_became_active":"2024-09-12T00:16:01.069838+0000","last_became_peered":"2024-09-12T00:16:01.069838+0000","last_unstale":"2024-09-12T01:03:04.582373+0000","last_undegraded":"2024-09-12T01:03:04.582373+0000","last_fullsized":"2024-09-12T01:03:04.582373+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'358","last_scrub_stamp":"2024-09-12T01:03:04.582029+0000","last_deep_scrub":"268'358","last_deep_scrub_stamp":"2024-09-12T01:03:04.582029+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.582029+0000","objects_scrubbed":10,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:04.440997+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45025,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":563,"num_read_kb":1131,"num_write":438,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.153517+0000","last_change":"2024-09-12T01:03:11.153393+0000","last_active":"2024-09-12T01:03:11.153517+0000","last_peered":"2024-09-12T01:03:11.153517+0000","last_clean":"2024-09-12T01:03:11.153517+0000","last_became_active":"2024-09-12T00:16:03.089533+0000","last_became_peered":"2024-09-12T00:16:03.089533+0000","last_unstale":"2024-09-12T01:03:11.153517+0000","last_undegraded":"2024-09-12T01:03:11.153517+0000","last_fullsized":"2024-09-12T01:03:11.153517+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:11.153215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:11.153215+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.153215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:32.835270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"268'575","reported_seq":1396,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.581859+0000","last_change":"2024-09-12T01:03:09.581701+0000","last_active":"2024-09-12T01:03:09.581859+0000","last_peered":"2024-09-12T01:03:09.581859+0000","last_clean":"2024-09-12T01:03:09.581859+0000","last_became_active":"2024-09-12T00:16:05.112960+0000","last_became_peered":"2024-09-12T00:16:05.112960+0000","last_unstale":"2024-09-12T01:03:09.581859+0000","last_undegraded":"2024-09-12T01:03:09.581859+0000","last_fullsized":"2024-09-12T01:03:09.581859+0000","mapping_epoch":36,"log_start":"268'500","ondisk_log_start":"268'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'575","last_scrub_stamp":"2024-09-12T01:03:09.581499+0000","last_deep_scrub":"268'575","last_deep_scrub_stamp":"2024-09-12T01:03:09.581499+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.581499+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":500,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:17.076524+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1305,"num_read_kb":1300,"num_write":1202,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"268'525","reported_seq":2012,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.187071+0000","last_change":"2024-09-12T01:02:49.186856+0000","last_active":"2024-09-12T01:02:49.187071+0000","last_peered":"2024-09-12T01:02:49.187071+0000","last_clean":"2024-09-12T01:02:49.187071+0000","last_became_active":"2024-09-12T00:15:57.045141+0000","last_became_peered":"2024-09-12T00:15:57.045141+0000","last_unstale":"2024-09-12T01:02:49.187071+0000","last_undegraded":"2024-09-12T01:02:49.187071+0000","last_fullsized":"2024-09-12T01:02:49.187071+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'525","last_scrub_stamp":"2024-09-12T01:02:49.186637+0000","last_deep_scrub":"268'525","last_deep_scrub_stamp":"2024-09-12T01:02:49.186637+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.186637+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:02.660716+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2585,"num_read_kb":2367,"num_write":669,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":506,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"268'370","reported_seq":1025,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:45.502665+0000","last_change":"2024-09-12T01:02:45.502549+0000","last_active":"2024-09-12T01:02:45.502665+0000","last_peered":"2024-09-12T01:02:45.502665+0000","last_clean":"2024-09-12T01:02:45.502665+0000","last_became_active":"2024-09-12T00:15:55.063542+0000","last_became_peered":"2024-09-12T00:15:55.063542+0000","last_unstale":"2024-09-12T01:02:45.502665+0000","last_undegraded":"2024-09-12T01:02:45.502665+0000","last_fullsized":"2024-09-12T01:02:45.502665+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-12T01:02:45.502377+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-12T01:02:45.502377+0000","last_clean_scrub_stamp":"2024-09-12T01:02:45.502377+0000","objects_scrubbed":6,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:03.174691+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":559,"num_read_kb":24074,"num_write":1250,"num_write_kb":38232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.118827+0000","last_change":"2024-09-12T01:03:01.118698+0000","last_active":"2024-09-12T01:03:01.118827+0000","last_peered":"2024-09-12T01:03:01.118827+0000","last_clean":"2024-09-12T01:03:01.118827+0000","last_became_active":"2024-09-12T00:15:59.050663+0000","last_became_peered":"2024-09-12T00:15:59.050663+0000","last_unstale":"2024-09-12T01:03:01.118827+0000","last_undegraded":"2024-09-12T01:03:01.118827+0000","last_fullsized":"2024-09-12T01:03:01.118827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:01.118502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:01.118502+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.118502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:20.630794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"268'250","reported_seq":839,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.300044+0000","last_change":"2024-09-12T01:03:11.299779+0000","last_active":"2024-09-12T01:03:11.300044+0000","last_peered":"2024-09-12T01:03:11.300044+0000","last_clean":"2024-09-12T01:03:11.300044+0000","last_became_active":"2024-09-12T00:16:01.068392+0000","last_became_peered":"2024-09-12T00:16:01.068392+0000","last_unstale":"2024-09-12T01:03:11.300044+0000","last_undegraded":"2024-09-12T01:03:11.300044+0000","last_fullsized":"2024-09-12T01:03:11.300044+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'250","last_scrub_stamp":"2024-09-12T01:03:11.299521+0000","last_deep_scrub":"268'250","last_deep_scrub_stamp":"2024-09-12T01:03:11.299521+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.299521+0000","objects_scrubbed":5,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:46.135518+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10400,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":388,"num_read_kb":849,"num_write":306,"num_write_kb":235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.374910+0000","last_change":"2024-09-12T01:03:18.374745+0000","last_active":"2024-09-12T01:03:18.374910+0000","last_peered":"2024-09-12T01:03:18.374910+0000","last_clean":"2024-09-12T01:03:18.374910+0000","last_became_active":"2024-09-12T00:16:03.086751+0000","last_became_peered":"2024-09-12T00:16:03.086751+0000","last_unstale":"2024-09-12T01:03:18.374910+0000","last_undegraded":"2024-09-12T01:03:18.374910+0000","last_fullsized":"2024-09-12T01:03:18.374910+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:18.374546+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:18.374546+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.374546+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:35.922479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"268'2412","reported_seq":4256,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.330226+0000","last_change":"2024-09-12T01:03:11.330226+0000","last_active":"2024-09-12T01:03:11.330226+0000","last_peered":"2024-09-12T01:03:11.330226+0000","last_clean":"2024-09-12T01:03:11.330226+0000","last_became_active":"2024-09-12T00:16:05.114563+0000","last_became_peered":"2024-09-12T00:16:05.114563+0000","last_unstale":"2024-09-12T01:03:11.330226+0000","last_undegraded":"2024-09-12T01:03:11.330226+0000","last_fullsized":"2024-09-12T01:03:11.330226+0000","mapping_epoch":36,"log_start":"268'2401","ondisk_log_start":"268'2401","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2412","last_scrub_stamp":"2024-09-12T01:03:11.330022+0000","last_deep_scrub":"268'2412","last_deep_scrub_stamp":"2024-09-12T01:03:11.330022+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.330022+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":2401,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:27.082423+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6030,"num_read_kb":6028,"num_write":4877,"num_write_kb":1792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"268'787","reported_seq":2367,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.639010+0000","last_change":"2024-09-12T01:02:51.638877+0000","last_active":"2024-09-12T01:02:51.639010+0000","last_peered":"2024-09-12T01:02:51.639010+0000","last_clean":"2024-09-12T01:02:51.639010+0000","last_became_active":"2024-09-12T00:15:57.024509+0000","last_became_peered":"2024-09-12T00:15:57.024509+0000","last_unstale":"2024-09-12T01:02:51.639010+0000","last_undegraded":"2024-09-12T01:02:51.639010+0000","last_fullsized":"2024-09-12T01:02:51.639010+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'787","last_scrub_stamp":"2024-09-12T01:02:51.638693+0000","last_deep_scrub":"268'787","last_deep_scrub_stamp":"2024-09-12T01:02:51.638693+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.638693+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:49.637175+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3769,"num_read_kb":3415,"num_write":1030,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":247,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"268'342","reported_seq":995,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.680813+0000","last_change":"2024-09-12T01:02:49.680665+0000","last_active":"2024-09-12T01:02:49.680813+0000","last_peered":"2024-09-12T01:02:49.680813+0000","last_clean":"2024-09-12T01:02:49.680813+0000","last_became_active":"2024-09-12T00:15:55.052916+0000","last_became_peered":"2024-09-12T00:15:55.052916+0000","last_unstale":"2024-09-12T01:02:49.680813+0000","last_undegraded":"2024-09-12T01:02:49.680813+0000","last_fullsized":"2024-09-12T01:02:49.680813+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-12T01:02:49.680438+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-12T01:02:49.680438+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.680438+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:55.122798+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306611,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":476,"num_read_kb":37817,"num_write":1138,"num_write_kb":39957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,0],"acting":[3,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.497054+0000","last_change":"2024-09-12T01:03:09.496915+0000","last_active":"2024-09-12T01:03:09.497054+0000","last_peered":"2024-09-12T01:03:09.497054+0000","last_clean":"2024-09-12T01:03:09.497054+0000","last_became_active":"2024-09-12T00:15:59.034650+0000","last_became_peered":"2024-09-12T00:15:59.034650+0000","last_unstale":"2024-09-12T01:03:09.497054+0000","last_undegraded":"2024-09-12T01:03:09.497054+0000","last_fullsized":"2024-09-12T01:03:09.497054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:09.496742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:09.496742+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.496742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:28.986770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"268'327","reported_seq":940,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.578723+0000","last_change":"2024-09-12T01:03:18.578572+0000","last_active":"2024-09-12T01:03:18.578723+0000","last_peered":"2024-09-12T01:03:18.578723+0000","last_clean":"2024-09-12T01:03:18.578723+0000","last_became_active":"2024-09-12T00:16:01.057281+0000","last_became_peered":"2024-09-12T00:16:01.057281+0000","last_unstale":"2024-09-12T01:03:18.578723+0000","last_undegraded":"2024-09-12T01:03:18.578723+0000","last_fullsized":"2024-09-12T01:03:18.578723+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'327","last_scrub_stamp":"2024-09-12T01:03:18.578375+0000","last_deep_scrub":"268'327","last_deep_scrub_stamp":"2024-09-12T01:03:18.578375+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.578375+0000","objects_scrubbed":9,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:44.728688+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49581,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":504,"num_read_kb":1060,"num_write":406,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"268'816","reported_seq":2433,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.506232+0000","last_change":"2024-09-12T01:03:15.506078+0000","last_active":"2024-09-12T01:03:15.506232+0000","last_peered":"2024-09-12T01:03:15.506232+0000","last_clean":"2024-09-12T01:03:15.506232+0000","last_became_active":"2024-09-12T00:16:03.097554+0000","last_became_peered":"2024-09-12T00:16:03.097554+0000","last_unstale":"2024-09-12T01:03:15.506232+0000","last_undegraded":"2024-09-12T01:03:15.506232+0000","last_fullsized":"2024-09-12T01:03:15.506232+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'816","last_scrub_stamp":"2024-09-12T01:03:15.505876+0000","last_deep_scrub":"268'816","last_deep_scrub_stamp":"2024-09-12T01:03:15.505876+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.505876+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:52.676458+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"268'96","reported_seq":610,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.196672+0000","last_change":"2024-09-12T01:03:15.196451+0000","last_active":"2024-09-12T01:03:15.196672+0000","last_peered":"2024-09-12T01:03:15.196672+0000","last_clean":"2024-09-12T01:03:15.196672+0000","last_became_active":"2024-09-12T00:16:05.112524+0000","last_became_peered":"2024-09-12T00:16:05.112524+0000","last_unstale":"2024-09-12T01:03:15.196672+0000","last_undegraded":"2024-09-12T01:03:15.196672+0000","last_fullsized":"2024-09-12T01:03:15.196672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'96","last_scrub_stamp":"2024-09-12T01:03:15.196178+0000","last_deep_scrub":"268'96","last_deep_scrub_stamp":"2024-09-12T01:03:15.196178+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.196178+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:31.550514+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":109,"num_write":225,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"268'459","reported_seq":1835,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.410646+0000","last_change":"2024-09-12T01:03:01.410451+0000","last_active":"2024-09-12T01:03:01.410646+0000","last_peered":"2024-09-12T01:03:01.410646+0000","last_clean":"2024-09-12T01:03:01.410646+0000","last_became_active":"2024-09-12T00:15:57.042663+0000","last_became_peered":"2024-09-12T00:15:57.042663+0000","last_unstale":"2024-09-12T01:03:01.410646+0000","last_undegraded":"2024-09-12T01:03:01.410646+0000","last_fullsized":"2024-09-12T01:03:01.410646+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'459","last_scrub_stamp":"2024-09-12T01:03:01.410256+0000","last_deep_scrub":"268'459","last_deep_scrub_stamp":"2024-09-12T01:03:01.410256+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.410256+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:01.856062+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2110,"num_read_kb":1961,"num_write":540,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"268'346","reported_seq":1096,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.586839+0000","last_change":"2024-09-12T01:02:51.586675+0000","last_active":"2024-09-12T01:02:51.586839+0000","last_peered":"2024-09-12T01:02:51.586839+0000","last_clean":"2024-09-12T01:02:51.586839+0000","last_became_active":"2024-09-12T00:15:55.054533+0000","last_became_peered":"2024-09-12T00:15:55.054533+0000","last_unstale":"2024-09-12T01:02:51.586839+0000","last_undegraded":"2024-09-12T01:02:51.586839+0000","last_fullsized":"2024-09-12T01:02:51.586839+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:02:51.586430+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:02:51.586430+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.586430+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:11:34.921515+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263223,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":794,"num_read_kb":57067,"num_write":1127,"num_write_kb":15994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.131221+0000","last_change":"2024-09-12T01:03:02.131072+0000","last_active":"2024-09-12T01:03:02.131221+0000","last_peered":"2024-09-12T01:03:02.131221+0000","last_clean":"2024-09-12T01:03:02.131221+0000","last_became_active":"2024-09-12T00:15:59.037145+0000","last_became_peered":"2024-09-12T00:15:59.037145+0000","last_unstale":"2024-09-12T01:03:02.131221+0000","last_undegraded":"2024-09-12T01:03:02.131221+0000","last_fullsized":"2024-09-12T01:03:02.131221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:02.130877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:02.130877+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.130877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:34.886452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"268'492","reported_seq":1150,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.258077+0000","last_change":"2024-09-12T01:03:10.257980+0000","last_active":"2024-09-12T01:03:10.258077+0000","last_peered":"2024-09-12T01:03:10.258077+0000","last_clean":"2024-09-12T01:03:10.258077+0000","last_became_active":"2024-09-12T00:16:01.068496+0000","last_became_peered":"2024-09-12T00:16:01.068496+0000","last_unstale":"2024-09-12T01:03:10.258077+0000","last_undegraded":"2024-09-12T01:03:10.258077+0000","last_fullsized":"2024-09-12T01:03:10.258077+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'492","last_scrub_stamp":"2024-09-12T01:03:10.257870+0000","last_deep_scrub":"268'492","last_deep_scrub_stamp":"2024-09-12T01:03:10.257870+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.257870+0000","objects_scrubbed":7,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:35.185896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92831,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":846,"num_read_kb":2016,"num_write":692,"num_write_kb":581,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.473441+0000","last_change":"2024-09-12T01:03:14.473305+0000","last_active":"2024-09-12T01:03:14.473441+0000","last_peered":"2024-09-12T01:03:14.473441+0000","last_clean":"2024-09-12T01:03:14.473441+0000","last_became_active":"2024-09-12T00:16:03.101984+0000","last_became_peered":"2024-09-12T00:16:03.101984+0000","last_unstale":"2024-09-12T01:03:14.473441+0000","last_undegraded":"2024-09-12T01:03:14.473441+0000","last_fullsized":"2024-09-12T01:03:14.473441+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:14.473119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:14.473119+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.473119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:56.000451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"268'132","reported_seq":642,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.898625+0000","last_change":"2024-09-12T01:03:10.898479+0000","last_active":"2024-09-12T01:03:10.898625+0000","last_peered":"2024-09-12T01:03:10.898625+0000","last_clean":"2024-09-12T01:03:10.898625+0000","last_became_active":"2024-09-12T00:16:05.104674+0000","last_became_peered":"2024-09-12T00:16:05.104674+0000","last_unstale":"2024-09-12T01:03:10.898625+0000","last_undegraded":"2024-09-12T01:03:10.898625+0000","last_fullsized":"2024-09-12T01:03:10.898625+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'132","last_scrub_stamp":"2024-09-12T01:03:10.898244+0000","last_deep_scrub":"268'132","last_deep_scrub_stamp":"2024-09-12T01:03:10.898244+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.898244+0000","objects_scrubbed":1,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:29:44.538905+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":502,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":121,"num_write":297,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"268'781","reported_seq":2295,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.555105+0000","last_change":"2024-09-12T01:02:57.554858+0000","last_active":"2024-09-12T01:02:57.555105+0000","last_peered":"2024-09-12T01:02:57.555105+0000","last_clean":"2024-09-12T01:02:57.555105+0000","last_became_active":"2024-09-12T00:15:57.016954+0000","last_became_peered":"2024-09-12T00:15:57.016954+0000","last_unstale":"2024-09-12T01:02:57.555105+0000","last_undegraded":"2024-09-12T01:02:57.555105+0000","last_fullsized":"2024-09-12T01:02:57.555105+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'781","last_scrub_stamp":"2024-09-12T01:02:57.554627+0000","last_deep_scrub":"268'781","last_deep_scrub_stamp":"2024-09-12T01:02:57.554627+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.554627+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:39.189137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3833,"num_read_kb":3467,"num_write":1045,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"268'302","reported_seq":914,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.716691+0000","last_change":"2024-09-12T01:02:49.716410+0000","last_active":"2024-09-12T01:02:49.716691+0000","last_peered":"2024-09-12T01:02:49.716691+0000","last_clean":"2024-09-12T01:02:49.716691+0000","last_became_active":"2024-09-12T00:15:55.062854+0000","last_became_peered":"2024-09-12T00:15:55.062854+0000","last_unstale":"2024-09-12T01:02:49.716691+0000","last_undegraded":"2024-09-12T01:02:49.716691+0000","last_fullsized":"2024-09-12T01:02:49.716691+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'302","last_scrub_stamp":"2024-09-12T01:02:49.716161+0000","last_deep_scrub":"268'302","last_deep_scrub_stamp":"2024-09-12T01:02:49.716161+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.716161+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:41.591969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262214,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":412,"num_read_kb":12698,"num_write":975,"num_write_kb":17642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":504,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.827324+0000","last_change":"2024-09-12T01:03:00.827168+0000","last_active":"2024-09-12T01:03:00.827324+0000","last_peered":"2024-09-12T01:03:00.827324+0000","last_clean":"2024-09-12T01:03:00.827324+0000","last_became_active":"2024-09-12T00:15:59.033844+0000","last_became_peered":"2024-09-12T00:15:59.033844+0000","last_unstale":"2024-09-12T01:03:00.827324+0000","last_undegraded":"2024-09-12T01:03:00.827324+0000","last_fullsized":"2024-09-12T01:03:00.827324+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:00.826990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:00.826990+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.826990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:17.427435+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"268'323","reported_seq":916,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.264429+0000","last_change":"2024-09-12T01:03:06.264266+0000","last_active":"2024-09-12T01:03:06.264429+0000","last_peered":"2024-09-12T01:03:06.264429+0000","last_clean":"2024-09-12T01:03:06.264429+0000","last_became_active":"2024-09-12T00:16:01.067377+0000","last_became_peered":"2024-09-12T00:16:01.067377+0000","last_unstale":"2024-09-12T01:03:06.264429+0000","last_undegraded":"2024-09-12T01:03:06.264429+0000","last_fullsized":"2024-09-12T01:03:06.264429+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'323","last_scrub_stamp":"2024-09-12T01:03:06.264071+0000","last_deep_scrub":"268'323","last_deep_scrub_stamp":"2024-09-12T01:03:06.264071+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.264071+0000","objects_scrubbed":7,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:11.054065+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44037,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":549,"num_read_kb":1240,"num_write":496,"num_write_kb":413,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.894777+0000","last_change":"2024-09-12T01:03:07.894544+0000","last_active":"2024-09-12T01:03:07.894777+0000","last_peered":"2024-09-12T01:03:07.894777+0000","last_clean":"2024-09-12T01:03:07.894777+0000","last_became_active":"2024-09-12T00:16:03.079004+0000","last_became_peered":"2024-09-12T00:16:03.079004+0000","last_unstale":"2024-09-12T01:03:07.894777+0000","last_undegraded":"2024-09-12T01:03:07.894777+0000","last_fullsized":"2024-09-12T01:03:07.894777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:07.894293+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:07.894293+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.894293+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:54.640963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"268'133","reported_seq":631,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.649176+0000","last_change":"2024-09-12T01:03:19.649176+0000","last_active":"2024-09-12T01:03:19.649176+0000","last_peered":"2024-09-12T01:03:19.649176+0000","last_clean":"2024-09-12T01:03:19.649176+0000","last_became_active":"2024-09-12T00:16:05.093815+0000","last_became_peered":"2024-09-12T00:16:05.093815+0000","last_unstale":"2024-09-12T01:03:19.649176+0000","last_undegraded":"2024-09-12T01:03:19.649176+0000","last_fullsized":"2024-09-12T01:03:19.649176+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'133","last_scrub_stamp":"2024-09-12T01:03:19.648987+0000","last_deep_scrub":"268'133","last_deep_scrub_stamp":"2024-09-12T01:03:19.648987+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.648987+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:21.363778+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":99,"num_read_kb":97,"num_write":302,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"268'447","reported_seq":2000,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.542538+0000","last_change":"2024-09-12T01:03:02.542377+0000","last_active":"2024-09-12T01:03:02.542538+0000","last_peered":"2024-09-12T01:03:02.542538+0000","last_clean":"2024-09-12T01:03:02.542538+0000","last_became_active":"2024-09-12T00:15:57.029290+0000","last_became_peered":"2024-09-12T00:15:57.029290+0000","last_unstale":"2024-09-12T01:03:02.542538+0000","last_undegraded":"2024-09-12T01:03:02.542538+0000","last_fullsized":"2024-09-12T01:03:02.542538+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'447","last_scrub_stamp":"2024-09-12T01:03:02.542185+0000","last_deep_scrub":"268'447","last_deep_scrub_stamp":"2024-09-12T01:03:02.542185+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.542185+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:21.152121+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2290,"num_read_kb":2163,"num_write":517,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":469,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"268'350","reported_seq":1021,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.685284+0000","last_change":"2024-09-12T01:02:48.685091+0000","last_active":"2024-09-12T01:02:48.685284+0000","last_peered":"2024-09-12T01:02:48.685284+0000","last_clean":"2024-09-12T01:02:48.685284+0000","last_became_active":"2024-09-12T00:16:26.796888+0000","last_became_peered":"2024-09-12T00:16:26.796888+0000","last_unstale":"2024-09-12T01:02:48.685284+0000","last_undegraded":"2024-09-12T01:02:48.685284+0000","last_fullsized":"2024-09-12T01:02:48.685284+0000","mapping_epoch":39,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T01:02:48.684885+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T01:02:48.684885+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.684885+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:14:31.844783+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":497,"num_read_kb":37574,"num_write":1133,"num_write_kb":35076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,6],"acting":[3,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":505,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.479209+0000","last_change":"2024-09-12T01:03:10.478940+0000","last_active":"2024-09-12T01:03:10.479209+0000","last_peered":"2024-09-12T01:03:10.479209+0000","last_clean":"2024-09-12T01:03:10.479209+0000","last_became_active":"2024-09-12T00:15:59.029998+0000","last_became_peered":"2024-09-12T00:15:59.029998+0000","last_unstale":"2024-09-12T01:03:10.479209+0000","last_undegraded":"2024-09-12T01:03:10.479209+0000","last_fullsized":"2024-09-12T01:03:10.479209+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:10.478741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:10.478741+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.478741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:32.181120+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"268'313","reported_seq":905,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.516343+0000","last_change":"2024-09-12T01:03:11.516160+0000","last_active":"2024-09-12T01:03:11.516343+0000","last_peered":"2024-09-12T01:03:11.516343+0000","last_clean":"2024-09-12T01:03:11.516343+0000","last_became_active":"2024-09-12T00:16:01.053660+0000","last_became_peered":"2024-09-12T00:16:01.053660+0000","last_unstale":"2024-09-12T01:03:11.516343+0000","last_undegraded":"2024-09-12T01:03:11.516343+0000","last_fullsized":"2024-09-12T01:03:11.516343+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'313","last_scrub_stamp":"2024-09-12T01:03:11.515958+0000","last_deep_scrub":"268'313","last_deep_scrub_stamp":"2024-09-12T01:03:11.515958+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.515958+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:02.549026+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54997,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":504,"num_read_kb":1130,"num_write":408,"num_write_kb":314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"268'777","reported_seq":2376,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.890344+0000","last_change":"2024-09-12T01:03:03.890196+0000","last_active":"2024-09-12T01:03:03.890344+0000","last_peered":"2024-09-12T01:03:03.890344+0000","last_clean":"2024-09-12T01:03:03.890344+0000","last_became_active":"2024-09-12T00:16:03.098077+0000","last_became_peered":"2024-09-12T00:16:03.098077+0000","last_unstale":"2024-09-12T01:03:03.890344+0000","last_undegraded":"2024-09-12T01:03:03.890344+0000","last_fullsized":"2024-09-12T01:03:03.890344+0000","mapping_epoch":34,"log_start":"268'701","ondisk_log_start":"268'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'777","last_scrub_stamp":"2024-09-12T01:03:03.889993+0000","last_deep_scrub":"268'777","last_deep_scrub_stamp":"2024-09-12T01:03:03.889993+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.889993+0000","objects_scrubbed":1,"log_size":76,"log_dups_size":701,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:19.782671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"268'154","reported_seq":665,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.205070+0000","last_change":"2024-09-12T01:03:12.204907+0000","last_active":"2024-09-12T01:03:12.205070+0000","last_peered":"2024-09-12T01:03:12.205070+0000","last_clean":"2024-09-12T01:03:12.205070+0000","last_became_active":"2024-09-12T00:16:05.107291+0000","last_became_peered":"2024-09-12T00:16:05.107291+0000","last_unstale":"2024-09-12T01:03:12.205070+0000","last_undegraded":"2024-09-12T01:03:12.205070+0000","last_fullsized":"2024-09-12T01:03:12.205070+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'154","last_scrub_stamp":"2024-09-12T01:03:12.204682+0000","last_deep_scrub":"268'154","last_deep_scrub_stamp":"2024-09-12T01:03:12.204682+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.204682+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:02.743584+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1256,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":174,"num_read_kb":162,"num_write":365,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"268'796","reported_seq":2317,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.684896+0000","last_change":"2024-09-12T01:02:53.684735+0000","last_active":"2024-09-12T01:02:53.684896+0000","last_peered":"2024-09-12T01:02:53.684896+0000","last_clean":"2024-09-12T01:02:53.684896+0000","last_became_active":"2024-09-12T00:15:57.024185+0000","last_became_peered":"2024-09-12T00:15:57.024185+0000","last_unstale":"2024-09-12T01:02:53.684896+0000","last_undegraded":"2024-09-12T01:02:53.684896+0000","last_fullsized":"2024-09-12T01:02:53.684896+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'796","last_scrub_stamp":"2024-09-12T01:02:53.684558+0000","last_deep_scrub":"268'796","last_deep_scrub_stamp":"2024-09-12T01:02:53.684558+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.684558+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":700,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:16.494973+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3776,"num_read_kb":3402,"num_write":1055,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"268'346","reported_seq":1001,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.643400+0000","last_change":"2024-09-12T01:02:52.643233+0000","last_active":"2024-09-12T01:02:52.643400+0000","last_peered":"2024-09-12T01:02:52.643400+0000","last_clean":"2024-09-12T01:02:52.643400+0000","last_became_active":"2024-09-12T00:15:55.027001+0000","last_became_peered":"2024-09-12T00:15:55.027001+0000","last_unstale":"2024-09-12T01:02:52.643400+0000","last_undegraded":"2024-09-12T01:02:52.643400+0000","last_fullsized":"2024-09-12T01:02:52.643400+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'346","last_scrub_stamp":"2024-09-12T01:02:52.642900+0000","last_deep_scrub":"268'346","last_deep_scrub_stamp":"2024-09-12T01:02:52.642900+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.642900+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:21.246963+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7614964,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":429,"num_read_kb":53256,"num_write":866,"num_write_kb":32142,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"268'4","reported_seq":1471,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.204787+0000","last_change":"2024-09-12T01:03:03.204641+0000","last_active":"2024-09-12T01:03:03.204787+0000","last_peered":"2024-09-12T01:03:03.204787+0000","last_clean":"2024-09-12T01:03:03.204787+0000","last_became_active":"2024-09-12T00:15:59.035380+0000","last_became_peered":"2024-09-12T00:15:59.035380+0000","last_unstale":"2024-09-12T01:03:03.204787+0000","last_undegraded":"2024-09-12T01:03:03.204787+0000","last_fullsized":"2024-09-12T01:03:03.204787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:03:03.204443+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:03:03.204443+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.204443+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:11.470633+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":957,"num_read_kb":957,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"268'85","reported_seq":610,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.231535+0000","last_change":"2024-09-12T01:03:06.231381+0000","last_active":"2024-09-12T01:03:06.231535+0000","last_peered":"2024-09-12T01:03:06.231535+0000","last_clean":"2024-09-12T01:03:06.231535+0000","last_became_active":"2024-09-12T00:16:01.065038+0000","last_became_peered":"2024-09-12T00:16:01.065038+0000","last_unstale":"2024-09-12T01:03:06.231535+0000","last_undegraded":"2024-09-12T01:03:06.231535+0000","last_fullsized":"2024-09-12T01:03:06.231535+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'85","last_scrub_stamp":"2024-09-12T01:03:06.231109+0000","last_deep_scrub":"268'85","last_deep_scrub_stamp":"2024-09-12T01:03:06.231109+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.231109+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:56.855213+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":79,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"268'798","reported_seq":2374,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.300957+0000","last_change":"2024-09-12T01:03:08.300708+0000","last_active":"2024-09-12T01:03:08.300957+0000","last_peered":"2024-09-12T01:03:08.300957+0000","last_clean":"2024-09-12T01:03:08.300957+0000","last_became_active":"2024-09-12T00:16:03.088856+0000","last_became_peered":"2024-09-12T00:16:03.088856+0000","last_unstale":"2024-09-12T01:03:08.300957+0000","last_undegraded":"2024-09-12T01:03:08.300957+0000","last_fullsized":"2024-09-12T01:03:08.300957+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'798","last_scrub_stamp":"2024-09-12T01:03:08.300494+0000","last_deep_scrub":"268'798","last_deep_scrub_stamp":"2024-09-12T01:03:08.300494+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.300494+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:31.004109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"268'127","reported_seq":644,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.575304+0000","last_change":"2024-09-12T01:03:10.575118+0000","last_active":"2024-09-12T01:03:10.575304+0000","last_peered":"2024-09-12T01:03:10.575304+0000","last_clean":"2024-09-12T01:03:10.575304+0000","last_became_active":"2024-09-12T00:16:05.107712+0000","last_became_peered":"2024-09-12T00:16:05.107712+0000","last_unstale":"2024-09-12T01:03:10.575304+0000","last_undegraded":"2024-09-12T01:03:10.575304+0000","last_fullsized":"2024-09-12T01:03:10.575304+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'127","last_scrub_stamp":"2024-09-12T01:03:10.574900+0000","last_deep_scrub":"268'127","last_deep_scrub_stamp":"2024-09-12T01:03:10.574900+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.574900+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:18.976742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":150,"num_write":299,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"268'859","reported_seq":2484,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.716496+0000","last_change":"2024-09-12T01:02:50.716343+0000","last_active":"2024-09-12T01:02:50.716496+0000","last_peered":"2024-09-12T01:02:50.716496+0000","last_clean":"2024-09-12T01:02:50.716496+0000","last_became_active":"2024-09-12T00:15:57.043447+0000","last_became_peered":"2024-09-12T00:15:57.043447+0000","last_unstale":"2024-09-12T01:02:50.716496+0000","last_undegraded":"2024-09-12T01:02:50.716496+0000","last_fullsized":"2024-09-12T01:02:50.716496+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'859","last_scrub_stamp":"2024-09-12T01:02:50.716156+0000","last_deep_scrub":"268'859","last_deep_scrub_stamp":"2024-09-12T01:02:50.716156+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.716156+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":800,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:50.072424+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4138,"num_read_kb":3738,"num_write":1141,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2781,"num_omap_keys":11,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"268'317","reported_seq":966,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.303400+0000","last_change":"2024-09-12T01:02:49.303242+0000","last_active":"2024-09-12T01:02:49.303400+0000","last_peered":"2024-09-12T01:02:49.303400+0000","last_clean":"2024-09-12T01:02:49.303400+0000","last_became_active":"2024-09-12T00:15:55.039512+0000","last_became_peered":"2024-09-12T00:15:55.039512+0000","last_unstale":"2024-09-12T01:02:49.303400+0000","last_undegraded":"2024-09-12T01:02:49.303400+0000","last_fullsized":"2024-09-12T01:02:49.303400+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'317","last_scrub_stamp":"2024-09-12T01:02:49.302955+0000","last_deep_scrub":"268'317","last_deep_scrub_stamp":"2024-09-12T01:02:49.302955+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.302955+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:28.690417+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655867,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":425,"num_read_kb":56944,"num_write":985,"num_write_kb":41414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,0],"acting":[4,7,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":513,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.587414+0000","last_change":"2024-09-12T01:03:12.587270+0000","last_active":"2024-09-12T01:03:12.587414+0000","last_peered":"2024-09-12T01:03:12.587414+0000","last_clean":"2024-09-12T01:03:12.587414+0000","last_became_active":"2024-09-12T00:15:59.046018+0000","last_became_peered":"2024-09-12T00:15:59.046018+0000","last_unstale":"2024-09-12T01:03:12.587414+0000","last_undegraded":"2024-09-12T01:03:12.587414+0000","last_fullsized":"2024-09-12T01:03:12.587414+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:12.587065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:12.587065+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.587065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:50.322069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"268'340","reported_seq":958,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.165014+0000","last_change":"2024-09-12T01:03:02.164857+0000","last_active":"2024-09-12T01:03:02.165014+0000","last_peered":"2024-09-12T01:03:02.165014+0000","last_clean":"2024-09-12T01:03:02.165014+0000","last_became_active":"2024-09-12T00:16:01.069078+0000","last_became_peered":"2024-09-12T00:16:01.069078+0000","last_unstale":"2024-09-12T01:03:02.165014+0000","last_undegraded":"2024-09-12T01:03:02.165014+0000","last_fullsized":"2024-09-12T01:03:02.165014+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'340","last_scrub_stamp":"2024-09-12T01:03:02.164644+0000","last_deep_scrub":"268'340","last_deep_scrub_stamp":"2024-09-12T01:03:02.164644+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.164644+0000","objects_scrubbed":8,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:23.713601+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46997,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":538,"num_read_kb":1097,"num_write":420,"num_write_kb":283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":496,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.527950+0000","last_change":"2024-09-12T01:03:05.527830+0000","last_active":"2024-09-12T01:03:05.527950+0000","last_peered":"2024-09-12T01:03:05.527950+0000","last_clean":"2024-09-12T01:03:05.527950+0000","last_became_active":"2024-09-12T00:16:03.106662+0000","last_became_peered":"2024-09-12T00:16:03.106662+0000","last_unstale":"2024-09-12T01:03:05.527950+0000","last_undegraded":"2024-09-12T01:03:05.527950+0000","last_fullsized":"2024-09-12T01:03:05.527950+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:05.527635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:05.527635+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.527635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:41.284662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"268'137","reported_seq":637,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.939630+0000","last_change":"2024-09-12T01:03:09.939466+0000","last_active":"2024-09-12T01:03:09.939630+0000","last_peered":"2024-09-12T01:03:09.939630+0000","last_clean":"2024-09-12T01:03:09.939630+0000","last_became_active":"2024-09-12T00:16:05.111705+0000","last_became_peered":"2024-09-12T00:16:05.111705+0000","last_unstale":"2024-09-12T01:03:09.939630+0000","last_undegraded":"2024-09-12T01:03:09.939630+0000","last_fullsized":"2024-09-12T01:03:09.939630+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'137","last_scrub_stamp":"2024-09-12T01:03:09.939285+0000","last_deep_scrub":"268'137","last_deep_scrub_stamp":"2024-09-12T01:03:09.939285+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.939285+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:38.978042+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":132,"num_read_kb":132,"num_write":316,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"268'515","reported_seq":2104,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.567033+0000","last_change":"2024-09-12T01:03:00.567033+0000","last_active":"2024-09-12T01:03:00.567033+0000","last_peered":"2024-09-12T01:03:00.567033+0000","last_clean":"2024-09-12T01:03:00.567033+0000","last_became_active":"2024-09-12T00:15:57.029211+0000","last_became_peered":"2024-09-12T00:15:57.029211+0000","last_unstale":"2024-09-12T01:03:00.567033+0000","last_undegraded":"2024-09-12T01:03:00.567033+0000","last_fullsized":"2024-09-12T01:03:00.567033+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'515","last_scrub_stamp":"2024-09-12T01:03:00.566844+0000","last_deep_scrub":"268'515","last_deep_scrub_stamp":"2024-09-12T01:03:00.566844+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.566844+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:35.368781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2638,"num_read_kb":2449,"num_write":617,"num_write_kb":165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"268'74","reported_seq":633,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:45.219135+0000","last_change":"2024-09-12T01:02:45.219078+0000","last_active":"2024-09-12T01:02:45.219135+0000","last_peered":"2024-09-12T01:02:45.219135+0000","last_clean":"2024-09-12T01:02:45.219135+0000","last_became_active":"2024-09-12T00:15:34.145413+0000","last_became_peered":"2024-09-12T00:15:34.145413+0000","last_unstale":"2024-09-12T01:02:45.219135+0000","last_undegraded":"2024-09-12T01:02:45.219135+0000","last_fullsized":"2024-09-12T01:02:45.219135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'74","last_scrub_stamp":"2024-09-12T01:02:45.219010+0000","last_deep_scrub":"268'74","last_deep_scrub_stamp":"2024-09-12T01:02:45.219010+0000","last_clean_scrub_stamp":"2024-09-12T01:02:45.219010+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:41.967660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"268'2","reported_seq":544,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.680071+0000","last_change":"2024-09-12T01:02:46.679981+0000","last_active":"2024-09-12T01:02:46.680071+0000","last_peered":"2024-09-12T01:02:46.680071+0000","last_clean":"2024-09-12T01:02:46.680071+0000","last_became_active":"2024-09-12T00:15:40.490486+0000","last_became_peered":"2024-09-12T00:15:40.490486+0000","last_unstale":"2024-09-12T01:02:46.680071+0000","last_undegraded":"2024-09-12T01:02:46.680071+0000","last_fullsized":"2024-09-12T01:02:46.680071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:02:46.679880+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:02:46.679880+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.679880+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:23.630978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0013201490000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"268'332","reported_seq":1017,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.270039+0000","last_change":"2024-09-12T01:02:48.269848+0000","last_active":"2024-09-12T01:02:48.270039+0000","last_peered":"2024-09-12T01:02:48.270039+0000","last_clean":"2024-09-12T01:02:48.270039+0000","last_became_active":"2024-09-12T00:15:55.048230+0000","last_became_peered":"2024-09-12T00:15:55.048230+0000","last_unstale":"2024-09-12T01:02:48.270039+0000","last_undegraded":"2024-09-12T01:02:48.270039+0000","last_fullsized":"2024-09-12T01:02:48.270039+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'332","last_scrub_stamp":"2024-09-12T01:02:48.269620+0000","last_deep_scrub":"268'332","last_deep_scrub_stamp":"2024-09-12T01:02:48.269620+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.269620+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:21.536299+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":550,"num_read_kb":9775,"num_write":1119,"num_write_kb":32871,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.587228+0000","last_change":"2024-09-12T01:03:03.587085+0000","last_active":"2024-09-12T01:03:03.587228+0000","last_peered":"2024-09-12T01:03:03.587228+0000","last_clean":"2024-09-12T01:03:03.587228+0000","last_became_active":"2024-09-12T00:15:59.041357+0000","last_became_peered":"2024-09-12T00:15:59.041357+0000","last_unstale":"2024-09-12T01:03:03.587228+0000","last_undegraded":"2024-09-12T01:03:03.587228+0000","last_fullsized":"2024-09-12T01:03:03.587228+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:03.586925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:03.586925+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.586925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:02.037337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"268'732","reported_seq":1457,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.633939+0000","last_change":"2024-09-12T01:03:20.633798+0000","last_active":"2024-09-12T01:03:20.633939+0000","last_peered":"2024-09-12T01:03:20.633939+0000","last_clean":"2024-09-12T01:03:20.633939+0000","last_became_active":"2024-09-12T00:16:01.052016+0000","last_became_peered":"2024-09-12T00:16:01.052016+0000","last_unstale":"2024-09-12T01:03:20.633939+0000","last_undegraded":"2024-09-12T01:03:20.633939+0000","last_fullsized":"2024-09-12T01:03:20.633939+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'732","last_scrub_stamp":"2024-09-12T01:03:20.633604+0000","last_deep_scrub":"268'732","last_deep_scrub_stamp":"2024-09-12T01:03:20.633604+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.633604+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":700,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:43.763989+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164258,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1426,"num_read_kb":3353,"num_write":1318,"num_write_kb":1186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89358,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":497,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.542586+0000","last_change":"2024-09-12T01:03:16.542440+0000","last_active":"2024-09-12T01:03:16.542586+0000","last_peered":"2024-09-12T01:03:16.542586+0000","last_clean":"2024-09-12T01:03:16.542586+0000","last_became_active":"2024-09-12T00:16:03.097343+0000","last_became_peered":"2024-09-12T00:16:03.097343+0000","last_unstale":"2024-09-12T01:03:16.542586+0000","last_undegraded":"2024-09-12T01:03:16.542586+0000","last_fullsized":"2024-09-12T01:03:16.542586+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:16.542262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:16.542262+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.542262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:38.878863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"268'175","reported_seq":883,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.574819+0000","last_change":"2024-09-12T01:03:07.574673+0000","last_active":"2024-09-12T01:03:07.574819+0000","last_peered":"2024-09-12T01:03:07.574819+0000","last_clean":"2024-09-12T01:03:07.574819+0000","last_became_active":"2024-09-12T00:16:05.113366+0000","last_became_peered":"2024-09-12T00:16:05.113366+0000","last_unstale":"2024-09-12T01:03:07.574819+0000","last_undegraded":"2024-09-12T01:03:07.574819+0000","last_fullsized":"2024-09-12T01:03:07.574819+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'175","last_scrub_stamp":"2024-09-12T01:03:07.574482+0000","last_deep_scrub":"268'175","last_deep_scrub_stamp":"2024-09-12T01:03:07.574482+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.574482+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:15:52.409139+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1020,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":408,"num_write":348,"num_write_kb":102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"268'1046","reported_seq":2802,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.449275+0000","last_change":"2024-09-12T01:03:00.449118+0000","last_active":"2024-09-12T01:03:00.449275+0000","last_peered":"2024-09-12T01:03:00.449275+0000","last_clean":"2024-09-12T01:03:00.449275+0000","last_became_active":"2024-09-12T00:15:57.047672+0000","last_became_peered":"2024-09-12T00:15:57.047672+0000","last_unstale":"2024-09-12T01:03:00.449275+0000","last_undegraded":"2024-09-12T01:03:00.449275+0000","last_fullsized":"2024-09-12T01:03:00.449275+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1046","last_scrub_stamp":"2024-09-12T01:03:00.448926+0000","last_deep_scrub":"268'1046","last_deep_scrub_stamp":"2024-09-12T01:03:00.448926+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.448926+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":1000,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:49.266149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5053,"num_read_kb":4502,"num_write":1469,"num_write_kb":612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":543,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.724112+0000","last_change":"2024-09-12T01:02:47.723987+0000","last_active":"2024-09-12T01:02:47.724112+0000","last_peered":"2024-09-12T01:02:47.724112+0000","last_clean":"2024-09-12T01:02:47.724112+0000","last_became_active":"2024-09-12T00:15:40.098303+0000","last_became_peered":"2024-09-12T00:15:40.098303+0000","last_unstale":"2024-09-12T01:02:47.724112+0000","last_undegraded":"2024-09-12T01:02:47.724112+0000","last_fullsized":"2024-09-12T01:02:47.724112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:47.723827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:47.723827+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.723827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:34.869689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0017858660000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"268'328","reported_seq":990,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.047640+0000","last_change":"2024-09-12T01:02:47.047495+0000","last_active":"2024-09-12T01:02:47.047640+0000","last_peered":"2024-09-12T01:02:47.047640+0000","last_clean":"2024-09-12T01:02:47.047640+0000","last_became_active":"2024-09-12T00:15:55.050874+0000","last_became_peered":"2024-09-12T00:15:55.050874+0000","last_unstale":"2024-09-12T01:02:47.047640+0000","last_undegraded":"2024-09-12T01:02:47.047640+0000","last_fullsized":"2024-09-12T01:02:47.047640+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'328","last_scrub_stamp":"2024-09-12T01:02:47.047228+0000","last_deep_scrub":"268'328","last_deep_scrub_stamp":"2024-09-12T01:02:47.047228+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.047228+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:26.163227+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2684897,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":131172,"num_write":1059,"num_write_kb":57813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.575314+0000","last_change":"2024-09-12T01:03:14.575165+0000","last_active":"2024-09-12T01:03:14.575314+0000","last_peered":"2024-09-12T01:03:14.575314+0000","last_clean":"2024-09-12T01:03:14.575314+0000","last_became_active":"2024-09-12T00:15:59.030858+0000","last_became_peered":"2024-09-12T00:15:59.030858+0000","last_unstale":"2024-09-12T01:03:14.575314+0000","last_undegraded":"2024-09-12T01:03:14.575314+0000","last_fullsized":"2024-09-12T01:03:14.575314+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:14.574985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:14.574985+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.574985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:22.049180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"268'1320","reported_seq":2831,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.853550+0000","last_change":"2024-09-12T01:03:02.853324+0000","last_active":"2024-09-12T01:03:02.853550+0000","last_peered":"2024-09-12T01:03:02.853550+0000","last_clean":"2024-09-12T01:03:02.853550+0000","last_became_active":"2024-09-12T00:16:01.057956+0000","last_became_peered":"2024-09-12T00:16:01.057956+0000","last_unstale":"2024-09-12T01:03:02.853550+0000","last_undegraded":"2024-09-12T01:03:02.853550+0000","last_fullsized":"2024-09-12T01:03:02.853550+0000","mapping_epoch":32,"log_start":"268'1300","ondisk_log_start":"268'1300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1320","last_scrub_stamp":"2024-09-12T01:03:02.853122+0000","last_deep_scrub":"268'1320","last_deep_scrub_stamp":"2024-09-12T01:03:02.853122+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.853122+0000","objects_scrubbed":12,"log_size":20,"log_dups_size":1300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:44.062604+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158341,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2071,"num_read_kb":3936,"num_write":1172,"num_write_kb":1006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.559225+0000","last_change":"2024-09-12T01:03:23.559225+0000","last_active":"2024-09-12T01:03:23.559225+0000","last_peered":"2024-09-12T01:03:23.559225+0000","last_clean":"2024-09-12T01:03:23.559225+0000","last_became_active":"2024-09-12T00:16:03.104040+0000","last_became_peered":"2024-09-12T00:16:03.104040+0000","last_unstale":"2024-09-12T01:03:23.559225+0000","last_undegraded":"2024-09-12T01:03:23.559225+0000","last_fullsized":"2024-09-12T01:03:23.559225+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:23.559011+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:23.559011+0000","last_clean_scrub_stamp":"2024-09-12T01:03:23.559011+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:45.337736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"268'223","reported_seq":758,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.641517+0000","last_change":"2024-09-12T01:03:20.641357+0000","last_active":"2024-09-12T01:03:20.641517+0000","last_peered":"2024-09-12T01:03:20.641517+0000","last_clean":"2024-09-12T01:03:20.641517+0000","last_became_active":"2024-09-12T00:16:05.099987+0000","last_became_peered":"2024-09-12T00:16:05.099987+0000","last_unstale":"2024-09-12T01:03:20.641517+0000","last_undegraded":"2024-09-12T01:03:20.641517+0000","last_fullsized":"2024-09-12T01:03:20.641517+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'223","last_scrub_stamp":"2024-09-12T01:03:20.641126+0000","last_deep_scrub":"268'223","last_deep_scrub_stamp":"2024-09-12T01:03:20.641126+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.641126+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:03.375193+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":366,"num_read_kb":355,"num_write":494,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"268'397","reported_seq":1899,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.050123+0000","last_change":"2024-09-12T01:02:56.049982+0000","last_active":"2024-09-12T01:02:56.050123+0000","last_peered":"2024-09-12T01:02:56.050123+0000","last_clean":"2024-09-12T01:02:56.050123+0000","last_became_active":"2024-09-12T00:15:57.022193+0000","last_became_peered":"2024-09-12T00:15:57.022193+0000","last_unstale":"2024-09-12T01:02:56.050123+0000","last_undegraded":"2024-09-12T01:02:56.050123+0000","last_fullsized":"2024-09-12T01:02:56.050123+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'397","last_scrub_stamp":"2024-09-12T01:02:56.049789+0000","last_deep_scrub":"268'397","last_deep_scrub_stamp":"2024-09-12T01:02:56.049789+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.049789+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:04.648345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2164,"num_read_kb":2061,"num_write":440,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1009,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":533,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.684987+0000","last_change":"2024-09-12T01:02:47.684705+0000","last_active":"2024-09-12T01:02:47.684987+0000","last_peered":"2024-09-12T01:02:47.684987+0000","last_clean":"2024-09-12T01:02:47.684987+0000","last_became_active":"2024-09-12T00:15:40.095888+0000","last_became_peered":"2024-09-12T00:15:40.095888+0000","last_unstale":"2024-09-12T01:02:47.684987+0000","last_undegraded":"2024-09-12T01:02:47.684987+0000","last_fullsized":"2024-09-12T01:02:47.684987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:47.684478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:47.684478+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.684478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:12.159645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000883303,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"268'366","reported_seq":994,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.311262+0000","last_change":"2024-09-12T01:02:47.311262+0000","last_active":"2024-09-12T01:02:47.311262+0000","last_peered":"2024-09-12T01:02:47.311262+0000","last_clean":"2024-09-12T01:02:47.311262+0000","last_became_active":"2024-09-12T00:15:55.043174+0000","last_became_peered":"2024-09-12T00:15:55.043174+0000","last_unstale":"2024-09-12T01:02:47.311262+0000","last_undegraded":"2024-09-12T01:02:47.311262+0000","last_fullsized":"2024-09-12T01:02:47.311262+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'366","last_scrub_stamp":"2024-09-12T01:02:47.311008+0000","last_deep_scrub":"268'366","last_deep_scrub_stamp":"2024-09-12T01:02:47.311008+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.311008+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:15.727357+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":498,"num_read_kb":17440,"num_write":1129,"num_write_kb":28417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"268'2","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.787225+0000","last_change":"2024-09-12T01:02:59.786958+0000","last_active":"2024-09-12T01:02:59.787225+0000","last_peered":"2024-09-12T01:02:59.787225+0000","last_clean":"2024-09-12T01:02:59.787225+0000","last_became_active":"2024-09-12T00:15:59.033660+0000","last_became_peered":"2024-09-12T00:15:59.033660+0000","last_unstale":"2024-09-12T01:02:59.787225+0000","last_undegraded":"2024-09-12T01:02:59.787225+0000","last_fullsized":"2024-09-12T01:02:59.787225+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:02:59.786685+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:02:59.786685+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.786685+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:29.273758+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"268'260","reported_seq":1374,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.587957+0000","last_change":"2024-09-12T01:03:02.587816+0000","last_active":"2024-09-12T01:03:02.587957+0000","last_peered":"2024-09-12T01:03:02.587957+0000","last_clean":"2024-09-12T01:03:02.587957+0000","last_became_active":"2024-09-12T00:16:01.072168+0000","last_became_peered":"2024-09-12T00:16:01.072168+0000","last_unstale":"2024-09-12T01:03:02.587957+0000","last_undegraded":"2024-09-12T01:03:02.587957+0000","last_fullsized":"2024-09-12T01:03:02.587957+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'260","last_scrub_stamp":"2024-09-12T01:03:02.587570+0000","last_deep_scrub":"268'260","last_deep_scrub_stamp":"2024-09-12T01:03:02.587570+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.587570+0000","objects_scrubbed":9,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:58.907887+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":183,"num_read_kb":175,"num_write":157,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.355570+0000","last_change":"2024-09-12T01:03:17.355434+0000","last_active":"2024-09-12T01:03:17.355570+0000","last_peered":"2024-09-12T01:03:17.355570+0000","last_clean":"2024-09-12T01:03:17.355570+0000","last_became_active":"2024-09-12T00:16:03.086646+0000","last_became_peered":"2024-09-12T00:16:03.086646+0000","last_unstale":"2024-09-12T01:03:17.355570+0000","last_undegraded":"2024-09-12T01:03:17.355570+0000","last_fullsized":"2024-09-12T01:03:17.355570+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:17.355239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:17.355239+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.355239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:32:34.338519+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"268'263","reported_seq":892,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.308774+0000","last_change":"2024-09-12T01:03:21.308615+0000","last_active":"2024-09-12T01:03:21.308774+0000","last_peered":"2024-09-12T01:03:21.308774+0000","last_clean":"2024-09-12T01:03:21.308774+0000","last_became_active":"2024-09-12T00:16:05.094684+0000","last_became_peered":"2024-09-12T00:16:05.094684+0000","last_unstale":"2024-09-12T01:03:21.308774+0000","last_undegraded":"2024-09-12T01:03:21.308774+0000","last_fullsized":"2024-09-12T01:03:21.308774+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'263","last_scrub_stamp":"2024-09-12T01:03:21.308439+0000","last_deep_scrub":"268'263","last_deep_scrub_stamp":"2024-09-12T01:03:21.308439+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.308439+0000","objects_scrubbed":3,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:00.925946+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":390,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":550,"num_read_kb":556,"num_write":574,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"268'874","reported_seq":2480,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.005791+0000","last_change":"2024-09-12T01:02:57.005503+0000","last_active":"2024-09-12T01:02:57.005791+0000","last_peered":"2024-09-12T01:02:57.005791+0000","last_clean":"2024-09-12T01:02:57.005791+0000","last_became_active":"2024-09-12T00:15:57.049533+0000","last_became_peered":"2024-09-12T00:15:57.049533+0000","last_unstale":"2024-09-12T01:02:57.005791+0000","last_undegraded":"2024-09-12T01:02:57.005791+0000","last_fullsized":"2024-09-12T01:02:57.005791+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'874","last_scrub_stamp":"2024-09-12T01:02:57.005246+0000","last_deep_scrub":"268'874","last_deep_scrub_stamp":"2024-09-12T01:02:57.005246+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.005246+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:59.310768+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4105,"num_read_kb":3691,"num_write":1162,"num_write_kb":431,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"268'3","reported_seq":545,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:45.698415+0000","last_change":"2024-09-12T01:02:45.698348+0000","last_active":"2024-09-12T01:02:45.698415+0000","last_peered":"2024-09-12T01:02:45.698415+0000","last_clean":"2024-09-12T01:02:45.698415+0000","last_became_active":"2024-09-12T00:15:40.144614+0000","last_became_peered":"2024-09-12T00:15:40.144614+0000","last_unstale":"2024-09-12T01:02:45.698415+0000","last_undegraded":"2024-09-12T01:02:45.698415+0000","last_fullsized":"2024-09-12T01:02:45.698415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'3","last_scrub_stamp":"2024-09-12T01:02:45.698281+0000","last_deep_scrub":"268'3","last_deep_scrub_stamp":"2024-09-12T01:02:45.698281+0000","last_clean_scrub_stamp":"2024-09-12T01:02:45.698281+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:37.018108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0019634679999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"268'351","reported_seq":1059,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:45.560755+0000","last_change":"2024-09-12T01:02:45.560698+0000","last_active":"2024-09-12T01:02:45.560755+0000","last_peered":"2024-09-12T01:02:45.560755+0000","last_clean":"2024-09-12T01:02:45.560755+0000","last_became_active":"2024-09-12T00:15:55.060303+0000","last_became_peered":"2024-09-12T00:15:55.060303+0000","last_unstale":"2024-09-12T01:02:45.560755+0000","last_undegraded":"2024-09-12T01:02:45.560755+0000","last_fullsized":"2024-09-12T01:02:45.560755+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'351","last_scrub_stamp":"2024-09-12T01:02:45.560574+0000","last_deep_scrub":"268'351","last_deep_scrub_stamp":"2024-09-12T01:02:45.560574+0000","last_clean_scrub_stamp":"2024-09-12T01:02:45.560574+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:31.985568+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262201,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":640,"num_read_kb":10990,"num_write":1328,"num_write_kb":39626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.777198+0000","last_change":"2024-09-12T01:02:57.777064+0000","last_active":"2024-09-12T01:02:57.777198+0000","last_peered":"2024-09-12T01:02:57.777198+0000","last_clean":"2024-09-12T01:02:57.777198+0000","last_became_active":"2024-09-12T00:15:59.042545+0000","last_became_peered":"2024-09-12T00:15:59.042545+0000","last_unstale":"2024-09-12T01:02:57.777198+0000","last_undegraded":"2024-09-12T01:02:57.777198+0000","last_fullsized":"2024-09-12T01:02:57.777198+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:57.776886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:57.776886+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.776886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:31.335494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"268'147","reported_seq":694,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.524008+0000","last_change":"2024-09-12T01:03:12.523810+0000","last_active":"2024-09-12T01:03:12.524008+0000","last_peered":"2024-09-12T01:03:12.524008+0000","last_clean":"2024-09-12T01:03:12.524008+0000","last_became_active":"2024-09-12T00:16:01.047278+0000","last_became_peered":"2024-09-12T00:16:01.047278+0000","last_unstale":"2024-09-12T01:03:12.524008+0000","last_undegraded":"2024-09-12T01:03:12.524008+0000","last_fullsized":"2024-09-12T01:03:12.524008+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'147","last_scrub_stamp":"2024-09-12T01:03:12.523474+0000","last_deep_scrub":"268'147","last_deep_scrub_stamp":"2024-09-12T01:03:12.523474+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.523474+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:43.617120+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":154,"num_read_kb":143,"num_write":118,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:26.580190+0000","last_change":"2024-09-12T01:03:26.580031+0000","last_active":"2024-09-12T01:03:26.580190+0000","last_peered":"2024-09-12T01:03:26.580190+0000","last_clean":"2024-09-12T01:03:26.580190+0000","last_became_active":"2024-09-12T00:16:03.097029+0000","last_became_peered":"2024-09-12T00:16:03.097029+0000","last_unstale":"2024-09-12T01:03:26.580190+0000","last_undegraded":"2024-09-12T01:03:26.580190+0000","last_fullsized":"2024-09-12T01:03:26.580190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:26.579853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:26.579853+0000","last_clean_scrub_stamp":"2024-09-12T01:03:26.579853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:20.359345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"268'158","reported_seq":742,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.301982+0000","last_change":"2024-09-12T01:03:14.301829+0000","last_active":"2024-09-12T01:03:14.301982+0000","last_peered":"2024-09-12T01:03:14.301982+0000","last_clean":"2024-09-12T01:03:14.301982+0000","last_became_active":"2024-09-12T00:16:05.111534+0000","last_became_peered":"2024-09-12T00:16:05.111534+0000","last_unstale":"2024-09-12T01:03:14.301982+0000","last_undegraded":"2024-09-12T01:03:14.301982+0000","last_fullsized":"2024-09-12T01:03:14.301982+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'158","last_scrub_stamp":"2024-09-12T01:03:14.301639+0000","last_deep_scrub":"268'158","last_deep_scrub_stamp":"2024-09-12T01:03:14.301639+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.301639+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:43.779965+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":344,"num_read_kb":315,"num_write":411,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"268'449","reported_seq":1942,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.027670+0000","last_change":"2024-09-12T01:02:54.027532+0000","last_active":"2024-09-12T01:02:54.027670+0000","last_peered":"2024-09-12T01:02:54.027670+0000","last_clean":"2024-09-12T01:02:54.027670+0000","last_became_active":"2024-09-12T00:15:57.023909+0000","last_became_peered":"2024-09-12T00:15:57.023909+0000","last_unstale":"2024-09-12T01:02:54.027670+0000","last_undegraded":"2024-09-12T01:02:54.027670+0000","last_fullsized":"2024-09-12T01:02:54.027670+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'449","last_scrub_stamp":"2024-09-12T01:02:54.027335+0000","last_deep_scrub":"268'449","last_deep_scrub_stamp":"2024-09-12T01:02:54.027335+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.027335+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:33.856984+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2256,"num_read_kb":2116,"num_write":511,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"268'339","reported_seq":991,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.549484+0000","last_change":"2024-09-12T01:02:47.549338+0000","last_active":"2024-09-12T01:02:47.549484+0000","last_peered":"2024-09-12T01:02:47.549484+0000","last_clean":"2024-09-12T01:02:47.549484+0000","last_became_active":"2024-09-12T00:15:55.056576+0000","last_became_peered":"2024-09-12T00:15:55.056576+0000","last_unstale":"2024-09-12T01:02:47.549484+0000","last_undegraded":"2024-09-12T01:02:47.549484+0000","last_fullsized":"2024-09-12T01:02:47.549484+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:02:47.549107+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:02:47.549107+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.549107+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:06.125443+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262186,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":528,"num_read_kb":507,"num_write":1203,"num_write_kb":27643,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":534,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.352459+0000","last_change":"2024-09-12T01:02:46.352302+0000","last_active":"2024-09-12T01:02:46.352459+0000","last_peered":"2024-09-12T01:02:46.352459+0000","last_clean":"2024-09-12T01:02:46.352459+0000","last_became_active":"2024-09-12T00:15:40.141037+0000","last_became_peered":"2024-09-12T00:15:40.141037+0000","last_unstale":"2024-09-12T01:02:46.352459+0000","last_undegraded":"2024-09-12T01:02:46.352459+0000","last_fullsized":"2024-09-12T01:02:46.352459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:46.352119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:46.352119+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.352119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:08.133964+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00088972300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.247436+0000","last_change":"2024-09-12T01:03:04.247303+0000","last_active":"2024-09-12T01:03:04.247436+0000","last_peered":"2024-09-12T01:03:04.247436+0000","last_clean":"2024-09-12T01:03:04.247436+0000","last_became_active":"2024-09-12T00:15:59.043935+0000","last_became_peered":"2024-09-12T00:15:59.043935+0000","last_unstale":"2024-09-12T01:03:04.247436+0000","last_undegraded":"2024-09-12T01:03:04.247436+0000","last_fullsized":"2024-09-12T01:03:04.247436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:04.247115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:04.247115+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.247115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:28.609481+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"268'569","reported_seq":1251,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.861542+0000","last_change":"2024-09-12T01:03:01.861542+0000","last_active":"2024-09-12T01:03:01.861542+0000","last_peered":"2024-09-12T01:03:01.861542+0000","last_clean":"2024-09-12T01:03:01.861542+0000","last_became_active":"2024-09-12T00:16:01.051753+0000","last_became_peered":"2024-09-12T00:16:01.051753+0000","last_unstale":"2024-09-12T01:03:01.861542+0000","last_undegraded":"2024-09-12T01:03:01.861542+0000","last_fullsized":"2024-09-12T01:03:01.861542+0000","mapping_epoch":32,"log_start":"268'500","ondisk_log_start":"268'500","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'569","last_scrub_stamp":"2024-09-12T01:03:01.861331+0000","last_deep_scrub":"268'569","last_deep_scrub_stamp":"2024-09-12T01:03:01.861331+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.861331+0000","objects_scrubbed":11,"log_size":69,"log_dups_size":500,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:48.337067+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93866,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1568,"num_read_kb":2666,"num_write":2048,"num_write_kb":1877,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":508024,"num_omap_keys":1152,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.556003+0000","last_change":"2024-09-12T01:03:02.555774+0000","last_active":"2024-09-12T01:03:02.556003+0000","last_peered":"2024-09-12T01:03:02.556003+0000","last_clean":"2024-09-12T01:03:02.556003+0000","last_became_active":"2024-09-12T00:16:03.099491+0000","last_became_peered":"2024-09-12T00:16:03.099491+0000","last_unstale":"2024-09-12T01:03:02.556003+0000","last_undegraded":"2024-09-12T01:03:02.556003+0000","last_fullsized":"2024-09-12T01:03:02.556003+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:02.555464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:02.555464+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.555464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:31.132662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"268'115","reported_seq":619,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.606620+0000","last_change":"2024-09-12T01:03:21.606441+0000","last_active":"2024-09-12T01:03:21.606620+0000","last_peered":"2024-09-12T01:03:21.606620+0000","last_clean":"2024-09-12T01:03:21.606620+0000","last_became_active":"2024-09-12T00:16:05.099975+0000","last_became_peered":"2024-09-12T00:16:05.099975+0000","last_unstale":"2024-09-12T01:03:21.606620+0000","last_undegraded":"2024-09-12T01:03:21.606620+0000","last_fullsized":"2024-09-12T01:03:21.606620+0000","mapping_epoch":36,"log_start":"268'101","ondisk_log_start":"268'101","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-12T01:03:21.606224+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-12T01:03:21.606224+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.606224+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":101,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:41.692200+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":92,"num_read_kb":90,"num_write":249,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"268'516","reported_seq":2251,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.037511+0000","last_change":"2024-09-12T01:02:55.037253+0000","last_active":"2024-09-12T01:02:55.037511+0000","last_peered":"2024-09-12T01:02:55.037511+0000","last_clean":"2024-09-12T01:02:55.037511+0000","last_became_active":"2024-09-12T00:15:57.019345+0000","last_became_peered":"2024-09-12T00:15:57.019345+0000","last_unstale":"2024-09-12T01:02:55.037511+0000","last_undegraded":"2024-09-12T01:02:55.037511+0000","last_fullsized":"2024-09-12T01:02:55.037511+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'516","last_scrub_stamp":"2024-09-12T01:02:55.037012+0000","last_deep_scrub":"268'516","last_deep_scrub_stamp":"2024-09-12T01:02:55.037012+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.037012+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":500,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:43.360929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2840,"num_read_kb":2674,"num_write":601,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2992,"num_omap_keys":12,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"268'351","reported_seq":997,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.075786+0000","last_change":"2024-09-12T01:02:48.075635+0000","last_active":"2024-09-12T01:02:48.075786+0000","last_peered":"2024-09-12T01:02:48.075786+0000","last_clean":"2024-09-12T01:02:48.075786+0000","last_became_active":"2024-09-12T00:15:55.064444+0000","last_became_peered":"2024-09-12T00:15:55.064444+0000","last_unstale":"2024-09-12T01:02:48.075786+0000","last_undegraded":"2024-09-12T01:02:48.075786+0000","last_fullsized":"2024-09-12T01:02:48.075786+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'351","last_scrub_stamp":"2024-09-12T01:02:48.075374+0000","last_deep_scrub":"268'351","last_deep_scrub_stamp":"2024-09-12T01:02:48.075374+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.075374+0000","objects_scrubbed":7,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:20.154477+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6340294,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":472,"num_read_kb":45788,"num_write":1017,"num_write_kb":51853,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":542,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.584086+0000","last_change":"2024-09-12T01:02:57.583864+0000","last_active":"2024-09-12T01:02:57.584086+0000","last_peered":"2024-09-12T01:02:57.584086+0000","last_clean":"2024-09-12T01:02:57.584086+0000","last_became_active":"2024-09-12T00:15:40.093718+0000","last_became_peered":"2024-09-12T00:15:40.093718+0000","last_unstale":"2024-09-12T01:02:57.584086+0000","last_undegraded":"2024-09-12T01:02:57.584086+0000","last_fullsized":"2024-09-12T01:02:57.584086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:57.583651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:57.583651+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.583651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:24.058214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001992522,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":507,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.571465+0000","last_change":"2024-09-12T01:02:56.571338+0000","last_active":"2024-09-12T01:02:56.571465+0000","last_peered":"2024-09-12T01:02:56.571465+0000","last_clean":"2024-09-12T01:02:56.571465+0000","last_became_active":"2024-09-12T00:15:59.041390+0000","last_became_peered":"2024-09-12T00:15:59.041390+0000","last_unstale":"2024-09-12T01:02:56.571465+0000","last_undegraded":"2024-09-12T01:02:56.571465+0000","last_fullsized":"2024-09-12T01:02:56.571465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:56.571111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:56.571111+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.571111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:00.193486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"268'163","reported_seq":738,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.191657+0000","last_change":"2024-09-12T01:03:05.191543+0000","last_active":"2024-09-12T01:03:05.191657+0000","last_peered":"2024-09-12T01:03:05.191657+0000","last_clean":"2024-09-12T01:03:05.191657+0000","last_became_active":"2024-09-12T00:16:01.050630+0000","last_became_peered":"2024-09-12T00:16:01.050630+0000","last_unstale":"2024-09-12T01:03:05.191657+0000","last_undegraded":"2024-09-12T01:03:05.191657+0000","last_fullsized":"2024-09-12T01:03:05.191657+0000","mapping_epoch":32,"log_start":"265'100","ondisk_log_start":"265'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'163","last_scrub_stamp":"2024-09-12T01:03:05.191433+0000","last_deep_scrub":"268'163","last_deep_scrub_stamp":"2024-09-12T01:03:05.191433+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.191433+0000","objects_scrubbed":8,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:08.125461+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":205,"num_read_kb":196,"num_write":136,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"268'798","reported_seq":2736,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.261963+0000","last_change":"2024-09-12T01:03:07.261963+0000","last_active":"2024-09-12T01:03:07.261963+0000","last_peered":"2024-09-12T01:03:07.261963+0000","last_clean":"2024-09-12T01:03:07.261963+0000","last_became_active":"2024-09-12T00:16:03.104125+0000","last_became_peered":"2024-09-12T00:16:03.104125+0000","last_unstale":"2024-09-12T01:03:07.261963+0000","last_undegraded":"2024-09-12T01:03:07.261963+0000","last_fullsized":"2024-09-12T01:03:07.261963+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'798","last_scrub_stamp":"2024-09-12T01:03:07.261772+0000","last_deep_scrub":"268'798","last_deep_scrub_stamp":"2024-09-12T01:03:07.261772+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.261772+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:32.205899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"268'118","reported_seq":632,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.940076+0000","last_change":"2024-09-12T01:03:11.939925+0000","last_active":"2024-09-12T01:03:11.940076+0000","last_peered":"2024-09-12T01:03:11.940076+0000","last_clean":"2024-09-12T01:03:11.940076+0000","last_became_active":"2024-09-12T00:16:05.114695+0000","last_became_peered":"2024-09-12T00:16:05.114695+0000","last_unstale":"2024-09-12T01:03:11.940076+0000","last_undegraded":"2024-09-12T01:03:11.940076+0000","last_fullsized":"2024-09-12T01:03:11.940076+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'118","last_scrub_stamp":"2024-09-12T01:03:11.939705+0000","last_deep_scrub":"268'118","last_deep_scrub_stamp":"2024-09-12T01:03:11.939705+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.939705+0000","objects_scrubbed":5,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:54.343129+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1115,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":147,"num_read_kb":134,"num_write":263,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":64,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"268'788","reported_seq":2361,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.186009+0000","last_change":"2024-09-12T01:02:55.186009+0000","last_active":"2024-09-12T01:02:55.186009+0000","last_peered":"2024-09-12T01:02:55.186009+0000","last_clean":"2024-09-12T01:02:55.186009+0000","last_became_active":"2024-09-12T00:15:57.027778+0000","last_became_peered":"2024-09-12T00:15:57.027778+0000","last_unstale":"2024-09-12T01:02:55.186009+0000","last_undegraded":"2024-09-12T01:02:55.186009+0000","last_fullsized":"2024-09-12T01:02:55.186009+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'788","last_scrub_stamp":"2024-09-12T01:02:55.185823+0000","last_deep_scrub":"268'788","last_deep_scrub_stamp":"2024-09-12T01:02:55.185823+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.185823+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":700,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:34.413708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3889,"num_read_kb":3532,"num_write":1033,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"268'413","reported_seq":1115,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.220812+0000","last_change":"2024-09-12T01:02:47.220555+0000","last_active":"2024-09-12T01:02:47.220812+0000","last_peered":"2024-09-12T01:02:47.220812+0000","last_clean":"2024-09-12T01:02:47.220812+0000","last_became_active":"2024-09-12T00:15:55.048610+0000","last_became_peered":"2024-09-12T00:15:55.048610+0000","last_unstale":"2024-09-12T01:02:47.220812+0000","last_undegraded":"2024-09-12T01:02:47.220812+0000","last_fullsized":"2024-09-12T01:02:47.220812+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'413","last_scrub_stamp":"2024-09-12T01:02:47.220177+0000","last_deep_scrub":"268'413","last_deep_scrub_stamp":"2024-09-12T01:02:47.220177+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.220177+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:09.862325+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":433395,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":696,"num_read_kb":32495,"num_write":1308,"num_write_kb":43441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":540,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.251879+0000","last_change":"2024-09-12T01:02:46.251707+0000","last_active":"2024-09-12T01:02:46.251879+0000","last_peered":"2024-09-12T01:02:46.251879+0000","last_clean":"2024-09-12T01:02:46.251879+0000","last_became_active":"2024-09-12T00:15:40.660718+0000","last_became_peered":"2024-09-12T00:15:40.660718+0000","last_unstale":"2024-09-12T01:02:46.251879+0000","last_undegraded":"2024-09-12T01:02:46.251879+0000","last_fullsized":"2024-09-12T01:02:46.251879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:46.251521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:46.251521+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.251521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:55:45.498343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080064100000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"268'6","reported_seq":998,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:11.598005+0000","last_change":"2024-09-12T01:03:11.597770+0000","last_active":"2024-09-12T01:03:11.598005+0000","last_peered":"2024-09-12T01:03:11.598005+0000","last_clean":"2024-09-12T01:03:11.598005+0000","last_became_active":"2024-09-12T00:15:59.022598+0000","last_became_peered":"2024-09-12T00:15:59.022598+0000","last_unstale":"2024-09-12T01:03:11.598005+0000","last_undegraded":"2024-09-12T01:03:11.598005+0000","last_fullsized":"2024-09-12T01:03:11.598005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'6","last_scrub_stamp":"2024-09-12T01:03:11.597536+0000","last_deep_scrub":"268'6","last_deep_scrub_stamp":"2024-09-12T01:03:11.597536+0000","last_clean_scrub_stamp":"2024-09-12T01:03:11.597536+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:23.814626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":729,"num_read_kb":1194,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"268'117","reported_seq":675,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:17.581145+0000","last_change":"2024-09-12T01:03:17.580915+0000","last_active":"2024-09-12T01:03:17.581145+0000","last_peered":"2024-09-12T01:03:17.581145+0000","last_clean":"2024-09-12T01:03:17.581145+0000","last_became_active":"2024-09-12T00:16:01.061378+0000","last_became_peered":"2024-09-12T00:16:01.061378+0000","last_unstale":"2024-09-12T01:03:17.581145+0000","last_undegraded":"2024-09-12T01:03:17.581145+0000","last_fullsized":"2024-09-12T01:03:17.581145+0000","mapping_epoch":32,"log_start":"268'100","ondisk_log_start":"268'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'117","last_scrub_stamp":"2024-09-12T01:03:17.580694+0000","last_deep_scrub":"268'117","last_deep_scrub_stamp":"2024-09-12T01:03:17.580694+0000","last_clean_scrub_stamp":"2024-09-12T01:03:17.580694+0000","objects_scrubbed":6,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:37.530726+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":124,"num_write":88,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"268'816","reported_seq":4455,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.478966+0000","last_change":"2024-09-12T01:03:13.478711+0000","last_active":"2024-09-12T01:03:13.478966+0000","last_peered":"2024-09-12T01:03:13.478966+0000","last_clean":"2024-09-12T01:03:13.478966+0000","last_became_active":"2024-09-12T00:16:03.097533+0000","last_became_peered":"2024-09-12T00:16:03.097533+0000","last_unstale":"2024-09-12T01:03:13.478966+0000","last_undegraded":"2024-09-12T01:03:13.478966+0000","last_fullsized":"2024-09-12T01:03:13.478966+0000","mapping_epoch":34,"log_start":"268'800","ondisk_log_start":"268'800","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'816","last_scrub_stamp":"2024-09-12T01:03:13.478485+0000","last_deep_scrub":"268'816","last_deep_scrub_stamp":"2024-09-12T01:03:13.478485+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.478485+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:54.004043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"268'168","reported_seq":674,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.623147+0000","last_change":"2024-09-12T01:03:22.623147+0000","last_active":"2024-09-12T01:03:22.623147+0000","last_peered":"2024-09-12T01:03:22.623147+0000","last_clean":"2024-09-12T01:03:22.623147+0000","last_became_active":"2024-09-12T00:16:05.110012+0000","last_became_peered":"2024-09-12T00:16:05.110012+0000","last_unstale":"2024-09-12T01:03:22.623147+0000","last_undegraded":"2024-09-12T01:03:22.623147+0000","last_fullsized":"2024-09-12T01:03:22.623147+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'168","last_scrub_stamp":"2024-09-12T01:03:22.622954+0000","last_deep_scrub":"268'168","last_deep_scrub_stamp":"2024-09-12T01:03:22.622954+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.622954+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:28.531402+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":113,"num_read_kb":112,"num_write":392,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"268'380","reported_seq":1841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.497732+0000","last_change":"2024-09-12T01:02:46.497640+0000","last_active":"2024-09-12T01:02:46.497732+0000","last_peered":"2024-09-12T01:02:46.497732+0000","last_clean":"2024-09-12T01:02:46.497732+0000","last_became_active":"2024-09-12T00:15:57.024399+0000","last_became_peered":"2024-09-12T00:15:57.024399+0000","last_unstale":"2024-09-12T01:02:46.497732+0000","last_undegraded":"2024-09-12T01:02:46.497732+0000","last_fullsized":"2024-09-12T01:02:46.497732+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'380","last_scrub_stamp":"2024-09-12T01:02:46.497554+0000","last_deep_scrub":"268'380","last_deep_scrub_stamp":"2024-09-12T01:02:46.497554+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.497554+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:56.056557+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2040,"num_read_kb":1940,"num_write":430,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"268'339","reported_seq":991,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.295768+0000","last_change":"2024-09-12T01:02:51.295542+0000","last_active":"2024-09-12T01:02:51.295768+0000","last_peered":"2024-09-12T01:02:51.295768+0000","last_clean":"2024-09-12T01:02:51.295768+0000","last_became_active":"2024-09-12T00:15:55.064782+0000","last_became_peered":"2024-09-12T00:15:55.064782+0000","last_unstale":"2024-09-12T01:02:51.295768+0000","last_undegraded":"2024-09-12T01:02:51.295768+0000","last_fullsized":"2024-09-12T01:02:51.295768+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'339","last_scrub_stamp":"2024-09-12T01:02:51.295109+0000","last_deep_scrub":"268'339","last_deep_scrub_stamp":"2024-09-12T01:02:51.295109+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.295109+0000","objects_scrubbed":7,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:28.870116+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2054932,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":492,"num_read_kb":4021,"num_write":1062,"num_write_kb":34802,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":541,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.634503+0000","last_change":"2024-09-12T01:02:50.634341+0000","last_active":"2024-09-12T01:02:50.634503+0000","last_peered":"2024-09-12T01:02:50.634503+0000","last_clean":"2024-09-12T01:02:50.634503+0000","last_became_active":"2024-09-12T00:15:40.663617+0000","last_became_peered":"2024-09-12T00:15:40.663617+0000","last_unstale":"2024-09-12T01:02:50.634503+0000","last_undegraded":"2024-09-12T01:02:50.634503+0000","last_fullsized":"2024-09-12T01:02:50.634503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:50.634154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:50.634154+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.634154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:09.526825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002428801,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":514,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.197315+0000","last_change":"2024-09-12T01:03:03.197315+0000","last_active":"2024-09-12T01:03:03.197315+0000","last_peered":"2024-09-12T01:03:03.197315+0000","last_clean":"2024-09-12T01:03:03.197315+0000","last_became_active":"2024-09-12T00:15:59.039777+0000","last_became_peered":"2024-09-12T00:15:59.039777+0000","last_unstale":"2024-09-12T01:03:03.197315+0000","last_undegraded":"2024-09-12T01:03:03.197315+0000","last_fullsized":"2024-09-12T01:03:03.197315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:03.197128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:03.197128+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.197128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.560737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"268'757","reported_seq":1490,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.503071+0000","last_change":"2024-09-12T01:02:59.502826+0000","last_active":"2024-09-12T01:02:59.503071+0000","last_peered":"2024-09-12T01:02:59.503071+0000","last_clean":"2024-09-12T01:02:59.503071+0000","last_became_active":"2024-09-12T00:16:01.051967+0000","last_became_peered":"2024-09-12T00:16:01.051967+0000","last_unstale":"2024-09-12T01:02:59.503071+0000","last_undegraded":"2024-09-12T01:02:59.503071+0000","last_fullsized":"2024-09-12T01:02:59.503071+0000","mapping_epoch":32,"log_start":"268'700","ondisk_log_start":"268'700","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'757","last_scrub_stamp":"2024-09-12T01:02:59.502579+0000","last_deep_scrub":"268'757","last_deep_scrub_stamp":"2024-09-12T01:02:59.502579+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.502579+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:00.575310+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138756,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1351,"num_read_kb":3224,"num_write":1110,"num_write_kb":922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:16.354025+0000","last_change":"2024-09-12T01:03:16.353870+0000","last_active":"2024-09-12T01:03:16.354025+0000","last_peered":"2024-09-12T01:03:16.354025+0000","last_clean":"2024-09-12T01:03:16.354025+0000","last_became_active":"2024-09-12T00:16:03.091920+0000","last_became_peered":"2024-09-12T00:16:03.091920+0000","last_unstale":"2024-09-12T01:03:16.354025+0000","last_undegraded":"2024-09-12T01:03:16.354025+0000","last_fullsized":"2024-09-12T01:03:16.354025+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:16.353684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:16.353684+0000","last_clean_scrub_stamp":"2024-09-12T01:03:16.353684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:25.336831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"268'141","reported_seq":674,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.561334+0000","last_change":"2024-09-12T01:03:12.561204+0000","last_active":"2024-09-12T01:03:12.561334+0000","last_peered":"2024-09-12T01:03:12.561334+0000","last_clean":"2024-09-12T01:03:12.561334+0000","last_became_active":"2024-09-12T00:16:05.112774+0000","last_became_peered":"2024-09-12T00:16:05.112774+0000","last_unstale":"2024-09-12T01:03:12.561334+0000","last_undegraded":"2024-09-12T01:03:12.561334+0000","last_fullsized":"2024-09-12T01:03:12.561334+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'141","last_scrub_stamp":"2024-09-12T01:03:12.561023+0000","last_deep_scrub":"268'141","last_deep_scrub_stamp":"2024-09-12T01:03:12.561023+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.561023+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:48.581308+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":264,"num_read_kb":230,"num_write":341,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"268'115","reported_seq":685,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.318998+0000","last_change":"2024-09-12T01:03:22.318860+0000","last_active":"2024-09-12T01:03:22.318998+0000","last_peered":"2024-09-12T01:03:22.318998+0000","last_clean":"2024-09-12T01:03:22.318998+0000","last_became_active":"2024-09-12T00:16:05.097548+0000","last_became_peered":"2024-09-12T00:16:05.097548+0000","last_unstale":"2024-09-12T01:03:22.318998+0000","last_undegraded":"2024-09-12T01:03:22.318998+0000","last_fullsized":"2024-09-12T01:03:22.318998+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-12T01:03:22.318681+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-12T01:03:22.318681+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.318681+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:22.176966+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":186,"num_read_kb":184,"num_write":255,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"268'855","reported_seq":2482,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.620835+0000","last_change":"2024-09-12T01:02:55.620835+0000","last_active":"2024-09-12T01:02:55.620835+0000","last_peered":"2024-09-12T01:02:55.620835+0000","last_clean":"2024-09-12T01:02:55.620835+0000","last_became_active":"2024-09-12T00:15:57.024237+0000","last_became_peered":"2024-09-12T00:15:57.024237+0000","last_unstale":"2024-09-12T01:02:55.620835+0000","last_undegraded":"2024-09-12T01:02:55.620835+0000","last_fullsized":"2024-09-12T01:02:55.620835+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'855","last_scrub_stamp":"2024-09-12T01:02:55.620655+0000","last_deep_scrub":"268'855","last_deep_scrub_stamp":"2024-09-12T01:02:55.620655+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.620655+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:46:41.671381+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4086,"num_read_kb":3684,"num_write":1101,"num_write_kb":403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"268'295","reported_seq":945,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.550626+0000","last_change":"2024-09-12T01:02:56.550626+0000","last_active":"2024-09-12T01:02:56.550626+0000","last_peered":"2024-09-12T01:02:56.550626+0000","last_clean":"2024-09-12T01:02:56.550626+0000","last_became_active":"2024-09-12T00:16:26.420272+0000","last_became_peered":"2024-09-12T00:16:26.420272+0000","last_unstale":"2024-09-12T01:02:56.550626+0000","last_undegraded":"2024-09-12T01:02:56.550626+0000","last_fullsized":"2024-09-12T01:02:56.550626+0000","mapping_epoch":39,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'295","last_scrub_stamp":"2024-09-12T01:02:56.550382+0000","last_deep_scrub":"268'295","last_deep_scrub_stamp":"2024-09-12T01:02:56.550382+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.550382+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:32.566018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":213277,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":414,"num_read_kb":13074,"num_write":956,"num_write_kb":25707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,0],"acting":[3,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"268'4","reported_seq":986,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.145180+0000","last_change":"2024-09-12T01:03:03.145180+0000","last_active":"2024-09-12T01:03:03.145180+0000","last_peered":"2024-09-12T01:03:03.145180+0000","last_clean":"2024-09-12T01:03:03.145180+0000","last_became_active":"2024-09-12T00:15:59.039169+0000","last_became_peered":"2024-09-12T00:15:59.039169+0000","last_unstale":"2024-09-12T01:03:03.145180+0000","last_undegraded":"2024-09-12T01:03:03.145180+0000","last_fullsized":"2024-09-12T01:03:03.145180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'4","last_scrub_stamp":"2024-09-12T01:03:03.144984+0000","last_deep_scrub":"268'4","last_deep_scrub_stamp":"2024-09-12T01:03:03.144984+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.144984+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:54.544211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":727,"num_read_kb":725,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"268'291","reported_seq":877,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.230273+0000","last_change":"2024-09-12T01:03:09.230273+0000","last_active":"2024-09-12T01:03:09.230273+0000","last_peered":"2024-09-12T01:03:09.230273+0000","last_clean":"2024-09-12T01:03:09.230273+0000","last_became_active":"2024-09-12T00:16:01.066524+0000","last_became_peered":"2024-09-12T00:16:01.066524+0000","last_unstale":"2024-09-12T01:03:09.230273+0000","last_undegraded":"2024-09-12T01:03:09.230273+0000","last_fullsized":"2024-09-12T01:03:09.230273+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'291","last_scrub_stamp":"2024-09-12T01:03:09.230064+0000","last_deep_scrub":"268'291","last_deep_scrub_stamp":"2024-09-12T01:03:09.230064+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.230064+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:35.110694+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43678,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":477,"num_read_kb":1068,"num_write":390,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.896686+0000","last_change":"2024-09-12T01:03:05.896686+0000","last_active":"2024-09-12T01:03:05.896686+0000","last_peered":"2024-09-12T01:03:05.896686+0000","last_clean":"2024-09-12T01:03:05.896686+0000","last_became_active":"2024-09-12T00:16:03.069399+0000","last_became_peered":"2024-09-12T00:16:03.069399+0000","last_unstale":"2024-09-12T01:03:05.896686+0000","last_undegraded":"2024-09-12T01:03:05.896686+0000","last_fullsized":"2024-09-12T01:03:05.896686+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:05.896501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:05.896501+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.896501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:45.361950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"268'132","reported_seq":631,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.923979+0000","last_change":"2024-09-12T01:03:12.923979+0000","last_active":"2024-09-12T01:03:12.923979+0000","last_peered":"2024-09-12T01:03:12.923979+0000","last_clean":"2024-09-12T01:03:12.923979+0000","last_became_active":"2024-09-12T00:16:05.102118+0000","last_became_peered":"2024-09-12T00:16:05.102118+0000","last_unstale":"2024-09-12T01:03:12.923979+0000","last_undegraded":"2024-09-12T01:03:12.923979+0000","last_fullsized":"2024-09-12T01:03:12.923979+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'132","last_scrub_stamp":"2024-09-12T01:03:12.923802+0000","last_deep_scrub":"268'132","last_deep_scrub_stamp":"2024-09-12T01:03:12.923802+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.923802+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:59.417375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":111,"num_write":330,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"268'498","reported_seq":2230,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.226442+0000","last_change":"2024-09-12T01:02:53.226442+0000","last_active":"2024-09-12T01:02:53.226442+0000","last_peered":"2024-09-12T01:02:53.226442+0000","last_clean":"2024-09-12T01:02:53.226442+0000","last_became_active":"2024-09-12T00:15:57.031322+0000","last_became_peered":"2024-09-12T00:15:57.031322+0000","last_unstale":"2024-09-12T01:02:53.226442+0000","last_undegraded":"2024-09-12T01:02:53.226442+0000","last_fullsized":"2024-09-12T01:02:53.226442+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'498","last_scrub_stamp":"2024-09-12T01:02:53.226262+0000","last_deep_scrub":"268'498","last_deep_scrub_stamp":"2024-09-12T01:02:53.226262+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.226262+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:59.880724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2797,"num_read_kb":2639,"num_write":567,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2040,"num_omap_keys":8,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"268'457","reported_seq":1173,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.555317+0000","last_change":"2024-09-12T01:02:46.555317+0000","last_active":"2024-09-12T01:02:46.555317+0000","last_peered":"2024-09-12T01:02:46.555317+0000","last_clean":"2024-09-12T01:02:46.555317+0000","last_became_active":"2024-09-12T00:15:55.065964+0000","last_became_peered":"2024-09-12T00:15:55.065964+0000","last_unstale":"2024-09-12T01:02:46.555317+0000","last_undegraded":"2024-09-12T01:02:46.555317+0000","last_fullsized":"2024-09-12T01:02:46.555317+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'457","last_scrub_stamp":"2024-09-12T01:02:46.555204+0000","last_deep_scrub":"268'457","last_deep_scrub_stamp":"2024-09-12T01:02:46.555204+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.555204+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:12.493482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5768209,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":905,"num_read_kb":8759,"num_write":1307,"num_write_kb":27844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":511,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.258104+0000","last_change":"2024-09-12T01:03:05.258104+0000","last_active":"2024-09-12T01:03:05.258104+0000","last_peered":"2024-09-12T01:03:05.258104+0000","last_clean":"2024-09-12T01:03:05.258104+0000","last_became_active":"2024-09-12T00:15:59.043146+0000","last_became_peered":"2024-09-12T00:15:59.043146+0000","last_unstale":"2024-09-12T01:03:05.258104+0000","last_undegraded":"2024-09-12T01:03:05.258104+0000","last_fullsized":"2024-09-12T01:03:05.258104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:05.257925+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:05.257925+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.257925+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:40.514412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"268'52","reported_seq":569,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.329141+0000","last_change":"2024-09-12T01:03:12.329141+0000","last_active":"2024-09-12T01:03:12.329141+0000","last_peered":"2024-09-12T01:03:12.329141+0000","last_clean":"2024-09-12T01:03:12.329141+0000","last_became_active":"2024-09-12T00:16:01.055002+0000","last_became_peered":"2024-09-12T00:16:01.055002+0000","last_unstale":"2024-09-12T01:03:12.329141+0000","last_undegraded":"2024-09-12T01:03:12.329141+0000","last_fullsized":"2024-09-12T01:03:12.329141+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'52","last_scrub_stamp":"2024-09-12T01:03:12.328903+0000","last_deep_scrub":"268'52","last_deep_scrub_stamp":"2024-09-12T01:03:12.328903+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.328903+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:35.047822+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.554003+0000","last_change":"2024-09-12T01:03:08.554003+0000","last_active":"2024-09-12T01:03:08.554003+0000","last_peered":"2024-09-12T01:03:08.554003+0000","last_clean":"2024-09-12T01:03:08.554003+0000","last_became_active":"2024-09-12T00:16:03.107695+0000","last_became_peered":"2024-09-12T00:16:03.107695+0000","last_unstale":"2024-09-12T01:03:08.554003+0000","last_undegraded":"2024-09-12T01:03:08.554003+0000","last_fullsized":"2024-09-12T01:03:08.554003+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:08.553798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:08.553798+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.553798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:15.552997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"268'246","reported_seq":807,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:14.231868+0000","last_change":"2024-09-12T01:03:14.231702+0000","last_active":"2024-09-12T01:03:14.231868+0000","last_peered":"2024-09-12T01:03:14.231868+0000","last_clean":"2024-09-12T01:03:14.231868+0000","last_became_active":"2024-09-12T00:16:05.106742+0000","last_became_peered":"2024-09-12T00:16:05.106742+0000","last_unstale":"2024-09-12T01:03:14.231868+0000","last_undegraded":"2024-09-12T01:03:14.231868+0000","last_fullsized":"2024-09-12T01:03:14.231868+0000","mapping_epoch":36,"log_start":"268'200","ondisk_log_start":"268'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'246","last_scrub_stamp":"2024-09-12T01:03:14.231510+0000","last_deep_scrub":"268'246","last_deep_scrub_stamp":"2024-09-12T01:03:14.231510+0000","last_clean_scrub_stamp":"2024-09-12T01:03:14.231510+0000","objects_scrubbed":1,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:02.610669+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":438,"num_read_kb":396,"num_write":482,"num_write_kb":134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"268'397","reported_seq":1842,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.275301+0000","last_change":"2024-09-12T01:02:52.275301+0000","last_active":"2024-09-12T01:02:52.275301+0000","last_peered":"2024-09-12T01:02:52.275301+0000","last_clean":"2024-09-12T01:02:52.275301+0000","last_became_active":"2024-09-12T00:15:57.015397+0000","last_became_peered":"2024-09-12T00:15:57.015397+0000","last_unstale":"2024-09-12T01:02:52.275301+0000","last_undegraded":"2024-09-12T01:02:52.275301+0000","last_fullsized":"2024-09-12T01:02:52.275301+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'397","last_scrub_stamp":"2024-09-12T01:02:52.275074+0000","last_deep_scrub":"268'397","last_deep_scrub_stamp":"2024-09-12T01:02:52.275074+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.275074+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:02.312499+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2041,"num_read_kb":1937,"num_write":459,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"268'320","reported_seq":955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.632454+0000","last_change":"2024-09-12T01:02:49.632454+0000","last_active":"2024-09-12T01:02:49.632454+0000","last_peered":"2024-09-12T01:02:49.632454+0000","last_clean":"2024-09-12T01:02:49.632454+0000","last_became_active":"2024-09-12T00:15:55.062990+0000","last_became_peered":"2024-09-12T00:15:55.062990+0000","last_unstale":"2024-09-12T01:02:49.632454+0000","last_undegraded":"2024-09-12T01:02:49.632454+0000","last_fullsized":"2024-09-12T01:02:49.632454+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-09-12T01:02:49.632190+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-09-12T01:02:49.632190+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.632190+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:54.520313+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838529,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":442,"num_read_kb":9756,"num_write":997,"num_write_kb":17415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.583322+0000","last_change":"2024-09-12T01:03:01.583322+0000","last_active":"2024-09-12T01:03:01.583322+0000","last_peered":"2024-09-12T01:03:01.583322+0000","last_clean":"2024-09-12T01:03:01.583322+0000","last_became_active":"2024-09-12T00:15:59.029162+0000","last_became_peered":"2024-09-12T00:15:59.029162+0000","last_unstale":"2024-09-12T01:03:01.583322+0000","last_undegraded":"2024-09-12T01:03:01.583322+0000","last_fullsized":"2024-09-12T01:03:01.583322+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:01.583122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:01.583122+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.583122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:27.595470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"268'287","reported_seq":883,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.940481+0000","last_change":"2024-09-12T01:03:04.940481+0000","last_active":"2024-09-12T01:03:04.940481+0000","last_peered":"2024-09-12T01:03:04.940481+0000","last_clean":"2024-09-12T01:03:04.940481+0000","last_became_active":"2024-09-12T00:16:01.059517+0000","last_became_peered":"2024-09-12T00:16:01.059517+0000","last_unstale":"2024-09-12T01:03:04.940481+0000","last_undegraded":"2024-09-12T01:03:04.940481+0000","last_fullsized":"2024-09-12T01:03:04.940481+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'287","last_scrub_stamp":"2024-09-12T01:03:04.940283+0000","last_deep_scrub":"268'287","last_deep_scrub_stamp":"2024-09-12T01:03:04.940283+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.940283+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:24.528106+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51265,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":460,"num_read_kb":973,"num_write":358,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":501,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.224169+0000","last_change":"2024-09-12T01:03:05.224169+0000","last_active":"2024-09-12T01:03:05.224169+0000","last_peered":"2024-09-12T01:03:05.224169+0000","last_clean":"2024-09-12T01:03:05.224169+0000","last_became_active":"2024-09-12T00:16:03.103630+0000","last_became_peered":"2024-09-12T00:16:03.103630+0000","last_unstale":"2024-09-12T01:03:05.224169+0000","last_undegraded":"2024-09-12T01:03:05.224169+0000","last_fullsized":"2024-09-12T01:03:05.224169+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:05.223967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:05.223967+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.223967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:01.031493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"268'168","reported_seq":690,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:32.538071+0000","last_change":"2024-09-12T01:03:32.537841+0000","last_active":"2024-09-12T01:03:32.538071+0000","last_peered":"2024-09-12T01:03:32.538071+0000","last_clean":"2024-09-12T01:03:32.538071+0000","last_became_active":"2024-09-12T00:16:05.109745+0000","last_became_peered":"2024-09-12T00:16:05.109745+0000","last_unstale":"2024-09-12T01:03:32.538071+0000","last_undegraded":"2024-09-12T01:03:32.538071+0000","last_fullsized":"2024-09-12T01:03:32.538071+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'168","last_scrub_stamp":"2024-09-12T01:03:32.537604+0000","last_deep_scrub":"268'168","last_deep_scrub_stamp":"2024-09-12T01:03:32.537604+0000","last_clean_scrub_stamp":"2024-09-12T01:03:32.537604+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:16.574263+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":853,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":175,"num_read_kb":175,"num_write":406,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"268'423","reported_seq":1868,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.679246+0000","last_change":"2024-09-12T01:02:53.679246+0000","last_active":"2024-09-12T01:02:53.679246+0000","last_peered":"2024-09-12T01:02:53.679246+0000","last_clean":"2024-09-12T01:02:53.679246+0000","last_became_active":"2024-09-12T00:15:57.028820+0000","last_became_peered":"2024-09-12T00:15:57.028820+0000","last_unstale":"2024-09-12T01:02:53.679246+0000","last_undegraded":"2024-09-12T01:02:53.679246+0000","last_fullsized":"2024-09-12T01:02:53.679246+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'423","last_scrub_stamp":"2024-09-12T01:02:53.679070+0000","last_deep_scrub":"268'423","last_deep_scrub_stamp":"2024-09-12T01:02:53.679070+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.679070+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:24.203431+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2332,"num_read_kb":2186,"num_write":478,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1006,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"268'304","reported_seq":963,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.317898+0000","last_change":"2024-09-12T01:02:51.317898+0000","last_active":"2024-09-12T01:02:51.317898+0000","last_peered":"2024-09-12T01:02:51.317898+0000","last_clean":"2024-09-12T01:02:51.317898+0000","last_became_active":"2024-09-12T00:15:55.054712+0000","last_became_peered":"2024-09-12T00:15:55.054712+0000","last_unstale":"2024-09-12T01:02:51.317898+0000","last_undegraded":"2024-09-12T01:02:51.317898+0000","last_fullsized":"2024-09-12T01:02:51.317898+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'304","last_scrub_stamp":"2024-09-12T01:02:51.317700+0000","last_deep_scrub":"268'304","last_deep_scrub_stamp":"2024-09-12T01:02:51.317700+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.317700+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:15.787375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25680,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":448,"num_read_kb":100896,"num_write":1015,"num_write_kb":52799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:13.612965+0000","last_change":"2024-09-12T01:03:13.612965+0000","last_active":"2024-09-12T01:03:13.612965+0000","last_peered":"2024-09-12T01:03:13.612965+0000","last_clean":"2024-09-12T01:03:13.612965+0000","last_became_active":"2024-09-12T00:15:59.028885+0000","last_became_peered":"2024-09-12T00:15:59.028885+0000","last_unstale":"2024-09-12T01:03:13.612965+0000","last_undegraded":"2024-09-12T01:03:13.612965+0000","last_fullsized":"2024-09-12T01:03:13.612965+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:13.612747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:13.612747+0000","last_clean_scrub_stamp":"2024-09-12T01:03:13.612747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:15.856950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"268'273","reported_seq":849,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.600517+0000","last_change":"2024-09-12T01:03:09.600517+0000","last_active":"2024-09-12T01:03:09.600517+0000","last_peered":"2024-09-12T01:03:09.600517+0000","last_clean":"2024-09-12T01:03:09.600517+0000","last_became_active":"2024-09-12T00:16:01.050654+0000","last_became_peered":"2024-09-12T00:16:01.050654+0000","last_unstale":"2024-09-12T01:03:09.600517+0000","last_undegraded":"2024-09-12T01:03:09.600517+0000","last_fullsized":"2024-09-12T01:03:09.600517+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'273","last_scrub_stamp":"2024-09-12T01:03:09.600297+0000","last_deep_scrub":"268'273","last_deep_scrub_stamp":"2024-09-12T01:03:09.600297+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.600297+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:17.048401+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48048,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":440,"num_read_kb":1024,"num_write":358,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.863748+0000","last_change":"2024-09-12T01:03:06.863748+0000","last_active":"2024-09-12T01:03:06.863748+0000","last_peered":"2024-09-12T01:03:06.863748+0000","last_clean":"2024-09-12T01:03:06.863748+0000","last_became_active":"2024-09-12T00:16:03.088929+0000","last_became_peered":"2024-09-12T00:16:03.088929+0000","last_unstale":"2024-09-12T01:03:06.863748+0000","last_undegraded":"2024-09-12T01:03:06.863748+0000","last_fullsized":"2024-09-12T01:03:06.863748+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:06.863544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:06.863544+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.863544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:09:13.284749+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"268'422","reported_seq":2052,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.544072+0000","last_change":"2024-09-12T01:03:07.543894+0000","last_active":"2024-09-12T01:03:07.544072+0000","last_peered":"2024-09-12T01:03:07.544072+0000","last_clean":"2024-09-12T01:03:07.544072+0000","last_became_active":"2024-09-12T00:15:57.039919+0000","last_became_peered":"2024-09-12T00:15:57.039919+0000","last_unstale":"2024-09-12T01:03:07.544072+0000","last_undegraded":"2024-09-12T01:03:07.544072+0000","last_fullsized":"2024-09-12T01:03:07.544072+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'422","last_scrub_stamp":"2024-09-12T01:03:07.543688+0000","last_deep_scrub":"268'422","last_deep_scrub_stamp":"2024-09-12T01:03:07.543688+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.543688+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:37.918345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2299,"num_read_kb":2203,"num_write":481,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"268'299","reported_seq":908,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.357075+0000","last_change":"2024-09-12T01:02:48.357075+0000","last_active":"2024-09-12T01:02:48.357075+0000","last_peered":"2024-09-12T01:02:48.357075+0000","last_clean":"2024-09-12T01:02:48.357075+0000","last_became_active":"2024-09-12T00:15:55.079264+0000","last_became_peered":"2024-09-12T00:15:55.079264+0000","last_unstale":"2024-09-12T01:02:48.357075+0000","last_undegraded":"2024-09-12T01:02:48.357075+0000","last_fullsized":"2024-09-12T01:02:48.357075+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'299","last_scrub_stamp":"2024-09-12T01:02:48.356731+0000","last_deep_scrub":"268'299","last_deep_scrub_stamp":"2024-09-12T01:02:48.356731+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.356731+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:01.723914+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311670,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":380,"num_read_kb":14024,"num_write":902,"num_write_kb":16591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.166848+0000","last_change":"2024-09-12T01:03:04.166848+0000","last_active":"2024-09-12T01:03:04.166848+0000","last_peered":"2024-09-12T01:03:04.166848+0000","last_clean":"2024-09-12T01:03:04.166848+0000","last_became_active":"2024-09-12T00:15:59.039042+0000","last_became_peered":"2024-09-12T00:15:59.039042+0000","last_unstale":"2024-09-12T01:03:04.166848+0000","last_undegraded":"2024-09-12T01:03:04.166848+0000","last_fullsized":"2024-09-12T01:03:04.166848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:04.166656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:04.166656+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.166656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:47.847682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"268'500","reported_seq":1141,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.253325+0000","last_change":"2024-09-12T01:03:08.253187+0000","last_active":"2024-09-12T01:03:08.253325+0000","last_peered":"2024-09-12T01:03:08.253325+0000","last_clean":"2024-09-12T01:03:08.253325+0000","last_became_active":"2024-09-12T00:16:01.062625+0000","last_became_peered":"2024-09-12T00:16:01.062625+0000","last_unstale":"2024-09-12T01:03:08.253325+0000","last_undegraded":"2024-09-12T01:03:08.253325+0000","last_fullsized":"2024-09-12T01:03:08.253325+0000","mapping_epoch":32,"log_start":"268'400","ondisk_log_start":"268'400","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'500","last_scrub_stamp":"2024-09-12T01:03:08.252996+0000","last_deep_scrub":"268'500","last_deep_scrub_stamp":"2024-09-12T01:03:08.252996+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.252996+0000","objects_scrubbed":7,"log_size":100,"log_dups_size":400,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:40.522444+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91700,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":904,"num_read_kb":2175,"num_write":782,"num_write_kb":696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25256,"num_omap_keys":48,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":494,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.547683+0000","last_change":"2024-09-12T01:03:07.547461+0000","last_active":"2024-09-12T01:03:07.547683+0000","last_peered":"2024-09-12T01:03:07.547683+0000","last_clean":"2024-09-12T01:03:07.547683+0000","last_became_active":"2024-09-12T00:16:03.087980+0000","last_became_peered":"2024-09-12T00:16:03.087980+0000","last_unstale":"2024-09-12T01:03:07.547683+0000","last_undegraded":"2024-09-12T01:03:07.547683+0000","last_fullsized":"2024-09-12T01:03:07.547683+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:07.547227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:07.547227+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.547227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:14.697460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"268'131","reported_seq":638,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:23.664635+0000","last_change":"2024-09-12T01:03:23.664635+0000","last_active":"2024-09-12T01:03:23.664635+0000","last_peered":"2024-09-12T01:03:23.664635+0000","last_clean":"2024-09-12T01:03:23.664635+0000","last_became_active":"2024-09-12T00:16:05.098424+0000","last_became_peered":"2024-09-12T00:16:05.098424+0000","last_unstale":"2024-09-12T01:03:23.664635+0000","last_undegraded":"2024-09-12T01:03:23.664635+0000","last_fullsized":"2024-09-12T01:03:23.664635+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'131","last_scrub_stamp":"2024-09-12T01:03:23.664450+0000","last_deep_scrub":"268'131","last_deep_scrub_stamp":"2024-09-12T01:03:23.664450+0000","last_clean_scrub_stamp":"2024-09-12T01:03:23.664450+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:04.081604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":165,"num_write":285,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"268'842","reported_seq":2439,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.169938+0000","last_change":"2024-09-12T01:02:56.169938+0000","last_active":"2024-09-12T01:02:56.169938+0000","last_peered":"2024-09-12T01:02:56.169938+0000","last_clean":"2024-09-12T01:02:56.169938+0000","last_became_active":"2024-09-12T00:15:57.022709+0000","last_became_peered":"2024-09-12T00:15:57.022709+0000","last_unstale":"2024-09-12T01:02:56.169938+0000","last_undegraded":"2024-09-12T01:02:56.169938+0000","last_fullsized":"2024-09-12T01:02:56.169938+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'842","last_scrub_stamp":"2024-09-12T01:02:56.169713+0000","last_deep_scrub":"268'842","last_deep_scrub_stamp":"2024-09-12T01:02:56.169713+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.169713+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":800,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:31.117935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3967,"num_read_kb":3571,"num_write":1117,"num_write_kb":414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1379,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"268'292","reported_seq":941,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.308689+0000","last_change":"2024-09-12T01:02:50.308689+0000","last_active":"2024-09-12T01:02:50.308689+0000","last_peered":"2024-09-12T01:02:50.308689+0000","last_clean":"2024-09-12T01:02:50.308689+0000","last_became_active":"2024-09-12T00:15:55.064940+0000","last_became_peered":"2024-09-12T00:15:55.064940+0000","last_unstale":"2024-09-12T01:02:50.308689+0000","last_undegraded":"2024-09-12T01:02:50.308689+0000","last_fullsized":"2024-09-12T01:02:50.308689+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'292","last_scrub_stamp":"2024-09-12T01:02:50.308457+0000","last_deep_scrub":"268'292","last_deep_scrub_stamp":"2024-09-12T01:02:50.308457+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.308457+0000","objects_scrubbed":6,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:18.717527+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1909911,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":2788,"num_write":1025,"num_write_kb":39220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":506,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.545283+0000","last_change":"2024-09-12T01:03:04.545155+0000","last_active":"2024-09-12T01:03:04.545283+0000","last_peered":"2024-09-12T01:03:04.545283+0000","last_clean":"2024-09-12T01:03:04.545283+0000","last_became_active":"2024-09-12T00:15:59.034648+0000","last_became_peered":"2024-09-12T00:15:59.034648+0000","last_unstale":"2024-09-12T01:03:04.545283+0000","last_undegraded":"2024-09-12T01:03:04.545283+0000","last_fullsized":"2024-09-12T01:03:04.545283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:04.544977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:04.544977+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.544977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:15.428165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"268'289","reported_seq":887,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:21.600067+0000","last_change":"2024-09-12T01:03:21.599928+0000","last_active":"2024-09-12T01:03:21.600067+0000","last_peered":"2024-09-12T01:03:21.600067+0000","last_clean":"2024-09-12T01:03:21.600067+0000","last_became_active":"2024-09-12T00:16:01.046783+0000","last_became_peered":"2024-09-12T00:16:01.046783+0000","last_unstale":"2024-09-12T01:03:21.600067+0000","last_undegraded":"2024-09-12T01:03:21.600067+0000","last_fullsized":"2024-09-12T01:03:21.600067+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'289","last_scrub_stamp":"2024-09-12T01:03:21.599715+0000","last_deep_scrub":"268'289","last_deep_scrub_stamp":"2024-09-12T01:03:21.599715+0000","last_clean_scrub_stamp":"2024-09-12T01:03:21.599715+0000","objects_scrubbed":8,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:04.490478+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45699,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":480,"num_read_kb":1022,"num_write":398,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":495,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:18.603068+0000","last_change":"2024-09-12T01:03:18.602862+0000","last_active":"2024-09-12T01:03:18.603068+0000","last_peered":"2024-09-12T01:03:18.603068+0000","last_clean":"2024-09-12T01:03:18.603068+0000","last_became_active":"2024-09-12T00:16:03.097160+0000","last_became_peered":"2024-09-12T00:16:03.097160+0000","last_unstale":"2024-09-12T01:03:18.603068+0000","last_undegraded":"2024-09-12T01:03:18.603068+0000","last_fullsized":"2024-09-12T01:03:18.603068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:18.602579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:18.602579+0000","last_clean_scrub_stamp":"2024-09-12T01:03:18.602579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:11.353722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"268'215","reported_seq":777,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:30.566931+0000","last_change":"2024-09-12T01:03:30.566931+0000","last_active":"2024-09-12T01:03:30.566931+0000","last_peered":"2024-09-12T01:03:30.566931+0000","last_clean":"2024-09-12T01:03:30.566931+0000","last_became_active":"2024-09-12T00:16:05.101338+0000","last_became_peered":"2024-09-12T00:16:05.101338+0000","last_unstale":"2024-09-12T01:03:30.566931+0000","last_undegraded":"2024-09-12T01:03:30.566931+0000","last_fullsized":"2024-09-12T01:03:30.566931+0000","mapping_epoch":36,"log_start":"268'201","ondisk_log_start":"268'201","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'215","last_scrub_stamp":"2024-09-12T01:03:30.566693+0000","last_deep_scrub":"268'215","last_deep_scrub_stamp":"2024-09-12T01:03:30.566693+0000","last_clean_scrub_stamp":"2024-09-12T01:03:30.566693+0000","objects_scrubbed":5,"log_size":14,"log_dups_size":201,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:00.382434+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1401,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":396,"num_read_kb":348,"num_write":595,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"268'506","reported_seq":2097,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.685588+0000","last_change":"2024-09-12T01:02:54.685414+0000","last_active":"2024-09-12T01:02:54.685588+0000","last_peered":"2024-09-12T01:02:54.685588+0000","last_clean":"2024-09-12T01:02:54.685588+0000","last_became_active":"2024-09-12T00:15:57.034257+0000","last_became_peered":"2024-09-12T00:15:57.034257+0000","last_unstale":"2024-09-12T01:02:54.685588+0000","last_undegraded":"2024-09-12T01:02:54.685588+0000","last_fullsized":"2024-09-12T01:02:54.685588+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'506","last_scrub_stamp":"2024-09-12T01:02:54.685233+0000","last_deep_scrub":"268'506","last_deep_scrub_stamp":"2024-09-12T01:02:54.685233+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.685233+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":400,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:00.855007+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2760,"num_read_kb":2552,"num_write":653,"num_write_kb":183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"268'359","reported_seq":1109,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:46.174248+0000","last_change":"2024-09-12T01:02:46.174196+0000","last_active":"2024-09-12T01:02:46.174248+0000","last_peered":"2024-09-12T01:02:46.174248+0000","last_clean":"2024-09-12T01:02:46.174248+0000","last_became_active":"2024-09-12T00:15:55.035741+0000","last_became_peered":"2024-09-12T00:15:55.035741+0000","last_unstale":"2024-09-12T01:02:46.174248+0000","last_undegraded":"2024-09-12T01:02:46.174248+0000","last_fullsized":"2024-09-12T01:02:46.174248+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T01:02:46.174096+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T01:02:46.174096+0000","last_clean_scrub_stamp":"2024-09-12T01:02:46.174096+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:23.160018+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":693,"num_read_kb":41169,"num_write":1152,"num_write_kb":26675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.627283+0000","last_change":"2024-09-12T01:03:00.627134+0000","last_active":"2024-09-12T01:03:00.627283+0000","last_peered":"2024-09-12T01:03:00.627283+0000","last_clean":"2024-09-12T01:03:00.627283+0000","last_became_active":"2024-09-12T00:15:59.044761+0000","last_became_peered":"2024-09-12T00:15:59.044761+0000","last_unstale":"2024-09-12T01:03:00.627283+0000","last_undegraded":"2024-09-12T01:03:00.627283+0000","last_fullsized":"2024-09-12T01:03:00.627283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:00.626946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:00.626946+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.626946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:42.833587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"268'298","reported_seq":887,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:10.202117+0000","last_change":"2024-09-12T01:03:10.201939+0000","last_active":"2024-09-12T01:03:10.202117+0000","last_peered":"2024-09-12T01:03:10.202117+0000","last_clean":"2024-09-12T01:03:10.202117+0000","last_became_active":"2024-09-12T00:16:01.052731+0000","last_became_peered":"2024-09-12T00:16:01.052731+0000","last_unstale":"2024-09-12T01:03:10.202117+0000","last_undegraded":"2024-09-12T01:03:10.202117+0000","last_fullsized":"2024-09-12T01:03:10.202117+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'298","last_scrub_stamp":"2024-09-12T01:03:10.201739+0000","last_deep_scrub":"268'298","last_deep_scrub_stamp":"2024-09-12T01:03:10.201739+0000","last_clean_scrub_stamp":"2024-09-12T01:03:10.201739+0000","objects_scrubbed":6,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:36.025785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50253,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":1058,"num_write":380,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":498,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.924910+0000","last_change":"2024-09-12T01:03:08.924910+0000","last_active":"2024-09-12T01:03:08.924910+0000","last_peered":"2024-09-12T01:03:08.924910+0000","last_clean":"2024-09-12T01:03:08.924910+0000","last_became_active":"2024-09-12T00:16:03.080825+0000","last_became_peered":"2024-09-12T00:16:03.080825+0000","last_unstale":"2024-09-12T01:03:08.924910+0000","last_undegraded":"2024-09-12T01:03:08.924910+0000","last_fullsized":"2024-09-12T01:03:08.924910+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:08.924731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:08.924731+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.924731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:25.806325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"268'158","reported_seq":665,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:29.572592+0000","last_change":"2024-09-12T01:03:29.572592+0000","last_active":"2024-09-12T01:03:29.572592+0000","last_peered":"2024-09-12T01:03:29.572592+0000","last_clean":"2024-09-12T01:03:29.572592+0000","last_became_active":"2024-09-12T00:16:05.098180+0000","last_became_peered":"2024-09-12T00:16:05.098180+0000","last_unstale":"2024-09-12T01:03:29.572592+0000","last_undegraded":"2024-09-12T01:03:29.572592+0000","last_fullsized":"2024-09-12T01:03:29.572592+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'158","last_scrub_stamp":"2024-09-12T01:03:29.572401+0000","last_deep_scrub":"268'158","last_deep_scrub_stamp":"2024-09-12T01:03:29.572401+0000","last_clean_scrub_stamp":"2024-09-12T01:03:29.572401+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:02.677911+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":105,"num_read_kb":95,"num_write":348,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"268'342","reported_seq":1674,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.129910+0000","last_change":"2024-09-12T01:02:57.129621+0000","last_active":"2024-09-12T01:02:57.129910+0000","last_peered":"2024-09-12T01:02:57.129910+0000","last_clean":"2024-09-12T01:02:57.129910+0000","last_became_active":"2024-09-12T00:15:57.039580+0000","last_became_peered":"2024-09-12T00:15:57.039580+0000","last_unstale":"2024-09-12T01:02:57.129910+0000","last_undegraded":"2024-09-12T01:02:57.129910+0000","last_fullsized":"2024-09-12T01:02:57.129910+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'342","last_scrub_stamp":"2024-09-12T01:02:57.129353+0000","last_deep_scrub":"268'342","last_deep_scrub_stamp":"2024-09-12T01:02:57.129353+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.129353+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:16.119165+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1750,"num_read_kb":1664,"num_write":383,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"268'336","reported_seq":960,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.234545+0000","last_change":"2024-09-12T01:02:54.234365+0000","last_active":"2024-09-12T01:02:54.234545+0000","last_peered":"2024-09-12T01:02:54.234545+0000","last_clean":"2024-09-12T01:02:54.234545+0000","last_became_active":"2024-09-12T00:15:55.042851+0000","last_became_peered":"2024-09-12T00:15:55.042851+0000","last_unstale":"2024-09-12T01:02:54.234545+0000","last_undegraded":"2024-09-12T01:02:54.234545+0000","last_fullsized":"2024-09-12T01:02:54.234545+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'336","last_scrub_stamp":"2024-09-12T01:02:54.233965+0000","last_deep_scrub":"268'336","last_deep_scrub_stamp":"2024-09-12T01:02:54.233965+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.233965+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:37.476942+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1919007,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":413,"num_read_kb":20803,"num_write":1107,"num_write_kb":57854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":510,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:09.223216+0000","last_change":"2024-09-12T01:03:09.223088+0000","last_active":"2024-09-12T01:03:09.223216+0000","last_peered":"2024-09-12T01:03:09.223216+0000","last_clean":"2024-09-12T01:03:09.223216+0000","last_became_active":"2024-09-12T00:15:59.048632+0000","last_became_peered":"2024-09-12T00:15:59.048632+0000","last_unstale":"2024-09-12T01:03:09.223216+0000","last_undegraded":"2024-09-12T01:03:09.223216+0000","last_fullsized":"2024-09-12T01:03:09.223216+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:09.222897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:09.222897+0000","last_clean_scrub_stamp":"2024-09-12T01:03:09.222897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:54.272835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"268'92","reported_seq":634,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:22.598105+0000","last_change":"2024-09-12T01:03:22.598105+0000","last_active":"2024-09-12T01:03:22.598105+0000","last_peered":"2024-09-12T01:03:22.598105+0000","last_clean":"2024-09-12T01:03:22.598105+0000","last_became_active":"2024-09-12T00:16:01.045565+0000","last_became_peered":"2024-09-12T00:16:01.045565+0000","last_unstale":"2024-09-12T01:03:22.598105+0000","last_undegraded":"2024-09-12T01:03:22.598105+0000","last_fullsized":"2024-09-12T01:03:22.598105+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'92","last_scrub_stamp":"2024-09-12T01:03:22.597904+0000","last_deep_scrub":"268'92","last_deep_scrub_stamp":"2024-09-12T01:03:22.597904+0000","last_clean_scrub_stamp":"2024-09-12T01:03:22.597904+0000","objects_scrubbed":8,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:28.342106+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":122,"num_read_kb":116,"num_write":132,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"268'786","reported_seq":4439,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.534845+0000","last_change":"2024-09-12T01:03:06.534702+0000","last_active":"2024-09-12T01:03:06.534845+0000","last_peered":"2024-09-12T01:03:06.534845+0000","last_clean":"2024-09-12T01:03:06.534845+0000","last_became_active":"2024-09-12T00:16:03.091506+0000","last_became_peered":"2024-09-12T00:16:03.091506+0000","last_unstale":"2024-09-12T01:03:06.534845+0000","last_undegraded":"2024-09-12T01:03:06.534845+0000","last_fullsized":"2024-09-12T01:03:06.534845+0000","mapping_epoch":34,"log_start":"268'700","ondisk_log_start":"268'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'786","last_scrub_stamp":"2024-09-12T01:03:06.534512+0000","last_deep_scrub":"268'786","last_deep_scrub_stamp":"2024-09-12T01:03:06.534512+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.534512+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:02.777021+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"268'115","reported_seq":631,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:28.588926+0000","last_change":"2024-09-12T01:03:28.588926+0000","last_active":"2024-09-12T01:03:28.588926+0000","last_peered":"2024-09-12T01:03:28.588926+0000","last_clean":"2024-09-12T01:03:28.588926+0000","last_became_active":"2024-09-12T00:16:05.101500+0000","last_became_peered":"2024-09-12T00:16:05.101500+0000","last_unstale":"2024-09-12T01:03:28.588926+0000","last_undegraded":"2024-09-12T01:03:28.588926+0000","last_fullsized":"2024-09-12T01:03:28.588926+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'115","last_scrub_stamp":"2024-09-12T01:03:28.588847+0000","last_deep_scrub":"268'115","last_deep_scrub_stamp":"2024-09-12T01:03:28.588847+0000","last_clean_scrub_stamp":"2024-09-12T01:03:28.588847+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:53.839494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":264,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"268'1104","reported_seq":2647,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.661907+0000","last_change":"2024-09-12T01:02:59.661665+0000","last_active":"2024-09-12T01:02:59.661907+0000","last_peered":"2024-09-12T01:02:59.661907+0000","last_clean":"2024-09-12T01:02:59.661907+0000","last_became_active":"2024-09-12T00:15:57.056507+0000","last_became_peered":"2024-09-12T00:15:57.056507+0000","last_unstale":"2024-09-12T01:02:59.661907+0000","last_undegraded":"2024-09-12T01:02:59.661907+0000","last_fullsized":"2024-09-12T01:02:59.661907+0000","mapping_epoch":28,"log_start":"268'1000","ondisk_log_start":"268'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1104","last_scrub_stamp":"2024-09-12T01:02:59.661368+0000","last_deep_scrub":"268'1104","last_deep_scrub_stamp":"2024-09-12T01:02:59.661368+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.661368+0000","objects_scrubbed":5,"log_size":104,"log_dups_size":1000,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:37.501861+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5000,"num_read_kb":4445,"num_write":1493,"num_write_kb":599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"268'355","reported_seq":1219,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:47.211403+0000","last_change":"2024-09-12T01:02:47.211133+0000","last_active":"2024-09-12T01:02:47.211403+0000","last_peered":"2024-09-12T01:02:47.211403+0000","last_clean":"2024-09-12T01:02:47.211403+0000","last_became_active":"2024-09-12T00:15:55.051336+0000","last_became_peered":"2024-09-12T00:15:55.051336+0000","last_unstale":"2024-09-12T01:02:47.211403+0000","last_undegraded":"2024-09-12T01:02:47.211403+0000","last_fullsized":"2024-09-12T01:02:47.211403+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'355","last_scrub_stamp":"2024-09-12T01:02:47.210757+0000","last_deep_scrub":"268'355","last_deep_scrub_stamp":"2024-09-12T01:02:47.210757+0000","last_clean_scrub_stamp":"2024-09-12T01:02:47.210757+0000","objects_scrubbed":8,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:14.508041+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174753,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1007,"num_read_kb":8590,"num_write":1279,"num_write_kb":12738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.157441+0000","last_change":"2024-09-12T01:03:01.157220+0000","last_active":"2024-09-12T01:03:01.157441+0000","last_peered":"2024-09-12T01:03:01.157441+0000","last_clean":"2024-09-12T01:03:01.157441+0000","last_became_active":"2024-09-12T00:15:59.046538+0000","last_became_peered":"2024-09-12T00:15:59.046538+0000","last_unstale":"2024-09-12T01:03:01.157441+0000","last_undegraded":"2024-09-12T01:03:01.157441+0000","last_fullsized":"2024-09-12T01:03:01.157441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:01.157005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:01.157005+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.157005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:05.303663+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"268'336","reported_seq":951,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.576715+0000","last_change":"2024-09-12T01:03:05.576715+0000","last_active":"2024-09-12T01:03:05.576715+0000","last_peered":"2024-09-12T01:03:05.576715+0000","last_clean":"2024-09-12T01:03:05.576715+0000","last_became_active":"2024-09-12T00:16:01.051648+0000","last_became_peered":"2024-09-12T00:16:01.051648+0000","last_unstale":"2024-09-12T01:03:05.576715+0000","last_undegraded":"2024-09-12T01:03:05.576715+0000","last_fullsized":"2024-09-12T01:03:05.576715+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'336","last_scrub_stamp":"2024-09-12T01:03:05.576460+0000","last_deep_scrub":"268'336","last_deep_scrub_stamp":"2024-09-12T01:03:05.576460+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.576460+0000","objects_scrubbed":11,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:44.168273+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50218,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":538,"num_read_kb":1138,"num_write":432,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:20.329374+0000","last_change":"2024-09-12T01:03:20.329374+0000","last_active":"2024-09-12T01:03:20.329374+0000","last_peered":"2024-09-12T01:03:20.329374+0000","last_clean":"2024-09-12T01:03:20.329374+0000","last_became_active":"2024-09-12T00:16:03.086333+0000","last_became_peered":"2024-09-12T00:16:03.086333+0000","last_unstale":"2024-09-12T01:03:20.329374+0000","last_undegraded":"2024-09-12T01:03:20.329374+0000","last_fullsized":"2024-09-12T01:03:20.329374+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:20.329196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:20.329196+0000","last_clean_scrub_stamp":"2024-09-12T01:03:20.329196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:26.619682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"268'129","reported_seq":639,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:12.316540+0000","last_change":"2024-09-12T01:03:12.316540+0000","last_active":"2024-09-12T01:03:12.316540+0000","last_peered":"2024-09-12T01:03:12.316540+0000","last_clean":"2024-09-12T01:03:12.316540+0000","last_became_active":"2024-09-12T00:16:05.107284+0000","last_became_peered":"2024-09-12T00:16:05.107284+0000","last_unstale":"2024-09-12T01:03:12.316540+0000","last_undegraded":"2024-09-12T01:03:12.316540+0000","last_fullsized":"2024-09-12T01:03:12.316540+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'129","last_scrub_stamp":"2024-09-12T01:03:12.316341+0000","last_deep_scrub":"268'129","last_deep_scrub_stamp":"2024-09-12T01:03:12.316341+0000","last_clean_scrub_stamp":"2024-09-12T01:03:12.316341+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:28.418713+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":420,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":114,"num_write":286,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"268'491","reported_seq":2126,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:57.653655+0000","last_change":"2024-09-12T01:02:57.653502+0000","last_active":"2024-09-12T01:02:57.653655+0000","last_peered":"2024-09-12T01:02:57.653655+0000","last_clean":"2024-09-12T01:02:57.653655+0000","last_became_active":"2024-09-12T00:15:57.021526+0000","last_became_peered":"2024-09-12T00:15:57.021526+0000","last_unstale":"2024-09-12T01:02:57.653655+0000","last_undegraded":"2024-09-12T01:02:57.653655+0000","last_fullsized":"2024-09-12T01:02:57.653655+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'491","last_scrub_stamp":"2024-09-12T01:02:57.653321+0000","last_deep_scrub":"268'491","last_deep_scrub_stamp":"2024-09-12T01:02:57.653321+0000","last_clean_scrub_stamp":"2024-09-12T01:02:57.653321+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:22.307720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2702,"num_read_kb":2545,"num_write":554,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"268'350","reported_seq":1039,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.624753+0000","last_change":"2024-09-12T01:02:54.624581+0000","last_active":"2024-09-12T01:02:54.624753+0000","last_peered":"2024-09-12T01:02:54.624753+0000","last_clean":"2024-09-12T01:02:54.624753+0000","last_became_active":"2024-09-12T00:15:55.052503+0000","last_became_peered":"2024-09-12T00:15:55.052503+0000","last_unstale":"2024-09-12T01:02:54.624753+0000","last_undegraded":"2024-09-12T01:02:54.624753+0000","last_fullsized":"2024-09-12T01:02:54.624753+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T01:02:54.624378+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T01:02:54.624378+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.624378+0000","objects_scrubbed":3,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:26.809590+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174814,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":563,"num_read_kb":52648,"num_write":1035,"num_write_kb":43222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:03.551087+0000","last_change":"2024-09-12T01:03:03.551002+0000","last_active":"2024-09-12T01:03:03.551087+0000","last_peered":"2024-09-12T01:03:03.551087+0000","last_clean":"2024-09-12T01:03:03.551087+0000","last_became_active":"2024-09-12T00:15:59.024564+0000","last_became_peered":"2024-09-12T00:15:59.024564+0000","last_unstale":"2024-09-12T01:03:03.551087+0000","last_undegraded":"2024-09-12T01:03:03.551087+0000","last_fullsized":"2024-09-12T01:03:03.551087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:03.550913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:03.550913+0000","last_clean_scrub_stamp":"2024-09-12T01:03:03.550913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:02.329399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"268'253","reported_seq":841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:15.338971+0000","last_change":"2024-09-12T01:03:15.338971+0000","last_active":"2024-09-12T01:03:15.338971+0000","last_peered":"2024-09-12T01:03:15.338971+0000","last_clean":"2024-09-12T01:03:15.338971+0000","last_became_active":"2024-09-12T00:16:01.051612+0000","last_became_peered":"2024-09-12T00:16:01.051612+0000","last_unstale":"2024-09-12T01:03:15.338971+0000","last_undegraded":"2024-09-12T01:03:15.338971+0000","last_fullsized":"2024-09-12T01:03:15.338971+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'253","last_scrub_stamp":"2024-09-12T01:03:15.338659+0000","last_deep_scrub":"268'253","last_deep_scrub_stamp":"2024-09-12T01:03:15.338659+0000","last_clean_scrub_stamp":"2024-09-12T01:03:15.338659+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:04.996974+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46385,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":418,"num_read_kb":940,"num_write":334,"num_write_kb":263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.564199+0000","last_change":"2024-09-12T01:03:25.564199+0000","last_active":"2024-09-12T01:03:25.564199+0000","last_peered":"2024-09-12T01:03:25.564199+0000","last_clean":"2024-09-12T01:03:25.564199+0000","last_became_active":"2024-09-12T00:16:03.095016+0000","last_became_peered":"2024-09-12T00:16:03.095016+0000","last_unstale":"2024-09-12T01:03:25.564199+0000","last_undegraded":"2024-09-12T01:03:25.564199+0000","last_fullsized":"2024-09-12T01:03:25.564199+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:25.564018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:25.564018+0000","last_clean_scrub_stamp":"2024-09-12T01:03:25.564018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:40.464867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"268'137","reported_seq":676,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:25.722423+0000","last_change":"2024-09-12T01:03:25.722423+0000","last_active":"2024-09-12T01:03:25.722423+0000","last_peered":"2024-09-12T01:03:25.722423+0000","last_clean":"2024-09-12T01:03:25.722423+0000","last_became_active":"2024-09-12T00:16:05.098796+0000","last_became_peered":"2024-09-12T00:16:05.098796+0000","last_unstale":"2024-09-12T01:03:25.722423+0000","last_undegraded":"2024-09-12T01:03:25.722423+0000","last_fullsized":"2024-09-12T01:03:25.722423+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'137","last_scrub_stamp":"2024-09-12T01:03:25.722226+0000","last_deep_scrub":"268'137","last_deep_scrub_stamp":"2024-09-12T01:03:25.722226+0000","last_clean_scrub_stamp":"2024-09-12T01:03:25.722226+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:56.957492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":964,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":248,"num_read_kb":225,"num_write":347,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"268'418","reported_seq":1971,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.676410+0000","last_change":"2024-09-12T01:02:52.676410+0000","last_active":"2024-09-12T01:02:52.676410+0000","last_peered":"2024-09-12T01:02:52.676410+0000","last_clean":"2024-09-12T01:02:52.676410+0000","last_became_active":"2024-09-12T00:15:57.038127+0000","last_became_peered":"2024-09-12T00:15:57.038127+0000","last_unstale":"2024-09-12T01:02:52.676410+0000","last_undegraded":"2024-09-12T01:02:52.676410+0000","last_fullsized":"2024-09-12T01:02:52.676410+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'418","last_scrub_stamp":"2024-09-12T01:02:52.676192+0000","last_deep_scrub":"268'418","last_deep_scrub_stamp":"2024-09-12T01:02:52.676192+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.676192+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:37:22.108077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2293,"num_read_kb":2185,"num_write":483,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3022,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"268'320","reported_seq":959,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:49.395489+0000","last_change":"2024-09-12T01:02:49.395489+0000","last_active":"2024-09-12T01:02:49.395489+0000","last_peered":"2024-09-12T01:02:49.395489+0000","last_clean":"2024-09-12T01:02:49.395489+0000","last_became_active":"2024-09-12T00:15:55.074964+0000","last_became_peered":"2024-09-12T00:15:55.074964+0000","last_unstale":"2024-09-12T01:02:49.395489+0000","last_undegraded":"2024-09-12T01:02:49.395489+0000","last_fullsized":"2024-09-12T01:02:49.395489+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'320","last_scrub_stamp":"2024-09-12T01:02:49.395237+0000","last_deep_scrub":"268'320","last_deep_scrub_stamp":"2024-09-12T01:02:49.395237+0000","last_clean_scrub_stamp":"2024-09-12T01:02:49.395237+0000","objects_scrubbed":4,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:09.752592+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655970,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":491,"num_read_kb":20129,"num_write":999,"num_write_kb":20535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":508,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.198645+0000","last_change":"2024-09-12T01:03:04.198645+0000","last_active":"2024-09-12T01:03:04.198645+0000","last_peered":"2024-09-12T01:03:04.198645+0000","last_clean":"2024-09-12T01:03:04.198645+0000","last_became_active":"2024-09-12T00:15:59.036492+0000","last_became_peered":"2024-09-12T00:15:59.036492+0000","last_unstale":"2024-09-12T01:03:04.198645+0000","last_undegraded":"2024-09-12T01:03:04.198645+0000","last_fullsized":"2024-09-12T01:03:04.198645+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:04.198465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:04.198465+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.198465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:22.027363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"268'249","reported_seq":819,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:07.271646+0000","last_change":"2024-09-12T01:03:07.271501+0000","last_active":"2024-09-12T01:03:07.271646+0000","last_peered":"2024-09-12T01:03:07.271646+0000","last_clean":"2024-09-12T01:03:07.271646+0000","last_became_active":"2024-09-12T00:16:01.050746+0000","last_became_peered":"2024-09-12T00:16:01.050746+0000","last_unstale":"2024-09-12T01:03:07.271646+0000","last_undegraded":"2024-09-12T01:03:07.271646+0000","last_fullsized":"2024-09-12T01:03:07.271646+0000","mapping_epoch":32,"log_start":"268'200","ondisk_log_start":"268'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'249","last_scrub_stamp":"2024-09-12T01:03:07.271298+0000","last_deep_scrub":"268'249","last_deep_scrub_stamp":"2024-09-12T01:03:07.271298+0000","last_clean_scrub_stamp":"2024-09-12T01:03:07.271298+0000","objects_scrubbed":3,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:45.855519+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41847,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":412,"num_read_kb":978,"num_write":338,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":503,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:27.548023+0000","last_change":"2024-09-12T01:03:27.547797+0000","last_active":"2024-09-12T01:03:27.548023+0000","last_peered":"2024-09-12T01:03:27.548023+0000","last_clean":"2024-09-12T01:03:27.548023+0000","last_became_active":"2024-09-12T00:16:03.099890+0000","last_became_peered":"2024-09-12T00:16:03.099890+0000","last_unstale":"2024-09-12T01:03:27.548023+0000","last_undegraded":"2024-09-12T01:03:27.548023+0000","last_fullsized":"2024-09-12T01:03:27.548023+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:27.547584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:27.547584+0000","last_clean_scrub_stamp":"2024-09-12T01:03:27.547584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:14.776930+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"268'191","reported_seq":1686,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:31.588583+0000","last_change":"2024-09-12T01:03:31.588583+0000","last_active":"2024-09-12T01:03:31.588583+0000","last_peered":"2024-09-12T01:03:31.588583+0000","last_clean":"2024-09-12T01:03:31.588583+0000","last_became_active":"2024-09-12T00:16:05.113207+0000","last_became_peered":"2024-09-12T00:16:05.113207+0000","last_unstale":"2024-09-12T01:03:31.588583+0000","last_undegraded":"2024-09-12T01:03:31.588583+0000","last_fullsized":"2024-09-12T01:03:31.588583+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'191","last_scrub_stamp":"2024-09-12T01:03:31.588376+0000","last_deep_scrub":"268'191","last_deep_scrub_stamp":"2024-09-12T01:03:31.588376+0000","last_clean_scrub_stamp":"2024-09-12T01:03:31.588376+0000","objects_scrubbed":5,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:09.293036+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1270,"num_read_kb":1246,"num_write":444,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"268'926","reported_seq":2674,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.619463+0000","last_change":"2024-09-12T01:02:56.619463+0000","last_active":"2024-09-12T01:02:56.619463+0000","last_peered":"2024-09-12T01:02:56.619463+0000","last_clean":"2024-09-12T01:02:56.619463+0000","last_became_active":"2024-09-12T00:15:57.012136+0000","last_became_peered":"2024-09-12T00:15:57.012136+0000","last_unstale":"2024-09-12T01:02:56.619463+0000","last_undegraded":"2024-09-12T01:02:56.619463+0000","last_fullsized":"2024-09-12T01:02:56.619463+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'926","last_scrub_stamp":"2024-09-12T01:02:56.619272+0000","last_deep_scrub":"268'926","last_deep_scrub_stamp":"2024-09-12T01:02:56.619272+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.619272+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":900,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:34.737350+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4477,"num_read_kb":4059,"num_write":1259,"num_write_kb":498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1011,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"268'359","reported_seq":1004,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.367738+0000","last_change":"2024-09-12T01:02:50.367417+0000","last_active":"2024-09-12T01:02:50.367738+0000","last_peered":"2024-09-12T01:02:50.367738+0000","last_clean":"2024-09-12T01:02:50.367738+0000","last_became_active":"2024-09-12T00:15:55.079005+0000","last_became_peered":"2024-09-12T00:15:55.079005+0000","last_unstale":"2024-09-12T01:02:50.367738+0000","last_undegraded":"2024-09-12T01:02:50.367738+0000","last_fullsized":"2024-09-12T01:02:50.367738+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T01:02:50.366971+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T01:02:50.366971+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.366971+0000","objects_scrubbed":10,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:04.196096+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525370,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":531,"num_read_kb":476,"num_write":1171,"num_write_kb":40462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"268'2","reported_seq":512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.241251+0000","last_change":"2024-09-12T01:03:08.241251+0000","last_active":"2024-09-12T01:03:08.241251+0000","last_peered":"2024-09-12T01:03:08.241251+0000","last_clean":"2024-09-12T01:03:08.241251+0000","last_became_active":"2024-09-12T00:15:59.039674+0000","last_became_peered":"2024-09-12T00:15:59.039674+0000","last_unstale":"2024-09-12T01:03:08.241251+0000","last_undegraded":"2024-09-12T01:03:08.241251+0000","last_fullsized":"2024-09-12T01:03:08.241251+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'2","last_scrub_stamp":"2024-09-12T01:03:08.241064+0000","last_deep_scrub":"268'2","last_deep_scrub_stamp":"2024-09-12T01:03:08.241064+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.241064+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:41.346192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"268'350","reported_seq":961,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.584868+0000","last_change":"2024-09-12T01:03:19.584713+0000","last_active":"2024-09-12T01:03:19.584868+0000","last_peered":"2024-09-12T01:03:19.584868+0000","last_clean":"2024-09-12T01:03:19.584868+0000","last_became_active":"2024-09-12T00:16:01.051324+0000","last_became_peered":"2024-09-12T00:16:01.051324+0000","last_unstale":"2024-09-12T01:03:19.584868+0000","last_undegraded":"2024-09-12T01:03:19.584868+0000","last_fullsized":"2024-09-12T01:03:19.584868+0000","mapping_epoch":32,"log_start":"268'300","ondisk_log_start":"268'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T01:03:19.584505+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T01:03:19.584505+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.584505+0000","objects_scrubbed":6,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:32.091357+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49632,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":580,"num_read_kb":1323,"num_write":476,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":502,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:19.348005+0000","last_change":"2024-09-12T01:03:19.347866+0000","last_active":"2024-09-12T01:03:19.348005+0000","last_peered":"2024-09-12T01:03:19.348005+0000","last_clean":"2024-09-12T01:03:19.348005+0000","last_became_active":"2024-09-12T00:16:03.099836+0000","last_became_peered":"2024-09-12T00:16:03.099836+0000","last_unstale":"2024-09-12T01:03:19.348005+0000","last_undegraded":"2024-09-12T01:03:19.348005+0000","last_fullsized":"2024-09-12T01:03:19.348005+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:03:19.347683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:03:19.347683+0000","last_clean_scrub_stamp":"2024-09-12T01:03:19.347683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:54.373409+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"268'116","reported_seq":617,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:08.623160+0000","last_change":"2024-09-12T01:03:08.623160+0000","last_active":"2024-09-12T01:03:08.623160+0000","last_peered":"2024-09-12T01:03:08.623160+0000","last_clean":"2024-09-12T01:03:08.623160+0000","last_became_active":"2024-09-12T00:16:05.113231+0000","last_became_peered":"2024-09-12T00:16:05.113231+0000","last_unstale":"2024-09-12T01:03:08.623160+0000","last_undegraded":"2024-09-12T01:03:08.623160+0000","last_fullsized":"2024-09-12T01:03:08.623160+0000","mapping_epoch":36,"log_start":"268'100","ondisk_log_start":"268'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'116","last_scrub_stamp":"2024-09-12T01:03:08.622957+0000","last_deep_scrub":"268'116","last_deep_scrub_stamp":"2024-09-12T01:03:08.622957+0000","last_clean_scrub_stamp":"2024-09-12T01:03:08.622957+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:44.955515+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":663,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":117,"num_read_kb":101,"num_write":263,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"268'812","reported_seq":2408,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.098804+0000","last_change":"2024-09-12T01:02:59.098674+0000","last_active":"2024-09-12T01:02:59.098804+0000","last_peered":"2024-09-12T01:02:59.098804+0000","last_clean":"2024-09-12T01:02:59.098804+0000","last_became_active":"2024-09-12T00:15:57.031161+0000","last_became_peered":"2024-09-12T00:15:57.031161+0000","last_unstale":"2024-09-12T01:02:59.098804+0000","last_undegraded":"2024-09-12T01:02:59.098804+0000","last_fullsized":"2024-09-12T01:02:59.098804+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'812","last_scrub_stamp":"2024-09-12T01:02:59.098486+0000","last_deep_scrub":"268'812","last_deep_scrub_stamp":"2024-09-12T01:02:59.098486+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.098486+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":800,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:40.804950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3882,"num_read_kb":3503,"num_write":1069,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":220,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"268'350","reported_seq":1125,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.589460+0000","last_change":"2024-09-12T01:02:48.589310+0000","last_active":"2024-09-12T01:02:48.589460+0000","last_peered":"2024-09-12T01:02:48.589460+0000","last_clean":"2024-09-12T01:02:48.589460+0000","last_became_active":"2024-09-12T00:15:55.042134+0000","last_became_peered":"2024-09-12T00:15:55.042134+0000","last_unstale":"2024-09-12T01:02:48.589460+0000","last_undegraded":"2024-09-12T01:02:48.589460+0000","last_fullsized":"2024-09-12T01:02:48.589460+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'350","last_scrub_stamp":"2024-09-12T01:02:48.589008+0000","last_deep_scrub":"268'350","last_deep_scrub_stamp":"2024-09-12T01:02:48.589008+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.589008+0000","objects_scrubbed":8,"log_size":50,"log_dups_size":300,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:56.525969+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918005,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":861,"num_read_kb":50816,"num_write":1243,"num_write_kb":44406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"268'404","reported_seq":1867,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.734420+0000","last_change":"2024-09-12T01:02:56.734203+0000","last_active":"2024-09-12T01:02:56.734420+0000","last_peered":"2024-09-12T01:02:56.734420+0000","last_clean":"2024-09-12T01:02:56.734420+0000","last_became_active":"2024-09-12T00:15:57.043013+0000","last_became_peered":"2024-09-12T00:15:57.043013+0000","last_unstale":"2024-09-12T01:02:56.734420+0000","last_undegraded":"2024-09-12T01:02:56.734420+0000","last_fullsized":"2024-09-12T01:02:56.734420+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'404","last_scrub_stamp":"2024-09-12T01:02:56.734008+0000","last_deep_scrub":"268'404","last_deep_scrub_stamp":"2024-09-12T01:02:56.734008+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.734008+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:54.403896+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2106,"num_read_kb":1998,"num_write":459,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"268'302","reported_seq":938,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.702379+0000","last_change":"2024-09-12T01:02:48.702227+0000","last_active":"2024-09-12T01:02:48.702379+0000","last_peered":"2024-09-12T01:02:48.702379+0000","last_clean":"2024-09-12T01:02:48.702379+0000","last_became_active":"2024-09-12T00:15:55.062524+0000","last_became_peered":"2024-09-12T00:15:55.062524+0000","last_unstale":"2024-09-12T01:02:48.702379+0000","last_undegraded":"2024-09-12T01:02:48.702379+0000","last_fullsized":"2024-09-12T01:02:48.702379+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'302","last_scrub_stamp":"2024-09-12T01:02:48.701961+0000","last_deep_scrub":"268'302","last_deep_scrub_stamp":"2024-09-12T01:02:48.701961+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.701961+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:23.572921+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291481,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":18226,"num_write":893,"num_write_kb":43043,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"268'497","reported_seq":2222,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.575417+0000","last_change":"2024-09-12T01:03:06.575277+0000","last_active":"2024-09-12T01:03:06.575417+0000","last_peered":"2024-09-12T01:03:06.575417+0000","last_clean":"2024-09-12T01:03:06.575417+0000","last_became_active":"2024-09-12T00:15:57.018875+0000","last_became_peered":"2024-09-12T00:15:57.018875+0000","last_unstale":"2024-09-12T01:03:06.575417+0000","last_undegraded":"2024-09-12T01:03:06.575417+0000","last_fullsized":"2024-09-12T01:03:06.575417+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'497","last_scrub_stamp":"2024-09-12T01:03:06.575054+0000","last_deep_scrub":"268'497","last_deep_scrub_stamp":"2024-09-12T01:03:06.575054+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.575054+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":400,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:10.216944+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2775,"num_read_kb":2615,"num_write":593,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1776,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"268'360","reported_seq":1019,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.598632+0000","last_change":"2024-09-12T01:02:53.598437+0000","last_active":"2024-09-12T01:02:53.598632+0000","last_peered":"2024-09-12T01:02:53.598632+0000","last_clean":"2024-09-12T01:02:53.598632+0000","last_became_active":"2024-09-12T00:15:55.063603+0000","last_became_peered":"2024-09-12T00:15:55.063603+0000","last_unstale":"2024-09-12T01:02:53.598632+0000","last_undegraded":"2024-09-12T01:02:53.598632+0000","last_fullsized":"2024-09-12T01:02:53.598632+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'360","last_scrub_stamp":"2024-09-12T01:02:53.598203+0000","last_deep_scrub":"268'360","last_deep_scrub_stamp":"2024-09-12T01:02:53.598203+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.598203+0000","objects_scrubbed":7,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:20.298117+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2055186,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":518,"num_read_kb":3291,"num_write":1136,"num_write_kb":12783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"268'394","reported_seq":1810,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:06.506241+0000","last_change":"2024-09-12T01:03:06.505984+0000","last_active":"2024-09-12T01:03:06.506241+0000","last_peered":"2024-09-12T01:03:06.506241+0000","last_clean":"2024-09-12T01:03:06.506241+0000","last_became_active":"2024-09-12T00:15:57.030173+0000","last_became_peered":"2024-09-12T00:15:57.030173+0000","last_unstale":"2024-09-12T01:03:06.506241+0000","last_undegraded":"2024-09-12T01:03:06.506241+0000","last_fullsized":"2024-09-12T01:03:06.506241+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T01:03:06.505753+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T01:03:06.505753+0000","last_clean_scrub_stamp":"2024-09-12T01:03:06.505753+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:29.265131+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2013,"num_read_kb":1910,"num_write":436,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":961,"num_omap_keys":4,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"268'370","reported_seq":1122,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.286524+0000","last_change":"2024-09-12T01:02:52.286233+0000","last_active":"2024-09-12T01:02:52.286524+0000","last_peered":"2024-09-12T01:02:52.286524+0000","last_clean":"2024-09-12T01:02:52.286524+0000","last_became_active":"2024-09-12T00:15:55.068349+0000","last_became_peered":"2024-09-12T00:15:55.068349+0000","last_unstale":"2024-09-12T01:02:52.286524+0000","last_undegraded":"2024-09-12T01:02:52.286524+0000","last_fullsized":"2024-09-12T01:02:52.286524+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'370","last_scrub_stamp":"2024-09-12T01:02:52.285815+0000","last_deep_scrub":"268'370","last_deep_scrub_stamp":"2024-09-12T01:02:52.285815+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.285815+0000","objects_scrubbed":5,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:42.779294+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5530690,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":847,"num_read_kb":11363,"num_write":1205,"num_write_kb":51000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"268'400","reported_seq":1893,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.517401+0000","last_change":"2024-09-12T01:03:04.517091+0000","last_active":"2024-09-12T01:03:04.517401+0000","last_peered":"2024-09-12T01:03:04.517401+0000","last_clean":"2024-09-12T01:03:04.517401+0000","last_became_active":"2024-09-12T00:15:57.037204+0000","last_became_peered":"2024-09-12T00:15:57.037204+0000","last_unstale":"2024-09-12T01:03:04.517401+0000","last_undegraded":"2024-09-12T01:03:04.517401+0000","last_fullsized":"2024-09-12T01:03:04.517401+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'400","last_scrub_stamp":"2024-09-12T01:03:04.516852+0000","last_deep_scrub":"268'400","last_deep_scrub_stamp":"2024-09-12T01:03:04.516852+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.516852+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:17.030355+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2120,"num_read_kb":2017,"num_write":453,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"268'338","reported_seq":982,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:50.070834+0000","last_change":"2024-09-12T01:02:50.070517+0000","last_active":"2024-09-12T01:02:50.070834+0000","last_peered":"2024-09-12T01:02:50.070834+0000","last_clean":"2024-09-12T01:02:50.070834+0000","last_became_active":"2024-09-12T00:15:55.071812+0000","last_became_peered":"2024-09-12T00:15:55.071812+0000","last_unstale":"2024-09-12T01:02:50.070834+0000","last_undegraded":"2024-09-12T01:02:50.070834+0000","last_fullsized":"2024-09-12T01:02:50.070834+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'338","last_scrub_stamp":"2024-09-12T01:02:50.070156+0000","last_deep_scrub":"268'338","last_deep_scrub_stamp":"2024-09-12T01:02:50.070156+0000","last_clean_scrub_stamp":"2024-09-12T01:02:50.070156+0000","objects_scrubbed":6,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:07.290148+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1919077,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":503,"num_read_kb":11487,"num_write":1134,"num_write_kb":34407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"268'584","reported_seq":2275,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.592106+0000","last_change":"2024-09-12T01:02:53.591872+0000","last_active":"2024-09-12T01:02:53.592106+0000","last_peered":"2024-09-12T01:02:53.592106+0000","last_clean":"2024-09-12T01:02:53.592106+0000","last_became_active":"2024-09-12T00:15:57.032818+0000","last_became_peered":"2024-09-12T00:15:57.032818+0000","last_unstale":"2024-09-12T01:02:53.592106+0000","last_undegraded":"2024-09-12T01:02:53.592106+0000","last_fullsized":"2024-09-12T01:02:53.592106+0000","mapping_epoch":28,"log_start":"268'500","ondisk_log_start":"268'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'584","last_scrub_stamp":"2024-09-12T01:02:53.591627+0000","last_deep_scrub":"268'584","last_deep_scrub_stamp":"2024-09-12T01:02:53.591627+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.591627+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:25.471327+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2922,"num_read_kb":2722,"num_write":707,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":468,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"268'345","reported_seq":1030,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.024847+0000","last_change":"2024-09-12T01:02:51.024703+0000","last_active":"2024-09-12T01:02:51.024847+0000","last_peered":"2024-09-12T01:02:51.024847+0000","last_clean":"2024-09-12T01:02:51.024847+0000","last_became_active":"2024-09-12T00:15:55.050781+0000","last_became_peered":"2024-09-12T00:15:55.050781+0000","last_unstale":"2024-09-12T01:02:51.024847+0000","last_undegraded":"2024-09-12T01:02:51.024847+0000","last_fullsized":"2024-09-12T01:02:51.024847+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'345","last_scrub_stamp":"2024-09-12T01:02:51.024453+0000","last_deep_scrub":"268'345","last_deep_scrub_stamp":"2024-09-12T01:02:51.024453+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.024453+0000","objects_scrubbed":7,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:07.021452+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432541,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":494,"num_read_kb":31947,"num_write":1072,"num_write_kb":41212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"268'801","reported_seq":2296,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.033872+0000","last_change":"2024-09-12T01:02:59.033726+0000","last_active":"2024-09-12T01:02:59.033872+0000","last_peered":"2024-09-12T01:02:59.033872+0000","last_clean":"2024-09-12T01:02:59.033872+0000","last_became_active":"2024-09-12T00:15:57.045500+0000","last_became_peered":"2024-09-12T00:15:57.045500+0000","last_unstale":"2024-09-12T01:02:59.033872+0000","last_undegraded":"2024-09-12T01:02:59.033872+0000","last_fullsized":"2024-09-12T01:02:59.033872+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'801","last_scrub_stamp":"2024-09-12T01:02:59.033539+0000","last_deep_scrub":"268'801","last_deep_scrub_stamp":"2024-09-12T01:02:59.033539+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.033539+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:16.520622+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3817,"num_read_kb":3427,"num_write":1098,"num_write_kb":456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"268'312","reported_seq":943,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.668203+0000","last_change":"2024-09-12T01:02:54.668061+0000","last_active":"2024-09-12T01:02:54.668203+0000","last_peered":"2024-09-12T01:02:54.668203+0000","last_clean":"2024-09-12T01:02:54.668203+0000","last_became_active":"2024-09-12T00:15:55.054914+0000","last_became_peered":"2024-09-12T00:15:55.054914+0000","last_unstale":"2024-09-12T01:02:54.668203+0000","last_undegraded":"2024-09-12T01:02:54.668203+0000","last_fullsized":"2024-09-12T01:02:54.668203+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'312","last_scrub_stamp":"2024-09-12T01:02:54.667783+0000","last_deep_scrub":"268'312","last_deep_scrub_stamp":"2024-09-12T01:02:54.667783+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.667783+0000","objects_scrubbed":9,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:58.504933+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262244,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":420,"num_read_kb":50634,"num_write":965,"num_write_kb":37363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"268'819","reported_seq":2521,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.205377+0000","last_change":"2024-09-12T01:02:52.205241+0000","last_active":"2024-09-12T01:02:52.205377+0000","last_peered":"2024-09-12T01:02:52.205377+0000","last_clean":"2024-09-12T01:02:52.205377+0000","last_became_active":"2024-09-12T00:15:57.021622+0000","last_became_peered":"2024-09-12T00:15:57.021622+0000","last_unstale":"2024-09-12T01:02:52.205377+0000","last_undegraded":"2024-09-12T01:02:52.205377+0000","last_fullsized":"2024-09-12T01:02:52.205377+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'819","last_scrub_stamp":"2024-09-12T01:02:52.205058+0000","last_deep_scrub":"268'819","last_deep_scrub_stamp":"2024-09-12T01:02:52.205058+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.205058+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:06.846282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4035,"num_read_kb":3684,"num_write":1067,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2043,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"268'352","reported_seq":1010,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.342132+0000","last_change":"2024-09-12T01:02:54.341830+0000","last_active":"2024-09-12T01:02:54.342132+0000","last_peered":"2024-09-12T01:02:54.342132+0000","last_clean":"2024-09-12T01:02:54.342132+0000","last_became_active":"2024-09-12T00:15:55.055929+0000","last_became_peered":"2024-09-12T00:15:55.055929+0000","last_unstale":"2024-09-12T01:02:54.342132+0000","last_undegraded":"2024-09-12T01:02:54.342132+0000","last_fullsized":"2024-09-12T01:02:54.342132+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'352","last_scrub_stamp":"2024-09-12T01:02:54.341405+0000","last_deep_scrub":"268'352","last_deep_scrub_stamp":"2024-09-12T01:02:54.341405+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.341405+0000","objects_scrubbed":7,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:10.803620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":553,"num_read_kb":589,"num_write":1208,"num_write_kb":30899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"268'838","reported_seq":2512,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.745029+0000","last_change":"2024-09-12T01:02:58.745029+0000","last_active":"2024-09-12T01:02:58.745029+0000","last_peered":"2024-09-12T01:02:58.745029+0000","last_clean":"2024-09-12T01:02:58.745029+0000","last_became_active":"2024-09-12T00:15:57.039946+0000","last_became_peered":"2024-09-12T00:15:57.039946+0000","last_unstale":"2024-09-12T01:02:58.745029+0000","last_undegraded":"2024-09-12T01:02:58.745029+0000","last_fullsized":"2024-09-12T01:02:58.745029+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'838","last_scrub_stamp":"2024-09-12T01:02:58.744791+0000","last_deep_scrub":"268'838","last_deep_scrub_stamp":"2024-09-12T01:02:58.744791+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.744791+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":800,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:14.176919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4272,"num_read_kb":3874,"num_write":1144,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2806,"num_omap_keys":11,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"268'428","reported_seq":1166,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:01.585209+0000","last_change":"2024-09-12T01:03:01.585054+0000","last_active":"2024-09-12T01:03:01.585209+0000","last_peered":"2024-09-12T01:03:01.585209+0000","last_clean":"2024-09-12T01:03:01.585209+0000","last_became_active":"2024-09-12T00:15:55.065129+0000","last_became_peered":"2024-09-12T00:15:55.065129+0000","last_unstale":"2024-09-12T01:03:01.585209+0000","last_undegraded":"2024-09-12T01:03:01.585209+0000","last_fullsized":"2024-09-12T01:03:01.585209+0000","mapping_epoch":26,"log_start":"268'400","ondisk_log_start":"268'400","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'428","last_scrub_stamp":"2024-09-12T01:03:01.584779+0000","last_deep_scrub":"268'428","last_deep_scrub_stamp":"2024-09-12T01:03:01.584779+0000","last_clean_scrub_stamp":"2024-09-12T01:03:01.584779+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:46.193473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170166,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":788,"num_read_kb":24149,"num_write":1329,"num_write_kb":32019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"268'878","reported_seq":2664,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.582210+0000","last_change":"2024-09-12T01:02:54.582210+0000","last_active":"2024-09-12T01:02:54.582210+0000","last_peered":"2024-09-12T01:02:54.582210+0000","last_clean":"2024-09-12T01:02:54.582210+0000","last_became_active":"2024-09-12T00:15:57.051976+0000","last_became_peered":"2024-09-12T00:15:57.051976+0000","last_unstale":"2024-09-12T01:02:54.582210+0000","last_undegraded":"2024-09-12T01:02:54.582210+0000","last_fullsized":"2024-09-12T01:02:54.582210+0000","mapping_epoch":28,"log_start":"268'800","ondisk_log_start":"268'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'878","last_scrub_stamp":"2024-09-12T01:02:54.581985+0000","last_deep_scrub":"268'878","last_deep_scrub_stamp":"2024-09-12T01:02:54.581985+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.581985+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":800,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:29.512097+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4749,"num_read_kb":4328,"num_write":1184,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3450,"num_omap_keys":14,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"268'343","reported_seq":980,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.325668+0000","last_change":"2024-09-12T01:02:53.325419+0000","last_active":"2024-09-12T01:02:53.325668+0000","last_peered":"2024-09-12T01:02:53.325668+0000","last_clean":"2024-09-12T01:02:53.325668+0000","last_became_active":"2024-09-12T00:15:55.055449+0000","last_became_peered":"2024-09-12T00:15:55.055449+0000","last_unstale":"2024-09-12T01:02:53.325668+0000","last_undegraded":"2024-09-12T01:02:53.325668+0000","last_fullsized":"2024-09-12T01:02:53.325668+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'343","last_scrub_stamp":"2024-09-12T01:02:53.325099+0000","last_deep_scrub":"268'343","last_deep_scrub_stamp":"2024-09-12T01:02:53.325099+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.325099+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:04.425777+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":322,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":487,"num_read_kb":2263,"num_write":1082,"num_write_kb":24139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"268'790","reported_seq":2378,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:05.480115+0000","last_change":"2024-09-12T01:03:05.479981+0000","last_active":"2024-09-12T01:03:05.480115+0000","last_peered":"2024-09-12T01:03:05.480115+0000","last_clean":"2024-09-12T01:03:05.480115+0000","last_became_active":"2024-09-12T00:15:57.031976+0000","last_became_peered":"2024-09-12T00:15:57.031976+0000","last_unstale":"2024-09-12T01:03:05.480115+0000","last_undegraded":"2024-09-12T01:03:05.480115+0000","last_fullsized":"2024-09-12T01:03:05.480115+0000","mapping_epoch":28,"log_start":"268'700","ondisk_log_start":"268'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'790","last_scrub_stamp":"2024-09-12T01:03:05.479793+0000","last_deep_scrub":"268'790","last_deep_scrub_stamp":"2024-09-12T01:03:05.479793+0000","last_clean_scrub_stamp":"2024-09-12T01:03:05.479793+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:48.321978+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3862,"num_read_kb":3503,"num_write":1033,"num_write_kb":375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"268'359","reported_seq":1018,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:48.167331+0000","last_change":"2024-09-12T01:02:48.167146+0000","last_active":"2024-09-12T01:02:48.167331+0000","last_peered":"2024-09-12T01:02:48.167331+0000","last_clean":"2024-09-12T01:02:48.167331+0000","last_became_active":"2024-09-12T00:15:55.051451+0000","last_became_peered":"2024-09-12T00:15:55.051451+0000","last_unstale":"2024-09-12T01:02:48.167331+0000","last_undegraded":"2024-09-12T01:02:48.167331+0000","last_fullsized":"2024-09-12T01:02:48.167331+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'359","last_scrub_stamp":"2024-09-12T01:02:48.166882+0000","last_deep_scrub":"268'359","last_deep_scrub_stamp":"2024-09-12T01:02:48.166882+0000","last_clean_scrub_stamp":"2024-09-12T01:02:48.166882+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:13.746661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263237,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":17816,"num_write":1180,"num_write_kb":26945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"268'485","reported_seq":2170,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:56.125316+0000","last_change":"2024-09-12T01:02:56.125082+0000","last_active":"2024-09-12T01:02:56.125316+0000","last_peered":"2024-09-12T01:02:56.125316+0000","last_clean":"2024-09-12T01:02:56.125316+0000","last_became_active":"2024-09-12T00:15:57.019963+0000","last_became_peered":"2024-09-12T00:15:57.019963+0000","last_unstale":"2024-09-12T01:02:56.125316+0000","last_undegraded":"2024-09-12T01:02:56.125316+0000","last_fullsized":"2024-09-12T01:02:56.125316+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'485","last_scrub_stamp":"2024-09-12T01:02:56.124868+0000","last_deep_scrub":"268'485","last_deep_scrub_stamp":"2024-09-12T01:02:56.124868+0000","last_clean_scrub_stamp":"2024-09-12T01:02:56.124868+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:10.557945+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2585,"num_read_kb":2455,"num_write":555,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":983,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"268'290","reported_seq":923,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.093495+0000","last_change":"2024-09-12T01:02:58.093202+0000","last_active":"2024-09-12T01:02:58.093495+0000","last_peered":"2024-09-12T01:02:58.093495+0000","last_clean":"2024-09-12T01:02:58.093495+0000","last_became_active":"2024-09-12T00:15:55.050267+0000","last_became_peered":"2024-09-12T00:15:55.050267+0000","last_unstale":"2024-09-12T01:02:58.093495+0000","last_undegraded":"2024-09-12T01:02:58.093495+0000","last_fullsized":"2024-09-12T01:02:58.093495+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'290","last_scrub_stamp":"2024-09-12T01:02:58.092896+0000","last_deep_scrub":"268'290","last_deep_scrub_stamp":"2024-09-12T01:02:58.092896+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.092896+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:16.075277+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":8617,"num_write":1019,"num_write_kb":22964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"268'1340","reported_seq":3159,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:53.183746+0000","last_change":"2024-09-12T01:02:53.183498+0000","last_active":"2024-09-12T01:02:53.183746+0000","last_peered":"2024-09-12T01:02:53.183746+0000","last_clean":"2024-09-12T01:02:53.183746+0000","last_became_active":"2024-09-12T00:15:57.045076+0000","last_became_peered":"2024-09-12T00:15:57.045076+0000","last_unstale":"2024-09-12T01:02:53.183746+0000","last_undegraded":"2024-09-12T01:02:53.183746+0000","last_fullsized":"2024-09-12T01:02:53.183746+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1340","last_scrub_stamp":"2024-09-12T01:02:53.183271+0000","last_deep_scrub":"268'1340","last_deep_scrub_stamp":"2024-09-12T01:02:53.183271+0000","last_clean_scrub_stamp":"2024-09-12T01:02:53.183271+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":1300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:37:32.397326+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6209,"num_read_kb":5540,"num_write":1861,"num_write_kb":794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"268'321","reported_seq":968,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:52.576244+0000","last_change":"2024-09-12T01:02:52.576069+0000","last_active":"2024-09-12T01:02:52.576244+0000","last_peered":"2024-09-12T01:02:52.576244+0000","last_clean":"2024-09-12T01:02:52.576244+0000","last_became_active":"2024-09-12T00:15:55.061287+0000","last_became_peered":"2024-09-12T00:15:55.061287+0000","last_unstale":"2024-09-12T01:02:52.576244+0000","last_undegraded":"2024-09-12T01:02:52.576244+0000","last_fullsized":"2024-09-12T01:02:52.576244+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'321","last_scrub_stamp":"2024-09-12T01:02:52.575842+0000","last_deep_scrub":"268'321","last_deep_scrub_stamp":"2024-09-12T01:02:52.575842+0000","last_clean_scrub_stamp":"2024-09-12T01:02:52.575842+0000","objects_scrubbed":5,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:54.370349+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":513,"num_read_kb":733,"num_write":1216,"num_write_kb":3677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"268'406","reported_seq":1782,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.700207+0000","last_change":"2024-09-12T01:02:55.700063+0000","last_active":"2024-09-12T01:02:55.700207+0000","last_peered":"2024-09-12T01:02:55.700207+0000","last_clean":"2024-09-12T01:02:55.700207+0000","last_became_active":"2024-09-12T00:15:57.043158+0000","last_became_peered":"2024-09-12T00:15:57.043158+0000","last_unstale":"2024-09-12T01:02:55.700207+0000","last_undegraded":"2024-09-12T01:02:55.700207+0000","last_fullsized":"2024-09-12T01:02:55.700207+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'406","last_scrub_stamp":"2024-09-12T01:02:55.699871+0000","last_deep_scrub":"268'406","last_deep_scrub_stamp":"2024-09-12T01:02:55.699871+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.699871+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:04.239689+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1978,"num_read_kb":1859,"num_write":462,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"268'386","reported_seq":1081,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:58.568297+0000","last_change":"2024-09-12T01:02:58.568150+0000","last_active":"2024-09-12T01:02:58.568297+0000","last_peered":"2024-09-12T01:02:58.568297+0000","last_clean":"2024-09-12T01:02:58.568297+0000","last_became_active":"2024-09-12T00:15:55.058726+0000","last_became_peered":"2024-09-12T00:15:55.058726+0000","last_unstale":"2024-09-12T01:02:58.568297+0000","last_undegraded":"2024-09-12T01:02:58.568297+0000","last_fullsized":"2024-09-12T01:02:58.568297+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'386","last_scrub_stamp":"2024-09-12T01:02:58.567923+0000","last_deep_scrub":"268'386","last_deep_scrub_stamp":"2024-09-12T01:02:58.567923+0000","last_clean_scrub_stamp":"2024-09-12T01:02:58.567923+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:21.225474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":549415,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":603,"num_read_kb":57120,"num_write":1303,"num_write_kb":58223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"268'1346","reported_seq":2841,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:00.143246+0000","last_change":"2024-09-12T01:03:00.143067+0000","last_active":"2024-09-12T01:03:00.143246+0000","last_peered":"2024-09-12T01:03:00.143246+0000","last_clean":"2024-09-12T01:03:00.143246+0000","last_became_active":"2024-09-12T00:15:57.043227+0000","last_became_peered":"2024-09-12T00:15:57.043227+0000","last_unstale":"2024-09-12T01:03:00.143246+0000","last_undegraded":"2024-09-12T01:03:00.143246+0000","last_fullsized":"2024-09-12T01:03:00.143246+0000","mapping_epoch":28,"log_start":"268'1300","ondisk_log_start":"268'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'1346","last_scrub_stamp":"2024-09-12T01:03:00.142862+0000","last_deep_scrub":"268'1346","last_deep_scrub_stamp":"2024-09-12T01:03:00.142862+0000","last_clean_scrub_stamp":"2024-09-12T01:03:00.142862+0000","objects_scrubbed":5,"log_size":46,"log_dups_size":1300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:03.208839+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5913,"num_read_kb":5121,"num_write":1910,"num_write_kb":821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"268'294","reported_seq":944,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:51.730311+0000","last_change":"2024-09-12T01:02:51.730311+0000","last_active":"2024-09-12T01:02:51.730311+0000","last_peered":"2024-09-12T01:02:51.730311+0000","last_clean":"2024-09-12T01:02:51.730311+0000","last_became_active":"2024-09-12T00:15:55.052287+0000","last_became_peered":"2024-09-12T00:15:55.052287+0000","last_unstale":"2024-09-12T01:02:51.730311+0000","last_undegraded":"2024-09-12T01:02:51.730311+0000","last_fullsized":"2024-09-12T01:02:51.730311+0000","mapping_epoch":26,"log_start":"268'200","ondisk_log_start":"268'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'294","last_scrub_stamp":"2024-09-12T01:02:51.729966+0000","last_deep_scrub":"268'294","last_deep_scrub_stamp":"2024-09-12T01:02:51.729966+0000","last_clean_scrub_stamp":"2024-09-12T01:02:51.729966+0000","objects_scrubbed":8,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:44.447259+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947345,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":476,"num_read_kb":19752,"num_write":916,"num_write_kb":40992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"268'335","reported_seq":1754,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:54.134930+0000","last_change":"2024-09-12T01:02:54.134671+0000","last_active":"2024-09-12T01:02:54.134930+0000","last_peered":"2024-09-12T01:02:54.134930+0000","last_clean":"2024-09-12T01:02:54.134930+0000","last_became_active":"2024-09-12T00:15:57.039633+0000","last_became_peered":"2024-09-12T00:15:57.039633+0000","last_unstale":"2024-09-12T01:02:54.134930+0000","last_undegraded":"2024-09-12T01:02:54.134930+0000","last_fullsized":"2024-09-12T01:02:54.134930+0000","mapping_epoch":28,"log_start":"268'300","ondisk_log_start":"268'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'335","last_scrub_stamp":"2024-09-12T01:02:54.134447+0000","last_deep_scrub":"268'335","last_deep_scrub_stamp":"2024-09-12T01:02:54.134447+0000","last_clean_scrub_stamp":"2024-09-12T01:02:54.134447+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:37.275755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1924,"num_read_kb":1842,"num_write":397,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"268'332","reported_seq":1022,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.525046+0000","last_change":"2024-09-12T01:02:59.525046+0000","last_active":"2024-09-12T01:02:59.525046+0000","last_peered":"2024-09-12T01:02:59.525046+0000","last_clean":"2024-09-12T01:02:59.525046+0000","last_became_active":"2024-09-12T00:15:55.054952+0000","last_became_peered":"2024-09-12T00:15:55.054952+0000","last_unstale":"2024-09-12T01:02:59.525046+0000","last_undegraded":"2024-09-12T01:02:59.525046+0000","last_fullsized":"2024-09-12T01:02:59.525046+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'332","last_scrub_stamp":"2024-09-12T01:02:59.524837+0000","last_deep_scrub":"268'332","last_deep_scrub_stamp":"2024-09-12T01:02:59.524837+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.524837+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:40.714134+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109426,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":500,"num_read_kb":117939,"num_write":959,"num_write_kb":46136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"268'394","reported_seq":1060,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:04.601429+0000","last_change":"2024-09-12T01:03:04.601429+0000","last_active":"2024-09-12T01:03:04.601429+0000","last_peered":"2024-09-12T01:03:04.601429+0000","last_clean":"2024-09-12T01:03:04.601429+0000","last_became_active":"2024-09-12T00:15:55.052320+0000","last_became_peered":"2024-09-12T00:15:55.052320+0000","last_unstale":"2024-09-12T01:03:04.601429+0000","last_undegraded":"2024-09-12T01:03:04.601429+0000","last_fullsized":"2024-09-12T01:03:04.601429+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'394","last_scrub_stamp":"2024-09-12T01:03:04.601179+0000","last_deep_scrub":"268'394","last_deep_scrub_stamp":"2024-09-12T01:03:04.601179+0000","last_clean_scrub_stamp":"2024-09-12T01:03:04.601179+0000","objects_scrubbed":7,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:40.828736+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":575,"num_read_kb":13865,"num_write":1350,"num_write_kb":55041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"268'477","reported_seq":2101,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:03:02.187209+0000","last_change":"2024-09-12T01:03:02.187209+0000","last_active":"2024-09-12T01:03:02.187209+0000","last_peered":"2024-09-12T01:03:02.187209+0000","last_clean":"2024-09-12T01:03:02.187209+0000","last_became_active":"2024-09-12T00:15:57.054996+0000","last_became_peered":"2024-09-12T00:15:57.054996+0000","last_unstale":"2024-09-12T01:03:02.187209+0000","last_undegraded":"2024-09-12T01:03:02.187209+0000","last_fullsized":"2024-09-12T01:03:02.187209+0000","mapping_epoch":28,"log_start":"268'400","ondisk_log_start":"268'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'477","last_scrub_stamp":"2024-09-12T01:03:02.187021+0000","last_deep_scrub":"268'477","last_deep_scrub_stamp":"2024-09-12T01:03:02.187021+0000","last_clean_scrub_stamp":"2024-09-12T01:03:02.187021+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:43.118548+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2784,"num_read_kb":2618,"num_write":619,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2539,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"268'328","reported_seq":955,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:55.387452+0000","last_change":"2024-09-12T01:02:55.387452+0000","last_active":"2024-09-12T01:02:55.387452+0000","last_peered":"2024-09-12T01:02:55.387452+0000","last_clean":"2024-09-12T01:02:55.387452+0000","last_became_active":"2024-09-12T00:15:55.078832+0000","last_became_peered":"2024-09-12T00:15:55.078832+0000","last_unstale":"2024-09-12T01:02:55.387452+0000","last_undegraded":"2024-09-12T01:02:55.387452+0000","last_fullsized":"2024-09-12T01:02:55.387452+0000","mapping_epoch":26,"log_start":"268'300","ondisk_log_start":"268'300","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'328","last_scrub_stamp":"2024-09-12T01:02:55.387211+0000","last_deep_scrub":"268'328","last_deep_scrub_stamp":"2024-09-12T01:02:55.387211+0000","last_clean_scrub_stamp":"2024-09-12T01:02:55.387211+0000","objects_scrubbed":6,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:04.897261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262198,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":33208,"num_write":990,"num_write_kb":34373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"268'953","reported_seq":2379,"reported_epoch":268,"state":"active+clean","last_fresh":"2024-09-12T01:02:59.151228+0000","last_change":"2024-09-12T01:02:59.151228+0000","last_active":"2024-09-12T01:02:59.151228+0000","last_peered":"2024-09-12T01:02:59.151228+0000","last_clean":"2024-09-12T01:02:59.151228+0000","last_became_active":"2024-09-12T00:15:57.027565+0000","last_became_peered":"2024-09-12T00:15:57.027565+0000","last_unstale":"2024-09-12T01:02:59.151228+0000","last_undegraded":"2024-09-12T01:02:59.151228+0000","last_fullsized":"2024-09-12T01:02:59.151228+0000","mapping_epoch":28,"log_start":"268'900","ondisk_log_start":"268'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"268'953","last_scrub_stamp":"2024-09-12T01:02:59.151013+0000","last_deep_scrub":"268'953","last_deep_scrub_stamp":"2024-09-12T01:02:59.151013+0000","last_clean_scrub_stamp":"2024-09-12T01:02:59.151013+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":900,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:17.674152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4238,"num_read_kb":3802,"num_write":1335,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6185,"num_read_kb":4382,"num_write":1972,"num_write_kb":869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7269,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1045,"ondisk_log_size":1045,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15645,"num_objects":93,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":15033,"num_read_kb":14688,"num_write":16727,"num_write_kb":4883,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2756,"num_omap_keys":18,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":598016,"data_stored":31290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1350,"ondisk_log_size":1350,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":509,"ondisk_log_size":509,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1515596,"num_objects":221,"num_object_clones":0,"num_object_copies":442,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":221,"num_whiteouts":0,"num_read":17695,"num_read_kb":36825,"num_write":14793,"num_write_kb":11553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":683890,"num_omap_keys":1566,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1901,"ondisk_log_size":1901,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2413,"num_read_kb":2876,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212032,"num_read_kb":193923,"num_write":55063,"num_write_kb":18681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43786,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4204,"ondisk_log_size":4204,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":91096211,"num_objects":373,"num_object_clones":0,"num_object_copies":1492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":373,"num_whiteouts":0,"num_read":36044,"num_read_kb":1967370,"num_write":71560,"num_write_kb":2158407,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":123895808,"data_stored":123895808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3636,"ondisk_log_size":3636,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":141,"num_read_kb":197046,"num_write":158,"num_write_kb":127402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":185778,"num_write":158,"num_write_kb":127402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":16,"seq":68719477321,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":249092,"kb_used_data":19380,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94122748,"statfs":{"total":96636764160,"available":96381693952,"internally_reserved":0,"allocated":19845120,"data_stored":17804594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510029,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":114752,"kb_used_data":15536,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94257088,"statfs":{"total":96636764160,"available":96519258112,"internally_reserved":0,"allocated":15908864,"data_stored":13884114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424510027,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":252652,"kb_used_data":18844,"kb_used_omap":1,"kb_used_meta":233790,"kb_avail":94119188,"statfs":{"total":96636764160,"available":96378048512,"internally_reserved":0,"allocated":19296256,"data_stored":17280849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239401413},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510029,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189312,"kb_used_data":23472,"kb_used_omap":1,"kb_used_meta":165822,"kb_avail":94182528,"statfs":{"total":96636764160,"available":96442908672,"internally_reserved":0,"allocated":24035328,"data_stored":22022383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169802181},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510028,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":350924,"kb_used_data":18492,"kb_used_omap":1,"kb_used_meta":332414,"kb_avail":94020916,"statfs":{"total":96636764160,"available":96277417984,"internally_reserved":0,"allocated":18935808,"data_stored":16894352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":340392389},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510027,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138540,"kb_used_data":21276,"kb_used_omap":1,"kb_used_meta":117246,"kb_avail":94233300,"statfs":{"total":96636764160,"available":96494899200,"internally_reserved":0,"allocated":21786624,"data_stored":19750277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":120060357},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542733,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":270872,"kb_used_data":19016,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94100968,"statfs":{"total":96636764160,"available":96359391232,"internally_reserved":0,"allocated":19472384,"data_stored":17479323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":257882570},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542731,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":281208,"kb_used_data":19560,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94090632,"statfs":{"total":96636764160,"available":96348807168,"internally_reserved":0,"allocated":20029440,"data_stored":18004914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":17494016,"data_stored":17494016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":14049280,"data_stored":14049280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19767296,"data_stored":19767296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15548416,"data_stored":15548416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15024128,"data_stored":15024128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15159296,"data_stored":15159296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11628544,"data_stored":11628544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15224832,"data_stored":15224832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":2507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":4071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:04:09.423 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T01:04:09.769 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T01:04:09.770 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T01:04:09.770 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T01:04:09.770 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:04:09.860 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T01:04:09.860 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T01:04:09.860 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:04:12.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-12T01:04:15.961 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T01:04:15.962 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T01:04:15.962 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:04:16.048 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T01:04:16.048 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T01:04:16.048 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:04:18.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-12T01:04:18.089 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-12T01:04:22.150 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T01:04:22.150 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T01:04:22.150 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:04:22.232 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T01:04:22.232 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T01:04:22.232 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:04:22.332 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T01:04:22.332 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T01:04:22.332 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:04:23.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-12T01:04:23.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-12T01:04:28.434 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T01:04:28.434 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T01:04:28.434 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:04:28.526 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T01:04:28.526 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T01:04:28.527 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T01:04:28.527 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:04:28.556 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T01:04:28.557 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T01:04:28.557 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:04:28.588 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T01:04:28.588 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T01:04:28.588 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T01:04:28.589 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:04:28.620 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T01:04:28.620 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T01:04:28.620 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:04:28.680 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T01:04:28.680 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T01:04:28.680 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:04:28.702 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T01:04:28.702 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T01:04:28.702 DEBUG:teuthology.orchestra.run.smithi138:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T01:04:28.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-12T01:04:28.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-12T01:04:28.739 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-12T01:04:28.740 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T01:04:29.235 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-12T01:04:29.236 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T01:04:29.548 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-12T01:04:29.548 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T01:04:29.734 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi138.front.sepia.ceph.com 2024-09-12T01:04:29.734 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T01:04:29.940 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-12T01:04:29.940 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T01:04:30.412 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-12T01:04:30.412 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T01:04:30.579 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-12T01:04:30.579 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T01:04:30.707 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi178.front.sepia.ceph.com 2024-09-12T01:04:30.708 DEBUG:teuthology.orchestra.run.smithi178:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T01:04:30.841 INFO:tasks.ceph:Archiving mon data... 2024-09-12T01:04:30.842 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901837/data/mon.a.tgz 2024-09-12T01:04:30.842 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-09-12T01:04:30.848 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.UlIVnQnIfS 2024-09-12T01:04:30.849 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.UlIVnQnIfS 2024-09-12T01:04:31.037 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.UlIVnQnIfS 2024-09-12T01:04:31.101 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.UlIVnQnIfS is 560KB 2024-09-12T01:04:31.162 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.UlIVnQnIfS 2024-09-12T01:04:31.168 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901837/data/mon.c.tgz 2024-09-12T01:04:31.168 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-09-12T01:04:31.217 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.xHtWXaxsqJ 2024-09-12T01:04:31.217 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.xHtWXaxsqJ 2024-09-12T01:04:31.419 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.xHtWXaxsqJ 2024-09-12T01:04:31.479 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.xHtWXaxsqJ is 590KB 2024-09-12T01:04:31.538 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.xHtWXaxsqJ 2024-09-12T01:04:31.543 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901837/data/mon.b.tgz 2024-09-12T01:04:31.543 DEBUG:teuthology.orchestra.run.smithi178:> mktemp 2024-09-12T01:04:31.549 INFO:teuthology.orchestra.run.smithi178.stdout:/tmp/tmp.zWgfbtBWnZ 2024-09-12T01:04:31.549 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.zWgfbtBWnZ 2024-09-12T01:04:31.746 DEBUG:teuthology.orchestra.run.smithi178:> sudo chmod 0666 /tmp/tmp.zWgfbtBWnZ 2024-09-12T01:04:31.809 DEBUG:teuthology.orchestra.remote:smithi178:/tmp/tmp.zWgfbtBWnZ is 590KB 2024-09-12T01:04:31.871 DEBUG:teuthology.orchestra.run.smithi178:> rm -fr /tmp/tmp.zWgfbtBWnZ 2024-09-12T01:04:31.876 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T01:04:31.876 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:04:31.879 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:04:31.937 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:04:31.977 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:04:31.978 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T01:04:31.979 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901837/remote/smithi138/crash 2024-09-12T01:04:31.980 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:04:31.993 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901837/remote/smithi178/crash 2024-09-12T01:04:31.994 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:04:32.033 INFO:tasks.ceph:Compressing logs... 2024-09-12T01:04:32.033 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:04:32.037 DEBUG:teuthology.orchestra.run.smithi178:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:04:32.066 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60843.log 2024-09-12T01:04:32.067 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68521.log 2024-09-12T01:04:32.067 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143078.log 2024-09-12T01:04:32.069 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.60843.log: /var/log/ceph/ceph-client.admin.68521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180042.log 2024-09-12T01:04:32.069 INFO:teuthology.orchestra.run.smithi138.stderr: 25.4% -- replaced with /var/log/ceph/ceph-client.admin.68521.log.gz 2024-09-12T01:04:32.069 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.143078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179379.log 2024-09-12T01:04:32.069 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.180042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50904.log 2024-09-12T01:04:32.069 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180042.log.gz 2024-09-12T01:04:32.070 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.179379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179379.log.gz 2024-09-12T01:04:32.070 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:04:32.073 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32751.log 2024-09-12T01:04:32.073 INFO:teuthology.orchestra.run.smithi138.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.143078.log.gz 2024-09-12T01:04:32.073 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.50904.log: /var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167873.log 2024-09-12T01:04:32.073 INFO:teuthology.orchestra.run.smithi138.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.50904.log.gz 89.5% 2024-09-12T01:04:32.073 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60843.log.gz 2024-09-12T01:04:32.073 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34070.log 2024-09-12T01:04:32.073 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32751.log.gz 2024-09-12T01:04:32.073 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.167873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98232.log 2024-09-12T01:04:32.073 INFO:teuthology.orchestra.run.smithi138.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.167873.log.gz 2024-09-12T01:04:32.073 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41904.log 2024-09-12T01:04:32.073 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34070.log.gz 2024-09-12T01:04:32.073 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.98232.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T01:04:32.073 INFO:teuthology.orchestra.run.smithi138.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.98232.log.gz 2024-09-12T01:04:32.074 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123606.log 2024-09-12T01:04:32.074 INFO:teuthology.orchestra.run.smithi138.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.41904.log.gz 2024-09-12T01:04:32.074 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32317.log 2024-09-12T01:04:32.074 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.123606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162730.log 2024-09-12T01:04:32.077 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32317.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.123606.log.gz 2024-09-12T01:04:32.077 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32317.log.gz 2024-09-12T01:04:32.077 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32513.log 2024-09-12T01:04:32.077 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183038.log 2024-09-12T01:04:32.077 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.162730.log: /var/log/ceph/ceph-client.admin.32513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183194.log 2024-09-12T01:04:32.077 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32513.log.gz 2024-09-12T01:04:32.077 INFO:teuthology.orchestra.run.smithi138.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.162730.log.gz 2024-09-12T01:04:32.077 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.183038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32525.log 2024-09-12T01:04:32.078 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183038.log.gz 2024-09-12T01:04:32.078 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.183194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183194.log.gz 2024-09-12T01:04:32.078 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179404.log 2024-09-12T01:04:32.078 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83479.log 2024-09-12T01:04:32.078 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32525.log.gz 2024-09-12T01:04:32.078 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.179404.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.179404.log.gz /var/log/ceph/ceph-client.admin.59553.log 2024-09-12T01:04:32.078 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-12T01:04:32.078 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.83479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40724.log 2024-09-12T01:04:32.078 INFO:teuthology.orchestra.run.smithi138.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.83479.log.gz 2024-09-12T01:04:32.078 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183116.log 2024-09-12T01:04:32.078 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.59553.log: /var/log/ceph/ceph-client.admin.40724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157335.log 2024-09-12T01:04:32.078 INFO:teuthology.orchestra.run.smithi138.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.40724.log.gz 2024-09-12T01:04:32.078 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.183116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50264.log 2024-09-12T01:04:32.079 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183116.log.gz 2024-09-12T01:04:32.082 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.157335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48494.log 2024-09-12T01:04:32.082 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157335.log.gz 2024-09-12T01:04:32.082 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.50264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32305.log 2024-09-12T01:04:32.082 INFO:teuthology.orchestra.run.smithi138.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.50264.log.gz 2024-09-12T01:04:32.082 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.48494.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T01:04:32.082 INFO:teuthology.orchestra.run.smithi138.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.48494.log.gz 2024-09-12T01:04:32.082 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32305.log.gz 2024-09-12T01:04:32.082 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182986.log 2024-09-12T01:04:32.083 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44954.log 2024-09-12T01:04:32.083 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182986.log.gz 2024-09-12T01:04:32.083 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32913.log 2024-09-12T01:04:32.083 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101184.log 2024-09-12T01:04:32.083 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.44954.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.44954.log.gz 2024-09-12T01:04:32.083 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41314.log 2024-09-12T01:04:32.083 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32913.log.gz 2024-09-12T01:04:32.083 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.101184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183012.log 2024-09-12T01:04:32.083 INFO:teuthology.orchestra.run.smithi138.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101184.log.gz 2024-09-12T01:04:32.083 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.41314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32315.log 2024-09-12T01:04:32.083 INFO:teuthology.orchestra.run.smithi138.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.41314.log.gz 2024-09-12T01:04:32.083 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.183012.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.183012.log.gz -5 2024-09-12T01:04:32.083 INFO:teuthology.orchestra.run.smithi138.stderr: --verbose -- /var/log/ceph/ceph-client.admin.99412.log 2024-09-12T01:04:32.084 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32315.log.gz 2024-09-12T01:04:32.084 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55383.log 2024-09-12T01:04:32.089 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32705.log/var/log/ceph/ceph-client.admin.99412.log: 2024-09-12T01:04:32.089 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.55383.log: gzip -5 --verbose 57.7% -- replaced with /var/log/ceph/ceph-client.admin.55383.log.gz 2024-09-12T01:04:32.089 INFO:teuthology.orchestra.run.smithi138.stderr: -- /var/log/ceph/ceph-client.admin.164038.log 2024-09-12T01:04:32.089 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32705.log.gz 2024-09-12T01:04:32.089 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183168.log 2024-09-12T01:04:32.089 INFO:teuthology.orchestra.run.smithi138.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.59553.log.gz 2024-09-12T01:04:32.090 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43134.log 2024-09-12T01:04:32.090 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.164038.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.99412.log.gz 2024-09-12T01:04:32.090 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.183168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55694.log 2024-09-12T01:04:32.090 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183168.log.gz 2024-09-12T01:04:32.090 INFO:teuthology.orchestra.run.smithi138.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.164038.log.gz 2024-09-12T01:04:32.090 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.43134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135407.log 2024-09-12T01:04:32.090 INFO:teuthology.orchestra.run.smithi138.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.43134.log.gz 2024-09-12T01:04:32.090 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.55694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32507.log 2024-09-12T01:04:32.090 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55694.log.gz 2024-09-12T01:04:32.090 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.135407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157360.log 2024-09-12T01:04:32.090 INFO:teuthology.orchestra.run.smithi138.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.135407.log.gz 2024-09-12T01:04:32.090 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32507.log.gz 2024-09-12T01:04:32.090 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78169.log 2024-09-12T01:04:32.090 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71089.log 2024-09-12T01:04:32.090 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.157360.log: /var/log/ceph/ceph-client.admin.78169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32523.log 2024-09-12T01:04:32.091 INFO:teuthology.orchestra.run.smithi138.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.78169.log.gz 2024-09-12T01:04:32.091 INFO:teuthology.orchestra.run.smithi138.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.157360.log.gz 2024-09-12T01:04:32.091 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.71089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170825.log 2024-09-12T01:04:32.091 INFO:teuthology.orchestra.run.smithi138.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.71089.log.gz 2024-09-12T01:04:32.091 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163319.log 2024-09-12T01:04:32.091 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32523.log.gz 2024-09-12T01:04:32.091 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.170825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80529.log 2024-09-12T01:04:32.091 INFO:teuthology.orchestra.run.smithi138.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.0.170825.log.gz 2024-09-12T01:04:32.091 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.163319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109445.log 2024-09-12T01:04:32.091 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.80529.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.163319.log.gz 2024-09-12T01:04:32.091 INFO:teuthology.orchestra.run.smithi138.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.80529.log.gz 2024-09-12T01:04:32.091 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135997.log 2024-09-12T01:04:32.091 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77579.log 2024-09-12T01:04:32.097 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.109445.log: /var/log/ceph/ceph-client.admin.135997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112395.log 2024-09-12T01:04:32.097 INFO:teuthology.orchestra.run.smithi138.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.135997.log.gz 2024-09-12T01:04:32.098 INFO:teuthology.orchestra.run.smithi138.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109445.log.gz 2024-09-12T01:04:32.098 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.77579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32501.log 2024-09-12T01:04:32.098 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.112395.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.77579.log.gz 2024-09-12T01:04:32.098 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182648.log 2024-09-12T01:04:32.098 INFO:teuthology.orchestra.run.smithi138.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.112395.log.gz 2024-09-12T01:04:32.098 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178766.log 2024-09-12T01:04:32.098 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32501.log.gz 2024-09-12T01:04:32.098 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108855.log 2024-09-12T01:04:32.098 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182648.log.gz 2024-09-12T01:04:32.098 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.178766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49674.log 2024-09-12T01:04:32.098 INFO:teuthology.orchestra.run.smithi138.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.178766.log.gz 2024-09-12T01:04:32.098 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.108855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107675.log 2024-09-12T01:04:32.098 INFO:teuthology.orchestra.run.smithi138.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.108855.log.gz 2024-09-12T01:04:32.098 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.49674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32724.log 2024-09-12T01:04:32.099 INFO:teuthology.orchestra.run.smithi138.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.49674.log.gz 2024-09-12T01:04:32.099 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38207.log 2024-09-12T01:04:32.099 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.107675.log: /var/log/ceph/ceph-client.admin.32724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32724.log.gz 2024-09-12T01:04:32.099 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171415.log 2024-09-12T01:04:32.099 INFO:teuthology.orchestra.run.smithi138.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.107675.log.gz 2024-09-12T01:04:32.099 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138357.log 2024-09-12T01:04:32.099 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.38207.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.38207.log.gz 2024-09-12T01:04:32.099 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.171415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121246.log 2024-09-12T01:04:32.099 INFO:teuthology.orchestra.run.smithi138.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.0.171415.log.gz 2024-09-12T01:04:32.099 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.138357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115346.log 2024-09-12T01:04:32.099 INFO:teuthology.orchestra.run.smithi138.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.138357.log.gz 2024-09-12T01:04:32.099 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.121246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34044.log 2024-09-12T01:04:32.099 INFO:teuthology.orchestra.run.smithi138.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.121246.log.gz 2024-09-12T01:04:32.099 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143668.log 2024-09-12T01:04:32.100 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.115346.log: /var/log/ceph/ceph-client.admin.34044.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34044.log.gz 2024-09-12T01:04:32.100 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169053.log 2024-09-12T01:04:32.100 INFO:teuthology.orchestra.run.smithi138.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.115346.log.gz 2024-09-12T01:04:32.100 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162141.log 2024-09-12T01:04:32.100 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.143668.log: /var/log/ceph/ceph-client.0.169053.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.143668.log.gz 2024-09-12T01:04:32.100 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T01:04:32.100 INFO:teuthology.orchestra.run.smithi138.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.169053.log.gz 2024-09-12T01:04:32.100 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.162141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128917.log 2024-09-12T01:04:32.100 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128327.log 2024-09-12T01:04:32.100 INFO:teuthology.orchestra.run.smithi138.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.162141.log.gz 2024-09-12T01:04:32.101 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26820.log 2024-09-12T01:04:32.101 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T01:04:32.105 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.128917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73449.log 2024-09-12T01:04:32.105 INFO:teuthology.orchestra.run.smithi138.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.128917.log.gz 2024-09-12T01:04:32.105 INFO:teuthology.orchestra.run.smithi138.stderr:gzip/var/log/ceph/ceph-client.admin.128327.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.124786.log 2024-09-12T01:04:32.105 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.73449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103544.log 2024-09-12T01:04:32.105 INFO:teuthology.orchestra.run.smithi138.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.128327.log.gz 2024-09-12T01:04:32.105 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.124786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71679.log 2024-09-12T01:04:32.105 INFO:teuthology.orchestra.run.smithi138.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.73449.log.gz 2024-09-12T01:04:32.105 INFO:teuthology.orchestra.run.smithi138.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.124786.log.gz 2024-09-12T01:04:32.105 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.103544.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.103544.log.gz 2024-09-12T01:04:32.106 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165216.log 2024-09-12T01:04:32.106 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.71679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111805.log 2024-09-12T01:04:32.106 INFO:teuthology.orchestra.run.smithi138.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.71679.log.gz 2024-09-12T01:04:32.106 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.165216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173185.log 2024-09-12T01:04:32.106 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.111805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31732.log 2024-09-12T01:04:32.106 INFO:teuthology.orchestra.run.smithi138.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.165216.log.gz 2024-09-12T01:04:32.106 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.173185.log: gzip 82.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.111805.log.gz -- 2024-09-12T01:04:32.106 INFO:teuthology.orchestra.run.smithi138.stderr: /var/log/ceph/ceph-client.admin.111215.log 2024-09-12T01:04:32.106 INFO:teuthology.orchestra.run.smithi138.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.173185.log.gz 2024-09-12T01:04:32.106 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178176.log 2024-09-12T01:04:32.106 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.31732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31732.log.gz 2024-09-12T01:04:32.106 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.111215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32140.log 2024-09-12T01:04:32.106 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.178176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79349.log 2024-09-12T01:04:32.106 INFO:teuthology.orchestra.run.smithi138.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.111215.log.gz 2024-09-12T01:04:32.107 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137767.log 2024-09-12T01:04:32.107 INFO:teuthology.orchestra.run.smithi138.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.178176.log.gz 2024-09-12T01:04:32.107 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32140.log.gz 2024-09-12T01:04:32.107 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.79349.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.79349.log.gz 2024-09-12T01:04:32.107 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32722.log 2024-09-12T01:04:32.107 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.137767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138947.log 2024-09-12T01:04:32.107 INFO:teuthology.orchestra.run.smithi138.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.137767.log.gz 2024-09-12T01:04:32.118 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.26820.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T01:04:32.118 INFO:teuthology.orchestra.run.smithi178.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26820.log.gz 2024-09-12T01:04:32.118 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26772.log 2024-09-12T01:04:32.119 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26844.log 2024-09-12T01:04:32.119 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.26772.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T01:04:32.119 INFO:teuthology.orchestra.run.smithi178.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26772.log.gz 2024-09-12T01:04:32.119 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.26844.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.26748.log 2024-09-12T01:04:32.119 INFO:teuthology.orchestra.run.smithi178.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26844.log.gz 2024-09-12T01:04:32.119 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T01:04:32.119 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.26748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26748.log.gz 2024-09-12T01:04:32.119 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:04:32.119 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26796.log 2024-09-12T01:04:32.119 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26724.log 2024-09-12T01:04:32.119 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.26796.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26796.log.gz 2024-09-12T01:04:32.119 INFO:teuthology.orchestra.run.smithi178.stderr: --verbose -- /var/log/ceph/ceph-client.admin.26868.log 2024-09-12T01:04:32.120 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.26724.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26724.log.gz 2024-09-12T01:04:32.120 INFO:teuthology.orchestra.run.smithi178.stderr: --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:04:32.120 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.26868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26868.log.gz 2024-09-12T01:04:32.120 INFO:teuthology.orchestra.run.smithi178.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26700.log 2024-09-12T01:04:32.120 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T01:04:32.120 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-client.admin.26700.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T01:04:32.120 INFO:teuthology.orchestra.run.smithi178.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26700.log.gz 2024-09-12T01:04:32.120 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-mon.b.log: 90.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:04:32.120 INFO:teuthology.orchestra.run.smithi178.stderr: 87.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:04:32.128 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T01:04:32.128 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32722.log.gz 2024-09-12T01:04:32.128 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.138947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118886.log 2024-09-12T01:04:32.128 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44904.log 2024-09-12T01:04:32.128 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.118886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176725.log 2024-09-12T01:04:32.128 INFO:teuthology.orchestra.run.smithi138.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.118886.log.gz/var/log/ceph/ceph-client.admin.44904.log: 2024-09-12T01:04:32.128 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44904.log.gz 2024-09-12T01:04:32.128 INFO:teuthology.orchestra.run.smithi138.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.138947.log.gz 2024-09-12T01:04:32.128 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34691.log 2024-09-12T01:04:32.128 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.176725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32185.log 2024-09-12T01:04:32.129 INFO:teuthology.orchestra.run.smithi138.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.0.176725.log.gz 2024-09-12T01:04:32.129 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.34691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53904.log 2024-09-12T01:04:32.129 INFO:teuthology.orchestra.run.smithi138.stderr: 44.2% -- replaced with /var/log/ceph/ceph-client.0.34691.log.gz 2024-09-12T01:04:32.129 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50854.log 2024-09-12T01:04:32.129 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32185.log.gz 2024-09-12T01:04:32.129 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.53904.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.53904.log.gz 2024-09-12T01:04:32.129 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26844.log 2024-09-12T01:04:32.129 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.50854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55462.log 2024-09-12T01:04:32.129 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50854.log.gz 2024-09-12T01:04:32.129 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.26844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86429.log 2024-09-12T01:04:32.129 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26844.log.gz 2024-09-12T01:04:32.129 INFO:teuthology.orchestra.run.smithi138.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T01:04:32.130 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.55462.log: 51.2% -- replaced with /var/log/ceph/ceph-client.admin.55462.log.gz 2024-09-12T01:04:32.130 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51494.log 2024-09-12T01:04:32.130 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.86429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56967.log 2024-09-12T01:04:32.130 INFO:teuthology.orchestra.run.smithi138.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.86429.log.gz 2024-09-12T01:04:32.130 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.51494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42494.log 2024-09-12T01:04:32.130 INFO:teuthology.orchestra.run.smithi138.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.51494.log.gz 2024-09-12T01:04:32.130 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.56967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119476.log 2024-09-12T01:04:32.130 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.42494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84659.log 2024-09-12T01:04:32.130 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42494.log.gz 2024-09-12T01:04:32.130 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.119476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92922.log 2024-09-12T01:04:32.130 INFO:teuthology.orchestra.run.smithi138.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.119476.log.gz 2024-09-12T01:04:32.130 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55772.log 2024-09-12T01:04:32.130 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.84659.log: /var/log/ceph/ceph-client.admin.92922.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.84659.log.gz 2024-09-12T01:04:32.130 INFO:teuthology.orchestra.run.smithi138.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.92922.log.gz 2024-09-12T01:04:32.131 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64719.log 2024-09-12T01:04:32.131 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.55772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146618.log 2024-09-12T01:04:32.131 INFO:teuthology.orchestra.run.smithi138.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.55772.log.gz 2024-09-12T01:04:32.131 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.64719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32508.log 2024-09-12T01:04:32.131 INFO:teuthology.orchestra.run.smithi138.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.64719.log.gz 2024-09-12T01:04:32.131 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.146618.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.146618.log.gz 2024-09-12T01:04:32.131 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104134.log 2024-09-12T01:04:32.131 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107084.log 2024-09-12T01:04:32.131 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32508.log.gz 2024-09-12T01:04:32.131 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.104134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32313.log 2024-09-12T01:04:32.131 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.107084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137177.log 2024-09-12T01:04:32.131 INFO:teuthology.orchestra.run.smithi138.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.104134.log.gz 2024-09-12T01:04:32.131 INFO:teuthology.orchestra.run.smithi138.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.107084.log.gz 2024-09-12T01:04:32.131 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32313.log.gz 2024-09-12T01:04:32.132 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47904.log 2024-09-12T01:04:32.132 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.137177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164627.log 2024-09-12T01:04:32.132 INFO:teuthology.orchestra.run.smithi138.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.137177.log.gz 2024-09-12T01:04:32.132 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.47904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177315.log 2024-09-12T01:04:32.132 INFO:teuthology.orchestra.run.smithi138.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.47904.log.gz/var/log/ceph/ceph-client.admin.164627.log: 2024-09-12T01:04:32.132 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176135.log 2024-09-12T01:04:32.132 INFO:teuthology.orchestra.run.smithi138.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.164627.log.gz 2024-09-12T01:04:32.132 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.177315.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.177315.log.gz 2024-09-12T01:04:32.132 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152540.log 2024-09-12T01:04:32.132 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.176135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95872.log 2024-09-12T01:04:32.132 INFO:teuthology.orchestra.run.smithi138.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.176135.log.gz 2024-09-12T01:04:32.132 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.152540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161552.log 2024-09-12T01:04:32.132 INFO:teuthology.orchestra.run.smithi138.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.152540.log.gz 2024-09-12T01:04:32.132 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149568.log 2024-09-12T01:04:32.133 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.95872.log: /var/log/ceph/ceph-client.admin.161552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147798.log 2024-09-12T01:04:32.133 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.149568.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.95872.log.gz 2024-09-12T01:04:32.133 INFO:teuthology.orchestra.run.smithi138.stderr: 82.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108265.log 2024-09-12T01:04:32.133 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.149568.log.gz 2024-09-12T01:04:32.133 INFO:teuthology.orchestra.run.smithi138.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.161552.log.gz 2024-09-12T01:04:32.133 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.147798.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.147798.log.gz 2024-09-12T01:04:32.133 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53314.log 2024-09-12T01:04:32.133 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.108265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84069.log 2024-09-12T01:04:32.133 INFO:teuthology.orchestra.run.smithi138.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.108265.log.gz 2024-09-12T01:04:32.133 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.53314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60198.log 2024-09-12T01:04:32.133 INFO:teuthology.orchestra.run.smithi138.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.53314.log.gz/var/log/ceph/ceph-client.admin.84069.log: 2024-09-12T01:04:32.133 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153720.log 2024-09-12T01:04:32.133 INFO:teuthology.orchestra.run.smithi138.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.84069.log.gz 2024-09-12T01:04:32.143 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.60198.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.60198.log.gz 2024-09-12T01:04:32.143 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126556.log 2024-09-12T01:04:32.143 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.153720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97642.log 2024-09-12T01:04:32.143 INFO:teuthology.orchestra.run.smithi138.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.153720.log.gz/var/log/ceph/ceph-client.admin.126556.log: 2024-09-12T01:04:32.143 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104724.log 2024-09-12T01:04:32.143 INFO:teuthology.orchestra.run.smithi138.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.56967.log.gz 2024-09-12T01:04:32.143 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.97642.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.97642.log.gz 2024-09-12T01:04:32.143 INFO:teuthology.orchestra.run.smithi138.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.126556.log.gz 2024-09-12T01:04:32.143 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183090.log 2024-09-12T01:04:32.143 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183142.log 2024-09-12T01:04:32.143 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.104724.log: /var/log/ceph/ceph-client.admin.183090.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.104724.log.gz 2024-09-12T01:04:32.144 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139538.log 2024-09-12T01:04:32.144 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183090.log.gz 2024-09-12T01:04:32.144 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100002.log 2024-09-12T01:04:32.144 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.183142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183142.log.gz 2024-09-12T01:04:32.144 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.139538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95282.log 2024-09-12T01:04:32.144 INFO:teuthology.orchestra.run.smithi138.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.139538.log.gz 2024-09-12T01:04:32.144 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.100002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72269.log 2024-09-12T01:04:32.144 INFO:teuthology.orchestra.run.smithi138.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.100002.log.gz 2024-09-12T01:04:32.144 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.95282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117116.log 2024-09-12T01:04:32.144 INFO:teuthology.orchestra.run.smithi138.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.95282.log.gz 2024-09-12T01:04:32.144 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.72269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125376.log 2024-09-12T01:04:32.144 INFO:teuthology.orchestra.run.smithi138.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.72269.log.gz 2024-09-12T01:04:32.144 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.117116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174365.log 2024-09-12T01:04:32.145 INFO:teuthology.orchestra.run.smithi138.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.117116.log.gz 2024-09-12T01:04:32.145 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.125376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157310.log 2024-09-12T01:04:32.145 INFO:teuthology.orchestra.run.smithi138.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.125376.log.gz 2024-09-12T01:04:32.145 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.174365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116526.log 2024-09-12T01:04:32.145 INFO:teuthology.orchestra.run.smithi138.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.174365.log.gz 2024-09-12T01:04:32.145 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.157310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179429.log 2024-09-12T01:04:32.145 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157310.log.gz 2024-09-12T01:04:32.145 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.116526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105904.log 2024-09-12T01:04:32.145 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.179429.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.116526.log.gz 2024-09-12T01:04:32.145 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T01:04:32.145 INFO:teuthology.orchestra.run.smithi138.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.179429.log.gz 2024-09-12T01:04:32.145 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.105904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182960.log 2024-09-12T01:04:32.145 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146028.log 2024-09-12T01:04:32.146 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120656.log 2024-09-12T01:04:32.146 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182960.log.gz 2024-09-12T01:04:32.146 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.146028.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.105904.log.gz 2024-09-12T01:04:32.146 INFO:teuthology.orchestra.run.smithi138.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.146028.log.gz 2024-09-12T01:04:32.146 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158540.log 2024-09-12T01:04:32.146 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.120656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156720.log 2024-09-12T01:04:32.146 INFO:teuthology.orchestra.run.smithi138.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.120656.log.gz/var/log/ceph/ceph-client.admin.158540.log: 2024-09-12T01:04:32.146 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180067.log 2024-09-12T01:04:32.146 INFO:teuthology.orchestra.run.smithi138.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.158540.log.gz 2024-09-12T01:04:32.146 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.156720.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.156720.log.gz 2024-09-12T01:04:32.146 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63423.log 2024-09-12T01:04:32.146 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.180067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182726.log 2024-09-12T01:04:32.146 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180067.log.gz 2024-09-12T01:04:32.147 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.63423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156130.log 2024-09-12T01:04:32.147 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175545.log 2024-09-12T01:04:32.147 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182726.log.gz 2024-09-12T01:04:32.147 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.156130.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.156130.log.gz 2024-09-12T01:04:32.147 INFO:teuthology.orchestra.run.smithi138.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63423.log.gz 2024-09-12T01:04:32.147 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34020.log 2024-09-12T01:04:32.147 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.175545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102954.log 2024-09-12T01:04:32.147 INFO:teuthology.orchestra.run.smithi138.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.175545.log.gz 2024-09-12T01:04:32.147 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.34020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182700.log 2024-09-12T01:04:32.147 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34020.log.gz 2024-09-12T01:04:32.147 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.102954.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.102954.log.gz 2024-09-12T01:04:32.150 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150158.log 2024-09-12T01:04:32.150 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133637.log 2024-09-12T01:04:32.151 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182700.log.gz 2024-09-12T01:04:32.151 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.150158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32524.log 2024-09-12T01:04:32.151 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.133637.log: 88.9% 82.0% -- replaced with /var/log/ceph/ceph-client.admin.133637.log.gz 2024-09-12T01:04:32.151 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.150158.log.gz 2024-09-12T01:04:32.151 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58260.log 2024-09-12T01:04:32.151 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44929.log 2024-09-12T01:04:32.151 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32524.log.gz 2024-09-12T01:04:32.151 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.58260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81119.log 2024-09-12T01:04:32.151 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.44929.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T01:04:32.151 INFO:teuthology.orchestra.run.smithi138.stderr: 29.2% -- replaced with /var/log/ceph/ceph-client.admin.44929.log.gz 2024-09-12T01:04:32.151 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.81119.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81119.log.gz 2024-09-12T01:04:32.151 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155490.log 2024-09-12T01:04:32.151 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T01:04:32.152 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.155490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155490.log.gz 2024-09-12T01:04:32.152 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144258.log 2024-09-12T01:04:32.152 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.1.log: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T01:04:32.153 INFO:teuthology.orchestra.run.smithi138.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.58260.log.gz 2024-09-12T01:04:32.156 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56342.log 2024-09-12T01:04:32.156 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123016.log 2024-09-12T01:04:32.157 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.144258.log: /var/log/ceph/ceph-client.admin.56342.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.144258.log.gz 2024-09-12T01:04:32.157 INFO:teuthology.orchestra.run.smithi138.stderr: 21.6% -- replaced with /var/log/ceph/ceph-client.admin.56342.log.gz 2024-09-12T01:04:32.157 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155515.log 2024-09-12T01:04:32.158 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52084.log 2024-09-12T01:04:32.159 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.123016.log: /var/log/ceph/ceph-client.admin.155515.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.123016.log.gz 2024-09-12T01:04:32.159 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155515.log.gz 2024-09-12T01:04:32.159 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125966.log 2024-09-12T01:04:32.160 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46724.log 2024-09-12T01:04:32.160 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.52084.log: /var/log/ceph/ceph-client.admin.125966.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.52084.log.gz 2024-09-12T01:04:32.160 INFO:teuthology.orchestra.run.smithi138.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.125966.log.gz 2024-09-12T01:04:32.160 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64068.log 2024-09-12T01:04:32.160 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.46724.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.46724.log.gz 2024-09-12T01:04:32.161 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67930.log 2024-09-12T01:04:32.161 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114165.log 2024-09-12T01:04:32.162 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.64068.log: /var/log/ceph/ceph-client.admin.67930.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.67930.log.gz 2024-09-12T01:04:32.165 INFO:teuthology.orchestra.run.smithi138.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.64068.log.gz 2024-09-12T01:04:32.166 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66157.log 2024-09-12T01:04:32.166 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.114165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32965.log 2024-09-12T01:04:32.167 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.66157.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.66157.log.gz 2024-09-12T01:04:32.167 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152518.log 2024-09-12T01:04:32.168 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32965.log.gz 2024-09-12T01:04:32.168 INFO:teuthology.orchestra.run.smithi138.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114165.log.gz 2024-09-12T01:04:32.168 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127146.log 2024-09-12T01:04:32.169 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69834.log 2024-09-12T01:04:32.169 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.152518.log: /var/log/ceph/ceph-client.admin.127146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152518.log.gz 2024-09-12T01:04:32.169 INFO:teuthology.orchestra.run.smithi138.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.127146.log.gz 2024-09-12T01:04:32.169 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141308.log 2024-09-12T01:04:32.172 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.69834.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.69834.log.gz 2024-09-12T01:04:32.173 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134227.log 2024-09-12T01:04:32.173 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33994.log 2024-09-12T01:04:32.174 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.141308.log: /var/log/ceph/ceph-client.admin.134227.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.141308.log.gz 2024-09-12T01:04:32.174 INFO:teuthology.orchestra.run.smithi138.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.134227.log.gz 2024-09-12T01:04:32.174 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170235.log 2024-09-12T01:04:32.175 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102364.log 2024-09-12T01:04:32.176 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33994.log: /var/log/ceph/ceph-client.0.170235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33994.log.gz 2024-09-12T01:04:32.176 INFO:teuthology.orchestra.run.smithi138.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.0.170235.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144848.log 2024-09-12T01:04:32.176 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-12T01:04:32.176 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.102364.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.102364.log.gz 2024-09-12T01:04:32.177 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94692.log 2024-09-12T01:04:32.177 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130687.log 2024-09-12T01:04:32.178 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.144848.log: /var/log/ceph/ceph-client.admin.94692.log: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.94692.log.gz 2024-09-12T01:04:32.178 INFO:teuthology.orchestra.run.smithi138.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.144848.log.gz 2024-09-12T01:04:32.179 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142488.log 2024-09-12T01:04:32.179 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110035.log 2024-09-12T01:04:32.180 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.130687.log: /var/log/ceph/ceph-client.admin.142488.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.130687.log.gz 2024-09-12T01:04:32.180 INFO:teuthology.orchestra.run.smithi138.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.142488.log.gz 2024-09-12T01:04:32.180 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131867.log 2024-09-12T01:04:32.181 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183220.log 2024-09-12T01:04:32.181 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.110035.log: /var/log/ceph/ceph-client.admin.131867.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.110035.log.gz 2024-09-12T01:04:32.181 INFO:teuthology.orchestra.run.smithi138.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.131867.log.gz 2024-09-12T01:04:32.182 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182804.log 2024-09-12T01:04:32.182 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122426.log 2024-09-12T01:04:32.183 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.183220.log: /var/log/ceph/ceph-client.admin.182804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183220.log.gz 2024-09-12T01:04:32.183 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182804.log.gz 2024-09-12T01:04:32.183 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49084.log 2024-09-12T01:04:32.184 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98822.log 2024-09-12T01:04:32.184 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.122426.log: /var/log/ceph/ceph-client.admin.49084.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.122426.log.gz 2024-09-12T01:04:32.184 INFO:teuthology.orchestra.run.smithi138.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.49084.log.gz 2024-09-12T01:04:32.184 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32263.log 2024-09-12T01:04:32.184 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.98822.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.98822.log.gz 2024-09-12T01:04:32.185 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183297.log 2024-09-12T01:04:32.185 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32237.log 2024-09-12T01:04:32.186 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32263.log: /var/log/ceph/ceph-client.admin.183297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32263.log.gz 2024-09-12T01:04:32.186 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183297.log.gz 2024-09-12T01:04:32.186 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179356.log 2024-09-12T01:04:32.187 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130097.log 2024-09-12T01:04:32.188 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32237.log: /var/log/ceph/ceph-client.admin.179356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32237.log.gz 2024-09-12T01:04:32.188 INFO:teuthology.orchestra.run.smithi138.stderr: 25.3% -- replaced with /var/log/ceph/ceph-client.admin.179356.log.gz 2024-09-12T01:04:32.188 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87609.log 2024-09-12T01:04:32.188 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145438.log 2024-09-12T01:04:32.189 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.130097.log: /var/log/ceph/ceph-client.admin.87609.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.130097.log.gz 2024-09-12T01:04:32.189 INFO:teuthology.orchestra.run.smithi138.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.87609.log.gz 2024-09-12T01:04:32.189 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110625.log 2024-09-12T01:04:32.189 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:04:32.190 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.145438.log: /var/log/ceph/ceph-client.admin.110625.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.145438.log.gz 2024-09-12T01:04:32.190 INFO:teuthology.orchestra.run.smithi138.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110625.log.gz 2024-09-12T01:04:32.190 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168463.log 2024-09-12T01:04:32.201 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.log: 93.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:04:32.202 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92329.log 2024-09-12T01:04:32.202 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113575.log 2024-09-12T01:04:32.203 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.168463.log: /var/log/ceph/ceph-client.admin.92329.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.92329.log.gz 2024-09-12T01:04:32.203 INFO:teuthology.orchestra.run.smithi138.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.0.168463.log.gz 2024-09-12T01:04:32.203 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181337.log 2024-09-12T01:04:32.204 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172595.log 2024-09-12T01:04:32.204 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.181337.log: /var/log/ceph/ceph-client.admin.113575.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.113575.log.gz 2024-09-12T01:04:32.204 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167272.log 2024-09-12T01:04:32.205 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.172595.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.172595.log.gz 2024-09-12T01:04:32.206 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74629.log 2024-09-12T01:04:32.207 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.167272.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.167272.log.gz 2024-09-12T01:04:32.207 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127736.log 2024-09-12T01:04:32.208 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.74629.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.74629.log.gz 2024-09-12T01:04:32.208 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67339.log 2024-09-12T01:04:32.209 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.127736.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.127736.log.gz 2024-09-12T01:04:32.210 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155540.log 2024-09-12T01:04:32.210 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.67339.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.67339.log.gz 2024-09-12T01:04:32.211 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93512.log 2024-09-12T01:04:32.212 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.155540.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.155540.log.gz 2024-09-12T01:04:32.212 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165805.log 2024-09-12T01:04:32.213 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.93512.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.93512.log.gz 2024-09-12T01:04:32.213 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32115.log 2024-09-12T01:04:32.214 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.165805.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.165805.log.gz 2024-09-12T01:04:32.215 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180143.log 2024-09-12T01:04:32.216 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32115.log.gz 2024-09-12T01:04:32.216 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53289.log 2024-09-12T01:04:32.217 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.180143.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.180143.log.gz 2024-09-12T01:04:32.217 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182830.log 2024-09-12T01:04:32.218 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.53289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53289.log.gz 2024-09-12T01:04:32.218 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147208.log 2024-09-12T01:04:32.219 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182830.log.gz 2024-09-12T01:04:32.219 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45544.log 2024-09-12T01:04:32.220 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.147208.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.147208.log.gz 2024-09-12T01:04:32.220 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32725.log 2024-09-12T01:04:32.221 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.45544.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.45544.log.gz 2024-09-12T01:04:32.222 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182778.log 2024-09-12T01:04:32.223 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32725.log.gz 2024-09-12T01:04:32.223 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105314.log 2024-09-12T01:04:32.223 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182778.log.gz 2024-09-12T01:04:32.224 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47314.log 2024-09-12T01:04:32.225 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.105314.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.105314.log.gz 2024-09-12T01:04:32.225 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68569.log 2024-09-12T01:04:32.226 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.47314.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.47314.log.gz 2024-09-12T01:04:32.226 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75219.log 2024-09-12T01:04:32.227 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.68569.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.68569.log.gz 2024-09-12T01:04:32.228 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57612.log 2024-09-12T01:04:32.228 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.75219.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.75219.log.gz 2024-09-12T01:04:32.229 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69159.log 2024-09-12T01:04:32.230 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.57612.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.57612.log.gz 2024-09-12T01:04:32.230 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88789.log 2024-09-12T01:04:32.231 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.69159.log: 84.6% -- replaced with /var/log/ceph/ceph-client.0.69159.log.gz 2024-09-12T01:04:32.232 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46134.log 2024-09-12T01:04:32.233 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.88789.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.88789.log.gz 2024-09-12T01:04:32.233 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 87.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.0.181337.log.gz /var/log/ceph/ceph-client.0.35275.log 2024-09-12T01:04:32.233 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-12T01:04:32.234 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.46134.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.46134.log.gz 2024-09-12T01:04:32.234 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54494.log 2024-09-12T01:04:32.235 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151338.log 2024-09-12T01:04:32.235 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.35275.log: /var/log/ceph/ceph-client.admin.54494.log: 82.1% 81.0% -- replaced with /var/log/ceph/ceph-client.0.35275.log.gz 2024-09-12T01:04:32.235 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54494.log.gz 2024-09-12T01:04:32.236 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151928.log 2024-09-12T01:04:32.236 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150748.log 2024-09-12T01:04:32.236 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.151338.log: /var/log/ceph/ceph-client.admin.151928.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.151338.log.gz 2024-09-12T01:04:32.237 INFO:teuthology.orchestra.run.smithi138.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.151928.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154310.log 2024-09-12T01:04:32.237 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-12T01:04:32.237 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.150748.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.150748.log.gz 2024-09-12T01:04:32.238 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79939.log 2024-09-12T01:04:32.238 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106494.log 2024-09-12T01:04:32.239 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.154310.log: /var/log/ceph/ceph-client.admin.79939.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.154310.log.gz 2024-09-12T01:04:32.239 INFO:teuthology.orchestra.run.smithi138.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.79939.log.gz 2024-09-12T01:04:32.239 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118296.log 2024-09-12T01:04:32.240 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.106494.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.106494.log.gz 2024-09-12T01:04:32.240 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T01:04:32.241 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148388.log 2024-09-12T01:04:32.241 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.118296.log: /var/log/ceph/ceph-mon.c.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118296.log.gz 2024-09-12T01:04:32.241 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173775.log 2024-09-12T01:04:32.242 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.148388.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.148388.log.gz 2024-09-12T01:04:32.243 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32211.log 2024-09-12T01:04:32.243 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.173775.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.173775.log.gz 2024-09-12T01:04:32.244 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174955.log 2024-09-12T01:04:32.244 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32211.log.gz 2024-09-12T01:04:32.244 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35865.log 2024-09-12T01:04:32.245 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.174955.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.174955.log.gz 2024-09-12T01:04:32.246 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180118.log 2024-09-12T01:04:32.246 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.35865.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.35865.log.gz 2024-09-12T01:04:32.247 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42519.log 2024-09-12T01:04:32.247 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.180118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180118.log.gz 2024-09-12T01:04:32.247 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133047.log 2024-09-12T01:04:32.248 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.42519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42519.log.gz 2024-09-12T01:04:32.249 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52674.log 2024-09-12T01:04:32.249 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.133047.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.133047.log.gz 2024-09-12T01:04:32.250 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182934.log 2024-09-12T01:04:32.250 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.52674.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.52674.log.gz 2024-09-12T01:04:32.251 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182674.log 2024-09-12T01:04:32.251 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182934.log.gz 2024-09-12T01:04:32.252 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76989.log 2024-09-12T01:04:32.252 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182674.log.gz 2024-09-12T01:04:32.253 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61488.log 2024-09-12T01:04:32.253 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.76989.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.76989.log.gz 2024-09-12T01:04:32.254 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87019.log 2024-09-12T01:04:32.268 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.61488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166683.log 2024-09-12T01:04:32.269 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.87019.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.87019.log.gz 2024-09-12T01:04:32.282 INFO:teuthology.orchestra.run.smithi138.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.61488.log.gz 2024-09-12T01:04:32.283 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T01:04:32.285 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.166683.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.166683.log.gz 2024-09-12T01:04:32.285 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89969.log 2024-09-12T01:04:32.300 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131277.log 2024-09-12T01:04:32.301 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.89969.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.89969.log.gz 2024-09-12T01:04:32.316 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183247.log 2024-09-12T01:04:32.317 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.131277.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.131277.log.gz 2024-09-12T01:04:32.331 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89379.log 2024-09-12T01:04:32.331 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.183247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183247.log.gz 2024-09-12T01:04:32.340 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58907.log 2024-09-12T01:04:32.341 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.89379.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.89379.log.gz 2024-09-12T01:04:32.348 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:04:32.356 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.58907.log: 93.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34093.log 2024-09-12T01:04:32.359 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.audit.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:04:32.364 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40134.log 2024-09-12T01:04:32.365 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.34093.log: 96.0% -- replaced with /var/log/ceph/ceph-client.0.34093.log.gz 2024-09-12T01:04:32.368 INFO:teuthology.orchestra.run.smithi138.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58907.log.gz 2024-09-12T01:04:32.372 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56315.log 2024-09-12T01:04:32.373 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.40134.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.40134.log.gz 2024-09-12T01:04:32.392 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32309.log 2024-09-12T01:04:32.393 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.56315.log: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.56315.log.gz 2024-09-12T01:04:32.404 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82299.log 2024-09-12T01:04:32.405 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32309.log.gz 2024-09-12T01:04:32.416 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153130.log 2024-09-12T01:04:32.417 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.82299.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.82299.log.gz 2024-09-12T01:04:32.423 INFO:teuthology.orchestra.run.smithi138.stderr: 94.5% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T01:04:32.423 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66749.log 2024-09-12T01:04:32.424 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.153130.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.153130.log.gz 2024-09-12T01:04:32.425 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148978.log 2024-09-12T01:04:32.426 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.66749.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.66749.log.gz 2024-09-12T01:04:32.426 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183064.log 2024-09-12T01:04:32.427 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.148978.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.148978.log.gz 2024-09-12T01:04:32.427 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38791.log 2024-09-12T01:04:32.428 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.183064.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183064.log.gz 2024-09-12T01:04:32.428 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140718.log 2024-09-12T01:04:32.429 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.38791.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.38791.log.gz 2024-09-12T01:04:32.430 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32165.log 2024-09-12T01:04:32.430 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.140718.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.140718.log.gz 2024-09-12T01:04:32.431 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182908.log 2024-09-12T01:04:32.431 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32165.log.gz 2024-09-12T01:04:32.432 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33970.log 2024-09-12T01:04:32.432 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182908.log.gz 2024-09-12T01:04:32.433 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42544.log 2024-09-12T01:04:32.433 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.33970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33970.log.gz 2024-09-12T01:04:32.434 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32709.log 2024-09-12T01:04:32.434 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.42544.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.42544.log.gz 2024-09-12T01:04:32.435 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32316.log 2024-09-12T01:04:32.435 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32709.log.gz 2024-09-12T01:04:32.436 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96462.log 2024-09-12T01:04:32.437 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32316.log.gz 2024-09-12T01:04:32.437 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81709.log 2024-09-12T01:04:32.438 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.96462.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.96462.log.gz 2024-09-12T01:04:32.438 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69797.log 2024-09-12T01:04:32.439 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.81709.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.81709.log.gz 2024-09-12T01:04:32.439 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32302.log 2024-09-12T01:04:32.440 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.69797.log: 54.1% -- replaced with /var/log/ceph/ceph-client.admin.69797.log.gz 2024-09-12T01:04:32.440 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120066.log 2024-09-12T01:04:32.441 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32302.log.gz 2024-09-12T01:04:32.441 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21901.log 2024-09-12T01:04:32.443 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.120066.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.120066.log.gz 2024-09-12T01:04:32.444 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136587.log 2024-09-12T01:04:32.444 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.tmp-client.admin.21901.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21901.log.gz 2024-09-12T01:04:32.445 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132457.log 2024-09-12T01:04:32.445 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.136587.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.136587.log.gz 2024-09-12T01:04:32.446 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53264.log 2024-09-12T01:04:32.447 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.132457.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.132457.log.gz 2024-09-12T01:04:32.447 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55651.log 2024-09-12T01:04:32.448 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.53264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53264.log.gz 2024-09-12T01:04:32.448 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32939.log 2024-09-12T01:04:32.449 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.55651.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.55651.log.gz 2024-09-12T01:04:32.449 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114755.log 2024-09-12T01:04:32.450 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32939.log.gz 2024-09-12T01:04:32.450 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101774.log 2024-09-12T01:04:32.451 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.114755.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.114755.log.gz 2024-09-12T01:04:32.451 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55747.log 2024-09-12T01:04:32.452 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.101774.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.101774.log.gz 2024-09-12T01:04:32.452 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182882.log 2024-09-12T01:04:32.453 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.55747.log: 55.2% -- replaced with /var/log/ceph/ceph-client.admin.55747.log.gz 2024-09-12T01:04:32.453 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74039.log 2024-09-12T01:04:32.454 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182882.log.gz 2024-09-12T01:04:32.454 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180740.log 2024-09-12T01:04:32.455 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.74039.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.74039.log.gz 2024-09-12T01:04:32.455 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180092.log 2024-09-12T01:04:32.456 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.180740.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.180740.log.gz 2024-09-12T01:04:32.457 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115936.log 2024-09-12T01:04:32.457 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.180092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180092.log.gz 2024-09-12T01:04:32.458 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140128.log 2024-09-12T01:04:32.458 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.115936.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.115936.log.gz 2024-09-12T01:04:32.459 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172005.log 2024-09-12T01:04:32.460 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.140128.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.140128.log.gz 2024-09-12T01:04:32.460 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55720.log 2024-09-12T01:04:32.461 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.172005.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.172005.log.gz 2024-09-12T01:04:32.461 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50879.log 2024-09-12T01:04:32.476 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.55720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182856.log 2024-09-12T01:04:32.477 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.50879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50879.log.gz 2024-09-12T01:04:32.479 INFO:teuthology.orchestra.run.smithi138.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55720.log.gz 2024-09-12T01:04:32.479 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62778.log 2024-09-12T01:04:32.480 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182856.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182856.log.gz 2024-09-12T01:04:32.480 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76399.log 2024-09-12T01:04:32.482 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.62778.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62778.log.gz 2024-09-12T01:04:32.482 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182752.log 2024-09-12T01:04:32.483 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.76399.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.76399.log.gz 2024-09-12T01:04:32.484 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56378.log 2024-09-12T01:04:32.484 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.182752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.182752.log.gz 2024-09-12T01:04:32.485 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32310.log 2024-09-12T01:04:32.486 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.56378.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.56378.log.gz 2024-09-12T01:04:32.486 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70424.log 2024-09-12T01:04:32.487 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32310.log.gz 2024-09-12T01:04:32.487 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90559.log 2024-09-12T01:04:32.488 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.70424.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.70424.log.gz 2024-09-12T01:04:32.488 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121836.log 2024-09-12T01:04:32.489 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.90559.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.90559.log.gz 2024-09-12T01:04:32.489 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32753.log 2024-09-12T01:04:32.490 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.121836.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.121836.log.gz 2024-09-12T01:04:32.491 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26696.log 2024-09-12T01:04:32.491 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32753.log.gz 2024-09-12T01:04:32.491 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141898.log 2024-09-12T01:04:32.492 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.26696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26696.log.gz 2024-09-12T01:04:32.493 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88199.log 2024-09-12T01:04:32.493 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.141898.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.141898.log.gz 2024-09-12T01:04:32.494 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91739.log 2024-09-12T01:04:32.494 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.88199.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.88199.log.gz 2024-09-12T01:04:32.495 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37623.log 2024-09-12T01:04:32.496 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.91739.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.91739.log.gz 2024-09-12T01:04:32.496 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94102.log 2024-09-12T01:04:32.497 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.37623.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.37623.log.gz 2024-09-12T01:04:32.497 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180019.log 2024-09-12T01:04:32.498 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.94102.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.94102.log.gz 2024-09-12T01:04:32.498 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43724.log 2024-09-12T01:04:32.499 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.180019.log: 25.1% -- replaced with /var/log/ceph/ceph-client.admin.180019.log.gz 2024-09-12T01:04:32.499 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26936.log 2024-09-12T01:04:32.500 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.43724.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.43724.log.gz 2024-09-12T01:04:32.500 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37039.log 2024-09-12T01:04:32.501 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.26936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26936.log.gz 2024-09-12T01:04:32.501 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36449.log 2024-09-12T01:04:32.502 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.37039.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.37039.log.gz 2024-09-12T01:04:32.502 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97052.log 2024-09-12T01:04:32.503 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.36449.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.36449.log.gz 2024-09-12T01:04:32.503 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65568.log 2024-09-12T01:04:32.504 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.97052.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.97052.log.gz 2024-09-12T01:04:32.504 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72859.log 2024-09-12T01:04:32.505 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.65568.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.65568.log.gz 2024-09-12T01:04:32.505 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44314.log 2024-09-12T01:04:32.506 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.72859.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.72859.log.gz 2024-09-12T01:04:32.507 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160031.log 2024-09-12T01:04:32.507 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.44314.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.44314.log.gz 2024-09-12T01:04:32.508 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124196.log 2024-09-12T01:04:32.512 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.160031.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.160031.log.gz 2024-09-12T01:04:32.513 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75809.log 2024-09-12T01:04:32.513 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.124196.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.124196.log.gz 2024-09-12T01:04:32.514 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183273.log 2024-09-12T01:04:32.514 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.75809.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.75809.log.gz 2024-09-12T01:04:32.515 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62133.log 2024-09-12T01:04:32.515 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.183273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.183273.log.gz 2024-09-12T01:04:32.516 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129507.log 2024-09-12T01:04:32.518 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.62133.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.62133.log.gz 2024-09-12T01:04:32.518 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32511.log 2024-09-12T01:04:32.519 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.129507.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.129507.log.gz 2024-09-12T01:04:32.520 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.159438.log 2024-09-12T01:04:32.520 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32511.log.gz 2024-09-12T01:04:32.521 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117706.log 2024-09-12T01:04:32.522 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.159438.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.159438.log.gz 2024-09-12T01:04:32.522 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78759.log 2024-09-12T01:04:32.523 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.117706.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.117706.log.gz 2024-09-12T01:04:32.523 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160620.log 2024-09-12T01:04:32.524 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.78759.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.78759.log.gz 2024-09-12T01:04:32.524 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157950.log 2024-09-12T01:04:32.525 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.160620.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.160620.log.gz 2024-09-12T01:04:32.525 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85249.log 2024-09-12T01:04:32.526 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.157950.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.157950.log.gz 2024-09-12T01:04:32.527 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32723.log 2024-09-12T01:04:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.85249.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.85249.log.gz 2024-09-12T01:04:32.528 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91149.log 2024-09-12T01:04:32.529 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.32723.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32723.log.gz 2024-09-12T01:04:32.529 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134817.log 2024-09-12T01:04:32.531 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.91149.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.91149.log.gz 2024-09-12T01:04:32.531 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55147.log 2024-09-12T01:04:32.533 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.134817.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.134817.log.gz 2024-09-12T01:04:32.534 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85839.log 2024-09-12T01:04:32.534 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.55147.log: 60.4% -- replaced with /var/log/ceph/ceph-client.admin.55147.log.gz 2024-09-12T01:04:32.535 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112985.log 2024-09-12T01:04:32.535 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.85839.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.85839.log.gz 2024-09-12T01:04:32.536 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100592.log 2024-09-12T01:04:32.537 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.112985.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.112985.log.gz 2024-09-12T01:04:32.537 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169645.log 2024-09-12T01:04:32.538 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.100592.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.100592.log.gz 2024-09-12T01:04:32.538 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154900.log 2024-09-12T01:04:32.539 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.0.169645.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.169645.log.gz 2024-09-12T01:04:32.539 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82889.log 2024-09-12T01:04:32.540 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.154900.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.154900.log.gz 2024-09-12T01:04:32.542 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.82889.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.82889.log.gz 2024-09-12T01:04:32.596 INFO:teuthology.orchestra.run.smithi178.stderr:/var/log/ceph/ceph-osd.4.log: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T01:04:32.812 INFO:teuthology.orchestra.run.smithi178.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T01:04:33.219 INFO:teuthology.orchestra.run.smithi138.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T01:04:33.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-12T01:04:34.543 INFO:teuthology.orchestra.run.smithi138.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T01:04:35.257 INFO:teuthology.orchestra.run.smithi138.stderr: 93.6% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T01:04:41.655 INFO:teuthology.orchestra.run.smithi178.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T01:04:42.053 INFO:teuthology.orchestra.run.smithi178.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T01:04:43.465 INFO:teuthology.orchestra.run.smithi138.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T01:04:43.777 INFO:teuthology.orchestra.run.smithi138.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T01:04:44.978 INFO:teuthology.orchestra.run.smithi138.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T01:04:46.421 INFO:teuthology.orchestra.run.smithi178.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T01:04:51.447 INFO:teuthology.orchestra.run.smithi138.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T01:04:51.448 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-09-12T01:04:51.448 INFO:teuthology.orchestra.run.smithi138.stderr:real 0m19.409s 2024-09-12T01:04:51.448 INFO:teuthology.orchestra.run.smithi138.stderr:user 1m0.070s 2024-09-12T01:04:51.448 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m2.436s 2024-09-12T01:04:52.068 INFO:teuthology.orchestra.run.smithi178.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T01:04:52.070 INFO:teuthology.orchestra.run.smithi178.stderr: 2024-09-12T01:04:52.070 INFO:teuthology.orchestra.run.smithi178.stderr:real 0m19.987s 2024-09-12T01:04:52.070 INFO:teuthology.orchestra.run.smithi178.stderr:user 0m52.997s 2024-09-12T01:04:52.071 INFO:teuthology.orchestra.run.smithi178.stderr:sys 0m2.020s 2024-09-12T01:04:52.071 INFO:tasks.ceph:Archiving logs... 2024-09-12T01:04:52.071 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901837/remote/smithi138/log 2024-09-12T01:04:52.072 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:04:59.191 DEBUG:teuthology.misc:Transferring archived files from smithi178:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901837/remote/smithi178/log 2024-09-12T01:04:59.192 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:05:05.518 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T01:05:05.528 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T01:05:05.529 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:05:05.531 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:05:05.623 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T01:05:05.633 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T01:05:05.633 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:05:05.636 DEBUG:teuthology.orchestra.run.smithi178:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:05:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T01:05:05.646 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2024-09-12T01:05:05.646 INFO:teuthology.orchestra.run.smithi138.stdout:*hv01.front.sepi 67.205.162.81 3 u 73 128 377 0.178 -5.110 0.452 2024-09-12T01:05:05.646 INFO:teuthology.orchestra.run.smithi138.stdout:+hv02.front.sepi 63.231.80.2 3 u 18 128 377 0.213 -4.213 0.196 2024-09-12T01:05:05.646 INFO:teuthology.orchestra.run.smithi138.stdout:+hv03.front.sepi 74.6.168.72 3 u 76 128 377 0.149 -6.061 0.331 2024-09-12T01:05:05.646 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T01:05:05.649 INFO:teuthology.orchestra.run.smithi178.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T01:05:05.649 INFO:teuthology.orchestra.run.smithi178.stdout:============================================================================== 2024-09-12T01:05:05.649 INFO:teuthology.orchestra.run.smithi178.stdout:*hv01.front.sepi 67.205.162.81 3 u 2 64 377 0.119 -2.685 1.820 2024-09-12T01:05:05.649 INFO:teuthology.orchestra.run.smithi178.stdout:+hv02.front.sepi 63.231.80.2 3 u 3 64 377 0.087 -4.090 0.860 2024-09-12T01:05:05.649 INFO:teuthology.orchestra.run.smithi178.stdout:+hv03.front.sepi 74.6.168.72 3 u 4 64 377 0.102 -6.161 0.814 2024-09-12T01:05:05.650 INFO:teuthology.orchestra.run.smithi178.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T01:05:05.650 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T01:05:05.727 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T01:05:05.728 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T01:05:05.759 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T01:05:05.769 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T01:05:05.778 INFO:teuthology.task.internal:Duration was 3612.120768 seconds 2024-09-12T01:05:05.778 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T01:05:05.788 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T01:05:05.788 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:05:05.791 DEBUG:teuthology.orchestra.run.smithi178:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:05:05.831 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T01:05:05.831 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2024-09-12T01:05:05.831 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:05:05.877 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi178.front.sepia.ceph.com 2024-09-12T01:05:05.878 DEBUG:teuthology.orchestra.run.smithi178:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:05:05.888 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T01:05:05.888 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:05:05.925 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:05:05.956 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T01:05:05.956 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:05:05.997 DEBUG:teuthology.orchestra.run.smithi178:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:05:06.057 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T01:05:06.069 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T01:05:06.069 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:05:06.082 DEBUG:teuthology.orchestra.run.smithi178:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:05:06.094 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T01:05:06.106 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:05:06.125 DEBUG:teuthology.orchestra.run.smithi178:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:05:06.133 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2024-09-12T01:05:06.147 INFO:teuthology.orchestra.run.smithi178.stdout:kernel.core_pattern = core 2024-09-12T01:05:06.170 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:05:06.192 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:05:06.192 DEBUG:teuthology.orchestra.run.smithi178:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:05:06.216 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:05:06.217 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T01:05:06.228 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T01:05:06.229 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901837/remote/smithi138 2024-09-12T01:05:06.229 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:05:06.259 DEBUG:teuthology.misc:Transferring archived files from smithi178:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901837/remote/smithi178 2024-09-12T01:05:06.259 DEBUG:teuthology.orchestra.run.smithi178:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:05:06.280 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T01:05:06.280 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:05:06.298 DEBUG:teuthology.orchestra.run.smithi178:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:05:06.326 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T01:05:06.337 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T01:05:06.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T01:05:06.372 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T01:05:06.373 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:05:06.375 DEBUG:teuthology.orchestra.run.smithi178:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:05:06.379 INFO:teuthology.orchestra.run.smithi138.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:05 /home/ubuntu/cephtest 2024-09-12T01:05:06.381 INFO:teuthology.orchestra.run.smithi178.stdout: 658615 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:05 /home/ubuntu/cephtest 2024-09-12T01:05:06.382 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T01:05:06.394 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T01:05:06.476 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{main-tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 3612.120767593384 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T01:05:06.477 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:05:06.576 INFO:teuthology.run:pass